Mainstream Models Supported by xLLM

LLM

ModelNPUMLUILU
DeepSeek-V3/R1/V3.1✅✅—
DeepSeek-V3.2✅✅—
DeepSeek-R1-Distill-Qwen✅——
Qwen2/2.5/QwQ✅✅✅
Qwen3✅✅✅
Qwen3 MoE✅✅✅
Kimi-k2✅——
Llama2/3✅—✅
GLM 4.5 / 4.6 / 4.7 / 5✅——

VLM

ModelNPUMLUILU
MiniCPM-V✅——
MiMo-VL✅——
Qwen2.5-VL✅✅—
Qwen3-VL✅✅—
Qwen3-VL-MoE✅✅—
GLM-4.6V✅——
VLM-R1✅——

DiT

ModelNPUMLUILU
Flux✅——

Rec

ModelNPUMLUILU
OneRec✅——
Qwen2 (Rec)✅——
Qwen2.5 (Rec)✅——
Qwen3 (Rec)✅——

Rerank

ModelNPUMLUILU
Qwen3-Reranker✅——