vLLM/Recipes

DeepSeek

deepseek-ai·7 recipesHuggingFace

Multimodal

2
DeepSeek-OCR-2
3B
dense
BF167G
v0.12.0+→
DeepSeek-OCR
3B
dense
BF167G
v0.12.0+→

Text

5
DeepSeek-V3.2
671B / 37B
moe
FP8805GNVFP4403G
v0.18.0+→
DeepSeek-V3.2-Exp
671B / 37B
moe
FP8805G
v0.12.0+→
DeepSeek-V3.1
671B / 37B
moe
FP8805GNVFP4403G
v0.12.0+→
DeepSeek-R1
671B / 37B
moe
FP8805GFP8805GNVFP4403G
v0.12.0+→
DeepSeek-V3
671B / 37B
moe
FP8805GFP4403G
v0.12.0+→