vLLM/Recipes

NVIDIA

nvidia·11 recipesHuggingFace

Multimodal

2
Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16
31B / 3B
moe
BF1675GFP838GNVFP428G
v0.20.0+→
NVIDIA-Nemotron-Nano-12B-v2-VL-BF16
12B
dense
BF1629GFP814GNVFP48G
v0.11.1+→

Text

5
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16
550B / 55B
moe
BF161320GNVFP4330G
v0.22.0+→
NVIDIA-Nemotron-3-Super-120B-A12B-BF16
120B / 12B
moe
BF16298GFP8149GNVFP475GBF16298G
v0.17.1+→
NVIDIA-Nemotron-3-Nano-4B-BF16
4B
dense
BF1610GFP85G
v0.11.2+→
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16
30B / 3B
moe
BF1672GFP835G
v0.11.2+→
NVIDIA-Nemotron-Nano-9B-v2
9B
dense
BF1622GFP811GNVFP46GBF1622GBF1622G
v0.10.1+→

Omni

4
Cosmos3-Super-Text2Image
64B
dense
BF16154G
v0.21.0+→
Cosmos3-Super-Image2Video
64B
dense
BF16154G
v0.21.0+→
Cosmos3-Nano
16B
dense
BF1639G
v0.21.0+→
Cosmos3-Super
64B
dense
BF16154G
v0.21.0+→