Browse Docs GitHub

Providers

Seed (ByteDance)

LongCat (Meituan)

Llama-4-Scout-17B-16E-Instruct Llama-3.3-70B-Instruct Llama-3.1-8B-Instruct

MiniCPM (OpenBMB)

InternVL (OpenGVLab)

Preferred Networks

Hunyuan (Tencent)

Thinking Machines Lab

Meta

meta-llama·3 recipesHuggingFace

Text

3

Llama-4-Scout-17B-16E-Instruct

BF16262GFP8131GNVFP465G

Llama-3.3-70B-Instruct

BF16170GFP884GNVFP442G

Llama-3.1-8B-Instruct

BF1620GNVFP45GFP810G

GitHub Request a recipe Documentation Supported Models & Hardware Install vLLM JSON API