vLLM/Recipes
Search
IFM

IFM/K2-Horizon-7B

Dense model for long-context research, fine-tuning, and cost-conscious deployment

9B stored parameters including embeddings, with up to 512K context

View on HuggingFace
dense9B524,288 ctxvLLM +text
Default configuration: 8× H200 · Tensor Parallel · BF16
vllm serve IFM/K2-Horizon-7B \
  --trust-remote-code \
  --chat-template-content-format string \
  --dtype bfloat16 \
  --tensor-parallel-size 1 \
  --reasoning-parser k2_horizon \
  --enable-auto-tool-choice \
  --tool-call-parser k2_horizon

The interactive builder loads with JavaScript. Append .md to this page's URL, query string included, for any configuration's command as Markdown — e.g. /IFM/K2-Horizon-7B.md.

Guide

Overview

K2-Horizon-7B is a compact dense model in the IFM K2-Horizon family, with 9B stored parameters including embeddings and support for up to 524,288 tokens of context.

K2-Horizon is an open-weight IFM model family built for transparent foundation-model research, staged checkpoint analysis, and practical deployment. The series spans compact dense models such as K2-Horizon-7B for local experimentation, dense mid-size and large models for high-quality research workloads, and mixture-of-expert (MoE) models for higher-capacity serving.

Launch Commands

vllm serve IFM/K2-Horizon-7B \
  --trust-remote-code \
  --chat-template-content-format string \
  --dtype bfloat16 \
  --reasoning-parser k2_horizon \
  --enable-auto-tool-choice \
  --tool-call-parser k2_horizon

Client usage

from openai import OpenAI

client = OpenAI(
    api_key="EMPTY", base_url="http://localhost:8000/v1", timeout=3600
)

resp = client.chat.completions.create(
    model="IFM/K2-Horizon-7B",
    messages=[{"role": "user", "content": "Give me three primes above 100."}],
    temperature=1.0, top_p=0.95, max_tokens=2048,
)
print(resp.choices[0].message.content)

Thinking modes

The model supports selectable thinking through chat_template_kwargs, per request or server-wide via --default-chat-template-kwargs:

  • {"reasoning_effort": "high"} — full thinking (default).
  • {"reasoning_effort": "medium"} — faster thinking.
  • {"reasoning_effort": "low"} — fastest thinking.

References