# OpenMOSS-Team/MOSS-SoundEffect — vLLM serving recipe

> OpenMOSS's 8B sound-effect generation model — environmental, urban, biological, human-action and musical sounds with controllable duration, no reference audio — served via vLLM-Omni through the OpenAI /v1/audio/speech API (24 kHz mono).

Configuration: hardware `h200` (8× H200) · variant `default` (BF16) · task `t2a`

- Interactive page: https://recipes.vllm.ai/OpenMOSS-Team/MOSS-SoundEffect
- This configuration as JSON: https://recipes.vllm.ai/OpenMOSS-Team/MOSS-SoundEffect.json?hardware=h200

The commands below were rendered for exactly this configuration and take precedence over any example in the guide.

## Other configurations

Change the query string (the same parameters as the page URL) and fetch this URL again. Unknown or incompatible values fall back to the recipe default, so check the Configuration line.

- `hardware`: `h100`, `h200`, `b200`, `gb200`, `b300`, `gb300`, `mi300x`, `mi325x`, `mi350x`, `mi355x`
- `variant`: `default`
- `task`: `t2a`

## Install

Requires vLLM >= 0.22.0.

```bash
uv venv
source .venv/bin/activate
uv pip install -U vllm --torch-backend auto
```

Extra dependencies:

- vLLM-Omni provides the audio serving backend and the `--omni` serve path. See the installation guide for pre-built wheels or building from source.

```bash
uv pip install git+https://github.com/vllm-project/vllm-omni.git
```

## Serve

vLLM-Omni recipe — the generation endpoints and request examples are in the guide below.

```bash
vllm serve OpenMOSS-Team/MOSS-SoundEffect \
  --deploy-config vllm_omni/deploy/moss_sound_effect.yaml \
  --omni
```

## Guide

> Background reference. Commands in it are examples and may target another configuration — use the Serve section above.

### Overview

[MOSS-SoundEffect](https://huggingface.co/OpenMOSS-Team/MOSS-SoundEffect) is the
**sound-effect generation** member of OpenMOSS's MOSS-TTS Family, served through
**vLLM-Omni** with the OpenAI-compatible `/v1/audio/speech` API. It generates
audio for natural environments, urban scenes, biological sounds, human actions,
and musical fragments — suitable for film, games, and interactive experiences.
Output is **24 kHz mono**.

Unlike the speech members of the family, MOSS-SoundEffect takes **no reference
audio**: the `input` field is a text description of the sound (mapped to the
upstream `ambient_sound` parameter). Generation runs at ~12.5 tokens/second;
longer descriptions (or a higher token budget) produce longer audio.

### Prerequisites

- **Hardware**: a single CUDA GPU comparable to the 8B MOSS-TTS profile
  (~18 GB talker + ~8 GB codec).
- **vLLM-Omni** targeting vLLM >= 0.22.

### Installation

```bash
uv venv && source .venv/bin/activate
uv pip install git+https://github.com/vllm-project/vllm-omni.git
```

### Launch the server

MOSS-SoundEffect shares `model_type=moss_tts_delay`, so pass its deploy config
explicitly:

```bash
vllm serve OpenMOSS-Team/MOSS-SoundEffect --omni \
  --deploy-config vllm_omni/deploy/moss_sound_effect.yaml --port 8000
```

### Client usage

```bash
curl -X POST http://localhost:8000/v1/audio/speech \
  -H "Content-Type: application/json" \
  -d '{
    "model": "OpenMOSS-Team/MOSS-SoundEffect",
    "input": "Thunder rumbling, rain pattering on a tin roof.",
    "response_format": "wav"
  }' --output thunder.wav
```

### Known limitations

- Output is **24 kHz mono**.
- No `ref_audio` is accepted; `input` is a text description of the sound.

### References

- [Model card](https://huggingface.co/OpenMOSS-Team/MOSS-SoundEffect)
- [MOSS-TTS Family](https://huggingface.co/OpenMOSS-Team/MOSS-TTS) · [GitHub](https://github.com/OpenMOSS/MOSS-TTS)