Streaming - Orbit

Pass "stream": true to get tokens as they generate. Buffered JSON is the default. Streaming uses the same auth, model slugs, and credit billing as a non-streamed call. The HTTP timeout on inference routes is long enough for a multi-minute completion.

OpenAI

curl https://api.tryorbit.cloud/api/v1/chat/completions \
  -H "Authorization: Bearer $ORBIT_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "claude-sonnet-5",
    "messages": [{ "role": "user", "content": "Hello!" }],
    "stream": true
  }'

The official OpenAI SDK exposes the same flag as stream=True / stream: true.

Anthropic

curl https://api.tryorbit.cloud/api/v1/messages \
  -H "x-api-key: $ORBIT_API_KEY" \
  -H "anthropic-version: 2023-06-01" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "claude-sonnet-5",
    "max_tokens": 1024,
    "messages": [{ "role": "user", "content": "Hello!" }],
    "stream": true
  }'

Native Orbit API

curl https://api.tryorbit.cloud/api/v1/models/claude-sonnet-5/chat \
  -H "Authorization: Bearer $ORBIT_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "messages": [{ "role": "user", "content": "Hello!" }],
    "stream": true
  }'

The dashboard playground always streams.

⌘I