Skip to content

Rate limits

Updated 2026-10-29.

Every limit returns an error code. Retryable errors include a Retry-After header (seconds).

Limits

LimitValueErrorReset
Calls per key200 per UTC day (default)429 daily_limit00:00 UTC
Tokens per member300,000 per UTC day429 daily_tokens00:00 UTC
Open calls per member64429 too_many_streamscall end
Open calls, all keys96503 device_busycall end
Request body32 MB413 too_largenone
Non-streamed responseabout 100 s524none
Tokens per requestcontext_length400none
Model load wait15 min503 model_loadingnone
GPU queue wait900 s503 gpu-busynone

Member limits apply to the session routes. context_length is per model, in GET /v1/models. Open calls count toward the daily call limit. GET /v1/models does not count. Keys have no token limit.

Usage

Citadel does not return the remaining call count. A 429 daily_limit response includes limit and used.

Recommendations

  • Set max_tokens on every request.
  • Use the loaded model. A model switch takes 2 to 5 minutes.
  • Limit concurrency to 64 on qwen3.8-27b. Requests above 64 wait in the engine.
  • For a higher daily limit, ask the owner of albastov.com.