Skip to main content
Choose Fast for Claude Opus 5.5 or Ultrafast for supported OpenAI models. Each tier has its own prices and uses its provider’s native API.

Fast

Fast mode runs the same Claude Opus 5.5 model with up to 2.5× higher output tokens per second. It changes inference speed, not model capabilities. Time to first token may not improve by the same amount. The gateway offers Fast only for anthropic/claude-opus-5-5, through Anthropic’s own API. It skips Azure Foundry, including when Foundry normally serves the model first. Fast is not available through the gateway’s Azure deployments or the Batch API.

Request Fast

Use service_tier: "fast" on Chat Completions and Responses, or speed: "fast" on Messages. Streaming and tools work on all three endpoints. Send the control on every request in a tool loop.
Chat also accepts the older providerOptions.anthropic.speed spelling. It goes through the same validation, routing and billing. If both spellings are set, they must agree. Speed controls in other provider buckets and per-fallback speed overrides return 400. On Messages, speed: "standard" is a no-op. service_tier belongs to Anthropic’s separate Priority Tier contract; it does not enable Fast on that endpoint.

Fast prices and delivered speed

Prices per million tokens, USD, passed through without margin: These rates apply across the full context window. Anthropic’s cache multipliers apply to Fast input prices: Opus 5.5 reads cost 0.05×, 5m writes 1.25× and 1h writes 2×. Switching between Fast and standard invalidates the prompt cache; speeds do not share cached prefixes. The balance check uses Fast rates. Promotional and negotiated standard prices do not apply to Fast. GET /v1/models lists standard prices only. Chat Completions and Responses report the delivered speed in service_tier. In streams it arrives on terminal chunks or the completed/incomplete response event, with final usage. Messages reports usage.speed when a speed control was supplied and the provider reported fast or standard; in a stream, check message_delta.usage.speed. The gateway never fills in delivered speed from the request. An absent Messages value stays absent; an unreported Chat or Responses tier is null. Requested, delivered and billed tiers appear in the request log. With an Anthropic BYOK key, Fast uses your key and deducts 0 credits from both gateway ledgers. Your Anthropic account pays the provider’s rates. Azure and Bedrock credentials do not serve Fast.

Fast errors and fallback

  • Unsupported model: 400, naming anthropic/claude-opus-5-5 as the supported model.
  • An incompatible x-impossibl-deployment pin: 400; a Foundry pin never silently overrides Fast.
  • Insufficient balance at Fast rates: 402.
  • No native Anthropic route configured: 503.
  • Anthropic Fast capacity or rate limit (429/529): the gateway uses its existing upstream error mapping (502 before streaming, an error event after streaming starts). It never retries at standard speed or on Foundry. See errors.
Your application can explicitly choose a standard-speed fallback. For example, using the Anthropic SDK and the gateway’s current error mapping:

Ultrafast

Ultrafast is OpenAI’s low-latency processing tier for selected models. Ask for it with the top-level service_tier field on Chat Completions or Responses. It costs more than standard processing, so use it where response time matters and keep standard processing elsewhere.

Make a request

With the OpenAI Python SDK, pass the same field:
service_tier accepts: Use the top-level field. Older Chat Completions requests that set providerOptions.openai.serviceTier are treated as the same field, with the same accepted values; if both are set they must match.

Which tier served the request

When a request sets service_tier, the response reports the tier OpenAI says it actually used, which can differ from the one you asked for: The gateway never fills this field in from your request: null means the provider did not say. Because the gateway cannot confirm a downgrade in that case, the request is billed at the Ultrafast rate you asked for. Requests that do not set service_tier keep their usual response shape, without the field. Where the field appears:
  • Chat Completions: on the completion object; when streaming, on the final chunk with finish_reason and on the usage chunk (stream_options.include_usage). Earlier chunks do not carry it.
  • Responses: on the response object; when streaming, on the response.completed or response.incomplete event. response.created and response.in_progress do not carry it.
The delivered tier is known only when generation finishes, so it arrives together with the final usage. If a stream fails after it has started, you receive the stream error event instead and no tier is reported for it. The request log records the requested, delivered, and billed tier on the attempt that served the request.

Routing

Ultrafast is served only through OpenAI’s own API. Some models, such as openai/gpt-6.1-sol, are normally served by other hosts first; an Ultrafast request skips them. If OpenAI fails the request, the gateway does not retry it on another host or at the standard tier. You get an error, and you decide whether to resend without service_tier. See routing and failover. Tool calling, streaming, reasoning controls and multi-turn tool results work as they do for standard requests. Send service_tier on each request in a tool loop; it is not remembered between requests.

Pricing

Ultrafast rates are higher than standard rates: currently 6× each standard rate. Prices per million tokens, USD: As with standard long-context tiers (see how request costs are calculated), a request with more than 272,000 input tokens is billed entirely at the higher row, not only the tokens past the threshold. GET /v1/models lists standard rates; Fast and Ultrafast rates are not in the catalog listing.
  • The balance check before generation uses Ultrafast rates. A balance that covers a standard request can return 402 for the same request at Ultrafast.
  • Negotiated workspace rates and promotional prices apply to standard processing only. Ultrafast requests are billed at the rates above.
  • openai/gpt-6-astra requires purchased credits, as for standard requests.
Latency depends on the prompt, output length and current provider load. Measure it on your own workload before relying on a particular speedup.

With your own OpenAI key

If you added an OpenAI BYOK credential, Ultrafast requests use it and deduct 0 credits, as with any BYOK request. Your OpenAI organization must have access to Ultrafast for the model; if OpenAI refuses, you get its error and the request is not retried on the gateway’s credentials. Azure, Azure Foundry and Bedrock credentials never serve Ultrafast requests.

Errors

See error handling for retry guidance.