AI Gateway adds unified fast mode support
Quick Answer
AI Gateway introduces a unified fast mode in beta, allowing users to request faster processing for models like 'anthropic/claude-opus-5' by simply setting speed to 'fast'.
Quick Take
This mode enhances performance at a higher cost per token, with fallback to standard speed when necessary.
Key Points
- Fast mode is available for multiple models, enhancing speed and throughput.
- Users can toggle fast mode easily in their API requests with specific settings.
- Fast variants of models typically incur higher costs than their base counterparts.
- Models with no fast tier will default to standard speed upon request.
- Fast mode can be directly accessed using fast slugs in configurations.
Source Excerpt
Fast mode on AI Gateway routes a request to a model's faster serving path for lower latency, set with the gateway. speed option or a fast slug, with automatic fallback to standard speed and per-request speed billing.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from Vercel AI
See more →
The Agent Stack
The Agent Stack by Vercel AI provides essential building blocks for creating production-grade agents, enabling seamless integration across multiple AI models and secure operations. It features components like AI Gateway for model routing, Workflow SDK for durable execution, and Vercel Connect for scoped access, streamlining agent development and deployment across various platforms.
