Grok Voice Think Fast 2.0 now available on AI Gateway
Quick Answer
Grok Voice Think Fast 2.0 by xAI is now available on AI Gateway, featuring enhanced reasoning, transcription accuracy, and real-time conversation capabilities.
Quick Take
This speech-to-speech model processes queries without latency and requires fewer reasoning tokens, improving response times. It performs well even in challenging audio conditions, making it suitable for various applications.
Key Points
- Grok Voice Think Fast 2.0 improves on its predecessor in reasoning and transcription accuracy.
- The model processes speech queries in parallel, eliminating latency during conversations.
- It requires fewer reasoning tokens, allowing for quicker tool calls.
- Transcription holds up well in noisy environments and with telephony compression.
- Accessible via the AI SDK's realtime API for voice agent development.
📖 Reader Mode
~1 min readGrok Voice Think Fast 2.0 from xAI is now available on AI Gateway. It is a speech-to-speech voice model that takes audio in and audio out, improving on the previous Grok Voice model in reasoning, transcription accuracy, and conversation.
The model reasons in parallel with speech, so it can think through a query while talking without adding latency. It has also been trained to use fewer reasoning tokens than before, so tool calls fire sooner, often before the end of the agent's first sentence. Transcription holds up in real-world conditions, including background noise and telephony compression.
Use xai/grok-voice-think-fast-2.0 through the AI SDK's realtime API. Mint a short-lived token on the server so your API key never reaches the client:
app/api/realtime/token/route.ts
import { gateway } from "@ai-sdk/gateway";
export async function POST() {
const { token, url } = await gateway.experimental_realtime.getToken({
model: "xai/grok-voice-think-fast-2.0",
});
return Response.json({ token, url, tools: [] });
}
See the realtime documentation to build a voice agent with Grok Voice Think Fast 2.0. Try out the model in the AI Gateway playground.
— Originally published at vercel.com
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from Vercel AI
See more →
The Agent Stack
The Agent Stack by Vercel AI provides essential building blocks for creating production-grade agents, enabling seamless integration across multiple AI models and secure operations. It features components like AI Gateway for model routing, Workflow SDK for durable execution, and Vercel Connect for scoped access, streamlining agent development and deployment across various platforms.
