WebSocket support for OpenAI Responses API live on AI Gateway
Quick Answer
AI Gateway now supports WebSocket for the OpenAI Responses API, enabling persistent connections that enhance performance by up to 40% for agentic rollouts with multiple tool calls.
Quick Take
Developers can send incremental inputs with previous response IDs instead of full context, streamlining interactions.
Key Points
- WebSocket mode allows persistent connections for OpenAI Responses API.
- Up to 40% faster execution for agentic rollouts with 20+ tool calls.
- Responses route available at GET /v1/responses over WebSocket.
- Compatible with store=false and Zero Data Retention settings.
- Documentation provides setup instructions and full route list.
Source Excerpt
AI Gateway now supports WebSocket mode for the OpenAI Responses API, with persistent connections, previous_response_id continuation, and realtime voice sessions.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from Vercel AI
See more →
The Agent Stack
The Agent Stack by Vercel AI provides essential building blocks for creating production-grade agents, enabling seamless integration across multiple AI models and secure operations. It features components like AI Gateway for model routing, Workflow SDK for durable execution, and Vercel Connect for scoped access, streamlining agent development and deployment across various platforms.
