Inkling from Thinking Machines is now available on AI Gateway
Quick Answer
Inkling from Thinking Machines is now accessible on AI Gateway, offering a versatile model for various tasks including reasoning and coding.
Quick Take
Inkling from Thinking Machines is now accessible on AI Gateway, offering a versatile model for various tasks including reasoning and coding. Users can easily implement it via the AI SDK with no additional platform fees on inference, ensuring cost-effective usage.
Key Points
- Inkling is a generalist model trained across multiple task domains.
- Users can set the model to 'thinkingmachines/inkling' in the AI SDK.
- AI Gateway offers a unified API for model usage tracking and performance optimization.
- No markup on provider pricing; no platform fees for inference.
- AI Gateway features a leaderboard to track popular models by usage.
📖 Reader Mode
~1 min readInkling from Thinking Machines is now available on AI Gateway.
Inkling is a broad generalist model, trained across agentic, reasoning, coding, instruction-following, factuality, vision, and audio tasks rather than optimized for a single domain. The model also supports controllable thinking effort.
To use Inkling, set model to thinkingmachines/inkling in the AI SDK:
import { streamText } from 'ai';
const result = streamText({
model: 'thinkingmachines/inkling',
prompt: 'Summarize this report and list the key risks.',
});
AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more.
AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests.
Try Inkling in the model playground.
AI Gateway: Track top AI models by usage
The AI Gateway model leaderboard tracks the most popular models over time, ranking them by the total volume of tokens processed across all Gateway traffic.
View the leaderboard
— Originally published at vercel.com
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from Vercel AI
See more →
The Agent Stack
The Agent Stack by Vercel AI provides essential building blocks for creating production-grade agents, enabling seamless integration across multiple AI models and secure operations. It features components like AI Gateway for model routing, Workflow SDK for durable execution, and Vercel Connect for scoped access, streamlining agent development and deployment across various platforms.
