Inkling Small from Thinking Machines is now available on AI Gateway
Quick Answer
Inkling Small from Thinking Machines is now available on AI Gateway, offering performance similar to larger models at a quarter of the size.
Quick Take
It excels in reasoning, coding, and image processing while allowing users to control the trade-off between quality, cost, and latency. This model is also compatible with Zero Data Retention for enhanced privacy.
Key Points
- Inkling Small achieves comparable performance to larger models with reduced compute requirements.
- Supports advanced reasoning, coding, and image processing tasks effectively.
- Users can adjust reasoning effort to balance quality, cost, and latency.
- Compatible with Zero Data Retention for enhanced privacy settings.
- AI Gateway offers no markup on provider pricing and no platform fees.
DeepSignal Analysis
What happened
Thinking Machines has released Inkling Small on AI Gateway, a model that offers performance similar to its larger counterpart while being significantly smaller in size. This model is designed for various tasks, including reasoning, coding, and image processing, and allows users to adjust the balance between quality, cost, and latency. Additionally, it supports Zero Data Retention for enhanced privacy.
Key evidence
- Inkling Small achieves performance comparable to the larger Inkling model while being about a quarter of its size, using less compute per task.
- The model is capable of performing reasoning over audio and images, and it can execute tasks such as cropping and inspecting images programmatically.
- Inkling Small is compatible with Zero Data Retention, allowing users to ensure that prompts and responses are deleted after each request.
Why it matters
The introduction of Inkling Small could provide a more accessible option for users needing AI capabilities without the resource demands of larger models. Its ability to balance quality, cost, and latency makes it suitable for a range of applications, particularly in coding and image processing. Moreover, the Zero Data Retention feature addresses growing concerns about data privacy, making it a more appealing choice for organizations focused on compliance and security.
Source Excerpt
Inkling-Small from Thinking Machines is now available on AI Gateway, an efficient open-weights multimodal Mixture-of-Experts model with a 1M token context window and controllable thinking effort.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from Vercel AI
See more →
The Agent Stack
The Agent Stack by Vercel AI provides essential building blocks for creating production-grade agents, enabling seamless integration across multiple AI models and secure operations. It features components like AI Gateway for model routing, Workflow SDK for durable execution, and Vercel Connect for scoped access, streamlining agent development and deployment across various platforms.
