Nemotron 3.5 Lightning now available on AI Gateway for free
Quick Answer
NVIDIA's Nemotron 3.5 Lightning is now available for free on AI Gateway, featuring 30B parameters and a hybrid Mixture-of-Experts design.
Quick Take
This model supports long-running agents, chatbots, and systems, with a 1M token context window and capabilities.
Key Points
- Nemotron 3.5 Lightning is an open-weight reasoning and chat model.
- It features a hybrid Mixture-of-Experts design with Mamba-2 and MoE layers.
- The model supports a 1M token context window and structured outputs.
- AI Gateway allows for unified API access and usage tracking.
- No platform fees are charged on inference, including BYOK requests.
📖 Reader Mode
~1 min readNemotron 3.5 Lightning from NVIDIA is now available for free on AI Gateway as nvidia/nemotron-3.5-lightning-free, served by NVIDIA.
Nemotron 3.5 Lightning is an open-weight reasoning and chat model for long-running agents, sub-agent work, chatbots, and RAG systems. The model has 30B parameters with 3B active per token, in a hybrid Mixture-of-Experts design that interleaves Mamba-2 and MoE layers with a few attention layers. It has a 1M token context window and supports tool calling and structured outputs.
Note: The provider may retain prompts for model improvement.
Call Nemotron 3.5 Lightning through the AI SDK, the Chat Completions, Responses, and Messages APIs, or a coding agent connected to AI Gateway.
Use nvidia/nemotron-3.5-lightning-free as the model name:
To use it in Claude Code, Codex, Cursor, and more, install the latest Vercel CLI and run setup:
npx vercel ai-gateway setup
Then select nvidia/nemotron-3.5-lightning-free in the agent. See the coding agents guide for details.
AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, budgets for API keys, routing rules, and more.
AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests.
You can view all language models available on AI Gateway.
— Originally published at vercel.com
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from Vercel AI
See more →
The Agent Stack
The Agent Stack by Vercel AI provides essential building blocks for creating production-grade agents, enabling seamless integration across multiple AI models and secure operations. It features components like AI Gateway for model routing, Workflow SDK for durable execution, and Vercel Connect for scoped access, streamlining agent development and deployment across various platforms.
