vLLM on X: "🚀 Qwen3.6-27B-NVFP4 is inference ready with vLLM on NVIDIA Blackwell GPUs. This checkpoint is optimized for Blackwell and reduces GPU memory requirements by ~2.5x for local AI with open-source models. 🧠 27B params, Hybrid Attention 📊 NVFP4 evals: 86.3 on MMLU Pro, 85.5 on" / X
Quick Answer
Qwen3.6-27B-NVFP4 is now inference-ready on NVIDIA Blackwell GPUs, optimizing GPU memory usage by ~2.5x for local AI.
Quick Take
With 27 billion parameters and hybrid attention, it achieves 86.3 on Pro and 85.5 on , exclusively supported by vLLM.
Key Points
- Optimized for NVIDIA Blackwell GPUs, enhancing local AI performance.
- Reduces GPU memory requirements by approximately 2.5x.
- Achieves 86.3 on MMLU Pro and 85.5 on GPQA Diamond benchmarks.
- Exclusively supported on vLLM as the runtime engine.
- Available on Hugging Face for easy access to open-source models.
📖 Reader Mode
~1 min read🚀 Qwen3.6-27B-NVFP4 is inference ready with vLLM on NVIDIA Blackwell GPUs. This checkpoint is optimized for Blackwell and reduces GPU memory requirements by ~2.5x for local AI with open-source models. 🧠 27B params, Hybrid Attention 📊 NVFP4 evals: 86.3 on MMLU Pro, 85.5 on GPQA Diamond 🛠️ Exclusively supported on vLLM as the runtime engine Get started from the Hugging Face checkpoint: huggingface.co/nvidia/Qwen3.6…
Fast, efficient local AI with open-source models just got easier. Qwen3.6-27B-NVFP4 is now on
@huggingface! It's optimized for NVIDIA Blackwell GPUs & inference ready with
@vllm_project. The checkpoint reduces GPU memory requirements by approximately 2.5x for powerful
— Originally published at x.com
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from WebSearch (Tavily)
See more →全球AI芯片峰会，9月上海见！
The 2026 Global AI Chip Summit will take place in Shanghai on September 22-23, focusing on the evolving AI chip landscape, including the shift from training to inference, the rise of diverse chip technologies, and the restructuring of industry competition. Notable speakers include experts from leading universities and companies, discussing advancements in AI chip architecture and applications.