Meet ‘North Mini Code’: Cohere’s 30B Open-Weight Mixture-of-Experts Model With 3B Active Parameters for Agentic Coding
Quick Answer
Cohere has launched 'North Mini Code', a 30B mixture-of-experts model with 3B active parameters, optimized for coding tasks.
Quick Take
This model operates on a single H100 GPU and supports a context length of 256K, marking a significant advancement in agentic coding capabilities.
Key Points
- North Mini Code features 30 billion parameters with 3 billion active for coding.
- The model runs on a single H100 GPU, showcasing efficient resource usage.
- Supports an impressive context length of 256K for enhanced coding tasks.
- This launch positions Cohere as a competitive player in developer tools.
Source Excerpt
Cohere's first developer coding model is a 30B mixture-of-experts running on a single H100 with 256K context length. The post Meet ‘North Mini Code’: Cohere’s 30B Open-Weight Mixture-of-Experts Model With 3B Active Parameters for Agentic Coding appeared first on MarkTechPost.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from MarkTechPost
See more →Meet Flash-KMeans: An IO-Aware, Exact K-Means That Runs Over 200× Faster Than FAISS on GPUs
Flash-KMeans is an open-source, IO-aware k-means implementation that operates over 200× faster than FAISS on NVIDIA H200 GPUs. It achieves 17.9× end-to-end and 33× speedup over cuML by optimizing distance calculations and updating mechanisms without approximating results. This advancement significantly enhances performance for data scientists and machine learning practitioners.
