Updates on North Mini Code: 4 bit quant + Ollama + OpenRouter
North Mini Code now has a 4-bit quantized version available on Hugging Face, enabling local runs on lower-end hardware like Macs with 20GB of RAM. The model is also supported on Ollama and OpenRouter API, expanding deployment options for builders. This update addresses user feedback on portability and accessibility. You can now run North Mini Code locally or via API without major resource constraints.
Key takeaways
- 4-bit quantization available for North Mini Code on Hugging Face
- Supported on Ollama and OpenRouter API for expanded deployment
- Local runs require at least 20GB RAM
North Mini Code now has a 4-bit quantized version available on Hugging Face, enabling local runs on lower-end hardware like Macs with 20GB of RAM. The model is also supported on Ollama and OpenRouter API, expanding deployment options for builders. This update addresses user feedback on portability and accessibility. You can now run North Mini Code locally or via API without major resource constraints.
Key takeaways
- 4-bit quantization available for North Mini Code on Hugging Face
- Supported on Ollama and OpenRouter API for expanded deployment
- Local runs require at least 20GB RAM