1sec.ai

Tag

#gguf

Every item tagged gguf, newest first.

2 items

Nex-N2 Pro is the real deal

The Nex-N2 Pro model, a rebranded version of Rio-3.5, has shown promising performance in local deployment tests. The model is a merge of N2 with the Qwen base model. Initial tests were hindered by bugs in the embedded GGUF chat template, but the issue was resolved. You can now run Nex-N2 Pro with bartowski's IQ2_S GGUFs.

Key takeaways
  • Nex-N2 Pro is a merge of N2 and Qwen base models.
  • Initial tests were hindered by bugs in the GGUF chat template.
  • bartowski's IQ2_S GGUFs enable successful deployment.