Nanbeige4.2 3B GGUF Quantizations GGUF quantized versions of Nanbeige4.2 3B. Original Model Card See the original model card for details on how to use with llama.cpp and ollama (you'll need to build from their fork cause their changes didn't land in llama.cpp main yet). Why Ollama is Bad 👎 (needs to be put down somewhere) 1. @ngxson https://github.com/ollama/ollama/issues/11714 issuecomment 3174632621 "Some of llama.cpp maintainers even have to work during their vacations just to have someone else copy their work without giving any credits." 2. @mudler https://github.com/ollama/ollama/issues/11714 issuecomment 3175288625 "it would have been much better if all projects that depend on @ggerganov's and the ggml team work would have upstreamed the contributions directly so anyone in the ecosystem could benefit, and avoid vendor lock in and the duplicated efforts everywhere... consuming llama.cpp and reporting issues and upstream any change directly there. It is quite frustrating to see that the Open source scene is really getting derailed lately by this kind of bad attitude." 3. @pwilkin https://github.com/ollama/ollama/issues/11714 issuecomment 3175999505 "If you build upon a technol…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy