Summary This is a LLaMA 3 Youko qlora fine tune, created using a new version of the VNTL dataset. The purpose of this fine tune is to improve performance of LLMs at translating Japanese visual novels to English. Unlike the previous version, this one doesn't includes the "chat mode". Notes For this new version of VNTL 8B, I've rebuilt and expanded VNTL's dataset from the groud up, and I'm happy to say it performs really well, outperforming the previous version when it comes to accuracy and stability, it makes far fewer mistakes than it even when running at high temperatures (though I still recommend temperature 0 for the best accuracy). Some major changes in this version: Switched to the default LLaMA3 prompt format since people had trouble with the custom one Added proper support for multi line translations (the old version only handled single lines) Overall better translation accuracy One thing to note: while the translations are more accurate, they tend to be more literal compared to the previous version. Sampling Recommendations For optimal results, it's highly recommended to use neutral sampling parameters (temperature 0 with no repetition penalty) when using this model. Traini…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy