Try LFM • Docs • LEAP • Discord 🇯🇵 LFM2.5 1.2B JP 202606 LFM2.5 1.2B JP 202606 is our latest general purpose Japanese chat model, delivering significant improvements in knowledge, instruction following, math, code, and tool use over both the models of comparable size and LFM2.5 1.2B JP. It sets a new benchmark for state of the art performance in Japanese language understanding. Ideal for developers building Japanese language applications where cultural and linguistic nuance matter. LFM2.5 1.2B JP 202606 は、当社の最新の汎用日本語チャットモデルです。知識、指示追従、数学、コード、ツール使用の各領域において、同規模の他モデルおよび LFM2.5 1.2B JP の双方を大幅に上回る改善を実現しています。日本語全般における最高水準のベンチマーク性能を発揮します。 文化的・言語的なニュアンスが重要となる日本語アプリケーションを構築する開発者に最適です。 Find more information about LFM2.5 in our blog post. 📊 Performance We compared LFM2.5 1.2B JP 202606 with relevant sub 2B models on a diverse suite of benchmarks. Model Size Knowledge Instruction Following Math Code Tool Use Domain Avg JMMLU‑ProX JMMLU JCulture JGPQA Avg J‑MIFEval JFBench 1 Avg J‑GSM8K J‑MATH500 Avg JHumanEval+ J‑BFCLv3 2 LFM2.5‑1.2B‑JP‑202606 1.2B 36.23 54.19 35.77 28.69 38.72 79.08 54.77 66.93 62.20 62.80 62.50 49.39 48.00 53.11 LFM2.5‑1.2B‑Instruct 1.2B 31.42 47.61 28.42 31.72 34.79 40.44…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy