OpenCALM 3B Model Description OpenCALM is a suite of decoder only language models pre trained on Japanese datasets, developed by CyberAgent, Inc. Usage Model Details Model Params Layers Dim Heads Dev ppl : : : : : : : : : : : : cyberagent/open calm small 160M 12 768 12 19.7 cyberagent/open calm medium 400M 24 1024 16 13.8 cyberagent/open calm large 830M 24 1536 16 11.3 cyberagent/open calm 1b 1.4B 24 2048 16 10.3 cyberagent/open calm 3b 2.7B 32 2560 32 9.7 cyberagent/open calm 7b 6.8B 32 4096 32 8.2 Developed by : CyberAgent, Inc. Model type : Transformer based Language Model Language : Japanese Library : GPT NeoX License : OpenCALM is licensed under the Creative Commons Attribution ShareAlike 4.0 International License (CC BY SA 4.0). When using this model, please provide appropriate credit to CyberAgent, Inc. Example (en): This model is a fine tuned version of OpenCALM XX developed by CyberAgent, Inc. The original model is released under the CC BY SA 4.0 license, and this model is also released under the same CC BY SA 4.0 license. For more information, please visit: https://creativecommons.org/licenses/by sa/4.0/ Example (ja): 本モデルは、株式会社サイバーエージェントによるOpenCALM XXをファインチューニングしたものです。元の…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy