Falcon H1R 7B This repository presents Falcon H1R 7B , a reasoning specialized model introduced in the paper Falcon H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test Time Scaling. Built on top of Falcon H1 7B Base, it was trained via cold start supervised fine tuning with long reasoning traces and further enhanced by scaling RL with GRPO. The model demonstrates outstanding performance across various benchmark evaluations, including mathematics, programming, instruction following, and general logic. Model Description Developed by: Technology Innovation Institute Model type: Causal decoder only Architecture: Hybrid (Transformers + Mamba2) architecture Language(s): English, Multilingual License: Falcon LLM License Training details For more details about the training protocol of this model, please refer to the Falcon H1R technical blogpost and Technical Report. Usage Currently to use this model, you can either rely on Hugging Face transformers , vLLM or SGLang library. Inference Make sure to install the latest version of transformers or vLLM or SGLang . For vLLM, make sure to install vllm=0.11.0 : Sampling Parameters We recommend using a temperature of 0.6 and…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy