Technical Report 🧬 Carbon 3B A generative DNA foundation model from the Carbon family. Table of Contents 1. Model Summary 2. How to use 3. Evaluation 4. Training 5. Limitations 6. License 7. Acknowledgements Model Summary Carbon 3B is a 3B parameter decoder only autoregressive genomic foundation model trained on DNA and RNA sequences, with a primary focus on eukaryotes. It has a native context length of 32,768 6 mer tokens (≈ 197k DNA base pairs) and extends to 65,536 tokens (≈ 393 kbp) at inference time via YaRN. Carbon 3B is designed to be both strong and efficient: on generative tasks (sequence recovery), variant effect prediction, and motif perturbation discrimination, it matches the capability of substantially larger single nucleotide baselines such as Evo2 7B while running several times faster. Carbon 3B is the flagship model of the Carbon family. We also release Carbon 8B for users who need additional capability at higher inference cost, and Carbon 500M — a small generative model intended for speculative decoding alongside Carbon 3B (or Carbon 8B). Technical report: https://github.com/huggingface/carbon/blob/main/tech report.pdf Demo: https://huggingface.co/spaces/HuggingFa…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy