RiNALMo Pre trained model on non coding RNA (ncRNA) using a masked language modeling (MLM) objective. Disclaimer This is an UNOFFICIAL implementation of the RiNALMo: General Purpose RNA Language Models Can Generalize Well on Structure Prediction Tasks by Rafael Josip Penić, et al. The OFFICIAL repository of RiNALMo is at lbcb sci/RiNALMo. [!TIP] The MultiMolecule team has confirmed that the provided model and checkpoints are producing the same intermediate representations as the original implementation. The team releasing RiNALMo did not write this model card for this model so this model card has been written by the MultiMolecule team. Model Details RiNALMo is a bert style model pre trained on a large corpus of non coding RNA sequences in a self supervised fashion. This means that the model was trained on the raw nucleotides of RNA sequences only, with an automatic process to generate inputs and labels from those texts. Please refer to the Training Details section for more information on the training process. Variants multimolecule/rinalmo giga : The RiNALMo model with 650 million parameters. multimolecule/rinalmo mega : The RiNALMo model with 150 million parameters. multimolecule/…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy