RNABERT Pre trained model on non coding RNA (ncRNA) using masked language modeling (MLM) and structural alignment learning (SAL) objectives. Disclaimer This is an UNOFFICIAL implementation of the Informative RNA base embedding for functional RNA clustering and structural alignment by Manato Akiyama, et al. The OFFICIAL repository of RNABERT is at mana438/RNABERT. [!CAUTION] The MultiMolecule team is aware of a potential risk in reproducing the results of RNABERT. The original implementation of RNABERT does not prepend ( ) and append tokens to the input sequence. This should not affect the performance of the model in most cases, but it can lead to unexpected behavior in some cases. Please set bos token=None, eos token=None in the tokenizer and set bos token id=None, eos token id=None in the model configuration if you want the exact behavior of the original implementation. [!TIP] The MultiMolecule team has confirmed that the provided model and checkpoints are producing the same intermediate representations as the original implementation. The team releasing RNABERT did not write this model card for this model so this model card has been written by the MultiMolecule team. Model Details…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy