IgT5 model Model pretrained on protein and antibody sequences using a masked language modeling (MLM) objective. It was introduced in the paper Large scale paired antibody language models. The model is finetuned from IgT5 unpaired using paired antibody sequences from the Observed Antibody Space. Use The encoder part of the model and tokeniser can be loaded using the transformers library The tokeniser is used to prepare batch inputs Note that the tokeniser adds a token at the end of each paired sequence and pads using the token. For example a batch containing sequences V Q L E V V , Q V A L will be tokenised to V Q L E V V and Q V A L . Sequence embeddings are generated by feeding tokens through the model To obtain a sequence representation, the residue tokens can be averaged over like so
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy