CodeBERT base Pretrained weights for CodeBERT: A Pre Trained Model for Programming and Natural Languages. Training Data The model is trained on bi modal data (documents & code) of CodeSearchNet Training Objective This model is initialized with Roberta base and trained with MLM+RTD objective (cf. the paper). Usage Please see the official repository for scripts that support "code search" and "code to document generation". Reference 1. CodeBERT trained with Masked LM objective (suitable for code completion) 2. 🤗 Hugging Face's CodeBERTa (small size, 6 layers) Citation
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy