prophetnet large uncased Pretrained weights for ProphetNet. ProphetNet is a new pre trained language model for sequence to sequence learning with a novel self supervised objective called future n gram prediction. ProphetNet is able to predict more future tokens with a n stream decoder. The original implementation is Fairseq version at github repo. Usage This pre trained model can be fine tuned on sequence to sequence tasks. The model could e.g. be trained on headline generation as follows: Citation
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy