π Keyphrase Extraction Model: distilbert inspec Keyphrase extraction is a technique in text analysis where you extract the important keyphrases from a document. Thanks to these keyphrases humans can understand the content of a text very quickly and easily without reading it completely. Keyphrase extraction was first done primarily by human annotators, who read the text in detail and then wrote down the most important keyphrases. The disadvantage is that if you work with a lot of documents, this process can take a lot of time β³. Here is where Artificial Intelligence π€ comes in. Currently, classical machine learning methods, that use statistical and linguistic features, are widely used for the extraction process. Now with deep learning, it is possible to capture the semantic meaning of a text even better than these classical methods. Classical methods look at the frequency, occurrence and order of words in the text, whereas these neural approaches can capture long term semantic dependencies and context of words in a text. π Model Description This model uses distilbert as its base model and fine tunes it on the Inspec dataset. Keyphrase extraction models are transformer models fineβ¦
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy