SPECTER2 SPECTER2 is the successor to SPECTER and is capable of generating task specific embeddings for scientific tasks when paired with adapters. This is the base model to be used along with the adapters. Given the combination of title and abstract of a scientific paper or a short texual query, the model can be used to generate effective embeddings to be used in downstream applications. Note:For general embedding purposes, please use allenai/specter2. To get the best performance on a downstream task type please load the associated adapter with the base model as in the example below. Dec 2023 Update: Model usage updated to be compatible with latest versions of transformers and adapters (newly released update to adapter transformers) libraries. Aug 2023 Update: 1. The SPECTER2 Base and proximity adapter models have been renamed in Hugging Face based upon usage patterns as follows: Old Name New Name allenai/specter2 allenai/specter2 base allenai/specter2 proximity allenai/specter2 2. We have a parallel version (termed aug2023refresh) where the base transformer encoder version is pre trained on a collection of newer papers (published after 2018). However, for benchmarking purposes, p…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy