SPECTER2 SPECTER2 is a family of models that succeeds SPECTER and is capable of generating task specific embeddings for scientific tasks when paired with adapters. This is the base encoder to be used with relevant task specific adapters. Given the combination of title and abstract of a scientific paper or a short texual query, the model can be used to generate effective embeddings to be used in downstream applications. Note:For general embedding purposes, please use allenai/specter2. To get the best performance on a downstream task type please load the associated adapter () with the base model as in the example below. Dec 2023 Update: Model usage updated to be compatible with latest versions of transformers and adapters (newly released update to adapter transformers) libraries. \ \ \ \ \ \ Update\ \ \ \ \ \ This update introduces a new set of SPECTER2 models with the base transformer encoder pre trained on an extended citation dataset containing more recent papers. For benchmarking purposes please use the existing SPECTER2 models w/o the aug2023refresh suffix. Note:For general embedding purposes, please use allenai/specter2. To get the best performance on a downstream task type ple…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy