PetBERT PetBERT is a masked language model based on the BERT architecture further trained on over 500 million additional words from first opinion veterinary clinicians from across the UK Paper Abstract Effective public health surveillance requires consistent monitoring of disease signals such that researchers and decision makers can react dynamically to changes in disease occurrence. However, whilst surveillance initiatives exist in production animal veterinary medicine, comparable frameworks for companion animals are lacking. First opinion veterinary electronic health records (EHRs) have the potential to reveal disease signals and often represent the initial reporting of clinical syndromes in animals presenting for medical attention, highlighting their possible significance in early disease detection. Yet despite their availability, there are limitations surrounding their free text based nature, inhibiting the ability for national level mortality and morbidity statistics to occur. This paper presents PetBERT, a large language model trained on over 500 million words from 5.1 million EHRs across the UK. PetBERT ICD is the additional training of PetBERT as a multi label classifier fo…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy