Model Card for BioCLIP BioCLIP is a foundation model for the tree of life, built using CLIP architecture as a vision model for general organismal biology. It is trained on TreeOfLife 10M, our specially created dataset covering over 450K taxa the most biologically diverse ML ready dataset available to date. Through rigorous benchmarking on a diverse set of fine grained biological classification tasks, BioCLIP consistently outperformed existing baselines by 16% to 17% absolute. Through intrinsic evaluation, we found that BioCLIP learned a hierarchical representation aligned to the tree of life, which demonstrates its potential for robust generalizability. See the examples/ directory for examples of how to use BioCLIP in zero shot and few shot settings. Model Details Model Description BioCLIP is based on OpenAI's CLIP. We trained the model on TreeOfLife 10M from OpenAI's ViT B/16 checkpoint, using OpenCLIP's code. BioCLIP is trained with the standard CLIP objective to imbue the model with an understanding, not just of different species, but of the hierarchical structure that relates species across the tree of life. In this way, BioCLIP offers potential to aid biologists in discovery o…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy