Chinese CLIP ViT Large Patch14 Introduction This is the large version of the Chinese CLIP, with ViT L/14 as the image encoder and RoBERTa wwm base as the text encoder. Chinese CLIP is a simple implementation of CLIP on a large scale dataset of around 200 million Chinese image text pairs. For more details, please refer to our technical report https://arxiv.org/abs/2211.01335 and our official github repo https://github.com/OFA Sys/Chinese CLIP (Welcome to star! 🔥🔥) Use with the official API We provide a simple code snippet to show how to use the API of Chinese CLIP to compute the image & text embeddings and similarities. However, if you are not satisfied with only using the API, feel free to check our github repo https://github.com/OFA Sys/Chinese CLIP for more details about training and inference. Results MUGE Text to Image Retrieval : Setup Zero shot Finetune Metric R@1 R@5 R@10 MR R@1 R@5 R@10 MR Wukong 42.7 69.0 78.0 63.2 52.7 77.9 85.6 72.1 R2D2 49.5 75.7 83.2 69.5 60.1 82.9 89.4 77.5 CN CLIP 63.0 84.1 89.2 78.8 68.9 88.7 93.1 83.6 Flickr30K CN Retrieval : Task Text to Image Image to Text Setup Zero shot Finetune Zero shot Finetune Metric R@1 R@5 R@10 R@1 R@5 R@10 R@1 R@5 R@10…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy