WebOrganizer/TopicClassifier [Paper] [Website] [GitHub] The TopicClassifier organizes web content into 24 categories based on the URL and text contents of web pages. The model is a gte base en v1.5 with 140M parameters fine tuned on the following training data: 1. WebOrganizer/TopicAnnotations Llama 3.1 8B: 1M documents annotated by Llama 3.1 8B (first stage training) 2. WebOrganizer/TopicAnnotations Llama 3.1 405B FP8: 100K documents annotated by Llama 3.1 405B FP8 (second stage training) All Domain Classifiers WebOrganizer/FormatClassifier WebOrganizer/FormatClassifier NoURL WebOrganizer/TopicClassifier ← you are here! WebOrganizer/TopicClassifier NoURL Usage This classifier expects input in the following input format: Example: You can convert the logits of the model with a softmax to obtain a probability distribution over the following 24 categories (in order of labels, also see id2label and label2id in the model config): 1. Adult 2. Art & Design 3. Software Dev. 4. Crime & Law 5. Education & Jobs 6. Hardware 7. Entertainment 8. Social Life 9. Fashion & Beauty 10. Finance & Business 11. Food & Dining 12. Games 13. Health 14. History 15. Home & Hobbies 16. Industrial 17. Literatu…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy