RexBERT mini TL;DR : An encoder only transformer (ModernBERT style) for e commerce applications, trained in three phases— Pre training , Context Extension , and Decay —to power product search, attribute extraction, classification, and embeddings use cases. The model has been trained on 2.3T+ tokens along with 350B+ e commerce specific tokens Table of Contents Quick Start Intended Uses & Limitations Model Description Training Recipe Data Overview Evaluation Usage Examples Masked language modeling Embeddings / feature extraction Text classification fine tune Model Architecture & Compatibility Efficiency & Deployment Tips Responsible & Safe Use License Maintainers & Contact Citation Quick Start Intended Uses & Limitations Use cases Product & query retrieval/semantic search (titles, descriptions, attributes) Attribute extraction / slot filling (brand, color, size, material) Classification (category assignment, unsafe/regulated item filtering, review sentiment) Reranking and query understanding (spelling/ASR normalization, acronym expansion) Out of scope Long form generation (use a decoder/seq to seq LM instead) High stakes decisions without human review (pricing, compliance, safety fla…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy