NemoCurator Prompt Task and Complexity Classifier Model Overview This is a multi headed model which classifies English text prompts across task types and complexity dimensions. Tasks are classified across 11 common categories. Complexity is evaluated across 6 dimensions and ensembled to create an overall complexity score. Further information on the taxonomies can be found below. This model is ready for commercial use. Task types: Open QA: A question where the response is based on general knowledge Closed QA: A question where the response is based on text/data provided with the prompt Summarization Text Generation Code Generation Chatbot Classification Rewrite Brainstorming Extraction Other Complexity dimensions: Overall Complexity Score: The weighted sum of the complexity dimensions. Calculated as 0.35\ CreativityScore + 0.25\ ReasoningScore + 0.15\ ConstraintScore + 0.15\ DomainKnowledgeScore + 0.05\ ContextualKnowledgeScore + 0.05\ NumberOfFewShots Creativity: The level of creativity needed to respond to a prompt. Score range of 0 1, with a higher score indicating more creativity. Reasoning: The extent of logical or cognitive effort required to respond to a prompt. Score range of…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy