Model Card for Model ID Lynx is an open source hallucination evaluation model. Patronus Lynx 8B Instruct was trained on a mix of datasets including CovidQA, PubmedQA, DROP, RAGTruth. The datasets contain a mix of hand annotated and synthetic data. The maximum sequence length is 8000 tokens. Model Details Model Type: Patronus Lynx 8B Instruct is a fine tuned version of meta llama/Meta Llama 3 8B Instruct model. Language: Primarily English Developed by: Patronus AI Paper: https://arxiv.org/abs/2407.08488 License: https://creativecommons.org/licenses/by nc/4.0/ Model Sources Repository: https://github.com/patronus ai/Lynx hallucination detection How to Get Started with the Model Lynx is trained to detect hallucinations in RAG settings. Provided a document, question and answer, the model can evaluate whether the answer is faithful to the document. To use the model, we recommend using the following prompt: The model will output the score as 'PASS' if the answer is faithful to the document or FAIL if the answer is not faithful to the document. Inference To run inference, you can use HF pipeline: Since the model is trained in chat format, ensure that you pass the prompt as a user message.…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy