search-arena-v1-7k

Overview

This dataset contains 7k leaderboard conversation votes collected from Search Arena between March 18, 2025 and April 13, 2025. All entries have been redacted for PII and sensitive user information to ensure privacy.

Each data point includes:

• Two model responses (messages_a and messages_b)
• The human vote result
• A timestamp
• Full system metadata, LLM + web search trace, and post-processed metadata for controlled experiments (conv_meta)

To reproduce the leaderboard results and analyses:

• Check out the Colab notebook for a step-by-step walkthrough.
• A companion blog post will provide deeper insights and commentary on the dataset and evaluation process.

License

User prompts are licensed under CC-BY-4.0, and model outputs are governed by the terms of use set by the respective model providers.

Citation

@misc{searcharena2025,
    title = {Introducing the Search Arena: Evaluating Search-Enabled AI},
    url = {https://blog.lmarena.ai/blog/2025/search-arena/},
    author = {Mihran Miroyan*, Tsung-Han Wu*, Logan Kenneth King, Tianle Li, Anastasios N. Angelopoulos, Wei-Lin Chiang, Narges Norouzi, Joseph E. Gonzalez},
    month = {April},
    year = {2025}
}

@misc{chiang2024chatbot,
    title={Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference},
    author={Wei-Lin Chiang and Lianmin Zheng and Ying Sheng and Anastasios Nikolas Angelopoulos and Tianle Li and Dacheng Li and Hao Zhang and Banghua Zhu and Michael Jordan and Joseph E. Gonzalez and Ion Stoica},
    year={2024},
    eprint={2403.04132},
    archivePrefix={arXiv},
    primaryClass={cs.AI}
}