GISA: A Benchmark for General Information Seeking Assistant Authors : Yutao Zhu, Xingshuo Zhang, Maosen Zhang, Jiajie Jin, Liancheng Zhang, Xiaoshuai Song, Kangzhi Zhao, Wencong Zeng, Ruiming Tang, Han Li, Ji Rong Wen, and Zhicheng Dou Benchmark Highlights GISA is a benchmark for General Information Seeking Assistants with 373 human crafted queries that reflect real world information needs. It includes both stable and live subsets, four structured answer formats (item, set, list, table), and complete human search trajectories for every query. Diverse answer formats with deterministic evaluation. GISA uses four structured answer types (item, set, list, table) with strict matching metrics for reproducible evaluation, avoiding subjective LLM judging while preserving task diversity. Unified deep + wide search capabilities. Tasks require both vertical reasoning and horizontal information aggregation across sources, evaluating long horizon exploration and summarization in one benchmark. Dynamic, anti static evaluation. Queries are split into stable and live subsets; the live subset is periodically updated to reduce memorization and keep the benchmark challenging over time. Process level…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy