GUI 360°: A Comprehensive Dataset And Benchmark For Computer Using Agents Paper Code GUI 360° is a large scale, comprehensive dataset and benchmark suite designed to advance Computer Using Agents (CUAs) . 🎯 Key Features 🔢 1.2M+ executed action steps across thousands of trajectories 💼 Popular Windows office applications (Word, Excel, PowerPoint) 📸 Full resolution screenshots with accessibility metadata 🎨 Multi modal trajectories with reasoning traces ✅ Both successful and failed action trajectories 🔄 Hybrid GUI+API action space for modern agent designs 🏗️ Collection Pipeline The GUI 360° dataset collection is organized into 3 major stages : 📥 Stage 1: Query Acquisition 🌐 Sources real world queries from various domains 🏭 Constructs environment templates for reproducible scenarios 🎯 Instantiates and filters queries into concrete, executable tasks 🤖 Stage 2: Automatic Trajectory Collection 🔄 A specialized agent automatically executes the tasks 📸 Records complete trajectories with: Screenshots at each step Agent's reasoning and thoughts Actions performed ✅ Stage 3: Evaluation and Post processing Quality assurance through three processes: 🔍 Trajectory Validation ensures ex…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy