Terminal Lego 15k: Docker Verified Terminal Agent Tasks from Real StackOverflow Issues Project Page · Code · Paper · Models Terminal Lego 15k is a large scale collection of Docker verified, Terminal Bench style agentic tasks built from real StackOverflow technical issues. Each task is constructed through the Terminal Lego pipeline: StackOverflow questions are filtered, converted via cascaded LLM generation, and retained only after Docker round trip verification. This dataset is the task substrate behind the paper What Makes Interaction Trajectories Effective for Training Terminal Agents? It supports trajectory collection, SFT, and evaluation on Terminal Bench 2.0 with the fixed Terminus 2 harness. 🚀 Key Results & Performance Training student models on 15.3K Terminal Lego trajectories (collected from these tasks) yields strong gains on Terminal Bench 2.0 with exceptional data efficiency: Model Size Backbone (Qwen3) Terminal Lego SFT Improvement 8B 2.5% 11.8% +9.3 pp 32B 3.4% 24.3% +20.9 pp (~7×) Compared with prior terminal agent datasets at similar model scales: Model Size Post Training Data Scaffold TB 2.0 Nemotron Terminal Qwen3 8B 8B 490.5K Terminus 2 13.0% Terminal Lego Qwen3…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy