Website Paper Code How good are language models at coming up with new algorithms? To try to answer this, we built a benchmark, AlgoTune, comprised of 154 widely used math, physics, and computer science functions. For each function, the goal is to write code that produces the same outputs as the original function, while being faster. In addition to the benchmark, we also provide an agent, AlgoTuner, which allows language models to easily optimize code. AlgoTune can now be easily run on AWS with just an OpenRouter API key and AWS credentials. Try it out here . For more information on running AlgoTuner on SLURM or a single machine, please refer to the code . Citation If you found this work helpful, please consider citing it using the following: AlgoTune citation
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy