SWE-Pair: a coding-agent benchmark where every task is two real bugs to fix at once, with results from four models [P]
We built a benchmark of 161 tasks from 69 Python projects where the agent has to fix two real bugs at once. The cheapest setup came out on top. DeepSeek V4.1 Flash at medium effort solved 90% of tasks, at about 6 cents p
![SWE-Pair: a coding-agent benchmark where every task is two real bugs to fix at once, with results from four models [P]](https://preview.redd.it/8ksnyprzst0i1.png?width=140&height=78&auto=webp&s=4fac5ca9b5d73eac9fbd8a0a6e2464bdc7ec86c0)
π
This source provides headlines only. Use the button below to read the complete article on the original site.
π° Read the original article on r/MachineLearning
Originally published by r/MachineLearning. Aggregated on AIWithGhost for educational purposes β full credit and traffic to the original publisher.