SWE-Race: a coding-agent benchmark of 188 real concurrency bugs, with results from three models [P]
We've been building a benchmark out of real concurrency bugs (race conditions, deadlocks, cancellation issues) taken from merged PRs in about 100 Python projects. Each task gets graded by the project's own tests, in a co
![SWE-Race: a coding-agent benchmark of 188 real concurrency bugs, with results from three models [P]](https://preview.redd.it/0uopztlmpsth1.png?width=140&height=78&auto=webp&s=9c151147cfaf8f65c529f01950c4c6a765649b81)
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/MachineLearning
Originally published by r/MachineLearning. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.