SWE-bench
AISWE-bench: A benchmark that gives a model real GitHub issues from open-source projects and checks whether its code patch makes the repository's tests pass.
Used in these stories
- Meta Opens Muse Glimmer Under Apache 2.0, Dropping The Llama Licence Rules
- Gemini 3.6 Flash, 3.5 Flash-Lite and 3.5 Flash Cyber: Google's security model is the one to watch
- GPT-5.6 Sol Terra And Luna Reset OpenAI Pricing
- Grok 4.5 Buys Its Way Into The Coding Race
- LongCat-2.0 Trained Without A Single Nvidia Chip
- Claude Sonnet 5 Puts Opus Class Agents On A Mid Tier Budget