CrossSWE: Benchmarking Cross-Repository Joint Development for Coding Agents Paper • 2611.01484 • Published 19 days ago • 26
"Shall We Approve?" Consequence-Aware Approval for Autonomous Coding Agents Paper • 2610.40753 • Published 22 days ago • 16
IQuest-Q1: Advancing Foundation Capabilities for Agentic CLI Systems Paper • 2610.30949 • Published 29 days ago • 100
ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement Paper • 2609.14857 • Published Sep 14 • 55
EarlyEval: Cheaper Agent Evaluation via Early Outcome Prediction Paper • 2609.02783 • Published Sep 2 • 55
CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild Paper • 2608.23181 • Published Aug 24 • 35
Second Thought: Reasoning in Parallel as LLM Agents Act and Observe Paper • 2608.13667 • Published Aug 13 • 18
How Do Practitioners Build SE Agents? Insights from a Mixed-Methods Study Paper • 2607.10856 • Published Jul 12 • 7
Are Performance-Optimization Benchmarks Reliably Measuring Coding Agents? Paper • 2607.01211 • Published Jul 1 • 12
Running on CPU Upgrade 14.2k Open LLM Leaderboard 🏆 14.2k Track, rank and evaluate open LLMs and chatbots
Running Agents 1.53k Big Code Models Leaderboard 📈 1.53k Explore code model leaderboard and submit evaluations