the.ai

Code / Agents

verified

Agentic Coding

Not a function from a description, but a task in a repository: read the issue, find the files, make the change, run the tests, fix what broke. The unit of work is a session rather than a completion, and what limits it is not whether the model can write the line — it usually can — but whether it can take fifty correct actions in a row.

Viz primitive · budget-splitfailed-trajectories = 8

failed-trajectories holds 17% of the budget; rest holds the remaining 83%.

Trajectories that fail at some step, against the ones that complete, in trajectories. Drag the task length up to watch failure take almost all of them — at 95% per action, fifty actions complete under a tenth of the time, which is why per-step reliability beats capability.

8

Reviewed by opendroid · 2026-08-18

  • arXiv:2405.15793 — SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
  • arXiv:2310.06770 — SWE-bench: Can Language Models Resolve Real-World GitHub Issues?