Google research: Agent framework edits raise coding task success from 5% to 40%
Google researchers proposed letting an optimization model edit one module of an AI agent's operating framework at a time, retaining changes only after validation. In a SWE-bench Lite test using Gemini 3.8 Flash and 40 tasks excluded from optimization, success rose from 5.0% to 40.0%, with about 46,700 tokens used per task on average. The results are limited to specific models and software engineering tasks and do not establish the same gains across all agent applications.