Original post · Original
The article text is unavailable in this language; an existing version is shown.
Rohan Paul@rohanpaul_ai
Title: "Who Verifies the Verifier? Co-Evolving Inspectable Graders with Self-Improving Agents"
Self-improving agents have always needed a human to write the grader.
A new AWS + HSBC paper removes that step: the grader evolves alongside the agent from 10 labeled examples and trains it about as well as ground truth.
Double Ratchet evolves the grader alongside the agent's skills, building it from small, mostly rule-based checks for 1 failure type each. A grader version is chosen for agreeing with 10 labeled examples, never for raising the agent's score.
It kept 88% to 110% of the gain that ground truth or a rubric gave the same skill loop, across code, SQL, and reports. With the safeguards removed, the grader passed 97% to 100% of outputs yet trained skills as well.
View this post on X ↗
· UTC+8