原帖引用 · 原文
该语言的正文暂不可用，当前显示已有版本。
Rohan Paul@rohanpaul_ai
Title: "Who Verifies the Verifier? Co-Evolving Inspectable Graders with Self-Improving Agents"
Self-improving agents have always needed a human to write the grader.
A new AWS + HSBC paper removes that step: the grader evolves alongside the agent from 10 labeled examples and trains it about as well as ground truth.
Double Ratchet evolves the grader alongside the agent's skills, building it from small, mostly rule-based checks for 1 failure type each. A grader version is chosen for agreeing with 10 labeled examples, never for raising the agent's score.
It kept 88% to 110% of the gain that ground truth or a rubric gave the same skill loop, across code, SQL, and reports. With the safeguards removed, the grader passed 97% to 100% of outputs yet trained skills as well.
在 X 查看这条帖子 ↗
· UTC+8