aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Google 与 Carnegie Mellon 研究让智能体工具框架分别优化任务表现与安全性

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

Harmony Harness 同时培育多种工具框架版本,分别权衡测试通过率和阻止漏洞利用的能力,并按任务选用相应改进。在 SecRepoBench 未见过的崩溃类型上,报告称其修复同时有效且阻止漏洞利用的比例为 66.7%,初始框架为 36.7%;安全收益保留率为 55%,对比基线 DGM 为 0%。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

– https://t.co/SnRFG2fgAk

Title: "Harmony Harness: Multi-Objective Self-Evolution of Agent Harnesses"

回复Rohan Paul@rohanpaul_ai
New Google and Carnegie Mellon paper finds self-improving agents hold on to security gains far better when security is evolved as a separate goal. Agent harnesses, the prompts, tools and loops around a model, can now rewrite themselves from feedback. Most such systems chase a single score, like test pass rate, and the security gains they pick up mostly vanish on new tasks. Harmony Harness evolves several harness versions, each pushed toward a different balance of passing tests and blocking exploits. It also keeps general fixes separate from benchmark-specific ones, and picks which pieces to use per task. On unseen crash types in SecRepoBench, 66.7% of its fixes both worked and blocked the exploit, against 36.7% for the starting harness. It kept 55% of its security gain on those tasks, while the DGM baseline kept 0%. When you let an agent improve itself, track security as its own score and check it on held-out tasks.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错