aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

卡内基梅隆大学论文提出可核验的 AI 智能体保险机制

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

一篇卡内基梅隆大学论文提出:服务提供方预存区块链保证金,由独立核验程序对照智能体的工具调用日志与链上哈希;若违反可由程序检查的规则,就用保证金赔付用户。在来自三个基准的696次违规运行中,检查程序证明了42.2%;作者估计,若把审批记录改为结构化格式,比例可达83.0%。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

– https://t.co/BqV45HtQMl

Title: "Holding Agents Accountable with Verifiable Agent Insurance"

回复Rohan Paul@rohanpaul_ai
New Carnegie Mellon paper finds that OpenClaw's logs left 0 of 4 policy violations provable, a warning for any team relying on agent logs for audits. They found that most agent policy violations in its tests could not be proven from logs, often because approvals and permissions were buried in chat text. Also finds that only 10% to 30% of violating runs needed human judgment, so most agent rule breaks could be checked by code with better logs. Safety work mostly tries to stop agents before they misbehave. When a mistake slips through, like a wiped inbox or a bad payment, users get little beyond slow, capped, case-by-case refunds. In verifiable agent insurance, a provider posts a deposit on a blockchain and promises rules a program can check, like paying only approved merchants. A neutral verifier compares the agent's tool-call log with on-chain hashes, and if a rule was broken, the deposit pays the user. Tested on 696 rule-breaking runs from 3 benchmarks, the checker proved 42.2%, often failing where approvals lived only in chat messages. With structured approval records, the authors estimate 83.0%, at under 1¢ of blockchain fees per session. Design your agent so every permission, its scope, and each risky action land in a machine-readable log.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错