aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分60

研究报告称,多智能体协作可提高提示注入攻击成功率

AI 导读

一则对 Google DeepMind 论文的介绍称,研究人员让 8 组 AI 智能体测试提示注入、共享经验并改进攻击。在 100 项工具使用任务中,攻击者的目标仅是诱使模型执行一次随机、无害的工具调用;最多尝试 320 次后,最强攻击者在 34% 的任务中攻破了被测试者称为防护最强的 Gemini 4 Argon。

原帖引用 · 原文

@rohanpaul_ai

– https://t.co/6v5of2p7Of

Title: "Scaling Adaptive Prompt Injection Attacks with Agent Swarms"

回复Rohan Paul@rohanpaul_ai
New Google DeepMind paper shows prompt injection is not solved, since a swarm of strong AI attacker agents still tricks even the best-defended models. Prompt injection means hiding instructions in data an AI agent reads, like a tool result, to make it act for the attacker. Human red-teaming attacks now almost never work on recent Gemini models, so the problem can look solved. They built Agentic Optimizer, 8 teams of AI agents that test injections, share notes, and build on each other's best attempts. They tested it on 100 tool-use tasks where the attacker only wanted one random, harmless tool call. With up to 320 tries, the strongest attacker beat Gemini 4 Argon, the most robust model, on 34% of tasks. Open-weight Kimi K3, GLM-5.3, and DeepSeek-V4.1-Flash resisted only 1% of tasks.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错