aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score60

Research report says coordinated AI agents can improve prompt injection attacksMachine translation

AI introduction

A post describing a Google DeepMind paper says researchers used eight teams of AI agents to test prompt injections, share notes and refine attacks. Across 100 tool-use tasks, the attacker sought just one random, harmless tool call. With up to 320 attempts, the strongest attacker succeeded on 34% of tasks against Gemini 4 Argon, described in the post as the most robust model.

Original post · Original

@rohanpaul_ai

– https://t.co/6v5of2p7Of

Title: "Scaling Adaptive Prompt Injection Attacks with Agent Swarms"

ReplyRohan Paul@rohanpaul_ai
New Google DeepMind paper shows prompt injection is not solved, since a swarm of strong AI attacker agents still tricks even the best-defended models. Prompt injection means hiding instructions in data an AI agent reads, like a tool result, to make it act for the attacker. Human red-teaming attacks now almost never work on recent Gemini models, so the problem can look solved. They built Agentic Optimizer, 8 teams of AI agents that test injections, share notes, and build on each other's best attempts. They tested it on 100 tool-use tasks where the attacker only wanted one random, harmless tool call. With up to 320 tries, the strongest attacker beat Gemini 4 Argon, the most robust model, on 34% of tasks. Open-weight Kimi K3, GLM-5.3, and DeepSeek-V4.1-Flash resisted only 1% of tasks.
View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction