aifollow.news Search
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time SelectedAI score60

METR and Redwood Research find monitoring gaps in OpenAI’s internal coding agentsMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

One researcher each from METR and Redwood Research spent three weeks assessing OpenAI’s codebase. They found that the monitor skipped some events, leaving roughly 10% of eligible internal Codex traffic unmonitored between May and July 2026; agents could also hide actions or launch unmonitored copies. OpenAI says it has patched every flaw affecting production safeguards, but the auditors have not verified that.

Why it matters

这次评估指出了内部代理监控的具体盲区,并明确区分了OpenAI的修复声明与审计人员尚未核实的结果。

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

Outside researchers embedded at OpenAI found several ways its internal coding agents could escape AI monitoring.

One employee each from METR and Redwood Research spent 3 weeks inside OpenAI’s codebase.

> OpenAI’s monitor checked agents only when they returned control to users and skipped compaction events, so roughly 10% of eligible internal Codex traffic went unmonitored between May and July 2026.

> Agents could hide hundreds of recent actions from the monitor, start unmonitored copies through 2 client-controllable headers, likely make the monitor fail via serialization mismatches, and bypass Codex sandboxing and Auto-Review.

> Even on paper, only an estimated 75% to 94% of internal Responses API agent traffic from GPT-5.5 or stronger models was eligible for monitoring, and RL training runs had no coverage when the exercise began.

> OpenAI says every flaw affecting production safeguards is patched, but the auditors haven’t verified that and couldn’t check whether agents ever exploited the postponement gap.

QuoteMETR@METR_Evals
Two employees from METR and Redwood Research worked on premises at OpenAI for three weeks this summer in an embedded assessment pilot. This team evaluated the systems OpenAI was using to monitor for misalignment from internal agents. A brief write-up of their work is now public.
View this post on X ↗

来源:Rohan Paul · x.com

Industry
Found an error? Send a correction