Original post · Original
Rohan Paul@rohanpaul_ai
@DeepnoteHQ beautiful product.
@rohanpaul_ai Thanks for sharing @rohanpaul_ai 💙
View this post on X ↗
This is a beautiful concept for a benchmark.
Deepnote (@deepnotehq), an agent workspace company, released the Agent Initiative Benchmark, a test that drops proactive agents into a company Slack and scores whether they know when to jump in, what to say, and when to stay quiet.
GPT-6 Astra led with 8.97 out of 10, and GPT-6.1 Sol followed at 8.65 for $0.11 per task, against $1.87 per task for third-placed Claude Fable 5.2.
It runs every model through the same loop:
> A thread starts in a simulated company’s Slack
> The agent decides whether to act at all
> It picks which of 11 services to check and investigates
> It posts and tags the right people, or stays silent
> Two LLM evaluators score the run 0 to 10 against a reference answer
View this post on X ↗
· UTC+8