aifollow.news Search
Back Tibo
Tibo· @thsottiaux · X· · Original publication time AI score40

PersonalAgentBench adds Dots and Hark and expands its tasksMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

PersonalAgentBench added OpenAI's Dots and Hark and doubled its task count, adding research, image understanding, editing, and everyday communication. In this early evaluation, Dots ranked first overall, with Hark close behind. Dots was relatively consistent across task types but weaker at inferring personal context.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@thsottiaux

@aliansarinik @hark_labs @OpenAI Nice

ReplyAli Ansari@aliansarinik
We have two additions to PersonalAgentBench: @hark_labs and @OpenAI's Dots! Dots has taken the lead, with Hark close behind while Gemini Spark moves to third, followed by Instinct, Grok Bot, and Muse. We also doubled the number of tasks this week, adding research, image understanding, editing, and everyday communication. The wider set changed the picture. Gemini Spark was strongest on research but weaker on image and editing tasks. Hark and Gemini tied on tasks involving user authority. Dots was the most consistent across task types, although it was weaker when it had to infer personal context. No assistant led every category; the overall ranking rewarded consistent performance across the full set. This is still an early snapshot, and we’re excited to see how results evolve as we add more agents, expand the tasks, and re-evaluate after product updates. If you’re using any of these six personal agents, follow along by visiting the link in the original post.
View this post on X ↗
Related contextAli Ansari@aliansarinik
Which personal agent is the best life assistant? Today we're releasing the micro1 PersonalAgentBench to help answer that, and we're paying real personal agent users to contribute to the benchmark. Personal agents can now book your flights, answer emails, and move your meetings around. That’s great, until one messages the wrong person or makes a purchase without confirming. Capability is not the same as trust. So we put four personal agents to the test: Instinct, Muse, Grok Bot, and Gemini Spark. We found that even when agents found the right information, they still often miss what matters, overshare, or make things up. To find out for yourself how your agent compares, you can join our benchmark. We’re paying the first 100 users to run our prompts and share their results.
View this post on X ↗

来源:Tibo · x.com

All
Found an error? Send a correction