aifollow.news 搜索
返回 Tibo
Tibo· @thsottiaux · X· · 原发布时间 AI 评分40

PersonalAgentBench 加入 Dots 和 Hark,扩充测试任务

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

PersonalAgentBench 新增 OpenAI 的 Dots 和 Hark,并将测试任务数量翻倍,加入研究、图像理解、编辑和日常沟通任务。在这次早期评测中,Dots 总排名第一,Hark 紧随其后;Dots 在各类任务中表现较稳定,但推断个人背景信息时较弱。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@thsottiaux

@aliansarinik @hark_labs @OpenAI Nice

回复Ali Ansari@aliansarinik
We have two additions to PersonalAgentBench: @hark_labs and @OpenAI's Dots! Dots has taken the lead, with Hark close behind while Gemini Spark moves to third, followed by Instinct, Grok Bot, and Muse. We also doubled the number of tasks this week, adding research, image understanding, editing, and everyday communication. The wider set changed the picture. Gemini Spark was strongest on research but weaker on image and editing tasks. Hark and Gemini tied on tasks involving user authority. Dots was the most consistent across task types, although it was weaker when it had to infer personal context. No assistant led every category; the overall ranking rewarded consistent performance across the full set. This is still an early snapshot, and we’re excited to see how results evolve as we add more agents, expand the tasks, and re-evaluate after product updates. If you’re using any of these six personal agents, follow along by visiting the link in the original post.
在 X 查看这条帖子 ↗
相关上下文Ali Ansari@aliansarinik
Which personal agent is the best life assistant? Today we're releasing the micro1 PersonalAgentBench to help answer that, and we're paying real personal agent users to contribute to the benchmark. Personal agents can now book your flights, answer emails, and move your meetings around. That’s great, until one messages the wrong person or makes a purchase without confirming. Capability is not the same as trust. So we put four personal agents to the test: Instinct, Muse, Grok Bot, and Gemini Spark. We found that even when agents found the right information, they still often miss what matters, overshare, or make things up. To find out for yourself how your agent compares, you can join our benchmark. We’re paying the first 100 users to run our prompts and share their results.
在 X 查看这条帖子 ↗

来源:Tibo · x.com

综合
发现内容有误?提交纠错