aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

TokenWave AI 发布 SWE-CoWork,测试编程智能体能否从团队沟通中补齐需求

AI 导读

SWE-CoWork 将智能体置于模拟职场:82% 的需求掌握在队友手中,智能体需主动询问才能确定任务。测试覆盖 101 个开源代码库中的 101 项任务;表现最好的模型虽通过约 63% 的单项检查,完整完成的任务仍不到 8%。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

Coding-agent benchmarks are starting to look like a new hire’s first week.

TokenWave AI has released SWE-CoWork, a new benchmark that tests whether AI coding agents can work like real team members.

Giving GPT-6 Astra the full spec up front lifted its passed checks by 16 points, yet it still fully finished only 8 of 101 tasks. SWE-CoWork puts coding agents in a simulated workplace modeled on real-world workflows, then links each failed check to a specific requirement.

Most coding benchmarks hand an AI agent a complete written task, but SWE-CoWork puts it in a simulated workplace where 82% of the requirements sit with teammates, so the agent only learns what to build by asking the right person. The best models pass about 63% of the individual checks yet fully finish fewer than 8% of 101 tasks.

引用TokenWave.AI@TokenWaveai
Can a coding agent take over a teammate’s work in progress? Introducing SWE-CoWork, a benchmark for coding agents working as digital employees on long-horizon software engineering tasks. Each assignment starts with a short handoff in a simulated workplace modeled on real-world engineering workflows. Agents search task boards and versioned docs, ask teammates for missing details, and revise their code when a reply changes what needs to be built. Open questions and confirmed requirements can both be lost before the agent hands the work back. SWE-CoWork lets us trace them through the conversation, the patch, and the tests. 101 assignments across 101 real open-source repositories. 26 simulated teammates per workplace. 11 programming languages. 12 application domains. 17 workplace tools. 🌐 Website: https://t.co/vyddiAIGDE 📄 Paper: https://t.co/EPBQ5RjlGy 💻 Code: https://t.co/zU8wPB0Wir 🤗 Hugging Face Daily Papers: https://t.co/tAbAQZ4pKR (If you find it useful, we’d appreciate an upvote!)
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错