Original post · AI translation
@TokenWaveai 这应该是个很实用的测试方法。 智能体可能实现了每一项新需求,却仍然破坏了旁边的功能。
编码智能体能接手队友正在进行的工作吗?
推出 SWE-CoWork:一个评测基准,用于评估编码智能体作为数字员工完成长周期软件工程任务的能力。
每项任务都以一次简短的工作交接开始,场景设在一个模拟职场中,其设计参照真实的软件工程工作流程。智能体搜索任务看板和带版本记录的文档,向队友询问缺失的细节,并在回复改变了需要开发的内容时修改代码。
在智能体交还工作之前,尚未解决的问题和已确认的需求都可能丢失。SWE-CoWork 让我们能够通过对话、代码补丁和测试追踪它们。
101 项任务,来自 101 个真实的开源代码仓库。
每个职场有 26 名模拟队友。
11 种编程语言。
12 个应用领域。
17 种职场工具。
🌐 网站:https://t.co/vyddiAIGDE
📄 论文:https://t.co/EPBQ5RjlGy
💻 代码:https://t.co/zU8wPB0Wir
🤗 Hugging Face Daily Papers:https://t.co/tAbAQZ4pKR(如果你觉得它有用,欢迎点赞!)
Original
Can a coding agent take over a teammate’s work in progress? Introducing SWE-CoWork, a benchmark for coding agents working as digital employees on long-horizon software engineering tasks. Each assignment starts with a short handoff in a simulated workplace modeled on real-world engineering workflows. Agents search task boards and versioned docs, ask teammates for missing details, and revise their code when a reply changes what needs to be built. Open questions and confirmed requirements can both be lost before the agent hands the work back. SWE-CoWork lets us trace them through the conversation, the patch, and the tests. 101 assignments across 101 real open-source repositories. 26 simulated teammates per workplace. 11 programming languages. 12 application domains. 17 workplace tools. 🌐 Website: https://t.co/vyddiAIGDE 📄 Paper: https://t.co/EPBQ5RjlGy 💻 Code: https://t.co/zU8wPB0Wir 🤗 Hugging Face Daily Papers: https://t.co/tAbAQZ4pKR (If you find it useful, we’d appreciate an upvote!)