aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

SWE-CoWork introduces a benchmark for coding agents taking over work in progressMachine translation

AI introduction

SWE-CoWork tests whether coding agents can take a handoff in a simulated workplace, search task boards and documents, ask teammates for details, and revise code as requirements change. Its 101 assignments span 101 real open-source repositories; the benchmark can trace open questions and confirmed requirements through conversations, patches, and tests.

Original post · Original

@rohanpaul_ai

@TokenWaveai this should so practical way to test. an agent can implement every new requirement and still break the feature sitting next to it.

ReplyTokenWave.AI@TokenWaveai
Can a coding agent take over a teammate’s work in progress? Introducing SWE-CoWork, a benchmark for coding agents working as digital employees on long-horizon software engineering tasks. Each assignment starts with a short handoff in a simulated workplace modeled on real-world engineering workflows. Agents search task boards and versioned docs, ask teammates for missing details, and revise their code when a reply changes what needs to be built. Open questions and confirmed requirements can both be lost before the agent hands the work back. SWE-CoWork lets us trace them through the conversation, the patch, and the tests. 101 assignments across 101 real open-source repositories. 26 simulated teammates per workplace. 11 programming languages. 12 application domains. 17 workplace tools. 🌐 Website: https://t.co/vyddiAIGDE 📄 Paper: https://t.co/EPBQ5RjlGy 💻 Code: https://t.co/zU8wPB0Wir 🤗 Hugging Face Daily Papers: https://t.co/tAbAQZ4pKR (If you find it useful, we’d appreciate an upvote!)
View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction