Trendoday

SWE-CoWork: Benchmarking Coding Agents as Digital Employees in Organizations

A coding agent working within a software organization must establish what to build, collaborate with colleagues, and verify what it delivers. We introduce SWE-CoWork, a benchmark comprising 101 develo

  • Upvotes21
–Rank now
#5Peak rank
2Days on list
306Score · 7d
Nov 17, 2026First seen
Rank · 7 days

About this paper

A benchmark of realistic software engineering assignments reveals that current coding agents struggle to track requirements from clarification through implementation, verification, and handoff, completing few tasks despite partial test success.

A coding agent working within a software organization must establish what to build, collaborate with colleagues, and verify what it delivers. We introduce SWE-CoWork, a benchmark comprising 101 development assignments across 101 real repositories, 11 programming languages, and 12 application domains. Each assignment places an agent in a simulated engineering organization with 26 colleagues who have distinct responsibilities, bounded knowledge, and controlled collaboration behavior. Starting from a brief handoff, agents must recover requirements distributed across colleagues and workplace records, reconcile conflicting evidence, and implement changes evaluated by private executable tests.…

coding agentbenchmarkfail-to-pass (F2P) testsrequirement-level trajectory analysisautonomous software engineeringrequirement tracking
Upvotes
21
Authors
26
Published
Nov 15, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

SWE-CoWork: Benchmarking Coding Agents as Digital Employees in Organizations was first seen on Hugging Face · Daily papers on Nov 17, 2026. Since then it has appeared in 12 checks on 2 different days. Its best position was #5 of 30, reached on Nov 18, 05:28 UTC. It dropped off the list after Nov 18, 07:28 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 09:2814:5820:2801:5807:28 Nov 17, 09:28 UTC · #10Nov 17, 11:28 UTC · #8Nov 17, 13:28 UTC · #9Nov 17, 15:28 UTC · #8Nov 17, 17:28 UTC · #6Nov 17, 19:28 UTC · #6Nov 17, 21:28 UTC · #6Nov 17, 23:28 UTC · #6Nov 18, 01:28 UTC · #6Nov 18, 03:28 UTC · #6Nov 18, 05:28 UTC · #5Nov 18, 07:28 UTC · #5

Last 14 days

Best rank per day (UTC).

Nov 9today

Metric history

Platform metric as reported by Hugging Face.

0163249 09:2814:5820:2801:5807:28 Nov 17, 09:28 UTC · 21Nov 17, 11:28 UTC · 27Nov 17, 13:28 UTC · 32Nov 17, 15:28 UTC · 35Nov 17, 17:28 UTC · 44Nov 17, 19:28 UTC · 44Nov 17, 21:28 UTC · 44Nov 17, 23:28 UTC · 44Nov 18, 01:28 UTC · 45Nov 18, 03:28 UTC · 46Nov 18, 05:28 UTC · 47Nov 18, 07:28 UTC · 49

Questions

Is SWE-CoWork: Benchmarking Coding Agents as Digital Employees in Organizations trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 18, 07:28 UTC, after 2 days of trending.

What is the highest rank SWE-CoWork: Benchmarking Coding Agents as Digital Employees in Organizations reached?

#5 on Hugging Face · Daily papers, on Nov 18, 05:28 UTC. Trendoday checks this list every 120 minutes.

How long has SWE-CoWork: Benchmarking Coding Agents as Digital Employees in Organizations been trending?

It was first seen on Nov 17, 2026 and has been on the list on 2 days (12 checks) since.