Trendoday

Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents

Computer-use agents increasingly tackle tasks ranging from everyday desktop activities to long-horizon professional workflows. Yet interfaces centered on screenshots and mouse-and-keyboard actions can

  • Upvotes17
#15Rank now –
#15Peak rank
4Days on list
298Score · 7d
Nov 5, 2026First seen
Rank · 7 days

About this paper

Hybrid Computer Use unifies programmatic, accessibility-based, and visual interaction channels to improve agent efficiency and success on complex desktop tasks.

Computer-use agents increasingly tackle tasks ranging from everyday desktop activities to long-horizon professional workflows. Yet interfaces centered on screenshots and mouse-and-keyboard actions can impose a human-interaction prior, requiring repeated screen interpretation while leaving the computer's semantic and programmatic capabilities underexposed. We argue for exposing these capabilities and letting models choose and combine them. We introduce Hybrid Computer Use (HCU), a unified interface for general agents that combines three complementary channels: programmatic interaction through code and command-line tools, semantic interaction through accessibility (AX), and visual…

Hybrid Computer Useprogrammatic interactionaccessibility (AX)GUIAX diffsOSWorld 2.0
Upvotes
17
Authors
8
Published
Oct 30, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents was first seen on Hugging Face · Daily papers on Nov 5, 2026. Since then it has appeared in 39 checks on 4 different days. Its best position was #15 of 30, reached on Nov 6, 21:28 UTC. It is #15 right now, climbing from #16 to #15 over the last 6 checks.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 Nov 5Nov 6Nov 7Nov 7Nov 8 Nov 5, 13:28 UTC · #29Nov 5, 15:28 UTC · #25Nov 5, 17:28 UTC · #25Nov 5, 19:28 UTC · #27Nov 5, 21:28 UTC · #28Nov 5, 23:28 UTC · #23Nov 6, 01:28 UTC · #20Nov 6, 03:28 UTC · #20Nov 6, 05:28 UTC · #19Nov 6, 07:28 UTC · #17Nov 6, 09:28 UTC · #18Nov 6, 11:28 UTC · #19Nov 6, 13:28 UTC · #20Nov 6, 15:28 UTC · #19Nov 6, 17:28 UTC · #18Nov 6, 19:28 UTC · #17Nov 6, 21:28 UTC · #15Nov 6, 23:28 UTC · #15Nov 7, 01:28 UTC · #15Nov 7, 03:28 UTC · #15Nov 7, 05:28 UTC · #15Nov 7, 07:28 UTC · #15Nov 7, 09:28 UTC · #15Nov 7, 11:28 UTC · #15Nov 7, 13:28 UTC · #15Nov 7, 15:28 UTC · #15Nov 7, 17:28 UTC · #16Nov 7, 19:28 UTC · #16Nov 7, 21:28 UTC · #16Nov 7, 23:28 UTC · #16Nov 8, 01:28 UTC · #16Nov 8, 03:28 UTC · #16Nov 8, 05:28 UTC · #16Nov 8, 07:28 UTC · #16Nov 8, 09:28 UTC · #15Nov 8, 11:28 UTC · #15Nov 8, 13:28 UTC · #15Nov 8, 15:28 UTC · #15Nov 8, 17:28 UTC · #15

Last 14 days

Best rank per day (UTC).

Oct 26today

Metric history

▲ as reported by Hugging Face.

061117 Nov 5Nov 6Nov 7Nov 7Nov 8 Nov 5, 13:28 UTC · 4Nov 5, 15:28 UTC · 6Nov 5, 17:28 UTC · 6Nov 5, 19:28 UTC · 7Nov 5, 21:28 UTC · 7Nov 5, 23:28 UTC · 9Nov 6, 01:28 UTC · 10Nov 6, 03:28 UTC · 10Nov 6, 05:28 UTC · 11Nov 6, 07:28 UTC · 13Nov 6, 09:28 UTC · 14Nov 6, 11:28 UTC · 14Nov 6, 13:28 UTC · 14Nov 6, 15:28 UTC · 14Nov 6, 17:28 UTC · 14Nov 6, 19:28 UTC · 14Nov 6, 21:28 UTC · 14Nov 6, 23:28 UTC · 14Nov 7, 01:28 UTC · 14Nov 7, 03:28 UTC · 14Nov 7, 05:28 UTC · 14Nov 7, 07:28 UTC · 14Nov 7, 09:28 UTC · 15Nov 7, 11:28 UTC · 15Nov 7, 13:28 UTC · 15Nov 7, 15:28 UTC · 15Nov 7, 17:28 UTC · 15Nov 7, 19:28 UTC · 16Nov 7, 21:28 UTC · 16Nov 7, 23:28 UTC · 16Nov 8, 01:28 UTC · 16Nov 8, 03:28 UTC · 16Nov 8, 05:28 UTC · 16Nov 8, 07:28 UTC · 16Nov 8, 09:28 UTC · 17Nov 8, 11:28 UTC · 17Nov 8, 13:28 UTC · 17Nov 8, 15:28 UTC · 17Nov 8, 17:28 UTC · 17

Questions

Is Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents trending on HF Daily Papers right now?

Yes. As of Nov 8, 17:28 UTC it is #15, climbing from #16 to #15 over the last 6 checks.

What is the highest rank Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents reached?

#15 on Hugging Face · Daily papers, on Nov 6, 21:28 UTC. Trendoday checks this list every 120 minutes.

How long has Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents been trending?

It was first seen on Nov 5, 2026 and has been on the list on 4 days (39 checks) since.