Trendoday

SIRIS: Can LLMs Tell When Simulation Errors Matter in AI-Driven Systems Research

LLM agents increasingly drive systems research and rely on simulators to evaluate candidate designs at scale. Simulators are imperfect by design: their modeling limitations can distort predictions yet

  • Upvotes6
–Rank now
#11Peak rank
2Days on list
193Score · 7d
Nov 10, 2026First seen
Rank · 7 days

About this paper

A benchmark probes whether large language models can determine when imperfect simulator limitations invalidate recommended system designs, finding that identifying a limitation does not ensure correct design choices and that review-based self-correction yields mixed results.

LLM agents increasingly drive systems research and rely on simulators to evaluate candidate designs at scale. Simulators are imperfect by design: their modeling limitations can distort predictions yet leave the recommended design correct, or change which design should be selected. We introduce Siris to test whether LLMs can tell these cases apart, judging from their systems understanding when a limitation invalidates the simulator's recommendation. By perturbing a simulator, Siris constructs workload pairs with the same candidates, limitation, and simulator recommendation. The perturbation changes predictions on both workloads, yet a reference simulator supports the recommendation on only…

LLM agentslarge language modelsfrontier LLMsLLM serving design problemsself-correctionreview turn
Upvotes
6
Authors
6
Published
Nov 6, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

SIRIS: Can LLMs Tell When Simulation Errors Matter in AI-Driven Systems Research was first seen on Hugging Face · Daily papers on Nov 10, 2026. Since then it has appeared in 13 checks on 2 different days. Its best position was #11 of 30, reached on Nov 11, 05:28 UTC. It dropped off the list after Nov 11, 07:28 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 07:2813:2819:2801:2807:28 Nov 10, 07:28 UTC · #26Nov 10, 09:28 UTC · #24Nov 10, 11:28 UTC · #21Nov 10, 13:28 UTC · #17Nov 10, 15:28 UTC · #16Nov 10, 17:28 UTC · #16Nov 10, 19:28 UTC · #14Nov 10, 21:28 UTC · #13Nov 10, 23:28 UTC · #13Nov 11, 01:28 UTC · #13Nov 11, 03:28 UTC · #12Nov 11, 05:28 UTC · #11Nov 11, 07:28 UTC · #16

Last 14 days

Best rank per day (UTC).

Nov 3today

Metric history

Platform metric as reported by Hugging Face.

04812 07:2813:2819:2801:2807:28 Nov 10, 07:28 UTC · 6Nov 10, 09:28 UTC · 8Nov 10, 11:28 UTC · 8Nov 10, 13:28 UTC · 9Nov 10, 15:28 UTC · 9Nov 10, 17:28 UTC · 10Nov 10, 19:28 UTC · 12Nov 10, 21:28 UTC · 12Nov 10, 23:28 UTC · 12Nov 11, 01:28 UTC · 12Nov 11, 03:28 UTC · 12Nov 11, 05:28 UTC · 12Nov 11, 07:28 UTC · 12

Questions

Is SIRIS: Can LLMs Tell When Simulation Errors Matter in AI-Driven Systems Research trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 11, 07:28 UTC, after 2 days of trending.

What is the highest rank SIRIS: Can LLMs Tell When Simulation Errors Matter in AI-Driven Systems Research reached?

#11 on Hugging Face · Daily papers, on Nov 11, 05:28 UTC. Trendoday checks this list every 120 minutes.

How long has SIRIS: Can LLMs Tell When Simulation Errors Matter in AI-Driven Systems Research been trending?

It was first seen on Nov 10, 2026 and has been on the list on 2 days (13 checks) since.