About this paper
A new benchmark, DominoBench, shows that current vision-language and multimodal models cannot reliably predict physical outcomes from still images unless the critical calculation and necessary quantities are provided.
Can a vision-language model look at a picture of a chain reaction and tell what will happen? Recent multimodal models describe scenes fluently and solve textbook physics problems, which suggests they should also predict how a scene of ramps, ledges, pendulums, seesaws and dominoes plays out once a ball is pushed. We tested this claim on 30 models from 10 families and reached a clear conclusion: unaided, no model predicts the outcome reliably. We built DominoBench, a benchmark of still images of 2D rigid-body scenes whose outcome a physics simulator computes. It holds 854 items in 427 minimal pairs, in which a change of one to three grid steps in one quantity decides whether one person…
vision-language modelsmultimodal modelsDominoBenchfrontier modelsopen-weight models
- Upvotes
- 3
- Authors
- 1
- Published
- Nov 16, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
DominoBench: Evaluating Multi-Step Physical Reasoning from Still Images was first seen on Hugging Face · Daily papers on Nov 17, 2026. Since then it has appeared in 8 checks on 2 different days. Its best position was #21 of 30, reached on Nov 17, 23:28 UTC. It dropped off the list after Nov 18, 05:28 UTC.