About this paper
Visual foundation models vary in supporting persistent spatial states across structure, persistence, prediction, and action, with readout accuracy not guaranteeing history-based updates or reliable goal-directed progress.
An observer sees only part of the surrounding world, yet must keep track of what lies beyond the current view. Spatial perception therefore involves more than recognizing individual images: it calls for a persistent spatial state that is updated under self-motion and used to guide action. Do visual foundation models provide representations that support such a state? We study this question through four levels of spatial capability---spatial structure, object persistence, predictive spatial update, and actionability---using frozen-feature probes on ten representations under streaming egocentric observations of static indoor environments. The resulting capability profiles vary across tasks,…
visual foundation modelsfrozen-feature probesspatial structureobject persistencepredictive spatial updateactionabilitycamera-pose readoutfeature predictionvisible-scene readoutgoal-dependent candidate selection
- Upvotes
- 9
- Authors
- 6
- Published
- Oct 29, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Probing Spatial State Representations in Visual Foundation Models was first seen on Hugging Face · Daily papers on Nov 2, 2026. Since then it has appeared in 12 checks on 2 different days. Its best position was #17 of 30, reached on Nov 2, 19:28 UTC. It dropped off the list after Nov 3, 07:28 UTC.