About this paper
SOMA is a benchmark assessing fine-grained egocentric body-motion reasoning in multimodal models, revealing substantial gaps versus human performance and providing training data and a multimodal baseline to advance the field.
Perceiving human body motion is critical for multimodal systems that understand and assist people. Yet current evaluations of Multimodal Large Language Models (MLLMs) largely focus on objects, scenes, and coarse actions, leaving their ability to reason about the body itself poorly assessed. This is especially challenging from the egocentric perspective, in which the body is only partially visible and motion must be inferred from occluded and temporally distributed cues. We introduce SOMA, a benchmark for fine-grained body-motion understanding from egocentric video, comprising 1,632 human-verified questions across three capability axes: body configuration, motion dynamics, and temporal…
Multimodal Large Language Modelsegocentric videobody-motion understandingtemporal reasoningcross-modal learningmultimodal baseline
- Upvotes
- 5
- Authors
- 4
- Published
- Oct 26, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
SOMA: A Benchmark for Fine-Grained Egocentric Behavior and Body-Motion Understanding was first seen on Hugging Face · Daily papers on Nov 3, 2026. Since then it has appeared in 8 checks on 2 different days. Its best position was #21 of 30, reached on Nov 3, 15:28 UTC. It dropped off the list after Nov 4, 01:28 UTC.