YANAMI introduces a large-scale multimodal dialogue dataset and benchmark for stateful interaction, requiring models to track and realize evolving dialogue states across turns, and reveals that current unified multimodal models still struggle with this task.
Unified Multimodal Models (UMMs) integrate visual understanding, generation, and editing within a single unified framework. However, existing unified multimodal datasets and benchmarks remain dominated by single-turn tasks. Even in recent multi-turn datasets, many turns can be solved independently without tracking information across turns. Consequently, they provide limited supervision and evaluation for multimodal stateful interaction, which requires models to understand, maintain, update, and faithfully realize evolving dialogue states across turns. To address this gap, we introduce YANAMI, the first large-scale multimodal dialogue dataset and benchmark for stateful interaction,…
Unified Multimodal Modelsmultimodal stateful interactiondialogue state understandingvisual realizationmulti-turn multimodal dialoguesimage editingworld modelingvisual reasoning
- Upvotes
- 6
- Authors
- 13
- Published
- Nov 3, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.