About this paper
DreamFree repurposes a pretrained video diffusion model as a predictive visual encoder through representation distillation, enabling real-time robot action prediction without generating future videos and improving control and learning from video demonstrations.
World Action Models (WAMs) use the predictive knowledge of pretrained video diffusion models for robot control through future video prediction. However, iterative video denoising is costly, and inaccurate visual predictions can compromise action prediction. Our key idea is to make this predictive knowledge available through visual representations computed from the current observation, enabling action prediction without generating future videos. We introduce DreamFree, a WAM that repurposes a pretrained video diffusion model as a predictive visual encoder through representation distillation. The visual encoder learns to predict a frozen video diffusion model's representation using only the…
World Action Modelspretrained video diffusion modelsrobot controlfuture video predictioniterative video denoisingvisual representationspredictive visual encoderrepresentation distillationfrozen video diffusion modelaction module
- Upvotes
- 6
- Authors
- 8
- Published
- Nov 4, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Future Representation Distillation for Imagination-free World Action Models was first seen on Hugging Face · Daily papers on Nov 6, 2026. Since then it has appeared in 25 checks on 3 different days. Its best position was #21 of 30, reached on Nov 7, 01:28 UTC. It is #27 right now, slipping from #24 to #27 over the last 6 checks.