A task-adaptive agentic framework utilizes 3D proxies, physics simulation, and multi-agent coordination to enhance the structural control, physical plausibility, and visual realism of generated videos.
Code2Video uses agent-authored 3D proxies to guide video generation, enabling explicit control over structure and dynamics. However, how to construct proxies and prompts for optimal downstream quality remains underexplored, as do the capabilities and limitations of this paradigm. Through controlled experiments and blinded human evaluation, we study proxy granularity, physics simulation, and prompting. The results reveal task-dependent trade-offs: coarse proxies favor natural motion, while medium-grained proxies favor consistency. Physics simulation and proxy-aligned prompting further improve average quality. Guided by these findings, we introduce Coda-DaVinci, a task-adaptive agentic…
3D proxiesProxy granularityPhysics simulationProxy-aligned promptingCoda-DaVinciTask-adaptive agentic frameworkMulti-agent harnessInstruction followingScene consistencyPhysical plausibility
- Upvotes
- 7
- Authors
- 23
- Published
- Nov 19, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.