About this paper
Executable code representations of video content improve reasoning and reconstruction over natural language, yet current multimodal models still struggle to generate faithful code captions for complex temporal dynamics.
Video captioning aims to preserve visual information through compact descriptions, predominantly using natural language. However, precisely expressing fine-grained spatial structures and temporal dynamics in natural language often leads to lengthy and potentially ambiguous descriptions. In this work, we explore Code as Video Caption, a paradigm where executable programs serve as a complementary representation of visual content through graphical primitives, layout rules, and functions of time. To examine whether code captions effectively preserve video information, we compare them with natural language captions on downstream question answering and video reconstruction tasks. Our results…
multimodal large language modelscode captioningtemporal dynamicsgraphical primitivesvideo reconstructionCodeCap-Bench
- Upvotes
- 49
- Authors
- 14
- Published
- Oct 27, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
CodeCap-Bench: Can Code Serve as a Good Video Caption? was first seen on Hugging Face · Daily papers on Oct 28, 2026. Since then it has appeared in 24 checks on 3 different days. Its best position was #7 of 30, reached on Oct 28, 07:28 UTC. It dropped off the list after Oct 30, 01:28 UTC.