WeMM-Video is a family of Chinese-English bilingual omni-modal foundation models that unify text, image, audio, and video processing for joint audio-visual perception and reasoning, using hybrid thinking modes and large-scale training to achieve strong open-source video understanding results.
Video understanding, particularly with accompanying audio, remains a central challenge in multimodal intelligence. In this report, we introduce WeMM-Video, a family of Chinese-English bilingual omni-modal foundation models spanning 2B, 4B, 9B, and 35B-A3B variants. Centering on joint audio-visual perception and reasoning, WeMM-Video unifies text, image, audio, and video processing within a hybrid-thinking paradigm, seamlessly supporting both a non-thinking instruct mode for fast, direct responses and a thinking mode for explicit step-by-step reasoning. The models are trained on a large-scale multimodal corpus of approximately 1.2 trillion tokens through progressive pre-training and a…
omni-modal foundation modelsjoint audio-visual perceptionjoint audio-visual reasoninghybrid-thinking paradigmnon-thinking instruct modethinking modeexplicit step-by-step reasoningprogressive pre-trainingmulti-stage post-training pipelinemulti-teacher OPD
- Upvotes
- 6
- Authors
- 12
- Published
- Nov 19, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.