EmbeddingGemma 2 is an open multimodal embedding model that unifies text, images, audio, and video representations with efficient resource-flexible design and state-of-the-art benchmark performance.
We present EmbeddingGemma 2, an open multimodal embedding model which natively represents text, images, audio, video, and combinations thereof in a unified space. Our approach introduces improvements such as simplified per-layer embeddings and a multi-stage curriculum with modality and objective progression which ensure strong quality across unimodal, cross-modal, and mixed-modal evaluations. Notably, in comprehensive embedding benchmarks across all modalities, EmbeddingGemma 2 establishes a new Pareto frontier, outperforming both specialist models and models two to twelve times larger. Furthermore, our design offers flexibility for resource-constrained environments, supporting selective…
multimodal embedding modelper-layer embeddingsmulti-stage curriculumcross-modalmixed-modalPareto frontierselective modality encoder loadingvision token budgetstruncatable embedding dimensionsquantized weights
- Upvotes
- 21
- Authors
- 73
- Published
- Oct 27, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.