About this paper
Cross-modal representational alignment between unimodal language and vision models increases with model capability when captions are clean and informative, but remains below same-modality alignment and can exceed explicitly aligned vision-language models.
The Platonic Representation Hypothesis (PRH) suggests that neural networks are converging toward similar representation spaces. As language models become more capable, their representations are aligning with those of vision models. However, recent work has questioned whether this trend continues to hold for newer language models. Moreover, it has been shown that representation similarity metrics can be confounded by model depth and width, requiring appropriate baselines for interpretation. In this work, we first investigate where alignment emerges between unimodal models across model layers and representation dimensions. Next, we find that the PRH capability-alignment trend persists for…
Platonic Representation Hypothesis (PRH)neural networksrepresentation spaceslanguage modelsvision modelsrepresentation similarity metricsmodel depth and widthunimodal modelsmodel layersrepresentation dimensions
- Upvotes
- 6
- Authors
- 4
- Published
- Nov 9, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Where Does Alignment Emerge and What Does It Mean? A Closer Look at the Platonic Representation Hypothesis was first seen on Hugging Face · Daily papers on Nov 12, 2026. Since then it has appeared in 42 checks on 5 different days. Its best position was #22 of 30, reached on Nov 12, 21:28 UTC. It dropped off the list after Nov 16, 03:28 UTC.