Dependency, Compression, and Synergy: A Unified Information-Theoretic View of Multimodal Learning.

arXiv:2609.14421v1 Announce Type: cross Abstract: Recent advances in multimodal foundation models have intensified the need to understand how different modalities share, preserve, and complement information. Mutual Information (MI), the Information Bottleneck