Interpretable Multi-View Representation Learning Towards Complex Scenes: From Homogeneity to Heterogeneity

Ying Zou,Zihan Fang,Shide Du,Yilin Wu,Hong Zhao,Shiping Wang

Published 2026 in IEEE transactions on multimedia

ABSTRACT

Multi-view representation learning is recognized for its effectiveness in multi-source data analysis, yet it faces significant challenges: 1) Deep model structures remain opaque, lacking interpretability; 2) Research on compatibility models toward multi-feature and multi-relation data is insufficient. In this paper, we introduce an interpretable multi-view representation learning framework specifically designed for the complex multi-view scene. The barrier to achieving compatibility stems from the need to simultaneously process the homogeneous information inherent in multiple features and the heterogeneous characteristic of multi-relation data. To address this, we design an objective function solved by iterative methods to learn comprehensive relations and consistent representation. The introduction of comprehensive relations aims to mitigate mutual interference among different data types while combining information abstracted from original features and relations into a unified representation. We then convert iterative solutions into feed-forward network layers with embedded learnable modules, resulting in a deep network architecture that is interpretable at the design level. Extensive experimental results demonstrate the superior performance of the proposed method over state-of-the-art approaches.

PUBLICATION RECORD

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-41 of 41 references · Page 1 of 1

CITED BY

  • No citing papers are available for this paper.

Showing 0-0 of 0 citing papers · Page 1 of 1