Tensor Canonical Correlation Analysis for Multi-View Dimension Reduction

Canonical correlation analysis (CCA) has proven an effective tool for two-view dimension reduction due to its profound theoretical foundation and success in practical applications. In respect of multi-view learning, however, it is limited by its capability of only handling data represented by two-view features, while in many real-world applications, the number of views is frequently many more. Although the ad hoc way of simultaneously exploring all possible pairs of features can numerically deal with multi-view data, it ignores the high order statistics (correlation information) which can only be discovered by simultaneously exploring all features. Therefore, in this work, we develop tensor CCA (TCCA) which straightforwardly yet naturally generalizes CCA to handle the data of an arbitrary number of views by analyzing the covariance tensor of the different views. TCCA aims to directly maximize the canonical correlation of multiple (more than two) views. Crucially, we prove that the main problem of multi-view canonical correlation maximization is equivalent to finding the best rank-1 approximation of the data covariance tensor, which can be solved efficiently using the well-known alternating least squares (ALS) algorithm. As a consequence, the high order correlation information contained in the different views is explored and thus a more reliable common subspace shared by all features can be obtained. In addition, a non-linear extension of TCCA is presented. Experiments on various challenge tasks, including large scale biometric structure prediction, internet advertisement classification, and web image annotation, demonstrate the effectiveness of the proposed method.

• Publication year

  2015

• Venue

  IEEE Transactions on Knowledge and Data Engineering

• Publication date

  2015-02-08

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1109/TKDE.2015.2445757arXiv 1502.02330
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Matrix Analysis and Applications

  2017influential reference
• Multi-view dimensionality reduction via canonical random correlation analysis

  2016cited by this paper
• Multi-View Intact Space Learning

  2015cited by this paper
• Multiview Matrix Completion for Multilabel Image Classification

  2015cited by this paper
• KNOWLEDGE FUSION FOR PROBABILISTIC GENERATIVE CLASSIFIERS WITH DATA MINING APPLICATIONS

  2015influential reference
• K-Means-Based Consensus Clustering: A Unified View

  2015cited by this paper
• EMR: A Scalable Graph-Based Ranking Model for Content-Based Image Retrieval

  2015cited by this paper
• Discovery of Ranking Fraud for Mobile Apps

  2015cited by this paper
• Efficient Semi-Supervised Feature Selection: Constraint, Relevance, and Redundancy

  2014influential reference
• Pre-Trained Multi-View Word Embedding Using Two-Side Neural Network

  2014cited by this paper
• A Cocktail Approach for Travel Package Recommendation

  2014cited by this paper
• Semi-Supervised Learning

  2014cited by this paper
• Large-Margin Multi-ViewInformation Bottleneck

  2014cited by this paper
• Decomposition-Based Transfer Distance Metric Learning for Image Classification

  2014cited by this paper
• Convergence Analysis of Graph Regularized Non-Negative Matrix Factorization

  2014cited by this paper
• Knowledge Fusion for Probabilistic Generative Classifiers with Data Mining Applications

  2014influential reference
• Group Sparse Multiview Patch Alignment Framework With View Consistency for Image Classification

  2014cited by this paper
• Hessian Regularized Support Vector Machines for Mobile Image Annotation on the Cloud

  2013cited by this paper
• Multiview Vector-Valued Manifold Regularization for Multilabel Image Classification

  2013cited by this paper
• Manifold Regularized Multitask Learning for Semi-Supervised Multilabel Image Classification

  2013cited by this paper
• Multi-source learning with block-wise missing data for Alzheimer's disease prediction

  2013cited by this paper
• Vector-Valued Multi-View Semi-Supervsed Learning for Multi-Label Image Classification

  2013cited by this paper
• Sparse 2-D Canonical Correlation Analysis via Low Rank Matrix Approximation for Feature Extraction

  2012cited by this paper
• Sparse Unsupervised Dimensionality Reduction for Multiple View Data

  2012influential reference
• Convex Multi-view Subspace Learning

  2012influential reference
• Sparse Higher-Order Principal Components Analysis

  2012influential reference
• Large-Margin Predictive Latent Subspace Learning for Multiview Data Analysis

  2012influential reference
• Matrix Completion for Multi-label Image Classification

  2011cited by this paper
• Co-regularized Multi-view Spectral Clustering

  2011cited by this paper
• Learning Multi-modal Similarity

  2010cited by this paper
• Multiview Spectral Embedding

  2010cited by this paper
• Local Two-Dimensional Canonical Correlation Analysis

  2010cited by this paper
• Canonical Correlation Analysis of Video Volume Tensors for Action Categorization and Detection

  2009cited by this paper
• Learning a dense multi-view representation for detection, viewpoint classification and synthesis of object categories

  2009influential reference
• NUS-WIDE: a real-world web image database from National University of Singapore

  2009cited by this paper
• TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation

  2009cited by this paper
• Multi-view clustering via canonical correlation analysis

  2009cited by this paper
• Structured Variable Selection with Sparsity-Inducing Norms

  2009cited by this paper
• Tensor decompositions, alternating least squares and other tales

  2009influential reference
• Incremental tensor analysis: Theory and applications

  2008cited by this paper
• Multi-View Dimensionality Reduction via Canonical Correlation Analysis

  2008influential reference
• A General Model for Multiple View Unsupervised Learning

  2008influential reference
• Correlational spectral clustering

  2008cited by this paper
• General Tensor Discriminant Analysis and Gabor Features for Gait Recognition

  2007cited by this paper
• Knowledge and Information Systems REGULAR PAPER

  2007cited by this paper
• Multi-view Regression Via Canonical Correlation Analysis

  2007influential reference
• A learning algorithm for adaptive canonical correlation analysis of several data sets

  2007influential reference
• Two-Dimensional Canonical Correlation Analysis

  2007cited by this paper
• Semi-Supervised Learning

  2006cited by this paper
• Two view learning: SVM-2K, Theory and Practice

  2005cited by this paper
• A Probabilistic Interpretation of Canonical Correlation Analysis

  2005influential reference
• Distinctive Image Features from Scale-Invariant Keypoints

  2004influential reference
• Canonical Correlation Analysis: An Overview with Application to Learning Methods

  2004influential reference
• Kernel Methods for Pattern Analysis

  2004cited by this paper
• Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond

  2003influential reference
• Learning the Kernel Matrix with Semidefinite Programming

  2002influential reference
• Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope

  2001cited by this paper
• Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering

  2001cited by this paper
• On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors

  2000influential reference
• A Multilinear Singular Value Decomposition

  2000influential reference
• Learning to remove Internet advertisements

  1999cited by this paper
• Principal component analysis of three-mode data by means of alternating least squares algorithms

  1980influential reference
• Canonical Analysis of Several Sets of Variables

  1973influential reference
• Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition

  1970cited by this paper
• Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Learning Canonical Correlations of Paired Tensor Sets Via Tensor-to-Vector Projection

  year unknowncited by this paper
• Article in Press Pattern Recognition Multiple View Semi-supervised Dimensionality Reduction

  year unknowncited by this paper

• Graph-enhanced dual low-rank correlation embedding for spatio-temporal EEG fusion in depression recognition.

  2026cites this paper
• Functional Tensor Regression

  2025cites this paper
• Adaptive Dictionary Learning for Multiview Subspace Clustering

  2025cites this paper
• Multi L0-DTCCA: Multimodal Emotion Recognition Method Based on L0-Sparse Deep Tensor Canonical Correlation Analysis

  2025influential citation
• Importance-aware nonlocal tensor nuclear norm for high-dimensional image recovery

  2025cites this paper
• Topology-Preserved Information Bottleneck for Multiview Anomaly Detection

  2025cites this paper
• Genre-aware user profiling using duration count matrices: A novel approach to enhancing content recommendation systems

  2025cites this paper
• The Pathway-Informed Deep Learning Models in Cancer Research: A Survey

  2025cites this paper
• Sparse Tensor CCA via Manifold Optimization for Multi-View Learning

  2025cites this paper
• A generalized higher-order correlation analysis framework for multi-omics network inference

  2025cites this paper
• Foundations and Innovations in Data Fusion and Ensemble Learning for Effective Consensus

  2025cites this paper
• CNN-CCA: A deep learning approach for anomaly detection in metro rail sensor time-series data

  2025cites this paper
• Adaptive group sparse multi-view classification method based on mutual information

  2025cites this paper
• Dimension reduction for hyperspectral image classification via discriminant spatial–spectral tensor locality preserving projection

  2025cites this paper
• Multiclass and Multilabel Classifications by Consensus and Complementarity-Based Multiview Latent Space Projection

  2024cites this paper
• Partially View-Aligned Representation Learning via Cross-View Graph Contrastive Network

  2024cites this paper
• A Generalized Higher-order Correlation Analysis Framework for Multi-Omics Network Inference

  2024cites this paper
• MUNPE:Multi-view uncorrelated neighborhood preserving embedding for unsupervised feature extraction

  2024cites this paper
• Evidential Deep Partial Multi-View Classification With Discount Fusion

  2024cites this paper
• Stable biomarker discovery in multi-omics data via canonical correlation analysis

  2024cites this paper
• MvHAAN: multi-view hierarchical attention adversarial network for person re-identification

  2024cites this paper
• Multiview Fuzzy Concept-Cognitive Learning With High-Order Information Fusion of Fuzzy Attributes

  2024cites this paper
• Discriminative Multi-View Fusion via Adaptive Regression

  2024cites this paper
• Estimation for pain from facial expression based on XQEDA and deep learning

  2024cites this paper
• Towards Robust Uncertainty-Aware Incomplete Multi-View Classification

  2024cites this paper
• Tensor Correlation Fusion for Multimodal Physiological Signal Emotion Recognition

  2024influential citation
• cuFastTucker: A Novel Sparse FastTucker Decomposition For HHLST on Multi-GPUs

  2024cites this paper
• Group Lasso with Checkpoints Selection for Biological Data Regression

  2023cites this paper
• Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learning

  2023cites this paper
• A novel descriptor (LGBQ) based on Gabor filters

  2023cites this paper
• A Discriminant Information Theoretic Learning Framework for Multi-modal Feature Representation

  2023cites this paper
• Unified Low-Rank Tensor Learning and Spectral Embedding for Multi-View Subspace Clustering

  2023cites this paper
• Resilient Countermeasures Against Cyber-Attacks on Self-Driving Car Architecture

  2023cites this paper
• Multiview Structural Large Margin Classifier and its Safe Acceleration Strategy

  2023cites this paper
• Multi-Group Tensor Canonical Correlation Analysis

  2023cites this paper
• Adaptive-weighted deep multi-view clustering with uniform scale representation

  2023cites this paper
• Robust generalized canonical correlation analysis

  2023cites this paper
• Exploring and Exploiting Uncertainty for Incomplete Multi-View Classification

  2023cites this paper
• Handwriting Analysis on the Diaries of Rosamond Jacob

  2023influential citation
• A primer on correlation-based dimension reduction methods for multi-omics analysis

  2023cites this paper
• Tensor Generalized Canonical Correlation Analysis

  2023cites this paper
• Association Testing for High-Dimensional Multiple Response Regression

  2023influential citation
• Distilling sub-space structure across views for cardiac indices estimation

  2023cites this paper
• Incomplete Multi-View Clustering With Reconstructed Views

  2023cites this paper
• Partial Tubal Nuclear Norm-Regularized Multiview Subspace Learning

  2023influential citation
• Learning High-Order Multi-View Representation by New Tensor Canonical Correlation Analysis

  2023cites this paper
• Multi-View Fuzzy Representation Learning With Rules Based Model

  2023cites this paper
• Finding Explanations in AI Fusion of Electro-Optical/Passive Radio-Frequency Data

  2023cites this paper
• Multi-view Discriminative Fusion on Canonical Correlation Analysis in Event Classification

  2023cites this paper
• Learning Canonical $\mathcal{F}$-Correlation Projection for Compact Multiview Representation

  2022cites this paper
• Tensor-based Multi-view Spectral Clustering via Shared Latent Space

  2022influential citation
• cuFasterTucker: A Stochastic Optimization Strategy for Parallel Sparse FastTucker Decomposition on GPU Platform

  2022cites this paper
• Adaptive incomplete multi-view learning via tensor graph completion

  2022influential citation
• Handling Slice Permutations Variability in Tensor Recovery

  2022cites this paper
• Higher Order Correlation Analysis for Multi-View Learning

  2022influential citation
• A novel unsupervised multiple feature hashing for image retrieval and indexing (MFHIRI)

  2022cites this paper
• cu_FastTucker: A Faster and Stabler Stochastic Optimization for Parallel Sparse Tucker Decomposition on Multi-GPUs

  2022cites this paper
• GSpTC: High-Performance Sparse Tensor Contraction on CPU-GPU Heterogeneous Systems

  2022cites this paper
• Semi-supervised multi-view clustering with dual hypergraph regularized partially shared non-negative matrix factorization

  2022cites this paper
• Cross-view Graph Contrastive Representation Learning on Partially Aligned Multi-view Data

  2022cites this paper
• Hierarchical Representation for Multi-view Clustering: From Intra-sample to Intra-view to Inter-view

  2022cites this paper
• Multiview nonlinear discriminant structure learning for emotion recognition

  2022cites this paper
• Multimodal Image Classification by Multiview Latent Pattern Extraction, Selection, and Correlation

  2022cites this paper
• inMTSCCA: An Integrated Multi-task Sparse Canonical Correlation Analysis for Multi-omic Brain Imaging Genetics

  2022cites this paper
• Incomplete Multi-view Learning via Consensus Graph Completion

  2022cites this paper
• Multivariate Modeling Analysis Based on Partial Least Squares Regression and Principal Component Regression

  2022cites this paper
• RTIM Hashing: Robust and Compact Video Hashing With a Rotation- and Translation-Invariant Model

  2022cites this paper
• KNH: Multi-View Modeling with K-Nearest Hyperplanes Graph for Misinformation Detection

  2021cites this paper
• A Novel Stochastic Optimization Strategy for Parallel Sparse Tucker Decomposition

  2021cites this paper
• Generalized canonical correlation analysis for labeled data

  2021cites this paper
• Multi-view Teacher-Student Network

  2021cites this paper
• circRNA-binding protein site prediction based on multi-view deep learning, subspace learning and multi-view classifier

  2021cites this paper
• Sparse additive discriminant canonical correlation analysis for multiple features fusion

  2021cites this paper
• Integration strategies of multi-omics data for machine learning analysis

  2021cites this paper
• Toward a Wearable Crowdsource System to Monitor Respiratory Symptoms for Pandemic Early Warning

  2021cites this paper
• Multi-Tensor Network Representation for High-Order Tensor Completion

  2021cites this paper
• An Online Riemannian PCA for Stochastic Canonical Correlation Analysis

  2021cites this paper
• A Structure-Exploiting Nested Lanczos-Type Iteration for the Multiview Canonical Correlation Analysis

  2021cites this paper
• Incomplete multi-view clustering with cosine similarity

  2021cites this paper
• A Novel Stochastic Optimization Strategy for Parallel Sparse Tucker Decomposition

  2021cites this paper
• One-Step Multiview Subspace Segmentation via Joint Skinny Tensor Learning and Latent Clustering

  2021cites this paper
• Tensor-based restricted kernel machines for multi-view classification

  2021cites this paper
• Various dimension reduction techniques for high dimensional data analysis: a review

  2021cites this paper
• Attentive multi-view deep subspace clustering net

  2021cites this paper
• Low-rank constrained weighted discriminative regression for multi-view feature learning

  2021cites this paper
• MulticlusterKDE: a new algorithm for clustering based on multivariate kernel density estimation

  2020cites this paper
• Opportunities in tensorial data analytics for chemical and biological manufacturing processes

  2020cites this paper
• Nonlinear dimensionality reduction in robot vision for industrial monitoring process via deep three dimensional Spearman correlation analysis (D3D-SCA)

  2020cites this paper
• An efficient data masking for securing medical data using DNA encoding and chaotic system

  2020cites this paper
• Multiview Uncorrelated Locality Preserving Projection

  2020influential citation
• Tensor Canonical Correlation Analysis With Convergence and Statistical Guarantees

  2020cites this paper
• Hyperspectral Image Dimension Reduction Using Weight Modified Tensor-Patch-Based Methods

  2020cites this paper
• xTML: A Unified Heterogeneous Transfer Metric Learning Framework for Multimedia Applications [Application Notes]

  2020cites this paper
• Supervised Fractional-Order Embedding Geometrical Multi-View CCA (SFGMCCA) for Multiple Feature Integration

  2020influential citation
• Robust canonical correlation analysis based on L1-norm minimization for feature learning and image recognition (Erratum)

  2020cites this paper
• Centralized joint sparse representation for multi-view subspace clustering

  2020cites this paper
• Hyperspectral Images Super-Resolution via Learning High-Order Coupled Tensor Ring Representation

  2020cites this paper
• Consistent Discriminant Correlation Analysis

  2020cites this paper
• Canonical Correlation Analysis With L2,1-Norm for Multiview Data Representation

  2020cites this paper
• A technical review of canonical correlation analysis for neuroscience applications

  2020influential citation