Multiview Feature Learning and Multilevel Information Fusion for Joint Classification of Hyperspectral and LiDAR Data

With the rapid development of earth observation technology, the fusion of multisource remote sensing (RS) data has become an important research field in land cover classification. Particularly, the fusion of hyperspectral image (HSI) and light detection and ranging (LiDAR) data, which can provide complementary information to each other, has attracted an increasing attention for land cover classification tasks. However, most of the existing methods focus on multisource information fusion on feature level and ignore the discrepancy of the land covers with the same label among different kinds of viewpoints, which limit the further improvement of classification performance. So, this article proposes a novel HSI-LiDAR classification method based on multiview feature learning (MVFL) and multilevel information fusion (MLIF), which consists of a multiview data representation (MVDR) strategy, a multibranch dual-channel graph convolutional networks (MB-DCGCNs) model, and a progressively high-confidence label assignment (PHCLA) scheme. MVDR is designed by jointly utilizing multiple attributes of spatial information and multisource RS data to re-express multisource land covers with diversity and complementarity. The MB-DCGCNs model, which aims at integrating spectral–spatial–elevation information on feature level, is employed on the above multiview re-expressed HSI-LiDAR (MVR-HL) data to explore land cover feature representations from different views. Furthermore, a PHCLA scheme is proposed to classify the land covers with high-reliability by a combination of decision-level label prediction and pixel-level label assignment. Comparative experiments on two benchmark datasets with several state-of-the-art classification methods validate the effectiveness and superior performance of the proposed method.

• Publication year

  2023

• Venue

  IEEE Transactions on Geoscience and Remote Sensing

• Publication date

  Unknown publication date

• Fields of study

  Computer Science, Engineering, Environmental Science

• Identifiers
  DOI 10.1109/TGRS.2023.3325818
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Coupled adversarial learning for fusion classification of hyperspectral and LiDAR data

  2023cited by this paper
• Global–Local Transformer Network for HSI and LiDAR Data Joint Classification

  2022cited by this paper
• Hyperspectral Image Classification Based on Semisupervised Self-Learning and Multiview Information Fusion

  2022cited by this paper
• Multi-view learning for hyperspectral image classification: An overview

  2022cited by this paper
• Optimized Spatial Gradient Transfer for Hyperspectral-LiDAR Data Classification

  2022cited by this paper
• Feature-Based Constraint Deep CNN Method for Mapping Rainfall-Induced Landslides in Remote Regions With Mountainous Terrain: An Application to Brazil

  2022cited by this paper
• Fusion of optical, radar and waveform LiDAR observations for land cover classification

  2022cited by this paper
• Progress and Challenges in Intelligent Remote Sensing Satellite Systems

  2022cited by this paper
• A Multiview Spectral–Spatial Feature Extraction and Fusion Framework for Hyperspectral Image Classification

  2022influential reference
• Convolutional Neural Networks for Multimodal Remote Sensing Data Classification

  2022cited by this paper
• A comprehensive review of hyperspectral data fusion with lidar and sar data

  2021cited by this paper
• Multiple Feature-Based Superpixel-Level Decision Fusion for Hyperspectral and LiDAR Data Classification

  2021cited by this paper
• Deep Multiview Learning for Hyperspectral Image Classification

  2021cited by this paper
• Relative Total Variation Structure Analysis-Based Fusion Method for Hyperspectral and LiDAR Data Classification

  2021cited by this paper
• Fractional Gabor Convolutional Network for Multisource Remote Sensing Data Classification

  2021cited by this paper
• Deep multi-view learning methods: A review

  2021cited by this paper
• Ensemble of multiple CNN classifiers for HSI classification with Superpixel Smoothing

  2021cited by this paper
• Gabor Features Extraction and Land-Cover Classification of Urban Hyperspectral Images for Remote Sensing Applications

  2021cited by this paper
• Hyperspectral and Lidar Data Applied to the Urban Land Cover Machine Learning and Neural-Network-Based Classification: A Review

  2021cited by this paper
• A Fast Hyperspectral Anomaly Detection Algorithm Based on Greedy Bilateral Smoothing and Extended Multi-Attribute Profile

  2021cited by this paper
• Multilevel Superpixel Structured Graph U-Nets for Hyperspectral Image Classification

  2021cited by this paper
• Classification of Hyperspectral and LiDAR Data Using Coupled CNNs

  2020cited by this paper
• Deep Encoder–Decoder Networks for Classification of Hyperspectral and LiDAR Data

  2020cited by this paper
• CNN-Enhanced Graph Convolutional Network With Pixel- and Superpixel-Level Feature Fusion for Hyperspectral Image Classification

  2020cited by this paper
• Multilevel Structure Extraction-Based Multi-Sensor Data Fusion

  2020cited by this paper
• More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification

  2020cited by this paper
• Graph Convolutional Networks for Hyperspectral Image Classification

  2020cited by this paper
• Joint Classification of Hyperspectral and LiDAR Data Using Hierarchical Random Walk and Deep CNN Architecture

  2020cited by this paper
• An overview on spectral and spatial information fusion for hyperspectral image classification: Current trends and challenges

  2020cited by this paper
• Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art

  2019cited by this paper
• Multi-GCN: Graph Convolutional Networks for Multi-View Networks, with Applications to Global Poverty

  2019cited by this paper
• Deep Learning for Hyperspectral Image Classification: An Overview

  2019cited by this paper
• Hyperspectral Image Classification Using Convolutional Neural Networks and Multiple Feature Learning

  2018cited by this paper
• Multisource Remote Sensing Data Classification Based on Convolutional Neural Network

  2018cited by this paper
• Hyperspectral and LiDAR Data Fusion Using Extinction Profiles and Deep Convolutional Neural Network

  2017cited by this paper
• Hyperspectral and LiDAR Fusion Using Extinction Profiles and Total Variation Component Analysis

  2017cited by this paper
• Deep learning in remote sensing: a review

  2017cited by this paper
• Discriminative Graph-Based Fusion of HSI and LiDAR Data for Urban Area Classification

  2017cited by this paper
• Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art

  2016cited by this paper
• Semi-Supervised Classification with Graph Convolutional Networks

  2016cited by this paper
• Fusion of waveform LiDAR data and hyperspectral imagery for land cover classification

  2015cited by this paper
• Generalized Graph-Based Fusion of Hyperspectral and LiDAR Data Using Morphological Features

  2015cited by this paper
• Fusion of Hyperspectral and LiDAR Remote Sensing Data Using Multiple Feature Learning

  2015cited by this paper
• Pixel- and feature-level fusion of hyperspectral and lidar data for urban land-use classification

  2015cited by this paper
• Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering

  2014cited by this paper

• AM2CFN: Assimilation Modality Mapping Guided Crossmodal Fusion Network for HSI and LiDAR Data Joint Classification

  2025cites this paper
• Coarse-to-Fine High-Order Network for Hyperspectral and LiDAR Classification

  2025cites this paper
• IDNet: Intensity-Constrained Detail-Enhanced Network for Hyperspectral and LiDAR Collaborative Classification

  2025cites this paper
• Heterogeneous Contrastive Graph Fusion Network for Classification of Hyperspectral and LiDAR Data

  2025cites this paper
• CSTC: Visual Transformer Network with Multimodal Dual Fusion for Hyperspectral and LiDAR Image Classification

  2025cites this paper
• Multi-View Data Fusion in Feature and Decision Spaces for Flood Inundation Mapping

  2025cites this paper
• Global Clue-Guided Cross-Memory Quaternion Transformer Network for Multisource Remote Sensing Data Classification

  2024cites this paper
• MAMInet II: Illumination-Insensitive Modalitywise Assimilation Guided Multistage Interaction Network for Hyperspectral and LiDAR Joint Classification

  2024cites this paper
• Hyperspectral and LiDAR Classification via Frequency Domain-Based Network

  2024cites this paper
• Multilevel Attention Dynamic-Scale Network for HSI and LiDAR Data Fusion Classification

  2024cites this paper
• Remote Sensing LiDAR and Hyperspectral Classification with Multi-Scale Graph Encoder-Decoder Network

  2024cites this paper
• Cross Attention-Based Multi-Scale Convolutional Fusion Network for Hyperspectral and LiDAR Joint Classification

  2024cites this paper
• Shared-Private Decoupling-Based Multilevel Feature Alignment Semisupervised Learning for HSI and LiDAR Classification

  2024cites this paper