A Dual Attention KPConv Network Combined With Attention Gates for Semantic Segmentation of ALS Point Clouds

Jinbiao Zhao,Hangyu Zhou,Feifei Pan

Published 2024 in IEEE Transactions on Geoscience and Remote Sensing

ABSTRACT

Kernel point convolution (KPConv) defines convolutional weights based on Euclidean distances between kernel points and input points and has shown good segmentation results on several datasets. However, it does not consider the intrinsic connection between input points and features, which is crucial for the semantic segmentation of airborne laser scanning (ALS) point clouds with sparse density and complex backgrounds. To address this problem, we design a dual attention KPConv network (DAKAG-Net) combined with attention gates for semantic segmentation of ALS point clouds. Specifically, we design the channel and spatial attention KPConv (CSAKPConv) block in the encoding process, which first performs adaptive feature refinement of the input mapping along two separate dimensions, channel and spatial, and then performs kernel point convolution. In addition, to enhance the use of high-level semantic information and detect objects of varying sizes, DAKAG-Net incorporates multiple attention gates (MAGs) that merge the lowest-level features, skip-connected features, and corresponding upsampled features during the decoding process. The decoded features are ultimately convolved with convolution kernels of various sizes and then merged to acquire multiscale perceptual field features. The proposed DAKAG-Net improves the OA, mF1, and mIoU by 3.5%, 3.1%, and 3.5%, respectively, compared with the baseline results on the ISPRS 3-D dataset, and yields the segmentation accuracy rates of 85.2% (OA), 73.7% (mF1), and 61.2% (mIoU). Moreover, the DAKAG-Net also obtains new state-of-the-art segmentation results on the DFC2019 dataset and the LASDU dataset.

PUBLICATION RECORD

  • Publication year

    2024

  • Venue

    IEEE Transactions on Geoscience and Remote Sensing

  • Publication date

    Unknown publication date

  • Fields of study

    Computer Science, Engineering, Environmental Science

  • Identifiers
  • External record

    Open on Semantic Scholar

  • Source metadata

    Semantic Scholar

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-53 of 53 references · Page 1 of 1