Disentangle domain features for cross-modality cardiac image segmentation

Unsupervised domain adaptation (UDA) generally learns a mapping to align the distribution of the source domain and target domain. The learned mapping can boost the performance of the model on the target data, of which the labels are unavailable for model training. Previous UDA methods mainly focus on domain-invariant features (DIFs) without considering the domain-specific features (DSFs), which could be used as complementary information to constrain the model. In this work, we propose a new UDA framework for cross-modality image segmentation. The framework first disentangles each domain into the DIFs and DSFs. To enhance the representation of DIFs, self-attention modules are used in the encoder which allows attention-driven, long-range dependency modeling for image generation tasks. Furthermore, a zero loss is minimized to enforce the information of target (source) DSFs, contained in the source (target) images, to be as close to zero as possible. These features are then iteratively decoded and encoded twice to maintain the consistency of the anatomical structure. To improve the quality of the generated images and segmentation results, several discriminators are introduced for adversarial learning. Finally, with the source data and their DIFs, we train a segmentation network, which can be applicable to target images. We validated the proposed framework for cross-modality cardiac segmentation using two public datasets, and the results showed our method delivered promising performance and compared favorably to state-of-the-art approaches in terms of segmentation accuracies. The source code of this work will be released via https://zmiclab.github.io/projects.html, once this manuscript is accepted for publication.

• Publication year

  2021

• Venue

  Medical Image Anal.

• Publication date

  2021-04-16

• Fields of study

  Medicine, Computer Science

• Identifiers
  DOI 10.1016/j.media.2021.102078PMID 33957557
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Generative Adversarial Networks

  2021cited by this paper
• CF Distance: A New Domain Discrepancy Metric and Application to Explicit Domain Adaptation for Cross-Modality Cardiac Image Segmentation

  2020cited by this paper
• Uncertainty-aware multi-view co-training for semi-supervised medical image segmentation and domain adaptation

  2020cited by this paper
• DRIT++: Diverse Image-to-Image Translation via Disentangled Representations

  2019cited by this paper
• Evaluation of algorithms for Multi-Modality Whole Heart Segmentation: An open-access grand challenge

  2019cited by this paper
• Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentation

  2019cited by this paper
• Application of deep transfer learning for automated brain abnormality classification using MR images

  2019cited by this paper
• Learning Disentangled Semantic Representation for Domain Adaptation

  2019cited by this paper
• Unsupervised Domain Adaptation via Disentangled Representations: Application to Cross-Modality Liver Segmentation

  2019cited by this paper
• Locality Preserving Joint Transfer for Domain Adaptation

  2019cited by this paper
• Transfusion: Understanding Transfer Learning for Medical Imaging

  2019cited by this paper
• Unsupervised Domain Adaptation via Regularized Conditional Alignment

  2019cited by this paper
• Unifying Unsupervised Domain Adaptation and Zero-Shot Visual Recognition

  2019cited by this paper
• Cycle-consistent Conditional Adversarial Transfer Networks

  2019cited by this paper
• HoMM: Higher-order Moment Matching for Unsupervised Domain Adaptation

  2019cited by this paper
• Domain Intersection and Domain Difference

  2019cited by this paper
• Unsupervised Multi-modal Style Transfer for Cardiac MR Segmentation

  2019cited by this paper
• Joint Domain Alignment and Discriminative Feature Learning for Unsupervised Deep Domain Adaptation

  2018cited by this paper
• Dual Attention Network for Scene Segmentation

  2018cited by this paper
• Unsupervised Domain Adaptation for Semantic Segmentation via Class-Balanced Self-training

  2018cited by this paper
• Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images

  2018cited by this paper
• Self-Attention Generative Adversarial Networks

  2018cited by this paper
• Translating and Segmenting Multimodal Medical Volumes with Cycle- and Shape-Consistency Generative Adversarial Network

  2018cited by this paper
• Deep Visual Domain Adaptation: A Survey

  2018cited by this paper
• Domain Adaptation for Visual Applications: A Comprehensive Survey

  2017cited by this paper
• DualGAN: Unsupervised Dual Learning for Image-to-Image Translation

  2017cited by this paper
• Adversarial Discriminative Domain Adaptation

  2017cited by this paper
• Maximum Classifier Discrepancy for Unsupervised Domain Adaptation

  2017cited by this paper
• Non-local Neural Networks

  2017cited by this paper
• Dual‐core steered non‐rigid registration for multi‐modal images via bi‐directional image synthesis

  2017cited by this paper
• CyCADA: Cycle-Consistent Adversarial Domain Adaptation

  2017cited by this paper
• Learning to Discover Cross-Domain Relations with Generative Adversarial Networks

  2017cited by this paper
• Unsupervised Reverse Domain Adaptation for Synthetic Medical Images via Adversarial Training

  2017cited by this paper
• Conditional Adversarial Domain Adaptation

  2017cited by this paper
• Multivariate Mixture Model for Cardiac Segmentation from Multi-Sequence MRI

  2016cited by this paper
• Multi-scale patch and multi-modality atlases for whole heart segmentation of MRI

  2016cited by this paper
• Multivariate Mixture Model for Myocardial Segmentation Combining Multi-Source Images

  2016cited by this paper
• Unsupervised domain adaptation in brain lesion segmentation with adversarial networks

  2016cited by this paper
• Long Short-Term Memory-Networks for Machine Reading

  2016cited by this paper
• Image-to-Image Translation with Conditional Adversarial Networks

  2016cited by this paper
• InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets

  2016cited by this paper
• Unsupervised Domain Adaptation with Residual Transfer Networks

  2016cited by this paper
• U-Net: Convolutional Networks for Biomedical Image Segmentation

  2015cited by this paper
• Deep Residual Learning for Image Recognition

  2015cited by this paper
• Domain-Adversarial Training of Neural Networks

  2015cited by this paper
• SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation

  2015cited by this paper
• Unsupervised Domain Adaptation by Backpropagation

  2014cited by this paper
• Deep Domain Confusion: Maximizing for Domain Invariance

  2014cited by this paper
• Deep Learning of Representations for Unsupervised and Transfer Learning

  2011cited by this paper
• A Survey on Transfer Learning

  2010cited by this paper
• Domain Adaptation via Transfer Component Analysis

  2009cited by this paper

• Irrelevance discriminative network for enhancing cross-center generalization in medical imaging segmentation

  2026cites this paper
• Fully utilizing cross modal features to achieve precise segmentation of brain gliomas

  2026cites this paper
• Channel-wise joint disentanglement representation learning for B-mode and super-resolution ultrasound based CAD of breast cancer.

  2026cites this paper
• Multi-Source Unsupervised Domain Adaptation with dual alignment for medical image segmentation

  2026cites this paper
• ReTri: Progressive domain bridging via representation disentanglement and triple-level consistency-driven feature alignment for unsupervised domain adaptive medical image segmentation.

  2026cites this paper
• MTKD-LRS: Semi Supervised Knee Cartilage Segmentation using Eigen Low Rank Subspace Assisted Mean-Teacher Framework

  2025cites this paper
• Causal recurrent intervention for cross-modal cardiac image segmentation

  2025cites this paper
• DFuse-Net: Disentangled Multi-Modal Fusion Via Contrastive and Consistency-Aware Learning for Reliable Brain Tumor Segmentation

  2025cites this paper
• Semi-Supervised Knee Cartilage Segmentation With Successive Eigen Noise-Assisted Mean Teacher Knowledge Distillation

  2025cites this paper
• Style Content Decomposition-based Data Augmentation for Domain Generalizable Medical Image Segmentation

  2025influential citation
• [Shape-aware cross-modal domain adaptive segmentation model].

  2025cites this paper
• DFuse-Net: Disentangled feature fusion with uncertainty-aware learning for reliable multi-modal brain tumor segmentation

  2025cites this paper
• FAUDA-Net: Frequency-aware unsupervised domain adaptation network for multimodal medical image segmentation

  2025cites this paper
• IPLC+: SAM-Guided Iterative Pseudo Label Correction for Source-Free Domain Adaptation in Medical Image Segmentation

  2025cites this paper
• Data Poisoning Attack Defense and Evolutionary Domain Adaptation for Federated Medical Image Segmentation

  2025cites this paper
• Active learning for cross-modal cardiac segmentation with sparse annotation

  2025cites this paper
• Unsupervised cross-domain semantic segmentation on multi-modality ovarian tumor ultrasound data

  2025cites this paper
• Multimodal Medical Endoscopic Image Analysis via Progressive Disentangle-aware Contrastive Learning

  2025cites this paper
• Collaborative Learning of Augmentation and Disentanglement for Semi-Supervised Domain Generalized Medical Image Segmentation

  2025influential citation
• Bridging the Inter-Domain Gap through Low-Level Features for Cross-Modal Medical Image Segmentation

  2025influential citation
• CMRVAE: Contrastive margin-restrained variational auto-encoder for class-separated domain adaptation in cardiac segmentation

  2024cites this paper
• IPLC: Iterative Pseudo Label Correction Guided by SAM for Source-Free Domain Adaptation in Medical Image Segmentation

  2024cites this paper
• Multi-modal brain tumor segmentation via disentangled representation learning and region-aware contrastive learning

  2024cites this paper
• A 3-D Anatomy-Guided Self-Training Segmentation Framework for Unpaired Cross-Modality Medical Image Segmentation

  2024cites this paper
• One-to-Multiple: A Progressive Style Transfer Unsupervised Domain-Adaptive Framework for Kidney Tumor Segmentation

  2024cites this paper
• Double Banking on Knowledge: Customized Modulation and Prototypes for Multi-Modality Semi-supervised Medical Image Segmentation

  2024cites this paper
• Style mixup enhanced disentanglement learning for unsupervised domain adaptation in medical image segmentation

  2024cites this paper
• Toward Accurate Cardiac MRI Segmentation With Variational Autoencoder-Based Unsupervised Domain Adaptation

  2024cites this paper
• Cross-modality cerebrovascular segmentation based on pseudo-label generation via paired data

  2024cites this paper
• Rethinking Barely-Supervised Volumetric Medical Image Segmentation from an Unsupervised Domain Adaptation Perspective

  2024cites this paper
• Unsupervised Domain Adaptation for Cross-Modality Cardiac Image Segmentation Based on Contrastive Image Synthesis

  2024cites this paper
• Dual domain distribution disruption with semantics preservation: Unsupervised domain adaptation for medical image segmentation

  2024cites this paper
• Image-level supervision and self-training for transformer-based cross-modality tumor segmentation

  2024cites this paper
• Enhancing Cross-Modal Medical Image Segmentation through Compositionality

  2024cites this paper
• Moment-Consistent Contrastive CycleGAN for Cross-Domain Pancreatic Image Segmentation

  2024cites this paper
• Unified bi-encoder bispace-discriminator disentanglement for cross-domain echocardiography segmentation

  2024cites this paper
• Cross-Modality Medical Image Segmentation via Enhanced Feature Alignment and Cross Pseudo Supervision Learning

  2024cites this paper
• Style Consistency Unsupervised Domain Adaptation Medical Image Segmentation

  2024influential citation
• Deep learning for unsupervised domain adaptation in medical imaging: Recent advancements and future perspectives

  2023cites this paper
• Partial Unbalanced Feature Transport for Cross-Modality Cardiac Image Segmentation

  2023influential citation
• WS-LungNet: A two-stage weakly-supervised lung cancer detection and diagnosis network

  2023cites this paper
• Aligning Multi-Sequence CMR Towards Fully Automated Myocardial Pathology Segmentation

  2023cites this paper
• A modality-collaborative convolution and transformer hybrid network for unpaired multi-modal medical image segmentation with limited annotations.

  2023cites this paper
• Siamese semi-disentanglement network for robust PET-CT segmentation

  2023cites this paper
• Causal knowledge fusion for 3D cross-modality cardiac image segmentation

  2023cites this paper
• Automatic Multiparametric Magnetic Resonance Imaging‐Based Prostate Lesions Assessment with Unsupervised Domain Adaptation

  2023cites this paper
• A review of disentangled representation learning for visual data processing and analysis

  2023cites this paper
• Unpaired, unsupervised domain adaptation assumes your domains are already similar

  2023cites this paper
• Unsupervised deep consistency learning adaptation network for cardiac cross-modality structural segmentation

  2023cites this paper
• EDRL: Entropy-guided disentangled representation learning for unsupervised domain adaptation in semantic segmentation

  2023cites this paper
• Tissue Segmentation of Thick-Slice Fetal Brain MR Scans With Guidance From High-Quality Isotropic Volumes

  2023cites this paper
• Training Cross-Modality Cerebrovascular Segmentation Networks With Paired Images

  2023cites this paper
• UPL-SFDA: Uncertainty-Aware Pseudo Label Guided Source-Free Domain Adaptation for Medical Image Segmentation

  2023cites this paper
• Medical Image Segmentation with Domain Adaptation: A Survey

  2023influential citation
• Image-level supervision and self-training for transformer-based cross-modality tumor segmentation

  2023cites this paper
• An Unsupervised Domain Adaptation Model Based on Multi-Level Joint Alignment for Multi-Modal Cardiac Image Segmentation

  2023cites this paper
• ST-GAN: A Swin Transformer-Based Generative Adversarial Network for Unsupervised Domain Adaptation of Cross-Modality Cardiac Segmentation

  2023cites this paper
• Rethinking Disentanglement in Unsupervised Domain Adaptation for Medical Image Segmentation

  2023cites this paper
• Multi-Source Domain Adaptation for Medical Image Segmentation

  2023cites this paper
• Effect of Data Augmentation on Deep-Learning-Based Segmentation of Long-Axis Cine-MRI

  2023cites this paper
• MMOTU: A Multi-Modality Ovarian Tumor Ultrasound Image Dataset for Unsupervised Cross-Domain Semantic Segmentation

  2022cites this paper
• Multi-Modality Cardiac Image Computing: A Survey

  2022cites this paper
• A bidirectional multilayer contrastive adaptation network with anatomical structure preservation for unpaired cross-modality medical image segmentation

  2022cites this paper
• LMISA: A lightweight multi-modality image segmentation network via domain adaptation using gradient magnitude and shape constraint

  2022cites this paper
• CDNet: Contrastive Disentangled Network for Fine-Grained Image Categorization of Ocular B-Scan Ultrasound

  2022cites this paper
• Contrastive Domain Disentanglement for Generalizable Medical Image Segmentation

  2022cites this paper
• FPL-UDA: Filtered Pseudo Label-Based Unsupervised Cross-Modality Adaptation for Vestibular Schwannoma Segmentation

  2022cites this paper
• SGDR: Semantic-guided Disentangled Representation for Unsupervised Cross-modality Medical Image Segmentation

  2022cites this paper
• A Review of Disentangled Representation Learning for Remote Sensing Data

  2022cites this paper
• Semantic-guided Disentangled Representation for Unsupervised Cross-modality Medical Image Segmentation

  2022cites this paper
• TAUNet: a triple-attention-based multi-modality MRI fusion U-Net for cardiac pathology segmentation

  2022cites this paper
• M-GenSeg: Domain Adaptation For Target Modality Tumor Segmentation With Annotation-Efficient Supervision

  2022cites this paper
• An Unpaired Cross-modality Segmentation Framework Using Data Augmentation and Hybrid Convolutional Networks for Segmenting Vestibular Schwannoma and Cochlea

  2022cites this paper
• CDDSA: Contrastive Domain Disentanglement and Style Augmentation for Generalizable Medical Image Segmentation

  2022cites this paper
• MyoPS-Net: Myocardial Pathology Segmentation with Flexible Combination of Multi-Sequence CMR Images

  2022cites this paper
• A Survey on Causal Representation Learning and Future Work for Medical Image Analysis

  2022cites this paper
• Dual attention-guided and learnable spatial transformation data augmentation multi-modal unsupervised medical image segmentation

  2022cites this paper
• Deep learning-based whole-heart segmentation in 4D contrast-enhanced cardiac CT

  2021cites this paper
• A Tutorial on Learning Disentangled Representations in the Imaging Domain

  2021cites this paper
• Medical Image Analysis on Left Atrial LGE MRI for Atrial Fibrillation Studies: A Review

  2021cites this paper
• Decomposing Normal and Abnormal Features of Medical Images into Discrete Latent Codes for Content-Based Image Retrieval

  2021cites this paper
• Multi-Modality Cardiac Image Analysis with Deep Learning

  2021cites this paper
• Learning disentangled representations in the imaging domain

  2021cites this paper
• Computerized Medical Imaging and Graphics

  year unknowninfluential citation