Transductive Zero-Shot Learning with Visual Structure Constraint

To recognize objects of the unseen classes, most existing Zero-Shot Learning(ZSL) methods first learn a compatible projection function between the common semantic space and the visual space based on the data of source seen classes, then directly apply it to the target unseen classes. However, in real scenarios, the data distribution between the source and target domain might not match well, thus causing the well-known \textbf{domain shift} problem. Based on the observation that visual features of test instances can be separated into different clusters, we propose a new visual structure constraint on class centers for transductive ZSL, to improve the generality of the projection function (i.e. alleviate the above domain shift problem). Specifically, three different strategies (symmetric Chamfer-distance, Bipartite matching distance, and Wasserstein distance) are adopted to align the projected unseen semantic centers and visual cluster centers of test instances. We also propose a new training strategy to handle the real cases where many unrelated images exist in the test dataset, which is not considered in previous methods. Experiments on many widely used datasets demonstrate that the proposed visual structure constraint can bring substantial performance gain consistently and achieve state-of-the-art results. The source code is available at \url{this https URL}.

• Publication year

  2019

• Venue

  Neural Information Processing Systems

• Publication date

  2019-01-06

• Fields of study

  Computer Science

• Identifiers
  arXiv 1901.01570
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Semantic-Guided Multi-Attention Localization for Zero-Shot Learning

  2019cited by this paper
• Combining deep neural networks and engineered features for cardiac arrhythmia detection from ECG recordings

  2019cited by this paper
• Learning where to look: Semantic-Guided Multi-Attention Localization for Zero-Shot Learning

  2019cited by this paper
• Zero-Shot Recognition via Semantic Embeddings and Knowledge Graphs

  2018cited by this paper
• Transductive Unbiased Embedding for Zero-Shot Learning

  2018cited by this paper
• Discriminative Learning of Latent Features for Zero-Shot Recognition

  2018cited by this paper
• Preserving Semantic Relations for Zero-Shot Learning

  2018cited by this paper
• Generalized Zero-Shot Learning with Deep Calibration Network

  2018influential reference
• Semantic Autoencoder for Zero-Shot Learning

  2017cited by this paper
• Zero-Shot Recognition Using Dual Visual-Semantic Mapping Paths

  2017cited by this paper
• Zero-Shot Visual Recognition Using Semantics-Preserving Adversarial Embedding Networks

  2017cited by this paper
• A Generative Adversarial Approach for Zero-Shot Learning from Noisy Texts

  2017cited by this paper
• Zero-Shot Learning — The Good, the Bad and the Ugly

  2017influential reference
• Zero-Shot Learning via Class-Conditioned Deep Generative Models

  2017cited by this paper
• Feature Generating Networks for Zero-Shot Learning

  2017cited by this paper
• ENCASE: An ENsemble ClASsifiEr for ECG classification using expert features and deep neural networks

  2017cited by this paper
• Zero-Shot Classification with Discriminative Semantic Representation Learning

  2017cited by this paper
• Semantically Consistent Regularization for Zero-Shot Recognition

  2017cited by this paper
• Zero-Shot Learning—A Comprehensive Evaluation of the Good, the Bad and the Ugly

  2017cited by this paper
• Synthesized Classifiers for Zero-Shot Learning

  2016cited by this paper
• A Point Set Generation Network for 3D Object Reconstruction from a Single Image

  2016cited by this paper
• Learning Deep Representations of Fine-Grained Visual Descriptions

  2016cited by this paper
• Semi-supervised Vocabulary-Informed Learning

  2016cited by this paper
• Transductive Zero-Shot Recognition via Shared Model Space Learning

  2016cited by this paper
• Zero-Shot Recognition via Structured Prediction

  2016influential reference
• Learning a Deep Embedding Model for Zero-Shot Learning

  2016influential reference
• Label-Embedding for Image Classification

  2015cited by this paper
• Unsupervised Domain Adaptation for Zero-Shot Learning

  2015cited by this paper
• Ridge Regression, Hubness, and Zero-Shot Learning

  2015cited by this paper
• Deep Residual Learning for Image Recognition

  2015cited by this paper
• Zero-Shot Learning via Joint Latent Similarity Embedding

  2015cited by this paper
• Predicting Deep Zero-Shot Convolutional Neural Networks Using Textual Descriptions

  2015cited by this paper
• Unsupervised Learning on Neural Network Outputs: With Application in Zero-Shot Learning

  2015cited by this paper
• An embarrassingly simple approach to zero-shot learning

  2015cited by this paper
• Zero-Shot Learning via Semantic Similarity Embedding

  2015cited by this paper
• Transductive Multi-View Zero-Shot Learning

  2015influential reference
• GloVe: Global Vectors for Word Representation

  2014cited by this paper
• Very Deep Convolutional Networks for Large-Scale Image Recognition

  2014cited by this paper
• Evaluation of output embeddings for fine-grained image classification

  2014cited by this paper
• Transductive Multi-view Embedding for Zero-Shot Recognition and Annotation

  2014cited by this paper
• The SUN Attribute Database: Beyond Categories for Deeper Scene Understanding

  2014influential reference
• Going deeper with convolutions

  2014cited by this paper
• Sinkhorn Distances: Lightspeed Computation of Optimal Transport

  2013cited by this paper
• Label-Embedding for Attribute-Based Classification

  2013cited by this paper
• Transfer Learning in a Transductive Setting

  2013cited by this paper
• Zero-Shot Learning by Convex Combination of Semantic Embeddings

  2013cited by this paper
• Write a Classifier: Zero-Shot Learning Using Purely Textual Descriptions

  2013cited by this paper
• DeViSE: A Deep Visual-Semantic Embedding Model

  2013cited by this paper
• Convolutional-Recursive Deep Learning for 3D Object Classification

  2012cited by this paper
• Hubs in Space: Popular Nearest Neighbors in High-Dimensional Data

  2010cited by this paper
• Describing objects by their attributes

  2009cited by this paper
• Learning to detect unseen object classes by between-class attribute transfer

  2009cited by this paper
• ImageNet: A large-scale hierarchical image database

  2009cited by this paper
• Breath gas aldehydes as biomarkers of lung cancer

  2009cited by this paper
• Learning from labeled and unlabeled data with label propagation

  2002cited by this paper
• WordNet: A Lexical Database for English

  1995cited by this paper
• The Hungarian method for the assignment problem

  1955cited by this paper
• Attribute-Based Classification for Zero-Shot Visual Object Categorization

  year unknowninfluential reference

• Chamfer-Linkage for Hierarchical Agglomerative Clustering

  2026cites this paper
• TransRefine: Transformer-augmented feature refinement for zero-shot scene classification in remote sensing images

  2025cites this paper
• Generate, Transduct, Adapt: Iterative Transduction with VLMs

  2025cites this paper
• GenZSL: Generative Zero-Shot Learning Via Inductive Variational Autoencoder

  2025cites this paper
• Even Faster Algorithm for the Chamfer Distance

  2025cites this paper
• Enhancing zero-shot scene recognition through semantic autoencoders and visual relation transfer

  2025cites this paper
• Fully Dynamic Algorithms for Chamfer Distance

  2025cites this paper
• Learning Generalizable Contrastive Representations for Graph Zero-Shot Learning

  2025cites this paper
• Enhancing destination marketing through artificial intelligence driven visual recognition

  2025cites this paper
• DualResolution Residual Architecture with Artifact Suppression for Melanocytic Lesion Segmentation

  2025cites this paper
• Edge Detection for Organ Boundaries via Top Down Refinement and SubPixel Upsampling

  2025cites this paper
• VesselRW: Weakly Supervised Subcutaneous Vessel Segmentation via Learned Random Walk Propagation

  2025cites this paper
• Deeply Dual Supervised learning for melanoma recognition

  2025cites this paper
• ConCM: Consistency-Driven Calibration and Matching for Few-Shot Class-Incremental Learning

  2025cites this paper
• Multihop Reconstruction for Generalized Zero-Shot Node Classification

  2025cites this paper
• GOTHAM: Graph Class Incremental Learning Framework under Weak Supervision

  2025cites this paper
• SuperCLIP: Semantic Attribute-Guided Transformer With Super-Resolution and CLIP for Zero-Shot Remote Sensing Scene Classification

  2025cites this paper
• Zero-shot Micro-video Classification with Dual Alignment Topic Model

  2025cites this paper
• Progressive Feature-Attribute Matching via Bi-Directional Generation for Transductive Zero-Shot Learning

  2025cites this paper
• A Transductive Zero-Shot Learning Framework for Ransomware Detection Using Malware Knowledge Graphs

  2025cites this paper
• PromptKD: Unsupervised Prompt Distillation for Vision-Language Models

  2024cites this paper
• MUVERA: Multi-Vector Retrieval via Fixed Dimensional Encodings

  2024cites this paper
• SpeAr: A Spectral Approach for Zero-Shot Node Classification

  2024cites this paper
• Improving Generalized Zero-Shot Learning by Exploring the Diverse Semantics from External Class Names

  2024cites this paper
• RSZero-CSAT: Zero-Shot Scene Classification in Remote Sensing Imagery using a Cross Semantic Attribute-guided Transformer

  2024cites this paper
• Candidate Pseudolabel Learning: Enhancing Vision-Language Models by Prompt Tuning with Unlabeled Data

  2024influential citation
• Generalized zero-shot learning for classifying unseen wafer map patterns

  2024cites this paper
• Progressive Semantic-Guided Vision Transformer for Zero-Shot Learning

  2024cites this paper
• Text guided zero-shot scene classification of high spatial resolution remote sensing images

  2024cites this paper
• Boosting Zero-Shot Node Classification via Dependency Capture and Discriminative Feature Learning

  2024cites this paper
• Prototype-Augmented Self-Supervised Generative Network for Generalized Zero-Shot Learning

  2024cites this paper
• Towards Zero-Shot Learning: A Brief Review and an Attention-Based Embedding Network

  2023cites this paper
• KMF: Knowledge-Aware Multi-Faceted Representation Learning for Zero-Shot Node Classification

  2023cites this paper
• MetaDT: Meta Decision Tree With Class Hierarchy for Interpretable Few-Shot Learning

  2023cites this paper
• Bi-Directional Distribution Alignment for Transductive Zero-Shot Learning

  2023cites this paper
• Semantic-visual shared knowledge graph for zero-shot learning

  2023cites this paper
• Structure-Preserving and Redundancy-Free Features Refinement for Generalized Zero-Shot Learning

  2023cites this paper
• Vision-Language Models in Remote Sensing: Current progress and future trends

  2023cites this paper
• Integrating topology beyond descriptions for zero-shot learning

  2023cites this paper
• Evolving Semantic Prototype Improves Generative Zero-Shot Learning

  2023cites this paper
• A Near-Linear Time Algorithm for the Chamfer Distance

  2023cites this paper
• Transductive semantic knowledge graph propagation for zero-shot learning

  2023cites this paper
• Attribute subspaces for zero-shot learning

  2023cites this paper
• Zero-shot Node Classification with Graph Contrastive Embedding Network

  2023cites this paper
• RS-CLIP: Zero shot remote sensing scene classification via contrastive vision-language supervision

  2023cites this paper
• A zero-shot learning boosting framework via concept-constrained clustering

  2023cites this paper
• Multi-view enhanced zero-shot node classification

  2023cites this paper
• Iterative Class Prototype Calibration for Transductive Zero-Shot Learning

  2023cites this paper
• Unbiased feature generating for generalized zero-shot learning

  2022cites this paper
• HardBoost: Boosting Zero-Shot Learning with Hard Classes

  2022influential citation
• Domain-aware multi-modality fusion network for generalized zero-shot learning

  2022cites this paper
• An active unseen sample selection framework for generalized zero-shot classification

  2022cites this paper
• MetaDT: Meta Decision Tree for Interpretable Few-Shot Learning

  2022cites this paper
• Generative Adversarial Networks for Zero-Shot Remote Sensing Scene Classification

  2022cites this paper
• Micro-Knowledge Embedding for Zero-shot Classification

  2022cites this paper
• Content-Attribute Disentanglement for Generalized Zero-Shot Learning

  2022cites this paper
• PROTOtypical Logic Tensor Networks (PROTO-LTN) for Zero Shot Learning

  2022cites this paper
• Dual Bidirectional Graph Convolutional Networks for Zero-shot Node Classification

  2022cites this paper
• Information bottleneck and selective noise supervision for zero-shot learning

  2022cites this paper
• Joint one‐sided synthetic unpaired image translation and segmentation for colorectal cancer prevention

  2022cites this paper
• Zero-shot Video Classification with Appropriate Web and Task Knowledge Transfer

  2022cites this paper
• Evolutionary Generalized Zero-Shot Learning

  2022cites this paper
• Attribute-Modulated Generative Meta Learning for Zero-Shot Classification

  2021cites this paper
• Attribute-Modulated Generative Meta Learning for Zero-Shot Learning

  2021cites this paper
• Learning Aligned Cross-Modal Representation for Generalized Zero-Shot Classification

  2021cites this paper
• A Few-Shot Learning-Based Siamese Capsule Network for Intrusion Detection with Imbalanced Training Data

  2021cites this paper
• Novelty detection using ensembles with regularized disagreement

  2021cites this paper
• Structure-Aware Feature Generation for Zero-Shot Learning

  2021influential citation
• Prototype Completion for Few-Shot Learning

  2021cites this paper
• An Iterative Co-Training Transductive Framework for Zero Shot Learning

  2021influential citation
• External-Memory Networks for Low-Shot Learning of Targets in Forward-Looking-Sonar Imagery

  2021cites this paper
• COCOA: Context-Conditional Adaptation for Recognizing Unseen Classes in Unseen Domains

  2021cites this paper
• “Zero-Shot” Point Cloud Upsampling

  2021cites this paper
• Zero-shot Node Classification with Decomposed Graph Prototype Network

  2021cites this paper
• Transductive Zero-Shot Learning by Decoupled Feature Generation

  2021cites this paper
• Learning from Multiple Noisy Partial Labelers

  2021cites this paper
• Hardness Sampling for Self-Training Based Transductive Zero-Shot Learning

  2021influential citation
• Visual Structure Constraint for Transductive Zero-Shot Learning in the Wild

  2021cites this paper
• Towards Novel Target Discovery Through Open-Set Domain Adaptation

  2021influential citation
• Domain-aware Stacked AutoEncoders for zero-shot learning

  2020cites this paper
• Graph-Based Visual-Semantic Entanglement Network for Zero-Shot Image Recognition

  2020cites this paper
• Attribute-Induced Bias Eliminating for Transductive Zero-Shot Learning

  2020cites this paper
• Deep transductive network for generalized zero shot learning

  2020cites this paper
• Zero-shot learning and its applications from autonomous vehicles to COVID-19 diagnosis: A review

  2020influential citation
• Zero-VAE-GAN: Generating Unseen Features for Generalized and Transductive Zero-Shot Learning

  2020cites this paper
• Supplementary Material: Two-Level Adversarial Visual-Semantic Coupling for Generalized Zero-shot Learning

  2020cites this paper
• Are Fewer Labels Possible for Few-shot Learning?

  2020cites this paper
• Learn what you can't learn: Regularized Ensembles for Transductive Out-of-distribution Detection

  2020cites this paper
• Compositional Zero-Shot Learning via Fine-Grained Dense Feature Composition

  2020cites this paper
• Two-Level Adversarial Visual-Semantic Coupling for Generalized Zero-shot Learning

  2020cites this paper
• Transductive Zero-Shot Learning using Cross-Modal CycleGAN

  2020cites this paper
• Learning Unseen Emotions from Gestures via Semantically-Conditioned Zero-Shot Perception with Adversarial Autoencoders

  2020cites this paper
• Prototype Completion with Primitive Knowledge for Few-Shot Learning

  2020cites this paper
• Transductive Zero-Shot Action Recognition via Visually Connected Graph Convolutional Networks

  2020cites this paper
• Enhancing Generalized Zero-Shot Learning via Adversarial Visual-Semantic Interaction

  2020cites this paper
• Semantic Graph-enhanced Visual Network for Zero-shot Learning

  2020cites this paper
• Transfer Feature Generating Networks With Semantic Classes Structure for Zero-Shot Learning

  2019cites this paper
• Semantic-Guided Multi-Attention Localization for Zero-Shot Learning

  2019cites this paper
• Heterogeneous Graph-based Knowledge Transfer for Generalized Zero-shot Learning

  2019cites this paper
• S UPER CAT: S UPER R ESOLUTION AND C ROSS S EMAN - TIC A TTRIBUTE - GUIDED T RANSFORMER BASED F EA - TURE R EFINEMENT FOR Z ERO -S HOT R EMOTE S ENS - ING S CENE

  year unknowncites this paper