Zero-Shot Learning by Convex Combination of Semantic Embeddings

Abstract: Several recent publications have proposed methods for mapping images into continuous semantic embedding spaces. In some cases the embedding space is trained jointly with the image transformation. In other cases the semantic embedding space is established by an independent natural language processing task, and then the image transformation into that space is learned in a second stage. Proponents of these image embedding systems have stressed their advantages over the traditional \nway{} classification framing of image understanding, particularly in terms of the promise for zero-shot learning -- the ability to correctly annotate images of previously unseen object categories. In this paper, we propose a simple method for constructing an image embedding system from any existing \nway{} image classifier and a semantic word embedding model, which contains the $\n$ class labels in its vocabulary. Our method maps images into the semantic embedding space via convex combination of the class label embedding vectors, and requires no additional training. We show that this simple and direct method confers many of the advantages associated with more complex image embedding schemes, and indeed outperforms state of the art methods on the ImageNet zero-shot learning task.

• Publication year

  2013

• Venue

  International Conference on Learning Representations

• Publication date

  2013-12-19

• Fields of study

  Computer Science

• Identifiers
  arXiv 1312.5650
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Zero-Shot Learning Through Cross-Modal Transfer

  2013influential reference
• DeViSE: A Deep Visual-Semantic Embedding Model

  2013cited by this paper
• Efficient Estimation of Word Representations in Vector Space

  2013influential reference
• ImageNet classification with deep convolutional neural networks

  2012cited by this paper
• Metric Learning for Large Scale Image Classification: Generalizing to New Classes at Near-Zero Cost

  2012cited by this paper
• Relative attributes

  2011cited by this paper
• WSABIE: Scaling Up to Large Vocabulary Image Annotation

  2011cited by this paper
• Evaluating knowledge transfer and zero-shot learning in a large-scale setting

  2011cited by this paper
• One shot learning of simple visual concepts

  2011cited by this paper
• Learning to detect unseen object classes by between-class attribute transfer

  2009cited by this paper
• ImageNet: A large-scale hierarchical image database

  2009cited by this paper
• Describing objects by their attributes

  2009cited by this paper
• Zero-shot Learning with Semantic Output Codes

  2009cited by this paper
• Zero-data Learning of New Tasks

  2008cited by this paper
• Neural Probabilistic Language Models

  2006cited by this paper
• One-shot learning of object categories

  2006cited by this paper
• Cross-generalization: learning novel classes from a single example by feature replacement

  2005cited by this paper
• Learning from one example through shared densities on transforms

  2000cited by this paper

• Feature Space Sharing via Visual Projector for Open-Vocabulary Multi-Label Classification

  2026cites this paper
• LLM-informed global-local contextualization for zero-shot food detection

  2026cites this paper
• Asynchronous Personalized Federated Learning through Global Memorization

  2025cites this paper
• MetaZero: A Novel Meta-Learning Method Suitable for Generalized Zero-Shot Learning

  2025cites this paper
• SVIP: Semantically Contextualized Visual Patches for Zero-Shot Learning

  2025cites this paper
• DFS: Dual-branch forward-looking simulation network for incremental learning of ancient Chinese characters

  2025cites this paper
• Adaptive Fusion Learning for Compositional Zero-Shot Recognition

  2025cites this paper
• Enabling Generalized Zero-Shot Vulnerability Classification

  2025cites this paper
• Attribute-Informed and Similarity-Enhanced Zero-Shot Radar Target Recognition

  2025cites this paper
• Charting trajectories of human thought using large language models

  2025cites this paper
• Visual-Semantic Cooperative Learning for Few-Shot SAR Target Classification

  2025cites this paper
• A Zero-shot Learning Method Based on Large Language Models for Multi-modal Knowledge Graph Embedding

  2025cites this paper
• Solving Inverse Problems in Stochastic Self-Organising Systems through Invariant Representations

  2025cites this paper
• OTTER: Open-Tagging via Text-Image Representation for Multi-modal Understanding

  2025cites this paper
• A review on NLP zero-shot and few-shot learning: methods and applications

  2025cites this paper
• Modality-Aware Feature Matching: A Comprehensive Review of Single- and Cross-Modality Techniques

  2025cites this paper
• DAR-Prompt: Dynamic Regulation in Prompt Tuning for Multi-Label Zero-Shot Learning

  2025cites this paper
• RSplitzero: generalized zero-shot learning in remote sensing across attribute splits with single and multi-modal representations

  2025cites this paper
• Deep ensemble learning method for zero-shot object detection

  2025cites this paper
• Object-Aware Image Augmentation for Audio-Visual Zero-Shot Learning

  2025cites this paper
• Seeing and Knowing in the Wild: Open-domain Visual Entity Recognition with Large-scale Knowledge Graphs via Contrastive Learning

  2025cites this paper
• Distributed Zero-Shot Learning for Visual Recognition

  2025cites this paper
• Multi-Modal Cooperative Distillation for Zero-Shot Multi-Label Classification

  2025cites this paper
• Expanding the Category of Classifiers with LLM Supervision

  2025cites this paper
• EfficientZSR: A Lightweight Generalized Zero-Shot Recognition Framework

  2025cites this paper
• Advancing Large Language Models for Spatiotemporal and Semantic Association Mining of Similar Environmental Events

  2024cites this paper
• Open-vocabulary multi-label classification with visual and textual features fusion

  2024cites this paper
• Dual-Stream Contrastive Learning for Compositional Zero-Shot Recognition

  2024cites this paper
• FZR: Enhancing Knowledge Transfer via Shared Factors Composition in Zero-Shot Relational Learning

  2024cites this paper
• An Art-centric perspective on AI-based content moderation of nudity

  2024cites this paper
• Dual insurance for generalized zero-shot learning

  2024cites this paper
• A Transferable Generative Framework for Multi-Label Zero-Shot Learning

  2024cites this paper
• Label correlation preserving visual-semantic joint embedding for multi-label zero-shot learning

  2024cites this paper
• PSVMA+: Exploring Multi-Granularity Semantic-Visual Adaption for Generalized Zero-Shot Learning

  2024cites this paper
• Attention-driven frequency-based Zero-Shot Learning with phase augmentation

  2024cites this paper
• Zero-shot image classification via Visual–Semantic Feature Decoupling

  2024cites this paper
• Sentinel-Guided Zero-Shot Learning: A Collaborative Paradigm Without Real Data Exposure

  2024cites this paper
• Estimating Noisy Class Posterior with Part-level Labels for Noisy Label Learning

  2024cites this paper
• CRADA: Cross Domain Object Detection With Cyclic Reconstruction and Decoupling Adaptation

  2024cites this paper
• Synthesizing Knowledge-Enhanced Features for Real-World Zero-Shot Food Detection

  2024cites this paper
• ZS-VAT: Learning Unbiased Attribute Knowledge for Zero-Shot Recognition Through Visual Attribute Transformer

  2024cites this paper
• Audio-Visual Generalized Zero-Shot Learning using Pre-Trained Large Multi-Modal Models

  2024cites this paper
• SKZC: self-distillation and k-nearest neighbor-based zero-shot classification

  2024cites this paper
• Towards Cognition-Aligned Visual Language Models via Zero-Shot Instance Retrieval

  2024cites this paper
• Zero-Shot Classification Using Hyperdimensional Computing

  2024cites this paper
• Transductive Learning With Prior Knowledge for Generalized Zero-Shot Action Recognition

  2024cites this paper
• Learning Invariant Causal Mechanism from Vision-Language Models

  2024cites this paper
• Review of Zero-Shot Remote Sensing Image Scene Classification

  2024cites this paper
• From Coarse to Fine-Grained Open-Set Recognition

  2024cites this paper
• Leveraging Pre-Trained Extreme Multi-Label Classifiers for Zero-Shot Learning

  2024influential citation
• I2DFormer+: Learning Image to Document Summary Attention for Zero-Shot Image Classification

  2024cites this paper
• A Lightweight Framework With Knowledge Distillation for Zero-Shot Mars Scene Classification

  2024cites this paper
• Promoting Machine Abilities of Discovering and Utilizing Knowledge in a Unified Zero-Shot Learning Paradigm

  2024cites this paper
• MLFA: Toward Realistic Test Time Adaptive Object Detection by Multi-Level Feature Alignment

  2024influential citation
• HCL: A Hierarchical Contrastive Learning Framework for Zero-Shot Relation Extraction

  2024cites this paper
• Relational Proxies: Fine-Grained Relationships as Zero-Shot Discriminators

  2024cites this paper
• Continual Gesture Learning without Data via Synthetic Feature Sampling

  2024cites this paper
• Application of CLIP for efficient zero-shot learning

  2024cites this paper
• Epsilon: Exploring Comprehensive Visual-Semantic Projection for Multi-Label Zero-Shot Learning

  2024cites this paper
• Low-rank Multi-modal Features Fusion Semantic Autoencoder For Zero-shot Learning

  2024influential citation
• Data-Free Class Incremental Gesture Recognition via Synthetic Feature Sampling

  2024cites this paper
• Self-Supervised Multi-Label Classification with Global Context and Local Attention

  2024cites this paper
• Multi-Label Zero-Shot Learning With Adversarial and Variational Techniques

  2024influential citation
• Zero-shot Image Classification with Logic Adapter and Rule Prompt

  2024cites this paper
• Generating visual representations for zero-shot learning via adversarial learning and variational autoencoders

  2023cites this paper
• Multi-Modal Multi-Grained Embedding Learning for Generalized Zero-Shot Video Classification

  2023cites this paper
• Semantic-visual shared knowledge graph for zero-shot learning

  2023influential citation
• Bi-Directional Distribution Alignment for Transductive Zero-Shot Learning

  2023cites this paper
• Adaptive adjustment with semantic embedding for zero-shot object detection

  2023cites this paper
• Fine-Grained Feature Generation for Generalized Zero-Shot Video Classification

  2023cites this paper
• Clustering of conversational bandits with posterior sampling for user preference learning and elicitation

  2023cites this paper
• Inducing Neural Collapse to a Fixed Hierarchy-Aware Frame for Reducing Mistake Severity

  2023cites this paper
• Adaptive Margin-based Contrastive Network for Generalized Zero-Shot Learning

  2023cites this paper
• Aligning Bag of Regions for Open-Vocabulary Object Detection

  2023cites this paper
• Meta-learning with topic-agnostic representations for zero-shot stance detection

  2023cites this paper
• Semantics Guided Contrastive Learning of Transformers for Zero-shot Temporal Activity Detection

  2023cites this paper
• Sustainable and Transferable Traffic Sign Recognition for Intelligent Transportation Systems

  2023cites this paper
• Hybrid Representation Learning via Epistemic Graph

  2023cites this paper
• Region-Aware Pretraining for Open-Vocabulary Object Detection with Vision Transformers

  2023cites this paper
• Discriminative and Robust Attribute Alignment for Zero-Shot Learning

  2023cites this paper
• Towards Zero-Shot Learning: A Brief Review and an Attention-Based Embedding Network

  2023cites this paper
• Prototypical Model with Information-Theoretic Loss Functions for Generalized Zero-Shot Learning

  2023influential citation
• Iterative Class Prototype Calibration for Transductive Zero-Shot Learning

  2023cites this paper
• Embedded Zero-shot Learning Algorithm Based on Semantic Attributes

  2023cites this paper
• Adequate alignment and interaction for cross-modal retrieval

  2023cites this paper
• Meta-Learned Attribute Self-Interaction Network for Continual and Generalized Zero-Shot Learning

  2023cites this paper
• A Few-Shot Learning Focused Survey on Recent Named Entity Recognition and Relation Classification Methods

  2023cites this paper
• Frequency-based Zero-Shot Learning with Phase Augmentation

  2023cites this paper
• Foregroundness-Aware Task Disentanglement and Self-Paced Curriculum Learning for Domain Adaptive Object Detection

  2023cites this paper
• SeeDS: Semantic Separable Diffusion Synthesizer for Zero-shot Food Detection

  2023cites this paper
• Probability-Based Binary Attribute Weighted Prediction Network for SAR Image Classification

  2023cites this paper
• Large Language Models Are Zero-Shot Text Classifiers

  2023cites this paper
• Privacy-Enhanced Zero-Shot Learning via Data-Free Knowledge Transfer

  2023cites this paper
• JSSE: Joint Sequential Semantic Encoder for Zero-Shot Event Recognition

  2023cites this paper
• Image-free Classifier Injection for Zero-Shot Classification

  2023influential citation
• Open-Vocabulary Multi-label Image Classification with Pretrained Vision-Language Model

  2023cites this paper
• KMF: Knowledge-Aware Multi-Faceted Representation Learning for Zero-Shot Node Classification

  2023cites this paper
• Spelling Check for Handwritten Homework and Exams

  2023cites this paper
• VS-Boost: Boosting Visual-Semantic Association for Generalized Zero-Shot Learning

  2023cites this paper
• Contrastive Feature Masking Open-Vocabulary Vision Transformer

  2023cites this paper