Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overview

Visual semantic segmentation aims at separating a visual sample into diverse blocks with specific semantic attributes and identifying the category for each block, and it plays a crucial role in environmental perception. Conventional learning-based visual semantic segmentation approaches count heavily on large-scale training data with dense annotations and consistently fail to estimate accurate semantic labels for unseen categories. This obstruction spurs a craze for studying visual semantic segmentation with the assistance of few/zero-shot learning. The emergence and rapid progress of few/zero-shot visual semantic segmentation make it possible to learn unseen categories from a few labeled or even zero-labeled samples, which advances the extension to practical applications. Therefore, this paper focuses on the recently published few/zero-shot visual semantic segmentation methods varying from 2D to 3D space and explores the commonalities and discrepancies of technical settlements under different segmentation circumstances. Specifically, the preliminaries on few/zero-shot visual semantic segmentation, including the problem definitions, typical datasets, and technical remedies, are briefly reviewed and discussed. Moreover, three typical instantiations are involved to uncover the interactions of few/zero-shot learning with visual semantic segmentation, including image semantic segmentation, video object segmentation, and 3D segmentation. Finally, the future challenges of few/zero-shot visual semantic segmentation are discussed.

• Publication year

  2022

• Venue

  IEEE/CAA Journal of Automatica Sinica

• Publication date

  2022-11-13

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/JAS.2023.123207arXiv 2211.08352
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Axial Assembled Correspondence Network for Few-Shot Semantic Segmentation

  2023cited by this paper
• Multi-frame based adversarial learning approach for video surveillance

  2022cited by this paper
• Flow-Edge Guided Unsupervised Video Object Segmentation

  2022cited by this paper
• DARTS—Drone and Artificial Intelligence Reconsolidated Technological Solution for Increasing the Oil and Gas Pipeline Resilience

  2022cited by this paper
• Meta-seg: A survey of meta-learning for image segmentation

  2022cited by this paper
• Multi-Attention Fusion and Fine-Grained Alignment for Bidirectional Image-Sentence Retrieval in Remote Sensing

  2022cited by this paper
• Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

  2022cited by this paper
• You Only Infer Once: Cross-Modal Meta-Transfer for Referring Video Object Segmentation

  2022cited by this paper
• Differentiable Automatic Data Augmentation by Proximal Update for Medical Image Segmentation

  2022cited by this paper
• A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities

  2022cited by this paper
• Video Object Segmentation Using Kernelized Memory Network With Multiple Kernels

  2022cited by this paper
• Rethinking Semantic Segmentation: A Prototype View

  2022cited by this paper
• A Mutually Supervised Graph Attention Network for Few-Shot Segmentation: The Perspective of Fully Utilizing Limited Samples

  2022cited by this paper
• Learning from Few Examples: A Summary of Approaches to Few-Shot Learning

  2022cited by this paper
• Learning What Not to Segment: A New Perspective on Few-Shot Segmentation

  2022cited by this paper
• Adaptive Prototype Learning and Allocation for Few-Shot Segmentation

  2021cited by this paper
• 3D Meta-Segmentation Neural Network

  2021cited by this paper
• Hierarchical Memory Matching Network for Video Object Segmentation

  2021cited by this paper
• GMNet: Graded-Feature Multilabel-Learning Network for RGB-Thermal Urban Scene Semantic Segmentation

  2021cited by this paper
• An Unified Recurrent Video Object Segmentation Framework for Various Surveillance Environments

  2021cited by this paper
• Exploiting a Joint Embedding Space for Generalized Zero-Shot Semantic Segmentation

  2021cited by this paper
• Guided Co-Segmentation Network for Fast Video Object Segmentation

  2021cited by this paper
• Efficient Regional Memory Network for Video Object Segmentation

  2021cited by this paper
• Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Clouds

  2021cited by this paper
• Multi-Source Fusion and Automatic Predictor Selection for Zero-Shot Video Object Segmentation

  2021cited by this paper
• Learning Meta-class Memory for Few-Shot Semantic Segmentation

  2021influential reference
• Full-duplex strategy for video object segmentation

  2021cited by this paper
• Per-Pixel Classification is Not All You Need for Semantic Segmentation

  2021cited by this paper
• A Survey on Deep Learning Technique for Video Segmentation

  2021cited by this paper
• Segmenting 3D Hybrid Scenes via Zero-Shot Learning

  2021cited by this paper
• Rich Embedding Features for One-Shot Semantic Segmentation

  2021cited by this paper
• FISS GAN: A Generative Adversarial Network for Foggy Image Semantic Segmentation

  2021cited by this paper
• What Can Knowledge Bring to Machine Learning?—A Survey of Low-shot Learning for Structured Data

  2021cited by this paper
• Variational Prototype Inference for Few-Shot Semantic Segmentation

  2021cited by this paper
• Exploring Cross-Image Pixel Contrast for Semantic Segmentation

  2021cited by this paper
• Mask Selection and Propagation for Unsupervised Video Object Segmentation

  2021cited by this paper
• Harmonic Feature Activation for Few-Shot Semantic Segmentation

  2021influential reference
• Medical Transformer: Gated Axial-Attention for Medical Image Segmentation

  2021cited by this paper
• Discriminative Region Suppression for Weakly-Supervised Semantic Segmentation

  2021cited by this paper
• Part-Based Semantic Transform for Few-Shot Semantic Segmentation

  2021cited by this paper
• Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentation

  2021cited by this paper
• Few-Shot Segmentation via Cycle-Consistent Transformer

  2021cited by this paper
• Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud

  2021cited by this paper
• Learning Semantic Segmentation of Large-Scale Point Clouds With Random Sampling

  2021cited by this paper
• Prototype Guided Federated Learning of Visual Feature Representations

  2021cited by this paper
• Semantically Meaningful Class Prototype Learning for One-Shot Image Segmentation

  2021influential reference
• Separable Structure Modeling for Semi-Supervised Video Object Segmentation

  2021cited by this paper
• Hierarchical Interaction Network for Video Object Segmentation from Referring Expressions

  2021cited by this paper
• Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes

  2021cited by this paper
• 3D-MetaConNet: Meta-learning for 3D Shape Classification and Segmentation

  2021cited by this paper
• An Effective Low-Contrast SF₆ Gas Leakage Detection Method for Infrared Imaging

  2021cited by this paper
• Meta-VOS: Learning to Adapt Online Target-Specific Segmentation

  2021cited by this paper
• Adaptive Selection of Reference Frames for Video Object Segmentation

  2021cited by this paper
• Few-Shot Object Detection: A Survey

  2021cited by this paper
• SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation Network

  2021cited by this paper
• End-to-End Referring Video Object Segmentation with Multimodal Transformers

  2021cited by this paper
• Learning Motion-Appearance Co-Attention for Zero-Shot Video Object Segmentation

  2021cited by this paper
• Few-Shot Semantic Segmentation with Cyclic Memory Network

  2021cited by this paper
• MaskSplit: Self-supervised Meta-learning for Few-shot Semantic Segmentation

  2021cited by this paper
• A survey on unsupervised domain adaptation in computer vision tasks

  2021cited by this paper
• Feature Enhanced Projection Network for Zero-shot Semantic Segmentation

  2021cited by this paper
• Deep Reasoning Network for Few-shot Semantic Segmentation

  2021cited by this paper
• Reducing Information Bottleneck for Weakly Supervised Semantic Segmentation

  2021cited by this paper
• From Pixel to Patch: Synthesize Context-Aware Features for Zero-Shot Semantic Segmentation

  2020cited by this paper
• Motion-Guided Cascaded Refinement Network for Video Object Segmentation

  2020cited by this paper
• Online Meta Adaptation for Fast Video Object Segmentation

  2020cited by this paper
• Fast Video Object Segmentation using the Global Context Module

  2020cited by this paper
• Directional Deep Embedding and Appearance Learning for Fast Video Object Segmentation

  2020cited by this paper
• Learning Fast and Robust Target Models for Video Object Segmentation

  2020cited by this paper
• Proximity based automatic data annotation for autonomous driving

  2020cited by this paper
• Dual Temporal Memory Network for Efficient Video Object Segmentation

  2020cited by this paper
• Monocular depth estimation based on deep learning: An overview

  2020cited by this paper
• Collaborative Video Object Segmentation by Foreground-Background Integration

  2020cited by this paper
• Domain-Adaptive Few-Shot Learning

  2020cited by this paper
• Pyramid Constrained Self-Attention Network for Fast Video Salient Object Detection

  2020cited by this paper
• ROSS: Robust Learning of One-Shot 3D Shape Segmentation

  2020cited by this paper
• When Autonomous Systems Meet Accuracy and Transferability through AI: A Survey

  2020cited by this paper
• BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic Segmentation

  2020cited by this paper
• A Transductive Approach for Video Object Segmentation

  2020cited by this paper
• Few-shot 3D Point Cloud Semantic Segmentation

  2020cited by this paper
• Few-Shot Learning of Part-Specific Probability Space for 3D Shape Segmentation

  2020cited by this paper
• Part-aware Prototype Network for Few-shot Semantic Segmentation

  2020cited by this paper
• Video Object Segmentation with Episodic Graph Memory Networks

  2020cited by this paper
• Kernelized Memory Network for Video Object Segmentation

  2020cited by this paper
• Prior Guided Feature Enrichment Network for Few-Shot Segmentation

  2020cited by this paper
• Space-Time Memory Networks for Video Object Segmentation With User Guidance

  2020influential reference
• BriNet: Towards Bridging the Intra-class and Inter-class Gaps in One-Shot Segmentation

  2020influential reference
• Context-aware Feature Generation For Zero-shot Semantic Segmentation

  2020cited by this paper
• Making a Case for 3D Convolutions for Object Segmentation in Videos

  2020cited by this paper
• Learning from Very Few Samples: A Survey

  2020cited by this paper
• Few-Shot Semantic Segmentation with Democratic Attention Networks

  2020cited by this paper
• Self-Supervised Few-Shot Learning on Point Clouds

  2020influential reference
• RefVOS: A Closer Look at Referring Expressions for Video Object Segmentation

  2020cited by this paper
• Dynamic Extension Nets for Few-shot Semantic Segmentation

  2020cited by this paper
• Cap2Seg: Inferring Semantic and Spatial Context from Captions for Zero-Shot Image Segmentation

  2020cited by this paper
• Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement

  2020cited by this paper
• URVOS: Unified Referring Video Object Segmentation Network with a Large-Scale Benchmark

  2020cited by this paper
• A Review of Generalized Zero-Shot Learning Methods

  2020cited by this paper
• Zero-Shot Video Object Segmentation With Co-Attention Siamese Networks

  2020cited by this paper
• Multitask GANs for Semantic Segmentation and Depth Completion With Cycle Consistency

  2020cited by this paper

• Double-Domain Driven Unet for Selective Segmentation of Medical Image

  2025cites this paper
• Point-MASNet: Masked Autoencoder-Based Sampling Network for 3D Point Cloud

  2025cites this paper
• Hyperbolic-Based Cross-Modal Semantic Remodeling Network for Zero-Shot Sketch-Based Image Retrieval

  2025cites this paper
• Zero‐shot point cloud segmentation for hydro power plant components

  2025cites this paper
• SAMR: A Spatial-Augmented Mixed Reality Method for Enhancing Vision-Language Models in 3D Scene Understanding

  2025cites this paper
• PLZero: placeholder based approach to generalized zero-shot learning for multi-label recognition in chest radiographs

  2025cites this paper
• Cross-Domain Semantic Segmentation with Large Language Model-Assisted Descriptor Generation

  2025cites this paper
• Enhancing music audio signal recognition through CNN-BiLSTM fusion with De-noising autoencoder for improved performance

  2025cites this paper
• Exploring Few-Shot Defect Segmentation in General Industrial Scenarios with Metric Learning and Vision Foundation Models

  2025cites this paper
• An integrated framework for multi-feature fusion and intelligent recognition of design elements: Challenges and solutions

  2025cites this paper
• When Embodied AI Meets Industry 5.0: Human-Centered Smart Manufacturing

  2025cites this paper
• How much data do you need? An analysis of pelvic multi-organ segmentation in a limited data context

  2025cites this paper
• A Rapid Segmentation Method Based on Few-Shot Learning: A Case Study on Roadways

  2025cites this paper
• Privacy-Preserving Information Extraction for Ethical Case Studies in Machine Learning Using ChatGLM-LtMP

  2025cites this paper
• Background-Enhanced Visual Prompting Transformer for Generalized Few-Shot Semantic Segmentation

  2025cites this paper
• SemiDAViL: Semi-supervised Domain Adaptation with Vision-Language Guidance for Semantic Segmentation

  2025cites this paper
• Zero-Shot Time Series Forecasting of the Online Gig Economy Using the CHRONOS Pretrained Language Model

  2025cites this paper
• SRLFormer: Single Retinex-based and low-light image guidance Transformer for low-light image enhancement

  2025cites this paper
• An Improved Method for Zero-Shot Semantic Segmentation

  2025cites this paper
• SAMRI: Segment Anything Model for MRI

  2025cites this paper
• ViStream: Improving Computation Efficiency of Visual Streaming Perception via Law-of-Charge-Conservation Inspired Spiking Neural Network

  2025cites this paper
• Small Data Explainer - The impact of small data methods in everyday life

  2025cites this paper
• GF-ResFormer: A Hybrid Gabor-Fourier ResNet-Transformer Network for Precise Semantic Segmentation of High-Resolution Remote Sensing Imagery

  2025cites this paper
• A review on NLP zero-shot and few-shot learning: methods and applications

  2025cites this paper
• Multi-Granularity Relation Enhancement Network for Tiny Defect Detection on Printed Circuit Board

  2025cites this paper
• Few-shot image semantic segmentation based on meta-learning: A review

  2024cites this paper
• Zero-Shot Remote Sensing Image Classification Algorithm Based on Improved CLIP Model

  2024cites this paper
• SHARP-Net: A Refined Pyramid Network for Deficiency Segmentation in Culverts and Sewer Pipes

  2024cites this paper
• Software Vulnerability Detection Using LLM: Does Additional Information Help?

  2024cites this paper
• Vision-enhanced Peg-in-Hole for automotive body parts using semantic image segmentation and object detection

  2024cites this paper
• BCE4ZSR: Bi-encoder empowered by teacher cross-encoder for zero-shot cold-start news recommendation

  2024cites this paper
• RSAM-Seg: A SAM-based Approach with Prior Knowledge Integration for Remote Sensing Image Semantic Segmentation

  2024cites this paper
• Phase Contour Enhancement Network for Clothing Parsing

  2024cites this paper
• Target Detection and Segmentation Technology for Zero-shot Learning

  2024cites this paper
• Salient object detection via multi-grained refinement polygon topology positive feedback

  2024cites this paper
• Enhancing Representation Power of Deep Neural Networks With Negligible Parameter Growth for Industrial Applications

  2024cites this paper
• Component recognition of ISAR targets via multimodal feature fusion

  2024cites this paper
• Enhancing left ventricular segmentation in echocardiography with a modified mixed attention mechanism in SegFormer architecture

  2024cites this paper
• From superpixels to foundational models: An overview of unsupervised and generalizable image segmentation

  2024cites this paper
• Adaptive Self-Supporting Prototype Learning for Remote Sensing Few-Shot Semantic Segmentation

  2024cites this paper
• A Zero Reference Low Illumination Image Enhancement Method Based on IB-UNet

  2024cites this paper
• Reading ability detection using eye-tracking data with LSTM-based few-shot learning

  2024cites this paper
• Semiautomated generation of species-specific training data from large, unlabeled acoustic datasets for deep supervised birdsong isolation

  2024cites this paper
• Weak Edge Target Segmentation Network Based on Dual Attention Mechanism

  2024cites this paper
• On filling the intra-class and inter-class gaps for few-shot segmentation

  2024cites this paper
• Real-time semantic segmentation for autonomous driving: A review of CNNs, Transformers, and Beyond

  2024cites this paper
• Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Development

  2024cites this paper
• Multi-label guided graph attention network for education image retrieval

  2024cites this paper
• UCDR-Adapter: Exploring Adaptation of Pre-Trained Vision-Language Models for Universal Cross-Domain Retrieval

  2024cites this paper
• AFANet: Adaptive Frequency-Aware Network for Weakly-Supervised Few-Shot Semantic Segmentation

  2024cites this paper
• ISAnWin: inductive generalized zero-shot learning using deep CNN for malware detection across windows and android platforms

  2024cites this paper
• CGCOD: Class-Guided Camouflaged Object Detection

  2024cites this paper
• Chatting with a Learning Analytics Dashboard: The Role of Generative AI Literacy on Learner Interaction with Conventional and Scaffolding Chatbots

  2024cites this paper
• Modular Anti-noise Deep Learning Network for Robotic Grasp Detection Based on RGB Images

  2023cites this paper
• An overview on Meta-learning approaches for Few-shot Weakly-supervised Segmentation

  2023cites this paper
• Few Shot Semantic Segmentation: a review of methodologies, benchmarks, and open challenges

  2023influential citation
• Testing the Segment Anything Model on radiology data

  2023cites this paper
• Delving Deeper Into Image Dehazing: A Survey

  2023cites this paper
• A multi-branched semantic segmentation network based on twisted information sharing pattern for medical images

  2023cites this paper
• Attention-Guided Multi-Scale Fusion Network for Similar Objects Semantic Segmentation

  2023cites this paper
• Causal reasoning in typical computer vision tasks

  2023cites this paper
• A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development

  2023influential citation
• Modality Translation and Fusion for event-based semantic segmentation

  2023cites this paper
• Few Shot Semantic Segmentation: a review of methodologies and open challenges

  2023cites this paper