A Survey of Semantic Segmentation

This survey gives an overview over different techniques used for pixel-level semantic segmentation. Metrics and datasets for the evaluation of segmentation algorithms and traditional approaches for segmentation such as unsupervised methods, Decision Forests and SVMs are described and pointers to the relevant papers are given. Recently published approaches with convolutional neural networks are mentioned and typical problematic situations for segmentation algorithms are examined. A taxonomy of segmentation algorithms is given.

• Publication year

  2016

• Venue

  arXiv.org

• Publication date

  2016-02-21

• Fields of study

  Computer Science

• Identifiers
  arXiv 1602.06541
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Instance-Aware Semantic Segmentation via Multi-task Network Cascades

  2015cited by this paper
• Memory based active contour algorithm using pixel-level classified images for colon crypt segmentation

  2015cited by this paper
• Pixel-wise Segmentation of Street with Neural Networks

  2015influential reference
• Conditional Random Fields as Recurrent Neural Networks

  2015cited by this paper
• Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討

  2014cited by this paper
• ImageNet Large Scale Visual Recognition Challenge

  2014cited by this paper
• Scene Parsing with Object Instances and Occlusion Ordering

  2014cited by this paper
• Medical Image Computing and Computer-Assisted Intervention – MICCAI 2014

  2014cited by this paper
• Fully convolutional networks for semantic segmentation

  2014cited by this paper
• Can Masses of Non-Experts Train Highly Accurate Image Classifiers? - A Crowdsourcing Approach to Instrument Segmentation in Laparoscopic Images

  2014cited by this paper
• Recurrent Convolutional Neural Networks for Scene Parsing

  2013cited by this paper
• A new performance measure and evaluation benchmark for road detection algorithms

  2013cited by this paper
• Probabilistic Tracking of Affine-Invariant Anisotropic Regions

  2013cited by this paper
• Microsoft Kinect Sensor and Its Effect

  2012cited by this paper
• ImageNet classification with deep convolutional neural networks

  2012cited by this paper
• Discovery, segmentation and reactive grasping of unknown objects

  2012cited by this paper
• Machine learning - a probabilistic perspective

  2012cited by this paper
• Layered Object Models for Image Segmentation

  2012cited by this paper
• Markov random field models for supervised land cover classification from very high resolution multispectral remote sensing images

  2012cited by this paper
• Random walks based multi-image segmentation: Quasiconvexity results and GPU-based solutions

  2012cited by this paper
• Segmentation and learning of unknown objects through physical interaction

  2011cited by this paper
• Markov Random Fields for Vision and Image Processing

  2011cited by this paper
• Detection of Retinal Vascular Bifurcations by Trainable V4-Like Filters

  2011cited by this paper
• A pixel classification system for segmenting biomedical images using intensity neighborhoods and dimension reduction

  2011cited by this paper
• Object segmentation by alignment of poselet activations to image contours

  2011cited by this paper
• Distinctive Image Features from Scale-Invariant Keypoints Abstract by Matthijs Dorst Based on the paper by

  2011cited by this paper
• Object Detection with Discriminatively Trained Part Based Models

  2010cited by this paper
• Harmony potentials for joint classification and segmentation

  2010cited by this paper
• An Introduction to Conditional Random Fields

  2010cited by this paper
• The Pascal Visual Object Classes (VOC) Challenge

  2010cited by this paper
• Cell segmentation in microscopy imagery using a bag of local Bayesian classifiers

  2010cited by this paper
• Detecting People Using Mutually Consistent Poselet Activations

  2010cited by this paper
• Constrained parametric min-cuts for automatic object segmentation

  2010cited by this paper
• Nuclear segmentation in microscope cell images: A hand-segmented dataset and comparison of algorithms

  2009cited by this paper
• Associative hierarchical CRFs for object class image segmentation

  2009cited by this paper
• An improved objective evaluation measure for border detection in dermoscopy images

  2009cited by this paper
• Multi-class image segmentation using conditional random fields and global classification

  2009cited by this paper
• From contours to regions: An empirical evaluation

  2009cited by this paper
• Dimensionality Reduction: A Comparative Review

  2008cited by this paper
• Semantic texton forests for image categorization and segmentation

  2008cited by this paper
• A Simple High Performance Approach to Semantic Segmentation

  2008cited by this paper
• Using contours to detect and localize junctions in natural images

  2008cited by this paper
• Object Class Segmentation using Random Forests

  2008cited by this paper
• Multi-Class Segmentation with Relative Location Prior

  2008cited by this paper
• The DIARETDB1 Diabetic Retinopathy Database and Evaluation Protocol

  2007cited by this paper
• Interactive Image Segmentation via Adaptive Weighted Distances

  2007cited by this paper
• Road-Sign Detection and Recognition Based on Support Vector Machines

  2007cited by this paper
• Figure-ground segmentation using a hierarchical conditional random field

  2007cited by this paper
• Spectral Matting

  2007cited by this paper
• Graph based image segmentation

  2007cited by this paper
• DIARETDB 1 diabetic retinopathy database and evaluation protocol

  2007cited by this paper
• A Markov random field image segmentation model for color textured images

  2006cited by this paper
• TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-class Object Recognition and Segmentation

  2006cited by this paper
• Cosegmentation of Image Pairs by Histogram Matching - Incorporating a Global Constraint into MRFs

  2006cited by this paper
• on Pattern Analysis and Machine Intelligence

  2005cited by this paper
• A Measure for Objective Evaluation of Image Segmentation Algorithms

  2005cited by this paper
• A Comparison of Image Segmentation Algorithms

  2005cited by this paper
• Histograms of oriented gradients for human detection

  2005cited by this paper
• Multiscale conditional random fields for image labeling

  2004cited by this paper
• Induction of decision trees

  2004cited by this paper
• "GrabCut": interactive foreground extraction using iterated graph cuts

  2004cited by this paper
• Ridge-based vessel segmentation in color images of the retina

  2004cited by this paper
• Distinctive Image Features from Scale-Invariant Keypoints

  2004cited by this paper
• Snakes: Active contour models

  2004cited by this paper
• A novel white blood cell segmentation scheme using scale-space filtering and watershed clustering

  2003cited by this paper
• Mean Shift: A Robust Approach Toward Feature Space Analysis

  2002cited by this paper
• A tutorial on Principal Components Analysis

  2002cited by this paper
• What are Textons?

  2002cited by this paper
• Visual categorization with bags of keypoints

  2002cited by this paper
• An assessment of support vector machines for land cover classi(cid:142) cation

  2002cited by this paper
• Automatic Brain and Tumor Segmentation

  2002cited by this paper
• Color image segmentation: advances and prospects

  2001cited by this paper
• Fast approximate energy minimization via graph cuts

  2001cited by this paper
• A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics

  2001cited by this paper
• Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm

  2001cited by this paper
• Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images

  2001cited by this paper
• The Watershed Transform: Definitions, Algorithms and Parallelization Strategies

  2000cited by this paper
• The Watershed Transform: Definitions, Algorithms and Parallelization Strategies

  2000cited by this paper
• Interactive Organ Segmentation Using Graph Cuts

  2000cited by this paper
• A Survey of Current Methods in Medical Image Segmentation

  1999cited by this paper
• Image segmentation via adaptive K-mean clustering and knowledge-based morphological operations with biomedical applications

  1998cited by this paper
• A Tutorial on Support Vector Machines for Pattern Recognition

  1998cited by this paper
• Fully automatic segmentation of the brain in MRI

  1998cited by this paper
• Evaluation of convolutional neural networks for visual recognition

  1998cited by this paper
• Automatic tracking of laparoscopic instruments by color coding

  1997cited by this paper
• An Experimental Comparison of Range Image Segmentation Algorithms

  1996cited by this paper
• An analysis of selected computer interchange color spaces

  1992cited by this paper
• An Empirical Comparison of Selection Measures for Decision-Tree Induction

  1989cited by this paper
• Adaptive histogram equalization and its variations

  1987cited by this paper
• Available

  1984cited by this paper
• Clustering Algorithms

  1975cited by this paper

• PBINet: A Pixel-Wise Boundary Information Refinement Network for Road Scene Segmentation

  2026cites this paper
• GEOMR: Integrating image geographic features and human reasoning knowledge for image geolocalization

  2026cites this paper
• PIA: Fusing edge prior information into attention for semantic segmentation in vision transformer

  2026cites this paper
• GeloVec: Higher Dimensional Geometric Smoothing for Coherent Visual Feature Extraction in Image Segmentation

  2025cites this paper
• Split Computing in Autonomous Mobility for Efficient Semantic Segmentation using Transformers

  2025cites this paper
• ArcSE: A Dual-Branch Semantic Segmentation Model for Robust Pantograph–Catenary Arcing Detection in Complex Environments

  2025cites this paper
• Unsupervised Deep Learning for Semantic Segmentation using Laparoscopic Videos: A Self-Detection and Self-Learning Approach

  2025cites this paper
• Enhancing DeepLabV3+ with Kolmogorov-Arnold Convolutions Networks: A Multiscale Feature Extraction Approach

  2025cites this paper
• Deep learning in dermatopathology: applications for skin disease diagnosis and classification

  2025cites this paper
• A Two-Dimensional Wavelet Attention U-Net for the Automatic Detection and Classification of Beehive Cells

  2025cites this paper
• LithoExp: Explainable Two-stage CNN-based Lithographic Hotspot Detection with Layout Defect Localization

  2025cites this paper
• A Novel Convolutional-Free Method for 3D Medical Imaging Segmentation

  2025cites this paper
• SiMultiF: A Remote Sensing Multimodal Semantic Segmentation Network With Adaptive Allocation of Modal Weights for Siamese Structures in Multiscene

  2025cites this paper
• A multiscale spectral embedding network with dual–domain attention for cell segmentation and detection

  2025cites this paper
• DarkSegNet: Low-light semantic segmentation network based on image pyramid

  2025cites this paper
• Characterizing Bruch's Membrane: State-of-the-Art Imaging, Computational Segmentation, and Biologic Models in Retinal Disease and Health.

  2025cites this paper
• SMFR-Net: simple multi-domain flare removal network

  2025cites this paper
• An intra- and inter-class context and consistency network for supervised and semi-supervised blastocyst segmentation

  2025cites this paper
• Integrating Multimodal Learning for Scalable Indoor Scene Understanding

  2025cites this paper
• From Pixels to Damage Severity: Estimating Earthquake Impacts Using Semantic Segmentation of Social Media Images

  2025cites this paper
• LESS-Net: a lightweight network for epistaxis image segmentation using similarity-based contrastive learning

  2025cites this paper
• Utility Loss of Information-Critical Prompt Transmission for Semantic Empowered S-IoT

  2025cites this paper
• Hotspot Segmentation in Whole-Body Bone Scans for Cancer Metastasis Detection Using U-Net++

  2025cites this paper
• Fast semantic segmentation for remote sensing images with an improved Short-Term Dense-Connection (STDC) network

  2024cites this paper
• Leveraging power of deep learning for fast and efficient elite pixel selection in time series SAR interferometry

  2024cites this paper
• A new baseline for edge detection: Make Encoder-Decoder great again

  2024cites this paper
• Evaluating the Effectiveness of Panoptic Segmentation Through Comparative Analysis

  2024cites this paper
• Image semantic segmentation of indoor scenes: A survey

  2024cites this paper
• More than the Sum of Its Parts: Ensembling Backbone Networks for Few-Shot Segmentation

  2024cites this paper
• Breast Anomaly Detection Using YOLO-Based Deep Learning CAD System in Digital Mammograms: A Second Opinion Tool for Breast Cancer Diagnosis (1st Stage)

  2024cites this paper
• Advanced analysis of disintegrating pharmaceutical compacts using deep learning-based segmentation of time-resolved micro-tomography images

  2024cites this paper
• Panoptic Segmentation using Mask2Former with Swin Transformers

  2024cites this paper
• Automatic generation of training data for semantic segmentation using game engine

  2024cites this paper
• From Feature Importance to Natural Language Explanations Using LLMs with RAG

  2024cites this paper
• A Self-Supervised Semantic Segmentation Method for Identifying Barrett' s Esophagus in Endoscopic Images

  2024cites this paper
• Road Network Mapping from Multispectral Satellite Imagery: Leveraging Deep Learning and Spectral Bands

  2024cites this paper
• Flare-Free Vision: Empowering Uformer with Depth Insights

  2024cites this paper
• Optimized Deep Network for Precise Digital Terrain Model Extraction from Light Detection and Ranging Data

  2024cites this paper
• On the Affinity of Image Smoothing and Segmentation Problems

  2024cites this paper
• In Defense of Lazy Visual Grounding for Open-Vocabulary Semantic Segmentation

  2024cites this paper
• Free usable space estimation in broiler farms using an image segmentation algorithm

  2024cites this paper
• A Study on the Regional Evolution of the Hefei Political and Cultural New District Skyline Based on Exploratory Factor Analysis and Semantic Segmentation

  2024cites this paper
• Towards In-Vehicle Multi-Task Facial Attribute Recognition: Investigating Synthetic Data and Vision Foundation Models

  2024cites this paper
• Class Similarity Transition: Decoupling Class Similarities and Imbalance from Generalized Few-shot Segmentation

  2024cites this paper
• Interactive Network Perturbation between Teacher and Students for Semi-Supervised Semantic Segmentation

  2024cites this paper
• Domain wall and magnetic tunnel junction hybrid for on-chip learning in UNet architecture

  2024cites this paper
• Emerging Trends in Autonomous Vehicle Perception: Multimodal Fusion for 3D Object Detection

  2024cites this paper
• Harnessing smartphone RGB imagery and LiDAR point cloud for enhanced leaf nitrogen and shoot biomass assessment - Chinese spinach as a case study

  2024cites this paper
• Keep the Human in the Loop: Arguments for Human Assistance in the Synthesis of Simulation Data for Robot Training

  2024cites this paper
• MarsSeg: Mars Surface Semantic Segmentation With Multilevel Extractor and Connector

  2024cites this paper
• ETFT: Equiangular Tight Frame Transformer for Imbalanced Semantic Segmentation

  2024cites this paper
• Multi-Task Self-Supervised Learning for Image Segmentation Task

  2023cites this paper
• Deep Image Matting: A Comprehensive Survey

  2023cites this paper
• Deep-learning based analysis of metal-transfer images in GMAW process

  2023cites this paper
• Semantic Image Segmentation: Two Decades of Research

  2023cites this paper
• Semantic Segmentation Based Copy Paste Forgery Detection

  2023cites this paper
• An Ultra Fast Semantic Segmentation Model for AMR’s Path Planning

  2023cites this paper
• Benchmarks: Semantic Segmentation Neural Network Verification and Objection Detection Neural Network Verification in Perceptions Tasks of Autonomous Driving

  2023cites this paper
• U-Net Wildfire Classification in Sumatra Island Based on Sentinel-2 and Landsat-8 Satellite Images

  2023cites this paper
• Scene Parsing Using Fully Convolutional Network for Semantic Segmentation

  2023cites this paper
• Toward Flare-Free Images: A Survey

  2023cites this paper
• Satellite Captioning: Large Language Models to Augment Labeling

  2023cites this paper
• Rethinking U-Net Deep Neural Network for Spine Radiographic Images-Based Spine Vertebrae Segmentation

  2023cites this paper
• Research on Positioning and dimension measurement of truck compartment based on Semantic segmentation in automatic loading system

  2023cites this paper
• Lidar Annotation Is All You Need

  2023cites this paper
• Novel Convolutions for Semantic Segmentation of Remote Sensing Images

  2023cites this paper
• Unlocking Early-Exiting Semantic Segmentation with Branched Networks

  2023cites this paper
• Fine-tuned deep convolutional neural network for hand segmentation in egocentric videos

  2023cites this paper
• Deep Learning Deep Learning -- Based Semantic Based Semantic Feature Extraction Feature Extraction:: A Literature Review and A Literature Review and Future Directions Future Directions

  2023cites this paper
• A Comparative Analysis of Image Segmentation Using Classical and Deep Learning Approach

  2023cites this paper
• Few Shot Semantic Segmentation: a review of methodologies, benchmarks, and open challenges

  2023cites this paper
• Supplementary Material: Compensation Learning in Semantic Segmentation

  2023cites this paper
• Context Aware Crowd Tracking and Anomaly Detection via Deep Learning and Social Force Model

  2023cites this paper
• Automated multi-scale computational pathotyping (AMSCP) of inflamed synovial tissue

  2023cites this paper
• Predicting dataset size for neural network fine-tuning with a given quality in object detection task

  2023cites this paper
• Few Shot Semantic Segmentation: a review of methodologies and open challenges

  2023cites this paper
• Compensation Learning in Semantic Segmentation

  2023cites this paper
• Detection and correction of image distortions induced by parasitic light sensitivity using deep learning methods

  2023cites this paper
• Vivid And Diverse Image Colorization Using Deep Learning Techniques

  2023cites this paper
• Knowledge Distillation for Quantized Vehicle Sensor Data

  2023cites this paper
• Building detection in aerial images using fusion of U-Net and ResNet architectures

  2023cites this paper
• Multi-view Semantic Information Guidance for Light Field Image Segmentation

  2023cites this paper
• Non-invasive identification of apple sugar content based on convolutional neural networks

  2022cites this paper
• Application of Multi-modal Fusion Attention Mechanism in Semantic Segmentation

  2022cites this paper
• Survey of Road Extraction Methods in Remote Sensing Images Based on Deep Learning

  2022influential citation
• GAN-Based Image Colorization for Self-Supervised Visual Feature Learning

  2022cites this paper
• Semantic Communications for Future Internet: Fundamentals, Applications, and Challenges

  2022cites this paper
• HALSIE: Hybrid Approach to Learning Segmentation by Simultaneously Exploiting Image and Event Modalities

  2022cites this paper
• Transferring learned patterns from ground-based field imagery to predict UAV-based imagery for crop and weed semantic segmentation in precision crop farming

  2022cites this paper
• A Review of Nuclei Detection and Segmentation on Microscopy Images Using Deep Learning With Applications to Unbiased Stereology Counting

  2022cites this paper
• Kidney Tumor Semantic Segmentation Using Deep Learning: A Survey of State-of-the-Art

  2022cites this paper
• Active learning based semantic segmentation for extraction of minute objects from multispectral satellite images

  2022cites this paper
• Moth image segmentation based on improved Unet

  2022cites this paper
• JSH-Net: joint semantic segmentation and height estimation using deep convolutional networks from single high-resolution remote sensing imagery

  2022cites this paper
• Segmentation of Medical Image Using Novel Dilated Ghost Deep Learning Model

  2022cites this paper
• Semantic Image Segmentation Methods in the Duckietown Project

  2022cites this paper
• HALSIE - Hybrid Approach to Learning Segmentation by Simultaneously Exploiting Image and Event Modalities

  2022cites this paper
• A modified DeepLabV3+ based semantic segmentation of chest computed tomography images for COVID‐19 lung infections

  2022cites this paper
• Water Color Identification System for Monitoring Aquaculture Farms

  2022cites this paper
• Semantic segmentation and path planning for orchards based on UAV images

  2022cites this paper