Sketch-Based Image Retrieval With Multi-Clustering Re-Ranking

To improve the performance of sketch-based image retrieval (SBIR) methods, most existing SBIR methods develop brand new SBIR methods. In fact, a re-ranking approach, which can refine the retrieval results of SBIR methods, is also beneficial. Inspired by this, in this paper, an SBIR re-ranking approach based on multi-clustering is proposed. In order to make the re-ranking approach invisible to users and adaptive to different types of image datasets, we made it an unsupervised method using blind feedback. Distinguished from the existing methods, this re-ranking approach uses the semantic information of three types of images: edge maps, object images (images with black background and natural images’ foreground objects) and natural images themselves. With the initial retrieval results of an SBIR method, our approach first does the clustering operation for three types of images. Then, we utilize the clustering results to generate a cluster score for each initial retrieval result. Finally, the cluster score is used to calculate the final retrieval scores for the initial retrieval results. The experiments on different SBIR datasets are conducted. Experimental results demonstrate that, by implementing our re-ranking approach, the retrieval accuracy of a variety of SBIR methods is increased. Furthermore, the comparisons between our re-ranking method and the existing re-ranking methods are given.

• Publication year

  2020

• Venue

  IEEE transactions on circuits and systems for video technology (Print)

• Publication date

  2020-12-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/TCSVT.2019.2959875
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Enhancing Sketch-Based Image Retrieval by CNN Semantic Re-ranking

  2020cited by this paper
• Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval

  2019cited by this paper
• Joint Image-Text Hashing for Fast Large-Scale Cross-Media Retrieval Using Self-Supervised Deep Learning

  2019cited by this paper
• Geometry and Topology Preserving Hashing for SIFT Feature

  2019cited by this paper
• Position Focused Attention Network for Image-Text Matching

  2019cited by this paper
• Joint Hypergraph Learning for Tag-Based Image Retrieval

  2018cited by this paper
• Sketching out the details: Sketch-based image retrieval using convolutional neural networks with multi-stage regression

  2018cited by this paper
• A Zero-Shot Framework for Sketch-based Image Retrieval

  2018cited by this paper
• Tag-based Weakly-supervised Hashing for Image Retrieval

  2018cited by this paper
• Robust Quantization for General Similarity Search

  2018cited by this paper
• Image Re-Ranking Based on Topic Diversity

  2017cited by this paper
• Unsupervised Visual Hashing with Semantic Assistant for Content-Based Image Retrieval

  2017cited by this paper
• Deep Sketch Hashing: Fast Free-Hand Sketch-Based Image Retrieval

  2017influential reference
• Compact descriptors for sketch-based image retrieval using a triplet loss convolutional neural network

  2017cited by this paper
• Cross-modal subspace learning for fine-grained sketch-based image retrieval

  2017cited by this paper
• Cross-View Retrieval via Probability-Based Semantics-Preserving Hashing

  2017cited by this paper
• Coherent Semantic-Visual Indexing for Large-Scale Image Retrieval in the Cloud

  2017cited by this paper
• Quadruplet Networks for Sketch-Based Image Retrieval

  2017cited by this paper
• Fusion of Deep Learning and Compressed Domain Features for Content-Based Image Retrieval

  2017cited by this paper
• SmartSketcher: sketch-based image retrieval with dynamic semantic re-ranking

  2017cited by this paper
• Synergistic Instance-Level Subspace Alignment for Fine-Grained Sketch-Based Image Retrieval

  2017cited by this paper
• Multi-View Object Retrieval via Multi-Scale Topic Models

  2016cited by this paper
• Instance-Level Coupled Subspace Learning for Fine-Grained Sketch-Based Image Retrieval

  2016cited by this paper
• A Privacy-Preserving and Copy-Deterrence Content-Based Image Retrieval Scheme in Cloud Computing

  2016cited by this paper
• Sketch Me That Shoe

  2016cited by this paper
• Sketch-based image retrieval via Siamese convolutional neural network

  2016cited by this paper
• Enhancing Sketch-Based Image Retrieval by Re-Ranking and Relevance Feedback

  2016influential reference
• SketchNet: Sketch Classification with Web Images

  2016cited by this paper
• Sketch-Based Image Retrieval by Salient Contour Reinforcement

  2016cited by this paper
• Sketch-based image retrieval using contour segments

  2015cited by this paper
• Deep Residual Learning for Image Recognition

  2015cited by this paper
• Scalable Sketch-Based Image Retrieval Using Color Gradient Features

  2015cited by this paper
• Sketch-based manga retrieval using manga109 dataset

  2015cited by this paper
• Learning Visual Semantic Relationships for Efficient Visual Retrieval

  2015cited by this paper
• Going deeper with convolutions

  2014cited by this paper
• Saliency Tree: A Novel Saliency Detection Framework

  2014cited by this paper
• Learning Fine-Grained Image Similarity with Deep Ranking

  2014cited by this paper
• Caffe: Convolutional Architecture for Fast Feature Embedding

  2014cited by this paper
• Similarity-Invariant Sketch-Based Image Retrieval in Large Databases

  2014cited by this paper
• Very Deep Convolutional Networks for Large-Scale Image Recognition

  2014cited by this paper
• Indexing billions of images for sketch-based retrieval

  2013cited by this paper
• Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection

  2013cited by this paper
• ImageNet classification with deep convolutional neural networks

  2012cited by this paper
• How do humans sketch objects?

  2012cited by this paper
• Sketch-based image retrieval on a large scale database

  2012cited by this paper
• Sketch-Based Image Retrieval: Benchmark and Bag-of-Features Descriptors

  2011cited by this paper
• Global contrast based salient region detection

  2011cited by this paper
• Edgel index for large-scale sketch-based image search

  2011cited by this paper
• Technical Section: An evaluation of descriptors for large-scale image retrieval from sketched feature lines

  2010cited by this paper
• A descriptor for large scale image retrieval based on sketched feature lines

  2009cited by this paper
• Boost search relevance for tag-based social image retrieval

  2009influential reference
• Clustering by Passing Messages Between Data Points

  2007cited by this paper
• Histograms of oriented gradients for human detection

  2005cited by this paper
• Distinctive Image Features from Scale-Invariant Keypoints

  2004cited by this paper
• Edge image description using angular radial partitioning

  2004cited by this paper
• Query by Visual Example - Content based Image Retrieval

  1992cited by this paper
• A Computational Approach to Edge Detection

  1986cited by this paper
• Submitted to Ieee Transactions on Pattern Analysis and Machine Intelligence Learning to Detect Natural Image Boundaries Using Local Brightness, Color, and Texture Cues

  year unknowncited by this paper

• A Video Summarization Technique using Multi- Feature DWHT and GMM for CBVR System

  2026cites this paper
• Modality Fused Class-Proxy With Knowledge Distillation for Zero-Shot Sketch-Based Image Retrieval

  2025cites this paper
• Multivariate Feedback-Based Image-Text Joint Learning for Sketch-Less Facial Image Retrieval

  2025cites this paper
• Text-to-Image Diffusion Models are Great Sketch-Photo Matchmakers

  2024cites this paper
• Modality-Aware Representation Learning for Zero-shot Sketch-based Image Retrieval

  2024cites this paper
• Learning Proposal-Aware Re-Ranking for Weakly-Supervised Temporal Action Localization

  2024cites this paper
• Fully Unsupervised Domain-Agnostic Image Retrieval

  2024cites this paper
• Deep supervision network with contrastive learning for zero-shot sketch-based image retrieval

  2024cites this paper
• RefinerHash: a new hashing-based re-ranking technique for image retrieval

  2024cites this paper
• If At First You Don't Succeed: Test Time Re-ranking for Zero-shot, Cross-domain Retrieval

  2023cites this paper
• Multi-Scale Human-Object Interaction Detector

  2023cites this paper
• Cross-Domain Alignment for Zero-Shot Sketch-Based Image Retrieval

  2023cites this paper
• Novel hybrid generative adversarial network for synthesizing image from sketch

  2023cites this paper
• Boosting Diversity in Visual Search with Pareto Non-Dominated Re-Ranking

  2023cites this paper
• Consensus Knowledge Exploitation for Partial Query Based Image Retrieval

  2023cites this paper
• A Weakly Supervised Learning Framework for Salient Object Detection via Hybrid Labels

  2022cites this paper
• Deep Learning Approaches for Fashion Knowledge Extraction From Social Media: A Review

  2022cites this paper
• DLI-Net: Dual Local Interaction Network for Fine-Grained Sketch-Based Image Retrieval

  2022cites this paper
• ACNet: Approaching-and-Centralizing Network for Zero-Shot Sketch-Based Image Retrieval

  2021cites this paper
• Deep Transfer Hashing for Image Retrieval

  2021cites this paper
• Social image retrieval based on topic diversity

  2021cites this paper
• Reference-based model using multimodal gated recurrent units for image captioning

  2020cites this paper
• 3D Shape Reconstruction from Free-Hand Sketches

  2020cites this paper
• New local binary pattern approaches based on color channels in texture classification

  2020cites this paper
• Sketch-Guided Scenery Image Outpainting

  2020cites this paper
• Where to Look and How to Describe: Fashion Image Retrieval With an Attentional Heterogeneous Bilinear Network

  2020cites this paper
• Optimally configured convolutional neural network for Tamil Handwritten Character Recognition by improved lion optimization model

  2020cites this paper
• Personalized product search based on user transaction history and hypergraph learning

  2020cites this paper
• A novel generative adversarial net for calligraphic tablet images denoising

  2019cites this paper
• AN EFFICIENT DENSITY BASED ANT COLONY APPROACH ON WEB DOCUMENT CLUSTERING

  year unknowncites this paper