High-dimensional mutual information estimation for image registration

We present a new algorithm for mutual information estimation for image registration based on the nearest neighbor entropy estimator of Kozachenko and Leonenko. We modify the algorithm to be numerically robust and computationally efficient, with optimal asymptotic complexity O(N/sub pixels/d/sub dim/). We propose two MI-based criteria exploiting the high-dimensionality of the feature space and show their effectiveness in determining the correct alignment even in difficult cases when classical criteria fail.

• Publication year

  2004

• Venue

  2004 International Conference on Image Processing, 2004. ICIP '04.

• Publication date

  2004-10-24

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1109/ICIP.2004.1421419
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A new class of entropy estimators for multi-dimensional densities

  2003cited by this paper
• Mutual-information-based registration of medical images: a survey

  2003cited by this paper
• Binless strategies for estimation of information from neural data.

  2002cited by this paper
• Applications of entropic spanning graphs

  2002cited by this paper
• Non-rigid registration using higher-order mutual information

  2000cited by this paper
• Mutual Information in Learning Feature Transformations

  2000cited by this paper
• Nonparametric entropy estimation. An overview

  1997cited by this paper
• Alignment by Maximization of Mutual Information

  1995cited by this paper
• A decomposition of multidimensional point sets with applications to k-nearest-neighbors and n-body potential fields

  1995cited by this paper
• A decomposition of multi-dimensional point-sets with applications to k-nearest-neighbors and n-body potential fields (preliminary version)

  1992cited by this paper

• Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Models

  2024cites this paper
• Efficient Implementation of Regional Mutual Information for the Registration of Road Images

  2020cites this paper
• Information Theory Measures via Multidimensional Gaussianization

  2020cites this paper
• An Information Theory-Based Scheme for Efficient Classification of Remote Sensing Data

  2017cites this paper
• PARAMETER IDENTIFIABILITY THROUGH INFORMATION THEORY

  2017cites this paper
• Unsupervised Data Driven Feature Extraction by Means of Mutual Information Maximization

  2017cites this paper
• A low dimensional entropy-based descriptor of several tissues in skin cancer histopathology samples

  2015cites this paper
• A fast affine-invariant features for image stitching under large viewpoint changes

  2015cites this paper
• Diffusion MRI Analysis Techniques Inspired by the Preterm Infant Brain

  2015influential citation
• Does dirichlet prior smoothing solve the Shannon entropy estimation problem?

  2015cites this paper
• Registration of Images With Outliers Using Joint Saliency Map

  2013influential citation
• Distributed high dimensional information theoretical image registration via random projections

  2012influential citation
• Method for estimating the relative contribution of phase and power spectra to the total information in natural-scene patches.

  2012cites this paper
• Group-Structured and Independent Subspace Based Dictionary Learning

  2012cites this paper
• Approximate all nearest neighbor search for high dimensional entropy estimation for image registration

  2012cites this paper
• Automatic colposcopy video tissue classification using higher order entropy-based image registration

  2011cites this paper
• Consistent Information Content Estimation for Diffusion Tensor MR Images

  2011cites this paper
• Approximate Best Bin First k-d Tree All Nearest Neighbor Search with Incremental Updates

  2010influential citation
• Design and implementation for satellite remote sensing forest fire-points automatic monitoring system

  2009cites this paper
• Universal Estimation of Information Measures for Analog Sources

  2009cites this paper
• Fast Parallel Estimation of High Dimensional Information Theoretical Quantities with Low Dimensional Random Projection Ensembles

  2009cites this paper
• Image Registration Model Under Arbitrarily-Shaped Locally Variant Illumination and Occlusions

  2009cites this paper
• Mutual information-based multimodal image registration using a novel joint histogram estimation

  2008cites this paper
• Regional image similarity criteria based on the Kozachenko-Leonenko entropy estimator

  2008cites this paper
• Estimates of the information content and dimensionality of natural scenes from proximity distributions.

  2007cites this paper
• Image registration methods in high‐dimensional space

  2006influential citation
• Incremental Updating of Nearest Neighbor-Based High-Dimensional Entropy Estimation

  2006influential citation
• Unsupervised registration of textured images: applications to side-scan sonar

  2005influential citation