Information Theory, Inference, and Learning Algorithms

No abstract is available for this paper.

• Publication year

  2004

• Venue

  IEEE Transactions on Information Theory

• Publication date

  Unknown publication date

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1109/tit.2004.834752
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A Mathematical Theory of Communication

  2006cited by this paper
• Information Theory and Coding

  2005cited by this paper
• The Theory of Information and Coding

  2005cited by this paper
• Constructing free-energy approximations and generalized belief propagation algorithms

  2005cited by this paper
• Low-Density Parity-Check Codes

  2004influential reference
• Sparse low-density parity-check codes for channels with cross-talk

  2003cited by this paper
• Tree-based reparameterization framework for analysis of sum-product and related algorithms

  2003influential reference
• Fast Forward Selection to Speed Up Sparse Gaussian Process Regression

  2003cited by this paper
• Sparse-graph codes for quantum error correction

  2003cited by this paper
• The Infinite Hidden Markov Model

  2002cited by this paper
• Fast hands-free writing by gaze direction

  2002cited by this paper
• Bayesian Monte Carlo

  2002cited by this paper
• Perfect sampling for the wavelet reconstruction of signals

  2002cited by this paper
• Mean-Field Approaches to Independent Component Analysis

  2002cited by this paper
• On ensembles of low-density parity-check codes: Asymptotic distance distributions

  2002cited by this paper
• VIBES: A Variational Inference Engine for Bayesian Networks

  2002cited by this paper
• Survey propagation: An algorithm for satisfiability

  2002cited by this paper
• AN ALGEBRAIC DESCRIPTION OF ITERATIVE DECODING SCHEMES

  2001cited by this paper
• Efficient encoding of low-density parity-check codes

  2001cited by this paper
• The capacity of low-density parity-check codes under message-passing decoding

  2001cited by this paper
• Bethe free energy, Kikuchi approximations, and belief propagation algorithms

  2001cited by this paper
• A Double-Loop Algorithm to Minimize the Bethe and Kikuchi Free Energies

  2001cited by this paper
• LDPC codes: a group algebra formulation

  2001cited by this paper
• BSC Thresholds for Code Ensembles Based on “Typical Pairs” Decoding

  2001cited by this paper
• Improving Markov chain Monte Carlo Estimators by Coupling to an Approximating Chain

  2001cited by this paper
• A New View of ICA

  2001cited by this paper
• Design of capacity-approaching irregular low-density parity-check codes

  2001cited by this paper
• Efficient erasure correcting codes

  2001cited by this paper
• Belief Optimization for Binary Networks: A Stable Alternative to Loopy Belief Propagation

  2001influential reference
• An Idiosyncratic Journey Beyond Mean Field Theory

  2001influential reference
• Infinite Mixtures of Gaussian Process Experts

  2001cited by this paper
• Evaluation of Gallager Codes for Short Block Length and High Rate Applications

  2001cited by this paper
• Following a moving target—Monte Carlo inference for dynamic Bayesian models

  2001cited by this paper
• Reliable communication over channels with insertions, deletions, and substitutions

  2001cited by this paper
• Thesis Supervisor Accepted by.......................................................................

  2001cited by this paper
• Ensemble Learning for Blind Source Separation

  2001cited by this paper
• What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration.

  2001cited by this paper
• Discovering Multiple Constraints that are Frequently Approximately Satisfied

  2001cited by this paper
• Dasher—a data entry interface using continuous gestures and language models

  2000cited by this paper
• Mendel's Demon: Gene Justice and the Complexity of Life

  2000cited by this paper
• Codes on graphs: normal realizations

  2000cited by this paper
• What is a moment? "Cortical" sensory integration over a brief interval.

  2000cited by this paper
• Variational Gaussian process classifiers

  2000influential reference
• The Origins of Spread-Spectrum Communications

  2000cited by this paper
• A Bayesian Committee Machine

  2000cited by this paper
• An Alternative to Runlength-limiting Codes: Turn Timing Errors into Substitution Errors

  2000influential reference
• Bayesian numerical analysis

  2000cited by this paper
• Using the Nyström Method to Speed Up Kernel Machines

  2000cited by this paper
• Ensemble Learning for Blind Image Separation and Deconvolution

  2000cited by this paper
• Gaussian Processes for Classification: Mean-Field Algorithms

  2000influential reference
• Watermark codes: reliable communication over insertion/deletion channels

  2000cited by this paper
• The Nature of Statistical Learning Theory

  2000cited by this paper
• Generalized Belief Propagation

  2000cited by this paper
• Sparse Greedy Gaussian Process Regression

  2000cited by this paper
• Comparison of constructions of irregular Gallager codes

  1999cited by this paper
• Comparison of Approximate Methods for Handling Hyperparameters

  1999cited by this paper
• High genomic deleterious mutation rates in hominids

  1999cited by this paper
• Ensemble learning for independent component analysis

  1999cited by this paper
• Blind Separation of Sources

  1999cited by this paper
• Fourier Analysis on Finite Groups and Applications: Special Functions on H q – K -Bessel and Spherical

  1999cited by this paper
• Convergence of iterative decoding

  1999cited by this paper
• The Infinite Gaussian Mixture Model

  1999cited by this paper
• Exact sampling and approximate counting techniques

  1998cited by this paper
• On Two-Dimensional Arrays and Crossword Puzzles

  1998cited by this paper
• Improved low-density parity-check codes using irregular graphs and belief propagation

  1998cited by this paper
• Choice of Basis for Laplace Approximation

  1998cited by this paper
• Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids

  1998cited by this paper
• Tools for Statistical Inference: Methods for the Exploration of Posterior Distributions and Likelihood Functions, 3rd Edition

  1998cited by this paper
• Fundamentals of Statistical and Thermal Physics

  1998cited by this paper
• Annealed importance sampling

  1998cited by this paper
• Perfect Simulation for orthogonal model mixing

  1998cited by this paper
• Turbo Decoding as an Instance of Pearl's "Belief Propagation" Algorithm

  1998cited by this paper
• Graphical Models for Machine Learning and Digital Communication

  1998cited by this paper
• The Z-coder adaptive binary coder

  1998cited by this paper
• A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants

  1998cited by this paper
• Reinforcement Learning: An Introduction

  1998cited by this paper
• Markov Chain Monte Carlo Methods Based on `Slicing' the Density Function

  1997influential reference
• A Bayesian approach to relevance in game playing

  1997cited by this paper
• The Major Transitions in Evolution

  1997cited by this paper
• Evaluation of Gaussian processes and other methods for non-linear regression

  1997influential reference
• Dynamic conditional independence models and Markov chain Monte Carlo methods

  1997cited by this paper
• Good error-correcting codes based on very sparse matrices

  1997cited by this paper
• Hybrid Adaptive Splines

  1997cited by this paper
• Insertion/deletion correction with spectral nulls

  1997cited by this paper
• Practical loss-resilient codes

  1997cited by this paper
• Maximum Likelihood Blind Source Separation: A Context-Sensitive Generalization of ICA

  1996cited by this paper
• BAYESIAN NON-LINEAR MODELING FOR THE PREDICTION COMPETITION

  1996cited by this paper
• Near Shannon Limit Performance of Low Density Parity Check Codes

  1996cited by this paper
• Near optimum error correcting coding and decoding: turbo-codes

  1996cited by this paper
• Gaussian Processes for Bayesian Classification via Hybrid Monte Carlo

  1996influential reference
• Bayesian Methods for Backpropagation Networks

  1996cited by this paper
• In Advances in Neural Information Processing Systems

  1996influential reference
• Codes and Decoding on General Graphs

  1996cited by this paper
• Exact sampling with coupled Markov chains and applications to statistical mechanics

  1996cited by this paper
• An Information-Maximization Approach to Blind Separation and Blind Deconvolution

  1995cited by this paper
• On genetic algorithms

  1995cited by this paper
• Probability estimation for PPM

  1995cited by this paper
• Similarity Metric Learning for a Variable-Kernel Classifier

  1995cited by this paper
• Bayesian learning for neural networks

  1995influential reference
• Linear-time encodable and decodable error-correcting codes

  1995cited by this paper

• Benchmarks Are Not That Out of Distribution: Word Overlap Predicts Performance

  2026cites this paper
• A note on data-driven methods for mechanical problems with non-unique solutions

  2026cites this paper
• Atmospheric characterization of HIP 67522 b with VLT/CRIRES+. VLT/CRIRES+ suggests a heavier planet and hints at deuterium fractionation

  2026cites this paper
• From Standard to Bayesian: Revisiting Ocean Color Model Evaluation

  2026cites this paper
• Information Theoretic Optimal Surveillance for Epidemic Prevalence in Networks

  2026cites this paper
• What Is a Pattern in Statistical Mechanics? Formalizing Structure and Patterns in One-Dimensional Spin Lattice Models with Computational Mechanics

  2026cites this paper
• Polyphonic Intelligence: Constraint-Based Emergence, Pluralistic Inference, and Non-Dominating Integration

  2026cites this paper
• Information-Theoretic Multi-Model Fusion for Target-Oriented Adaptive Sampling in Materials Design

  2026cites this paper
• Physics-Aware, Shannon-Optimal Compression via Arithmetic Coding for Distributional Fidelity

  2026influential citation
• MarkSweep: A No-box Removal Attack on AI-Generated Image Watermarking via Noise Intensification and Frequency-aware Denoising

  2026cites this paper
• Sample size dependence of Occam’s razor in human decision-making

  2026cites this paper
• Breaking the Orthogonality Barrier in Quantum LDPC Codes

  2026cites this paper
• SigGen: Signal Generation for Wireless Sensing Based on Disentangled Representation

  2026cites this paper
• Efficient prior sensitivity analysis for Bayesian model comparison

  2026influential citation
• Proteins as Statistical Languages: Information-Theoretic Signatures of Proteomes Across the Tree of Life

  2026cites this paper
• Irreversible Kinetics Emerges from Bayesian Inference over Admissible Histories

  2026cites this paper
• SunBURST: Deterministic GPU-Accelerated Bayesian Evidence via Mode-Centric Laplace Integration

  2026cites this paper
• Opposite amplitude phase entropy responses at a non Hermitian avoided crossing

  2026cites this paper
• Popularity Feedback Constrains Innovation in Cultural Markets

  2026cites this paper
• Beam-Offset Thermoreflectance with Bayesian Optimization to Measure the Anisotropic Thermal Properties of Semiconductor Superlattices

  2026cites this paper
• Entropic-Time Inference: Self-Organizing Large Language Model Decoding Beyond Attention

  2026cites this paper
• Fed-GTopK: Expediting In-Network Federated Learning by Transmitting Global Top Model Updates

  2026cites this paper
• Swordsman: Entropy-Driven Adaptive Block Partition for Efficient Diffusion Language Models

  2026cites this paper
• Bayesian Interpolating Neural Network (B-INN): a scalable and reliable Bayesian model for large-scale physical systems

  2026cites this paper
• Hamiltonian Decoded Quantum Interferometry for General Pauli Hamiltonians

  2026cites this paper
• Detecting Batch Heterogeneity via Likelihood Clustering

  2026cites this paper
• Defense Against Adversarial Samples for Replay Attacks in Automotive AVTP Streams via a Novel Bidirectional Mamba-Based Intrusion Detection System

  2026influential citation
• When physics gets in the way: an entropy-based evaluation of conceptual constraints in hybrid hydrological models

  2026cites this paper
• Transsaccadic working memory in healthy ageing and neurodegenerative disease

  2026cites this paper
• Symbolically regressing dark matter halo profiles using weak lensing

  2026cites this paper
• Artificial intelligence transformations in geotechnics: progress, challenges and future enablers

  2026cites this paper
• Message-Passing Neural Network (MPNN) for Large-Scale Healthcare IoT Networks in Smart City

  2026cites this paper
• USFetal: Tools for Fetal Brain Ultrasound Compounding

  2026cites this paper
• Bayesian Model Selection for Complex Flows of Yield Stress Fluids

  2026cites this paper
• Achieving DNA Labeling Capacity With Minimum Labels Through Extremal de Bruijn Subgraphs

  2026cites this paper
• Evolving beyond collapse: An adaptive particle batch smoother for cryospheric data assimilation

  2026influential citation
• Clocks and Dominoes: Timing Mechanisms of Embryogenesis

  2026influential citation
• A new multilayer tree structure belief rule base-based prediction method for key indicators of flotation process

  2026cites this paper
• Select First, Transfer Later: Choosing a Proper Dataset for SRL and GNN Based Transfer Learning

  2026cites this paper
• Complementary Roles of Distance and Growth Probes in Testing Time-Varying Dark Energy

  2026cites this paper
• Aplicação de PINN em Redes Neurais para Treinamento do Modelo SIR na Covid-19

  2026influential citation
• Connecting the concepts of quantum state tomography and molecular representations for machine learning

  2026cites this paper
• Dual-space posterior sampling for Bayesian inference in constrained inverse problems

  2026cites this paper
• Simplified circuit-level decoding using Knill error correction

  2026cites this paper
• Signals too small to sense: Physical and information-theoretic limits to induction-based magnetoreception in birds

  2026cites this paper
• An efficient method to improve machine learning decoders using automorphisms group

  2026cites this paper
• BayesFlow 2.0: Multi-Backend Amortized Bayesian Inference in Python

  2026cites this paper
• Large-scale Score-based Variational Posterior Inference for Bayesian Deep Neural Networks

  2026cites this paper
• "I May Not Have Articulated Myself Clearly": Diagnosing Dynamic Instability in LLM Reasoning at Inference Time

  2026cites this paper
• Richer Bayesian Last Layers with Subsampled NTK Features

  2026cites this paper
• Hierarchical quantum decoders

  2026cites this paper
• Evaluating Explanations: An Explanatory Virtues Framework for Mechanistic Interpretability - The Strange Science Part I.ii

  2025cites this paper
• mmSnap: Bayesian One-Shot Fusion in a Self-Calibrated mmWave Radar Network

  2025cites this paper
• Baryon Acoustic Oscillations from a Different Angle

  2025cites this paper
• PREDICTION OF MASONRY STRENGTH AND EARTHQUAKE CHARACTERISTICS USING MACHINE-LEARNING ALGORITHMS

  2025cites this paper
• A Markov Chain Monte Carlo Method for Efficient Finite-Length LDPC Code Design

  2025cites this paper
• Constraining population III stellar demographics with next-generation gravitational-wave observatories

  2025cites this paper
• Joint leave-group-out cross-validation in Bayesian spatial models

  2025cites this paper
• Addressing Data Scarcity with Synthetic Data: A Secure and GDPR-Compliant Cloud-Based Platform

  2025cites this paper
• A Mathematical Philosophy of Explanations in Mechanistic Interpretability - The Strange Science Part I.i

  2025cites this paper
• Quantitative Attractor Analysis of High-Capacity Kernel Logistic Regression Hopfield Networks

  2025influential citation
• Geoinformation dependencies in geographic space and beyond

  2025cites this paper
• Selecting a conceptual hydrological model using Bayes' factors computed with replica-exchange Hamiltonian Monte Carlo and thermodynamic integration

  2025cites this paper
• Dimension-Free Decision Calibration for Nonlinear Loss Functions

  2025cites this paper
• Localized Fock Space Cages in Kinetically Constrained Models

  2025cites this paper
• Bayesian Robust Aggregation for Federated Learning

  2025cites this paper
• A hybrid hierarchical health monitoring solution for autonomous detection, localization and quantification of damage in composite wind turbine blades for tinyML applications

  2025cites this paper
• Leveraging Artificial Intelligence to Predict Potential TB Hotspots at the Community Level in Bangui, Republic of Central Africa

  2025cites this paper
• Simple physical systems as a reference for multivariate information dynamics

  2025cites this paper
• Quantifying uncertainty in inverse scattering problems set in layered environments

  2025influential citation
• Secret and shared keys recovery on hamming quasi-cyclic with SASCA

  2025cites this paper
• Classification of Radar Targets via Distribution Matching of Late-Time Resonance Parameters

  2025cites this paper
• Normalizing Flow Regression for Bayesian Inference with Offline Likelihood Evaluations

  2025cites this paper
• Cooperative Direct Localization in Multipath Environments Using Binary Sparse Modeling and Cayley–Menger Determinant

  2025cites this paper
• A DNN-based 5G MIMO system adopting a mix of tactics

  2025cites this paper
• Sparse parity random linear codes for URLLC in channels with memory

  2025cites this paper
• High-Order and Interactive Perceptual Feature Learning for Medical Image Retargeting

  2025cites this paper
• Benchmarking overlapping community detection methods for applications in human connectomics

  2025cites this paper
• Simulations in Statistical Workflows

  2025cites this paper
• Stacking Variational Bayesian Monte Carlo

  2025cites this paper
• Kernel Ridge Regression for Efficient Learning of High-Capacity Hopfield Networks

  2025cites this paper
• Logits-Constrained Framework with RoBERTa for Ancient Chinese NER

  2025cites this paper
• Social organization as the collective management of uncertainty

  2025cites this paper
• On a fast consistent selection of nested models with possibly unnormalized probability densities

  2025cites this paper
• Simulation-based Bayesian inference under model misspecification

  2025cites this paper
• A Unifying Model of Information Loss in Communication Across Populations

  2025cites this paper
• Real-time active learning for optimised spectroscopic follow-up: Enhancing early SN Ia classification with the Fink broker

  2025cites this paper
• Combining Sampling Methods with Attractor Dynamics in Spiking Models of Head-Direction Systems

  2025cites this paper
• INFO-SEDD: Continuous Time Markov Chains as Scalable Information Metrics Estimators

  2025cites this paper
• Near-instantaneous Atmospheric Retrievals and Model Comparison with FASTER

  2025cites this paper
• Deep Learning is Not So Mysterious or Different

  2025cites this paper
• Unifying Privacy and AI: Why I am an Entropist

  2025cites this paper
• Learning Decision Trees as Amortized Structure Inference

  2025cites this paper
• Solving Bayesian inverse problems with diffusion priors and off-policy RL

  2025cites this paper
• An improved preconditioned unsupervised K-means clustering algorithm

  2025cites this paper
• Information Theoretic Pruning of Coupled Channels in Deep Neural Networks

  2025cites this paper
• Enabling Robust Exoplanet Atmospheric Retrievals with Gaussian Processes

  2025cites this paper
• Estimation of Building Energy Demand Characteristics using Bayesian Statistics and Energy Signature Models

  2025cites this paper
• Integrating neural networks and tensor networks for computing free energy

  2025influential citation
• Transformer-Based Nonlinear Transform Coding for Multi-Rate CSI Compression in MIMO-OFDM Systems

  2025influential citation