Fast Bayesian Updates via Harmonic Representations

Bayesian inference, while foundational to probabilistic reasoning, is often hampered by the computational intractability of posterior distributions, particularly through the challenging evidence integral. Conventional approaches like Markov Chain Monte Carlo (MCMC) and Variational Inference (VI) face significant scalability and efficiency limitations. This paper introduces a novel, unifying framework for fast Bayesian updates by leveraging harmonic analysis. We demonstrate that representing the prior and likelihood in a suitable orthogonal basis transforms the Bayesian update rule into a spectral convolution. Specifically, the Fourier coefficients of the posterior are shown to be the normalized convolution of the prior and likelihood coefficients. To achieve computational feasibility, we introduce a spectral truncation scheme, which, for smooth functions, yields an exceptionally accurate finite-dimensional approximation and reduces the update to a circular convolution. This formulation allows us to exploit the Fast Fourier Transform (FFT), resulting in a deterministic algorithm with O(N log N) complexity -- a substantial improvement over the O(N^2) cost of naive methods. We establish rigorous mathematical criteria for the applicability of our method, linking its efficiency to the smoothness and spectral decay of the involved distributions. The presented work offers a paradigm shift, connecting Bayesian computation to signal processing and opening avenues for real-time, sequential inference in a wide class of problems.

• Publication year

  2025

• Venue

  arXiv.org

• Publication date

  2025-11-10

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.48550/arXiv.2511.06978arXiv 2511.06978
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Probabilistic machine learning and artificial intelligence

  2015influential reference
• MCMC Using Hamiltonian Dynamics

  2011cited by this paper
• Bayesian data analysis.

  2010cited by this paper
• The Variational Gaussian Approximation Revisited

  2009cited by this paper
• Graphical Models, Exponential Families, and Variational Inference

  2008cited by this paper
• All of Nonparametric Statistics

  2007cited by this paper
• Monte Carlo Statistical Methods

  2004cited by this paper
• Information Theory, Inference, and Learning Algorithms

  2004cited by this paper
• The Elements of Statistical Learning: Data Mining, Inference, and Prediction

  2001cited by this paper
• Markov Chains for Exploring Posterior Distributions

  1994cited by this paper
• Fundamentals of statistical signal processing: estimation theory

  1993influential reference
• Chebyshev and Fourier Spectral Methods

  1989influential reference
• An algorithm for the machine calculation of complex Fourier series

  1965influential reference

• No citing papers are available for this paper.