Variance Reduction in Stochastic Gradient Langevin Dynamics

No abstract is available for this paper.

• Publication year

  2016

• Venue

  Neural Information Processing Systems

• Publication date

  2016-12-01

• Fields of study

  Mathematics, Computer Science, Medicine

• Identifiers
  PMID 28713210PMCID PMC5508544
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• On the Convergence of Stochastic Gradient MCMC Algorithms with High-Order Integrators

  2015influential reference
• A Complete Recipe for Stochastic Gradient MCMC

  2015cited by this paper
• SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives

  2014influential reference
• Distributed Stochastic Gradient MCMC

  2014cited by this paper
• Bayesian Sampling Using Stochastic Gradient Thermostats

  2014cited by this paper
• Stochastic Gradient Hamiltonian Monte Carlo

  2014cited by this paper
• Introductory Lectures on Convex Optimization - A Basic Course

  2014cited by this paper
• Accelerating Stochastic Gradient Descent using Predictive Variance Reduction

  2013influential reference
• Stochastic Gradient Riemannian Langevin Dynamics on the Probability Simplex

  2013cited by this paper
• Minimizing finite sums with the stochastic average gradient

  2013cited by this paper
• Bayesian Posterior Sampling via Stochastic Gradient Fisher Scoring

  2012cited by this paper
• Riemann manifold Langevin and Hamiltonian Monte Carlo methods

  2011cited by this paper
• Handbook of Markov Chain Monte Carlo

  2011cited by this paper
• Bayesian Learning via Stochastic Gradient Langevin Dynamics

  2011cited by this paper
• A Stochastic Approximation Method

  1951cited by this paper

• Robust Stochastic Gradient Posterior Sampling with Lattice Based Discretisation

  2026cites this paper
• Flatness-Aware Stochastic Gradient Langevin Dynamics

  2025cites this paper
• Client-only Distributed Markov Chain Monte Carlo Sampling over a Network

  2025cites this paper
• SPIDER: Scalable Probabilistic Inference for Differential Earthquake Relocation

  2025cites this paper
• Feel-Good Thompson Sampling for Contextual Bandits: a Markov Chain Monte Carlo Showdown

  2025cites this paper
• Quantifying Uncertainty in the Presence of Distribution Shifts

  2025cites this paper
• RTPV-YOLO: Real-Time Photovoltaic Detection With UAV-Based Thermal and RGB Imaging

  2025cites this paper
• Slimmable Federated Reinforcement Learning for Energy-Efficient Proactive Caching

  2025cites this paper
• Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis

  2025influential citation
• Quantum Speedups for Markov Chain Monte Carlo Methods with Application to Optimization

  2025cites this paper
• Validity Matters: Uncertainty‐Guided Testing of Deep Neural Networks

  2024cites this paper
• Isoperimetry is All We Need: Langevin Posterior Sampling for RL with Sublinear Regret

  2024cites this paper
• Variance-reduced random batch Langevin dynamics.

  2024cites this paper
• On Divergence Measures for Training GFlowNets

  2024cites this paper
• Stochastic Gradient MCMC for Massive Geostatistical Data

  2024cites this paper
• Perturbations of Markov Chains

  2024cites this paper
• Are Uncertainty Quantification Capabilities of Evidential Deep Learning a Mirage?

  2024cites this paper
• A strategic approach to handle performance uncertainties in autonomous vehicle’s car-following behavior

  2024cites this paper
• Continuous-time Riemannian SGD and SVRG Flows on Wasserstein Probabilistic Space

  2024cites this paper
• A survey on Bayesian nonparametric learning for time series analysis

  2024cites this paper
• Diverse 3D Hand Gesture Prediction from Body Dynamics by Bilateral Hand Disentanglement

  2023influential citation
• Self-Critical Alternate Learning-Based Semantic Broadcast Communication

  2023cites this paper
• Balance is Essence: Accelerating Sparse Training via Adaptive Gradient Correction

  2023influential citation
• Time-Independent Information-Theoretic Generalization Bounds for SGLD

  2023cites this paper
• Langevin Quasi-Monte Carlo

  2023cites this paper
• Convergence of mean-field Langevin dynamics: Time and space discretization, stochastic gradient, and variance reduction

  2023cites this paper
• Provable and Practical: Efficient Exploration in Reinforcement Learning via Langevin Monte Carlo

  2023cites this paper
• Subsampling Error in Stochastic Gradient Langevin Diffusions

  2023influential citation
• A Variance-Reduced Stochastic Accelerated Primal Dual Algorithm

  2022cites this paper
• Benchmarking Bayesian neural networks and evaluation metrics for regression tasks

  2022influential citation
• Federated Averaging Langevin Dynamics: Toward a unified theory and new algorithms

  2022cites this paper
• Preferential Subsampling for Stochastic Gradient Langevin Dynamics

  2022cites this paper
• Langevin Monte Carlo for Contextual Bandits

  2022cites this paper
• Low-Precision Stochastic Gradient Langevin Dynamics

  2022cites this paper
• Quantitative performance evaluation of Bayesian neural networks

  2022influential citation
• An Energy-Based Prior for Generative Saliency

  2022cites this paper
• Langevin Diffusion: An Almost Universal Algorithm for Private Euclidean (Convex) Optimization

  2022cites this paper
• Improved Convergence Rate of Stochastic Gradient Langevin Dynamics with Variance Reduction and its Application to Optimization

  2022influential citation
• Provable Constrained Stochastic Convex Optimization with XOR-Projected Gradient Descent

  2022cites this paper
• A Multi-Stage Approach for Knowledge-Guided Predictions With Application to Additive Manufacturing

  2022cites this paper
• Identification of factors impacting on the transmission and mortality of COVID-19

  2021cites this paper
• A New Framework for Variance-Reduced Hamiltonian Monte Carlo

  2021cites this paper
• Stochastic Gradient Langevin Dynamics with Variance Reduction

  2021cites this paper
• Communication Efficient Federated Generalized Tensor Factorization for Collaborative Health Data Analytics

  2021cites this paper
• A Hybrid Stochastic Gradient Hamiltonian Monte Carlo Method

  2021influential citation
• Approximation to Stochastic Variance Reduced Gradient Langevin Dynamics by Stochastic Delay Differential Equations

  2021cites this paper
• XOR-SGD: provable convex stochastic optimization for decision-making under uncertainty

  2021cites this paper
• A survey of uncertainty in deep neural networks

  2021cites this paper
• On the Convergence of Hamiltonian Monte Carlo with Stochastic Gradients

  2021influential citation
• On Estimation in Latent Variable Models

  2021cites this paper
• Asymptotic bias of inexact Markov Chain Monte Carlo methods in high dimension

  2021cites this paper
• A fast asynchronous MCMC sampler for sparse Bayesian inference

  2021cites this paper
• Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Prediction

  2021cites this paper
• A Lyapunov Analysis of Loopless SARAH

  2020cites this paper
• Structured Logconcave Sampling with a Restricted Gaussian Oracle

  2020cites this paper
• Accelerating Convergence of Replica Exchange Stochastic Gradient MCMC via Variance Reduction

  2020influential citation
• Variance reduction for Random Coordinate Descent-Langevin Monte Carlo

  2020cites this paper
• Variance Reduction and Quasi-Newton for Particle-Based Variational Inference

  2020cites this paper
• Stein Variational Gradient Descent with Variance Reduction

  2020influential citation
• Federated stochastic gradient Langevin dynamics

  2020influential citation
• Variance Reduction for Dependent Sequences with Applications to Stochastic Gradient MCMC

  2020cites this paper
• Langevin Monte Carlo: random coordinate descent and variance reduction

  2020cites this paper
• Decentralized Stochastic Gradient Langevin Dynamics and Hamiltonian Monte Carlo

  2020cites this paper
• Multi-index antithetic stochastic gradient algorithm

  2020cites this paper
• Variance reduction for Langevin Monte Carlo in high dimensional sampling problems

  2020cites this paper
• Variance reduction for distributed stochastic gradient MCMC

  2020cites this paper
• Asynchronous Parallel Stochastic Quasi-Newton Methods

  2020cites this paper
• One-Point Gradient Estimators for Zeroth-Order Stochastic Gradient Langevin Dydamics

  2020cites this paper
• Improving Sampling Accuracy of Stochastic Gradient MCMC Methods via Non-uniform Subsampling of Gradients

  2020cites this paper
• The Hastings algorithm at fifty

  2020cites this paper
• Scalable Metropolis-Hastings for Exact Bayesian Inference with Large Datasets

  2019influential citation
• Practical optimization methods for machine learning models

  2019cites this paper
• On Stationary-Point Hitting Time and Ergodicity of Stochastic Gradient Langevin Dynamics

  2019cites this paper
• MCMC algorithms for sampling from multimodal and changing distributions

  2019cites this paper
• Laplacian Smoothing Stochastic Gradient Markov Chain Monte Carlo

  2019cites this paper
• Aggregated Gradient Langevin Dynamics

  2019influential citation
• Stochastic Gradient Hamiltonian Monte Carlo Methods with Recursive Variance Reduction

  2019influential citation
• Calibrating the adaptive learning rate to improve convergence of ADAM

  2019cites this paper
• Autour de l'algorithme du Langevin : extensions et applications

  2019cites this paper
• Stochastic Gradient Markov Chain Monte Carlo

  2019influential citation
• Hill Climbing on Value Estimates for Search-control in Dyna

  2019cites this paper
• Efficient MCMC Sampling with Dimension-Free Convergence Rate using ADMM-type Splitting

  2019influential citation
• Sampling from Non-Log-Concave Distributions via Stochastic Variance-Reduced Gradient Langevin Dynamics

  2019influential citation
• Hitting Time of Stochastic Gradient Langevin Dynamics to Stationary Points: A Direct Analysis

  2019cites this paper
• Online Sampling from Log-Concave Distributions

  2019cites this paper
• Transformation Autoregressive Networks

  2018cites this paper
• Algorithmic Theory of ODEs and Sampling from Well-conditioned Logconcave Densities

  2018cites this paper
• Langevin Markov Chain Monte Carlo with stochastic gradients

  2018cites this paper
• Stochastic Expectation Maximization with Variance Reduction

  2018cites this paper
• The promises and pitfalls of Stochastic Gradient Langevin Dynamics

  2018influential citation
• Variance Reduction in Stochastic Particle-Optimization Sampling

  2018influential citation
• MASAGA: A Linearly-Convergent Stochastic First-Order Method for Optimization on Manifolds

  2018cites this paper
• On the Theory of Variance Reduction for Stochastic Gradient Monte Carlo

  2018influential citation
• Stochastic Gradient MCMC for State Space Models

  2018cites this paper
• Stochastic gradient Hamiltonian Monte Carlo with variance reduction for Bayesian inference

  2018influential citation
• Stochastic Variance-Reduced Hamilton Monte Carlo Methods

  2018cites this paper
• Large-Scale Stochastic Sampling from the Probability Simplex

  2018cites this paper
• Subsampled Stochastic Variance-Reduced Gradient Langevin Dynamics

  2018influential citation
• MASAGA: A Stochastic Algorithm for Manifold Optimization

  2018cites this paper
• Control variates for stochastic gradient MCMC

  2017influential citation