A Note on Reverse Pinsker Inequalities

A simple method is shown to provide optimal variational bounds on <inline-formula> <tex-math notation="LaTeX">$f$ </tex-math></inline-formula>-divergences with possible constraints on relative information extremums. The known results are refined or proved to be optimal as particular cases.

• Publication year

  2018

• Venue

  IEEE Transactions on Information Theory

• Publication date

  2018-05-14

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1109/TIT.2019.2896192arXiv 1805.05135
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Bayesian Nonparametrics for Directional Statistics

  2018cited by this paper
• Upper bounds on the relative entropy and Rényi divergence as a function of total variation distance for finite alphabets

  2015cited by this paper
• $f$ -Divergence Inequalities

  2015influential reference
• On Reverse Pinsker Inequalities

  2015cited by this paper
• Total variation distance and the distribution of relative information

  2014cited by this paper
• Optimal Quantization for Distribution Synthesis

  2013cited by this paper
• Sharp global bounds for Jensen's inequality

  2011cited by this paper
• Statistical Inference: The Minimum Distance Approach

  2011influential reference
• Jensen's inequality and new entropy bounds

  2009cited by this paper
• Best possible global bounds for Jensen's inequality

  2009cited by this paper
• On Metric Divergences of Probability Measures

  2009cited by this paper
• On certain new inequalities in information theory

  2009cited by this paper
• On Divergences and Informations in Statistics and Information Theory

  2006cited by this paper
• A symmetric information divergence measure of the Csiszár's f-divergence class and its bounds

  2005cited by this paper
• Relative information of type s, Csiszár's f-divergence, and information inequalities

  2004cited by this paper
• On thef-divergence and singularity of probability measures

  1972cited by this paper
• A General Class of Coefficients of Divergence of One Distribution from Another

  1966cited by this paper

• The Sample Complexity of Lossless Data Compression

  2026cites this paper
• Dobrushin Coefficients of Private Mechanisms Beyond Local Differential Privacy

  2026cites this paper
• On the Independence Assumption in Quasi-Cyclic Code-Based Cryptography

  2025cites this paper
• Bounds on the privacy amplification of arbitrary channels via the contraction of $f_\alpha$-divergence

  2025influential citation
• Non-Linear Strong Data-Processing for Quantum Hockey-Stick Divergences

  2025cites this paper
• Divergence Inequalities with Applications in Ergodic Theory

  2024cites this paper
• New Upper bounds for KL-divergence Based on Integral Norms

  2024cites this paper
• Divergence Inequalities from Multivariate Taylor's Theorem

  2024cites this paper
• Bounds on f-Divergences between Distributions within Generalized Quasi-ε-Neighborhood

  2024cites this paper
• Filtered not Mixed: Stochastic Filtering-Based Online Gating for Mixture of Large Language Models

  2024cites this paper
• The Interplay between Error, Total Variation, Alpha-Entropy and Guessing: Fano and Pinsker Direct and Reverse Inequalities

  2023cites this paper
• On the Stability of General Bayesian Inference

  2023cites this paper
• Empirical Squared Hellinger Distance Estimator and Generalizations to a Family of α-Divergence Estimators

  2023cites this paper
• Quantum Rényi and f-Divergences from Integral Representations

  2023cites this paper
• Remarks on Reverse Pinsker Inequalities

  2022influential citation
• Learning Rationalizable Equilibria in Multiplayer Games

  2022influential citation
• Refined Pinsker’s and Reverse Pinsker’s Inequalities for Probability Distributions of Different Dimensions

  2022cites this paper
• TIGHT BOUNDS FOR AUGMENTED KL DIVERGENCE IN TERMS OF AUGMENTED TOTAL VARIATION DISTANCE

  2022cites this paper
• An Information-theoretic Approach to Distribution Shifts

  2021cites this paper
• Limits of Detecting Text Generated by Large-Scale Language Models

  2020cites this paper
• Multi-armed bandits with dependent arms

  2020cites this paper
• Cryptographic Divergences: New Techniques and New Applications

  2020cites this paper
• On f-Divergences: Integral Representations, Local Behavior, and Inequalities

  2018cites this paper
• UvA-DARE (Digital Academic Repository) An Information-theoretic Approach to Distribution Shifts

  year unknowncites this paper