Estimating Renyi Entropy of Discrete Distributions

No abstract is available for this paper.

• Publication year

  2014

• Venue

  IEEE Transactions on Information Theory

• Publication date

  2014-08-02

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1109/TIT.2016.2620435
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• On Measures of Entropy and Information

  2015cited by this paper
• The Complexity of Estimating Rényi Entropy

  2014cited by this paper
• Maximum Likelihood Estimation of Functionals of Discrete Distributions

  2014cited by this paper
• Minimax Rates of Entropy Estimation on Large Alphabets via Best Polynomial Approximation

  2014influential reference
• Minimax Estimation of Functionals of Discrete Distributions

  2014influential reference
• Order-Optimal Estimation of Functionals of Discrete Distributions

  2014influential reference
• A unified characterization of generalized information and certainty measures

  2013cited by this paper
• Parallel Collision Search with Cryptanalytic Applications

  2013cited by this paper
• Information Theory of DNA Shotgun Sequencing

  2012cited by this paper
• Estimating the unseen: an n/log(n)-sample estimator for entropy and support size, shown optimal via new CLTs

  2011cited by this paper
• Statistical Inference for Rényi Entropy Functionals

  2011cited by this paper
• Renyi's Entropy, Divergence and Their Nonparametric Estimators

  2010cited by this paper
• Testing Closeness of Discrete Distributions

  2010cited by this paper
• DRDO – IISc Programme on Advanced Research in Mathematical Engineering Guessing Revisited : A Large Deviations Approach ( TR-PME-2008-08 ) by Manjesh

  2010cited by this paper
• Multiple Source Adaptation and the Rényi Divergence

  2009cited by this paper
• Sketching and Streaming Entropy via Approximation Theory

  2008cited by this paper
• A Coincidence-Based Test for Uniformity Given Very Sparsely Sampled Discrete Data

  2008cited by this paper
• Testing symmetric properties of distributions

  2008cited by this paper
• Data streaming algorithms for estimating entropy of network traffic

  2006cited by this paper
• Image registration methods in high‐dimensional space

  2006cited by this paper
• On the zeros of finite sums of exponential functions

  2006cited by this paper
• Optimal approximations of the frequency moments of data streams

  2005cited by this paper
• On Modeling Profiles Instead of Values

  2004cited by this paper
• Estimating entropy on m bins given fewer than m samples

  2004cited by this paper
• Renyi entropy, guesswork moments, and large deviations

  2004cited by this paper
• Clustering using Renyi's entropy

  2003cited by this paper
• Estimation of Entropy and Mutual Information

  2003cited by this paper
• Entropy and information in neural spike trains: progress on the sampling problem.

  2003cited by this paper
• Abstract The

  2002cited by this paper
• Convergence properties of functional estimates for discrete distributions

  2001cited by this paper
• Sampling algorithms: lower bounds and applications

  2001cited by this paper
• On Testing Expansion in Bounded-Degree Graphs

  2000cited by this paper
• Image registration with minimum spanning tree algorithm

  2000cited by this paper
• The Art of Computer Programming: Volume 3: Sorting and Searching

  1998cited by this paper
• Energy, entropy and information potential for neural computation

  1998cited by this paper
• Assouad, Fano, and Le Cam

  1997cited by this paper
• An inequality on guessing and its application to sequential decoding

  1995cited by this paper
• Theory of Approximation of Functions of a Real Variable

  1994cited by this paper
• Guessing and entropy

  1994cited by this paper
• Generalized privacy amplification

  1994cited by this paper
• Generalized Cutoff Rates and Renyi's Information Measures

  1993cited by this paper
• Information‐theoretical entropy as a measure of sequence variability

  1991cited by this paper
• How to recycle random bits

  1989cited by this paper
• Estimation of the entropy and information of absolutely continuous random variables

  1989cited by this paper
• Finite sample corrections to entropy and dimension estimates

  1988cited by this paper
• Distribution Inequalities for the Binomial Law

  1977cited by this paper
• The art of computer programming: sorting and searching (volume 3)

  1973cited by this paper
• Note on the bias of information estimates

  1955cited by this paper

• Token-Efficient Change Detection in LLM APIs

  2026cites this paper
• Hierarchical AMR Scheme Exploiting Modulation-Shared and Modulation- Specific Features

  2026cites this paper
• Computational Hardness of Estimating Quantum Entropies via Binary Entropy Bounds

  2026cites this paper
• Improved Sample Upper and Lower Bounds for Trace Estimation of Quantum State Powers

  2025cites this paper
• Information-Theoretic Lower Bounds for Approximating Monomials via Optimal Quantum Tsallis Entropy Estimation

  2025cites this paper
• A List of Complexity Bounds for Property Testing by Quantum Sample-to-Query Lifting

  2025cites this paper
• Entropy testing and its application to testing Bayesian networks

  2024cites this paper
• The Illusion of Randomness: An Empirical Analysis of Address Space Layout Randomization Implementations

  2024cites this paper
• Auxiliary-Free Replica Shadows: Efficient Estimation of Multiple Nonlinear Quantum Properties

  2024cites this paper
• Experimental signatures of Hilbert-space ergodicity: Universal bitstring distributions and applications in noise learning

  2024influential citation
• Properties of Shannon and Rényi entropies of the Poisson distribution as the functions of intensity parameter

  2024cites this paper
• Time-Efficient Quantum Entropy Estimator via Samplizer

  2024cites this paper
• Statistical Inference on the Entropy Measures of Gamma Distribution under Progressive Censoring: EM and MCMC Algorithms

  2023cites this paper
• Towards More Efficient Rényi Entropy Estimation

  2023influential citation
• Collision Entropy Estimation in a One-Line Formula

  2023cites this paper
• Fixed confidence community mode estimation

  2023cites this paper
• Range (Rényi) Entropy Queries and Partitioning

  2023cites this paper
• Estimation of Rényi entropy for lifetime uncertainty

  2023cites this paper
• Multivariate trace estimation in constant quantum depth

  2022cites this paper
• Correcting convexity bias in function and functional estimate

  2022cites this paper
• Modelling the lexical complexity of homogenous texts: a time series approach

  2022cites this paper
• Entropy-Learned Hashing: Constant Time Hashing with Controllable Uniformity

  2022cites this paper
• A Quantum Algorithm Framework for Discrete Probability Distributions With Applications to Rényi Entropy Estimation

  2022cites this paper
• On the Efficient Implementation of High Accuracy Optimality of Profile Maximum Likelihood

  2022cites this paper
• Tight Chernoff-Like Bounds Under Limited Independence

  2022cites this paper
• Entropy-Learned Hashing 10x Faster Hashing with Controllable Uniformity

  2021cites this paper
• Estimating distinguishability measures on quantum computers

  2021cites this paper
• Concentration of the Collision Estimator

  2021cites this paper
• Estimation and Concentration of Missing Mass of Functions of Discrete Probability Distributions

  2021cites this paper
• Sequential community mode estimation

  2021cites this paper
• Missing g-Mass: Investigating the Missing Parts of Distributions

  2021cites this paper
• SqSelect: Automatic assessment of Failed Error Propagation in state-based systems

  2021cites this paper
• Locally differentially private estimation of nonlinear functionals of discrete distributions

  2021cites this paper
• On the High Accuracy Limitation of Adaptive Property Estimation

  2020cites this paper
• A Survey on Distribution Testing: Your Data is Big. But is it Blue?

  2020cites this paper
• Practical Estimation of Renyi Entropy

  2020cites this paper
• Practical Renyi Entropy Estimation from Birthday Paradox

  2020cites this paper
• Estimating fault masking using squeeziness based on Rényi's entropy

  2020cites this paper
• The Bethe and Sinkhorn Permanents of Low Rank Matrices and Implications for Profile Maximum Likelihood

  2020cites this paper
• The Optimality of Profile Maximum Likelihood in Estimating Sorted Discrete Distributions

  2020cites this paper
• Variational Mode Decomposition-Based Multilevel Threshold Selection Scheme for Color Image Segmentation

  2020cites this paper
• Towards quantum advantage via topological data analysis

  2020cites this paper
• Query Complexity of Heavy Hitter Estimation

  2020cites this paper
• Concentration Bounds for the Collision Estimator

  2020cites this paper
• An Enhanced View of Incidence Functions for Applying Graph Theory to Modeling Network Intrusions

  2020cites this paper
• On the Competitive Analysis and High Accuracy Optimality of Profile Maximum Likelihood

  2020cites this paper
• Entropy property testing with finitely many errors

  2020cites this paper
• Bessel Smoothing and Multi-Distribution Property Estimation

  2020cites this paper
• Instance Based Approximations to Profile Maximum Likelihood

  2020cites this paper
• Profile Entropy: A Fundamental Measure for the Learnability and Compressibility of Distributions

  2020cites this paper
• Minimax Rates of Estimating Approximate Differential Privacy

  2019cites this paper
• Entropies and their Asymptotic Theory in the discrete case

  2019cites this paper
• Data Amplification: A Unified and Competitive Approach to Property Estimation

  2019cites this paper
• Minimax Optimal Estimation of Approximate Differential Privacy on Neighboring Databases

  2019cites this paper
• Differentially private anonymized histograms

  2019cites this paper
• Estimating Entropy of Distributions in Constant Space

  2019cites this paper
• The Broad Optimality of Profile Maximum Likelihood

  2019influential citation
• Demystifying Fixed $k$ -Nearest Neighbor Information Estimators

  2018cites this paper
• INSPECTRE: Privately Estimating the Unseen

  2018cites this paper
• Distributed Simulation and Distributed Inference

  2018cites this paper
• D S ] 1 5 A ug 2 01 7 Generalized Uniformity Testing

  2018cites this paper
• Modern challenges in distribution testing

  2018cites this paper
• Internal generative mechanism driven blind quality index for deblocked images

  2018cites this paper
• Profile Maximum Likelihood is Optimal for Estimating KL Divergence

  2018cites this paper
• Hybrid shallow and deep learned feature mixture model for arrhythmia classification

  2018cites this paper
• Generalized Uniformity Testing

  2017cites this paper
• Statistical hypotheses testing for random and pseudorandom generators based on statistical estimators of entropy

  2017cites this paper
• Minimax Estimation of the $L_1$ Distance

  2017cites this paper
• Modulation Recognition of Digital Multimedia Signal Based on Data Feature Selection

  2017cites this paper
• Which Distribution Distances are Sublinearly Testable?

  2017cites this paper
• Quantum Query Complexity of Entropy Estimation

  2017influential citation
• Differentially Private Testing of Identity and Closeness of Discrete Distributions

  2017influential citation
• Estimating Quantum Entropy

  2017cites this paper
• Sharp Bounds for Generalized Uniformity Testing

  2017cites this paper
• Renyi Entropy Estimation Revisited

  2017cites this paper
• Demystifying fixed k-nearest neighbor information estimators

  2016cites this paper
• Does dirichlet prior smoothing solve the Shannon entropy estimation problem?

  2015cites this paper
• Maximum Likelihood Estimation of Functionals of Discrete Distributions

  2014cites this paper
• On the Efficient Implementation of High Accuracy Optimality of Profile Maximum Likelihood

  year unknowncites this paper