Duality between channel capacity and rate distortion with two-sided state information

We show that the duality between channel capacity and data compression is retained when state information is available to the sender, to the receiver, to both, or to neither. We present a unified theory for eight special cases of channel capacity and rate distortion with state information, which also extends existing results to arbitrary pairs of independent and identically distributed (i.i.d.) correlated state information (S/sub 1/, S/sub 2/) available at the sender and at the receiver, respectively. In particular, the resulting general formula for channel capacity C = max/sub p/(u,x|s/sub 1/) [I(U; S/sub 2/, Y) I(U; S/sub 1/)] assumes the same form as the generalized Wyner-Ziv (1976) rate distortion function R(D) = min/sub p/(u|x, s/sub 1/)p(x/spl I.cap/|u, s/sub 2/) [I(U; S/sub 1/, X) 1(U; S/sub 2/)].

• Publication year

  2002

• Venue

  IEEE Transactions on Information Theory

• Publication date

  2002-06-01

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1109/TIT.2002.1003843arXiv cs/0508050
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• The duality between information embedding and source coding with side information and some applications

  2001cited by this paper
• Tradeoff between message and state information rates

  2001cited by this paper
• On source coding with side-information-dependent distortion measures

  2000cited by this paper
• Optimal entropy-constrained scalar quantization of a uniform source

  2000cited by this paper
• Duality between channel capacity and rate distortion with state information

  2000cited by this paper
• On the duality between distributed source coding and data hiding

  1999cited by this paper
• Nested linear/lattice codes for Wyner-Ziv encoding

  1998cited by this paper
• On the capacity of some channels with channel state information

  1998cited by this paper
• The rate loss in the Wyner-Ziv problem

  1996cited by this paper
• Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959.

  1993cited by this paper
• Writing on dirty paper

  1983cited by this paper
• On the capacity of computer memory with defects

  1983cited by this paper
• The rate-distortion function for source coding with side information at the decoder

  1976cited by this paper
• Rate distortion theory : a mathematical basis for data compression

  1971cited by this paper
• Channels with Side Information at the Transmitter

  1958cited by this paper

• Semantic Communication Through the Lens of Context-Dependent Channel Modeling

  2026influential citation
• ISAC-Enabled Statistical-QoS Provisioning for mURLLC over Massive MIMO Mobile Networks Using FBC

  2025influential citation
• Design Problems in Cognitive Radio Networks for Spectrum Sensing

  2023cites this paper
• An extension of Cover–Chiang work on point to point channel to less noisy broadcast channel and analysis of the receivers cognition impacts

  2023cites this paper
• Computation of a Unified Graph-Based Rate Optimization Problem

  2023cites this paper
• A Graph-Based Approach to the Computation of Rate-Distortion and Capacity-Cost Functions with Side Information

  2023influential citation
• Design and Resource Allocation of NOMA-based Transmission Scheme for Industrial Collaborative AR

  2022cites this paper
• Bregman Divergence Based Em Algorithm and its Application to Classical and Quantum Rate Distortion Theory

  2022cites this paper
• Duality Between Source Coding With Quantum Side Information and Classical-Quantum Channel Coding

  2022cites this paper
• Error Exponents of the Dirty-Paper and Gel’fand–Pinsker Channels

  2022cites this paper
• Impact of The Correlation Between Channel Input And Side Information On Physical Layer Security Performances of Wireless Wiretap Channel

  2021cites this paper
• Asymptotic Frame Theory for Analog Coding

  2021cites this paper
• Analysis of Side Information Impact on the Coverage Region of Wireless Wiretap Channel

  2021cites this paper
• Analysis of side information impact on the physical layer security performances in wireless wiretap channel

  2021cites this paper
• Secrecy Capacity Outer Bound of Broadcast Channels with States Known at the Transmitter and Message Side Information at Receivers

  2020cites this paper
• Capacity Region for Wireless More Capable Broadcast Channel with Channel State Available at the Receivers

  2020cites this paper
• A Novelty in Blahut-Arimoto Type Algorithms: Optimal Control Over Noisy Communication Channels

  2020cites this paper
• Capacity Upper Bound and Minimum Energy-per-Bit for AWGN Relay Channel with Channel Side Information

  2020cites this paper
• Semi-deterministic Broadcast Channel With Side Information: A Secrecy Capacity Outer Bound

  2020cites this paper
• A New Capacity Theorem for the Gaussian Channel with Two-sided Input and Noise Dependent State Information

  2020cites this paper
• Shared Context-Based Compression Paradigm for Ubiquitous Local Transmissions

  2019influential citation
• Rate Distortion Study for Time-Varying Autoregressive Gaussian Process

  2019cites this paper
• Compressed Sensing with Applications in Wireless Networks

  2019cites this paper
• Variable-Length Source Dispersions Differ under Maximum and Average Error Criteria

  2019cites this paper
• Communication over an Arbitrarily Varying Channel under a State-Myopic Encoder

  2018cites this paper
• Duality between source coding with quantum side information and c-q channel coding

  2018cites this paper
• Distributed compressed data gathering in wireless sensor networks

  2018cites this paper
• Strong Coordination of Signals and Actions Over Noisy Channels With Two-Sided State Information

  2018cites this paper
• Rate-Distortion Performance of Lossy Compressed Sensing of Sparse Sources

  2018cites this paper
• Feedback-Free Binning Design for Mobile Wyner-Ziv Video Coding: An Operational Duality between Source Distortion and Channel Capacity

  2017influential citation
• Wiretap and Gelfand-Pinsker Channels Analogy and Its Applications

  2017cites this paper
• The capacity-distortion function for multihop channels with state

  2017cites this paper
• Capacity analysis of power line communication point‐to‐point and relay channels

  2016cites this paper
• Rate-distortion lower bound for compressed sensing via conditional remote source coding

  2016cites this paper
• On Capacity of the Writing Onto Fast Fading Dirt Channel

  2016cites this paper
• Characterization, Signaling, Capacity and Coding Based on Fading Channels: A Review

  2016cites this paper
• On State-Dependent Degraded Broadcast Channels With Cooperation

  2016cites this paper
• The Secrecy Capacity of the Semi-Deterministic Wiretap Channel with Three State Information

  2016influential citation
• A New and More General Capacity Theorem for the Gaussian Channel with Two-sided Input-Noise Dependent State Information

  2015cites this paper
• Achievable rate regions for a three‐user multiple access channel with partial side information

  2015cites this paper
• On capacity region of certain classes of three-receiver broadcast channels with side information

  2015cites this paper
• Coordination d'appareils autonomes dans un réseau décentralisé

  2015cites this paper
• The effect of transceiver recognition on the Gaussian channel capacity

  2015cites this paper
• Empirical coordination with two-sided state information and correlated source and state

  2015cites this paper
• MAC With Action-Dependent State Information at One Encoder

  2015cites this paper
• Remote source coding with two-sided information

  2015cites this paper
• Coordination in Distributed Networks via Coded Actions With Application to Power Control

  2015cites this paper
• Broadcast channels with cooperation: Capacity and duality for the semi-deterministic case

  2015cites this paper
• An inner bound on the capacity region of multiple-access channel with side information

  2014cites this paper
• Multiple access channels with combined cooperation and partial cribbing

  2014cites this paper
• Capacity Bounds and a Certain Capacity Region for Special Three-Receiver Broadcast Channels with Side Information

  2014cites this paper
• Communication With Reconstruction and Privacy Constraints

  2014cites this paper
• Empirical Coordination for Joint Source-Channel Coding

  2014influential citation
• Lattice Coding for Signals and Networks: A Structured Coding Approach to Quantization, Modulation and Multiuser Information Theory

  2014cites this paper
• The Impact of Phase Fading on the Dirty Paper Channel

  2014cites this paper
• The Ahlswede-Körner coordination problem with one-sided encoder cooperation

  2014cites this paper
• Joint Empirical Coordination of Source and Channel

  2014cites this paper
• On capacity of the dirty paper channel with fading dirt in the strong fading regime

  2014cites this paper
• Energetic-lattice based optimization. (L'optimization par trellis-énergetique)

  2014cites this paper
• Duality of a Source Coding Problem and the Semi-Deterministic Broadcast Channel With Rate-Limited Cooperation

  2014cites this paper
• Energetic-lattice based optimization

  2014cites this paper
• On State Dependent Broadcast Channels with Cooperation

  2014cites this paper
• Two-way writing on dirty paper in the presence of noise-dependent interference

  2014cites this paper
• Structure d'information, stratégies de communication et application aux réseaux distribués. (Information structure, communication strategies and application to distributed networks)

  2014cites this paper
• The impact of phase fading on the dirty paper coding channel

  2014cites this paper
• Capacity for the doubly dirty multiple access channel with partial side information at the transmitters

  2013cites this paper
• Constrained Source-Coding With Side Information

  2013cites this paper
• A More General Version of the Costa Theorem

  2013cites this paper
• A Class of Three-Receiver Broadcast Channels with Degraded Message Sets and Side Information

  2013cites this paper
• nput Frequencies Optimization Based on Genetic Algorithm f or Maximal Mutual Information

  2013cites this paper
• Encoder, controller and decoder design of jump linear systems over jump communication channels

  2013cites this paper
• Information Theoretic Exemplification of the Receiver Re-cognition and a More General Version for the Costa Theorem

  2013influential citation
• Wiretap channel with causal state information and secure rate-limited feedback

  2013cites this paper
• Universal Wyner-Ziv coding for distortion constrained general side-information

  2013cites this paper
• The state-dependent broadcast channel with cooperation

  2013cites this paper
• Feed-Forward Rate Distortion Function and Markov Sources

  2013cites this paper
• A formula for the capacity of the general Gel'fand-Pinsker channel

  2012influential citation
• Coding With Action-Dependent Side Information and Additional Reconstruction Requirements

  2012influential citation
• Successive Refinement With Decoder Cooperation and Its Channel Coding Duals

  2012cites this paper
• DATA OPTIMIZATION WITH BUILT IN SECURITY

  2012cites this paper
• On the Capacity Region of Cognitive Multiple Access over White Space Channels

  2012cites this paper
• Achievable rate regions for the dirty multiple access channel with partial side information at the transmitters

  2012cites this paper
• HITE S PACE C HANNELS

  2012cites this paper
• Reliability bound and channel capacity of IBS-based fuzzy embedders

  2012cites this paper
• Achievability Proof via Output Statistics of Random Binning

  2012cites this paper
• Three-receiver broadcast channels with side information

  2012cites this paper
• Key Agreement over Wiretap Models with Non-Causal Side Information

  2012cites this paper
• Optimal Signal Sets and Binary Labelings for BICM at low SNR

  2011cites this paper
• Capacity bounds for multiuser channels with non-causal channel state information at the transmitters

  2011cites this paper
• Covering Point Patterns

  2011cites this paper
• Information-theoretic aspects of optical communications

  2011influential citation
• Network Information Theory

  2011cites this paper
• Capacity bounds of spectrum sharing networks with no channel state information

  2011cites this paper
• Cooperative relay broadcast channels with partial causal channel state information

  2011cites this paper
• Information Theoretic Exemplification of the Impact of Transmitter-Receiver Cognition on the Channel Capacity

  2011cites this paper
• Chalmers Publication Library

  2011cites this paper
• Source Coding for Erasure Channels

  2011cites this paper
• On the capacity of a channel with action-dependent state and reversible input

  2011cites this paper
• BICM Capacity - Part II: First-Order Optimal Signal Sets and Binary Labelings

  2010cites this paper
• Gaussian Z-Interference Channel With a Relay Link: Achievability Region and Asymptotic Sum Capacity

  2010cites this paper