Youla Coding and Computation of Gaussian Feedback Capacity

In this paper, we propose an approach to numerically compute the feedback capacity of stationary finite-dimensional (FD) Gaussian channels and construct (arbitrarily close to) capacity-achieving feedback codes. In particular, we first extend the interpretation of feedback communication over stationary FD Gaussian channels as feedback control systems. We show that the problem of finding stabilizing feedback controllers with maximal reliable transmission rate over Youla parameters coincides with the problem of finding strictly causal filters to achieve feedback capacity. This extended interpretation provides an approach to construct deterministic feedback coding schemes with double exponential decaying error probability. We next propose asymptotic capacity-achieving upper bounds, which can be numerically evaluated by solving FD convex optimizations. From the filters that achieve the upper bounds, we apply the Youla-based interpretation to construct feasible filters, i.e., feedback codes, leading to a sequence of lower bounds. We prove that the sequence of lower bounds is asymptotically capacity achieving.

• Publication year

  2018

• Venue

  IEEE Transactions on Information Theory

• Publication date

  2018-01-12

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1109/TIT.2018.2802538arXiv 1801.04190
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Non-commutative discretize-then-optimize algorithms for elliptic PDE-constrained optimal control problems

  2017cited by this paper
• Control approach to computing the feedback capacity for stationary finite dimensional Gaussian channels

  2015cited by this paper
• Fundamental limitations on communication channels with noisy feedback: information flow, capacity and bounds

  2013cited by this paper
• Noisy feedback communications with side information at the decoder

  2012cited by this paper
• Control-Theoretic Approach to Communication With Feedback

  2012influential reference
• LQG control approach to Gaussian broadcast channels with feedback

  2011cited by this paper
• Upper bound on the capacity of Gaussian channels with noisy feedback

  2011cited by this paper
• The information theoretic characterization of the capacity of channels with noisy feedback

  2011cited by this paper
• Bounds on the achievable rate of noisy feedback Gaussian channels under linear feedback coding scheme

  2011cited by this paper
• Towards a unified view of inference, communication and control

  2010cited by this paper
• On the achievable rate of the additive Gaussian noise channel with noisy feedback

  2010cited by this paper
• Optimal Feedback Communication Via Posterior Matching

  2009influential reference
• Interpretations of Directed Information in Portfolio Theory, Data Compression, and Hypothesis Testing

  2009cited by this paper
• Convergence of Fundamental Limitations in Feedback Communication, Estimation, and Feedback Control over Gaussian Channels

  2009influential reference
• Introduction of Fréchet and Gâteaux Derivative

  2008cited by this paper
• Graph Implementations for Nonsmooth Convex Programs

  2008cited by this paper
• A Coding Theorem for a Class of Stationary Channels with Feedback

  2007cited by this paper
• Feedback Capacity of Stationary Gaussian Channels

  2006influential reference
• The Capacity of Channels With Feedback

  2006cited by this paper
• Linear Systems and Control

  2005influential reference
• Feedback capacity of finite-state machine channels

  2005cited by this paper
• Cambridge Cambridge University

  2005cited by this paper
• Convex Optimization

  2004cited by this paper
• Capacity-achieving feedback scheme for Markov channels with channel state information

  2004cited by this paper
• When bode meets shannon: control-oriented feedback communication schemes

  2004influential reference
• Linear systems and control

  2003cited by this paper
• Directed information for channels with feedback

  1998cited by this paper
• Feedback Control Theory

  1992influential reference
• Random coding for additive Gaussian channels with feedback

  1990cited by this paper
• Upper bounds on the capacity of Gaussian channels with feedback

  1990cited by this paper
• CAUSALITY, FEEDBACK AND DIRECTED INFORMATION

  1990cited by this paper
• The statistical theory of linear systems

  1989cited by this paper
• Gaussian feedback capacity

  1989cited by this paper
• A new identification and model reduction algorithm via singular value decomposition

  1978cited by this paper
• Linear feedback rate bounds for regressive channels

  1976cited by this paper
• Analysis of the optimum linear system for the autoregressive forward channel with noiseless feedback (Corresp.)

  1976cited by this paper
• Linear feedback rate bounds for regressive channels (Corresp.)

  1976cited by this paper
• Signalling over a Gaussian channel with feedback and autoregressive noise

  1975cited by this paper
• An upper bound to the capacity of the band-limited Gaussian autoregressive channel with noiseless feedback

  1974influential reference
• Modern Control Theory

  1971cited by this paper
• A general formulation of linear feedback communication systems with solutions

  1969cited by this paper
• Optimization by Vector Space Methods

  1968cited by this paper
• Networks of Gaussian channels with applications to feedback systems

  1967cited by this paper
• A coding scheme for additive noise channels with feedback-I: No bandwidth constraint

  1966influential reference
• Ieee Transactions on Information Theory 2 on the Feedback Capacity of Power Constrained Gaussian Noise Channels with Memory

  year unknowncited by this paper

• Communication over LQG Control Systems: A Convex Optimization Approach to Capacity

  2025cites this paper
• The Capacity Gains of Gaussian Channels with Unstable Versus Stable Autoregressive Noise

  2025influential citation
• Signalling and Control of Nonlinear Partially Observable Stochastic Systems: Information States, Sufficient Statistics, and Applications

  2025cites this paper
• Application of Youla Parameterization Algorithm Improved by Simulated Annealing in Active Vibration Control

  2025cites this paper
• Comments on “Feedback Capacity of Stationary Gaussian Channels”

  2024cites this paper
• Feedback Capacity of MIMO Gaussian Channels

  2023cites this paper
• Linear Coding for AWGN Channels With Noisy Output Feedback via Dynamic Programming

  2023cites this paper
• On the Cover and Pombra Gaussian Feedback Capacity: Complete Sequential Characterizations via a Sufficient Statistic

  2021cites this paper
• Feedback Capacity of Parallel ACGN Channels and Kalman Filter: Power Allocation with Feedback

  2021cites this paper
• Feedback Capacity of MIMO Gaussian Channels

  2021cites this paper
• On the Fragile Rates of Linear Feedback Coding Schemes of Gaussian Channels with Memory

  2021cites this paper
• Feedback Capacity of ISI MIMO Channel with Colored Noise

  2021influential citation
• A Connection between Feedback Capacity and Kalman Filter for Colored Gaussian Noises

  2020cites this paper
• Feedback Capacity and a Variant of the Kalman Filter with ARMA Gaussian Noises: Explicit Bounds and Feedback Coding Design

  2020cites this paper
• New Formulas of Feedback Capacity for AGN Channels with Memory: A Time-Domain Sufficient Statistic Approach

  2020influential citation
• Time-Invariant Feedback Strategies Do Not Increase Capacity of AGN Channels Driven by Stable and Certain Unstable Autoregressive Noise

  2019influential citation
• Secrecy Capacity of Colored Gaussian Noise Channels With Feedback

  2018influential citation
• Computation of Feedback Capacity of Single User Multi-Antenna Stationary Gaussian Channel

  2018influential citation
• A Coding Scheme for Colored Gaussian Wiretap Channels with Feedback

  2018cites this paper