Information thermodynamics on causal networks.

We study nonequilibrium thermodynamics of complex information flows induced by interactions between multiple fluctuating systems. Characterizing nonequilibrium dynamics by causal networks (i.e., Bayesian networks), we obtain novel generalizations of the second law of thermodynamics and the fluctuation theorem, which include an informational quantity characterized by the topology of the causal network. Our result implies that the entropy production in a single system in the presence of multiple other systems is bounded by the information flow between these systems. We demonstrate our general result by a simple model of biochemical adaptation.

• Publication year

  2013

• Venue

  Physical Review Letters

• Publication date

  2013-06-12

• Fields of study

  Mathematics, Physics, Medicine

• Identifiers
  DOI 10.1103/PhysRevLett.111.180603arXiv 1306.2756PMID 24237500
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Maxwell's refrigerator: an exactly solvable model.

  2013cited by this paper
• An autonomous and reversible Maxwell's demon

  2013cited by this paper
• Rate of Mutual Information Between Coarse-Grained Non-Markovian Variables

  2013cited by this paper
• Feedback cooling, measurement errors, and entropy production

  2013cited by this paper
• Imitating chemical motors with optimal information motors.

  2012cited by this paper
• Work and information processing in a solvable model of Maxwell’s demon

  2012cited by this paper
• Nonequilibrium fluctuation theorem for systems under discrete and continuous feedback control.

  2012cited by this paper
• Fluctuation theorem with information exchange: role of correlations in stochastic thermodynamics.

  2012cited by this paper
• Entropy production and fluctuation theorems under feedback control: the molecular refrigerator model revisited

  2012cited by this paper
• Thermodynamics of a physical model implementing a Maxwell demon.

  2012cited by this paper
• Efficiency of a Brownian information machine

  2012cited by this paper
• The thermodynamics of prediction

  2012cited by this paper
• Stochastic thermodynamics for “Maxwell demon” feedbacks

  2012cited by this paper
• The energy-speed-accuracy tradeoff in sensory adaptation

  2012cited by this paper
• Open Problems on Information and Feedback Controlled Systems

  2012cited by this paper
• Information-theoretic versus thermodynamic entropy production in autonomous sensory networks.

  2012cited by this paper
• Experimental verification of Landauer’s principle linking information and thermodynamics

  2012cited by this paper
• Role of hidden slow degrees of freedom in the fluctuation theorem.

  2012cited by this paper
• Stochastic thermodynamics, fluctuation theorems and molecular machines

  2012cited by this paper
• Thermodynamics of genuine nonequilibrium states under feedback control.

  2011cited by this paper
• Designing optimal discrete-feedback thermodynamic engines

  2011cited by this paper
• Erratum: Minimal Energy Cost for Thermodynamic Information Processing: Measurement and Information Erasure [Phys. Rev. Lett. 102, 250602 (2009)]

  2011cited by this paper
• Fluctuation theorems in the presence of information gain and feedback

  2011cited by this paper
• Extracting work from a single heat bath through feedback

  2011cited by this paper
• Nonequilibrium thermodynamics of feedback control.

  2011cited by this paper
• Modeling Maxwell's demon with a microcanonical Szilard engine.

  2011cited by this paper
• Information Transduction Capacity of Noisy Biochemical Signaling Networks

  2011cited by this paper
• Effects of error on fluctuations under feedback control.

  2011cited by this paper
• Second law and Landauer principle far from equilibrium

  2011cited by this paper
• Thermodynamic cost of measurements.

  2011cited by this paper
• Thermodynamic reversibility in feedback processes

  2011cited by this paper
• Quantum Jarzynski-Sagawa-Ueda Relations

  2010cited by this paper
• Quantum Szilard engine.

  2010cited by this paper
• Generalized detailed fluctuation theorem under nonequilibrium feedback control.

  2010cited by this paper
• Nonequilibrium detailed fluctuation theorem for repeated discrete feedback.

  2010cited by this paper
• Jarzynski Equality Modified in the Linear Feedback System

  2010cited by this paper
• Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski equality

  2010cited by this paper
• Generalized Jarzynski equality under nonequilibrium feedback control.

  2009cited by this paper
• Mutual information between input and output trajectories of biochemical networks.

  2009cited by this paper
• Information processing and signal integration in bacterial quorum sensing

  2009cited by this paper
• Minimal energy cost for thermodynamic information processing: measurement and information erasure.

  2008cited by this paper
• Modeling the chemotactic response of Escherichia coli to time-varying stimuli

  2008cited by this paper
• Feedback Loops Shape Cellular Signals in Space and Time

  2008cited by this paper
• Thermodynamics of feedback controlled systems.

  2008cited by this paper
• Second law of thermodynamics with discrete quantum feedback control.

  2007cited by this paper
• Information and flux in a feedback controlled Brownian ratchet

  2007cited by this paper
• Distribution of entropy production for a colloidal particle in a nonequilibrium steady state

  2007cited by this paper
• Fluctuation theorems for a molecular refrigerator.

  2007cited by this paper
• Feedback control in a collective flashing ratchet.

  2004cited by this paper
• Maxwell's demon 2: entropy, classical and quantum information, computing

  2002cited by this paper
• The Fluctuation Theorem

  2002cited by this paper
• Bayesian Networks and Decision Graphs

  2001influential reference
• Information-theoretic approach to the study of control systems

  2001cited by this paper
• Measuring information transfer

  2000cited by this paper
• Hamiltonian Derivation of a Detailed Fluctuation Theorem

  1999cited by this paper
• Information-theoretic limits of control

  1999cited by this paper
• Nonequilibrium Measurements of Free Energy Differences for Microscopically Reversible Markovian Systems

  1998cited by this paper
• A Gallavotti–Cohen-Type Symmetry in the Large Deviation Functional for Stochastic Dynamics

  1998cited by this paper
• Kinetic Characterization of Heat Bath and the Energetics of Thermal Ratchet Models

  1997cited by this paper
• Minimal Energy Requirements in Communication

  1996cited by this paper
• Nonequilibrium Equality for Free Energy Differences

  1996cited by this paper
• Probability of second law violations in shearing steady states.

  1993cited by this paper
• über die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen

  1929cited by this paper
• The Theory of Heat

  year unknowncited by this paper
• and as an in

  year unknowncited by this paper

• Fluctuation Theorems from a Continuous-Time Markov Model of Information-Thermodynamic Capacity in Biochemical Signal Cascades

  2026cites this paper
• Thermodynamic uncertainty relation under continuous measurement and feedback with quantum-classical-transfer entropy

  2026cites this paper
• Thermodynamic approach to quantum cooling limit of continuous Gaussian feedback

  2025cites this paper
• Geometric decomposition of information flow: New insights into information thermodynamics

  2025influential citation
• Bayesian Field Theory of the Rate Estimation

  2025cites this paper
• Diversity and similarity of information transfers and flows in continuous-time stochastic systems.

  2025cites this paper
• Precision and cost of feedback cooling

  2025cites this paper
• Coulomb-mediated single-electron heat transfer statistics across capacitively coupled silicon nanodots

  2025cites this paper
• Fluctuation theorems for multipartite quantum coherence and correlation dynamics

  2025cites this paper
• Work and entropy of mixing in isolated quantum systems

  2025cites this paper
• Exact Identity Linking Entropy Production and Mutual Information

  2025cites this paper
• Unravelling the Flow of Information in a Nonequilibrium Process in the Presence of Hydrodynamic Interactions

  2025cites this paper
• Investigation of the neural origin of non-Euclidean visual space and analysis of visual phenomena using information geometry

  2025cites this paper
• Thermodynamic inference in molecular motors: A martingale approach.

  2025cites this paper
• Experimentally probing entropy reduction via iterative quantum information transfer

  2024cites this paper
• Speed-accuracy trade-off for the diffusion models: Wisdom from nonequilibrium thermodynamics and optimal transport

  2024cites this paper
• Speed-accuracy trade-off for the diffusion models: Wisdom from nonequilibrium thermodynamics and optimal transport

  2024cites this paper
• Transfer entropy and flow of information in two-skyrmion system

  2024cites this paper
• Optimal finite-time Maxwell's demons in Langevin systems

  2024cites this paper
• Finite-time thermodynamic bounds and trade-off relations for information processing

  2024cites this paper
• Modeling the Arrows of Time with Causal Multibaker Maps

  2024cites this paper
• Entropy production in communication channels.

  2024cites this paper
• A simple reconstruction method to infer nonreciprocal interactions and local driving in complex systems

  2024cites this paper
• Optimization of nonequilibrium free energy harvesting illustrated on bacteriorhodopsin

  2023cites this paper
• Universal bounds on optimization of free energy harvesting

  2023cites this paper
• Entropy production in communication channels

  2023cites this paper
• Conjecture of an information-response inequality

  2023cites this paper
• Foundations of algorithmic thermodynamics.

  2023cites this paper
• Quantum Fluctuation Theorem for Arbitrary Measurement and Feedback Schemes.

  2023cites this paper
• Stochastic Thermodynamics of Multiple Co-Evolving Systems—Beyond Multipartite Processes

  2023cites this paper
• Thermodynamic cost of Brownian computers in the stochastic thermodynamics of resetting

  2023cites this paper
• Thermodynamics of signal transduction systems and fluctuation theorem in a signal cascade

  2023cites this paper
• Thermodynamic Bound on the Asymmetry of Cross-Correlations.

  2023cites this paper
• Learning stochastic filtering

  2022cites this paper
• Computation time and thermodynamic uncertainty relation of Brownian circuits

  2022cites this paper
• From a feedback-controlled demon to an information ratchet in a double quantum dot.

  2022cites this paper
• Relationship between Schreiber's transfer entropy and Liang-Kleeman information flow from the perspective of stochastic thermodynamics.

  2022cites this paper
• Geometric decomposition of entropy production into excess, housekeeping, and coupling parts.

  2022cites this paper
• Thermodynamics of Internal Correlations

  2022cites this paper
• Estimating time-dependent entropy production from non-equilibrium trajectories

  2022cites this paper
• Theoretical and Numerical Study of Self-Organizing Processes in a Closed System Classical Oscillator and Random Environment

  2022cites this paper
• Nonequilibrium thermodynamics in cavity optomechanics

  2022cites this paper
• Theoretical and Numerical Study of Self-Organizing Processes In a Closed System Classical Oscillator + Random Environment

  2022cites this paper
• Geometric thermodynamics for the Fokker–Planck equation: stochastic thermodynamic links between information geometry and optimal transport

  2022cites this paper
• Combining lower bounds on entropy production in complex systems with multiple interacting components

  2022influential citation
• Extracting Bayesian networks from multiple copies of a quantum system

  2021cites this paper
• Title: Experimental evaluation of thermodynamic speed limit in living cells via information geometry

  2021cites this paper
• 2 Information thermodynamics encoder and encoding 2 . 1 Definition of information thermodynamics encoder

  2021cites this paper
• Information flow, gating, and energetics in dimeric molecular motors

  2021cites this paper
• Quantum Fluctuation Theorem under Quantum Jumps with Continuous Measurement and Feedback.

  2021cites this paper
• Thermodynamic role of main reaction pathway and multi-body information flow in membrane transport

  2021cites this paper
• Interpretation of TOF‐SIMS data based on information entropy of spectra

  2021cites this paper
• Thermodynamic speed limits for co-evolving systems

  2021cites this paper
• Information thermodynamics of encoding and encoders.

  2021cites this paper
• Fundamental Advantage of Feedback Control Based on a Generalized Second Law of Thermodynamics

  2021cites this paper
• Fundamental Advantage of Feedback Control Caused by Dissipation of Internal Correlations

  2021cites this paper
• Informational Steady States and Conditional Entropy Production in Continuously Monitored Systems

  2021cites this paper
• Geometrical aspects of entropy production in stochastic thermodynamics based on Wasserstein distance

  2021cites this paper
• Fluctuation-response theorem for Kullback-Leibler divergences to quantify causation

  2021cites this paper
• Estimating entropy production by machine learning of short-time fluctuating currents.

  2020cites this paper
• Prediction and Dissipation in Nonequilibrium Molecular Sensors: Conditionally Markovian Channels Driven by Memoryful Environments

  2020cites this paper
• Functional thermodynamics of Maxwellian ratchets: Constructing and deconstructing patterns, randomizing and derandomizing behaviors

  2020cites this paper
• Information geometric inequalities of chemical thermodynamics

  2020cites this paper
• Experimental Assessment of Entropy Production in a Continuously Measured Mechanical Resonator.

  2020influential citation
• Minimal entropy production rate of interacting systems

  2020cites this paper
• Experimental evaluation of thermodynamic cost and speed limit in living cells via information geometry

  2020cites this paper
• Tighter thermodynamic bound on the speed limit in systems with unidirectional transitions.

  2020cites this paper
• Information geometry in the population dynamics of bacteria

  2020cites this paper
• Estimating entropy production along a single non-equilibrium trajectory.

  2020cites this paper
• A unifying framework for mean-field theories of asymmetric kinetic Ising systems

  2020cites this paper
• Thermodynamic bound on speed limit in systems with unidirectional transitions and a tighter bound

  2020cites this paper
• Redundancy of Hidden Layers in Deep Learning: An Information Perspective

  2020influential citation
• Entropy production and thermodynamics of information under protocol constraints

  2020cites this paper
• Coupled and Hidden Degrees of Freedom in Stochastic Thermodynamics

  2020cites this paper
• Estimating time-dependent entropy production from non-equilibrium trajectories

  2020cites this paper
• The Functional Thermodynamics of Finite-State Maxwellian Ratchets

  2020cites this paper
• The principles of adaptation in organisms and machines II: Thermodynamics of the Bayesian brain

  2020cites this paper
• Diagrammatic expansion of information flows in stochastic Boolean networks

  2020cites this paper
• Fluctuation theorems for multipartite processes

  2020cites this paper
• Cell-to-cell diversification in ERBB-RAS-MAPK signal transduction that produces cell-type specific growth factor responses

  2019cites this paper
• The principles of adaptation in organisms and machines I: machine learning, information theory, and thermodynamics

  2019cites this paper
• Information Thermodynamics for Time Series of Signal-Response Models

  2019influential citation
• Thermodynamics of continuous non-Markovian feedback control

  2019cites this paper
• The stochastic thermodynamics of computation

  2019cites this paper
• Information thermodynamics for interacting stochastic systems without bipartite structure

  2019cites this paper
• Stochastic thermodynamics with arbitrary interventions.

  2019cites this paper
• Autonomous conversion of information to work in quantum dots

  2019cites this paper
• Thermodynamics of information geometry as a generalization of the Glansdorff-Prigogine criterion for stability

  2019cites this paper
• Quantum Fluctuation Theorems beyond Two-Point Measurements.

  2019cites this paper
• Uncertainty relations and fluctuation theorems for Bayes nets

  2019influential citation
• Information geometry, trade-off relations, and generalized Glansdorff-Prigogine criterion for stability

  2019cites this paper
• Analysis of Cell Signal Transduction Based on Kullback–Leibler Divergence: Channel Capacity and Conservation of Its Production Rate during Cascade

  2018cites this paper
• Information Thermodynamics of Cell Signal Transduction

  2018cites this paper
• 1 3 M ar 2 01 8 Information-thermodynamic characterization of stochastic Boolean networks

  2018cites this paper
• The Conservation of Average Entropy Production Rate in a Model of Signal Transduction: Information Thermodynamics Based on the Fluctuation Theorem

  2018cites this paper
• Semantic information, autonomous agency and non-equilibrium statistical physics

  2018cites this paper
• Unified framework for the second law of thermodynamics and information thermodynamics based on information geometry

  2018cites this paper
• Stochastic Time Evolution, Information Geometry, and the Cramér-Rao Bound

  2018cites this paper
• Unified framework for the entropy production and the stochastic interaction based on information geometry

  2018cites this paper
• Entropy in Cell Biology: Information Thermodynamics of a Binary Code and Szilard Engine Chain Model of Signal Transduction

  2018cites this paper