Information theory and adaptation

In this Chapter, we ask questions (1) What is the right way to measure the quality of information processing in a biological system? and (2) What can real-life organisms do in order to improve their performance in information-processing tasks? We then review the body of work that investigates these questions experimentally, computationally, and theoretically in biological domains as diverse as cell biology, population biology, and computational neuroscience

• Publication year

  2010

• Venue

  arXiv: Quantitative Methods

• Publication date

  2010-11-24

• Fields of study

  Biology, Mathematics, Computer Science

• Identifiers
  arXiv 1011.5466
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Possible Principles Underlying the Transformations of Sensory Messages

  2012cited by this paper
• Gain control in molecular information processing: lessons from neuroscience

  2011cited by this paper
• Bacterial strategies for chemotaxis response

  2010cited by this paper
• Optimal Strategy for Competence Differentiation in Bacteria

  2010cited by this paper
• Time and Associative Learning.

  2010cited by this paper
• Adaptive behavior of bacterial mechanosensitive channels is coupled to membrane mechanics

  2010cited by this paper
• State-stabilizing Interactions in Bacterial Mechanosensitive Channel Gating and Adaptation*

  2009cited by this paper
• A systems-level analysis of perfect adaptation in yeast osmoregulation.

  2009cited by this paper
• Mutual information between input and output trajectories of biochemical networks.

  2009cited by this paper
• Adaptive response by state-dependent inactivation

  2009cited by this paper
• Temporal maps and informativeness in associative learning.

  2009cited by this paper
• Gene expression profiling supports the hypothesis that human ovarian surface epithelia are multipotent and capable of serving as ovarian cancer initiating cells

  2009cited by this paper
• Past-future information bottleneck in dynamical systems.

  2009cited by this paper
• Timescales of inference in visual adaptation.

  2009cited by this paper
• Architecture-dependent noise discriminates functionally analogous differentiation circuits.

  2009cited by this paper
• Adaptive prediction of environmental changes by microorganisms

  2009cited by this paper
• Natural selection maximizes Fisher information

  2009cited by this paper
• Quantifying evolvability in small biological networks.

  2008cited by this paper
• Signal processing by the HOG MAP kinase pathway

  2008cited by this paper
• Predictive Behavior Within Microbial Genetic Networks

  2008cited by this paper
• A Hebbian learning rule mediates asymmetric plasticity in aligning sensory representations.

  2008cited by this paper
• The Frequency Dependence of Osmo-Adaptation in Saccharomyces cerevisiae

  2008cited by this paper
• Variable sizes of Escherichia coli chemoreceptor signaling teams

  2008cited by this paper
• Fus3 generates negative feedback that improves information transmission in yeast pheromone response

  2008cited by this paper
• Phenotypic diversity as an adaptation to environmental uncertainty

  2008cited by this paper
• Remarks on feedforward circuits, adaptation, and pulse memory.

  2008cited by this paper
• MAPK-mediated bimodal gene expression and adaptive gradient sensing in yeast

  2007cited by this paper
• Neural Coding of Natural Stimuli: Information at Sub-Millisecond Resolution

  2007influential reference
• Noise in Gene Expression Determines Cell Fate in Bacillus subtilis

  2007cited by this paper
• Empirical fitness landscapes reveal accessible evolutionary paths

  2007cited by this paper
• Information-theoretic approach to interactive learning

  2007cited by this paper
• Detection and prediction of periodic patterns by the retina

  2007cited by this paper
• Chemotaxis in Escherichia coli: A Molecular Model for Robust Precise Adaptation

  2007cited by this paper
• Information flow and optimization in transcriptional regulation

  2007cited by this paper
• ‘Infotaxis’ as a strategy for searching without gradients

  2007cited by this paper
• An Information-Theoretic Characterization of the Optimal Gradient Sensing Response of Cells

  2007cited by this paper
• Microfluidic large-scale integration: the evolution of design rules for biological automation.

  2007cited by this paper
• Optimal Noise Filtering in the Chemotactic Response of Escherichia coli

  2006influential reference
• A Mathematical Theory of Communication

  2006influential reference
• Positive feedback may cause the biphasic response observed in the chemoattractant-induced response of Dictyostelium cells

  2006cited by this paper
• Optimal Signal Processing in Small Stochastic Biochemical Networks

  2006influential reference
• Adaptation without parameter change: Dynamic gain control in motion detection

  2005cited by this paper
• Phenotypic Diversity, Population Growth, and Information in Fluctuating Environments

  2005cited by this paper
• Faculty Opinions recommendation of Bacterial persistence: a model of survival in changing environments.

  2005cited by this paper
• Spontaneous evolution of modularity and network motifs.

  2005cited by this paper
• Elements of Information Theory

  2005influential reference
• A plausible model for the digital response of p53 to DNA damage.

  2005cited by this paper
• Dynamic predictive coding by the retina

  2005cited by this paper
• The learning curve: implications of a quantitative analysis.

  2004cited by this paper
• Matching Behavior and the Representation of Value in the Parietal Cortex

  2004cited by this paper
• Summing up the noise in gene networks

  2004cited by this paper
• E. coli in Motion

  2004cited by this paper
• Fluctuation-Dissipation Theorem and Models of Learning

  2004cited by this paper
• Dynamics of the p53-Mdm2 feedback loop in individual cells

  2004cited by this paper
• Bacterial Persistence as a Phenotypic Switch

  2004cited by this paper
• Design and Diversity in Bacterial Chemotaxis: A Comparative Study in Escherichia coli and Bacillus subtilis

  2004cited by this paper
• Shannon information and biological fitness

  2004influential reference
• Signaling switches and bistability arising from multisite phosphorylation in protein kinase cascades

  2004cited by this paper
• Why are chemotaxis receptors clustered but other receptors aren't?

  2003cited by this paper
• Estimation of Entropy and Mutual Information

  2003cited by this paper
• Feedback Control in Intracellular Signaling Pathways: Regulating Chemotaxis in Dictyostelium Discoideum

  2003cited by this paper
• Predictability , Complexity , and Learning

  2002cited by this paper
• Binless strategies for estimation of information from neural data.

  2002cited by this paper
• Instructed learning in the auditory localization pathway of the barn owl

  2002cited by this paper
• Signal Processing by Simple Chemical Systems

  2002cited by this paper
• Immunology as Information Processing

  2001cited by this paper
• Efficiency and ambiguity in an adaptive neural code

  2001influential reference
• Specificity of MAP kinase signaling in yeast differentiation involves transient versus sustained MAPK activation.

  2001cited by this paper
• Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems

  2001cited by this paper
• The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect.

  2001cited by this paper
• Variability and information in a neural code of the cat lateral geniculate nucleus.

  2001cited by this paper
• Entropy and Inference, Revisited

  2001cited by this paper
• Design Principles for the Immune System and Other Distributed Autonomous Systems

  2001cited by this paper
• Self-Organized Biological Dynamics and Nonlinear Control: Signal processing by biochemical reaction networks

  2000cited by this paper
• Temporal Coding of Visual Information in the Thalamus

  2000cited by this paper
• Self-organized biological dynamics and nonlinear control : toward understanding complexity, chaos and emergent function in living systems

  2000cited by this paper
• Time, rate, and conditioning.

  2000cited by this paper
• Scientific Papers

  2000cited by this paper
• Engineering aspects of enzymatic signal transduction: photoreceptors in the retina.

  2000cited by this paper
• The information bottleneck method

  2000cited by this paper
• Acquisition in Autoshaping

  1999cited by this paper
• Robustness in bacterial chemotaxis

  1999cited by this paper
• The metabolic cost of neural information

  1998cited by this paper
• Asymmetric Dynamics in Optimal Variance Adaptation

  1998cited by this paper
• IgE-mediated desensitization in human basophils and mast cells.

  1998cited by this paper
• Spikes: Exploring the Neural Code

  1996cited by this paper
• Entropy and Information in Neural Spike Trains

  1996cited by this paper
• Ultrasensitivity in the mitogen-activated protein kinase cascade.

  1996cited by this paper
• Specificity of receptor tyrosine kinase signaling: transient versus sustained extracellular signal-regulated kinase activation.

  1995cited by this paper
• Statistical Construction of Chemical Reaction Mechanisms from Measured Time-Series

  1995cited by this paper
• Towards a Theory of Early Visual Processing

  1990cited by this paper
• What is Bet-Hedging

  1987cited by this paper
• Predictive coding: a fresh view of inhibition in the retina

  1982cited by this paper
• A Simple Coding Procedure Enhances a Neuron's Information Capacity

  1981cited by this paper
• The effects of background illumination on the photoresponses of red and green cones.

  1979cited by this paper
• Changes in time scale and sensitivity in turtle photoreceptors

  1974cited by this paper
• Extrapolation, Interpolation, and Smoothing of Stationary Time Series

  1964influential reference
• A new interpretation of information rate

  1956cited by this paper
• The mathematical theory of communication

  1950influential reference

• The hierarchical timescale hypothesis: Functional and structural convergence of biological networks and artificial neural nets.

  2026cites this paper
• Normative approaches to neural coding and behavior

  2024cites this paper
• Playing it safe: information constrains collective betting strategies

  2023cites this paper
• Playing it safe: information constrains collective betting strategies

  2023cites this paper
• Optimal information gain at the onset of habituation to repeated stimuli

  2023cites this paper
• Information dynamics emerging from memory and adaptation in non-equilibrium sensing of living systems

  2023cites this paper
• Temporal Contrastive Learning through implicit non-equilibrium memory

  2023cites this paper
• Maximization of information transmission influences selection of native phosphorelay architectures

  2021cites this paper
• The Information in Emotion Communication

  2020cites this paper
• Individual yeast cells signal at different levels but each with good precision

  2020cites this paper
• What influences selection of native phosphorelay architectures?

  2020cites this paper
• Front-end Weber-Fechner gain 1 control enhances the � delity of 2 combinatorial odor coding

  2019cites this paper
• Efficient and adaptive sensory codes

  2019cites this paper
• First-principles prediction of the information processing capacity of a simple genetic circuit

  2019cites this paper
• Variance adaptation in navigational decision making

  2018cites this paper
• Information-theoretic models of communication in biological systems

  2017cites this paper
• Infomax Strategies for an Optimal Balance Between Exploration and Exploitation

  2016cites this paper
• Limits on information transduction through amplitude and frequency regulation of transcription factor activity

  2015cites this paper
• Cooperation and antagonism in information exchange in a growth scenario with two species

  2015cites this paper
• Cellular noise and information transmission.

  2014cites this paper
• The Fidelity of Dynamic Signaling by Noisy Biomolecular Networks

  2013cites this paper
• Molecular and Functional Aspects of Bacterial Chemotaxis

  2011cites this paper
• Gain control in molecular information processing: lessons from neuroscience

  2011cites this paper
• Emergent properties of spike frequency adaptation in neuronal systems

  2011cites this paper