Maximum entropy models for antibody diversity

Recognition of pathogens relies on families of proteins showing great diversity. Here we construct maximum entropy models of the sequence repertoire, building on recent experiments that provide a nearly exhaustive sampling of the IgM sequences in zebrafish. These models are based solely on pairwise correlations between residue positions but correctly capture the higher order statistical properties of the repertoire. By exploiting the interpretation of these models as statistical physics problems, we make several predictions for the collective properties of the sequence ensemble: The distribution of sequences obeys Zipf’s law, the repertoire decomposes into several clusters, and there is a massive restriction of diversity because of the correlations. These predictions are completely inconsistent with models in which amino acid substitutions are made independently at each site and are in good agreement with the data. Our results suggest that antibody diversity is not limited by the sequences encoded in the genome and may reflect rapid adaptation to antigenic challenges. This approach should be applicable to the study of the global properties of other protein families.

• Publication year

  2009

• Venue

  Proceedings of the National Academy of Sciences of the United States of America

• Publication date

  2009-12-28

• Fields of study

  Biology, Medicine, Physics

• Identifiers
  DOI 10.1073/pnas.1001705107arXiv 0912.5175PMID 20212159PMCID PMC2851784
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Introduction to Protein Structure

  2012cited by this paper
• High-Throughput Sequencing of the Zebrafish Antibody Repertoire

  2009cited by this paper
• Protein sectors: evolutionary units of three-dimensional structure.

  2009cited by this paper
• Identification of direct residue contacts in protein–protein interaction by message passing

  2009cited by this paper
• Fish immunology.

  2009cited by this paper
• Maximum-entropy network analysis reveals a role for tumor necrosis factor in peripheral nerve development and function

  2009cited by this paper
• Inferring species interactions in tropical forests

  2009cited by this paper
• Maximum entropy approach for deducing amino Acid interactions in proteins.

  2008cited by this paper
• A Maximum Entropy Model Applied to Spatial and Temporal Correlations from Cortical Networks In Vitro

  2008cited by this paper
• World Scientific

  2007cited by this paper
• Janeway's immunobiology

  2007cited by this paper
• Rediscovering the power of pairwise interactions

  2007cited by this paper
• Ising models for networks of real neurons

  2006cited by this paper
• An integrated view of protein evolution

  2006cited by this paper
• Power laws, Pareto distributions and Zipf's law

  2005cited by this paper
• Evolutionary information for specifying a protein fold

  2005cited by this paper
• Natural-like function in artificial WW domains

  2005cited by this paper
• Weak pairwise correlations imply strongly correlated network states in a neural population

  2005cited by this paper
• Pillars Article: Evidence for somatic rearrangement of immunoglobulin genes coding for variable and constant regions

  2004cited by this paper
• Network information and connected correlations.

  2003cited by this paper
• Entropy and Information in Neural Spike Trains

  1996cited by this paper
• Sequence space, folding and protein design.

  1996cited by this paper
• Reaction-rate theory: fifty years after Kramers

  1990cited by this paper
• Spin Glass Theory and Beyond

  1987cited by this paper
• Identification of common molecular subsequences.

  1981cited by this paper
• Statistical Mechanics (2nd edn)

  1977cited by this paper
• Information Theory and Statistical Mechanics

  1957cited by this paper
• A Mathematical Theory of Evolution Based on the Conclusions of Dr. J. C. Willis, F.R.S.

  1925cited by this paper
• A Mathematical Theory of Evolution, Based on the Conclusions of Dr. J. C. Willis, F.R.S.

  year unknowncited by this paper

• Spontaneous switching in a protein signalling array reveals near-critical cooperativity

  2026cites this paper
• Comprehensive immune repertoire profiling reveals distinct characteristics in Kawasaki disease and a mouse model.

  2026cites this paper
• Inferring the Chemotaxis Distortion Function from Cellular Decision Strategies

  2025cites this paper
• Maximum entropy models for patterns of gene expression.

  2025cites this paper
• High-fidelity in silico generation and augmentation of TCR repertoire data using generative adversarial networks

  2025cites this paper
• Collective contributions to polarization in political voting

  2025cites this paper
• Data augmentation using diffusion models to enhance inverse Ising inference

  2025cites this paper
• Noise equals control.

  2025cites this paper
• Bacterial population dynamics during colonization of solid tumors

  2025cites this paper
• Profiling Adaptive Immunity: A Quantitative Framework for Immune Repertoire Dynamics and Clinical Diagnostics

  2025cites this paper
• Bacterial population dynamics during colonization of solid tumors

  2025cites this paper
• Minimax entropy: The statistical physics of optimal models.

  2025cites this paper
• Establishing a system to identify correlations among immune system components for exploring alternative pathways for immune information transfer.

  2025cites this paper
• GEM-T: Generative Tabular Data via Fitting Moments

  2025cites this paper
• Learning What’s in a Name with Graphical Models

  2025cites this paper
• Understanding temperature tuning in energy-based models

  2025cites this paper
• Physical modeling of embryonic transcriptomes identifies collective modes of gene expression

  2024cites this paper
• Density estimation for ordinal biological sequences and its applications.

  2024cites this paper
• Shape of the art: TCR-repertoire after allogeneic hematopoietic cell transplantation.

  2024cites this paper
• Dynamical theory of complex systems with two-way micro–macro causation

  2024cites this paper
• Dynamic Programming-Based Approach to Model Antigen-Driven Immune Repertoire Synthesis

  2024cites this paper
• Density estimation for ordinal biological sequences and its applications.

  2024cites this paper
• Hebbian learning from first principles

  2024cites this paper
• Maximum entropy models for patterns of gene expression

  2024cites this paper
• Universality of area occupancy-based fundamental diagrams in mixed traffic

  2024cites this paper
• Statistical physics of large-scale neural activity with loops.

  2024cites this paper
• Valence and interactions in judicial voting

  2024cites this paper
• Statistical thermodynamics of the binding energy super-landscape in the adaptive immune system

  2023cites this paper
• Biases in Inverse Ising Estimates of Near-Critical Behaviour

  2023cites this paper
• Multiphysics modelling of immune processes using distributed parameter systems

  2023cites this paper
• Per-capita change rates of the Phanerozoic Earth-life system exhibited Zipf distributions

  2023cites this paper
• Inferring Local Structure from Pairwise Correlations

  2023cites this paper
• Statistical thermodynamics of self-organization in the adaptive immune system

  2023cites this paper
• An integrated approach to the characterization of immune repertoires using AIMS: An Automated Immune Molecule Separator

  2023cites this paper
• Entropy-Driven, Integrative Bioinformatics Approaches Reveal the Recent Transmission of the Monkeypox Virus from Nigeria to Multiple Non-African Countries

  2023cites this paper
• Diversity loss in microbial ecosystems undergoing gradual environmental changes

  2023cites this paper
• Ultrametric identities in glassy models of natural evolution

  2023cites this paper
• HCV E1 influences the fitness landscape of E2 and may enhance escape from E2-specific antibodies

  2023influential citation
• Learning Interacting Theories from Data

  2023cites this paper
• Universal scaling relation and criticality in bacterial metabolism and growth

  2023cites this paper
• Universal scaling relation and criticality in metabolism and growth of Escherichia coli

  2023cites this paper
• Scaling Monte-Carlo-Based Inference on Antibody and TCR Repertoires

  2023cites this paper
• Conserved biophysical compatibility among the highly variable germline-encoded regions shapes TCR-MHC interactions

  2023cites this paper
• Steering and controlling evolution — from bioengineering to fighting pathogens

  2023cites this paper
• Extrinsic vs Intrinsic Criticality in Systems with Many Components

  2023cites this paper
• Utilizing Entropy to Systematically Quantify the Resting‐Condition Baroreflex Regulation Function

  2023cites this paper
• Universality of Area Occupancy-Based Fundamental Diagrams in Mixed Traffic

  2023cites this paper
• Universality of Form: The Case of Retinal Cone Photoreceptor Mosaics

  2023cites this paper
• Generalized Glauber Dynamics for Inference in Biology

  2022cites this paper
• Inference of metabolic fluxes in nutrient-limited continuous cultures: A Maximum Entropy approach with the minimum information

  2022cites this paper
• Information theory: A foundation for complexity science

  2022cites this paper
• The evolutionary and functional significance of germline immunoglobulin gene variation.

  2022cites this paper
• Time-Dependent Maximum Entropy Model for Populations of Retinal Ganglion Cells†

  2022cites this paper
• Maximum Entropy Technique and Regularization Functional for Determining the Pharmacokinetic Parameters in DCE-MRI

  2022cites this paper
• Toward Interactive Music Generation: A Position Paper

  2022cites this paper
• Utility of Bulk T-Cell Receptor Repertoire Sequencing Analysis in Understanding Immune Responses to COVID-19

  2022cites this paper
• Quantifying information of intracellular signaling: progress with machine learning

  2022cites this paper
• Immunopeptidome Cluster Profiling with Critical Variable Selection

  2022cites this paper
• Unsupervised Bayesian Ising Approximation for decoding neural activity and other biological dictionaries

  2022cites this paper
• Named-Entity Recognition for Hindi language using context pattern-based maximum entropy

  2022cites this paper
• Affinity maturation for an optimal balance between long-term immune coverage and short-term resource constraints

  2022cites this paper
• Mutual information in changing environments: Nonlinear interactions, out-of-equilibrium systems, and continuously varying diffusivities.

  2022cites this paper
• TCRpower: quantifying the detection power of T-cell receptor sequencing with a novel computational pipeline calibrated by spike-in sequences

  2022cites this paper
• Statistical models of complex brain networks: a maximum entropy approach

  2022cites this paper
• Inferring Cultural Landscapes with the Inverse Ising Model

  2022cites this paper
• Quantifying Relevance in Learning and Inference

  2022influential citation
• Modified Maximum Entropy Method and Estimating the AIF via DCE-MRI Data Analysis

  2022cites this paper
• Advanced Maximum Entropy Approaches for Medical and Microscopy Imaging

  2022influential citation
• Lemaître's law and the spatial distributions of the cone photoreceptors in the retinas of vertebrates

  2022cites this paper
• How Naive T-Cell Clone Counts Are Shaped By Heterogeneous Thymic Output and Homeostatic Proliferation

  2022cites this paper
• A Maximum Entropy Approach to Defining Cell State

  2022cites this paper
• Analyzing the heterogeneous structure of the genes interaction network through the random matrix theory

  2021cites this paper
• Progress and challenges in mass spectrometry-based analysis of antibody repertoires.

  2021cites this paper
• Affinity maturation for an optimal balance between long-term immune coverage and short-term resource constraints

  2021cites this paper
• Complex physical properties of a self-organizing biological system

  2021cites this paper
• Mutual Information Disentangles Interactions from Changing Environments.

  2021cites this paper
• CD8+ T-cell Epitope Presentation on MHC-1 as a Probability Space

  2021cites this paper
• Inferring couplings in networks across order-disorder phase transitions

  2021cites this paper
• Italian Twitter semantic network during the Covid-19 epidemic

  2021cites this paper
• TOLOMEO, a Novel Machine Learning Algorithm to Measure Information and Order in Correlated Networks and Predict Their State

  2021cites this paper
• Using Domain Based Latent Personal Analysis of B Cell Clone Diversity Patterns to Identify Novel Relationships Between the B Cell Clone Populations in Different Tissues

  2021cites this paper
• Learning the distribution of single-cell chromosome conformations in bacteria reveals emergent order across genomic scales

  2021cites this paper
• Generalization of the maximum entropy principle for curved statistical manifolds

  2021cites this paper
• Learning and organization of memory for evolving patterns

  2021cites this paper
• PDE/Statistical Mechanics Duality: Relation Between Guerra’s Interpolated p-Spin Ferromagnets and the Burgers Hierarchy

  2021cites this paper
• Inference of stochastic time series with missing data.

  2021cites this paper
• Dynamic maximum entropy provides accurate approximation of structured population dynamics

  2021cites this paper
• Successes and failures of simple statistical physics models for a network of real neurons

  2021cites this paper
• Complex Physical Properties of an Adaptive, Self-Organizing Biological System

  2021cites this paper
• Introduction to the special issue: quantifying collectivity

  2021cites this paper
• Protein design and variant prediction using autoregressive generative models

  2021cites this paper
• Field-theoretic density estimation for biological sequence space with applications to 5′ splice site diversity and aneuploidy in cancer

  2021cites this paper
• Successes and failures of simplified models for a network of real neurons

  2021cites this paper
• Non-parametric Bayesian density estimation for biological sequence space with applications to pre-mRNA splicing and the karyotypic diversity of human cancer

  2020cites this paper
• DynaMETE: a hybrid MaxEnt‐plus‐mechanism theory of dynamic macroecology

  2020cites this paper
• Information geometry in the population dynamics of bacteria

  2020cites this paper
• Biochemical patterns of antibody polyreactivity revealed through a bioinformatics-based analysis of CDR loops

  2020cites this paper
• Latent dynamical variables produce signatures of spatiotemporal criticality in large biological systems

  2020cites this paper
• Analysis of temporal correlation in heart rate variability through maximum entropy principle in a minimal pairwise glassy model

  2020cites this paper
• Systems immunology

  2020cites this paper