Masked Inverse Folding with Sequence Transfer for Protein Representation Learning

No abstract is available for this paper.

• Publication year

  2023

• Venue

  bioRxiv

• Publication date

  2023-03-19

• Fields of study

  Biology, Medicine, Computer Science

• Identifiers
  DOI 10.1101/2022.05.25.493516PMID 37883472
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Computational protein design

  2025cited by this paper
• Convolutions are competitive with transformers for protein sequence pretraining

  2024cited by this paper
• Predicting the structure of large protein complexes using AlphaFold and sequential assembly

  2023cited by this paper
• Robust deep learning based protein sequence design using ProteinMPNN

  2022cited by this paper
• RITA: a Study on Scaling Up Generative Protein Sequence Models

  2022cited by this paper
• DeepLoc 2.0: multi-label subcellular localization prediction using protein language models

  2022cited by this paper
• LM-GVP: an extensible sequence and structure informed deep learning framework for protein property prediction

  2022cited by this paper
• A Deep SE(3)-Equivariant Model for Learning Inverse Protein Folding

  2022cited by this paper
• Efficient evolution of human antibodies from general protein language models and sequence information alone

  2022cited by this paper
• Learning inverse folding from millions of predicted structures

  2022cited by this paper
• Structure-aware protein self-supervised learning

  2022cited by this paper
• ProtGPT2 is a deep unsupervised language model for protein design

  2022cited by this paper
• Protein Structure Representation Learning by Geometric Pretraining

  2022cited by this paper
• Non-identifiability and the Blessings of Misspecification in Models of Molecular Fitness

  2022cited by this paper
• Design in the DARK: Learning Deep Generative Models for De Novo Protein Design

  2022cited by this paper
• Multi-Scale Representation Learning on Proteins

  2022cited by this paper
• ColabFold: making protein folding accessible to all

  2022cited by this paper
• Evolutionary-scale prediction of atomic level protein structure with a language model

  2022cited by this paper
• Protein Sequence and Structure Co-Design with Equivariant Translation

  2022cited by this paper
• Deep neural language modeling enables functional protein generation across families

  2021cited by this paper
• De novo design of modular and tunable protein biosensors

  2021cited by this paper
• MSA Transformer

  2021cited by this paper
• Protein design and variant prediction using autoregressive generative models

  2021cited by this paper
• Protein sequence design by conformational landscape optimization

  2021cited by this paper
• Protein sequence design with deep generative models

  2021cited by this paper
• ProteinBERT: a universal deep-learning model of protein sequence and function

  2021cited by this paper
• SignalP 6.0 achieves signal peptide prediction across all types using protein language models

  2021cited by this paper
• Fold2Seq: A Joint Sequence(1D)-Fold(3D) Embedding-based Generative Model for Protein Design

  2021cited by this paper
• Language models enable zero-shot prediction of the effects of mutations on protein function

  2021cited by this paper
• Highly accurate protein structure prediction with AlphaFold

  2021influential reference
• Single-sequence protein structure prediction using language models from deep learning

  2021cited by this paper
• Using AlphaFold for Rapid and Accurate Fixed Backbone Protein Design

  2021cited by this paper
• Toward More General Embeddings for Protein Design: Harnessing Joint Representations of Sequence and Structure

  2021cited by this paper
• Structure-based protein design with deep learning.

  2021cited by this paper
• Using AlphaFold to predict the impact of single mutations on protein stability and function

  2021cited by this paper
• Iterative Refinement Graph Neural Network for Antibody Sequence-Structure Co-design

  2021cited by this paper
• AlphaDesign: A de novo protein design framework based on AlphaFold

  2021cited by this paper
• FLIP: Benchmark tasks in fitness landscape inference for proteins

  2021influential reference
• Deep learning methods for designing proteins scaffolding functional sites

  2021cited by this paper
• AlphaFold Protein Structure Database: massively expanding the structural coverage of protein-sequence space with high-accuracy models

  2021cited by this paper
• Evolutionary velocity with protein language models

  2021cited by this paper
• ProtTrans: Towards Cracking the Language of Life’s Code Through Self-Supervised Learning

  2021cited by this paper
• New computational protein design methods for de novo small molecule binding sites

  2020cited by this paper
• ProGen: Language Modeling for Protein Generation

  2020cited by this paper
• High-resolution structures of the SARS-CoV-2 2’-O-methyltransferase reveal strategies for structure-based inhibitor design

  2020cited by this paper
• SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networks

  2020cited by this paper
• Deep Mutational Scanning of SARS-CoV-2 Receptor Binding Domain Reveals Constraints on Folding and ACE2 Binding

  2020cited by this paper
• Learning the language of viral evolution and escape

  2020cited by this paper
• De novo protein design by deep network hallucination

  2020cited by this paper
• Learning from Protein Structure with Geometric Vector Perceptrons

  2020influential reference
• Transformer protein language models are unsupervised structure learners

  2020cited by this paper
• ATOM3D: Tasks On Molecules in Three Dimensions

  2020cited by this paper
• UniProt: the universal protein knowledgebase in 2021

  2020cited by this paper
• Improved protein structure prediction using predicted interresidue orientations

  2019cited by this paper
• Fast and flexible design of novel proteins using graph neural networks

  2019cited by this paper
• Machine learning-assisted directed protein evolution with combinatorial libraries

  2019cited by this paper
• Learning protein sequence embeddings using information from structure

  2019cited by this paper
• Unified rational protein engineering with sequence-based deep representation learning

  2019cited by this paper
• Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences

  2019influential reference
• Generative Models for Graph-Based Protein Design

  2019influential reference
• Evaluating Protein Transfer Learning with TAPE

  2019cited by this paper
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  2019cited by this paper
• SKEMPI 2.0: an updated benchmark of changes in protein–protein binding energy, kinetics and thermodynamics upon mutation

  2018cited by this paper
• Deep generative models of genetic variation capture the effects of mutations

  2018cited by this paper
• ProtaBank: A repository for protein design and engineering data

  2018cited by this paper
• End-to-End Learning on 3D Protein Structure for Interface Prediction

  2018cited by this paper
• Protein-level assembly increases protein sequence recovery from metagenomic samples manyfold

  2018cited by this paper
• A general-purpose protein design framework based on mining sequence–structure relationships in known protein structures

  2018cited by this paper
• The Rosetta all-atom energy function for macromolecular modeling and design

  2017cited by this paper
• Global analysis of protein folding using massively parallel design, synthesis, and testing

  2017cited by this paper
• Massively parallel de novo protein design for targeted therapeutics

  2017cited by this paper
• Attention is All you Need

  2017cited by this paper
• Clustering huge protein sequence sets in linear time

  2017cited by this paper
• Adaptation in protein fitness landscapes is facilitated by indirect paths

  2016cited by this paper
• The RCSB protein data bank: integrative view of protein, gene and 3D structural information

  2016influential reference
• UniRef clusters: a comprehensive and scalable alternative for improving sequence similarity searches

  2014influential reference
• Computational Design of an Enzyme Catalyst for a Stereoselective Bimolecular Diels-Alder Reaction

  2010cited by this paper
• Backbone conformational constraints in a microcrystalline U-15N-labeled protein by 3D dipolar-shift solid-state NMR spectroscopy.

  2006cited by this paper
• Computational protein design.

  1999cited by this paper
• High-resolution protein design with backbone freedom.

  1998cited by this paper
• De novo protein design: fully automated sequence selection.

  1997cited by this paper
• De novo protein design: what are we learning?

  1991cited by this paper

• JanusDDG: a physics-informed neural network for sequence-based protein stability via two-fronts attention.

  2026cites this paper
• Dynamics-inspired Structure Hallucination for Protein-protein Interaction Modeling

  2026cites this paper
• Multimodal Mixture-of-Experts with Retrieval Augmentation for Protein Active Site Identification

  2026cites this paper
• Harnessing AI to Decode Protein Kinases: Structural, Functional, and Therapeutic Design Perspectives.

  2026cites this paper
• Coupling codon and protein constraints decouples drivers of variant pathogenicity

  2026cites this paper
• Graph with Residue-Based Cross-Modal Framework Enhances Cell Function-Related Protein Properties Prediction

  2025cites this paper
• Large Language Model (LLM)-Based Advances in Prediction of Post-translational Modification Sites in Proteins.

  2025cites this paper
• From high-throughput evaluation to wet-lab studies: advancing mutation effect prediction with a retrieval-enhanced model

  2025cites this paper
• A Matrix Variational Auto-Encoder for Variant Effect Prediction in Pharmacogenes

  2025influential citation
• Enhancing functional proteins through multimodal inverse folding with ABACUS-T

  2025cites this paper
• Protein Structure Tokenization via Geometric Byte Pair Encoding

  2025cites this paper
• Amino acid exchangeability and surface accessibility underpin the effects of single substitutions

  2025cites this paper
• M3Site: multiclass multimodal learning for protein active site identification and classification

  2025cites this paper
• Graph attention with structural features improves the generalizability of identifying functional sequences at a protein interface

  2025cites this paper
• Glycolysis-compatible urethanases for polyurethane recycling.

  2025cites this paper
• Democratizing protein language model training, sharing and collaboration.

  2025cites this paper
• Kideraspa: designing variants of staphylococcal protein a based on a diffusion model with kidera factors

  2025cites this paper
• Distilling Structural Representations into Protein Sequence Models

  2025cites this paper
• Advances in Prediction of Posttranslational Modification Sites Known to Localize in Protein Supersecondary Structures.

  2025cites this paper
• Decoding the physicochemical basis of taxonomy preferences in protein design models

  2025cites this paper
• Learning Protein Representations with Conformational Dynamics

  2025cites this paper
• Democratizing Protein Language Model Training, Sharing and Collaboration

  2025cites this paper
• FusionProt: Fusing Sequence and Structural Information for Unified Protein Representation Learning

  2025influential citation
• Structure-based self-supervised learning enables ultrafast protein stability prediction upon mutation

  2025cites this paper
• Transformers trained on proteins can learn to attend to Euclidean distance

  2025cites this paper
• Evolutionary Profiles for Protein Fitness Prediction

  2025cites this paper
• Reliable prediction of protein–protein binding affinity changes upon mutations with Pythia-PPI

  2025cites this paper
• Steering Protein Family Design through Profile Bayesian Flow

  2025cites this paper
• A Simple yet Effective DDG Predictor is An Unsupervised Antibody Optimizer and Explainer

  2025cites this paper
• InstructPLM-mu: 1-Hour Fine-Tuning of ESM2 Beats ESM3 in Protein Mutation Predictions

  2025cites this paper
• Foundation models of protein sequences: A brief overview.

  2025cites this paper
• Protein Structure Tokenization: Benchmarking and New Recipe

  2025cites this paper
• VenusMutHub: A systematic evaluation of protein mutation effect predictors on small-scale experimental data

  2025influential citation
• Advances in Protein Representation Learning: Methods, Applications, and Future Directions

  2025cites this paper
• Scalable and cost-efficient custom gene library assembly from oligopools

  2025influential citation
• JanusDDG: A Thermodynamics-Compliant Model for Sequence-Based Protein Stability via Two-Fronts Multi-Head Attention

  2025cites this paper
• Exploring zero-shot structure-based protein fitness prediction

  2025influential citation
• Accelerating functional protein discovery with GPT models: Antimicrobials and enzymes

  2025cites this paper
• VenusMutHub—A benchmark for protein mutation effect prediction

  2025cites this paper
• Beyond the leaderboard: leveraging predictive modeling for protein–ligand insights and discovery

  2025cites this paper
• VenusX: Unlocking Fine-Grained Functional Understanding of Proteins

  2025cites this paper
• Machine learning models for pharmacogenomic variant effect predictions - recent developments and future frontiers.

  2025cites this paper
• Recent advances in engineering microbial lipases for industrial applications.

  2025cites this paper
• NS-Pep: De novo Peptide Design with Non-Standard Amino Acids

  2025cites this paper
• SurfFold: a unified model for protein inverse folding by integrating surface and structural information

  2025cites this paper
• Predictive and therapeutic applications of protein language models.

  2025cites this paper
• Integrating Protein Language Models and Geometric Deep Learning for Peptide Toxicity Prediction

  2025cites this paper
• Protein-nucleic acid language model-assisted design of precise and compact adenine base editor

  2025cites this paper
• Tokenizing Loops of Antibodies

  2025cites this paper
• Semantical and geometrical protein encoding toward enhanced bioactivity and thermostability

  2025cites this paper
• BEST: Basic Embedding Search Tool Enhancing Discovery of Novel Enzyme

  2025cites this paper
• Energy-Based Models for Predicting Mutational Effects on Proteins

  2025cites this paper
• MMSite: A Multi-modal Framework for the Identification of Active Sites in Proteins

  2024cites this paper
• Convolutions are competitive with transformers for protein sequence pretraining

  2024cites this paper
• Rotamer Density Estimator is an Unsupervised Learner of the Effect of Mutations on Protein-Protein Interaction

  2024cites this paper
• FLOP: Tasks for Fitness Landscapes Of Protein wildtypes

  2024cites this paper
• SaProt: Protein Language Modeling with Structure-aware Vocabulary

  2024cites this paper
• PETA: evaluating the impact of protein transfer learning with sub-word tokenization on downstream applications

  2024cites this paper
• Binary Discriminator Facilitates GPT-based Protein Design

  2024cites this paper
• Enhancing Antibody Language Models with Structural Information

  2024cites this paper
• FLAb: Benchmarking deep learning methods for antibody fitness prediction

  2024cites this paper
• Opportunities and Challenges for Machine Learning-Assisted Enzyme Engineering

  2024cites this paper
• Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models

  2024cites this paper
• Sparks of function by de novo protein design

  2024cites this paper
• MAPE-PPI: Towards Effective and Efficient Protein-Protein Interaction Prediction via Microenvironment-Aware Protein Embedding

  2024cites this paper
• Advances of Deep Learning in Protein Science: A Comprehensive Survey

  2024cites this paper
• NeuroFold: A Multimodal Approach to Generating Novel Protein Variants in silico

  2024influential citation
• Combining Rosetta Sequence Design with Protein Language Model Predictions Using Evolutionary Scale Modeling (ESM) as Restraint

  2024cites this paper
• ProSST: Protein Language Modeling with Quantized Structure and Disentangled Attention

  2024influential citation
• Simple, Efficient and Scalable Structure-aware Adapter Boosts Protein Language Models

  2024cites this paper
• Complex-based Ligand-Binding Proteins Redesign by Equivariant Diffusion-based Generative Models

  2024cites this paper
• Learning to Predict Mutation Effects of Protein-Protein Interactions by Microenvironment-aware Hierarchical Prompt Learning

  2024cites this paper
• GeoAB: Towards Realistic Antibody Design and Reliable Affinity Maturation

  2024cites this paper
• MULAN: multimodal protein language model for sequence and structure encoding

  2024cites this paper
• Strategies of rational and structure-driven vaccine design for Arenaviruses

  2024cites this paper
• Machine learning for predicting protein properties: A comprehensive review

  2024cites this paper
• Self-supervised machine learning methods for protein design improve sampling but not the identification of high-fitness variants

  2024cites this paper
• Protein Representation Learning with Sequence Information Embedding: Does it Always Lead to a Better Performance?

  2024cites this paper
• Zero-shot prediction of mutation effects with multimodal deep representation learning guides protein engineering

  2024cites this paper
• Secondary Structure-Guided Novel Protein Sequence Generation with Latent Graph Diffusion

  2024cites this paper
• A PLMs based protein retrieval framework

  2024cites this paper
• Progress in Protein Pre-training Models Integrated with Structural Knowledge

  2024cites this paper
• Towards deep learning sequence-structure co-generation for protein design

  2024cites this paper
• Protein representations: Encoding biological information for machine learning in biocatalysis.

  2024cites this paper
• Immunogenicity Prediction with Dual Attention Enables Vaccine Target Selection

  2024cites this paper
• Unlearning Virus Knowledge Toward Safe and Responsible Mutation Effect Predictions

  2024cites this paper
• DPLM-2: A Multimodal Diffusion Protein Language Model

  2024cites this paper
• Evaluation of Machine Learning-Assisted Directed Evolution Across Diverse Combinatorial Landscapes

  2024cites this paper
• Retrieval-Enhanced Mutation Mastery: Augmenting Zero-Shot Prediction of Protein Language Model

  2024cites this paper
• SFM-Protein: Integrative Co-evolutionary Pre-training for Advanced Protein Sequence Representation

  2024cites this paper
• Reliable prediction of protein-protein binding affinity changes upon mutations with Pythia-PPI

  2024influential citation
• SSEmb: A joint embedding of protein sequence and structure enables robust variant effect predictions

  2024cites this paper
• ProteinReDiff: Complex-based ligand-binding proteins redesign by equivariant diffusion-based generative models

  2024cites this paper
• A general temperature-guided language model to design proteins of enhanced stability and activity

  2024cites this paper
• The Historical Evolution and Significance of Multiple Sequence Alignment in Molecular Structure and Function Prediction

  2024cites this paper
• Protein engineering in the deep learning era

  2024cites this paper
• Enhancing Protein Mutation Effect Prediction through a Retrieval-Augmented Framework

  2024cites this paper
• Ultrafast classical phylogenetic method beats large protein language models on variant effect prediction

  2024cites this paper
• Structure-informed Language Models Are Protein Designers

  2023cites this paper
• Pro-PRIME: A general Temperature-Guided Language model to engineer enhanced Stability and Activity in Proteins

  2023influential citation