Comparison and quantitative verification of mapping algorithms for whole-genome bisulfite sequencing

Coupling bisulfite conversion with next-generation sequencing (Bisulfite-seq) enables genome-wide measurement of DNA methylation, but poses unique challenges for mapping. However, despite a proliferation of Bisulfite-seq mapping tools, no systematic comparison of their genomic coverage and quantitative accuracy has been reported. We sequenced bisulfite-converted DNA from two tissues from each of two healthy human adults and systematically compared five widely used Bisulfite-seq mapping algorithms: Bismark, BSMAP, Pash, BatMeth and BS Seeker. We evaluated their computational speed and genomic coverage and verified their percentage methylation estimates. With the exception of BatMeth, all mappers covered >70% of CpG sites genome-wide and yielded highly concordant estimates of percentage methylation (r2 ≥ 0.95). Fourfold variation in mapping time was found between BSMAP (fastest) and Pash (slowest). In each library, 8–12% of genomic regions covered by Bismark and Pash were not covered by BSMAP. An experiment using simulated reads confirmed that Pash has an exceptional ability to uniquely map reads in genomic regions of structural variation. Independent verification by bisulfite pyrosequencing generally confirmed the percentage methylation estimates by the mappers. Of these algorithms, Bismark provides an attractive combination of processing speed, genomic coverage and quantitative accuracy, whereas Pash offers considerably higher genomic coverage.

• Publication year

  2014

• Venue

  Nucleic Acids Research

• Publication date

  2014-01-03

• Fields of study

  Biology, Medicine, Computer Science

• Identifiers
  DOI 10.1093/nar/gkt1325PMID 24391148PMCID 3973287
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• In-solution hybrid capture of bisulfite-converted DNA for targeted bisulfite sequencing of 174 ADME genes

  2013cited by this paper
• PASS-bis: a bisulfite aligner suitable for whole methylome analysis of Illumina and SOLiD reads

  2013cited by this paper
• BatMeth: improved mapper for bisulfite sequencing reads on DNA methylation

  2012influential reference
• Comparison of alignment software for genome-wide bisulphite sequence data

  2012influential reference
• Analysing and interpreting DNA methylation data

  2012cited by this paper
• Functions of DNA methylation: islands, start sites, gene bodies and beyond

  2012cited by this paper
• DNA methylome analysis using short bisulfite sequencing data

  2012cited by this paper
• BSmooth: from whole genome bisulfite sequencing reads to differentially methylated regions

  2012cited by this paper
• The Dynamics of Genome-wide DNA Methylation Reprogramming in Mouse Primordial Germ Cells

  2012cited by this paper
• Fast and sensitive mapping of bisulfite-treated sequencing data

  2012cited by this paper
• ReadDepth: A Parallel R Package for Detecting Copy Number Alterations from Short Sequencing Reads

  2011cited by this paper
• Bismark: a flexible aligner and methylation caller for Bisulfite-Seq applications

  2011cited by this paper
• VennDiagram: a package for the generation of highly-customizable Venn and Euler diagrams in R

  2011cited by this paper
• MethylCoder: software pipeline for bisulfite-treated sequences

  2011cited by this paper
• Cutadapt removes adapter sequences from high-throughput sequencing reads

  2011cited by this paper
• Pash 3.0: A versatile software package for read mapping and integrative analysis of genomic and epigenomic variation using massively parallel DNA sequencing

  2010cited by this paper
• Comparison of sequencing-based methods to profile DNA methylation and identification of monoallelic epigenetic modifications

  2010cited by this paper
• Season of Conception in Rural Gambia Affects DNA Methylation at Putative Human Metastable Epialleles

  2010cited by this paper
• BS Seeker: precise mapping for bisulfite sequencing

  2010influential reference
• Updates to the RMAP short-read mapping software

  2009cited by this paper
• BMC Bioinformatics BioMed Central Methodology article BSMAP: whole genome bisulfite sequence MAPping program

  2009cited by this paper
• Human DNA methylomes at base resolution show widespread epigenomic differences

  2009cited by this paper
• Ultrafast and memory-efficient alignment of short DNA sequences to the human genome

  2009influential reference
• Shotgun bisulphite sequencing of the Arabidopsis genome reveals DNA methylation patterning

  2008cited by this paper
• Genome-scale DNA methylation maps of pluripotent and differentiated cells

  2008cited by this paper
• SOAP: short oligonucleotide alignment program

  2008cited by this paper
• Optimizing annealing temperature overcomes bias in bisulfite PCR methylation analysis.

  2007cited by this paper
• Pash 2.0: Scaleable Sequence Anchoring for Next-Generation Sequencing Technologgies

  2007cited by this paper
• High sensitivity mapping of methylated cytosines.

  1994cited by this paper
• Bioinformatics Applications Note Genome Analysis Bedtools: a Flexible Suite of Utilities for Comparing Genomic Features

  year unknowncited by this paper

• Integrated epigenomic and transcriptional profiling reveals genotype-specific adaptive reprogramming to drought stress in Brassica napus.

  2026cites this paper
• Assessment of bisulfite sequencing alignment tools for whole genome analysis in plants.

  2025cites this paper
• Mouse metastable epialleles are extremely rare

  2025cites this paper
• Pipeline Olympics: continuable benchmarking of computational workflows for DNA methylation sequencing data against an experimental gold standard

  2024cites this paper
• Lambda3: homology search for protein, nucleotide, and bisulfite-converted sequences

  2024cites this paper
• Alpha-Synuclein Inhibition Promotes Erythropoiesis by Affecting Methylation Modifications of Fructose and Mannose Metabolism

  2024cites this paper
• DNA methylation landscape reveals GNAS as a decitabine-responsive marker in patients with acute myeloid leukemia

  2024cites this paper
• Aryana-bs: context-aware alignment of bisulfite-sequencing reads

  2024cites this paper
• Systematic and benchmarking studies of pipelines for mammal WGBS data in the novel NGS platform

  2023cites this paper
• DNA methylation landscape reveals LIN7A as a decitabine-responsive marker in patients with t(8;21) acute myeloid leukemia

  2023cites this paper
• Cell-free DNA methylome analysis for early preeclampsia prediction

  2023cites this paper
• A Cautionary Tale of Sexing by Methylation: Hybrid Bisulfite-Conversion Sequencing of Immunoprecipitated Methylated DNA in Chrysemys picta Turtles with Temperature-Dependent Sex Determination Reveals Contrasting Patterns of Somatic and Gonadal Methylation, but No Unobtrusive Sex Diagnostic

  2022cites this paper
• Analysis of Bisulfite Sequencing Data Using Bismark and DMRcaller to Identify Differentially Methylated Regions.

  2022cites this paper
• Benchmarking DNA methylation analysis of 14 alignment algorithms for whole genome bisulfite sequencing in mammals

  2022cites this paper
• Performance of methods to detect genetic variants from bisulphite sequencing data in a non‐model species

  2021cites this paper
• Comprehensive Evaluation of Differential Methylation Analysis Methods for Bisulfite Sequencing Data

  2021cites this paper
• Species-Specific Relationships between DNA and Chromatin Properties of CpG Islands in Embryonic Stem Cells and Differentiated Cells

  2021cites this paper
• Epigenetic biomarkers of disease

  2021cites this paper
• Performance of Mapping Approaches for Whole-Genome Bisulfite Sequencing Data in Crop Plants

  2020cites this paper
• DNA methylation-driven EMT is a common mechanism of resistance to various therapeutic agents in cancer

  2020cites this paper
• Comprehensive benchmarking of software for mapping whole genome bisulfite data: from read alignment to DNA methylation analysis

  2020cites this paper
• Guide Positioning Sequencing identifies aberrant DNA methylation patterns that alter cell identity and tumor-immune surveillance networks

  2019influential citation
• Cell-Free DNA Methylation Profiling Analysis—Technologies and Bioinformatics

  2019cites this paper
• Early postnatal overnutrition accelerates aging-associated epigenetic drift in pancreatic islets

  2019cites this paper
• DNA methylation data by sequencing: experimental approaches and recommendations for tools and pipelines for data analysis

  2019cites this paper
• BiSpark: a Spark-based highly scalable aligner for bisulfite sequencing data

  2018cites this paper
• Genome-wide sampling suggests island divergence accompanied by cryptic epigenetic plasticity in Canada lynx

  2018cites this paper
• A comprehensive evaluation of alignment software for reduced representation bisulfite sequencing data

  2018cites this paper
• Bioinformatic Analysis of Methylation Patterns Using Bisulfite Sequencing Data.

  2018cites this paper
• Murine Methyl Donor Deficiency Impairs Early Growth in Association with Dysmorphic Small Intestinal Crypts and Reduced Gut Microbial Community Diversity

  2018cites this paper
• Phenotypic and genomic characterization of the antimicrobial producer Rheinheimera sp. EpRS3 isolated from the medicinal plant Echinacea purpurea: insights into its biotechnological relevance.

  2017cites this paper
• A multi-dimensional characterization of anxiety in monozygotic twin pairs reveals susceptibility loci in humans

  2017cites this paper
• Comparative Assessment of Alignment Algorithms for NGS Data: Features, Considerations, Implementations, and Future

  2017cites this paper
• Error Correction in Methylation Profiling From NGS Bisulfite Protocols

  2017cites this paper
• Deep sequencing approaches for the analysis of prokaryotic transcriptional boundaries and dynamics.

  2017cites this paper
• Strategies for analyzing bisulfite sequencing data

  2017cites this paper
• Analysis of High-Throughput RNA Bisulfite Sequencing Data.

  2017cites this paper
• Targeted deletion of Nmnat1 in mouse retina leads to early severe retinal dystrophy

  2017cites this paper
• New Genome Sequence of an Echinacea purpurea Endophyte, Arthrobacter sp. Strain EpSL27, Able To Inhibit Human-Opportunistic Pathogens

  2017cites this paper
• Body-hypomethylated human genes harbor extensive intragenic transcriptional activity and are prone to cancer-associated dysregulation

  2017cites this paper
• meRanTK: methylated RNA analysis ToolKit

  2016cites this paper
• Modeling methyl-sensitive transcription factor motifs with an expanded epigenetic alphabet

  2016cites this paper
• Arthrobacter sp. EpRS66 and Arthrobacter sp. EpRS71: Draft Genome Sequences from Two Bacteria Isolated from Echinacea purpurea Rhizospheric Soil

  2016cites this paper
• CpG Methylation Differences Between Neurons and Glia are Highly Conserved from Mouse to Human

  2016influential citation
• Sequence analysis meRanTK : methylated RNA analysis ToolKit

  2016cites this paper
• Statistical Challenges in Analyzing Methylation and Long-Range Chromosomal Interaction Data

  2016cites this paper
• Analysis and Visualization Tool for Targeted Amplicon Bisulfite Sequencing on Ion Torrent Sequencers

  2016cites this paper
• Novel computational techniques for mapping and classifying Next-Generation Sequencing data. (Nouvelles techniques informatiques pour la localisation et la classification de données de séquençage haut débit)

  2016cites this paper
• Analysis and Visualization Tool for Targeted Amplicon Bisulfite Sequencing on Ion Torrent

  2016cites this paper
• Whole-genome bisulfite sequencing maps from multiple human tissues reveal novel CpG islands associated with tissue-specific regulation

  2015cites this paper
• Integrative analysis of 111 reference human epigenomes

  2015cites this paper
• MBRidge: an accurate and cost-effective method for profiling DNA methylome at single-base resolution.

  2015cites this paper
• An integrative approach for efficient analysis of whole genome bisulfite sequencing data

  2015cites this paper
• Postnatal epigenetic regulation of intestinal stem cells requires DNA methylation and is guided by the microbiome

  2015influential citation
• Independent genomewide screens identify the tumor suppressor VTRNA2-1 as a human epiallele responsive to periconceptional environment

  2015influential citation
• Promoter Hypermethylation of Tumour Suppressor Genes as Potential Biomarkers in Colorectal Cancer

  2015cites this paper
• Evaluation of preprocessing, mapping and postprocessing algorithms for analyzing whole genome bisulfite sequencing data

  2015cites this paper
• Two algorithmic problems in analyzing genetic and epigenetic variations

  2015influential citation
• Development of a scalable, precise, and high-coverage genomics mapping tool for NGS

  2015cites this paper
• Genome-Wide Epigenetic Studies in Human Disease: A Primer on -Omic Technologies.

  2015cites this paper
• Bioinformatics Principles for Deciphering Cardiovascular Diseases

  2014cites this paper
• The epigenomic tool kit

  2014cites this paper
• Determinants of Unique DNA Methylation, Histone Modification, and Nucleosome Occupany at CpG Islands

  2014influential citation
• DMAP: differential methylation analysis package for RRBS and WGBS data

  2014cites this paper
• TAMeBS: A sensitive bisulfite-sequencing read mapping tool for DNA methylation analysis

  2014cites this paper
• Bison: bisulfite alignment on nodes of a cluster

  2014cites this paper