A comprehensive evaluation of assembly scaffolding tools

Genome assembly is typically a two-stage process: contig assembly followed by the use of paired sequencing reads to join contigs into scaffolds. Scaffolds are usually the focus of reported assembly statistics; longer scaffolds greatly facilitate the use of genome sequences in downstream analyses, and it is appealing to present larger numbers as metrics of assembly performance. However, scaffolds are highly prone to errors, especially when generated using short reads, which can directly result in inflated assembly statistics. Here we provide the first independent evaluation of scaffolding tools for second-generation sequencing data. We find large variations in the quality of results depending on the tool and dataset used. Even extremely simple test cases of perfect input, constructed to elucidate the behaviour of each algorithm, produced some surprising results. We further dissect the performance of the scaffolders using real and simulated sequencing data derived from the genomes of Staphylococcus aureus, Rhodobacter sphaeroides, Plasmodium falciparum and Homo sapiens. The results from simulated data are of high quality, with several of the tools producing perfect output. However, at least 10% of joins remains unidentified when using real data. The scaffolders vary in their usability, speed and number of correct and missed joins made between contigs. Results from real data highlight opportunities for further improvements of the tools. Overall, SGA, SOPRA and SSPACE generally outperform the other tools on our datasets. However, the quality of the results is highly dependent on the read mapper and genome complexity.

• Publication year

  2014

• Venue

  Genome Biology

• Publication date

  2014-03-01

• Fields of study

  Biology, Medicine, Computer Science

• Identifiers
  DOI 10.1186/gb-2014-15-3-r42PMID 24581555PMCID 4053845
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• SCARPA: scaffolding reads with practical algorithms

  2013cited by this paper
• Assemblathon 2: evaluating de novo methods of genome assembly in three vertebrate species

  2013cited by this paper
• which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. REAPR: a universal tool for genome assembly evaluation

  2013cited by this paper
• BAIT: Organizing genomes and mapping rearrangements in single cells

  2013cited by this paper
• Chromosome-scale scaffolding of de novo genome assemblies based on chromatin interactions

  2013cited by this paper
• GAGE: A critical evaluation of genome assemblies and assembly algorithms.

  2012cited by this paper
• Tools for mapping high-throughput sequencing data

  2012cited by this paper
• Toward almost closed genomes with GapFiller

  2012cited by this paper
• SOAPdenovo2: an empirically improved memory-efficient short-read de novo assembler

  2012cited by this paper
• Sequencing and automated whole-genome optical mapping of the genome of a domestic goat (Capra hircus)

  2012cited by this paper
• Efficient de novo assembly of large genomes using compressed data structures.

  2012cited by this paper
• Fast gapped-read alignment with Bowtie 2

  2012cited by this paper
• GRASS: a generic algorithm for scaffolding next-generation sequencing assemblies

  2012cited by this paper
• Assemblathon 1: a competitive assessment of de novo short read assembly methods.

  2011cited by this paper
• Bambus 2: scaffolding metagenomes

  2011cited by this paper
• The Genomes OnLine Database (GOLD) v.4: status of genomic and metagenomic projects and their associated metadata

  2011cited by this paper
• Opera: Reconstructing Optimal Genomic Scaffolds with High-Throughput Paired-End Sequences

  2011cited by this paper
• Improving draft assemblies by iterative mapping and assembly of short reads to eliminate gaps

  2010cited by this paper
• SOPRA: Scaffolding algorithm for paired reads via statistical optimization

  2010cited by this paper
• Iterative Correction of Reference Nucleotides (iCORN) using second generation sequencing technology

  2010cited by this paper
• Ultrafast and memory-efficient alignment of short DNA sequences to the human genome

  2009cited by this paper
• The Sequence Alignment/Map format and SAMtools

  2009cited by this paper
• ABySS: a parallel assembler for short read sequence data.

  2009cited by this paper
• The Genomes On Line Database (GOLD) in 2007: status of genomic and metagenomic projects and their associated metadata

  2008cited by this paper
• Velvet: algorithms for de novo short read assembly using de Bruijn graphs.

  2008influential reference
• Versatile and open software for comparing large genomes

  2004cited by this paper
• Hierarchical scaffolding with Bambus.

  2003cited by this paper
• Genome sequence of the human malaria parasite Plasmodium falciparum

  2002cited by this paper
• The greedy path-merging algorithm for contig scaffolding

  2002cited by this paper
• BIOINFORMATICS ORIGINAL PAPER

  year unknowncited by this paper

• A Novel Mycoprotein Candidate: Neurospora intermedia FF171 from Pu-Erh Tea with Genomics-Based Safety Profiling

  2026influential citation
• Additive Effects of Natural Plant Extracts/Essential Oils and Probiotics as an Antipathogenic Topical Skin Patch Solution for Acne and Eczema.

  2025cites this paper
• Ancient alleles drive contemporary climate adaptation in an alpine plant.

  2025cites this paper
• Metagenomic Profiling Reveals Microbial Diversity and MicroTrait Bioelement Signatures in Ethiopian Soda Lakes

  2025cites this paper
• A Novel Lytic Salmonella Phage Harboring an Unprecedented Tail-Protein Domain Combination Capable of Lysing Cross-Host-Transmitted Salmonella Strains

  2025cites this paper
• Enhancement of astaxanthin production in novel red yeast Rhodosporidiobolus sp. SP3-3/4 and genomic characterization

  2025cites this paper
• In Vitro Profiling of Potential Fish Probiotics, Enterococcus hirae Strains, Isolated from Jade Perch, and Safety Properties Assessed Using Whole Genome Sequencing

  2024cites this paper
• Unveiling Acetobacter syzygii from Tibetan Kefir Grain: Fermentation-Enhanced Anti-Tyrosinase, and Anti-Melanin

  2024cites this paper
• Genomic and biological insights of bacteriophages JNUWH1 and JNUWD in the arms race against bacterial resistance

  2024cites this paper
• Isolation and identification of specific Enterococcus faecalis phage C-3 and G21-7 against Avian pathogenic Escherichia coli and its application to one-day-old geese

  2024cites this paper
• Characterization and genomic analysis of a broad-spectrum lytic phage PG288: A potential natural therapy candidate for Vibrio infections

  2024influential citation
• Diversity, astaxanthin production, and genomic analysis of Rhodotorula paludigena SP9-15

  2023cites this paper
• Novel Plastid Genome Characteristics in Fugacium kawagutii and the Trend of Accelerated Evolution of Plastid Proteins in Dinoflagellates

  2023cites this paper
• Thermobacterium salinum gen. nov., sp. nov., a novel member of the family Flavobacteriaceae isolated from a hydrothermal zone.

  2023cites this paper
• A large-scale phylogeny-guided analysis of pseudogenes in Pseudomonas aeruginosa bacterium

  2023influential citation
• Paracoccus albicereus sp. nov., isolated from the shallow-sea hydrothermal system off Kueishantao Island.

  2023cites this paper
• Characterization of a novel and active temperate phage vB_AbaM_ABMM1 with antibacterial activity against Acinetobacter baumannii infection

  2023cites this paper
• An Optimized Scaffolding Algorithm for Unbalanced Sequencing

  2023cites this paper
• Genomic Insight and Optimization of Astaxanthin Production from a New Rhodotorula sp. CP72-2

  2023cites this paper
• Prevalence, antibiotic resistance and virulence feature of Listeria monocytogenes isolated from bovine milk in Yunnan, Southwest China

  2023cites this paper
• Draft Whole-Genome Sequence of the Black Yeast Aureobasidium pullulans NRRL 62031

  2023cites this paper
• Chicken Production and Human Clinical Escherichia coli Isolates Differ in Their Carriage of Antimicrobial Resistance and Virulence Factors

  2023cites this paper
• Paraphocaeicola brunensis gen. nov., sp. nov., Carrying Two Variants of nimB Resistance Gene from Bacteroides fragilis, and Caecibacteroides pullorum gen. nov., sp. nov., Two Novel Genera Isolated from Chicken Caeca

  2022cites this paper
• Complete genome sequencing and in silico genome mining reveal the promising metabolic potential in Streptomyces strain CS-7

  2022cites this paper
• Metagenomic assembled genomes unravel purple non‑sulfur bacteria (PNSB) involved in integrating C, N, P biotransformation.

  2022cites this paper
• Draft genome sequence of myo-inositol utilizing Aeromonas dhakensis 1P11S3 isolated from striped catfish (Pangasianodon hypopthalmus) in a local fish farm in Malaysia

  2022cites this paper
• FINISHING THE JOB - UTILITY OF LONG-READ SEQUENCING USING THE MINION FOR BACTERIAL GENOMICS

  2021cites this paper
• Rhizosphere Dynamics: An OMICS Perspective

  2021cites this paper
• On a greedy approach for genome scaffolding

  2021cites this paper
• Producing Genomic Sequences after Genome Scaffolding with Ambiguous Paths: Complexity, Approximation and Lower Bounds

  2021cites this paper
• Biological computation and computational biology: survey, challenges, and discussion

  2021cites this paper
• Figbird: A probabilistic method for filling gaps in genome assemblies

  2021cites this paper
• Genome sequence and annotation of Bacteroides sp aff. Thetaiotaomicron strain isolated from blood.

  2021cites this paper
• The Carbon Footprint of Bioinformatics

  2021cites this paper
• A comprehensive review of scaffolding methods in genome assembly

  2021cites this paper
• Assembling the Rye Genome

  2021cites this paper
• Reads2Resistome: An adaptable and high-throughput whole-genome sequencing pipeline for bacterial resistome characterization

  2020cites this paper
• Paracoccus aurantiacus sp. nov., isolated from shallow-sea hydrothermal systems off Kueishantao Island.

  2020cites this paper
• for the rapid

  2020cites this paper
• Test and Benchmarking of A New Scaffolding Methodology

  2020cites this paper
• SynVisio: A Multiscale Tool to Explore Genomic Conservation

  2020cites this paper
• Raw transcriptomics data to gene specific SSRs: a validated free bioinformatics workflow for biologists

  2020cites this paper
• Cobetia sp. Bacteria, Which Are Capable of Utilizing Alginate or Waste Laminaria sp. for Poly(3-Hydroxybutyrate) Synthesis, Isolated From a Marine Environment

  2020cites this paper
• Transposon activation is a major driver in the genome evolution of cultivated olive trees (Olea europaea L.)

  2020cites this paper
• OMGS: Optical Map-Based Genome Scaffolding

  2019cites this paper
• A Novel Scaffolding Algorithm Based on Contig Error Correction and Path Extension

  2019cites this paper
• Whole-Genome Shotgun Sequencing and Characterization of Probiotic Strain Clostridium butyricum UBCB 70 To Assess Its Safety

  2019cites this paper
• Genome Sequencing and Annotation of Bacillus subtilis UBBS-14 to Ensure Probiotic Safety

  2019cites this paper
• Mitotic Recombination and Rapid Genome Evolution in the Invasive Forest Pathogen Phytophthora ramorum

  2019cites this paper
• Systematic benchmarking of omics computational tools

  2019cites this paper
• Tools and Strategies for Long-Read Sequencing and De Novo Assembly of Plant Genomes.

  2019cites this paper
• Challenges and recommendations to improve the installability and archival stability of omics computational tools

  2019cites this paper
• SLR: a scaffolding algorithm based on long reads and contig classification

  2019cites this paper
• Orienting Ordered Scaffolds: Complexity and Algorithms

  2019cites this paper
• Parameterized Algorithms in Bioinformatics: An Overview

  2019cites this paper
• High-quality draft genome and characterization of commercially potent probiotic Lactobacillus strains

  2019cites this paper
• Towards Multi-approaches Bioinformatics Pipeline Based on Big Data and Cloud Computing for Next Generation Sequencing Data Analysis

  2019cites this paper
• UNIVERSITY OF CALIFORNIA RIVERSIDE Optical Map-Based Genome Scaffolding A Dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy

  2019cites this paper
• Multi-CSAR: a multiple reference-based contig scaffolder using algebraic rearrangements

  2018cites this paper
• A 2-approximation algorithm for the contig-based genomic scaffold filling problem

  2018cites this paper
• Use of a draft genome of coffee (Coffea arabica) to identify SNPs associated with caffeine content

  2018cites this paper
• Assembly, quantification, and downstream analysis for high trhoughput sequencing data

  2018influential citation
• Solving scaffolding problem with repeats

  2018influential citation
• Using genomic data to understand anthropogenic influences on Oomycete and Phytophthora communities, and the evolution of an alien invasive species responsible for sudden oak death, Phytophthora ramorum

  2018influential citation
• Clonorchis sinensis and Clonorchiasis: The Relevance of Exploring Genetic Variation.

  2018cites this paper
• Genomic repeats, misassembly and reannotation: a case study with long-read resequencing of Porphyromonas gingivalis reference strains

  2018cites this paper
• SMRT long-read sequencing and Direct Label and Stain optical maps allow the generation of a high-quality genome assembly for the European barn swallow (Hirundo rustica rustica)

  2018cites this paper
• IMPROVING GENOME ANNOTATION WITH RNA-SEQ DATA

  2018cites this paper
• Scaffolding Problems Revisited: Complexity, Approximation and Fixed Parameter Tractable Algorithms, and Some Special Cases

  2018cites this paper
• SECAPR—a bioinformatics pipeline for the rapid and user-friendly processing of targeted enriched Illumina sequences, from raw reads to alignments

  2018cites this paper
• A comprehensive analysis of the usability and archival stability of omics computational tools and resources

  2018cites this paper
• Whole genome sequencing and function prediction of 133 gut anaerobes isolated from chicken caecum in pure cultures

  2018cites this paper
• The chromosome-level genome assemblies of two rattans (Calamus simplicifolius and Daemonorops jenkinsiana)

  2018cites this paper
• GRASShopPER—An algorithm for de novo assembly based on GPU alignments

  2018cites this paper
• Plant Pathogenic Fungi and Oomycetes

  2018cites this paper
• From Short Reads to Chromosome-Scale Genome Assemblies.

  2018cites this paper
• SCOP: a novel scaffolding algorithm based on contig classification and optimization

  2018cites this paper
• Genome-scale analysis of Acetobacterium bakii reveals the cold adaptation of psychrotolerant acetogens by post-transcriptional regulation

  2018influential citation
• Functional and taxonomic classification of a greenhouse water drain metagenome

  2018cites this paper
• Evaluation of genome scaffolding tools using pooled clone sequencing

  2018cites this paper
• SMRT long reads and Direct Label and Stain optical maps allow the generation of a high-quality genome assembly for the European barn swallow (Hirundo rustica rustica)

  2018cites this paper
• Microsatellite development from genome skimming and transcriptome sequencing: comparison of strategies and lessons from frog species

  2018cites this paper
• New Results About the Linearization of Scaffolds Sharing Repeated Contigs

  2018cites this paper
• LRScaf: improving draft genomes using long noisy reads

  2018cites this paper
• ARCS: scaffolding genome drafts with linked reads

  2017cites this paper
• Draft Genome Sequences of Two Unclassified Bacteria, Sphingomonas sp. Strains IBVSS1 and IBVSS2, Isolated from Environmental Samples

  2017cites this paper
• Rapid de novo assembly of the European eel genome from nanopore sequencing reads

  2017cites this paper
• Draft Genome Sequences of Two Unclassified Chitinophagaceae Bacteria, IBVUCB1 and IBVUCB2, Isolated from Environmental Samples

  2017cites this paper
• Approximation algorithms for the scaffolding problem and its generalizations

  2017cites this paper
• Resequencing of the Leishmania infantum (strain JPCM5) genome and de novo assembly into 36 contigs

  2017cites this paper
• Assembly and Data Quality

  2017cites this paper
• BOSS: a novel scaffolding algorithm based on an optimized scaffold graph

  2017cites this paper
• Overlap Detection for a Genome Assembly Based on Genomic Signal Processing

  2017cites this paper
• From data to knowledge: The future of multi-omics data analysis for the rhizosphere

  2017cites this paper
• Pathogen genomics of methicillin resistant staphylococcus aureus and leishmania

  2017cites this paper
• Improving the detection of genomic rearrangements in short read sequencing data

  2017cites this paper
• Next‐Generation Sequencing Technologies and the Assembly of Short Reads into Reference Genome Sequences

  2017cites this paper
• Draft Genome Sequences of Two Unclassified Bacteria, Hydrogenophaga sp. Strains IBVHS1 and IBVHS2, Isolated from Environmental Samples

  2017cites this paper
• Towards a whole‐genome sequence for rye (Secale cereale L.)

  2017cites this paper
• Focus: A Graph Approach for Data-Mining and Domain-Specific Assembly of Next Generation Sequencing Data

  2017cites this paper