FastUniq: A Fast De Novo Duplicates Removal Tool for Paired Short Reads

The presence of duplicates introduced by PCR amplification is a major issue in paired short reads from next-generation sequencing platforms. These duplicates might have a serious impact on research applications, such as scaffolding in whole-genome sequencing and discovering large-scale genome variations, and are usually removed. We present FastUniq as a fast de novo tool for removal of duplicates in paired short reads. FastUniq identifies duplicates by comparing sequences between read pairs and does not require complete genome sequences as prerequisites. FastUniq is capable of simultaneously handling reads with different lengths and results in highly efficient running time, which increases linearly at an average speed of 87 million reads per 10 minutes. FastUniq is freely available at http://sourceforge.net/projects/fastuniq/.

• Publication year

  2012

• Venue

  PLoS ONE

• Publication date

  2012-12-20

• Fields of study

  Biology, Medicine, Computer Science

• Identifiers
  DOI 10.1371/journal.pone.0052249PMID 23284954PMCID 3527383
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Efficient Mapping and Cloning of Mutations in Zebrafish by Low-Coverage Whole-Genome Sequencing

  2012cited by this paper
• Fulcrum: condensing redundant reads from high-throughput sequencing studies

  2012cited by this paper
• A dominant mutation in RPE65 identified by whole-exome sequencing causes retinitis pigmentosa with choroidal involvement

  2011cited by this paper
• Illumina mate-paired DNA sequencing-library preparation using Cre-Lox recombination

  2011cited by this paper
• Quality Control Procedures for Genome‐Wide Association Studies

  2011cited by this paper
• Using the Acropora digitifera genome to understand coral responses to environmental change

  2011influential reference
• SEAL: a distributed short read mapping and duplicate removal tool

  2011cited by this paper
• A powerful and flexible statistical framework for testing hypotheses of allele-specific gene expression from RNA-seq data.

  2011cited by this paper
• Performance comparison of exome DNA sequencing technologies

  2011cited by this paper
• Discovery and genotyping of genome structural polymorphism by sequencing on a population scale

  2011cited by this paper
• High-quality draft assemblies of mammalian genomes from massively parallel sequence data

  2010cited by this paper
• The sequence and de novo assembly of the giant panda genome

  2010cited by this paper
• The sequence and de novo assembly of the giant panda genome

  2010cited by this paper
• Discovery of common Asian copy number variants using integrated high-resolution array CGH and massively parallel DNA sequencing

  2010cited by this paper
• Function annotation of the rice transcriptome at single-nucleotide resolution by RNA-seq.

  2010cited by this paper
• Population Genomics of Parallel Adaptation in Threespine Stickleback using Sequenced RAD Tags

  2010cited by this paper
• De novo assembly of human genomes with massively parallel short read sequencing.

  2010cited by this paper
• Ultrafast and memory-efficient alignment of short DNA sequences to the human genome

  2009cited by this paper
• The Sequence Alignment/Map format and SAMtools

  2009cited by this paper
• Amplification-free Illumina sequencing-library preparation facilitates improved mapping and assembly of GC-biased genomes

  2009cited by this paper
• Searching for SNPs with cloud computing

  2009cited by this paper
• Mu Transposon Insertion Sites and Meiotic Recombination Events Co-Localize with Epigenetic Marks for Open Chromatin across the Maize Genome

  2009cited by this paper
• Comparative analysis of Alu repeats in primate genomes.

  2009cited by this paper
• Velvet: algorithms for de novo short read assembly using de Bruijn graphs.

  2008cited by this paper
• High-throughput oncogene mutation profiling in human cancer

  2007cited by this paper
• Paired-End Mapping Reveals Extensive Structural Variation in the Human Genome

  2007cited by this paper
• An initial map of insertion and deletion (INDEL) variation in the human genome.

  2006cited by this paper
• Theoretical and practical advances in genome halving

  2004cited by this paper
• Comparison of DNA sequences with protein sequences.

  1997influential reference
• BIOINFORMATICS APPLICATIONS

  year unknowncited by this paper

• Gut microbial ammonia enhances colonic acetylcholine levels to regulate intestinal motility.

  2026cites this paper
• Chromosome-level genome assembly of Siberian kale (Brassica napus subsp. pabularia).

  2026cites this paper
• Temperature changes reveal different transcriptional responses in the larvae of the bark beetle Dendroctonus rhizophagus during the cold season.

  2026cites this paper
• Biological big data analysis in the post-genomic era: applications and limitations

  2026cites this paper
• Inverse Restriction Site-Associated DNA Sequencing (iRAD-seq)

  2026cites this paper
• Employing exon capture to resolve species-level relationships in Australian Arid Zone camaenid land snails.

  2026cites this paper
• Anoxia-adapted cyanobacteria in a marine blue hole

  2026cites this paper
• On the presence of Xanthium ser. Glabrata in Italy and in the Mediterranean basin

  2026influential citation
• A multi-omics integrative gene network of pear (Pyrus).

  2026cites this paper
• Chromosome-scale genome of the burrowing sea anemone Paracondylactis sinensis.

  2026cites this paper
• Diversity loss of soil microbiome stimulates soil carbon emissions

  2025cites this paper
• Seasonal variability in community structure and metabolism of active deep-sea microorganisms

  2025cites this paper
• GenomeDPU: A Cost-Effective In-Memory Data Processing Unit for GPU-based Genome Analysis

  2025cites this paper
• The gut methanotroph Methylocystis intestini modulates intestinal peristalsis and fat metabolism via reducing methane levels

  2025cites this paper
• A chromosome-scale assembly of Ormosia boluoensis (Fabaceae)

  2025cites this paper
• Herbariomic approach solved identity crisis of the putatively extinct Armeria arcuata Welw. ex Boiss. & Reut. (Plumbaginaceae).

  2025cites this paper
• Genetic characteristics of anelloviruses detected in individual viromes of children with acute respiratory symptoms using the metagenomic approach

  2025cites this paper
• Dynamic changes of dental plaque and saliva microbiota in OSCC progression

  2025influential citation
• Are Ophiolitic Substrates Drivers for Reticulate Evolution in Armeria (Plumbaginaceae)?

  2025influential citation
• Prophylactic and therapeutic effects of Limosilactobacillus reuteri E on 5-fluorouracil-induced intestinal mucositis in Caco-2 cells.

  2025cites this paper
• Integrating genome‐wide traits and multi‐loci phylogeny to investigate orchid evolution—A case study on Pleurothallidinae

  2025cites this paper
• Integrated multi-omics reveals different host crosstalk of atopic dermatitis-enriched Bifidobacterium longum Strains

  2025cites this paper
• The baldcypress genome provides insights into the adaptive evolution of flooding stress tolerance

  2025influential citation
• Genomic and biological characterization of Streptomyces strains isolated from barley

  2025cites this paper
• Exploration of synthesis of anthocyanins in passion fruit pericarp through combinatorial transcriptomic analysis and WGCNA

  2025cites this paper
• Ancient alleles drive contemporary climate adaptation in an alpine plant.

  2025cites this paper
• Comprehensive multi omics explore the microbial function in metabolic pathway flow during altered diet

  2025cites this paper
• Historical introgression as a driver of diversification of diploid Picris (Compositae) in the Mediterranean Basin

  2025cites this paper
• Genomic surveillance uncovers regional variation in HCV transmission networks in rural United States

  2025cites this paper
• A multi-step filtering pipeline for human read removal enhances detection of Fusobacterium in WGS datasets with immunohistochemical confirmation in mucinous rectal cancer

  2025cites this paper
• Eukaryotic composition across seasons and social groups in the gut microbiota of wild baboons

  2025cites this paper
• Characterisation of Exiguobacterium abrahamii sp. nov., a novel strain isolated from mangrove soil with lanthipeptide biosynthetic genes

  2025cites this paper
• methylGrapher: genome-graph-based processing of DNA methylation data from whole genome bisulfite sequencing

  2025influential citation
• Faster soil organic carbon turnover in MAOM versus POM: straw input causes larger microbial driven soil organic carbon decomposition but higher straw accumulation in MAOM

  2025cites this paper
• The Succession of Cervical Canal Microbiota in Endometrial Cancer and Cervical Cancer: A Clinical Metagenomics Study

  2025influential citation
• Comprehensive Analysis of Vaginal and Gut Microbiome Alterations in Endometriosis Patients

  2025cites this paper
• How error correction affects polymerase chain reaction deduplication: A survey based on unique molecular identifier datasets of short reads

  2025influential citation
• Phosphorus release and microbial community alterations in submerged areas of Qinghai Lake

  2025cites this paper
• Microbial metabolisms determine soil priming effect induced by organic inputs

  2025cites this paper
• Genomes of critically endangered saola are shaped by population structure and purging

  2025cites this paper
• Pangenome analysis reveals yield- and fiber-related diversity and interspecific gene flow in Gossypium barbadense L.

  2025cites this paper
• Pervasive Intraspecific Genetic Local Adaptation Within the Natural Gut Microbiome

  2025cites this paper
• Deciphering the microbial mechanisms underlying glucose induced soil priming effects under low and high nutrient levels

  2025cites this paper
• Genomic surveillance uncovers regional variation in HCV transmission networks among people who use drugs in rural U.S. communities

  2025cites this paper
• Deciphering the microbial players driving straw decomposition and accumulation in soil components of particulate and mineral-associated organic matter

  2025cites this paper
• Transcriptional Difference of Deep-Sea Microorganisms under Different Sampling Methods.

  2025cites this paper
• Small proteins from prokaryotes in the marine water column at full ocean depth

  2025cites this paper
• Recent Long‐Distance‐Dispersal Explains the Range Disjunction of the Old‐Word Cockleburs (Xanthium strumarium)

  2025influential citation
• The six whole mitochondrial genomes for the Diaporthe species: features, evolution and phylogeny

  2025cites this paper
• Fecal microbiomes from healthy adult consumers of fruits and vegetables exhibit fiber- and donor-specific fermentation: “5 a day” is not enough

  2025cites this paper
• A frameshift-generated cancer neoepitope that controls tumor burden in prophylaxis as well as therapy

  2025cites this paper
• Gut microbiome genes involved in plant and mucin breakdown correlate with diet and gastrointestinal inflammation in healthy US adults.

  2025cites this paper
• Phylogeny of the species-rich pantropical genus Zanthoxylum (Rutaceae) based on hybrid capture.

  2025cites this paper
• Genomic potential for mercury biotransformation in marine sediments across marginal slope to hadal zone

  2025cites this paper
• Cyclization diversity of meroditerpenoids from endophytic fungi of medicinal plants driven by synthetic biology strategies

  2025cites this paper
• Opportunistic Pathogen and Virulence Factor Dynamics Along Stored Manure, Receiving Soil and Green Leaf Continua in Wet Zone of Sri Lanka

  2025cites this paper
• A novel method for effectively selecting fragments not associated with restriction sites for whole-genome genotyping

  2025cites this paper
• Dcr1 senses R-loops for RNAPII termination at sites of replication stress and repair pathway choice.

  2025cites this paper
• Long non-coding RNAs direct the SWI/SNF complex to cell type-specific enhancers

  2025cites this paper
• Bacterium-Phage Symbiosis Facilitates the Enrichment of Bacterial Pathogens and Antibiotic-Resistant Bacteria in the Plastisphere.

  2025cites this paper
• The global RNA-binding protein RbpB is a regulator of polysaccharide utilization in Bacteroides thetaiotaomicron

  2025cites this paper
• Fastq-dupaway: a fast and memory-efficient tool for deduplication of single- and paired-end NGS data

  2025influential citation
• Resveratrol and rutin alleviate DSS-induced ulcerative colitis by affecting the polarization of intestinal epithelial T cells

  2025cites this paper
• Enhanced analysis of the genomic diversity of Mycobacterium bovis in Great Britain to aid control of bovine tuberculosis

  2025influential citation
• Uncovering microbial drivers and regulatory edaphic factors for DNRA-nitrogen recovery under diverse rice agro-ecosystems

  2025cites this paper
• Phylogenomic, morphological and acoustic data support a revised taxonomy of the lissodelphinine dolphin subfamily.

  2025cites this paper
• Phylogenomic and morphological evidence supports the reinstatement of the bamboo genus Clavinodum from Oligostachyum (Poaceae: Bambusoideae).

  2025cites this paper
• Heat stress induces unreduced male gamete formation by targeting meiocyte translation

  2025cites this paper
• Dissemination mechanisms of unique antibiotic resistance genes from flowback water to soil revealed by combined Illumina and Nanopore sequencing.

  2024cites this paper
• Daily sampling reveals household-specific water microbiome signatures and shared antimicrobial resistomes in premise plumbing

  2024cites this paper
• Inflammation switches the chemoattractant requirements for naive lymphocyte entry into lymph nodes

  2024cites this paper
• Community Structure and Biodiversity of Active Microbes in the Deep South China Sea

  2024influential citation
• Distinct Escherichia coli transcriptional profiles in the guts of recurrent UTI sufferers revealed by pangenome hybrid selection

  2024cites this paper
• Genomic characterization and comparative genomics of Chlorella sp. CH2018 from Musi River water, India

  2024cites this paper
• The evolutionary dynamics of genome sizes and repetitive elements in Ensifera (Insecta: Orthoptera)

  2024cites this paper
• Complete genome sequence of Kozakia baliensis LTH 7215, a newly isolated strain from grape must

  2024cites this paper
• A comprehensive molecular phylogeny of the genus Sylvirana (Anura: Ranidae) highlights unrecognized diversity, revised classification and historical biogeography.

  2024cites this paper
• Structural variation in the pangenome of wild and domesticated barley

  2024cites this paper
• Rapid Evolution of Host Repertoire and Geographic Range in a Young and Diverse Genus of Montane Butterflies

  2024cites this paper
• Eukaryotic composition across seasons and social groups in the gut microbiota of wild baboons

  2024cites this paper
• Shift of microbial taxa and metabolisms relying on carbon sources of rhizodeposits and straw of Zea mays L

  2024cites this paper
• Hybrid capture resolves the phylogeny of Tetradium (Rutaceae) and supports the inclusion of a species from Sulawesi

  2024cites this paper
• Comparative plastome assembly of the yellow ironweed (Verbesina alternifolia) using Nanopore and Illumina reads

  2024cites this paper
• Species delimitation in Xanthium sect. Acanthoxanthium (Heliantheae, Asteraceae) and the neglected species Xanthium argenteum

  2024cites this paper
• Metagenomic 18S rDNA reads revealed zonation of eukaryotic communities in the Yongle blue hole

  2024cites this paper
• Genomic Signatures and Demographic History of the Widespread and Critically Endangered Yellow‐Breasted Bunting

  2024influential citation
• k‐mer genome‐wide association study for anthracnose and BCMV resistance in a Phaseolus vulgaris Andean Diversity Panel

  2024cites this paper
• Evolution across the adaptive landscape in a hyperdiverse beetle radiation.

  2024cites this paper
• Characterization of the CsCENH3 protein and centromeric DNA profiles reveal the structures of centromeres in cucumber

  2024cites this paper
• Macroalgal virosphere assists with host–microbiome equilibrium regulation and affects prokaryotes in surrounding marine environments

  2024cites this paper
• How Error Correction Affects PCR Deduplication: A Survey Based on UMI Datasets of Short Reads

  2024influential citation
• Pan-omics-based characterization and prediction of highly multidrug-adapted strains from an outbreak fungal species complex

  2024cites this paper
• Recovery of 240 metagenome-assembled genomes from coastal mariculture environments in South Korea

  2024cites this paper
• Metabolic labeling based methylome profiling enables functional dissection of histidine methylation in C3H1 zinc fingers

  2024cites this paper
• A CTCF-binding site in the Mdm1-Il22-Ifng locus shapes cytokine expression profiles and plays a critical role in early Th1 cell fate specification.

  2024cites this paper
• Hepatocyte nuclear factor 4 located in different developmental stages of Schistosoma japonicum and involved in important metabolic pathways

  2024cites this paper
• Annotation of nuclear lncRNAs based on chromatin interactions

  2024cites this paper
• DGCNN approach links metagenome-derived taxon and functional information providing insight into global soil organic carbon

  2024cites this paper
• The complete mitochondrial genomes of five critical phytopathogenic Bipolaris species: features, evolution, and phylogeny

  2024cites this paper
• Fructo-oligosaccharides supplementation enhances the growth of nursing dairy calves while stimulating the persistence of Bifidobacterium and hindgut microbiome's maturation.

  2024influential citation