A semi-automated workflow for biodiversity data retrieval, cleaning, and quality control

Abstract The compilation and cleaning of data needed for analyses and prediction of species distributions is a time consuming process requiring a solid understanding of data formats and service APIs provided by biodiversity informatics infrastructures. We designed and implemented a Taverna-based Data Refinement Workflow which integrates taxonomic data retrieval, data cleaning, and data selection into a consistent, standards-based, and effective system hiding the complexity of underlying service infrastructures. The workflow can be freely used both locally and through a web-portal which does not require additional software installations by users.

• Publication year

  2014

• Venue

  Biodiversity Data Journal

• Publication date

  2014-11-12

• Fields of study

  Biology, Medicine, Computer Science, Environmental Science

• Identifiers
  DOI 10.3897/BDJ.2.e4221PMID 25535486PMCID 4267104
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• The Taverna workflow suite: designing and executing workflows of Web Services on the desktop, web or in the cloud

  2013cited by this paper
• Kurator: A Kepler Package for Data Curation Workflows

  2012cited by this paper
• Tools for Identifying Biodiversity: Progress and Problems

  2012cited by this paper
• Biodiversity information platforms: From standards to interoperability

  2011cited by this paper
• Devising the EDIT Platform for Cybertaxonomy

  2010cited by this paper
• EFFECTIVELY SEARCHING SPECIMEN AND OBSERVATION DATA WITH TOQE, THE THESAURUS OPTIMIZED QUERY EXPANDER

  2009cited by this paper

• Pytaxon: A Python software for resolving and correcting taxonomic names in biodiversity data

  2025cites this paper
• Making the most of existing data in conservation research

  2023cites this paper
• Relationships between Selected Quality Tools and Energy Efficiency in Production Processes

  2023cites this paper
• Ontology-Based decision tree model for prediction of fatty liver diseases

  2022cites this paper
• DASCO: A workflow to downscale alien species checklists using occurrence records and to re-allocate species distributions across realms

  2022cites this paper
• Outlier detection methods to improve the quality of citizen science data

  2020cites this paper
• Ontology Based System for Prediction of Diseases

  2020cites this paper
• Landscape Analysis for the Specimen Data Refinery

  2020cites this paper
• A workflow for standardising and integrating alien species distribution data

  2020cites this paper
• FAIR Computational Workflows

  2020cites this paper
• The Bari Manifesto: An interoperability framework for essential biodiversity variables

  2019cites this paper
• Research infrastructure challenges in preparing essential biodiversity variables data products for alien invasive species

  2019cites this paper
• Research applications of primary biodiversity databases in the digital age

  2019cites this paper
• Unidirectional Introgression and Evidence of Hybrid Superiority over Parental Populations in Eastern Iranian Plateau Population of Hares (Mammalia: Lepus Linnaeus, 1758)

  2019cites this paper
• Improved standardization of transcribed digital specimen data

  2019cites this paper
• Biodiversity informatics - entomological data processing, analysis and visualization

  2019cites this paper
• Toward a service-based workflow for automated information extraction from herbarium specimens

  2018cites this paper
• Utility and limitations of climate‐matching approaches in detecting different types of spatial errors in biodiversity data

  2018cites this paper
• Standard methods for the assessment of structural and functional diversity of soil organisms: A review

  2018cites this paper
• Marine long-term biodiversity assessment suggests loss of rare species in the Skagerrak and Kattegat region

  2018influential citation
• Interoperable framework for improving data quality using semantic approach: use case on biodiversity

  2018cites this paper
• Present and Potential Future Distributions of Asian Horseshoe Crabs Determine Areas for Conservation

  2018cites this paper
• Building essential biodiversity variables (EBVs) of species distribution and abundance at a global scale

  2018cites this paper
• AnnoSys—implementation of a generic annotation system for schema-based data using the example of biodiversity collection data

  2017cites this paper
• EDIT Platform Web Services in the Biodiversity Infrastructure Landscape

  2017cites this paper
• Similarity Score Estimation and Gaps Trimming of Multiple Sequence Alignment for Phylogenetic Tree Analysis

  2017cites this paper
• Taxonomic perils and pitfalls of dataset assembly in ecology: a case study of the naturalized Asteraceae in Australia

  2017cites this paper
• Marine long-term biodiversity assessment suggests loss of rare species in the Skagerrak and Kattegat region

  2017influential citation
• Scientific Workflows

  2016cites this paper
• BioVeL: a virtual laboratory for data analysis and modelling in biodiversity science and ecology

  2016cites this paper
• Integrated Automatic Workflow for Phylogenetic Tree Analysis Using Public Access and Local Web Services

  2016cites this paper
• Integrated Automatic Workflow for Phylogenetic Tree Analysis Using Public Access and Local Web Services

  2016cites this paper
• Quantifying the value of user-level data cleaning for big data: A case study using mammal distribution models

  2016cites this paper
• UvA-DARE ( Digital Academic Repository ) BioVeL : a virtual laboratory for data analysis and modelling in biodiversity science and ecology

  2016influential citation
• Evaluating the potential of ecological niche modelling as a component in marine non-indigenous species risk assessments.

  2015cites this paper
• B-HIT - A Tool for Harvesting and Indexing Biodiversity Data

  2015cites this paper
• Biomathematical exploration of the MARK-AGE database

  2015cites this paper
• A global perspective on decadal challenges and priorities in biodiversity informatics

  2015cites this paper
• PESI - a taxonomic backbone for Europe

  2015cites this paper
• Towards global interoperability for supporting biodiversity research on essential biodiversity variables (EBVs)

  2015cites this paper
• Shaping an ecosystem for species distribution modeling

  2015cites this paper
• An integrative and dynamic approach for monographing species-rich plant groups - Building the global synthesis of the angiosperm order Caryophyllales

  2015influential citation
• Trends in IT Innovation to Build a Next Generation Bioinformatics Solution to Manage and Analyse Biological Big Data Produced by NGS Technologies

  2015cites this paper