Outlier Detection and Processing Technology and Its Application

Faced with the development of information technology and the arrival of the era of big data, data has become the advanced productive forces and strategic resources. However, the existence of outliers often has a negative impact on the storageand analysis of the data, andeven causes disastrous consequences. This paper starts with the definition, concept and classification of outliers, and then compares and analyzes various methods of outlier detection and cleaning technology based on attribute anomaly and the duplicate or similarrecords.Finally, the research and application of outliers are prospected.

• Publication year

  2016

• Venue

  Unknown venue

• Publication date

  2016-12-29

• Fields of study

  Computer Science

• Identifiers
  DOI 10.2991/ICMCM-16.2016.5
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Outlier detection in high-dimensional regression model

  2017cited by this paper
• Research on Eliminating Duplicate Records Based on SNM Improved Algorithm

  2016cited by this paper
• Application of an integrated multi-criteria decision making AHP-TOPSIS methodology for ETL software selection

  2016cited by this paper
• ActiveClean: Interactive Data Cleaning While Learning Convex Loss Models

  2016cited by this paper
• A High-Density Seismic Network for Earthquake Early Warning in Taiwan Based on Low Cost Sensors

  2013cited by this paper
• Outlier detection from ETL execution trace

  2011cited by this paper
• Evaluation of Root-n Bandwidth Selectors for Kernel Density Estimation

  2010cited by this paper
• A fuzzy vector valued KNN-algorithm for automatic outlier detection

  2009cited by this paper
• SOM-based unifying framework for mining outliers

  2007cited by this paper
• Anomaly Based Network Intrusion Detection with Unsupervised Outlier Detection

  2006cited by this paper
• Using Ontologies for XML Data Cleaning

  2005cited by this paper
• Novelty detection: a review - part 2: : neural network based approaches

  2003cited by this paper
• Coordination middleware for XML-centric applications

  2002cited by this paper
• Data Cleaning: Problems and Current Approaches.

  2000cited by this paper
• Joint Estimation of Model Parameters and Outlier Effects in Time Series

  1993cited by this paper

• A Multi-Model Automated Framework for Scalable and Robust Outlier Detection in Data Warehousing

  2025cites this paper