Extending the Generalised Pareto Distribution for Novelty Detection in High-Dimensional Spaces

Novelty detection involves the construction of a “model of normality”, and then classifies test data as being either “normal” or “abnormal” with respect to that model. For this reason, it is often termed one-class classification. The approach is suitable for cases in which examples of “normal” behaviour are commonly available, but in which cases of “abnormal” data are comparatively rare. When performing novelty detection, we are typically most interested in the tails of the normal model, because it is in these tails that a decision boundary between “normal” and “abnormal” areas of data space usually lies. Extreme value statistics provides an appropriate theoretical framework for modelling the tails of univariate (or low-dimensional) distributions, using the generalised Pareto distribution (GPD), which can be demonstrated to be the limiting distribution for data occurring within the tails of most practically-encountered probability distributions. This paper provides an extension of the GPD, allowing the modelling of probability distributions of arbitrarily high dimension, such as occurs when using complex, multimodel, multivariate distributions for performing novelty detection in most real-life cases. We demonstrate our extension to the GPD using examples from patient physiological monitoring, in which we have acquired data from hospital patients in large clinical studies of high-acuity wards, and in which we wish to determine “abnormal” patient data, such that early warning of patient physiological deterioration may be provided.

• Publication year

  2013

• Venue

  Journal of Signal Processing Systems

• Publication date

  2013-08-16

• Fields of study

  Mathematics, Computer Science, Medicine

• Identifiers
  DOI 10.1007/s11265-013-0835-2PMID 24683434PMCID 3963457
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Markov Models

  2017cited by this paper
• Pattern Recognition And Machine Learning

  2016cited by this paper
• Extending the Generalised Pareto Distribution for Novelty Detection in High-Dimensional Spaces

  2013cited by this paper
• Extreme value distributions

  2013cited by this paper
• Engine Parameter Outlier Detection: Verification by Simulating PID Controllers Generated by Genetic Algorithm

  2012cited by this paper
• Constructing minimum volume surfaces using level set methods for novelty detection

  2012cited by this paper
• Introduction to Statistical Limit Theory

  2011cited by this paper
• Novelty Detection with Multivariate Extreme Value Statistics

  2011influential reference
• Probabilistic Patient Monitoring with Multivariate, Multimodal Extreme Value Theory

  2010cited by this paper
• Parameter estimation of the generalized Pareto distribution—Part II

  2010cited by this paper
• Visualizing uncertainty in reliability functions with application to aero engine overhaul

  2010cited by this paper
• Probabilistic approach to the condition monitoring of aerospace engines

  2009cited by this paper
• Bayesian Extreme Value Statistics for Novelty Detection in Gas-Turbine Engines

  2008cited by this paper
• Defining the incidence of cardiorespiratory instability in patients in step-down units using an electronic integrated monitoring system.

  2008cited by this paper
• Nonparametric Analysis of Univariate Heavy-Tailed Data: Research and Practice

  2007cited by this paper
• Extreme value theory : an introduction

  2006cited by this paper
• Pattern Recognition and Machine Learning

  2006cited by this paper
• BIOSIGN™ : multi-parameter monitoring for early warning of patient deterioration

  2005cited by this paper
• The Variational Bayes Method in Signal Processing (Signals and Communication Technology)

  2005cited by this paper
• Extreme value and related models with applications in engineering and science

  2005influential reference
• Bayesian analysis of extreme events with threshold estimation

  2004cited by this paper
• Extreme Value and Related Models with Applications in Engineering and Science

  2004influential reference
• Markov Models for Automated ECG Interval Analysis

  2003cited by this paper
• Modelling Extremal Events for Insurance and Finance

  2002influential reference
• An Introduction to Statistical Modeling of Extreme Values

  2001cited by this paper
• Data domain description using support vectors

  1999cited by this paper
• Novelty detection using extreme value statistics

  1999cited by this paper
• Support Vector Method for Novelty Detection

  1999cited by this paper
• Support vector domain description

  1999cited by this paper
• Modelling Extremal Events

  1997cited by this paper
• Bayesian methods in extreme value modelling: a review and new developments.

  1996cited by this paper
• Modelling of extremal events in insurance and finance

  1994cited by this paper
• Extreme Values, Regular Variation, and Point Processes

  1987cited by this paper
• Statistical Inference Using Extreme Order Statistics

  1975influential reference
• Limiting forms of the frequency distribution of the largest or smallest member of a sample

  1928cited by this paper

• Detecting Perceived Unfair Treatment Among US College Students Using Mobile Sensing: Pilot Machine Learning Study

  2025cites this paper
• Botnet detection in internet of things using stacked ensemble learning model

  2025cites this paper
• A Multi-Scale Self-Supervision Approach for Bearing Anomaly Detection Using Sensor Data Under Multiple Operating Conditions

  2025cites this paper
• Implementing Anomaly-Based Intrusion Detection for Resource-Constrained Devices in IoMT Networks

  2025cites this paper
• Anomaly Detection in High-Dimensional Time Series Data with Scaled Bregman Divergence

  2025cites this paper
• Outlier analysis for accelerating clinical discovery: An augmented intelligence framework and a systematic review

  2024cites this paper
• Universal digital high-resolution melting for the detection of pulmonary mold infections

  2024cites this paper
• Bayesian design for sampling anomalous spatio-temporal data

  2024cites this paper
• On the Search for Potentially Anomalous Traces of Cosmic Ray Particles in Images Acquired by Cmos Detectors for a Continuous Stream of Emerging Observational Data

  2024cites this paper
• General value functions for fault detection in multivariate time series data

  2024cites this paper
• Data-Driven Structural Health Monitoring: Leveraging Amplitude-Aware Permutation Entropy of Time Series Model Residuals for Nonlinear Damage Diagnosis

  2024cites this paper
• Anomaly Detection Methods in Autonomous Robotic Missions

  2024cites this paper
• Applying aperture-based intensity map in automated plan review of volumetric modulated arc therapy for lung cancer patients

  2024cites this paper
• Catalyzing EEG signal analysis: unveiling the potential of machine learning-enabled smart K nearest neighbor outlier detection

  2024cites this paper
• Robust Support Vector Data Description with Truncated Loss Function for Outliers Depression

  2024cites this paper
• Making the Most of Nothing: One-Class Classification for Single-Molecule Transport Studies

  2024cites this paper
• Power Disturbance Monitoring through Techniques for Novelty Detection on Wind Power and Photovoltaic Generation

  2023cites this paper
• Seminar: Scalable Preprocessing Tools for Exposomic Data Analysis

  2023cites this paper
• Robust Machine Learning Framework for Modeling the Compressive Strength of SFRC: Database Compilation, Predictive Analysis, and Empirical Verification

  2023cites this paper
• Anomaly Detection Models for SARS-CoV-2 Surveillance Based on Genome k-mers

  2023cites this paper
• Data Anomaly Detection for Structural Health Monitoring Based on a Convolutional Neural Network

  2023cites this paper
• Malicious traffic detection on sampled network flow data with novelty-detection-based models

  2023cites this paper
• Unknown cell class distinction via neural network based scattering snapshot recognition.

  2023cites this paper
• Machine Learning in Automated Monitoring of Metabolic Changes Accompanying the Differentiation of Adipose-Tissue-Derived Human Mesenchymal Stem Cells Employing 1H-1H TOCSY NMR

  2023cites this paper
• Combined Use of Cointegration Analysis and Robust Outlier Statistics to Improve Damage Detection in Real-World Structures

  2022cites this paper
• Regression modelling of spatiotemporal extreme U.S. wildfires via partially-interpretable neural networks

  2022cites this paper
• Novelty detection in rover-based planetary surface images using autoencoders

  2022cites this paper
• Fast and Efficient Image Novelty Detection Based on Mean-Shifts

  2022cites this paper
• Unleashing high content screening in hit detection – Benchmarking AI workflows including novelty detection

  2022cites this paper
• A Comprehensive “Real-World Constraints”-Aware Requirements Engineering Related Assessment and a Critical State-of-the-Art Review of the Monitoring of Humans in Bed

  2022cites this paper
• Taxonomy of Anomaly Detection Techniques in Crowd Scenes

  2022cites this paper
• A unifying partially-interpretable framework for neural network-based extreme quantile regression

  2022cites this paper
• An Unsupervised Data-Driven Anomaly Detection Approach for Adverse Health Conditions in People Living With Dementia: Cohort Study

  2022cites this paper
• Characterizing Prosthesis Control Fault During Human-Prosthesis Interactive Walking Using Intrinsic Sensors

  2022cites this paper
• One-Class Classification by Ensembles of Random Planes (OCCERPs)

  2022cites this paper
• Detecting Cyberattacks on Electrical Storage Systems through Neural Network Based Anomaly Detection Algorithm

  2022cites this paper
• Multiscale generative model using regularized skip-connections and perceptual loss for anomaly detection in toxicologic histopathology

  2022cites this paper
• A fusion approach to improve accuracy and estimate uncertainty in cuffless blood pressure monitoring

  2022cites this paper
• MEDEP: Maintenance Event Detection for Multivariate Time Series Based on the PELT Approach

  2022cites this paper
• Current Only-Based Fault Diagnosis Method for Industrial Robot Control Cables

  2022cites this paper
• New Avenues in Audio Intelligence: Towards Holistic Real-life Audio Understanding

  2021cites this paper
• CNN-Based Volume Flow Rate Prediction of Oil–Gas–Water Three-Phase Intermittent Flow from Multiple Sensors

  2021cites this paper
• Out-of-Distribution Detection of Human Activity Recognition with Smartwatch Inertial Sensors

  2021cites this paper
• An anomaly detection approach to identify chronic brain infarcts on MRI

  2021cites this paper
• Anomaly Detection Algorithm for Real-World Data and Evidence in Clinical Research: Implementation, Evaluation, and Validation Study

  2021cites this paper
• Inspection of Transparent Objects with Varying Light Scattering Using a Frangi Filter

  2021cites this paper
• Leave-One-Out Kernel Density Estimates for Outlier Detection

  2021cites this paper
• Examining Response to Negative Life Events Through Fitness Tracker Data

  2021cites this paper
• Comparison of Novelty Detection Methods for Detection of Various Rotary Machinery Faults

  2021cites this paper
• Application of an Anomaly Detection Model to Screen for Ocular Diseases Using Color Retinal Fundus Images: Design and Evaluation Study

  2021cites this paper
• Machine-learning based feature selection for a non-invasive breathing change detection

  2021cites this paper
• Deep Convolutional Clustering-Based Time Series Anomaly Detection

  2021cites this paper
• Deep-Compact-Clustering Based Anomaly Detection Applied to Electromechanical Industrial Systems

  2021cites this paper
• Fast FMCW Terahertz Imaging for In-Process Defect Detection in Press Sleeves for the Paper Industry and Image Evaluation with a Machine Learning Approach

  2021cites this paper
• Toward the Integration of Cyber and Physical Security Monitoring Systems for Critical Infrastructures

  2021cites this paper
• Recognition awareness: adding awareness to pattern recognition using latent cognizance

  2021cites this paper
• A Smart Capacitive Sensor Skin with Embedded Data Quality Indication for Enhanced Safety in Human–Robot Interaction

  2021cites this paper
• Tracking clusters and anomalies in evolving data streams

  2021influential citation
• One generalized mixture Pareto distribution and estimation of the parameters by the EM algorithm for complete and right-censored data

  2021cites this paper
• Computational Time Evaluation of the Various Methods of Parameter Estimation for Pareto Distribution

  2021cites this paper
• Recognizing New Classes with Synthetic Data in the Loop: Application to Traffic Sign Recognition

  2020cites this paper
• Anomaly Detection in EEG Signals: A Case Study on Similarity Measure

  2020cites this paper
• Target specific mining of COVID-19 scholarly articles using one-class approach

  2020cites this paper
• Model-free detection of unique events in time series

  2020cites this paper
• MorphoCluster: Efficient Annotation of Plankton Images by Clustering

  2020cites this paper
• Handling imbalanced medical image data: A deep-learning-based one-class classification approach

  2020cites this paper
• Modelling and Recognition of Protein Contact Networks by Multiple Kernel Learning and Dissimilarity Representations

  2020cites this paper
• On the nature and types of anomalies: a review of deviations in data

  2020cites this paper
• Perfect Density Models Cannot Guarantee Anomaly Detection

  2020cites this paper
• Risk, Trust, and Bias: Causal Regulators of Biometric-Enabled Decision Support

  2020cites this paper
• Introduction to Extreme Seeking Entropy

  2020cites this paper
• Out-of-Distribution Detection with Distance Guarantee in Deep Generative Models

  2020cites this paper
• Supervised Machine-Learning Enables Segmentation and Evaluation of Heterogeneous Post-treatment Changes in Multi-Parametric MRI of Soft-Tissue Sarcoma

  2019cites this paper
• A Machine Learning-Based Method for Automated Blockchain Transaction Signing Including Personalized Anomaly Detection

  2019cites this paper
• Detecting Out-of-Distribution Inputs to Deep Generative Models Using Typicality

  2019influential citation
• Vision-Based Novelty Detection Using Deep Features and Evolved Novelty Filters for Specific Robotic Exploration and Inspection Tasks

  2019cites this paper
• Integrated Clustering and Anomaly Detection (INCAD) for Streaming Data

  2019cites this paper
• Detecting Out-of-Distribution Inputs to Deep Generative Models Using a Test for Typicality

  2019influential citation
• Bayesian Anomaly Detection Using Extreme Value Theory

  2019cites this paper
• Anomaly Detection in Streaming Nonstationary Temporal Data

  2019cites this paper
• Data Discovery and Anomaly Detection Using Atypicality for Real-Valued Data

  2019cites this paper
• A review of big data applications of physiological signal data

  2019cites this paper
• Sensor Compromise Detection in Multiple-Target Tracking Systems

  2018cites this paper
• Point process models for novelty detection on spatial point patterns and their extremes

  2018influential citation
• Novelty Detection using Deep Normative Modeling for IMU-Based Abnormal Movement Monitoring in Parkinson’s Disease and Autism Spectrum Disorders

  2018cites this paper
• Intelligent Electronic Health Systems

  2018cites this paper
• Silhouette Scores for Arbitrary Defined Groups in Gene Expression Data and Insights into Differential Expression Results

  2018cites this paper
• Anomaly Detection in Nanofibrous Materials by CNN-Based Self-Similarity

  2018cites this paper
• Using Bayesian Kriging for Spatial Smoothing in Crop Insurance Rating

  2018cites this paper
• Protection of Superconducting Industrial Machinery Using RNN-Based Anomaly Detection for Implementation in Smart Sensor

  2018cites this paper
• Reasoning and Knowledge Acquisition Framework for 5G Network Analytics

  2017cites this paper
• An Anomalous Noise Events Detector for Dynamic Road Traffic Noise Mapping in Real-Life Urban and Suburban Environments

  2017cites this paper
• A deep learning and novelty detection framework for rapid phenotyping in high-content screening

  2017cites this paper
• Extreme value-based novelty detection

  2017cites this paper
• Improved prediction of missing protein interactome links via anomaly detection

  2017cites this paper
• Deep Recurrent Neural Network-Based Autoencoders for Acoustic Novelty Detection

  2017cites this paper
• Constraints and Adaptation of Closed-Loop Neuroprosthetics for Functional Restoration

  2017cites this paper
• Efficiency of different measures for defining the applicability domain of classification models

  2017cites this paper
• A Comparative Evaluation of Unsupervised Anomaly Detection Algorithms for Multivariate Data

  2016cites this paper
• Eye movements and information geometry.

  2016cites this paper