A Novel Streaming Data Clustering Algorithm Based on Fitness Proportionate Sharing

As an unsupervised learning technique, clustering can effectively capture the patterns in a data stream based on similarities among the data. Traditional data stream clustering algorithms either heavily depend on some prior knowledge or predefined parameters while the characteristics of real-time data are considered unknown. Besides, the user-specified threshold is used to overcome the effect of outliers and noises, which significantly affects the clustering performance. The overlap among clusters is another major challenge for the existing stream clustering methods. These constraints strongly limit their real-time applications. In this paper, a two-phase stream clustering algorithm based on fitness proportionate sharing is proposed. It handles streaming data when prior knowledge is not available and maps the clustering problem into a multimodal optimization problem. It introduces a density-based objective function and adopts the fitness proportionate sharing strategy to perform a more effective search for the cluster centers. To capture the dynamic characteristics of streaming data, a recursive formula for the lower bound of the density function is derived, and a summary of historical data is established for the proposed algorithm. The proposed algorithm is applied to different data sets, and a comprehensive comparison between the proposed algorithm and five well-known data stream clustering algorithms in the literature is provided. Results show comparable or better performance relative to five popular data stream clustering algorithms. A scalability analysis of the proposed streaming clustering method is presented in this paper as well.

• Publication year

  2019

• Venue

  IEEE Access

• Publication date

  Unknown publication date

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/ACCESS.2019.2922162
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• DOE-AND-SCA: A Novel SCA Based on DNN With Optimal Eigenvectors and Automatic Cluster Number Determination

  2018cited by this paper
• BEstream: Batch Capturing with Elliptic Function for One-Pass Data Stream Clustering

  2018cited by this paper
• An evaluation of data stream clustering algorithms

  2018cited by this paper
• Data Stream Clustering Techniques, Applications, and Models: Comparative Analysis and Discussion

  2018cited by this paper
• Clustering Stream Data by Exploring the Evolution of Density Mountain

  2017cited by this paper
• A novel clustering algorithm based on fitness proportionate sharing

  2017cited by this paper
• EDDS: An Enhanced Density-Based Method for Clustering Data Streams

  2017cited by this paper
• Clustering by Fast Search and Find of Density Peaks

  2016cited by this paper
• A dynamic niching clustering algorithm based on individual-connectedness and its application to color image segmentation

  2016cited by this paper
• Autonomous data-driven clustering for live data stream

  2016cited by this paper
• Hyper-cylindrical micro-clustering for streaming data with unscheduled data removals

  2016cited by this paper
• A fast density-based data stream clustering algorithm with cluster centers self-determined for mixed data

  2016cited by this paper
• Clustering Data Streams Based on Shared Density between Micro-Clusters

  2016influential reference
• MuDi-Stream: A multi density clustering algorithm for evolving data stream

  2016cited by this paper
• Data-Stream-Based Intrusion Detection System for Advanced Metering Infrastructure in Smart Grid: A Feasibility Study

  2015cited by this paper
• On comparing partitions

  2015influential reference
• Taming instabilities in power grid networks by decentralized control

  2015cited by this paper
• A method for discovering clusters of e-commerce interest patterns using click-stream data

  2015cited by this paper
• Open challenges for data stream mining research

  2014cited by this paper
• Clustering data streams using grid-based synopsis

  2014cited by this paper
• Autonomous Learning Systems: From Data Streams to Knowledge in Real-time

  2013cited by this paper
• LeaDen-Stream: A Leader Density-Based Clustering Algorithm over Evolving Data Stream

  2013cited by this paper
• Data stream clustering: A survey

  2013cited by this paper
• An evaluation framework for traffic information systems based on data streams

  2012cited by this paper
• DENGRIS-Stream: A Density-Grid based Clustering Algorithm for Evolving Data Streams over Sliding Window

  2012cited by this paper
• Facing the reality of data stream classification: coping with scarcity of labeled data

  2012cited by this paper
• A Fitness Proportionate Reward Sharing : a Viable Default Hierarchy Formation Strategy in LCS

  2012cited by this paper
• Density-based Projected Clustering over High Dimensional Data Streams

  2012influential reference
• The ClusTree: indexing micro-clusters for anytime stream mining

  2011cited by this paper
• Data Mining and Machine Learning in Cybersecurity

  2011cited by this paper
• A robust dynamic niching genetic algorithm with niche migration for automatic clustering problem

  2010cited by this paper
• Density-Based Data Streams Clustering over Sliding Windows

  2009cited by this paper
• Density-based clustering of data streams at multiple resolutions

  2009cited by this paper
• A Grid and Density-Based Clustering Algorithm for Processing Data Stream

  2008influential reference
• Real-time storm detection and weather forecast activation through data mining and events processing

  2008cited by this paper
• On the Equivalence of Cohen’s Kappa and the Hubert-Arabie Adjusted Rand Index

  2008cited by this paper
• Density-based clustering for real-time stream data

  2007influential reference
• Knowledge and Information Systems REGULAR PAPER

  2007cited by this paper
• DENCLUE 2.0: Fast Clustering Based on Kernel Density Estimation

  2007influential reference
• Mean shift-based clustering

  2007cited by this paper
• Learning from Data Streams: Processing Techniques in Sensor Networks

  2007cited by this paper
• Unsupervised Clustering In Streaming Data

  2006cited by this paper
• Mining data streams: a review

  2005cited by this paper
• An approach to online identification of Takagi-Sugeno fuzzy models

  2004cited by this paper
• A similarity-based robust clustering method

  2004influential reference
• Maintaining variance and k-medians over data stream windows

  2003cited by this paper
• A Framework for Clustering Evolving Data Streams

  2003influential reference
• Streaming-data algorithms for high-quality clustering

  2002cited by this paper
• Dynamic Niche Clustering: a fuzzy variable radius niching technique for multimodal optimisation in GAs

  2001cited by this paper
• Clustering data streams

  2000influential reference
• An Efficient Approach to Clustering in Large Multimedia Databases with Noise

  1998cited by this paper
• BIRCH: an efficient data clustering method for very large databases

  1996influential reference
• Approximate Clustering Via the Mountain Method

  1994cited by this paper
• Natural Scales in Geographical Patterns

  1971influential reference
• Similarity relations and fuzzy orderings

  1971cited by this paper

• Unsupervised heterogeneous group streaming feature selection

  2026cites this paper
• Density Peaks Clustering Algorithm Based on Neighborhood Radius and Membership Degree

  2025cites this paper
• Hybrid lion and exponential PSO-based metaheuristic clustering approach for efficient dynamic data stream management

  2025influential citation
• Online Research Topic Modeling and Recommendation Utilizing Multiview Autoencoder-Based Approach

  2024cites this paper
• Exponentially Consistent Nonparametric Linkage-Based Clustering of Data Sequences

  2024cites this paper
• A Streaming Data Clustering Method Based on Dual Strategies Improved DENCLUE

  2024cites this paper
• In Search of Excellence: SHOA as a Competitive Shrike Optimization Algorithm for Multimodal Problems

  2024cites this paper
• LAPAID: A Lightweight, Adaptive and Perspicacious Active Intrusion Detection Method on Network Traffic Streams

  2024cites this paper
• A smart intelligent approach based on hybrid group search and pelican optimization algorithm for data stream clustering

  2023cites this paper
• Untangling the Effects of Down-Sampling and Selection in Genetic Programming

  2023cites this paper
• An Online Unsupervised Streaming Features Selection Through Dynamic Feature Clustering

  2023cites this paper
• Data Stream Unsupervised Partitioning Method

  2022cites this paper
• A clustering-based active learning method to query informative and representative samples

  2022cites this paper
• Deep flight track clustering based on spatial-temporal distance and denoising auto-encoding

  2022cites this paper
• SubtStream: Online subtractive stream clustering algorithm

  2022cites this paper
• DFAID: Density-aware and feature-deviated active intrusion detection over network traffic streams

  2022cites this paper
• Density Peaks Clustering Based on Natural Search Neighbors and Manifold Distance Metric

  2022cites this paper
• Remote Big Data Management Tools, Sensing and Computing Technologies, and Visual Perception and Environment Mapping Algorithms in the Internet of Robotic Things

  2022cites this paper
• Expert Systems With Applications

  2022cites this paper
• A niching framework based on fitness proportionate sharing for multi-objective genetic algorithm (MOGA-FPS)

  2021cites this paper
• A Clustering-based Framework for Classifying Data Streams

  2021cites this paper
• An Improved High-Density Sub Trajectory Clustering Algorithm

  2020cites this paper
• Online Multi-objective Subspace Clustering for Streaming Data

  2020cites this paper
• Online Clustering of Evolving Data Streams Using a Density Grid-Based Method

  2020cites this paper
• IoT-enabled autonomous system collaboration for disaster-area management

  2020cites this paper
• Resource Constrained Profit Optimization Method for Task Scheduling in Edge Cloud

  2020cites this paper
• Gaussian Mean Shift Ellipsoidal Clustering-Based R-Tree Indexing For Multidimensional Data Stream Analysis

  2020cites this paper
• Driver Identification Based on Vehicle Telematics Data using LSTM-Recurrent Neural Network

  2019cites this paper