Dynamic Network Cartography: Advances in Network Health Monitoring

Communication networks have evolved from specialized research and tactical transmission systems to large-scale and highly complex interconnections of intelligent devices, increasingly becoming more commercial, consumer oriented, and heterogeneous. Propelled by emergent social networking services and high-definition streaming platforms, network traffic has grown explosively thanks to the advances in processing speed and storage capacity of state-of-the-art communication technologies. As "netizens" demand a seamless networking experience that entails not only higher speeds but also resilience and robustness to failures and malicious cyberattacks, ample opportunities for signal processing (SP) research arise. The vision is for ubiquitous smart network devices to enable data-driven statistical learning algorithms for distributed, robust, and online network operation and management, adaptable to the dynamically evolving network landscape with minimal need for human intervention. This article aims to delineate the analytical background and the relevance of SP tools to dynamic network monitoring, introducing the SP readership to the concept of dynamic network cartography? a framework to construct maps of the dynamic network state in an efficient and scalable manner tailored to large-scale heterogeneous networks.

• Publication year

  2012

• Venue

  IEEE Signal Processing Magazine

• Publication date

  2012-11-29

• Fields of study

  Mathematics, Computer Science, Engineering, Environmental Science

• Identifiers
  DOI 10.1109/MSP.2012.2232355arXiv 1211.6950
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Advances in Spectrum Sensing and Cross-Layer Design for Cognitive Radio Networks

  2014influential reference
• Parallel stochastic gradient algorithms for large-scale matrix completion

  2013cited by this paper
• Recovery of Low-Rank Plus Compressed Sparse Matrices With Application to Unveiling Traffic Anomalies

  2012cited by this paper
• Exact recovery of low-rank plus compressed sparse matrices

  2012influential reference
• PETRELS: Subspace estimation and tracking from partial observations

  2012cited by this paper
• Spatio-Temporal Compressive Sensing and Internet Traffic Matrices (Extended Version)

  2012cited by this paper
• Compressed Sensing

  2012influential reference
• High-Rank Matrix Completion

  2012cited by this paper
• Absence of Debye sheaths due to secondary electron emission.

  2012cited by this paper
• Dynamic Network Delay Cartography

  2012cited by this paper
• Dynamic Anomalography: Tracking Network Anomalies Via Sparsity and Low Rank

  2012influential reference
• Semi-supervised dictionary learning for network-wide link load prediction

  2012influential reference
• Dynamic network kriging

  2012influential reference
• Incremental gradient on the Grassmannian for online foreground and background separation in subsampled video

  2012cited by this paper
• High-dimensional Principal Component Analysis

  2011cited by this paper
• ReProCS: A Missing Link between Recursive Robust PCA and Recursive Sparse Recovery in Large but Correlated Noise

  2011cited by this paper
• Cooperative Spectrum Sensing for Cognitive Radios Using Kriged Kalman Filtering

  2011cited by this paper
• Extracting baseline patterns in Internet traffic using Robust Principal Components

  2011cited by this paper
• On the growth of Internet application flows: A complex network perspective

  2011cited by this paper
• Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent

  2011cited by this paper
• Dictionary Learning

  2011cited by this paper
• A Case Study of the Accuracy of SNMP Measurements

  2010influential reference
• Network Distance Prediction Based on Decentralized Matrix Factorization

  2010cited by this paper
• Group-Lasso on Splines for Spectrum Cartography

  2010cited by this paper
• Online identification and tracking of subspaces from highly incomplete information

  2010cited by this paper
• Robust traffic anomaly detection with principal component pursuit

  2010cited by this paper
• Distributed Spectrum Sensing for Cognitive Radio Networks by Exploiting Sparsity

  2010cited by this paper
• Spatio-temporal compressive sensing and internet traffic matrices

  2009influential reference
• Matrix Completion With Noise

  2009cited by this paper
• Online Learning for Matrix Factorization and Sparse Coding

  2009cited by this paper
• Rank-Sparsity Incoherence for Matrix Decomposition

  2009influential reference
• Distributed Kriged Kalman Filter for Spatial Estimation

  2009cited by this paper
• Robust principal component analysis?

  2009cited by this paper
• Spatio-temporal compressive sensing and internet traffic matrices

  2009influential reference
• Statistical Analysis of Network Data

  2009cited by this paper
• Statistical Analysis of Network Data: Methods and Models

  2009influential reference
• CRAWDAD dataset mannheim/compass (v.2008-04-11)

  2008cited by this paper
• PATHWISE COORDINATE OPTIMIZATION

  2007cited by this paper
• Security data visualization : graphical techniques for network analysis

  2007cited by this paper
• Compressed network monitoring for ip and all-optical networks

  2007influential reference
• Self-taught learning: transfer learning from unlabeled data

  2007cited by this paper
• On suitability of Euclidean embedding of internet hosts

  2006cited by this paper
• Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples

  2006cited by this paper
• Traffic matrix tracking using Kalman filters

  2005cited by this paper
• Decoding by linear programming

  2005cited by this paper
• Estimating point-to-point and point-to-multipoint traffic matrices: an information-theoretic approach

  2005cited by this paper
• Network Kriging

  2005influential reference
• Traffic matrices: balancing measurements, inference and modeling

  2005cited by this paper
• Network anomography

  2005influential reference
• Computing the unmeasured: an algebraic approach to Internet mapping

  2004cited by this paper
• Diagnosing network-wide traffic anomalies

  2004influential reference
• Vivaldi: a decentralized network coordinate system

  2004cited by this paper
• Network Tomography: Recent Developments

  2004cited by this paper
• The Elements of Statistical Learning

  2003cited by this paper
• The Kriged Kalman filter

  1998cited by this paper
• Regression Shrinkage and Selection via the Lasso

  1996influential reference
• The origins of kriging

  1990cited by this paper
• Book Review : Parallel and Distributed Computation: Numerical Methods

  1989cited by this paper
• An analysis of approximations for maximizing submodular set functions—I

  1978cited by this paper
• Adaptive sequential estimation with unknown noise statistics

  1976cited by this paper

• Consensus-Based Approximation and Quadrature on the Sphere via Weighted Least Squares Polynomial Models

  2025cites this paper
• Innovative Application and Performance Optimization of Artificial Intelligence Algorithms for Malware Variant Identification

  2025cites this paper
• Federated Learning For Heterogeneous Electronic Health Records Utilising Augmented Temporal Graph Attention Networks

  2024cites this paper
• Gradient-Based Spectral Embeddings of Random Dot Product Graphs

  2023cites this paper
• Algorithmic Advances for the Adjacency Spectral Embedding

  2022cites this paper
• Fusion Subspace Clustering for Incomplete Data

  2022cites this paper
• Spectrum Cartography Using the Variational Bayesian EM Algorithm

  2020cites this paper
• Online Learning: the Stochastic Gradient Descent Family of Algorithms

  2020cites this paper
• Development of Multi-function Sensor Integration and Data Process SW Module for Real-time Situation Recognition

  2019cites this paper
• Dictionary learning based fingerprinting for indoor localization

  2018cites this paper
• Signal Processing for High-Throughput Satellites: Challenges in new interference-limited scenarios

  2018cites this paper
• Adaptive Sensor Selection for Nonlinear Tracking via Sparsity-Promoting Approaches

  2018cites this paper
• Identifying Susceptible Agents in Time Varying Opinion Dynamics Through Compressive Measurements

  2018cites this paper
• Spatiotemporal Cyberspace Situation Awareness Mechanism for Backbone Networks

  2018cites this paper
• Dynamic Network Latency Prediction with Adaptive Matrix Completion

  2018cites this paper
• Fusion Subspace Clustering: Full and Incomplete Data

  2018cites this paper
• Mixture regression as subspace clustering

  2017cites this paper
• Converged Wireless Access/Optical Metro Networks in Support of Cloud and Mobile Cloud Services Deploying SDN Principles

  2017cites this paper
• Sparsity-promoting sensor selection for nonlinear target tracking with quantized data

  2017cites this paper
• Adaptive Low-Rank Matrix Completion

  2017cites this paper
• Reconstruction of a Gaussian random field with application to spectrum cartography

  2016cites this paper
• Asynchronous Optimization Over Heterogeneous Networks Via Consensus ADMM

  2016cites this paper
• Group-sparse subspace clustering with missing data

  2016cites this paper
• Necessary and sufficient conditions for sketched subspace clustering

  2016cites this paper
• Combinations of eigenspace and GMM with Kinect sensor-extracted action gesture features for person identity recognition

  2016cites this paper
• The Information-Theoretic Requirements of Subspace Clustering with Missing Data

  2016cites this paper
• Scalable service provisioning in converged optical/wireless clouds using compression techniques

  2015cites this paper
• Stochastic Gradient Descent

  2015cites this paper
• Decentralized learning for wireless communications and networking

  2015cites this paper
• Outlier-aware cooperative spectrum sensing in cognitive radio networks

  2015cites this paper
• Outlier-aware spectrum sensing in cognitive radio networks

  2014cites this paper
• Sparsity-Promoting Sensor Selection for Non-Linear Measurement Models

  2013cites this paper
• Big Data

  2013cites this paper