Net-Fli: On-the-fly Compression, Archiving and Indexing of Streaming Network Traffic

No abstract is available for this paper.

• Publication year

  2010

• Venue

  Proceedings of the VLDB Endowment

• Publication date

  2010-09-01

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.14778/1920841.1921011
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Position list word aligned hybrid: optimizing space and performance for compressed bitmaps

  2010cited by this paper
• Scale-Up Strategies for Processing High-Rate Data Streams in System S

  2009cited by this paper
• Sorting improves word-aligned bitmap indexes

  2009cited by this paper
• Application of bitmap index to information retrieval

  2008cited by this paper
• DIPStorage: Distributed storage of IP flow records

  2008cited by this paper
• Histogram-aware sorting for enhanced word-aligned compression in bitmap indexes

  2008cited by this paper
• Breaking the memory wall in MonetDB

  2008cited by this paper
• Challenges and Experience in Prototyping a Multi-Modal Stream Analytic and Monitoring Application on System S

  2007cited by this paper
• Enabling Real-Time Querying of Live and Historical Stream Data

  2007cited by this paper
• Multi-Probe LSH: Efficient Indexing for High-Dimensional Similarity Search

  2007cited by this paper
• Optimizing bitmap indices with efficient compression

  2006cited by this paper
• MIND: A Distributed Multi-Dimensional Indexing System for Network Diagnosis

  2006cited by this paper
• Bigtable: a distributed storage system for structured data

  2006cited by this paper
• Super-Scalar RAM-CPU Cache Compression

  2006cited by this paper
• BLINC: multilevel traffic classification in the dark

  2005cited by this paper
• Compressing bitmap indices by data reorganization

  2005cited by this paper
• The design of VisFlowConnect-IP: a link analysis system for IP security situational awareness

  2005cited by this paper
• C-Store: A Column-oriented DBMS

  2005cited by this paper
• More Netflow Tools for Performance and Security

  2004cited by this paper
• Inverted Index Compression Using Word-Aligned Binary Codes

  2004cited by this paper
• On the performance of bitmap indices for high cardinality attributes

  2004cited by this paper
• Locality-sensitive hashing scheme based on p-stable distributions

  2004cited by this paper
• Using Data Stream Management Systems for Traffic Analysis - A Case Study

  2004cited by this paper
• TelegraphCQ: continuous dataflow processing

  2003cited by this paper
• Gigascope: a stream database for network applications

  2003cited by this paper
• The OSU Flow-tools Package and CISCO NetFlow Logs

  2000cited by this paper
• Similarity Search in High Dimensions via Hashing

  1999cited by this paper
• Query processing and optimization in Oracle Rdb

  1996cited by this paper

• Serf: Streaming Error-Bounded Floating-Point Compression

  2025cites this paper
• Handling Large-Scale Network Flow Records: A Comparative Study on Lossy Compression

  2025cites this paper
• RABIT: Efficient Range Queries with Bitmap Indexing

  2025cites this paper
• Partition, Don't Sort! Compression Boosters for Cloud Data Ingestion Pipelines

  2024cites this paper
• BK-Index: A Multi-attribute Index algorithm for Network Traffic

  2024cites this paper
• CUBIT: Concurrent Updatable Bitmap Indexing

  2024cites this paper
• Leveraging Spatial and Temporal Correlations for Network Traffic Compression

  2023cites this paper
• Atom: Neural Traffic Compression with Spatio-Temporal Graph Neural Networks

  2023cites this paper
• A Framework for Storage-Accuracy Optimization of IoT Forensic Analysis

  2022cites this paper
• A Survey on Big IoT Data Indexing: Potential Solutions, Recent Advancements, and Open Issues

  2021cites this paper
• Compact-index: an efficient index algorithm for network traffic

  2021influential citation
• Verifiable and Dynamic Multi-Keyword Search Over Encrypted Cloud Data Using Bitmap

  2021cites this paper
• An Efficient Indexing Scheme for Network Traffic Collection and Retrieval System

  2021influential citation
• Caching Support for Range Query Processing on Bitmap Indices

  2021cites this paper
• Parallel acceleration of CPU and GPU range queries over large data sets

  2020cites this paper
• Variable word length word-aligned hybrid compression

  2020cites this paper
• MANTIS: time-shifted prefetching of YouTube videos to reduce peak-time cellular data usage

  2020cites this paper
• AvaTar: Zero-Copy Archiving With New Kernel-Level Operations

  2020cites this paper
• Increasing the Efficiency of GPU Bitmap Index Query Processing

  2020cites this paper
• Information Security Theory and Practice: 13th IFIP WG 11.2 International Conference, WISTP 2019, Paris, France, December 11–12, 2019, Proceedings

  2020cites this paper
• Exploring Means to Enhance the Efficiency of GPU Bitmap Index Query Processing

  2020cites this paper
• Optimizing bitmap index encoding for high performance queries

  2020cites this paper
• High Performance Queries Using Compressed Bitmap Indexes

  2019cites this paper
• GPU Acceleration of Range Queries over Large Data Sets

  2019cites this paper
• Efficient Join Processing Over Incomplete Data Streams

  2019cites this paper
• A Survey on Big Data for Network Traffic Monitoring and Analysis

  2019cites this paper
• Confluo: Distributed Monitoring and Diagnosis Stack for High-speed Networks

  2019cites this paper
• Drawbacks and Proposed Solutions for Real-time Processing on Existing State-of-the-art Locality Sensitive Hashing Techniques

  2019cites this paper
• CompactFlow: A Hybrid Binary Format for Network Flow Data

  2019cites this paper
• Boosting data filtering on columnar encoding with SIMD

  2018cites this paper
• A Novel Representation and Compression for Queries on Trajectories in Road Networks

  2018cites this paper
• THE UNIVERSITY OF CHICAGO OPTIMIZING LIGHTWEIGHT ENCODING IN COLUMNAR STORE A DISSERTATION SUBMITTED TO THE FACULTY OF THE DIVISION OF THE PHYSICAL SCIENCE DIVISION IN CANDIDACY FOR THE DEGREE OF MASTER OF SCIENCE DEPARTMENT OF COMPUTER SCIENCE BY HAO JIANG

  2018cites this paper
• Overview on Hardware Optimizations for Database Engines

  2017cites this paper
• Intelligent Probing for Locality Sensitive Hashing: Multi-Probe LSH and Beyond

  2017cites this paper
• Cache-Friendly Bitmap Compression on Symmetric Multiprocessors

  2017cites this paper
• CODIS: A New Compression Scheme for Bitmap Indexes

  2017influential citation
• Indexing the Pickup and Drop-Off Locations of NYC Taxi Trips in PostgreSQL - Lessons from the Road

  2017cites this paper
• An Experimental Study of Bitmap Compression vs. Inverted List Compression

  2017cites this paper
• Datenbanksysteme für Business, Technologie und Web (BTW 2017), 17. Fachtagung des GI-Fachbereichs „Datenbanken und Informationssysteme" (DBIS), 6.-10. März 2017, Stuttgart, Germany, Proceedings

  2017cites this paper
• Improving the Querying Efficiency of the PLWAH Bitmap Algorithm

  2017cites this paper
• Roaring bitmaps: Implementation of an optimized software library

  2017cites this paper
• Index-Trie: Efficient archival and retrieval of network traffic

  2017cites this paper
• COMBAT: a new bitmap index coding algorithm for big data

  2016cites this paper
• BAH: A Bitmap Index Compression Algorithm for Fast Data Retrieval

  2016cites this paper
• NetMemex: Providing Full-Fidelity Traffic Archival

  2016cites this paper
• Consistently faster and smaller compressed bitmaps with Roaring

  2016cites this paper
• CAMP: A New Bitmap Index for Data Retrieval in Traffic Archival

  2016cites this paper
• MASC: A bitmap index encoding algorithm for fast data retrieval

  2016cites this paper
• Two Birds, One Stone: A Fast, yet Lightweight, Indexing Scheme for Modern Database Systems

  2016cites this paper
• VAST: A Unified Platform for Interactive Network Forensics

  2016cites this paper
• Improving Bitmap Execution Performance Using Column-Based Metadata

  2016cites this paper
• SBH: Super byte-aligned hybrid bitmap compression

  2016influential citation
• Hippo: A Fast, yet Scalable, Database Indexing Approach

  2016cites this paper
• Scalable Network Forensics

  2016influential citation
• HW/SW-database-codesign for compressed bitmap index processing

  2016influential citation
• nMASE – A Search Engine for Network Trace

  2016cites this paper
• Distributed indexing and scalable query processing for interactive big data explorations

  2016cites this paper
• PcapWT: An efficient packet extraction tool for large volume network traces

  2015cites this paper
• SPLWAH: A bitmap index compression scheme for searching in archival Internet traffic

  2015influential citation
• Performance evaluation of word-aligned compression methods for bitmap indices

  2015influential citation
• Hybrid query optimization for hard-to-compress bit-vectors

  2015cites this paper
• A survey of bitmap index compression algorithms for Big Data

  2015cites this paper
• A General Analytical Model for Spatial and Temporal Performance of Bitmap Index Compression Algorithms in Big Data

  2015cites this paper
• A Data Driven Framework for Real Time Power System Event Detection and Visualization

  2015cites this paper
• qflow: a fast customer-oriented NetFlow database for accounting and data retention

  2014cites this paper
• Managing PMU data sets with bitmap indexes

  2014cites this paper
• Better bitmap performance with Roaring bitmaps

  2014cites this paper
• SECOMPAX: A bitmap index compression algorithm

  2014cites this paper
• Optimizing query execution for variable-aligned length compression of bitmap indices

  2014cites this paper
• Roaring bitmap : nouveau modèle de compression bitmap

  2014cites this paper
• A backend framework for the efficient management of power system measurements

  2014cites this paper
• Space-Time Efficient and Secure Algorithms for Data Processing and Transmission

  2014influential citation
• PLWAH+: A bitmap index compressing scheme based on PLWAH

  2014cites this paper
• A tunable compression framework for bitmap indices

  2014influential citation
• Adaptive parallel compressed event matching

  2014cites this paper
• DNFStore: A Distributed Netflow Storage System Supports Fast Retrieval

  2014cites this paper
• A Survey on Internet Traffic Archival Systems

  2014cites this paper
• Compressed bitmap indexes: beyond unions and intersections

  2014cites this paper
• An Efficient, Extensible, Hardware-aware Indexing Kernel

  2014cites this paper
• BreadZip: a combination of network traffic data and bitmap index encoding algorithm

  2014cites this paper
• Threshold and Symmetric Functions over Bitmaps

  2014cites this paper
• Parameterizable benchmarking framework for designing a MapReduce performance model

  2014cites this paper
• Performance Modeling And Resource Management For Mapreduce Applications

  2014cites this paper
• TIFAflow: enhancing traffic archiving system with flow granularity for forensic analysis in network security

  2013cites this paper
• Dynamic bitmap index recompression through workload-based optimizations

  2013influential citation
• A survey on privacy impacts of digital investigation

  2013cites this paper
• 10 Gbit line rate packet-to-disk using n2disk

  2013cites this paper
• An efficient and compact indexing scheme for large-scale data store

  2013cites this paper
• Black Box Testing for Cloud-Based Client Security Software in Network Behaviors

  2013cites this paper
• A Study on Database Indexing Techniques and Their Limitations

  2013cites this paper
• Improving Compression of Massive Log Data

  2013cites this paper
• 10 Gbit line rate packet-to-disk using n2disk

  2013cites this paper
• Reordering rows for better compression: Beyond the lexicographic order

  2012cites this paper
• Minimizing Index Size by Reordering Rows and Columns

  2012cites this paper
• Decoding billions of integers per second through vectorization

  2012cites this paper
• pcapIndex: an index for network packet traces with legacy compatibility

  2012cites this paper
• High-speed indexing and archival of network measurement data

  2012cites this paper
• An empirical analysis of scheduling techniques for real-time cloud-based data processing

  2011cites this paper
• Towards Monitoring Programmability in Future Internet: Challenges and Solutions

  2011cites this paper
• Real-time creation of bitmap indexes on streaming network data

  2011cites this paper