Elastic scaling of data parallel operators in stream processing

No abstract is available for this paper.

• Publication year

  2009

• Venue

  2009 IEEE International Symposium on Parallel & Distributed Processing

• Publication date

  2009-05-23

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/IPDPS.2009.5161036
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Hadoop++

  2010cited by this paper
• Auto-vectorization through code generation for stream processing applications

  2009cited by this paper
• A code generation approach to optimizing high-performance distributed data stream processing

  2009influential reference
• Scale-Up Strategies for Processing High-Rate Data Streams in System S

  2009cited by this paper
• Positivity, posynomials and tile size selection

  2008cited by this paper
• Pig latin: a not-so-foreign language for data processing

  2008cited by this paper
• SPADE: the system s declarative stream processing engine

  2008cited by this paper
• Challenges and Experience in Prototyping a Multi-Modal Stream Analytic and Monitoring Application on System S

  2007cited by this paper
• Expressing and exploiting concurrency in networked applications with aspen

  2007cited by this paper
• Design, implementation, and evaluation of the linear road bnchmark on the stream processing core

  2006cited by this paper
• SPC: a distributed, scalable platform for data mining

  2006cited by this paper
• Multi-Core Processors: New Way to Achieve High System Performance

  2006cited by this paper
• Adaptive Control of Extreme-scale Stream Processing Systems

  2006influential reference
• W Projection: A New Algorithm for Wide Field Imaging with Radio Synthesis Arrays

  2005cited by this paper
• The Design of the Borealis Stream Processing Engine

  2005cited by this paper
• STREAM: The Stanford Stream Data Manager

  2003cited by this paper
• TelegraphCQ: Continuous Dataflow Processing for an Uncertain World

  2003cited by this paper
• StreamIt: A Language for Streaming Applications

  2002cited by this paper
• New trends in high performance computing

  2001cited by this paper
• DataCutter: Middleware for Filtering Very Large Scientific Datasets on Archival Storage Systems

  2000cited by this paper
• The implementation of the Cilk-5 multithreaded language

  1998cited by this paper

• Justin: Hybrid CPU/Memory Elastic Scaling for Distributed Stream Processing

  2025cites this paper
• Runtime Adaptation of Data Stream Processing Systems: The State of the Art

  2022cites this paper
• Jarvis: Large-scale Server Monitoring with Adaptive Near-data Processing

  2022cites this paper
• An elastic and traffic-aware scheduler for distributed data stream processing in heterogeneous clusters

  2022cites this paper
• Performance Prediction Method for Stream Computing Platform Based on Time Series

  2021cites this paper
• Self‐adaptation on parallel stream processing: A systematic review

  2021influential citation
• Run-time adaptation of stream processing spanning the cloud and the edge

  2021cites this paper
• Heterogeneity-aware elastic scaling of streaming applications on cloud platforms

  2021cites this paper
• STRETCH: Virtual Shared-Nothing Parallelism for Scalable and Elastic Stream Processing

  2021cites this paper
• WASP: Wide-area Adaptive Stream Processing

  2020cites this paper
• Maximum Sustainable Throughput Evaluation Using an Adaptive Method for Stream Processing Platforms

  2020cites this paper
• Move Fast and Meet Deadlines: Fine-grained Real-time Stream Processing with Cameo

  2020cites this paper
• A Data Streaming Process Framework for Autonomous Driving By Edge

  2020cites this paper
• Information Communication Technologies

  2020cites this paper
• An edge streaming data processing framework for autonomous driving

  2020cites this paper
• A Comprehensive Survey on Parallelization and Elasticity in Stream Processing

  2019cites this paper
• Multi-Level Elasticity for Data Stream Processing

  2019cites this paper
• DABS-Storm: A Data-Aware Approach for Elastic Stream Processing

  2019influential citation
• A Low-Power Scalable Signal Processing Chip Platform for 5G and Beyond - Kachel

  2019cites this paper
• An Adaptive Online Scheme for Scheduling and Resource Enforcement in Storm

  2019cites this paper
• STRETCH: Scalable and Elastic Deterministic Streaming Analysis with Virtual Shared-Nothing Parallelism

  2019cites this paper
• SERVICE COMPUTATION 2019

  2019cites this paper
• Transactions on Large-Scale Data- and Knowledge-Centered Systems XL

  2019influential citation
• Managing and understanding distributed stream processing

  2019cites this paper
• A Comprehensive Survey on Parallelization and Elasticity in Stream Processing 1 : 3 apply methods from control theory to adapt the parallelization degree of the operators

  2019cites this paper
• Thesis for the Degree of Habilitation

  2019cites this paper
• Computational Shedding in Stream Computing

  2019cites this paper
• Towards a Microservices-based Distribution for Situation-aware Adaptive Event Stream Processing

  2019cites this paper
• Adaptive degree of parallelism for the spar runtime

  2018cites this paper
• A Service Based Architecture for Situation-Aware Adaptive Event Stream Processing

  2018cites this paper
• Henge: Intent-driven Multi-Tenant Stream Processing

  2018cites this paper
• SpinStreams: a Static Optimization Tool for Data Stream Processing Applications

  2018cites this paper
• TurboStream: Towards Low-Latency Data Stream Processing

  2018cites this paper
• Viper: A module for communication-layer determinism and scaling in low-latency stream processing

  2018cites this paper
• Three steps is all you need: fast, accurate, automatic scaling decisions for distributed streaming dataflows

  2018cites this paper
• Elastic-PPQ: A two-level autonomic system for spatial preference query processing over dynamic data streams

  2018influential citation
• SERVICE COMPUTATION 2018 Proceedings

  2018cites this paper
• Rethinking Adaptability in Wide-Area Stream Processing Systems

  2018cites this paper
• On Design and Applications of Practical Concurrent Data Structures

  2018cites this paper
• Robust resource management in distributed stream processing systems

  2018cites this paper
• System Support For Stream Processing In Collaborative Cloud-Edge Environment

  2018cites this paper
• Window-based data parallelization in complex event processing

  2018cites this paper
• Concept-Driven Load Shedding: Reducing Size and Error of Voluminous and Variable Data Streams

  2018cites this paper
• Distributed query processing over fluctuating streams

  2018cites this paper
• A Preventive Auto-Parallelization Approach for Elastic Stream Processing

  2017cites this paper
• Cost-efficient enactment of stream processing topologies

  2017cites this paper
• Situation-Aware Adaptive Event Stream Processing A Processing Model and Scenario Definition Language

  2017cites this paper
• A Cloud-Based Stream Processing Platform for Traffic Monitoring Using Large-Scale Probe Vehicle Data

  2017cites this paper
• Synopsis: A Distributed Sketch over Voluminous Spatiotemporal Observational Streams

  2017cites this paper
• A Stepwise Auto-Profiling Method for Performance Optimization of Streaming Applications

  2017influential citation
• CBP :

  2017cites this paper
• Forum Jeunes Chercheurs à Inforsid 2016

  2017cites this paper
• CBP :

  2017cites this paper
• CBP: A New Parallelization Paradigm for Massively Distributed Stream Processing

  2017cites this paper
• Approche préventive pour une gestion élastique du traitement parallèle et distribué de flux de données

  2017cites this paper
• Model-driven Scheduling for Distributed Stream Processing Systems

  2017cites this paper
• Low-synchronization, mostly lock-free, elastic scheduling for streaming runtimes

  2017cites this paper
• A Lightweight Elastic Queue Middleware for Distributed Streaming Pipeline

  2017cites this paper
• New techniques to curtail the tail latency in stream processing systems

  2016cites this paper
• Minimizing Rental Cost for Multiple Recipe Applications in the Cloud

  2016cites this paper
• Towards a flexible data stream analytics platform based on the GCM autonomous software component technology

  2016cites this paper
• Efficient Data Streaming Multiway Aggregation through Concurrent Algorithmic Designs and New Abstract Data Types

  2016cites this paper
• Runtime‐aware adaptive scheduling in stream processing

  2016cites this paper
• Stela: Enabling Stream Processing Systems to Scale-in and Scale-out On-demand

  2016cites this paper
• Enabling Elastic Stream Processing in Shared Clusters

  2016cites this paper
• Adaptive Block and Batch Sizing for Batched Stream Processing System

  2016cites this paper
• Locality-aware distributed state partitioning for stream processing systems

  2016cites this paper
• Efficient resource sharing for big data applications in shared clusters

  2016cites this paper
• Elastic Stream Processing for the Internet of Things

  2016cites this paper
• Efficient Stream Analysis and its Application to Big Data Processing. (Analyse efficace de flux de données et applications au traitement des grandes masses de données)

  2016cites this paper
• Real-Time Logo Recognition from Live Video Streams Using an Elastic Cloud Platform

  2016cites this paper
• Roboconf : an Autonomic Platform Supporting Multi-level Fine-grained Elasticity of Complex Applications on the Cloud. (Roboconf : une plateforme autonomique pour l'élasticité multi-niveau, multi-granularité pour les applications complexes dans le cloud)

  2016cites this paper
• DOCTEUR DE LA COMMUNAUT ´ E UNIVERSIT ´ E

  2016cites this paper
• Enhanced Load Balance to Predict Fast Data Stream using E-Tree MSI Method on Cloud

  2016cites this paper
• Efficient stream analysis and its application to big data processing

  2016cites this paper
• Pipelined fission for stream programs with dynamic selectivity and partitioned state

  2016cites this paper
• Distributed Real-Time Event Analysis

  2015cites this paper
• Agent based Resource Allocation Mechanism Focusing Cost Optimization in Cloud Computing

  2015cites this paper
• Proceedings of the Second International Workshop on Sustainable Ultrascale Computing Systems (NESUS 2015) Krakow, Poland

  2015cites this paper
• Safe Data Parallelism for General Streaming

  2015cites this paper
• Co-sites: the autonomous distributed dataflows in collaborative scientific discovery

  2015cites this paper
• Dynamic Scheduling of Irregular Stream Programs toward Many-Core Scalability

  2015influential citation
• Machines Tuning Machines: Configuring Distributed Stream Processors with Bayesian Optimization

  2015cites this paper
• Operator fission for load balancing in distributed heterogeneous data stream processing systems

  2015cites this paper
• Study and Implementation of Elastic Stream Computing In The Cloud

  2015cites this paper
• Secured fast prediction of cloud data stream with balanced load factor using Ensemble Tree Classification

  2015cites this paper
• Online parameter optimization for elastic data stream processing

  2015cites this paper
• Dynamic Resource Management In a Massively Parallel Stream Processing Engine

  2015cites this paper
• Smooth Task Migration in Apache Storm

  2015cites this paper
• A Platform for Scalable Low-Latency Analytics using MapReduce

  2015cites this paper
• Scalable Fault-Tolerant Elastic Data Ingestion in AsterixDB

  2015cites this paper
• Stela: On-demand Elasticity in Distributed Data Stream Processing Systems Table of Contents

  2015cites this paper
• Elasticity and resource aware scheduling in distributed data stream processing systems

  2015cites this paper
• Stela: on-demand elasticity in distributed data stream processing systems

  2015cites this paper
• Elasticity in the Cloud

  2015cites this paper
• Optimizing memory allocation for multistage scheduling including setup times

  2015cites this paper
• Fundamentals of Stream Processing by Henrique C. M. Andrade

  2014cites this paper
• Floe: A Continuous Dataflow Framework for Dynamic Cloud Applications

  2014cites this paper
• Scalable Mobile Data Streaming with Trajectory Preserving Partitioning

  2014cites this paper
• No . 2013 : 11 Concurrent Data Structures for Efficient Streaming Aggregation

  2014cites this paper