CherryPick: Adaptively Unearthing the Best Cloud Configurations for Big Data Analytics

No abstract is available for this paper.

• Publication year

  2017

• Venue

  Symposium on Networked Systems Design and Implementation

• Publication date

  2017-03-27

• Fields of study

  Computer Science

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Statistical Learning Theory

  2021cited by this paper
• A framework to build bespoke auto-tuners with structured Bayesian optimisation

  2017cited by this paper
• Ernest: Efficient Performance Prediction for Large-Scale Advanced Analytics

  2016influential reference
• WebPerf: Evaluating What-If Scenarios for Cloud-hosted Web Applications

  2016cited by this paper
• CMA-ES for Hyperparameter Optimization of Deep Neural Networks

  2016cited by this paper
• Taking the Human Out of the Loop: A Review of Bayesian Optimization

  2016cited by this paper
• Human-level control through deep reinforcement learning

  2015cited by this paper
• MRONLINE: MapReduce online performance tuning

  2014cited by this paper
• Bayesian Optimization with Inequality Constraints

  2014cited by this paper
• Quasar: resource-efficient and QoS-aware cluster management

  2014cited by this paper
• QoS-Aware scheduling in heterogeneous datacenters with paragon

  2013cited by this paper
• Practical Bayesian Optimization of Machine Learning Algorithms

  2012influential reference
• Reoptimizing Data Parallel Computing

  2012cited by this paper
• Automated profiling and resource management of pig programs for meeting service level objectives

  2012cited by this paper
• Jockey: guaranteed job latency in data parallel clusters

  2012influential reference
• TritonSort: A Balanced Large-Scale Sorting System

  2011cited by this paper
• ARIA: automatic resource inference and allocation for mapreduce environments

  2011cited by this paper
• Starfish: A Self-tuning System for Big Data Analytics

  2011cited by this paper
• No one (cluster) size fits all: automatic cluster sizing for data-intensive analytics

  2011cited by this paper
• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning

  2010influential reference
• The Impact of Virtualization on Network Performance of Amazon EC2 Data Center

  2010cited by this paper
• CloudCmp: comparing public cloud providers

  2010cited by this paper
• Spark: Cluster Computing with Working Sets

  2010cited by this paper
• Hadoop: The Definitive Guide

  2009influential reference
• Automatic exploration of datacenter performance regimes

  2009cited by this paper
• Introduction to Gaussian Processes

  2008cited by this paper
• A smart hill-climbing algorithm for application server configuration

  2004cited by this paper
• Storage device performance prediction with CART models

  2004cited by this paper
• A recursive random search algorithm for large-scale network parameter configuration

  2003cited by this paper
• HPL – SSP – 2001 – 4 : Simple table-based modeling of storage devices

  2001cited by this paper
• On quasi-Monte Carlo integrations

  1998cited by this paper
• Introduction to Reinforcement Learning

  1998cited by this paper
• Efficient Global Optimization of Expensive Black-Box Functions

  1998cited by this paper
• Reinforcement Learning: An Introduction

  1998cited by this paper
• Bayesian Approach to Global Optimization: Theory and Applications

  1989cited by this paper

• Trident: Adaptive Scheduling for Heterogeneous Multimodal Data Pipelines

  2026cites this paper
• A hybrid metaheuristics-Bayesian optimization framework with safe transfer learning for continuous spark tuning

  2026cites this paper
• Optimizing UDF Queries in SQL Data Engines

  2026cites this paper
• A Concern-Decoupled Architecture for Scenario-Optimized Congestion Control in Large-Scale Live Video CDNs

  2026cites this paper
• Improving Database Performance by Application-side Transaction Merging

  2026cites this paper
• Machine Learning for Energy-Performance-aware Scheduling

  2026cites this paper
• Prediction-Guided Control in Data Center Networks

  2026cites this paper
• RedunCut: Measurement-Driven Sampling and Accuracy Performance Modeling for Low-Cost Live Video Analytics

  2025cites this paper
• KnobTuneX:LLM-Enhanced Automatic Database Tuning via Structured Reasoning*

  2025cites this paper
• ADAMAS: Adaptive Domain-Aware Performance Anomaly Detection in Cloud Service Systems

  2025cites this paper
• Vulcan: Instance-Optimal Systems Heuristics Through LLM-Driven Search

  2025cites this paper
• Coach: Exploiting Temporal Patterns for All-Resource Oversubscription in Cloud Platforms

  2025cites this paper
• ConfigBot: Adaptive Resource Allocation for Robot Applications in Dynamic Environments

  2025cites this paper
• Into the Void: Mapping the Unseen Gaps in High Dimensional Data

  2025cites this paper
• Flora: Efficient Cloud Resource Selection for Big Data Processing Via Job Classification

  2025cites this paper
• Reinforcement Learning for Autonomous Data Pipeline Optimization in Cloud-Native Architectures

  2025cites this paper
• Predicting Performance Variability

  2025cites this paper
• Algorithm Generation via Creative Ideation

  2025cites this paper
• CausalConf: Datasize-Aware Configuration Auto-Tuning for Recurring Big Data Processing Jobs via Adaptive Causal Structure Learning

  2025cites this paper
• Oltp in the cloud: architectures, tradeoffs, and cost

  2025cites this paper
• Intra-Query Runtime Elasticity for Cloud-Native Data Analysis

  2025cites this paper
• Optimizing Cloud Deployment: Blending of IaaS and FaaS for Microservice Architecture

  2025cites this paper
• InferLog: Accelerating LLM Inference for Online Log Parsing via ICL-oriented Prefix Caching

  2025cites this paper
• Sailor: Automating Distributed Training over Dynamic, Heterogeneous, and Geo-distributed Clusters

  2025influential citation
• Optimal Configuration of API Resources in Cloud Native Computing

  2025cites this paper
• Towards Workload-aware Cloud Efficiency: A Large-scale Empirical Study of Cloud Workload Characteristics

  2025cites this paper
• StorageXTuner: An LLM Agent-Driven Automatic Tuning Framework for Heterogeneous Storage Systems

  2025cites this paper
• Assessing and Mitigating Heterogeneity-Driven Security Threats in the Cloud

  2025cites this paper
• Moirai: Optimizing Placement of Data and Compute in Hybrid Clouds

  2025cites this paper
• FlowMoE: A Scalable Pipeline Scheduling Framework for Distributed Mixture-of-Experts Training

  2025influential citation
• Eva: Cost-Efficient Cloud-Based Cluster Scheduling

  2025cites this paper
• Iridescence: Improving Configuration Tuning in the Presence of Confounders for 5G NSA Networks

  2025cites this paper
• Workload Characterization for Resource Optimization of Big Data Analytics: Best Practices, Trends, and Opportunities

  2025cites this paper
• Circinus: Efficient Query Planner for Compound ML Serving

  2025cites this paper
• Iridescent: A Framework Enabling Online System Implementation Specialization

  2025cites this paper
• MOBOS: Co-Optimizing Cost and Execution Time in Serverless Workflow with Multi-Objective Bayesian Optimization

  2025cites this paper
• Cost and performance-effective dynamic VM type selection in auto-scaling using reinforcement learning

  2025cites this paper
• Leveraging Distributional Reinforcement Learning for Performance Optimization of Spark Job Scheduling in Cloud Environment

  2025cites this paper
• Ksurf-Drone: Attention Kalman Filter for Contextual Bandit Optimization in Cloud Resource Allocation

  2025cites this paper
• Efficient and Reuseable Cloud Configuration Search Using Discovery Spaces

  2025influential citation
• ChunkFunc: Dynamic SLO-Aware Configuration of Serverless Functions

  2025cites this paper
• LOFTune: A Low-Overhead and Flexible Approach for Spark SQL Configuration Tuning

  2025cites this paper
• IPA: Inference Pipeline Adaptation to Achieve High Accuracy and Cost-Efficiency

  2025cites this paper
• Experimentally Evaluating the Resource Efficiency of Big Data Autoscaling

  2024cites this paper
• EcoEdgeInfer: Dynamically Optimizing Latency and Sustainability for Inference on Edge Devices

  2024cites this paper
• COTuner: Joint Optimization of Resource Configuration and Software Parameters for Recurring Streaming Jobs on the Cloud

  2024influential citation
• TuneChain: An Online Configuration Auto-Tuning Approach for Permissioned Blockchain Systems

  2024cites this paper
• FaaSConf: QoS-aware Hybrid Resources Configuration for Serverless Workflows

  2024cites this paper
• DeepCAT+: A Low-Cost and Transferrable Online Configuration Auto-Tuning Approach for Big Data Frameworks

  2024cites this paper
• HYPPO: Using Equivalences to Optimize Pipelines in Exploratory Machine Learning

  2024cites this paper
• Measurement-based Resource Allocation and Control in Data Centers: A Survey

  2024influential citation
• CNN Training Latency Prediction Using Hardware Metrics on Cloud GPUs

  2024cites this paper
• Computing in the Era of Large Generative Models: From Cloud-Native to AI-Native

  2024cites this paper
• Agile-Ant: Self-managing Distributed Cache Management for Cost Optimization of Big Data Applications

  2024cites this paper
• Joint Optimization of Parallelism and Resource Configuration for Serverless Function Steps

  2024cites this paper
• TIE: Fast Experiment-Driven ML-Based Configuration Tuning for In-Memory Data Analytics

  2024influential citation
• Self-Provisioning Infrastructures for the Next Generation Serverless Computing

  2024cites this paper
• Fluid-Shuttle: Efficient Cloud Data Transmission Based on Serverless Computing Compression

  2024cites this paper
• A lightweight performance proxy for deep‐learning model training on Amazon SageMaker

  2024cites this paper
• A learned cost model for big data query processing

  2024cites this paper
• Opportunities and Challenges in Service Layer Traffic Engineering

  2024cites this paper
• Righteous: Automatic Right-Sizing for Complex Edge Deployments

  2024cites this paper
• Towards Cloud Efficiency with Large-scale Workload Characterization

  2024cites this paper
• Demeter: Resource-Efficient Distributed Stream Processing under Dynamic Loads with Multi-Configuration Optimization

  2024cites this paper
• Memory orchestration mechanisms in serverless computing: a taxonomy, review and future directions

  2024cites this paper
• Proactive Auto-Scaling for Service Function Chains in Cloud Computing Based on Deep Learning

  2024cites this paper
• Shabari: Delayed Decision-Making for Faster and Efficient Serverless Functions

  2024cites this paper
• Integrating Bayesian Optimization and Machine Learning for the Optimal Configuration of Cloud Systems

  2024influential citation
• A Model for Query Execution Over Heterogeneous Instances

  2024cites this paper
• ENOVA: Autoscaling towards Cost-effective and Stable Serverless LLM Serving

  2024cites this paper
• Proactive Auto-Scaling for Delay-Sensitive IoT Applications Over Edge Clouds

  2024cites this paper
• Automating Cloud Deployment for Real-Time Online Foundation Model Inference

  2024influential citation
• OPPerTune: Post-Deployment Configuration Tuning of Services Made Easy

  2024influential citation
• QFusor: A UDF Optimizer Plugin for SQL Databases

  2024cites this paper
• Adaptive Online Cache Capacity Optimization via Lightweight Working Set Size Estimation at Scale

  2023cites this paper
• Serverless Computing: State-of-the-Art, Challenges and Opportunities

  2023influential citation
• Auto-tuning elastic applications in production

  2023cites this paper
• Measuring the Impact of Gradient Accumulation on Cloud-based Distributed Training

  2023cites this paper
• Smartpick: Workload Prediction for Serverless-enabled Scalable Data Analytics Systems

  2023influential citation
• Mimir: Finding Cost-efficient Storage Configurations in the Public Cloud

  2023cites this paper
• Online Learning for Right-Sizing Serverless Function Invocations

  2023cites this paper
• Enabling Long-term Fairness in Dynamic Resource Allocation

  2023cites this paper
• CAMEO: A Causal Transfer Learning Approach for Performance Optimization of Configurable Computer Systems

  2023cites this paper
• DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining

  2023cites this paper
• FaaSDeliver: Cost-Efficient and QoS-Aware Function Delivery in Computing Continuum

  2023cites this paper
• Hyper-parameter Tuning for Adversarially Robust Models

  2023cites this paper
• A Multilayer Perceptron Model for Station Grouping in IEEE 802.11ah Networks

  2023cites this paper
• COUNSEL: Cloud Resource Configuration Management using Deep Reinforcement Learning

  2023influential citation
• Cougar: A General Framework for Jobs Optimization In Cloud

  2023cites this paper
• TuneOS: Auto-Tuning Operating System Parameters for Varying Database Workloads

  2023cites this paper
• Dense or Sparse : Elastic SPMM Implementation for Optimal Big-Data Processing

  2023cites this paper
• HeteroScore: Evaluating and Mitigating Cloud Security Threats Brought by Heterogeneity

  2023cites this paper
• Intent-Driven Orchestration: Enforcing Service Level Objectives for Cloud Native Deployments

  2023cites this paper
• Configuration and Placement of Serverless Applications Using Statistical Learning

  2023cites this paper
• Decoupling the All-Reduce Primitive for Accelerating Distributed Deep Learning

  2023cites this paper
• Memtrade: Marketplace for Disaggregated Memory Clouds

  2023cites this paper
• Saba: Rethinking Datacenter Network Allocation from Application's Perspective

  2023cites this paper
• Toulouse: Learning Join Order Optimization Policies for Rule-based Data Engines

  2023cites this paper
• Selecting Efficient Cluster Resources for Data Analytics: When and How to Allocate for In-Memory Processing?

  2023cites this paper
• Scavenger: A Cloud Service For Optimizing Cost and Performance of ML Training

  2023cites this paper