Adaptive Disk I/O Scheduling for MapReduce in Virtualized Environment

No abstract is available for this paper.

• Publication year

  2011

• Venue

  International Conference on Parallel Processing

• Publication date

  2011-09-13

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/ICPP.2011.86
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Towards Pay-As-You-Consume Cloud Computing

  2011cited by this paper
• Comet: batched stream processing for data intensive distributed computing

  2010cited by this paper
• On disk I/O scheduling in virtual machines

  2010influential reference
• Does virtualization make disk scheduling passé?

  2010influential reference
• LEEN: Locality/Fairness-Aware Key Partitioning for MapReduce in the Cloud

  2010cited by this paper
• CLOUDLET: towards mapreduce implementation on virtual machines

  2009cited by this paper
• Evaluating MapReduce on Virtual Machines: The Hadoop Case

  2009cited by this paper
• Wave Computing in the Cloud

  2009cited by this paper
• MapReduce: simplified data processing on large clusters

  2008cited by this paper
• Improving MapReduce Performance in Heterogeneous Environments

  2008cited by this paper
• Pig latin: a not-so-foreign language for data processing

  2008cited by this paper
• Scheduling I/O in virtual machine monitors

  2008cited by this paper
• Parallel PSO using MapReduce

  2007cited by this paper
• Dynamic Scheduling of Virtual Machines Running HPC Workloads in Scientific Grids

  2007cited by this paper
• Data-Intensive Supercomputing: The case for DISC

  2007cited by this paper
• Enhancements to Linux I/O Scheduling

  2005cited by this paper
• Workload Dependent Performance Evaluation of the Linux 2 . 6 I / O Schedulers

  2004influential reference
• Xen and the art of virtualization

  2003cited by this paper
• Adaptive disk scheduling in a multimedia DBMS

  2003cited by this paper
• Ieee Transactions on Knowledge and Data Engineering 1 Self-learning Disk Scheduling

  year unknowncited by this paper
• Automatic I / O Scheduler Selection for Latency and Bandwidth Optimization

  year unknowncited by this paper

• Dynamic Job Ordering and Slot Configurations for MapReduce Workloads

  2024cites this paper
• Learnings from an Under the Hood Analysis of an Object Storage Node IO Stack

  2022cites this paper
• Application and Storage-Aware Data Placement and Job Scheduling for Hadoop Clusters

  2020cites this paper
• Using independent resource allocation strategies to solve conflicts of Hadoop distributed architecture in virtualization

  2020cites this paper
• Phase-Reconfigurable Shuffle Optimization for Hadoop MapReduce

  2020cites this paper
• Dependency-Aware Data Locality for MapReduce

  2018cites this paper
• Minimizing the MakeSpan of Multiple MapReduce Jobs through Job Ordering Technique

  2017cites this paper
• Optimized Speculative Execution to Improve Performance of MapReduce Jobs on Virtualized Computing Environment

  2017cites this paper
• IOPriority: To The Device and Beyond

  2017cites this paper
• YASMIN: Efficient Intra-node Communication Using Generic Sockets

  2017cites this paper
• MAPREDUCE WORKLOAD FOR DYNAMIC JOB ORDERING AND SLOT CONFIGURATION

  2017cites this paper
• Host managed contention avoidance storage solutions for Big Data

  2017influential citation
• A performance-satisfied and affection-aware MapReduce allocation scheme for intelligent information applications

  2016cites this paper
• VMCD: A Virtual Multi-Channel Disk I/O Scheduling Method for Virtual Machines

  2016cites this paper
• Um estudo sobre a contenção de disco em ambientes virtualizados utilizando contêineres e seu impacto sobre aplicações MapReduce

  2016cites this paper
• An Adaptive Efficiency-Fairness Meta-Scheduler for Data-Intensive Computing

  2016cites this paper
• Managing contamination delay to improve Timing Speculation architectures

  2016influential citation
• Bulk I/O Storage Management for Big Data Applications

  2016cites this paper
• On the Dynamic Shifting of the MapReduce Timeout

  2016cites this paper
• Governing energy consumption in Hadoop through CPU frequency scaling: An analysis

  2016cites this paper
• Big data infrastructure: Storage considerations

  2016cites this paper
• Evolutionary approaches to signal decomposition in an application service management system

  2015cites this paper
• Context‐aware scheduling in MapReduce: a compact review

  2015cites this paper
• Crowdsourced multimedia content: Resource allocation and data transmission

  2015cites this paper
• Adaptive Consistency Approaches for Cloud Computing Platform

  2015cites this paper
• Approach to Big Data Applications on Cloud System

  2015cites this paper
• Gemini: An Adaptive Performance-Fairness Scheduler for Data-Intensive Cluster Computing

  2015cites this paper
• Mitigate I/O access pattern divergence with heterogeneous architecture in HDFS

  2015cites this paper
• Network Aware Scheduling for Virtual Machine Workloads with Interference Models

  2015cites this paper
• Spatial Locality Aware Disk Scheduling in Virtualized Environment

  2015cites this paper
• I/O Characteristics and Implications of Big Data Processing on Virtualized Environments

  2015cites this paper
• Big Data Platform of a System Recommendation in Cloud Environment

  2015cites this paper
• Dependency-Aware Data Locality for MapReduce

  2014cites this paper
• A dynamic block device reconfiguration algorithm in virtual MapReduce cluster

  2014cites this paper
• DynamicMR: A Dynamic Slot Allocation Optimization Framework for MapReduce Clusters

  2014cites this paper
• Proactive workload management in dynamic virtualized environments

  2014cites this paper
• Priority IO Scheduling in the Cloud

  2013cites this paper
• Design and performance evaluation for Hadoop clusters on virtualized environment

  2013cites this paper
• Black box scheduling for resource intensive virtual machine workloads with interference models

  2013cites this paper
• Monetary Cost Optimizations for Hosting Workflow-as-a-Service in IaaS Clouds

  2013cites this paper
• Exploiting Spatial Locality to Improve Disk Efficiency in Virtualized Environments

  2013cites this paper
• Handling partitioning skew in MapReduce using LEEN

  2013cites this paper
• Understanding Vertical Scalability of I/O Virtualization for MapReduce Workloads: Challenges and Opportunities

  2013cites this paper
• Flubber: Two-level disk scheduling in virtualized environment

  2013cites this paper
• Consistency in the Cloud: When Money Does Matter!

  2013cites this paper
• MROrder: Flexible Job Ordering Optimization for Online MapReduce Workloads

  2013cites this paper
• Managing consistency for big data applications : tradeoffs and self-adaptiveness. (Gérer la cohérence pour les applications big data : compromis et auto-adaptabilité)

  2013cites this paper
• An adaptive machine learning on Map-Reduce framework for improving performance of large-scale data analysis on EC2

  2013cites this paper
• Evaluating MapReduce System Performance: A Simulation Approach

  2012cites this paper
• Assessing MapReduce for Internet Computing: A Comparison of Hadoop and BitDew-MapReduce

  2012cites this paper
• Minimizing Cost of Virtual Machines for Deadline-Constrained MapReduce Applications in the Cloud

  2012cites this paper
• vHadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

  2012cites this paper
• Maestro: Replica-Aware Map Scheduling for MapReduce

  2012cites this paper
• Efficient Disk I/O Scheduling with QoS Guarantee for Xen-based Hosting Platforms

  2012cites this paper