PACMan: Coordinated Memory Caching for Parallel Jobs

No abstract is available for this paper.

• Publication year

  2012

• Venue

  Symposium on Networked Systems Design and Implementation

• Publication date

  2012-04-25

• Fields of study

  Computer Science

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Scarlett: coping with skewed content popularity in mapreduce clusters

  2011cited by this paper
• Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center

  2011cited by this paper
• The case for RAMClouds: scalable high-performance storage entirely in DRAM

  2010cited by this paper
• Reining in the Outliers in Map-Reduce Clusters using Mantri

  2010cited by this paper
• Piccolo: Building Fast, Distributed Programs with Partitioned Tables

  2010cited by this paper
• Building fast, distributed programs with partitioned tables

  2010cited by this paper
• Spark: Cluster Computing with Working Sets

  2010cited by this paper
• SCOPE: easy and efficient parallel processing of massive data sets

  2008cited by this paper
• MapReduce: simplified data processing on large clusters

  2008cited by this paper
• Pig latin: a not-so-foreign language for data processing

  2008cited by this paper
• Dryad: distributed data-parallel programs from sequential building blocks

  2007cited by this paper
• Serverless Network File Systems

  2006cited by this paper
• The Zebra Striped Network File System

  2002cited by this paper
• Role of Aging, Frequency, and Size in Web Cache Replacement Policies

  2001cited by this paper
• Evaluating content management techniques for Web proxy caches

  2000cited by this paper
• Connection Scheduling in Web Servers

  1999cited by this paper
• Cost-Aware WWW Proxy Caching Algorithms

  1997cited by this paper
• Removal policies in network caches for World-Wide Web documents

  1996cited by this paper
• The Zebra striped network file system

  1994cited by this paper
• Zebra: A Striped Network File System

  1992cited by this paper
• Global Memory Management in Client-Server Database Architectures

  1992cited by this paper
• Main Memory Database Systems: An Overview

  1992cited by this paper
• Caching in the Sprite network file system

  1987cited by this paper
• A Study of Replacement Algorithms for Virtual-Storage Computer

  1966influential reference

• Decision Shuffle: Efficient Pre-scheduling System for Push-based Shuffle in DAG Computing Frameworks

  2025cites this paper
• FEDeS: Fair, Efficient, and Reliable Multi-Tenant Deep Learning Training with Serverless Computing

  2025cites this paper
• Kspeed: Beating I/O Bottlenecks of Data Provisioning for RDMA Training Clusters

  2024cites this paper
• Improving reading performance by file prefetching mechanism in distributed cache systems

  2024cites this paper
• Can Increasing the Hit Ratio Hurt Cache Throughput?

  2024cites this paper
• EdgStr: Automating Client-Cloud to Client-Edge-Cloud Transformation

  2024cites this paper
• Fairness-Efficiency Scheduling for Pay-as-You-Go Shared Caching Systems With Long-Term Fairness Guarantees

  2024cites this paper
• Distributed cache strategy based on LT codes under spark platform

  2024cites this paper
• Adaptive and Scalable Caching With Erasure Codes in Distributed Cloud-Edge Storage Systems

  2023cites this paper
• Vineyard: Optimizing Data Sharing in Data-Intensive Analytics

  2023cites this paper
• Overview of Caching Mechanisms to Improve Hadoop Performance

  2023cites this paper
• Cost-based Data Prefetching and Scheduling in Big Data Platforms over Tiered Storage Systems

  2023influential citation
• HAAC: Highly Available Access to Credentials, with DHTs

  2023cites this paper
• of the 17th USENIX Symposium on Operating Systems Design and Implementation

  2023influential citation
• Take Out the TraChe: Maximizing (Tra)nsactional Ca(che) Hit Rate

  2023influential citation
• SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

  2023cites this paper
• AMS: Adaptive Multiget Scheduling Algorithm for Distributed Key-Value Stores

  2023cites this paper
• Hadoop-Oriented SVM-LRU (H-SVM-LRU): An Intelligent Cache Replacement Algorithm to Improve MapReduce Performance

  2023cites this paper
• Bottleneck-Aware Non-Clairvoyant Coflow Scheduling With Fai

  2023cites this paper
• Tereis: A Package-Based Scheduling in Deep Learning Systems

  2023cites this paper
• A Novel Cache and Consistency Mechanism for IoT Time Series Data

  2023cites this paper
• PickyMan: A Preemptive Scheduler for Deep Learning Jobs on GPU Clusters

  2022cites this paper
• Cost-Efficient and Latency-Aware Event Consuming in Workload-Skewed Distributed Event Queues

  2022cites this paper
• Towards a Highly Available Model for Processing Service Requests Based on Distributed Hash Tables

  2022cites this paper
• Multi Resource Scheduling with Task Cloning in Heterogeneous Clusters

  2022cites this paper
• LPW: an efficient data-aware cache replacement strategy for Apache Spark

  2022cites this paper
• Exploring the Impacts of Software Cache Configuration for In-line Compressed Arrays

  2022cites this paper
• Coflow scheduling and placement for packet-switched optical datacenter networks

  2022cites this paper
• IMapC: Inner MAPping Combiner to Enhance the Performance of MapReduce in Hadoop

  2022cites this paper
• Tripod: Harmonizing Job Scheduling and Data Caching for Analytics Frameworks

  2022cites this paper
• Data Locality in High Performance Computing, Big Data, and Converged Systems: An Analysis of the Cutting Edge and a Future System Architecture

  2022cites this paper
• Cachew: Machine Learning Input Data Processing as a Service

  2022cites this paper
• Parallelism-Optimizing Data Placement for Faster Data-Parallel Computations

  2022influential citation
• tf.data: A Machine Learning Data Processing Framework

  2021cites this paper
• Trident: Task Scheduling over Tiered Storage Systems in Big Data Platforms

  2021influential citation
• Carousel Memory: Rethinking the Design of Episodic Memory for Continual Learning

  2021cites this paper
• QoS-Aware Data Placement for MapReduce Applications in Geo-Distributed Data Centers

  2021cites this paper
• Network Cost-Aware Geo-Distributed Data Analytics System

  2021cites this paper
• A Holistic Approach to Data Access for Cloud-Native Analytics and Machine Learning

  2021cites this paper
• Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics

  2021cites this paper
• Efficient shuffle management for DAG computing frameworks based on the FRQ model

  2021cites this paper
• Sticky Policies: A Survey

  2020cites this paper
• Application and Storage-Aware Data Placement and Job Scheduling for Hadoop Clusters

  2020cites this paper
• Achieving Load-Balanced, Redundancy-Free Cluster Caching with Selective Partition

  2020influential citation
• Detecting cache-related bugs in Spark applications

  2020cites this paper
• Bottleneck-Aware Coflow Scheduling Without Prior Knowledge

  2020cites this paper
• Data-Intensive Task Scheduling for Heterogeneous Big Data Analytics in IoT System

  2020cites this paper
• Balancing Fairness and Efficiency for Cache Sharing in Semi-external Memory System

  2020cites this paper
• Distributed Applications and Interoperable Systems: 20th IFIP WG 6.1 International Conference, DAIS 2020, Held as Part of the 15th International Federated Conference on Distributed Computing Techniques, DisCoTec 2020, Valletta, Malta, June 15–19, 2020, Proceedings

  2020influential citation
• TailX: Scheduling Heterogeneous Multiget Queries to Improve Tail Latencies in Key-Value Stores

  2020cites this paper
• RepBun: Load-Balanced, Shuffle-Free Cluster Caching for Structured Data

  2020cites this paper
• A Task-Aware Fine-Grained Storage Selection Mechanism for In-Memory Big Data Computing Frameworks

  2020cites this paper
• Compilation-assisted performance acceleration for data analytics

  2020cites this paper
• Quiver: An Informed Storage Cache for Deep Learning

  2020cites this paper
• Architecture of a distributed storage that combines file system, memory and computation in a single layer

  2020cites this paper
• InfiniCache: Exploiting Ephemeral Serverless Functions to Build a Cost-Effective Memory Cache

  2020cites this paper
• Building An Elastic Query Engine on Disaggregated Storage

  2020cites this paper
• OCam: Out-of-core coordinate descent algorithm for matrix completion

  2020cites this paper
• Guaranteeing the response deadline for general aggregation trees

  2020cites this paper
• Limiting Global Warming by Improving Data-Centre Software

  2020cites this paper
• In-Memory Cache and Intra-Node Combiner Approaches for Optimizing Execution Time in High-Performance Computing

  2020cites this paper
• Incremental Sliding Window Analytics

  2019cites this paper
• Fast Coflow Scheduling via Traffic Compression and Stage Pipelining in Datacenter Networks

  2019cites this paper
• Maximizing Page-Level Cache Hit Ratios in LargeWeb Services

  2019cites this paper
• Yugong: Geo-Distributed Data and Job Placement at Scale

  2019cites this paper
• Scheduling and Prefetching in Hadoop with Block Access Pattern Awareness and Global Memory Sharing with Load Balancing Scheme

  2019influential citation
• Enhancing MapReduce Fault Recovery Through Binocular Speculation

  2019cites this paper
• Caching in the Multiverse Mania

  2019influential citation
• Automating Distributed Tiered Storage Management in Cluster Computing

  2019cites this paper
• BoPF: Mitigating the Burstiness-Fairness Tradeoff in Multi-Resource Clusters

  2019cites this paper
• AutoCache: Employing Machine Learning to Automate Caching in Distributed File Systems

  2019influential citation
• Semi-Clairvoyant Scheduling in Data Analytics Systems

  2019cites this paper
• The Power of d Choices in Scheduling for Data Centers with Heterogeneous Servers

  2019cites this paper
• Terra: Scalable Cross-Layer GDA Optimizations

  2019cites this paper
• DYRS: Bandwidth-Aware Disk-to-Memory Migration of Cold Data in Big-Data File Systems

  2019influential citation
• A Workload-aware Resource Management and Scheduling System for Big Data Analysis

  2019cites this paper
• Towards Efficient and Scalable Data-Intensive Content Delivery: State-of-the-Art, Issues and Challenges

  2019cites this paper
• PaRS: A Popularity-Aware Redundancy Scheme for In-Memory Stores

  2019cites this paper
• Tiresias: A GPU Cluster Manager for Distributed Deep Learning

  2019cites this paper
• LDM: Lineage-Aware Data Management in Multi-tier Storage Systems

  2019cites this paper
• A survey on cost-effective context-aware distribution of social data streams over energy-efficient data centres

  2019cites this paper
• Transactional Streaming: Managing Push-Based Workloads with Shared Mutable State in a Distributed Setting

  2019cites this paper
• Eirene: Improving Short Job Latency Performance with Coordinated Cold Data Migration and Scheduler-Aware Task Cloning

  2019cites this paper
• Cloud-based parallel power flow calculation using resilient distributed datasets and directed acyclic graph

  2019cites this paper
• Towards Dependency-Aware Cache Management for Data Analytics Applications

  2019influential citation
• Improving Performance Predictability in Cloud Data Stores

  2019cites this paper
• Data Prefetching and Eviction Mechanisms of In-Memory Storage Systems Based on Scheduling for Big Data Processing

  2019cites this paper
• Global Model Push Pull Worker 1 Worker 2 Worker 3 Training Data Local Model PS 1 PS 2

  2019cites this paper
• AViC: a cache for adaptive bitrate video

  2019cites this paper
• An Experimental Evaluation of Garbage Collectors on Big Data Applications

  2019cites this paper
• Task-Aware TCP in Data Center Networks

  2019cites this paper
• Multivariate modeling and two-level scheduling of analytic queries

  2019cites this paper
• D3N: A multi-layer cache for the rest of us

  2019influential citation
• Scheduling Coflows with Incomplete Information

  2018cites this paper
• Ignem: Upward Migration of Cold Data in Big Data File Systems

  2018influential citation
• Efficient shuffle management with SCache for DAG computing frameworks

  2018cites this paper
• Practical Cross Program Memoization with KeyChain

  2018cites this paper
• OpuS: Fair and Efficient Cache Sharing for In-Memory Data Analytics

  2018cites this paper
• Dynamic Query RePlanning Using QOOP

  2018cites this paper
• Disk blocks Abstraction level Physical disk offset JVM Java Obj . Java Obj . Java Obj . Java Obj . Java Obj

  2018cites this paper