HOMR: a hybrid approach to exploit maximum overlapping in MapReduce over high performance interconnects

No abstract is available for this paper.

• Publication year

  2014

• Venue

  International Conference on Supercomputing

• Publication date

  2014-06-10

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1145/2597652.2597684
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• High-Performance RDMA-based Design of Hadoop MapReduce over InfiniBand

  2013cited by this paper
• JVM-Bypass for Efficient Hadoop Shuffling

  2013cited by this paper
• High-Performance Design of Hadoop RPC with RDMA over InfiniBand

  2013cited by this paper
• Can Parallel Replication Benefit Hadoop Distributed File System for High Performance Interconnects?

  2013cited by this paper
• High performance RDMA-based design of HDFS over InfiniBand

  2012cited by this paper
• High-Performance Design of HBase with RDMA over InfiniBand

  2012cited by this paper
• Hadoop acceleration through network levitated merge

  2011cited by this paper
• Can MPI Benefit Hadoop and MapReduce Applications?

  2011cited by this paper
• The Hadoop Distributed File System

  2010cited by this paper
• Providing a cloud network infrastructure on a supercomputer

  2010cited by this paper
• Can High-Performance Interconnects Benefit Hadoop Distributed File System ?

  2010cited by this paper
• HPMR: Prefetching and pre-shuffling in shared MapReduce computation environment

  2009cited by this paper
• MapReduce: simplified data processing on large clusters

  2008cited by this paper
• Bigtable: a distributed storage system for structured data

  2006cited by this paper

• Decision Shuffle: Efficient Pre-scheduling System for Push-based Shuffle in DAG Computing Frameworks

  2025cites this paper
• xCCL: A Survey of Industry-Led Collective Communication Libraries for Deep Learning

  2023cites this paper
• OPS: Optimized Shuffle Management System for Apache Spark

  2020cites this paper
• Approaches of enhancing interoperations among high performance computing and big data analytics via augmentation

  2019cites this paper
• Networking and communication challenges for post-exascale systems

  2018cites this paper
• Multilevel Data Processing Using Parallel Algorithms for Analyzing Big Data in High-Performance Computing

  2018cites this paper
• Cutting the Tail: Designing High Performance Message Brokers to Reduce Tail Latencies in Stream Processing

  2018cites this paper
• An intelligent scheme for assigning queries

  2018cites this paper
• Spark-uDAPL: Cost-Saving Big Data Analytics on Microsoft Azure Cloud with RDMA Networks*

  2018cites this paper
• Swift-X: Accelerating OpenStack Swift with RDMA for Building an Efficient HPC Cloud

  2017cites this paper
• NVMD: Non-volatile memory assisted design for accelerating MapReduce and DAG execution frameworks on HPC systems

  2017cites this paper
• Performance characterization and acceleration of big data workloads on OpenPOWER system

  2017cites this paper
• Customized Filesystem with Dynamic Stripe Strategies on Lustre-Based Hadoop

  2017cites this paper
• MR-Advisor: A comprehensive tuning, profiling, and prediction tool for MapReduce execution frameworks on HPC clusters

  2017cites this paper
• Leveraging Adaptive I/O to Optimize Collective Data Shuffling Patterns for Big Data Analytics

  2017influential citation
• EclipseMR: Distributed and Parallel Task Processing with Consistent Hashing

  2017cites this paper
• A Comprehensive Study of MapReduce Over Lustre for Intermediate Data Placement and Shuffle Strategies on HPC Clusters

  2017influential citation
• A Cross-Jobs-Cross-Phases Map-Reduce Scheduling Algorithm in Heterogeneous Cloud

  2017cites this paper
• MR-Advisor: A Comprehensive Tuning Tool for Advising HPC Users to Accelerate MapReduce Applications on Supercomputers

  2016cites this paper
• Hadoop on HPC: Integrating Hadoop and Pilot-Based Dynamic Resource Management

  2016cites this paper
• BlueDBM

  2016cites this paper
• Can Non-volatile Memory Benefit MapReduce Applications on HPC Clusters?

  2016cites this paper
• Impact of HPC Cloud Networking Technologies on Accelerating Hadoop RPC and HBase

  2016cites this paper
• On exploring efficient shuffle design for in-memory MapReduce

  2016cites this paper
• Characterizing and benchmarking stand-alone Hadoop MapReduce on modern HPC clusters

  2016cites this paper
• Experiences and Benefits of Running RDMA Hadoop and Spark on SDSC Comet

  2016cites this paper
• Towards Memory-Optimized Data Shuffling Patterns for Big Data Analytics

  2016cites this paper
• Analysis and evaluation of MapReduce solutions on an HPC cluster

  2016influential citation
• ALGORITHMS USING MAP REDUCE-A SURVEY

  2016cites this paper
• Designing and Modeling High-Performance MapReduce and DAG Execution Framework on Modern HPC Systems

  2016influential citation
• Topic Modeling and Visualization for Big Data in Social Sciences

  2016cites this paper
• Accelerating Big Data Processing on Modern Clusters

  2015cites this paper
• BlueDBM: An appliance for Big Data analytics

  2015cites this paper
• Accelerating Iterative Big Data Computing Through MPI

  2015cites this paper
• A Plugin-Based Approach to Exploit RDMA Benefits for Apache and Enterprise HDFS

  2015cites this paper
• High-Performance Design of YARN MapReduce on Modern HPC Clusters with Lustre and RDMA

  2015influential citation
• Big data analytics: a literature review

  2015cites this paper
• Accelerating Spark with RDMA for Big Data Processing: Early Experiences

  2014influential citation
• A Micro-benchmark Suite for Evaluating Hadoop MapReduce on High-Performance Networks

  2014influential citation
• Phadoop : Power Balancing Cloud-Based Workloads by Sandeep Reddy Kandula

  2014cites this paper
• Performance Modeling for RDMA-Enhanced Hadoop MapReduce

  2014cites this paper
• MapReduce over Lustre: Can RDMA-Based Approach Benefit?

  2014cites this paper
• 2015 Ieee International Conference on Big Data (big Data) Performance Characterization and Acceleration of In-memory File Systems for Hadoop and Spark Applications on Hpc Clusters*

  year unknowncites this paper
• 2016 Ieee International Conference on Big Data (big Data) Efficient Data Access Strategies for Hadoop and Spark on Hpc Cluster with Heterogeneous Storage*

  year unknowncites this paper
• MIT Open Access Articles BlueDBM: An Appliance for Big Data Analytics

  year unknowncites this paper
• 2016 Ieee International Conference on Big Data (big Data) High-performance Design of Apache Spark with Rdma and Its Benefits on Various Workloads

  year unknowncites this paper