MapReduce in MPI for Large-scale graph algorithms

No abstract is available for this paper.

• Publication year

  2011

• Venue

  Parallel Computing

• Publication date

  2011-09-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1016/j.parco.2011.02.004
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Book Reviews: Data-Intensive Text Processing with MapReduce by Jimmy Lin and Chris Dyer

  2010cited by this paper
• Towards Efficient MapReduce Using MPI

  2009cited by this paper
• Graph Twiddling in a MapReduce World

  2009influential reference
• PEGASUS: A Peta-Scale Graph Mining System Implementation and Observations

  2009cited by this paper
• High Performance Parallel Computing with Clouds and Cloud Technologies

  2009cited by this paper
• MapReduce: simplified data processing on large clusters

  2008cited by this paper
• A scalable parallel framework for analyzing terascale molecular dynamics simulation trajectories

  2008cited by this paper
• Proceedings of the 2008 ACM/IEEE conference on Supercomputing

  2008cited by this paper
• Software and Algorithms for Graph Queries on Multithreaded Architectures

  2007influential reference
• An Experimental Study of A Parallel Shortest Path Algorithm for Solving Large-Scale Graph Instances

  2007cited by this paper
• The Parallel BGL : A Generic Library for Distributed Graph Computations

  2005cited by this paper
• A Survey of Eigenvector Methods for Web Information Retrieval

  2005cited by this paper
• R-MAT: A Recursive Model for Graph Mining

  2004cited by this paper
• An Overview of Trilinos

  2003cited by this paper
• Delta-Stepping: A Parallel Single Source Shortest Path Algorithm

  1998cited by this paper
• Modern Software Tools for Scientific Computing

  1997cited by this paper
• Efficient Management of Parallelism in Object-Oriented Numerical Software Libraries

  1997cited by this paper
• A simple parallel algorithm for the maximal independent set problem

  1985cited by this paper
• Flows in Networks

  1963cited by this paper
• ON A ROUTING PROBLEM

  1958cited by this paper

• Towards Hybrid Architectures for Big Data Analytics: Insights From Spark-MPI Integration

  2025cites this paper
• GPU-Accelerated Dynamic Frontier PageRank

  2025cites this paper
• A Network-Based, Data-Driven Methodology for Identifying and Ranking Freight Bottlenecks

  2024cites this paper
• An Incrementally Expanding Approach for Updating PageRank on Dynamic Graphs

  2024cites this paper
• Efficient GPU Implementation of Static and Incrementally Expanding DF-P PageRank for Dynamic Graphs

  2024cites this paper
• DF* PageRank: Improved Incrementally Expanding Approaches for Updating PageRank on Dynamic Graphs

  2024cites this paper
• Scalable Fault-Tolerant MapReduce

  2024cites this paper
• Lock-free Computation of PageRank in Dynamic Graphs

  2024cites this paper
• Peachy Parallel Assignments (EduHPC 2023)

  2023cites this paper
• TEE-Graph: efficient privacy and ownership protection for cloud-based graph spectral analysis

  2023cites this paper
• Parallel Integrity Authentication Data Structure Construction for Encrypted Range Queries

  2023cites this paper
• Parallel-Friendly and Work-Efficient Single Source Shortest Path Algorithm on Single-Node System

  2022cites this paper
• Data Locality in High Performance Computing, Big Data, and Converged Systems: An Analysis of the Cutting Edge and a Future System Architecture

  2022influential citation
• Optimizing All-to-All Collective Communication on Tianhe Supercomputer

  2022cites this paper
• Parallel Multiphysics Simulation for the Stabilized Optimal Transportation Meshfree (OTM)

  2022cites this paper
• An alternative C++-based HPC system for Hadoop MapReduce

  2022cites this paper
• Big optimization with genetic algorithms: Hadoop, Spark, and MPI

  2021cites this paper
• Rendezvous algorithms for large-scale modeling and simulation

  2021cites this paper
• XSP: Fast SSSP Based on Communication-Computation Collaboration

  2021cites this paper
• Power-Law Distributed Graph Generation With MapReduce

  2021cites this paper
• Connecting MapReduce Computations to Realistic Machine Models

  2020cites this paper
• Memory-Efficient and Skew-Tolerant MapReduce Over MPI for Supercomputing Systems

  2020cites this paper
• A survey of algorithms for transforming molecular dynamics data into metadata for in situ analytics based on machine learning methods

  2020cites this paper
• An Alternative C++ based HPC system for Hadoop MapReduce

  2020cites this paper
• XPySom: High-Performance Self-Organizing Maps

  2020cites this paper
• Performance optimization of non-equilibrium ionization simulations from MapReduce and GPU acceleration

  2020cites this paper
• Building Graphs at a Large Scale: Union Find Shuffle

  2020cites this paper
• High Performance Cluster Computing for MapReduce

  2020influential citation
• PACC: Large scale connected component computation on Hadoop and Spark

  2020cites this paper
• A Survey of Singular Value Decomposition Methods for Distributed Tall/Skinny Data

  2020cites this paper
• DisGCo

  2020cites this paper
• A MapReduce Algorithm for Minimum Vertex Cover Problems and Its Randomization

  2020cites this paper
• A model of k-mer surprisal to quantify local sequence information content surrounding splice regions

  2020cites this paper
• Modeling and Research of Processing Big Data Sets in Distributed Information Systems

  2020cites this paper
• Contribution to High Performance Computing and Big Data Infrastructure Convergence. (Contribution à la convergence d'infrastructure entre le calcul haute performance et le traitement de données a large échelle)

  2019cites this paper
• A Brief Survey of Algorithms, Architectures, and Challenges toward Extreme-scale Graph Analytics

  2019cites this paper
• A survey of current challenges in partitioning and processing of graph-structured data in parallel and distributed systems

  2019cites this paper
• Toward High-Performance Computing and Big Data Analytics Convergence: The Case of Spark-DIY

  2019cites this paper
• Edge-Based Shortest Path Caching for Location-Based Services

  2019cites this paper
• Blaze: Simplified High Performance Cluster Computing

  2019influential citation
• Big Data and HPC Convergence for Smart Infrastructures: A Review and Proposed Architecture

  2019cites this paper
• Locality-aware and load-balanced static task scheduling for MapReduce

  2019influential citation
• Classifying Pedagogical Material to Improve Adoption of Parallel and Distributed Computing Topics

  2019cites this paper
• High-Performance I/O Programming Models for Exascale Computing

  2019cites this paper
• Desarrollo de algoritmos genéticos utilizando diferentes frameworks de MapReduce: MPI vs. Hadoop

  2019cites this paper
• Review of Graph Processing Frameworks

  2018cites this paper
• A Scalable Multi-Granular Data Model for Data Parallel Workflows

  2018cites this paper
• MapReduce with Components for Processing Big Graphs

  2018cites this paper
• Achieving Performance and Programmability for MapReduce(-Like) Frameworks

  2018cites this paper
• MapReduce with Components for Processing Big Graphs

  2018cites this paper
• An Improved Index Based on MapReduce for Path Queries in Public Transportation Networks

  2018cites this paper
• Scalable Graph Processing Frameworks

  2018cites this paper
• Mimir+: An Optimized Framework of MapReduce on Heterogeneous High-Performance Computing System

  2018cites this paper
• Comparing load-balancing algorithms for MapReduce under Zipfian data skews

  2018cites this paper
• Spark-DIY: A Framework for Interoperable Spark Operations with High Performance Block-Based Data Models

  2018cites this paper
• Alignment-free clustering of large data sets of unannotated protein conserved regions using minhashing

  2018cites this paper
• The MapReduce-based approach to improve the shortest path computation in large-scale road networks: the case of A* algorithm

  2018cites this paper
• Processing Unstructured Databases Using a Quantum Approach

  2018cites this paper
• Developing Genetic Algorithms Using Different MapReduce Frameworks: MPI vs. Hadoop

  2018cites this paper
• Transforming and Optimizing Irregular Applications for Parallel Architectures

  2018cites this paper
• A Visual MapReduce Program Development Environment for Heterogeneous Computing on Clouds

  2018cites this paper
• Mobile 3D assembly process information construction and transfer to the assembly station of complex products

  2018cites this paper
• On the Power of Combiner Optimizations in MapReduce Over MPI Workflows

  2018cites this paper
• Cost-efficient resource provisioning for large-scale graph processing systems in cloud computing environments

  2018cites this paper
• In silico error correction improves cfDNA mutation calling

  2018cites this paper
• Mapreduce Iterative Computation Model Based on Non-Global Parallel and Heartbeat Synchronization

  2018cites this paper
• Decoupled Strategy for Imbalanced Workloads in MapReduce Frameworks

  2018influential citation
• Tasks management of manned space ground data processing based on OSWorkflow engine and Web Services

  2017cites this paper
• WolfPath: Accelerating Iterative Traversing-Based Graph Processing Algorithms on GPU

  2017cites this paper
• Parallelizing Single Source Shortest Path with OpenSHMEM

  2017cites this paper
• Locality-aware load-balanced task scheduling for MapReduce (cid:73)

  2017influential citation
• Performance Evaluation of Apache Spark Vs MPI: A Practical Case Study on Twitter Sentiment Analysis

  2017cites this paper
• A containerized analytics framework for data and compute-intensive pipeline applications

  2017cites this paper
• Towards Seamless Integration of Data Analytics into Existing HPC Infrastructures

  2017cites this paper
• K-mer clustering algorithm using a MapReduce framework: application to the parallelization of the Inchworm module of Trinity

  2017cites this paper
• MapReduce and Its Applications, Challenges, and Architecture: a Comprehensive Review and Directions for Future Research

  2017cites this paper
• Enabling scalable and accurate clustering of distributed ligand geometries on supercomputers

  2017cites this paper
• Mimir: Memory-Efficient and Scalable MapReduce for Large Supercomputing Systems

  2017cites this paper
• MPI Streams for HPC Applications

  2017cites this paper
• PaPar: A Parallel Data Partitioning Framework for Big Data Applications

  2017cites this paper
• A case for asynchronous many task runtimes: a modeling approach for high performance computing and Big Data analytics

  2017cites this paper
• ASYMP: Fault-tolerant Mining of Massive Graphs

  2017cites this paper
• Data Movement on Emerging Large-Scale Parallel Systems

  2017cites this paper
• OpenSHMEM and Related Technologies. Big Compute and Big Data Convergence

  2017influential citation
• Scalable Single Source Shortest Path Algorithms for Massively Parallel Systems

  2017cites this paper
• Analyzing Large-Scale, Distributed and Uncertain Data

  2017cites this paper
• Deriving Streaming Graph Algorithms from Static Definitions

  2017cites this paper
• MRA*: Parallel and Distributed Path in Large-Scale Graph Using MapReduce-A* Based Approach

  2017cites this paper
• Application-Level Optimization of On-Node Communication in OpenSHMEM

  2017cites this paper
• An Integrated Disk and Memory Based Big Graph Mining – FASC Approach

  2017cites this paper
• Molecular Dynamics Simulations of Hydration Effects on Solvation, Diffusivity, and Permeability in Chitosan/Chitin Films.

  2016cites this paper
• Connected components of big graphs in fixed MapReduce rounds

  2016cites this paper
• CUDA Kernel Based Collective Reduction Operations on Large-scale GPU Clusters

  2016cites this paper
• Gossip Management at Universities using Big Data Warehouse Model Integrated with a Decision Support System

  2016cites this paper
• Parallelization Strategies for Computational Fluid Dynamics Software: State of the Art Review

  2016cites this paper
• Big Data Analytics on High Performance Computing Infrastructures – Technologies , Tools , Examples

  2016cites this paper
• Introduction to HPC with MPI for Data Science

  2016cites this paper
• Mass and Charge Transport in Hydrated Polymeric Membranes

  2016cites this paper
• A Fast Alignment-Free Approach for De Novo Detection of Protein Conserved Regions

  2016cites this paper
• Mizan-RMA: Accelerating Mizan Graph Processing Framework with MPI RMA

  2016cites this paper