A Job Sizing Strategy for High-Throughput Scientific Workflows

No abstract is available for this paper.

• Publication year

  2018

• Venue

  IEEE Transactions on Parallel and Distributed Systems

• Publication date

  2018-02-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/TPDS.2017.2762310
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A balanced scheduler with data reuse and replication for scientific workflows in cloud computing systems

  2017cited by this paper
• Speeding Up Large-Scale Next Generation Sequencing Data Analysis with pBWA

  2017cited by this paper
• Dynamic and Fault-Tolerant Clustering for Scientific Workflows

  2016cited by this paper
• Enhancing Reliability of Workflow Execution Using Task Replication and Spot Instances

  2016cited by this paper
• Improving backfilling by using machine learning to predict running times

  2015cited by this paper
• Characterizing a High Throughput Computing Workload: The Compact Muon Solenoid (CMS) Experiment at LHC

  2015cited by this paper
• Scaling Data Intensive Physics Applications to 10k Cores on Non-dedicated Clusters with Lobster

  2015cited by this paper
• Practical Resource Monitoring for Robust High Throughput Computing

  2015cited by this paper
• Predicting the Effect of Memory Contention in Multi-Core Computers Using Analytic Performance Models

  2015cited by this paper
• Online Task Resource Consumption Prediction for Scientific Workflows

  2015cited by this paper
• Estimating job runtime for CMS analysis jobs

  2014cited by this paper
• Controlling fairness and task granularity in distributed, online, non‐clairvoyant workflow executions

  2014cited by this paper
• Workflows for e-Science, Scientific Workflows for Grids

  2014cited by this paper
• Self-healing of workflow activity incidents on distributed computing infrastructures

  2013cited by this paper
• Omega: flexible, scalable schedulers for large compute clusters

  2013cited by this paper
• Comprehensive job level resource usage measurement and analysis for XSEDE HPC systems

  2013cited by this paper
• Toward fine-grained online task characteristics estimation in scientific workflows

  2013cited by this paper
• Fairness Resource Sharing for Dynamic Workflow Scheduling on Heterogeneous Systems

  2012cited by this paper
• On Identifying User Session Boundaries in Parallel Workload Logs

  2012cited by this paper
• Makeflow: a portable abstraction for data intensive computing on clusters, clouds, and grids

  2012cited by this paper
• ExPERT: Pareto-Efficient Task Replication on Grids and a Cloud

  2012cited by this paper
• Heterogeneity and dynamicity of clouds at scale: Google trace analysis

  2012cited by this paper
• System-level monitoring of floating-point performance to improve effective system utilization

  2011cited by this paper
• ParaTrac: a fine-grained profiler for data-intensive workflows

  2010cited by this paper
• Issues and scenarios for self-managing grid middleware

  2010cited by this paper
• Workflow-based comparison of two Distributed Computing Infrastructures

  2010cited by this paper
• Autonomic virtual resource management for service hosting platforms

  2009cited by this paper
• Ptrace , Utrace , Uprobes : Lightweight , Dynamic Tracing of User Apps

  2007cited by this paper
• Scheduling strategies for mapping application workflows onto the grid

  2005cited by this paper
• P3: P2P-based middleware enabling transfer and aggregation of computational resources

  2005cited by this paper
• Distributed computing in practice: the Condor experience

  2005cited by this paper
• The ganglia distributed monitoring system: design, implementation, and experience

  2004cited by this paper
• A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems

  2001cited by this paper
• Condor: a distributed job scheduler

  2001cited by this paper
• Heuristics for scheduling parameter sweep applications in grid environments

  2000cited by this paper
• The ANL/IBM SP Scheduling System

  1995cited by this paper
• A comparison of next-fit, first-fit, and best-fit

  1977cited by this paper

• Predicting the Performance of Scientific Workflow Tasks for Cluster Resource Management: An Overview of the State of the Art

  2025cites this paper
• Adapting Classic Scheduling Heuristics for Online Execution under Uncertainty

  2025cites this paper
• Scaling Up Throughput-oriented LLM Inference Applications on Heterogeneous Opportunistic GPU Clusters with Pervasive Context Management

  2025cites this paper
• Adaptive Task-Oriented Resource Allocation for Large Dynamic Workflows on Opportunistic Resources

  2024cites this paper
• KS+: Predicting Workflow Task Memory Usage Over Time

  2024cites this paper
• Ponder: Online Prediction of Task Memory Requirements for Scientific Workflows

  2024influential citation
• Sizey: Memory-Efficient Execution of Scientific Workflow Tasks

  2024cites this paper
• Novel Approaches Toward Scalable Composable Workflows in Hyper-Heterogeneous Computing Environments

  2023cites this paper
• Predicting Dynamic Memory Requirements for Scientific Workflow Tasks

  2023influential citation
• How Workflow Engines Should Talk to Resource Managers: A Proposal for a Common Workflow Scheduling Interface

  2023cites this paper
• Dynamic Task Shaping for High Throughput Data Analysis Applications in High Energy Physics

  2022cites this paper
• Leveraging Reinforcement Learning for Task Resource Allocation in Scientific Workflows

  2022influential citation
• Not All Tasks Are Created Equal: Adaptive Resource Allocation for Heterogeneous Tasks in Dynamic Workflows

  2021cites this paper
• Lightweight Function Monitors for Fine-Grained Management in Large Scale Python Applications

  2021cites this paper
• GLUME: A Strategy for Reducing Workflow Execution Times on Batch-Scheduled Platforms

  2021cites this paper
• Autoscaling High-Throughput Workloads on Container Orchestrators

  2020cites this paper
• Developing accurate and scalable simulators of production workflow management systems with WRENCH

  2020cites this paper
• The role of machine learning in scientific workflows

  2019cites this paper
• Learning Low-Wastage Memory Allocations for Scientific Workflows at IceCube

  2019influential citation
• The Evolution of the Pegasus Workflow Management Software

  2019cites this paper
• Feedback-Based Resource Allocation for Batch Scheduling of Scientific Workflows

  2019cites this paper
• Reduction of Workflow Resource Consumption Using a Density-based Clustering Model

  2018cites this paper
• A STUDY ON THE SELECTION OF RESOURCES FROM XSEDE SUPERCOMPUTERS AND THE OPEN SCIENCE GRID

  2018cites this paper
• Similarity-based Resource Selection for Scientific Workflows in Cloud Computing

  2018cites this paper
• Towards General Distributed Resource Selection

  2018cites this paper
• Memory thrifty workflow resource assignment

  year unknowncites this paper