Data placement for scientific applications in distributed environments

No abstract is available for this paper.

• Publication year

  2007

• Venue

  IEEE/ACM International Conference on Grid Computing

• Publication date

  2007-09-19

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/GRID.2007.4354142
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Scheduling Workflows with Budget Constraints

  2007cited by this paper
• Pegasus: Mapping Large-Scale Workflows to Distributed Resources

  2007cited by this paper
• Proactive Replication for Data Durability

  2006cited by this paper
• A budget constrained scheduling of workflow applications on utility Grids using genetic algorithms

  2006cited by this paper
• Efficient Replica Maintenance for Distributed Storage Systems

  2006influential reference
• Advance Reservation Policies for Workflows

  2006cited by this paper
• LIGO: The laser interferometer gravitational-wave observatory

  2006cited by this paper
• PhEDEx high-throughput data transfer management system

  2006cited by this paper
• Pegasus: A framework for mapping complex scientific workflows onto distributed systems

  2005cited by this paper
• Scheduling of scientific workflows in the ASKALON grid environment

  2005cited by this paper
• QCDgrid: A Grid Resource for Quantum Chromodynamics

  2005cited by this paper
• Wide area data replication for scientific collaborations

  2005cited by this paper
• A framework for reliable and efficient data placement in distributed computing systems

  2005cited by this paper
• Task scheduling strategies for workflow-based applications in grids

  2005cited by this paper
• The Globus Striped GridFTP Framework and Server

  2005cited by this paper
• Scheduling strategies for mapping application workflows onto the grid

  2005cited by this paper
• Software Agents in Data and Workflow Management

  2004cited by this paper
• Performance and scalability of a replica location service

  2004cited by this paper
• Montage: a grid-enabled engine for delivering custom science-grade mosaics on demand

  2004cited by this paper
• Simulation Studies of Computation and Data Scheduling Algorithms for Data Grids

  2003cited by this paper
• Giggle: A Framework for Constructing Scalable Replica Location Services

  2002cited by this paper
• Decoupling computation and data scheduling in distributed data-intensive applications

  2002cited by this paper
• The Anatomy of the Grid: Enabling Scalable Virtual Organizations

  2001cited by this paper
• Identifying Dynamic Replication Strategies for a High-Performance Data Grid

  2001cited by this paper
• Condor-G: A Computation Management Agent for Multi-Institutional Grids

  2001cited by this paper
• OceanStore: an architecture for global-scale persistent storage

  2000cited by this paper
• Static scheduling algorithms for allocating directed task graphs to multiprocessors

  1999cited by this paper
• Condor-a hunter of idle workstations

  1988influential reference
• CONCURRENCY AND COMPUTATION: PRACTICE AND EXPERIENCE Concurrency Computat.: Pract. Exper. 2000; 00:1–7 Prepared using cpeauth.cls [Version: 2002/09/19 v2.02] Taverna: Lessons in creating

  year unknowncited by this paper

• Interval type-2 fuzzy c-means collaborative clustering approach for scientific cloud workflows

  2025cites this paper
• A User Mobility-Based Data Placement Strategy in a Hybrid Cloud/Edge Environment Using a Causal-Aware Deep Learning Network

  2023cites this paper
• Collaborative Fuzzy Clustering Approach for Scientific Cloud Workflows

  2023cites this paper
• Efficient Hierarchical Storage Management Empowered by Reinforcement Learning

  2022cites this paper
• Efficient Hierarchical Storage Management Framework Empowered by Reinforcement Learning

  2022cites this paper
• Data sharing.

  2022cites this paper
• CDAP: A Cultural Algorithm for Data Placement in Big Data Workflows

  2022cites this paper
• Merging NMR Data and Computation Facilitates Data-Centered Research

  2022influential citation
• Resilient Techniques Against Disruptions of Volatile Cloud Resources

  2020cites this paper
• UnifyDR: A Generic Framework for Unifying Data and Replica Placement

  2020cites this paper
• A survey on preemptible IaaS cloud instances: challenges, issues, opportunities, and advantages

  2020cites this paper
• Multi-Objective Data Placement for Workflow Management in Cloud Infrastructure Using NSGA-II

  2020cites this paper
• Geomancy: Automated Performance Enhancement through Data Layout Optimization

  2020cites this paper
• A Data and Task Co-Scheduling Algorithm for Scientific Cloud Workflows

  2020cites this paper
• Unifying Data and Replica Placement for Data-intensive Services in Geographically Distributed Clouds

  2019cites this paper
• Simulating Data Access Profiles of Computational Jobs in Data Grids

  2019cites this paper
• A Novel Workflow-Level Data Placement Strategy for Data-Sharing Scientific Cloud Workflows

  2019cites this paper
• Context-Aware Data and Task Placement in Edge Computing Environments

  2019cites this paper
• SpeCH: A scalable framework for data placement of data-intensive services in geo-distributed clouds

  2019cites this paper
• Forecasting Network Throughput of Remote Data Access in Computing Grids

  2019cites this paper
• Realistic simulation of the execution of applications deployed on large distributed systems with a focus on improving file management. (Simulation réaliste de l'exécution des applications déployées sur des systèmes distribués avec un focus sur l'amélioration de la gestion des fichiers)

  2019cites this paper
• Scheduling data-intensive scientific workflows with reduced communication

  2018cites this paper
• Combining Static and Dynamic Storage Management for Data Intensive Scientific Workflows

  2018cites this paper
• A Data Placement Scheme for the Characteristics of Data Intensive Scientific Workflow Applications

  2018cites this paper
• Fault-Tolerant Scheduling for Hybrid Real-Time Tasks Based on CPB Model in Cloud

  2018cites this paper
• A Greedy Approach with New Cost Model for Intermediate Datasets Storage Problem in General Workflows

  2018cites this paper
• Evaluation Through Realistic Simulations of File Replication Strategies for Large Heterogeneous Distributed Systems

  2018cites this paper
• A Two-Stage Fuzzy C-Means Data Placement Strategy for Scientific Cloud Workflows

  2018cites this paper
• A Genetic Algorithm Based Data Replica Placement Strategy for Scientific Applications in Clouds

  2018cites this paper
• Scalable Data Placement of Data-intensive Services in Geo-distributed Clouds

  2018cites this paper
• Data Placement And Task Mapping Optimization For Big Data Workflows In The Cloud

  2017cites this paper
• A Taxonomy and Survey of Fault-Tolerant Workflow Management Systems in Cloud and Distributed Computing Environments

  2017cites this paper
• Tasks management of manned space ground data processing based on OSWorkflow engine and Web Services

  2017cites this paper
• A cost minimization data allocation algorithm for dynamic datacenter resizing

  2017cites this paper
• Heuristic Data Placement for Data-Intensive Applications in Heterogeneous Cloud

  2016cites this paper
• Workflow-and-Platform Aware task clustering for scientific workflow execution in Cloud environment

  2016cites this paper
• A preemptible resource management scheme on multimedia processing cloud systems

  2016cites this paper
• Enhancing Reliability of Workflow Execution Using Task Replication and Spot Instances

  2016cites this paper
• BRPS: A Big Data Placement Strategy for Data Intensive Applications

  2016cites this paper
• Microplanificación de asignación tardía y almacenamiento temporal distribuidos para flujos de trabajo intensivos en datos

  2016cites this paper
• A GENETIC ALGORITHM BASED LOAD BALANCING TECHNIQUE ( GALBT ) FOR APPLICATION PROCESSING IN CLOUD

  2016cites this paper
• SABA: A security-aware and budget-aware workflow scheduling strategy in clouds

  2015cites this paper
• Content placement strategies for smart products

  2015cites this paper
• Workflow System Performance Improving and Analyzing by Using Memory Cache

  2015cites this paper
• Application of k-ACO for Compute Intensive Applications

  2015cites this paper
• Resource Scheduling in Data-Centric Systems

  2015cites this paper
• High-Throughput Geocomputational Workflows in a Grid Environment

  2015cites this paper
• BDAP: A Big Data Placement Strategy for Cloud-Based Scientific Workflows

  2015cites this paper
• WANalytics: Analytics for a Geo-Distributed Data-Intensive World

  2015cites this paper
• Robust and fault-tolerant scheduling for scientific workflows in cloud computing environments

  2015cites this paper
• Novel Data-Distribution Technique for Hadoop in Heterogeneous Cloud Environments

  2015cites this paper
• The Case for Workflow-Aware Storage:An Opportunity Study

  2015cites this paper
• k-ACO: Information Retrieval from Cloud using Optimum Data Migration based on K-Means & ACO

  2015cites this paper
• Performance Based Data-Distribution Methodology In Heterogeneous Hadoop Environment

  2014cites this paper
• Adaptation and Policy-Based Resource Allocation for Efficient Bulk Data Transfers in High Performance Computing Environments

  2014cites this paper
• Data Placement and Query for Cloud Computing Based on MyHeawood Network

  2014cites this paper
• A Novel Replication Strategy in Data Grid Environment with a Dynamic Threshold

  2014cites this paper
• Evolutionary data reorganization for efficient workload processing

  2014cites this paper
• Cloud Data Management for Scientific Workflows: Research Issues, Methodologies, and State-of-the-Art

  2014cites this paper
• Performance modeling and optimization techniques for heterogeneous computing

  2014cites this paper
• Workflow Partitioning and Deployment on the Cloud Using Orchestra

  2014cites this paper
• High Performance Computing of Hydrologic Models Using HTCondor

  2013cites this paper
• Extending Summation Precision for Network Reduction Operations

  2013cites this paper
• Rethinking data management for big data scientific workflows

  2013cites this paper
• SPOAN: Load Balancing Replica Placement Strategy for Large Scale Biometric Identification Service

  2013cites this paper
• A clustering based coscheduling strategy for efficient scientific workflow execution in cloud computing

  2013cites this paper
• Analysis Of Fault Tolerance Approach For Data Replication In Data Intensive Scientific Applications

  2013cites this paper
• Enhanced Ant Colony Algorithm for Cost-Aware Data-Intensive Service Provision

  2013cites this paper
• A classification of file placement and replication methods on grids

  2013cites this paper
• Exploitation d'infrastructures hétérogènes de calcul distribué pour la simulation Monte-Carlo dans le domaine médical

  2013cites this paper
• A Workflow-Aware Storage System: An Opportunity Study

  2012cites this paper
• TOWARDS A HIGH-PERFORMANCE SCALABLE STORAGE SYSTEM FOR WORKFLOW APPLICATIONS

  2012cites this paper
• Improving Scientific Workflow Performance Using Policy Based Data Placement

  2012cites this paper
• Adaptive Data Transfers that Utilize Policies for Resource Sharing

  2012cites this paper
• A Novel Dynamic Replication Algorithm in Hierarchical Data Grid

  2012cites this paper
• Achieving the Best Trade-Off between Computation and Storage in the Cloud - Cost Model, Benchmarking and Strategies for Datasets Storage of Scientific Applications

  2012cites this paper
• Distributed data as a choice in PetaBricks

  2012cites this paper
• Data Management in Scientific Workflows

  2012cites this paper
• Data Intensive Distributed Computing : Challenges and Solutions for Large-Scale Information Management

  2012cites this paper
• Integrating Policy with Scientific Workflow Management for Data-Intensive Applications

  2012cites this paper
• K%-Fair scheduling: A flexible task scheduling strategy for balancing fairness and efficiency in MapReduce systems

  2012cites this paper
• A MapReduce workflow system for architecting scientific data intensive applications

  2011cites this paper
• An Approach to Mapping Scientific Workflow in Cloud Computing data centers to Minimize Costs of Workflow Execution

  2011cites this paper
• Data Replication in Data Intensive Scientific Applications with Performance Guarantee

  2011cites this paper
• Enhanced 3-layer hierarchical replication algorithm for Data Grid

  2011cites this paper
• Ten years of software sustainability at the Infrared Processing and Analysis Center

  2011cites this paper
• Workflow overhead analysis and optimizations

  2011cites this paper
• Towards Intelligent Data Placement for Scientific Workflows in Collaborative Cloud Environment

  2011cites this paper
• A New Dynamic Replication Algorithm for Hierarchy Networks in Data Grid

  2011cites this paper
• Policy Based Data Placement in High Performance Scientific Computing

  2011cites this paper
• A Middleware for Service Deployment in Contributory Computing Systems

  2011cites this paper
• On-demand minimum cost benchmarking for intermediate dataset storage in scientific cloud workflow systems

  2011cites this paper
• A data placement strategy in scientific cloud workflows

  2010cites this paper
• Data location-aware job scheduling in the grid. Application to the GridWay metascheduler

  2010cites this paper
• Scheduling and management of data intensive application workflows in grid and cloud computing environments

  2010cites this paper
• Data Storage, Retrieval and Management

  2010cites this paper
• SwinDeW-C: A Peer-to-Peer Based Cloud Workflow System

  2010cites this paper
• Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling

  2010cites this paper
• Speculative Scheduling of Parameter Sweep Applications Using Job Behavior Descriptions

  2009cites this paper
• The Merging of Telecommunications Policy and Science Policy Through Broadband Stimulus Funding

  2009cites this paper