Disk scrubbing in large archival storage systems

No abstract is available for this paper.

• Publication year

  2004

• Venue

  The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, 2004. (MASCOTS 2004). Proceedings.

• Publication date

  2004-10-04

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/MASCOT.2004.1348296
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Disk Backup Through Algebraic Signatures in Scalable Distributed Data Structures

  2006cited by this paper
• Latent Sector Faults and Reliability of Disk Arrays

  2005cited by this paper
• Coding techniques for handling failures in large disk arrays

  2005cited by this paper
• Algebraic signatures for scalable distributed data structures

  2004cited by this paper
• Verification of Parity Data in Large Scale Storage Systems

  2004cited by this paper
• Improved file synchronization techniques for maintaining large replicated collections over slow networks

  2004cited by this paper
• Replication under scalable hashing: a family of algorithms for scalable decentralized data distribution

  2004cited by this paper
• Evaluation of distributed recovery in large-scale storage systems

  2004cited by this paper
• Disk drive reliability case study: dependence upon head fly-height and quantity of heads

  2003cited by this paper
• Reliability mechanisms for very large storage systems

  2003cited by this paper
• More Than an Interface - SCSI vs. ATA

  2003cited by this paper
• The Case for Massive Arrays of Idle Disks (MAID)

  2002cited by this paper
• Massive Arrays of Idle Disks For Storage Archives

  2002influential reference
• A tutorial on Reed–Solomon coding for fault‐tolerance in RAID‐like systems

  1997cited by this paper
• On the Methods to Detect Sector Faults of a Disk Subsystem

  1993cited by this paper
• Some applications of Rabin’s fingerprinting method

  1993cited by this paper
• Exploiting symmetries for low-cost comparison of file copies

  1988cited by this paper
• Efficient Randomized Pattern-Matching Algorithms

  1987cited by this paper
• A Parity Structure for Large Remotely Located Replicated Data Files

  1983cited by this paper

• Project Silica: sustainable cloud archival storage in glass

  2024cites this paper
• A Call for Research on Storage Emissions

  2024cites this paper
• Project Silica: Towards Sustainable Cloud Archival Storage in Glass

  2024cites this paper
• Project Silica: Towards Sustainable Cloud Archival Storage in Glass

  2023cites this paper
• Durability and Availability of Erasure-Coded Storage Systems with Concurrent Maintenance

  2023cites this paper
• Reliability Evaluation of Erasure-coded Storage Systems with Latent Errors

  2022cites this paper
• Disk-Adaptive Redundancy: Tailoring Data Redundancy to Disk-Reliability Heterogeneity in Cluster Storage Systems

  2021cites this paper
• Cores that don't count

  2021cites this paper
• PACEMAKER: Avoiding HeART attacks in storage clusters with disk-adaptive redundancy

  2021cites this paper
• Design and implementation of an efficient and parallel bad block checker for parallelism of storage devices

  2021cites this paper
• Distributed Disk Store

  2020cites this paper
• An Efficient and Parallel Bad Block Checker for Parallelism of Storage Devices

  2020cites this paper
• The Case for Custom Storage Backends in Distributed Storage Systems

  2020cites this paper
• A Modeling Framework for Reliability of Erasure Codes in SSD Arrays

  2020cites this paper
• A Data-Assisted Reliability Model for Carrier-Assisted Cold Data Storage Systems

  2019cites this paper
• Minimizing Retention Induced Refresh Through Exploiting Process Variation of Flash Memory

  2019cites this paper
• Reliability Evaluation of Erasure Coded Systems under Rebuild Bandwidth Constraints

  2019cites this paper
• CPR for SSDs

  2019cites this paper
• File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution

  2019cites this paper
• CTRQ 2018 Proceedings

  2018cites this paper
• Reliability of Erasure Coded Systems under Rebuild Bandwidth Constraints

  2018cites this paper
• Protecting Single Shingled Write Drives Against Latent Sector Failures

  2018cites this paper
• Reliability Evaluation of Erasure Coded Systems

  2018cites this paper
• WAFL Iron: Repairing Live Enterprise File Systems

  2018cites this paper
• Performability Modeling for RAID Storage Systems by Markov Regenerative Process

  2018cites this paper
• PCS: a parity-based personal data recovery service in cloud

  2017influential citation
• High Performance Metadata Integrity Protection in the WAFL Copy-on-Write File System

  2017cites this paper
• aHDFS: An Erasure-Coded Data Archival System for Hadoop Clusters

  2017cites this paper
• CTRQ 2017 Proceedings

  2017cites this paper
• Reliability Assessment of Erasure Coded Systems

  2017cites this paper
• Achieving High Reliability and Efficiency in Maintaining Large-Scale Storage Systems through Optimal Resource Provisioning and Data Placement

  2016cites this paper
• Exploiting process variation for retention induced refresh minimization on flash memory

  2016cites this paper
• LoneStar RAID

  2016cites this paper
• Implicit effect of decoding time on fault tolerance in erasure coded Cloud Storage systems

  2016cites this paper
• RESAR: Reliable Storage at Exabyte Scale

  2016cites this paper
• Does RAID Improve Lifetime of SSD Arrays?

  2016cites this paper
• Thermal Management and Data Archiving in Data Centers

  2016cites this paper
• Unobtrusive Storage Maintenance

  2016cites this paper
• Combining Low IO-Operations During Data Recovery with Low Parity Overhead in Two-Failure Tolerant Archival Storage Systems

  2015cites this paper
• Parity Resynchronization using a Block-level Journaling for Software RAID

  2015cites this paper
• A practical approach to reconciling availability, performance, and capacity in provisioning extreme-scale storage systems

  2015cites this paper
• Opportunistic storage maintenance

  2015cites this paper
• Hardened Paxos through Consistency Validation

  2015cites this paper
• Frequency and Similarity-Aware Partitioning for cloud storage based on Space-Time Utility Maximization Model

  2015cites this paper
• RAIDShield

  2015cites this paper
• THE RELIABILITY MODEL OF A DISTRIBUTED DATA STORAGE IN CASE OF EXPLICIT AND LATENT DISK FAULTS

  2015cites this paper
• LoneStar: Design and evaluation of an energy-efficient, disk-based archival storage system

  2015cites this paper
• Proactive Data Migration for Improved Storage Availability in Large-Scale Data Centers

  2015cites this paper
• Incremental redundancy to reduce data retention errors in flash-based SSDs

  2015cites this paper
• Reliability challenges for storing exabytes

  2014cites this paper
• STAIR Codes: A General Family of Erasure Codes for Tolerating Device and Sector Failures

  2014cites this paper
• Wear unleveling: improving NAND flash lifetime by balancing page endurance

  2014cites this paper
• Cooperative Data Protection

  2014cites this paper
• On the Feasibility of Data Loss Insurance for Personal Cloud Storage

  2014cites this paper
• Effect of Latent Errors on the Reliability of Data Storage Systems

  2013cites this paper
• Reliability of Disk Arrays with Double Parity

  2013cites this paper
• Paired-replicas with constant repair time: Loss functions and memorylessness

  2013cites this paper
• Redundancy and Aging of Efficient Multidimensional MDS Parity-Protected Distributed Storage Systems

  2013cites this paper
• Ffsck

  2013cites this paper
• Design of an exact data deduplication cluster

  2012cites this paper
• The road (and the roadmap) for building Trusted Digital Repositories within an Interuniversity Consortium

  2012cites this paper
• A Review of Disc Scrubbing and Intra Disc Redundancy Techniques for Reducing Data Loss in Disc File Systems

  2012influential citation
• PERSES: Data Layout for Low Impact Failures

  2012cites this paper
• Long-term View of the Reliability of Archival Storage Systems First Step Towards a Reliability-Aware Storage System Manager

  2012cites this paper
• Understanding data survivability in archival storage systems

  2012cites this paper
• Research on Reliability Design of Data Storage for Embedded System

  2012cites this paper
• Incorporating solid state drives into distributed storage systems

  2012cites this paper
• Highly reliable two-dimensional RAID arrays for archival storage

  2012cites this paper
• Impact of Data Organization on Distributed Storage System

  2012cites this paper
• Write amplification due to ECC on flash memory or leave those bit errors alone

  2012cites this paper
• Estimation of deduplication ratios in large data sets

  2012cites this paper
• Practical scrubbing: Getting to the bad sector at the right time

  2012cites this paper
• Integrated Management of the Persistent-Storage and Data-Processing Layers in Data-Intensive Computing Systems

  2012cites this paper
• Distributed Detecting and Real-Time Advertising System of Equipment Failure Based on MANET

  2012cites this paper
• Deduplication in SSDs: Model and quantitative analysis

  2012cites this paper
• Addressing performance challenges in secure storage systems

  2011cites this paper
• Online availability upgrades for parity-based RAIDs through supplementary parity augmentations

  2011cites this paper
• Designing Reliable High-Performance Storage Systems for HPC Environments

  2011cites this paper
• SCAN: An Efficient Decoding Algorithm for RAID-6 Codes

  2011cites this paper
• A HIERARCHICAL MARKOV RELIABILITY MODEL FOR DATA STORAGE SYSTEMS WITH MEDIA SELF-RECOVERY

  2011cites this paper
• Hyfs: design and implementation of a reliable file system

  2011cites this paper
• Using Storage Class Memory for Archives with DAWN , a Durable Array of Wimpy Nodes Technical Report UCSC-SSRC-1107 October 2011

  2011cites this paper
• Improving Availability of RAID-Structured Storage Systems by Workload Outsourcing

  2011cites this paper
• Warding off the dangers of data corruption with amulet

  2011cites this paper
• Disk Scrubbing Versus Intradisk Redundancy for RAID Storage Systems

  2011cites this paper
• Evaluation of Applied Intra-disk Redundancy Schemes to Improve Single Disk Reliability

  2011cites this paper
• Hyfs: design and implementation of a reliable fi le

  2011cites this paper
• Using Storage Class Memory for Archives with DAWN , a Durable Array of Wimpy Nodes Technical Report UCSC-SSRC-1105 May 2011

  2011cites this paper
• Parity Cloud Service: A Privacy-Protected Personal Data Recovery Service

  2011cites this paper
• Reliability Analysis of Declustered-Parity RAID 6 with Disk Scrubbing and Considering Irrecoverable Read Errors

  2010cites this paper
• Availability in Globally Distributed Storage Systems

  2010cites this paper
• Improving Disk Array Reliability Through Expedited Scrubbing

  2010cites this paper
• A Clean-Slate Look at Disk Scrubbing

  2010influential citation
• Understanding latent sector errors and how to protect against them

  2010influential citation
• End-to-end Data Integrity for File Systems: A ZFS Case Study

  2010cites this paper
• Optimizing RAID for long term data archives

  2010cites this paper
• Chit-based remote storage

  2010cites this paper
• Examining Energy Use in Heterogeneous Archival Storage Systems

  2010cites this paper
• Decoding STAR code for tolerating simultaneous disk failure and silent errors

  2010cites this paper
• Preventing Silent Data Corruptions from Propagating During Data Reconstruction

  2010cites this paper