Flat XOR-based erasure codes in storage systems: Constructions, efficient recovery, and tradeoffs

No abstract is available for this paper.

• Publication year

  2010

• Venue

  IEEE Conference on Mass Storage Systems and Technologies

• Publication date

  2010-05-03

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/MSST.2010.5496983
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• P-Code: a new RAID-6 code with optimal properties

  2009cited by this paper
• Reliability and power-efficiency in erasure-coded storage systems

  2009cited by this paper
• An efficient XOR-scheduling algorithm for erasure codes encoding

  2009cited by this paper
• The Raid-6 Liber8Tion Code

  2009cited by this paper
• eRAID: Conserving Energy in Conventional Disk-Based RAID System

  2008cited by this paper
• The RAID-6 Liberation Codes

  2008cited by this paper
• Progressive Parity-Based Hardening of Data Stores

  2008cited by this paper
• Reliability of flat XOR-based erasure codes on heterogeneous devices

  2008cited by this paper
• Optimizing Galois Field Arithmetic for Diverse Processor Architectures and Applications

  2008cited by this paper
• Tornado Codes for MAID Archival Storage

  2007cited by this paper
• An analysis of latent sector errors in disk drives

  2007cited by this paper
• Outshining Mirrors: MTTDL of Fixed-Order Spiral Layouts

  2007cited by this paper
• Self-Adaptive Two-Dimensional RAID Arrays

  2007cited by this paper
• Enhanced Reliability Modeling of RAID Storage Systems

  2007cited by this paper
• Determining Fault Tolerance of XOR-Based Erasure Codes Efficiently

  2007cited by this paper
• Disk Failures in the Real World: What Does an MTTF of 1, 000, 000 Hours Mean to You?

  2007cited by this paper
• Failure Trends in a Large Disk Drive Population

  2007cited by this paper
• Pyramid Codes: Flexible Schemes to Trade Space for Access Efficiency in Reliable Data Storage Systems

  2007cited by this paper
• PARAID: A gear-shifting power-aware RAID

  2007cited by this paper
• Hard Disk Drives: The Good, the Bad and the Ugly!

  2007cited by this paper
• Network coding: an instant primer

  2006cited by this paper
• HoVer Erasure Codes For Disk Arrays

  2006influential reference
• Optimizing Cauchy Reed-Solomon Codes for Fault-Tolerant Network Storage Applications

  2006cited by this paper
• Decentralized erasure codes for distributed networked storage

  2006cited by this paper
• Reliability for Networked Storage Nodes

  2006cited by this paper
• STAR : An Efficient Coding Scheme for Correcting Triple Storage Node Failures

  2005cited by this paper
• Matrix methods for lost data reconstruction in erasure codes

  2005cited by this paper
• WEAVER codes: highly fault tolerant erasure codes for storage systems

  2005cited by this paper
• On the stopping distance and the stopping redundancy of codes

  2005cited by this paper
• Small parity-check erasure codes - exploration and observations

  2005cited by this paper
• A fresh look at the reliability of long-term digital storage

  2005cited by this paper
• EERAID: energy efficient redundant and inexpensive disk array

  2004cited by this paper
• Low-Density Parity-Check Codes

  2004cited by this paper
• IBM Research Report Performance Metrics for Erasure Codes in Storage Systems

  2004cited by this paper
• A practical analysis of low-density parity-check erasure codes for wide-area storage applications

  2004cited by this paper
• X-Code: MDS Array Codes with Optimal Encoding

  1999cited by this paper
• A digital fountain approach to reliable distribution of bulk data

  1998cited by this paper
• Practical loss-resilient codes

  1997cited by this paper
• Efficient Placement of Parity and Data to Tolerate Two Disk Failures in Disk Array Systems

  1995cited by this paper
• EVENODD: An Efficient Scheme for Tolerating Double Disk Failures in RAID Architectures

  1995influential reference
• MDS array codes with independent parity symbols

  1995influential reference
• Disk array storage system reliability

  1993cited by this paper
• Distributed sparing in disk arrays

  1992cited by this paper
• Parity declustering for continuous operation in redundant disk arrays

  1992cited by this paper
• Chained declustering: a new availability strategy for multiprocessor database machines

  1990cited by this paper
• Failure correction techniques for large disk arrays

  1989cited by this paper
• A case for redundant arrays of inexpensive disks (RAID)

  1988cited by this paper
• Error Free Coding

  1973influential reference
• Proceedings of the Third Usenix Conference on File and Storage Technologies Row-diagonal Parity for Double Disk Failure Correction

  year unknowninfluential reference

• Exploring Data Protection with ISA-L: A Study on Erasure Coding

  2024cites this paper
• Venus: Enhancing QoE of Crowdsourced Live Video Streaming by Exploiting Multiflow Viewer Assistance

  2024cites this paper
• Boosting the Performance of Degraded Reads in RS-coded Distributed Storage Systems

  2023cites this paper
• DSPR: Secure decentralized storage with proof-of-replication for edge devices

  2022cites this paper
• Review on LDPC Codes for Big Data Storage

  2021cites this paper
• Design and Evaluation of a Risk-Aware Failure Identification Scheme for Improved RAS in Erasure-Coded Data Centers

  2021cites this paper
• ECS2: A Fast Erasure Coding Library for GPU-Accelerated Storage Systems with Parallel & Direct IO

  2020cites this paper
• INEC: Fast and Coherent In-Network Erasure Coding

  2020cites this paper
• TriEC: Tripartite Graph Based Erasure Coding NIC Offload

  2019cites this paper
• An Exploratory Study on Software-Defined Data Center Hard Disk Drives

  2019cites this paper
• N-Code: An Optimal RAID-6 MDS Array Code for Load Balancing and High I/O Performance

  2019cites this paper
• Active Data Replica Recovery for Quality-Assurance Big Data Analysis in IC-IoT

  2019cites this paper
• Mitigate HDD Fail-Slow by Pro-actively Utilizing System-level Data Redundancy with Enhanced HDD Controllability and Observability

  2019cites this paper
• RAFI: Risk-Aware Failure Identification to Improve the RAS in Erasure-coded Data Centers

  2018cites this paper
• Applied Erasure Coding in Networks and Distributed Storage

  2018cites this paper
• A New Adaptive Coding Selection Method for Distributed Storage Systems

  2018cites this paper
• A PARALLEL AND ASCENDABLE OF ERASURE WRITING SUPPORT IN CLOUD OBJECTIVE STORAGE SYSTEM

  2018cites this paper
• EC-Bench: Benchmarking Onload and Offload Erasure Coders on Modern Hardware Architectures

  2018cites this paper
• Reliable and Secure Advanced Metering Infrastructure for Smart Grid Network

  2018cites this paper
• BEAT: Asynchronous BFT Made Practical

  2018cites this paper
• Early Identification of Critical Blocks: Making Replicated Distributed Storage Systems Reliable Against Node Failures

  2018cites this paper
• EGE: A New Energy-Aware GPU Based Erasure Coding Scheduler for Cloud Storage Systems

  2018cites this paper
• Optimizing Cauchy Technique to Improve CPU Performance in Cloud Storage System Using N-gram Method

  2017cites this paper
• RESAR: Reliable storage at exabyte scale reconsidered

  2017cites this paper
• A Comparative Study on Distributed Storage and Erasure Coding Techniques Using Apache Hadoop Over NorNet Core

  2017cites this paper
• Short Code: An Efficient RAID-6 MDS Code for Optimizing Degraded Reads and Partial Stripe Writes

  2017cites this paper
• Fast Reconstruction for Degraded Reads and Recovery Process in Primary Array Storage Systems

  2017cites this paper
• Performance Improvement of Hadoop Distributed File System Using Cauchy Coding Approach

  2017cites this paper
• Enhancing Storage Performance of Hadoop Distributed File System Using Cauchy Coding

  2017cites this paper
• Guided Systematic Random LDPC for Distributed Storage System

  2017influential citation
• Facilitating Magnetic Recording Technology Scaling for Data Center Hard Disk Drives through Filesystem-Level Transparent Local Erasure Coding

  2017cites this paper
• expanCodes: Tailored LDPC Codes for Big Data Storage

  2016cites this paper
• LoneStar RAID

  2016cites this paper
• A Performance Evaluation of Erasure Coding Libraries for Cloud-Based Data Stores - (Practical Experience Report)

  2016cites this paper
• Reconsidering Single Disk Failure Recovery for Erasure Coded Storage Systems: Optimizing Load Balancing in Stack-Level

  2016cites this paper
• Irregular flat XOR codes for reducing repair bandwidth of multi-point distributed storage systems

  2016cites this paper
• Reliable and secure storage with erasure codes for OpenStack Swift in PyECLib

  2016influential citation
• RESAR: Reliable Storage at Exabyte Scale

  2016cites this paper
• CaCo: An Efficient Cauchy Coding Approach for Cloud Storage Systems

  2016cites this paper
• A study of the performance of novel storage-centric repairable codes

  2016cites this paper
• HV Code: An All-Around MDS Code for RAID-6 Storage Systems

  2016cites this paper
• PSG-Codes: An Erasure Codes Family with High Fault Tolerance and Fast Recovery

  2015influential citation
• Boosting Degraded Reads in Heterogeneous Erasure-Coded Storage Systems

  2015cites this paper
• An efficient data layout scheme for better I/O balancing in RAID-6 storage systems

  2015cites this paper
• Energy-aware and intelligent storage features for multimedia devices in smart classroom

  2015influential citation
• Building Reliable Storage Clouds: Models, Fundamental Tradeoffs, and Solutions

  2015cites this paper
• A QoS-Aware Data Reconstruction Strategy for a Data Fault-Tolerant Storage System

  2015cites this paper
• Combining Low IO-Operations During Data Recovery with Low Parity Overhead in Two-Failure Tolerant Archival Storage Systems

  2015influential citation
• Triple Failure Tolerant Storage Systems Using Only Exclusive-Or Parity Calculations

  2015cites this paper
• Code 5-6: An Efficient MDS Array Coding Scheme to Accelerate Online RAID Level Migration

  2015cites this paper
• HTSC and FH_HTSC: XOR-based codes to reduce access latency in distributed storage systems

  2015influential citation
• FINGER: A novel erasure coding scheme using fine granularity blocks to improve Hadoop write and update performance

  2015cites this paper
• LoneStar: Design and evaluation of an energy-efficient, disk-based archival storage system

  2015cites this paper
• A study of suitable fault tolerance frameworks for an energy-efficient storage system

  2015cites this paper
• A New Non-MDS RAID-6 Code to Support Fast Reconstruction and Balanced I/Os

  2015cites this paper
• Large LDPC Codes for Big Data Storage

  2015cites this paper
• Intelligent Scheduled Backup Using Duplicity

  2015cites this paper
• RESAR: Reliable Storage at Exabyte Scale

  2015cites this paper
• Families of Optimal Binary Non-MDS Erasure Codes

  2014cites this paper
• On the Speedup of Recovery in Large-Scale Erasure-Coded Storage Systems

  2014cites this paper
• Experience of a low-maintenance distributed data management system

  2014cites this paper
• The Auto-configurable LDPC Codes for Distributed Storage

  2014cites this paper
• RTP Compatible: Two Models of Video Streaming Over VANETs

  2014cites this paper
• HV Code: An All-Around MDS Code to Improve Efficiency and Reliability of RAID-6 Systems

  2014cites this paper
• A Stack-Based Single Disk Failure Recovery Scheme for Erasure Coded Storage Systems

  2014cites this paper
• Exploiting Decoding Computational Locality to Improve the I/O Performance of an XOR-Coded Storage Cluster under Concurrent Failures

  2014cites this paper
• Auto-configurable, Reliable, and Fault-Tolerant Cloud Storage with Dynamic Parameterization

  2014cites this paper
• Efficient Cache Utilization of DiskArray Failures

  2014cites this paper
• Sector-Disk (SD) Erasure Codes for Mixed Failure Modes in RAID Systems

  2014cites this paper
• BEC: A reliable and efficient mechanism for cloud storage service

  2013cites this paper
• Distributed computing column 49: coding for distributed storage

  2013cites this paper
• Expander code: A scalable erasure-resilient code to keep up with data growth in distributed storage

  2013cites this paper
• Load-Balanced Recovery Schemes for Single-Disk Failure in Storage Systems with Any Erasure Code

  2013influential citation
• SD codes: erasure codes designed for how storage systems really fail

  2013cites this paper
• A Flexible Framework to Enhance RAID-6 Scalability via Exploiting the Similarities among MDS Codes

  2013cites this paper
• Distributed Computing Column 49 Coding for Distributed Storage

  2013cites this paper
• V2-Code: A new non-MDS array code with optimal reconstruction performance for RAID-6

  2013cites this paper
• An Efficient Penalty-Aware Cache to Improve the Performance of Parity-Based Disk Arrays under Faulty Conditions

  2013cites this paper
• Erasure Codes for Storage Systems

  2013cites this paper
• Erasure Code based Cloud Storage File system-Minimizing IO Recovery S .

  2013cites this paper
• Heuristics for optimizing matrix-based erasure codes for fault-tolerant storage systems

  2012cites this paper
• Rethinking erasure codes for cloud file systems: minimizing I/O for recovery and degraded reads

  2012cites this paper
• Erasure Coding in Windows Azure Storage

  2012influential citation
• LT Codes For Efficient and Reliable Distributed Storage Systems Revisited

  2012cites this paper
• Improve the performance and scalability of raid-6 systems using erasure codes

  2012cites this paper
• An Empirical Study of the Repair Performance of Novel Coding Schemes for Networked Distributed Storage Systems

  2012cites this paper
• On the speedup of single-disk failure recovery in XOR-coded storage systems: Theory and practice

  2012cites this paper
• An overview of codes tailor-made for better repairability in networked distributed storage systems

  2011cites this paper
• A Non-MDS Erasure Code Scheme For Storage Applications

  2011cites this paper
• H-Code: A Hybrid MDS Array Code to Optimize Partial Stripe Writes in RAID-6

  2011cites this paper
• Lonestar: An Energy-Aware Disk Based Long-Term Archival Storage System

  2011cites this paper
• Finding the most fault-tolerant flat XOR-based erasure codes for storage systems

  2011cites this paper
• Research of network storage system based on erasure code

  2011cites this paper
• In Search of I/O-Optimal Recovery from Disk Failures

  2011cites this paper
• A Hybrid Approach to Failed Disk Recovery Using RAID-6 Codes: Algorithms and Performance Evaluation

  2011influential citation
• HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6

  2011cites this paper
• Victim Disk First: An Asymmetric Cache to Boost the Performance of Disk Arrays under Faulty Conditions

  2011cites this paper
• A A Hybrid Approach of Failed Disk Recovery Using RAID-6 Codes : Algorithms and Performance Evaluation

  2011cites this paper
• Self-adjusting two-failure tolerant disk arrays

  2010cites this paper