Erasure Coding in Windows Azure Storage

Cheng Huang,Huseyin Simitci,Yikang Xu,Aaron Ogus,B. Calder,Parikshit Gopalan,Jin Li,S. Yekhanin

Published 2012 in USENIX Annual Technical Conference

ABSTRACT

No abstract is available for this paper.

PUBLICATION RECORD

Publication year
2012
Venue
USENIX Annual Technical Conference
Publication date
2012-06-13
Fields of study
Computer Science
Identifiers
No identifiers available.
External record
Open on Semantic Scholar
Source metadata
Semantic Scholar

CITATION MAP

EXTRACTION MAP

CLAIMS

No claims are published for this paper.

CONCEPTS

No concepts are published for this paper.

REFERENCES

NCCloud: applying network coding for the storage repair in a cloud-of-clouds
2012cited by this paper
Rethinking erasure codes for cloud file systems: minimizing I/O for recovery and degraded reads
2012cited by this paper
Windows Azure Storage: a highly available cloud storage service with strong consistency
2011cited by this paper
AONT-RS: Blending Security and Performance in Dispersed Storage Systems
2011cited by this paper
On the Locality of Codeword Symbols
2011cited by this paper
Fast and Cautious Evolution of Cloud Storage
2010cited by this paper
Flat XOR-based erasure codes in storage systems: Constructions, efficient recovery, and tradeoffs
2010influential reference
Optimal recovery of single disk failure in RDP code storage systems
2010cited by this paper
Availability in Globally Distributed Storage Systems
2010influential reference
HydraFS: A High-Throughput File System for the HYDRAstor Content-Addressable Storage System
2010cited by this paper
An efficient XOR-scheduling algorithm for erasure codes encoding
2009cited by this paper
Parity Lost and Parity Regained
2008cited by this paper
An analysis of data corruption in the storage stack
2008cited by this paper
PRO: A Popularity-based Multi-threaded Reconstruction Optimization for RAID-Structured Storage Systems
2007cited by this paper
Network Coding for Distributed Storage Systems
2007cited by this paper
Pyramid Codes: Flexible Schemes to Trade Space for Access Efficiency in Reliable Data Storage Systems
2007cited by this paper
Subtleties in Tolerating Correlated Failures in Wide-area Storage Systems
2006cited by this paper
Efficient Replica Maintenance for Distributed Storage Systems
2006cited by this paper
HoVer Erasure Codes For Disk Arrays
2006cited by this paper
Ursa minor: versatile cluster-based storage
2005cited by this paper
WEAVER codes: highly fault tolerant erasure codes for storage systems
2005cited by this paper
Small parity-check erasure codes - exploration and observations
2005cited by this paper
Glacier: highly durable, decentralized storage despite massive correlated failures
2005cited by this paper
Low-Density Parity-Check Codes
2004cited by this paper
Reliability mechanisms for very large storage systems
2003cited by this paper
Erasure Coding Vs. Replication: A Quantitative Comparison
2002cited by this paper
Efficient erasure correcting codes
2001cited by this paper
Wide-area cooperative storage with CFS
2001cited by this paper
OceanStore: an architecture for global-scale persistent storage
2000cited by this paper
The part-time parliament
1998cited by this paper
An XOR-based erasure-resilient coding scheme
1995cited by this paper
Replication in the harp file system
1991cited by this paper
Coda: a highly available file system for a distributed workstation environment
1989cited by this paper
Scale and performance in a distributed file system
1987cited by this paper
Theory of Error-correcting Codes
year unknowninfluential reference

CITED BY

ZJC: Constructing fully local repair in erasure codes for distributed cloud storage
2026cites this paper
Efficient disk read and recovery cost reduction approach in heterogeneous liberation-coded storage systems
2026cites this paper
Cross-Rack Aware Recycle Technique in Erasure-Coded Data Centers
2026influential citation
AFCC: ACK-Based Fast Congestion Control in Lossless Networks
2026cites this paper
Erasure Coding-Based Cost-Optimized and Latency-Aware Data Storage in UAV-Enabled Edge Systems
2026cites this paper
SpotCC: Facilitating Coded Computation for Prediction Serving Systems on Spot Instances
2026cites this paper
Cross-Rack Update Bandwidth for Rack-Aware Storage Systems
2026cites this paper
FAR: Fast and Accurate Rate Control for Lossless Datacenter Networks
2026cites this paper
Easy repair via codes with simplex locality
2026cites this paper
Some new constructions of optimal and almost optimal locally repairable codes
2025cites this paper
Two Generic Constructions of MDS Array Codes With Optimal Repair Bandwidth From Two Special Sets
2025cites this paper
Asymptotically Optimal Repair of Reed-Solomon Codes with Small Sub-Packetization under Rack-Aware Model
2025cites this paper
Harnessing Parallelism for Fast Data Repair in MSR-Coded Storage
2025cites this paper
ElasticEC: Achieving Fast and Elastic Redundancy Transitioning in Erasure-Coded Clusters
2025cites this paper
RLDR: Reinforcement Learning-Based Fast Data Recovery in Cloud-of-Clouds Storage Systems
2025cites this paper
Improved Constructions and Lower Bounds for Maximally Recoverable Grid Codes
2025cites this paper
TSUE: A Two-Stage Data Update Method for an Erasure Coded Cluster File System
2025cites this paper
A Class of Parallel LRCs Applied in Large-scale Distributed Storage Systems——BRP-LRC
2025cites this paper
GroupRS: Node-Grouping-Based Data Placement Strategy in Erasure-Coded Data Center Storage for High Data Reliability
2025cites this paper
Construction of Quaternary Locally Repairable Codes with Distance Four for Cyber Storage
2025cites this paper
A Family of Optimal Linear Functional-Repair Regenerating Storage Codes
2025cites this paper
Fast Garbage Collection in Erasure-Coded Storage Clusters
2025influential citation
RaSA: Robust and Adaptive Secure Aggregation for Edge-Assisted Hierarchical Federated Learning
2025cites this paper
An Extensible Software Transport Layer for GPU Networking
2025influential citation
AC-Cache: A Memory-Efficient Caching System for Small Objects via Exploiting Access Correlations
2025cites this paper
Accelerating Erasure Coding on Persistent Memory via Adaptive Prefetcher Scheduling
2025cites this paper
Optimizing encoding and repair for wide-stripe minimum bandwidth regenerating codes in in-memory key-value stores
2025cites this paper
Tight Lower Bounds on the Bandwidth Cost of MDS Convertible Codes in the Split Regime
2025cites this paper
Undirected Multicast Network Coding Gaps via Locally Decodable Codes
2025cites this paper
Structure-Preserving Error-Correcting Codes for Polynomial Frames
2025cites this paper
Optimizing Data Availability and Performance in Cloud Storage with Hybrid Network-Coding and Object-Based Storage Systems
2025cites this paper
Fusion: An Analytics Object Store Optimized for Query Pushdown
2025cites this paper
Popularity-Aware Data Placement in Erasure Coding-Based Edge Storage Systems
2025cites this paper
Shift-XOR Convertible Locally Repairable Codes
2025cites this paper
NStripeMerge: A Storage Performance Improvement Strategy for Distributed Erasure Coded Cluster
2025influential citation
Secure Convertible Codes for Passive Eavesdroppers
2025cites this paper
Make Updates Faster: A Fast Multi-Stripe Updates Framework in Erasure-Coded Storage Clusters
2025cites this paper
Mitigating Inter-datacenter Incast with a Proxy: The shortest path is not necessarily the fastest
2025cites this paper
ZipLLM: Efficient LLM Storage via Model-Aware Synergistic Data Deduplication and Compression
2025cites this paper
DuoAdmit: Dual-Layer Cache Admission for Load-Balancing Hybrid-Redundancy Block Storage
2025cites this paper
Two Families of Optimal Quantum Locally Recoverable Codes
2025cites this paper
Erasure Coding Aware Block Placement for Data-Intensive Applications
2025cites this paper
New Wide Locally Recoverable Codes with Unified Locality
2025cites this paper
Towards the Question of Packet Recovery at the Transport Layer
2025cites this paper
An MDS Code Construction for Optimal Update and Efficient Repair With Linear Subpacketization Level and Small Field Size
2025cites this paper
Cooperative Repair Schemes of Reed–Solomon Codes With Three Erasures
2025cites this paper
Crossword: Adaptive Consensus for Dynamic Data-Heavy Workloads
2025influential citation
A hardware/software architecture for multi-threaded offloading of erasure codes in distributed file systems
2025cites this paper
Non-Reed-Solomon Type MDS Codes from Elliptic Curves
2025cites this paper
Toward Efficient Repair for Wide-Stripe Erasure Coding With High Reliability
2025influential citation
Reducing Multi-Node Repair Bandwidth with ERN-MBR Codes
2025cites this paper
Separation and optimization of encryption and erasure coding in decentralized storage systems
2025cites this paper
MetaEC: An Efficient and Resilient Erasure-Coded KV Store on Disaggregated Memory
2025cites this paper
Toward Load-Balanced Redundancy Transitioning for Erasure-Coded Storage
2025cites this paper
Te-PID: An Adaptive Erasure Coding Temperature Management System for Optimized Cloud Storage
2025influential citation
Optimal repair and load balance in locally repairable codes: Design and evaluation
2025cites this paper
LWCM: A Lookahead-Window Constrained Model for Disk Failure Prediction in Large Data Centers
2025cites this paper
Correction of chain losses in trapped ion quantum computers
2025cites this paper
DSPE: Profit Maximization in Edge-Cloud Storage System using Dynamic Space Partitioning with Erasure Code
2025cites this paper
Design of Storage Codes Based on Integer Arithmetic Modulo a Power of Two
2025cites this paper
RAN: Accelerating Data Repair with Available Nodes in Erasure-Coded Storage
2025cites this paper
Proactive SSD Failure Prediction with A Gradient-Guided LSTM-xLSTM Hybrid Model
2025cites this paper
Making Wide Stripes Practical: Cascaded Parity LRCs for Efficient Repair and High Reliability
2025cites this paper
EdgeHydra: Fault-Tolerant Edge Data Distribution Based on Erasure Coding
2025cites this paper
File-Level EC : A Chunk Containing Meaning
2025cites this paper
A Blockchain Spatiotemporal Information Consensus Scheme Toward Mobile Edge Nodes
2025cites this paper
ChameleonEC: Exploiting Tunability of Erasure Coding for Low-Interference Repair
2025influential citation
An exabyte a day: throughput-oriented, large scale, managed data transfers with Effingo
2024cites this paper
On Lengths of Singleton-Optimal Locally Repairable Codes
2024cites this paper
Examining SSD-correlated Failures within Racks in Production Data Centers
2024cites this paper
Storage-Transmission Integrated Erasure Coding Aggregation Repair Techniques in LEO Satellite Data Centers
2024cites this paper
DBNode: A Decentralized Storage System for Big Data Storage in Consortium Blockchains
2024cites this paper
Coupling Congestion Control and Flow Pausing in Data Center Network
2024cites this paper
Designing Non-uniform Locally Repairable Codes for Wide Stripes under Skewed File Accesses
2024cites this paper
A Parallel Partial Merge Repair Algorithm for Multi-block Failures for Erasure Storage Systems
2024cites this paper
A Call for Research on Storage Emissions
2024cites this paper
Elastic Reed-Solomon Codes for Efficient Redundancy Transitioning in Distributed Key-Value Stores
2024cites this paper
TREAT - Two wRongs makE A righT: efficient distributed storage and queries of IoT datasets with erasure coding and compression
2024cites this paper
Storage and Data Processing Technology in the Era of Information Explosion: from Traditional to Edge Computing
2024cites this paper
Achieving Tunable Erasure Coding with Cluster-Aware Redundancy Transitioning
2024cites this paper
Erasure-Coded Hybrid Writes Based on Data Delta
2024influential citation
CXL Shared Memory Programming: Barely Distributed and Almost Persistent
2024cites this paper
Rethinking Erasure-Coding Libraries in the Age of Optimized Machine Learning
2024cites this paper
FNCC: Fast Notification Congestion Control in Data Center Networks
2024cites this paper
SiaDFP: A Disk Failure Prediction Framework Based on Siamese Neural Network in Large-Scale Data Center
2024cites this paper
Stripe-schedule Aware Repair in Erasure-coded Clusters with Heterogeneous Star Networks
2024influential citation
A family of self-orthogonal divisible codes with locality 2
2024cites this paper
Optimal Wide Stripe Generation in Locally Repairable Codes via Staged Stripe Merging
2024influential citation
Locally maximal recoverable codes and LMR-LCD codes
2024cites this paper
The augmented codes of a family of linear codes with locality 2
2024cites this paper
Revisiting Erasure Codes: A Configuration Perspective
2024influential citation
Beehive: A Flexible Network Stack for Direct-Attached Accelerators
2024cites this paper
TORR: A Lightweight Blockchain for Decentralized Federated Learning
2024cites this paper
Parallelized In-Network Aggregation for Failure Repair in Erasure-Coded Storage Systems
2024influential citation
Comparative Analysis of Object-Based Big Data Storage Systems on Architectures and Services: A Recent Survey
2024cites this paper
HSM: A Hybrid Storage Method Based on the Heat of Data and Global Disk Space Utilization
2024cites this paper
A Fast Location-Aware Repair Strategy for Mobile Grouped Storage Clusters
2024cites this paper
AquaSonic: Acoustic Manipulation of Underwater Data Center Operations and Resource Management
2024cites this paper
New EVENODD+ Codes with More Flexible Parameters and Lower Complexity
2024cites this paper
Low-repair array codes based on nested structures
2024cites this paper