HYDRAstor: A Scalable Secondary Storage

C. Dubnicki,Leszek Gryz,L. Heldt,M. Kaczmarczyk,W. Kilian,P. Strzelczak,Jerzy Szczepkowski,C. Ungureanu,Michal Welnicki

Published 2009 in USENIX Conference on File and Storage Technologies

ABSTRACT

No abstract is available for this paper.

PUBLICATION RECORD

Publication year
2009
Venue
USENIX Conference on File and Storage Technologies
Publication date
2009-02-24
Fields of study
Computer Science, Engineering
Identifiers
No identifiers available.
External record
Open on Semantic Scholar
Source metadata
Semantic Scholar

CITATION MAP

EXTRACTION MAP

CLAIMS

No claims are published for this paper.

CONCEPTS

No concepts are published for this paper.

REFERENCES

7th USENIX Conference on File and Storage Technologies, February 24-27, 2009, San Francisco, CA, USA. Proceedings
2009cited by this paper
Avoiding the Disk Bottleneck in the Data Domain Deduplication File System
2008influential reference
Fast, Inexpensive Content-Addressed Storage in Foundation
2008cited by this paper
Scalable Performance of the Panasas Parallel File System
2008cited by this paper
Pergamum: Replacing Tape with Energy Efficient, Reliable, Disk-Based Archival Storage
2008cited by this paper
RADOS: a scalable, reliable storage service for petabyte-scale storage clusters
2007cited by this paper
Stardust: tracking activity in a distributed storage system
2006cited by this paper
Early experiences on the journey towards self-* storage
2006cited by this paper
Modular Software Upgrades for Distributed Systems
2006cited by this paper
Ceph: a scalable, high-performance distributed file system
2006cited by this paper
Deconstructing commodity storage clusters
2005cited by this paper
Glacier: highly durable, decentralized storage despite massive correlated failures
2005cited by this paper
DISP: Practical, efficient, secure and fault-tolerant distributed data storage
2005cited by this paper
Ursa minor: versatile cluster-based storage
2005cited by this paper
Deep Store: an archival storage system architecture
2005cited by this paper
FPN: a distributed hash table for commercial applications
2004cited by this paper
Tapestry: a resilient global-scale overlay for service deployment
2004cited by this paper
A Self-Organizing Storage Cluster for Parallel Data-Intensive Applications
2004cited by this paper
FAB: building distributed enterprise disk arrays from commodity components
2004cited by this paper
RepStore: a self-managing and self-tuning storage backend with smart bricks
2004cited by this paper
The Google file system
2003cited by this paper
Kademlia: A peer-to-peer information system based on the xor metric
2003cited by this paper
A Human Organization Analogy for Self-* Systems (CMU-CS-03-129)
2003cited by this paper
Object-based storage
2003cited by this paper
System Support for Online Reconfiguration
2003cited by this paper
Erasure Coding Vs. Replication: A Quantitative Comparison
2002cited by this paper
Kademlia: A Peer-to-Peer Information System Based on the XOR Metric
2002cited by this paper
OceanStore: An Extremely Wide-Area Storage System
2002cited by this paper
Scalable, decentralized object location and routing for large-scale peer-to-peer systems
2001cited by this paper
Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility
2001cited by this paper
Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
2001cited by this paper
Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications
2001cited by this paper
Wide-area cooperative storage with CFS
2001cited by this paper
A scalable content-addressable network
2001cited by this paper
Chord: A scalable peer-to-peer lookup service for internet applications
2001cited by this paper
Petal: distributed virtual disks
1996cited by this paper
A Survey of Distributed Garbage Collection Techniques
1995cited by this paper
An XOR-based erasure-resilient coding scheme
1995cited by this paper
Proceedings of the Fast 2002 Conference on File and Storage Technologies Venti: a New Approach to Archival Storage
year unknowncited by this paper
Object-based Storage
year unknowncited by this paper
Proceedings of the 5th Symposium on Operating Systems Design and Implementation Farsite: Federated, Available, and Reliable Storage for an Incompletely Trusted Environment
year unknowncited by this paper

CITED BY

Optimizing Deduplication Parameters via a Change-Estimation Analytical Model
2026influential citation
Accelerating Data Chunking in Deduplication Systems using Vector Instructions
2025cites this paper
Let It Slide: Online Deduplicated Data Migration
2025cites this paper
Vectorized Sequence-Based Chunking for Data Deduplication
2025cites this paper
Distributed Data Deduplication for Big Data: A Survey
2025influential citation
Palantir: Hierarchical Similarity Detection for Post-Deduplication Delta Compression
2024cites this paper
Common Pitfalls with Data Deduplication Parameters and Metrics
2024influential citation
Derrick: A Three-layer Balancer for Self-managed Continuous Scalability
2023influential citation
ObjDedup: High-Throughput Object Storage Layer for Backup Systems With Block-Level Deduplication
2023cites this paper
A smart hybrid content-defined chunking algorithm for data deduplication in cloud storage
2023cites this paper
Saving power in disks, flash memories, and servers
2022cites this paper
DeepSketch: A New Machine Learning-Based Reference Search Technique for Post-Deduplication Delta Compression
2022cites this paper
Predicting Deduplication Performance: An Analytical Model and Empirical Evaluation
2022cites this paper
DENOVA: Deduplication Extended NOVA File System
2022cites this paper
The what, The from, and The to: The Migration Games in Deduplicated Systems
2022cites this paper
Decentralized and Privacy Sensitive Data De-Duplication Framework for Convenient Big Data Management in Cloud Backup Systems
2022cites this paper
From Hyper-dimensional Structures to Linear Structures: Maintaining Deduplicated Data’s Locality
2022cites this paper
Pushing Collaborative Data Deduplication to the Network Edge: An Optimization Framework and System Design
2022cites this paper
Efficient data deduplication scheme for scale-out distributed storage
2021cites this paper
Deduplication: Concepts and Techniques
2021cites this paper
Coupling Right-Provisioned Cold Storage Data Centers with Deduplication
2021cites this paper
Research on Routing Strategy in Cluster Deduplication System
2021cites this paper
SLIMSTORE: A Cloud-based Deduplication System for Multi-version Backups
2021cites this paper
Ensuring high reliability and performance with low space overhead for deduplicated and delta‐compressed storage systems
2021cites this paper
DedupCloud: an optimized efficient virtual machine deduplication algorithm in cloud computing environment
2021cites this paper
Classification criteria for data deduplication methods
2021cites this paper
Crocus: Enabling Computing Resource Orchestration for Inline Cluster-Wide Deduplication on Scalable Storage Systems
2020cites this paper
Deduplication: Concepts and Techniques
2020cites this paper
A Content Fingerprint-Based Cluster-Wide Inline Deduplication for Shared-Nothing Storage Systems
2020influential citation
QuickDedup: Efficient VM deduplication in cloud computing environments
2020cites this paper
SACRO : Solid state drive‐assisted chunk caching for restore optimization
2020cites this paper
Ensuring Reliability in Deduplicated Data by Erasure Coded Replication
2020cites this paper
Using Efficient Deduplication Method in Large-scale Distributed Storage System
2020cites this paper
GoSeed: Generating an Optimal Seeding Plan for Deduplicated Storage
2020cites this paper
Distributed deduplication with fingerprint index management model for big data storage in the cloud
2020cites this paper
Making Data Storage Efficient in the Era of Cloud Computing
2020cites this paper
Boafft: Distributed Deduplication for Big Data Storage in the Cloud
2020cites this paper
SSD Assisted Caching for Restore Optimization in Distributed Deduplication Environment
2020cites this paper
PBCCF: Accelerated Deduplication by Prefetching Backup Content Correlated Fingerprints
2020cites this paper
HotDedup: Managing Hot Data Storage at Network Edge through Optimal Distributed Deduplication
2020cites this paper
IMPROVED DATA DE-DUPLICATION IN CLOUD
2019cites this paper
Chunk Rewriting for Improving Deduplication Restore Performance
2019cites this paper
CSF: An Efficient Parallel Deduplication Algorithm by Clustering Scattered Fingerprints
2019cites this paper
Securing Cloud Data Under Key Exposure
2019influential citation
Improving Restore Performance in Deduplication Systems via a Cost-Efficient Rewriting Scheme
2019cites this paper
Application-Aware Big Data Deduplication in Cloud Environment
2019influential citation
Practices of backuping homomorphically encrypted databases
2019cites this paper
EF-Dedup: Enabling Collaborative Data Deduplication at the Network Edge
2019cites this paper
RepEC-Duet: Ensure High Reliability and Performance for Deduplicated and Delta-Compressed Storage Systems
2019cites this paper
PROVIDING SECURITY BY USING BASTION ALGORITHM FOR COLLEGE MANAGEMENT SYSTEM
2018cites this paper
A Robust Fault-Tolerant and Scalable Cluster-Wide Deduplication for Shared-Nothing Storage Systems
2018influential citation
Design of Global Data Deduplication for a Scale-Out Distributed Storage System
2018cites this paper
HPDV:A Highly Parallel Deduplication Cluster for Virtual Machine Images
2018cites this paper
Developing Cost-Effective Data Rescue Schemes to Tackle Disk Failures in Data Centers
2018cites this paper
A Simulation Analysis of Redundancy and Reliability in Primary Storage Deduplication
2018cites this paper
ALACC: Accelerating Restore Performance of Data Deduplication Systems Using Adaptive Look-Ahead Window Assisted Chunk Caching
2018cites this paper
Incorporate Proactive Data Protection in ZFS Towards Reliable Storage Systems
2018cites this paper
PM-RAD: An Efficient Restore Algorithm in Deduplication by Pattern Matching
2018cites this paper
KerA: A Unified Ingestion and Storage System for Scalable Big Data Processing. (KerA : un système unifié d'ingestion et de stockage pour le traitement efficace du Big Data)
2018cites this paper
DARM: A Deduplication-Aware Redundancy Management Approach for Reliable-Enhanced Storage Systems
2018cites this paper
Improving Restore Performance in Deduplication-Based Backup Systems via a Fine-Grained Defragmentation Approach
2018cites this paper
Enabling Proactive Data Protection in ZFS To Build Reliable Big Data Storage Systems
2018cites this paper
A Global Survey on Data Deduplication
2018cites this paper
Second Order Mutual Information based Grey Wolf Optimization for effective storage and de-duplication
2018cites this paper
Reducing Fragmentation via Exploiting Backup History and Cache Knowledge Granting Security
2018cites this paper
Envisioning an Information Assurance and Performance Infrastructure for the Internet of Things
2018cites this paper
A Lookahead Read Cache: Improving Read Performance for Deduplication Backup Storage
2017cites this paper
Existing Deduplication Techniques
2017cites this paper
Multi-Objective Metrics to Evaluate Deduplication Approaches
2017cites this paper
International Journal of Scientific Research in Computer Science, Engineering and Information Technology
2017cites this paper
Online Deduplication for Databases
2017cites this paper
A Fine-Grained Defragmentation Approach to Improve Restore Performance
2017cites this paper
Efficient image restoration of virtual machines with reference count based rewriting and caching
2017cites this paper
Exploring Shared State in Key-Value Store for Window-Based Multi-pattern Streaming Analytics
2017cites this paper
Similarity-based Deduplication for Databases
2017cites this paper
RefCRE: A Reference Count Based Rewriting Framework for VM Image Restoration
2017cites this paper
DOMe: A deduplication optimization method for the NewSQL database backups
2017cites this paper
Data Deduplication Based on Hadoop
2017cites this paper
A Cost-efficient Rewriting Scheme to Improve Restore Performance in Deduplication Systems
2017cites this paper
DDFlasks: Deduplicated Very Large Scale Data Store
2017cites this paper
Data deduplication techniques for efficient cloud storage management: a systematic review
2017cites this paper
A Delayed Container Organization Approach to Improve Restore Speed for Deduplication Systems
2016cites this paper
Wiki-Health: From Quantified Self to Self-Understanding
2016cites this paper
Reducing Fragmentation for In-line Deduplication Backup Storage via Exploiting Backup History and Cache Knowledge
2016cites this paper
AVOIDING THE DE-DUPLICATION USING CONTENT SIMILARITY AND JOB SCHEDULING ALLOCATION BASED ON WORKLOADS
2016cites this paper
Experimental Study on Chunking Algorithms of Data Deduplication System on Large Scale Data
2016cites this paper
AN APPROACH TO REDUCE FRAGMENTATION FOR DEDUPLICATION BACKUP STORAGE BY EXPLOITING BACKUP HISTORY AND CACHE KNOWLEDGE
2016cites this paper
VMBackup: an efficient framework for online virtual machine image backup and recovery
2016cites this paper
Online Deduplication for Distributed Databases
2016cites this paper
Cloud Based Data Recovery and Reconstruction System Using Erasure Code Implementation
2016cites this paper
Cloud Based Data Recovery and Reconstruction System Using BI-Methodology Erasure Code Implementation
2016cites this paper
Improvement of Deduplication Efficiency by Two-Layer Deduplication System
2016cites this paper
File similarity evaluation scheme for multimedia data using partial hash information
2016cites this paper
A Comprehensive Study of the Past, Present, and Future of Data Deduplication
2016influential citation
Hadoop Based Scalable Cluster Deduplication for Big Data
2016cites this paper
Result on Storage and Security Management on Private Cloud
2016cites this paper
A simulation analysis of reliability in primary storage deduplication
2016cites this paper
RMD: A Resemblance and Mergence Based Approach for High Performance Deduplication
2016cites this paper
Utilizing SSD to Alleviate Chunk Fragmentation in De-Duplicated Backup Systems
2016cites this paper
ブロックストレージシステムにおけるLatency‐aware Inline‐dedup Optimization
2016influential citation