Data Deduplication Based on Hadoop

No abstract is available for this paper.

• Publication year

  2017

• Venue

  International Conference on Advanced Cloud and Big Data

• Publication date

  2017-08-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/CBD.2017.33
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A Survey of Secure Data Deduplication Schemes for Cloud Storage Systems

  2017cited by this paper
• Distributed Data Deduplication

  2016cited by this paper
• Trends in Cleaning Relational Data: Consistency and Deduplication

  2015cited by this paper
• An Overview on Data Deduplication Techniques

  2015cited by this paper
• Design and Implementation of File Deduplication Framework on HDFS

  2014cited by this paper
• A novel approach to data deduplication over the engineering-oriented cloud systems

  2013influential reference
• SAFE: Structure-aware file and email deduplication for cloud-based storage systems

  2013cited by this paper
• Primary Data Deduplication - Large Scale Study and System Design

  2012cited by this paper
• Dedoop: Efficient Deduplication with Hadoop

  2012cited by this paper
• iDedup: latency-aware, inline data deduplication for primary storage

  2012cited by this paper
• Entity Resolution: Theory, Practice & Open Challenges

  2012cited by this paper
• Tradeoffs in Scalable Data Routing for Deduplication Clusters

  2011cited by this paper
• SiLo: A Similarity-Locality based Near-Exact Deduplication Scheme with Low RAM Overhead and High Throughput

  2011cited by this paper
• A Method of Object-based De-duplication

  2011cited by this paper
• ChunkStash: Speeding Up Inline Storage Deduplication Using Flash Memory

  2010cited by this paper
• Multi-level comparison of data deduplication in a backup scenario

  2009cited by this paper
• Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality

  2009cited by this paper
• HYDRAstor: A Scalable Secondary Storage

  2009cited by this paper
• ADMAD: Application-Driven Metadata Aware De-duplication Archival Storage System

  2008cited by this paper
• Avoiding the Disk Bottleneck in the Data Domain Deduplication File System

  2008cited by this paper
• Duplicate Record Detection: A Survey

  2007cited by this paper
• A low-bandwidth network file system

  2001cited by this paper
• Single Instance Storage in Windows

  2000cited by this paper
• OceanStore: an architecture for global-scale persistent storage

  2000cited by this paper
• Single Instance Storage in Windows (cid:1) 2000

  2000cited by this paper
• Proceedings of the Fast 2002 Conference on File and Storage Technologies Venti: a New Approach to Archival Storage

  year unknowncited by this paper
• Proceedings of the General Track: 2003 Usenix Annual Technical Conference Application-specific Delta-encoding via Resemblance Detection

  year unknowncited by this paper

• MEIS: Optimizing deduplication system with efficient index structure

  2026cites this paper
• An exploratory analysis of methods for real-time data deduplication in streaming processes

  2023cites this paper
• Secure EMR Classification and Deduplication using MapReduce

  2022cites this paper
• Concepts, strategies, and challenges of data deduplication

  2021cites this paper
• Data Deduplication on Multi-domain Big Data to Overcome Communication Overheads

  2021cites this paper
• Hadoop Data Reduction Framework: Applying Data Reduction at the DFS Layer

  2021cites this paper
• SecDedoop: Secure Deduplication with Access Control of Big Data in the HDFS/Hadoop Environment

  2020cites this paper
• HDRF: Hadoop data reduction framework for hadoop distributed file system

  2020cites this paper
• Data Deduplication Techniques for Big Data Storage Systems

  2019cites this paper
• International Journal of Innovative Technology and Exploring Engineering (IJITEE)

  2019cites this paper
• Implementation of Deduplication on Encrypted Big-data using Signcryption for cloud storage applications

  2018cites this paper