Improving metadata management for small files in HDFS

No abstract is available for this paper.

• Publication year

  2009

• Venue

  2009 IEEE International Conference on Cluster Computing and Workshops

• Publication date

  2009-10-16

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/CLUSTR.2009.5289133
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• CloudBurst: highly sensitive read mapping with MapReduce

  2009cited by this paper
• Small-file access in parallel file systems

  2009cited by this paper
• Introducing map-reduce to high end computing

  2008cited by this paper
• MapReduce: simplified data processing on large clusters

  2008cited by this paper
• The Sloan Digital Sky Survey Data Archive Server

  2006cited by this paper
• Monitoring the Earth System Grid with MDS4

  2006cited by this paper
• ZTR: a new format for DNA sequence trace data

  2002cited by this paper

• Correlation aware solution for merging small files based on similarity and clustering in HDFS

  2025cites this paper
• Research on Situational Awareness Technology of Industrial Control Network Based on Big Data

  2022cites this paper
• Time series modelling and forecasting for predicting Covid19 Case Load using LSTM

  2021cites this paper
• An Efficient Approach for Merging Small Files in HDFS Storage and Accessing Small Files by Using Name Node Method in Big Data

  2021cites this paper
• Massive Small File Storage Scheme Based on Association Rule Mining

  2021cites this paper
• Performance Analysis of Distributed Computing Frameworks for Big Data Analytics: Hadoop Vs Spark

  2020cites this paper
• ATCS: Auto-Tuning Configurations of Big Data Frameworks Based on Generative Adversarial Nets

  2020cites this paper
• User Behavior Data Analysis of Taobao Online Based on Flink-Based K-Means Algorithm

  2020cites this paper
• Parallel I/O on Compressed Data Files: Semantics, Algorithms, and Performance Evaluation

  2020cites this paper
• PHDFS: Optimizing I/O performance of HDFS in deep learning cloud computing platform

  2020cites this paper
• Toward a big data approach for indexing encrypted data in Cloud Computing

  2019cites this paper
• An improved distributed storage model of remote sensing images based on the HDFS and pyramid structure

  2019cites this paper
• A noble approach to develop dynamically scalable namenode in hadoop distributed file system using secondary storage

  2019cites this paper
• Big Data Warehouses for Smart Industries

  2019cites this paper
• Designing Authentication for Hadoop Cluster using DNA Algorithm

  2019influential citation
• Portable Smart Spectrometer Integrated with Blockchain and Big Data Technology

  2019cites this paper
• A Survey of Big Data Analytics for Smart Forestry

  2019cites this paper
• A MapReduce-Based Parallel Frequent Pattern Growth Algorithm for Spatiotemporal Association Analysis of Mobile Trajectory Big Data

  2018cites this paper
• Evaluating Several Design Patterns and Trends in Big Data Warehousing Systems

  2018cites this paper
• Small file problem in Hadoop and solution to improve access and storage performance

  2018cites this paper
• Review on Design & Implementation of Metadata Management for File System

  2018cites this paper
• Research of Access Optimization of Small Files on Basis of B + Tree on Hadoop

  2018cites this paper
• A Proposed Approach for Improving Hadoop Performance for Handling Small Files

  2018cites this paper
• Hybrid approach for big data localization and semantic annotation

  2018cites this paper
• Data and container placement in scalable data analytics platforms

  2018cites this paper
• solution for the future: small file management by optimizing Hadoop

  2018cites this paper
• An Optimal Solution of Storing and Processing Small Image Files on Hadoop

  2018cites this paper
• Research and Optimization of Massive Music Data Access Based on HDFS

  2018cites this paper
• HDFSx: An Enhanced Model to Handle Small Files in Hadoop with a Simulating Toolkit

  2018cites this paper
• TýrFS: Increasing Small Files Access Performance with Dynamic Metadata Replication

  2018cites this paper
• Optimized MapFile Based Storage of Small Files in Hadoop

  2017cites this paper
• Addressing Hadoop's Small File Problem With an Appendable Archive File Format

  2017cites this paper
• Prefetching-based metadata management in Advanced Multitenant Hadoop

  2017cites this paper
• Performance efficiency in Hadoop for storing and accessing small files

  2017cites this paper
• An efficient distributed caching for accessing small files in HDFS

  2017cites this paper
• Optimizing small file storage process of the HDFS which based on the indexing mechanism

  2017cites this paper
• Structured Parallel Efficient Execution Database Management System Over Enormous Dataset with MapReduce using Matlab

  2017cites this paper
• Improving Small File Management in Hadoop

  2017cites this paper
• An Efficient Approach to Optimize the Performance of Massive Small Files in Hadoop MapReduce Framework

  2017cites this paper
• A REVIEW ON SMALL FILES IN HADOOP A NOVEL APPROACH TO UNDESTAND SMALL FILES PROBLEM IN HADOOP

  2017cites this paper
• An Efficient Approach to Manage Small Files in Distributed File Systems

  2017cites this paper
• An improved HDFS for small file

  2016cites this paper
• SFS: A massive small file processing middleware in Hadoop

  2016cites this paper
• Balanced multifileinput split (BaMS) technique to solve small file problem in hadoop

  2016cites this paper
• A Method of Adjusting the Number of Replica Dynamically in HDFS

  2016cites this paper
• Storing shared documents that are customized by users in cloud computing

  2016cites this paper
• MDS: In-Depth Insight

  2016cites this paper
• Survey of data intensive computing technologies application to to security log data management

  2016cites this paper
• HDCache: A Distributed Cache System for Real-Time Cloud Services

  2016cites this paper
• Kangaroo: Workload-Aware Processing of Range Data and Range Queries in Hadoop

  2016cites this paper
• A New Scheme for Storage and Retrieval of Shared Text Files

  2016cites this paper
• A Survey of Different Technologies and Recent Challenges of Big Data

  2016cites this paper
• System Optimization for Big Data Processing

  2016cites this paper
• A Review on an Efficient Approach to Manage Small Files in Distributed File Systems

  2016cites this paper
• HDFSX: Big data Distributed File System with small files support

  2016cites this paper
• Improving Access Efficiency of Small Files in HDFS

  2016influential citation
• Optimization strategy of Hadoop small file storage for big data in healthcare

  2016cites this paper
• HDFS enabled storage and management of remote sensing data

  2016cites this paper
• An Efficient Approach for Storing and Accessing Small Files with Big Data Technology

  2016cites this paper
• Performance enhancement of distributed K-Means clustering for big Data analytics through in-memory computation

  2015cites this paper
• A novel approach to improve the performance of Hadoop in handling of small files

  2015cites this paper
• Implementation of a Software-Defined Storage Service with Heterogeneous Storage Technologies

  2015cites this paper
• Assessment of Multiple MapReduce Strategies for Fast Analytics of Small Files

  2015cites this paper
• Genetic Algorithms Using Hadoop MapReduce

  2015cites this paper
• An Innovative Approach for Storing and Accessing Small Files in Hadoop Distributed File System

  2015cites this paper
• Small files storing and computing optimization in Hadoop parallel rendering

  2015cites this paper
• SCALABLE RESOURCE MANAGEMENT SYSTEM SOFTWARE FOR EXTREMESCALE DISTRIBUTED SYSTEMS

  2015cites this paper
• Cut-GAR: solution to determine cut-off point in cloud storage system

  2015cites this paper
• SFMapReduce: An optimized MapReduce framework for Small Files

  2015cites this paper
• An approach for choosing the right distributed file system

  2015cites this paper
• AQWA: Adaptive Query-Workload-Aware Partitioning of Big Spatial Data

  2015cites this paper
• Mitigate I/O access pattern divergence with heterogeneous architecture in HDFS

  2015cites this paper
• A novel approach for efficient handling of small files in HDFS

  2015cites this paper
• CLOUD STORAGE GATEWAYS AND RELATED CHALLENGES

  2015cites this paper
• An Effective Strategy for Improving Small File Problem in Distributed File System

  2015cites this paper
• Survey on Frameworks for Distributed Computing: Hadoop, Spark and Storm

  2015cites this paper
• A Novel Approach for Improving Security and Storage Efficiency on HDFS

  2015cites this paper
• HAR+: Archive and metadata distribution! Why not both?

  2015cites this paper
• Big Data Clustering Using Genetic Algorithm On Hadoop Mapreduce

  2015cites this paper
• A Novel Storing and Accessing Method of Traffic Incident Video Based on Spatial-Temporal Analysis

  2015cites this paper
• Overcoming Hadoop Scaling Limitations through Distributed Task Execution

  2015cites this paper
• Performance Optimization for Managing Massive Numbers of Small Files in Distributed File Systems

  2015cites this paper
• Optimization Scheme for Small Files Storage Based on Hadoop Distributed File System

  2015cites this paper
• Implementation of Software-Defined Storage Service with Heterogeneous Object Storage Technologies

  2015cites this paper
• A Demonstration of AQWA: Adaptive Query-Workload-Aware Partitioning of Big Spatial Data

  2015cites this paper
• Hmfs: Efficient Support of Small Files Processing over HDFS

  2014cites this paper
• On construction of a distributed data storage system in cloud

  2014cites this paper
• Improving performance of small-file accessing in Hadoop

  2014influential citation
• Clustering massive small data for IOT

  2014cites this paper
• Analytical review on Hadoop Distributed file system

  2014cites this paper
• A Paradigm Shift for Improved Processing of Small Files in Hadoop

  2014cites this paper
• Research on Storage Strategy of Unstructured Small Files in HDFS

  2014cites this paper
• Processing Method of Mass Small File Using Hadoop Platform

  2014cites this paper
• Sensor data compression based on MapReduce

  2014cites this paper
• Storage and Accessing Small Files Based on HDFS

  2014cites this paper
• Cloud Storage Management Technology for Small File Based on Two-Dimensional Packing Algorithm

  2014cites this paper
• A Hadoop Based Weblog Analysis System

  2014cites this paper
• New Framework For Improving Big Data Analysis Using Mobile Agent

  2014cites this paper
• Efficient Ways to Improve the Performance of HDFS for Small Files

  2014cites this paper
• Enhancing Availability and Reliability of Cloud Data through Syncopy

  2014cites this paper