Hadoop is widely used for massively distributed data storage. Even though it is highly fault tolerant, scalable and runs on commodity hardware, it does not provide efficient and optimized data storage solution. When user uploads files with the same contents in Hadoop, it stores all files to HDFS (Hadoop Distributed File System) even if the contents are same that leads to duplication of contents hence it is wastage of storage space. Data deduplication is process to reduce the required storage capacity as only the unique instances of data get stored. The Data Deduplication process is widely...

To protect outsourced data in cloud storage against corruptions, enabling integrity protection, fault tolerance, and efficient recovery for cloud storage becomes critical. FMSR-DIP is a proof-of-concept prototype aimed at providing data integrity protection atop todays cloud storage. FMSR-DIP augments the FMSR code with a data checking capability that allows stored data to be sampled for checking in a flexible manner, without adding to its download traffic requirements during file downloads or repairs. So its provides an efficient data integrity checking capability to FMSR code to provide a...