A Hand Book on Hadoop : Real World Approach for Infinite Scalability

Dipayan Dev

ISBN 10: 3659890847 / ISBN 13: 9783659890840

Edité par LAP LAMBERT Academic Publishing, 2016

A Hand Book on Hadoop : Real World Approach for Infinite Scalability | Dipayan Dev | Taschenbuch | 84 S. | Englisch | 2016 | LAP LAMBERT Academic Publishing | EAN 9783659890840 | Verantwortliche Person für die EU: preigu GmbH & Co. KG, Lengericher Landstr. 19, 49078 Osnabrück, mail[at]preigu[dot]de | Anbieter: preigu. N° de réf. du vendeur 103762921

Synopsis :

In this Exa byte scale era, data increases at an exponential rate. This is in turn generating a massive amount of metadata in the file system. Hadoop is the most widely used framework to deal with big data. Due to this growth of huge amount of metadata, however, the efficiency of Hadoop is questioned numerous times by many researchers. Therefore, it is essential to create an efficient and scalable metadata management for Hadoop. The book principally deals with the Single Point of Failure (SPOF) of Hadoop by providing a suitable distributed metadata management. This book presents a circular Metadata management mechanism named Dynamic Circular Metadata Splitting (DCMS). DCMS preserves metadata locality using consistent hashing as well as locality-preserving hashing, keeps replicated metadata for excellent reliability, as well as dynamically distributes metadata among the NameNodes to keep load balancing. DCMS removes Hadoop's SPOF as well as provides an efficient and scalable metadata management. This book demonstrates the various experiments with DCMS, and shows how the new framework is an improved solution compared to the existing one, both mathematically and theoretically.

Présentation de l'éditeur: In this Exa byte scale era, data increases at an exponential rate. This is in turn generating a massive amount of metadata in the file system. Hadoop is the most widely used framework to deal with big data. Due to this growth of huge amount of metadata, however, the efficiency of Hadoop is questioned numerous times by many researchers. Therefore, it is essential to create an efficient and scalable metadata management for Hadoop. The book principally deals with the Single Point of Failure (SPOF) of Hadoop by providing a suitable distributed metadata management. This book presents a circular Metadata management mechanism named Dynamic Circular Metadata Splitting (DCMS). DCMS preserves metadata locality using consistent hashing as well as locality-preserving hashing, keeps replicated metadata for excellent reliability, as well as dynamically distributes metadata among the NameNodes to keep load balancing. DCMS removes Hadoop's SPOF as well as provides an efficient and scalable metadata management. This book demonstrates the various experiments with DCMS, and shows how the new framework is an improved solution compared to the existing one, both mathematically and theoretically.

Détails bibliographiques

Titre : A Hand Book on Hadoop : Real World Approach ...
Éditeur : LAP LAMBERT Academic Publishing
Date d'édition : 2016
Reliure : Taschenbuch
Etat : Neu