Advances in Indexing Scientific Data: Helping Science Reach New Frontiers - Couverture souple

Sinha, Rishi

 
9783838310411: Advances in Indexing Scientific Data: Helping Science Reach New Frontiers
Couverture souple
ISBN 10 : 3838310411 ISBN 13 : 9783838310411
Editeur : LAP LAMBERT Academic Publishing, 2010

Synopsis

The ability to extract information from collected data has always driven science. Today’s large computers and automated sensing technologies collect terabytes of data in a few weeks. Extracting information from such large amounts of data is like trying to find a needle in a haystack. This book proposes the use of bitmap indexes to efficiently solve this problem. Earlier solutions around bitmap indexes were either too slow or too large to answer large-range scientific queries, and did not provide a way to efficiently consolidate queried data points into meaningful objects. To solve these problems, we introduce multi-resolution, adaptive bitmap indexes in this book and a novel algorithm to consolidate points into objects of interest. Data is binned at multiple granularities, and indexes created for these bins giving a 10x performance gain compared to traditional bitmaps. Making these indexes adaptive reduces the size requirement, giving a 6x performance improvement over a regular bitmap index of the same size. The consolidation algorithm uses special properties of compressed bitmaps and scientific meshes to create objects in time sub linear in number of points retrieved.

Les informations fournies dans la section « Synopsis » peuvent faire référence à une autre édition de ce titre.

Présentation de l'éditeur

The ability to extract information from collected data has always driven science. Today?s large computers and automated sensing technologies collect terabytes of data in a few weeks. Extracting information from such large amounts of data is like trying to find a needle in a haystack. This book proposes the use of bitmap indexes to efficiently solve this problem. Earlier solutions around bitmap indexes were either too slow or too large to answer large-range scientific queries, and did not provide a way to efficiently consolidate queried data points into meaningful objects. To solve these problems, we introduce multi-resolution, adaptive bitmap indexes in this book and a novel algorithm to consolidate points into objects of interest. Data is binned at multiple granularities, and indexes created for these bins giving a 10x performance gain compared to traditional bitmaps. Making these indexes adaptive reduces the size requirement, giving a 6x performance improvement over a regular bitmap index of the same size. The consolidation algorithm uses special properties of compressed bitmaps and scientific meshes to create objects in time sub linear in number of points retrieved.

Biographie de l'auteur

Dr. Sinha did his Ph. D.(2007) from Univ. of Illinois, Urbana in scientific data management. He has worked as a researcher at the Lawrence Berkeley Lab and has many publications and patent applications to his name. He is currently working at Microsoft, creating novel distributed systems for SQL Azure. He lives in Bothel with his lovely wife, Swati.

Les informations fournies dans la section « A propos du livre » peuvent faire référence à une autre édition de ce titre.

Éditeur
LAP LAMBERT Academic Publishing
Date d'édition
2010
Langue
anglais
ISBN 10 
3838310411
ISBN 13 
9783838310411
Reliure
Broché
Nombre de pages
172
Coordonnées du fabricant
non disponible
Personne responsable
KreGa Onlinehandel GmbH
4950000000000
info@krega-onlinehandel.de

Birkenweg 31
Brakel
33034
Allemagne