Scientific Data Management: Challenges, Technology, and Deployment, (Hardcover)

This work describes cutting-edge technologies and solutions for managing and analyzing vast amounts of scientific data. It begins with coverage of efficient storage systems, discussing how to write and read large volumes of data without slowing the simulation, analysis, or visualization processes. The book then focuses on the efficient data movement and management of storage spaces and explores emerging database systems for scientific data. It also addresses how to best organize data for analysis purposes, how to effectively conduct searches over large datasets, how to successfully automate multistep scientific process workflows, and how to automatically collect metadata and lineage information.