Automatic Tuning of Data-Intensive Analytical Workloads

ISBN-13: 9783330001404 / Angielski / Miękka / 2016 / 328 str.

Herodotos Herodotou

Opis

Modern industrial, government, and academic organizations are collecting massive amounts of data at an unprecedented scale and pace. The ability to perform timely and cost-effective analytical processing of such large datasets in order to extract deep insights is now a key ingredient for success. Existing database systems are adapting to the new status quo while large-scale dataflow systems like MapReduce are becoming popular for executing analytical workloads on Big Data. In order to ensure good and robust performance automatically on such systems, a novel dynamic optimization approach has been developed that works across different tuning scenarios and systems. The solution is based on (i) collecting monitoring information in order to learn the run-time behavior of workloads, (ii) deploying appropriate models to predict the impact of hypothetical tuning choices on workload behavior, and (iii) using efficient search strategies to find tuning choices that give good workload performance. The dynamic nature enables this solution to overcome the new challenges posed by Big Data, and also makes it applicable to both MapReduce and Database systems.

O autorze

Dr. Herodotos Herodotou is a tenure-track Lecturer at the Cyprus University of Technology. He received his Ph.D. in Computer Science from Duke University in 2012. His research interests are in large-scale Data Processing and Database Systems. In particular, his work focuses on automatic manageability and tuning of data-intensive computing systems.