Abstract
The use of economical, low-power microservers comprising of embedded CPUs is on the rise in supporting a myriad of applications. State of the art microservers can already match the performance of low-end traditional servers, and have been advocated as an energy-efficient alternative computing substrate for data centers as well. In this paper, we explore whether cluster comprising microservers can support the popular Hadoop platform. We conduct a quantitative study of six representative Hadoop applications on five hardware configurations. To compare the different clusters, we also define a comprehensive metric, PerfEC, which unifies the performance, energy consumption, and the acquisition and operating costs of the applications, and helps identify appropriate clusters for Hadoop applications. Experiments on our test clusters suggest that for applications such as TeraSort, RandomWriter and Grep microservers offer up to two orders of magnitude better efficiency in terms of PerfEC than traditional clusters. Similarly, a 3000-node cluster simulation driven by a real-world trace from Facebook shows that on average the studied microservers can match the performance of standard servers, while providing up to 31% energy savings at only 60% of the acquisition cost. We also compare PerfEC to the extant Total Cost of Ownership (TCO) metric, and find that our approach is better able to capture the trade-offs involved.
Original language | English (US) |
---|---|
Title of host publication | 2014 IEEE International Conference on Cluster Computing, CLUSTER 2014 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 66-74 |
Number of pages | 9 |
ISBN (Electronic) | 9781479955480 |
DOIs | |
State | Published - Nov 26 2014 |
Externally published | Yes |
Event | 16th IEEE International Conference on Cluster Computing, CLUSTER 2014 - Madrid, Spain Duration: Sep 22 2014 → Sep 26 2014 |
Publication series
Name | 2014 IEEE International Conference on Cluster Computing, CLUSTER 2014 |
---|
Conference
Conference | 16th IEEE International Conference on Cluster Computing, CLUSTER 2014 |
---|---|
Country/Territory | Spain |
City | Madrid |
Period | 9/22/14 → 9/26/14 |
Bibliographical note
Publisher Copyright:© 2014 IEEE.