In this paper, we present a new scheduling algorithm, Qin2, for heterogeneous datacenters. Its goal is to improve performance measured as jobs completion time by exploiting increased server heterogeneity using deep neural network (DNN) models. The proposed scheduling framework uses an efficient automatic feature selection technique, which significantly reduces the training data size required to train the DNN to levels that provide satisfactory prediction accuracy. Its efficiency is especially helpful when the DNN model is re-Trained to adapt it to new types of application workloads arriving to the datacenter. The novelty of the proposed scheduling approach lies in this feature selection technique and the integration of simple and training-efficient DNN models into a scheduler, which is deployed on a real cluster of heterogeneous nodes. Experiments demonstrate that the Qin2 scheduler outperforms state-of-The-Art schedulers in terms of jobs completion time.
|Original language||English (US)|
|Title of host publication||2022 IEEE 13th International Green and Sustainable Computing Conference, IGSC 2022|
|Publisher||Institute of Electrical and Electronics Engineers Inc.|
|State||Published - 2022|
|Event||13th IEEE International Green and Sustainable Computing Conference, IGSC 2022 - Virtual, Online, United States|
Duration: Oct 24 2022 → Oct 25 2022
|Name||2022 IEEE 13th International Green and Sustainable Computing Conference, IGSC 2022|
|Conference||13th IEEE International Green and Sustainable Computing Conference, IGSC 2022|
|Period||10/24/22 → 10/25/22|
Bibliographical notePublisher Copyright:
© 2022 IEEE.
- deep neural networks