Machine Learning-based Adaptive Migration Algorithm for Hybrid Storage Systems

Milan M. Shetti, Bingzhe Li, David H.C. Du

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Hybrid storage systems are prevalent in most large-scale enterprise storage systems since they balance storage performance, storage capacity and cost. The goal of such systems is to serve the majority of the I/O requests from high-performance devices and store less frequently used data in low-performance devices. A large data migration volume between tiers can cause a huge overhead in practical hybrid storage systems. Therefore, how to balance the trade-off between the migration cost and potential performance gain is a challenging and critical issue in hybrid storage systems. In this paper, we focused on the data migration problem of hybrid storage systems with two classes of storage devices. A machine learning-based migration algorithm called K-Means assisted Support Vector Machine (K-SVM) migration algorithm is proposed. This algorithm is capable of more precisely classifying and efficiently migrating data between performance and capacity tiers. Moreover, this K-SVM migration algorithm involves a K-Means clustering algorithm to dynamically select a proper training dataset such that the proposed algorithm can significantly reduce the volume of migrating data. Finally, the real implementation results indicate that the ML-based algorithm reduces the migration data volume by about 40% and achieves 70% lower latency than other algorithms.

Original languageEnglish (US)
Title of host publication2022 IEEE International Conference on Networking, Architecture and Storage, NAS 2022 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665454087
DOIs
StatePublished - 2022
Event16th IEEE International Conference on Networking, Architecture and Storage, NAS 2022 - Philadelphia, United States
Duration: Oct 3 2022Oct 4 2022

Publication series

Name2022 IEEE International Conference on Networking, Architecture and Storage, NAS 2022 - Proceedings

Conference

Conference16th IEEE International Conference on Networking, Architecture and Storage, NAS 2022
Country/TerritoryUnited States
CityPhiladelphia
Period10/3/2210/4/22

Bibliographical note

Funding Information:
VIII. ACKNOWLEDGEMENT This work was partially supported by NSF I/UCRC Center Research in Intelligent Storage and the following NSF awards 1439622, 1812537, 2204656, and 2204657.

Publisher Copyright:
© 2022 IEEE.

Fingerprint

Dive into the research topics of 'Machine Learning-based Adaptive Migration Algorithm for Hybrid Storage Systems'. Together they form a unique fingerprint.

Cite this