HeuristicDB: A hybrid storage database system using a non-volatile memory block device

Jinfeng Yang; Bingzhe Li; David J. Lilja

doi:10.1145/3456727.3463774

HeuristicDB: A hybrid storage database system using a non-volatile memory block device

Jinfeng Yang
, Bingzhe Li
, David J. Lilja

Electrical and Computer Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

5 Scopus citations

Abstract

Hybrid storage systems are widely used in big data fields to balance system performance and cost. However, due to a poor understanding of the characteristics of database block requests, past studies in this area cannot fully utilize the performance gain from emerging storage devices. This study presents a hybrid storage database system, called HeuristicDB, which uses an emerging non-volatile memory (NVM) block device as an extension of the database buffer pool. To consider the unique performance behaviors of NVM block devices and the block-level characteristics of database requests, a set of heuristic rules that associate database (block) requests with the appropriate quality of service for the purpose of caching priority are proposed. Using online analytical processing (OLAP) and online transactional processing (OLTP) benchmarks, both trace-based examination and system implementation on MySQL are carried out to evaluate the effectiveness of the proposed design. The experimental results indicate that HeuristicDB provides up to 75% higher performance and migrates 18X fewer data between storage and the NVM block device than existing systems.

Original language	English (US)
Title of host publication	SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage
Publisher	Association for Computing Machinery, Inc
ISBN (Electronic)	9781450383981
DOIs	https://doi.org/10.1145/3456727.3463774
State	Published - Jun 14 2021
Event	14th ACM International Conference on Systems and Storage, SYSTOR 2021 - Virtual, Online, Israel Duration: Jun 14 2021 → Jun 16 2021

Publication series

Name	SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage

Conference

Conference	14th ACM International Conference on Systems and Storage, SYSTOR 2021
Country/Territory	Israel
City	Virtual, Online
Period	6/14/21 → 6/16/21

Bibliographical note

Funding Information:
This work was supported in part by the Center for Research in Intelligent Storage (CRIS), which is supported by National Science Foundation grant no. IIP-1439622 and member companies. Any opinions, findings and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the NSF.

Publisher Copyright:
© 2021 ACM.

Keywords

Hybrid storage database management system
Non-volatile memory block device
Relational database management system

Publisher link

10.1145/3456727.3463774

Find It

Find It at U of M Libraries

Cite this

Yang, J., Li, B., & Lilja, D. J. (2021). HeuristicDB: A hybrid storage database system using a non-volatile memory block device. In SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage Article 3463774 (SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage). Association for Computing Machinery, Inc. https://doi.org/10.1145/3456727.3463774

HeuristicDB: A hybrid storage database system using a non-volatile memory block device. / Yang, Jinfeng; Li, Bingzhe; Lilja, David J.
SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage. Association for Computing Machinery, Inc, 2021. 3463774 (SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Yang, J, Li, B & Lilja, DJ 2021, HeuristicDB: A hybrid storage database system using a non-volatile memory block device. in SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage., 3463774, SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage, Association for Computing Machinery, Inc, 14th ACM International Conference on Systems and Storage, SYSTOR 2021, Virtual, Online, Israel, 6/14/21. https://doi.org/10.1145/3456727.3463774

Yang J, Li B, Lilja DJ. HeuristicDB: A hybrid storage database system using a non-volatile memory block device. In SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage. Association for Computing Machinery, Inc. 2021. 3463774. (SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage). doi: 10.1145/3456727.3463774

@inproceedings{a71c519c4e794aaf9b13b5563d60d864,

title = "HeuristicDB: A hybrid storage database system using a non-volatile memory block device",

abstract = "Hybrid storage systems are widely used in big data fields to balance system performance and cost. However, due to a poor understanding of the characteristics of database block requests, past studies in this area cannot fully utilize the performance gain from emerging storage devices. This study presents a hybrid storage database system, called HeuristicDB, which uses an emerging non-volatile memory (NVM) block device as an extension of the database buffer pool. To consider the unique performance behaviors of NVM block devices and the block-level characteristics of database requests, a set of heuristic rules that associate database (block) requests with the appropriate quality of service for the purpose of caching priority are proposed. Using online analytical processing (OLAP) and online transactional processing (OLTP) benchmarks, both trace-based examination and system implementation on MySQL are carried out to evaluate the effectiveness of the proposed design. The experimental results indicate that HeuristicDB provides up to 75\% higher performance and migrates 18X fewer data between storage and the NVM block device than existing systems.",

keywords = "Hybrid storage database management system, Non-volatile memory block device, Relational database management system",

author = "Jinfeng Yang and Bingzhe Li and Lilja, \{David J.\}",

note = "Funding Information: This work was supported in part by the Center for Research in Intelligent Storage (CRIS), which is supported by National Science Foundation grant no. IIP-1439622 and member companies. Any opinions, findings and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the NSF. Publisher Copyright: {\textcopyright} 2021 ACM.; 14th ACM International Conference on Systems and Storage, SYSTOR 2021 ; Conference date: 14-06-2021 Through 16-06-2021",

year = "2021",

month = jun,

day = "14",

doi = "10.1145/3456727.3463774",

language = "English (US)",

series = "SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage",

publisher = "Association for Computing Machinery, Inc",

booktitle = "SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage",

}

TY - GEN

T1 - HeuristicDB

T2 - 14th ACM International Conference on Systems and Storage, SYSTOR 2021

AU - Yang, Jinfeng

AU - Li, Bingzhe

AU - Lilja, David J.

N1 - Funding Information: This work was supported in part by the Center for Research in Intelligent Storage (CRIS), which is supported by National Science Foundation grant no. IIP-1439622 and member companies. Any opinions, findings and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the NSF. Publisher Copyright: © 2021 ACM.

PY - 2021/6/14

Y1 - 2021/6/14

N2 - Hybrid storage systems are widely used in big data fields to balance system performance and cost. However, due to a poor understanding of the characteristics of database block requests, past studies in this area cannot fully utilize the performance gain from emerging storage devices. This study presents a hybrid storage database system, called HeuristicDB, which uses an emerging non-volatile memory (NVM) block device as an extension of the database buffer pool. To consider the unique performance behaviors of NVM block devices and the block-level characteristics of database requests, a set of heuristic rules that associate database (block) requests with the appropriate quality of service for the purpose of caching priority are proposed. Using online analytical processing (OLAP) and online transactional processing (OLTP) benchmarks, both trace-based examination and system implementation on MySQL are carried out to evaluate the effectiveness of the proposed design. The experimental results indicate that HeuristicDB provides up to 75% higher performance and migrates 18X fewer data between storage and the NVM block device than existing systems.

AB - Hybrid storage systems are widely used in big data fields to balance system performance and cost. However, due to a poor understanding of the characteristics of database block requests, past studies in this area cannot fully utilize the performance gain from emerging storage devices. This study presents a hybrid storage database system, called HeuristicDB, which uses an emerging non-volatile memory (NVM) block device as an extension of the database buffer pool. To consider the unique performance behaviors of NVM block devices and the block-level characteristics of database requests, a set of heuristic rules that associate database (block) requests with the appropriate quality of service for the purpose of caching priority are proposed. Using online analytical processing (OLAP) and online transactional processing (OLTP) benchmarks, both trace-based examination and system implementation on MySQL are carried out to evaluate the effectiveness of the proposed design. The experimental results indicate that HeuristicDB provides up to 75% higher performance and migrates 18X fewer data between storage and the NVM block device than existing systems.

KW - Hybrid storage database management system

KW - Non-volatile memory block device

KW - Relational database management system

UR - https://www.scopus.com/pages/publications/85108406114

UR - https://www.scopus.com/pages/publications/85108406114#tab=citedBy

U2 - 10.1145/3456727.3463774

DO - 10.1145/3456727.3463774

M3 - Conference contribution

AN - SCOPUS:85108406114

T3 - SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage

BT - SYSTOR 2021 - Proceedings of the 14th ACM International Conference on Systems and Storage

PB - Association for Computing Machinery, Inc

Y2 - 14 June 2021 through 16 June 2021

ER -

HeuristicDB: A hybrid storage database system using a non-volatile memory block device

Abstract

Publication series

Conference

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this