Query processing on cloud database systems is a challenging problem due to the dynamic cloud environment. The configuration and utilization of the distributed hardware used to process queries change continuously. A query optimizer aims to generate query execution plans (QEPs) that are optimal meet user requirements. In order to achieve such QEPs under dynamic environments, performing query re-optimizations during query execution has been proposed in the literature. In cloud database systems, besides query execution time, users also consider the monetary cost to be paid to the cloud provider for executing queries. Thus, such query re-optimizations are multi-objective optimizations which take both time and monetary costs into consideration. However, traditional re-optimization requires accurate cost estimations, and obtaining these estimations adds overhead to the system, and thus causes negative impacts on query performance. To fill this gap, in this paper, we introduce ReOptRL, a novel query processing algorithm based on deep reinforcement learning. It bootstraps a QEP generated by an existing query optimizer and dynamically changes the QEP during the query execution. It also keeps learning from incoming queries to build a more accurate optimization model. In this algorithm, the QEP of a query is adjusted based on the recent performance of the same query so that the algorithm does not rely on cost estimations. Our experiments show that the proposed algorithm performs better than existing query optimization algorithms in terms of query execution time and query execution monetary costs.
|Original language||English (US)|
|Title of host publication||Model and Data Engineering - 10th International Conference, MEDI 2021, Proceedings|
|Editors||Christian Attiogbé, Sadok Ben Yahia|
|Publisher||Springer Science and Business Media Deutschland GmbH|
|Number of pages||15|
|State||Published - 2021|
|Event||10th International Conference on Model and Data Engineering, MEDI 2021 - Virtual, Online|
Duration: Jun 21 2021 → Jun 23 2021
|Name||Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)|
|Conference||10th International Conference on Model and Data Engineering, MEDI 2021|
|Period||6/21/21 → 6/23/21|
Bibliographical noteFunding Information:
Acknowledgements. This work is partially supported by the National Science Foundation Award No. 1349285.
© 2021, Springer Nature Switzerland AG.
- Cloud databases
- Query optimization
- Query re-optimization
- Reinforcement learning