Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3489048.3522644acmconferencesArticle/Chapter ViewAbstractPublication PagesmetricsConference Proceedingsconference-collections
abstract

A Comprehensive Empirical Study of Query Performance Across GPU DBMSes

Published: 06 June 2022 Publication History

Abstract

In recent years, GPU database management systems (DBMSes) have rapidly become popular largely due to their remarkable acceleration capability obtained through extreme parallelism in query evaluations. However, there has been relatively little study on the characteristics of these GPU DBMSes for a better understanding of their query performance in various contexts. To fill this gap, we have conducted a rigorous empirical study to identify such factors and to propose a structural causal model, including key factors and their relationships, to explicate the variances of the query execution times on the GPU DBMSes. To test the model, we have designed and run comprehensive experiments and conducted in-depth statistical analyses on the obtained data. As a result, our model achieves about 77% amount of variance explained on the query time and indicates that reducing kernel time and data transfer time are the key factors to improve the query time. Also, our results show that the studied systems still need to resolve several concerns such as bounded processing within GPU memory, lack of rich query evaluation operators, limited scalability, and GPU under-utilization.

References

[1]
Richard Bieringa, Abijith Radhakrishnan, Tavneet Singh, Sophie Vos, Jesse Donkervliet, and Alexandru Iosup. 2021. An Empirical Evaluation of the Performance of Video Conferencing Systems. In Companion of the ACM/SPEC International Conference on Performance Engineering . 65--71.
[2]
BlazingSQL, Inc. 2021. BlazingSQL - The Official Homepage. URL: https://blazingsql.com/.
[3]
Sebastian Breß. 2014. The Design and Implementation of CoGaDB: A hboxColumn-oriented hboxGPU-accelerated DBMS. Datenbank-Spektrum, Vol. 14, 3 (2014), 199--209.
[4]
Zhifeng Chen, Yan Zhang, Yuanyuan Zhou, Heidi Scott, and Berni Schiefer. 2005. Empirical Evaluation of Multi-level Buffer Cache Collaboration for Storage Systems. In Proceedings of the 2005 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems. 145--156.
[5]
Periklis Chrysogelos, Panagiotis Sioulas, and Anastasia Ailamaki. 2019. Hardware-conscious Query Processing in GPU-accelerated Analytical Engines. In Proceesings of the 9th Biennial Conference on Innovative Data Systems Research. www.cidrdb.org.
[6]
Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. arXiv preprint arXiv:1412.3555 (2014).
[7]
Sabah Currim, Richard T. Snodgrass, Young-Kyoon Suh, and Rui Zhang. 2016. hboxDBMS Metrology: Measuring Query Time. ACM Transactions on Database Systems, Vol. 42, 1, Article 3 (2016), bibinfonumpages42 pages.
[8]
Moises Goldszmidt and Rebecca Isaacs. 2011. More Intervention Now!. In Proceedings of the 13th USENIX Conference on Hot Topics in Operating Systems. USENIX Association, 25.
[9]
Kinetica DB Inc. 2021. Kinetica High Performance Analytics Database. URL: https://www.kinetica.com/.
[10]
Stefan Manegold. 2008. An Empirical Evaluation of XQuery Processors. Information Systems, Vol. 33, 2 (2008), 203--220.
[11]
Michele Mazzucco and Isi Mitrani. 2012. Empirical Evaluation of Power Saving Policies for Data Centers. ACM SIGMETRICS Performance Evaluation Review, Vol. 40, 3 (2012), 18--22.
[12]
OmniSci, Inc. 2021. OmniSciDB - The Official Website. URL: https://omnisci.com/platform/omniscidb.
[13]
Johns Paul, Jiong He, and Bingsheng He. 2016. GPL: A GPU-based Pipelined Query Processing Engine. In Proceedings of the 2016 ACM SIGMOD International Conference on Management of Data. 1935--1950.
[14]
Johns Paul, Shengliang Lu, and Bingsheng He. 2021. Foundations and Trends® in Databases, Vol. 11, 1 (2021), 1--108.
[15]
PG-Strom Development Team. 2021. PG-Strom Manual - Home. URL: https://heterodb.github.io/pg-strom/.
[16]
Holger Pirk, Oscar Moll, Matei Zaharia, and Sam Madden. 2016. Voodoo-A Vector Algebra for Portable Database Performance on Modern Hardware. Proceedings of the VLDB Endowment, Vol. 9, 14 (2016), 1707--1718.
[17]
Syed Mohammad Aunn Raza, Periklis Chrysogelos, Panagiotis Sioulas, Vladimir Indjic, Angelos Christos Anadiotis, and Anastasia Ailamaki. 2020. hboxGPU-accelerated Data Management under the Test of Time. In Proceesings of the 10th Conference on Innovative Data Systems Research. www.cidrdb.org.
[18]
Raja R. Sambasivan, Ilari Shafer, Jonathan Mace, Benjamin H. Sigelman, Rodrigo Fonseca, and Gregory R. Ganger. 2016. Principled Workflow-Centric Tracing of Distributed Systems. In Proceedings of the Seventh ACM Symposium on Cloud Computing. ACM, 401--414.
[19]
Richard T. Snodgrass, Sabah Currim, and Young-Kyoon Suh. 2021. Have Query Optimizers Hit the Wall. The VLDB Journal (2021), 1--20. https://doi.org/10.1007/s00778-021-00689-y
[20]
SQream Technologies. 2021. SQream - The Official Website. URL: https://sqream.com/.
[21]
Yingjun Wu, Joy Arulraj, Jiexi Lin, Ran Xian, and Andrew Pavlo. 2017. An Empirical Evaluation of In-memory Multi-version Concurrency Control. Proceedings of the VLDB Endowment, Vol. 10, 7 (2017), 781--792.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGMETRICS/PERFORMANCE '22: Abstract Proceedings of the 2022 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems
June 2022
132 pages
ISBN:9781450391412
DOI:10.1145/3489048
  • cover image ACM SIGMETRICS Performance Evaluation Review
    ACM SIGMETRICS Performance Evaluation Review  Volume 50, Issue 1
    SIGMETRICS '22
    June 2022
    118 pages
    ISSN:0163-5999
    DOI:10.1145/3547353
    Issue’s Table of Contents
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2022

Check for updates

Author Tags

  1. causal model
  2. gpu dbms
  3. performance evaluation
  4. query time

Qualifiers

  • Abstract

Funding Sources

  • Electronics and Telecommunications Research Institute

Conference

SIGMETRICS/PERFORMANCE '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 459 of 2,691 submissions, 17%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 68
    Total Downloads
  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)1
Reflects downloads up to 30 Sep 2024

Other Metrics

Citations

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media