Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3596225.3596230acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
research-article
Open access

Cooperative Memory Management for Table and Temporary Data

Published: 17 July 2023 Publication History

Abstract

The traditional paradigm for managing memory in database management systems (DBMS) treats memory used for caching table data and memory for temporary data as separate entities. This leads to inefficient utilization of the available memory capacity for mixed workloads. With memory being a significant factor in the costs of operating a DBMS, utilizing memory as efficiently as possible is highly desirable. As an alternative to the traditional paradigm, we propose managing the entire available memory in a cooperative manner to achieve better memory utilization and consequently higher cost–effectiveness for DBMSs. Initial experimental evaluation of cooperative memory management using a prototype implementation shows promising results and leads to several interesting further research directions.

References

[1]
Richard Cole, Florian Funke, Leo Giakoumakis, Wey Guy, Alfons Kemper, Stefan Krompass, Harumi Kuno, Raghunath Nambiar, Thomas Neumann, Meikel Poess, Kai-Uwe Sattler, Michael Seibold, Eric Simon, and F. Michael Waas. 2011. The mixed workload CH-benCHmark. In DBTest’11. ACM Press.
[2]
Benoit Dageville and Mohammed Zait. 2002. SQL memory management in Oracle9i. In VLDB’02. VLDB Endowment, 962–973.
[3]
Dominik Durner, Viktor Leis, and Thomas Neumann. 2019. On the impact of memory allocation on high-performance query processing. In DaMoN’19.
[4]
Viktor Leis, Adnan Alhomssi, Tobias Ziegler, Yannick Loeck, and Christian Dietrich. 2023. Virtual-memory assisted buffer management. In SIGMOD’23. To appear. https://www.cs.cit.tum.de/fileadmin/w00cfj/dis/_my_direct_uploads/vmcache.pdf
[5]
Viktor Leis, Michael Haubenschild, Alfons Kemper, and Thomas Neumann. 2018. LeanStore: In-memory data management beyond main memory. In ICDE’18. IEEE, 185–196.
[6]
David Lomet. 2018. Cost/performance in modern data stores: How data caching systems succeed. In DaMoN’18.
[7]
Thomas Neumann and Michael Freitag. 2020. Umbra: A Disk-Based System with in-Memory Performance. In CIDR’20.
[8]
Adam J. Storm, Christian Garcia-Arellano, Sam S. Lightstone, Yixin Diao, and M. Surendra. 2006. Adaptive self-tuning memory in DB2. In VLDB’06. VLDB Endowment, 1081–1092.

Cited By

View all
  • (2024)Robust External Hash Aggregation in the Solid State Age2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00288(3753-3766)Online publication date: 13-May-2024

Index Terms

  1. Cooperative Memory Management for Table and Temporary Data
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    SiMoD '23: Proceedings of the 1st Workshop on Simplicity in Management of Data
    June 2023
    28 pages
    ISBN:9798400707834
    DOI:10.1145/3596225
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 17 July 2023

    Check for updates

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    SiMoD '23

    Acceptance Rates

    Overall Acceptance Rate 2 of 8 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)256
    • Downloads (Last 6 weeks)22
    Reflects downloads up to 24 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Robust External Hash Aggregation in the Solid State Age2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00288(3753-3766)Online publication date: 13-May-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media