Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3626246.3654741acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
short-paper
Open access

ASQP-RL Demo: Learning Approximation Sets for Exploratory Queries

Published: 09 June 2024 Publication History

Abstract

We demonstrate the Approximate Selection Query Processing (ASQP-RL) system, which uses Reinforcement Learning to select a subset of a large external dataset to process locally in a notebook during data exploration. Given a query workload over an external database and notebook memory size, the system translates the workload to select-project-join (non-aggregate) queries and finds a subset of each relation such that the data subset - called the approximation set - fits into the notebook memory and maximizes query result quality. The data subset can then be loaded into the notebook, and rapidly queried by the analyst. Our demonstration shows how ASQP-RL can be used during data exploration and achieve comparable results to external queries over the large dataset at significantly reduced query times. It also shows how ASQP-RL can be used for aggregation queries, achieving surprisingly good results compared to state-of-the-art techniques.

References

[1]
Greg Brockman et al. 2016. Openai gym. arXiv preprint arXiv:1606.01540 (2016).
[2]
Susan B Davidson, Tova Milo, Kathy Razmadze, and Gal Zeevi. 2024. Learning Approximation Sets for Exploratory Queries. arXiv preprint http://arxiv.org/abs/2401.17059 (2024).
[3]
Park el al. 2018. Verdictdb: Universalizing approximate query processing. Proceedings of the 2018 International Conference on Management of Data (2018).
[4]
Saravanan Thirumuruganathan et al. 2020. Approximate query processing for data exploration using deep generative models. In ICDE. IEEE, 1309--1320.
[5]
Terry Gaasterland. 1997. Cooperative answering through controlled query relaxation. IEEE Expert 12, 5 (1997), 48--59.
[6]
Viktor Leis et al. 2015. How good are query optimizers, really? VLDB 9, 3 (2015), 204--215.
[7]
Kaiyu Li and Guoliang Li. 2018. Approximate query processing: What is new and where to go? A survey on approximate query processing. Data Science and Engineering 3 (2018), 379--397.
[8]
Microsoft. 2016. Microsoft academic search. http://academic.research.microsoft.com
[9]
Philipp Moritz et al. 2018. Ray: A distributed framework for emerging AI applications. In OSDI. 561--577.
[10]
John Schulman et al. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017).

Index Terms

  1. ASQP-RL Demo: Learning Approximation Sets for Exploratory Queries

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGMOD/PODS '24: Companion of the 2024 International Conference on Management of Data
    June 2024
    694 pages
    ISBN:9798400704222
    DOI:10.1145/3626246
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 June 2024

    Check for updates

    Author Tags

    1. exploratory data analysis
    2. queries approximation
    3. reinforcement learning

    Qualifiers

    • Short-paper

    Funding Sources

    • iSF - the Israel Science foundation
    • BSF - the US-Israel Binational Science foundation

    Conference

    SIGMOD/PODS '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 785 of 4,003 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 87
      Total Downloads
    • Downloads (Last 12 months)87
    • Downloads (Last 6 weeks)34
    Reflects downloads up to 18 Nov 2024

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media