Nothing Special   »   [go: up one dir, main page]

skip to main content
10.5555/1881867.1881885guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Towards efficient concurrent scans on flash disks

Published: 30 August 2010 Publication History

Abstract

Flash disk, also known as Solid State Disk (SSD), is widely considered by the database community as a next-generation storage media which will completely or to a large extent replace magnetic disk in data-intensive applications. However, the vast differences on the I/O characteristics between SSD and magnetic disk imply that a considerable part of the existing database techniques need to be modified to gain the best efficiency on flash storage. In this paper, we study the problem of large-scale concurrent disk scans which are frequently used in the decision support systems. We demonstrate that the conventional sharing techniques of mutiple concurrent scans are not suitable for SSDs as they are designed to exploit the characteristics of hard disk drivers (HDD). To leverage the fast random reads on SSD, we propose a new framework named Semi-Sharing Scan (S3) in this paper. S3 shares the readings between scans of similar speeds to save the bandwidth utilization. Meanwhile, it compensates the faster scans by executing random I/O requests separately, in order to reduce single scan latency. By utilizing techniques called group splitting and I/O scheduling, S3 aims at achieving good performance for concurrent scans on various workloads. We implement the S3 framework on a PostgreSQL database deployed on an enterprise SSD drive. Experiments demonstrate that S3 outperforms the conventional schemes in both bandwidth utilization and single scan latency.

References

[1]
Colby, L.S., et al.: Redbrick vista: Aggregate computation and management. In: Proc. ICDE (1998).
[2]
Cook., C., et al.: SQL Server Architecture: The Storage Engine. Microsoft Corp., http://msdn.microsoft.com/library
[3]
Jeff Davis Laika, Inc.: Synchronized Sequential Scan in PostgreSQL: http://j-davis.com/postgresql/syncscan/syncscan.pdf
[4]
NCR Corp. Teradata Multi-Value Compression V2R5.0 (2002).
[5]
Zukowski, M., Héman, S., Nes, N., Boncz, P.A.: Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS. In: VLDB (2007).
[6]
Lang, C.A., Bhattacharjee, B., Malkemus, T., Padmanabhan, S., Wong, K.: Increasing buffer-locality for multiple relational table scans through grouping and throttling. In: ICDE (2007).
[7]
Lang, C.A., Bhattacharjee, B., Malkemus, T., Wong, K.: Increasing Buffer-Locality for Multiple Index Based Scans through Intelligent Placement and Index Scan Speed Control. In: VLDB (2007).
[8]
Lee, S.-W., Moon, B., Park, C., Kim, J.-M., Kim, S.-W.: A Case for Flash Memory SSD in Enterprise Database Applications. In: Sigmod (2008).
[9]
O'Neil, E.J., O'Neil, P.E., Weikum, G.: The LRU-K Page Replacement Algorithm For Database Disk Buffering. In: SIGMOD Conference (1993).
[10]
Johnson, T., Shasha, D.: 2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm. In: VLDB (2004).
[11]
Nyhcrg, Chris: Disk Scheduling and Cache Replacement for a Database Machine, Master Report, UC Berkeley (July 1984).
[12]
Robinson, J., Devarakonda, M.: Data cache management using frequency-based replacement. In: Proc. ACM SIGMETRICS Conf. (1990).
[13]
Lee, D., Choi, J., Kim, J.-H., Noh, S.H., Min, S.L., Cho, Y., Kim, C.-S.: LRFU: A Spectrum of Policies that Subsumes the Least Recently Used and Least Frequently Used Policies. IEEE Trans. Computers (2001).
[14]
Lee, S.W., Moon, B.: Design of flash-based dbms: an in-page logging approach. In: SIGMOD Conference, pp. 55-66 (2007).
[15]
Tsirogiannis, D., Harizopoulos, S., Shah, M.A., Wiener, J.L., Graefe, G.: Query processing techniques for solid state drives. In: Sigmod (2009).

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings
DEXA'10: Proceedings of the 21st international conference on Database and expert systems applications: Part I
August 2010
522 pages
ISBN:3642153631
  • Editors:
  • Pablo García Bringas,
  • Abdelkader Hameurlain,
  • Gerald Quirchmayr

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 30 August 2010

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Nov 2024

Other Metrics

Citations

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media