Abstract
The storage of hot and cold data play a crucial role in improving data access efficiency and reducing storage expenses. This paper proposed a temperature model to quantify the real-time hotness of data. Based on the temperature model, we proposed a hierarchical storage mechanism for hot and cold data, managing dynamic data migration among local cold database, local hot database, and remote cold database. Experimental results show the advantages of the proposed method in terms of hot data hit rate, hot data hit rate for key data, migration count, and average response time. It can improve data access performance and the satisfaction of important users, and significantly reduce expenses.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sanders, R.: The Pareto principle: its use and abuse. J. Serv. Mark. 1, 37–40 (1987)
Eastern Data, Western Computing: China’s National Big Data Infrastructure Project. rootaccess.substack.com/p/eastern-data-western-computing-chinas. Accessed 16 Mar 2024
Dan, A., Towsley, D.: An approximate analysis of the LRU and FIFO buffer replacement schemes. In: Proceedings of the 1990 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pp. 143–152. ACM (1990)
Robinson, J.T., Devarakonda, M.V.: Data cache management using frequency-based replacement. In: Proceedings of the 1990 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pp. 134–142. ACM (1990)
O’Neil, E.J., O’Neil, P.E., Weikum, G.: The LRU-K page replacement algorithm for database disk buffering. ACM SIGMOD Rec. 22(2), 297–306 (1993)
Arlitt, M., Friedrich, R., Jin, T.: Performance evaluation of web proxy cache replacement policies. In: Puigjaner, R., Savino, N.N., Serra, B. (eds.) TOOLS 1998. LNCS, vol. 1469, pp. 193–206. Springer, Heidelberg (1998). https://doi.org/10.1007/3-540-68061-6_16
Chan, H.H., et al.: HashKV: enabling efficient updates in KV storage via hashing. In: USENIX ATC 2018, pp. 1007–1019 (2018)
Chen, J., et al.: HotRing: a hotspot-aware in-memory key-value store. In: 18th FAST, Santa Clara, pp. 239–252 (2020)
Muralidhar, S., et al.: f4: Facebook’s warm BLOB storage system. In: 11th OSDI, Broomfield, pp. 383–398 (2014)
Xie, Y., et al.: Efficient storage management for social network events based on clustering and hot/cold data classification. IEEE Trans. Comput. Soc. Syst. 10, 120–130 (2023)
Song, Y., et al.: A novel hot-cold data identification mechanism based on multidimensional data. In: 2022 5th DSIT, Shanghai, pp. 1–5 (2022)
Acknowledgments
This work is supported by the National Key R&D Program of China (NO. 2022YFB4501701).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ma, S., Zhao, T., Gu, J., Wang, Y. (2024). A Hierarchical Storage Mechanism for Hot and Cold Data Based on Temperature Model. In: Strauss, C., Amagasa, T., Manco, G., Kotsis, G., Tjoa, A.M., Khalil, I. (eds) Database and Expert Systems Applications. DEXA 2024. Lecture Notes in Computer Science, vol 14910. Springer, Cham. https://doi.org/10.1007/978-3-031-68309-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-031-68309-1_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-68308-4
Online ISBN: 978-3-031-68309-1
eBook Packages: Computer ScienceComputer Science (R0)