Abstract
Disk-based storage subsystems account for a significant portion of the energy consumption in both low and high end servers. Therefore, there is a dire need to reduce the server power consumption of the hard disks. In this work, the power-aware framework has been proposed, which efficiently switches the disk into standby, active and idle states, leading to the least power consumption. Firstly, the trace of a real-world application has been generated and processed. The frequently used queries from the trace have been analyzed and prefetched in SSD cache using the data placement policy which lead to 78.5% cache hits. Subsequently, the idle time threshold policy has been executed, which regularly monitors and compares the disk idle time with its threshold value. Later, the request arrival threshold policy predicts the breakeven time using the ensemble machine learning model, which yields 87% accuracy with 3.5% average error rate. Only upon exceeding the threshold values, the disk would smartly be placed in the standby mode; otherwise, it would remain in the idle state to avoid the high power spins in case of frequent requests. Finally, the experimental results have been validated with the existing benchmarks using SSD as a cache, which leads to 75% average power savings.
Similar content being viewed by others
Notes
k-fold cross-validation quarantines the subsets of the training data during the learning process. It randomly splits the data into k subsets termed as folds.
Write off-loading allows write requests on spun-down disks to be temporarily redirected to persistent storage elsewhere in the data center.
References
Cho, S., Park, C., Won, Y., Kang, S., Cha, J., Yoon, S., Choi, J.: Design tradeoffs of SSDS: from energy consumptions perspective. ACM Trans. Storage (TOS) 11(2), 8 (2015)
Arora, S., Bala, A.: A survey: ICT enabled energy efficiency techniques for big data applications. Clust. Comput. 1–22 (2019)
Datacenter knowledge, https://www.datacenterknowledge.com/archives/2014/12/11/reducing-energy-consumption-cost-data-center (2019). Accessed 30 Jan 2019
Hylick, A., Sohan, R., Rice, A., Jones, B.: An analysis of hard drive energy consumption. In: IEEE International Symposium on Modeling, Analysis and Simulation of Computers and Telecommunication Systems, 2008. MASCOTS 2008. IEEE, pp. 1–10 (2008)
Ganesh, L., Weatherspoon, H., Balakrishnan, M., Birman, K.: Optimizing power consumption in large scale storage systems. In: HotOS (2007)
Schall, D., Hudlet, V., Härder, T.: Enhancing energy efficiency of database applications using SSDS, In: Proceedings of the Third C* Conference on Computer Science and Software Engineering, pp. 1–9. ACM (2010)
Paulraj, G.J.L., Francis, S.A.J., Peter, J.D., Jebadurai, I.J.: A combined forecast-based virtual machine migration in cloud data centers. Comput. Electr. Eng. 69, 287–300 (2018)
Behzadnia, P., Tu, Y.-C., Zeng, B., Yuan, W.: Energy-aware disk storage management: online approach with application in DBMS, arXiv preprint arXiv:1703.02591
Xie, W., Lin, D.: Binding energy of biexcitons in a quantum disk. Mod. Phys. Lett. B 14(19), 701–707 (2000)
Zedlewski, J., Sobti, S., Garg, N., Zheng, F., Krishnamurthy, A., Wang, R.Y. et al.: In: FAST, vol. 3, pp. 217–230 (2003)
Wildani, A., Miller, E.L.: Can we group storage? Statistical techniques to identify predictive groupings in storage system accesses. ACM Trans. Storage (TOS) 12(2), 7 (2016)
Meng, X., Wu, C., Guo, M., Zheng, L., Zhang, J.: Pam: an efficient power-aware multilevel cache policy to reduce energy consumption of storage systems. Front. Comput. Sci. 13(4), 850–863 (2019)
Yuan, Z., Yu, C., Sun, J., Xiao, J., Wang, J., Shang, Z., Hu, Y.: An energy efficient storage system for astronomical observation data on dome a. In: International Conference on Algorithms and Architectures for Parallel Processing, pp. 33–46. Springer, New York (2015)
Chou, J., Kim, J., Rotem, D.: Energy-aware scheduling in disk storage systems. In: 2011 31st International Conference on Distributed Computing Systems, pp. 423–433. IEEE (2011)
Li, X., Li, Z., Zhou, Y., Adve, S.: Performance directed energy management for main memory and disks. ACM Trans. Storage (TOS) 1(3), 346–380 (2005)
Golding, R., Bosch, P., Wilkes, J., et al.: Idleness is not sloth. In: USENIX, pp. 201–212 (1995)
Vázquez Pérez, S., Rodríguez, J., Rivera, M., García Franquelo, L., Norambuena, M.: Model predictive control for power converters and drives: advances and trends. IEEE Trans. Ind. Electron. 64(2), 935–947 (2016)
Mahajan, D., Blakeney, C., Zong, Z.: Improving the energy efficiency of relational and nosql databases via query optimizations. Sustain. Comput. 22, 120–133 (2019)
Helmbold, D.P., Long, D.D., Sherrod, B.: A dynamic disk spin-down technique for mobile computing. In: Proceedings of the 2nd Annual International Conference on Mobile Computing and Networking, pp. 130–142. ACM (1996)
Paul, M., Krishnaswamy, S.: System and method to enable prediction-based power management. US Patent App. 15/978,176 (2019)
Galicia, A., Talavera-Llames, R., Troncoso, A., Koprinska, I., Martínez-Álvarez, F.: Multi-step forecasting for big data time series based on ensemble learning. Knowl.-Based Syst. 163, 830–841 (2019)
Gao, Y., Guan, H., Qi, Z., Wang, B., Liu, L.: Quality of service aware power management for virtualized data centers. J. Syst. Archit. 59(4–5), 245–259 (2013)
Yin, S., Li, X., Li, K., Huang, J., Ruan, X., Zhu, X., Cao, W., Qin, X.: Reed: A reliable energy-efficient raid. In: 2015 44th International Conference on Parallel Processing, pp. 649–658. IEEE (2015)
Ma, L., Van Aken, D., Hefny, A., Mezerhane, G., Pavlo, A., Gordon, G. J.: Query-based workload forecasting for self-driving database management systems. In: Proceedings of the 2018 International Conference on Management of Data, pp. 631–645. ACM (2018)
Sun, Z., Kuenning, G., Mandal, S., Shilane, P., Tarasov, V., Xiao, N., Zadok, E., et al.: Cluster and single-node analysis of long-term deduplication patterns. ACM Trans. Storage (TOS) 14(2), 13 (2018)
Deng, Y., Wang, F., Helian, N.: EED: energy efficient disk drive architecture. Inf. Sci. 178(22), 4403–4417 (2008)
Li, D., Wang, J.: Eeraid: energy efficient redundant and inexpensive disk array. In: Proceedings of the 11th Workshop on ACM SIGOPS European Workshop, p. 29. ACM (2004)
Liebig, T., Piatkowski, N., Bockermann, C., Morik, K.: Dynamic route planning with real-time traffic predictions. Inf. Syst. 64, 258–265 (2017)
Kang, S.-W., Song, M., Park, K., Hwang, C.-S.: Towards an efficient semantic prefetching for location based services. In: iiWAS (2004)
Wang, H., Luo, Z.: Data cache prefetching with perceptron learning, arXiv preprint arXiv:1712.00905
Yin, S., Xiao, Z., Li, K., Huang, J., Ruan, X., Zhu, X., Qin, X.: Ress: A reliable energy-efficient storage system. In: 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS), pp. 1193–1198. IEEE (2016)
Yao, X., Wang, J.: Rimac: a novel redundancy-based hierarchical cache architecture for energy efficient, high performance storage systems. In: ACM SIGOPS Operating Systems Review, vol. 40, pp. 249–262. ACM (2006)
Iqbal, W., Erradi, A., Mahmood, A.: Dynamic workload patterns prediction for proactive auto-scaling of web applications. J. Netw. Comput. Appl. 124, 94–107 (2018)
Acknowledgements
One of the authors, Sumedha Arora offers the sincerest gratitude to the Council of Scientific and Industrial Research (CSIR), Government of India, for funding the research and providing required resources to carry out this research work with the Ack. No. 143253/2K17/1 and File No. 09/677(0030)/2018-EMR-I.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Arora, S., Bala, A. PAP: power aware prediction based framework to reduce disk energy consumption. Cluster Comput 23, 3157–3174 (2020). https://doi.org/10.1007/s10586-020-03077-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-020-03077-3