Nothing Special   »   [go: up one dir, main page]

Skip to main content

Advertisement

Log in

PAP: power aware prediction based framework to reduce disk energy consumption

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Disk-based storage subsystems account for a significant portion of the energy consumption in both low and high end servers. Therefore, there is a dire need to reduce the server power consumption of the hard disks. In this work, the power-aware framework has been proposed, which efficiently switches the disk into standby, active and idle states, leading to the least power consumption. Firstly, the trace of a real-world application has been generated and processed. The frequently used queries from the trace have been analyzed and prefetched in SSD cache using the data placement policy which lead to 78.5% cache hits. Subsequently, the idle time threshold policy has been executed, which regularly monitors and compares the disk idle time with its threshold value. Later, the request arrival threshold policy predicts the breakeven time using the ensemble machine learning model, which yields 87% accuracy with 3.5% average error rate. Only upon exceeding the threshold values, the disk would smartly be placed in the standby mode; otherwise, it would remain in the idle state to avoid the high power spins in case of frequent requests. Finally, the experimental results have been validated with the existing benchmarks using SSD as a cache, which leads to 75% average power savings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Notes

  1. https://www.bmj.com/about-bmj/resources-readers/publications/statistics-square-one/11-correlation-and-regression.

  2. http://scikit-learn.org/stable/modules/model_evaluation.html.

  3. http://www.dublinked.ie.

  4. k-fold cross-validation quarantines the subsets of the training data during the learning process. It randomly splits the data into k subsets termed as folds.

  5. Write off-loading allows write requests on spun-down disks to be temporarily redirected to persistent storage elsewhere in the data center.

References

  1. Cho, S., Park, C., Won, Y., Kang, S., Cha, J., Yoon, S., Choi, J.: Design tradeoffs of SSDS: from energy consumptions perspective. ACM Trans. Storage (TOS) 11(2), 8 (2015)

    Google Scholar 

  2. Arora, S., Bala, A.: A survey: ICT enabled energy efficiency techniques for big data applications. Clust. Comput. 1–22 (2019)

  3. Datacenter knowledge, https://www.datacenterknowledge.com/archives/2014/12/11/reducing-energy-consumption-cost-data-center (2019). Accessed 30 Jan 2019

  4. Hylick, A., Sohan, R., Rice, A., Jones, B.: An analysis of hard drive energy consumption. In: IEEE International Symposium on Modeling, Analysis and Simulation of Computers and Telecommunication Systems, 2008. MASCOTS 2008. IEEE, pp. 1–10 (2008)

  5. Ganesh, L., Weatherspoon, H., Balakrishnan, M., Birman, K.: Optimizing power consumption in large scale storage systems. In: HotOS (2007)

  6. Schall, D., Hudlet, V., Härder, T.: Enhancing energy efficiency of database applications using SSDS, In: Proceedings of the Third C* Conference on Computer Science and Software Engineering, pp. 1–9. ACM (2010)

  7. Paulraj, G.J.L., Francis, S.A.J., Peter, J.D., Jebadurai, I.J.: A combined forecast-based virtual machine migration in cloud data centers. Comput. Electr. Eng. 69, 287–300 (2018)

    Article  Google Scholar 

  8. Behzadnia, P., Tu, Y.-C., Zeng, B., Yuan, W.: Energy-aware disk storage management: online approach with application in DBMS, arXiv preprint arXiv:1703.02591

  9. Xie, W., Lin, D.: Binding energy of biexcitons in a quantum disk. Mod. Phys. Lett. B 14(19), 701–707 (2000)

    Article  Google Scholar 

  10. Zedlewski, J., Sobti, S., Garg, N., Zheng, F., Krishnamurthy, A., Wang, R.Y. et al.: In: FAST, vol. 3, pp. 217–230 (2003)

  11. Wildani, A., Miller, E.L.: Can we group storage? Statistical techniques to identify predictive groupings in storage system accesses. ACM Trans. Storage (TOS) 12(2), 7 (2016)

    Google Scholar 

  12. Meng, X., Wu, C., Guo, M., Zheng, L., Zhang, J.: Pam: an efficient power-aware multilevel cache policy to reduce energy consumption of storage systems. Front. Comput. Sci. 13(4), 850–863 (2019)

    Article  Google Scholar 

  13. Yuan, Z., Yu, C., Sun, J., Xiao, J., Wang, J., Shang, Z., Hu, Y.: An energy efficient storage system for astronomical observation data on dome a. In: International Conference on Algorithms and Architectures for Parallel Processing, pp. 33–46. Springer, New York (2015)

  14. Chou, J., Kim, J., Rotem, D.: Energy-aware scheduling in disk storage systems. In: 2011 31st International Conference on Distributed Computing Systems, pp. 423–433. IEEE (2011)

  15. Li, X., Li, Z., Zhou, Y., Adve, S.: Performance directed energy management for main memory and disks. ACM Trans. Storage (TOS) 1(3), 346–380 (2005)

    Article  Google Scholar 

  16. Golding, R., Bosch, P., Wilkes, J., et al.: Idleness is not sloth. In: USENIX, pp. 201–212 (1995)

  17. Vázquez Pérez, S., Rodríguez, J., Rivera, M., García Franquelo, L., Norambuena, M.: Model predictive control for power converters and drives: advances and trends. IEEE Trans. Ind. Electron. 64(2), 935–947 (2016)

    Article  Google Scholar 

  18. Mahajan, D., Blakeney, C., Zong, Z.: Improving the energy efficiency of relational and nosql databases via query optimizations. Sustain. Comput. 22, 120–133 (2019)

    Google Scholar 

  19. Helmbold, D.P., Long, D.D., Sherrod, B.: A dynamic disk spin-down technique for mobile computing. In: Proceedings of the 2nd Annual International Conference on Mobile Computing and Networking, pp. 130–142. ACM (1996)

  20. Paul, M., Krishnaswamy, S.: System and method to enable prediction-based power management. US Patent App. 15/978,176 (2019)

  21. Galicia, A., Talavera-Llames, R., Troncoso, A., Koprinska, I., Martínez-Álvarez, F.: Multi-step forecasting for big data time series based on ensemble learning. Knowl.-Based Syst. 163, 830–841 (2019)

    Article  Google Scholar 

  22. Gao, Y., Guan, H., Qi, Z., Wang, B., Liu, L.: Quality of service aware power management for virtualized data centers. J. Syst. Archit. 59(4–5), 245–259 (2013)

    Article  Google Scholar 

  23. Yin, S., Li, X., Li, K., Huang, J., Ruan, X., Zhu, X., Cao, W., Qin, X.: Reed: A reliable energy-efficient raid. In: 2015 44th International Conference on Parallel Processing, pp. 649–658. IEEE (2015)

  24. Ma, L., Van Aken, D., Hefny, A., Mezerhane, G., Pavlo, A., Gordon, G. J.: Query-based workload forecasting for self-driving database management systems. In: Proceedings of the 2018 International Conference on Management of Data, pp. 631–645. ACM (2018)

  25. Sun, Z., Kuenning, G., Mandal, S., Shilane, P., Tarasov, V., Xiao, N., Zadok, E., et al.: Cluster and single-node analysis of long-term deduplication patterns. ACM Trans. Storage (TOS) 14(2), 13 (2018)

    Google Scholar 

  26. Deng, Y., Wang, F., Helian, N.: EED: energy efficient disk drive architecture. Inf. Sci. 178(22), 4403–4417 (2008)

    Article  Google Scholar 

  27. Li, D., Wang, J.: Eeraid: energy efficient redundant and inexpensive disk array. In: Proceedings of the 11th Workshop on ACM SIGOPS European Workshop, p. 29. ACM (2004)

  28. Liebig, T., Piatkowski, N., Bockermann, C., Morik, K.: Dynamic route planning with real-time traffic predictions. Inf. Syst. 64, 258–265 (2017)

    Article  Google Scholar 

  29. Kang, S.-W., Song, M., Park, K., Hwang, C.-S.: Towards an efficient semantic prefetching for location based services. In: iiWAS (2004)

  30. Wang, H., Luo, Z.: Data cache prefetching with perceptron learning, arXiv preprint arXiv:1712.00905

  31. Yin, S., Xiao, Z., Li, K., Huang, J., Ruan, X., Zhu, X., Qin, X.: Ress: A reliable energy-efficient storage system. In: 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS), pp. 1193–1198. IEEE (2016)

  32. Yao, X., Wang, J.: Rimac: a novel redundancy-based hierarchical cache architecture for energy efficient, high performance storage systems. In: ACM SIGOPS Operating Systems Review, vol. 40, pp. 249–262. ACM (2006)

  33. Iqbal, W., Erradi, A., Mahmood, A.: Dynamic workload patterns prediction for proactive auto-scaling of web applications. J. Netw. Comput. Appl. 124, 94–107 (2018)

    Article  Google Scholar 

Download references

Acknowledgements

One of the authors, Sumedha Arora offers the sincerest gratitude to the Council of Scientific and Industrial Research (CSIR), Government of India, for funding the research and providing required resources to carry out this research work with the Ack. No. 143253/2K17/1 and File No. 09/677(0030)/2018-EMR-I.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sumedha Arora.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Arora, S., Bala, A. PAP: power aware prediction based framework to reduce disk energy consumption. Cluster Comput 23, 3157–3174 (2020). https://doi.org/10.1007/s10586-020-03077-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-020-03077-3

Keywords

Navigation