Abstract
Recent advances in hardware and software virtualization offer unprecedented management capabilities for the mapping of virtual resources to physical resources. It is highly desirable to further create a “service hosting abstraction” that allows application owners to focus on service level objectives (SLOs) for their applications. This calls for a resource management solution that achieves the SLOs for many applications in response to changing data center conditions and hides the complexity from both application owners and data center operators. In this paper, we describe an automated capacity and workload management system that integrates multiple resource controllers at three different scopes and time scales. Simulation and experimental results confirm that such an integrated solution ensures efficient and effective use of data center resources while reducing service level violations for high priority applications.
Similar content being viewed by others
References
HP Virtual Connect Enterprise Manager: http://h18004.www1.hp.com/products/blades/components/ethernet/vcem/index.html
VMware ESX Server: http://vmware.com/products/vi/esx/
Citrix XenServer: http://www.citrixxenserver.com/products/Pages/XenEnterprise.aspx
Microsoft Hyper-V: http://www.microsoft.com/windowsserver2008/en/us/hyperv.aspx
Virtual Iron: http://www.virtualiron.com/products/
Zhu, X., Wang, Z., Singhal, S.: Utility-driven workload management using nested control design. In: Proc. of the American Control Conference (ACC’06), June 2006
Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proc. of the 2nd Symposium on Networked Systems Design and Implementation (NSDI’05), May 2005
Hyser, C., Mckee, B., Gardner, R., Watson, B.J.: Autonomic virtual machine placement in the data center. HP Labs Technical Report HPL-2007-189, February 2007
Seltzsam, S., Gmach, D., Krompass, S., Kemper, A.: AutoGlobe: An automatic administration concept for service-oriented database applications. In: Proc. of the 22nd Intl. Conference on Data Engineering (ICDE’06), Industrial Track, April 2006
Gmach, D., Rolia, J., Cherkasova, L., Belrose, G., Turicchi, T., Kemper, A.: An integrated approach to resource pool management: policies, efficiency and quality metrics. In: Proc. of IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’08), June 2008
Rolia, J., Cherkasova, L., Arlitt, M., Andrzejak, A.: A capacity management service for resource pools. In: Proc. of the 5th Intl. Workshop on Software and Performance (WOSP’05), Spain, July 2005
Mosberger, D., Jin, T.: Httperf—A tool for measuring Web server performance. In: Proc. of the Workshop on Internet Server Performance, June 1998
Khana, G., Beaty, K., Kar, G., Kochut, A.: Application performance management in virtualized server environments. In: Proc. of the IEEE/IFIP Network Operations & Management Symposium (NOMS’06), April 2006
Kephart, J., Chan, H., Das, R., Levine, D., Tesauro, G., Rawson, F., Lefurgy, C.: Coordinating multiple autonomic managers to achieve specified power-performance tradeoffs. In: Proc. of the 4th IEEE Int. Conf. on Autonomic Computing (ICAC’07), June 2007
Heo, J., Henriksson, D., Liu, X., Abdelzaher, T.: Integrating adaptive components: An emerging challenge in performance adaptive systems and a server farm case-study. In: Proc. of the 28th IEEE Int. Real-Time Systems Symposium (RTSS’07), December 2007
Xu, J., Zhao, M., Fortes, J., Carpenter, R., Yousif, M.: Autonomic resource management in virtualized data centers using fuzzy logic-based approaches. Cluster Comput. J. 11, 213–227 (2008)
Wood, T., Shenoy, P., Venkataramani, A., Yousif, M.: Black-box and gray-box strategies for virtual machine migration. In: Proc. of the 4th USENIX Symposium on Networked Systems Design & Implementation (NSDI’07), April 2007
Raghavendra, R., Ranganathan, P., Talwar, V., Wang, Z., Zhu, X.: No power struggles: Coordinated multi-level power management for the data center. In: Proc. of the 13th Int. Conf. on Architectural Support for Programming Languages and Operating Systems (ASPLOS’08), March 2008
Hellerstein, J., Diao, Y., Parekh, S., Tilbury, D.: Feedback Control of Computing Systems. Wiley-IEEE Press, New York (2004). ISBN: 0-471266-37-X
Kamra, A., Misra, V., Nahum, E.: Yaksha: A self-tuning controller for managing the performance of 3-tiered web sites. In: Proc. of the Int. Workshop on Quality of Service (IWQoS’04), June 2004
Karlsson, M., Karamanolis, C., Zhu, X.: Triage: Performance differentiation for storage systems using adaptive control. ACM Trans. Storage 1(4), 457–480 (2005)
Abdelzaher, T., Shin, K., Bhatti, N.: Performance guarantees for web server end-systems: A control-theoretical approach. IEEE Trans. Parallel Distrib. Syst. 13, 80–96 (2002)
Lu, Y., Abdelzaher, T., Saxena, A.: Design, implementation, and evaluation of differentiated caching services. IEEE Trans. Parallel Distrib. Syst. 15(5), 440–452 (2004)
Urgaonkar, B., Shenoy, P., Chandra, A., Goyal, P.: Dynamic provisioning of multi-tier internet applications. In: Proc. of the Int. Conf. on Autonomic Computing (ICAC’05), June 2005
Wang, Z., Zhu, X., Singhal, S.: Utilization and SLO-based control for dynamic sizing of resource partitions. In: Proc. of the 16th IFIP/IEEE Distributed Systems: Operations and Management (DSOM’05), October 2005
Padala, P., Zhu, X., Uysal, M., Wang, Z., Singhal, S., Merchant, A., Salem, K., Shin, K.: Adaptive control of virtualized resources in utility computing environments. In: Proc. of the EuroSys’07, March 2007
Bash, C.E., Patel, C.D., Sharma, R.K.: Dynamic thermal management of air cooled data centers. In: Proc. of the Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems (ITHERM’06), May 2006
Cherkasova, L., Rolia, J.: R-Opus: A composite framework for application performability and QoS in shared resource pools. In: Proc. of the Int. Conf. on Dependable Systems and Networks (DSN’06), June 2006
Chen, Y., Iyer, S., Liu, X., Milojicic, D., Sahai, A.: SLA decomposition: Translating service level objectives to system level thresholds. In: Proc. of the 4th IEEE Int. Conf. on Autonomic Computing (ICAC’07), June 2007
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhu, X., Young, D., Watson, B.J. et al. 1000 islands: an integrated approach to resource management for virtualized data centers. Cluster Comput 12, 45–57 (2009). https://doi.org/10.1007/s10586-008-0067-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-008-0067-6