Towards massive consolidation in data centers with SEaMLESS
Authors: 
Andrea Segalini, Dino Lopez Pacheco, Quentin Jacquemart, Myriana Rifai, Guillaume Urvoy-Keller, Marcos DioneAuthors Info & Claims
Pages 233 - 242
Abstract
In Data Centers (DCs), an abundance of virtual machines (VMs) remain idle due to network services awaiting for incoming connections, or due to established-and-idling sessions. These VMs lead to wastage of RAM - the scarcest resource in DCs - as they lock their allocated memory.
In this paper, we introduce SEaMLESS, a solution designed to (i) transform fully-fledged idle VMs into lightweight and resourceless virtual network functions (VNFs), then (ii) reduces the allocated memory to those idle VMs. By replacing idle VMs with VNFs, SEaMLESS provides fast VM restoration upon user activity detection, thereby introducing limited impact on the Quality of Experience (QoE). Our results show that SEaMLESS can consolidate hundreds of VMs as VNFs onto one single machine. SEaMLESS is thus able to release the majority of the memory allocated to idle VMs. This freed memory can then be reassigned to new VMs, or lead to massive consolidation, to enable a better utilization of DC resources.
References
[1]
J. Koomey and J. Taylor, "Zombie/comatose servers redux," 2017, visited on 2017-11-07. {Online}. Available: http://anthesisgroup.com/wp-content/uploads/2017/03/Comatsoe-Servers-Redux-2017.pdf
[2]
L. Zhang, J. Litton, F. Cangialosi, T. Benson, D. Levin, and A. Mislove, "Picocenter: Supporting long-lived, mostly-idle applications in cloud environments," in EuroSys 2016. ACM.
[3]
G. Moltó, M. Caballer, and C. de Alfonso, "Automatic memory-based vertical elasticity and oversubscription on cloud platforms," Future Gener. Comput. Syst., vol. 56, no. C, Mar. 2016.
[4]
T.-I. Salomie, G. Alonso, T. Roscoe, and K. Elphinstone, "Application level ballooning for efficient server consolidation," in EuroSys 2013. ACM.
[5]
N. Bila, E. de Lara, K. Joshi, H. A. Lagar-Cavilla, M. Hiltunen, and M. Satyanarayanan, "Jettison: Efficient idle desktop consolidation with partial vm migration," in EuroSys 2012. ACM, 2012, pp. 211--224.
[6]
D. L. Pacheco, Q. Jacquemart, A. Segalini, M. Rifai, M. Dione, and G. Urvoy-Keller, "Seamless: A service migration cloud architecture for energy saving and memory releasing capabilities," in ACM SoCC 2017. ACM.
[7]
F. Hermenier, J. L. Lawall, and G. Muller, "Btrplace: A flexible consolidation manager for highly available applications," IEEE Trans. Dependable Sec. Comput., vol. 10, no. 5, pp. 273--286, 2013.
[8]
Docker, "Build, ship, and run any app, anywhere," https://www.docker.com/.
[9]
CRIU, "Checkpoint/Restore In Userspace," https://criu.org/Main_Page.
[10]
M. Mahalingam, T. Sridhar, M. Bursell, L. Kreeger, C. Wright, K. Duda, P. Agarwal, and D. Dutt, "Virtual extensible Local Area Network (VXLAN): A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks," RFC 7348, Aug. 2014.
[11]
O. vSwitch, "Open vSwitch," http://openvswitch.org/.
[12]
Neutron, "Neutron," https://wiki.openstack.org/wiki/Neutron.
[13]
I. Zhang, T. Denniston, Y. Baskakov, and A. Garthwaite, "Optimizing vm checkpointing for restore performance in vmware esxi."
[14]
C. A. Waldspurger, "Memory resource management in vmware esx server," ACM SIGOPS Operating Systems Review, vol. 36, no. SI, pp. 181--194, 2002.
[15]
D. Balouek, A. Carpen Amarie, G. Charrier, F. Desprez, E. Jeannot, E. Jeanvoine, A. Lèbre, D. Margery, N. Niclausse, L. Nussbaum, O. Richard, C. Pérez, F. Quesnel, C. Rohr, and L. Sarzyniec, "Adding virtualization capabilities to the Grid'5000 testbed," in Communications in Computer and Information Science - Cloud Computing and Services Science. Springer, 2013, vol. 367.
[16]
Y. Chen, T. Farley, and N. Ye, "Qos requirements of network applications on the internet," Inf. Knowl. Syst. Manag., vol. 4, no. 1, pp. 55--76, Jan. 2004.
[17]
"Will aws t2 replace 30 percent of instances? not so fast," https://www.rightscale.com/blog/cloud-cost-analysis/will-aws-t2-replace-30-percent-instances-not-so-fast.
[18]
"Inside amazon's cloud: Just how many customer projects?" https://www.cio.com/article/2424378/virtualization/inside-amazon-s-cloud-just-how-many-customer-projects-.html.
[19]
J. Zhi, N. Bila, and E. de Lara, "Oasis: Energy proportionality with hybrid server consolidation," in EuroSys 2016. ACM.
[20]
Giovanni Franzini, "Idle virtual machine detection in fermicloud," Fermi National Accelerator Laboratory Scientific Computing Division Grid and Cloud Computing, Tech. Rep., sep 2012.
[21]
R. A. C. da Silva and N. L. S. da Fonseca, "Topology-aware virtual machine placement in data centers," Journal of Grid Computing, vol. 14, no. 1, pp. 75--90, 2016.
[22]
J. A. Pascual, T. Lorido-Botrán, J. Miguel-Alonso, and J. A. Lozano, "Towards a greener cloud infrastructure management using optimized placement policies," Journal of Grid Computing, vol. 13, no. 3, 2015.
[23]
A. Beloglazov, J. Abawajy, and R. Buyya, "Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing," Future Generation Computer Systems, vol. 28, no. 5, pp. 755 -- 768, 2012.
[24]
A. Beloglazov and R. Buyya, "Energy efficient resource management in virtualized cloud data centers," in IEEE/ACM CCGRID 2010.
[25]
H. Liu, H. Jin, C.-Z. Xu, and X. Liao, "Performance and energy modeling for live migration of virtual machines," Cluster computing, vol. 16, no. 2, pp. 249--264, 2013.
[26]
J. Sekhar, G. Jeba, and S. Durga, "A survey on energy efficient server consolidation through vm live migration," International Journal of Advances in Engineering & Technology, vol. 5, no. 1, pp. 515--525, 2012.
[27]
C. Ghribi, M. Hadji, and D. Zeghlache, "Energy efficient vm scheduling for cloud data centers: exact allocation and migration algorithms," in CCGrid 2013. IEEE/ACM.
[28]
T. Das, P. Padala, V. Padmanabhan, R. Ramjee, and K. G. Shin, "Litegreen: Saving energy in networked desktops using virtualization," in ATC. USENIX, June 2010.
[29]
J. Reich, M. Goraczko, A. Kansal, and J. Padhye, "Sleepless in seattle no longer," in ATC 2010. USENIX, 2010.
[30]
T. Knauth and C. Fetzer, "Dreamserver: Truly on-demand cloud services," in Proceedings of International Conference on Systems and Storage. ACM, 2014, pp. 1--11.
[31]
U. Deshpande, D. Chan, T.-Y. Guh, J. Edouard, K. Gopalan, and N. Bila, "Agile live migration of virtual machines," in Parallel and Distributed Processing Symposium. IEEE, 2016.
[32]
A. C. Snoeren and H. Balakrishnan, "TCP connection migration," Working Draft, IETF Secretariat, Internet-Draft, Nov 2000. {Online}. Available: http://www.rfc-editor.org/internet-drafts/draft-snoeren-tcp-migrate-00.txt
[33]
M. Bernaschi, F. Casadei, and P. Tassotti, "Sockmi: a solution for migrating tcp/ip connections," in Parallel, Distributed and Network-Based Processing, 2007. PDP '07. 15th EUROMICRO International Conference on, Feb 2007, pp. 221--228.
[34]
F. Manco, C. Lupu, F. Schmidt, J. Mendes, S. Kuenzer, S. Sati, K. Yasukata, C. Raiciu, and F. Huici, "My vm is lighter (and safer) than your container," in Proceedings of the 26th Symposium on Operating Systems Principles. ACM, 2017, pp. 218--233.
- Towards massive consolidation in data centers with SEaMLESS
Recommendations
Server consolidation with migration control for virtualized data centers
Virtualization has become a key technology for simplifying service management and reducing energy costs in data centers. One of the challenges faced by data centers is to decide when, how, and which virtual machines (VMs) have to be consolidated into a ...
Towards Economical Live Migration in Data Centers
Economics of Grids, Clouds, Systems, and ServicesAbstractLive migration of virtual machines (VMs) enables maintenance, load balancing, and power management in data centers. The cost of live migration on several key metrics combined with strict service-level objectives (SLOs), however, typically limits ...
Virtual Machine Consolidation with Usage Prediction for Energy-Efficient Cloud Data Centers
CLOUD '15: Proceedings of the 2015 IEEE 8th International Conference on Cloud ComputingVirtual machine consolidation aims at reducing the number of active physical servers in a data center, with the goal to reduce the total power consumption. In this context, most of the existing solutions rely on aggressive virtual machine migration, ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
May 2018
731 pages
ISBN:9781538658154
- Conference Chair:
- Esam El-Araby,
- General Chair:
- Tarek El-Ghazawi,
- Program Chair:
- Dhabaleswar K. Panda
Sponsors
In-Cooperation
- IEEE-CS: Computer Society
Publisher
IEEE Press
Publication History
Published: 01 May 2018
Check for updates
Qualifiers
- Research-article
Conference
CCGrid '18
Sponsor:
CCGrid '18: 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
May 1 - 4, 2018
District of Columbia, Washington
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 23Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in