research-article

Interference Management for Distributed Parallel Applications in Consolidated Clusters

Authors:

Seungheun Jeon,

Jaehyuk HuhAuthors Info & Claims

ACM SIGARCH Computer Architecture News, Volume 44, Issue 2

Pages 443 - 456

https://doi.org/10.1145/2980024.2872388

Published: 25 March 2016 Publication History

Abstract

Consolidating multiple applications on a system can improve the overall resource utilization of data center systems. However, such consolidation can adversely affect the performance of some applications due to interference caused by resource contention. Despite many prior studies on the interference effects in single-node systems, the interference behaviors of distributed parallel applications have not been investigated thoroughly. With distributed applications, a local interference in a node can affect the whole execution of an application spanning many nodes. This paper studies an interference modeling methodology for distributed applications to predict their performance under interference effects in consolidated clusters. This study first characterizes the effects of interference for various distributed applications over different interference settings, and analyzes how diverse interference intensities on multiple nodes affect the overall performance. Based on the characterization, this study proposes a static profiling-based model for interference propagation and heterogeneity behaviors. In addition, this paper presents use case studies of the modeling method, two interference-aware placement techniques for consolidated virtual clusters, which attempt to maximize the overall throughput or to guarantee the quality-of-service.

References

[1]

VMware ESX Server 2 NUMA Support. White paper.

[2]

Jeongseob Ahn, Changdae Kim, Jaeung Han, Young-ri Choi, and Jaehyuk Huh. Dynamic virtual machine scheduling in clouds for architectural shared resources. In Proceedings of the 4th USENIX Conference on Hot Topics in Cloud Computing (HotCloud), 2012.

Digital Library

[3]

Sergey Blagodurov, Sergey Zhuravlev, Mohammad Dashti, and Alexandra Fedorova. A case for NUMA-aware contention management on multicore systems. In Proceedings of the 2011 USENIX Conference on USENIX Annual Technical Conference (ATC), 2011.

Digital Library

[4]

Xiangping Bu, Jia Rao, and Cheng-zhong Xu. Interference and locality-aware task scheduling for MapReduce applications in virtual clusters. In Proceedings of the 22nd International Symposium on High-performance Parallel and Distributed Computing (HPDC), 2013.

Digital Library

[5]

Ron C. Chiang and H. Howie Huang. Tracon: interference-aware scheduling for data-intensive applications in virtualized environments. In Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 2011.

Digital Library

[6]

Hyung Won Choi, Hukeun Kwak, Andrew Sohn, and Kyusik Chung. Autonomous learning for efficient resource utilization of dynamic VM migration. In Proceedings of the 22nd annual international conference on Supercomputing (ICS), 2008.

Digital Library

[7]

Christina Delimitrou and Christos Kozyrakis. Paragon: QoS-aware scheduling for heterogeneous datacenters. In Proceedings of the 18th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2013.

Digital Library

[8]

Christina Delimitrou and Christos Kozyrakis. Quasar: Resource-efficient and QoS-aware cluster management. In Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2014.

Digital Library

[9]

RW Eglese. Simulated annealing: a tool for operational research. European journal of operational research, 46(3):271--281, 1990.

[10]

Ajay Gulati, Ganesha Shanmuganathan, Anne Holler, and Irfan Ahmad. Cloud-scale resource management: Challenges and techniques. In Proceedings of the 3rd USENIX Conference on Hot Topics in Cloud Computing (HotCloud), 2011.

[11]

Jaeung Han, Jeongseob Ahn, Changdae Kim, Youngjin Kwon, Young-ri Choi, and Jaehyuk Huh. The effect of multi-core on HPC applications in virtualized systems. In Proceedings of the 5th Workshop on Virtualization in High-Performance Cloud Computing (VHPC), 2011.

[12]

Jason Mars and Lingjia Tang. Whare-map: Heterogeneity in "homogeneous" warehouse-scale computers. In Proceedings of the 40th Annual International Symposium on Computer Architecture (ISCA), 2013.

Digital Library

[13]

Jason Mars, Lingjia Tang, Robert Hundt, Kevin Skadron, and Mary Lou Soffa. Bubble-Up: Increasing utilization in modern warehouse scale computers via sensible co-locations. In Proceedings of the 44th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO), 2011.

Digital Library

[14]

Andreas Merkel, Jan Stoess, and Frank Bellosa. Resource-conscious scheduling for energy efficiency on multicore processors. In Proceedings of the 5th European Conference on Computer Systems (EuroSys), 2010.

Digital Library

[15]

Ripal Nathuji, Aman Kansal, and Alireza Ghaffarkhah. Q-clouds: managing performance interference effects for qos-aware clouds. In Proceedings of the 5th European conference on Computer systems (EuroSys), 2010.

Digital Library

[16]

Dejan Novaković, Nedeljko Vasić, Stanko Novaković, Dejan Kostić, and Ricardo Bianchini. DeepDive: Transparently identifying and managing performance interference in virtualized environments. In Proceedings of the 2013 USENIX Conference on Annual Technical Conference (ATC), 2013.

[17]

Moinuddin K. Qureshi and Yale N. Patt. Utility-based cache partitioning: A low-overhead, high-performance, runtime mechanism to partition shared caches. In Proceedings of the 39th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO), 2006.

[18]

Jason Sonnek, James Greensky, Robert Reutiman, and Abhishek Chandra. Starling: Minimizing communication overhead in virtualized computing platforms using decentralized affinity-aware migration. In Proceedings of the 2010 39th International Conference on Parallel Processing (ICPP), 2010.

Digital Library

[19]

G. Edward Suh, Srinivas Devadas, and Larry Rudolph. A new memory monitoring scheme for memory-aware scheduling and partitioning. In Proceedings of the 8th International Symposium on High-Performance Computer Architecture (HPCA), 2002.

[20]

Timothy Wood, Prashant Shenoy, Arun Venkataramani, and Mazin Yousif. Black-box and gray-box strategies for virtual machine migration. In Proceedings of the 4th USENIX Conference on Networked Systems Design & Implementation (NSDI), 2007.

Digital Library

[21]

Hailong Yang, Alex Breslow, Jason Mars, and Lingjia Tang. Bubble-flux: Precise online QoS management for increased utilization in warehouse scale computers. In Proceedings of the 40th Annual International Symposium on Computer Architecture (ISCA), 2013.

Digital Library

[22]

Xiao Zhang, Eric Tune, Robert Hagmann, Rohit Jnagal, Vrigo Gokhale, and John Wilkes. CPI2: Cpu performance isolation for shared compute clusters. In Proceedings of the 8th European Conference on Computer Systems (EuroSys), 2013.

Digital Library

[23]

Qian Zhu, Jiedan Zhu, and Gagan Agrawal. Power-aware consolidation of scientific workflows in virtualized environments. In Proceedings of the 2010 International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 2010.

Digital Library

[24]

Sergey Zhuravlev, Sergey Blagodurov, and Alexandra Fedorova. Addressing shared resource contention in multicore processors via scheduling. In Proceedings of the 15th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2010.

Digital Library

Cited By

Liao HLiu TGuo JHuang BYang DDing J(2024)Retrospecting Available CPU Resources: SMT-Aware Scheduling to Prevent SLA Violations in Data CentersIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.349487936:1(67-83)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1109/TPDS.2024.3494879
Yuan YAlian MWang YWang RKurakin ITai CKim NMartínez JDuato JJohn L(2021)Don't forget the I/O when allocating your LLCProceedings of the 48th Annual International Symposium on Computer Architecture10.1109/ISCA52012.2021.00018(112-125)Online publication date: 14-Jun-2021
https://dl.acm.org/doi/10.1109/ISCA52012.2021.00018
Sun BHuang ZZhao HXiao WZhang XLi YLin WGavrilovska ATerry D(2024)LlumnixProceedings of the 18th USENIX Conference on Operating Systems Design and Implementation10.5555/3691938.3691948(173-191)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691938.3691948
Show More Cited By

Index Terms

Interference Management for Distributed Parallel Applications in Consolidated Clusters
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Networks
  1. Network services
    1. Cloud computing

Recommendations

Interference Management for Distributed Parallel Applications in Consolidated Clusters
ASPLOS '16

Consolidating multiple applications on a system can improve the overall resource utilization of data center systems. However, such consolidation can adversely affect the performance of some applications due to interference caused by resource contention. ...
Interference Management for Distributed Parallel Applications in Consolidated Clusters
ASPLOS '16: Proceedings of the Twenty-First International Conference on Architectural Support for Programming Languages and Operating Systems

Consolidating multiple applications on a system can improve the overall resource utilization of data center systems. However, such consolidation can adversely affect the performance of some applications due to interference caused by resource contention. ...
Error Performance of FH Wireless LANs in DS and Tone Interference

In this paper the bit error probability of the SFH/MFSK system in presence of wideband and tone interference in a fading environment is evaluated. Simultaneous license-free operation of tone-like applications, Frequency Hopping (FH), and Direct Sequence (...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGARCH Computer Architecture News

ACM SIGARCH Computer Architecture News Volume 44, Issue 2

ASPLOS'16

May 2016

774 pages

ISSN:0163-5964

DOI:10.1145/2980024

Editor:
Doug DeGroot
acm dot org

Issue’s Table of Contents

ASPLOS '16: Proceedings of the Twenty-First International Conference on Architectural Support for Programming Languages and Operating Systems
March 2016
824 pages
ISBN:9781450340915
DOI:10.1145/2872362
General Chair:
Tom Conte
Georgia Tech, USA
,
Program Chair:
Yuanyuan Zhou
University of California, San Diego, USA

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 March 2016

Published in SIGARCH Volume 44, Issue 2

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
640
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liao HLiu TGuo JHuang BYang DDing J(2024)Retrospecting Available CPU Resources: SMT-Aware Scheduling to Prevent SLA Violations in Data CentersIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.349487936:1(67-83)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1109/TPDS.2024.3494879
Yuan YAlian MWang YWang RKurakin ITai CKim NMartínez JDuato JJohn L(2021)Don't forget the I/O when allocating your LLCProceedings of the 48th Annual International Symposium on Computer Architecture10.1109/ISCA52012.2021.00018(112-125)Online publication date: 14-Jun-2021
https://dl.acm.org/doi/10.1109/ISCA52012.2021.00018
Sun BHuang ZZhao HXiao WZhang XLi YLin WGavrilovska ATerry D(2024)LlumnixProceedings of the 18th USENIX Conference on Operating Systems Design and Implementation10.5555/3691938.3691948(173-191)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691938.3691948
Cheng YHuang XLiu ZChen JGao XFang ZYang Y(2024)FEDGE: An Interference-Aware QoS Prediction Framework for Black-Box Scenario in IaaS Clouds with Domain Generalization2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS57955.2024.00020(128-138)Online publication date: 27-May-2024
https://doi.org/10.1109/IPDPS57955.2024.00020
Wang YYu JYu Z(2023)Resource scheduling techniques in cloud from a view of coordination: a holistic survey从协同视角论云资源调度技术：综述Frontiers of Information Technology & Electronic Engineering10.1631/FITEE.210029824:1(1-40)Online publication date: 23-Jan-2023
https://doi.org/10.1631/FITEE.2100298
Iqbal SLi HBergsma SBeschastnikh IHu AGavrilovska AAltınbüken DBinnig C(2022)CoSpotProceedings of the 13th Symposium on Cloud Computing10.1145/3542929.3563499(540-556)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3542929.3563499
Kim SPham NBaek WChoi Y(2021)Holistic VM Placement for Distributed Parallel Applications in Heterogeneous ClustersIEEE Transactions on Services Computing10.1109/TSC.2018.289066814:5(1411-1425)Online publication date: 1-Sep-2021
https://doi.org/10.1109/TSC.2018.2890668
Hwang EKim JChoi Y(2021)Achieving Fairness-Aware Two-Level Scheduling for Heterogeneous Distributed SystemsIEEE Transactions on Services Computing10.1109/TSC.2018.283644414:3(639-653)Online publication date: 1-May-2021
https://doi.org/10.1109/TSC.2018.2836444
Wang YYu JYu Z(2021)Treator: a Fast Centralized Cluster Scheduling at Scale Based on B+ Tree and BSP2021 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking (ISPA/BDCloud/SocialCom/SustainCom)10.1109/ISPA-BDCloud-SocialCom-SustainCom52081.2021.00053(324-335)Online publication date: Sep-2021
https://doi.org/10.1109/ISPA-BDCloud-SocialCom-SustainCom52081.2021.00053
Yuan YAlian MWang YWang RKurakin ITai CKim N(2021)Don’t Forget the I/O When Allocating Your LLC2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA)10.1109/ISCA52012.2021.00018(112-125)Online publication date: Jun-2021
https://doi.org/10.1109/ISCA52012.2021.00018
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents