research-article

An autonomic network-aware scheduling architecture for grid computing

Authors:

Agustín Caminero,

Blanca Caminero,

Carmen CarriónAuthors Info & Claims

MGC '07: Proceedings of the 5th international workshop on Middleware for grid computing: held at the ACM/IFIP/USENIX 8th International Middleware Conference

Article No.: 1, Pages 1 - 6

https://doi.org/10.1145/1376849.1376850

Published: 26 November 2007 Publication History

Abstract

Grid technologies have enabled the aggregation of geographically distributed resources, in the context of a particular application. The network remains an important requirement for any Grid application, as entities involved in a Grid system (such as users, services, and data) need to communicate with each other over a network. The performance of the network must therefore be considered when carrying out tasks such as scheduling, migration or monitoring of jobs. Surprisingly, many existing QoS efforts ignore the network and focus instead on processor workload and disk access. Making use of the network in an efficient and fault tolerance manner, in the context of such existing research, leads to a significant number of research challenges. One way to address these problems is to make Grid middleware incorporate the concept of autonomic systems. Such a change would involve the development of "self-configuring" systems that are able to make decisions autonomously, and adapt themselves as the system status changes. We propose an autonomic network-aware scheduling infrastructure that is capable of adapting its behavior to the current status of the environment.

References

[1]

J. H. Abawajy. Autonomic job scheduling policy for grid computing. In 5th Intl. Conf. on Computational Science (ICCS), LNCS. Springer, 2005.

Digital Library

[2]

D. Adami et al. Design and implementation of a grid network-aware resource broker. In Proc. of the IASTED Intl. Conf. on Parallel and Distributed Computing and Networks, 2006.

Digital Library

[3]

R. Al-Ali et al. Network QoS Provision for Distributed Grid Applications. In Proc. of the Intl. Journal of Simulations Systems, Science and Technology, 2004.

[4]

S. Bhatti, S. Sørensen, P. Clark, and J. Crowcroft. Network QoS for Grid Systems. Intl. Journal of High Performance Computing Applications, 17(3), 2003.

Digital Library

[5]

A. Caminero, C. Carrión, and B. Caminero. Designing an entity to provide network QoS in a grid system. In Proc. of the 1st Iberian Grid Infrastructure Conference (IberGrid), 2007.

[6]

H.-H. Chu and K. Nahrstedt. CPU service classes for multimedia applications. In Proc. of IEEE Int. Conf. on Multimedia Computing and Systems (ICMCS), 1999.

Digital Library

[7]

X. Dong, S. Hariri, L. Xue, H. Chen, M. Zhang, S. Pavuluri, and S. Rao. Autonomia: an autonomic computing environment. In Proceedings of the IEEE Intl. Conf. on Performance, Computing and Communications, 2003.

[8]

S. Fitzgerald, I. Foster, C. Kesselman, G. von Laszewski, W. Smith, and S. Tuecke. A directory service for configuring high-performance distributed computations. In Proc. 6th IEEE Symp. on High Performance Distributed Computing, 1997.

Digital Library

[9]

S. Floyd and V. Jacobson. Random early detection gateways for congestion avoidance. IEEE/ACM Trans. Netw, 1(4):397413, 1993.

Digital Library

[10]

I. Foster and C. Kesselman. The Grid 2: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, 2 edition, 2003.

Digital Library

[11]

H. Liu and M. Parashar. A component based programming framework for autonomic applications. In Proc. of the Intl. Conference on Autonomic Computing, 2004.

Digital Library

[12]

F. T. Marchese and N. Brajkovska. Fostering asynchronous collaborative visualization. In Proc. of the 11th IEEE Intl. Conf. on Information Visualization, 2007.

Digital Library

[13]

M. L. Massie, B. N. Chun, and D. E. Culler. The ganglia distributed monitoring system: design, implementation, and experience. Parallel Computing, 30(5--6):817--840, 2004.

[14]

G. Mateescu. Extending the Portable Batch System with preemptive job scheduling. In ACM, editor, SC2000: High Performance Networking and Computing, 2000.

[15]

A. Roy. End-to-End Quality of Service for High-End Applications. PhD thesis, Dept. of Computer Science, University of Chicago, 2001.

Digital Library

[16]

S. Sohail, K. B. Pham, R. Nguyen, and S. Jha. Bandwidth Broker Implementation: Circa-Complete and Integrable. Technical report, School of Computer Science and Engineering, The University of New South Wales, 2003.

[17]

W. R. Stevens. TCP/IP Illustrated: The Protocols. Addison-Wesley, 1994.

Digital Library

[18]

A. Sulistio, G. Poduval, R. Buyya, and C.-K. Tham. On incorporating differentiated levels of network service into GridSim. Future Generation Computer Systems, 23(4):606--615, May 2007.

Digital Library

[19]

VIOLA : Vertically Integrated Optical Testbed for Large Application in DFN, 2006. Web site at http://www.viola-testbed.de/.

[20]

O. Waldrich, P. Wieder, and W. Ziegler. A Meta-scheduling Service for Co-allocating Arbitrary Types of Resources. In Proc. of the 6th Intl. Conf. on Parallel Processing and Applied Mathematics (PPAM), LNCS. Springer, 2005.

Digital Library

Cited By

Melchiors CTeixeira Mattjie DPaula dos Santos CPanisson AZambenedetti Granville LMargarida Rockenbach Tarouco L(2012)A P2P-Based Strongly Distributed Network Polling SolutionAdvancements in Distributed Computing and Internet Technologies10.4018/978-1-61350-110-8.ch014(289-313)Online publication date: 2012
https://doi.org/10.4018/978-1-61350-110-8.ch014
Lee CAbe HHirotsu TUmemura KBalman MByna S(2011)Predicting network throughput for grid applications on network virtualization areasProceedings of the first international workshop on Network-aware data management10.1145/2110217.2110220(11-20)Online publication date: 14-Nov-2011
https://dl.acm.org/doi/10.1145/2110217.2110220
Tripathi SDroux NSrinivasan TBelgaied KIyer VMogul J(2009)CrossbowProceedings of the 1st ACM workshop on Research on enterprise networking10.1145/1592681.1592689(45-54)Online publication date: 21-Aug-2009
https://dl.acm.org/doi/10.1145/1592681.1592689
Show More Cited By

Index Terms

An autonomic network-aware scheduling architecture for grid computing
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Enabling Autonomic Meta-Scheduling in Grid Environments
ICAC '08: Proceedings of the 2008 International Conference on Autonomic Computing

Grid computing supports workload execution on computing resources that are shared across a set of collaborative organizations. At the core of workload management for Grid computing is a software component, called meta-scheduler or Grid resource broker, ...
A GridWay-based autonomic network-aware metascheduler

One of the key motivations of computational and data grids is the ability to make coordinated use of heterogeneous computing resources which are geographically dispersed. Consequently, the performance of the network linking all the resources present in ...
MGC middleware for grid computing: the Globus Toolkit
ACAI '11: Proceedings of the International Conference on Advances in Computing and Artificial Intelligence

Grid computing has made substantial advances during the last decade. A major concern in Grid environments is dealing with the high degree of heterogeneity of resources that can range from laptops and PCs to supercomputers. The unified virtual view of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MGC '07: Proceedings of the 5th international workshop on Middleware for grid computing: held at the ACM/IFIP/USENIX 8th International Middleware Conference

November 2007

64 pages

ISBN:9781595939449

DOI:10.1145/1376849

Conference Chairs:
Bruno Schulze
LNCC, Brazil
,
Omer Rana
Cardiff Univesity, UK
,
Jim Myers
UIUC/NCSA
,
Walfredo Cirne
UFCG, Brazil and Google

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 November 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tag

network QoS in grid systems

Qualifiers

Research-article

Funding Sources

Spanish MEC and European Commission
JCCM
European Commission

Conference

Middleware07

Middleware07: 8th International Middleware Conference

November 26 - 30, 2007

California, Newport Beach

Acceptance Rates

Overall Acceptance Rate 14 of 36 submissions, 39%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
421
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Melchiors CTeixeira Mattjie DPaula dos Santos CPanisson AZambenedetti Granville LMargarida Rockenbach Tarouco L(2012)A P2P-Based Strongly Distributed Network Polling SolutionAdvancements in Distributed Computing and Internet Technologies10.4018/978-1-61350-110-8.ch014(289-313)Online publication date: 2012
https://doi.org/10.4018/978-1-61350-110-8.ch014
Lee CAbe HHirotsu TUmemura KBalman MByna S(2011)Predicting network throughput for grid applications on network virtualization areasProceedings of the first international workshop on Network-aware data management10.1145/2110217.2110220(11-20)Online publication date: 14-Nov-2011
https://dl.acm.org/doi/10.1145/2110217.2110220
Tripathi SDroux NSrinivasan TBelgaied KIyer VMogul J(2009)CrossbowProceedings of the 1st ACM workshop on Research on enterprise networking10.1145/1592681.1592689(45-54)Online publication date: 21-Aug-2009
https://dl.acm.org/doi/10.1145/1592681.1592689
Tomas LCaminero ACaminero BCarrion C(2009)Improving GridWay with network informationProceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing10.1109/IPDPS.2009.5160967(1-8)Online publication date: 23-May-2009
https://dl.acm.org/doi/10.1109/IPDPS.2009.5160967
Caminero ARana OCaminero BCarrión C(2009)Performance evaluation of an autonomic network‐aware metascheduler for GridsConcurrency and Computation: Practice and Experience10.1002/cpe.139321:13(1692-1708)Online publication date: 13-Feb-2009
https://doi.org/10.1002/cpe.1393
Caminero ARana OCaminero BCarrión C(2008)Improving Grid Inter-Domain Scheduling with P2P TechniquesProceedings of the 2008 Seventh International Conference on Grid and Cooperative Computing10.1109/GCC.2008.50(190-200)Online publication date: 24-Oct-2008
https://dl.acm.org/doi/10.1109/GCC.2008.50
Tomás LCaminero ACaminero BCarrión C(2008)Studying the Influence of Network-Aware Grid Scheduling on the Performance Received by UsersProceedings of the OTM 2008 Confederated International Conferences, CoopIS, DOA, GADA, IS, and ODBASE 2008. Part I on On the Move to Meaningful Internet Systems:10.1007/978-3-540-88871-0_51(726-743)Online publication date: 9-Nov-2008
https://dl.acm.org/doi/10.1007/978-3-540-88871-0_51

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents