Abstract
Many Grid architectures have been developed in recent years. These range from the large community Grids such as LHG and EGEE to single site deployments such as Condor. However, these Grid architectures have tended to focus on the single or batch submission of executable jobs. Application scientists are now seeking to manage and use physical instrumentation on the Grid, integrating these with the computational tasks they already perform. This will require the functionality of current Grid systems to be extended to allow the submission of entire workflows. Thus allowing the scientists to perform increasingly larger parts of their experiments within the Grid environment. We propose here a set of high level services which may be used on-top of these existing Grid architectures such that the benefits of these architectures may be exploited along with the new functionality of workflows.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Project SGE, http://wwws.sun.com/software/gridware/
The GridCC Architecture Version 1.1.4 (2005), http://www.gridCC.org
McGough, A.S., Cohen, J., Darlington, J., Katsiri, E., Lee, W., Panagiotidi, S., Patel, Y.: An End-to-end Workflow Pipeline for Large-scale Grid Computing. Accepted for inclusion in the Journal of Grid Computing
Cao, J., Jarvis, S.A., Saini, S., Nudd, G.R.: GridFlow: Workflow Management for Grid Computing. In: Proceedings of 3rd International Symposium on Cluster Computing and the Grid (CCGrid), Tokyo, Japan, May 12–15. IEEE CS Press, Los Alamitos (2003)
Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Lazzarini, A., Arbree, A., Cavanaugh, R., Koranda, S.: Mapping Abstract Complex Workflows onto Grid Environments. Journal of Grid Computing 1(1), 9–23 (2003)
EGEE. Enabling Grids for E-science, http://public.eu-egee.org/
eGee gLite Lightweight Middleware for Grid Computing (2005), http://glite.web.cern.ch/glite/
Sun Grid Engine (2005), http://www.sun.com/software/grid/
Fahringer, T., Jugravu, A., Pllana, S., Prodan, R., Seragiotto Jr., C., Truong, H.L.: ASKALON: a tool set for cluster and Grid computing. Concurrency and Computation: Practice and Experience 17(2-4), 143–169 (2005)
Litzkow, M., Livny, M., Mutka, M.: Condor - A Hunter of Idle Workstations. In: Proceedings of 8th International Conference of Distributed Computing Systems (ICDCS), pp. 104–111. IEEE CS Press, Los Alamitos (1988)
Mayer, A., McGough, S., Furmento, N., Lee, W., Newhouse, S., Darlington, J.: ICENI Dataflow and Workflow: Composition and Scheduling in Space and Time. In: UK e-Science All Hands Meeting, Nottingham, UK, pp. 894–900. IOP Publishing Ltd., Bristol (2003)
McGough, S., Young, L., Afzal, A., Newhouse, S., Darlington, J.: Performance Architecture within ICENI. In: UK e-Science All Hands Meeting, Nottingham, UK, pp. 906–911. IOP Publishing Ltd., Bristol (2004)
McGough, S., Young, L., Afzal, A., Newhouse, S., Darlington, J.: Workflow Enactment in ICENI. In: UK e-Science All Hands Meeting, Nottingham, UK, September 2004, pp. 894–900. IOP Publishing Ltd., Bristol (2004)
Globus Project (2005), http://www.globus.org
Andreozzi, S., Ferrari, T., Monforte, S., Ronchieri, E.: Agreement-based Workload and Resource Management. In: Proceedings of the 1st IEEE International Conference on e-Science and Grid Computing, Melbourne, Australia, December 2005. IEEE Computer Society, Los Alamitos (2005)
Tannenbaum, T., Wright, D., Miller, K., Livny, M.: Condor - A Distributed Job Scheduler. Beowulf Cluster Computing with Linux. The MIT Press, MA (2002)
Taylor, I., Shields, M., Wang, I.: Resource Management for the Triana Peer-to-Peer Services. In: Nabrzyski, J., Schopf, J.M., Wȩglarz, J. (eds.) Grid Resource Management - State of the Art and Future Trends, pp. 451–462. Kluwer Academic Publishers, Dordrecht (2004)
Condor Team. Condor Project Homepage, http://www.cs.wisc.edu/condor
Thain, D., Tannenbaum, T., Livny, M.: Condor and the Grid. Grid Computing: Making the Global Infrastructure a Reality. John Wiley & Sons, NJ (2003)
van der Aalst, W.M.P.: Workflow Patterns, http://www.workflowpatterns.com/
Young, L., Darlington, J.: Scheduling Componentized Applications on a Computational Grid. MPhil/PhD Transfer Report, Imperial College London, University of London (2004)
Young, L., McGough, S., Newhouse, S., Darlington, J.: Scheduling Architecture and Algorithms within the ICENI Grid Middleware. In: UK e-Science All Hands Meeting, Nottingham, UK, September 2003, pp. 5–12. IOP Publishing Ltd., Bristol (2003)
Yu, J., Buyya, R.: A Novel Architecture for Realizing Grid Workflow using Tuple Spaces. In: Proceedings of 5th IEEE/ACM International Workshop on Grid Computing (Grid 2004), Pittsburgh, USA. IEEE CS Press, Los Alamitos (2004)
Yu, J., Buyya, R.: A taxonomy of workflow management systems for grid computing. GRIDS-TR-2005-1, Grid Computing and Distributed Systems Laboratory, University of Melbourne, Australia, March 10 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Colling, D.J. et al. (2006). Adding Instruments and Workflow Support to Existing Grid Architectures. In: Alexandrov, V.N., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds) Computational Science – ICCS 2006. ICCS 2006. Lecture Notes in Computer Science, vol 3993. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11758532_129
Download citation
DOI: https://doi.org/10.1007/11758532_129
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34383-7
Online ISBN: 978-3-540-34384-4
eBook Packages: Computer ScienceComputer Science (R0)