Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Multi-Grid, Multi-User Workflows in the P-GRADE Grid Portal

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Computational Grids connect resources and users in a complex way in order to deliver nontrivial qualities of services. According to the current trend various communities build their own Grids and due to the lack of generally accepted standards these Grids are usually not interoperable. As a result, large scale sharing of resources is prevented by the isolation of Grid systems. Similarly, people are isolated, because the collaborative work of Grid users is not supported by current environments. Each user accesses Grids as an individual person without having the possibility of organizing teams that could overcome the difficulties of application development and execution more easily. The paper describes a new workflow-oriented portal concept that solves both problems. It enables the interoperability of various Grids during the execution of workflow applications, and supports users to develop and run their Grid workflows in a collaborative way. The paper also introduces a classification model that can be used to identify workflow-oriented Grid portals based on two general features: Ability to access multiple Grids, and support for collaborative problem solving. Using the approach the different potential portal types are introduced, their unique features are discussed and the portals and Problem Solving Environments (PSE) of our days are classified. The P-GRADE Portal as a Globus-based implementation for the classification model is also presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. I. Foster and C. Kesselman, “Computational Grids”, The Grid: Blueprint for a New Computing Infrastructure, Morgan Kaufmann, pp. 15–52, 1998.

  2. I. Foster and C. Kesselman, “The Globus project: A status report”, in Proc. of the Heterogeneous Computing Workshop, IEEE Computer Society, pp. 4–18, 1998.

  3. E. Korpela, D. Werthimer, D.P. Anderson, J. Cobb and M. Lebofsky, “SETI@home – Massively distributed computing for SETI”, IEEE Computational Science and Engineering, Vol. 3, No. 1, pp. 78–83, 2001.

    Google Scholar 

  4. A.A. Chien, “Architecture of a commercial enterprise desktop Grid: The Entropia system”, Grid Computing – Making the Global Infrastructure a Reality, Wiley, Ltd., pp. 337–350, 2003.

  5. M. Snir, S.W. Otto, S. Huss-Lederman, D.W. Walker and J. Dongarra, “MPI: The Complete Reference”, MIT, 1995.

  6. N. Karonis, B. Toonen, and I. Foster, “MPICH-G2: A Grid-Enabled Implementation of the Message Passing Interface”, Journal of Parallel and Distributed Computing, Vol. 63, No. 5, pp. 551–563, 2003.

    Article  MATH  Google Scholar 

  7. I. Foster, M. Fidler, A. Roy, V. Sander and L. Winkler, “End-to-end quality of service for high-end applications”, Elsevier Computer Communications Journal, Vol. 27, No. 14, pp. 1375–1388, 2004.

    Article  Google Scholar 

  8. Ewa Deelman, et al. “Mapping abstract complex workflows onto Grid environments”, Journal of Grid Computing, Vol. 1, No. 1, pp. 25–39, 2003.

    Article  Google Scholar 

  9. I. Taylor et al., “Triana applications within Grid computing and peer to peer environments”, Journal of Grid Computing, Vol. 1, No. 2, pp. 199–217, 2003.

    Article  Google Scholar 

  10. Matthew Addis et al., “Experiences with eScience workflow specification and enactment in bioinformatics”, in Proc. of UK e-Science All Hands Meeting, S.J. Cox, Editor. 2003.

  11. R. Barbera, A. Falzone and A. Rodolico, “The GENIUS Grid portal”, Computing in High Energy and Nuclear Physics, 2003.

  12. UK NGS Portal: http://portal.ngs.ac.uk.

  13. M. Thomas, S. Mock and J. Boisseau, “Development of Web Toolkits for computational Science Portals: The NPACI HotPage”, in Proc. of the 9th IEEE International Symposium on High Performance Distributed Computing (HPDC 2000), Pittsburgh, 2000.

  14. R. Barbera et al., “The GENIUS Grid portal”, Computing in High Energy and Nuclear Physics, 2003.

  15. I. Taylor et al., “Grid enabling applications using Triana”, Workshop on Grid Applications and Programming Tools, Seattle, 2003.

  16. M.J. Flynn, “Some computer organizations and their effectiveness”, IEEE Transactions on Computers, C-21, 948–960, 1972.

    Article  Google Scholar 

  17. J. Novotny, S. Tuecke and V. Welch, “An online credential repository for the Grid: MyProxy”, in Proc. of 10th IEEE International. Symposium on High Performance Distributed Computing, 2001.

  18. R. Lovas, G. Dózsa, P. Kacsuk, N. Podhorszki and D. Drótos, “Workflow support for complex Grid applications: Integrated and portal solutions”, in Proc. of Second European AcrossGrids Conference, (AxGrids 2004), Nicosia, Cyprus, LNCS, Vol. 3165, 2004, pp. 129–138.

  19. UK e-Science OGSA Testbed: http://dsg.port.ac.uk/projects/ogsa-testbed/.

  20. Southern Eastern European GRid-enabled eInfrastructure Development (SEE-GRID): http://www.see-Grid.org/.

  21. UK National Grid Service: http://www.ngs.ac.uk/.

  22. D. Thain, T. Tannenbaum and M. Livny, “Distributed computing in practice: The Condor experience”, Concurrency and Computation: Practice and Experience, pp. 323–356, 2005.

  23. W. Allcock et al., “Gridftp protocol specification”, GGF GridFTP Working Group Document, September 2002.

  24. B. Berliner: CVS II: ParalMizing software development, in Proc. of Winter 1990 USENIX Technical Conference, 1990.

  25. W. Appelt, “WWW based collaboration with the BSCW system”, in Proc. of the Conference on Current Trends in Theory and Informatics, pp. 66–78, 1999.

  26. R. Butler, D. Engert, I. Foster, C. Kesselman, S. Tuecke, J. Volmer and V. Welch, A national-scale authentication infrastructure. IEEE Computer, Vol. 33, No. 12, 60–66, 2000.

    Google Scholar 

  27. D.W. Erwin and D.F. Snelling, “UNICORE: A Grid computing environment”, In Lecture Notes in Computer Science, volume 2150, Springer, pp. 825–834, 2001.

  28. G. Allen et al., “Enabling applications on the Grid: A Gridlab overview”, International Journal of High Performance Computing Applications, Issue 17, pp. 449–466, 2003.

  29. G. Singh et al., “The Pegasus portal: Web based Grid computing”, in Proc. Of 20th Annual ACM Symposium on Applied Computing, Santa Fe, New Mexico, 2005.

  30. J. Cao, S.A. Jarvis, S. Saini, and G.R. Nudd, “GridFlow: Workflow management for Grid computing”, in Proc. of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID'03), pp. 198–205, 2003.

  31. LHC Computing Grid: http://lcg.web.cern.ch/LCG/.

  32. M. Ellert et al., “The NorduGrid project: Using Globus toolkit for building Grid infrastructure,” Nuclear Instruments and Methods (Section A) 502, pp. 407–410, 2003.

  33. Grid2003 Team, “The Grid2003 production Grid: Principles and practice”, in Proc. of the 13th IEEE Intl. Symposium on High Performance Distributed Computing (HPDC-13), 2004.

  34. V. Sunderam and J. Dongarra, “PVM: A framework for parallel distributed computing”, Concurrency: Practice and Experience, Vol. 2, No. 4, pp. 315–339, 1990.

    Article  Google Scholar 

  35. B. Coghlan, J. Walsh and D. O'Callaghan, “The Grid-Ireland deployment architecture”, in Proc. Of European Grid Conference, Amsterdam, The Netherlands, pp. 354–363, 2005.

  36. R. Allan et al., “Virtual research environments: Sakai demonstrator”, in Proc. Of UK e-Science All Hands Meeting, 2005.

  37. L. Childers, T. Disz, R. Olson, M.E. Papka, R. Stevens and T. Udeshi, “Access Grid: Immersive group-to-group collaborative visualization,” in Proc. of the 4th International Immersive Projection Technology Workshop, 2000.

  38. W. Gantzsch, “Sun Grid engine, towards creating a compute power Grid”, in Proc. Of the 1st International Symposium on Cluster Computing and the Grid (CCGrid '01), IEEE Computer Society, pp. 35–6, 2001.

  39. S. Zhou, “LSF: Load sharing in large-scale Heterogeneous distributed systems”, in Proc. Of Workshop on Cluster Computing, 1992.

  40. E. Seidel, G. Allen, A. Merzky and J. Nabrzyski, “GridLab – A Grid application toolkit and testbed”, Future Generation Computer Systems, Vol. 18, No. 8, pp. 1143–1153, 2002.

    Article  MATH  Google Scholar 

  41. I. Foster, C. Kesselman and S. Tuecke, “The anatomy of the Grid: Enabling scalable virtual organizations”, International Journal of Supercomputer Applications, Vol. 15, No. 3, 2001.

  42. The HunGrid Virtual Organisation: http://www.lcg.kfki.hu/?hunGrid and hunGridgeneral.

  43. J, Novotny, M. Russell and O. Wehrens: Grid-sphere: A portal framework for building collaborations” in Proc. of the 1st International Workshop on Middleware in Grid Computing, Rio de Janeiro, Brazil, 2003.

  44. P-GRADE Grid Portal: http://www.pds.sztaki.hu/pgportal.

  45. D. Britton et al., “GridPP: Meeting the particle physics computing challenge”, in Proc. Of UK e-Science All Hands Meeting, 2005.

  46. LCG-2 User Guide, 4 August, 2005: https://edms.cern.ch/file/454439/2/LCG-2-UserGuide.html.

  47. J. Yu and R. Buyya, “A Taxonomy of Workflow Management Systems for Grid Computing”, Journal of Computing, Vol.3, No. 3–4, 2006.

Download references

Author information

Authors and Affiliations

  1. MTA SZTAKI Computer and Automation Research Institute, P.O. Box 63, H-1518, Budapest, Hungary

    Péter Kacsuk & Gergely Sipos

Authors
  1. Péter Kacsuk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gergely Sipos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Péter Kacsuk.

Additional information

The work described in this paper is supported by the Hungarian Grid project (IHM 4671/1/2003), by the Hungarian OTKA project (No. T042459) and a collaboration project with the University of Reading.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kacsuk, P., Sipos, G. Multi-Grid, Multi-User Workflows in the P-GRADE Grid Portal. J Grid Computing 3, 221–238 (2005). https://doi.org/10.1007/s10723-005-9012-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-005-9012-6

Key words

Search

Navigation