Abstract
We present the AMGA metadata catalogue, which was developed as part of the EGEE (enabling Grids for EsciencE) project’s gLite Grid middleware. AMGA provides access to meta data for files stored on the Grid, as well as a simplified general access to relational data stored in database systems. Design and implementation of AMGA was done in close collaboration with the very diverse EGEE user community to make sure all functionality, performance and security requirements were met. In particular, AMGA targets the needs of the high energy physics community to rapidly access very large amounts of metadata, as well as the needs for security of the biomedical community. AMGA therefore tightly integrates fine grained access control making use of a virtual organisation management system. In addition, it offers advanced federation and features to increase dependability, performance and data security.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Albrand, S., Fulachier, J.: ATLAS metadata interfaces (AMI) and ATLAS metadata catalogs. In: Computing in High Energy and Nuclear Physics (CHEP) (2004)
Alfieri, R., Cecchini, R., Ciaschini, V., dell’Agnello, L., Frohner, A., Gianoli, A., Lorentey, K., Spataro, F.: VOMS, an authorization system for virtual organizations. In: 1st European Across Grids Conference (2003)
Antonioletti, M., Atkinson, M., Baxter, R., Borley, A., Hong, N.P.C., Dantressangle, P., Hume, A.C., Jackson, M., Krause, A., Laws, S., Parsons, M., Paton, N.P., Schopf, J.M., Sugden, P.W., Vyvyan, D.: OSA-DAI status and benchmarks. In: Proceedings of the UK e-Science All Hands Meeting (2005a)
Antonioletti, M., Atkinson, M., Baxter, R., Hong, A.B.N.P.C., Collins, B., Hardman, N., Hume, A.C., Knox, A., Jackson, M., Krause, A., Laws, S., Magowan, J., Paton, N.W., Pearson, D., Sugden, T., Watson, P., Westhead, M.: Design and implementation of Grid database services in OGSA-DAI. Concurrency and Computation: Practice and Experience 17, 357–376 (2005b)
Apostolopoulos, G., Peris, V., Saha, D.: Transport layer security: how much does it really cost? In: INFOCOM: The Conference on Computer Communications, Joint Conference of the IEEE Computer and Communications Societies (1999)
Barrass, T., et al.: Unlucky for some – the thirteen core use cases of HEP metadata. Preprint GLAS-PPE/2005-03, University of Glasgow (2005)
Baru, C.K., Moore, R.W., Rajasekar, A., Wan, M.: The SDSC storage resource broker. In: CASCON, p. 5 (1998)
Baud, J.-P., Casey, J., Lemaitre, S., Nicholson, C.: Performance analysis of a file catalog for the LHC computing Grid. In: Proceedings of High Performance Distributed Computing 14, 2005
Beltran, V., Guitarat, J., Carrera, D., Torres, J., Ayaguade, E., Labarta, J.: Performance impact of using ssl on dynamic web applications. In: Jornadas de Pralelismo (2004)
Blumenfeld, B., et al.: FroNtier: high performance database access using standard web components in a scalable multi-tier architecture. In: Computing in High Energy and Nuclear Physics (2004)
Buncic, P., Peters, A.J., Saiz, P.: The AliEn system, status and perspectives. In: Computing in High Energy and Nuclear Physics (CHEP) (2003)
Deelman, E., Singh, G., Atkinson, M.P., Chervenak, A., Hong, N.P.C., Kesselman, C., Patil, S., Pearlman, L., Su, M.-H.: Grid-based metadata services. In: 16th International Conference on Scientific and Statistical Database Management (SSDBM’04) (2004)
EGEE project: EGEE gLite metadata catalog user’s guide: gLite metadata catalogue interface description. EGEE-TECH-573725 (2005)
Foster, I., et al.: The anatomy of the Grid: enabling scalable virtual organizations. Int. J. High Perform. Comput. Appl. 15, (2001)
Foster, I.T., Kesselman, C., Nick, J.M., Tuecke, S.: Grid services for distributed system integration. IEEE Comput. 35(6), 37–46 (2002)
Gray, J., Helland, P., O’Neil, P., Shasha, D.: The dangers of replication and a solution. In: SIGMOD ’96: Proceedings of the 1996 ACM SIGMOD International Conference on Management of Data, New York, NY, USA, pp. 173–182 (1996)
Harrison, K., et al.: Ganga: a user-Grid interface for ATLAS and LHCb. In: Proceedings of UK e-Science All ’Ands Conference, Nottingham (September 2003)
Knobloch, J.: LHC computing Grid – technical design report. Technical report CERN-LHCC-2005-024, CERN. http://lcg.web.cern.ch/LCG/tdr/ (2005)
LCG 3D project – distributed deployment of databases. http://lcg3d.cern.ch/
Lefebure, V., Andreeva, J.: RefDB: the reference database for CMS Monte Carlo production. In: Computing in High Energy and Nuclear Physics (CHEP) (2003)
Montagnat, J., et al.: Bridging clinical information systems and Grid middleware: a medical data manager. In: HealthGrid (2006)
Rajasekar, A., Wan, M., Moore, R., Schroeder, W.: Data Grid federation. In: PDPTA – special session on new trends in distributed data Access, pp. 541–546 (2004)
Santos, N., Koblitz, B.: Distributed metadata with the AMGA metadata catalog. In: Workshop on Next-Generation Distributed Data Management – HPDC-15 (2006a)
Santos, N., Koblitz, B.: Metadata services on the Grid. Nucl. Instrum. Methods Phys. Res. A 559, 53–56 (2006b)
Singh, G., Bharathi, S., Chervenak, A., Deelman, E., Kesselman, C., Manohar, M., Patil, S., Pearlman, L.: A metadata catalogue service for data intensive applications. In: SC ’03: Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, pp. 33. Washington, DC, USA (2003)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Koblitz, B., Santos, N. & Pose, V. The AMGA Metadata Service. J Grid Computing 6, 61–76 (2008). https://doi.org/10.1007/s10723-007-9084-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10723-007-9084-6