Nothing Special   »   [go: up one dir, main page]
Skip to main content
SpringerLink
Log in

Distributed Analysis in CMS

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

The CMS experiment expects to manage several Pbytes of data each year during the LHC programme, distributing them over many computing sites around the world and enabling data access at those centers for analysis. CMS has identified the distributed sites as the primary location for physics analysis to support a wide community with thousands potential users. This represents an unprecedented experimental challenge in terms of the scale of distributed computing resources and number of user. An overview of the computing architecture, the software tools and the distributed infrastructure is reported. Summaries of the experience in establishing efficient and scalable operations to get prepared for CMS distributed analysis are presented, followed by the user experience in their current analysis activities.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. CMS Collaboration, Adolphi, R., et al.: The CMS experiment at the CERN LHC, JINST, 0803, S08004 (2008)

  2. CMS Collaboration, CMS: The computing project. Technical design report, CERN-LHCC-2005-023, ISBN 92-9083-252-5 (2005)

  3. Grandi, C., Stickland, D., Taylor, L., et al.: The CMS computing model, CERN-LHCC-2004-035/G-083 (2004)

  4. Flix, J., Sciabà, A., et al.: The commissioning of CMS sites: improving the site reliability. In: Proceedings of 17th International Conference On Computing in High Energy Physics and Nuclear Physics. J. Phys.: Conf. Ser., in press (2009)

  5. Flix, J., Sciabà, A., et al.: The commissioning of CMS computing centres in the worldwide LHC computing Grid. In: Conference Record N29-5 Session Grid Computing, Nuclear Science Symposium IEEE, Dresden (2008)

  6. Afaq, A., et al.: The CMS dataset bookkeeping service. J. Phys. Conf. Ser. 119, 072001 (2008)

    Article  Google Scholar 

  7. Blumenfeld, B., Dykstra, D., Lueking, L., Wicklund, E.: CMS conditions data access using FroNTier. J. Phys. Conf. Ser. 119, 072007 (2008)

    Article  Google Scholar 

  8. Egeland, R., et al.: Data transfer infrastructure for CMS data taking. In: Proceedings of Science, PoS(ACAT08)033 (2008)

  9. Tuura, L., et al.: Scaling CMS data transfer system for LHC start-up. J. Phys. Conf. Ser. 119, 072030 (2008)

    Article  Google Scholar 

  10. CMS collaboration: CMS computing, software and analysis challenge in 2006 (CSA06) Summary. CERN/LHCC 2007-010 (2007)

  11. DeFilippis, N., et al.: The CMS analysis chain in a distributed environment. Nucl. Instrum. Methods A559, 38–42 (2006)

    Google Scholar 

  12. Fanfani, A., et al.: Distributed computing Grid experiences in CMS. IEEE Trans. Nucl. Sci. 52, 884–890 (2005)

    Article  Google Scholar 

  13. Bonacorsi, D., Bauerdick, L., on behalf of the CMS Collaboration: CMS results in the combined computing readiness challenge (CCRC08). Nucl. Phys., B Proc. Suppl. 197, 99–108 (2009)

    Article  Google Scholar 

  14. Evans, D., et al.: The CMS Monte Carlo production system: development and design. Nucl. Phys. Proc. Suppl. 177–178, 285–286 (2008)

    Article  Google Scholar 

  15. Codispoti, G., et al.: CRAB: a CMS application for distributed analysis. IEEE Trans. Nucl. Sci. 56, 2850–2858 (2009)

    Article  Google Scholar 

  16. Codispoti, G., et al.: Use of the gLite-WMS in CMS for production and analysis. In: Proceedings of 17th International Conference on Computing in High Energy Physics and Nuclear Physics. J. Phys. Conf. Ser., in press (2009)

  17. Andreetto, P., et al.: The gLite workload management system. J. Phys. Conf. Ser. 119, 062007 (2008)

    Article  Google Scholar 

  18. Pordes, R., et al.: The open science Grid. J. Phys. Conf. Ser. 78, 012057 (2007). http://www.opensciencegrid.org/

    Article  Google Scholar 

  19. Sfiligoi, I., et al.: glideinWMS—a generic pilot-based workload management system. J. Phys. Conf. Ser. 119, 062044 (2008)

    Article  Google Scholar 

  20. Ellertet, M., et al.: Advanced resource connector middleware for lightweight computational Grids. Future Gener. Comput. Syst. 23, 219–240 (2007). http://www.nordugrid.org/arc/

    Article  Google Scholar 

  21. Andreeva, J., et al.: Dashboard for the LHC experiments. J. Phys. Conf. Ser. 119, 062008 (2008)

    Article  Google Scholar 

  22. LCG: LCG Computing Grid Technical Design Report, LCG-TDR-001 CERN/LHCC 2005-024. http://lcg.web.cern.ch/lcg/ (2005)

  23. Bonacorsi, D., Egeland, R., Metson, S.: SiteDB: marshalling the people and resources available to CMS. In: Poster at the International Conference on Computing in High Energy and Nuclear Physics (CHEP 2009), Prague, 21–27 March 2009

  24. Magini, N., et al.: The CMS data transfer test environment in preparation for LHC data taking. In: Conference Record N67-2 Session Applied Computing Techniques, Nuclear Science Symposium IEEE, Dresden (2008)

  25. Bayatian, G.L., et al.: CMS technical design report volume II: physics performance. J. Phys., G Nucl. Part. Phys. 34, 995–1579 (2007)

    Article  Google Scholar 

  26. ALICE Collaboration: ALICE technical design report of the computing, CERN-LHCC-2005-018, ISBN 92-9083-247-9 (2005)

  27. ATLAS Collaboration: ATLAS computing: technical design report, CERN-LHCC-2005-022, ISBN 92-9083-250-9 (2005)

  28. LHCb Collaboration: LHCb TDR computing technical design report, CERN-LHCC-2005-019 (2005)

  29. Laure, E., Fisher, S.M., Frohner, A., Grandi, C., Kunszt, P., et al.: Programming the Grid with gLite. Comput. Methods Sci. Technol. 12(1), 33–45 (2006)

    Google Scholar 

  30. Aderholz, M., et al.: Models of networked analysis at regional centres for LHC experiments (MONARC). Phase 2 report, CERN/LCB 2000-001 (2000)

  31. Moscicki, J.T., et al.: Ganga: a tool for computational-task management and easy access to Grid resources. Comput. Phys. Commun. 180(11), 2303–2316 (2009)

    Article  Google Scholar 

  32. Bagnasco, S., et al.: AliEn: ALICE environment on the Grid. Grid J. Phys.: Conf. Series 119(6), 062012 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. INFN and University of Bologna, viale Berti Pichat 6/2, 40127, Bologna, Italy

    Alessandra Fanfani, Daniele Bonacorsi, Giuseppe Codispoti & Claudio Grandi

  2. Fermilab, Batavia, IL, USA

    Anzar Afaq, Lothar Bauerdick, David Dykstra, Dave Evans, Ian Fisk, Yuyi Guo, Chih-Hao Huang, Lee Lueking, Patricia Mcbride, Paul Rossman, Vijay Sekhri, Eric Vaandering & Eric Wicklund

  3. University of Rio De Janeiro UERJ, Rio De Janeiro, Brazil

    Jose Afonso Sanches & Patricia Bittencourt Sampaio

  4. CERN, Geneva, Switzerland

    Julia Andreeva, Marco Calloni, Nicolò Magini, Vincenzo Miccio, Pablo Saiz, Andrea Sciabà & Daniele Spiga

  5. Pisa INFN, Pisa, Italy

    Giusepppe Bagliesi

  6. Trieste INFN, Trieste, Italy

    Stefano Belforte & Carlos Kavka

  7. University of Nebraska, Lincoln, NE, USA

    Ken Bloom

  8. Johns Hopkins University, Baltimore, MD, USA

    Barry Blumenfeld

  9. Rutherford Appleton Laboratory, Didcot, UK

    Chris Brew

  10. INFN-CNAF, Bologna, Italy

    Daniele Cesini, Danilo Dongiovanni, Nicolò Magini & Vincenzo Miccio

  11. Perugia INFN, Perugia, Italy

    Mattia Cinquilli, Hassen Riahi & Aresh Vedaee

  12. Brussel University, Brussel, Belgium

    Jorgen D’Hondt, Joris Maes, Petra Van Mulders & Ilaria Villella

  13. Institute of High Energy Physics, Chinese Academy of Sciences Academia Sinica, Beijing, China

    Liang Dong

  14. INFN and University of Bari, Bari, Italy

    Giacinto Donvito

  15. Helsinki Institute of Physics, Helsinki, Finland

    Erik Edelmann, Kalle Happonen, Jukka Klem, Jesper Koivumäki, Kati Lassila-Perini & Tomas Lindén

  16. University of Minnesota, Twin Cities, MN, USA

    Ricky Egeland

  17. Princeton University, Princeton, NJ, USA

    Peter Elmer & Tony Wildish

  18. University of Northeastern, Boston, MA, USA

    Giulio Eulisse & Lassi Tuura

  19. Padova INFN, Padova, Italy

    Federica Fanzago

  20. Milano Bicocca INFN, Milan, Italy

    Fabio Farina

  21. Paul Scherrer Institut (PSI), Villigen, Switzerland

    Derek Feichtinger

  22. CIEMAT, Madrid, Spain

    Josep Flix & José M. Hernàndez

  23. PIC, Barcelona, Spain

    Josep Flix

  24. Peking University, Peking, China

    Kejing Kang

  25. Brunel University, London, UK

    Edward Karavakis & Akram Khan

  26. DESY, Hamburg, Germany

    Matthias Kasemann & Christoph Wissing

  27. University of Florida, Gainesville, FL, USA

    Bockjoo Kim

  28. RWTH, Aachen, Germany

    Thomas Kress & Peter Kreuzer

  29. Institut de Physique Nucleaire de Lyon, Villeurbanne Cedex, France

    Tibor Kurca

  30. Cornell University, Ithaca, NY, USA

    Valentin Kuznetsov & Daniel Riley

  31. Legnaro INFN, Legnaro, Italy

    Stefano Lacaprara

  32. University of California San Diego, La Jolla, CA, USA

    James Letts, Sanjay Padhi, Haifeng Pi & Frank Würthwein

  33. University of Linz, Linz, Austria

    Gerhild Maier

  34. Bristol University, Bristol, UK

    Simon Metson

  35. Ecole Polytechnique, Paris, France

    Andrea Sartirana

  36. University of Gent, Gent, Belgium

    Lukas Vanelderen

Authors
  1. Alessandra Fanfani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anzar Afaq
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jose Afonso Sanches
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Julia Andreeva
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Giusepppe Bagliesi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lothar Bauerdick
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Stefano Belforte
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Patricia Bittencourt Sampaio
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Ken Bloom
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Barry Blumenfeld
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Daniele Bonacorsi
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Chris Brew
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Marco Calloni
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Daniele Cesini
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Mattia Cinquilli
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Giuseppe Codispoti
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Jorgen D’Hondt
    View author publications

    You can also search for this author in PubMed Google Scholar

  18. Liang Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  19. Danilo Dongiovanni
    View author publications

    You can also search for this author in PubMed Google Scholar

  20. Giacinto Donvito
    View author publications

    You can also search for this author in PubMed Google Scholar

  21. David Dykstra
    View author publications

    You can also search for this author in PubMed Google Scholar

  22. Erik Edelmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  23. Ricky Egeland
    View author publications

    You can also search for this author in PubMed Google Scholar

  24. Peter Elmer
    View author publications

    You can also search for this author in PubMed Google Scholar

  25. Giulio Eulisse
    View author publications

    You can also search for this author in PubMed Google Scholar

  26. Dave Evans
    View author publications

    You can also search for this author in PubMed Google Scholar

  27. Federica Fanzago
    View author publications

    You can also search for this author in PubMed Google Scholar

  28. Fabio Farina
    View author publications

    You can also search for this author in PubMed Google Scholar

  29. Derek Feichtinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  30. Ian Fisk
    View author publications

    You can also search for this author in PubMed Google Scholar

  31. Josep Flix
    View author publications

    You can also search for this author in PubMed Google Scholar

  32. Claudio Grandi
    View author publications

    You can also search for this author in PubMed Google Scholar

  33. Yuyi Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  34. Kalle Happonen
    View author publications

    You can also search for this author in PubMed Google Scholar

  35. José M. Hernàndez
    View author publications

    You can also search for this author in PubMed Google Scholar

  36. Chih-Hao Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  37. Kejing Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  38. Edward Karavakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  39. Matthias Kasemann
    View author publications

    You can also search for this author in PubMed Google Scholar

  40. Carlos Kavka
    View author publications

    You can also search for this author in PubMed Google Scholar

  41. Akram Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  42. Bockjoo Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  43. Jukka Klem
    View author publications

    You can also search for this author in PubMed Google Scholar

  44. Jesper Koivumäki
    View author publications

    You can also search for this author in PubMed Google Scholar

  45. Thomas Kress
    View author publications

    You can also search for this author in PubMed Google Scholar

  46. Peter Kreuzer
    View author publications

    You can also search for this author in PubMed Google Scholar

  47. Tibor Kurca
    View author publications

    You can also search for this author in PubMed Google Scholar

  48. Valentin Kuznetsov
    View author publications

    You can also search for this author in PubMed Google Scholar

  49. Stefano Lacaprara
    View author publications

    You can also search for this author in PubMed Google Scholar

  50. Kati Lassila-Perini
    View author publications

    You can also search for this author in PubMed Google Scholar

  51. James Letts
    View author publications

    You can also search for this author in PubMed Google Scholar

  52. Tomas Lindén
    View author publications

    You can also search for this author in PubMed Google Scholar

  53. Lee Lueking
    View author publications

    You can also search for this author in PubMed Google Scholar

  54. Joris Maes
    View author publications

    You can also search for this author in PubMed Google Scholar

  55. Nicolò Magini
    View author publications

    You can also search for this author in PubMed Google Scholar

  56. Gerhild Maier
    View author publications

    You can also search for this author in PubMed Google Scholar

  57. Patricia Mcbride
    View author publications

    You can also search for this author in PubMed Google Scholar

  58. Simon Metson
    View author publications

    You can also search for this author in PubMed Google Scholar

  59. Vincenzo Miccio
    View author publications

    You can also search for this author in PubMed Google Scholar

  60. Sanjay Padhi
    View author publications

    You can also search for this author in PubMed Google Scholar

  61. Haifeng Pi
    View author publications

    You can also search for this author in PubMed Google Scholar

  62. Hassen Riahi
    View author publications

    You can also search for this author in PubMed Google Scholar

  63. Daniel Riley
    View author publications

    You can also search for this author in PubMed Google Scholar

  64. Paul Rossman
    View author publications

    You can also search for this author in PubMed Google Scholar

  65. Pablo Saiz
    View author publications

    You can also search for this author in PubMed Google Scholar

  66. Andrea Sartirana
    View author publications

    You can also search for this author in PubMed Google Scholar

  67. Andrea Sciabà
    View author publications

    You can also search for this author in PubMed Google Scholar

  68. Vijay Sekhri
    View author publications

    You can also search for this author in PubMed Google Scholar

  69. Daniele Spiga
    View author publications

    You can also search for this author in PubMed Google Scholar

  70. Lassi Tuura
    View author publications

    You can also search for this author in PubMed Google Scholar

  71. Eric Vaandering
    View author publications

    You can also search for this author in PubMed Google Scholar

  72. Lukas Vanelderen
    View author publications

    You can also search for this author in PubMed Google Scholar

  73. Petra Van Mulders
    View author publications

    You can also search for this author in PubMed Google Scholar

  74. Aresh Vedaee
    View author publications

    You can also search for this author in PubMed Google Scholar

  75. Ilaria Villella
    View author publications

    You can also search for this author in PubMed Google Scholar

  76. Eric Wicklund
    View author publications

    You can also search for this author in PubMed Google Scholar

  77. Tony Wildish
    View author publications

    You can also search for this author in PubMed Google Scholar

  78. Christoph Wissing
    View author publications

    You can also search for this author in PubMed Google Scholar

  79. Frank Würthwein
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alessandra Fanfani.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fanfani, A., Afaq, A., Sanches, J.A. et al. Distributed Analysis in CMS. J Grid Computing 8, 159–179 (2010). https://doi.org/10.1007/s10723-010-9152-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-010-9152-1

Keywords

Search

Navigation