| ATLAS Slides | |
| Report number | ATL-SOFT-SLIDE-2023-155 |
| Title | Deployment and Operation of the ATLAS EventIndex for LHC Run 3 |
| Author(s) |
Gallas, Elizabeth (University of Oxford (GB)) ; Alexandrov, Evgeny (Joint Institute for Nuclear Research (RU)) ; Alexandrov, Igor (Joint Institute for Nuclear Research (RU)) ; Barberis, Dario (INFN e Universita Genova (IT)) ; Canali, Luca (CERN) ; Cherepanova, Elizaveta (Nikhef National institute for subatomic physics (NL)) ; Fernandez Casani, Alvaro (Univ. of Valencia and CSIC (ES)) ; Garcia Montoro, Carlos (Univ. of Valencia and CSIC (ES)) ; Gonzalez De La Hoz, Santiago (Univ. of Valencia and CSIC (ES)) ; Iakovlev, Alexander (Joint Institute for Nuclear Research (RU)) ; Prokoshin, Fedor (Joint Institute for Nuclear Research (RU)) ; Salt, Jose (Univ. of Valencia and CSIC (ES)) ; Sanchez Martinez, Francisco Javier (Univ. of Valencia and CSIC (ES)) ; Rybkin, Grigori (Université Paris-Saclay (FR)) ; Villaplana, Miguel (Univ. of Valencia and CSIC (ES)) |
| Corporate author(s) | The ATLAS collaboration |
| Submitted to | 26th International Conference on Computing in High Energy & Nuclear Physics, Norfolk, Virginia, Us, 8 - 12 May 2023 |
| Submitted by | dario.barberis@cern.ch on 04 May 2023 |
| Subject category | Particle Physics - Experiment |
| Accelerator/Facility, Experiment | CERN LHC ; ATLAS |
| Free keywords | EventIndex ; Hadoop ; HBase |
| Abstract | The ATLAS EventIndex is the global catalogue of all ATLAS real and simulated events. During the LHC long shutdown between Run 2 (2015-2018) and Run 3 (2022-2025) all its components were substantially revised and a new system was deployed for the start of Run 3 in Spring 2022. The new core storage system, based on HBase tables with a Phoenix interface rather than HDFS MapFiles, allows much faster data ingestion rates and scales much better than the old one to the data rates expected for the end of Run 3 and beyond. All user interfaces were also revised and a new command-line interface and web services were also deployed. The new system was initially populated with all existing data relative to Run 1 and Run 2 datasets, and then put online to receive Run 3 data in real time. After extensive testing, the old system, which ran in parallel to the new one for a few months, was finally switched off in October 2022. This paper describes the new system, the move of all existing data from the old to the new storage schemas and the operational experience gathered so far. |
Record created 2023-05-04, last modified 2024-10-23