CERN Accelerating science

ATLAS Slides
Report number	ATL-SOFT-SLIDE-2019-772
Title	Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana
Author(s)	Beermann, Thomas Alfons (Bergische Universitaet Wuppertal) ; Alekseev, Aleksandr (M.V.Lomonosov Moscow State University) ; Barberis, Dario (INFN Genova and Universita' di Genova, Dipartimento di Fisica) ; Crépé-Renaudin, Sabine (Laboratoire de Physique Subatomique et de Cosmologie de Grenoble (LPSC)) ; Elmsheuser, Johannes (Brookhaven National Laboratory (BNL)) ; Glushkov, Ivan (The University of Texas at Arlington) ; Svatos, Michal (Institute of Physics of the Czech Academy of Sciences) ; Vartapetian, Armen (The University of Texas at Arlington) ; Vokac, Petr (Czech Technical University in Prague) ; Wolters, Helmut (Laboratorio de Instrumenta\c{c}\~ao e Fisica Experimental de Particulas - LIP, Lisbon)
Corporate author(s)	The ATLAS collaboration
Collaboration	ATLAS Collaboration
Submitted to	24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019
Submitted by	thomas.beermann@cern.ch on 16 Oct 2019
Subject category	Particle Physics - Experiment
Accelerator/Facility, Experiment	CERN LHC ; ATLAS
Abstract	For the last 10 years, the ATLAS Distributed Computing project has based its monitoring infrastructure on a set of custom designed dashboards provided by CERN-IT. This system functioned very well for LHC Runs 1 and 2, but its maintenance has progressively become more difficult and the conditions for Run 3, starting in 2021, will be even more demanding; hence a more standard code base and more automatic operations are needed. A new infrastructure has been provided by the CERN-IT Monit group, based on InfluxDB as the data store and Grafana as the display environment. ATLAS has adapted and further developed its monitoring tools to use this infrastructure for data and workflow management monitoring and accounting dashboards, expanding the range of previous possibilities with the aim of achieving a single, simpler, environment for all monitoring applications. This presentation will describe the tools used, the data flows for monitoring and accounting, the problems encountered and the solutions found.