CERN Accelerating science

ATLAS Note
Report number	arXiv:2007.01791 ; ATL-SOFT-PROC-2020-031
Title	Towards an Intelligent Data Delivery Service
Author(s)	Guan, Wen (Department of Physics, University of Wisconsin) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Dimitrov, Gancho (European Laboratory for Particle Physics, CERN) ; Bockelman, Brian Paul (University of Nebraska Lincoln (US)) ; Wenaus, Torre (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Magini, Nicolo (Iowa State University)
Collaboration	ATLAS Collaboration
Publication	2020
Imprint	14 Mar 2020
Number of pages	6
Note	6 pages, 3 figures
In:	EPJ Web Conf. 245 (2020) 04015
In:	24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.04015
DOI	10.1051/epjconf/202024504015
Subject category	Detectors and Experimental Techniques ; Particle Physics - Experiment ; Computing and Computers
Accelerator/Facility, Experiment	CERN LHC ; ATLAS
Abstract	Abstract. The ATLAS Event Streaming Service (ESS) is an approach to preprocess and deliver data for Event Service (ES) that has implemented a fine-grained approach for ATLAS event processing. The ESS allows one to asynchronously deliver only the input events required by ES processing, with the aim to decrease data traffic over WAN and improve overall data processing throughput. A prototype of ESS was developed to deliver streaming events to fine-grained ES jobs. Based on it, an intelligent Data Delivery Service (iDDS) is under development to decouple the “cold format” and the processing format of the data, which also opens the opportunity to include the production systems of other HEP experiments. Here we will at first present the ESS model view and its motivations for iDDS system. Then we will also present the iDDS schema, architecture and the applications of iDDS.
Copyright/License	publication: © The Authors (License: CC-BY-4.0) preprint: (License: arXiv nonexclusive-distrib 1.0)

Corresponding record in: Inspire