|
1.
|
CERNBox: Storage gateway for CERN and beyond
/ Labrador, Hugo Gonzalez (CERN) ; Monte, Gianmaria Del (CERN) ; Ferrer, Javier (CERN) ; Keeble, Oliver (CERN)
The CERN IT Storage group ensures the coherent design, development, operation and evolution of storage and data management services at CERN for all aspects of physics, user and project data and general needs of the Laboratory. CERNBox is one of the services that actively contributes to this objective.CERNBox is a cloud collaboration platform providing storage space (18PB) to users (37K accounts), projects (1.1K) and to LHC experiments (ATLAS, CMS, LHCb, ALICE) and other smaller experiments (33). [...]
2024 - 8 p.
- Published in : EPJ Web Conf. 295 (2024) 01012
Fulltext: PDF;
In : 26th International Conference on Computing in High Energy & Nuclear Physics, Norfolk, Virginia, Us, 8 - 12 May 2023, pp.01012
|
|
|
2.
|
|
|
3.
|
LHC Data Storage: Preparing for the Challenges of Run-3
/ Arsuaga-Rios, Maria (CERN) ; Bahyl, Vladimír (CERN) ; Batalha, Manuel (CERN) ; Caffy, Cédric (CERN) ; Cano, Eric (CERN) ; Capitoni, Niccolo (CERN) ; Contescu, Cristian (CERN) ; Davis, Michael (CERN) ; Alvarez, David Fernandez (CERN) ; Guenther, Jaroslav (CERN) et al.
The CERN IT Storage Group ensures the symbiotic development and operations of storage and data transfer services for all CERN physics data, in particular the data generated by the four LHC experiments (ALICE, ATLAS, CMS and LHCb).In order to accomplish the objectives of the next run of the LHC (Run-3), the Storage Group has undertaken a thorough analysis of the experiments’ requirements, matching them to the appropriate storage and data transfer solutions, and undergoing a rigorous programme of testing to identify and solve any issues before the start of Run-3.In this paper, we present the main challenges presented by each of the four LHC experiments. We describe their workflows, in particular how they communicate with and use the key components provided by the Storage Group: the EOS disk storage system; its archival back-end, the CERN Tape Archive (CTA); and the File Transfer Service (FTS). [...]
2021 - 10 p.
- Published in : EPJ Web Conf. 251 (2021) 02023
Fulltext: PDF;
In : 25th International Conference on Computing in High-Energy and Nuclear Physics (CHEP), Online, Online, 17 - 21 May 2021, pp.02023
|
|
|
4.
|
|
|
5.
|
CERN Tape Archive: a distributed, reliable and scalable scheduling system
/ Cano, Eric (CERN) ; Bahyl, Vladimír (CERN) ; Caffy, Cédric (CERN) ; Cancio, Germán (CERN) ; Davis, Michael (CERN) ; Keeble, Oliver (CERN) ; Kotlyar, Viktor (Kurchatov Inst., Moscow) ; Leduc, Julien (CERN) ; Murray, Steven (CERN)
The CERN Tape Archive (CTA) provides a tape backend to disk systems and, in conjunction with EOS, is managing the data of the LHC experiments at CERN.Magnetic tape storage offers the lowest cost per unit volume today, followed by hard disks and flash. In addition, current tape drives deliver a solid bandwidth (typically 360MB/s per device), but at the cost of high latencies, both for mounting a tape in the drive and for positioning when accessing non-adjacent files. [...]
2021 - 10 p.
- Published in : EPJ Web Conf. 251 (2021) 02037
Fulltext: PDF;
In : 25th International Conference on Computing in High-Energy and Nuclear Physics (CHEP), Online, Online, 17 - 21 May 2021, pp.02037
|
|
|
6.
|
FTS improvements for LHC Run-3 and beyond
/ Karavakis, Edward (CERN) ; Manzi, Andrea (CERN) ; Rios, Maria Arsuaga (CERN) ; Keeble, Oliver (CERN) ; Cabot, Carles Garcia (CERN) ; Simon, Michal (CERN) ; Patrascoiu, Mihai (CERN) ; Angelogiannopoulos, Aris (CERN)
The File Transfer Service (FTS) developed at CERN and in production since 2014, has become a fundamental component for the LHC experiments and is tightly integrated with experiment frameworks. Starting from the beginning of 2018 with the participation to the European Commission funded project eXtreme Data Cloud (XDC) and the activities carried out in the context of the WLCG DOMA TPC and QoS working groups, a series of new developments and improvements have been planned and performed taking also into account the requirements from the experiments in preparation for the LHC Run-3. [...]
2020 - 8 p.
- Published in : EPJ Web Conf. 245 (2020) 04016
Fulltext from publisher: PDF;
In : 24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.04016
|
|
|
7.
|
The eXtreme-DataCloud project solutions for data management services in distributed e-infrastructures
/ Cesini, Daniele (INFN, Bologna) ; Donvito, Giacinto (INFN, Bari) ; Costantini, Alessandro (INFN, Bologna) ; Aguilar Gomez, Fernando (Cantabria Inst. of Phys.) ; Duma, Doina Cristina (INFN, Bologna) ; Fuhrmann, Patrick (DESY) ; Dutka, Lukasz (AGH-UST, Cracow) ; Viljolen, Matthew (EGI Foundation, Amsterdam) ; Battaglia, Serena (ECRIN, Paris) ; Poireau, Vincent (Annecy, LAPP) et al.
The eXtreme DataCloud (XDC) project is aimed at developing data management services capable to cope with very large data resources allowing the future e-infrastructures to address the needs of the next generation extreme scale scientific experiments. Started in November 2017, XDC is combining the expertise of 8 large European research organisations. [...]
2020 - 6 p.
- Published in : EPJ Web Conf. 245 (2020) 04010
Fulltext from publisher: PDF;
In : 24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.04010
|
|
|
8.
|
The Dynafed data federator as a grid site storage element
/ Ebert, Marcus (Victoria U.) ; Berghaus, Frank (Victoria U.) ; Casteels, Kevin (Victoria U.) ; Driemel, Colson (Victoria U.) ; Keeble, Oliver (CERN) ; Leavett-Brown, Colin (Victoria U.) ; Galindo, Fernando Fernandez (TRIUMF) ; Furano, Fabrizio (CERN) ; Paterson, Michael (Victoria U.) ; Seuster, Rolf (Victoria U.) et al.
The Dynafed data federator is designed to present a dynamic and unified view of a distributed file repository. We describe our use of Dynafed to construct a production-ready WLCG storage element (SE) using existing grid storage endpoints as well as object storage. [...]
2020 - 7 p.
- Published in : EPJ Web Conf. 245 (2020) 04003
Fulltext from publisher: PDF;
In : 24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.04003
|
|
|
9.
|
The NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTS
/ Busse-Grawitz, Coralie ; Martelli, Edoardo ; Lassnig, Mario ; Manzi, Andrea ; Keeble, Oliver ; Cass, Tony
We present NOTED, a project to better exploit WAN bandwidth for Rucio and FTS data transfers. We describe the developed software tool-box and a successful demonstration of automated load-balancing in the production network. [...]
2020 - 7 p.
- Published in : EPJ Web Conf. 245 (2020) 07022
Fulltext: PDF;
In : 24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.07022
|
|
|
10.
|
|