1.
|
Fine-Grained Processing Towards HL-LHC Computing in ATLAS
/ Benjamin, Doug (Duke U.) ; Calafiura, Paolo (LBNL, Berkeley) ; Childers, Taylor (Argonne) ; De, Kaushik (Texas U., Arlington) ; Di Girolamo, Alessandro (CERN) ; Fullana, Esteban (Valencia U.) ; Guan, Wen (Wisconsin U., Madison) ; Maeno, Tadashi (Brookhaven Natl. Lab.) ; Magini, Nicolo (U. Genoa (main)) ; Nilsson, Paul (Brookhaven Natl. Lab.) et al.
/ATLAS
During LHC's Run-2 ATLAS has been developing and evaluating new fine-grained approaches to workflows and dataflows able to better utilize computing resources in terms of storage, processing and networks. The compute-limited physics of ATLAS has driven the collaboration to aggressively harvest opportunistic cycles from what are often transiently available resources, including HPCs, clouds, volunteer computing, and grid resources in transitional states. [...]
2018 - 1 p.
- Published in : 10.1109/eScience.2018.00083
In : 14th eScience IEEE International Conference, Amsterdam, Netherlands, 29 Oct - 1 Nov 2018, pp.338
|
|
2.
|
Fine-grained processing towards HL-LHC computing in ATLAS
/ ATLAS Collaboration
During LHC's Run-2 ATLAS has been developing and evaluating new fine-grained approaches to workflows and dataflows able to better utilize computing resources in terms of storage, processing and networks. The compute-limited physics of ATLAS has driven the collaboration to aggressively harvest opportunistic cycles from what are often transiently available resources, including HPCs, clouds, volunteer computing, and grid resources in transitional states. [...]
ATL-SOFT-SLIDE-2018-981.-
Geneva : CERN, 2018 - 13 p.
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 14th eScience IEEE International Conference, Amsterdam, Netherlands, 29 Oct - 1 Nov 2018
|
|
3.
|
Metadata for fine-grained processing at ATLAS
/ Cranshaw, Jack (Argonne National Laboratory) ; van Gemmeren, Peter (Argonne National Laboratory) ; Malon, David (Argonne National Laboratory)
/ATLAS Collaboration
High energy physics experiments are implementing highly parallel solutions for event processing on resources that support concurrency at multiple levels. These range from the inherent large-scale parallelism of HPC resources to the multiprocessing and multithreading needed for effective use of multi-core and GPU-augmented nodes. [...]
ATL-SOFT-SLIDE-2016-658.-
Geneva : CERN, 2016 - 1 p.
Fulltext: FineGrainedMetadataSummary - PDF; ATL-SOFT-SLIDE-2016-658 - PDF; External link: Original Communication (restricted to ATLAS)
|
|
4.
|
Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
/ Benjamin, Douglas (Duke University, Department of Physics) ; Caballero, Jose (Brookhaven National Laboratory (BNL)) ; Ernst, Michael (Brookhaven National Laboratory (BNL)) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Hover, John (Brookhaven National Laboratory (BNL)) ; Lesny, David (University of Illinois at Urbana-Champaign) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) et al.
Continued growth in public cloud and HPC resources is on track to overcome the dedicated resources available for ATLAS on the WLCG. Example of such platforms are Amazon AWS EC2 Spot Instances, Edison Cray XC30 supercomputer, backfill at the Tier-2 and Tier-3 sites, opportunistic resources at the Open Science Grid, and ATLAS High Level Trigger farm between the data taking periods. [...]
ATL-SOFT-SLIDE-2016-012.-
Geneva : CERN, 2016 - 1 p.
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 17th INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH, Valparaíso, Valparaíso, Chile, 18 - 22 Jan 2016
|
|
5.
|
|
|
Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
/ Benjamin, Douglas (Duke University, Department of Physics) ; Caballero, Jose (Brookhaven National Laboratory (BNL)) ; Ernst, Michael (Brookhaven National Laboratory (BNL)) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Hover, John (Brookhaven National Laboratory (BNL)) ; Lesny, David (University of Illinois at Urbana-Champaign) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) et al.
Continued growth in public cloud and HPC resources is on track to exceed the dedicated resources available for ATLAS on the WLCG. [...]
ATL-SOFT-PROC-2016-001.
-
2016. - 5 p.
Original Communication (restricted to ATLAS) - Full text - Fulltext
|
|
6.
|
|
Towards an Event Streaming Service for ATLAS data processing
/ Magini, Nicolo (Iowa State U. (main) ; INFN, Genoa) ; Di Girolamo, Alessandro (CERN) ; Guan, Wen (U. Wisconsin, Madison (main)) ; Wenaus, Torre (Brookhaven Natl. Lab.) ; Tsulaia, Vakhtang (LBNL, Berkeley) ; Lassnig, Mario (CERN) ; Walker, Rodney (LMU Munich (main)) ; Maeno, Tadashi (Brookhaven Natl. Lab.) ; Nilsson, Paul (Brookhaven Natl. Lab.) ; Brino, Alex (U. Udine (main))
The ATLAS experiment at the LHC is gradually transitioning from the traditional file-based processing model to dynamic workflow management at the event level with the ATLAS Event Service (AES). [...]
ATL-SOFT-PROC-2018-050.
-
2019. - 6 p.
Original Communication (restricted to ATLAS) - ATLAS Note - Fulltext from publisher
|
|
7.
|
|
8.
|
Raythena: a vertically integrated scheduler for ATLAS applications on heterogeneous distributed resources
/ Muskinja, Miha (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Calafiura, Paolo (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Leggett, Charles (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Shapoval, Illya (Lawrence Berkeley National Laboratory and University of California, Berkeley)
/ATLAS Collaboration
The ATLAS experiment has successfully integrated High-Performance Computing (HPC) resources in its production system. Unlike the current generation of HPC systems, and the LHC computing grid, the next generation of supercomputers is expected to be extremely heterogeneous in nature: different systems will have radically different architectures, and most of them will provide partitions optimized for different kinds of workloads. [...]
ATL-SOFT-SLIDE-2019-812.-
Geneva : CERN, 2019
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
|
|
9.
|
Running ATLAS workloads within massively parallel distributed applications using Athena Multi-Process framework (AthenaMP)
/ Calafiura, Paolo (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Leggett, Charles (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Seuster, Rolf (TRIUMF) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory)
AthenaMP is a multi-process version of the ATLAS reconstruction and data analysis framework Athena. By leveraging Linux fork and copy-on-write, it allows the sharing of memory pages between event processors running on the same compute node with little to no change in the application code. [...]
ATL-SOFT-SLIDE-2015-099.-
Geneva : CERN, 2015 - 13 p.
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa, Japan, 13 - 17 Apr 2015
|
|
10.
|
|