Результаты исследований: Научные публикации в периодических изданиях › статья по материалам конференции › Рецензирование
Global heterogeneous resource harvesting : The next-generation PanDA Pilot for ATLAS. / Anisenkov, A.; Drizhuk, D.; Guan, W. и др.
в: Journal of Physics: Conference Series, Том 1085, № 3, 032031, 18.10.2018.Результаты исследований: Научные публикации в периодических изданиях › статья по материалам конференции › Рецензирование
}
TY - JOUR
T1 - Global heterogeneous resource harvesting
T2 - 18th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, ACAT 2017
AU - Anisenkov, A.
AU - Drizhuk, D.
AU - Guan, W.
AU - Lassnig, M.
AU - Nilsson, P.
AU - Oleynik, D.
N1 - Publisher Copyright: © 2018 Institute of Physics Publishing. All rights reserved.
PY - 2018/10/18
Y1 - 2018/10/18
N2 - The Production and Distributed Analysis system (PanDA), used for workload management in the ATLAS Experiment at the LHC for over a decade, has in recent years expanded its reach to diverse new resource types such as HPCs, and innovative new workflows such as the Event Service. PanDA meets the heterogeneous resources it harvests in the PanDA Pilot, which has embarked on a next-generation reengineering to efficiently integrate and exploit the new platforms and workflows. The new modular architecture is the product of a year of design and prototyping in conjunction with the design of a completely new component, Harvester, that will mediate a richer flow of control and information between Pilot and PanDA. Harvester will enable more intelligent and dynamic matching between processing tasks and resources, with an initial focus on HPCs, simplifying the operator and user view of a PanDA site but internally leveraging deep information gathering on the resource to accrue detailed knowledge of a site's capabilities and dynamic state to inform the matchmaking. This paper will give an overview of the new Pilot architecture, how it will be used in and beyond ATLAS, its relation to Harvester, and the work ahead.
AB - The Production and Distributed Analysis system (PanDA), used for workload management in the ATLAS Experiment at the LHC for over a decade, has in recent years expanded its reach to diverse new resource types such as HPCs, and innovative new workflows such as the Event Service. PanDA meets the heterogeneous resources it harvests in the PanDA Pilot, which has embarked on a next-generation reengineering to efficiently integrate and exploit the new platforms and workflows. The new modular architecture is the product of a year of design and prototyping in conjunction with the design of a completely new component, Harvester, that will mediate a richer flow of control and information between Pilot and PanDA. Harvester will enable more intelligent and dynamic matching between processing tasks and resources, with an initial focus on HPCs, simplifying the operator and user view of a PanDA site but internally leveraging deep information gathering on the resource to accrue detailed knowledge of a site's capabilities and dynamic state to inform the matchmaking. This paper will give an overview of the new Pilot architecture, how it will be used in and beyond ATLAS, its relation to Harvester, and the work ahead.
UR - http://www.scopus.com/inward/record.url?scp=85055671752&partnerID=8YFLogxK
U2 - 10.1088/1742-6596/1085/3/032031
DO - 10.1088/1742-6596/1085/3/032031
M3 - Conference article
AN - SCOPUS:85055671752
VL - 1085
JO - Journal of Physics: Conference Series
JF - Journal of Physics: Conference Series
SN - 1742-6588
IS - 3
M1 - 032031
Y2 - 21 August 2017 through 25 August 2017
ER -
ID: 17211571