Global heterogeneous resource harvesting: The next-generation PanDA Pilot for ATLAS

A. Anisenkov, D. Drizhuk, W. Guan, M. Lassnig, P. Nilsson, D. Oleynik

Результат исследования: Научные публикации в периодических изданияхстатья по материалам конференциирецензирование

1 Цитирования (Scopus)


The Production and Distributed Analysis system (PanDA), used for workload management in the ATLAS Experiment at the LHC for over a decade, has in recent years expanded its reach to diverse new resource types such as HPCs, and innovative new workflows such as the Event Service. PanDA meets the heterogeneous resources it harvests in the PanDA Pilot, which has embarked on a next-generation reengineering to efficiently integrate and exploit the new platforms and workflows. The new modular architecture is the product of a year of design and prototyping in conjunction with the design of a completely new component, Harvester, that will mediate a richer flow of control and information between Pilot and PanDA. Harvester will enable more intelligent and dynamic matching between processing tasks and resources, with an initial focus on HPCs, simplifying the operator and user view of a PanDA site but internally leveraging deep information gathering on the resource to accrue detailed knowledge of a site's capabilities and dynamic state to inform the matchmaking. This paper will give an overview of the new Pilot architecture, how it will be used in and beyond ATLAS, its relation to Harvester, and the work ahead.

Язык оригиналаанглийский
Номер статьи032031
Число страниц5
ЖурналJournal of Physics: Conference Series
Номер выпуска3
СостояниеОпубликовано - 18 окт. 2018
Событие18th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, ACAT 2017 - Seattle, Соединенные Штаты Америки
Продолжительность: 21 авг. 201725 авг. 2017


Подробные сведения о темах исследования «Global heterogeneous resource harvesting: The next-generation PanDA Pilot for ATLAS». Вместе они формируют уникальный семантический отпечаток (fingerprint).