Published in:LOFAR Family Meeting 2022, Cologne, Germany, 2022-06-13 - 2022-06-17
Language:
English
Origination:
Footnote:
Diese Datenquelle enthält auch Bestandsnachweise, die nicht zu einem Volltext führen.
Description:
The LOFAR radio telescope produces yearly huge amounts of data comparable to the data produced by other experiments like the ones conducted at the Large Hadron Collider, and has to deal as well with the challenges big data brings in terms of storage, compute and network. Regarding the storage challenge a tiered heterogeneous structure is needed: a smart solution for being able to store the vast amount of data and at the same time allow efficient access and (re)use of it. The data collected by the radio telescope is first sent to a central processor, and distributed later to the three sites in Europe which form the Long Term Archive: SURF in the Netherlands, the Jülich Supercomputing Centre in Germany and PSNC in Poland. The poster describes the Jülich LTA which consists of a distributed storage system based on the dCache software. At the moment the LOFAR LTA contains around 55 petabytes of data. About one third of it is hosted in Jülich, with a yearly growth of 2 petabytes.