• Medientyp: E-Artikel
  • Titel: The IceProd framework: Distributed data processing for the IceCube neutrino observatory
  • Beteiligte: Aartsen, M. G. [VerfasserIn]; Abbasi, R. [VerfasserIn]; Baker, M. [VerfasserIn]; Hebecker, D. [VerfasserIn]; Heereman, D. [VerfasserIn]; Heinen, D. [VerfasserIn]; Helbing, K. [VerfasserIn]; Hellauer, R. [VerfasserIn]; Hickford, S. [VerfasserIn]; Hill, G. C. [VerfasserIn]; Hoffman, K. D. [VerfasserIn]; Hoffmann, R. [VerfasserIn]; Homeier, A. [VerfasserIn]; Barwick, S. W. [VerfasserIn]; Hoshina, K. [VerfasserIn]; Huang, F. [VerfasserIn]; Huelsnitz, W. [VerfasserIn]; Hulth, P. O. [VerfasserIn]; Hultqvist, K. [VerfasserIn]; Hussain, S. [VerfasserIn]; Ishihara, A. [VerfasserIn]; Jacobi, E. [VerfasserIn]; Jacobsen, J. [VerfasserIn]; Jagielski, K. [VerfasserIn]; [...]
  • Erschienen: Elsevier, 2015
  • Erschienen in: Journal of parallel and distributed computing 75, 198 - 211 (2015). doi:10.1016/j.jpdc.2014.08.001
  • Sprache: Englisch
  • DOI: https://doi.org/10.1016/j.jpdc.2014.08.001
  • ISSN: 0743-7315; 1096-0848
  • Entstehung:
  • Anmerkungen: Diese Datenquelle enthält auch Bestandsnachweise, die nicht zu einem Volltext führen.
  • Beschreibung: IceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, identify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computational resources. This paper presents the first detailed description of IceProd, a lightweight distributed management system designed to meet these requirements. It is driven by a central database in order to manage mass production of simulations and analysis of data produced by the IceCube detector. IceProd runs as a separate layer on top of other middleware and can take advantage of a variety of computing resources, including grids and batch systems such as CREAM, HTCondor, and PBS. This is accomplished by a set of dedicated daemons that process job submission in a coordinated fashion through the use of middleware plugins that serve to abstract the details of job submission and job management from the framework.
  • Zugangsstatus: Freier Zugang