• Medientyp: E-Artikel
  • Titel: Jobflow: Computational Workflows Made Simple
  • Beteiligte: Rosen, Andrew S. [VerfasserIn]; Gallant, Max [VerfasserIn]; George, Janine [VerfasserIn]; Riebesell, Janosh [VerfasserIn]; Sahasrabuddhe, Hrushikesh [VerfasserIn]; Shen, Jimmy-Xuan [VerfasserIn]; Wen, Mingjian [VerfasserIn]; Evans, Matthew L. [VerfasserIn]; Petretto, Guido [VerfasserIn]; Waroquiers, David [VerfasserIn]; Rignanese, Gian-Marco [VerfasserIn]; Persson, Kristin A. [VerfasserIn]; Jain, Anubhav [VerfasserIn]; Ganose, Alex M. [VerfasserIn]
  • Erschienen: BAM-Publica - Publikationsserver der Bundesanstalt für Materialforschung und -prüfung (BAM), 2024
  • Sprache: Englisch
  • DOI: https://doi.org/10.21105/joss.05995
  • Entstehung:
  • Anmerkungen: Diese Datenquelle enthält auch Bestandsnachweise, die nicht zu einem Volltext führen.
  • Beschreibung: We present Jobflow, a domain-agnostic Python package for writing computational workflows tailored for high-throughput computing applications. With its simple decorator-based approach, functions and class methods can be transformed into compute jobs that can be stitched together into complex workflows. Jobflow fully supports dynamic workflows where the full acyclic graph of compute jobs is not known until runtime, such as compute jobs that launch other jobs based on the results of previous steps in the workflow. The results of all Jobflow compute jobs can be easily stored in a variety of filesystem- and cloud-based databases without the data storage process being part of the underlying workflow logic itself. Jobflow has been intentionally designed to be fully independent of the choice of workflow manager used to dispatch the calculations on remote computing resources. At the time of writing, Jobflow workflows can be executed either locally or across distributed compute environments via an adapter to the FireWorks package, and Jobflow fully supports the integration of additional workflow execution adapters in the future.
  • Zugangsstatus: Freier Zugang