> Details

Götz, Markus [Author]; Coquelin, Daniel [Author]; Debus, Charlotte [Author]; Krajsek, Kai [Author]; Comito, Claudia [Author]; Knechtges, Philipp [Author]; Hagemeier, Björn [Author]; Tarnawa, Michael [Author]; Hanselmann, Simon [Author]; Siggel, Martin [Author]; Basermann, Achim [Author]; Streit, Achim [Author]

HeAT – a Distributed and GPU-accelerated Tensor Framework for Data Analytics

Reference
management

Bookmarks

Remove from
bookmarks

Share this on Whatsapp

Close

Bookmarks



You can manage bookmarks using lists, please log in to your user account for this.
  • Media type: Text; E-Book; Report
  • Title: HeAT – a Distributed and GPU-accelerated Tensor Framework for Data Analytics
  • Contributor: Götz, Markus [Author]; Coquelin, Daniel [Author]; Debus, Charlotte [Author]; Krajsek, Kai [Author]; Comito, Claudia [Author]; Knechtges, Philipp [Author]; Hagemeier, Björn [Author]; Tarnawa, Michael [Author]; Hanselmann, Simon [Author]; Siggel, Martin [Author]; Basermann, Achim [Author]; Streit, Achim [Author]
  • imprint: KITopen (Karlsruhe Institute of Technologie), 2020-09-10
  • Language: English
  • DOI: https://doi.org/10.5445/IR/1000123473
  • Keywords: NumPy ; Message Passing Interface ; Machine Learning ; Tensor Framework ; Dask ; Data Analysis ; High-performance Computing ; Neural Networks ; PyTorch ; GPU ; DATA processing & computer science ; HeAT
  • Origination:
  • Footnote: Diese Datenquelle enthält auch Bestandsnachweise, die nicht zu einem Volltext führen.
  • Description: In order to cope with the exponential growth in available data, the efficiency of data analysis and machine learning libraries have recently received increased attention. Although corresponding array-based numerical kernels have been significantly improved, most are limited by the resources available on a single computational node. Consequently, kernels must exploit distributed resources, e.g., distributed memory architectures. To this end, we introduce HeAT, an array-based numerical programming framework for large-scale parallel processing with an easy-to-use NumPy-like API. HeAT utilizes PyTorch as a node-local eager execution engine and distributes the workload via MPI on arbitrarily large high-performance computing systems. It provides both low-level array-based computations, as well as assorted higher-level algorithms. With HeAT, it is possible for a NumPy user to take advantage of their available resources, significantly lowering the barrier to distributed data analysis. Compared with applications written in similar frameworks, HeAT achieves speedups of up to two orders of magnitude.
  • Access State: Open Access