Duwe, Kira
[Author];
Lüttgau, Jakob
[Author];
Mania, Georgiana
[Author];
Squar, Jannek
[Author];
Fuchs, Anna
[Author];
Kuhn, Michael
[Author];
Betke, Eugen
[Author];
Ludwig, Thomas
[Author]
State of the Art and Future Trends in Data Reduction for High-Performance Computing
You can manage bookmarks using lists, please log in to your user account for this.
Media type:
E-Article
Title:
State of the Art and Future Trends in Data Reduction for High-Performance Computing
Contributor:
Duwe, Kira
[Author];
Lüttgau, Jakob
[Author];
Mania, Georgiana
[Author];
Squar, Jannek
[Author];
Fuchs, Anna
[Author];
Kuhn, Michael
[Author];
Betke, Eugen
[Author];
Ludwig, Thomas
[Author]
imprint:
South Ural State University, 2020
Published in:Supercomputing frontiers and innovations 7(1), 4 - 36 (2020). doi:10.14529/jsfi200101
Footnote:
Diese Datenquelle enthält auch Bestandsnachweise, die nicht zu einem Volltext führen.
Description:
Research into data reduction techniques has gained popularity in recent years as storage capacity and performance become a growing concern. This survey paper provides an overview of leveraging points found in high-performance computing (HPC) systems and suitable mechanisms to reduce data volumes. We present the underlying theories and their application throughout the HPC stack and also discuss related hardware acceleration and reduction approaches. After introducing relevant use-cases, an overview of modern lossless and lossy compression algorithms and their respective usage at the application and file system layer is given. In anticipation of their increasing relevance for adaptive and in situ approaches, dimensionality reduction techniques are summarized with a focus on non-linear feature extraction. Adaptive approaches and in situ compression algorithms and frameworks follow. The key stages and new opportunities to deduplication are covered next. An unconventional but promising method is recomputation, which is proposed at last. We conclude the survey with an outlook on future developments.