The system will be going down for regular maintenance. Please save your work and logout.
What Size Should your Buffers to Disks be?
Language
en
Communication dans un congrès
This item was published in
International Parallel and Distributed Processing Symposium (IPDPS), 2018-05-20, Vancouver. 2018-05-21
IEEE
English Abstract
Burst-Buffers are high throughput, small size intermediate storage systems typically based on SSDs or NVRAM that are designed to be used as a potential buffer between the computing nodes of a supercomputer and its main ...Read more >
Burst-Buffers are high throughput, small size intermediate storage systems typically based on SSDs or NVRAM that are designed to be used as a potential buffer between the computing nodes of a supercomputer and its main storage system consisting of hard drives. Their purpose is to absorb the bursts of I/O that many HPC applications experience (for example for saving checkpoints or data from intermediate results). In this paper, we propose a probabilistic model for evaluating the performance of Burst-Buffers. From a model of application and a data management strategy, we build a Markov chain based model of the system, that allows to quickly answer issues about dimensioning of the system: for a given set of applications, and for a given Burst-Buffer size and bandwidth, how often does the buffer overflow? We also provide extensive simulation results to validate our modeling approach.Read less <
English Keywords
Models
Burst Buffers
I/O
Scheduling
ANR Project
Ordonnancement de données pour le calcul haute-performance - ANR-17-CE25-0004
Origin
Hal imported