Early Evaluation of the “Infinite Memory Engine” Burst Buffer Solution
W. Schenck, S. El Sayed, M. Foszczynski, W. Homberg, D. Pleiter, in: M. Taufer, B. Mohr, J.M. Kunkel (Eds.), High Performance Computing, Springer International Publishing, Cham, 2016, pp. 604–615.
Download
Es wurde kein Volltext hochgeladen. Nur Publikationsnachweis!
Buchbeitrag
| Veröffentlicht
| Englisch
Autor*in
Schenck, Wolfram
;
El Sayed, Salem;
Foszczynski, Maciej;
Homberg, Wilhelm;
Pleiter, Dirk


Herausgeber*in
Taufer, Michela;
Mohr, Bernd;
Kunkel, Julian M.
Abstract
Hierarchical storage architectures are required to meet both, capacity and bandwidth requirements for future high-end storage architectures. In this paper we present the results of an evaluation of an emerging technology, DataDirect Networks’ (DDN) Infinite Memory Engine (IME). IME allows to realize a fast buffer in front of a large capacity storage system. We collected benchmarking data with IOR and with the HPC application NEST. The IOR bandwidth results show how well network bandwidth towards such fast buffer can be exploited compared to the external storage system. The NEST benchmarks clearly demonstrate that IME can reduce I/O-induced load imbalance between MPI ranks to a minimum while speeding up I/O as a whole by a considerable factor.
Erscheinungsjahr
Buchtitel
High Performance Computing
Band
vol 9945
Seite
604-615
Konferenz
ISC High Performance 2016 international workshops, Exacomm, E-MuCoCoS, HPC-IODC, IXPUG, IWOPH, P 3MA, VHPC, WOPSSS
Konferenzort
Frankfurt
Konferenzdatum
2016-06-19 – 2016-06-23
ISBN
ISSN
eISSN
FH-PUB-ID
Zitieren
Schenck, Wolfram ; El Sayed, Salem ; Foszczynski, Maciej ; Homberg, Wilhelm ; Pleiter, Dirk: Early Evaluation of the “Infinite Memory Engine” Burst Buffer Solution. In: Taufer, M. ; Mohr, B. ; Kunkel, J. M. (Hrsg.): High Performance Computing, Lecture Notes in Computer Science. Bd. vol 9945. Cham : Springer International Publishing, 2016, S. 604–615
Schenck W, El Sayed S, Foszczynski M, Homberg W, Pleiter D. Early Evaluation of the “Infinite Memory Engine” Burst Buffer Solution. In: Taufer M, Mohr B, Kunkel JM, eds. High Performance Computing. Vol vol 9945. Lecture Notes in Computer Science. Cham: Springer International Publishing; 2016:604-615. doi:10.1007/978-3-319-46079-6_41
Schenck, W., El Sayed, S., Foszczynski, M., Homberg, W., & Pleiter, D. (2016). Early Evaluation of the “Infinite Memory Engine” Burst Buffer Solution. In M. Taufer, B. Mohr, & J. M. Kunkel (Eds.), High Performance Computing (Vol. vol 9945, pp. 604–615). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-46079-6_41
@inbook{Schenck_El Sayed_Foszczynski_Homberg_Pleiter_2016, place={Cham}, series={Lecture Notes in Computer Science}, title={Early Evaluation of the “Infinite Memory Engine” Burst Buffer Solution}, volume={vol 9945}, DOI={10.1007/978-3-319-46079-6_41}, booktitle={High Performance Computing}, publisher={Springer International Publishing}, author={Schenck, Wolfram and El Sayed, Salem and Foszczynski, Maciej and Homberg, Wilhelm and Pleiter, Dirk}, editor={Taufer, Michela and Mohr, Bernd and Kunkel, Julian M.Editors}, year={2016}, pages={604–615}, collection={Lecture Notes in Computer Science} }
Schenck, Wolfram, Salem El Sayed, Maciej Foszczynski, Wilhelm Homberg, and Dirk Pleiter. “Early Evaluation of the ‘Infinite Memory Engine’ Burst Buffer Solution.” In High Performance Computing, edited by Michela Taufer, Bernd Mohr, and Julian M. Kunkel, vol 9945:604–15. Lecture Notes in Computer Science. Cham: Springer International Publishing, 2016. https://doi.org/10.1007/978-3-319-46079-6_41.
W. Schenck, S. El Sayed, M. Foszczynski, W. Homberg, and D. Pleiter, “Early Evaluation of the ‘Infinite Memory Engine’ Burst Buffer Solution,” in High Performance Computing, vol. vol 9945, M. Taufer, B. Mohr, and J. M. Kunkel, Eds. Cham: Springer International Publishing, 2016, pp. 604–615.
Schenck, Wolfram, et al. “Early Evaluation of the ‘Infinite Memory Engine’ Burst Buffer Solution.” High Performance Computing, edited by Michela Taufer et al., vol. vol 9945, Springer International Publishing, 2016, pp. 604–15, doi:10.1007/978-3-319-46079-6_41.
Link(s) zu Volltext(en)
Access Level
