Running HPC applications on many million cores Cloud (CROSBI ID 648218)
Prilog sa skupa u zborniku | izvorni znanstveni rad | međunarodna recenzija
Podaci o odgovornosti
Tomić, Draško ; Car, Zlatan ; Ogrizović, Dario
engleski
Running HPC applications on many million cores Cloud
Despite the various hardware and software improvements in Cloud architecture, there still exists the huge performance gap between the commodity supercomputers and Cloud when running HPC communication intensive applications. In order to find what is preventing them to better scale on Cloud, we evaluated HPL and NAMD benchmarks on HPE Openstack testbed, and NAMD benchmarks on supercomputer located at Rijeka University Supercomputing Center. Our results revealed two major bottlenecks: the throughput of the interconnect, and Cloud orchestration layer, among other responsible for the management of the communication between Cloud instances. We investigated the influence of jittering, but did not find the significant influence on performance. Our conclusion is that by solely increasing the interconnect throughput, one will not improve the scalability of HPC communication intensive HPC applications in Cloud. This is also backed up with NAMD performed at HP Labs, and with HPL benchmark performed at San Diego Supercomputing Center. We propose two possible scenarios of scalability improvements. One with distributed model of Cloud Orchestration layer ; another with bare metal containers. Efficient load balancing remains the must if we want to see HPC applications scaling over many million Cloud cores. For this, we propose novel SLEM based load balancing strategy.
HPC Cloud, Openstack, HPL, NAMD, Cloud controller
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
Podaci o prilogu
226-231.
2017.
objavljeno
10.23919/MIPRO.2017.7973420
Podaci o matičnoj publikaciji
MIPRO 2017 40th International Convention Proceedings
Skala, Karolj ; Trobec, Roman
Opatija: Hrvatska udruga za informacijsku i komunikacijsku tehnologiju, elektroniku i mikroelektroniku - MIPRO
9-781-50904969-1
Podaci o skupu
MIPRO 2017
predavanje
22.05.2017-26.05.2017
Opatija, Hrvatska
Povezanost rada
Računarstvo