Program scalability analysis for HPC cloud: Applying amdahl's law to NAS benchmarks

Justin Y. Shi, Moussa Taifi, Aakash Pradeep, Abdallah Khreishah, Vivek Antony

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

The availability of high performance computing (HPC) clouds requires scalability analysis of parallel programs for multiple different environments in order to maximize the promised economic benefits. Unlike traditional HPC application performance studies that aim to predict performances of like-kind processors, this paper reports an instrumentation assisted complexity analysis method based on Amdahl's Law framework for program scalability analysis for different HPC environments. We show that program instrumentation helps Gustafson's scaled speedup formulation to quantify the elusive quality in Amdahl's Law. We report that without separating communication time from computing, prediction results are not trustworthy. We demonstrate a methodology that can transform asymptotic complexity models to timing models in order to separate communication time and to identify the optimal degree of parallelism. A traditional HPC cluster and a private HPC cloud are used to validate the proposed methodology by showing the feasibility of optimal parallel processing and by scalability analysis of five NAS benchmarks. Our results show that either cloud or cluster can be effectively exploited if the application can adapt to changing processing conditions dynamically. As we dig deeper into the performance analysis myths, 'scalability limit' seems to mean less than its common interpretation but more on the inadequacy our programming habits and architecture support. Index

Original languageEnglish (US)
Title of host publicationProceedings - 2012 SC Companion
Subtitle of host publicationHigh Performance Computing, Networking Storage and Analysis, SCC 2012
Pages1215-1225
Number of pages11
DOIs
StatePublished - Dec 1 2012
Externally publishedYes
Event2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012 - Salt Lake City, UT, United States
Duration: Nov 10 2012Nov 16 2012

Other

Other2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012
CountryUnited States
CitySalt Lake City, UT
Period11/10/1211/16/12

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Science Applications
  • Computational Theory and Mathematics

Cite this

Shi, J. Y., Taifi, M., Pradeep, A., Khreishah, A., & Antony, V. (2012). Program scalability analysis for HPC cloud: Applying amdahl's law to NAS benchmarks. In Proceedings - 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012 (pp. 1215-1225). [6495929] https://doi.org/10.1109/SC.Companion.2012.147