Application-aware management parallel simulation collections

Siu Man Yau; Vijay Karamcheti; Denis Zorin; Kostadin Damevski; Steven G. Parker

doi:10.1145/1504176.1504184

Application-aware management parallel simulation collections

Siu Man Yau, Vijay Karamcheti, Denis Zorin, Kostadin Damevski, Steven G. Parker

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper presents a system deployed on parallel clusters to manage a collection of parallel simulations that make up a computational study. It explores how such a system can extend traditional parallel job scheduling and resource allocation techniques to incorporate knowledge specific to the study. Using a UINTAH-based helium gas simulation code (ARCHES) and the SimX system for multi-experiment computational studies, this paper demonstrates that, by using application-specific knowledge in resource allocation and scheduling decisions, one can reduce the run time of a computational study from over 20 hours to under 4.5 hours on a 32-processor cluster, and from almost 11 hours to just over 3.5 hours on a 64-processor cluster.

Original language	English (US)
Title of host publication	Proceedings of the 2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09
Pages	35-44
Number of pages	10
DOIs	https://doi.org/10.1145/1504176.1504184
State	Published - 2009
Event	2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09 - Raleigh, NC, United States Duration: Feb 14 2009 → Feb 18 2009

Publication series

Name	Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

Other

Other	2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09
Country	United States
City	Raleigh, NC
Period	2/14/09 → 2/18/09

Keywords

High-throughput computing
Parallel system

ASJC Scopus subject areas

Software

Access to Document

10.1145/1504176.1504184

Fingerprint Dive into the research topics of 'Application-aware management parallel simulation collections'. Together they form a unique fingerprint.

Cite this

Yau, S. M., Karamcheti, V., Zorin, D., Damevski, K., & Parker, S. G. (2009). Application-aware management parallel simulation collections. In Proceedings of the 2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09 (pp. 35-44). (Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP). https://doi.org/10.1145/1504176.1504184

Application-aware management parallel simulation collections. / Yau, Siu Man; Karamcheti, Vijay; Zorin, Denis; Damevski, Kostadin; Parker, Steven G.

Proceedings of the 2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09. 2009. p. 35-44 (Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Yau, SM, Karamcheti, V, Zorin, D, Damevski, K & Parker, SG 2009, Application-aware management parallel simulation collections. in Proceedings of the 2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09. Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP, pp. 35-44, 2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09, Raleigh, NC, United States, 2/14/09. https://doi.org/10.1145/1504176.1504184

Yau SM, Karamcheti V, Zorin D, Damevski K, Parker SG. Application-aware management parallel simulation collections. In Proceedings of the 2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09. 2009. p. 35-44. (Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP). https://doi.org/10.1145/1504176.1504184

Yau, Siu Man ; Karamcheti, Vijay ; Zorin, Denis ; Damevski, Kostadin ; Parker, Steven G. / Application-aware management parallel simulation collections. Proceedings of the 2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09. 2009. pp. 35-44 (Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP).

@inproceedings{9721d976a2cb41ab894f0eda6150b2f2,

title = "Application-aware management parallel simulation collections",

abstract = "This paper presents a system deployed on parallel clusters to manage a collection of parallel simulations that make up a computational study. It explores how such a system can extend traditional parallel job scheduling and resource allocation techniques to incorporate knowledge specific to the study. Using a UINTAH-based helium gas simulation code (ARCHES) and the SimX system for multi-experiment computational studies, this paper demonstrates that, by using application-specific knowledge in resource allocation and scheduling decisions, one can reduce the run time of a computational study from over 20 hours to under 4.5 hours on a 32-processor cluster, and from almost 11 hours to just over 3.5 hours on a 64-processor cluster.",

keywords = "High-throughput computing, Parallel system",

author = "Yau, {Siu Man} and Vijay Karamcheti and Denis Zorin and Kostadin Damevski and Parker, {Steven G.}",

year = "2009",

doi = "10.1145/1504176.1504184",

language = "English (US)",

isbn = "9781605583976",

series = "Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP",

pages = "35--44",

booktitle = "Proceedings of the 2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09",

note = "2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09 ; Conference date: 14-02-2009 Through 18-02-2009",

}

TY - GEN

T1 - Application-aware management parallel simulation collections

AU - Yau, Siu Man

AU - Karamcheti, Vijay

AU - Zorin, Denis

AU - Damevski, Kostadin

AU - Parker, Steven G.

PY - 2009

Y1 - 2009

N2 - This paper presents a system deployed on parallel clusters to manage a collection of parallel simulations that make up a computational study. It explores how such a system can extend traditional parallel job scheduling and resource allocation techniques to incorporate knowledge specific to the study. Using a UINTAH-based helium gas simulation code (ARCHES) and the SimX system for multi-experiment computational studies, this paper demonstrates that, by using application-specific knowledge in resource allocation and scheduling decisions, one can reduce the run time of a computational study from over 20 hours to under 4.5 hours on a 32-processor cluster, and from almost 11 hours to just over 3.5 hours on a 64-processor cluster.

AB - This paper presents a system deployed on parallel clusters to manage a collection of parallel simulations that make up a computational study. It explores how such a system can extend traditional parallel job scheduling and resource allocation techniques to incorporate knowledge specific to the study. Using a UINTAH-based helium gas simulation code (ARCHES) and the SimX system for multi-experiment computational studies, this paper demonstrates that, by using application-specific knowledge in resource allocation and scheduling decisions, one can reduce the run time of a computational study from over 20 hours to under 4.5 hours on a 32-processor cluster, and from almost 11 hours to just over 3.5 hours on a 64-processor cluster.

KW - High-throughput computing

KW - Parallel system

UR - http://www.scopus.com/inward/record.url?scp=67650070998&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=67650070998&partnerID=8YFLogxK

U2 - 10.1145/1504176.1504184

DO - 10.1145/1504176.1504184

M3 - Conference contribution

AN - SCOPUS:67650070998

SN - 9781605583976

T3 - Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

SP - 35

EP - 44

BT - Proceedings of the 2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09

T2 - 2009 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'09

Y2 - 14 February 2009 through 18 February 2009

ER -