loading...
Flexible and Efficient Parallel I/O for Large-Scale Multi-Component Simulations
Nice, France April 22-April 26
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/IPDPS.2003.1213462International Parallel and Distribute ...
 This Article 
 
Buy PURCHASE ARTICLE: $19
PDF
HTML
Buy IEEE Xplore Subscribers
 
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
ASCII Text
x 
 
Xiaosong Ma, Xiangmin Jiao, Michael Campbell, Marianne Winslett, "Flexible and Efficient Parallel I/O for Large-Scale Multi-Component Simulations," Parallel and Distributed Processing Symposium, International, pp. 255a, International Parallel and Distributed Processing Symposium (IPDPS'03), 2003.
 
 
BibTex
x
 
@article{ 10.1109/IPDPS.2003.1213462,
author = {Xiaosong Ma and Xiangmin Jiao and Michael Campbell and Marianne Winslett},
title = {Flexible and Efficient Parallel I/O for Large-Scale Multi-Component Simulations},
journal ={Parallel and Distributed Processing Symposium, International},
volume = {0},
year = {2003},
issn = {1530-2075},
pages = {255a},
doi = {http://doi.ieeecomputersociety.org/10.1109/IPDPS.2003.1213462},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - CONF
JO - Parallel and Distributed Processing Symposium, International
TI - Flexible and Efficient Parallel I/O for Large-Scale Multi-Component Simulations
SN - 1530-2075
SP
EP
A1 - Xiaosong Ma,
A1 - Xiangmin Jiao,
A1 - Michael Campbell,
A1 - Marianne Winslett,
PY - 2003
KW - parallel I/O
KW - I/O performance optimization
KW - multi-component simulations
KW - irregular data distribution
KW - scientific data management
VL - 0
JA - Parallel and Distributed Processing Symposium, International
ER -
 
In this paper, we discuss our experience of providing high performance parallel I/O for a large-scale, on-going, multi-disciplinary simulation project for solid propellant rockets. We describe the performance and data management issues observed in this project and present our solutions, including (1) support for relatively fine-grained distribution of irregular datasets in parallel I/O, (2) a flexible data management facility for inter-module communication, and (3) two schemes to overlap computation with I/O. Performance results obtained from both development and production platforms show that our I/O optimizations can dramatically reduce the simulation?s visible I/O cost, as well as the number of disk files, and significantly improve the overall performance. Meanwhile, our data management facility helps to provide simulation developers with simple user interfaces for parallel I/O.
Index Terms:
parallel I/O, I/O performance optimization, multi-component simulations, irregular data distribution, scientific data management
Citation:
Xiaosong Ma, Xiangmin Jiao, Michael Campbell, Marianne Winslett, "Flexible and Efficient Parallel I/O for Large-Scale Multi-Component Simulations," ipdps, pp.255a, International Parallel and Distributed Processing Symposium (IPDPS'03), 2003
Usage of this product signifies your acceptance of the Terms of Use.