loading...
Exploring I/O Strategies for Parallel Sequence-Search Tools with S3aSim
Paris June 19-June 23
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/HPDC.2006.16521542006 15th IEEE International Conferen ...
 This Article 
 
PDF
HTML
 
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A. Ching, Dept. of Electr. Eng.&Comput. Sci., Northwestern Univ., Evanston, IL
Parallel sequence-search tools are rising in popularity among computational biologists. With the rapid growth of sequence databases, database segmentation is the trend of the future for such search tools. While I/O currently is not a significant bottleneck for parallel sequence-search tools, future technologies including faster processors, customized computational hardware such as FPGAs, improved search algorithms, and exponentially growing databases emphasize an increasing need for efficient parallel I/O in future parallel sequence-search tools. Our paper focuses on examining different I/O strategies for these future tools in a modern parallel file system (PVFS2). Because implementing and comparing various I/O algorithms in every search tool is labor-intensive and time-consuming, we introduce S3aSim, a general simulation framework for sequence-search which allows us to quickly implement, test, and profile various I/O strategies. We examine a variety of I/O strategies (e.g., master-writing and various worker-writing strategies using individual and collective I/O methods) for storing result data in sequence-search tools such as mpiBLAST, pioBLAST, and parallel HMMer. Our experiments fully detail the interaction of computing and I/O within a full application simulation as opposed to typical I/O-only benchmarks
Index Terms:
parallel HMMer tool, parallel I/O strategy, parallel sequence-search tool, S3aSim framework, computational biologist, sequence database segmentation, search algorithm, parallel file system, master-writing strategy, worker-writing strategy, mpiBLAST tool, pioBLAST tool
Citation:
A. Ching, W. Feng, H. Lin, X. Ma, A. Choudhary, "Exploring I/O Strategies for Parallel Sequence-Search Tools with S3aSim," hpdc, pp.229-240, 2006 15th IEEE International Conference on High Performance Distributed Computing, 2006
Usage of this product signifies your acceptance of the Terms of Use.