loading...
An evaluation of the close-to-files processor and data co-allocation policy in multiclusters
San Diego, CA, USA September 20-September 23
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/CLUSTR.2004.1392626Sixth IEEE International Conference o ...
 This Article 
 
PDF
HTML
 
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
H.H. Mohamed, Fac. of Electr. Eng., Math., & Comput. Sci., Delft Univ. of Technol., Netherlands
D.H.J. Epema, Fac. of Electr. Eng., Math., & Comput. Sci., Delft Univ. of Technol., Netherlands
In multicluster systems, and more generally, in grids, jobs may require coallocation, i.e., the simultaneous allocation of resources such as processors and input files in multiple clusters. While such jobs may have reduced runtimes because they have access to more resources, waiting for processors in multiple clusters and for the input files to become available in the right locations may introduce inefficiencies. In previous work, we have studied through simulations only processor coallocation. Here, we extend this work with an analysis of the performance in a real testbed of our prototype processor and data coallocator with the close-to-files (CF) job-placement algorithm. CF tries to place job components on clusters with enough idle processors which are close to the sites where the input files reside. We present a comparison of the performance of CF and the worst-fit job-placement algorithm, with and without file replication, achieved with our prototype. Our most important findings are that CF with replication works best, and that the utilization in our testbed can be driven to about 80%.
Citation:
H.H. Mohamed, D.H.J. Epema, "An evaluation of the close-to-files processor and data co-allocation policy in multiclusters," cluster, pp.287-298, Sixth IEEE International Conference on Cluster Computing (CLUSTER'04), 2004
Usage of this product signifies your acceptance of the Terms of Use.