loading...
Towards a Decentralized Algorithm for Mapping Network and Computational Resources for Distributed Data-Flow Computations
Saskatoon, Saskatchewan, Canada May 13-May 16
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/HPCS.2007.3221st International Symposium on High ...
 This Article 
 
PDF
HTML
 
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Shah, McGill University, Montreal, QC, Canada
Muthucumaru Maheswaran, McGill University, Montreal, QC, Canada
Several high-throughput distributed data-processing applications require multi-hop processing of streams of data. These applications include continual processing on data streams originating from a network of sensors, composing a multimedia stream through embedding several component streams originating from different locations, etc. These data-flow computing applications require multiple processing nodes interconnected according to the data-flow topology of the application, for on-stream processing of the data. Since the applications usually sustain for a long period, it is important to optimally map the component computations and communications on the nodes and links in the network, fulfilling the capacity constraints and optimizing some quality metric such as end-to-end latency. The mapping problem is unfortunately NP-complete and heuristics have been previously proposed to compute the approximate solution in a centralized way. However, because of the dynamicity of the network, it is practically impossible to aggregate the correct state of the whole network in a single node. In this paper, we present a distributed algorithm for optimal mapping of the components of the data flow applications. We propose several heuristics to minimize the message complexity of the algorithm while maintaining the quality of the solution.
Citation:
Shah , Muthucumaru Maheswaran, "Towards a Decentralized Algorithm for Mapping Network and Computational Resources for Distributed Data-Flow Computations," hpcs, pp.30, 21st International Symposium on High Performance Computing Systems and Applications (HPCS'07), 2007
Usage of this product signifies your acceptance of the Terms of Use.