loading...
Autonomic Management of Stream Processing Applications via Adaptive Bandwidth Control
Lisboa, Portugal July 04-July 07
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/ICDCS.2006.2026th IEEE International Conference on ...
 This Article 
 
PDF
HTML
 
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Dimitrios Pendarakis, IBM T.J. Watson Research Center, NY
Jeremy Silber, Google, New York, NY, USA
Laura Wynter, IBM T.J. Watson Research Center, NY
We present a novel autonomic control system for high performance stream processing systems. The system uses bandwidth controls on incoming or outgoing streams to achieve a desired resource utilization balance among a set of concurrently executing stream processing tasks. We show that CPU prioritization and allocation mechanisms in schedulers and virtual machine managers are not sufficient to control such I/O-centric applications, and present an autonomic bandwidth control system that adaptively adjusts incoming and outgoing traffic rates to achieve system management goals. The system dynamically learns the bandwidth rate necessary to meet the system management goals using stochastic nonlinear optimization, and detects changes in the stream processing applications that require bandwidth adjustment. Our prototype Linux implementation is lightweight, has low overhead, and is capable of effectively managing stream processing applications.
Citation:
Dimitrios Pendarakis, Jeremy Silber, Laura Wynter, "Autonomic Management of Stream Processing Applications via Adaptive Bandwidth Control," icdcs, pp.7, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06), 2006
Usage of this product signifies your acceptance of the Terms of Use.