loading...
Improving I/O Performance of Clustered Storage Systems by Adaptive Request Distribution
Paris June 19-June 23
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/HPDC.2006.16521522006 15th IEEE International Conferen ...
 This Article 
 
PDF
HTML
 
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
C. Wu, Dept. of Comput. Sci., Johns Hopkins Univ., Baltimore, MD
R. Burns, Dept. of Comput. Sci., Johns Hopkins Univ., Baltimore, MD
We develop an adaptive load distribution protocol for logical volume I/O workload in clustered storage systems. It exploits data redundancy among decentralized storage servers to dynamically route I/O workload on a per-request basis, offering short-term load balancing and improved I/O performance. Our protocol builds on tunable hashing techniques and is based purely on client logic. Therefore, it does not limit system scalability and requires no change to the existing infrastructure. It distributes the I/O requests of a client to storage servers selected adoptively by a decentralized tunable hashing scheme, and, applies different policies to read and write requests. It also makes no assumption about inter-server communication latency and thus is robust to different network configurations. It supports both replication and erasure coding data redundancy schemes. Experimental results show that our protocol performs closely to a centralized load-balancing algorithm and verify the robustness of our protocol
Index Terms:
client-server system, I/O performance, clustered storage system, adaptive request distribution, adaptive load distribution protocol, data redundancy, decentralized storage server, load balancing, tunable hashing technique, inter-server communication latency, network configuration
Citation:
C. Wu, R. Burns, "Improving I/O Performance of Clustered Storage Systems by Adaptive Request Distribution," hpdc, pp.207-217, 2006 15th IEEE International Conference on High Performance Distributed Computing, 2006
Usage of this product signifies your acceptance of the Terms of Use.