article

An up-to-date survey in web load balancing

Authors:

Ramon PuigjanerAuthors Info & Claims

World Wide Web, Volume 14, Issue 2

Pages 105 - 131

https://doi.org/10.1007/s11280-010-0101-5

Published: 01 March 2011 Publication History

Abstract

This survey is an up-to-date state-of-the-art in Web load balancing mechanisms that includes all the possible classifications and focuses on the advantages of using load balancing solutions to increase the performance of the Web system. A general description of the Web load balancing solutions is included and organised by differentiating the OSI protocol stack layer the load balancing is based on. The most important request distributing polices that are proposed in the literature are also included. This article summarises all previous surveys on the Web load balancing subject and updates the state-of-the-art with the most recent load balancing proposals.

References

[1]

Andreolini, M., Colajanni, M., Nuccio, M.: Kernel-based web switches providing content-aware routing. In: Proc. of the 2nd IEEE International Symposium on Network Computing and Applications (NCA'03) (2003).

Digital Library

[2]

Apostolopoulos, G., Aubespin, D., Peris, V.G.J., Pradhan, P., Saha, D.: Design, implementation and performance of a content-based switch. In: Proc. of INFOCOM (2000).

[3]

Aron, M., Druschel, P., Zwaenepoel, W.: Efficient support for P-HTTP in cluster-based web servers. In: Proc. of the Annual Conference on USENIX Annual Technical Conference (1999).

Digital Library

[4]

Aron, M., Druschel, P., Zwaenepoel, W.: Cluster reserves: a mechanism for resource management in cluster-based network servers. In: Proc. of ACM SIGMETRICS (2000).

Digital Library

[5]

Aron, M., Sanders, D., Druschel, P., Zwaenepoel, W.: Scalable content-aware request distribution in cluster-based network servers. In: Proc. of the USENIX 2000 Annual Technical Conference (2000).

Digital Library

[6]

Barroso, L., Dean, J., Hoelzle, U.: Web search for a planet: the google cluster architecture. IEEE Micro <b>23</b>, 22-28 (2003).

Digital Library

[7]

Bent, L., Rabinovich, M., Voelker, G.M., Xiao, Z.: Characterization of a large web site population with implications for content delivery. In: Proc. of the 13th International Conference on World Wide Web (2004).

Digital Library

[8]

Borzemski, L., Zatwarnicki, K.: Afuzzy adaptive request distribution algorithm for cluster-based web systems. In: Proc. of the 11th Euromicro Conference on Parallel, Distributed and Network-Based Processing (Euro PDP) (2003).

[9]

Brendel, J.: Client-side resource-based load-balancing with delayed-resource-binding using TCP state migration to WWW server farm. United States Patent 6,182,139. Resonate Inc (2001).

[10]

Brisco, T.P.: DNS support for Load Balancing. RFC 1794 (1995).

[11]

Cardellini, V., Casalicchio, E., Colajanni, M., Yu, P.S.: The state of the art in locally distributed web-server systems. ACM Comput. Surv. <b>34</b>, 263-311 (2002).

Digital Library

[12]

Cardellini, V., Colajanni, M., Yu, P.S.: Dynamic load balancing on web-server systems. IEEE Int. Comp. <b>3</b>(3), 28-39 (1999).

Digital Library

[13]

Carrera, E., Bianchini, R.: Efficiency vs. portability in cluster-based network servers (2001).

[14]

Casalicchio, E., Colajanni, M.: A client-aware dispatching algorithm for web clusters providing multiple services. In: Proc. of the 10th International Conference on World Wide Web (2001).

Digital Library

[15]

Cavale, M.R.: Introducing Microsoft Cluster Service (MSCS) in the Windows Server 2003 Family. Microsoft Corporation (2002).

[16]

Chang, Y.K., Cheng, W.H., Young, C.P.: Fully pre-splicing TCP for web switches. In: Proc. of the 1st International Conference on Innovative Computing, Information and Control (ICICIC) (2006).

Digital Library

[17]

Cherkasova, L., DeSouza, M., Ponnekanti, S.: Performance analysis of "content-aware" load balancing strategy FLEX: two case studies. In: Proc. of the 34th Hawaii International Conference on System Sciences (2001).

Digital Library

[18]

Cherkasova, L., Karlsson, M.: Scalable web server cluster design with workload-aware request distribution strategy WARD. In: Proc. of the Third International Workshop on Advanced Issues of E-Commerce and Web-Based Information Systems (WECWIS) (2001).

Digital Library

[19]

Chiang, M.L., Lin, Y.C., Guo, L.F.: Design and implementation of an efficient web cluster with content-based request distribution and file caching. J. Syst. Softw. <b>81</b>, 2044-2058 (2008).

Digital Library

[20]

Chiang, M.L., Wu, C.H., Liao, Y.J., Chen, Y.F.: New content-aware request distribution policies in web clusters providing multiple services. In: Proc. of the ACM Symposium on Applied Computing (2009).

Digital Library

[21]

Choi, E.: Performance test and analysis for an adaptive load balancing mechanism on distributed server cluster systems. Future Gener. Comput. Syst. <b>20</b>, 237-247 (2004).

Digital Library

[22]

Ciardo, G., Riska, A., Smirni, E.: EQUILOAD: a load balancing policy for clustered web servers. Perform. Eval. <b>46</b>(2-3), 101-124 (2001).

Digital Library

[23]

Cisco Systems, I.: Scalable Content Switching. A discussion of the cisco css 11500 series content services switch architecture. White Paper (2002).

[24]

Cisco systems, inc. http://www.cisco.com/ (2010). Accessed 26 Nov 2010.

[25]

Cohen, A., Rangarajan, S., Slye, H.: On the performance of TCP splicing for URL-aware redirection. In: Proc. of the 2nd Conference on USENIX Symposium on Internet Technologies and Systems (1999).

Digital Library

[26]

Colajanni, M., Yu, P.S.: A performance study of robust load sharing strategies for distributed heterogeneous web server systems. IEEE Trans. Knowl. Data Eng. <b>14</b>(2), 398-414 (2002).

Digital Library

[27]

Colby, S., Krawezyk, J.J., Nair, R.K., Royee, K., Siegel, K.P., Stevens, R.C., Wasson, S.: Method and System for Directing a Flow Between a Client and a Server. United States Patent 6,006,264 (2001). Arrowpoint Communications, Inc.

[28]

Dahlin, M.: Interpreting stale load information. IEEE Trans. Parallel Distrib. Syst. <b>11</b>(10), 1033-1047 (2000).

Digital Library

[29]

Damani, O.P., Chung, E., Huang, Y., Kintala, C., Wang, Y.M.: ONE-IP: techniques for hosting a service on a cluster of machines. Comput. Netw. ISDN Syst. <b>29</b>, 1019-1027 (1997).

Digital Library

[30]

(DARPA), D.A.R.P.A.: Transmission Control Protocol. RFC 793 (1981).

[31]

F5 Networks, Inc.: http://www.f5.com/ (2010).

[32]

Faour, A., Mansour, N.: Weblins: A scalable www cluster-based server. Adv. Eng. Softw. <b>37</b>, 11-19 (2006).

Digital Library

[33]

Fielding, R.T., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P.J., Berners-Lee, T.: Hypertext transfer protocol--HTTP/1.1. RFC <b>2616</b> (1999).

[34]

Gan, X., Schroeder, T., Goddard, S., Ramamurthy, B.: Highly available and scalable cluster-based web servers. In: Proc. of the 8th IEEE International Conference on Computer Communications and Networks (1999).

[35]

Gilly, K., Alcaraz, S., Juiz, C., Puigjaner, R.: Analysis of burstiness monitoring and detection in an adaptive web system. Comput. Networks <b>53</b>, 668-679 (2009).

Digital Library

[36]

Gilly, K., Juiz, C., Alcaraz, S., Puigjaner, R.: Adaptive admission control algorithm in a QoS-aware web system. In: Proc. of IEEE International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS) (2009).

[37]

Goddard, S., Schroeder, T.: The SASHA architecture for network-clustered web servers. In: Proc. of the 6th IEEE International Symposium on High Assurance Systems Engineering (2001).

Digital Library

[38]

Hunt, G., Nahum, E., Tracey, J.: Enabling Content-based Load Distribution for Scalable Services. Tech. rep., IBM T.J. Watson Research Center (1997).

[39]

IBM: http://www.ibm.com/ (2010).

[40]

IBM: Application Switching with Nortel Networks Layer 2-7 gigabit Ethernet Switch Module for IBM Bladecenter. IBM Redbook (2006).

[41]

Iyengar, A., Challenger, J., Dias, D., Dantzig, P.: High-performance web site design techniques. IEEE Int. Comp. <b>4</b>, 17-26 (2000).

Digital Library

[42]

Kachris, C., Vassiliadis, S.: Design of a web switch in a reconfigurable platform. In: Proc. of the 2006 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (2006).

Digital Library

[43]

Kerdlapanan, D., Khunkitti, A.: Content-based load balancing with multicast and tcp-handoff. In: Proc. of International Symposium on Circuits and Systems (2003).

[44]

Kobayashi, M., Murase, T.: Asymmetric tcp splicing for content-based switches. In: Proc. of IEEE International Conference on Communications (ICC) (2002).

[45]

Kokku, R., Rajamony, R., Harrick Vin, L.A.: Half-pipe anchoring: an efficient technique for multiple connection handoff. In: Proc. of the 10th IEEE International Conference on Network Protocols (2002).

Digital Library

[46]

Kopparapu, C.: Load Balancing Servers, Firewalls and Caches. Wiley (2001).

Digital Library

[47]

Krishnamurthy, B., Wills, C., Zhang, Y.: On the use and performance of content distribution networks. In: Proc. of the 1st ACM SIGCOMM Workshop on Internet Measurement (2001).

Digital Library

[48]

Li, C., Peng, G., Gopalan, K., cker Chiueh, T.: Performance guarantee for cluster-based internet services. In: Proc. of the 23rd International Conference on Distributed Computing Systems (2003).

Digital Library

[49]

Lin, Y.D., Tsai, P.T., Lin, P.C., Tien, C.M.: Direct web switch routing with state migration, TCP masquerade, and cookie name rewriting. In: Proc. of Global Telecommunications Conference (2003).

[50]

Liu, H.H., Chiang, M.L.: Tcp rebuilding for content-aware request dispatching in web clusters. Journal of Internet Technology <b>6</b>, 231-240 (2005).

[51]

Liu, H.H., Chiang, M.L., Wu, M.C.: Efficient support for content-aware request distribution and persistent connection in Web clusters. Softw. Pract. Exp. <b>37</b>, 1215-1241 (2007).

Digital Library

[52]

Luo, M.Y., Yang, C.S.: System support for scalable, reliable and highly manageable web hosting service. In: Proc. of the 3rd conference on USENIX Symposium on Internet Technologies and Systems (2001).

Digital Library

[53]

Luo, M.Y., Yang, C.S., Tseng, C.W.: Analysis and improvement of content-aware routing mechanisms. IEICE Trans. Commun. <b>E88</b>, 227-238 (2005).

[54]

Maltz, D.A., Bhagwat, P.: TCP Splicing for Application Layer Proxy Performance. Tech. Rep., IBM (1998).

[55]

Marwah, M., Mishra, S., Fetzer, C.: Fault-tolerant and scalable TCP splice and web server architecture. In: Proc. of the 25th IEEE Symposium on Reliable Distributed Systems (2006).

Digital Library

[56]

Mogul, J.C.: The case for persistent-connection HTTP. In: Proc. of SIGCOMM (1995).

Digital Library

[57]

Networks, F.: http://www.foundrynet.com (2010).

[58]

Networks, N.: http://www.nortel.com/ (2010).

[59]

Ok, M., Park, M.S.: Distributing requests by (around k)-bounded load-balancing in web server cluster with high scalability. IEICE Trans. Inf. Sys. <b>E89-D</b>, 663-672 (2006).

Digital Library

[60]

Pai, V.S., Aron, M., Banga, G., Svendsen, M., Druschel, P., Zwaenepoel, W., Nahum, E.M.: Locality-aware request distribution in cluster-based network servers. In: Proc. of Architectural Support for Programming Languages and Operating Systems (ASPLOS) (1998).

Digital Library

[61]

Papathanasiou, A.E., Hensbergen, E.V.: KNITS: switch-based connection hand-off. In: Proc. of IEEE INFOCOM (2002).

[62]

Park, S.Y., Park, D., Lee, J., Cho, J.W.: Efficient inter-backend prefetch algorithms in cluster-based web servers. In: Proc. of International Conference/Exhibition on High Performance Computing (2001).

[63]

Radware: http://www.radware.com (2010).

[64]

Resonate: Resonate central dispatch technology advantage: TCP connection HOP. White Paper (2001).

[65]

Resonate, inc. http://www.resonate.com/ (2010).

[66]

Riska, A., Sun, W., Smirni, E., Ciardo, G.: ADAPTLOAD: effective balancing in clustered web servers under transient load conditions. In: Proc. of the 22nd International Conference on Distributed Computing Systems (2002).

Digital Library

[67]

Rosu, M.C., Rosu, D.: An evaluation of TCP splice benefits in web proxy servers. In: Proc. of WWW (2002).

Digital Library

[68]

Satake, S., Inai, H.: Special issue on internet architecture technology papers: a nonprobabilistic server selection method based on periodically obtained load information for web server clusters. Electron. Commun. Jpn. <b>89</b>, 1-12 (2006).

[69]

Schroeder, T., Goddard, S., Ramamurthy, B.: Scalable web server ciustering technologies. IEEE Netw. May, 38-46 (2000).

Digital Library

[70]

Server, L.V.: http://www.linuxvirtualserver.org/ (2006). Accessed 26 Nov 2010.

[71]

Shan, Z., Lin, C., Marinescu, D.C., Yang., Y.: Modeling and performance analysis of QoS-aware load balancing of web-server clusters. Comput. Networks <b>40</b>, 235-256 (2002).

Digital Library

[72]

Sharifian, S., Motamedi, S.A., Akbarib, M.K.: A content-based load balancing algorithm with admission control for cluster web servers. Future Gener. Comput. Syst. <b>24</b>, 775-787 (2008).

Digital Library

[73]

Sit, Y.F., Wang, C.L., Lau, F.: Socket cloning for cluster-based web servers. In: Proc. of IEEE International Conference on Cluster Computing (2002).

Digital Library

[74]

Sit, Y.F., Wang, C.L., Lau, F.: Cyclone: a high-performance cluster-based web server with socket cloning. Cluster Comput. <b>7</b>, 21-37 (2004).

Digital Library

[75]

Snoeren, A.C., Andersen, D.G., Balakrishnan, H.: Fine-grained failover using connection migration. In: Proc. of 3rd USENIX Symp. on Internet Technologies and Systems (2001).

Digital Library

[76]

Switching, L.L.: http://www.linuxvirtualserver.org/software/ktcpvs/ktcpvs.html (2010).

[77]

Syme, M., Goldie, P.: Optimizing Network Performance with Content Switching. Server, Firewall and Cache Load Balancing. Prentice Hall (2004).

Digital Library

[78]

Takahashi, M., Kohiga, A., Sugawara, T., Tanaka, A.: Tcp-migration with application-layer dispatching: a new http request distribution architecture in locally distributed web server systems. In: Proc. of the 1st International Conference on Communication System Software and Middleware (2006).

[79]

Tang, W., Cherkasova, L., Russell, L., Mutka, M.W.: Modular tcp handoff design in streams-based tcp/ip implementation. In: Proc. of the 1st International Conference on Networking-Part 2 (2001).

Digital Library

[80]

Tang, X., Chanson, S.T.: On caching effectiveness of web clusters under persistent connections. J. Parallel Distrib. Comput. <b>63</b>, 981-995 (2003).

Digital Library

[81]

TCPHA project. http://dragon.linux-vs.org/~dragonfly/htm/tcpha.htm (2004). Accessed 26 Nov 2010.

[82]

Teo, Y.M., Ayani, R.: Comparison of load balancing strategies on cluster-based web servers. Trans. of the Soc. for Model. and Sim. <b>77</b>, 185-195 (2001).

[83]

Yang, C.S., Luo, M.Y.: Efficient support for content-based routing in web server clusters. In: Proc. of the 2nd Conference on USENIX Symposium on Internet Technologies and Systems, vol. 2 (1999).

Digital Library

[84]

Yang, J., Jin, D., Li, Y., Hielscher, K.S., German, R.: Modeling and simulation of performance analysis for a cluster-based web server. Simulation Modelling Practice and Theory <b>14</b>, 188-200 (2006).

[85]

Yao, J., Ding, J.J., Bhuyan, L.N.: Intelligent message scheduling in application oriented networking systems. In: Proc. of IEEE International Conference on Communications (ICC) (2008).

[86]

Zeng-Kai, D., Jiu-Bin, J.: A completely distributed architecture for cluster-based web servers. In: Proc. of the 4th International Conference on Parallel and Distributed Computing, Applications and Technologies (2003).

[87]

Zhang, Q., Mi, N., Riska, A., Smirni, E.: Load unbalancing to improve performance under autocorrelated traffic. In: Proc. of the 26th IEEE International Conference on Distributed Computing Systems (2006).

Digital Library

[88]

Zhang, Q., Riska, A., Sun, W., Smirni, E., Ciardo, G.: Workload-aware load balancing for clustered web servers. IEEE Trans. Parallel Distrib. Syst. <b>3</b>, 219-233 (2005).

Digital Library

[89]

Zhang, R., Abdelzaher, T.F., Stankovic, J.A.: Efficient TCP connection failover in web server clusters. In: Proc. of IEEE INFOCOM (2004).

[90]

Zhang, W.: Linux virtual server for scalable network services. In: Proc. of OTTAWA Linux Symposium (2000).

[91]

Zhang, X., Barrientos, M., Chen, J.B., Seltzer, M.: HACC: an architecture for cluster-based web servers. In: Proc. of the 3rd USENIX Windows NT Symposium (1999).

Digital Library

[92]

Zhao, L., Luo, Y., Bhuyan, L., Iyer, R.: Design and implementation of a content-aware switch using a network processor. In: Proc. of the 13th Symposium on High Performance Interconnects (2005).

Digital Library

Cited By

Bhattacharya RGao YWood T(2024)Dynamically Balancing Load with Overload Control for MicroservicesACM Transactions on Autonomous and Adaptive Systems10.1145/367616719:4(1-23)Online publication date: 5-Jul-2024
https://dl.acm.org/doi/10.1145/3676167
Turin GBorgarelli ADonetti SDamiani FJohnsen ETapia Tarifa S(2023)Predicting resource consumption of Kubernetes container systems using resource modelsJournal of Systems and Software10.1016/j.jss.2023.111750203:COnline publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1016/j.jss.2023.111750
Mittal VQi SBhattacharya RLyu XLi JKulkarni SLi DHwang JRamakrishnan KWood T(2021)MuProceedings of the ACM Symposium on Cloud Computing10.1145/3472883.3487014(168-181)Online publication date: 1-Nov-2021
https://dl.acm.org/doi/10.1145/3472883.3487014
Show More Cited By

An up-to-date survey in web load balancing

Recommendations

Elastic Load Balancing Classic Load Balancers
Decoupled load balancing
PPoPP '15

Modern scientific simulations divide work between parallel processors by decomposing a spatial domain of mesh cells, particles, or other elements. A balanced assignment of the computational load is critical for parallel performance. If the computation ...
Elastic Load Balancing Application Load Balancers

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image World Wide Web

World Wide Web Volume 14, Issue 2

March 2011

110 pages

ISSN:1386-145X

Issue’s Table of Contents

Copyright © Copyright © 2011 Springer Science+Business Media, LLC.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 March 2011

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bhattacharya RGao YWood T(2024)Dynamically Balancing Load with Overload Control for MicroservicesACM Transactions on Autonomous and Adaptive Systems10.1145/367616719:4(1-23)Online publication date: 5-Jul-2024
https://dl.acm.org/doi/10.1145/3676167
Turin GBorgarelli ADonetti SDamiani FJohnsen ETapia Tarifa S(2023)Predicting resource consumption of Kubernetes container systems using resource modelsJournal of Systems and Software10.1016/j.jss.2023.111750203:COnline publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1016/j.jss.2023.111750
Mittal VQi SBhattacharya RLyu XLi JKulkarni SLi DHwang JRamakrishnan KWood T(2021)MuProceedings of the ACM Symposium on Cloud Computing10.1145/3472883.3487014(168-181)Online publication date: 1-Nov-2021
https://dl.acm.org/doi/10.1145/3472883.3487014
Bermejo BJuiz CGuerrero C(2019)Virtualization and consolidationThe Journal of Supercomputing10.1007/s11227-018-2613-175:2(808-836)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1007/s11227-018-2613-1
Velusamy GLent R(2017)Smart load-balancer for web applicationsProceedings of the 2017 International Conference on Smart Digital Environment10.1145/3128128.3128132(19-26)Online publication date: 21-Jul-2017
https://dl.acm.org/doi/10.1145/3128128.3128132
Mohamed M(2016)Service replication taxonomy in distributed environmentsService Oriented Computing and Applications10.1007/s11761-015-0189-710:3(317-336)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1007/s11761-015-0189-7
Ma SLee WChen PLi C(2016)Framework for Enhancing Mobile Availability of RESTful ServicesMobile Networks and Applications10.1007/s11036-015-0655-721:2(337-351)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.1007/s11036-015-0655-7
Amelina NFradkov AYuming Jiang Vergados D(2015)Approximate Consensus in Stochastic Networks With Application to Load BalancingIEEE Transactions on Information Theory10.1109/TIT.2015.240632361:4(1739-1752)Online publication date: 1-Apr-2015
https://dl.acm.org/doi/10.1109/TIT.2015.2406323
Nakai AMadeira EBuzato L(2015)On the Use of Resource Reservation for Web Services Load BalancingJournal of Network and Systems Management10.1007/s10922-014-9303-y23:3(502-538)Online publication date: 1-Jul-2015
https://dl.acm.org/doi/10.1007/s10922-014-9303-y
Kontogiannis SKarakos A(2014)ALBLInternational Journal of Communication Networks and Distributed Systems10.5555/2661487.266148913:2(144-168)Online publication date: 1-Jul-2014
https://dl.acm.org/doi/10.5555/2661487.2661489
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents