Article

SEDA: an architecture for well-conditioned, scalable internet services

Authors:

Eric BrewerAuthors Info & Claims

SOSP '01: Proceedings of the eighteenth ACM symposium on Operating systems principles

Pages 230 - 243

https://doi.org/10.1145/502034.502057

Published: 21 October 2001 Publication History

Abstract

We propose a new design for highly concurrent Internet services, which we call the staged event-driven architecture (SEDA). SEDA is intended to support massive concurrency demands and simplify the construction of well-conditioned services. In SEDA, applications consist of a network of event-driven stages connected by explicit queues. This architecture allows services to be well-conditioned to load, preventing resources from being overcommitted when demand exceeds service capacity. SEDA makes use of a set of dynamic resource controllers to keep stages within their operating regime despite large fluctuations in load. We describe several control mechanisms for automatic tuning and load conditioning, including thread pool sizing, event batching, and adaptive load shedding. We present the SEDA design and an implementation of an Internet services platform based on this architecture. We evaluate the use of SEDA through two applications: a high-performance HTTP server and a packet router for the Gnutella peer-to-peer file sharing network. These results show that SEDA applications exhibit higher performance than traditional service designs, and are robust to huge variations in load.

References

[1]

Akamai, Inc. h t t p : //www. akamai, coma]]

[2]

America Online Press Data Points. http ://corp.aol,com /press/ press datapoints.html.]]

[3]

Digital Island, Inc. http : //www. digitalisland, com/.]]

[4]

Acme Labs. thttpd: Tiny/Turbo{rhrottling HTrP Server. http : //www. acrae, com/software/tht tpd/.]]

[5]

T. Anderson, B. Bershad, E. Lazowska, and H. Levy. Scheduler activations: Effective kernel support for the user-level management of parallelism. ACM Transactions on Computer Systems, 10(1):53-79, February 1992.]]

Digital Library

[6]

Apache Software Foundation. The Apache web server, http : //www. apache, org.]]

[7]

G. Banga, E Druschel, and J. Mogul. Resource containers: A new facility for resource management in server systems. In Prec. Third Symposium on Operating Systems Design and Implementation ( OSDI '99), February 1999.]]

Digital Library

[8]

G.BangaandJ. C. Mogul. Scalable kernel performance for lnternet servers under realistic loads. In Prec. 1998 Annual Usenix Technical Conference, New Orleans, LA, June 1998.]]

Digital Library

[9]

G. Banga, J. C. Mogul, and P. Druscbel. A scalable and explicit event delivery mechanism for UNIX. In Prec. USENIX 1999 Annual Technical Conference, Monterey, CA, June 1999.]]

Digital Library

[10]

BEA Systems. BEA WebLogic. http://www.beasys.com/ product s/weblogic/.]]

[11]

B. Bershad, S. Savage, R Pardyak, E. G. Sirer, D. Becker, M. Fiuczynski, C. Chambers, and S. Eggers. Extensibility, safety and performance in the SPIN operating system. In Prec. 15th ACM Symposium on Operating System Principles (SOSP-15), 1995.]]

Digital Library

[12]

A. Chankhunthod, P. B. Danzig, C. Neerdaels, M. E Schwartz, and K. J. Worrell. A hierarchical Internet object cache. In Prec. 1996 Usenix Annual Technical Conference, pages 153-163, January 1996.]]

Digital Library

[13]

Y. Chen, J. Edler, A. Goldberg, A. Gottlieb, S. Sobti, and P. Yianilos. A prototype implementation of archival Intermemory. In Prec. Fourth ACM Conference on Digital Libraries (DL "99), Berkeley, CA, 1999.]]

Digital Library

[14]

I. Clarke, O. Sandberg, B. Wiley, and T. W. Hong. Freenet: A distributed anonymous information storage and retrieval system in designing privacy enhancing technologies. In Prec. ICSI Workshop on Design Issues in Anonymity and Unobservability, Berkeley, CA, 2000.]]

Digital Library

[15]

M. Crovella, R. Frangioso, and M. Harchol-Balter. Connection scheduling in Web servers. In Prec. 1999 USENIX Symposium on lnternet Technologies and Systems ( USITS "99), October 1999.]]

Digital Library

[16]

M.L. Dertouzos. The future of computing. Scientific American, July 1999.]]

[17]

S. Floyd and V. Jacobsen. Random early detection gateways for congestion avoidance. IEEE/ACM Transactions on Networking, 1(4):397-413, August 1993.]]

Digital Library

[18]

A. Fox, S. D. Gribble, Y. Chawathe, E. A. Brewer, andP. Gauthier. Clusterbased scalable network services. In Prec. 16th ACM Symposium on Operating Systems Principles, St.-Male, France, October 1997.]]

Digital Library

[19]

Gnutella. http : //gnutella .wego. com.]]

[20]

S. Oribble, E. Brewer, J. Hellersteln, and D. Culler. Scalable, distributed data structures for interact service construction. In Prec. Fourth Symposium on Operating Systems Design and Implementation ( OSD12000), October 2000.]]

Digital Library

[21]

S. Gribble, M. Welsh, R. yon Behren, E. Brewer, D. Culler, N. Borisov, S. Czerwinski, R. Gummadi, J. Hill, A. Joseph, R. Katz, Z. Mao, S. Ross, and B. Zhao. The Ninja architecture for robust Intemet-scale systems and services. Computer Networks, June 2000. Special Issue on Pervasive Computing.]]

Digital Library

[22]

Hewlett-Packard Corporation. e-speak Open Services Platform. http: //www. e- speak, net/.]]

[23]

J. Hu, S. Mungee, and D. Schmidt. Techniques for developing and measuring high-performance Web servers over ATM networks. In Prec. IN- FOCOM '98, March/April 1998.]]

[24]

J. C. Hu, I. Pyarali, and D. C. Schmidt. High performance Web servers on Windows NT: Design and performance. In Prec. USENIX Windows NT Workshop 1997, August 1997.]]

Digital Library

[25]

IBM Corporation. IBM WebSphere Application Server. http :// www-4, ibm. com/so f tware/webservers/.]]

[26]

S. M. Inc. Java Server Pages API. http://java.sun.com/ product s /jsp.]]

[27]

R. Jain, D. Chiu, and W. Hawe. A quantitative measure of fairness and discrimination for resource allocation in shared computer systems. Technical Report TR-301, DEC Research, September 1984.]]

[28]

M. E Kaashoek, D. R. Engler, G. R. Ganger, H. M. Briceflo, R. Hunt, D. Mazieres, T. Pinckney, R. Grimm, J. Jannotti, and K. Mackenzie. Application performance and flexibility on Exokernel systems. In Prec. 16th ACM Symposium on Operating Systems Principles (SOSP '97), October 1997.]]

Digital Library

[29]

D. Kegel. The C10K problem, http://www.kegel .com/cl0k. html.]]

[30]

J. Kubiatowicz, D. Bindel, Y. Chen, S. Czervinski, R Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, and B. Zhao. OceanStore: An architecture for global-scale persistent storage. In Proc. Ninth international Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2000), November 2000.]]

Digital Library

[31]

J. Larus and M. Parkes. Using cohort scheduling to enhance server performance. Technical Report MSR-TR-2001-39, Microsoft Research, March 2001.]]

[32]

H. Lauer and R. Needhant On the duality of operating system structures. In Proc. Second International Symposium on Operating Systems, IRIA, October 1978.]]

[33]

J. Lemon. FreeBSD kernel event queue patch, http://www. flugsvamp,com/~jlemon/fbsd/.]]

[34]

I. Leslie, D. McAuley, R. Black, T. Roscoe, E Barbara, D. Evers, R. Fairbairns, and E. Hyden. The design and implementation of an operating system to support distributed multimedia applications. IEEE Journal on Selected Areas in Communications, 14:1280-1297, September 1996.]]

Digital Library

[35]

A. S. Lett and W L. Konigsford. TSS/360: A time-shared operating system. In Proc. Fall Joint Computer Conference, Volume 33, Part 1, pages 15-28, 1968.]]

Digital Library

[36]

M. Lutz. Programming Python. O'Reilly and Associates, March 2001.]]

Digital Library

[37]

Microsoft Corporation. DCOM Technical Overview. h t t p : //msdn. mi croso ft. com/I ibrary/backgrnd/html/msdn_ dcomt ec. htm.]]

[38]

Microsoft Corporation. IIS 5.0 Overview. http ://w. microsoft, com/windows2000 / i ibrary/howitworks / iis / iis5techove%rview, asp.]]

[39]

J. C. Mogul. The case for persistent-connection HTrP. In Prec. ACM SIGCOMM'95, October 1995.]]

Digital Library

[40]

R. Morris, E. Kohler, J. Jannotti, and M. E Kaashoek. The Click modular router. In Proc. 17th ACM Symposium on Operating Systems Principles (SOSP '99), pages 217-231, Kiawah Island, South Carolina, December 1999.]]

Digital Library

[41]

D. Mosberger and L. Peterson. Making paths explicit in the Scout operating system. In Proc. OSDI '96, October 1996.]]

Digital Library

[42]

Netscape Corporation. Netscape Enterprise Server. http: //home. net scape, com/enterprise/v3.6 / index, html.]]

[43]

K. Ogata. Modern Control Engineering. Prentice Hall, 1997.]]

Digital Library

[44]

V.S. Pal, P. Druschel, and W. Zwaenepoel. Flash: An efficient and portable Web server. In Proc. 1999 Annual Usenix Technical Conference, June 1999.]]

Digital Library

[45]

S. Parekh, N. Gandhi, J. L. Hellerstein, D. Tilbury, T. Jayram, and J. Bigus. Using control theory to achieve service level objectives in performance management. In Proc. IFIP/IEEE International Symposium on Integrated Network Management, Seattle, WA, May 2001.]]

[46]

N. Provos and C. Lever. Scalable network I/O in Linux. Technical Report CITI-TR-00-4, University of Michigan Center for Information Technology Integration, May 2000.]]

[47]

X. Qie, A. Bavier, L. Peterson, and S. Karlin. Scheduling computations on a software-based router. In Proc. SIGMETRICS 2001, June 2001.]]

Digital Library

[48]

M. Russinovich. Inside lgO completion ports, http://www. sysinternals, com/comport, htm.]]

[49]

O. Spatscheck and L. Petersen. Defending against denial of service attacks in Scout. In Proc. 3rd Symposium on Operating Systems Design and Implementation, February 1999.]]

Digital Library

[50]

Standard Performance Evaluation Corporation. The SPECweb99 benchmark. http : //www. spec. org/osg/web99/.]]

[51]

D.C. Steere, A. Goel, J. Gruenberg, D. McNamee, C. Pu, and J. Walpole. A feedback-driven proportion allocator for real-rate scheduling. In Proc. 3rd Usenix Symposium on Operating Systems Design and Implementation (0SD1'99), pages 145-158, 1999.]]

Digital Library

[52]

Sun Microsystems. RPC: Remote Procedure Call Protocol Specification Version 2. Internet Network Working Group RFC1057, June 1988.]]

Digital Library

[53]

Sun Microsysterns Inc. Enterprise Java Beans Technology. http :// java. sun. com/products/ejb/.]]

[54]

Sun Microsystems, Inc. Java Remote Method Invocation. http:// java.sun.com/products/jdk/rmi/.]]

[55]

Sun Microsysterns Inc. Jini Connection Technology. http: //www. sun. com/j ini/.]]

[56]

M. Vandevoorde and E. Roberts. Work crows: An abstraction for controlling parallelism. Technical Report Research Report 42, Digital Equipment Corporation Systems Research Center, February 1988.]]

[57]

T. Voigt, R. Tewari, D. Freimuth, and A. Mehra. Kernel mechanisms for service differentiation in overloaded Web servers. In Proc. 2001 USENIX Annual Technical Conference, Boston, June 2001.]]

Digital Library

[58]

L. A. Wald and S. Schwarz. The 1999 Southern California Seismic Network Bulletin. Seismological Research Letters, 71(4), July/August 2000.]]

[59]

D. A. Wallach, D. R. Engler, and M. E Kaashoek. ASHs: Applicationspecific handlers for high-performance messaging. In Proc. ACM SIG- COMM '96 Conference: Applications, Technologies, Architectures, and Protocols for Computer Communication, pages 40-52, Stanford, California, August 1996.]]

Digital Library

[60]

M. Welsh. NBIO: Nonhlocking I/O for Java. http: //www.cs. berkeley, edu/~mdw/pro j / java- nbio.]]

[61]

M. Welsh and D. Culler. Virtualization considered harmful: OS design directions for well-conditioned services. In Proc. 8th Workshop on Hot Topics in Operating Systems (HotOS VIII), Schloss Elmau, Germany, May 2001.]]

Digital Library

[62]

Yahoo! Inc. Yahoo! reports Second Quarter 2001 financial results, http : //docs. yahoo, com/docs/pr / rel ease794, html.]]

[63]

Zeus Technology. Zeus Web Server. http://www.zeus.co.uk/ products/ws/.]]

Cited By

Ma LLiu ZXiong JWu YChen RPeng XZhang YZhang GJiang D(2024)zQoS: Unleashing full performance capabilities of NVMe SSDs while enforcing SLOs in distributed storage systemsProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673156(618-628)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3673038.3673156
Santhanam KRaghavan DRahman MVenkatesh TKunjal NThaker PLevis PZaharia M(2024)ALTOProceedings of the 4th Workshop on Machine Learning and Systems10.1145/3642970.3655844(117-125)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3642970.3655844
Canon LDugois AMarchal LRivière E(2023)Hector: A Framework to Design and Evaluate Scheduling Strategies in Persistent Key-Value StoresProceedings of the 52nd International Conference on Parallel Processing10.1145/3605573.3605614(535-545)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3605573.3605614
Show More Cited By

Index Terms

SEDA: an architecture for well-conditioned, scalable internet services
1. Networks
  1. Network architectures
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Process management
        Concurrency control
        Scheduling

Recommendations

SEDA: an architecture for well-conditioned, scalable internet services

We propose a new design for highly concurrent Internet services, which we call the staged event-driven architecture (SEDA). SEDA is intended to support massive concurrency demands and simplify the construction of well-conditioned services. In SEDA, ...
SEDA: a system for search, exploration, discovery, and analysis of XML Data

Keyword search in XML repositories is a powerful tool for interactive data exploration. Much work has recently been done on making XML search aware of relationship information embedded in XML document structure, but without a clear winner in all data ...
The Effect of Artificial Neural Network Model Combined with Six Tumor Markers in Auxiliary Diagnosis of Lung Cancer

To evaluate the diagnosis potential of artificial neural network (ANN) model combined with six tumor markers in auxiliary diagnosis of lung cancer, to differentiate lung cancer from lung benign disease, normal control, and gastrointestinal cancers. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '01: Proceedings of the eighteenth ACM symposium on Operating systems principles

October 2001

254 pages

ISBN:1581133898

DOI:10.1145/502034

General Chair:
Keith Marzullo
University of California, San Diego
,
Program Chair:
M. Satyanarayanan
Carnegie Mellon University and Intel Research, Pittsburgh

ACM SIGOPS Operating Systems Review Volume 35, Issue 5
Dec. 2001
243 pages
ISSN:0163-5980
DOI:10.1145/502059
Issue’s Table of Contents

Copyright © 2001 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2001

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SOSP01

Sponsor:

SIGOPS

SOSP01: 18th Symposium on Operating System Principles

October 21 - 24, 2001

Alberta, Banff, Canada

Acceptance Rates

SOSP '01 Paper Acceptance Rate 17 of 85 submissions, 20%;

Overall Acceptance Rate 131 of 716 submissions, 18%

Upcoming Conference

SOSP '24

Sponsor:
sigops

ACM SIGOPS 30th Symposium on Operating Systems Principles

November 4 - 6, 2024

Austin , TX , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

678
Total Citations
View Citations
4,699
Total Downloads

Downloads (Last 12 months)113
Downloads (Last 6 weeks)8

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ma LLiu ZXiong JWu YChen RPeng XZhang YZhang GJiang D(2024)zQoS: Unleashing full performance capabilities of NVMe SSDs while enforcing SLOs in distributed storage systemsProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673156(618-628)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3673038.3673156
Santhanam KRaghavan DRahman MVenkatesh TKunjal NThaker PLevis PZaharia M(2024)ALTOProceedings of the 4th Workshop on Machine Learning and Systems10.1145/3642970.3655844(117-125)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3642970.3655844
Canon LDugois AMarchal LRivière E(2023)Hector: A Framework to Design and Evaluate Scheduling Strategies in Persistent Key-Value StoresProceedings of the 52nd International Conference on Parallel Processing10.1145/3605573.3605614(535-545)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3605573.3605614
Wei TTurtayeva NOrenes-Vera MLonkar OBalkind JAamodt TJerger NSwift M(2023)Cohort: Software-Oriented Acceleration for Heterogeneous SoCsProceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 310.1145/3582016.3582059(105-117)Online publication date: 25-Mar-2023
https://dl.acm.org/doi/10.1145/3582016.3582059
Li HChen YShi XBai XMo NLi WGuo RWang ZSun YMohror KArnold DBadia R(2023)FISCO-BCOS: An Enterprise-grade Permissioned Blockchain System with High-performanceProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3581784.3607053(1-17)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3581784.3607053
Yang SLiu JArpaci-Dusseau AArpaci-Dusseau R(2023)Principled Schedulability Analysis for Distributed Storage Systems Using Thread Architecture ModelsACM Transactions on Storage10.1145/357432319:2(1-47)Online publication date: 6-Mar-2023
https://dl.acm.org/doi/10.1145/3574323
Distler TEischer MLawniczak L(2023)Micro Replication2023 53rd Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN)10.1109/DSN58367.2023.00024(123-137)Online publication date: Jun-2023
https://doi.org/10.1109/DSN58367.2023.00024
Doost-Mohammady RZhong LSabharwal A(2022)RenewGetMobile: Mobile Computing and Communications10.1145/3551670.355167426:2(12-18)Online publication date: 25-Jul-2022
https://dl.acm.org/doi/10.1145/3551670.3551674
Chen YYou Y(2022)Structured Concurrency: A ReviewWorkshop Proceedings of the 51st International Conference on Parallel Processing10.1145/3547276.3548519(1-8)Online publication date: 29-Aug-2022
https://dl.acm.org/doi/10.1145/3547276.3548519
Shao WYe BWang HParmer GRen Y(2022)Edge-RT: OS Support for Controlled Latency in the Multi-Tenant, Real-Time Edge2022 IEEE Real-Time Systems Symposium (RTSS)10.1109/RTSS55097.2022.00011(1-13)Online publication date: Dec-2022
https://doi.org/10.1109/RTSS55097.2022.00011
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents