research-article

Free access

The tail at scale

Authors:

Jeffrey Dean,

Luiz André BarrosoAuthors Info & Claims

Communications of the ACM, Volume 56, Issue 2

Pages 74 - 80

https://doi.org/10.1145/2408776.2408794

Published: 01 February 2013 Publication History

All formats PDF

Abstract

Software techniques that tolerate latency variability are vital to building responsive large-scale Web services.

References

[1]

Barroso, L.A. and Höelzle, U. The case for energy proportional computing. IEEE Computer 40, 12 (Dec. 2007), 33--37.

Digital Library

Google Scholar

[2]

Barroso, L.A. and Höelzle, U. The Datacenter as a Computer: An Introduction to the Design of Warehouse-scale Machines. Synthesis Series on Computer Architecture, Morgan & Claypool Publishers, May 2009.

Digital Library

Google Scholar

[3]

Card, S.K., Robertson, G.G., and Mackinlay, J.D. The information visualizer: An information workspace. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (New Orleans, Apr. 28--May 2). ACM Press, New York, 1991, 181--188.

Digital Library

Google Scholar

[4]

Chang F., Dean J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., and Gruber, R.E. BigTable: A distributed storage system for structured data. In Proceedings of the Seventh Symposium on Operating Systems Design and Implementation (Seattle, Nov.). USENIX Association, Berkeley CA, 2006, 205--218.

Digital Library

Google Scholar

[5]

Charles, J., Jassi, P., Ananth, N.S., Sadat, A., and Fedorova, A. Evaluation of the Intel Core i7 Turbo Boost feature. In Proceedings of the IEEE International Symposium on Workload Characterization (Austin, TX, Oct. 4--6). IEEE Computer Society Press, 2009, 188--197.

Digital Library

Google Scholar

[6]

DeWitt, D.J., Naughton, J.F., Schneider, D.A., and Seshadri, S. Practical skew handling in parallel joins. In Proceedings of the 18^th International Conference on Very Large Data Bases, Li-Yan Yuan, Ed. (Vancouver, BC, Aug. 24--27). Morgan Kaufmann Publishers, Inc., San Francisco, 1992, 27--40.

Digital Library

Google Scholar

[7]

Google, Inc. Project Glass; http://g.co/projectglass

Google Scholar

[8]

Lamport, L. The part-time parliament. ACM Transactions on Computer Systems 16, 2 (May 1998), 133--169.

Digital Library

Google Scholar

[9]

Lumb, C.R. and Golding, R. D-SPTF: Decentralized request distribution in brick-based storage systems. SIGOPS Operating System Review 38, 5 (Oct. 2004), 37--47.

Digital Library

Google Scholar

[10]

Mitzenmacher, M. The power of two choices in randomized load balancing. IEEE Transactions on Parallel and Distributed Computing 12, 10 (Oct. 2001), 1094--1104.

Digital Library

Google Scholar

[11]

Mudge, T. and Hölzle, U. Challenges and opportunities for extremely energy-efficient processors. IEEE Micro 30, 4 (July 2010), 20--24.

Digital Library

Google Scholar

[12]

Stoica I., Morris, R., Karger, D., Kaashoek, F., and Balakrishnan, H. Chord: A scalable peer-to-peer lookup service for Internet applications. In Proceedings of SIGCOMM (San Diego, Aug. 27--31). ACM Press, New York, 2001, 149--160.

Digital Library

Google Scholar

Cited By

View all

Li NXu LFang GMa Y(2024)Fault-tolerant Coded Quantum Chemical Distributed CalculationActa Chimica Sinica10.6023/A2311049682:2(138)Online publication date: 2024
https://doi.org/10.6023/A23110496
Zeng QNan ZZhou S(2024)Adaptive Privacy-Preserving Coded Computing with Hierarchical Task PartitioningEntropy10.3390/e2610088126:10(881)Online publication date: 21-Oct-2024
https://doi.org/10.3390/e26100881
Ravikumar DYeo AZhu YLakra ANagulapalli HRavindran SSuh SDutta NFogarty APark YKhushalani STarafdar AParekh KKrishnan S(2024)Intelligent Pooling: Proactive Resource Provisioning in Large-scale Cloud ServiceProceedings of the VLDB Endowment10.14778/3654621.365462917:7(1618-1627)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.14778/3654621.3654629
Show More Cited By

Index Terms

The tail at scale

Recommendations

Scalable cache memory design for large-scale SMT architectures
WMPI '04: Proceedings of the 3rd workshop on Memory performance issues: in conjunction with the 31st international symposium on computer architecture

The cache hierarchy design in existing SMT and superscalar processors is optimized for latency, but not for band-width. The size of the L1 data cache did not scale over the past decade. Instead, larger unified L2 and L3 caches were introduced. This ...
A Hierarchical Directory Scheme for Large-Scale Cache-Coherent Multipmcessors
IPPS '92: Proceedings of the 6th International Parallel Processing Symposium

Cache coherence problem is a major design issue for shared-memory multiprocessors. As the system size scales, traditional bus-based snoopy cache coherence schemes are no longer adequate. Instead, the directory-based scheme is a promising approach to ...
μManycore: A Cloud-Native CPU for Tail at Scale
ISCA '23: Proceedings of the 50th Annual International Symposium on Computer Architecture

Microservices are emerging as a popular cloud-computing paradigm. Microservice environments execute typically-short service requests that interact with one another via remote procedure calls (often across machines), and are subject to stringent tail-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

Communications of the ACM Volume 56, Issue 2

February 2013

95 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/2408776

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 February 2013

Published in CACM Volume 56, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,447
Total Citations
View Citations
122,615
Total Downloads

Downloads (Last 12 months)10,797
Downloads (Last 6 weeks)1,750

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Li NXu LFang GMa Y(2024)Fault-tolerant Coded Quantum Chemical Distributed CalculationActa Chimica Sinica10.6023/A2311049682:2(138)Online publication date: 2024
https://doi.org/10.6023/A23110496
Zeng QNan ZZhou S(2024)Adaptive Privacy-Preserving Coded Computing with Hierarchical Task PartitioningEntropy10.3390/e2610088126:10(881)Online publication date: 21-Oct-2024
https://doi.org/10.3390/e26100881
Ravikumar DYeo AZhu YLakra ANagulapalli HRavindran SSuh SDutta NFogarty APark YKhushalani STarafdar AParekh KKrishnan S(2024)Intelligent Pooling: Proactive Resource Provisioning in Large-scale Cloud ServiceProceedings of the VLDB Endowment10.14778/3654621.365462917:7(1618-1627)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.14778/3654621.3654629
Ng NSouza AAli-Eldin AIrwin DTowsley DShenoy P(2024)TailClipper: Reducing Tail Response Time of Distributed Services Through System-Wide SchedulingProceedings of the 2024 ACM Symposium on Cloud Computing10.1145/3698038.3698554(398-414)Online publication date: 20-Nov-2024
https://dl.acm.org/doi/10.1145/3698038.3698554
Xie MQian CLitz H(2024)En4S: Enabling SLOs in Serverless Storage SystemsProceedings of the 2024 ACM Symposium on Cloud Computing10.1145/3698038.3698529(160-177)Online publication date: 20-Nov-2024
https://dl.acm.org/doi/10.1145/3698038.3698529
Vijayakumar SMadhavapeddy AKalyvianaki E(2024)Scheduling for Reduced Tail Task Latencies in Highly Utilized DatacentersProceedings of the 2024 ACM Symposium on Cloud Computing10.1145/3698038.3698522(302-321)Online publication date: 20-Nov-2024
https://dl.acm.org/doi/10.1145/3698038.3698522
Kim TAthlur SKadekodi SMaturana FDelvira DMerchant AGanger GRashmi KWitchel EArpaci-Dusseau ARossbach CKeeton K(2024)Morph: Efficient File-Lifetime Redundancy Management for Cluster File SystemsProceedings of the ACM SIGOPS 30th Symposium on Operating Systems Principles10.1145/3694715.3695981(330-346)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3694715.3695981
Giridharan NSuri-Payer FAbraham IAlvisi LCrooks NWitchel EArpaci-Dusseau ARossbach CKeeton K(2024)Autobahn: Seamless high speed BFTProceedings of the ACM SIGOPS 30th Symposium on Operating Systems Principles10.1145/3694715.3695942(1-23)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3694715.3695942
Tang SXiang MWang YWu BChen JLiu TFilkov VRay BZhou M(2024)Scaler: Efficient and Effective Cross Flow AnalysisProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695473(907-918)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695473
Wong ABucci PBeschastnikh IFedorova A(2024)Making Sense of Multi-threaded Application Performance at Scale with NonSequiturProceedings of the ACM on Programming Languages10.1145/36897938:OOPSLA2(2325-2354)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3689793
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Scalable cache memory design for large-scale SMT architectures

A Hierarchical Directory Scheme for Large-Scale Cache-Coherent Multipmcessors

μManycore: A Cloud-Native CPU for Tail at Scale

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Digital Edition

Magazine Site

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations