research-article

A High Performance, Scalable DNS Service for Very Large Scale Container Cloud Platforms

Authors:

Huasong ShanAuthors Info & Claims

Middleware '18: Proceedings of the 19th International Middleware Conference Industry

Pages 39 - 45

https://doi.org/10.1145/3284028.3284034

Published: 10 December 2018 Publication History

Abstract

Containers and microservices are dominating the world of data center and cloud computing. As the scale, dynamism and complexity grow, the performance of the DNS system in container clusters becomes vital. As the world's third and China's largest e-commerce site by revenue, JD.com runs one of the world's largest Kubernetes container clusters in production. It is imperative that the DNS system can handle extremely high traffic. In this paper, we present ContainerDNS, a high performance DNS system for very large scale container clusters with millions of containers. ContainerDNS maximizes DNS system performance and scalability by optimizing DNS packet processing and using efficient memory and cache management.

ContainerDNS has been deployed in JD's container platform with 30,000 servers and 500,000 containers running tens of thousands of services and applications. It improves the maximum throughput from 130,000 to 9,000,000 QPS, a 67X performance boost comparing to existing DNS systems.

Supplementary Material

MP4 File (p39-ding.mp4)

Download
114.12 MB

References

[1]

{n. d.}. CoreDNS. "https://coredns.io/".

[2]

{n. d.}. Docker. "https://www.docker.com/".

[3]

{n. d.}. DPDK. "https://dpdk.org/".

[4]

{n. d.}. Jmeter. "https://github.com/apache/jmeter".

[5]

{n. d.}. Kube-dns. "https://github.com/kubernetes/kubernetes/tree/master/cluster/addons/dns".

[6]

{n. d.}. Kubernetes. "https://kubernetes.io/".

[7]

{n. d.}. perfquery. "https://linux.die.net/man/8/perfquery".

[8]

{n. d.}. Qugga. "https://www.quagga.net/".

[9]

{n. d.}. SkyDNS. "https://github.com/skynetservices/skydns".

[10]

{n. d.}. Swarm. "https://docs.docker.com/engine/swarm/".

[11]

Charles Edward Anderson IV, Thomas Carroll Willis Jr, and Jason Andrew Willis. 2006. System, method and computer program product for caching domain name system information on a network gateway. US Patent 7,152,118.

[12]

Roy Arends, Rob Austein, Matt Larson, Dan Massey, and Scott Rose. 2005. DNS security introduction and requirements. Technical Report.

[13]

Armin Balalaie, Abbas Heydarnoori, and Pooyan Jamshidi. 2015. Migrating to cloud-native architectures using microservices: an experience report. In European Conference on Service-Oriented and Cloud Computing. Springer, 201--215.

[14]

Armin Balalaie, Abbas Heydarnoori, and Pooyan Jamshidi. 2016. Microservices architecture enables devops: Migration to a cloud-native architecture. IEEE Software 33, 3 (2016), 42--52.

Digital Library

[15]

David Bernstein. 2014. Containers and cloud: From lxc to docker to kubernetes. IEEE Cloud Computing 3 (2014), 81--84.

[16]

Eric A Brewer. 2015. Kubernetes and the path to cloud native. In Proceedings of the Sixth ACM Symposium on Cloud Computing. ACM, 167--167.

Digital Library

[17]

Thomas Brisco. 1995. DNS support for load balancing. (1995).

[18]

Peter B Danzig, Katia Obraczka, and Anant Kumar. 1992. An analysis of wide-area name server traffic: a study of the Internet Domain Name System. ACM SIGCOMM Computer Communication Review 22, 4 (1992), 281--292.

Digital Library

[19]

Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D Joseph, Randy H Katz, Scott Shenker, and Ion Stoica. 2011. Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center. In NSDI, Vol. 11. 22--22.

Digital Library

[20]

Bill Karakostas. 2013. A DNS architecture for the internet of things: A case study in transport logistics. Procedia Computer Science 19 (2013), 594--601.

[21]

Paul Mockapetris and Kevin J Dunlap. 1988. Development of the domain name system. Vol. 18. ACM.

Digital Library

[22]

Claus Pahl. 2015. Containerization and the paas cloud. IEEE Cloud Computing 2, 3 (2015), 24--31.

[23]

Robert Sandoval et al. 2015. A case study in enabling DevOps using Docker. Ph.D. Dissertation.

[24]

Eric Sven-Johan Swildens, Richard David Day, and Vikas Garg. 2004. Scalable domain name system with persistence and load balancing. US Patent 6,754,706.

[25]

Johannes Thönes. 2015. Microservices. IEEE software 32, 1 (2015), 116--116.

[26]

Roland van Rijswijk-Deij, Mattijs Jonker, Anna Sperotto, and Aiko Pras. 2016. A High-Performance, Scalable Infrastructure for Large-Scale Active DNS Measurements. IEEE Journal on Selected Areas in Communications 34, 6 (2016), 1877--1888.

[27]

Brian Wellington. 2000. Secure domain name system (DNS) dynamic update. Technical Report.

Digital Library

Cited By

Bardinelli JZhang YSu JHuang LParilla AJarvi RKulkarni SZhang W(2024)hyDNS: Acceleration of DNS Through Kernel Space ResolutionProceedings of the ACM SIGCOMM 2024 Workshop on eBPF and Kernel Extensions10.1145/3672197.3673439(58-64)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3672197.3673439
Li ZGao SPeng ZGuo SYang YXiao B(2021)B-DNS: A Secure and Efficient DNS Based on the Blockchain TechnologyIEEE Transactions on Network Science and Engineering10.1109/TNSE.2021.30687888:2(1674-1686)Online publication date: 1-Apr-2021
https://doi.org/10.1109/TNSE.2021.3068788
Shiraishi TNoro MKondo RTakano YOguchi N(2020)Real-time Monitoring System for Container Networks in the Era of Microservices2020 21st Asia-Pacific Network Operations and Management Symposium (APNOMS)10.23919/APNOMS50412.2020.9237055(161-166)Online publication date: Sep-2020
https://doi.org/10.23919/APNOMS50412.2020.9237055

Index Terms

A High Performance, Scalable DNS Service for Very Large Scale Container Cloud Platforms
1. Networks
  1. Network architectures
    1. Network design principles
      1. Naming and addressing
  2. Network services
    1. Cloud computing

Recommendations

Performance-aware server architecture recommendation and automatic performance verification technology on IaaS cloud

In this paper, we propose a server architecture recommendation and automatic performance verification technology, which recommends and verifies appropriate server architecture on Infrastructure as a Service (IaaS) cloud with bare metal servers, ...
The Journey of Cloud Computing with Open Source
UCC '19 Companion: Proceedings of the 12th IEEE/ACM International Conference on Utility and Cloud Computing Companion

Cloud computing is changing from a buzz word to a common technology nowadays. Though there is clarification for cloud computing for three types/layers: Infrastructure as a Service (IaaS), Platform as a Service (PaaS), Software as a Service (SaaS), ...
AWS EC2 vs. Joyent's Triton: A Comparison of Docker Container-hosting Platforms
ScienceCloud '17: Proceedings of the 8th Workshop on Scientific Cloud Computing

Containers, and in particular Docker, have emerged as promising addition and in some cases, alternative to virtual machines (VMs) for application deployment in cloud environments. Docker containers enable massive scalability and rapid deployment of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

Middleware '18: Proceedings of the 19th International Middleware Conference Industry

December 2018

64 pages

ISBN:9781450360166

DOI:10.1145/3284028

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ACM: Association for Computing Machinery
USENIX Assoc: USENIX Assoc
IFIP: International Federation for Information Processing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 December 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

Middleware '18

Sponsor:

ACM
USENIX Assoc
IFIP

Middleware '18: 19th International Middleware Conference

December 10 - 14, 2018

Rennes, France

Acceptance Rates

Overall Acceptance Rate 203 of 948 submissions, 21%

Upcoming Conference

MIDDLEWARE '24

25th International Middleware Conference

December 2 - 6, 2024

Hong Kong , Hong Kong

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
312
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)1

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bardinelli JZhang YSu JHuang LParilla AJarvi RKulkarni SZhang W(2024)hyDNS: Acceleration of DNS Through Kernel Space ResolutionProceedings of the ACM SIGCOMM 2024 Workshop on eBPF and Kernel Extensions10.1145/3672197.3673439(58-64)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3672197.3673439
Li ZGao SPeng ZGuo SYang YXiao B(2021)B-DNS: A Secure and Efficient DNS Based on the Blockchain TechnologyIEEE Transactions on Network Science and Engineering10.1109/TNSE.2021.30687888:2(1674-1686)Online publication date: 1-Apr-2021
https://doi.org/10.1109/TNSE.2021.3068788
Shiraishi TNoro MKondo RTakano YOguchi N(2020)Real-time Monitoring System for Container Networks in the Era of Microservices2020 21st Asia-Pacific Network Operations and Management Symposium (APNOMS)10.23919/APNOMS50412.2020.9237055(161-166)Online publication date: Sep-2020
https://doi.org/10.23919/APNOMS50412.2020.9237055

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents