Nothing Special   »   [go: up one dir, main page]
Skip to main content

Advertisement

Springer Nature Link
Log in

Providing overlay-based multicast in data center networks with optional millimeter wavelength links

  • Published:
Telecommunication Systems Aims and scope Submit manuscript

Abstract

Efficient multicast support is very important in data center (DC) networks, as many big data systems in data centers are bandwidth-hungry. Multicast implementations in DC networks are usually overlay-based. The major challenges are how can we accurately infer the topology of DC networks with both wired and wireless millimeter wavelength (MMW) links and how to design multicast algorithm for these topologies. In this paper, we first use hierarchical clustering to accurately infer the topology. Then, we propose the Inter-Rack First Multicast (IRFM) algorithm to match the fan-in nature of DC topologies. Evaluation results demonstrate that IRFM is \(3.7{-}11.2{\times }\) faster than naive multicast implementations in the pure wired case, and \(4.8{-}14.6{\times }\) faster in the case of MMW enhancement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Li, D., Cui, H., Hu, Y., Xia, Y., & Wang, X. (2011). Scalable data center multicast using multi-class bloom filter. In 2011 19th IEEE international conference on network protocols (pp. 266–275). New York: IEEE.

  2. Li, D., Li, Y., Wu, J., Su, S., & Esm, J. Y. (2012). Efficient and scalable data center multicast routing. IEEE/ACM Transactions on Networking (TON), 20(3), 944–955.

    Article  Google Scholar 

  3. Li, X., & Freedman, M. J. (2013) Scaling IP multicast on datacenter topologies. In Proceedings of the 9th ACM conference on emerging networking experiments and technologies (pp. 61–72). New York: ACM.

  4. Data Distribution Service. http://portals.omg.org/dds/.

  5. Fan, L., Cao, P., Almeida, J., & Broder, A. Z. (2000). Summary cache: A scalable wide-area web cache sharing protocol. IEEE/ACM Transactions on Networking (TON), 8(3), 281–293.

    Article  Google Scholar 

  6. Zhou, Y., Wilkinson, D., Schreiber, R., & Pan, R. (2008). Large-scale parallel collaborative filtering for the netflix prize. In International conference on algorithmic applications in management (pp. 337–348). Berlin: Springer.

  7. Gates, A. F., Natkovich, O., Chopra, S., Kamath, P., Narayanamurthy, S. M., Olston, C., et al. (2009). Building a high-level dataflow system on top of map-reduce: The pig experience. Proceedings of the VLDB Endowment, 2(2), 1414–1425.

    Article  Google Scholar 

  8. McBride, M., & Liu, H. (2012). Multicast in the data center overview. https://datatracker.ietf.org/doc/draft-ietf-mboned-dc-deploy/.

  9. Chokkalingam, A., & Riyaz, F. (2004). BitTorrent protocol specification v1. 0. CSI 5321.

  10. Qiu, D., & Srikant, R. (2004). Modeling and performance analysis of BitTorrent-like peer-to-peer networks. In ACM SIGCOMM computer communication review (Vol. 34, pp. 367–378). New York: ACM.

  11. Beloglazov, A., & Buyya, R. (2010). Energy efficient resource management in virtualized cloud data centers. In Proceedings of the 2010 10th IEEE/ACM international conference on cluster, cloud and grid computing (pp. 826–831). New York: IEEE Computer Society.

  12. Al-Fares, M., Loukissas, A., & Vahdat, A. (2008). A scalable, commodity data center network architecture. In ACM SIGCOMM computer communication review (Vol. 38, pp. 63–74). New York: ACM.

  13. Alizadeh, M., & Edsall, T. (2013). On the data path performance of leaf-spine datacenter fabrics. In 2013 IEEE 21st annual symposium on high-performance interconnects (pp. 71–74). New York: IEEE.

  14. Petrini, F., & Vanneschi, M. (1997). k-ary n-trees: High performance networks for massively parallel architectures. In Proceedings 11th international parallel processing symposium (pp. 87–93). New York: IEEE.

  15. Greenberg, A., Hamilton, J. R., Jain, N., Kandula, S., Kim, C., Lahiri, P., et al. (2009). Vl2: A scalable and flexible data center network. In ACM SIGCOMM.

  16. Singh, A., Ong, J., Agarwal, A., Anderson, G., Armistead, A., Bannon, R., et al. (2015). Jupiter rising: A decade of clos topologies and centralized control in Google’s datacenter network. In Proceeding of the ACM SIGDC 2015 (pp. 183–197). New York: ACM.

    Article  Google Scholar 

  17. Adhikari, P. (2008). Understanding millimeter wave wireless communication. San Diego: Loea Corporation.

    Google Scholar 

  18. Rappaport, T. S., Heath, R. W, Jr., Daniels, R. C., & Murdock, J. N. (2014). Millimeter wave wireless communications. London: Pearson Education.

    Google Scholar 

  19. Shi, J.-W., Huang, C.-B., & Pan, C.-L. (2011). Millimeter-wave photonic wireless links for very high data rate communication. NPG Asia Materials, 3(4), 41.

    Article  Google Scholar 

  20. Bhattacharyya, S., Keshav, S., & Seth, A. (August 3, 2010). Opportunistic data transfer over heterogeneous wireless networks. US Patent 7,769,887.

  21. Katayama, Y., Takano, K., Kohda, Y., Ohba, N., & Nakano, D. (2011). Wireless data center networking with steered-beam mmwave links. In 2011 IEEE wireless communications and networking conference (pp. 2179–2184). New York: IEEE.

  22. Vardhan, H., Thomas, N., Ryu, S. R., Banerjee, B., & Prakash, R. (2010). Wireless data center with millimeter wave network. In 2010 IEEE global telecommunications conference GLOBECOM 2010 (pp. 1–6). New York: IEEE.

  23. Halperin, D., Kandula, S., Padhye, J., Bahl, P., & Wetherall, D. (2011). Augmenting data center networks with multi-gigabit wireless links. In ACM SIGCOMM computer communication review (Vol. 41, pp. 38–49). New York: ACM.

  24. Hamedazimi, N., Qazi, Z., Gupta, H., Sekar, V., Das, S. R., Longtin, J. P., et al. (2014). Firefly: A reconfigurable wireless data center fabric using free-space optics. In ACM SIGCOMM computer communication review (Vol. 44, pp. 319–330). New York: ACM.

    Article  Google Scholar 

  25. Wang, X., Kong, L., Kong, F., Qiu, F., Xia, M., Arnon, S., et al. (2018). Millimeter wave communication: A comprehensive survey. IEEE Communications Surveys and Tutorials, 20(3), 1616–1653.

    Article  Google Scholar 

  26. Zhou, X., Zhang, Z., Zhu, Y., Li, Y., Kumar, S., Vahdat, A., et al. (2012). Mirror mirror on the ceiling: Flexible wireless links for data centers. ACM SIGCOMM Computer Communication Review, 42(4), 443–454.

    Article  Google Scholar 

  27. Jiang, D., Huo, L., Lv, Z., Song, H., & Qin, W. (2018). A joint multi-criteria utility-based network selection approach for vehicle-to-infrastructure networking. IEEE Transactions on Intelligent Transportation Systems, 99, 1–15.

    Google Scholar 

  28. Jiang, D., Li, W., & Lv, H. (2017). An energy-efficient cooperative multicast routing in multi-hop wireless networks for smart medical applications. Neurocomputing, 220, 160–169.

    Article  Google Scholar 

  29. Cui, Y., Wang, H., Cheng, X., Li, D., & Ylä-Jääski, A. (2013). Dynamic scheduling for wireless data center networks. IEEE Transactions on Parallel and Distributed Systems, 24(12), 2365–2374.

    Article  Google Scholar 

  30. Yi, X., Liu, F., Liu, J., & Jin, H. (2014). Building a network highway for big data: Architecture and challenges. IEEE Network, 28(4), 5–13.

    Article  Google Scholar 

  31. Li, D., Yu, J., Yu, J., & Wu, J. (2011). Exploring efficient and scalable multicast routing in future data center networks. In INFOCOM, 2011 proceedings IEEE (pp. 1368–1376). New York: IEEE.

  32. Chowdhury, M., Zaharia, M., Ma, J., Jordan, M. I., & Stoica, I. (2011). Managing data transfers in computer clusters with orchestra. In ACM SIGCOMM computer communication review (Vol. 41, pp. 98–109). New York: ACM.

  33. Yu, T., Noghabi, S. A., Raindel, S., Liu, H., Padhye, J., & Sekar, V. (2016). Freeflow: High performance container networking. In Proceedings of the 15th ACM workshop on hot topics in networks (pp. 43–49). New York: ACM.

  34. Jiang, D., Huo, L., & Song, H. (2018). Rethinking behaviors and activities of base stations in mobile cellular networks based on big data analysis. IEEE Transactions on Network Science and Engineering. (Early Access).

  35. Jiang, D., Huo, L., & Li, Y. (2018). Fine-granularity inference and estimations to network traffic for SDN. PLoS ONE, 13(5), e0194302.

    Article  Google Scholar 

  36. Nie, L., Jiang, D., & Xu, Z. (2013). A compressive sensing-based reconstruction approach to network traffic. Computers and Electrical Engineering, 39(5), 1422–1432.

    Article  Google Scholar 

  37. Mao, Y., & Saul, L. K. (2004). Modeling distances in large-scale networks by matrix factorization. In Proceedings of the 4th ACM SIGCOMM conference on internet measurement (pp. 278–287). New York: ACM.

  38. Kruskal, J. B., & Wish, M. (1978). Multidimensional scaling. Quantitative applications in the social. Beverly Hills: Sage University Papers Series.

    Book  Google Scholar 

  39. Mclust. http://www.stat.washington.edu/mclust/.

  40. Fraley, C., Raftery, A., Murphy, T., & Scrucca, L. (2012). mclust version 4 for R: Normal mixture modeling for model-based clustering, classification, and density estimation. Seattle: University of Washington.

    Google Scholar 

  41. HDFS. https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html.

Download references

Acknowledgements

The authors would like to thank anonymous reviewers for their valuable comments. This research is supported by the National Key R&D Program of China 2018YFB1003505, the National Natural Science Foundation of China under Grant Nos. 61602194, 61772265, and 61802172, the Collaborative Innovation Center of Novel Software Technology and Industrialization, and the Jiangsu Innovation and Entrepreneurship (Shuangchuang) Program.

Author information

Authors and Affiliations

  1. School of Modern Posts, Nanjing University of Posts and Telecommunications, Nanjing, 210046, China

    Yi Wang

  2. State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, 210023, China

    Bingquan Wang & Chen Tian

  3. School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing, 210046, China

    Fu Xiao

Authors
  1. Yi Wang
    View author publications

    Search author on:PubMed Google Scholar

  2. Bingquan Wang
    View author publications

    Search author on:PubMed Google Scholar

  3. Chen Tian
    View author publications

    Search author on:PubMed Google Scholar

  4. Fu Xiao
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Chen Tian.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Y., Wang, B., Tian, C. et al. Providing overlay-based multicast in data center networks with optional millimeter wavelength links. Telecommun Syst 73, 95–104 (2020). https://doi.org/10.1007/s11235-019-00601-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11235-019-00601-8

Keywords