Abstract
Lightweight real-time network communication is crucial for commodity cluster systems and embedded control systems. This paper introduces the design, implementation and evaluation of SS-RTUDP, a novel zero-copy data path based real-time communication protocol with efficient communication resources management. To avoid unpredictable overheads during SS-RTUDP packets transmission, all communication resources are pre-allocated. A feasible fragmentation mechanism is also proposed for transmitting SS-RTUDP packets larger than the network MTU. On the other hand, the additional real-time traffic smoother provides high priorities to SS-RTUDP packets and also smoothes peak packets arrival curve. The prototype of SS-RTUDP is implemented under Linux systems and performance evaluations over Fast/Gigabit Ethernet are provided. The measurement results prove that SS-RTUDP can provide not only much lower latency and higher communication bandwidth than traditional UDP protocol, but also good real-time network communication performance for commodity cluster systems.
This paper is supported by National 863 Hi-Tech R&D Project under grant No.2002AA 1Z2102.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Di, S., Zheng, W.: Reduced Communication Protocol for Clusters. In: Proceedings of Advances in Parallel and Distributed Computing, Shanghai, China, pp. 314–319 (1997)
Buyya, R.: High Performance Cluster Computing Architectures and Systems, 1st edn., vol. 1, pp. 182–184. Prentice-Hall, Inc., USA (1999)
Diaz, F., Ortega, J., Canas, A., Fernandez, F.J., Anguita, M., Prieto, A.: The lightweight protocol CLIC on Gigabit Ethernet. In: Proceedings of International Parallel and Distributed Processing Symposium (IPDPS 2003) (April 2003)
Christian, K., Michel, M., Felix, R.: Speculative Defragmentation − A Technique to Improve the Communication Software Efficiency for Gigabit Ethernet. In: Proceedings of the 9th International Symposium on High-Performance Distributed Computing, Pittsburgh, PA, USA, pp. 131–138 (2000)
Skevik, K.A., Thomas, P., Plagemann, G., Goebel, V., Halvorsen, P.: Evaluation of a Zero-Copy Protocol Implementation. In: Proceedings of the 27th EUROMICRO Conference, Warsaw, Poland, pp. 324–330 (2001)
Chiola, G., Ciaccio, G.: Efficient parallel processing on low-cost clusters with GAMMA active ports. Parallel Computing 26, 333–354 (2000)
Díaz, F., Ortega, J., Cañas, A., Fernández, F.J., Prieto, A.: The Lightweight Protocol CLIC: Performance of an MPI implementation on CLIC. In: IEEE International Conference on Cluster Computing (CLUSTER 2001), October 2001, pp.391–398 (2001)
Ghouas, K., Omang, K., Bugge, H.: VIA over SCI - Consequences of a Zero Copy Implementation, and Comparison with VIA over Myrinet. In: Proceedings of the 15th International Parallel and Distributed Processing Symposium (IPDPS 2001), San Francisco, California, USA, pp. 1632–1639 (2001)
Chen, Y., Jiao, Z.Q., Xie, J., Du, Z.H., Li, S.L.: Design and Implementation of a High Performance VIA Based on Myrinet. Journal of Software 14(2), 285–292 (2003)
Pakin, S., Karacheti, V., Chien, A.: Fast Messages (FM): Efficient, Portable Communication for Workstation Clusters and Massively-Parallel Processors. IEEE Parallel and Distributed Technlogy 5(2) (April/June 1997)
Prylli, L., Tourancheau, B.: BIP: a new protocol designed for high performance networking on Myrinet. In: Proceedings of Workshop PC-NOW at IPPS/SPDP 1998, pp. 472–485 (April 1998)
Eicken, T., Basu, A., Buch, V., Vogels, W.: U-Net: a user-level network interface for parallel and distributed computing. In: Proceedings of the 15th ACM Symposium on Operating Systems Principles (SOSP 1995) (December 1995)
Bhoedjang, R.A.F., Rühl, T., Bal, H.E.: User-level Network Interface Protocols. IEEE Computer, 53–60 (November 1998)
Clark, D., Jacobson, V., Romkey, J., Salwen, H.: An Analysis of TCP Processing Overhead. IEEE Communications Magazine 27(6), 23–29 (1989)
Chou, C., Shin, K.G.: Statistical real_time channels on multiaccess networks. IEEE Transaction on Parallel and Distributed Systems 8, 769–780 (1997)
Cruz, R.L.: A Calculus for network delay, Part I: Network Elements in Isolation. IEEE Transaction on Information Theory 37(1), 114–131 (1991)
NetPIPE: A Network Protocol Independent Performance Evaluator, http://www.scl.ameslab.gov/netpipe/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jin, H., Zhang, M., Tan, P., Chen, H., Xu, L. (2005). Lightweight Real-Time Network Communication Protocol for Commodity Cluster Systems. In: Yang, L.T., Amamiya, M., Liu, Z., Guo, M., Rammig, F.J. (eds) Embedded and Ubiquitous Computing – EUC 2005. EUC 2005. Lecture Notes in Computer Science, vol 3824. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11596356_107
Download citation
DOI: https://doi.org/10.1007/11596356_107
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30807-2
Online ISBN: 978-3-540-32295-5
eBook Packages: Computer ScienceComputer Science (R0)