Performance Characterization of MQTT Brokers in a Device-Local Edge Deployment
Authors: 
Guillaume Simard, Cédric Melançon, Patrick Cardinal, Julien Gascon-SamsonAuthors Info & Claims
Pages 13 - 18
Abstract
The Message Queuing Telemetry Transport (MQTT) protocol is prevalent in the IoT landscape, as it can be used to dynamically interconnect the entities that produce and consume data (i.e., sensors and services/actuators) with easy-to-use abstractions and programming paradigms. In addition to its popularity for handling networked communications, MQTT can also be used to disseminate data towards different services located onto the same device, which can provide a significant amount of flexibility due to the malleable nature of the dynamic subscriptions. This paper presents a detailed performance comparison of four popular MQTT brokers over the use case of an autonomous robot that produces and disseminates data at a high volume and with a high frequency towards various locally deployed services. Our methodology considers various combinations of parameters, and we present a detailed characterization of different performance metrics, both under normal broker operation and peak load.
References
[1]
[n. d.]. gopsutil package - Go Packages. https://pkg.go.dev/github.com/shirou/gopsutil/v3
[2]
[n. d.]. HiveMQ CE is a Java-based open source MQTT broker that fully supports MQTT 3.x and MQTT 5. https://github.com/hivemq/hivemq-community-edition
[3]
2015. Benchmark of MQTT servers. (2015). www.scalagent.com
[4]
Melvin Bender, Erkin Kirdan, Marc Oliver Pahl, and Georg Carle. 2021. Open-source MQTT evaluation. CCNC 2021 (1 2021). https://doi.org/10.1109/CCNC49032.2021.9369499
[5]
Zhuo Chen, Chao Jiang, and Yi Guo. 2018. Pedestrian-Robot Interaction Experiments in an Exit Corridor. 2018 15th International Conference on Ubiquitous Robots, UR 2018 (2 2018), 29--34. https://doi.org/10.1109/URAI.2018.8441839
[6]
S Cousins. 2010. ROS on the PR2 [ROS Topics]. IEEE Robotics & Automation Magazine 17, 3 (2010). https://doi.org/10.1109/mra.2010.938502
[7]
Davi L. De Oliveira, Artur F. Da Veloso, Jose V.V. Sobral, Ricardo A.L. Rabelo, Joel J.P.C. Rodrigues, and Petar Solic. 2019. Performance evaluation of mqtt brokers in the internet of things for smart cities. SpliTech (6 2019). https://doi.org/10.23919/SPLITECH.2019.8783166
[8]
Jasenka Dizdarević, Marc Michalke, and Admela Jukan. 2023. Engineering and Experimentally Benchmarking Open Source MQTT Broker Implementations. (5 2023). https://arxiv.org/abs/2305.13893v1
[9]
Maurice Fallon, Hordur Johannsson, Michael Kaess, and John J Leonard. 2013. The MIT Stata Center dataset. The International Journal of Robotics Research 32, 14 (12 2013), 1695--1699. https://doi.org/10.1177/0278364913509035
[10]
Daniel Happ, Niels Karowski, Thomas Menzel, Vlado Handziski, and Adam Wolisz. 2017. Meeting IoT platform requirements with open pub/sub solutions. Annales des Telecommunications/Annals of Telecommunications 72, 1-2 (2 2017), 41--52. https://doi.org/10.1007/S12243-016-0537-4/FIGURES/5
[11]
Heiko Koziolek, Sten Grüner, and Julius Rückert. 2020. A Comparison of MQTT Brokers for Distributed IoT Edge Computing. In Lecture Notes in Computer Science. Vol. 12292 LNCS. 352--368. https://doi.org/10.1007/978-3-030-58923-3{_}23
[12]
Alexandr Krylovskiy. 2022. MQTT benchmarking tool. https://github.com/krylovsk/mqtt-benchmark
[13]
Edoardo Longo, Alessandro Enrico Cesare Redondi, Matteo Cesana, and Pietro Manzoni. 2022. BORDER: A Benchmarking Framework for Distributed MQTT Brokers. IEEE Internet of Things Journal 9, 18 (9 2022), 17728--17740. https://doi.org/10.1109/JIOT.2022.3155872
[14]
Cédric Melançon, Kuljeet Kaur, Julien Gascon-Samson, and Maarouf Saad. 2023. Towards Smart Distributed Robotics Solution using Digital Twin. (9 2023), 1--6. https://doi.org/10.1109/PEDS57185.2023.10246745
[15]
Biswajeeban Mishra. 2018. Performance Evaluation of MQTT Broker Servers. In Lecture Notes in Computer Science. Vol. 10963 LNCS. 599--609. https://doi.org/10.1007/978-3-319-95171-3{_}47
[16]
Biswajeeban Mishra, Biswaranjan Mishra, and Attila Kertesz. 2021. Stress-Testing MQTT Brokers: A Comparative Analysis of Performance Measurements. Energies 14, 5817 (9 2021), 5817. https://doi.org/10.3390/EN14185817
[17]
OASIS Standard. 2016. Information technology --- Message Queuing Telemetry Transport (MQTT) v3.1.1. Technical Report. International Organization for Standardization. http://docs.oasis-open.org/mqtt/mqtt/v3.1.1/os/mqtt-v3.1.1-os.html
[18]
N. Sai Lohitha and M. Pounambal. 2023. Integrated publish/subscribe and push-pullmethod for cloud based IoT framework for real time data processing. Measurement: Sensors 27 (6 2023), 100699. https://doi.org/10.1016/J.MEASEN.2023.100699
[19]
Guojie Yang, Mian Ahmad Jan, Ateeq Ur Rehman, Muhammad Babar, Mian Muhammad Aimal, and Sahil Verma. 2020. Interoperability and Data Storage in Internet of Multimedia Things: Investigating Current Trends, Research Challenges and Future Directions. IEEE Access 8 (2020), 124382--124401. https://doi.org/10.1109/ACCESS.2020.3006036
Index Terms
- Performance Characterization of MQTT Brokers in a Device-Local Edge Deployment
Recommendations
A Comparison of MQTT Brokers for Distributed IoT Edge Computing
Software ArchitectureAbstractMany enterprise IoT application scenarios, such as connected cars, smart cities, and cloud-connected industrial plants require distributed MQTT brokers to achieve high scalability and availability. With a market of over 20 MQTT brokers, it is hard ...
Authentication mechanisms for IoT system based on distributed MQTT brokers: review and challenges
AbstractWith the rapid growth of internet connected devices and the tremendous amount of data that could be generated and exchanged in IoT environment, we need to reconsider in the current IoT architecture that based on Cloud computing system, to avoid ...
IoT Protocols – MQTT versus CoAP
NISS '21: Proceedings of the 4th International Conference on Networking, Information Systems & SecurityThe usage of Internet of Things has increased in the recent years allowing a new way of connecting devices together. Many transactions happen over the IoT calling for protocols to ensure the efficiency and management of the communication traffic. This ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2023
31 pages
ISBN:9798400704512
DOI:10.1145/3630180
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
- IFIP: International Federation for Information Processing
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 December 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Middleware '23
Sponsor:
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 55Total Downloads
- Downloads (Last 12 months)21
- Downloads (Last 6 weeks)1
Reflects downloads up to 13 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in