ShutPub: Publisher-side Filtering for Content-based Pub/Sub on the Edge
Abstract
The pub/sub paradigm facilitates communication among heterogeneous edge and IoT devices for distributed edge applications. At the same time, the increasing number of devices and sensors at the edge leads to higher network congestion, which requires more processing power for both pub/sub brokers and devices. While message filtering based on subscriber-specified rules can alleviate this, implementing filtering logic on the brokers still requires publishing components to send all messages over constrained links.
In this paper, we instead propose filtering pub/sub messages directly on the publisher, in order to reduce network congestion. We present ShutPub, a publisher-side middleware that performs message filtering before forwarding them to the broker. ShutPub limits the publisher message dissemination based on subscriptions and their filters while still being transparent to the publisher. In this way, the content-based filter capabilities are moved from the broker to the publisher so that only messages that have a receiver are transmitted. Our prototype evaluation shows that ShutPub can reduce system strain on the network and broker without simply shifting the burden to the publisher, which benefits from sending fewer messages.
References
[1]
Carlos E. Arruda, Pedro F. Moraes, Nazim Agoulmine, and Joberto S. B. Martins. 2021. Enhanced Pub/Sub Communications for Massive IoT Traffic with SARSA Reinforcement Learning. In Proceedings of the International Conference on Machine Learning for Networking (MLN 2021). Springer, Cham, Switzerland, 204--225. https://doi.org/10.1007/978-3-030-70866-5_13
[2]
David Bermbach, Frank Pallas, David García Pérez, Pierluigi Plebani, Maya Anderson, Ronen Kat, and Stefan Tai. 2017. A Research Perspective on Fog Computing. In Proceedings of the 2nd Workshop on IoT Systems Provisioning & Management for Context-Aware Smart Cities (Malaga, Spain) (ISYCC 2017). Springer, Cham, Switzerland, 198--210. https://doi.org/10.1007/978-3-319-91764-1_16
[3]
Antonio Carzaniga, David S. Rosenblum, and Alexander L. Wolf. 2001. Design and evaluation of a wide-area event notification service. ACM Trans. Comput. Syst. 19, 3 (Aug. 2001), 332--383. https://doi.org/10.1145/380749.380767
[4]
Lisi Chen, Shuo Shang, Zhiwei Zhang, Xin Cao, Christian S. Jensen, and Panos Kalnis. 2018. Location-Aware Top-k Term Publish/Subscribe. In Proceedings of the 2018 IEEE 34th International Conference on Data Engineering (Paris, France) (ICDE '18). IEEE, New York, NY, USA, 749--760. https://doi.org/10-1109/ICDE.2018.00073
[5]
Kyu Bong Cho, Sung Keun Song, and Hee Yong Youn. 2007. Publisher-side Event Filtering for QoS-Awareness in Ubiquitous Computing. In Proceedings of the 2007 International Conference on Computational Science and its Applications (Kuala Lumpur, Malaysia) (ICCSA '07). IEEE, New York, NY, USA, 361--366. https://doi.org/10.1109/ICCSA.2007.51
[6]
Ivan Čilić and Ivana Podnar Žarko. 2022. Adaptive Data-Driven Routing for Edge-to-Cloud Continuum: A Content-Based Publish/Subscribe Approach. In Proceedings of the Global IoT Summit 2022 (Dublin, Ireland) (GIoTS 2022). Springer, Cham, Switzerland, 29--42. https://doi.org/10.1007/978-3-031-20936-9_3
[7]
Ivan Čilić and Ivana Podnar Žarko. 2022. Adaptive Data-Driven Routing for Edge-to-Cloud Continuum: A Content-Based Publish/Subscribe Approach. In Global IoT Summit. Springer, 29--42.
[8]
Cédric du Mouza and Nicolas Travers. 2018. Relevant Filtering in a Distributed Content-based Publish/Subscribe System. In NoSQL Data Models: Trends and Challenges. Wiley Data and Cybersecurity, 203--244.
[9]
Eli Fidler, Hans-Arno Jacobsen, Guoli Li, and Serge Mankovski. 2005. The PADRES Distributed Publish/Subscribe System. In Principles and Applications of Distributed Event-Based Systems. IGI Global, 12--30.
[10]
Martin Grambow, Jonathan Hasenburg, and David Bermbach. 2018. Public Video Surveillance: Using the Fog to Increase Privacy. In Proceedings of the 5th Workshop on Middleware and Applications for the Internet of Things (Rennes, France) (M4IoT '18). Association for Computing Machinery, New York, NY, USA, 11--14. https://doi.org/10.1145/3286719.3286722
[11]
Daniel Happ and Suzan Bayhan. 2020. On the impact of clustering for IoT analytics and message broker placement across cloud and edge. In Proceedings of the Third ACM International Workshop on Edge Systems, Analytics and Networking (Heraklion, Greece) (EdgeSys '20). Association for Computing Machinery, New York, NY, USA, 43--48. https://doi.org/10.1145/3378679.3394538
[12]
Jonathan Hasenburg and David Bermbach. 2020. DisGB: Using Geo-Context Information for Efficient Routing in Geo-Distributed Pub/Sub Systems. In Proceedings of the 13th IEEE/ACM International Conference on Utility and Cloud Computing (Leicester, United Kingdom) (UCC 2020). IEEE, New York, NY, USA, Dec. https://doi.org/10.1109/UCC48980.2020.00026
[13]
Jonathan Hasenburg and David Bermbach. 2020. GeoBroker: Leveraging Geo-Context for IoT Data Distribution. Elsevier Computer Communications 151 (Feb. 2020), 473--484. https://doi.org/10.1016/j.comcom.2020.01.015
[14]
Jonathan Hasenburg, Martin Grambow, and David Bermbach. 2020. Towards A Replication Service for Data-Intensive Fog Applications. In Proceedings of the 35th ACM Symposium on Applied Computing, Posters Track (Brno, Czech Republic) (SAC '20). Association for Computing Machinery, New York, NY, USA, 267--270. https://doi.org/10.1145/3341105.3374060
[15]
Jonathan Hasenburg, Florian Stanek, Florian Tschorsch, and David Bermbach. 2020. Managing Latency and Excess Data Dissemination in Fog-Based Publish/Subscribe Systems. In Proceedings of the Second IEEE International Conference on Fog Computing (Sydney, NSW, Australia) (ICFC 2020). IEEE, New York, NY, USA, 9--16. https://doi.org/10.1109/ICFC49376.2020.00010
[16]
Sayed Hadi Hashemi, Faraz Faghri, Paul Rausch, and Roy H Campbell. 2016. World of empowered IoT users. In Proceedings of the 2016 IEEE First International Conference on Internet-of-Things Design and Implementation (Berlin, Germany) (IoTDI '16). IEEE, New York, NY, USA, 13--24. https://doi.org/10.1109/IoTDI.2015.39
[17]
Yafei Li, Lei Gao, Haobo Sun, Huiling Li, and Qingshun Wu. 2022. PRID: An Efficient Pub/Sub Ride Hitching System. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (Atlanta, GA, USA) (CIKM '22). Association for Computing Machinery, New York, NY, USA, 4921--4925. https://doi.org/10.1145/3511808.3557213
[18]
Yanhong Li, Wang Zhang, Rongbo Zhu, Guohui Li, Maode Ma, Lihchyun Shu, and Changyin Luo. 2018. Fog-based pub/sub index with Boolean expressions in the internet of industrial vehicles. IEEE Transactions on Industrial Informatics 15, 3 (Sept. 2018), 1629--1642. https://doi.org/10.1109/TII.2018.2868720
[19]
Yanhong Li, Wang Zhang, Rongbo Zhu, Guohui Li, Maode Ma, Lihchyun Shu, and Changyin Luo. 2019. Fog-Based Pub/Sub Index With Boolean Expressions in the Internet of Industrial Vehicles. IEEE Transactions on Industrial Informatics 15, 3 (Sept. 2019), 1629--1642. https://doi.org/10.1109/TII.2018.2868720
[20]
Pezhman Nasirifard and Hans-Arno Jacobsen. 2022. A Serverless Publish/Subscribe System. (Oct. 2022). arXiv:2210.07897
[21]
Shunya Nishio, Daichi Amagata, and Takahiro Hara. 2022. Lamps: Location-Aware Moving Top-k Pub/Sub. IEEE Transactions on Knowledge and Data Engineering 34, 1 (March 2022), 352--364. https://doi.org/10.1109/TKDE.2020.2979176
[22]
Frank Pallas, Philip Raschke, and David Bermbach. 2020. Fog Computing as Privacy Enabler. IEEE Internet Computing 24, 4 (March 2020), 15--21. https://doi.org/10.1109/MIC.2020.2979161
[23]
Tobias Pfandzelter and David Bermbach. 2023. Enoki: Stateful Distributed FaaS from Edge to Cloud. In Proceedings of the 2nd International Workshop on Middleware for the Edge. 19--24.
[24]
Tobias Pfandzelter, Jonathan Hasenburg, and David Bermbach. 2021. From Zero to Fog: Efficient Engineering of Fog-Based Internet of Things Applications. Software: Practice and Experience 51, 8 (June 2021), 1798--1821. https://doi.org/10.1002/spe.3003
[25]
Shiyou Qian, Jian Cao, Yanmin Zhu, and Minglu Li. 2014. Rein: A fast event matching approach for content-based publish/subscribe systems. In Proceedings of the IEEE Conference on Computer Communications (Toronto, ON, Canada) (INFOCOM 2014). IEEE, New York, NY, USA, 2058--2066. https://doi.org/10.1109/INFOCOM.2014.6848147
[26]
Shiyou Qian, Jian Cao, Yanmin Zhu, Minglu Li, and Jie Wang. 2014. H-tree: An efficient index structure for event matching in content-based publish/subscribe systems. IEEE Transactions on Parallel and Distributed Systems 26, 6 (May 2014), 1622--1632. https://doi.org/10.1109/TPDS.2014.2323262
[27]
Shiyou Qian, Weichao Mao, Jian Cao, Frédéric Le Mouël, and Minglu Li. 2019. Adjusting Matching Algorithm to Adapt to Workload Fluctuations in Content-based Publish/Subscribe Systems. In Proceedings of the IEEE Conference on Computer Communications (Paris, France) (INFOCOM 2019). IEEE, New York, NY, USA, 1936--1944. https://doi.org/10.1109/INFOCOM.2019.8737647
[28]
Thomas Rausch, Stefan Nastic, and Schahram Dustdar. 2018. EMMA: Distributed QoS-Aware MQTT Middleware for Edge Computing Applications. In Proceedings of the 2018 IEEE International Conference on Cloud Engineering (Orlando, FL, USA) (IC2E). IEEE, New York, NY, USA, 191--197. https://doi.org/10.1109/IC2E.2018.00043
[29]
Wanghua Shi and Shiyou Qian. 2022. HEM: A Hardware-Aware Event Matching Algorithm for Content-Based Pub/Sub Systems. In Proceedings of the International Conference on Database Systems for Advanced Applications (DASFAA 2022). Springer, Cham, Switzerland, 277--292. https://doi.org/10.1007/978-3-031-00123-9_23
[30]
Sasu Tarkoma. 2012. Publish/Subscribe Systems: Design and Principles. John Wiley & Sons Ltd., Chichester, UK.
[31]
Minghe Wang, Trever Schirmer, Tobias Pfandzelter, and David Bermbach. 2023. Lotus: Serverless In-Transit Data Processing for Edge-based Pub/Sub. In Proceedings of the 6th International Workshop on Edge Systems, Analytics and Networking (Rome, Italy) (EdgeSys '23). ACM, New York, NY, USA. https://doi.org/10.1145/3578354.3592869
[32]
Kaiwen Zhang, Mohammad Sadoghi, Vinod Muthusamy, and Hans-Arno Jacobsen. 2017. Efficient covering for top-k filtering in content-based publish/subscribe systems. In Proceedings of the 18th ACM/IFIP/USENIX Middleware Conference (Las Vegas, NV, USA) (Middleware '17). Association for Computing Machinery, New York, NY, USA, 174--184. https://doi.org/10.1145/3135974.3135976
Index Terms
- ShutPub: Publisher-side Filtering for Content-based Pub/Sub on the Edge
Recommendations
GraPS: A Graph Publish/Subscribe Middleware
Middleware '15: Proceedings of the 16th Annual Middleware ConferencePub/sub is an elegant paradigm for disseminating information efficiently and anonymously among producers (publishers) and consumers (subscribers). However, with current topic and content-based pub/sub approaches it is difficult to formulate ...
Performance of publish/subscribe middleware in mobile wireless networks
WOSP '04: Proceedings of the 4th international workshop on Software and performancePublish/subscribe middlewares are becoming popular for distributed applications because of their flexible and scalable nature. Anonymous and loosely-coupled communication between publisher and subscriber, along with the inherently asynchronous nature of ...
StreamHub: a massively parallel architecture for high-performance content-based publish/subscribe
DEBS '13: Proceedings of the 7th ACM international conference on Distributed event-based systemsBy routing messages based on their content, publish/subscribe (pub/sub) systems remove the need to establish and maintain fixed communication channels. Pub/sub is a natural candidate for designing large-scale systems, composed of applications running in ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
April 2024
67 pages
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 April 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
EuroSys '24
Sponsor:
Acceptance Rates
EdgeSys '24 Paper Acceptance Rate 10 of 23 submissions, 43%;
Overall Acceptance Rate 10 of 23 submissions, 43%
Upcoming Conference
EuroSys '25
- Sponsor:
- sigops
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 166Total Downloads
- Downloads (Last 12 months)166
- Downloads (Last 6 weeks)28
Reflects downloads up to 26 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in