research-article

Héctor: A Framework for Testing IoT Applications Across Heterogeneous Edge and Cloud Testbeds

Authors:

Lauritz Thamsen,

Odej KaoAuthors Info & Claims

UCC '19 Companion: Proceedings of the 12th IEEE/ACM International Conference on Utility and Cloud Computing Companion

Pages 15 - 20

https://doi.org/10.1145/3368235.3368832

Published: 02 December 2019 Publication History

Abstract

As a result of the many technical advances in microcomputers and mobile connectivity, the Internet of Things (IoT) has been on the rise in the recent decade. Due to the broad spectrum of applications, networks facilitating IoT scenarios can be of very different scale and complexity. Additionally, connected devices are uncommonly heterogeneous, including micro controllers, smartphones, fog nodes and server infrastructures. Therefore, testing IoT applications is difficult, motivating adequate tool support.

In this paper, we present Héctor, a framework for the automatic testing of IoT applications. Héctor allows the automated execution of user-defined experiments on agnostic IoT testbeds. To test applications independently of the availability of required devices, the framework is able to generate virtual testbeds with adjustable network properties. Our evaluations show that simple experiments can be easily automated across a broad spectrum of testbeds. However, the results also indicate that there is considerable interference in experiments, in which many devices are emulated, due to the high resource demand of system emulation.

References

[1]

Fabrice Bellard. 2005. QEMU, A Fast and Portable Dynamic Translator. In USENIX Annual Technical Conference, FREENIX Track, Vol. 41. 46.

Digital Library

[2]

Flavio Bonomi, Rodolfo Milito, Jiang Zhu, and Sateesh Addepalli. 2012. Fog Computing and Its Role in the Internet of Things. In First Edition of the MCC Workshop on Mobile Cloud Computing (MCC '12). 13--16.

[3]

Paris Carbone, Asterios Katsifodimos, Stephan Ewen, Volker Markl, Seif Haridi, and Kostas Tzoumas. 2015. Apache Flink: Stream and Batch Processing in a Single Engine. IEEE Data Engineering Bulletin, Vol. 36, 4 (2015).

[4]

B. Cheng, S. Longo, F. Cirillo, M. Bauer, and E. Kovacs. 2015. Building a Big Data Platform for Smart Cities: Experience and Lessons from Santander. In 2015 IEEE International Congress on Big Data (BigDataCongress '15). IEEE, 592--599.

[5]

Mitch Cherniack, Hari Balakrishnan, Magdalena Balazinska, Donald Carney, Ugur Cetintemel, Ying Xing, and Stanley B Zdonik. 2003. Scalable Distributed Stream Processing. In First Biennial Conference on Innovative Data Systems Research (CIDR), Vol. 3. 257--268.

[6]

Susanta Nanda Tzi-cker Chiueh and Stony Brook. 2005. A Survey on Virtualization Technologies. Rpe Report, Vol. 142 (2005).

[7]

Jo ao Pedro Dias, Flávio Couto, Ana CR Paiva, and Hugo Sereno Ferreira. 2018. A Brief Overview of Existing Tools for Testing the Internet-of-Things. In 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). IEEE, 104--109.

[8]

Jonathan Hasenburg, Martin Grambow, Elias Grünewald, Sascha Huk, and David Bermbach. 2019. MockFog: Emulating Fog Computing Infrastructure in the Cloud. In Proceedings of the First IEEE International Conference on Fog Computing .

[9]

Stephen Hemminger et almbox. 2005. Network Emulation with NetEm. In Linux Conference Australia . 18--23.

[10]

G. Janßen, I. Verbitskiy, T. Renner, and L. Thamsen. 2018. Scheduling Stream Processing Tasks on Geo-Distributed Heterogeneous Resources. In 2018 IEEE International Conference on Big Data (Big Data) . IEEE, 5159--5164.

[11]

Hermann Kopetz. 2011. Internet of Things .Springer, 307--323.

[12]

Jay Kreps, Neha Narkhede, Jun Rao, et almbox. 2011. Kafka: A Distributed Messaging System for Log Processing. In 6th International Workshop on Networking Meets Databases (NetDB). 1--7.

[13]

Shih-Chieh Lin, Yunqi Zhang, Chang-Hong Hsu, Matt Skach, Md E Haque, Lingjia Tang, and Jason Mars. 2018. The Architectural Implications of Autonomous Driving: Constraints and Acceleration. In 23rd International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'18). ACM, 751--766.

[14]

Vilen Looga, Zhonghong Ou, Yang Deng, and Antti Yl"a-J"a"aski. 2012. Mammoth: A Massive-Scale Emulation Platform for Internet of Things. In 2nd International Conference on Cloud Computing and Intelligence Systems, Vol. 3. IEEE, 1235--1239.

[15]

M. Ma, P. Wang, and C. Chu. 2013. Data Management for Internet of Things: Challenges, Approaches and Opportunities. In GreenCom/iThings/CPSCom 2013 . 1144--1151.

[16]

Fredrik Österlind, Adam Dunkels, Joakim Eriksson, Niclas Finne, and Thiemo Voigt. 2006. Cross-Level Sensor Network Simulation with Cooja. In Workshop on Practical Issues in Building Sensor Network Applications (SenseApp 2006). IEEE.

[17]

George F Riley and Thomas R Henderson. 2010. The ns-3 Network Simulator. In Modeling and Tools for Network Simulation. Springer, 15--34.

[18]

H. P. Sajjad, K. Danniswara, A. Al-Shishtawy, and V. Vlassov. 2016. SpanEdge: Towards Unifying Stream Processing over Central and Near-the-Edge Data Centers. In 2016 IEEE/ACM Symposium on Edge Computing (SEC). IEEE, 168--178.

[19]

M. Satyanarayanan. 2017. The Emergence of Edge Computing. Computer, Vol. 50, 1 (Jan 2017), 30--39.

[20]

Martin Serrano, Amelie Gyrard, Elias Tragos, and Hung Nguyen. 2018. FIESTAIoT Project: Federated Interoperable Semantic IoT/Cloud Testbeds and Applications. In The Web Conference 2018. Web Conferences Steering Committee, 425--426.

Digital Library

Cited By

Minani JSabir FMoha NGuéhéneuc Y(2024)A Systematic Review of IoT Systems Testing: Objectives, Approaches, Tools, and ChallengesIEEE Transactions on Software Engineering10.1109/TSE.2024.336361150:4(785-815)Online publication date: Apr-2024
https://doi.org/10.1109/TSE.2024.3363611
Lauwaerts TMarr SScholliers C(2024) LatchScience of Computer Programming10.1016/j.scico.2024.103157238:COnline publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1016/j.scico.2024.103157
Abdalzaher MKrichen MYiltas-Kaplan DBen Dhaou IAdoni W(2023)Early Detection of Earthquakes Using IoT and Cloud Infrastructure: A SurveySustainability10.3390/su15151171315:15(11713)Online publication date: 28-Jul-2023
https://doi.org/10.3390/su151511713
Show More Cited By

Index Terms

Héctor: A Framework for Testing IoT Applications Across Heterogeneous Edge and Cloud Testbeds

Recommendations

Secure Authentication and Reliable Cloud Storage Scheme for IoT-Edge-Cloud Integration
Abstract
The Internet of Things (IoT) devices are used in almost every aspect of life to automate routine or critical tasks with great precision. The IoT nodes, users, edge nodes, cloud resources, and the connected network are critical components of IoT-...
On the impact of clustering for IoT analytics and message broker placement across cloud and edge
EdgeSys '20: Proceedings of the Third ACM International Workshop on Edge Systems, Analytics and Networking

With edge computing emerging as a promising solution to cope with the challenges of Internet of Things (IoT) systems, there is an increasing need to automate the deployment of large-scale applications along with the publish/subscribe brokers they ...
The convergence and interplay of edge, fog, and cloud in the AI-driven Internet of Things (IoT)
Abstract
The Internet of Things (IoT) tsunami, public embracement, and the ubiquitous adoption of smart devices are affecting virtually every industry, directly or indirectly. The success of the current and future landscape of IoT and connected ...
Highlights
- IoT architectures: SDN, Fog Computing, Multi-Access Edge Computing, Cloudlet, Transparent Computing, Extreme Edge, etc.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UCC '19 Companion: Proceedings of the 12th IEEE/ACM International Conference on Utility and Cloud Computing Companion

December 2019

193 pages

ISBN:9781450370448

DOI:10.1145/3368235

General Chairs:
Kenneth Johnson
Auckland University of Technology, New Zealand
,
Josef Spillner
Zurich University of Applied Sciences, Switzerland
,
Program Chairs:
Dalibor Klusáček
CESNET
,
Ashiq Anjum
University of Derby

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE TCSC: IEEE Technical Committee on Scalable Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 December 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Bundesministerium für Bildung und Forschung

Conference

UCC '19

Sponsor:

SIGARCH
IEEE TCSC

UCC '19: IEEE/ACM 12th International Conference on Utility and Cloud Computing

December 2 - 5, 2019

Auckland, New Zealand

Acceptance Rates

Overall Acceptance Rate 38 of 125 submissions, 30%

Upcoming Conference

UCC '24

Sponsor:
sigarch

2024 IEEE/ACM 17th International Conference on Utility and Cloud Computing

December 16 - 19, 2024

Sharjah , United Arab Emirates

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
265
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)2

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Minani JSabir FMoha NGuéhéneuc Y(2024)A Systematic Review of IoT Systems Testing: Objectives, Approaches, Tools, and ChallengesIEEE Transactions on Software Engineering10.1109/TSE.2024.336361150:4(785-815)Online publication date: Apr-2024
https://doi.org/10.1109/TSE.2024.3363611
Lauwaerts TMarr SScholliers C(2024) LatchScience of Computer Programming10.1016/j.scico.2024.103157238:COnline publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1016/j.scico.2024.103157
Abdalzaher MKrichen MYiltas-Kaplan DBen Dhaou IAdoni W(2023)Early Detection of Earthquakes Using IoT and Cloud Infrastructure: A SurveySustainability10.3390/su15151171315:15(11713)Online publication date: 28-Jul-2023
https://doi.org/10.3390/su151511713
Ferreira VHerrera CSouza SSantos RSouza P(2023)Software Testing applied to the Development of IoT Systems: preliminary resultsProceedings of the 8th Brazilian Symposium on Systematic and Automated Software Testing10.1145/3624032.3624049(113-122)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3624032.3624049
Hasenburg JGrambow MBermbach D(2023)MockFog 2.0: Automated Execution of Fog Application Experiments in the CloudIEEE Transactions on Cloud Computing10.1109/TCC.2021.307498811:1(58-70)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TCC.2021.3074988
Ansari MAlam M(2023)IoT-Cloud-Enabled Smart Framework for Real-World ApplicationsIntelligent Systems and Applications10.1007/978-981-19-6581-4_8(87-105)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-981-19-6581-4_8
Wiesner PSteinke MNickel HKitana YKao O(2023)Software‐in‐the‐loop simulation for developing and testing carbon‐aware applicationsSoftware: Practice and Experience10.1002/spe.327553:12(2362-2376)Online publication date: 25-Sep-2023
https://doi.org/10.1002/spe.3275
Pfandzelter TBermbach DBellavista PZhang KGherbi ABagchi SPatiño MDi Modica GGascon-Samson J(2022)CelestialProceedings of the 23rd ACM/IFIP International Middleware Conference10.1145/3528535.3531517(69-81)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3528535.3531517
Becker SPfandzelter TJapke NBermbach DKao O(2022)Network Emulation in Large-Scale Virtual Edge Testbeds: A Note of Caution and the Way Forward2022 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E55432.2022.00007(1-7)Online publication date: Sep-2022
https://doi.org/10.1109/IC2E55432.2022.00007
Fadhil JSarhan Q(2022)A Survey on Internet of Things (IoT) Testing2022 International Conference on Computer Science and Software Engineering (CSASE)10.1109/CSASE51777.2022.9759705(77-83)Online publication date: 15-Mar-2022
https://doi.org/10.1109/CSASE51777.2022.9759705
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents