Article

JamLab-NG: Benchmarking Low-Power Wireless Protocols under Controllable and Repeatable Wi-Fi Interference

Authors:

Carlo Alberto Boano,

Matthias Schulz,

Matthias Hollick,

Kay RömerAuthors Info & Claims

EWSN '19: Proceedings of the 2019 International Conference on Embedded Wireless Systems and Networks

Pages 83 - 94

Published: 15 March 2019 Publication History

Abstract

Evaluating the performance of low-power wireless protocols in noisy environments in a repeatable and fullyautomated way is still an open problem in our community. On the one hand, there is a lack of tools enabling the controllable and repeatable generation of interference using Wi-Fi devices. On the other hand, existing testbeds do not offer the automated generation of Wi-Fi interference on a large-scale. In this work, we present JamLab-NG, an open-source framework allowing the generation of controllable Wi-Fi interference using off-the-shelf devices such as the Raspberry Pi 3. JamLab-NG enables the fine-grained control of individual link-layer transmissions, avoiding the uncontrollable delays introduced by the network stack, the operating system, and the clear channel assessment procedure. Furthermore, JamLab-NG allows to generate repeatable Wi-Fi interference patterns by controlling radio settings such as the transmission speed and the packet length, which would otherwise be automatically adapted by the radio firmware at run-time. We use JamLab-NG to augment a testbed and embed the generation of Wi-Fi interference into its automated execution of experiments. Among others, we allow remote configuration of the interference generated by individual Wi-Fi devices, and show that they can operate in a synchronized fashion. Finally, we use the augmented testbed to benchmark the performance of state-of-the-art IoT protocols under Wi-Fi interference in a repeatable and fully-automated way.

References

[1]

M. D. Abrignani et al. Testing the Impact of Wi-Fi Interference on Zigbee Networks. In Proc. of the EMTC Conf., 2014.

[2]

J. Bellardo et al. 802.11 Denial-of-service Attacks: Real Vulnerabilities and Practical Solutions. In Proc. of the 12t h SSYM Symp., 2003.

Digital Library

[3]

A. Bereza et al. Cross-Technology Communication Between BLE and Wi-Fi Using Commodity Hardware. In Proc. of the 14th EWSN Conf., demo session, 2017.

[4]

K. Bicakci et al. Denial-of-Service Attacks and Countermeasures in IEEE 802.11 Wireless Networks. Comp. Stand. & Interf., 31(5), 2009.

Digital Library

[5]

B. Bloessl et al. An IEEE 802.11a/g/p OFDM Receiver for GNU Radio. In Proceedings of the 2nd SRIF Worksh., 2013.

Digital Library

[6]

B. Bloessl, C. Leitner, F. Dressler, and C. Sommer. A GNU Radiobased IEEE 802.15.4 Testbed. In Proc. of the 12th FGSN Conf., 2013.

[7]

C. A. Boano et al. Towards a Benchmark for Low-power Wireless Networking. In Proc. of the 1st CPSBench Worksh., 2018.

[8]

C. A. Boano and K. Römer. External radio interference. In Radio Link Quality Estimation in Low-Power Wireless Networks, SpringerBriefs in Electrical and Computer Engineering Cooperating Objects. 2013.

[9]

C. A. Boano, T. Voigt, C. Noda, K. Römer, and M. A. Zúñiga. JamLab: Augmenting Sensornet Testbeds with Realistic and Controlled Interference Generation. In Proc. of the 10th IPSN Conf., 2011.

[10]

Z. Brodard et al. Rover: Poor (but Elegant) Man’s Testbed. In Proc. of the 13th PE-WASUN Symp., 2016.

Digital Library

[11]

L. S. Cardoso et al. Reliable and Reproducible Radio Experiments in FIT/CorteXlab* SDR testbed: Initial Findings. In Proc. of the 12th CrownCom Conf., 2017.

[12]

S. Duquennoy, F. Österlind, and A. Dunkels. Lossy Links, Low Power, High Throughput. In Proc. of the 9th ACM SenSys Conf., 2011.

Digital Library

[13]

P. Dutta et al. Design and Evaluation of a Versatile and Efficient Receiver-Initiated Link Layer for Low-Power Wireless. In Proc. of the 8th ACM SenSys Conf., 2010.

Digital Library

[14]

A. Escobar et al. BigBangBus. In Proc. of the 15th EWSN Conf., competition session, 2018.

[15]

P. Gawłowicz and A. Zubow. Practical cross-technology radio resource management between LTE-U and WiFi. In Proc. of the IEEE INFOCOM Conf., demo session, 2018.

[16]

O. Gnawali et al. Collection Tree Protocol. In Proceedings of the 7th ACM SenSys Conf., 2009.

Digital Library

[17]

A. Hithnawi et al. Controlled Interference Generation for Wireless Coexistence Research. In Proc. of the SRIF Worksh., 2015.

Digital Library

[18]

iLab-t Testbeds’ 1.0.0 Documentation. https://doc.ilabt.imec.be/ilabtdocumentation/wilabfacility.html.

[19]

T. Istomin et al. Interference-resilient Ultra-low Power Aperiodic Data Collection. In Proc. of the 17th IPSN Conf., 2018.

Digital Library

[20]

M. S. Kang et al. Adaptive Interference-Aware Multi-Channel Clustering Algorithm in a ZigBee Network in the Presence of WLAN Interference. In Proc. of the 2nd ISWPC Symp., 2007.

[21]

A. King, J. Brown, and U. Roedig. DCCA: Differentiating Clear Channel Assessment for Improved 802.11/802.15.4 Coexistence. In Proc. of the 10th WiMob Conf., 2014.

[22]

C.-J. M. Liang et al. Surviving Wi-Fi Interference in Low Power ZigBee Networks. In Proc. of the 8th ACM SenSys Conf., 2010.

Digital Library

[23]

R. Lim et al. FlockLab: A Testbed for Distributed, Synchronized Tracing and Profiling of Wireless Embedded Systems. In Proc. of the 12th IPSN Conf., 2013.

Digital Library

[24]

S. Moeller et al. Routing without Routes: the Backpressure Collection Protocol. In Proc. of the 9th IPSN Conf., 2010.

Digital Library

[25]

R. Musaloiu-E. and A. Terzis. Minimising the Effect of Wi-Fi Interference in 802.15.4 Wireless Sensor Networks. IJSNet, 3(1), 2007.

Digital Library

[26]

B. A. Nahas, S. Duquennoy, V. Iyer, and T. Voigt. Low-Power Listening Goes Multi-Channel. In Proc. of the 10th DCOSS Conf., 2014.

Digital Library

[27]

B. A. Nahas and O. Landsiedel. Aggressive Synchronous Transmissions with In-network Processing for Dependable All-to-All Communication. In Proc. of the 15th EWSN Conf., competition session, 2018.

Digital Library

[28]

Nexmon GitHub repository. https://github.com/seemoo-lab/nexmon.

[29]

C. Noda et al. On Packet Size and Error Correction Optim. in LowPower Wireless Networks. In Proc. of the 10th SECON Conf., 2013.

[30]

Open-Access Research Testbed for Next-Generation Wireless Networks (ORBIT). http://www.orbit-lab.org/.

[31]

G. Z. Papadopoulos, A. Gallais, G. Schreiner, and T. Noël. Importance of Repeatable Setups for Reproducible Experimental Results in IoT. In Proc. of the 13th PE-WASUN Symp., 2016.

Digital Library

[32]

M. Petrova, L. Wu, P. Mähönen, and J. Riihijärvi. Interference Measurements on Performance Degradation between Colocated IEEE 802.11g/n and 802.15.4 Networks. In Proc. of the 6th ICN Conf., 2007.

Digital Library

[33]

S. Pollin et al. Harmful Coexistence Between 802.15.4 and 802.11: A Measurement-based Study. In Proc. of the CrownCom Conf., 2008.

[34]

P. I. Richards. Probability of Coincidence for Two Periodically Recurring Events. The Annals of Mathematical Statistics, 19(1), 1948.

[35]

Scapy: Packet Crafting for Python2 and Python3. https://scapy.net/.

[36]

M. Schulz et al. Massive Reactive Smartphone-based Jamming Using Arbitrary Waveforms and Adaptive Power Control. In Proc. of the 10th WiSec Conf., 2017.

Digital Library

[37]

M. Schulz et al. Nexmon: Build Your Own Wi-Fi Testbeds with LowLevel MAC & PHY-Access using Firmware Patches on Off-the-Shelf Mobile Devices. In Proc. of the 11th WinTECH Worksh., 2017.

Digital Library

[38]

M. Schulz et al. Teaching Smartphones to Transmit Raw Signals and to Extract Channel State Information to Implement Practical Covert Channels over Wi-Fi. In Proc. of the 16th MobiSys Conf., 2018.

Digital Library

[39]

M. Schulz, D. Wegemer, and M. Hollick. The Nexmon Firmware Analysis and Modification Framework: Empowering Researchers to Enhance Wi-Fi Devices. COMCOM, 129(1), 2018.

[40]

M. Schuß, C. A. Boano, and K. Röemer. Moving Beyond Competitions: Extending D-Cube to Seamlessly Benchmark Low-Power Wireless Systems. In Proc. of the 1st CPSBench Worksh., 2018.

[41]

M. Schuß, C. A. Boano, M. Weber, and K. Römer. A Competition to Push the Dependability of Low-Power Wireless Protocols to the Edge. In Proc. of the 14th EWSN Conf., 2017.

[42]

M. Sha, G. Hackmann, and C. Lu. Energy-efficient Low Power Listening for Wireless Sensor Networks in Noisy Environments. In Proc. of the 12th IPSN Conf., 2013.

Digital Library

[43]

J. Shi, M. Sha, and Z. Yang. DiGS: Distributed Graph Routing and Scheduling for Industrial Wireless Sensor-Actuator Networks. In Proc. of the 38th ICDCS Conf., 2018.

[44]

L. Tang, Y. Sun, O. Gurewitz, and D. B. Johnson. EM-MAC: A Dynamic Multichannel Energy-Efficient MAC Protocol for Wireless Sensor Networks. In Proc. of the 12th MobiHoc Conf., 2011.

Digital Library

[45]

The Binghamton University Wireless Embedded System Testbed. http://www.cs.binghamton.edu/ msha/testbed.

[46]

V. Toldov et al. Experimental Evaluation of Interference Impact on the Energy Consumption in Wireless Sensor Networks. In Proc. of the 17th WoWMoM Symp., 2016.

[47]

M. Trobinger et al. CRYSTAL Clear: Making Interference Transparent. In Proc. of the 15th EWSN Conf., competition session, 2018.

Digital Library

[48]

TWIST Testbeds’ 1.12.0 Documentation. https://www.twist.tuberlin.de/testbeds/wireless.html#twist-nucs.

[49]

M. Vanhoef and F. Piessens. Advanced Wi-Fi Attacks Using Commodity Hardware. In Proc. of the 30th ACSAC Conf., 2014.

Digital Library

[50]

M. Vanhoef and F. Piessens. Key reinstallation attacks: Forcing nonce reuse in WPA2. In Proc. of the ACM CCS Conf., 2017.

Digital Library

Cited By

Geissdoerfer KChwalisz MZimmerling M(2021)Taking a Deep Dive Into The Batteryless Internet of Things With ShepherdGetMobile: Mobile Computing and Communications10.1145/3447853.344785524:3(5-8)Online publication date: 26-Jan-2021
https://dl.acm.org/doi/10.1145/3447853.3447855
Wang WHe DJia WChen XGu TLiu HSun XChen GWu F(2021)PRCommProceedings of the 20th International Conference on Information Processing in Sensor Networks (co-located with CPS-IoT Week 2021)10.1145/3412382.3458264(163-175)Online publication date: 18-May-2021
https://dl.acm.org/doi/10.1145/3412382.3458264
Mager FJacob RForno RZimmerling MLiu YXing GHe YPicco G(2019)Competition: Low-Power Wireless Bus BaselineProceedings of the 2019 International Conference on Embedded Wireless Systems and Networks10.5555/3324320.3324386(292-293)Online publication date: 25-Feb-2019
https://dl.acm.org/doi/10.5555/3324320.3324386
Show More Cited By

JamLab-NG: Benchmarking Low-Power Wireless Protocols under Controllable and Repeatable Wi-Fi Interference
1. Networks
  1. Network types

Recommendations

Towards a Wi-Fi ecosystem: Technology integration and emerging service models

This paper outlines emerging business models of heterogeneous wireless networks that are mainly Wi-Fi centric. Wi-Fi networks can be integrated with the Internet and cellular infrastructures to offer innovative services (data and voice) to individuals ...
Seamless handoff scheme in Wi-Fi and WiMAX heterogeneous networks

With the development of wireless communication technology, various wireless networks have been deployed. Heterogeneous networks will be dominant in the next generation wireless networks. In such networks, providing a seamless handoff and quality of ...
Secure interworking & roaming of WiMAX with 3G and Wi-Fi
IM'09: Proceedings of the 11th IFIP/IEEE international conference on Symposium on Integrated Network Management

The roaming between different WiMAX (Worldwide Interoperability for Microwave Access) networks as well as the interworking between WiMAX and other access technologies will be a key enabler for global WiMAX deployment. To provide secure and seamless ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

EWSN '19: Proceedings of the 2019 International Conference on Embedded Wireless Systems and Networks

February 2019

436 pages

ISBN:9780994988638

General Chairs:
Yunhao Liu
Tsinghua University
,
Guoliang Xing
The Chinese University of Hong Kong
,
Program Chairs:
Yuan He
Tsinghua University
,
Gian Pietro Picco
University of Trento

Sponsors

EWSN: International Conference on Embedded Wireless Systems and Networks

In-Cooperation

SIGBED: ACM Special Interest Group on Embedded Systems

Publisher

Junction Publishing

United States

Publication History

Published: 15 March 2019

Check for updates

Author Tags

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 81 of 195 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Geissdoerfer KChwalisz MZimmerling M(2021)Taking a Deep Dive Into The Batteryless Internet of Things With ShepherdGetMobile: Mobile Computing and Communications10.1145/3447853.344785524:3(5-8)Online publication date: 26-Jan-2021
https://dl.acm.org/doi/10.1145/3447853.3447855
Wang WHe DJia WChen XGu TLiu HSun XChen GWu F(2021)PRCommProceedings of the 20th International Conference on Information Processing in Sensor Networks (co-located with CPS-IoT Week 2021)10.1145/3412382.3458264(163-175)Online publication date: 18-May-2021
https://dl.acm.org/doi/10.1145/3412382.3458264
Mager FJacob RForno RZimmerling MLiu YXing GHe YPicco G(2019)Competition: Low-Power Wireless Bus BaselineProceedings of the 2019 International Conference on Embedded Wireless Systems and Networks10.5555/3324320.3324386(292-293)Online publication date: 25-Feb-2019
https://dl.acm.org/doi/10.5555/3324320.3324386
Spörk MBoano CRömer KLiu YXing GHe YPicco G(2019)Improving the Timeliness of Bluetooth Low Energy in Noisy RF EnvironmentsProceedings of the 2019 International Conference on Embedded Wireless Systems and Networks10.5555/3324320.3324324(23-34)Online publication date: 25-Feb-2019
https://dl.acm.org/doi/10.5555/3324320.3324324
Jacob RBoano CRaza UZimmerling MThiele LZimmerling M(2019)Towards a methodology for experimental evaluation in low-power wireless networkingProceedings of the 2nd Workshop on Benchmarking Cyber-Physical Systems and Internet of Things10.1145/3312480.3313173(18-23)Online publication date: 15-Apr-2019
https://dl.acm.org/doi/10.1145/3312480.3313173

View Options

View options

Media

Figures

Other

Tables

View Table of Contents