short-paper

BED: A Real-Time Object Detection System for Edge Devices

Authors:

Zaid Pervaiz Bhat,

Alfredo Costilla Reyes,

Afshin Niktash,

Xia HuAuthors Info & Claims

CIKM '22: Proceedings of the 31st ACM International Conference on Information & Knowledge Management

Pages 4994 - 4998

https://doi.org/10.1145/3511808.3557168

Published: 17 October 2022 Publication History

Abstract

Deploying deep neural networks (DNNs) on edge devices provides efficient and effective solutions for the real-world tasks. Edge devices have been used for collecting a large volume of data efficiently in different domains. DNNs have been an effective tool for data processing and analysis. However, designing DNNs on edge devices is challenging due to the limited computational resources and memory. To tackle this challenge, we demonstrate oBject detection system for Edge Devices (BED) on the MAX78000 DNN accelerator. It integrates on-device DNN inference with a camera and an LCD display for image acquisition and detection exhibition, respectively. BED is a concise, effective and detailed solution, including model training, quantization, synthesis and deployment. The entire repository is open-sourced on Github1, including a Graphical User Interface (GUI) for on-chip debugging. Experiment results indicate that BED can produce accurate detection with a 300-KB tiny DNN model, which takes only 91.9 ms of inference time and 1.845 mJ of energy. The real-time detection is available at YouTube.

Supplementary Material

MP4 File (CIKM video fast.mp4)

Presentation video

Download
84.02 MB

References

[1]

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).

[2]

Tharam Dillon, Chen Wu, and Elizabeth Chang. 2010. Cloud computing: issues and challenges. In 2010 24th IEEE international conference on advanced information networking and applications. Ieee, 27--33.

Digital Library

[3]

Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. 2020. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In International Conference on Learning Representations.

[4]

M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. [n.d.]. The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results. http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html.

[5]

Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, and Mao Yang. 2020. Estimating gpu memory consumption of deep learning models. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 1342--1352.

Digital Library

[6]

Song Han, Huizi Mao, and William J Dally. 2015. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 (2015).

[7]

Najmul Hassan, Saira Gillani, Ejaz Ahmed, Ibrar Yaqoob, and Muhammad Imran. 2018. The role of edge computing in internet of things. IEEE communications magazine 56, 11 (2018), 110--115.

[8]

Raghuraman Krishnamoorthi. 2018. Quantizing deep convolutional networks for efficient inference: A whitepaper. arXiv preprint arXiv:1806.08342 (2018).

[9]

Ardis Kristopher and Muchsel Robert. 2020. Cutting the AI Power Cord: Technology to Enable True Edge Inference. https:// cms.tinyml.org/ wp-content/ uploads/talks2020/ tinyML_Talks_Kris_Ardis_and_Robert_Muchsel_-201027.pdf (2020).

[10]

Jonathan Long, Evan Shelhamer, and Trevor Darrell. 2015. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3431--3440.

[11]

MG Sarwar Murshed, Christopher Murphy, Daqing Hou, Nazar Khan, Ganesh Ananthanarayanan, and Faraz Hussain. 2021. Machine learning at the network edge: A survey. ACM Computing Surveys (CSUR) 54, 8 (2021), 1--37.

Digital Library

[12]

Ajeet Ram Pathak, Manjusha Pandey, and Siddharth Rautaray. 2018. Application of deep learning for object detection. Procedia computer science 132 (2018), 1706--1717.

[13]

Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition. 779--788.

[14]

Joseph Redmon and Ali Farhadi. 2018. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767 (2018).

[15]

Weisong Shi, Jie Cao, Quan Zhang, Youhuizi Li, and Lanyu Xu. 2016. Edge computing: Vision and challenges. IEEE internet of things journal 3, 5 (2016), 637--646.

[16]

Science U.S. Department of Homeland Security and Technology Directorate. [n.d.]. CCTV Technology Handbook. https://www.dhs.gov/sites/default/files/publications/CCTV-Tech-HBK_0713--508.pdf.

[17]

Blesson Varghese, Nan Wang, Sakil Barbhuiya, Peter Kilpatrick, and Dimitrios S Nikolopoulos. 2016. Challenges and opportunities in edge computing. In 2016 IEEE International Conference on Smart Cloud (SmartCloud). IEEE, 20--26.

[18]

Wei Wei, Andrew T Yang, Weisong Shi, and Kewei Sha. 2016. Security in internet of things: Opportunities and challenges. In 2016 International Conference on Identification, Information and Knowledge in the Internet of Things (IIKI). IEEE, 512--518.

Cited By

Choi JLee YJo K(2024)Efficient Detection Model Using Feature Maximizer Convolution for Edge ComputingFrontiers of Computer Vision10.1007/978-981-97-4249-3_10(122-133)Online publication date: 30-Jun-2024
https://doi.org/10.1007/978-981-97-4249-3_10
Choi JNguyen DVo XJo K(2024)Small Object Detection Without Attention for Aerial SurveillanceThe 13th Conference on Information Technology and Its Applications10.1007/978-3-031-74127-2_31(372-383)Online publication date: 8-Nov-2024
https://doi.org/10.1007/978-3-031-74127-2_31
Wang GLiu ZJiang ZLiu NZou NHu XKrause ABrunskill ECho KEngelhardt BSabato SScarlett J(2023)DIVISIONProceedings of the 40th International Conference on Machine Learning10.5555/3618408.3619904(36036-36057)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.5555/3618408.3619904
Show More Cited By

Index Terms

BED: A Real-Time Object Detection System for Edge Devices
1. Computing methodologies
  1. Machine learning
    1. Machine learning algorithms
2. Information systems
  1. Information systems applications
    1. Mobile information processing systems

Recommendations

A real-time object detection algorithm for video
Abstract
Deep learning technology has been widely used in object detection. Although the deep learning technology greatly improves the accuracy of object detection, we also have the challenge of a high computational time. You Only Look Once (...
Dataset and Benchmarking of Real-Time Embedded Object Detection for RoboCup SSL
RoboCup 2021: Robot World Cup XXIV
Abstract
When producing a model to object detection in a specific context, the first obstacle is to have a dataset labeling the desired classes. In RoboCup, some leagues already have more than one dataset to train and evaluate a model. However, in the ... $_{}$
YOLO with adaptive frame control for real-time object detection applications
Abstract
You only look once (YOLO) is being used as the most popular object detection software in many intelligent video applications due to its ease of use and high object detection precision. In addition, in recent years, various intelligent vision ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '22: Proceedings of the 31st ACM International Conference on Information & Knowledge Management

October 2022

5274 pages

ISBN:9781450392365

DOI:10.1145/3511808

General Chairs:
Mohammad Al Hasan
Indiana University Purdue University, Indianapolis, USA
,
Li Xiong
Emory University, Atlanta, USA

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

CIKM '22

Sponsor:

CIKM '22: The 31st ACM International Conference on Information and Knowledge Management

October 17 - 21, 2022

GA, Atlanta, USA

Acceptance Rates

CIKM '22 Paper Acceptance Rate 621 of 2,257 submissions, 28%;

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
201
Total Downloads

Downloads (Last 12 months)75
Downloads (Last 6 weeks)12

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Choi JLee YJo K(2024)Efficient Detection Model Using Feature Maximizer Convolution for Edge ComputingFrontiers of Computer Vision10.1007/978-981-97-4249-3_10(122-133)Online publication date: 30-Jun-2024
https://doi.org/10.1007/978-981-97-4249-3_10
Choi JNguyen DVo XJo K(2024)Small Object Detection Without Attention for Aerial SurveillanceThe 13th Conference on Information Technology and Its Applications10.1007/978-3-031-74127-2_31(372-383)Online publication date: 8-Nov-2024
https://doi.org/10.1007/978-3-031-74127-2_31
Wang GLiu ZJiang ZLiu NZou NHu XKrause ABrunskill ECho KEngelhardt BSabato SScarlett J(2023)DIVISIONProceedings of the 40th International Conference on Machine Learning10.5555/3618408.3619904(36036-36057)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.5555/3618408.3619904
Ma HLi YGao YZhang ZAbuadbba AFu AAl-Sarawi SNepal SAbbott D(2023)TransCAB: Transferable Clean-Annotation Backdoor to Object Detection with Natural Trigger in Real-World2023 42nd International Symposium on Reliable Distributed Systems (SRDS)10.1109/SRDS60354.2023.00018(82-92)Online publication date: 25-Sep-2023
https://doi.org/10.1109/SRDS60354.2023.00018
Tu DQuang PNghi HThinh T(2023)An Edge AI-Based Vehicle Tracking Solution for Smart Parking SystemsIntelligence of Things: Technologies and Applications10.1007/978-3-031-46573-4_22(234-243)Online publication date: 20-Oct-2023
https://doi.org/10.1007/978-3-031-46573-4_22
Martin Wisniewski LBec JBoguszewski GGamatié A(2022)Hardware Solutions for Low-Power Smart Edge ComputingJournal of Low Power Electronics and Applications10.3390/jlpea1204006112:4(61)Online publication date: 25-Nov-2022
https://doi.org/10.3390/jlpea12040061
Bhat MAlex SNanda SGoutham S(2022)Qualitative Analysis of Anomaly Detection in Time Series2022 4th International Conference on Circuits, Control, Communication and Computing (I4C)10.1109/I4C57141.2022.10057732(250-253)Online publication date: 21-Dec-2022
https://doi.org/10.1109/I4C57141.2022.10057732

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents