research-article

Open access

DeepDish: multi-object tracking with an off-the-shelf Raspberry Pi

Authors:

Matthew Danish,

Justas Brazauskas,

Richard MortierAuthors Info & Claims

EdgeSys '20: Proceedings of the Third ACM International Workshop on Edge Systems, Analytics and Networking

Pages 37 - 42

https://doi.org/10.1145/3378679.3394535

Published: 13 May 2020 Publication History

Abstract

When looking at a building or urban settings, information about the number of people present and the way they move through the space is useful for helping designers to understand what they have created, fire marshals to identify potential safety hazards, planners to speculate about what is needed in the future, and the public to have real data on which to base opinions about communal choices. We propose a network of edge devices based on Raspberry Pi and TensorFlow, which will ultimately push data via LoRaWAN to a real-time data server. This network is being integrated into a Digital Twin of a local site which includes several dozen buildings spread over approximately 500,000 square metres. We share and discuss issues regarding privacy, accuracy and performance.

References

[1]

Ragaad Al-Tarawneh, Christina Strong, Luis Remis, Pablo Munoz, Addicam Sanjay, and Srikanth Kambhatla. 2019. Navigating the visual fog: analyzing and managing visual data from edge to cloud. In 2nd USENIX Workshop on Hot Topics in Edge Computing (HotEdge 19). USENIX Association, Renton, WA. https://www.usenix.org/conference/hotedge19/presentation/altarawneh

[2]

Alex Bewley, Zongyuan Ge, Lionel Ott, Fabio Ramos, and Ben Upcroft. 2016. Simple online and realtime tracking. In 2016 IEEE International Conference on Image Processing (ICIP). IEEE, 3464--3468.

[3]

Alejandro Cartas, Martin Kocour, Aravindh Raman, Ilias Leontiadis, Jordi Luque, Nishanth Sastry, Jose Nuñez-Martinez, Diego Perino, and Carlos Segura. 2019. A reality check on inference at mobile networks edge. In Proceedings of the 2nd International Workshop on Edge Systems, Analytics and Networking. 54--59.

Digital Library

[4]

Gioele Ciaparrone, Francisco Luque Sánchez, Siham Tabik, Luigi Troiano, Roberto Tagliaferri, and Francisco Herrera. 2019. Deep learning in video multi-object tracking: a survey. Neurocomputing (2019).

[5]

Junwei Han, Dingwen Zhang, Gong Cheng, Nian Liu, and Dong Xu. 2018. Advanced deep-learning techniques for salient and category-specific object detection: a survey. IEEE Signal Processing Magazine 35, 1 (2018), 84--100.

[6]

Jacob Hochstetler, Rahul Padidela, Qi Chen, Qing Yang, and Song Fu. 2018. Embedded deep learning for vehicular edge computing. In 2018 IEEE/ACM Symposium on Edge Computing (SEC). IEEE, 341--343.

[7]

Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. MobileNets: efficient convolutional neural networks for mobile vision applications. CoRR abs/1704.04861 (2017). [arxiv]1704.04861 http://arxiv.org/abs/1704.04861

[8]

Kirsten Lamb. 2019. Principle-based digital twins: a scoping review. (2019).

[9]

Nicholas D Lane, Sourav Bhattacharya, Petko Georgiev, Claudio Forlivesi, Lei Jiao, Lorena Qendro, and Fahim Kawsar. 2016. DeepX: A software accelerator for low-power deep learning inference on mobile devices. In 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 1--12.

[10]

L. Leal-Taixé, A. Milan, I. Reid, S. Roth, and K. Schindler. 2015. MOTChallenge 2015: towards a benchmark for multi-target tracking. arXiv:1504.01942 [cs] (April 2015). http://arxiv.org/abs/1504.01942 arXiv: 1504.01942.

[11]

Tsung-Yi Lin, Michael Maire, Serge Belongie, Lubomir Bourdev, Ross Girshick, James Hays, Pietro Perona, Deva Ramanan, C. Lawrence Zitnick, and Piotr Dollár. 2014. Microsoft COCO: common objects in context. [arxiv]1405.0312 [cs.CV]

[12]

Peng Liu, Bozhao Qi, and Suman Banerjee. 2018. EdgeEye: an edge service framework for real-time intelligent video analytics. In Proceedings of the 1st International Workshop on Edge Systems, Analytics and Networking. 1--6.

Digital Library

[13]

Joseph Redmon and Ali Farhadi. 2016. YOLO9000: Better, Faster, Stronger. CoRR abs/1612.08242 (2016). [arxiv]1612.08242 http://arxiv.org/abs/1612.08242

[14]

Ju Ren, Yundi Guo, Deyu Zhang, Qingqing Liu, and Yaoxue Zhang. 2018. Distributed and efficient object detection in edge computing: challenges and solutions. IEEE Network 32, 6 (2018), 137--143.

[15]

Springer 2016. MARS: a video benchmark for large-scale person re-identification. Springer.

[16]

Nicolai Wojke and Alex Bewley. 2018. Deep cosine metric learning for person re-identification. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, 748--756.

[17]

Nicolai Wojke, Alex Bewley, and Dietrich Paulus. 2017. Simple online and realtime tracking with a deep association metric. In 2017 IEEE international conference on image processing (ICIP). IEEE, 3645--3649.

Digital Library

[18]

Xu Zhang, Xiangyang Hao, Songlin Liu, Junqiang Wang, Jiwei Xu, and Jun Hu. 2019. Multi-target tracking of surveillance video with differential YOLO and DeepSORT. In Eleventh International Conference on Digital Image Processing (ICDIP 2019), Jenq-Neng Hwang and Xudong Jiang (Eds.), Vol. 11179. International Society for Optics and Photonics, SPIE, 701 -- 710.

Cited By

Brazauskas JJensen CDanish MLewis IMortier RDing AAral AHilt V(2024)CerberusProceedings of the 7th International Workshop on Edge Systems, Analytics and Networking10.1145/3642968.3654817(25-30)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3642968.3654817
ElTobgui RZayer FIacoponi SDe Masi GRenda FDias J(2024)Towards Efficient Underwater Robotic Swarms: Edge-Based Comparative Analysis of Multi-Object TrackersOCEANS 2024 - Singapore10.1109/OCEANS51537.2024.10682269(1-7)Online publication date: 15-Apr-2024
https://doi.org/10.1109/OCEANS51537.2024.10682269
Ali SAhmed S(2024)US Scanning Technologies and AIScanning Technologies for Autonomous Systems10.1007/978-3-031-59531-8_5(131-158)Online publication date: 18-Jul-2024
https://doi.org/10.1007/978-3-031-59531-8_5
Show More Cited By

Index Terms

DeepDish: multi-object tracking with an off-the-shelf Raspberry Pi
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Sensor networks
2. Hardware
  1. Communication hardware, interfaces and storage
    1. Sensor applications and deployments
    2. Sensor devices and platforms

Recommendations

DeepDish on a diet: low-latency, energy-efficient object-detection and tracking at the edge
EdgeSys '22: Proceedings of the 5th International Workshop on Edge Systems, Analytics and Networking

Intelligent sensors using deep learning to comprehend video streams have become commonly used to track and analyse the movement of people and vehicles in public spaces. The models and hardware become more powerful at regular and frequent intervals. ...
Trajectory based video object manipulation
ICME '11: Proceedings of the 2011 IEEE International Conference on Multimedia and Expo

We propose an object centric representation for easy and intuitive navigation and manipulation of videos. Object centric representation allows a user to directly access and process objects as basic video components. We demonstrate a trajectory based ...
Edge Assisted Object Detection for Mobile Application
ICIT '19: Proceedings of the 2019 7th International Conference on Information Technology: IoT and Smart City

Object detection for mobile devices is meaningful especially in the field of IoT. Limited by computing power and network transmission, it's challenging to get high accuracy in mobile object detection. To solve this question, this article designs a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

EdgeSys '20: Proceedings of the Third ACM International Workshop on Edge Systems, Analytics and Networking

April 2020

78 pages

ISBN:9781450371322

DOI:10.1145/3378679

General Chairs:
Aaron Yi Ding
TU Delft
,
Richard Mortier
University of Cambridge

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

EuroSys '20

Sponsor:

SIGOPS

EuroSys '20: Fifteenth EuroSys Conference 2020

April 27, 2020

Heraklion, Greece

Acceptance Rates

Overall Acceptance Rate 10 of 23 submissions, 43%

Upcoming Conference

EuroSys '25

Sponsor:
sigops

Twentieth European Conference on Computer Systems

March 30 - April 3, 2025

Rotterdam , Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
754
Total Downloads

Downloads (Last 12 months)144
Downloads (Last 6 weeks)37

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Brazauskas JJensen CDanish MLewis IMortier RDing AAral AHilt V(2024)CerberusProceedings of the 7th International Workshop on Edge Systems, Analytics and Networking10.1145/3642968.3654817(25-30)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3642968.3654817
ElTobgui RZayer FIacoponi SDe Masi GRenda FDias J(2024)Towards Efficient Underwater Robotic Swarms: Edge-Based Comparative Analysis of Multi-Object TrackersOCEANS 2024 - Singapore10.1109/OCEANS51537.2024.10682269(1-7)Online publication date: 15-Apr-2024
https://doi.org/10.1109/OCEANS51537.2024.10682269
Ali SAhmed S(2024)US Scanning Technologies and AIScanning Technologies for Autonomous Systems10.1007/978-3-031-59531-8_5(131-158)Online publication date: 18-Jul-2024
https://doi.org/10.1007/978-3-031-59531-8_5
Danish MVerma RBrazauskas JLewis IMortier RDing AHilt V(2022)DeepDish on a dietProceedings of the 5th International Workshop on Edge Systems, Analytics and Networking10.1145/3517206.3526273(43-48)Online publication date: 5-Apr-2022
https://dl.acm.org/doi/10.1145/3517206.3526273
Lu SYao YLuo BYu ZLi DShi W(2022)EdgeWare: toward extensible and flexible middleware for connected vehicle servicesCCF Transactions on High Performance Computing10.1007/s42514-022-00100-44:3(339-356)Online publication date: 9-May-2022
https://doi.org/10.1007/s42514-022-00100-4
Lujic IMaio VPollhammer KBodrozic ILasic JBrandic IDing AMortier R(2021)Increasing Traffic Safety with Real-Time Edge Analytics and 5GProceedings of the 4th International Workshop on Edge Systems, Analytics and Networking10.1145/3434770.3459732(19-24)Online publication date: 26-Apr-2021
https://dl.acm.org/doi/10.1145/3434770.3459732

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents