research-article

Real-Time Low-Pixel Infrared Human Detection From Unmanned Aerial Vehicles

Authors:

Ignacio Martinez-Alpiste,

Gelayol Golcarenarenji,

Jose Maria Alcaraz-CaleroAuthors Info & Claims

DIVANet '20: Proceedings of the 10th ACM Symposium on Design and Analysis of Intelligent Vehicular Networks and Applications

Pages 9 - 15

https://doi.org/10.1145/3416014.3424600

Published: 16 November 2020 Publication History

Abstract

To improve the speed and accuracy in human detection in Search and Rescue (SAR) operations, this paper presents a novel and highly efficient machine learning empowered system by extending the You Only Look Once (YOLO) algorithm, which is designed and deployed on an embedded system. The proposed approach has been evaluated under real-world conditions on a Jetson AGX Xavier platform and the results have shown a well-balanced system in terms of accuracy, speed and portability. Moreover, the system demonstrates its resilience to perform low-pixel human detection on infrared images received from an Unmanned Aerial Vehicle (UAV) at low-light conditions, different altitudes and postures such as sitting, walking and running. The proposed approach has achieved in a constrained environment a total of 89.26% of accuracy and 24.6 FPS, surpassing the barrier of real-time object recognition.

References

[1]

Alexey. 2020 a. Darknet. https://github.com/AlexeyAB/darknet.

[2]

Alexey. 2020 b. YoloMark. https://github.com/AlexeyAB/Yolo_mark.

[3]

Elizabeth Bondi, Fei Fang, Mark Hamilton, Debarun Kar, Donnabell Dmello, Jongmoo Choi, Robert Hannaford, Arvind Iyer, Lucas Joppa, Milind Tambe, and Ramakant Nevatia. 2018. SPOT Poachers in Action: Augmenting Conservation Drones With Automatic Detection in Near Real Time. In AAAI.

[4]

Dunja Bovz ić-vS tulić, vZ eljko Maruvs ić, and Sven Gotovac. 2019. Deep learning approach in aerial imagery for supporting land search and rescue missions. International Journal of Computer Vision, Vol. 127, 9 (2019), 1256--1278.

Digital Library

[5]

Dane Brown and Daniel Schormann. [n.d.]. Poacher Detection and Wildlife Counting System. ( [n.,d.]).

[6]

Nikolaos Doulamis, Panagiotis Agrafiotis, George Athanasiou, and Angelos Amditis. 2017. Human object detection using very low resolution thermal cameras for urban search and rescue. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments. 311--318.

Digital Library

[7]

Marina Ivasic-Kos, Mate Kristo, and Miran Pobar. 2019. Person Detection in thermal videos using YOLO. In Proceedings of SAI Intelligent Systems Conference. Springer, 254--267.

[8]

TY Lin, M Maire, S Belongie, L Bourdev, R Girshick, J Hays, P Perona, D Ramanan, CL Zitnick, and P Dollar. 2019. Microsoft COCO: common objects in context (2015). arXiv preprint arXiv:1405.0312 (2019).

[9]

Ilya Loshchilov and Frank Hutter. 2016. Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983 (2016).

[10]

Eleftherios Lygouras, Nicholas Santavas, Anastasios Taitzoglou, Konstantinos Tarchanidis, Athanasios Mitropoulos, and Antonios Gasteratos. 2019. Unsupervised Human Detection with an Embedded Vision System on a Fully Autonomous UAV for Search and Rescue Operations. Sensors, Vol. 19, 16 (2019), 3542.

[11]

Ignacio Martinez-Alpiste, Pablo Casaseca-de-la higuera, Jose Alcaraz-calero, Christos Grecos, and Qi Wang. 2019. Benchmarking Machine-Learning-Based Object Detection on a UAV and Mobile Platform. 2019 IEEE Wireless Communications and Networking Conference, WCNC (2019).

Digital Library

[12]

Ignacio Martinez-Alpiste, Pablo Casaseca-de-la Higuera, Jose M Alcaraz-Calero, Christos Grecos, and Qi Wang. 2020. Smartphone-based object recognition with embedded machine learning intelligence for unmanned aerial vehicles. Journal of Field Robotics, Vol. 37, 3 (2020), 404--420.

[13]

Felipe Martins, Marc de Groot, Xeryus Stokkel, and Marco Wiering. 2016. Human detection and classification of landing sites for search and rescue drones. In ESANN.

[14]

Jerico Moeyersons, Brecht Verhoeve, Pieter-Jan Maenhaut, Bruno Volckaert, and Filip De Turck. 2019. Pluggable drone imaging analysis framework for mob detection during open-air events. In ICPRAM2019, the 8th International Conference on Pattern Recognition Applications and Methods. 64--72.

[15]

Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2016-Decem (2016), 779--788. https://doi.org/10.1109/CVPR.2016.91 arxiv: arXiv:1506.02640v5

[16]

Joseph Redmon and Ali Farhadi. 2017. YOLO9000: Better, faster, stronger. Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Vol. 2017-Janua (2017), 6517--6525. https://doi.org/10.1109/CVPR.2017.690 arxiv: arXiv:1612.08242v1

[17]

Joseph Redmon and Ali Farhadi. 2018. YOLOv3: An Incremental Improvement. (2018). arxiv: 1804.02767 http://arxiv.org/abs/1804.02767

[18]

Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in neural information processing systems. 91--99.

Digital Library

[19]

Sumant Sharma. 2017. Flood-survivors detection using IR imagery on an autonomous drone.

[20]

Xuehui Yu, Yuqi Gong, Nan Jiang, Qixiang Ye, and Zhenjun Han. 2020. Scale Match for Tiny Person Detection. In The IEEE Winter Conference on Applications of Computer Vision. 1257--1265.

[21]

Sungmin Yun and Sungho Kim. 2019. Recurrent YOLO and LSTM-based IR single pedestrian tracking. In 2019 19th International Conference on Control, Automation and Systems (ICCAS). IEEE, 94--96.

Digital Library

Cited By

Läufer DBraun SSüme SHimmelsbach U(2024)Comparison of Approaches for Human Detection with Low-Resolution Infrared Data Sets Using Deep Learning2024 21st International Conference on Ubiquitous Robots (UR)10.1109/UR61395.2024.10597494(596-602)Online publication date: 24-Jun-2024
https://doi.org/10.1109/UR61395.2024.10597494
Diez-Tomillo JAlcaraz-Calero JWang Q(2024)Edge-Accelerated UAV Operations: A Case Study of Open Source Solutions2024 International Wireless Communications and Mobile Computing (IWCMC)10.1109/IWCMC61514.2024.10592445(0114-0119)Online publication date: 27-May-2024
https://doi.org/10.1109/IWCMC61514.2024.10592445
Wijesundara DGunawardena LPremachandra C(2022)Human Recognition from High-altitude UAV Camera Images by AI based Body Region Detection2022 Joint 12th International Conference on Soft Computing and Intelligent Systems and 23rd International Symposium on Advanced Intelligent Systems (SCIS&ISIS)10.1109/SCISISIS55246.2022.10002039(1-4)Online publication date: 29-Nov-2022
https://doi.org/10.1109/SCISISIS55246.2022.10002039
Show More Cited By

Index Terms

Real-Time Low-Pixel Infrared Human Detection From Unmanned Aerial Vehicles
1. Computing methodologies
  1. Machine learning
    1. Machine learning approaches
      1. Neural networks

Recommendations

Automatic Pose Estimation of Micro Unmanned Aerial Vehicle for Autonomous Landing
Intelligent Computing Methodologies
Abstract
The guided navigation has enabled users with minimal amount of training to navigate and perform flight mission of micro unmanned aerial vehicle (MAV). In non-urban areas, where there are no other aerial traffic and congestion, MAV take-off & ...
Fuzzy Logic Based Approach to Design of Autonomous Landing System for Unmanned Aerial Vehicles

This paper is concerned with autonomous flight of UAVs and proposes a fuzzy logic based autonomous flight and landing system controller. Besides three fuzzy logic controllers which are developed for autonomous navigation for UAVs in a previous work as ...
Acoustic Stall Detection of Variable Pitch Propeller for Unmanned Aerial Vehicles
Abstract
This paper presents an analysis of acoustic emission and performance data of a UAV rotor equipped with a variable pitch propeller. The proposed study aims to show propeller noise features that indicate stall flow regime on the blade. Analysis of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIVANet '20: Proceedings of the 10th ACM Symposium on Design and Analysis of Intelligent Vehicular Networks and Applications

November 2020

76 pages

ISBN:9781450381215

DOI:10.1145/3416014

General Chair:
Mirela Notare
Technology University on Fly Transportation, Brazil
,
Program Chair:
Peng Sun
Duke Kunshan University, China

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSIM: ACM Special Interest Group on Simulation and Modeling

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

CENSIS
Thales UK

Conference

MSWiM '20

Sponsor:

SIGSIM

MSWiM '20: 23rd International ACM Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems

November 16 - 20, 2020

Alicante, Spain

Acceptance Rates

Overall Acceptance Rate 70 of 308 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
190
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)1

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Läufer DBraun SSüme SHimmelsbach U(2024)Comparison of Approaches for Human Detection with Low-Resolution Infrared Data Sets Using Deep Learning2024 21st International Conference on Ubiquitous Robots (UR)10.1109/UR61395.2024.10597494(596-602)Online publication date: 24-Jun-2024
https://doi.org/10.1109/UR61395.2024.10597494
Diez-Tomillo JAlcaraz-Calero JWang Q(2024)Edge-Accelerated UAV Operations: A Case Study of Open Source Solutions2024 International Wireless Communications and Mobile Computing (IWCMC)10.1109/IWCMC61514.2024.10592445(0114-0119)Online publication date: 27-May-2024
https://doi.org/10.1109/IWCMC61514.2024.10592445
Wijesundara DGunawardena LPremachandra C(2022)Human Recognition from High-altitude UAV Camera Images by AI based Body Region Detection2022 Joint 12th International Conference on Soft Computing and Intelligent Systems and 23rd International Symposium on Advanced Intelligent Systems (SCIS&ISIS)10.1109/SCISISIS55246.2022.10002039(1-4)Online publication date: 29-Nov-2022
https://doi.org/10.1109/SCISISIS55246.2022.10002039
Yabe TAzumi T(2022)Exploring the Performance of Deep Neural Networks on Embedded Many-Core Processors2022 ACM/IEEE 13th International Conference on Cyber-Physical Systems (ICCPS)10.1109/ICCPS54341.2022.00024(193-202)Online publication date: May-2022
https://doi.org/10.1109/ICCPS54341.2022.00024
Golcarenarenji GMartinez-Alpiste IWang QAlcaraz-Calero J(2022)Illumination-aware image fusion for around-the-clock human detection in adverse environments from Unmanned Aerial VehicleExpert Systems with Applications10.1016/j.eswa.2022.117413204(117413)Online publication date: Oct-2022
https://doi.org/10.1016/j.eswa.2022.117413
Dantas ADiniz LAlmeida MOlsson EFunk PSohlberg RRamos A(2022)Intelligent System for Detection and Identification of Ground Anomalies for RescueITNG 2022 19th International Conference on Information Technology-New Generations10.1007/978-3-030-97652-1_34(277-282)Online publication date: 14-Feb-2022
https://doi.org/10.1007/978-3-030-97652-1_34
Lou XZhang TJiang JZhang Y(2021)A Survey of Microarchitectural Side-channel Vulnerabilities, Attacks, and Defenses in CryptographyACM Computing Surveys10.1145/345662954:6(1-37)Online publication date: 13-Jul-2021
https://dl.acm.org/doi/10.1145/3456629
Badr E(2021)Images in Space and TimeACM Computing Surveys10.1145/345365754:6(1-38)Online publication date: 13-Jul-2021
https://dl.acm.org/doi/10.1145/3453657
Rauf BAbbas HUsman MZia TIqbal WAbbas YAfzal H(2021)Application Threats to Exploit Northbound Interface Vulnerabilities in Software Defined NetworksACM Computing Surveys10.1145/345364854:6(1-36)Online publication date: 13-Jul-2021
https://dl.acm.org/doi/10.1145/3453648
Golcarenarenji GMartinez-Alpiste IWang QAlcaraz-Calero J(2021)Machine-learning-based top-view safety monitoring of ground workforce on complex industrial sitesNeural Computing and Applications10.1007/s00521-021-06489-3Online publication date: 22-Oct-2021
https://doi.org/10.1007/s00521-021-06489-3

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents