research-article

Automatic Basketball Detection in Sport Video Based on R-FCN and Soft-NMS

Authors:

Qiaokang Liang,

Dan ZhangAuthors Info & Claims

CACRE2019: Proceedings of the 2019 4th International Conference on Automation, Control and Robotics Engineering

Article No.: 9, Pages 1 - 6

https://doi.org/10.1145/3351917.3351970

Published: 19 July 2019 Publication History

Abstract

In basketball videos, the ball is always so small in the camera that its appearance feature is hard to be extracted. In this paper, we introduce a deep-learning technology to detect the basketball. Specifically, we train our basketball detection model based on the Region-based Fully Convolutional Networks (R-FCN) which uses the fully convolutional Residual Network (ResNet) as the backbone network. What's more, we apply some new techniques including Online Hard Example Mining (OHEM), Soft-NMS and multi-scale training strategy to achieve higher detection accuracy. In detail, the OHEM method can reduce the cost of fine-tuning during training by calculating the loss of the RoIs. Soft-NMS can reduce the false positive rate by decreasing the object detection score between the overlap object. And the multi-scale training can improve the detection performance by receiving the good feature from the object with different scale. Finally, we achieve a mean average precision (mAP) value of 89.7% on a public basketball dataset. It proves that applying the deep-learning approach to basketball detection is effective.

References

[1]

T. D'Orazio, C. Guaragnella, M. Leo, and A. Distante, "A new algorithm for ball recognition using circle Hough transform and neural classifier," Pattern Recognition, vol. 37, pp. 393--408, 2004.

[2]

H. T. Chen, M. C. Tien, Y. W. Chen, W. J. Tsai, and S. Y. Lee, "Physics-based ball tracking and 3D trajectory reconstruction with applications to shooting location estimation in basketball video," Journal of Visual Communication & Image Representation, vol. 20, pp. 204--216, 2009.

Digital Library

[3]

B. Chakraborty and S. Meher, "A real-time trajectory-based ball detection-and-tracking framework for basketball video," Journal of Optics, vol. 42, pp. 156--170, 2013.

[4]

X. Wang, V. Ablavsky, H. B. Shitrit, and P. Fua, "Take your eyes off the ball: Improving ball-tracking by focusing on team play," Computer Vision & Image Understanding, vol. 119, pp. 102--115, 2014.

Digital Library

[5]

M. Archana and M. K. Geetha, "Object Detection and Tracking Based on Trajectory in Broadcast Tennis Video" Procedia Computer Science, vol. 58, pp. 225--232, 2015.

[6]

J. Metzler, "Video-based soccer ball detection in difficult situations," presented at the Sports Science Research and Technology Support, 2013.

[7]

T. Qazi, P. Mukherjee, S. Srivastava, B. Lall, and N. R. Chauhan, "Automated ball tracking in tennis videos," presented at the Third International Conference on Image Information Processing, 2016.

[8]

A. Maksai, X. Wang, and P. Fua, "What Players do with the Ball: A Physically Constrained Interaction Modeling," presented at the IEEE Conference on Computer Vision and Pattern Recognition 2016.

[9]

Y. Zhao, J. Wu, Y. Zhu, H. Yu, and R. Xiong, "A learning framework towards real-time detection and localization of a ball for robotic table tennis system," presented at the IEEE International Conference on Real-Time Computing and Robotics, 2018.

[10]

Y. Lecun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, p. 436, 2015.

[11]

J. Dai, Y. Li, K. He, and J. Sun, "R-FCN: Object Detection via Region-based Fully Convolutional Networks," presented at the Neural Information Processing Systems, 2016.

[12]

A. Shrivastava, A. Gupta, and R. Girshick, "Training Region-Based Object Detectors with Online Hard Example Mining," presented at the Computer Vision and Pattern Recognition, 2016.

[13]

N. Bodla, B. Singh, R. Chellappa, and L. S. Davis, "Soft-NMS -- Improving Object Detection with One Line of Code," presented at the IEEE International Conference on Computer Vision, 2017.

[14]

A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," presented at the International Conference on Neural Information Processing Systems, 2012.

[15]

J. Deng, W. Dong, R. Socher, L. J. Li, K. Li, and F. F. Li, "ImageNet: A large-scale hierarchical image database," presented at the Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, 2009.

[16]

J. D. R. Girshick, T. Darrell, J. Malik, "Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation," presented at the IEEE Conference on Computer Vision and Pattern Recognition 2014.

[17]

M. Everingham, L. V. Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The Pascal Visual Object Classes (VOC) Challenge," International Journal of Computer Vision, vol. 88, pp. 303--338, 2010.

Digital Library

[18]

R. Girshick, "Fast R-CNN," presented at the IEEE International Conference on Computer Vision, 2015.

[19]

S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: towards real-time object detection with region proposal networks," presented at the International Conference on Neural Information Processing Systems, 2015.

[20]

J. R. Uijlings, K. E. Sande, T. Gevers, and A. W. Smeulders, "Selective Search for Object Recognition," International Journal of Computer Vision, vol. 104, pp. 154--171, 2013.

Digital Library

[21]

K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," presented at the Computer Vision and Pattern Recognition, 2015.

[22]

Jia, Yangqing, Shelhamer, Evan, Donahue, Jeff, et al., "Caffe: Convolutional Architecture for Fast Feature Embedding," presented at the arXiv: 1408.5093, 2014.

[23]

K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," Computer Science, 2014.

Cited By

Shepley AFalzon GKwan PBrankovic L(2023)Confluence: A Robust Non-IoU Alternative to Non-Maxima Suppression in Object DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.3273210(1-16)Online publication date: 2023
https://doi.org/10.1109/TPAMI.2023.3273210
Sakabe HNakada Y(2023)Enhanced Method for Computing Optimal Dribbling Routes Using Tracking Data in Basketball2023 IEEE Ninth Multimedia Big Data (BigMM)10.1109/BigMM59094.2023.00009(11-18)Online publication date: 11-Dec-2023
https://doi.org/10.1109/BigMM59094.2023.00009
Yuan SZuo ZSun BLiu Y(2023)Research on Grasping Detection Method of Manipulator Based on SOLOV2Proceedings of 2022 International Conference on Autonomous Unmanned Systems (ICAUS 2022)10.1007/978-981-99-0479-2_51(550-561)Online publication date: 10-Mar-2023
https://doi.org/10.1007/978-981-99-0479-2_51
Show More Cited By

Recommendations

R-FCN: object detection via region-based fully convolutional networks
NIPS'16: Proceedings of the 30th International Conference on Neural Information Processing Systems

We present region-based, fully convolutional networks for accurate and efficient object detection. In contrast to previous region-based detectors such as Fast/Faster R-CNN [7, 19] that apply a costly per-region subnetwork hundreds of times, our region-...
Playfield and ball detection in soccer video
ISVC'07: Proceedings of the 3rd international conference on Advances in visual computing - Volume Part II

The ball is really hard to be detected when it is merged with field lines or players in soccer video. A trajectory based ball detection scheme together with an approach of playfield detection is proposed to solve this problem. Playfield detection plays ...
Region-Based Convolutional Networks for End-to-End Detection of Agricultural Mushrooms
Image and Signal Processing
Abstract
Conventional image processing techniques have been applied to the field of agricultural machine vision for the purposes of identifying crops for quality control, weed detection, automated spraying and harvesting. With the recent advancements in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

CACRE2019: Proceedings of the 2019 4th International Conference on Automation, Control and Robotics Engineering

July 2019

478 pages

ISBN:9781450371865

DOI:10.1145/3351917

Editor:
Fumin Zhang

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

Sichuan University

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 July 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CACRE2019

CACRE2019: 2019 4th International Conference on Automation, Control and Robotics Engineering

July 19 - 21, 2019

Shenzhen, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
177
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shepley AFalzon GKwan PBrankovic L(2023)Confluence: A Robust Non-IoU Alternative to Non-Maxima Suppression in Object DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.3273210(1-16)Online publication date: 2023
https://doi.org/10.1109/TPAMI.2023.3273210
Sakabe HNakada Y(2023)Enhanced Method for Computing Optimal Dribbling Routes Using Tracking Data in Basketball2023 IEEE Ninth Multimedia Big Data (BigMM)10.1109/BigMM59094.2023.00009(11-18)Online publication date: 11-Dec-2023
https://doi.org/10.1109/BigMM59094.2023.00009
Yuan SZuo ZSun BLiu Y(2023)Research on Grasping Detection Method of Manipulator Based on SOLOV2Proceedings of 2022 International Conference on Autonomous Unmanned Systems (ICAUS 2022)10.1007/978-981-99-0479-2_51(550-561)Online publication date: 10-Mar-2023
https://doi.org/10.1007/978-981-99-0479-2_51
Russomanno TBlauberger PKolbinger OLam HSchmid MLames M(2022)Drone-Based Position Detection in Sports—Validation and ApplicationsFrontiers in Physiology10.3389/fphys.2022.85051213Online publication date: 17-Mar-2022
https://doi.org/10.3389/fphys.2022.850512
Zang YZhu H(2022)Multi-Hypothesis Joint Detection and Estimation with Worst-Case Mean Square Error2022 7th International Conference on Automation, Control and Robotics Engineering (CACRE)10.1109/CACRE54574.2022.9834114(288-295)Online publication date: Jul-2022
https://doi.org/10.1109/CACRE54574.2022.9834114
Moodley Tvan der Haar D(2022)Cricket Scene Analysis Using the RetinaNet ArchitectureProgress in Pattern Recognition, Image Analysis, Computer Vision, and Applications10.1007/978-3-030-93420-0_19(197-206)Online publication date: 1-Jan-2022
https://doi.org/10.1007/978-3-030-93420-0_19
Sano YNakada Y(2021)Visualization for Potential Pass Courses and Quantification for Offensive and Defensive Players in Basketball2021 International Conference on Engineering and Emerging Technologies (ICEET)10.1109/ICEET53442.2021.9659701(1-6)Online publication date: 27-Oct-2021
https://doi.org/10.1109/ICEET53442.2021.9659701
Nelikanti AVenkata Rami Reddy GKaruna G(2021)An Optimization Based deep LSTM Predictive Analysis for Decision Making in CricketInnovative Data Communication Technologies and Application10.1007/978-981-15-9651-3_59(721-737)Online publication date: 3-Feb-2021
https://doi.org/10.1007/978-981-15-9651-3_59

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents