Cited By
View all- García FGarcía JPonz ADe La Escalera AArmingol J(2019)ReviewExpert Systems with Applications: An International Journal10.1016/j.eswa.2014.04.03441:15(6646-6661)Online publication date: 25-Nov-2019
Information fusion to detect and classify pedestrians using invariant features
Abstract
A novel approach to detect pedestrians and to classify them according to their moving direction and relative speed is presented in this paper. This work focuses on the recognition of pedestrian lateral movements, namely: walking and running in both directions, as well as no movement. The perception of the environment is performed through a lidar sensor and an infrared camera. Both sensor signals are fused to determine regions of interest in the video data. The classification of these regions is based on the extraction of 2D translation invariant features, which are constructed by integrating over the transformation group. Special polynomial kernel functions are defined in order to obtain a good separability between the classes. Support vector machine classifiers are used in different configurations to classify the invariants. The proposed approach was evaluated offline considering fixed sensors. Results obtained based on real traffic scenes demonstrate very good detection and classification rates.
References
[1]
European Road Safety Observatory, Annual statistical report, 2008.
[2]
S.J. Krotosky, M.M. Trivedi, On color-, infrared-, and multimodal-stereo approaches to pedestrian detection, in: Transactions on Intelligent Transportation Systems, vol. 8, 2007, pp. 619-629.
[3]
Bertozzi, M., Broggi, A., Caraffi, C., Rose, M.D., Felisa, M. and Vezzoni, G., Pedestrian detection by means of far-infrared stereo vision. Computer Vision and Image Understanding. v106. 194-204.
[4]
Y. Chen, C. Han, Night-time pedestrian detection by visual-infrared video fusion, in: World Congress on Intelligent Control and Automation, 2008.
[5]
S. Gidel, P. Checchin, T.C. Christophe Blanc, L. Trassoudaine, Parzen method for fusion of laserscanner data: application to pedestrian detection, in: IEEE Intelligent Vehicles Symposium, 2008.
[6]
G. Gate, F. Nashashibi, Using targets appearance to improve pedestrian classification with a laser scanner, in: IEEE Intelligent Vehicles Symposium, 2008, pp. 571-576.
[7]
S. Wender, K.C.J. Dietmayer, An adaptable object classification framework, in: IEEE Intelligent Vehicles Symposium, 2006.
[8]
M.-M. Meinecke, M.A. Obojski, M. Töns, M. Dehesa, SAVE-U: first experiences with a pre-crash system for enhancing pedestrian safety, in: 5th European Congress and Exhibition on Intelligent Transport Systems, 2005.
[9]
B. Fardi, U. Schuenert, G. Wanielik, Shape and motion-based pedestrian detection in infrared images: a multi sensor approach, in: IEEE Intelligent Vehicles Symposium, 2005, pp. 18-23.
[10]
L.N. Pangop, S. Comou, F. Chausse, R. Chapuis, S. Bonnet, A bayesian classification of pedestrians in urban areas: the importance of the data preprocessing, in: IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, 2008.
[11]
C. Premebida, G. Monteiro, U. Nunes, P. Peixoto, A lidar and vision-based approach for pedestrian and vehicle detection and tracking, in: IEEE Intelligent Transportation Systems Conference, 2007.
[12]
Z. Wang, J. Zhang, Detecting pedestrian abnormal behavior based on fuzzy associative memory, in: Fourth International Conference on Natural Computation, 2008.
[13]
Z. Chen, D.C.K. Ngai, N.H.C. Yung, Pedestrian behavior prediction based on motion patterns for vehicle-to-pedestrian collision avoidance, in: International IEEE Conference on Intelligent Transportation Systems, 2008.
[14]
Bota, S. and Nedesvchi, S., Multi-feature walking pedestrians detection for driving assistance systems. IET Intelligent Transport Systems. v2. 92-104.
[15]
P. Geismann, G. Schneider, A two-staged approach to vision-based pedestrian recognition using haar and hog features, in: IEEE Intelligent Vehicles Symposium, 2008.
[16]
M. Enzweiler, D.M. Gavrila, A mixed generative-discriminative framework for pedestrian classification, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008.
[17]
Bertozzi, M., Broggi, A., Ghidoni, S. and Rose, M.D., Pedestrian shape extraction by means of active contours. Field and Service Robotics. v42. 265-274.
[18]
M. Thuy, A. Pérez Grassi, V.A. Frolov, F. Puente León, Fusion von MIR-Bildern und Lidardaten zur Klassifikation menschlicher Verkehrsteilnehmer, in: M. Maurer, C. Stiller (Eds.), Workshop Fahrerassistenzsysteme, vol. 5, 2008, pp. 168-175.
[19]
Lowe, D.G., Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision. v60. 91-110.
[20]
B. Leibe, E. Seemann, B. Schiele, Pedestrian detection in crowded scenes, in: CVPR'05: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - IEEE Computer Society, vol. 1, Washington, DC, USA, 2005, pp. 878-885.
[21]
F.H.C. Tivive, A. Bouzerdoum, A biologically inspired visual pedestrian detection system, in: IEEE International Joint Conference On Neural Networks, 2008.
[22]
M. Bertozzi, A. Broggi, M.D. Rose, M. Felisa, A. Rakotomamonjy, F. Suard, A pedestrian detector using histograms of oriented gradients and a support vector machine classifier, in: IEEE Intelligent Transportation Systems Conference, 2007.
[23]
J. Dong, J. Ge, Y. Luo, Nighttime pedestrian detection with near infrared using cascaded classifiers, in: IEEE International Conference on Image Processing, 2007.
[24]
B. Fardi, I. Seifert, G. Wanielik, J. Gayko, Motion-based pedestrian recognition from a moving vehicle, in: IEEE Intelligent Vehicles Symposium, 2006.
[25]
Y. Chen, Q. Wu, X. He, Motion based pedestrian recognition, in: Congress on Image and Signal Processing, 2008.
[26]
L. Havasi, Z. Szlávik, T. Szirányi, Pedestrian detection using derived third-order symmetry of legs, in: International Conference Computer Vision and Graphics, vol. 32, 2004.
[27]
S. Wu, S. Decker, P. Chang, T. Camus, J. Eledath, Collision sensing by stereo vision and radar sensor fusion, in: IEEE Intelligent Vehicles Symposium, 2008.
[28]
Dimitrijevic, M., Lepetit, V. and Fua, P., Human body pose detection using bayesian spatio-temporal templates. Computer Vision and Image Understanding. v104 i2. 127-139.
[29]
P. Viola, M. Jones, D. Snow, Detecting pedestrians using patterns of motion and appearance, in: International Journal of Computer Vision, vol. 63, 2005, pp. 153-161.
[30]
E. Seemann, B. Leibe, B. Schiele, Multi-aspect detection of articulated objects, in: CVPR'06: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, Washington, DC, USA, 2006, pp. 1582-1588.
[31]
S. Milch, M. Behrens, Pedestrian detection with radar and computer vision, 2001.
[32]
N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: C. Schmid, S. Soatto, C. Tomasi (Eds.), International Conference on Computer Vision & Pattern Recognition, vol. 2, 2005, pp. 886-893.
[33]
A. Mohan, T. Poggio, Example-based object detection in images by components, in: Proceedings of IEEE Transactions on PAMI, vol. 23, 2001, pp. 349-361.
[34]
F. Xu, X. Lui, K. Fukimura, Pedestrian detection and tracking with night vision, in: Proceedings of IEEE Transactions on Intelligent Transportation Systems, vol. 6, 2005, pp. 63-71.
[35]
M. Thuy, F. Puente León, Non-linear, shape independent object tracking based on 2d lidar data, in: Intelligent Vehicles Symposium, 2009 IEEE, 2009, pp. 532-537.
[36]
Dasarathy, B., Sensor fusion potential exploitation-innovative architectures and illustrative applications. Proceedings of IEEE. v85. 24-38.
[37]
H. Schulz-Mirbach, Anwendung von Invarianzprinzipien zur Merkmalgewinnung in der Mustererkennung, Ph.D. thesis, Technische Universität Hamburg-Harburg, 1995.
[38]
Lenz, R., Group Theoretical Methods in Image Processing, Lecture Notes in Computer Science. 1990. Springer.
[39]
Wood, J., Invariant pattern recognition: a review. Pattern Recognition. v29 i1. 1-17.
[40]
Burges, C., A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery. v2. 121-167.
[41]
C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm, National Taiwan University, 2001.
[42]
Q. Zhu, S. Avidan, M.C. Yeh, K.T. Cheng, Fast human detection using a cascade of histograms of oriented gradients, in: CVPR, IEEE Computer Society, 2006, pp. 1491-1498.
[43]
H.-X. Jia, Y.-J. Zhang, Fast human detection by boosting histograms of oriented gradients, in: Fourth International Conference on Image and Graphics, ICIG 2007, 2007, pp. 683-688.
[44]
S. Munder, D. Gavrilla, An experimental study on pedestrian classification, in: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, 2006, pp. 1863-1868.
Index Terms
- Information fusion to detect and classify pedestrians using invariant features
Index terms have been assigned to the content through auto-classification.
Recommendations
3D radial invariant of dual Hahn moments
In this work, we propose new sets of 2D and 3D rotation invariants based on orthogonal radial dual Hahn moments, which are orthogonal on a non-uniform lattice. We also present theoretical mathematics to derive them. Thus, this paper presents in the ...
Hybrid cascade boosting machine using variant scale blocks based HOG features for pedestrian detection
This paper contributes two issues for enhancing the accuracy and speed of a pedestrian detection system. First, it introduces a feature description using variant-scale block based Histograms of Oriented Gradients (HOG) features. By non-restricted block ...
Rotation, Scaling and Deformation Invariant Scattering for Texture Discrimination
CVPR '13: Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern RecognitionAn affine invariant representation is constructed with a cascade of invariants, which preserves information for classification. A joint translation and rotation invariant representation of image patches is calculated with a scattering transform. It is ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © Elsevier B.V. © 2010.
Publisher
Elsevier Science Publishers B. V.
Netherlands
Publication History
Published: 01 October 2011
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 04 Oct 2024
Other Metrics
Citations
Cited By
View all- García FGarcía JPonz ADe La Escalera AArmingol J(2019)ReviewExpert Systems with Applications: An International Journal10.1016/j.eswa.2014.04.03441:15(6646-6661)Online publication date: 25-Nov-2019
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in