Semantic segmentation of surface from lidar point cloud
Authors: 
Aritra Mukherjee, Sourya Dipta Das, Jasorsi Ghosh, Ananda S. Chowdhury, Sanjoy Kumar SahaAuthors Info & Claims
Pages 35171 - 35191
Abstract
Mapping the environment for robot navigation is an important and challenging task in SLAM (Simultaneous Localization And Mapping). Lidar sensor can produce near accurate 3D map of the environment in real time in form of point clouds. Though the point cloud data is adequate for building the map of the environment, processing millions of points in a point cloud is found to be computationally expensive. In this paper, we propose a fast algorithm that can be used to extract semantically labelled surface segments from the cloud in real time for direct navigational use or for higher level contextual scene reconstruction. First, a single scan from a spinning Lidar is used to generate a mesh of sampled cloud points. The generated mesh is further used for surface normal computation of a set of points on the basis of which surface segments are estimated. A novel descriptor is proposed to represent the surface segments. This descriptor is used to determine the surface class (semantic label) of the segments with the help of a classifier. These semantic surface segments can be further utilized for geometric reconstruction of objects in the scene or for optimized trajectory planning of a robot. The proposed method is compared with a number of point cloud segmentation methods and state of the art semantic segmentation methods to demonstrate its efficacy in terms of speed and accuracy.
References
[1]
Altman NS An introduction to kernel and nearest-neighbor nonparametric regression Amer Stat 1992 46 3 175-185
[2]
Bassier M, Bonduel M, Van Genechten B, and Vergauwen M Segmentation of large unstructured point clouds using octree-based region growing and conditional random fields Int Arch Photogr Remote Sens Spatial Inf Sci 2017 42 2W8 25-30
[3]
Ben-Shabat Y, Avraham T, Lindenbaum M, and Fischer A Graph based over-segmentation methods for 3d point clouds Comput Vis Image Underst 2018 174 12-23
[4]
Bhanu B, Lee S, Ho C-C, Henderson T (1986) Range data processing: Representation of surfaces by edges. In: Proceedings of the eighth international conference on pattern recognition. IEEE Computer Society Press, pp 236–238
[5]
Feng C, Taguchi Y, Kamat VR (2014) Fast plane extraction in organized point clouds using agglomerative hierarchical clustering. In: 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp 6218–6225
[6]
Fu K, Fan D-P, Ji G-P, Zhao Q (2020) Jl-dcf: Joint learning and densely-cooperative fusion framework for rgb-d salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 3052–3062
[7]
Geurts P, Ernst D, and Wehenkel L Extremely randomized trees Mach Learn 2006 63 1 3-42
[8]
Golovinskiy A, Funkhouser T (2009) Min-cut based segmentation of point clouds. In: 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops. IEEE, pp 39–46
[9]
Gschwandtner M, Kwitt R, Uhl A, Pree W (2011) Blensor: Blender sensor simulation toolbox. In International Symposium on Visual Computing. Springer, pp 199–208
[10]
Hackel T, Wegner JD, and Schindler K Fast semantic segmentation of 3d point clouds with strongly varying density ISPRS Ann Photogr Remote Sens Spatial Inf Sci 2016 3 3 177-184
[11]
Himmelsbach M, Hundelshausen FV, Wuensche H-J (2010) Fast segmentation of 3d point clouds for ground vehicles. In: 2010 IEEE Intelligent Vehicles Symposium. IEEE, pp 560–565
[12]
Ho TK (1995) Random decision forests. In: Proceedings of 3rd international conference on document analysis and recognition, vol 1. IEEE, pp 278–282
[13]
Hu Q, Yang B, Xie L, Rosa S, Guo Y, Wang Z, Trigoni N, Markham A (2020) Randla-net: Efficient semantic segmentation of large-scale point clouds. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 11108–11117
[14]
Ioannou Y, Taati B, Harrap R (2012) M. Greenspan. Difference of normals as a multi-scale operator in unorganized point clouds. In: 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission. IEEE, pp 501–508
[15]
Jiang XY, Meier U, Bunke H (1996) Fast range image segmentation using high-level segmentation primitives. In: Proceedings Third IEEE Workshop on Applications of Computer Vision WACV’96. IEEE, pp 83–88
[16]
Jiang M, Wu Y, Zhao T, Zhao Z, Lu C (2018) Pointsift: A sift-like network module for 3d point cloud semantic segmentation. arXiv:1807.00652
[17]
Landrieu L, Simonovsky M (2018) Large-scale point cloud semantic segmentation with superpoint graphs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 4558–4567
[18]
Lee Y, Lin Y, and Wahba G Multicategory support vector machines: Theory and application to the classification of microarray data and satellite radiance data J Am Stat Assoc 2004 99 465 67-81
[19]
Li M, Yin D (2017) A fast segmentation method of sparse point clouds. In 2017 29th Chinese Control And Decision Conference (CCDC). IEEE, pp 3561–3565
[20]
Li Y, Bu R, Sun M, Wu W, Di X, Chen B (2018) Pointcnn: Convolution on x-transformed points. In: Advances in neural information processing systems, pp 820–830
[21]
Li G, Muller M, Thabet A, Ghanem B (2019) Deepgcns: Can gcns go as deep as cnns?. In: Proceedings of the IEEE International Conference on Computer Vision, pp 9267–9276
[22]
Liu Z, Tang H, Lin Y, Han S (2019) Point-voxel cnn for efficient 3d deep learning. In: Advances in Neural Information Processing Systems, pp 963–973
[23]
Moosmann F, Pink O, Stiller C (2009) Segmentation of 3d lidar data in non-flat urban environments using a local convexity criterion. In: 2009 IEEE Intelligent Vehicles Symposium. IEEE, pp 215–220
[24]
Mukherjee A, Das SD, Ghosh J, Chowdhury AS, Saha SK (2019) Fast geometric surface based segmentation of point cloud from lidar data. In International Conference on Pattern Recognition and Machine Intelligence. Springer, pp 415–423
[25]
Nguyen A, Le B (2013) 3d point cloud segmentation: A survey. In 2013 6th IEEE conference on robotics, automation and mechatronics (RAM). IEEE, pp 225–230
[26]
Qi CR, Su H, Mo K, Guibas LJ (2017a) Pointnet: Deep learning on point sets for 3d classification and segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 652–660
[27]
Qi CR, Yi L, Su H, Guibas LJ (2017b) Pointnet++ Deep hierarchical feature learning on point sets in a metric space. In: Advances in neural information processing systems, pp 5099–5108
[28]
Quinlan JR Induction of decision trees Mach Learn 1986 1 1 81-106
[29]
Rusu RB, Cousins S (2011) 3d is here: Point cloud library (pcl). In 2011 IEEE international conference on robotics and automation. IEEE, pp 1–4
[30]
Rusu RB, Holzbach A, Blodow N, Beetz M (2009) Fast geometric point labeling using conditional random fields. In: 2009 IEEE/RSJ International Conference On Intelligent Robots and Systems. IEEE, pp 7–12
[31]
Srivastava S and Lall B Deeppoint3d: Learning discriminative local descriptors using deep metric learning on 3d point clouds Pattern Recogn Lett 2019 127 27-36
[32]
Tarsha-Kurdi F, Landes T, Grussenmeyer P (2007) Hough-transform and extended ransac algorithms for automatic detection of 3d building roof planes from lidar data. In: ISPRS Workshop on Laser Scanning 2007 and SilviLaser 2007, vol 36, pp 407–412
[33]
Vo A-V, Truong-Hong L, Laefer DF, and Bertolotto M Octree-based region growing for point cloud segmentation ISPRS J Photogramm Remote Sens 2015 104 88-100
[34]
Wang Y, Sun Y, Liu Z, Sarma SE, Bronstein MM, and Solomon JM Dynamic graph cnn for learning on point clouds Acm Trans Graph (tog) 2019 38 5 1-12
[35]
Wicaksono SB, Wibisono A, Jatmiko W, Gamal A, Wisesa HA (2019) Semantic segmentation on lidar point cloud in urban area using deep learning. In: 2019 International Workshop on Big Data and Information Security (IWBIS). IEEE, pp 63–66
[36]
Zermas D, Izzat I, Papanikolopoulos N (2017) Fast segmentation of 3d point clouds: A paradigm on lidar data for autonomous vehicle applications. In: 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp 5067–5073
[37]
Zhan Q, Liang Y, and Xiao Y Color-based segmentation of point clouds Laser Scann 2009 38 3 155-161
[38]
Zhang J, Fan D-P, Dai Y, Anwar S, Saleh FS, Zhang T, Barnes N (2020a) Uc-net: uncertainty inspired rgb-d saliency detection via conditional variational autoencoders. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 8582–8591
[39]
Zhang Y, Zhou Z, David P, Yue X, Xi Z, Foroosh H (2020b) Polarnet: An improved grid representation for online lidar point clouds semantic segmentation. arXiv:2003.14032
[40]
Zhao N, Chua T-S, Lee GH (2020) Few-shot 3d point cloud semantic segmentation. arXiv:2006.12052
Index Terms
- Semantic segmentation of surface from lidar point cloud
Index terms have been assigned to the content through auto-classification.
Recommendations
Fast Geometric Surface Based Segmentation of Point Cloud from Lidar Data
Pattern Recognition and Machine IntelligenceAbstractMapping the environment has been an important task for robot navigation and Simultaneous Localization And Mapping (SLAM). LIDAR provides a fast and accurate 3D point cloud map of the environment which helps in map building. However, processing ...
Incorporation of Morphological Properties of Buildings' Descriptors Computed from GIS and LIDAR Data on an Urban Multi-agent Vector Based Geo-simulator
ICCSA '09: Proceedings of the International Conference on Computational Science and Its Applications: Part IIn this paper we present an application of GIS and airborne light detection and ranging (LIDAR) data analysis for computation of morphological properties of buildings' descriptors in the context of an urban morphogenesis geo-simulator. The morphological ...
Crest Lines for Surface Segmentation and Flattening
We present a method for extracting feature curves called crest lines from a triangulated surface. Then, we calculate the geodesic Voronoi diagram of crest lines to segment the surface into several regions. Afterward, barycentric surface flattening using ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© Springer Science+Business Media, LLC, part of Springer Nature 2020.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 01 November 2021
Accepted: 09 September 2020
Revision received: 13 July 2020
Received: 29 April 2020
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 09 Jan 2025