Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Topological Semantic Mapping and Localization in Urban Road Scenarios

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Autonomous vehicle self-localization must be robust to environment changes, such as dynamic objects, variable illumination, and atmospheric conditions. Topological maps provide a concise representation of the world by only keeping information about relevant places, being robust to environment changes. On the other hand, semantic maps correspond to a high level representation of the environment that includes labels associated with relevant objects and places. Hence, the use of a topological map based on semantic information represents a robust and efficient solution for large-scale outdoor scenes for autonomous vehicles and Advanced Driver Assistance Systems (ADAS). In this work, a novel topological semantic mapping and localization methodology for large-scale outdoor scenarios for autonomous driving and ADAS applications is presented. The methodology uses: (i) a deep neural network for obtaining semantic observations of the environment, (ii) a Topological Semantic Map (TSM) for storing selected semantic observations, and (iii) a topological localization algorithm which uses a Particle Filter for obtaining the vehicle’s pose in the TSM. The proposed methodology was tested on a real driving scenario, where a True Estimate Rate of the vehicle’s pose of 96.9% and a Mean Position Accuracy of 7.7[m] were obtained. These results are much better than the ones obtained by other two methods used for comparative purposes. Experiments also show that the method is able to obtain the pose of the vehicle when its initial pose is unknown.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Arulampalam, M.S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking. IEEE Trans. Signal Process. 50(2), 174–188 (2002)

    Article  Google Scholar 

  2. Bernuy, F., Ruiz del Solar, J.: Topological semantic mapping and localization demo. https://youtu.be/H9TPohkC4yE

  3. Bernuy, F., Ruiz del Solar, J.: Semantic mapping of large-scale outdoor scenes for autonomous off-road driving. In: 2015 IEEE International Conference on Computer Vision Workshop (ICCVW), pp. 124–130. IEEE (2015)

  4. Best, D., Fisher, N.I.: Efficient simulation of the von mises distribution. Appl. Stat. 28, 152–157 (1979)

  5. Brubaker, M.A., Geiger, A., Urtasun, R.: Lost! leveraging the crowd for probabilistic visual self-localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3057–3064 (2013)

  6. Brubaker, M.A., Geiger, A., Urtasun, R.: Map-based probabilistic visual self-localization. IEEE Trans. Pattern Anal. Mach. Intell. 38(4), 652–665 (2016)

    Article  Google Scholar 

  7. Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., Leonard, J.J.: Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Trans. Robot. 32(6), 1309–1332 (2016)

    Article  Google Scholar 

  8. Churchill, W., Newman, P.: Experience-based navigation for long-term localisation. Int. J. Robot. Res. 32 (14), 1645–1661 (2013)

    Article  Google Scholar 

  9. Cole, D., Newman, P.: Using laser range data for 3d SLAM in outdoor environments. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Orlando (2006)

  10. Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., Schiele, B.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)

  11. Cover, T.M., Thomas, J.A.: Elements of information theory. Wiley, NJ (2012)

    MATH  Google Scholar 

  12. Floros, G., van der Zander, B., Leibe, B.: Openstreetslam: Global vehicle localization using openstreetmaps. In: 2013 IEEE International Conference on Robotics and Automation (ICRA), pp. 1054–1059. IEEE (2013)

  13. Gadd, M., Newman, P.: Checkout my map: Version control for fleetwide visual localisation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2016)

  14. Galindo, C., Fernández-Madrigal, J.A., González, J., Saffiotti, A.: Robot task planning using semantic maps. Robot. Auton. Syst. 56(11), 955–966 (2008)

    Article  Google Scholar 

  15. Garcia-Fidalgo, E., Ortiz, A.: Vision-based topological mapping and localization methods: A survey. Robot. Auton. Syst. 64, 1–20 (2015)

    Article  Google Scholar 

  16. Glover, A.J., Maddern, W.P., Milford, M.J., Wyeth, G.F.: Fab-map+ ratslam: Appearance-based slam for multiple times of day. In: 2010 IEEE International Conference on Robotics and Automation (ICRA), pp. 3507–3512. IEEE (2010)

  17. Henson, C., Sheth, A., Thirunarayan, K.: Semantic perception: Converting sensory observations to abstractions. Internet Comput. IEEE 16(2), 26–34 (2012)

    Article  Google Scholar 

  18. Kitagawa, G.: Monte carlo filter and smoother for non-gaussian nonlinear state space models. J. Comput. Graph. Stat. 5(1), 1–25 (1996)

    MathSciNet  Google Scholar 

  19. Kostavelis, I., Gasteratos, A.: Semantic mapping for mobile robotics tasks: A survey. Robot. Auton. Syst. 66, 86–103 (2015)

    Article  Google Scholar 

  20. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)

    Article  Google Scholar 

  21. Linegar, C., Churchill, W., Newman, P.: Work smart, not hard: Recalling relevant experiences for vast-scale but time-constrained localisation. In: 2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 90–97. IEEE (2015)

  22. Maddern, W., Pascoe, G., Newman, P.: Leveraging Experience for Large-Scale LIDAR Localisation in Changing Cities. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Seattle (2015)

  23. Merriaux, P., Dupuis, Y., Vasseur, P., Savatier, X.: Fast and robust vehicle positioning on graph-based representation of drivable maps. In: 2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 2787–2793. IEEE (2015)

  24. Newman, P., Sibley, G., Smith, M., Cummins, M., Harrison, A., Mei, C., Posner, I., Shade, R., Schroeter, D., Murphy, L., Churchill, W., Cole, D., Reid, I.: Navigating, recognising and describing urban spaces with vision and laser. Int. J. Robot. Res. 28 (2009). https://doi.org/10.1177/0278364909341483

  25. Nüchter, A., Hertzberg, J.: Towards semantic maps for mobile robots. Robot. Auton. Syst. 56(11), 915–926 (2008)

    Article  Google Scholar 

  26. Paul, R., Newman, P.: Fab-map 3d: Topological mapping with spatial and visual appearance. In: Robotics and Automation (ICRA), 2010 IEEE International Conference on, pp. 2649–2656. IEEE (2010)

  27. Pronobis, A., Aydemir, A., Sjöö, K., Jensfelt, P.: Exploiting semantics in mobile robotics. In: ICRA 2012 Workshop on Semantic Perception, Mapping and Exploration (2012)

  28. Rabiner, L.R.: A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257–286 (1989)

    Article  Google Scholar 

  29. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556 (2014)

  30. Tomatis, N., Nourbakhsh, I., Siegwart, R.: Hybrid simultaneous localization and map building: a natural integration of topological and metric. Robot. Auton. Syst. 44(1), 3–14 (2003)

    Article  Google Scholar 

  31. Wolcott, R.W., Eustice, R.M.: Visual localization within lidar maps for automated urban driving. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 176–183. IEEE (2014)

  32. Yu, F., Koltun, V.: Multi-scale context aggregation by dilated convolutions. In: ICLR (2016)

Download references

Acknowledgements

This work was partially funded by FONDECYT Project 1161500.

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Universidad de Chile, Santiago, Chile

    Fernando Bernuy & Javier Ruiz-del-Solar

  2. Advanced Mining Technology Center, Universidad de Chile, Santiago, Chile

    Javier Ruiz-del-Solar

Authors
  1. Fernando Bernuy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Javier Ruiz-del-Solar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fernando Bernuy.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bernuy, F., Ruiz-del-Solar, J. Topological Semantic Mapping and Localization in Urban Road Scenarios. J Intell Robot Syst 92, 19–32 (2018). https://doi.org/10.1007/s10846-017-0744-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-017-0744-x

Keywords

Search

Navigation