research-article

Autonomous vehicles testing methods review

Authors:

FengHua ZhuAuthors Info & Claims

2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC)

Pages 163 - 168

https://doi.org/10.1109/ITSC.2016.7795548

Published: 01 November 2016 Publication History

Abstract

Driving test is critical to the deployment of autonomous vehicles. It is necessary to review the related works since the methodologies summaries are rare, which will help to set up an integrated method for autonomous driving test in different development stages, and help to provide a reliable, quick, safe, low cost and reproducible method and accelerate the development of autonomous vehicle. In this paper, we review the related autonomous driving test works, including autonomous vehicle functional verification, vehicle integrated testing, system validation in different architectures. This review work will be helpful for autonomous vehicle development.

References

[1]

www.google.com/en//selfdrivingcar/files/reports/report-0216.pdf

[2]

https:llwww.dspace.com/zh/zho/home/products/systems/ecutest/configuration_examples/ecus_for_vehicle_dynamics.cfm

[3]

http://www.mtc.umich.edu/test-facility

[4]

https://en.wikipedia.org/wiki/Google_self-driving_car

[5]

http://www.bitrebels.com/technology/teslas-first-autopilot-crash-happened/

[6]

http://www.rand.org/content/dam/rand/pubs/research_reports/RR400/RR443-2/RAND_RR443-2.pdf

[7]

M. Aeberhard, S. Rauch, M. Bahram, G. Tanzmeister, J. Thomas, Y. Pilat, F. Homm, W. Huber, and N. Kaempchen, “Experience, Results and Lessons Learned from Automated Driving on Germany's Highways”, IEEE Intelligent Transportation Systems Magazine, vol. 7, no. 1, pp. 42–57, 2015.

[8]

F. Flemisch, A. Schieben, N. Schoemig, M. Strauss, S. Lueke, and A. Heyden, “Design of human computer interfaces for highly automated vehicles in the eu-project HAVEit”, pp. 270–279.

[9]

M. Campbell, M. Egerstedt, J. P. How, and R. M. Murray, “Autonomous driving in urban environments: approaches, lessons and challenges”, Philosophical Transactions of the Royal Society of London A: Mathematical, Physical and Engineering Sciences, vol. 368, no. 1928, pp. 4649–4672, 2010.

[10]

O. Carsten, and L. Nilsson, “Safety assessment of driver assistance systems”, European Journal of Transport and Infrastructure Research, vol. 1, no. 3, pp. 225–243, 2001.

[11]

European research project “Testing and Evaluation Methods for ICT-based Safety Systems (eVALUE)”, http://www.evalue-project.eu/

[12]

M. Anwar Taie, “New trends in automotive software design for the challenges of active safety and autonomous vehicles”.

[13]

C. Gühmann, J. Riese, and K. von Rüden, “Simulation and Testing for Vehicle Technology”.

[14]

R. Schilling, and T. Schultz, “Validation of Automated Driving Functions”, Simulation and Testing for Vehicle Technology, pp. 377–381: Springer, 2016.

[15]

M. Hjort, H. Andersson, J. Jansson, S. Mårdh, and J. Sundström, “A test method for evaluating safety aspects of ESC equipped passenger cars: a prototype proposal”, 2009.

[16]

F.-Y. Wang, X. Wang, L. Li, P. Mirchandani, and Z. Wang, “Digital and construction of a digital vehicle proving ground”. pp. 533–536.

[17]

W. Huang, D. Wen, J. Geng, and N.-N. Zheng, “Task-specific performance evaluation of ugvs: Case studies at the IVFC”, IEEE Transactions on Intelligent Transportation Systems, vol. 15, no. 5, pp. 1969–1979, 2014.

[18]

H.-M. Huang, K. Pavek, J. Albus, and E. Messina, “Autonomy levels for unmanned systems (alfus) framework: An update”. pp. 439–448.

[19]

M. Broy, “Challenges in automotive software engineering”. pp. 33–42.

[20]

M. R. Heinen, F. S. Osório, F. J. Heinen, and C. Kelber, “SEVA3D: Autonomous Vehicles Parking Simulator in a three-dimensional environment”, INFOCOMP Journal of Computer Science, vol. 6, no. 2, pp. 63–70, 2007.

[21]

M. Kuderer, S. Gulati, and W. Burgard, “Learning driving styles for autonomous vehicles from demonstration”. pp. 2641–2646.

[22]

R. Austin, Unmanned aircraft systems: UAVs design, development and deployment: John Wiley & Sons, 2011.

[23]

J. L. Pereira, and R. J. Rossetti, “An integrated architecture for autonomous vehicles simulation”. pp. 286–292.

[24]

https://www.tassinternational.com, TNO spinout TASSInternational

[25]

D. Gruyer, S. Pechberti, and S. Glaser, “Development of full speed range ACC with SiVIC, a virtual platform for ADAS prototyping, test and evaluation”. pp. 100–105.

[26]

M. Lesemann, A. Zlocki, J. Dalmau, M. Vesco, M. Hjort, L. Isasi, H. Eriksson, J. Jacobson, L. Nordström, and D. Westhoff, “A test programme for active vehicle safety–detailed discussion of the eVALUE testing protocols for longitudinal and stability functionality”, in 22nd Enhanced Safety of Vehicles (ESV) Conf., Washington, USA, 2011.

[27]

M. Buhren, and B. Yang, “Simulation of automotive radar target lists using a novel approach of object representation”, in 2006 IEEE Intelligent Vehicles Symposium, 2006, pp. 314–319.

[28]

A. Sidhu, “Development of an Autonomous Test Driver and Strategies for Vehicle Dynamics Testing and Lateral Motion Control”, The Ohio State University, 2010.

[29]

C. Miquet, “New test method for reproducible real-time tests of ADAS ECUs: “Vehicle-in-the-Loop” connects real-world vehicles with the virtual world.” pp. 575–589.

[30]

http://www.js.xinhuanet.com/2015–08/18/c_1116293050.htm

[31]

M. Blanco, J. Atwood, S. Russell, T. Trimble, J. McClafferty, and M. Perez, Automated Vehicle Crash Rate Comparison Using Naturalistic Data, Virginia Tech Transportation Institute, 2016.

[32]

O. Gietelink, D. Verburg, K. Labibes, and A. Oostendorp, “Pre-crash system validation with PRESCAN and VEHIL”. pp. 913–918.

[33]

M. Montremerlo, J. Beeker, S. Bhat, and H. Dahlkamp, “The stanford entry in the urban challenge”, Journal of Field Robotics, vol. 7, no. 9, pp. 468–492, 2008.

[34]

S. Thrun, M. Montemerlo, H. Dahlkamp, D. Stavens, A. Aron, J. Diebel, P. Fong, J. Gale, M. Halpenny, and G. Hoffmann, “Stanley: The robot that won the DARPA Grand Challenge”, Journal of field Robotics, vol. 23, no. 9, pp. 661–692, 2006.

[35]

T. J. Alberi, “A proposed standardized testing procedure for autonomous ground vehicles”, Embry Riddle Aeronautical University, 2008.

[36]

C. Adam, and G. Wanielik, “Map-based driving profile simulation for energy consumption estimation of electric vehicles”, in 2012 15th International IEEE Conference on Intelligent Transportation Systems, 2012, pp. 1078–1084.

[37]

P. Nordin, L. Andersson, and J. Nygards, “Sensor data fusion for terrain exploration by collaborating unmanned ground vehicles”. pp. 1–8.

[38]

J. Z. Varghese, and R. G. Boone, “Overview of Autonomous Vehicle Sensors and Systems”. [J].

[39]

C. Berger, “Automating Acceptance Tests for Sensor-and Actuator-based Systems on the Example of Autonomous Vehicles. Aachen”, Germany: Shaker Verlag, Aachener Informatik-Berichte, Software Engineering, 2010.

[40]

A. Geiger, P. Lenz, and R. Urtasun, “Are we ready for autonomous driving? the kitti vision benchmark suite”. in 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 3354–3361.

[41]

W. Wachenfeld, and H. Winner, “Virtual Assessment of Automation in Field Operation A New Runtime Validation Method”. p. 161.

[42]

A. Christensen, A. Cunningham, J. Engelman, C. Green, C. Kawashima, S. Kiger et al., “Key Considerations in the Development of Driving Automation Systems”, in 24th International Technical Conference on the Enhanced Safety of Vehicles (ESV), 2015.

[43]

M. Quinlan, T.-C. Au, J. Zhu, N. Stiurca, and P. Stone, “Bringing simulation to life: A mixed reality autonomous intersection”, in Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on, 2010, pp. 6083–6088.

[44]

F. Gechter, B. Dafflon, P. Gruer, and A. Koukam, “Towards a hybrid real/virtual simulation of autonomous vehicles for critical scenarios”, in The Sixth International Conference on Advances in System Simulation (SIMUL 2014), 2014.

Cited By

Guo AZhou YTian HFang CSun YSun WGao XLuu ALiu YChen ZFilkov VRay BZhou M(2024)SoVAR: Build Generalizable Scenarios from Accident Reports for Autonomous Driving TestingProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695037(268-280)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695037
Wang YLi WAlam MManiatakos MJabari S(2024)Backdozer: A Backdoor Detection Methodology for DRL-based Traffic ControllersACM Journal on Autonomous Transportation Systems10.1145/36398281:4(1-22)Online publication date: 8-Jan-2024
https://dl.acm.org/doi/10.1145/3639828
Conradi Hoffmann JPassig Horstmann LFröhlich A(2024)Transparent integration of autonomous vehicles simulation tools with a data-centric middlewareDesign Automation for Embedded Systems10.1007/s10617-023-09280-w28:1(45-66)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1007/s10617-023-09280-w
Show More Cited By

Recommendations

Promising SLAM Methods for Automated Guided Vehicles and Autonomous Mobile Robots
Abstract
Autonomous Mobile Robots, as the advanced version of Automated Guided Vehicles have received a lot of interest and recognition in recent years. Simultaneous Localization and Mapping (SLAM) techniques enable the vehicles to independently navigate ...
Review of SLAM Techniques For Autonomous Underwater Vehicles
RICAI '19: Proceedings of the 2019 International Conference on Robotics, Intelligent Control and Artificial Intelligence

Simultaneous Localization and Mapping (SLAM) is an important method for autonomous positioning and navigation of robots. SLAM application in underwater area has become an active field of research. Firstly, this paper presents the research status of SLAM ...
Motion planning of autonomous vehicles in a non-autonomous vehicle environment without speed lanes

Planning is one of the key problems for autonomous vehicles operating in road scenarios. Present planning algorithms operate with the assumption that traffic is organised in predefined speed lanes, which makes it impossible to allow autonomous vehicles ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC)

2678 pages

Copyright © 2016.

Publisher

IEEE Press

Publication History

Published: 01 November 2016

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Guo AZhou YTian HFang CSun YSun WGao XLuu ALiu YChen ZFilkov VRay BZhou M(2024)SoVAR: Build Generalizable Scenarios from Accident Reports for Autonomous Driving TestingProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695037(268-280)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695037
Wang YLi WAlam MManiatakos MJabari S(2024)Backdozer: A Backdoor Detection Methodology for DRL-based Traffic ControllersACM Journal on Autonomous Transportation Systems10.1145/36398281:4(1-22)Online publication date: 8-Jan-2024
https://dl.acm.org/doi/10.1145/3639828
Conradi Hoffmann JPassig Horstmann LFröhlich A(2024)Transparent integration of autonomous vehicles simulation tools with a data-centric middlewareDesign Automation for Embedded Systems10.1007/s10617-023-09280-w28:1(45-66)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1007/s10617-023-09280-w
Li CSifakis JWang QYan RZhang JJust RFraser G(2023)Simulation-Based Validation for Autonomous Driving SystemsProceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3597926.3598100(842-853)Online publication date: 12-Jul-2023
https://dl.acm.org/doi/10.1145/3597926.3598100
Zhang XCai YJust RFraser G(2023)Building Critical Testing Scenarios for Autonomous Driving from Real AccidentsProceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3597926.3598070(462-474)Online publication date: 12-Jul-2023
https://dl.acm.org/doi/10.1145/3597926.3598070
Ghumman UFaraz KJabbar HTiwana M(2022)Unified Navigational Approach for an Autonomous Vehicle Joining a Multilane Highway from RampJournal of Robotics10.1155/2022/99170292022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/9917029
Kim SLiu MRhee JJeon YKwon YKim CYin HStavrou ACremers CShi E(2022)DriveFuzzProceedings of the 2022 ACM SIGSAC Conference on Computer and Communications Security10.1145/3548606.3560558(1753-1767)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3548606.3560558
Hildebrandt CElbaum SBezzo NDwyer MKhurshid SPăsăreanu C(2020)Feasible and stressful trajectory generation for mobile robotsProceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3395363.3397387(349-362)Online publication date: 18-Jul-2020
https://dl.acm.org/doi/10.1145/3395363.3397387
Wang JSu LHan SSong DMiao F(undefined)Towards Safe Autonomy in Hybrid Traffic: Detecting Unpredictable Abnormal Behaviors of Human Drivers via Information SharingACM Transactions on Cyber-Physical Systems10.1145/3616398
https://dl.acm.org/doi/10.1145/3616398

View Options

View options

Figures

Tables

Media

View Table of Conten