GA‐based camera calibration for vision‐assisted robotic assembly system
Abstract
Vision sensors are employed in robotic assembly system to sense the dynamic environment and to position the manipulator precisely based on the sensor feedback. This process is termed as visual servoing. Precise calibration of the camera and camera/robot system are required to estimate the desired velocity of the robot and accurate positioning of the mating parts. In position‐based visual servoing, roughly calibrated camera leads to errors in robot/camera pose identification that affects the positional accuracy and time to reach the target position. A camera calibration procedure based on genetic algorithm (GA) is proposed in this study to estimate the intrinsic and extrinsic parameters of the camera model for improving positional accuracy and faster convergence. The proposed algorithm is implemented with two‐stage procedure and it comprises: determination of the camera parameters for distortion‐less model and reduction of re‐projection error through GA with linearly determined camera distortion‐less parameters as an initial solution. The proposed camera calibration algorithm has been tested and compared with the dataset images in the literature for its performance in terms of measurement accuracy. The result shows that the proposed algorithm has the capability to calibrate the distorted images with minimum re‐projection error using single image.
9 References
[1]
Weng, J., Cohen, P., Herniou, M.: ‘Camera calibration with distortion models and accuracy evaluation’, IEEE Trans. Pattern Anal. Mach. Intell., 1992, 14, (10), pp. 965–980
[2]
Dong, G., Zhu, Z.H.: ‘Position based visual servo control of autonomous robotic manipulators’, Acta Astronaut., 2015, 115, pp. 291–302
[3]
Mallis, E.: ‘Survey of vision based robot control’. Proc. European Naval Ship Design, Captain Computer IV Forum, Brest, France, 2002, pp. 1–16
[4]
Chaumette, F., Hutchinson, S.: ‘Visual servo control part I: basic approaches’, IEEE Robot. Autom. Mag., 2006, 13, (4), pp. 82–90
[5]
Chaumette, F.: ‘Potential problems of stability and convergence in image based and position based visual servoing’ The Confluence of Vision and Control, LNCIS Series, No 237 (Springer, London, 1998), pp. 66–78
[6]
Zhang, Z.: ‘A flexible new technique for camera calibration’, IEEE Trans. Pattern Anal. Mach. Intell., 2000, 22, (11), pp. 1330–1334
[7]
Tsai, R.: ‘A versatile camera calibration technique for high‐accuracy 3D machine vision metrology using off‐the‐shelf TV cameras and lenses’, IEEE J. Robot. Autom., 1987, 3, (4), pp. 323–344
[8]
Wang, J., Shi, F., Zhang, J., et al: ‘A new calibration model of camera lens distortion’, Pattern Recognit., 2008, 41, pp. 607–615
[9]
Shuo, W., Shi, S.: ‘An improved adaptive correction method for camera distortion’. Proc. of the 33rd Chinese Control Conf., Nanjing, July 2014, pp. 4821–4825
[10]
Hughes, C., Glavin, M., Jones, E., et al: ‘Review of geometric distortion compensation in fish‐eye cameras’. Signals and Systems Conf., Galway, June 2008, pp. 162–167
[11]
Lu, J., Hou, C., Yu, Y., et al: ‘A novel calibration method based on heuristic B‐spline model for fish‐eye lenses’. IEEE Int. Conf. System Science and Engineering (ICSSE), Hungary, July 2013, pp. 413–417
[12]
Devernay, F., Faugeras, O.: ‘Straight lines have to be straight, automatic calibration and removal of distortion from scenes of structured environments’, J. Mach. Vis. Appl., 2001, 13, pp. 14–24
[13]
Hati, S., Sengupta, S.: ‘Robust camera parameter estimation using genetic algorithm’, Pattern Recognit. Lett., 2001, 22, pp. 289–298
[14]
Ji, Q., Zhang, Y.: ‘Camera calibration with genetic algorithms’, IEEE Trans. Syst. Man Cybern. A, Syst. Hum., 2001, 31, (2), pp. 120–130
[15]
Yang, Z., Chen, F., Zhao, J., et al: ‘A novel camera calibration method based on genetic algorithm’. IEEE Conf. on Industrial Electronics and Applications, Singapore, June 2008, pp. 2222–2227
[16]
Song, X., Yang, B., Feng, Z., et al: ‘Camera calibration based on particle swarm optimization’. Proc. IEEE Int. Conf. Image and Signal Processing, Tianjin, October 2009, pp. 1–5
[17]
Zhou, F., Cui, Y., Peng, B., et al: ‘A novel optimization method of camera parameters used for vision measurement’, Opt. Laser Technol., 2012, 44, (6), pp. 1840–1849
[18]
Xuejun, Q., Lu, Z., Biao, M., et al: ‘A new camera calibration method based on two stages distortion model’. IEEE Int. Conf. of Information Science and Management Engineering, Xian, August 2010, pp. 125–129
[19]
Gao, H., Niu, B., Yu, Y., et al: ‘An improved two‐stage camera calibration method based on particle swarm optimization’. Proc. Int. Conf. on Intelligent Computing (ICIC), Korea, 2009, pp. 804–813
[20]
Li, W., Gee, T., Friedrich, H., et al: ‘A practical comparison between Zhang's and Tsai's calibration approaches’. Int. Conf. on Image and Vision Computing (IVCNZ), New Zealand, November 2014, pp. 166–171
[21]
Armangue, X., Salvi, J., Batlle, J.: ‘A comparative review of camera calibrating methods with accuracy evaluation’, J. Pattern Recognit., 2002, 35, (7), pp. 1617–1635
[22]
Lenz, R., Tsai, R.: ‘Techniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology’. Proc. IEEE Int. Conf. Robotics and Automation, March 1987, pp. 68–75
[23]
Eshelman, L., Schaffer, J.: ‘Real‐coded genetic algorithms and interval schemata’, Found. Genet. Algorithms, 1993, 2, pp. 187–202
[24]
Deep, K., Thakur, M.: ‘A new mutation operator for real coded genetic algorithms’, Appl. Math. Comput., 2007, 193, pp. 211–230
[25]
Zhou, F., Cui, Y., Gao, H., et al: ‘Line‐based camera calibration with lens distortion correction from a single image’, Opt. Laser Eng., 2013, 51, pp. 1332–1343
[26]
‘OpenCV camera calibration module’. Available at http://www.docs.opencv.org/2.4/doc/tutorials/calib3d/camera_calibration, accessed January 2016
[27]
‘Mathworks Single Camera Calibration App’. Available at http://www.in.mathworks.com/help/vision/ug/single‐camera‐calibrator‐app.html, accessed June 2016
Recommendations
3-D Position Sensing Using a Passive Monocular Vision System
Passive monocular 3-D position sensing is made possible by a new calibration scheme that relates depth to focus blur through a composite lens and aperture model. The calibration technique enables the recovery of absolute 3-D position coordinates from ...
Camera Calibration: A Quick and Easy Way to Determine the Scale Factor
The author presents a quick and easy solution to the camera calibration problem of finding the scale factor that arises because of a difference between the scanning frequency of the camera sensor plane and the scanning frequency of the image capture ...
Implicit and Explicit Camera Calibration: Theory and Experiments
By implicit camera calibration, we mean the process of calibrating a camera without explicitly computing its physical parameters. Implicit calibration can be used for both three-dimensional (3-D) measurement and generation of image coordinates. In this ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© 2017 The Institution of Engineering and Technology.
Publisher
John Wiley & Sons, Inc.
United States
Publication History
Published: 22 September 2016
Author Tags
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 16 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in