Abstract
In the paper, the vision system for control of manipulator by operator’s hand movement is presented. The Authors propose method which uses specific colors of markers. The fast camera 3iCube (frequency 50 Hz) was used and connected with PC by USB 3.0. The position of the manipulator was controlled by industrial controller. Connection between PLC and PC was realized by TCP/IP protocol. The two green markers were used to scale operator’s working area. One green marker indicated a base coordinates of manipulator. The red marker was held in hand by operator. Movement of the red marker was in ratio 1:2 to manipulator. The research was focused on the correctness of detection of markers and response trajectory of the manipulator. Proposed method can be used to control manipulator movement by operator without uses classic control panel. The research proves possibility of application of the vision system for control of manipulator.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Cook Diane, J., Augusto, J.C., Jakkula, V.R.: Ambient intelligence: Technol-ogies, applications, and opportunities. Pervasive and Mobile Computing 5(4) (August 2009)
Parnian, N., Won, S.P., Golnaraghi, F.: Position sensing using integration of a vision system and inertial sensors. In: The 34th Annual Conference of IEEE Industrial Electronics, IECON (2008)
Friedewald, M., Da Costa, O., Punie, Y., Alahuhta, P., Heinonen, S.: Perspectives of ambient intelligence in the home environment. Telematics and Informatics (2005)
Schmidt, B., Wang, L.: Depth camera based collision avoidance via active robot control. Journal of Manufacturing Systems (May 2009)
Hua, C., Wang, Y., Guan, X.: Visual tracking control for an uncalibrated robot system with unknown camera parameters. Robotics and Computer-Integrated Manufacturing 30 (2014)
Jiang, H., Wachs, J.P., Duerstock, B.S.: Integrated Vision-Based Robotic Arm Interface for Operators with Upper Limb Mobility Impairments. In: IEEE International Conference on Rehabilitation Robotics (2013)
Pateraki, M., Baltzakis, H., Trahanias, P.: Visual estimation of pointed targets for robot guid-ance via fusion of face pose and hand orientation. Computer Vision and Image Understanding 120, 1–13 (2014)
Aliakbarpour, H., Tahri, O., Araujoa, H.: Visual servoing of mobile robots using non-central catadioptric cameras. Robotics and Autonomous Systems 62, 1613–1622 (2014)
Alenyà, G., Foix, S., Torras, C.: ToF cameras for active vision in robotics. Sensors and Actuators A: Physical 218, 10–22 (2014)
Du, G., Zhang, P.: Markerless human–robot interface for dual robot manipulators using Kinect sensor. Robotics and Computer-Integrated Manufacturing 30, 150–159 (2014)
Milecki, A., Rybarczyk, D., Owczarek, P.: The control of the manipulator by operator hand movement watched by visual system. International Journal of Applied Engineering (2012)
Adaptive Vision, http://www.adaptive-vision.com/pl
New Electronic Technology, http://www.net-gmbh.com
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Owczarek, P., Rybarczyk, D., Sędziak, D., Kašpárek, M. (2015). HMI with Vision System to Control Manipulator by Operator Hand Movement. In: Szewczyk, R., Zieliński, C., Kaliczyńska, M. (eds) Progress in Automation, Robotics and Measuring Techniques. Advances in Intelligent Systems and Computing, vol 351. Springer, Cham. https://doi.org/10.1007/978-3-319-15847-1_20
Download citation
DOI: https://doi.org/10.1007/978-3-319-15847-1_20
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-15846-4
Online ISBN: 978-3-319-15847-1
eBook Packages: EngineeringEngineering (R0)