Nothing Special   »   [go: up one dir, main page]

Zhang et al., 2015 - Google Patents

Teaching-playback of robot manipulator based on human gesture recognition and motion tracking

Zhang et al., 2015

Document ID
3737030135728893981
Author
Zhang X
Zhou H
Cheng H
Huang Y
Publication year
Publication venue
2015 IEEE International Conference on Robotics and Biomimetics (ROBIO)

External Links

Snippet

In this paper, we propose a new approach to teach a robot to complete a task based on the human gesture recognition and hand motion tracking. The image coordinate of the human hand and the region of interest (ROI) with the center of the hand are captured by the Kinect …
Continue reading at ieeexplore.ieee.org (other versions)

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40611—Camera to monitor endpoint, end effector position
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1674—Programme controls characterised by safety, monitoring, diagnostic
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1679—Programme controls characterised by the tasks executed
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1602—Programme controls characterised by the control system, structure, architecture
    • B25J9/1607—Calculation of inertia, jacobian matrixes and inverses
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1694—Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/36—Image preprocessing, i.e. processing the image information without deciding about the identity of the image
    • G06K9/46—Extraction of features or characteristics of the image

Similar Documents

Publication Publication Date Title
US20210205986A1 (en) Teleoperating Of Robots With Tasks By Mapping To Human Operator Pose
Morales et al. Integrated grasp planning and visual object localization for a humanoid robot with five-fingered hands
Sanz et al. Vision-guided grasping of unknown objects for service robots
Nozaki et al. Motion expression by elemental separation of haptic information
Fang et al. Visual-guided robotic object grasping using dual neural network controllers
Zhang et al. A real-time upper-body robot imitation system
Lengare et al. Human hand tracking using MATLAB to control Arduino based robotic arm
Wang 3D object pose estimation using stereo vision for object manipulation system
Mohamed et al. Stereo vision based object tracking control for a movable robot head
Zhang et al. Teaching-playback of robot manipulator based on human gesture recognition and motion tracking
Wang et al. Robot programming by demonstration with a monocular RGB camera
Wu et al. Kinect-based robotic manipulation: From human hand to end-effector
Celik et al. Development of a robotic-arm controller by using hand gesture recognition
Grzejszczak et al. Robot manipulator teaching techniques with use of hand gestures
Romero et al. Modeling and evaluation of human-to-robot mapping of grasps
Lin et al. Cloud robotic grasping of Gaussian mixture model based on point cloud projection under occlusion
Shauri et al. Sensor integration and fusion for autonomous screwing task by dual-manipulator hand robot
Kawasaki et al. Virtual robot teaching for humanoid hand robot using muti-fingered haptic interface
Kim et al. 6-DOF Robot Arm Visual Servoing with Canny Edge-Based Object Detection
Ren et al. Vision based object grasping of robotic manipulator
Lepora et al. Pose-based servo control with soft tactile sensing
Salvietti et al. Hands. dvi: A device-independent programming and control framework for robotic hands
Kawasaki et al. Virtual robot teaching based on motion analysis and hand manipulability for multi-fingered robot
Zhao et al. Intuitive robot teaching by hand guided demonstration
Wang et al. Robot Grasp Planning from Human Demonstration