CN111390919A - Accompany robot intelligence image recognition behavior analysis system - Google Patents
Accompany robot intelligence image recognition behavior analysis system Download PDFInfo
- Publication number
- CN111390919A CN111390919A CN202010155972.3A CN202010155972A CN111390919A CN 111390919 A CN111390919 A CN 111390919A CN 202010155972 A CN202010155972 A CN 202010155972A CN 111390919 A CN111390919 A CN 111390919A
- Authority
- CN
- China
- Prior art keywords
- module
- robot
- base
- image recognition
- analysis system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
- B25J11/0005—Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Toys (AREA)
- Manipulator (AREA)
Abstract
The invention discloses an intelligent image recognition behavior analysis system of a companion robot, which comprises a base, wherein the side wall of the base is provided with a first storage groove and a second storage groove, pushing mechanisms used for pushing out articles in the first storage groove and the second storage groove are respectively arranged in the first storage groove and the second storage groove, the side wall of the base is also provided with a battery compartment, a storage battery is arranged in the battery compartment, and the upper end of the base is fixedly connected with a body. The child accompanying robot is used as a core, functions of distance education, multimedia playing, equipment management, instant communication and the like are realized through the cloud platform and the parent terminal, the robot technology and the internet technology are applied to education and supervision of preschool children, energy and time of parents are saved, and use interest of accompanying targets can be improved.
Description
Technical Field
The invention relates to the technical field of intelligent equipment, in particular to an intelligent image recognition behavior analysis system for a companion robot.
Background
The preschool children need to accompany and take care of adults for a long time because the intelligence and the physical development are not complete. The children stage is also the sensitive period with the fastest development of abilities of sports, language and the like, and the importance of the children stage is self-evident. This requires a lot of effort and cost from the parents.
However, the early education system in the prior art is single in function, and mainly has audio and video playing functions, some early education systems can perform simple interaction through a voice or touch mode and far cannot meet accompanying requirements, most of the existing intelligent robots are based on voice control and need a large person or a small person to independently control the robot to act, and the robot cannot independently and spontaneously trigger work according to the realization of the emotional state intelligence of an accompanying target object to perform higher-level personalized accompanying on the accompanying target.
Disclosure of Invention
The invention aims to solve the defects in the prior art, provides an intelligent image recognition behavior analysis system for an accompanying robot, takes a child accompanying robot as a core, realizes the functions of distance education, multimedia playing, equipment management, instant communication and the like through a cloud platform and a parent terminal, applies the robot technology and the internet technology to the education management of preschool children, saves the energy and time of parents, can improve the use interest of accompanying targets, realizes the detection and classification recognition of the facial expressions of the accompanying objects, obtains the facial expression images of the accompanying objects based on machine vision, obtains characteristic regions containing expression characteristics through a series of processing such as preprocessing and threshold segmentation and the like, further extracts the expression characteristics, and recognizes the expression categories by adopting a characteristic vector extracted by a machine learning algorithm, the system is used for detecting the facial expressions of the accompanying objects in real time on line, and the accompanying robot selects a proper interactive mode and interactive contents based on the personality of the user according to the recognized facial expressions.
In order to achieve the purpose, the invention adopts the following technical scheme:
the utility model provides an accompany robot intelligence image recognition behavior analysis system, includes the base, first storing groove and second storing groove have been seted up to the lateral wall of base, all install the pushing mechanism who is used for releasing the article in first storing groove and the second storing groove, the lateral wall of base still is provided with the battery compartment, be provided with the battery in the battery compartment, the upper end fixedly connected with health of base, the health adopts soft rubber materials to make, the display screen is installed through the arm to the both sides of health, the touch pad is installed near one side of display screen to the upper end of base, the upper end of health is rotated through the bracing piece and is connected with the head, the front side of head is provided with expression recognition device, main control module still installs in the body.
Preferably, the lower extreme of base is installed the walking wheel, install roadblock recognition device in front of the walking wheel.
Preferably, the rear side of the head is further provided with a WiFi antenna, and the surface of the WiFi antenna is wrapped by a layer of soft rubber.
Preferably, the main control module is electrically connected with a voice information storage module, an audio output module, a recording module, an expression recognition module, an operation module, an audio output module, a power supply module and a WiFi module, the voice information storage module is used for storing the voice of parents, the recording module is used for recording the voice of parents and transmitting the voice to the voice information storage module for storage, the expression recognition module is used for recognizing the expression condition of children, and the operation module is used for operating the equipment.
Preferably, the audio output module is used for playing music or parent voice according to the expression of the child, the power supply module is used for supplying power to all parts in the accompanying robot, and the WiFi module is used for connecting the accompanying robot and a mobile phone.
Preferably, the robot companion further comprises a remote terminal, and the remote terminal can be connected with the robot companion through a WiFi module to realize video interaction.
The invention has the following beneficial effects:
1. the child accompanying robot is used as a core, functions of remote education, multimedia playing, equipment management, instant messaging and the like are achieved through the cloud platform and the parent terminal, the robot technology and the internet technology are applied to education and supervision of preschool children, the energy and time of parents are saved, and the use interest of accompanying targets can be improved.
2. The system is used for detecting the facial expression of the companion object in real time on line, and the companion robot selects a proper interaction mode and interaction content based on the personality of a user according to the recognized facial expression.
Drawings
Fig. 1 is a schematic structural diagram of an intelligent image recognition behavior analysis system of a companion robot according to the present invention;
fig. 2 is a system block diagram of an intelligent image recognition behavior analysis system of a companion robot according to the present invention.
In the figure: 1WiFi antenna, 2 battery storehouses, 3 batteries, 4 walking wheels, 5 first storing grooves, 6 second storing grooves, 7 display screens, 8 touch pads, 9 bracing pieces, 10 heads, 11 bodies, 12 bases and 13 expression recognition devices.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein, but rather should be construed as broadly as the present invention is capable of modification in various respects, all without departing from the spirit and scope of the present invention.
It will be understood that when an element is referred to as being "secured to" another element, it can be directly on the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present. The terms "vertical," "horizontal," "left," "right," and the like as used herein are for illustrative purposes only and do not represent the only embodiments.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
Referring to fig. 1-2, an intelligent image recognition behavior analysis system for an accompanying robot comprises a base 12, a walking wheel 4 is mounted at the lower end of the base 12, a roadblock recognition device is mounted in front of the walking wheel 4, a first storage groove 5 and a second storage groove 6 are formed in the side wall of the base 12, pushing mechanisms for pushing out articles in the first storage groove 5 and the second storage groove 6 are mounted in the first storage groove 5 and the second storage groove 6, a battery compartment 2 is further arranged on the side wall of the base 12, a storage battery 3 is arranged in the battery compartment 2, a body 11 is fixedly connected to the upper end of the base 12, the body 11 is made of soft rubber materials, a display screen 7 is mounted on two sides of the body 11 through arms, a touch pad 8 is mounted on one side of the upper end of the base 1 close to the display screen 7, a head 10 is rotatably connected to the upper end of the body 11 through a support rod 9, an expression, the main control module is also installed in the body 11.
The rear side of the head 10 is also provided with a WiFi antenna 1, and the surface of the WiFi antenna 1 is wrapped by a layer of soft rubber.
The main control module electricity is connected with speech information storage module, audio output module, recording module, expression recognition module, operation module, audio output module, power module and wiFi module, and speech information storage module is used for storing father's pronunciation, and recording module is arranged in the admission father's pronunciation and transmits and stores in the speech information storage module, and expression recognition module is used for discerning children's expression situation, and operation module is used for the operation of this equipment.
The audio output module is used for playing music or playing parent voice according to the child expression, the power supply module is used for supplying power to all parts in the accompanying robot, and the WiFi module is used for connecting the accompanying robot with a mobile phone.
Still include remote terminal, this remote terminal accessible wiFi module is connected with this companion robot, realizes video interaction.
The invention takes the child accompanying robot as the core, realizes the functions of remote education, multimedia playing, equipment management, instant communication and the like through the cloud platform and the parent terminal, applies the robot technology and the internet technology to the education and the supervision of preschool children, not only saves the energy and time of parents, but also can improve the use interest of accompanying objects, realizes the detection and the classification recognition of the facial expressions of the accompanying objects, obtains the facial expression images of the accompanying objects based on machine vision, obtaining a characteristic region containing expression characteristics through a series of processes such as preprocessing, threshold segmentation and the like, and then the expression characteristics are extracted, the expression category is identified by adopting a machine learning algorithm according to the extracted characteristic vector, the system is used for detecting the facial expression of the accompanying object on line in real time, and according to the recognized facial expression, the accompanying robot selects a proper interactive mode and interactive content based on the personality of the user.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (6)
1. The utility model provides an intelligent image recognition behavior analysis system of accompanying robot, includes base (12), its characterized in that, first storing groove (5) and second storing groove (6) have been seted up to the lateral wall of base (12), all install the pushing mechanism who is used for pushing out the article in first storing groove (5) and second storing groove (6), the lateral wall of base (12) still is provided with battery compartment (2), be provided with battery (3) in battery compartment (2), the upper end fixedly connected with health (11) of base (12), health (11) adopt soft rubber materials to make, display screen (7) are installed through the arm to the both sides of health (11), touch pad (8) are installed to one side that the upper end of base (1) is close to display screen (7), the upper end of the body (11) is rotatably connected with a head (10) through a supporting rod (9), the front side of the head (10) is provided with an expression recognition device (13), and a main control module is further installed in the body (11).
2. The accompany robot intelligent image recognition behavior analysis system according to claim 1, wherein a walking wheel (4) is installed at the lower end of the base (12), and a roadblock recognition device is installed in front of the walking wheel (4).
3. The intelligent image recognition behavior analysis system for the companion robot as claimed in claim 1, wherein a WiFi antenna (1) is further disposed on the rear side of the head (10), and a layer of soft rubber is wrapped on the surface of the WiFi antenna (1).
4. The intelligent image recognition behavior analysis system for the companion robot as claimed in claim 1, wherein the main control module is electrically connected with a voice information storage module, an audio output module, a recording module, an expression recognition module, an operation module, an audio output module, a power supply module and a WiFi module, the voice information storage module is used for storing the voice of parents, the recording module is used for recording the voice of parents and transmitting the voice to the voice information storage module for storage, the expression recognition module is used for recognizing the expression condition of children, and the operation module is used for operating the equipment.
5. The system for analyzing the intelligent image recognition behaviors of the accompanying robot as claimed in claim 4, wherein the audio output module is used for playing music or parent voice according to the expression of the child, the power supply module is used for supplying power to all parts in the accompanying robot, and the WiFi module is used for connecting the accompanying robot with a mobile phone.
6. The system for analyzing the intelligent image recognition behaviors of the companion robot as claimed in claim 4, further comprising a remote terminal, wherein the remote terminal can be connected with the companion robot through a WiFi module to realize video interaction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010155972.3A CN111390919A (en) | 2020-03-09 | 2020-03-09 | Accompany robot intelligence image recognition behavior analysis system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010155972.3A CN111390919A (en) | 2020-03-09 | 2020-03-09 | Accompany robot intelligence image recognition behavior analysis system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111390919A true CN111390919A (en) | 2020-07-10 |
Family
ID=71424675
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010155972.3A Pending CN111390919A (en) | 2020-03-09 | 2020-03-09 | Accompany robot intelligence image recognition behavior analysis system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111390919A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112634684A (en) * | 2020-12-11 | 2021-04-09 | 深圳市木愚科技有限公司 | Intelligent teaching method and device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106851216A (en) * | 2017-03-10 | 2017-06-13 | 山东师范大学 | A kind of classroom behavior monitoring system and method based on face and speech recognition |
| CN107283389A (en) * | 2017-08-31 | 2017-10-24 | 李景龙 | Robot for auxiliary treatment self-closing disease |
| CN107888620A (en) * | 2017-12-11 | 2018-04-06 | 大连高马艺术设计工程有限公司 | A kind of long-range reception and registration expression, voice, the role playing toy system of image |
| CN109159129A (en) * | 2018-08-03 | 2019-01-08 | 深圳市益鑫智能科技有限公司 | A kind of intelligence company robot based on facial expression recognition |
| CN109684949A (en) * | 2018-12-12 | 2019-04-26 | 嘉兴极点科技有限公司 | A kind of online education man-machine interaction method and system based on artificial intelligence |
| CN109703647A (en) * | 2019-02-14 | 2019-05-03 | 江门市国彬机器人有限公司 | Walk upright robot |
| US10482886B2 (en) * | 2017-08-05 | 2019-11-19 | Fu Tai Hua Industry (Shenzhen) Co., Ltd. | Interactive robot and human-robot interaction method |
| CN110524555A (en) * | 2019-08-28 | 2019-12-03 | 南京市晨枭软件技术有限公司 | A kind of station robot service system |
-
2020
- 2020-03-09 CN CN202010155972.3A patent/CN111390919A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106851216A (en) * | 2017-03-10 | 2017-06-13 | 山东师范大学 | A kind of classroom behavior monitoring system and method based on face and speech recognition |
| US10482886B2 (en) * | 2017-08-05 | 2019-11-19 | Fu Tai Hua Industry (Shenzhen) Co., Ltd. | Interactive robot and human-robot interaction method |
| CN107283389A (en) * | 2017-08-31 | 2017-10-24 | 李景龙 | Robot for auxiliary treatment self-closing disease |
| CN107888620A (en) * | 2017-12-11 | 2018-04-06 | 大连高马艺术设计工程有限公司 | A kind of long-range reception and registration expression, voice, the role playing toy system of image |
| CN109159129A (en) * | 2018-08-03 | 2019-01-08 | 深圳市益鑫智能科技有限公司 | A kind of intelligence company robot based on facial expression recognition |
| CN109684949A (en) * | 2018-12-12 | 2019-04-26 | 嘉兴极点科技有限公司 | A kind of online education man-machine interaction method and system based on artificial intelligence |
| CN109703647A (en) * | 2019-02-14 | 2019-05-03 | 江门市国彬机器人有限公司 | Walk upright robot |
| CN110524555A (en) * | 2019-08-28 | 2019-12-03 | 南京市晨枭软件技术有限公司 | A kind of station robot service system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112634684A (en) * | 2020-12-11 | 2021-04-09 | 深圳市木愚科技有限公司 | Intelligent teaching method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11858118B2 (en) | Robot, server, and human-machine interaction method | |
| JP6816925B2 (en) | Data processing method and equipment for childcare robots | |
| CN202315292U (en) | Comprehensive greeting robot based on smart phone interaction | |
| CN103369303B (en) | Analysis of operative action record and the system and method for reproduction | |
| CN107682536A (en) | A kind of sound control method, terminal and computer-readable recording medium | |
| CN102500113A (en) | Comprehensive greeting robot based on smart phone interaction | |
| CN107633098A (en) | A kind of content recommendation method and mobile terminal | |
| Huahu et al. | Application of speech emotion recognition in intelligent household robot | |
| CN104493827A (en) | Intelligent cognitive robot and cognitive system thereof | |
| CN205817875U (en) | Interactive emotional robot | |
| Liu et al. | A multimodal emotional communication based humans-robots interaction system | |
| CN108572764A (en) | A kind of word input control method, equipment and computer readable storage medium | |
| CN204650422U (en) | A kind of intelligent movable toy manipulated alternately based on language | |
| CN108711430A (en) | Audio recognition method, smart machine and storage medium | |
| CN207139820U (en) | A kind of intelligent robot | |
| CN206584114U (en) | A kind of low power-consumption intelligent AR devices and intelligence AR glasses | |
| CN106707512B (en) | Low-power consumption intelligent AR system and intelligent AR glasses | |
| WO2022121592A1 (en) | Livestreaming interaction method and apparatus | |
| CN108073112A (en) | A kind of intelligent Service humanoid robot with role playing | |
| CN106826851A (en) | A kind of intelligent early education robot based on multi-sensor fusion technology | |
| CN111390919A (en) | Accompany robot intelligence image recognition behavior analysis system | |
| CN204791614U (en) | Juvenile study machine people of intelligence | |
| CN109391842A (en) | A kind of dubbing method, mobile terminal | |
| CN206481399U (en) | A kind of children accompany robot | |
| CN109419609A (en) | A kind of intelligent glasses of blind man navigation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200710 |