Nothing Special   »   [go: up one dir, main page]

CN111007732A - Air conditioner vision wake-up-free identification method and system based on scale change and intelligent home - Google Patents

Air conditioner vision wake-up-free identification method and system based on scale change and intelligent home Download PDF

Info

Publication number
CN111007732A
CN111007732A CN201911098282.2A CN201911098282A CN111007732A CN 111007732 A CN111007732 A CN 111007732A CN 201911098282 A CN201911098282 A CN 201911098282A CN 111007732 A CN111007732 A CN 111007732A
Authority
CN
China
Prior art keywords
user
air conditioner
face
scale
visual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911098282.2A
Other languages
Chinese (zh)
Inventor
汪进
李保水
文皓
王子
王慧君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gree Electric Appliances Inc of Zhuhai
Original Assignee
Gree Electric Appliances Inc of Zhuhai
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gree Electric Appliances Inc of Zhuhai filed Critical Gree Electric Appliances Inc of Zhuhai
Priority to CN201911098282.2A priority Critical patent/CN111007732A/en
Publication of CN111007732A publication Critical patent/CN111007732A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Air Conditioning Control Device (AREA)

Abstract

The invention belongs to the technical field of automatic control of electric appliances, and discloses a scale change-based visual awakening-free identification method and system for an air conditioner and an intelligent home. The method comprises the steps that a user generates different anchors in different proportions and scales through a pyramid network RPN and a generator anchor generated by the user at different positions in a field range, different anchors are obtained by different targets, and a user face region of interest is obtained through multi-scale transformation; when the human face is identified and the gesture is estimated, the human face and the gesture stay for a certain time and then send a voice awakening command, and the voice module triggers a voice awakened state after receiving voice awakening information. In order to reduce active intervention of a user on a household air conditioner, the user swipes the face within the indoor visual field range of the user to replace a voice awakening word.

Description

Air conditioner vision wake-up-free identification method and system based on scale change and intelligent home
Technical Field
The invention belongs to the technical field of automatic control of electric appliances, and particularly relates to a scale change-based visual awakening-free identification method and system for an air conditioner and an intelligent home.
Background
Currently, the closest prior art: home appliances (HEA) mainly refer to various electric and electronic appliances used in homes and the like. Also known as civil electric appliances and daily electric appliances. The household appliances are released from heavy, trivial and time-consuming household work, create more comfortable and beautiful life and working environment which are more beneficial to physical and mental health for human beings, provide rich and colorful cultural and entertainment conditions, and become necessities of modern family life.
At present, the household appliance needs to be awakened by a remote controller or voice when being opened, so that a user needs to actively awaken the household appliance, the operation is inconvenient, and the user experience feeling, the comfort feeling and the safety feeling are poor.
In summary, the problems of the prior art are as follows: the existing household appliance opening mode has the defects of inconvenient operation, and poor use experience, comfort and safety of a user.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a scale change-based visual awakening-free identification method and system for an air conditioner, and an intelligent home.
The invention is realized in such a way that the air conditioner vision awakening-free identification method based on the scale change comprises the following steps:
the method comprises the following steps that firstly, whether a user is registered in the air conditioner or not is distinguished through face brushing; belonging to the registered user, and carrying out the next step; if not, the process is ended.
Secondly, the user generates different anchors in different proportions and scales through the pyramid network RPN and the generated generateranchors at different positions in the field of view, different anchors are obtained by different targets, and the region of interest of the user face is obtained through multi-scale transformation;
and thirdly, when the human face is identified and the posture is estimated, sending a voice awakening command after the human face and the posture stay for a certain time, and triggering a voice awakened state after the voice module receives the voice awakening information.
Furthermore, the scale change-based visual awakening-free identification method for the air conditioner opens the authority of the user to perform face brushing registration on other users, and judges whether the user has the authority to use the air conditioner or not by brushing the face under the use condition.
Further, the user of the scale change-based air conditioner vision wake-up-free identification method obtains the area of interest of the face of the user through multi-scale transformation in a vision algorithm at different positions in a field of view.
Further, the scale change-based visual awakening-free air conditioner identification method awakens the current air conditioner when the face of a user is opposite to a camera in the air conditioner and exceeds a certain time.
Further, when a user faces the camera of the household air conditioner in the field of view of the camera of the household air conditioner, when the face of the user in the database and the current face IOU of the user reach a threshold value, the system automatically wakes up the air conditioner when the front face faces the air conditioner and the threshold value time is reached, the sizes of the head images of the user in the field of view of the camera are not consistent, the camera obtains the face information of the user through multi-scale transformation, and the household air conditioner can prompt the user that the air conditioner is awakened through buzzing sound or light and voice after being awakened by face recognition.
Further, after the air conditioner is awakened, the face recognition technology of the camera acquires the relevant information of the user, whether the user is registered on the air conditioner or not can be judged through the information, and the use right of the air conditioner is opened by judging whether the user is registered on the air conditioner or not; related information of strangers entering the user home can be recorded through multi-scale face recognition, and the information is pushed to the user mobile phone through WIFI and prompts that strangers enter the user home; the face recognition technology through multi-scale transformation can enable a user or a stranger to use the air conditioner to get rid of a remote controller or wake up the household air conditioner through voice.
Another object of the present invention is to provide a scale-change-based visual awakening-free identification system for an air conditioner, which implements the scale-change-based visual awakening-free identification method for an air conditioner, the scale-change-based visual awakening-free identification system for an air conditioner comprising:
the user identity identification module is used for distinguishing whether the user is registered in the air conditioner or not by brushing the face;
the face recognition module is used for realizing that the user obtains a face interesting area of the user through multi-scale transformation at different positions in a view field range;
and the awakening module is used for sending a voice awakening command after the face and the gesture stay for a certain time when the face recognition and the gesture estimation are carried out, and triggering a voice awakened state after the voice module receives the voice awakening information.
The invention further aims to provide the smart home for realizing the scale-change-based visual awakening-free identification method of the air conditioner.
Another object of the present invention is to provide a computer-readable storage medium, which includes instructions that, when executed on a computer, cause the computer to execute the scale-change-based air conditioner visual wake-up-free identification method.
The invention also aims to provide an application of the scale change-based visual awakening-free identification method for the air conditioner in starting of the household appliance.
In summary, the advantages and positive effects of the invention are: according to the method, a user obtains a face interesting area of the user through multi-scale transformation in a visual algorithm at different positions in a field range; when the face of a user is opposite to a camera in the air conditioner, the current air conditioner is awakened after a certain time; whether the user is registered with the air conditioner or not is discriminated by brushing the face.
In order to reduce active intervention of a user on a household air conditioner, the user swipes the face within the indoor visual field range of the user to replace a voice awakening word.
Drawings
Fig. 1 is a flowchart of a scale-change-based visual wake-up-free identification method for an air conditioner according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of a scale-change-based visual wake-up-free identification system for an air conditioner according to an embodiment of the present invention;
in the figure: 1. a user identity recognition module; 2. a face recognition module; 3. and a wake-up module.
Fig. 3 is a schematic diagram of multi-scale transform face recognition provided in the embodiment of the present invention.
Fig. 4 is a flowchart for waking up an air conditioner through face recognition performed when the front of a user faces a camera for a certain time according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Aiming at the problems in the prior art, the invention provides a scale change-based visual awakening-free identification method and system for an air conditioner and an intelligent home, and the invention is described in detail below with reference to the accompanying drawings.
As shown in fig. 1, the scale-change-based visual arousal-free identification method for an air conditioner according to an embodiment of the present invention includes the following steps:
s101: distinguishing whether the user is registered in the air conditioner or not by brushing the face; belonging to the registered user, and carrying out the next step; if not, the process is ended.
S102: the method comprises the steps that a user generates different anchors in different proportions and scales through a pyramid network (RPN) and a generator anchor generated at different positions in a field range, different anchors are obtained from different targets, and a human face interesting region of the user is obtained through multi-scale transformation.
S103: when the human face is identified and the gesture is estimated, the human face and the gesture stay for a certain time and then send a voice awakening command, and the voice module triggers a voice awakened state after receiving voice awakening information.
In the preferred embodiment of the present invention, step S101 opens the authority of the user to perform the face brushing registration for other users, and determines whether the user has the authority to use the air conditioner by brushing the face in the use case.
In the preferred embodiment of the present invention, step S102, the user obtains the region of interest of the user' S face through multi-scale transformation in the vision algorithm at different positions within the field of view.
In the preferred embodiment of the present invention, step S103 wakes up the current air conditioner more than a certain time when the face of the user is facing the camera in the air conditioner.
As shown in fig. 2, the scale-change-based visual arousal-free identification system for an air conditioner according to an embodiment of the present invention includes:
and the user identity identification module 1 is used for distinguishing whether the user is registered in the air conditioner or not by brushing the face.
And the face recognition module 2 is used for realizing that the user obtains the face interesting region of the user at different positions in the field of view by multi-scale transformation.
And the awakening module 3 is used for sending a voice awakening command after the face and the gesture stay for a certain time when the face recognition and the gesture estimation are carried out, and triggering a voice awakened state after the voice module receives the voice awakening information.
The technical solution of the present invention is further described below with reference to the accompanying drawings.
As shown in fig. 3 and 4, the scale-change-based visual arousal-free identification method for an air conditioner according to an embodiment of the present invention includes the following steps:
(1) in an indoor environment, a user is in a camera view field range of a household air conditioner, when the face of the user faces a camera of the household air conditioner, when the face of the user in a database and the current face IOU of the user reach a certain value, a system automatically wakes up the air conditioner when the front face faces the air conditioner and reaches a certain time, the sizes of the images of the user in the view field range of the camera are not consistent, the camera can acquire the face information of the user through multi-scale transformation, and therefore the situation that the user can wake up the household air conditioner only by facing the camera in a close range can be avoided, and the experience of the user using an AI voice visual air conditioner can be improved only by acquiring the face information of the user through a multi-scale transformation pyramid network. When the front face of the user faces the camera of the household air conditioner, the user is reminded that the air conditioner is awakened through buzzing sound or light and voice after the household air conditioner is awakened through face recognition.
(2) When the air conditioner is awakened, the face recognition technology of the camera can acquire the relevant information of the user, and the information can judge whether the user is registered on the air conditioner or not, and the use right of the air conditioner is opened by judging whether the user is registered on the air conditioner or not. Related information of strangers entering the user home can be recorded through face recognition of multi-scale transformation, and the information is pushed to the user mobile phone through WIFI and prompts that strangers break into the user home. The user or stranger can use the air conditioner to get rid of a remote controller or wake up the household air conditioner by voice through the multi-scale transformation face recognition technology, and the method reduces the strong wake-up air conditioner of the user to improve the experience of the user. The multi-scale transformation face recognition can improve the safety of a security system in the home of a user.
It should be noted that the embodiments of the present invention can be realized by hardware, software, or a combination of software and hardware. The hardware portion may be implemented using dedicated logic; the software portions may be stored in a memory and executed by a suitable instruction execution system, such as a microprocessor or specially designed hardware. Those skilled in the art will appreciate that the apparatus and methods described above may be implemented using computer executable instructions and/or embodied in processor control code, such code being provided on a carrier medium such as a disk, CD-or DVD-ROM, programmable memory such as read only memory (firmware), or a data carrier such as an optical or electronic signal carrier, for example. The apparatus and its modules of the present invention may be implemented by hardware circuits such as very large scale integrated circuits or gate arrays, semiconductors such as logic chips, transistors, or programmable hardware devices such as field programmable gate arrays, programmable logic devices, etc., or by software executed by various types of processors, or by a combination of hardware circuits and software, e.g., firmware.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.

Claims (10)

1. The scale-change-based visual awakening-free identification method for the air conditioner is characterized by comprising the following steps of:
the method comprises the following steps that firstly, whether a user is registered in the air conditioner or not is distinguished through face brushing; belonging to the registered user, and carrying out the next step; if not, ending;
secondly, the user generates different anchors in different proportions and scales through the pyramid network RPN and the generated generator anchors at different positions in the field of view, different anchors are obtained by different targets, and the region of interest of the user face is obtained through multi-scale transformation;
and thirdly, when the human face is identified and the posture is estimated, sending a voice awakening command after the human face and the posture stay for a certain time, and triggering a voice awakened state after the voice module receives the voice awakening information.
2. The visual arousal-free identification method for the air conditioner based on the scale change as claimed in claim 1, wherein the visual arousal-free identification method for the air conditioner based on the scale change opens the authority of the user to perform face brushing registration for other users, and judges whether the user has the authority to use the air conditioner by face brushing under the use condition.
3. The visual arousal-free identification method for air conditioners based on scale change of claim 1, wherein the user of the visual arousal-free identification method for air conditioners based on scale change obtains the area of interest of the face of the user through multi-scale transformation in a visual algorithm at different positions in a visual field range.
4. The visual wake-up-free recognition method for air conditioners based on scale change of claim 1, wherein the visual wake-up-free recognition method for air conditioners based on scale change wakes up the current air conditioner more than a certain time when the face of the user is facing a camera in the air conditioner.
5. The visual non-awakening recognition method of the air conditioner based on the scale change as claimed in claim 4, wherein when the user faces the camera of the household air conditioner within the visual field range of the camera of the household air conditioner, when the user's face and the current face IOU of the user in the database reach a threshold value, the system automatically awakens the air conditioner when the user faces the air conditioner and reaches the threshold value, the size of the user's face image is not consistent within the visual field range of the camera, the camera acquires the user's face information through multi-scale transformation, and the household air conditioner reminds the user that the air conditioner is awakened through buzzing sound or light and voice after being awakened by the face recognition.
6. The visual arousal-free identification method for the air conditioner based on the scale change as claimed in claim 5, wherein after the air conditioner is aroused, the face recognition technology of the camera acquires the relevant information of the user, and the user can be judged whether the user is registered on the air conditioner or not through the information, and the use right of the air conditioner is opened by judging whether the user is registered on the air conditioner or not; related information of strangers entering the user home can be recorded through multi-scale face recognition, and the information is pushed to the user mobile phone through WIFI and prompts that strangers enter the user home; the face recognition technology through multi-scale transformation can enable a user or a stranger to use the air conditioner to get rid of a remote controller or wake up the household air conditioner through voice.
7. A scale change based air conditioner visual arousal-free identification system for implementing the scale change based air conditioner visual arousal-free identification method according to any one of claims 1 to 6, wherein the scale change based air conditioner visual arousal-free identification system comprises:
the user identity identification module is used for distinguishing whether the user is registered in the air conditioner or not by brushing the face;
the face recognition module is used for realizing that the user obtains a face interesting area of the user through multi-scale transformation at different positions in a view field range;
and the awakening module is used for sending a voice awakening command after the face and the gesture stay for a certain time when the face recognition and the gesture estimation are carried out, and triggering a voice awakened state after the voice module receives the voice awakening information.
8. An intelligent home for realizing the scale-change-based air conditioner visual awakening-free identification method according to any one of claims 1-6.
9. A computer-readable storage medium comprising instructions that, when executed on a computer, cause the computer to perform the scale-change-based air conditioner visual wake-up-free identification method of any one of claims 1-6.
10. Use of the scale-change-based visual wake-up-free identification method for the air conditioner in the starting of the household appliance according to any one of claims 1 to 6.
CN201911098282.2A 2019-11-12 2019-11-12 Air conditioner vision wake-up-free identification method and system based on scale change and intelligent home Pending CN111007732A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911098282.2A CN111007732A (en) 2019-11-12 2019-11-12 Air conditioner vision wake-up-free identification method and system based on scale change and intelligent home

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911098282.2A CN111007732A (en) 2019-11-12 2019-11-12 Air conditioner vision wake-up-free identification method and system based on scale change and intelligent home

Publications (1)

Publication Number Publication Date
CN111007732A true CN111007732A (en) 2020-04-14

Family

ID=70111920

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911098282.2A Pending CN111007732A (en) 2019-11-12 2019-11-12 Air conditioner vision wake-up-free identification method and system based on scale change and intelligent home

Country Status (1)

Country Link
CN (1) CN111007732A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113759732A (en) * 2021-04-30 2021-12-07 北京字节跳动网络技术有限公司 Intelligent household appliance control method and device, electronic equipment and storage medium
WO2023005844A1 (en) * 2021-07-26 2023-02-02 华为技术有限公司 Device wake-up method, related apparatus, and communication system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105204628A (en) * 2015-09-01 2015-12-30 涂悦 Voice control method based on visual awakening
CN105700363A (en) * 2016-01-19 2016-06-22 深圳创维-Rgb电子有限公司 Method and system for waking up smart home equipment voice control device
CN105868693A (en) * 2016-03-21 2016-08-17 深圳市商汤科技有限公司 Identity authentication method and system
CN107293011A (en) * 2017-06-15 2017-10-24 深圳源广安智能科技有限公司 A kind of gate control system of smart home
CN109934098A (en) * 2019-01-24 2019-06-25 西北工业大学 A kind of video camera intelligence system and its implementation with secret protection
CN110136714A (en) * 2019-05-14 2019-08-16 北京探境科技有限公司 Natural interaction sound control method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105204628A (en) * 2015-09-01 2015-12-30 涂悦 Voice control method based on visual awakening
CN105700363A (en) * 2016-01-19 2016-06-22 深圳创维-Rgb电子有限公司 Method and system for waking up smart home equipment voice control device
CN105868693A (en) * 2016-03-21 2016-08-17 深圳市商汤科技有限公司 Identity authentication method and system
CN107293011A (en) * 2017-06-15 2017-10-24 深圳源广安智能科技有限公司 A kind of gate control system of smart home
CN109934098A (en) * 2019-01-24 2019-06-25 西北工业大学 A kind of video camera intelligence system and its implementation with secret protection
CN110136714A (en) * 2019-05-14 2019-08-16 北京探境科技有限公司 Natural interaction sound control method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113759732A (en) * 2021-04-30 2021-12-07 北京字节跳动网络技术有限公司 Intelligent household appliance control method and device, electronic equipment and storage medium
WO2023005844A1 (en) * 2021-07-26 2023-02-02 华为技术有限公司 Device wake-up method, related apparatus, and communication system

Similar Documents

Publication Publication Date Title
CN106705385A (en) Control method, control device and control system of air conditioner
CN109346071A (en) Wake up processing method, device and electronic equipment
CN107085380B (en) Intelligent household system user position judgment method and electronic equipment
CN108198553B (en) Voice interaction method, device, equipment and computer readable storage medium
CN110767225B (en) Voice interaction method, device and system
WO2022227820A1 (en) Method and apparatus for sleep environment control in home system, and device and system
WO2018157542A1 (en) Smart home appliance control method and device
CN107566227A (en) Control method and device of household appliance, intelligent device and storage medium
CN106250747B (en) Information processing method and electronic equipment
CN111007732A (en) Air conditioner vision wake-up-free identification method and system based on scale change and intelligent home
CN111199733A (en) Multi-stage recognition voice awakening method and device, computer storage medium and equipment
WO2023050903A1 (en) Method and device for air conditioner control, and air conditioner and storage medium
TW201222426A (en) Alarm clock and method for waking users using a face recognition function
CN111965991A (en) Authority adjusting method and device of intelligent control switch, intelligent control switch and storage medium
WO2023179226A1 (en) Method and apparatus for voice control of air conditioner, and air conditioner and storage medium
CN112634894A (en) Awakening method, awakening device and terminal
CN112932225A (en) Intelligent awakening pillow and awakening method based on intelligent awakening pillow
CN111325877B (en) Electronic equipment control method and device and electronic equipment
CN105739686A (en) Control method and device of mobile terminal
CN109920420A (en) A kind of voice wake-up system based on environment measuring
CN111179924B (en) Method and system for optimizing awakening performance based on mode switching
CN112634922A (en) Voice signal processing method, apparatus and computer readable storage medium
CN106379274A (en) Control method and device for automobile components, as well as automobile
CN113129878A (en) Voice control method and terminal device
CN111383633A (en) Voice recognition continuity control method and device, intelligent terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200414

RJ01 Rejection of invention patent application after publication