CN111817936A

CN111817936A - Control method and device of intelligent household equipment, electronic equipment and storage medium

Info

Publication number: CN111817936A
Application number: CN202010809084.9A
Authority: CN
Inventors: 黄洪波
Original assignee: Shenzhen Oribo Technology Co Ltd
Current assignee: Shenzhen Oribo Technology Co Ltd
Priority date: 2020-08-12
Filing date: 2020-08-12
Publication date: 2020-10-23

Abstract

The embodiment of the application discloses a control method and device of intelligent household equipment, electronic equipment and a storage medium. The method is applied to an intelligent household control panel, the intelligent household control panel is used for being connected with intelligent household equipment and controlling the working state of the intelligent household equipment, and the method comprises the following steps: when voice information is detected, acquiring equipment information of the intelligent home control panel of which the voice information is detected; judging whether the equipment information meets a preset condition or not; when the equipment information meets the preset condition, processing the voice information based on a local voice library to obtain a control instruction corresponding to the voice information; and controlling the working state of the intelligent household equipment based on the control instruction. This application is through when the equipment information who detects voice information's intelligent house control panel satisfies the preset condition, uses local voice library to handle voice information to improve voice information's response speed.

Description

Control method and device of intelligent household equipment, electronic equipment and storage medium

Technical Field

The present application relates to the field of smart home technologies, and in particular, to a method and an apparatus for controlling smart home devices, an electronic device, and a storage medium.

Background

With the continuous development of the technology, the voice intelligent home equipment is gradually popularized. Wherein, pronunciation intelligent household equipment can awaken up and control according to the instruction that the user assigned, is convenient for control, just so makes pronunciation intelligent household equipment more and more receive people's favor. Although the current voice intelligent home equipment can realize the advantages of high-precision recognition rate, intelligent upgrading and the like by depending on a cloud service platform, the command issued by a response user is recognized through a cloud server, and due to the instability of network connection, factors such as the response time of the cloud server and the like cause a certain time delay, so that the real-time performance of voice recognition and control is difficult to guarantee.

Disclosure of Invention

The embodiment of the application provides a control method and device for smart home equipment, electronic equipment and a storage medium, so as to solve the problems.

In a first aspect, an embodiment of the present application provides a control method for an intelligent home device, which is applied to an intelligent home control panel, where the intelligent home control panel is used to connect with the intelligent home device and control a working state of the intelligent home device, and the method includes: when voice information is detected, acquiring equipment information of the intelligent home control panel of which the voice information is detected; judging whether the equipment information meets a preset condition or not; when the equipment information meets the preset condition, processing the voice information based on a local voice library to obtain a control instruction corresponding to the voice information; and controlling the working state of the intelligent household equipment based on the control instruction.

In a second aspect, an embodiment of the present application provides a control device for smart home devices, which is applied to a smart home control panel, where the smart home control panel is used to be connected to the smart home devices, and is right to control a working state of the smart home devices, and the device includes: the equipment information acquisition module is used for acquiring the equipment information of the intelligent home control panel which detects the voice information when the voice information is detected; the device information judging module is used for judging whether the device information meets a preset condition or not; the voice information processing module is used for processing the voice information based on the local voice library when the equipment information meets the preset condition to obtain a control instruction corresponding to the voice information; the equipment control module is used for controlling the working state of the intelligent household equipment based on the control instruction

In a third aspect, an embodiment of the present application provides a smart home control panel, including a memory and a processor, where the memory is coupled to the processor, and the memory stores instructions, and when the instructions are executed by the processor, the processor performs the above-mentioned method.

In a fourth aspect, the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.

In the embodiment of the application, when the voice information is detected, the equipment information of the intelligent home control panel of which the voice information is detected is obtained; judging whether the equipment information meets a preset condition or not; when the equipment information meets the preset condition, processing the voice information based on a local voice library to obtain a control instruction corresponding to the voice information; and controlling the working state of the intelligent household equipment based on the control instruction. This application is through when the equipment information who detects voice information's intelligent house control panel satisfies the preset condition, uses local voice library to handle voice information to improve voice information's response speed.

These and other aspects of the present application will be more readily apparent from the following description of the embodiments.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 shows an application environment schematic diagram of a control method for smart home devices provided in an embodiment of the present application;

fig. 2 is a schematic flowchart illustrating a control method of smart home devices according to an embodiment of the present application;

fig. 3 is a schematic flowchart illustrating a control method for smart home devices according to another embodiment of the present application;

fig. 4 is a schematic flowchart illustrating a control method for smart home devices according to another embodiment of the present application;

fig. 5 is a schematic flowchart illustrating a control method for smart home devices according to still another embodiment of the present application;

fig. 6 is a schematic flowchart illustrating a control method for smart home devices according to still another embodiment of the present application;

fig. 7 is a schematic flowchart illustrating a control method for smart home devices according to still another embodiment of the present application;

fig. 8 shows a block diagram of a control device of smart home equipment provided in an embodiment of the present application;

fig. 9 shows a hardware structure block diagram of an electronic device of a control method for smart home devices according to an embodiment of the present application;

fig. 10 shows a storage unit, according to an embodiment of the present application, for storing or carrying program codes for implementing a control method of a smart home device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Therefore, the inventor provides a method, an apparatus, an electronic device, and a storage medium for controlling smart home devices, which are provided in this application embodiment, and when it is detected that device information of a smart home control panel of voice information satisfies a preset condition, the voice information is processed by using a local voice library of the smart home control panel, so as to improve response speed of the voice information.

An application environment to which the present application relates will be described below.

Referring to fig. 1, fig. 1 is a schematic diagram of an application environment suitable for the embodiment of the present application. The control method of the smart home device provided by the embodiment of the application can be applied to the smart home system 10 shown in fig. 1. The smart home system 10 includes a smart home control panel 100, a smart home device 200, and a server 300. The smart home control panel 100 has certain computing power, and a local voice library, and can acquire a corresponding control instruction by detecting and recognizing voice information of a user. The smart home device 200 may include, but is not limited to, a door and window sensor, a smart switch, a lamp, an air conditioner, a curtain, a television, a refrigerator, and a fan. The number of the smart home devices 200 is at least one, and the at least one smart home device 200 is connected to the smart home control panel 100. The smart home control panel 100 and the smart home device 200 may be connected via bluetooth, Wifi, or ZigBee. The smart home control panel 100 may be used as a user operation inlet, may communicate with and control peripheral home appliances, may access and output text, pictures, and audio/video information in a wireless or wired communication manner, or may forward server-side information to a local or playing device for display, and the like, and may specifically be an intelligent gateway.

Further, the smart home system 10 may further include a server 300, where the server 300 may be a conventional server, or may also be a cloud server, which is not limited herein. The number of the smart home control panels 100 is at least one, wherein the server 300 is respectively connected to the at least one smart home control panel 100, for example, the server 300 may be respectively in communication connection with the at least one smart home control panel 100 through a wireless network, so as to perform data interaction between the server 300 and the smart home control panel 100.

The above application environments are only examples for facilitating understanding, and it is to be understood that the embodiments of the present application are not limited to the above application environments.

Embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Referring to fig. 2, fig. 2 is a schematic flowchart illustrating a control method for smart home devices according to an embodiment of the present application. The method is applied to an intelligent home control panel, the intelligent home control panel is used for being connected with an intelligent home device and controlling the working state of the intelligent home device, and the following detailed description is provided for the embodiment shown in fig. 2, and the method specifically includes the following steps:

step S110: and when the voice information is detected, acquiring the equipment information of the intelligent home control panel of which the voice information is detected.

In this embodiment, the smart home system includes a smart home control panel and a smart home device, and the smart home control panel may be used to connect to the smart home device and control a working state of the smart home device. The intelligent home control panel can be provided with a voice acquisition device for detecting voice information sent by a user, and the voice acquisition device can be a microphone, a radio and the like.

Under the scene of intelligent home, when detecting voice information of a user, the intelligent home control panel generally uploads the detected voice information to the server by itself or the gateway, and the server identifies and processes the voice information to obtain a corresponding control instruction of the intelligent home device to control the working state of the intelligent home device. However, due to the instability of network connection and the access speed of the cloud server, a certain time delay is caused, so that it is difficult to ensure the real-time performance of voice recognition and control. Therefore, the local voice library can be preferentially used for recognizing and processing the voice information in some scenes, so that the response speed of the voice information is improved. Therefore, in the present embodiment, when voice information is detected, device information of the smart home control panel in which the voice information is detected may be acquired, and it may be determined whether a condition for processing the voice information based on the local voice library is satisfied according to the device information. The device information may include, but is not limited to, a device model, a device manufacturer, a device name, a device type, and a device status.

Step S120: and judging whether the equipment information meets a preset condition or not.

In this embodiment, when the device information of the smart home control panel, in which the voice information is detected, is acquired, it may be determined whether the device information satisfies a preset condition. The preset condition may be preset by the system, or may be set by the user, which is not limited herein. The preset condition may be a condition that the device information needs to meet and the voice information is processed based on a local voice library. For example, when the device information is the device model, when the device model of the smart home control panel represents that the smart home control panel is the latest model, the voice information may be identified by using the local voice library of the smart home control panel, and then the preset condition may be set as the latest model of the smart home control panel, and whether the device information satisfies the preset condition may be determined as whether the device information corresponds to the latest model. For example, when the device information is address information, the preset condition may be that the device information is installed in a bedroom, and it may be determined whether the address information of the smart home control panel, in which the voice information is detected, is in the bedroom, so as to determine whether the device information satisfies the preset condition. The foregoing examples are merely exemplary and are not intended to be limiting.

Step S130: and when the equipment information meets the preset condition, processing the voice information based on the local voice library to obtain a control instruction corresponding to the voice information.

In this embodiment, when it is detected that the device information of the smart home control panel of the voice information satisfies the preset condition, the voice information may be processed based on the local voice library of the smart home control panel, so as to obtain a control instruction corresponding to the voice information.

The local voice library based on the intelligent home control panel processes the voice information to obtain a control instruction corresponding to the voice information, and specifically, in some embodiments, the local voice library may include a keyword corresponding to the voice information and a control instruction corresponding to the voice information, and the keyword and the control instruction are stored in the local voice library of the intelligent home control panel in a one-to-one correspondence manner. Therefore, the voice information can be recognized through the local voice recognition model of the intelligent home control panel to obtain the keywords corresponding to the voice information, and the control instruction corresponding to the keywords is searched in the local voice library according to the keywords corresponding to the voice information. For example, if the detected voice information is "turn on the fan to 2 th gear", the voice information can be identified to obtain keywords "fan", "turn on", and "2 nd gear", and then the corresponding control instruction can be found in the local voice library of the smart home control panel according to the three keywords. Of course, in other embodiments, the local voice library may include part of the fuzzy semantic recognition data pre-stored for the voice instruction corresponding to the daily usage scenario, where the fuzzy semantic recognition data may be pre-stored according to the daily habit of the user, or may be obtained according to big data statistics. When the voice command of the user is recognized according to the fuzzy semantic recognition algorithm to accord with the fuzzy semantic recognition data, the corresponding control command can also be executed.

In some embodiments, the local voice library may be preset by the system, or may be manually added by the user according to the use habit of the user, for example, the user may directly input the voice information and the control instruction corresponding to the voice information on the smart home control panel to add the voice information to the local voice library of the smart home control panel. In some embodiments, the local voice library may also be automatically added by the smart home control panel according to habits of the user, specifically, when the voice information is detected, the frequency of use of the detected voice information may be obtained, and when the frequency of use is greater than the preset frequency of use, it may be stated that the voice information is commonly used by the user, and the voice information and the control instruction corresponding to the voice information may be correspondingly stored in the local voice library, for example, if the user frequently says "turn on a lamp in a bedroom", a control instruction corresponding to "turn on a lamp in a bedroom" may be obtained, and "turn on a lamp in a bedroom" and a control instruction corresponding thereto may be correspondingly stored in the local voice library.

In some embodiments, when the number of the family members is multiple, a local personal voice library corresponding to each family member may be further created for each family member according to the identity information of the family member. Specifically, a corresponding local voice library can be set for each family member according to the accent and expression habits of each family member, for example, a local personal voice library of dad can be established according to the accent and expression habits of dad in home, and when the detected voice information is sent by dad, the voice information can be processed according to the local personal voice library of dad, so that the voice information can be processed more accurately.

Step S140: and controlling the working state of the intelligent household equipment based on the control instruction.

In this embodiment, after the control instruction corresponding to the voice information is obtained, the smart home control panel may control the working state of the smart home device based on the control instruction. The working state of the smart home device may be an operating state of the smart home device. For example, when the smart home device is an air conditioner, the operation state may be temperature, wind sweeping direction, timing time, and the like; when the intelligent household equipment is an electric control curtain, the running state can be the opening and closing degree, the shading angle and the like.

In some embodiments, when it is detected that the device information of the smart home control panel of the voice information does not satisfy the preset condition, the voice information may be uploaded to the server, and the voice information is processed according to a voice library stored in the server, so as to obtain a control instruction corresponding to the voice information.

According to the control method of the intelligent home equipment provided by the embodiment, when the voice information is detected, the equipment information of the intelligent home control panel of which the voice information is detected is obtained; judging whether the equipment information meets a preset condition or not; when the equipment information meets the preset condition, processing the voice information based on a local voice library to obtain a control instruction corresponding to the voice information; and controlling the working state of the intelligent household equipment based on the control instruction. According to the embodiment, when the equipment information of the intelligent home control panel which detects the voice information meets the preset condition, the local voice library of the intelligent home control panel is used for processing the voice information, so that the response speed of the voice information is improved.

Referring to fig. 3, fig. 3 is a schematic flowchart illustrating a control method for smart home devices according to another embodiment of the present application. As will be explained in detail with respect to the flow shown in fig. 3, the method may specifically include the following steps:

step S210: and when the voice information is detected, acquiring the equipment information of the intelligent home control panel of which the voice information is detected.

For detailed description of step S210, please refer to step S110, which is not described herein again.

Step S220: and judging whether the current network state of the intelligent home control panel is in a crowded state.

In this embodiment, the device information may include a network status, and when the voice information is detected, the current network status of the smart home control panel where the voice information is detected may be obtained, and whether the current network status of the smart home control panel is in a congestion state may be determined. The preset condition may be that the current network state of the smart home control panel is in a congestion state.

In some embodiments, the network speed information of the smart home control panel may be obtained, and the current network state of the smart home control panel may be obtained according to the network speed information. Specifically, the network speed information may include a numerical value used for representing the network speed of the smart home control panel, and when the numerical value is lower than a preset numerical value, the network state may be considered as a congestion state; when the value is greater than or equal to the preset value, the network state may be considered as a smooth state. The network speed information may be obtained according to a network speed average value of the smart home control panel within a certain period of time, or may be obtained according to a network speed of the smart home control panel at a certain moment, which is not limited herein.

Step S230: and when the current network state is in a congestion state, determining that the equipment information meets a preset condition.

In this embodiment, when the current network state of the smart home control panel is in a crowded state, it can be shown that if the voice information is processed through the voice library stored in the cloud server, a certain degree of time delay may be caused because the current network state of the smart home control panel is in the crowded state, so that the system cannot quickly respond to the voice information of the user. Therefore, the voice information can be processed based on the local voice library of the intelligent home control panel, and the control instruction corresponding to the voice information is obtained. That is, when the current network status is in a congested state, it may be determined that the device information satisfies a preset condition.

Step S240: and when the equipment information meets the preset condition, processing the voice information based on the local voice library to obtain a control instruction corresponding to the voice information.

Step S250: and controlling the working state of the intelligent household equipment based on the control instruction.

For detailed description of steps S240 to S250, please refer to steps S130 to S140, which are not described herein again.

According to the control method of the intelligent home equipment provided by the embodiment, when the voice information is detected, the equipment information of the intelligent home control panel of which the voice information is detected is obtained; judging whether the current network state of the intelligent home control panel is in a crowded state; when the current network state is in a congestion state, determining that the equipment information meets a preset condition; and when the equipment information meets the preset condition, processing the voice information based on the local voice library to obtain a control instruction corresponding to the voice information. According to the embodiment, when the current network state of the intelligent home control panel detecting the voice information is in a crowded state, the voice information is processed based on the local voice library of the intelligent home control panel, so that the voice information can be processed by the local voice library when the current network state of the intelligent home control panel is in the crowded state, and compared with processing through a cloud server, the voice information of a user can be responded more quickly, and the real-time performance of voice recognition and control is guaranteed.

Referring to fig. 4, fig. 4 is a schematic flowchart illustrating a control method for smart home devices according to another embodiment of the present application. As will be explained in detail with respect to the flow shown in fig. 4, the method may specifically include the following steps:

step S310: and when the voice information is detected, acquiring the equipment information of the intelligent home control panel of which the voice information is detected.

For detailed description of step S310, please refer to step S110, which is not described herein again.

Step S320: and judging whether the address information is located in a preset area.

In this embodiment, the device information may include address information, and when the voice information is detected, the address information of the smart home control panel where the voice information is detected may be acquired, and whether the address information is located in the preset area may be determined.

In some embodiments, the address information of the smart home control panel may be obtained by obtaining a MAC address of the smart home control panel, where the address information may refer to an installation location of the smart home control panel. The preset area may be set by a user or preset by the system, and is not limited herein. In some embodiments, the preset area may refer to a certain room, such as a bedroom, a living room, a kitchen, etc., or to an area where several rooms are combined, such as a leisure area consisting of a living room and a balcony. Whether the address information of the intelligent home control panel is located in the preset area or not can be judged by checking whether the installation position of the intelligent home control panel is in the preset area or not.

Step S330: and when the address information is located in the preset area, determining that the equipment information meets the preset condition.

In this embodiment, when the address information is located in the preset area, it may be determined that the device information meets the preset condition, and then, the voice information may be processed based on the local voice library of the smart home control panel. For example, the preset area may be a bedroom, and when the address information of the smart home control panel is located in the bedroom, it may be determined that the device information of the smart home control panel meets a preset condition, and then the voice information may be processed based on a local voice library of the smart home control panel.

Step S340: and when the equipment information meets the preset condition, processing the voice information based on the local voice library to obtain a control instruction corresponding to the voice information.

Step S350: and controlling the working state of the intelligent household equipment based on the control instruction.

For the detailed description of steps S340 to S350, refer to steps S130 to S140, which are not described herein again.

According to the control method of the intelligent home equipment provided by the embodiment, when the voice information is detected, the equipment information of the intelligent home control panel of which the voice information is detected is obtained; judging whether the address information is located in a preset area; when the address information is located in a preset area, determining that the equipment information meets a preset condition; and when the equipment information meets the preset condition, processing the voice information based on the local voice library to obtain a control instruction corresponding to the voice information. According to the embodiment, when the address information of the intelligent home control panel which detects the voice information is located in the preset area, the voice information is processed through the local voice library of the intelligent home control panel, so that when the intelligent home control panel which is installed in the specific area detects the voice information, the local voice library is preferentially used for identifying and processing the voice information, and the response speed of the voice information is improved.

Referring to fig. 5, fig. 5 is a schematic flowchart illustrating a control method for an intelligent home device according to still another embodiment of the present application, and details of the flow illustrated in fig. 5 will be described below, where the type of the intelligent home control panel includes a master control device and a slave control device, and the slave control device interacts with a server through the master control device, where the method specifically includes the following steps:

step S410: and when the voice information is detected, acquiring the equipment information of the intelligent home control panel of which the voice information is detected.

The detailed description of step S410 may refer to step S110, which is not described herein again.

Step S420: and judging whether the type information is the slave control equipment.

In this embodiment, the smart home system may include a plurality of smart home control panels, and the types of the smart home control panels may include a master control device and a slave control device, where at least one smart home control panel may be selected from the plurality of smart home control panels as the master control device, and other smart home control panels may be selected as the slave control devices, for example, the smart home control panel closest to the router may be selected as the master control device. The slave control device may interact with the server through the master control device, and therefore, the device information may further include type information. In this embodiment, when the voice information is detected, the type information of the smart home control panel where the voice information is detected may be obtained, and further, whether the type information is the slave control device may be determined.

In some embodiments, the identification information of the smart home control panel includes type information, and therefore, the type information of the smart home control panel may be searched by the identification information of the smart home control panel, which is not limited herein.

Step S430: and when the type information is the slave control equipment, determining that the equipment information meets the preset condition.

In this embodiment, the preset condition may be that the type of the smart home control panel is the slave control device, and therefore, when the type information of the smart home control panel, which detects the voice information, is also the slave control device, it may be determined that the device information of the smart home control panel satisfies the preset condition.

Step S440: and when the equipment information meets the preset condition, acquiring the current network state of the main control equipment.

The slave control equipment uploads the voice information to the master control equipment when detecting the voice information, and then the master control equipment uploads the voice information to the server for processing, if the network state of the master control equipment is in a crowded state at the moment, the voice information is uploaded to the master control equipment, the master control equipment may not receive the voice information quickly, and also may not upload the voice information to the server immediately after receiving the voice information, so that the real-time performance of voice recognition and control is greatly influenced. Therefore, in this embodiment, when the device information meets the preset condition, that is, the type information of the smart home control panel that detects the voice information is the slave control device, the current network state of the master control device may be obtained first.

In some embodiments, the network speed information of the master device may be obtained, and the current network state of the master device may be obtained according to the network speed information. Specifically, the network speed information may include a numerical value used to represent the network speed of the master control device, and when the numerical value is lower than a preset numerical value, the network status may be considered as a congestion status; when the value is greater than or equal to the preset value, the network state may be considered as a smooth state.

Step S450: and when the current network state of the master control equipment is in a congestion state, the slave control equipment processes the voice information based on a local voice library to obtain a control instruction corresponding to the voice information.

In this embodiment, when the current network state of the master control device is in a congestion state, the slave control device may process the voice information based on the local voice library to obtain a control instruction corresponding to the voice information, so as to improve a response speed to the voice information and ensure real-time performance of voice recognition and control.

Step S460: and controlling the working state of the intelligent household equipment based on the control instruction.

The detailed description of step S460 may refer to step S140, and is not repeated herein.

In some embodiments, the device information may include a plurality of types, and the voice information is processed based on the local voice library when the plurality of types of device information respectively satisfy the preset conditions. As an implementation manner, the types of the device information may include two types, and when both types of the device information meet corresponding preset conditions, the voice information is processed based on a local voice library, for example, the device information may include a network state and address information, and when the current network state of the smart home control panel is in a crowded state and the address information of the smart home control panel is located in a preset area, it may be determined that the device information meets the preset conditions, and then the voice information may be processed based on the local voice library of the smart home control panel; for another example, the device information may include a network state and type information, and when the current network state of the smart home control panel is in a crowded state and the type information of the smart home control panel is a slave control device, it may be determined that the device information satisfies a preset condition, and meanwhile, if the current network state of the master control device is in the crowded state, the voice information is processed based on a local voice library of the slave control device, so as to obtain a control instruction corresponding to the voice information; for another example, the device information may include address information and type information, and when the address information of the smart home control panel is located in a preset area and the type information of the smart home control panel is a reference device, it is determined that the device information meets a preset condition, and meanwhile, if the current network state of the master control device is in a congested state, the voice information is processed based on a local voice library of the slave control device, so as to obtain a control instruction corresponding to the voice information.

As another embodiment, the types of the device information may include three types, and when the three types of device information all satisfy corresponding preset conditions, the voice information is processed based on a local voice library, for example, the device information includes a network state, address information, and type information, when the current network state of the smart home control panel is in a congestion state, and the address information of the smart home control panel is located in a preset area, and the type information of the smart home control panel is a slave control device, it may be determined that the device information satisfies the preset conditions, and meanwhile, when the current network state of the master control device is in the congestion state, the voice information is processed based on the local voice library of the slave control device, so as to obtain a control instruction corresponding to the voice information.

According to the control method of the intelligent home equipment provided by the embodiment, when the voice information is detected, the equipment information of the intelligent home control panel of which the voice information is detected is obtained; judging whether the type information is slave control equipment or not; when the type information is the slave control equipment, determining that the equipment information meets a preset condition; when the equipment information meets a preset condition, acquiring the current network state of the master control equipment; when the current network state of the master control equipment is in a crowded state, the slave control equipment processes the voice information based on a local voice library to obtain a control instruction corresponding to the voice information; and controlling the working state of the intelligent household equipment based on the control instruction. According to the embodiment, when the intelligent home control panel detecting the voice information is the slave control equipment and the current network state of the master control equipment is in a crowded state, the slave control equipment can process the voice information based on the local voice library, so that when the master control equipment is busy, the voice command of a user can be responded quickly, and the real-time performance of voice recognition and control is ensured.

Referring to fig. 6, fig. 6 is a schematic flow chart illustrating a control method for smart home devices according to still another embodiment of the present application, where the smart home control panel includes a first smart home control panel and a second smart home control panel, and the following will explain in detail with respect to the flow chart shown in fig. 6, where the method specifically includes the following steps:

step S510: and when the voice information is detected, acquiring the equipment information of the intelligent home control panel of which the voice information is detected.

Step S520: and judging whether the equipment information meets a preset condition or not.

For the detailed description of steps S510 to S520, refer to steps S110 to S120, which are not described herein again.

Step S530: when the equipment information meets the preset condition and the voice information comprises first voice information and second voice information, calculating the similarity of the first voice information and the second voice information, wherein the first intelligent home control panel detects the first voice information, and the second intelligent home control panel detects the second voice information.

If there are multiple smart home control panels in the smart home system, it may be possible that several smart home control panels detect the voice information at the same time, and how to determine the processing manner of the voice information may refer to the method provided in this embodiment. In this embodiment, the example that two smart home control panels detect the voice information is taken as an example for explanation, it is to be understood that three or four smart home control panels may detect the voice information, and the present invention is not limited herein.

In this embodiment, the smart home control panel includes a first smart home control panel and a second smart home control panel, the first smart home control panel detects the first voice information, and the second smart home control panel detects the second voice information. In some embodiments, if the first voice message and the second voice message are sent by the same user, the local voice library of the first smart home control panel or the second smart home control panel may be selected to identify the voice message; if the first voice message and the second voice message are not sent by the same user, the voice messages can be identified according to the local voice library of the intelligent home control panel corresponding to the detected voice messages. In some embodiments, the similarity between the first voice message and the second voice message may be calculated to determine whether the first voice message and the second voice message are uttered by the same user. The voiceprint information of the first voice message and the voiceprint information of the second voice message may be obtained, and the similarity between the first voice message and the second voice message is obtained by comparing the voiceprint information of the first voice message with the voiceprint information of the second voice message, which is not limited herein.

Step S540: when the similarity is smaller than the similarity threshold value, the first intelligent home control panel processes the first voice information based on the local voice library, and the second intelligent home control panel processes the second voice information based on the local voice library.

In this embodiment, when the similarity between the first voice message and the second voice message is smaller than the similarity threshold, it may be stated that the first voice message and the second voice message are not sent by the same user, and meanwhile, the first voice message and the second voice message may correspond to different control instructions. Therefore, the first voice information can be processed by the first intelligent home control panel based on the local voice library, and the second voice information can be processed by the second intelligent home control panel based on the local voice library, so that the processing of the first voice information and the processing of the second voice information cannot be influenced mutually, and the response speed of the first voice information and the second voice information is improved.

In some embodiments, when the similarity is greater than or equal to the similarity threshold, the target smart home control panel processes the target voice information based on the local voice library to obtain a control instruction corresponding to the target voice information, where the target smart home control panel may be a first smart home control panel or a second smart home control panel, and the target voice information may be first voice information or second voice information. That is, when the similarity is greater than or equal to the similarity threshold, it indicates that the first voice message and the second voice message may be sent by the same user, so that the first smart home control panel may be selected to process the first voice message or the second voice message based on the local voice library, or the second smart home control panel may process the first voice message or the second voice message based on the local voice library.

Further, in other embodiments, because the positions of the first smart home control panel and the second smart home control panel do not coincide, the times when the first smart home control panel and the second smart home control panel detect the voice information may be different. When the similarity is greater than or equal to the similarity threshold, the time when the first intelligent home control panel detects the first voice information can be acquired, and the time when the second intelligent home control panel detects the second voice information can be acquired. As an implementation manner, when the time when the first smart home control panel controls the first voice message is earlier than the time when the second smart home control panel detects the second voice message, the first voice message may be processed by the first smart home control panel based on the local voice library, so that the voice message may be responded faster. As another implementation, when the time when the second smart home control panel detects the second voice information is earlier than the time when the first smart home control panel detects the first voice information, the second smart home control panel may process the second voice information based on the local voice library, so that the voice information may be responded faster.

Step S550: and controlling the working state of the intelligent household equipment based on the control instruction.

For detailed description of step S550, please refer to step S140, which is not described herein.

According to the control method of the intelligent home equipment provided by the embodiment, when the voice information is detected, the equipment information of the intelligent home control panel of which the voice information is detected is obtained; judging whether the equipment information meets a preset condition or not; when the equipment information meets a preset condition and the voice information comprises first voice information and second voice information, calculating the similarity of the first voice information and the second voice information, wherein the first intelligent home control panel detects the first voice information, and the second intelligent home control panel detects the second voice information; when the similarity is smaller than the similarity threshold value, the first intelligent home control panel processes the first voice information based on the local voice library, and the second intelligent home control panel processes the second voice information based on the local voice library; and controlling the working state of the intelligent household equipment based on the control instruction. According to the embodiment, when the similarity of the detected first voice information and the second voice information is smaller than the similarity threshold value, the first voice information and the second voice information are respectively identified according to the detected local voice libraries of the intelligent home control panel corresponding to the first voice information and the second voice information, so that the processing of the first voice information and the processing of the second voice information cannot be influenced mutually, and the response speed of the first voice information and the response speed of the second voice information are improved.

Referring to fig. 7, fig. 7 is a schematic flow chart illustrating a control method for an intelligent home device according to still another embodiment of the present application, where the intelligent home control panel includes a first intelligent home control panel and a second intelligent home control panel, and the following will explain in detail with respect to the flow chart shown in fig. 7, where the method specifically includes the following steps:

step S610: and when the voice information is detected, acquiring the equipment information of the intelligent home control panel of which the voice information is detected.

Step S620: and judging whether the equipment information meets a preset condition or not.

For the detailed description of steps S610 to S620, refer to steps S110 to S120, which are not described herein again.

Step S630: and when the equipment information meets the preset condition, acquiring the time when the first intelligent household control panel and the second intelligent household control panel detect the voice information.

In this embodiment, the smart home control panel includes a first smart home control panel and a second smart home control panel, and may acquire a time when the first smart home control panel and the second smart home control panel detect the voice information. Specifically, when the first smart home control panel detects the voice information, the system time of the first smart home control panel at the moment can be recorded, and the system time can be used as the time when the first smart home control panel detects the voice information.

In some embodiments, the voice information may be voice information sent by the same user, that is, when the user sends the voice information, the first smart home control panel and the second smart home control panel both detect the voice information, and at this time, which smart home control panel processes the voice information may be determined according to the sequence of times when the first smart home control panel and the second smart home control panel detect the voice information.

In other embodiments, the voice message may be sent by different users, that is, the first smart home control panel detects the voice message of the first user, the second smart home control panel detects the voice message of the second user, and at this time, or the time when the first smart home control panel detects the voice message of the first user and the time when the second smart home control panel detects the voice message of the second user, when the first smart home control panel detects the voice information of the first user earlier than the second smart home control panel detects the voice information of the second user, the voice information of the first user can be processed by the first intelligent home control panel based on the local voice library, and then the voice information of the second user can be processed by the second intelligent home control panel based on the local voice library.

Step S640: when the time that the first intelligent home control panel detects the voice information is earlier than the time that the second intelligent home control panel detects the voice information, the first intelligent home control panel processes the voice information based on the local voice library.

In this embodiment, the time when the first smart home control panel detects the voice information may be compared with the time when the second smart home control panel detects the voice information, and when the time when the first smart home control panel detects the voice information is earlier than the time when the second smart home control panel detects the voice information, the first smart home control panel may process the voice information based on the local voice library, so that the response speed to the voice information may be increased.

Step S650: when the time that the second intelligent home control panel detects the voice information is earlier than the time that the first intelligent home control panel detects the voice information, the second intelligent home control panel processes the voice information based on the local voice library.

In this embodiment, when comparing the time when the first smart home control panel detects the voice information with the time when the second smart home control panel detects the voice information, if the time when the second smart home control panel detects the voice information is earlier than the time when the first smart home control panel detects the voice information, the second smart home control panel may process the voice information based on the local voice library, so as to improve the response speed to the voice information.

Step S660: and controlling the working state of the intelligent household equipment based on the control instruction.

For detailed description of step S660, please refer to step S140, which is not described herein.

In some embodiments, the distance between the first smart home control panel and the user and the distance between the second smart home control panel and the user may also be obtained, where as an embodiment, the distance between the first smart home control panel and the user may be determined by detecting the volume of the voice information by the first smart home control panel and the second smart home control panel, and the larger the volume is, the closer the distance between the smart home control panel and the user may be. As another embodiment, the distance between the smart home control panel and the user may be measured by an infrared ray or a camera. Further, the processing mode of the voice information can be determined according to the distance from the user. Specifically, when the distance between the first smart home control panel and the user is shorter than the distance between the second smart home control panel and the user, the first smart home control panel may process the voice information based on the local voice library; when the distance between the second intelligent home control panel and the user is shorter than the distance between the first intelligent home control panel and the user, the second intelligent home control panel can process the voice information based on the local voice library. And is not limited herein.

According to the control method of the intelligent home equipment provided by the embodiment, when the voice information is detected, the equipment information of the intelligent home control panel of which the voice information is detected is obtained; judging whether the equipment information meets a preset condition or not; when the equipment information meets a preset condition, acquiring the time when the first intelligent home control panel and the second intelligent home control panel detect voice information; when the first intelligent home control panel detects the voice information earlier than the second intelligent home control panel detects the voice information, the first intelligent home control panel processes the voice information based on the local voice library; when the time that the second intelligent home control panel detects the voice information is earlier than the time that the first intelligent home control panel detects the voice information, the second intelligent home control panel processes the voice information based on the local voice library. According to the embodiment, the processing mode of the voice information is determined according to the sequence of the time when the first intelligent home control panel and the second intelligent home control panel detect the voice information, so that the intelligent home control panel which detects the voice information firstly processes the voice information based on the local voice library, and the response speed of the voice information is improved.

Referring to fig. 8, fig. 8 shows a block diagram of a control device 800 of smart home equipment according to an embodiment of the present application. The device is applied to an intelligent household control panel, the intelligent household control panel is used for being connected with intelligent household equipment and controlling the working state of the intelligent household equipment, the following description is made for a block diagram shown in fig. 8, and the control device 800 of the intelligent household equipment comprises: an equipment information obtaining module 810, a condition judging module 820, a voice information processing module 830 and a state control module 840, wherein:

and the device information acquiring module 810 is configured to acquire the device information of the smart home control panel, where the voice information is detected, when the voice information is detected.

And a condition determining module 820, configured to determine whether the device information satisfies a preset condition.

Further, the device information includes a network status, and the condition determining module 820 includes: a state judgment submodule and a first condition determination submodule, wherein:

and the state judgment submodule is used for judging whether the current network state of the intelligent home control panel is in a crowded state.

And the first condition determining submodule is used for determining that the equipment information meets the preset condition when the current network state is in a congestion state.

Further, the device information includes address information, and the condition determining module 820 further includes: the area judgment submodule and the second condition determination submodule, wherein:

and the area judgment submodule is used for judging whether the address information is positioned in a preset area.

And the second condition determining submodule is used for determining that the equipment information meets the preset condition when the address information is positioned in the preset area.

Further, the type of the smart home control panel includes a master control device and a slave control device, the slave control device interacts with the server through the master control device, the device information includes type information, and the condition determining module 820 further includes: the device judgment sub-module and a third determination sub-module, wherein:

and the equipment judgment submodule is used for judging whether the type information is the slave control equipment.

And the third determining submodule is used for determining that the equipment information meets the preset condition when the type information is the slave control equipment.

And the voice information processing module 830 is configured to, when the device information meets the preset condition, process the voice information based on a local voice library to obtain a control instruction corresponding to the voice information.

Further, the voice information processing module 830 includes: network state acquisition submodule and first speech information processing submodule, wherein:

and the network state acquisition submodule is used for acquiring the current network state of the main control equipment when the equipment information meets the preset condition.

And the first voice information processing submodule is used for processing the voice information by the slave control equipment based on the local voice library to obtain a control instruction corresponding to the voice information when the current network state of the master control equipment is in a congestion state.

Further, intelligent house control panel includes first intelligent house control panel and second intelligent house control panel, and voice information processing module still includes: similarity operator module and second speech information processing submodule, wherein:

and the similarity calculation sub-module is used for calculating the similarity of the first voice information and the second voice information when the voice information comprises the first voice information and the second voice information, wherein the first intelligent home control panel detects the first voice information, and the second intelligent home control panel detects the second voice information.

And the second voice information processing submodule is used for processing the first voice information by the first intelligent home control panel based on the local voice library and processing the second voice information by the second intelligent home control panel based on the local voice library when the similarity is smaller than the similarity threshold value.

Further, the voice information processing module further comprises: a third speech information processing sub-module, wherein:

and the third voice information processing submodule is used for processing the target voice information by the target intelligent home control panel based on the local voice library to obtain a control instruction corresponding to the target voice information when the similarity is greater than or equal to the similarity threshold, wherein the target intelligent home control panel is the first intelligent home control panel or the second intelligent home control panel, and the target voice information is the first voice information or the second voice information.

Further, intelligent house control panel includes first intelligent house control panel and second intelligent house control panel, and voice information processing module still includes: the time acquisition submodule, the fourth voice information processing submodule and the fifth voice information processing submodule, wherein:

and the time acquisition submodule is used for acquiring the time when the first intelligent home control panel and the second intelligent home control panel detect the voice information.

The fourth voice information processing submodule is used for processing the voice information by the first intelligent home control panel based on the local voice library when the time of the first intelligent home control panel detecting the voice information is earlier than the time of the second intelligent home control panel detecting the voice information;

and the fifth voice information processing submodule is used for processing the voice information based on the local voice library by the second intelligent household control panel when the time for detecting the voice information by the second intelligent household control panel is earlier than the time for detecting the voice information by the first intelligent household control panel.

And the state control module 840 is used for controlling the working state of the intelligent household equipment based on the control instruction.

The control device of the intelligent home equipment provided by the embodiment of the application comprises an equipment information acquisition module, a voice information acquisition module and a control module, wherein the equipment information acquisition module is used for acquiring the equipment information of the intelligent home control panel which detects the voice information when the voice information is detected; the device information judging module is used for judging whether the device information meets a preset condition or not; the voice information processing module is used for processing the voice information based on the local voice library when the equipment information meets the preset condition to obtain a control instruction corresponding to the voice information; and the equipment control module is used for controlling the working state of the intelligent household equipment based on the control instruction, so that when the equipment information of the intelligent household control panel which detects the voice information meets the preset condition, the local voice library of the intelligent household control panel is used for processing the voice information, and the response speed of the voice information is improved.

As will be clearly understood by those skilled in the art, the control device of the smart home device provided in the embodiment of the present application can implement each process implemented by the electronic device in the method embodiments of fig. 2 to fig. 7, and for convenience and simplicity of description, specific working processes of the above-described device and module may refer to corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, the coupling or direct coupling or communication connection between the modules shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or modules may be in an electrical, mechanical or other form. In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.

Referring to fig. 9, a block diagram of an electronic device 900 according to an embodiment of the present disclosure is shown. The electronic device 900 in the present application may include one or more of the following components: a processor 910, a memory 920, and one or more applications, wherein the one or more applications may be stored in the memory 920 and configured to be executed by the one or more processors 910, the one or more programs configured to perform a method as described in the aforementioned method embodiments.

Processor 910 may include one or more processing cores. The processor 910 interfaces with various components throughout the electronic device 900 using various interfaces and circuitry to perform various functions of the electronic device 900 and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 920 and invoking data stored in the memory 920. Alternatively, the processor 910 may be implemented in hardware using at least one of Digital Signal Processing (DSP), field-programmable gate array (FPGA), and Programmable Logic Array (PLA). The processor 910 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 910, but may be implemented by a communication chip.

The memory 920 may include a Random Access Memory (RAM) or a read-only memory (ROM). The memory 920 may be used to store instructions, programs, code sets, or instruction sets. The memory 920 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The data storage area may also store data created during use by the electronic device 900 (e.g., phone books, audio-visual data, chat log data), and so forth.

Referring to fig. 10, a block diagram of a computer-readable storage medium according to an embodiment of the present disclosure is shown. The computer-readable storage medium 1000 stores program code that can be called by a processor to execute the methods described in the above-described method embodiments.

The computer-readable storage medium 1000 may be an electronic memory such as a flash memory, an electrically-erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a hard disk, or a ROM. Alternatively, the computer-readable storage medium 1000 includes a non-volatile computer-readable medium (non-transitory-readable storage medium). The computer readable storage medium 1000 has storage space for a program medium 1010 for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program medium 1010 may be compressed, for example, in a suitable form.

To sum up, the method, the apparatus, the electronic device and the storage medium for controlling the smart home device provided in the embodiments of the present application include: when voice information is detected, acquiring equipment information of the intelligent home control panel of which the voice information is detected; judging whether the equipment information meets a preset condition or not; when the equipment information meets the preset condition, processing the voice information based on a local voice library to obtain a control instruction corresponding to the voice information; and controlling the working state of the intelligent household equipment based on the control instruction. According to the voice information processing method and device, when the equipment information of the intelligent home control panel which detects the voice information meets the preset conditions, the local voice library of the intelligent home control panel is used for processing the voice information, and therefore the response speed of the voice information is improved.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A control method of intelligent household equipment is applied to an intelligent household control panel, the intelligent household control panel is used for being connected with the intelligent household equipment and controlling the working state of the intelligent household equipment, and the method comprises the following steps:

when voice information is detected, acquiring equipment information of an intelligent home control panel which detects the voice information;

judging whether the equipment information meets a preset condition or not;

when the equipment information meets the preset condition, processing the voice information based on a local voice library to obtain a control instruction corresponding to the voice information;

and controlling the working state of the intelligent household equipment based on the control instruction.

2. The method of claim 1, wherein the device information includes a network status, and wherein the determining whether the device information satisfies a predetermined condition includes:

judging whether the current network state of the intelligent home control panel is in a crowded state;

and when the current network state is in a congestion state, determining that the equipment information meets a preset condition.

3. The method of claim 1, wherein the device information includes address information, and wherein the determining whether the device information satisfies a preset condition comprises:

judging whether the address information is located in a preset area;

and when the address information is located in the preset area, determining that the equipment information meets a preset condition.

4. The method according to claim 1, wherein the type of the smart home control panel comprises a master control device and a slave control device, the slave control device interacts with a server through the master control device, the device information comprises type information, and the determining whether the device information meets a preset condition comprises:

judging whether the type information is slave control equipment or not;

when the type information is the slave control equipment, determining that the equipment information meets a preset condition;

when the device information meets the preset condition, processing the voice information based on a local voice library to obtain a control instruction corresponding to the voice information, including:

when the equipment information meets the preset condition, acquiring the current network state of the master control equipment;

and when the current network state of the master control equipment is in a congestion state, the slave control equipment processes the voice information based on a local voice library to obtain a control instruction corresponding to the voice information.

5. The method according to any one of claims 1 to 4, wherein the smart home control panel comprises a first smart home control panel and a second smart home control panel, and the processing the voice information based on the local voice library to obtain the control instruction corresponding to the voice information comprises:

when the voice information comprises first voice information and second voice information, calculating the similarity of the first voice information and the second voice information, wherein the first intelligent home control panel detects the first voice information, and the second intelligent home control panel detects the second voice information;

and when the similarity is smaller than a similarity threshold value, the first voice information is processed by the first intelligent home control panel based on a local voice library, and the second voice information is processed by the second intelligent home control panel based on the local voice library.

6. The method of claim 5, further comprising:

when the similarity is larger than or equal to the similarity threshold, a target intelligent home control panel processes target voice information based on a local voice library to obtain a control instruction corresponding to the target voice information, wherein the target intelligent home control panel is the first intelligent home control panel or the second intelligent home control panel, and the target voice information is the first voice information or the second voice information.

7. The method according to any one of claims 1 to 4, wherein the smart home control panel comprises a first smart home control panel and a second smart home control panel, and the processing the voice information based on the local voice library to obtain the control instruction corresponding to the voice information comprises:

acquiring the time when the first intelligent household control panel and the second intelligent household control panel detect the voice information;

when the time when the first intelligent home control panel detects the voice information is earlier than the time when the second intelligent home control panel detects the voice information, the first intelligent home control panel processes the voice information based on a local voice library;

and when the time when the second intelligent home control panel detects the voice information is earlier than the time when the first intelligent home control panel detects the voice information, the second intelligent home control panel processes the voice information based on a local voice library.

8. The utility model provides a controlling means of intelligent household equipment, its characterized in that is applied to intelligent household control panel, intelligent household control panel is used for being connected with intelligent household equipment, and right the operating condition of intelligent household equipment controls, the device includes:

the device information acquisition module is used for acquiring the device information of the intelligent home control panel which detects the voice information when the voice information is detected;

the device information judging module is used for judging whether the device information meets a preset condition or not;

the voice information processing module is used for processing the voice information based on a local voice library to obtain a control instruction corresponding to the voice information when the equipment information meets the preset condition;

and the equipment control module is used for controlling the working state of the intelligent household equipment based on the control instruction.

9. An electronic device comprising a memory and a processor, the memory coupled to the processor, the memory storing instructions that, when executed by the processor, the processor performs the method of any of claims 1-7.

10. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 7.