CN113763691A

CN113763691A - Control method, control device, control system and storage medium

Info

Publication number: CN113763691A
Application number: CN202011288037.0A
Authority: CN
Inventors: 李志伟
Original assignee: Beijing Jingdong Century Trading Co Ltd; Beijing Wodong Tianjun Information Technology Co Ltd
Current assignee: Beijing Jingdong Century Trading Co Ltd; Beijing Wodong Tianjun Information Technology Co Ltd
Priority date: 2020-11-17
Filing date: 2020-11-17
Publication date: 2021-12-07

Abstract

The embodiment of the invention provides a control method, a control device, a control system and a storage medium. The control device includes: the device comprises a shell, a user input assembly, a remote control signal assembly, a processing unit, a wireless communication module and a device identification assembly, wherein the user input assembly is arranged on the shell and used for inputting a control instruction, the remote control signal assembly is arranged in the shell and used for transmitting or receiving control information, the processing unit is respectively and electrically connected with the user input assembly and the remote control signal assembly, the wireless communication module is electrically connected with the processing unit, the device identification assembly comprises a camera which is arranged at the front end of the shell, the camera is electrically connected with the processing unit, the camera is used for collecting image information of the equipment to be controlled, the processing unit is configured to acquire the equipment type of the equipment to be controlled according to the image information, and determining control information corresponding to the equipment type of the equipment to be controlled according to the corresponding relation between the pre-stored equipment type and the control information, and remotely controlling the equipment to be controlled according to the control information.

Description

Control method, control device, control system and storage medium

Technical Field

The present invention relates to the field of electronic technologies, and in particular, to a control method, apparatus, system, and storage medium.

Background

A remote controller is a device for remotely controlling an apparatus. At present, two common remote controllers are available, one is an infrared remote controller commonly used for household appliances, and the other is a remote controller controlled through networking. When the equipment to be controlled needs to be controlled, a user opens the corresponding application program to select the equipment to be controlled and sends an instruction to control the equipment to be controlled through the terminal equipment.

In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art: the infrared remote controller can only control one or one type of equipment, and when various types of equipment exist, a plurality of remote controllers are needed for controlling. Networking control can control multiple types of devices, but is complex for a user to operate.

Disclosure of Invention

The embodiment of the invention provides a control method, a control device, a control system and a storage medium, which are used for solving the problems of single type and complex operation of equipment which can be remotely controlled by the existing remote controller.

In a first aspect, an embodiment of the present invention provides a control apparatus, including:

the shell surrounds a hollow accommodating cavity;

the user input assembly is arranged on the shell and used for inputting a control command;

the remote control signal assembly is arranged in the shell and used for transmitting or receiving control information;

the processing unit is electrically connected with the user input assembly and the remote control signal assembly respectively;

the wireless communication module is electrically connected with the processing unit; and

the equipment identification assembly comprises a camera, the camera is arranged at the front end of the shell and is electrically connected with the processing unit, and the camera is used for responding to the operation of a user to receive a first control instruction and acquiring the image information of the equipment to be controlled according to the first control instruction;

the processing unit is configured to:

acquiring the equipment type of the equipment to be controlled according to the image information;

determining control information corresponding to the equipment type of the equipment to be controlled according to a pre-stored corresponding relation between the equipment type and the control information;

and remotely controlling the equipment to be controlled according to the control information.

Optionally, the device identification assembly further includes a spotlight disposed at the front end of the housing for indicating a shooting identification area of the camera.

Optionally, the irradiation range of the spotlight at least partially coincides with the shooting range of the camera.

One embodiment of the above invention has the following advantages or benefits: through setting up the spotlight, can be convenient for shoot treating controlgear under the poor scene of light, the irradiation range of spotlight and the at least partial coincidence of shooting range of camera to can instruct the shooting identification area of camera, make the image information of treating controlgear who shoots more accurate.

Optionally, the remote control signal assembly includes an infrared transmitting unit and an infrared receiving unit.

One embodiment of the above invention has the following advantages or benefits: through setting up infrared receiving unit, infrared receiving unit can receive the infrared signal of treating the remote controller transmission of controlgear to the corresponding relation of the equipment type of infrared signal and controlgear of storage, in order to treat controlgear according to infrared signal remote control.

Optionally, the user input assembly comprises a plurality of keys.

Optionally, the user input assembly further comprises a display screen.

Optionally, the control information includes an infrared signal;

the user input component is particularly configured to respond to the operation of a user to receive a second control instruction;

the remote control signal assembly is specifically configured to send the infrared signal to the device to be controlled according to the second control instruction, so as to remotely control the device to be controlled.

Optionally, the control information includes identification information of the device to be controlled;

the user input component is specifically configured to respond to a user operation to receive a third control instruction;

the processing unit is configured to:

and sending a first control message to a server according to the third control instruction, wherein the first control message comprises the identification information, and the first control message is used for indicating the server to send a second control message to the device to be controlled so as to remotely control the device to be controlled.

Optionally, the processing unit is specifically configured to:

receiving an infrared signal which is sent by remote control equipment and used for controlling equipment to be controlled;

sending the infrared signal to a server, wherein the infrared signal is used for indicating the server to search for the equipment type corresponding to the infrared signal;

and receiving the infrared signal sent by the server and the equipment type corresponding to the infrared signal, and storing the corresponding relation between the infrared signal and the equipment type.

One embodiment of the above invention has the following advantages or benefits: when the device to be controlled is an infrared device, the infrared signal which is sent by the remote control device and used for controlling the device to be controlled is received through the processing unit, the infrared signal is sent to the server, the server searches the device type corresponding to the infrared signal and then sends the device type to be controlled to the device to be controlled, therefore, the control device can obtain the corresponding relation between the infrared signal of the device to be controlled and the device type of the device to be controlled, and stores the corresponding relation between the infrared signal of the device to be controlled and the device type of the device to be controlled, and therefore remote control over the device to be controlled is facilitated.

Optionally, the processing unit is specifically configured to:

acquiring a first device type and first identification information of the device to be controlled;

sending the first equipment type and the first identification information to a server;

receiving a confirmation message sent by the server, wherein the confirmation message is used for indicating that a second device type and second identification information which are received by the server and sent by the device to be controlled are the same as the first device type and the first identification information respectively;

and storing the corresponding relation between the first equipment type and the first identification information.

One embodiment of the above invention has the following advantages or benefits: when the device to be controlled is a networked device, the control device may acquire the correspondence between the identification information of the device to be controlled and the device type of the device to be controlled, and store the correspondence between the identification information of the device to be controlled and the device type of the device to be controlled, thereby facilitating remote control of the device to be controlled.

Optionally, the processing unit is specifically configured to:

sending the image information to a server, wherein the server stores the corresponding relation between the image information of the equipment to be controlled and the equipment type of the equipment to be controlled;

and receiving the equipment type of the equipment to be controlled sent by the server.

In a second aspect, an embodiment of the present invention provides a control system, including a server and the control device as described in the first aspect and each possible manner of the first aspect, where the server has a wireless communication module, and the server performs data transmission through the wireless communication module and the control device.

In a third aspect, an embodiment of the present invention provides a control method, which is applied to the control device described in the first aspect and each possible manner of the first aspect, where the method includes:

receiving a first control instruction;

acquiring image information of equipment to be controlled according to the first control instruction;

Optionally, the control information includes an infrared signal;

the remote control of the device to be controlled according to the control information includes:

receiving a second control instruction;

and sending the infrared signal to the equipment to be controlled according to the second control instruction so as to remotely control the equipment to be controlled.

receiving a third control instruction;

Optionally, the method further includes:

One embodiment of the above invention has the following advantages or benefits: when the device to be controlled is an infrared device, the infrared signal which is sent by the remote control device and used for controlling the device to be controlled is received, the infrared signal is sent to the server, the server finds the device type corresponding to the infrared signal and then sends the device type to be controlled, therefore, the control device can obtain the corresponding relation between the infrared signal of the device to be controlled and the device type of the device to be controlled, and stores the corresponding relation between the infrared signal of the device to be controlled and the device type of the device to be controlled, and therefore remote control of the device to be controlled is facilitated.

Optionally, the method further includes:

One embodiment of the above invention has the following advantages or benefits: when the device to be controlled is a networking device, the corresponding relationship between the identification information of the device to be controlled and the device type of the device to be controlled can be acquired, and the corresponding relationship between the identification information of the device to be controlled and the device type of the device to be controlled is stored, so that the device to be controlled can be remotely controlled conveniently.

Optionally, the obtaining the device type of the device to be controlled according to the image information includes:

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where computer-executable instructions are stored, and when the computer-executable instructions are executed by a processor, the computer-readable storage medium is configured to implement the control method according to each possible implementation manner of the third aspect and the third aspect.

The control method, the device, the system and the storage medium provided by the embodiment of the invention are characterized in that an equipment identification component, a remote control signal component, a wireless communication module and a processing unit are arranged, wherein the remote control signal component is used for transmitting or receiving control information, the equipment identification component comprises a camera which is used for responding to the operation of a user so as to receive a first control instruction and collect the image information of equipment to be controlled according to the first control instruction, the processing unit obtains the equipment type of the equipment to be controlled according to the image information of the equipment to be controlled, then determines the control information corresponding to the equipment type of the equipment to be controlled according to the corresponding relation between the equipment type and the control information which are stored in advance, and finally remotely controls the equipment to be controlled according to the control information. Therefore, the device type of the device to be controlled can be identified through the image information of the device to be controlled, which is shot by the camera on the control device, and then the device to be controlled is remotely controlled according to the control information corresponding to the device type, so that various types of devices can be remotely controlled, the operation is simple, and the user experience is improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a schematic view of an application scenario of a control device according to an embodiment of the present invention;

fig. 2 is a schematic view of an application scenario of the control device according to the embodiment of the present invention;

fig. 3 is a schematic structural diagram of a control device according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a control device according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a control system according to an embodiment of the present invention;

fig. 6 is a schematic flowchart of a control method according to an embodiment of the present invention;

fig. 7 is a schematic flowchart illustrating a control device connecting to a server in a control method according to an embodiment of the present invention;

fig. 8 is a schematic flowchart of a control apparatus binding an infrared device in a control method according to an embodiment of the present invention;

fig. 9 is a schematic flowchart of a control apparatus binding a networking device in a control method according to an embodiment of the present invention;

fig. 10 is an interaction flow diagram of a control method according to an embodiment of the present invention.

With the foregoing drawings in mind, certain embodiments of the disclosure have been shown and described in more detail below. These drawings and written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the concepts of the disclosure to those skilled in the art by reference to specific embodiments.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

The terms "first" and "second", and the like, in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and are not necessarily meant to define a particular order or sequence Unless otherwise indicated (Unless other indicated). It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

Before the technical solutions of the embodiments of the present invention are introduced, the problems existing in the prior art and the technical conception processes of the embodiments of the present invention are first described.

The existing remote controllers are of two types, one type is an infrared remote controller, an infrared transmitting module is arranged on the infrared remote controller, an infrared receiving module is arranged on the electronic equipment, the infrared remote controller transmits infrared signals to the electronic equipment to realize remote control of the electronic equipment, the infrared signals of different types of electronic equipment are different, the infrared remote controller can only control one or one type of electronic equipment, when various types of equipment exist, a plurality of remote controllers are needed to control, and the use is inconvenient for users. The other is networking control, an application program is installed on terminal equipment such as a mobile phone and a computer, the terminal equipment is used as a remote controller, when a user needs to control the equipment to be controlled, the user opens the corresponding application program to select the equipment to be controlled, and the terminal equipment sends an instruction to control the equipment to be controlled. Although the networking control can realize the remote control of various types of electronic equipment, the operation is complex and the user experience is not high. To solve the problem, embodiments of the present invention provide a control method and apparatus, a system, and a storage medium, in which a device identification component, a remote control signal component, a wireless communication module, and a processing unit are disposed on a control apparatus (which may be a remote controller), where the device identification component may include a camera, and the remote control signal component may include an infrared transmitting unit and an infrared receiving unit. If the device to be controlled is an infrared device, an infrared receiving unit arranged on the control device in the embodiment of the invention can acquire an infrared signal emitted by a remote controller for remotely controlling the device to be controlled, and store the corresponding relation between the device type of the device to be controlled and the infrared signal. When the remote control device is used by a user, the camera responds to the operation of the user to receive a control instruction, image information of the device to be controlled is acquired according to the control instruction, the processing unit acquires the device type of the device to be controlled according to the image information of the device to be controlled, and the infrared signal of the device to be controlled is determined according to the pre-stored corresponding relation between the device type and the infrared signal, so that the device to be controlled can be remotely controlled according to the infrared signal of the device to be controlled; if the device to be controlled is an electronic device capable of being networked, the control device in the embodiment of the invention can acquire the device type and the identification information of the device to be controlled through the wireless communication module, and store the corresponding relationship between the device type and the identification information of the device to be controlled, when the control device is used by a user, the camera responds to the operation of the user to receive a control instruction, and acquires the image information of the device to be controlled according to the control instruction, and the processing unit acquires the device type of the device to be controlled according to the image information of the device to be controlled, and determines the identification information of the device to be controlled according to the corresponding relationship between the pre-stored device type and the identification information, so that the device to be controlled can be remotely controlled according to the identification information of the device to be controlled. Therefore, the device type of the device to be controlled can be identified through the image information of the device to be controlled, which is shot by the camera on the control device, and then the device to be controlled is remotely controlled according to the control information (which is an infrared signal or identification information) corresponding to the device type, so that various types of devices can be remotely controlled, the operation is simple, and the user experience is improved.

Fig. 1 is a schematic view of an application scenario of a control device according to an embodiment of the present invention. As shown in fig. 1, the application scenario may include: at least one device to be controlled (three devices to be controlled, namely, a device 111 to be controlled, a device 112 to be controlled, and a device 113 to be controlled are shown in fig. 1), and a control apparatus 12, wherein, in particular, a user can operate the control apparatus 12 to realize remote control of the device to be controlled, and the control apparatus 12 is used for responding to the user operation to remotely control the device to be controlled. In this application scenario, the device to be controlled is an electronic device provided with an infrared receiving unit, such as a television, an air conditioner, and the like, and the control device 12 transmits an infrared signal to the device to be controlled, so as to remotely control the device to be controlled. In this embodiment, the control device 12 can remotely control a plurality of devices to be controlled of the same type or different types, such as a television or an air conditioner.

For example, fig. 2 is a schematic view of an application scenario of the control device according to the embodiment of the present invention. As shown in fig. 2, the application scenario may include: at least one device to be controlled (three devices to be controlled, which are a device to be controlled 111, a device to be controlled 112, and a device to be controlled 113, respectively), a control apparatus 12, and a network 13 are shown in fig. 1, where both the control apparatus 12 and the device to be controlled can access the network, and each device to be controlled can perform data transmission with the control apparatus 12 through the network 13. Specifically, the user can operate the control device 12 to realize remote control of the device to be controlled, and the control device 12 is configured to remotely control the device to be controlled in response to the user operation. In this application scenario, the device to be controlled is an electronic device capable of being networked, that is, an electronic device having a wireless communication module, such as a smart television, a smart air conditioner, and a smart lamp. In this embodiment, the control device 12 may remotely control a plurality of devices to be controlled of the same type or different types, such as a smart tv or a smart air conditioner.

The following describes the technical solutions of the present invention and how to solve the above technical problems with specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present invention will be described below with reference to the accompanying drawings.

Fig. 3 is a schematic structural diagram of a control device according to an embodiment of the present invention, and as shown in fig. 3, the control device according to the embodiment may include: a housing 2, a user input assembly 3, a remote control signal assembly 4, a processing unit, a wireless communication module and a device identification assembly 5.

Wherein, casing 2 encloses into hollow holding chamber, and user input component 3 sets up on casing 2 for input control command, and remote control signal subassembly 4 sets up in casing 2 for the transmission or receive control information. The processing unit is respectively electrically connected with the user input assembly 3 and the remote control signal assembly 4, the wireless communication module is electrically connected with the processing unit, the equipment identification assembly 5 comprises a camera, the camera is arranged at the front end of the shell and electrically connected with the processing unit, the camera is used for responding to the operation of a user so as to receive a first control instruction, and image information of the equipment to be controlled is collected according to the first control instruction, for example, a picture of the equipment to be controlled is shot by the camera, and the picture of the equipment to be controlled is the image information of the equipment to be controlled.

Further, the remote control signal assembly 4 may include an infrared transmitting unit and an infrared receiving unit, the infrared receiving unit is configured to receive an infrared signal transmitted by a remote controller of the device to be controlled and store a corresponding relationship between the infrared signal and a device type of the device to be controlled, and the infrared transmitting unit is configured to transmit an infrared signal corresponding to the device type of the device to be controlled to the device to be controlled when the device to be controlled is remotely controlled.

Optionally, the user input component 3 may include a plurality of keys, for example, as shown in fig. 3, the user input component 3 may include a control key 31 and a squared figure keyboard 32, the control key 31 may include commonly used control keys, for example, a menu key, a return key, an on-off key, a mode key, a wind direction key, an up-down switching key, a left-right switching key, an identification key, and the like, and the identification key is used for turning on a shooting function to shoot a picture of the device to be controlled to identify the type of the device to be controlled. The nine-grid keyboard 32 can input alphabets and symbols and can support chinese/english. Optionally, the control key 31 may be a key set on a remote controller of an existing electronic device provided with an infrared receiving unit, for example, the control key may include a control key of a television remote controller and a control key of an air conditioner remote controller, the same keys of the television remote controller and the air conditioner remote controller may be shared, for example, an up-down switching key and a left-right switching key, when the control device identifies a device type of a device to be controlled, the device type here is, for example, a television, an air conditioner, a lamp, and the like, the control device lights the key corresponding to the device to be controlled, for example, if the device to be controlled is a lamp, only the on-off key needs to be turned on.

In an implementable manner, the device recognition assembly 5 may further comprise a spotlight provided at the front end of the housing 2 for indicating the shooting recognition area of the camera. Through setting up the spotlight, on the one hand, can be convenient for shoot treating controlgear under the poor scene of light, optional, the irradiation range of spotlight and the shooting scope at least part coincidence of camera to can instruct the shooting identification area of camera, make the image information of the treating controlgear who shoots more accurate.

In an implementable manner, the user input assembly 3 may further include a display screen, fig. 4 is a schematic structural diagram of a control device provided in the embodiment of the present invention, as shown in fig. 4, the user input assembly 3 further includes a display screen 33, the display screen 33 may be disposed at a front end of the control device, so as to be convenient for a user to view, for example, as shown in fig. 4, the display screen 33 may be disposed above the control keys, and it is understood that the positions of the display screen 33, the control keys, and the nine-grid keyboard are not limited to the positions shown in fig. 4, and may be set according to considerations of convenience and practicability.

Specifically, the display screen can be used for displaying image information acquired by the camera so as to facilitate corresponding adjustment when a user takes a picture, and can also display remote control information of the device to be controlled, for example, when the air conditioner is remotely controlled, information such as temperature, wind direction and mode is displayed.

Optionally, a key may be further disposed on the display screen, where the key may be an entity key or a touch key, and the key is used to facilitate a user to switch the same type of device at different positions, for example, the device to be controlled is a lamp, and the device has different positions such as a main bed, a sub bed, a living room or a kitchen. As an implementable manner, as shown in fig. 4, 4 keys 331 are provided on the display screen, and it is understood that the number of keys is not limited, and 1 key may be provided.

In the control apparatus shown in fig. 3 and 4, wherein the processing unit is configured to: and obtaining the equipment type of the equipment to be controlled according to the image information, determining control information corresponding to the equipment type of the equipment to be controlled according to the corresponding relation between the equipment type and the control information which are stored in advance, and remotely controlling the equipment to be controlled according to the control information.

The process of the control device of this embodiment for remotely controlling the device to be controlled specifically includes: the camera responds to the operation of a user, for example, the user presses an identification key, the camera responds to the operation to receive a first control instruction, and image information of the equipment to be controlled is collected according to the first control instruction. And then the processing unit acquires the equipment type of the equipment to be controlled according to the image information of the equipment to be controlled, determines control information corresponding to the equipment type of the equipment to be controlled according to the corresponding relation between the equipment type and the control information which are stored in advance, and finally remotely controls the equipment to be controlled according to the control information.

Specifically, the processing unit obtains the device type of the device to be controlled according to the image information of the device to be controlled, and as an implementable manner, the processing unit may send the image information of the device to be controlled to the server, store a correspondence between the image information of the device to be controlled and the device type of the device to be controlled in the server, determine the device type of the device to be controlled from the correspondence according to the image information of the device to be controlled by the server, and then send the device type to the control apparatus, where the control apparatus receives the device type of the device to be controlled sent by the server.

The device to be controlled may be an infrared device or a device that can be networked, and accordingly, the control information may be an infrared signal or identification information of the device to be controlled, the control information corresponding to the infrared device may be an infrared signal, and the control information corresponding to the device to be networked may be identification information of the device to be controlled. If the control information comprises an infrared signal, the user input assembly 3 is specifically configured to receive a second control instruction in response to a user operation.

The remote control signal assembly 4 is specifically configured to send an infrared signal to the device to be controlled according to the second control instruction, so as to remotely control the device to be controlled.

For the control apparatus, before remotely controlling the device to be controlled, the corresponding relationship between the infrared signal and the device type needs to be prestored, so as to facilitate remote control, and accordingly, the processing unit is specifically configured to:

and receiving an infrared signal which is sent by the remote control equipment and used for controlling the equipment to be controlled.

And sending the infrared signal to a server, wherein the infrared signal is used for indicating the server to search the equipment type corresponding to the infrared signal.

The user input component 3 is specifically configured to receive a third control instruction in response to a user operation if the control information includes identification information of the device to be controlled. Accordingly, the processing unit is configured to:

and sending a first control message to the server according to the third control instruction, wherein the first control message comprises the identification information of the equipment to be controlled, and the first control message is used for indicating the server to send a second control message to the equipment to be controlled so as to remotely control the equipment to be controlled.

For the control apparatus, before remotely controlling the device to be controlled, first, a corresponding relationship between the identification information of the device to be controlled and the device type of the device to be controlled needs to be prestored, so as to facilitate remote control, and accordingly, the processing unit is specifically configured to: the method comprises the steps of receiving an infrared signal which is sent by a remote control device and used for controlling a device to be controlled, then sending the infrared signal to a server, wherein the infrared signal is used for indicating the server to search for a device type corresponding to the infrared signal, then receiving the infrared signal sent by the server and the device type corresponding to the infrared signal, and storing the corresponding relation between the infrared signal and the device type. Wherein, the remote control equipment can be an infrared remote controller.

If the device to be controlled is an infrared device, an infrared receiving unit arranged on the control apparatus in this embodiment may acquire an infrared signal emitted by a remote controller for remotely controlling the device to be controlled, and store a correspondence between a device type of the device to be controlled and the infrared signal. When the remote control device is used by a user, the camera responds to the operation of the user to receive the control instruction, the image information of the device to be controlled is acquired according to the control instruction, the processing unit acquires the device type of the device to be controlled according to the image information of the device to be controlled, the infrared signal of the device to be controlled is determined according to the pre-stored corresponding relation between the device type and the infrared signal, and therefore the device to be controlled can be remotely controlled according to the infrared signal of the device to be controlled.

If the device to be controlled is an electronic device capable of being networked, the control apparatus in this embodiment may obtain the device type and the identification information of the device to be controlled through the wireless communication module, and store the correspondence between the device type and the identification information of the device to be controlled. When the remote control device is used by a user, the camera responds to the operation of the user to receive the control instruction, the image information of the device to be controlled is acquired according to the control instruction, the processing unit acquires the device type of the device to be controlled according to the image information of the device to be controlled, and the identification information of the device to be controlled is determined according to the pre-stored corresponding relation between the device type and the identification information, so that the device to be controlled can be remotely controlled according to the identification information of the device to be controlled. Therefore, the device type of the device to be controlled can be identified through the image information of the device to be controlled, which is shot by the camera on the control device, and then the device to be controlled is remotely controlled according to the control information (which is an infrared signal or identification information) corresponding to the device type, so that various types of devices can be remotely controlled, the operation is simple, and the user experience is improved.

The control device provided by this embodiment is provided with an equipment identification component, a remote control signal component, a wireless communication module and a processing unit, wherein the remote control signal component is used for transmitting or receiving control information, the equipment identification component comprises a camera, the camera is used for responding to the operation of a user to receive a first control instruction, and acquires image information of equipment to be controlled according to the first control instruction, the processing unit acquires the equipment type of the equipment to be controlled according to the image information of the equipment to be controlled, and then determines control information corresponding to the equipment type of the equipment to be controlled according to a pre-stored correspondence between the equipment type and the control information, and finally remotely controls the equipment to be controlled according to the control information. Therefore, the device type of the device to be controlled can be identified through the image information of the device to be controlled, which is shot by the camera on the control device, and then the device to be controlled is remotely controlled according to the control information corresponding to the device type, so that various types of devices can be remotely controlled, the operation is simple, and the user experience is improved.

Fig. 5 is a schematic structural diagram of a control system according to an embodiment of the present invention, and as shown in fig. 5, the control system according to this embodiment may include a server 21 and a control device 12, where the control device 12 may be the control device in the above embodiment shown in fig. 3 or fig. 4, the server 21 has a wireless communication module, and the server 21 performs data transmission with the control device 12 through the wireless communication module.

The embodiment of the present invention further provides a control method, which is applied to the control device in the above embodiment shown in fig. 3 or fig. 4, and the following describes in detail a control process of the control device provided in the embodiment of the present invention with reference to the drawings.

Fig. 6 is a flowchart illustrating a control method according to an embodiment of the present invention, and as shown in fig. 6, an execution main body of the embodiment may be the control device in the foregoing embodiment, and the method of the embodiment may include:

s101, receiving a first control instruction.

S102, acquiring image information of the equipment to be controlled according to the first control instruction.

Specifically, in response to a user operation, a first control instruction is received, and a camera on the control device collects image information of the device to be controlled, for example, a picture of the device to be controlled is obtained by taking a picture through the camera.

S103, acquiring the device type of the device to be controlled according to the image information.

Specifically, the device type may include, for example, a television, an air conditioner, a lamp, a washing machine, and other household appliances, and may also be other electronic devices such as a computer, and the device type of the device to be controlled is obtained according to the image information, and the corresponding device type may be found according to the image information according to a correspondence between pre-stored image information of the device to be controlled and the device type of the device to be controlled. The obtaining from the server may specifically include:

and S1031, sending the image information to a server, wherein the server stores the corresponding relation between the image information of the equipment to be controlled and the equipment type of the equipment to be controlled.

Specifically, after receiving the image information, the server finds the corresponding device type according to the stored correspondence between the image information of the device to be controlled and the device type of the device to be controlled.

S1032, receiving the device type of the device to be controlled sent by the server.

And S104, determining control information corresponding to the equipment type of the equipment to be controlled according to the corresponding relation between the equipment type and the control information which are stored in advance.

Specifically, after the device type of the device to be controlled is acquired according to the image information, optionally, a key corresponding to the device type may be turned on, and the user is prompted to use the turned-on key to remotely control the device to be controlled. The correspondence between the device type and the control information may be pre-stored, and after the device type of the device to be controlled is acquired according to the image information, the control information corresponding to the device type of the device to be controlled may be determined according to the correspondence between the device type and the control information. The control information is information for remotely controlling the device to be controlled, the device to be controlled may be an infrared device or a device capable of being networked (hereinafter referred to as a networked device), and accordingly, the control information may include an infrared signal or identification information of the device to be controlled, and the infrared signal may be an infrared signal emitted by a remote controller for remotely controlling the device to be controlled. The identification information of the Control device may be, for example, a Media Access Control (MAC) Address of the Control device.

And S105, remotely controlling the equipment to be controlled according to the control information.

Specifically, as an implementable manner, if the control information includes an infrared signal, S105 may include:

and S1051, receiving a third control command.

Specifically, the user may use a key on the control device to remotely control the device to be controlled, the user presses a corresponding key, such as an on-off key, and the control device receives a third control instruction in response to the user operation.

And S1052, sending an infrared signal to the device to be controlled according to the third control instruction so as to remotely control the device to be controlled.

Specifically, the control device sends an infrared signal to the device to be controlled according to the third control instruction, so as to remotely control the device to be controlled, such as controlling the on/off of the device, adjusting the volume, adjusting the temperature, and the like.

For the control apparatus, before remotely controlling the device to be controlled, the corresponding relationship between the infrared signal and the device type needs to be prestored, which is convenient for remote control, and accordingly, the method of this embodiment may further include:

and S106, receiving an infrared signal which is sent by the remote control equipment and used for controlling the equipment to be controlled.

Specifically, the remote control device may be an infrared remote controller, for example, the remote control device may transmit an infrared signal by pressing a key against the control device in this embodiment, and the control device in this embodiment receives an infrared signal sent by the remote control device and used for controlling the device to be controlled.

And S107, sending the infrared signal to a server, wherein the infrared signal is used for indicating the server to search the equipment type corresponding to the infrared signal.

Specifically, the server stores a correspondence between the device type and the infrared signal, for example, a television: infrared signal 1, air conditioner: infrared signal 2. The server receives the infrared signal, can search for the equipment type corresponding to the infrared signal, and then sends the searched equipment type and the infrared signal to the control device. Optionally, brands of the devices may be distinguished, for example, there are multiple brands of the television, and corresponding infrared signals may be prestored according to different brands.

And S108, receiving the infrared signal sent by the server and the equipment type corresponding to the infrared signal, and storing the corresponding relation between the infrared signal and the equipment type.

In this embodiment, when the device to be controlled is an infrared device, through S106 to S108, the control apparatus may acquire the correspondence between the infrared signal of the device to be controlled and the device type of the device to be controlled, and store the correspondence between the infrared signal of the device to be controlled and the device type of the device to be controlled, thereby facilitating remote control of the device to be controlled.

Specifically, as another implementable manner, if the control information includes identification information of the device to be controlled, S105 may include:

s1051', a third control command is received.

And S1052' sending a first control message to the server according to the third control instruction, where the first control message includes identification information of the device to be controlled, and the first control message is used to instruct the server to send a second control message to the device to be controlled, so as to remotely control the device to be controlled.

Specifically, the user may use a key on the control device to remotely control the device to be controlled, the user presses a corresponding key, such as an on-off key, and the control device receives a third control instruction in response to the user operation. And the control device sends a first control message to the server according to the third control instruction, wherein the first control message comprises the identification information of the equipment to be controlled, and the server sends a second control message to the corresponding equipment to be controlled according to the identification information of the equipment to be controlled after receiving the first control message, so that the equipment to be controlled is remotely controlled.

s106', the first device type and the first identification information of the device to be controlled are obtained.

S107', the first device type and the first identification information are sent to a server.

S108', receiving a confirmation message sent by the server, wherein the confirmation message is used for indicating that the second device type and the second identification information sent by the device to be controlled and received by the server are respectively the same as the first device type and the first identification information.

Specifically, the server determines that the second device type and the second identification information sent by the device to be controlled are the same as the first device type and the first identification information, respectively, stores the correspondence between the device type and the identification information of the device to be controlled, and sends a confirmation message to the control apparatus.

S109', the corresponding relation between the first device type and the first identification information is saved.

And after receiving the confirmation message, the control device stores the corresponding relation between the first equipment type of the equipment to be controlled and the first identification information.

In this embodiment, when the device to be controlled is a networked device, the control device may obtain the correspondence between the identification information of the device to be controlled and the device type of the device to be controlled through S106 'to S109', and store the correspondence between the identification information of the device to be controlled and the device type of the device to be controlled, thereby facilitating remote control of the device to be controlled.

Further, after S108 or S109', the method of this embodiment may further include:

the method comprises the steps of collecting image information of equipment to be controlled, sending the image information of the equipment to be controlled to a server, storing the corresponding relation between the image information of the equipment to be controlled and the equipment type of the equipment to be controlled by the server, and storing the corresponding relation between the image information of the equipment to be controlled, the control information of the equipment to be controlled and the equipment type of the equipment to be controlled by the server. And determining the equipment type of the equipment to be controlled according to the stored corresponding relation after receiving the image information of the equipment to be controlled.

In the control method provided in this embodiment, the control device receives the first control instruction, acquires image information of the device to be controlled according to the first control instruction, then acquires the device type of the device to be controlled according to the image information, determines control information corresponding to the device type of the device to be controlled according to a correspondence between a pre-stored device type and the control information, and finally remotely controls the device to be controlled according to the control information. Therefore, the device type of the device to be controlled is identified through the image information of the device to be controlled, which is shot by the camera on the control device, the device to be controlled is remotely controlled according to the control information corresponding to the device type, various devices can be remotely controlled, infrared devices can be controlled, networking devices can be controlled, the operation is simple, a user only needs to shoot the device to be controlled, the device to be controlled can be remotely controlled, and the user experience is improved.

The control method shown in fig. 6 will be described in detail below using two specific examples.

First, a new user needs to connect to a network and then connect to a server before using the control device provided in the embodiment of the present invention, specifically, as shown in fig. 7, a flowchart illustrating a process of connecting the control device to the server in the control method provided in the embodiment of the present invention is shown, and as shown in fig. 7, the method in this embodiment may include:

s201, the control device is connected with the router.

Specifically, the control device may send the connection request by inputting a route name and a password through the user input component, and connecting the router, wherein the route name is, for example, a wifi account.

S202, the control device is connected with the server.

Specifically, the user registers a new user through the control device, and sends a connection request to the server, where the connection request includes user registration information, such as a mobile phone number, and after receiving the connection request, the server sends a response message to the control device, where the response message may include, for example, an authentication code, and the authentication code may also be sent to a terminal device corresponding to the mobile phone number, and the user inputs the authentication code through the control device, and connects to the server, and the server may send the response message again.

Then, the control device adds and binds the device to be controlled. Infrared equipment, networking equipment and the like are added on the control device, the control device can be remotely controlled only by establishing a binding relationship with a user, and each equipment to be controlled is added only once and can be directly controlled during subsequent use. It can be understood that networking equipment such as smart homes needs to be configured with a network and connected with a router before use. Next, a process of binding the infrared device and the networking device by the control apparatus is respectively described with reference to fig. 8 and fig. 9, where fig. 8 is a schematic flow diagram of binding the infrared device by the control apparatus in the control method according to the embodiment of the present invention, as shown in fig. 8, the method according to the embodiment may include:

and S301, the infrared remote controller sends an infrared signal to the control device.

Specifically, the user may operate the control device to add the device, may select the device type of the device to be controlled and select the intelligent learning, or may directly select the intelligent learning, and the device type is selected first and then the intelligent learning is performed, so that the method is more targeted and has higher accuracy. The infrared remote control may be a remote control of the device to be controlled.

S302, the control device receives the infrared signal sent by the infrared remote controller and sends the infrared signal to the server.

Specifically, the infrared signal sent by the infrared remote controller is the infrared signal for controlling the device to be controlled.

S303, the server searches for the equipment type corresponding to the received infrared signal according to the corresponding relation between the pre-stored infrared signal and the equipment type, and sends the determined infrared signal and the equipment type to the control device.

Specifically, the server may pre-store infrared signals corresponding to various types of devices, and may also distinguish brands of the devices, for example, a television has multiple brands, and may pre-store corresponding infrared signals according to different brands.

S304, the control device receives the infrared signals sent by the server and the equipment types corresponding to the infrared signals, and stores the corresponding relation between the infrared signals and the equipment types.

Optionally, after the control device receives the infrared signal sent by the server and the device type corresponding to the infrared signal, the user may try to control the infrared device through the control device, receive a message that whether the user confirms successful control, send a binding request to the server if the message that the user confirms successful control is received, and send a response message to the control device by the server to indicate that the binding is successful.

S305, the control device receives a second control instruction, acquires image information of the equipment to be controlled according to the second control instruction, and sends the image information of the equipment to be controlled to the server.

It is understood that the device to be controlled here is an infrared device remotely controlled by an infrared remote controller.

S306, the server stores the device type of the device to be controlled, the image information of the device to be controlled and the corresponding relation of the infrared signal of the device to be controlled.

Optionally, after receiving the image information of the device to be controlled, the server may further send a response message to the control apparatus to indicate whether the image information is successfully uploaded.

Through the above S301-S306, the infrared device is bound, the control device may obtain a correspondence between the infrared signal of the device to be controlled and the device type of the device to be controlled, and store a correspondence between the infrared signal of the device to be controlled and the device type of the device to be controlled, and the server stores a correspondence between the image information of the device to be controlled, the control information of the device to be controlled, and the device type of the device to be controlled, so that after the image information of the device to be controlled is received, the device type of the device to be controlled is determined according to the stored correspondence, thereby facilitating remote control of the device to be controlled.

Fig. 9 is a schematic flowchart of a control apparatus binding a networked device in a control method provided in an embodiment of the present invention, and as shown in fig. 9, a device to be controlled in the embodiment is a networked device, and the method in this embodiment may include:

s401, the control device obtains a first device type and first identification information of the device to be controlled.

Wherein the first identification information may be a MAC address. If the first identification information is an MAC address, specifically, the first identification information may be a device added by the user operating the control device, the setting type and the MAC address of the device to be controlled may be obtained by scanning a two-dimensional code of the device to be controlled, the MAC address of the networked device may be obtained by distributing a network for the device to be controlled, or the MAC address of the networked device may be obtained by sending a request to the device to be controlled by the control device after the device to be controlled is networked. The process of distributing the network for the equipment to be controlled can be as follows: the control device sends the wifi account and the password connected with the control device to the equipment to be controlled, the equipment to be controlled is connected with the router according to the wifi account and the password, and sends the MAC address of the equipment to be controlled to the control device.

S402, the control device sends the first equipment type and the first identification information to a server.

And S403, the device to be controlled sends the second device type and the second identification information of the device to be controlled to the server.

Specifically, the device to be controlled may send a connection request to the server, where the connection request may carry the second device type and the second identification information of the device to be controlled.

S404, the server confirms that the received second equipment type and the second identification information sent by the equipment to be controlled are the same as the first equipment type and the first identification information respectively, and stores the corresponding relation between the first equipment type and the first identification information of the equipment to be controlled.

Specifically, it can be understood that the server stores a correspondence between a device type of the device to be controlled and the identification information, where the first device type is the device type of the device to be controlled, and the first identification information is the identification information of the device to be controlled.

S405, the server sends the device type and the identification information of the device to be controlled to the control device.

S406, the control device stores the corresponding relation between the equipment type and the identification information of the equipment to be controlled.

S407, the control device receives the second control instruction, acquires the image information of the equipment to be controlled according to the second control instruction, and sends the image information of the equipment to be controlled to the server.

It is understood that the device to be controlled is a networked device.

S408, the server stores the corresponding relation among the equipment type of the equipment to be controlled, the image information of the equipment to be controlled and the identification information of the equipment to be controlled.

Through the above S401-S408, the binding of the networked devices is completed, and the server stores the image information of the device to be controlled, the control information of the device to be controlled, and the correspondence between the device types of the device to be controlled, so that after the image information of the device to be controlled is received, the device type of the device to be controlled is determined according to the stored correspondence, and the device to be controlled is conveniently remotely controlled.

In the using process, a control device may be added with a plurality of infrared devices and networking devices, in order to enable fast and intelligent switching, the control device provided in the embodiment of the present invention may take a picture through a camera, and upload the taken picture information to a server for intelligent identification, where the server stores a correspondence between the picture information of a device to be controlled and the device type of the device to be controlled, the server performs comparison identification according to the received picture information and the stored picture information, and then sends the identified device type to the control device, and the control device lights corresponding keys supporting control of the device type according to the device type, for example: the lamp may only have a switch function, and then the switch case is lighted, and only the key is controllable, so that the equipment to be controlled is more conveniently and remotely controlled.

After the binding of the equipment to be controlled is finished, the user can directly remotely control the bound equipment to be controlled through the control device. The process of the control device for remotely controlling the device to be controlled is described in detail below with reference to fig. 10.

Fig. 10 is an interaction flow diagram of a control method according to an embodiment of the present invention, and as shown in fig. 10, the method according to the embodiment may include:

s501, the control device receives a first control instruction and collects image information of the equipment to be controlled according to the first control instruction.

S502, the control device sends the image information of the equipment to be controlled to the server.

S503, the server searches the device type corresponding to the image information of the device to be controlled according to the stored corresponding relationship between the image information of the device to be controlled and the device type of the device to be controlled.

And S504, the server sends the device type of the device to be controlled to the control device.

And S505, the control device determines the control information corresponding to the equipment type of the equipment to be controlled according to the corresponding relation between the equipment type and the control information which are stored in advance.

Specifically, the device to be controlled may be an infrared device or a networked device, and the corresponding control information is an infrared signal or identification information of the device to be controlled.

After acquiring the device type of the device to be controlled according to the image information, the control device may light a key corresponding to the device type to prompt a user to use the lighted key to remotely control the device to be controlled, for example, if the device to be controlled is a lamp, a switch key is lighted; if the equipment to be controlled is a television, lightening keys required by the remote control television, such as an on-off key, a volume adjusting key, a channel switching key, a return key and the like; if the equipment to be controlled is an air conditioner, keys required by the remote control air conditioner are lightened, such as an on-off key, a mode switching key, a temperature adjusting key and the like.

And S506, the control device remotely controls the equipment to be controlled according to the control information.

Specifically, if the device to be controlled is an infrared device, S506 may specifically be:

and receiving a third control instruction, and sending an infrared signal to the equipment to be controlled according to the third control instruction so as to remotely control the equipment to be controlled.

If the device to be controlled is a networking device, S506 may specifically be:

and receiving a third control instruction, and sending a first control message to the server according to the third control instruction, wherein the first control message comprises identification information of the device to be controlled, and the first control message is used for indicating the server to send a second control message to the device to be controlled so as to remotely control the device to be controlled.

An embodiment of the present invention further provides a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when the computer-executable instructions are executed by a processor, the computer-executable instructions are used to implement the control method according to the embodiment shown in fig. 6.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A control device, comprising:

the shell surrounds a hollow accommodating cavity;

the processing unit is configured to:

2. The control device of claim 1, wherein the control information comprises an infrared signal;

3. The control apparatus according to claim 1, wherein the control information includes identification information of the device to be controlled;

the processing unit is configured to:

4. A control device according to any of claims 1-3, characterized in that the processing unit is specifically configured to:

5. A control system comprising a server and the control device of any one of claims 1 to 4, the server having a wireless communication module, and the server performing data transmission through the wireless communication module and the control device.

6. A control method, characterized by being applied to the control apparatus according to any one of claims 1 to 4, the method comprising:

receiving a first control instruction;

7. The method of claim 6, wherein the control information comprises an infrared signal;

receiving a second control instruction;

8. The method according to claim 6, wherein the control information includes identification information of the device to be controlled;

receiving a third control instruction;

9. The method according to any one of claims 6 to 8, wherein the obtaining the device type of the device to be controlled according to the image information comprises:

10. A computer-readable storage medium having computer-executable instructions stored thereon, which when executed by a processor, are configured to implement the control method of any one of claims 6 to 9.