CN103051693A

CN103051693A - Equipment control method and mobile communication terminal

Info

Publication number: CN103051693A
Application number: CN2012105371441A
Authority: CN
Inventors: 陈虞付; 李超; 刘晓健; 吴军
Original assignee: Beijing Qihoo Technology Co Ltd; Qizhi Software Beijing Co Ltd
Current assignee: Beijing Qihoo Technology Co Ltd; Qizhi Software Beijing Co Ltd
Priority date: 2012-12-12
Filing date: 2012-12-12
Publication date: 2013-04-17
Anticipated expiration: 2032-12-12
Also published as: CN103051693B; WO2014090016A1

Abstract

The invention provides an equipment control method and a mobile communication terminal, wherein the equipment control method comprises the steps that a mobile communication terminal receives a control operational order of controlling appointed equipment by a user through a set HTML (Hypertext Markup Language) webpage, wherein the HTML webpage is used for providing an interface of controlling the appointed equipment by the user through the mobile communication terminal, receiving the control operational order generated by operating the interface by the user, and sending the control operational order; and the mobile communication terminal sends the control operational order to the appointed equipment through the HTML webpage to ensure that the appointed equipment executes the control operation indicated by the control operational order. According to the invention, the remote control of the equipment is achieved, and the effect of user operation experience is improved.

Description

Device control method and mobile communication terminal

Technical Field

The present invention relates to the field of computer technologies, and in particular, to an apparatus control method and a mobile communication terminal.

Background

With the development of the internet, computers play an increasingly important role in the life of people, and people rely on computers more and more in life and work. In order to control a computer, the computer has input devices, such as a keyboard and a mouse, which are commonly used as input devices for operating the computer, wherein the keyboard is commonly used for inputting information, and the mouse is used for selecting or some common operations; another common input device is a computer operated using a keyboard, which is commonly used for information input, and a touch panel, which is used for selection or some common operations, and a touch panel, which is commonly used for portable computers.

However, when the first input device is used to control a computer, the keyboard and the mouse are physical media, occupy space and have requirements on placement positions, and the computer can only be operated in a short distance; when the second input device is used for controlling a computer, the keyboard and the touch panel are both arranged in the computer, the computer can be operated only in a short distance, and the operation limitation exists.

Similarly, in the internet of things, people usually need to use a special controller to control the internet of things equipment, and there is also a requirement for location, and the operation can be performed only in a short distance.

Therefore, the existing input equipment is used for controlling the computer or the internet of things equipment, various limitations exist, particularly, the user cannot control the computer or the internet of things equipment at a long distance, and the operation experience of the user on the computer or the internet of things equipment is reduced.

Disclosure of Invention

In view of the above-mentioned problem that the conventional input device cannot control a computer or an internet of things device at a long distance, and the operation experience of the user on the computer or the internet of things device is reduced, the present invention is provided to provide a device control method and a mobile communication terminal that overcome the above-mentioned problem or at least partially solve the above-mentioned problem.

According to an aspect of the present invention, there is provided an apparatus control method including: the mobile communication terminal receives a control operation instruction for a user to control and operate the specified equipment through a set HTML page, wherein the HTML page is used for providing an interface for the user to control and operate the specified equipment through the mobile communication terminal, receiving the control operation instruction generated by the user operating the interface, and sending the control operation instruction; and the mobile communication terminal sends the control operation instruction to the specified equipment through the HTML page, so that the specified equipment executes the control operation indicated by the control operation instruction.

According to another aspect of the present invention, there is provided a mobile communication terminal including: the receiving module is used for receiving a control operation instruction for controlling and operating the specified equipment by a user through a set HTML page, wherein the HTML page is used for providing an interface for controlling and operating the specified equipment by the user through the mobile communication terminal, receiving the control operation instruction generated by the user operating the interface, and sending the control operation instruction; and the control module is used for sending the control operation instruction to the specified equipment through the HTML page so that the specified equipment executes the control operation indicated by the control operation instruction.

According to the equipment control scheme, the mobile communication terminal receives the control operation of the user on the specified equipment through the HTML page, and sends a control operation instruction to the specified equipment, so that the specified equipment carries out corresponding control operation according to the control operation instruction. The HTML page is widely applied and supported by almost all operating systems, the operation control of the mobile communication terminal on the designated equipment is realized through the HTML page, special operation control software is not needed on the mobile communication terminal side and the designated equipment side, the operation is convenient, the realization is simple, the compatibility is good, and the realization cost is low. By the scheme of the invention, the operation of the appointed equipment (such as a PC or an Internet of things equipment) can be controlled by the mobile communication terminal at a long distance. The mobile communication terminal can replace the traditional input equipment, conveniently operate the equipment under the condition of being far away from the equipment, monitor the equipment in real time and comprehensively control the equipment, so that the problems that the existing input equipment cannot control the computer or the Internet of things equipment at a far distance by a user, the operation experience of the user on the computer or the Internet of things equipment is reduced, the remote control on the equipment is realized, and the effect of improving the operation experience of the user is achieved.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

fig. 1 is a flowchart illustrating steps of a method for controlling a device according to a first embodiment of the present invention;

fig. 2 is a flowchart of steps of a device control method according to a second embodiment of the present invention;

fig. 3 is a flowchart of the steps of a device control method according to a third embodiment of the present invention;

FIG. 4 is a schematic interface diagram of a touch panel HTML page in the embodiment of FIG. 3;

FIG. 5 is a schematic interface diagram of a shortcut HTML page in the embodiment of FIG. 3;

FIG. 6 is a schematic diagram of an interface for selecting a terminal HTML page in the embodiment shown in FIG. 3;

fig. 7 is a flowchart of the steps of a device control method according to a fourth embodiment of the present invention;

fig. 8 is a block diagram of a mobile communication terminal according to a fifth embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

Example one

Referring to fig. 1, a flowchart illustrating steps of a device control method according to a first embodiment of the present invention is shown.

The device control method of the embodiment includes the steps of:

step S102: the mobile communication terminal receives a control operation instruction of a user for performing control operation on a specified device through a set HTML page.

The HTML page is used for providing an interface for a user to control and operate the designated equipment through the mobile communication terminal, receiving a control operation instruction generated by the user operating the interface, and sending the control operation instruction.

Step S104: and the mobile communication terminal sends the control operation instruction to the specified equipment through the HTML page, so that the specified equipment executes the control operation indicated by the control operation instruction.

Through the embodiment, the mobile communication terminal receives the control operation of the user on the designated equipment through the HTML page, and sends the control operation instruction to the designated equipment, so that the designated equipment performs corresponding control operation according to the control operation instruction. The HTML page is widely applied and supported by almost all operating systems, the operation control of the mobile communication terminal on the designated equipment is realized through the HTML page, special operation control software is not needed on the mobile communication terminal side and the designated equipment side, the operation is convenient, the realization is simple, the compatibility is good, and the realization cost is low. By the scheme of the invention, the operation of the appointed equipment (such as a PC or an Internet of things equipment) can be controlled by the mobile communication terminal at a long distance. The mobile communication terminal of this embodiment can replace traditional input device, realized keeping away from convenient operating means under the condition of equipment to and in real time supervisory equipment, control equipment comprehensively, thereby solved current input device and can't realize that the user controls computer or thing networking equipment at long distance, reduced the problem that the user experienced the operation of computer or thing networking equipment, reached the remote control to equipment, promoted user operation experience's effect.

Example two

Referring to fig. 2, a flowchart illustrating steps of a device control method according to a second embodiment of the present invention is shown.

In this embodiment, the network control server is used to connect the mobile communication terminal and the specific device, and WebSocket connections are established between the mobile communication terminal and the network control server, and between the network control server and the specific device.

The WebSocket protocol is a new protocol of HTML5, and realizes full-duplex communication between a browser and a server. The WebSocket protocol is simple, the device and the server perform request handshake through an 80 or 443 port as a common browser, the server identifies whether the request is a WebSocket request according to HTTP HEADER, if so, the request is upgraded to a WebSocket connection, and the data transmission stage of the two-way long connection is started after the handshake is successful.

When using the WebSocket protocol, the specified device side may set the NPAPI. NPAPI (netscape Application Programming Interface) is a general-purpose Interface for executing an external Application in a browser. Each plug-in the netscape plug-in declares that the plug-in self supports one or more content types, when the browser encounters the content of the type, a plug-in capable of decoding is searched in a plug-in library, the part of the content is analyzed by the plug-in library, and the content is displayed in a position corresponding to a webpage. The NPAPI in the browser can call a corresponding API (application programming Interface) in the system to implement corresponding functions, such as shutdown, volume adjustment, mouse operation control, and the like. For example, the browser provides SetCursorPos, shutdowno, Snapshot, MouseDown, MouseUp, KeyDown, KeyUp and other interface functions to the javascript script in the extension program web page through an NPAPI mechanism (currently, the mechanism is applied to browsers of chrome, chrome open source project development-based browsers, firefox and the like), the javascript communicates with the server through websocket, and the javascript expanded through the NPAPI is called after receiving a control command, so that the functions of controlling the cursor position, simulating mouse click and keyboard pressing, computer Snapshot, computer Shutdown and the like are realized.

Based on the above arrangement, the device control method of the present embodiment includes the steps of:

step S202: the mobile communication terminal acquires information of at least one designated device to be controlled from the network control server.

The network control server can pre-store the information of one or more appointed devices to be controlled, and send the information of the appointed devices to be controlled to the mobile communication terminal when receiving the request of the mobile communication terminal; the network control server may also send information to the connected specified device when receiving a request from the mobile communication terminal, acquire information of one or more specified devices to be controlled, and then return the information to the mobile communication terminal.

In this embodiment, the mobile communication terminal sends a request to the network control server through the WebSocket connection, and obtains information of at least one specific device to be controlled from the network control server through the WebSocket connection. That is, the communication between the mobile communication terminal and the network control server follows the WebSocket protocol. Similarly, WebSocket connection also exists between the network control server and the specified device, and the two devices also communicate with each other according to the WebSocket protocol.

Preferably, when the mobile communication terminal acquires information of at least one designated device to be controlled from the network control server, the information of the designated device includes at least one of: the two-dimensional code of the designated equipment, the identification of the designated equipment and the IP address of the designated equipment; the mobile communication terminal identifies and displays the designated device by the information of the designated device. Or, the network control server identifies the specified device according to the information of the specified device to be controlled, wherein the information of the specified device comprises at least one of the following: the two-dimensional code of the designated equipment, the identification of the designated equipment and the IP address of the designated equipment; the mobile communication terminal acquires information of the specified device recognized by the network control server from the network control server.

Step S204: the mobile communication terminal selects a designated device to be controlled according to the user input and sends authentication information to the network control server.

And the authentication information is used for requesting the control operation authorization of the selected specified equipment.

Step S206: and the mobile communication terminal receives the confirmation authorization information returned by the network control server.

Through the authorization authentication, the safety of the mobile communication terminal on the operation control of the equipment can be ensured.

Step S208: the mobile communication terminal acquires the HTML page of the selected specified device.

The mobile communication terminal may acquire the HTML page of the selected specific device in various ways.

For example, the mobile communication terminal sends an information acquisition command to the network control server by using WebSocket connection, wherein the information acquisition command is used for acquiring control operation supported by the specified device; the network control server sends the information acquisition command to the specified equipment by using WebSocket connection, so that the specified equipment acquires the control operation supported by the specified equipment through an NPAPI function according to the information acquisition command, returns the control operation to the network control server and forwards the control operation to the mobile communication terminal through the network control server; and the mobile communication terminal displays the control corresponding to the control operation supported by the specified equipment in the HTML page according to the information of the control operation supported by the specified equipment returned by the network control server, and finally generates the HTML page corresponding to the specified equipment.

For another example, the mobile communication terminal sends an information acquisition command to the network control server by using WebSocket connection, wherein the information acquisition command is used for acquiring the control operation supported by the specified device; the network control server sends the information acquisition command to the specified equipment by using WebSocket connection, so that the specified equipment acquires the control operation supported by the specified equipment through an NPAPI function according to the information acquisition command and returns the control operation to the network control server; and the network control server generates a corresponding HTML page according to the information of the control operation supported by the specified equipment and returns the HTML page to the mobile communication terminal.

For another example, the mobile communication terminal is constructed with set HTML pages in advance, and the HTML pages constructed in advance include at least one of the following: the mobile terminal comprises a touch pad page, a shortcut operation page and a selection terminal page, wherein the touch pad page is used for receiving information of touch operation of a user on the touch pad page and generating a control operation instruction according to the information of the touch operation so as to control cursor operation of a designated device; the shortcut operation page includes at least one of the following controls: the device comprises a volume adjusting control, a device desktop display control, a device screenshot control and a device shutdown control, wherein the shortcut operation page is used for receiving information of operation of a user on the control in the shortcut operation page, and generating a control operation instruction according to the information of the operation of the control so as to control the specified device to perform control operation indicated by the control operation instruction; the selection terminal page is used for displaying information of the equipment to be controlled and the controlled state of the equipment to be controlled so that a user can select the equipment to be controlled, and the selection terminal page further comprises an authorized password input control so that the user can input an authorized password to perform control operation authentication. When the mobile communication terminal obtains the authorization of the appointed equipment, the mobile communication terminal correspondingly displays all or part of the HTML pages constructed in advance for the user to operate. It should be noted that, in practical applications, a person skilled in the art may construct one or more of the HTML pages according to actual needs, or integrate one or more of the HTML pages into one HTML page, and the HTML page may be used to implement an operation function for a specific device, and is flexible and easy to expand.

Step S210: the mobile communication terminal receives a control operation instruction of a user for performing control operation on a specified device through a set HTML page.

In this embodiment, an HTML page in the mobile communication terminal monitors a control operation performed by a user on a specific device through the HTML page, acquires information of the control operation through a DOM (Document object model) event of the HTML page, and generates a control operation instruction according to the information of the control operation.

The DOM is a standard programming interface for the W3C organization to handle markup languages, and is a platform and language independent application program interface that dynamically accesses programs and scripts to update its content, structure, and style of www documents. Event processing is the most important component in the DOM, and a perfect event mechanism enables a program such as a JavaScript program to trigger different execution methods according to a specific event, so that the program can be more interactive and intelligent. For example, the mouse movement data on the HTML page can be obtained through a touchstart event, a touchmove event and a touchend event.

Step S212: the mobile communication terminal uses WebSocket connection to send the control operation instruction to the network control server through the HTML page.

Wherein, the network control server can be built by using node. Js is a set of JavaScript toolkit used for writing a high-performance network server, and has the advantages of single thread, non-blocking IO, event driving and the like. Of course, without being limited thereto, the network control server may also be built in other suitable ways, such as building an Apache server. The network control server establishes connection between the mobile communication terminal and the specified device controlled by the mobile communication terminal through a WebSocket protocol.

Step S214: and the network control server forwards the control operation instruction to the specified equipment by using the WebSocket connection.

Step S216: and the appointed equipment receives the control operation instruction, and calls a system API of the appointed equipment through the NPAPI to realize the control operation indicated by the control operation instruction according to the control operation instruction.

Preferably, the specified device of the present embodiment has installed therein a browser and a browser extension program having an NPAPI mechanism. The browser extension program comprises an NPAPI plug-in (namely a DLL file), and is used for realizing WebSocket communication between the specified device and the network control server and calling a system API of the specified device through the NPAPI plug-in.

The method comprises the following steps that appointed equipment monitors and receives a control operation instruction sent by a network control server through an HTML page of a browser extension program; and then, the HTML page of the browser extension program calls an NPAPI function corresponding to the control operation indicated by the control operation instruction, and calls a corresponding system API function through the NPAPI function to realize the control operation indicated by the control operation instruction. For example, when the control operation indicated by the control operation instruction is a cursor movement operation, the NPAPI function called by the HTML page of the browser extension program of the specified device is SetCursorPos, and the NPAPI function calls the mouse event function of the system to realize the movement of the cursor.

According to the embodiment, the function of the mobile communication terminal as a remote controller is realized, such as a mobile phone remote controller, the mobile communication terminal remote controller completes communication between the mobile communication terminal such as a mobile phone and a designated device such as a computer through a two-way communication completion mechanism of WebSocket, and calls an API of a system to execute a user command through a plug-in mechanism of an NPAPI, so that comprehensive control on the designated device is realized under the condition that a user is completely separated from the traditional input device.

EXAMPLE III

Referring to fig. 3, a flowchart illustrating steps of a device control method according to a third embodiment of the present invention is shown.

In this embodiment, a mobile communication terminal is taken as a mobile phone, a designated device is taken as a personal computer, and a user performs a touch movement operation on a touch pad page of the mobile communication terminal to control a cursor operation of the designated device.

The device control method of the embodiment includes the steps of:

step S302: and (5) building a network control server.

In this embodiment, a network control server is built by node. Js as an emerging background language has many attractions: RESTful API, single threaded, non-blocking IO, Google V8, event driven, etc.

The construction of the network control server comprises the following steps:

the first step is as follows: installing Cygwin; then, node.

The second step is that: and realizing WebSocket communication by using socket Io js.

The socket.io.js is a js library file which realizes bidirectional communication between a browser and a server by using WebSocket standard programming in the HTML5 draft, and provides APIs such as sending message (socket.emit ()), receiving information (socket.on ()), broadcasting information (socket.broadcast.emit ()) and the like.

The third step: and realizing the authorization and authentication of the mobile communication terminal.

The implementation mode is as follows: the appointed equipment sends the controlled password to the network control server, the network control server backs up the controlled password, when the control end, namely the mobile communication terminal, wants to control one appointed equipment, the controlled password needs to be input and sent to the network control server for verification, and if the password is input correctly, the control right is obtained.

The fourth step: the network control server obtains the command of the appointed equipment and the control terminal, namely the mobile communication terminal, and realizes the transfer.

The acquisition and the transfer of the step are completed through WebSocket communication.

Step S304: and constructing an HTML page on the mobile communication terminal, wherein the HTML page is used for a user to control the specified equipment and sending a control operation instruction generated according to the control operation.

In this embodiment, the constructed HTML page includes a touch panel page, a shortcut operation page, and a selection terminal page.

The interface of the touch panel page is shown in fig. 4, and the touch panel page is used for receiving information of touch operation of a user on the touch panel page, and generating a control operation instruction according to the information of the touch operation to control cursor operation of the device. The movement of the cursor of the specified device is controlled by dragging the touch point of the touch panel page (e.g., the white dot in fig. 4) and calculating the distance (unit may be pixel) of its dragging. The distance conversion mode is equidistant conversion, namely the distance of the touch point dragged on the touch pad page of the mobile communication terminal such as a mobile phone is the distance of the cursor on the computer. During implementation, a control terminal, namely a mobile communication terminal, acquires mobile information or a click event of a touch point through a DOM event (including touch start, touch move, touch end, and the like) of an HTML page, then sends corresponding data to a network control server by using a socket.exit () method, the network control server monitors the data sent by the control terminal, namely the mobile communication terminal, through socket.on () and sends the data to a specified device by using a socket.broadcast.exit () method, a browser extension program of the specified device monitors the data sent by the network control server through socket.on (), and calls a related system API (such as mobile _ window, web _ event, openprocess token, lookup prievigevalue, adj tokenview, exitdoowsexrawsexs) through an NPAPI plug-in (one DLL of the browser extension program) to execute a related operation action. The distance may be converted by other suitable methods, such as geometric conversion.

The shortcut operation page is shown in fig. 5, and is configured to receive information of an operation performed by a user on a control in the shortcut operation page, and generate a control operation instruction according to the information of the operation performed by the control, so as to control the device to perform a control operation indicated by the control operation instruction. In this embodiment, the controls set in the shortcut operation page in the form of buttons include: volume control, equipment desktop display control, equipment screenshot control and equipment shutdown control, promptly, the swift operation that carries out equipment through this page includes: volume adjustment, desktop display, screen capture, power off and the like. When the method is implemented, a control end, namely a quick operation HTML page of a mobile communication terminal monitors click events of all buttons, then corresponding information is sent to a network control server, the network control server sends data to designated equipment, and the designated equipment calls a corresponding system API to complete corresponding operation according to the type of the data through an NPAPI plug-in mechanism after acquiring the data.

In addition, a selection terminal button control is further arranged in the shortcut operation page of this embodiment, and when the button is clicked, a selection terminal page is displayed, as shown in fig. 6.

The interface of the selection terminal page is shown in fig. 6, and is used for displaying information of the designated device to be controlled and the controlled state of the designated device to be controlled, so that the user can select the designated device to be controlled; in addition, the selection terminal page can also comprise an authorized password input control for the user to input an authorized password to carry out control operation authentication. And the selected terminal page displays the designated equipment list acquired from the network control server and the controlled state of the designated equipment, and the user can acquire the control right of the selected designated equipment after inputting the authorization password and verifying the authorization password by the network control server. In implementation, the designated device sends the information (e.g., computer name, IP address, controlled password, etc.) of the device to the network control server, the network control server can send the related information (information except the controlled password) to the control end, i.e., the mobile communication terminal, selects the designated device (e.g., according to the IP address or the computer name) and inputs the controlled password and sends the selected password to the network control server for verification, after the password is correct, the network control server returns the successful information, so that the control end, i.e., the mobile communication terminal, obtains the control authority, and then the control end, i.e., the mobile communication terminal, can control the designated device.

Step S306: setting a designated device.

The designated device has a browser with NPAPI mechanism and a browser extension, i.e., the designated device needs to rely on a browser extension (. crx,. xpi file). The background page of the extension program is an HTML page and is used for finishing communication with the network control server, and the NPAPI plug-in of the extension program is a DLL and is used for finishing calling of a system API.

When the control end, namely the HTML page of the mobile communication terminal, sends the control operation instruction to the network control server through the Websocket, the network control server sends the control operation instruction to the specified equipment through the Websocket, and the specified equipment receives the instruction of the control end, namely the mobile communication terminal, to operate.

After a background page of the specified device browser extension program acquires a control operation instruction sent by the network control server, the instruction is analyzed and a related function of the NPAPI is called, and then the mouse click, cursor movement, shutdown and other events are completed by the API (such as mouse _ event, keybd _ event, OpenProcessToken, LookupPrivilegeValue, AdjustTokenPriviges, ExitWindowsEx and the like) of the function call system of the NPAPI. This is because the browser extension program cannot directly call the system API, but can call the export function of the NPAPI plug-in, and the NPAPI plug-in is a DLL that can directly call the system API, thereby implementing that the specified device executes the received command through the API of the NPAPI call system.

It should be noted that, the execution among the steps S302, S304, and S306 may not be in a sequential order.

After the mobile communication terminal, the network control server and the designated device complete the corresponding settings, the operation control of the mobile communication terminal on the designated device can be started, including:

step S308: the mobile communication terminal acquires a list of specified devices (PCs).

The designated device transmits its own information (such as computer name, IP address, controlled password, etc.) to the network control server, and the network control server transmits the relevant information (information other than the controlled password) of the designated device to the control terminal, i.e., the mobile communication terminal.

Step S310: the mobile communication terminal selects a specified device (PC) and performs authorization authentication.

The appointed equipment sends the controlled password to the network control server, the control end, namely the mobile communication terminal, inputs the password in an authorized password input control such as an input control of an HTML page and sends the password to the network control server for verification, and authorization is obtained if the input password is correct.

Step S312: the mobile communication terminal moves a cursor through a touch area of the touch pad page to generate a control operation instruction.

When a user drags a touch point in a touch area of a touch pad page to move the cursor, a DOM event of the touch pad page acquires the movement information and the click event of the touch point, and then a control operation instruction is generated.

Similarly, when a user initiates an operation command (such as volume adjustment, desktop display, screen capture, shutdown and the like) through a button of the shortcut operation page, the DOM event of the shortcut operation page acquires button click information, and then generates a control operation instruction.

Step S314: the mobile communication terminal communicates with the network control server by using WebSocket connection, and sends the control operation instruction to the network control server through the touch pad page.

Step S316: the network control server communicates with the specified equipment by using WebSocket connection, and sends the control operation instruction to the specified equipment.

Step S318: and the appointed equipment acquires the control operation instruction sent by the network control server through a background page of the browser extension program and calls a related NPAPI function.

For example, when the control operation instruction indicates a cursor operation, the device calls the NPAPI function SetCursorPos.

Step S320: and the appointed equipment calls the API function of the system through the NPAPI function and executes the control operation indicated by the control operation instruction.

For example, the API function mouse _ event corresponding to the NPAPI function in step S318 is called to implement the cursor operation of the specified device.

The present embodiment describes the device control method according to the present invention, taking a cursor control operation of a specified device as an example. It should be understood by those skilled in the art that other control operations, such as volume control, power-off operation, etc., may be performed with reference to the present embodiment. Through the embodiment, the functions of replacing traditional computer input equipment such as a keyboard, a touch pad, a mouse and the like by a mobile communication terminal such as a mobile phone, conveniently operating a computer under the condition of being far away from the computer and monitoring the computer in real time are realized. The embodiment utilizes the new Web standard and the characteristic that the mobile communication terminal such as a mobile phone is carried about, and takes the mobile communication terminal such as the mobile phone as the input equipment of the computer, thereby greatly improving the operation experience of a user on the computer while furthest expanding the input convenience of the computer.

Example four

Referring to fig. 7, a flowchart illustrating steps of a device control method according to a fourth embodiment of the present invention is shown.

The equipment control method can be applied to the control of the mobile communication terminal on the terminal equipment of the Internet of things.

The device control method of the embodiment includes the steps of:

step S402: the mobile communication terminal obtains and displays information of at least one appointed device in a certain range, and a user can select the appointed device.

For example, the mobile communication terminal sends a corresponding request to a specified device within a certain distance through a specific connection, such as bluetooth, to obtain information of the specified devices around. For example, the mobile communication terminal may search for a plurality of internet of things devices (e.g., a smart television, a smart refrigerator, etc.) in the same room through bluetooth, obtain information of the devices, and then display the information in the mobile communication terminal, so that the user may select a controlled designated device.

Step S404: the mobile communication terminal receives user selection to determine the designated equipment, sends a pairing request to the designated equipment and requests to establish pairing connection with the designated equipment.

The pairing request includes information of the mobile communication terminal. Preferably, the information of the mobile communication terminal includes at least one of: the two-dimensional code of the mobile communication terminal, the identification of the mobile communication terminal and the IP address of the mobile communication terminal.

Step S406: and the mobile communication terminal receives a pairing response which is returned by the appointed equipment and carries the information of the appointed equipment, and establishes pairing connection with the appointed equipment according to the pairing response.

Preferably, the information specifying the device includes at least one of: the two-dimensional code of the designated device, the identification of the designated device and the IP address of the designated device.

Step S408: the mobile communication terminal acquires an HTML page corresponding to the designated device.

For example, after establishing a pairing connection with a designated device, the mobile communication terminal sends an information acquisition command to the designated device through the pairing connection to request for acquiring a control operation supported by the designated device; further, an HTML page is generated based on the information of the supported control operation returned by the specified device.

For another example, the mobile communication terminal stores an HTML page matched with one or more types of specified devices; after the mobile communication terminal acquires the information of the designated equipment, the type of the designated equipment is determined according to the information, and then a matched HTML page is selected.

For another example, in a case where some servers can also participate, the mobile communication terminal transmits the acquired information of the specified device to the server; the server determines the type of the specified equipment and then generates an HTML page to be sent to the mobile communication terminal, or the server returns the operation supported by the specified equipment of the type to the mobile communication terminal according to the type of the specified equipment, and then the mobile communication terminal generates a corresponding HTML page.

Taking an intelligent television as an example, the mobile communication terminal generates a corresponding HTML page according to information returned by the intelligent television, the HTML page can comprise a power on/off button control, a volume adjustment control, a channel adjustment control, a menu operation control and the like, and the remote control of the intelligent television is realized through the controls.

Step S410: and the mobile communication terminal receives a control operation instruction for controlling and operating the specified equipment by the user through the HTML page.

Step S412: and the mobile communication terminal sends the control operation instruction to the specified equipment which is successfully paired by using the pairing connection through the HTML page.

Step S414: the designated equipment receives a control operation instruction sent by the mobile communication terminal through the pairing connection and executes the control operation indicated by the control operation instruction.

Through the embodiment, point-to-point equipment control is realized. The control of various appointed devices can be realized only by one mobile communication terminal, a special remote controller or control software is not needed, the compatible control of various devices under the condition of being far away from the devices is realized, and the effect of user operation experience is improved.

EXAMPLE five

Referring to fig. 8, a block diagram of a mobile communication terminal according to a fifth embodiment of the present invention is shown.

The mobile communication terminal of the embodiment is provided with a device for controlling equipment, and the device comprises: a receiving module 502, configured to receive a control operation instruction for a user to perform a control operation on a specified device through a set HTML page, where the HTML page is used to provide an interface for the user to perform the control operation on the specified device through a mobile communication terminal, receive the control operation instruction generated by the user through the interface operation, and send the control operation instruction; and the control module 504 is configured to send the control operation instruction to the specified device through the HTML page, so that the specified device executes the control operation indicated by the control operation instruction.

Preferably, the control module 504 is configured to send the control operation instruction to the network control server through the HTML page by using a WebSocket connection, and the network control server forwards the control operation instruction to the specified device by using the WebSocket connection, so that the specified device calls a system API of the specified device through an NPAPI according to the control operation instruction to implement the control operation indicated by the control operation instruction.

Preferably, the specified device is installed with a browser with an NPAPI and a browser extension program, wherein the browser extension program includes an NPAPI plug-in, and the browser extension program is used for realizing WebSocket communication between the specified device and the network control server and calling a system API of the specified device through the NPAPI plug-in.

Preferably, when the designated device calls the system API of the designated device through the NPAPI to implement the control operation indicated by the control operation instruction according to the control operation instruction, the control module 504 enables the designated device to monitor and receive the control operation instruction sent by the network control server through the HTML page of the browser extension program; and calling an NPAPI function corresponding to the control operation indicated by the control operation instruction by an HTML page of the browser extension program, and calling a corresponding system API function through the NPAPI function to realize the control operation indicated by the control operation instruction.

Preferably, this embodiment further includes: a selecting module 506, configured to obtain information of at least one specific device to be controlled from the network control server before the receiving module 504 receives a control operation instruction for performing a control operation on the specific device through the set HTML page by the user; selecting a designated device to be controlled, and sending authentication information to a network control server, wherein the authentication information is used for requesting control operation authorization on the selected designated device; and receiving the confirmation authorization information returned by the network control server.

Preferably, the selecting module 506 is further configured to send an information obtaining command to the network control server by using WebSocket connection after receiving the authorization confirmation information returned by the network control server, where the information obtaining command is used to obtain a control operation supported by the specified device; the network control server sends the information acquisition command to the specified equipment by using WebSocket connection, so that the specified equipment acquires the control operation supported by the specified equipment through an NPAPI function according to the information acquisition command and returns the control operation to the network control server, and the control operation is forwarded to the selection module by the network control server; and the selection module displays a control corresponding to the control operation supported by the specified equipment in the HTML page according to the information of the control operation supported by the specified equipment, which is returned by the network control server.

Preferably, the selecting module 506 acquires the information of the at least one specified device to be controlled from the network control server when acquiring the information of the at least one specified device to be controlled from the network control server, wherein the information of the specified device includes at least one of: the two-dimensional code of the designated equipment, the identification of the designated equipment and the IP address of the designated equipment; the mobile communication terminal identifies and displays the appointed equipment through the information of the appointed equipment; or the network control server identifies the specified equipment according to the information of the specified equipment to be controlled; the mobile communication terminal acquires information of the specified device recognized by the network control server from the network control server.

Preferably, the network control server is built using node.

Preferably, the control module 504 is configured to send the control operation instruction to the specified device successfully paired with the mobile communication terminal through the HTML page, so that the specified device executes the control operation indicated by the control operation instruction.

Preferably, this embodiment further includes: a pairing module 508, configured to send a pairing request to the specified device before the receiving module 502 receives a control operation instruction for controlling an operation on the specified device through the set HTML page by the user, where the pairing request includes information of the mobile communication terminal; and receiving a pairing response which is returned by the appointed equipment and carries the information of the appointed equipment, and establishing pairing connection with the appointed equipment according to the pairing response.

Preferably, the information of the mobile communication terminal includes at least one of: the two-dimensional code of the mobile communication terminal, the identification of the mobile communication terminal and the IP address of the mobile communication terminal; the information specifying the device includes at least one of: the two-dimensional code of the designated device, the identification of the designated device and the IP address of the designated device.

Preferably, this embodiment further includes: the building module 510 is configured to, before the receiving module 502 receives a control operation instruction for a user to perform a control operation on a specified device through a set HTML page, build the set HTML page, where the HTML page includes at least one of: the mobile terminal comprises a touch pad page, a shortcut operation page and a selection terminal page, wherein the touch pad page is used for receiving information of touch operation of a user on the touch pad page and generating a control operation instruction according to the information of the touch operation so as to control cursor operation of a designated device; the shortcut operation page includes at least one of the following controls: the device comprises a volume adjusting control, a device desktop display control, a device screenshot control and a device shutdown control, wherein the shortcut operation page is used for receiving information of operation of a user on the control in the shortcut operation page, and generating a control operation instruction according to the information of the operation of the control so as to control the specified device to perform control operation indicated by the control operation instruction; the selection terminal page is used for displaying information of the equipment to be controlled and the controlled state of the equipment to be controlled so that a user can select the equipment to be controlled, and the selection terminal page further comprises an authorized password input control so that the user can input an authorized password to perform control operation authentication.

Preferably, the receiving module 502 is configured to monitor, through a set HTML page, a control operation performed by a user on a designated device through the HTML page, acquire information of the control operation through a DOM event of the HTML page, and generate a control operation instruction according to the information of the control operation.

The mobile communication terminal of this embodiment is used to implement the corresponding device control method in the foregoing method embodiment, and has the beneficial effects of the corresponding method embodiment, which are not described herein again.

The appliance control schemes provided herein are not inherently related to any particular computer, virtual system, or other appliance. Various general purpose systems may also be used with the teachings herein. The structure required to construct a system incorporating aspects of the present invention will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.

The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in a device control scheme according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Disclosed herein is a1, an apparatus control method, characterized by comprising: the method comprises the steps that a mobile communication terminal receives a control operation instruction of a user for controlling and operating appointed equipment through a set HTML page, wherein the HTML page is used for providing an interface for the user to control and operate the appointed equipment through the mobile communication terminal, receiving the control operation instruction generated by the user for interface operation, and sending the control operation instruction; and the mobile communication terminal sends the control operation instruction to the specified equipment through the HTML page, so that the specified equipment executes the control operation indicated by the control operation instruction. A2, the method according to a1, wherein the step of the mobile communication terminal sending the control operation command to the designated device through the HTML page, and the step of causing the designated device to execute the control operation indicated by the control operation command includes: the mobile communication terminal uses WebSocket connection to send the control operation instruction to a network control server through the HTML page, and the network control server uses the WebSocket connection to forward the control operation instruction to the specified equipment, so that the specified equipment calls a system API of the specified equipment through an NPAPI to realize the control operation indicated by the control operation instruction according to the control operation instruction. A3, the method according to A2, characterized in that the specified device is installed with a browser with NPAPI and a browser extension program, wherein the browser extension program includes NPAPI plug-in, and the browser extension program is used for realizing WebSocket communication between the specified device and the network control server, and calling the system API of the specified device through the NPAPI plug-in. A4, the method according to A3, wherein the step that the designated device calls a system API of the designated device through an NPAPI to realize the control operation indicated by the control operation instruction according to the control operation instruction comprises the following steps: the designated equipment monitors and receives the control operation instruction sent by the network control server through an HTML page of the browser extension program; and the HTML page of the browser extension program calls an NPAPI function corresponding to the control operation indicated by the control operation instruction, and calls a corresponding system API function through the NPAPI function to realize the control operation indicated by the control operation instruction. A5, the method according to a1, wherein before the step of the mobile communication terminal receiving a control operation command for a user to perform a control operation on a designated device through a set HTML page, the method further comprises: the mobile communication terminal acquires information of at least one designated device to be controlled from a network control server; selecting one appointed device to be controlled, and sending authentication information to the network control server, wherein the authentication information is used for requesting control operation authorization on the selected appointed device; and receiving the confirmation authorization information returned by the network control server. A6, the method according to A5, wherein after the receiving the confirmation authorization information returned by the network control server, the method further comprises: the mobile communication terminal sends an information acquisition command to the network control server by using WebSocket connection, wherein the information acquisition command is used for acquiring the control operation supported by the specified equipment; the network control server sends the information acquisition command to the specified equipment by using the WebSocket connection, so that the specified equipment acquires the control operation supported by the specified equipment through an NPAPI function according to the information acquisition command, returns the control operation to the network control server and forwards the control operation to the mobile communication terminal by the network control server; and the mobile communication terminal displays a control corresponding to the control operation supported by the specified equipment in an HTML page according to the information of the control operation supported by the specified equipment, which is returned by the network control server. A7, the method according to a5 or a6, wherein the step of the mobile communication terminal obtaining information of at least one designated device to be controlled from a network control server comprises: the mobile communication terminal acquires information of at least one specified device to be controlled from the network control server, wherein the information of the specified device comprises at least one of the following: the two-dimensional code of the designated equipment, the identifier of the designated equipment and the IP address of the designated equipment; the mobile communication terminal identifies and displays the specified equipment through the information of the specified equipment; or, the network control server identifies the specified device according to the information of the specified device to be controlled; the mobile communication terminal acquires information of the specified device identified by the network control server from the network control server. A8, the method according to a2, wherein the network control server is built using node. A9, the method according to a1, wherein the step of the mobile communication terminal sending the control operation command to the designated device through the HTML page, and the step of causing the designated device to execute the control operation indicated by the control operation command includes: and the mobile communication terminal sends the control operation instruction to the specified equipment successfully matched with the mobile communication terminal through the HTML page, so that the specified equipment executes the control operation indicated by the control operation instruction. A10, the method according to a9, wherein before the step of the mobile communication terminal receiving a control operation command for a user to perform a control operation on a designated device through a set HTML page, the method further comprises: the mobile communication terminal sends a pairing request to the designated equipment to request to establish pairing connection with the designated equipment, wherein the pairing request comprises information of the mobile communication terminal; and the mobile communication terminal receives a pairing response which is returned by the appointed equipment and carries the information of the appointed equipment, and establishes pairing connection with the appointed equipment according to the pairing response. A11, the method according to A10, wherein the information of the mobile communication terminal includes at least one of: the two-dimensional code of the mobile communication terminal, the identification of the mobile communication terminal and the IP address of the mobile communication terminal; the information specifying the device includes at least one of: the two-dimensional code of the designated equipment, the identification of the designated equipment and the IP address of the designated equipment. A12, the method according to a1, wherein before the step of the mobile communication terminal receiving a control operation command for a user to perform a control operation on a designated device through a set HTML page, the method further comprises: constructing the set HTML page, wherein the HTML page comprises at least one of the following: the mobile terminal comprises a touch pad page, a shortcut operation page and a selection terminal page, wherein the touch pad page is used for receiving information of touch operation of a user on the touch pad page, and generating a control operation instruction according to the information of the touch operation so as to control cursor operation of the specified equipment; the shortcut operation page includes at least one of the following controls: the shortcut operation page is used for receiving information of operation of a control in the shortcut operation page by the user, and generating the control operation instruction according to the information of the operation of the control so as to control the specified equipment to perform the control operation indicated by the control operation instruction; the selection terminal page is used for displaying information of the equipment to be controlled and the controlled state of the equipment to be controlled so that the user can select the equipment to be controlled, and the selection terminal page further comprises an authorized password input control part so that the user can input an authorized password to perform control operation authentication. A13, the method according to a1 or a2, wherein the step of the mobile communication terminal receiving a control operation command for a user to perform a control operation on a designated device through a set HTML page comprises: and the set HTML page monitors the control operation of the user on the designated equipment through the HTML page, acquires the information of the control operation through the DOM event of the HTML page, and generates the control operation instruction according to the information of the control operation.

Disclosed herein is a mobile communication terminal B14, comprising: the receiving module is used for receiving a control operation instruction of a user for performing control operation on the specified equipment through a set HTML page, wherein the HTML page is used for providing an interface for the user to perform control operation on the specified equipment through the mobile communication terminal, receiving the control operation instruction generated by the user for the interface operation, and sending the control operation instruction; and the control module is used for sending the control operation instruction to the specified equipment through the HTML page so as to enable the specified equipment to execute the control operation indicated by the control operation instruction. The mobile communication terminal according to B15, or B14, wherein the control module is configured to use a WebSocket connection to send the control operation instruction to a network control server through the HTML page, and the network control server uses the WebSocket connection to forward the control operation instruction to the specified device, so that the specified device calls a system API of the specified device through an NPAPI to implement the control operation indicated by the control operation instruction according to the control operation instruction. B16, the mobile communication terminal according to B15, wherein the designated device is installed with a browser with NPAPI and a browser extension program, wherein the browser extension program includes NPAPI plug-in, and the browser extension program is used to realize WebSocket communication between the designated device and the network control server, and to call the system API of the designated device through the NPAPI plug-in. B17 and the mobile communication terminal according to B16, wherein the control module, when the designated device calls a system API of the designated device through an NPAPI to implement the control operation indicated by the control operation instruction according to the control operation instruction, causes the designated device to monitor and receive the control operation instruction sent by the network control server through an HTML page of the browser extension program; and the HTML page of the browser extension program calls an NPAPI function corresponding to the control operation indicated by the control operation instruction, and calls a corresponding system API function through the NPAPI function to realize the control operation indicated by the control operation instruction. B18, the mobile communication terminal according to B14, further comprising: the selection module is used for acquiring information of at least one designated device to be controlled from a network control server before the receiving module receives a control operation instruction for controlling and operating the designated device by a user through a set HTML page; selecting one appointed device to be controlled, and sending authentication information to the network control server, wherein the authentication information is used for requesting control operation authorization on the selected appointed device; and receiving the confirmation authorization information returned by the network control server. B19, the mobile communication terminal according to B18, wherein the selecting module is further configured to send an information obtaining command to the network control server by using WebSocket connection after receiving the authorization confirmation information returned by the network control server, where the information obtaining command is used to obtain the control operation supported by the specified device; the network control server sends the information acquisition command to the specified equipment by using the WebSocket connection, so that the specified equipment acquires the control operation supported by the specified equipment through an NPAPI function according to the information acquisition command, returns the control operation to the network control server and forwards the control operation to the selection module by the network control server; and the selection module displays a control corresponding to the control operation supported by the specified equipment in an HTML page according to the information of the control operation supported by the specified equipment, which is returned by the network control server. B20, the mobile communication terminal according to B18 or B19, wherein the selection module, when acquiring information of at least one designated device to be controlled from a network control server, acquires the information of the at least one designated device to be controlled from the network control server, wherein the information of the designated device comprises at least one of: the two-dimensional code of the designated equipment, the identifier of the designated equipment and the IP address of the designated equipment; the mobile communication terminal identifies and displays the specified equipment through the information of the specified equipment; or, the network control server identifies the specified device according to the information of the specified device to be controlled; the mobile communication terminal acquires information of the specified device identified by the network control server from the network control server. B21, the mobile communication terminal according to B15, wherein the network control server is built using node. The mobile communication terminal according to B22 or B14, wherein the control module is configured to send the control operation instruction to the specified device that is successfully paired with the mobile communication terminal through the HTML page, so that the specified device executes the control operation indicated by the control operation instruction. B23, the mobile communication terminal according to B22, further comprising: the pairing module is used for sending a pairing request to the specified equipment before the receiving module receives a control operation instruction of a user for controlling and operating the specified equipment through a set HTML page, and requesting to establish pairing connection with the specified equipment, wherein the pairing request comprises information of the mobile communication terminal; and receiving a pairing response which is returned by the appointed equipment and carries the information of the appointed equipment, and establishing pairing connection with the appointed equipment according to the pairing response. B24, the mobile communication terminal according to B23, wherein the information of the mobile communication terminal includes at least one of: the two-dimensional code of the mobile communication terminal, the identification of the mobile communication terminal and the IP address of the mobile communication terminal; the information specifying the device includes at least one of: the two-dimensional code of the designated equipment, the identification of the designated equipment and the IP address of the designated equipment. B25, the mobile communication terminal according to B14, further comprising: the building module is used for building the set HTML page before the receiving module receives a control operation instruction of a user for controlling and operating the specified device through the set HTML page, and the HTML page comprises at least one of the following: the mobile terminal comprises a touch pad page, a shortcut operation page and a selection terminal page, wherein the touch pad page is used for receiving information of touch operation of a user on the touch pad page, and generating a control operation instruction according to the information of the touch operation so as to control cursor operation of the specified equipment; the shortcut operation page includes at least one of the following controls: the shortcut operation page is used for receiving information of operation of a control in the shortcut operation page by the user, and generating the control operation instruction according to the information of the operation of the control so as to control the specified equipment to perform the control operation indicated by the control operation instruction; the selection terminal page is used for displaying information of the equipment to be controlled and the controlled state of the equipment to be controlled so that the user can select the equipment to be controlled, and the selection terminal page further comprises an authorized password input control part so that the user can input an authorized password to perform control operation authentication. B26, according to B14 or B15, the mobile communication terminal is characterized in that the receiving module is configured to monitor, through the set HTML page, a control operation performed by the user on the designated device through the HTML page, obtain information of the control operation through a DOM event of the HTML page, and generate the control operation instruction according to the information of the control operation.

Claims

1. An apparatus control method characterized by comprising:

the method comprises the steps that a mobile communication terminal receives a control operation instruction of a user for controlling and operating appointed equipment through a set HTML page, wherein the HTML page is used for providing an interface for the user to control and operate the appointed equipment through the mobile communication terminal, receiving the control operation instruction generated by the user for interface operation, and sending the control operation instruction;

and the mobile communication terminal sends the control operation instruction to the specified equipment through the HTML page, so that the specified equipment executes the control operation indicated by the control operation instruction.

2. The method according to claim 1, wherein the mobile communication terminal sends the control operation instruction to the specified device through the HTML page, and the step of causing the specified device to execute the control operation indicated by the control operation instruction includes:

the mobile communication terminal uses WebSocket connection to send the control operation instruction to a network control server through the HTML page, and the network control server uses the WebSocket connection to forward the control operation instruction to the specified equipment, so that the specified equipment calls a system API of the specified equipment through an NPAPI to realize the control operation indicated by the control operation instruction according to the control operation instruction.

3. The method of claim 2, wherein the specified device is installed with a browser having an NPAPI and a browser extension program, wherein the browser extension program comprises an NPAPI plug-in, and wherein the browser extension program is configured to enable WebSocket communication between the specified device and the network control server, and to call a system API of the specified device through the NPAPI plug-in.

4. The method according to claim 3, wherein the step of the designated device calling a system API of the designated device through an NPAPI to implement the control operation indicated by the control operation instruction according to the control operation instruction comprises:

the designated equipment monitors and receives the control operation instruction sent by the network control server through an HTML page of the browser extension program;

and the HTML page of the browser extension program calls an NPAPI function corresponding to the control operation indicated by the control operation instruction, and calls a corresponding system API function through the NPAPI function to realize the control operation indicated by the control operation instruction.

5. The method according to claim 1, before the step of the mobile communication terminal receiving a control operation instruction for a user to perform a control operation on a specified device through a set HTML page, further comprising:

the mobile communication terminal acquires information of at least one designated device to be controlled from a network control server;

selecting one appointed device to be controlled, and sending authentication information to the network control server, wherein the authentication information is used for requesting control operation authorization on the selected appointed device;

and receiving the confirmation authorization information returned by the network control server.

6. The method according to claim 5, further comprising, after said receiving the confirmation authorization information returned by the network control server:

the mobile communication terminal sends an information acquisition command to the network control server by using WebSocket connection, wherein the information acquisition command is used for acquiring the control operation supported by the specified equipment;

the network control server sends the information acquisition command to the specified equipment by using the WebSocket connection, so that the specified equipment acquires the control operation supported by the specified equipment through an NPAPI function according to the information acquisition command, returns the control operation to the network control server and forwards the control operation to the mobile communication terminal by the network control server;

and the mobile communication terminal displays a control corresponding to the control operation supported by the specified equipment in an HTML page according to the information of the control operation supported by the specified equipment, which is returned by the network control server.

7. The method according to claim 5 or 6, wherein the step of the mobile communication terminal acquiring information of at least one of the designated devices to be controlled from a network control server comprises:

the mobile communication terminal acquires information of at least one specified device to be controlled from the network control server, wherein the information of the specified device comprises at least one of the following: the two-dimensional code of the designated equipment, the identifier of the designated equipment and the IP address of the designated equipment; the mobile communication terminal identifies and displays the specified equipment through the information of the specified equipment;

or,

the network control server identifies the specified equipment according to the information of the specified equipment to be controlled; the mobile communication terminal acquires information of the specified device identified by the network control server from the network control server.

8. The method of claim 2, wherein the network control server is built using node.

9. The method according to claim 1, wherein the mobile communication terminal sends the control operation instruction to the specified device through the HTML page, and the step of causing the specified device to execute the control operation indicated by the control operation instruction includes:

and the mobile communication terminal sends the control operation instruction to the specified equipment successfully matched with the mobile communication terminal through the HTML page, so that the specified equipment executes the control operation indicated by the control operation instruction.

10. The method according to claim 9, before the step of the mobile communication terminal receiving a control operation instruction for a user to perform a control operation on a specified device through a set HTML page, further comprising:

the mobile communication terminal sends a pairing request to the designated equipment to request to establish pairing connection with the designated equipment, wherein the pairing request comprises information of the mobile communication terminal;

and the mobile communication terminal receives a pairing response which is returned by the appointed equipment and carries the information of the appointed equipment, and establishes pairing connection with the appointed equipment according to the pairing response.

11. The method according to claim 10, wherein the information of the mobile communication terminal comprises at least one of: the two-dimensional code of the mobile communication terminal, the identification of the mobile communication terminal and the IP address of the mobile communication terminal; the information specifying the device includes at least one of: the two-dimensional code of the designated equipment, the identification of the designated equipment and the IP address of the designated equipment.

12. The method according to claim 1, before the step of the mobile communication terminal receiving a control operation instruction for a user to perform a control operation on a specified device through a set HTML page, further comprising:

constructing the set HTML page, wherein the HTML page comprises at least one of the following: the mobile terminal comprises a touch pad page, a shortcut operation page and a selection terminal page, wherein the touch pad page is used for receiving information of touch operation of a user on the touch pad page, and generating a control operation instruction according to the information of the touch operation so as to control cursor operation of the specified equipment; the shortcut operation page includes at least one of the following controls: the shortcut operation page is used for receiving information of operation of a control in the shortcut operation page by the user, and generating the control operation instruction according to the information of the operation of the control so as to control the specified equipment to perform the control operation indicated by the control operation instruction; the selection terminal page is used for displaying information of the equipment to be controlled and the controlled state of the equipment to be controlled so that the user can select the equipment to be controlled, and the selection terminal page further comprises an authorized password input control part so that the user can input an authorized password to perform control operation authentication.

13. The method according to claim 1 or 2, wherein the step of the mobile communication terminal receiving a control operation instruction for the user to perform the control operation on the specified device through the set HTML page comprises:

and the set HTML page monitors the control operation of the user on the designated equipment through the HTML page, acquires the information of the control operation through the DOM event of the HTML page, and generates the control operation instruction according to the information of the control operation.

14. A mobile communication terminal, comprising:

the receiving module is used for receiving a control operation instruction of a user for performing control operation on the specified equipment through a set HTML page, wherein the HTML page is used for providing an interface for the user to perform control operation on the specified equipment through the mobile communication terminal, receiving the control operation instruction generated by the user for the interface operation, and sending the control operation instruction;

and the control module is used for sending the control operation instruction to the specified equipment through the HTML page so as to enable the specified equipment to execute the control operation indicated by the control operation instruction.

15. The mobile communication terminal of claim 14, wherein the control module is configured to send the control operation instruction to a network control server through the HTML page using a WebSocket connection, and the network control server forwards the control operation instruction to the specific device using the WebSocket connection, so that the specific device calls a system API of the specific device through an NPAPI to implement the control operation indicated by the control operation instruction according to the control operation instruction.

16. The mobile communication terminal of claim 15, wherein the specified device is installed with a browser having an NPAPI and a browser extension program, wherein the browser extension program comprises an NPAPI plug-in, and the browser extension program is configured to implement WebSocket communication between the specified device and the network control server, and to call a system API of the specified device through the NPAPI plug-in.

17. The mobile communication terminal of claim 16, wherein the control module, when causing the specified device to call a system API of the specified device through an NPAPI according to the control operation instruction to implement the control operation indicated by the control operation instruction, causes the specified device to monitor and receive the control operation instruction sent by the network control server through an HTML page of the browser extension program; and the HTML page of the browser extension program calls an NPAPI function corresponding to the control operation indicated by the control operation instruction, and calls a corresponding system API function through the NPAPI function to realize the control operation indicated by the control operation instruction.

18. The mobile communication terminal according to claim 14, further comprising:

the selection module is used for acquiring information of at least one designated device to be controlled from a network control server before the receiving module receives a control operation instruction for controlling and operating the designated device by a user through a set HTML page; selecting one appointed device to be controlled, and sending authentication information to the network control server, wherein the authentication information is used for requesting control operation authorization on the selected appointed device; and receiving the confirmation authorization information returned by the network control server.

19. The mobile communication terminal of claim 18, wherein the selecting module is further configured to send an information obtaining command to the network control server by using a WebSocket connection after the receiving of the authorization confirmation information returned by the network control server, where the information obtaining command is used to obtain a control operation supported by the specified device; the network control server sends the information acquisition command to the specified equipment by using the WebSocket connection, so that the specified equipment acquires the control operation supported by the specified equipment through an NPAPI function according to the information acquisition command, returns the control operation to the network control server and forwards the control operation to the selection module by the network control server; and the selection module displays a control corresponding to the control operation supported by the specified equipment in an HTML page according to the information of the control operation supported by the specified equipment, which is returned by the network control server.

20. The mobile communication terminal according to claim 18 or 19, wherein the selection module acquires information of the at least one designated device to be controlled from a network control server when acquiring the information of the at least one designated device to be controlled from the network control server, wherein the information of the designated device comprises at least one of: the two-dimensional code of the designated equipment, the identifier of the designated equipment and the IP address of the designated equipment; the mobile communication terminal identifies and displays the specified equipment through the information of the specified equipment; or, the network control server identifies the specified device according to the information of the specified device to be controlled; the mobile communication terminal acquires information of the specified device identified by the network control server from the network control server.