CN113473194B

CN113473194B - Intelligent device and response method

Info

Publication number: CN113473194B
Application number: CN202010384298.6A
Authority: CN
Inventors: 陈维强; 孟卫明; 高雪松
Original assignee: Hisense Co Ltd
Current assignee: Hisense Co Ltd
Priority date: 2020-05-09
Filing date: 2020-05-09
Publication date: 2022-04-08
Anticipated expiration: 2040-05-09
Also published as: CN113473194A

Abstract

The embodiment of the invention relates to the technical field of communication, in particular to an intelligent device and a response method, which are applied to a scene that the display content of the intelligent device is synchronized to a control device, wherein the intelligent device comprises: the receiver is used for receiving a first touch instruction from the control equipment; the processor is configured to determine whether a current timer arrives at the receiving moment of the first touch instruction; and responding to the first touch instruction when the timer is reached. The method can solve the problem of response disorder caused by the fact that multiple users control the same intelligent device, and improves use experience.

Description

Intelligent device and response method

Technical Field

The invention relates to the technical field of communication, in particular to intelligent equipment and a response method.

Background

The existing remote controllers are mostly infrared remote controllers, and in the using process, due to the technical limitation that infrared communication needs to be in the same direction, when remote control operation is caused, a user needs to aim the remote controllers at the receiver position to smoothly realize the remote control function, so that remote control action becomes inconvenient. Especially, when the infrared receiver is shielded by an object, the remote control function cannot be realized.

With the development of communication technology, the display content of the large-screen device can be projected into the small-screen device, and the small-screen device can control the large-screen device through touch operation. For example, after the smart television is connected with the mobile phone, the display content of the smart television can be projected to the mobile phone, and the mobile phone can control a program channel or a program playing progress through touch operation. However, when multiple mobile phones are connected to the same smart television at the same time, the smart television may be controlled by multiple users, and if the time interval between the touch operations of the multiple users is too short, or the touch operations are performed simultaneously, the smart television may respond to the touch instruction in a non-timely manner, and cause problems such as response disorder, which may affect the user experience.

Disclosure of Invention

The application provides an intelligent device and a response method, which are used for solving the problem of response disorder caused by the fact that multiple users control the same intelligent device and improving use experience.

In a first aspect, an embodiment of the present invention provides an intelligent device, including: the receiver receives a first touch instruction from the control equipment. And the processor is configured to determine whether the current timer arrives at the receiving moment of the first touch instruction, and further respond to the first touch instruction when the timer arrives.

In the embodiment of the invention, the intelligent equipment working under the same local area network is connected with the control equipment, and then the intelligent equipment can send the streaming media data to the control equipment through the connection, so that the display content of the intelligent equipment is synchronized to the control equipment. Further, the user may perform a touch operation on the control device, generate a corresponding touch instruction, then the control device sends the touch instruction to the smart device, and the smart device responds to the touch instruction after determining that the current timer has reached, and instructs the display to output corresponding response content. In the above scheme, the intelligent device avoids response disorder to the touch instruction by judging whether the timer is reached. The user can efficiently and accurately control the intelligent device.

In an alternative embodiment, the processor is further configured to: when the timer does not arrive, judging whether the control device of the first touch instruction is the same control device as the control device corresponding to the historical touch instruction, wherein the historical touch instruction is the touch instruction received within a set time period before the first touch instruction is received. And when the touch control device is the same control device, the processor responds to the first touch control instruction.

In the embodiment of the present invention, when the smart device determines that the timer has not arrived, the smart device further compares the current touch instruction with the historical touch instruction, that is, whether the source control devices of the last responded touch instruction within the set time are the same, and when the current touch instruction is the same control device, executes the current touch instruction. By the method, after the timer is judged not to arrive, the current touch instruction and the source equipment of the last responded touch instruction are further compared, so that the intelligent equipment can only respond to one control device in a short time, the problem of disordered response of the intelligent equipment is avoided, and the user experience is improved.

Further, in an optional embodiment, the processor is further configured not to respond to the first touch instruction when the control device is a different control device.

In the embodiment of the invention, when the intelligent device judges that the timer does not arrive, the control device corresponding to the current touch instruction and the historical touch instruction is further compared, and when the intelligent device judges that the current touch instruction is not the same control device, the intelligent device does not respond to the touch instruction and abandons the current touch instruction. The problem of response disorder caused by the fact that the intelligent device does not know whether the intelligent device responds to the control device of the intelligent device or not after the control devices send the touch instruction in a short time is effectively solved, and control efficiency is improved.

In an alternative embodiment, the processor is further configured to: and monitoring the pulling quantity of the streaming media data, and determining that the control equipment connected with the intelligent equipment is at least two control equipment according to the pulling quantity of the streaming media data.

In the embodiment of the invention, after the intelligent equipment is connected with the control equipment, the streaming media service is started, the streaming media video, namely the streaming media data, is transmitted to the control equipment, the synchronization with the control equipment is realized, the pulling quantity of the streaming media data is monitored in real time, and the connected control equipment is determined. Optionally, after the control device is connected with the intelligent device, the control device actively uploads the information of the control device, and the intelligent device determines the connected control devices and the number of the control devices according to the received information of the control device, so that preparation is made for responding to the intelligent device and the control device in subsequent steps, and the control efficiency is improved.

In an alternative embodiment, the treatment appliance is configured to: when the current state position of the timer is set as a first state position, determining that the current timer arrives; and when the current state bit of the timer is the second state bit, determining that the current timer does not arrive.

In the embodiment of the invention, the intelligent equipment determines the arrival state of the timer according to the current state bit of the timer, thereby more conveniently and directly determining whether the timer finishes timing and improving the control efficiency.

In an optional embodiment, the touch control device further comprises a timer, configured to reset after the processor responds to the first touch control instruction.

In the embodiment of the invention, the intelligent device indicates that the timer is reset after responding to the first touch instruction, namely, the timer is restarted to count or count down, so that preparation is made for checking the state of the timer in the subsequent steps, the problem of response disorder is effectively avoided, and the control efficiency is improved.

In a second aspect, an embodiment of the present invention further provides a response method, which is applied to an intelligent device, and display content of the intelligent device is synchronized to a control device. The method comprises the following steps:

the intelligent device receives a first touch instruction from the control device, wherein at the receiving moment of the first touch instruction, the intelligent device determines whether a current timer is reached. Further, when the timer is reached, the smart device responds to the first touch instruction.

Further, in an optional embodiment, when the timer does not arrive, the intelligent device determines whether the control device of the first touch instruction and the control device corresponding to the historical touch instruction are the same control device. The historical touch instruction is a touch instruction received within a set time period before the first touch instruction is received. Further, when the control device is judged to be the same, the intelligent device responds to the first touch instruction.

Further, in an optional embodiment, when it is determined that the device is a different control device, the smart device does not respond to the first touch instruction.

In an optional embodiment, the number of pulled streaming media data is monitored, and the control device connected to the intelligent device is determined to be at least two control devices according to the number of pulled streaming media data.

In an alternative embodiment, the smart device determining whether the current timer has arrived includes:

when the current state position of the timer is set as a first state position, determining that the current timer arrives; and when the current state bit of the timer is the second state bit, determining that the current timer does not arrive.

In an alternative embodiment, when the timer reaches, the smart device resets the timer after the smart device responds to the first touch command.

In a third aspect, an embodiment of the present invention further provides an intelligent device, where display content of the intelligent device is synchronized to a control device, including: the receiver is used for receiving a first touch instruction from the control equipment. The processor is configured to: and judging whether the time difference between the first touch instruction and the historical touch instruction is greater than or equal to a set threshold value, and responding to the first touch instruction when the time difference is greater than or equal to the set threshold value.

In an alternative embodiment, the processor is further configured to: and when the time difference is smaller than the set threshold, further judging whether the source control device of the first touch instruction and the source control device of the historical touch instruction are the same control device, and responding to the first touch instruction when the source control device of the first touch instruction and the source control device of the historical touch instruction are the same control device.

In an alternative embodiment, the processor is further configured to: when the control device is different, the intelligent device does not respond to the first touch instruction.

In a fourth aspect, an embodiment of the present invention further provides a response method applied to an intelligent device, where display content of the intelligent device is synchronized to a control device. The method comprises the following steps: the intelligent device receives a first touch instruction from the control device, and judges whether the time difference between the first touch instruction and the historical touch instruction is larger than or equal to a set threshold value. Further, when the time difference is greater than or equal to the set threshold, the intelligent device responds to the first touch instruction.

In an optional embodiment, when the time difference is smaller than the set threshold, the intelligent device determines whether the control device of the first touch instruction is the same as the control device corresponding to the historical touch instruction, and when the control device of the first touch instruction is the same, the intelligent device responds to the first touch instruction.

In an alternative embodiment, when the control device is a different control device, the smart device does not respond to the first touch instruction.

In a fifth aspect, an embodiment of the present invention further provides an electronic device, including at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores a program executable by the at least one processor, the program being executable by the at least one processor to enable the at least one processor to perform the method as above.

In a sixth aspect, embodiments of the present invention also provide a non-transitory computer-readable storage medium storing a computer program, where the computer program is used to make a computer execute the above method.

In the embodiment of the invention, the control equipment determines whether to respond to the touch instruction or not according to the state of the timer and the source control equipment of the touch instruction, so that the control equipment can only respond to one control equipment in a short time, and the problem that in the prior art, the intelligent equipment responds to the received touch instructions from a plurality of control equipment in a short time, so that a user does not know whether to successfully send the touch instruction or not and thinks that the response of the control equipment is mistaken as disordered is solved. In addition, because the control device synchronizes the display screen picture to the connected control device through the streaming media data service, the user can directly perform touch screen operation on the display screen of the control device to generate a touch screen instruction, for example, the user slides up and down on the right side of the display screen to generate a touch instruction for increasing or decreasing the volume, thereby conveniently and flexibly realizing the control of the intelligent device.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1 is a schematic diagram of a system architecture of an application scenario according to an embodiment of the present invention;

fig. 2 is a schematic diagram of a hardware structure of an intelligent device according to an embodiment of the present invention;

FIG. 3 is a block diagram illustrating an operating system according to an embodiment of the present invention;

fig. 4 is a schematic diagram of a client according to an embodiment of the present invention;

fig. 5 is a schematic flow chart of a response method according to an embodiment of the present invention;

FIG. 6 is a flow chart of another response method according to an embodiment of the present invention;

fig. 7 is a schematic structural diagram of an intelligent device according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of an intelligent device according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Referring to fig. 1, a system architecture diagram of an application scenario is shown, which includes an intelligent device 20, a control device 10 and a control device 11.

The control device 10 and the control device 11 may be electronic devices such as mobile phones, tablet computers or dedicated handheld devices that have wireless communication functions and support touch screen operations.

The intelligent device 20 may be an electronic device supporting wireless communication connection, such as a projector and an intelligent television, for displaying, and the intelligent device 20 may also be a set of electronic devices that receive a control signal through a set-top box and display through a display screen, such as a television and a screen projector. Illustratively, the smart device may be a digital television, a web television, an Internet Protocol Television (IPTV), or the like.

It should be noted that, although only one intelligent device and two control devices are shown in fig. 1, in the embodiment of the present invention, the same intelligent device may send streaming media data to multiple control devices at the same time, that is, the same control device may receive streaming media data sent by multiple intelligent devices, and multiple control devices may send a touch instruction to the same intelligent device.

In order to make the description of the embodiments of the present application clearer, the applicant further describes the scenario, and it is understood that the following description is only one of the embodiments and does not limit the present solution.

The smart device 20 also performs data communication with the control device 10 and the control device 11 by a plurality of communication methods. The smart device 20 may be enabled to communicate over a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The user can send a touch instruction to the smart device 20 through the control device 10 and the control device 11 to control the smart device 20.

For example, the smart device 20 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library, etc.

In the embodiment of the present application, the smart device 20 includes: a receiver 201, a processor 254, and a display 275. The display 275 may be a liquid crystal display, an organic light emitting display, or a projection device, among others. The type, size, resolution, etc. of the particular display screen are not limited.

A hardware configuration block diagram of the smart device 20 is exemplarily shown in fig. 2. As shown in fig. 2, the smart device 20 may include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a video processor 270, a display 275, an audio processor 280, an audio output interface 285, and a power supply 290.

The tuner demodulator 210 receives broadcast television signals by wire or wirelessly, and may perform modulation and demodulation processes such as amplification, mixing, and resonance, and is configured to demodulate audio/video signals carried in a frequency of a television channel selected by a user and additional information (e.g., Electrical Program Guide (EPG) data) from a plurality of wireless or wire broadcast television signals.

The tuner demodulator 210 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by the controller 250.

The tuner demodulator 210 may receive signals according to different broadcasting systems of the smart device signals, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.

In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. Thus, the set-top box outputs the signal after modulation and demodulation, and the signal is input to the display 275 through the external device interface 240.

The communicator 220, which may be the receiver 201 of the smart device 20, is a component for communicating with an external device or an external server according to various communication protocol types. For example, the smart device 20 may transmit the content data to an external device such as the control device 10, the control device 11, etc. connected via the communicator 220 or browse and download the content data from an external device connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive control signals, such as touch commands, of the control device 10 and the control device 11 according to the control of the controller 250. And the control signal is realized as a WIFI signal, a Bluetooth signal, a radio frequency signal and the like.

The detector 230, the components of the smart device 20 for collecting signals of the external environment or interaction with the outside. The detector 230 may include a sound collector 231, such as a microphone, which may be used to receive the sound of the user, such as a voice signal of a control instruction of the user controlling the smart device 20; alternatively, ambient sounds may be collected for identifying the type of ambient scene, enabling the smart device 20 to adapt to ambient noise. The detector 230 may include an image collector 232 for collecting images of the external environmental scene.

In some other exemplary embodiments, the detector 230, which may be a camera, a video camera, or the like, is used to capture external environment scenes to adaptively change the display parameters of the smart device 20; and functions for collecting attributes of the user to enable interaction between the smart device 20 and the user.

In other exemplary embodiments, the detector 230 may further include a light receiver for collecting ambient light intensity to adapt to changes in display parameters of the display screen 275, and the like.

In some other exemplary embodiments, the detector 230, may further include a temperature sensor, such as by sensing an ambient temperature, and the smart device 20 may adaptively adjust a display color temperature of the image of the display screen 275. For example, when the temperature is higher, the display screen 275 may be adjusted to display a cool color tone; when the temperature is lower, the display screen 275 can be adjusted to display a warmer color temperature of the image.

The external device interface 240 is a component for providing the controller 250 to control data transmission between the display 275 and an external device. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.

The controller 250 controls the operation of the smart device 20 and responds to the user's operations by running various software control programs (e.g., an operating system and various application programs) stored on the memory 260.

As shown in fig. 2, the controller 250 includes a Random Access Memory (RAM)251, a Read Only Memory (ROM)252, a graphics processor 253, a processor 254, a communication interface 255, and a communication bus 256. The RAM251, the ROM252, the graphic processor 253, the processor 254, and the communication interface 255 may be connected by a communication bus 256.

The ROM252 stores various system boot instructions. When the power-on signal is received, the smart device 20 starts to boot, and the processor 254 executes the system boot instruction in the ROM252 and copies the operating system stored in the memory 260 to the RAM251 to start running the boot operating system. After the start of the operating system is completed, the processor 254 copies the various applications in the memory 260 to the RAM251 and then starts running the various applications.

And a graphic processor 253 for generating various graphic objects such as icons, operation menus, and user input instruction display graphics, etc. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.

A processor 254 for executing operating system and application program instructions stored in memory 260. And according to the touch instructions received by the receiver 201 from the control device 10 and the control device 11, processing of various applications, data and contents is performed, so as to finally display and play various audio and video contents.

In some demonstrative embodiments, processor 254 may include a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of the smart device 20 in the display preloading mode and/or operations of displaying a screen in the normal mode. A plurality of or a sub-processor for performing an operation in a display standby mode or the like.

The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

The controller 250 may control the overall operation of the display 275. For example: in response to receiving a user's touch instruction for selecting a GUI object displayed on the display screen 275, the controller 250 may perform an operation related to the object selected by the user's input of the touch instruction.

Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the smart device 20 or a touch instruction received by the receiver 201 from the control device.

A memory 260 for storing various types of data, software programs, or applications that drive and control the operation of the smart device 20. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the smart device 20.

In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 in the smart device 20; various application programs built in the storage display 275 and downloaded by the user from an external device; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.

In some embodiments, the memory 260 is specifically configured to store drivers and related data for the tuner demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, and the like, such as external data (e.g., audio-video data) received from the external device interface or user data (e.g., touch information, text information, touch instructions, etc.) received by the receiver 201.

In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.

In fig. 2, the communicator 220 may be used as a receiver 201 for receiving various touch commands from the control device. Specifically, the method is used for sending a touch instruction of the user to the controller 250, or transmitting output streaming media data from the controller 250 to the user. For example, the control device 10 and the control device 11 may send the touch instruction input by the user to the communicator 220, and then forward the touch instruction to the controller 250; further, the control device 10, the control device 11 may receive streaming media data or the like output from the communicator 220 processed by the controller 250.

In some embodiments, the video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display screen 275.

Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.

And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

And a display screen 275 for receiving the image signal from the video processor 270 and displaying the video content, the image and the menu manipulation interface. The display video content may be from the video content in the broadcast signal received by the tuner-demodulator 210, or from the video content input by the communicator 220 or the external device interface 240.

And, the display screen 275 may include a display component for presenting a picture and a driving component for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided that the display screen 275 is a projection display.

The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.

Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.

The audio output interface 285 is used for receiving an audio signal output by the audio processor 280 under the control of the controller 250, and the audio output interface 285 may include a speaker 286 or an external sound output terminal 287, such as an earphone output terminal, for outputting to a generating device of an external device.

In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.

And a power supply 290 for providing power supply support for the smart device 20 by the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the smart device 20, or may be a power supply installed outside the smart device 20.

A block diagram of the architectural configuration of the operating system in the memory of the smart device 20 is illustrated in fig. 3. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.

The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer. Is responsible for direct interaction with the user. The application layer may include a plurality of applications such as a setup application, a post application, a media center application, and the like. These applications may be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML5, Cascading Style Sheets (CSS), and JavaScript.

Here, HTML, which is called HyperText Markup Language (HyperText Markup Language), is a standard Markup Language for creating web pages, and describes the web pages by Markup tags, where the HTML tags are used to describe characters, graphics, animation, sound, tables, links, etc., and a browser reads an HTML document, interprets the content of the tags in the document, and displays the content in the form of web pages.

CSS, known as Cascading Style Sheets (Cascading Style Sheets), is a computer language used to represent the Style of HTML documents, and may be used to define Style structures, such as fonts, colors, locations, etc. The CSS style can be directly stored in the HTML webpage or a separate style file, so that the style in the webpage can be controlled.

JavaScript, a language applied to Web page programming, can be inserted into an HTML page and interpreted and executed by a browser. The interaction logic of the Web application is realized by JavaScript. The JavaScript can package a JavaScript extension interface through the browser to realize communication with the kernel layer.

The middleware layer may provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.

The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..

In a possible embodiment, the smart device 20 installs a touch service, and the control device 10 installs a client corresponding to the touch service, namely a touch application APP 101, as shown in fig. 4. After the intelligent device 20 is operated, the touch service starts a device search service and a streaming media service by default. Specifically, the device search service is used for searching for a control device in a local area network to which the smart device 20 is connected, for example, the smart device 20 searches for the control device 10 and the control device 11 in the same local area network through the device search service; the streaming media service is configured to intercept display content of the display screen 275 of the intelligent device 20 in real time, and may further send corresponding streaming media data to the control device 10 and the control device 11 connected to the intelligent device 20 through the WIFI module 221 of the communicator 220 by the streaming media service. Meanwhile, the smart device 20 starts a touch instruction response service, receives touch instructions sent by the control device 10 and the control device 11, and processes the touch instructions.

After a user opens the touch APP 101, the control device, such as the control device 10, automatically searches for the smart device in the current local area network. Illustratively, the user clicks on the searched smart device 20, and the control device 10 connects with the smart device 20. Furthermore, the intelligent device 20 sends the display content of the display screen 275 to the control device 10 in the format of streaming media data, and after receiving the display content, the control device 10 plays the display content in real time according to the streaming media data, so as to realize the picture synchronization with the intelligent device 20. Through the above-mentioned picture synchronization operation, realize synchronizing the display content of intelligent device 20 to control device 10 in real time, for the user controls intelligent device 20 through control device 10 and makes preparations in subsequent step, and the user carries out touch operation through the synchronous picture to showing on touch APP 101, can help the user to control intelligent device 20 more conveniently high-efficiently.

In a possible embodiment, the intelligent device 20 monitors the pulling amount of the streaming media data, determines at least two control devices connected to the intelligent device according to the pulling amount of the streaming media data, that is, periodically detects the transmission amount of the streaming media data in the communicator 220, determines the connected control devices according to the transmission amount, and further sets a response mode of the intelligent device to the touch screen instruction according to the connection amount. Alternatively, the smart device 20 does not limit the number of connected control devices 10. Optionally, the smart device 20 may also determine the connected control device according to the received connection request.

In a possible embodiment, a user may perform a touch screen operation on a synchronous screen in the touch APP 101 on the control device 10, and further the control device 10 generates a corresponding touch instruction and sends the touch instruction to the smart device 20, and the smart device 20 processes the touch instruction.

Further, the smart device 20 responds to the received touch command according to the number of connected control devices. Specifically, in one possible embodiment, when the number of control devices connected to the smart device 20 is 0 or 1, the smart device 20 does not make any limitation on the touch operation, and directly responds after receiving the touch instruction.

Illustratively, the smart device 20 is only connected to the control device 10, and when the user slides upwards on the left area of the synchronous screen on the touch APP 101 of the control device 10, the control device 11 correspondingly generates a touch instruction of "increasing the brightness of the display screen" and sends the touch instruction to the smart device 20. In another possible embodiment, the control device 10 may send touch screen data corresponding to a touch screen operation of "sliding left area up" by the user to the smart device 20, and the smart device 20 generates a touch instruction according to the touch screen data and then performs subsequent processing.

In another possible embodiment, when the number of control devices connected to the smart device 20 is greater than 1, for example, the smart device 20 detects that the control device 10 and the control device 11 are currently connected to itself. According to the prior art, when a plurality of users control the smart device 20 in a short time through different control devices, the problem of response disorder of the smart device 20 may occur. That is, when there are a plurality of control devices to which the smart device 20 is connected, the following response method needs to be performed.

In order to solve this problem, an embodiment of the present invention provides a response method, and as shown in fig. 5, the response method provided by the embodiment of the present invention includes the following steps:

in step 501, the smart device 20 receives a first touch instruction from the control device 10.

Illustratively, the control device 10 and the control device 11 are connected with the smart device 20, and the display screen of the smart device 20 is synchronized to the client of the control device 10 and the control device 11 in real time. When the user performs a touch screen operation on the client of the control device 10, that is, in the synchronous frame on the touch APP 101, for example, the user slides upwards on the left side of the screen, the control device 10 correspondingly generates a first touch instruction "increase the brightness of the display screen" and sends the first touch instruction to the smart device 20 through the communicator 220.

Step 502, the smart device 20 determines whether the current timer arrives at the receiving time of the first touch instruction; when the timer is reached, go to step 503; when the timer has not been reached, step 504 is entered.

Illustratively, the communicator 220 of the smart device 20 further checks the status of the current timer after receiving the first touch command of "increase display screen brightness". In the embodiment of the present invention, when the number of the control devices connected to the smart device 20 is greater than 1, the smart device 20 determines whether a touch instruction has been successfully responded in a short time by checking the state of the timer, so as to avoid that the smart device 20 responds to a plurality of touch instructions from different control devices in a short time, and avoid the problem of response disorder.

In step 503, the smart device 20 responds to the first touch instruction.

Illustratively, the smart device 20 responds to the first touch command of "increase the brightness of the display screen" when it determines that the current timer status is reached, i.e. the timer has timed out and the status bit is 0. Further, the processor 254 in the controller 250 of the smart device 20 instructs the display 275 to execute a first touch command of "increase display screen brightness", increasing the brightness. In the implementation of the present invention, when the smart device 20 determines that the timer is reached, the first touch instruction is executed, so as to respond to the user and improve the control efficiency.

Step 504, the smart device 20 determines whether the control device 10 of the first touch instruction is the same control device 10 as the control device 10 corresponding to the historical touch instruction, where the historical touch instruction is a touch instruction received within a set time period before the first touch instruction is received; when the control device 10 is the same, step 503 is entered; when the device is not the same device, step 505 is entered.

Illustratively, when the smart device 20 determines that the timer has not arrived, the control device 10 corresponding to the current first touch instruction is further compared with the historical touch instruction, that is, the control device corresponding to the last responded touch instruction within the set time, and then whether to process the current first touch instruction is further determined according to the comparison result, so that multiple touch instructions from different control devices are prevented from being executed within a short time by the timer, the problem of response disorder is further avoided, and the control efficiency is improved.

In step 505, the smart device 20 does not respond to the first touch instruction.

Illustratively, when the smart device 20 determines that the control device is a different control device, it does not respond to the first touch instruction, and discards the touch instruction. In the embodiment of the present invention, the smart device 20 compares the historical touch instruction with the corresponding control device of the current touch instruction, and abandons the response when the control device does not respond at the same time, so as to effectively avoid the problem of response disorder and improve the response efficiency.

In one possible embodiment, the smart device 20 resets the timer after each touch command response. Illustratively, the smart device 20 instructs a timer to reset after responding to the first touch instruction. Further, when the timer status bit is the first status bit, it is determined that the current timer has arrived. And when the timer status bit is the second status bit, determining that the current timer does not arrive. For example, a timer is set to count down for 3 seconds, and if the 3 seconds are over, that is, the timer arrives, the status bit is 0; otherwise the status bit is 1.

Further, in order to solve the problem of the response disorder, based on the above description, an embodiment of the present invention further provides a response method, as shown in fig. 6, the response method provided by the embodiment of the present invention includes the following steps:

in step 601, the smart device 20 receives a first touch instruction from the control device 10.

Step 602, the smart device 20 determines, at the time of receiving the first touch instruction, whether a time difference between the first touch instruction and the historical touch instruction is greater than or equal to a set threshold, and if so, goes to step 603; if not, go to step 604.

Illustratively, the communicator 220 of the smart device 20 further looks at the time difference between the current touch instruction and the historical touch instruction after receiving the first touch instruction of "increase display screen brightness". In the embodiment of the present invention, when the number of the control devices connected to the intelligent device 20 is greater than 1, the intelligent device 20 determines whether a touch instruction has been successfully responded in a short time by checking the time difference, so as to avoid that the intelligent device 20 responds to a plurality of touch instructions from different control devices in a short time, and avoid the problem of response disorder.

In step 603, the smart device 20 responds to the first touch instruction.

Illustratively, the smart device 20 responds to the current "increase the brightness of the display screen" first touch command when the time difference is determined to be greater than or equal to the set threshold, that is, no touch command is responded in a short time. Further, the processor 254 in the controller 250 of the smart device 20 instructs the display 275 to execute a first touch command of "increase display screen brightness", increasing the brightness. In the implementation of the present invention, when the time difference is determined to be greater than or equal to the set threshold, the smart device 20 executes the first touch instruction, so as to respond to the user and improve the control efficiency.

Step 604, the smart device 20 determines whether the control device 10 of the first touch instruction and the source control device of the historical touch instruction are the same control device; when the control device is the same, go to step 603; when the devices are not the same device, step 605 is entered.

In step 605, the smart device 20 does not respond to the first touch command.

Illustratively, when the smart device 20 determines that the control device is a different control device, it does not respond to the first touch instruction, and discards the touch instruction. In the embodiment of the present invention, the smart device 20 compares the historical touch instruction with the source device of the current touch instruction, and abandons the response when the source device is different, so as to effectively avoid the problem of response disorder and improve the response efficiency.

An embodiment of the present invention further provides an intelligent device, as shown in fig. 7, including:

the receiver 701 receives a first touch instruction from a control device. The processor 702 is configured to determine whether the current timer arrives at the time of receiving the first touch instruction, and further, when the timer arrives, respond according to the first touch instruction.

An embodiment of the present invention further provides an intelligent device, as shown in fig. 8, including:

the receiver 801 is configured to receive a first touch instruction from a control device. The processor 802 is configured to: and judging whether the time difference between the first touch instruction and the historical touch instruction is greater than or equal to a set threshold value, and responding to the first touch instruction when the time difference between the first touch instruction and the historical touch instruction is determined to be greater than or equal to the set threshold value.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A smart device whose display content is synchronized to a control device, comprising:

the receiver is used for receiving a first touch instruction from the control equipment;

a processor configured to:

determining whether a current timer arrives at the receiving moment of the first touch instruction; responding to the first touch instruction when the timer is reached; when the timer does not arrive, judging whether the control equipment and the control equipment corresponding to the historical touch instruction are the same control equipment or not, wherein the historical touch instruction is a touch instruction received within a set time period before the first touch instruction is received; when the first touch control command is the same control equipment, responding to the first touch control command; when the control device is different, the first touch instruction is not responded.

2. The smart device of claim 1, wherein the processor is further configured to:

monitoring the pulling quantity of the streaming media data, and determining that the control equipment connected with the intelligent equipment is at least two control equipment according to the pulling quantity of the streaming media data.

3. The smart device of claim 1, wherein the processor is configured to:

when the current state position of the timer is set as a first state position, determining that the current timer arrives;

and when the current state bit of the timer is the second state bit, determining that the current timer does not arrive.

4. The smart device of claim 1, wherein the processor is further configured to:

resetting the timer after responding to the first touch instruction.

5. A response method applied to an intelligent device, the display content of which is synchronized to a control device, the response method comprising:

receiving a first touch instruction from the control equipment;

determining whether a current timer arrives at the receiving moment of the first touch instruction;

responding to the first touch instruction when the timer is reached; when the timer does not arrive, judging whether the control equipment and the control equipment corresponding to the historical touch instruction are the same control equipment or not, wherein the historical touch instruction is a touch instruction received within a set time period before the first touch instruction is received; when the first touch control command is the same control equipment, responding to the first touch control command; when the control device is different, the first touch instruction is not responded.

6. A smart device whose display content is synchronized to a control device, comprising:

a processor configured to:

judging whether the time difference between the first touch instruction and the historical touch instruction is larger than or equal to a set threshold value or not;

responding to the first touch instruction when the time difference is larger than or equal to a set threshold;

when the time difference is smaller than the set threshold, judging whether the control equipment and the control equipment corresponding to the historical touch instruction are the same control equipment or not; when the first touch control command is the same control equipment, responding to the first touch control command; when the control device is different, the first touch instruction is not responded.

7. A response method applied to an intelligent device, the display content of which is synchronized to a control device, the response method comprising:

receiving a first touch instruction from the control equipment;