Nothing Special   »   [go: up one dir, main page]

CN113742609A - Display device and method for guiding voice search function - Google Patents

Display device and method for guiding voice search function Download PDF

Info

Publication number
CN113742609A
CN113742609A CN202010460795.XA CN202010460795A CN113742609A CN 113742609 A CN113742609 A CN 113742609A CN 202010460795 A CN202010460795 A CN 202010460795A CN 113742609 A CN113742609 A CN 113742609A
Authority
CN
China
Prior art keywords
search
display
control
guidance
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010460795.XA
Other languages
Chinese (zh)
Inventor
李巧眉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Juhaokan Technology Co Ltd
Original Assignee
Juhaokan Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Juhaokan Technology Co Ltd filed Critical Juhaokan Technology Co Ltd
Priority to CN202010460795.XA priority Critical patent/CN113742609A/en
Priority to PCT/CN2021/081253 priority patent/WO2021197068A1/en
Publication of CN113742609A publication Critical patent/CN113742609A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9538Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a display device and a method for guiding a voice search function, comprising the following steps: a display; a controller communicatively coupled to the display, the controller configured to: receiving an operation instruction and determining a target search word; acquiring search result data according to the target search word; controlling a display to display a search result control according to the search result data; receiving selection of a first control in the search result controls by a user, and acquiring first media asset data from the server; when the time interval from the last time of guidance prompt meets the triggering condition, displaying a playing interface according to the first media asset data, and performing guidance prompt according to the guidance statement; and when the time interval from the last time of guidance prompt does not meet the trigger condition, displaying a playing interface according to the first media asset data. Thus, in the application, when the user uses the search function, the user is reminded to use the voice search through the periodic guidance prompt, and the frequency of using the voice search by the user is increased.

Description

Display device and method for guiding voice search function
Technical Field
The present application relates to the field of television technologies, and in particular, to a display device and a method for guiding a voice search function.
Background
The intelligent television is a television product which can realize the bidirectional human-computer interaction function and integrates various functions of video, entertainment, data and the like. The user interface of the smart television is used as a medium for interaction and information exchange between the smart television and a user, and various application programs such as audio and video, entertainment and the like are correspondingly displayed in order to meet the diversified requirements of the user.
In order to facilitate users to search favorite media resources for watching, a search function is usually provided in the smart television. At present, the search function develops manual search and voice search in turn. The manual search means that a user inputs the first letter or pinyin of the media asset to be searched in a search interface by using a remote controller for retrieval, the operation is complex, and when only the first letter is input, the solution of the search intention of the user by the smart television is not accurate enough. The voice search refers to that a user sends a voice search command of media assets to be searched to the smart television through a remote controller and other equipment, the operation is simple, and the search result is accurate. But at present, most users are in the first place and are accustomed to using the traditional manual search function and neglecting the voice search function.
Disclosure of Invention
The application provides a display device and a guiding method of a voice search function, and aims to solve the technical problem that users neglect to use the voice search function in the prior art.
In order to solve the technical problem, the embodiment of the application discloses the following technical scheme:
in a first aspect, an embodiment of the present application discloses a display device, where the display device includes:
a display;
a controller communicatively coupled with the display, the controller configured to:
receiving an operation instruction and determining a target search word;
sending a search request containing the target search word to a server, wherein the server is used for feeding back search result data according to the target search word;
controlling the display to display a search result control according to the search result data;
receiving selection of a user on a first control in the search result control, and sending a media resource request containing a first identifier to the server, wherein the server is used for feeding back first media resource data to the controller according to the first identifier in the media resource request;
when the time interval from the last time of guidance prompt meets the triggering condition, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to a guidance statement, wherein the guidance statement is generated according to the first identifier;
and when the time interval from the last time of guidance prompt does not meet the trigger condition, displaying a playing interface according to the received first media asset data, and not performing guidance prompt.
In a second aspect, an embodiment of the present application discloses a display device, including:
a display;
a controller communicatively coupled with the display, the controller configured to:
receiving a selection operation of a virtual keyboard control in a search interface in the search interface, and determining a target search word;
sending a search request containing the target search word to a server, wherein the server is used for feeding back search result data according to the target search word;
controlling the display to display a search result control according to the search result data;
receiving selection of a user on a first control in the search result control, and sending a media resource request containing a first identifier to the server, wherein the server is used for feeding back first media resource data to the controller according to the first identifier in the media resource request;
when user operation meets a trigger condition in periodic detection, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to a guidance statement, wherein the guidance statement is generated according to the first identifier;
and when the user operation does not meet the triggering condition in the periodic detection, displaying a playing interface according to the received first media asset data without guidance prompt.
In a third aspect, an embodiment of the present application discloses a method for guiding a voice search function, where the method includes:
receiving an operation instruction and determining a target search word;
sending a search request containing the target search word to a server, wherein the server is used for feeding back search result data according to the target search word;
controlling a display to display a search result control according to the search result data;
receiving selection of a user on a first control in the search result control, and sending a media resource request containing a first identifier to the server, wherein the server is used for feeding back first media resource data to the controller according to the first identifier in the media resource request;
when the time interval from the last time of guidance prompt meets the triggering condition, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to a guidance statement, wherein the guidance statement is generated according to the first identifier;
and when the time interval from the last time of guidance prompt does not meet the trigger condition, displaying a playing interface according to the received first media asset data, and not performing guidance prompt.
In a fourth aspect, an embodiment of the present application discloses a method for guiding a voice search function, where the method includes:
receiving a selection operation of a virtual keyboard control in a search interface in the search interface, and determining a target search word;
sending a search request containing the target search word to a server, wherein the server is used for feeding back search result data according to the target search word;
controlling a display to display a search result control according to the search result data;
receiving selection of a user on a first control in the search result control, and sending a media resource request containing a first identifier to the server, wherein the server is used for feeding back first media resource data to a controller according to the first identifier in the media resource request;
when user operation meets a trigger condition in periodic detection, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to a guidance statement, wherein the guidance statement is generated according to the first identifier;
and when the user operation does not meet the triggering condition in the periodic detection, displaying a playing interface according to the received first media asset data without guidance prompt.
Compared with the prior art, the beneficial effect of this application is:
when a user receives an operation instruction into the display device, the controller determines a target search word according to the operation instruction and sends a search request containing the target search word to the server, so that the server can find search result data according to the target search word. The controller displays a search result control on the display according to search result data fed back by the server, the search result control comprises a plurality of controls, and a user can select the first control according to any viewing requirement. The controller sends the first media asset request containing the first identifier to the server so that the server feeds back the first media asset data according to the media asset request. The controller detects a time interval from the last time of the guidance prompt, if the time interval meets the trigger condition, the controller displays a playing interface according to the first media data and conducts the guidance prompt according to the guidance statement, and if the time interval does not meet the trigger condition, the controller displays the playing interface only according to the first media data and does not conduct the guidance prompt. Therefore, when the user uses the search function, the user is reminded of using the voice search periodically through the guidance prompt, so that the user is reminded of using the voice search function, and the number of times that the user uses the voice search is increased.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is an application scenario diagram of a display device according to some embodiments of the present application;
fig. 2 is a block diagram of a hardware configuration of the control device 100 in fig. 1 according to some embodiments of the present disclosure;
fig. 3 is a block diagram of a hardware configuration of the display apparatus 200 of fig. 1 according to some embodiments of the present disclosure;
FIG. 4 is a block diagram of an architectural configuration of an operating system in a memory of a display device 200, provided in some embodiments of the present application;
FIG. 5 is a flow chart illustrating a method for guiding a voice search function according to some embodiments of the present disclosure;
FIG. 6 is a schematic illustration of a search interface provided in some embodiments of the present application;
FIG. 7 is a display diagram of a media asset detail page provided in some embodiments of the present application;
FIG. 8 is a flow chart illustrating another method for guiding a voice search function provided in some embodiments of the present application;
FIG. 9 is a schematic diagram of a voice-guided floating layer shown on a display in some embodiments of the present application;
FIG. 10 is a schematic diagram of a search interface including a voice prompt control shown on a display in some embodiments of the present application;
fig. 11 is a timing diagram illustrating a guidance of a voice search function between a display device and a server according to some embodiments of the present disclosure.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
When the user watches the assets through the display equipment, the user can search the assets which the user wants to watch through the search function in the display equipment. For the manual search and the voice search developed at present, most users are still used to select the manual search with complicated operation. Based on this, the embodiment of the application provides a display device and a guiding method of a voice search function.
Referring to fig. 1, an application scenario diagram of a display device according to some embodiments of the present application is provided. As shown in fig. 1, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.
Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.
The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.
The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.
For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200 to implement the functions of the physical keys as arranged in the remote control 100A by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.
The display apparatus 200 may provide a network television function of a broadcast receiving function and a computer support function. The display device may be implemented as a digital television, a web television, an Internet Protocol Television (IPTV), or the like.
The display device 200 may be a liquid crystal display, an organic light emitting display, a projection device. The specific display device type, size, resolution, etc. are not limited.
The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.
Fig. 2 is a block diagram illustrating the configuration of the control device 100. As shown in fig. 2, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, a user output interface 150, and a power supply 160.
The controller 110 includes a Random Access Memory (RAM)111, a Read Only Memory (ROM)112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.
Illustratively, when an interaction of a user pressing a key disposed on the remote controller 100A or an interaction of touching a touch panel disposed on the remote controller 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.
And a memory 120 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 120 may store various control signal commands input by a user.
The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the control apparatus 100 transmits a control signal (e.g., a touch signal or a button signal) to the display device 200 via the communicator 130, and the control apparatus 100 may receive the signal transmitted by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.
The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling the display apparatus 200 to the control apparatus 100 through voice, touch, gesture, press, and the like.
The user output interface 150 outputs a user instruction received by the user input interface 140 to the display apparatus 200, or outputs an image or voice signal received by the display apparatus 200. Here, the user output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting images, and the like. For example, the remote controller 100A may receive an output signal such as audio, video, or data from the user output interface 150 and display the output signal in the form of an image on the display 154, an audio on the sound output interface 153, or a vibration on the vibration interface 152.
And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.
A hardware configuration block diagram of the display device 200 is exemplarily shown in fig. 3. As shown in fig. 3, the display apparatus 200 may include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, an audio processor 280, an audio output interface 285, and a power supply 290.
The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).
The tuner demodulator 210 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by the controller 250.
The tuner demodulator 210 can receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.
In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.
The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.
The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's sound, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.
In some other exemplary embodiments, the detector 230, which may further include an image collector 232, such as a camera, a video camera, etc., may be configured to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user.
In some other exemplary embodiments, the detector 230 may further include a light receiver for collecting the intensity of the ambient light to adapt to the display parameter variation of the display device 200.
In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.
The external device interface 240 is a component for providing the controller 250 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.
The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.
The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.
As shown in fig. 3, the controller 250 includes a Random Access Memory (RAM)251, a Read Only Memory (ROM)252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. The RAM251, the ROM252, the graphic processor 253, and the CPU processor 254 are connected to each other through a communication bus 256 through a communication interface 255.
The ROM252 stores various system boot instructions. When the display apparatus 200 starts power-on upon receiving the power-on signal, the CPU processor 254 executes a system boot instruction in the ROM252, copies the operating system stored in the memory 260 to the RAM251, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 254 copies the various application programs in the memory 260 to the RAM251 and then starts running and starting the various application programs.
And a graphic processor 253 for generating various graphic objects such as icons, operation menus, and user input instruction display graphics, etc. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.
A CPU processor 254 for executing operating system and application program instructions stored in memory 260. And according to the received user input instruction, processing of various application programs, data and contents is executed so as to finally display and play various audio-video contents.
In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of the display apparatus 200 in the display apparatus preload mode and/or operations of displaying a screen in the normal mode. A plurality of or one sub-processor for performing an operation in a state of a standby mode or the like of the display apparatus.
The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.
The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.
Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.
A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.
In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.
In some embodiments, memory 260 is specifically configured to store drivers for tuner demodulator 210, communicator 220, detector 230, external device interface 240, video processor 270, display 275, audio processor 280, etc., and related data, such as external data (e.g., audio-visual data) received from the external device interface or user data (e.g., key information, voice information, touch information, etc.) received by the user interface.
In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.
A block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 4. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.
The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer. Is responsible for direct interaction with the user. The application layer may include a plurality of applications such as a setup application, a post application, a media center application, and the like. These applications may be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML5, Cascading Style Sheets (CSS), and JavaScript.
Here, HTML, which is called HyperText Markup Language (HyperText Markup Language), is a standard Markup Language for creating web pages, and describes the web pages by Markup tags, where the HTML tags are used to describe characters, graphics, animation, sound, tables, links, etc., and a browser reads an HTML document, interprets the content of the tags in the document, and displays the content in the form of web pages.
CSS, known as Cascading Style Sheets (Cascading Style Sheets), is a computer language used to represent the Style of HTML documents, and may be used to define Style structures, such as fonts, colors, locations, etc. The CSS style can be directly stored in the HTML webpage or a separate style file, so that the style in the webpage can be controlled.
JavaScript, a language applied to Web page programming, can be inserted into an HTML page and interpreted and executed by a browser. The interaction logic of the Web application is realized by JavaScript. The JavaScript can package a JavaScript extension interface through a browser, realize the communication with the kernel layer,
the middleware layer may provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.
The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.
The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..
A user interface 265 receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items.
Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.
The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.
Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.
The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.
And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.
And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.
The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.
And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.
A display 275 for receiving the image signal from the video processor 270 and displaying the video content, the image and the menu manipulation interface. The display video content may be from the video content in the broadcast signal received by the tuner-demodulator 210, or from the video content input by the communicator 220 or the external device interface 240. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.
And, the display 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided display 275 is a projection display.
The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.
Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.
The audio output interface 285 is used for receiving an audio signal output by the audio processor 280 under the control of the controller 250, and the audio output interface 285 may include a speaker 286 or an external sound output terminal 287, such as an earphone output terminal, for outputting to a generating device of an external device.
In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.
And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.
And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.
The display device can guide the voice search function for a user, and the controller in the display device is configured to execute the guide process of the voice search function and display the voice search function guide on the display. The configuration process of the controller will be described with reference to the drawings.
Referring to fig. 5, a flowchart of a guiding method of a voice search function according to some embodiments of the present application is shown. As shown in fig. 5, the guiding method includes the steps of:
s510: and receiving an operation instruction and determining a target search word.
In the embodiment of the present application, when a user has a need to search for a media asset, a search function in the display device may be found by using the remote controller, and after receiving a selection operation of a search control by the user, the controller 250 in the display device 200 controls the display 275 to jump from a currently displayed interface to a search interface, where the search interface includes a virtual keyboard control, a search input box, a search result display area, and a search result preview area. Referring to fig. 6, a search interface provided in some embodiments of the present application is illustrated. With reference to fig. 6, in the search interface, a virtual keyboard control 601 is displayed on the left side, and a search input box 602 is disposed above the virtual keyboard control 601, where the search input box 602 is used to display letters selected by the user through the virtual keyboard control 601. In addition, a search result display area 603 and a search result preview area 604 are also arranged in the search interface, the search result display area is used for displaying the media asset name associated with the target search word, and meanwhile, a search result control corresponding to the media asset name is displayed in the search result preview area 604.
In one implementation, when the focus is located at the main interface of the display, the user may move the position of the focus by pressing up, down, left, and right keys on the remote controller, move the focus onto the search control, and after clicking the confirm key, the controller controls the display to jump to the search interface. The main interface of the display comprises a status bar (Top bar), a channel bar (Tab bar) and various recommended media assets or channels, and the like, the search control is often displayed in the status bar, the focus is on the current user interface, the starting point of the operation of the user remote controller, namely the currently selected position, is similar to the mouse hovering state of the PC end. In another implementation, the user presses a voice input key on the remote controller and sends out voice information of "opening a search function", and the controller can also control the display to jump to the search interface according to the voice control of the user.
In the embodiment of the present application, the controller 250 receives a selection operation on a virtual keyboard control in the search interface, and determines a target search term. In the search interface, according to the name of the medium resource to be searched, a user selects letters in the virtual keyboard control 601 through an upper key, a lower key, a left key and a right key on a remote controller, and a target search word is determined through the selected letters.
S520: and sending a search request containing the target search word to a server, wherein the server is used for feeding back search result data according to the target search word.
In the embodiment of the present application, after determining the target search term, the controller 250 sends a search request including the target search term to the server 300, so that the server can search for relevant search result data according to the target search request, and feeds back the search result data to the controller 250.
S530: and controlling the display to display a search result control according to the search result data.
After receiving the search result data fed back by the server 300, the controller 250 displays media titles associated with the target search term in the search result presentation area 603 according to the search result data, and presents a search result control corresponding to each media title in the search result preview area 604. For example, in fig. 6, after selecting the letter m in the virtual keyboard control 601, the user displays the names of the media assets beginning with the letter m in the search result display area, such as "stuffing for beauty", "album for beauty house dish", "beauty and beast", and so on, and correspondingly displays the search result controls corresponding to "stuffing for beauty", "album for beauty house dish", "beauty and beast" in the search result preview area 604.
S540: and receiving selection of a user on a first control in the search result control, and sending a media resource request containing a first identifier to the server, wherein the server is used for feeding back first media resource data to the controller according to the first identifier in the media resource request.
In the embodiment of the present application, the user browses the display contents in the search result display area 603 and the search result preview area 604, and finds the media assets that the user wants to search. After the user determines the assets the user wants to view, a corresponding first control can be selected from a plurality of controls in the search result controls in the search preview area. After receiving the selection of the first control by the user, the controller 250 sends a media asset request containing the first identifier to the server 300, and the server 300 feeds back the first media asset data to the controller 250 according to the first identifier in the media asset request. The first identifier may be a name of the asset corresponding to the first control selected by the user, or an Identity document (ID number) of the asset corresponding to the first control selected by the user, and the server 300 may search the first asset data from the database according to the first identifier and send the first asset data to the controller 250.
S550: and when the time interval from the last time of guidance prompt meets the trigger condition, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to the guidance statement.
In this embodiment of the application, the guidance statement is generated according to the first identifier, for example, the guidance statement is determined according to a name of a medium corresponding to the first control. In one implementation, the controller 250 sends a media asset request including a first identifier to the server 300, and the server 300 may determine a name of a media asset corresponding to the first identifier according to the first identifier in the media asset request. Also, the server 300 stores a preset sentence template, for example, "the content can be searched the next time i say … …", "press the remote controller voice key … …, make the voice search more convenient", and so on. After determining the name of the medium resource, the server may nest the name of the medium resource in a preset statement template to generate a guidance statement. The server 300 simultaneously feeds back the guide sentence to the display apparatus 200 while feeding back the first asset data to the controller 250. In another implementation, when receiving a selection of a first control in the search result control by the user, the controller 250 may obtain a name of the asset corresponding to the first control. Moreover, a preset sentence template is stored in the display device 200, and after the name of the asset is determined, the controller 250 may nest the name of the asset in the preset sentence template, generate a guidance sentence, and store the guidance sentence in the display device 200.
In this embodiment of the application, the trigger condition may be set to a fixed preset duration, that is, meeting the trigger condition means: the time interval from the last guiding prompt is longer than the preset time. The controller 250 determines whether to perform the guidance display again according to the length of the time interval by detecting the time interval from the last guidance display. When the time interval from the last guidance prompt is longer than the preset time, the controller 250 displays a playing interface according to the received first media asset data, and performs guidance prompt according to the guidance statement. For example, the preset time period may be set to one week, and the controller 250 detects that the time interval from the last guidance prompt is more than one week, then the controller 250 controls the display 275 to display the playing interface and perform the guidance prompt. The guidance statement is generated according to the first identifier, for example, if the first identifier is a name of a asset corresponding to the first control, the guidance statement may include the name of the asset.
In some embodiments, the trigger condition may also be set to a preset duration that is not fixed, and at this time, meeting the trigger condition means: in the earlier stage of use of the display equipment, the time interval from the last time of guidance prompt is longer than a first preset time; and in the later use stage of the display equipment, the time interval from the last time of the guidance prompt is longer than a second preset time. When the display device 200 is just started to be used, the time interval from the last time of the guidance prompt is longer than a first preset time, or, in the later period of use of the display device 200, the time interval from the last time of the guidance prompt is longer than a second preset time, the controller 250 displays a playing interface according to the received first media asset data, and performs the guidance prompt according to the guidance statement. For example, the first preset time period may be set to be one week, and the second preset time period may be set to be half a month. In a half year after the display device 200 starts to be used, since a high frequency of guidance prompts for the user is required to prompt the user that the display device 200 has a voice search function, the controller 250 detects that the time interval from the previous guidance prompt is more than one week, and controls the display 275 to display a play interface and perform the guidance prompt. After the display device 200 is used for half a year, since the user knows that the display device 200 has the voice search function and may not be used to the voice search function, the controller 250 controls the display 275 to display the play interface and perform the guidance prompt when the time interval from the last guidance prompt is detected to be longer than half a month, so as to avoid that the frequency of the guidance prompt is too high, which brings discomfort to the user. It should be noted that, for the earlier stage and the later stage of the use of the display device, the first preset time length, the second preset time length, and the like may be set according to the use habits of most users on the display device, which is not limited herein.
In some embodiments, the first asset data includes an asset detail page corresponding to the asset selected by the user, and the controller 250 controls the play interface of the display to display the asset detail page. Referring to fig. 7, a diagram is presented of a media asset detail page provided in some embodiments of the present application. Referring to fig. 7, the media details page includes a video preview window, a details introduction of the media, a collection list of the media, and a full screen play control. When the asset detail page is displayed on the playing interface, after the user selects the full-screen playing control, the controller 250 controls the display 275 to play the asset in full screen.
In addition, for the display of the guide statement, a voice search guide control can be displayed in a floating layer above the playing interface, and the voice search guide control is used for loading and displaying the guide statement. Referring to fig. 7, the voice search guidance control comprises a small voice assistant 701 and a voice prompt box 702, the small voice assistant 701 can be set as a conspicuous cartoon animation, and a guidance sentence is loaded and displayed in the voice prompt box 702. Referring to fig. 6, if the user selects "american stuffing", the guidance sentence is set to "the content can be searched by" searching for american stuffing "the next time. Because what the display shows through the broadcast interface is the detailed page of media asset at this moment, does not play the audio frequency that the media asset corresponds, so in order to play better guide effect, this application accessible speaker pronunciation broadcast guide statement to reach the effect of the dual guide suggestion of characters pronunciation.
In other embodiments, the first asset data includes a media asset playing page corresponding to the user-selected media asset, and the controller 250 controls the playing interface of the display to display the media asset playing page. That is, when the time interval from the last guidance prompt is longer than the preset time, the controller 250 controls the play interface of the display 275 to directly play the corresponding media asset. Because the display displays the media asset playing page through the playing interface, the media asset playing is started at the moment, and then when the guiding prompt is carried out, the voice searching guiding control can be displayed only in the floating layer above the playing interface, namely, the voice small assistant and the voice prompt box play a role in guiding and prompting the user in characters.
When the guidance prompt is carried out in the application, the voice search guidance control is displayed in the floating layer above the playing interface, and/or the guidance sentence is played through the voice of the loudspeaker, namely the guidance prompt is carried out through characters and/or in a voice mode.
In the embodiment of the application, the display time of the voice search guide control can be controlled through the preset display time. The display time of the voice search guidance control can be configured in the server, for example, it can be set to 3S, that is, the floating layer for displaying the voice search guidance control can be hidden after displaying 3S, and the display 275 continues to play the user-selected media asset. Of course, when the display time is set to 0, the floating layer is not displayed.
In some embodiments, after sending the first media asset request to the server, the controller does not receive data related to the guidance statement fed back by the server after a preset timeout, and at this time, the display device may be considered to request that the guidance prompt is timed out, for example, if the display device does not receive the guidance statement within 5S, the display device may abandon the guidance prompt.
In some embodiments, the controller may actively request the server for the configuration of the preset display time and the preset timeout time after the display device is powered on. After the user opens the search interface, the controller requests the server for the relevant configuration of the voice guidance interface.
S560: and when the time interval from the last time of guidance prompt does not meet the trigger condition, displaying a playing interface according to the received first media asset data, and not performing guidance prompt.
In this embodiment of the present application, the trigger condition may be set to a fixed preset duration, that is, the trigger condition is not satisfied: the time interval from the last time of the guidance prompt is not more than the preset time. If the controller 250 detects that the time interval from the last guidance prompt is not longer than the preset time, in order to avoid too frequent guidance prompts to the user, the controller 250 only controls the display 275 to display the playing interface according to the received first media asset data, and does not perform guidance prompt. That is, the controller 250 controls only the display 275 to show a media detail page or a media play page.
In some embodiments, the trigger condition may also be set to a preset duration that is not fixed, and at this time, the trigger condition not being met refers to: in the earlier stage of use of the display equipment, the time interval from the last time of guidance prompt is not more than a first preset time; and in the later use stage of the display equipment, the time interval from the last time of the guidance prompt is not more than a second preset time. When the display device 200 is just started to be used, the time interval from the last time of the guidance prompt is not longer than the first preset time, or, in the later period of use of the display device 200, the time interval from the last time of the guidance prompt is not longer than the second preset time, the controller 250 displays the playing interface only according to the received first media asset data, and does not perform the guidance prompt.
In the above, the present application describes how to perform the guidance prompt, and next, the present application describes when to perform the guidance prompt and when not to perform the guidance prompt, that is, how to detect the time interval from the last time of performing the guidance prompt.
In the embodiment of the present application, the controller 250 determines the time interval of the last guidance prompt according to the time interval between the selection operation of the virtual keyboard control in the search interface this time and the selection operation of the virtual keyboard control in the search interface corresponding to the last guidance prompt display. The controller 250 may set a preset time period. In the search interface, a user searches for media assets by selecting the virtual keyboard control, that is, when the media assets are searched by using manual search, if the manual search operation is the first time within the preset time length, the controller 250 displays a play interface according to the received first media asset data, and performs guidance prompt according to the guidance statement. And, the controller 250 records the time of the current user's selection operation of the virtual keyboard control. When the user selects the virtual keyboard control in the search interface again, the controller 250 records a time interval between the time of the selection operation on the virtual keyboard control this time and the time of the selection operation on the virtual keyboard control corresponding to the previous guidance prompt, and determines the time interval from the previous guidance prompt according to the time interval.
For example, the controller 250 sets the preset time period to one week. If on Tuesday, the user searches for the media assets which the user wants to watch through the selection operation of the virtual keyboard control in the search interface, and the controller 250 controls the display 275 to display the play interface according to the selection operation of the user and performs guidance prompt. On saturday, the user searches for the media assets which the user wants to watch by selecting the virtual keyboard control, and since the time between saturday and tuesday is 5 days, and the time length is less than the preset time length, the controller 250 only controls the display 275 to display the playing interface, and does not perform guidance prompt. On wednesday in the second week, if the user searches for the media assets that the user wants to watch by using the selection operation of the virtual keyboard control, since the time of the wednesday is 9 days away from the wednesday, and the time is longer than the preset time, the controller 250 controls the display 275 to display the playing interface and perform guidance prompt.
In some embodiments, the controller 250 determines the time interval of the last guidance prompt according to the time interval between the current selection operation of the search control and the selection operation of the search control corresponding to the last guidance prompt display. The controller 250 may set a preset time period. After the user opens the display device 200, the user enters a search interface by selecting the search control, that is, the search function is opened, and if the operation of opening the search function is the first time within the preset time duration, the controller 250 displays a play interface according to the received first media data, and performs guidance prompt according to the guidance statement. And, the controller 250 records the time when the current user operates the search control. When the user selects the search control again, the controller 250 records a time interval between the time of the selection operation on the search control this time and the time of the selection operation on the search control corresponding to the previous guidance prompt, and determines the time interval of the previous guidance prompt according to the time interval.
For example, the controller 250 sets the preset time period to 10 days. If the user enters the search interface by selecting the search control on day 1, the controller 250 controls the display 275 to display the play interface according to the user's selection, and performs guidance prompt. On the 8 th day, the user enters the search interface by using the selection operation of the search control, and since the time interval from the 1 st day to the 8 th day is 5 days, which is less than the preset time length, the controller 250 only controls the display 275 to display the play interface, and does not perform guidance prompt. On day 12, if the user enters the search interface again by using the selection operation of the search control, since the time interval between day 1 and day 12 is 12 days, which is greater than the preset time length, the controller 250 controls the display 275 to display the play interface and perform guidance prompt.
In some embodiments, the controller 250 determines the time interval from the last time of the guidance prompt according to the time interval between the time of displaying the search interface this time and the time of displaying the search interface corresponding to the last guidance prompt. The controller 250 may set a preset time period. When the display device 200 jumps from the current display interface to the search interface, if the operation of entering the search interface is the first time within the preset time length, the controller 250 displays the play interface according to the received first media data, and performs guidance prompt according to the guidance statement. And, the controller 250 records the time when the search interface is currently displayed. When the display 275 displays the search interface again, the controller 250 records a time interval between a time when the search interface is displayed this time and a time when the search interface is displayed last time, and determines a time interval from which the guidance prompt was last performed at the time interval.
In some embodiments, the controller 250 determines the time interval from the last time of the guidance prompt according to the time interval between the selection operation of the control in the search result control this time and the selection operation of the control in the search result control corresponding to the last guidance prompt display. The controller 250 may set a preset time period. In the search interface, a user selects the media assets to be watched through the selection operation of the control in the search result control, and if the selection operation of the control in the search result control is the first time in the preset time length, the controller 250 displays the play interface according to the received first media asset data and conducts guidance prompt according to the guidance statement. And, the controller 250 records the time when the user selects the control in the search result control. When the user selects the control in the search result control again, the controller 250 records a time interval between the selection of the control in the search result control this time and the time when the selection of the control in the search result control corresponding to the guidance prompt was performed last time, and determines a time interval from the time interval when the guidance prompt was performed last time.
In some embodiments, the time interval from the last guidance prompt refers to: and the time interval between the time of receiving the operation instruction at this time and the time of receiving the operation instruction corresponding to the time of displaying the guidance prompt at the last time. When the user transmits an operation instruction to the display apparatus 200 through the remote controller, the controller 250 receives the operation instruction and records the time when the operation instruction is received. When the user sends the operation instruction again, the controller 250 records a time interval between the time of sending the operation instruction this time and the time of sending the operation instruction corresponding to the last guidance prompt, where the time interval is a time interval from the last guidance prompt.
In the method and the device, when the user uses the search function, the user is reminded of using the voice search periodically through the guidance prompt, so that the user is reminded of using the voice search function, and the number of times that the user uses the voice search is increased.
In order to further describe the guiding process of the voice search function, the embodiment of the application also provides a display device. The controller in the display device is configured to perform a guidance process for a voice search function and to present a voice search function guidance on the display. The configuration process of the controller will be described with reference to the drawings.
Referring to fig. 8, a flow chart of another guiding method for a voice search function according to some embodiments of the present application is shown. As shown in fig. 8, the guiding method includes the steps of:
s810: and receiving the selected operation of the virtual keyboard control in the search interface, and determining the target search word.
The search interface in the embodiment of the application comprises a virtual keyboard control, a search input box, a search result display area and a search result preview area. The search input box is used for displaying letters selected by a user through the virtual keyboard control, the search result display area is used for displaying the media asset name associated with the target search word, and meanwhile, the search result control corresponding to the media asset name is displayed in the search result preview area. In the present application, the controller 250 receives a selection operation of a virtual keyboard control in the search interface and determines a target search term. In the search interface, according to the name of the medium resource to be searched, a user selects letters in the virtual keyboard control through an upper key, a lower key, a left key and a right key on the remote controller, and the target search word is determined through the selected letters.
S820: and sending a search request containing the target search word to a server, wherein the server is used for feeding back search result data according to the target search word.
In the embodiment of the present application, after determining the target search term, the controller 250 sends a search request including the target search term to the server 300, so that the server can search for relevant search result data according to the target search request, and feeds back the search result data to the controller 250.
And S830, controlling the display to display the search result control according to the search result data.
After receiving the search result data fed back by the server 300, the controller 250 displays media asset names associated with the target search term in the search result presentation area according to the search result data, and displays a search result control corresponding to each media asset name in the search result preview area.
S840: and receiving selection of a user on a first control in the search result control, and sending a media resource request containing a first identifier to the server, wherein the server is used for feeding back first media resource data to the controller according to the first identifier in the media resource request.
In the embodiment of the application, the user browses the display contents in the search result display area and the search result preview area and finds the media assets which the user wants to search. After the user determines the assets the user wants to view, a corresponding first control can be selected from a plurality of controls in the search result controls in the search preview area. After receiving the selection of the first control by the user, the controller 250 sends a media asset request containing the first identifier to the server 300, and the server 300 feeds back the first media asset data to the controller 250 according to the first identifier in the media asset request. The first identifier may be a name of the asset corresponding to the first control selected by the user, or an ID of the asset corresponding to the first control selected by the user, and the server 300 may search the first asset data from the database according to the first identifier, and issue the first asset data to the controller 250.
S850: and when the user operation meets the triggering condition in the periodic detection, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to a guidance statement.
In the embodiment of the application, the controller can set a preset time length, and each time the preset time length is passed, the user operation is checked once to judge whether the user operation meets the triggering condition. For example, the preset time length is set to be one week, the triggering condition includes that the user firstly performs a selection operation on a virtual keyboard control in the search interface, namely, a manual search, within one week, searches out a media asset which the user wants to watch, and clicks a search result, that is, the triggering condition includes that the time interval between two manual searches and a click operation of the user is maximally one week. Therefore, the operation of triggering the voice search function guidance in this scenario is: in a week, after a user opens a search function, the user searches for the assets which the user wants to watch by using manual search for the first time, and clicks the searched assets, and at the moment, the user operation meets the trigger condition in the periodic detection. Of course, if it is desired to provide a higher frequency reminder for the user, the first preset time period may also be set to 3 days or 5 days, etc. Referring to fig. 6, if the user manually inputs the letter m and clicks the "american artificial stuffing", the user is determined to satisfy the trigger condition if the user performs the operation for the first time within a week. The controller 250 displays a playing interface according to the received first asset data, and performs guidance prompt according to a guidance statement, where the guidance statement is generated according to a first identifier, for example, if the first identifier is a name of the asset corresponding to the first control, the guidance statement may include the name of the asset.
S860: and when the user operation does not meet the triggering condition in the periodic detection, displaying a playing interface according to the received first media asset data without guidance prompt.
In the embodiment of the present application, if the time interval between two manual searches and the operation of clicking the search result by the user is less than one week, the controller 250 only controls the display to display the play interface, and does not perform guidance prompt. For example, in a week, after the user enters the search interface, the user finds the assets that the user wants to watch by using manual search for many times, and clicks the found assets, at this time, it can be considered that the user operation does not meet the trigger condition in the periodic detection. That is to say, the time interval between two manual search operations before and after the user and the operation of clicking the search result is not longer than the predetermined time period, then, the controller controls the display 275 to display the playing interface only according to the first media data, and does not perform guidance prompt, so as to avoid that the frequency of guidance prompt is too high, which causes discomfort to the user.
In some embodiments, the controller 250 controls the display 275 to exhibit a voice-guided floating layer when the search interface is first entered after the display device 200 is powered on. The voice guidance floating layer includes: the voice search system comprises an operation guide for entering voice search and an operation guide for exiting the voice search, wherein the operation guide for entering the voice search comprises a voice guide word which is used for instructing a user to send a voice search command. In the voice guidance floating layer, a user can be guided to specifically use the voice search function, namely, how to enter the voice search and how to exit the voice search.
In the embodiment of the present application, the operation guidance for entering the voice search includes: and continuously pressing a voice input key of the remote controller, and inputting a voice search command to perform voice search. Exiting the operational guide of the voice search comprises: pressing the non-power-on key of the remote controller quits the voice search. Referring to fig. 9, a schematic diagram of a voice-guided floating layer shown on a display in some embodiments of the present application is shown. In fig. 9, a prompt "press any key to exit guidance" is provided below the small voice assistant, that is, the cartoon animation, and a "try-on long presses the remote control voice key: i want to see guide sentences like comedy movies, liude hua and view voice help. The guide sentences can be used by the server to obtain the titles of popular search media assets in the current business search, wherein the number of the guide sentences can also be set by the server, and 3 guide sentences are selected in fig. 9. After the display apparatus 200 is turned on, when the user uses the search function for the first time, the user is informed how to use the voice search function by displaying the voice guidance floating layer on the search interface.
In some embodiments, after the user turns on the display device 200, the controller 250 may request the server 300 for the relevant configuration of the voice guidance floating layer.
In some embodiments, as long as the display 275 exhibits a search interface, that is, the controller 250 detects that the focus is within the search interface, the controller 250 controls the display 275 to exhibit a voice prompt control within the search interface. The voice prompt control includes: the prompt icon is arranged behind the search input frame, and different guide sentences are broadcast in turn at the position close to the prompt icon. Referring to fig. 10, a schematic diagram of a search interface including a voice prompt control shown on a display in some embodiments of the present application is shown. In fig. 10, a prompt icon is arranged beside the search input box, and the prompt icon can be set as a small voice assistant. And a guide statement is alternately broadcast beside the prompt icon. The guide sentence can be set as "try-me voice search", "speak me voice help", "speak" liudelhi movie "ready to search", "try-me" man-made stuffing ", and so on. The asset name in the voice guidance language may be a title of a popular search asset for the server 300 to obtain in the current service search. The server 300 may set the name of the asset in the guidance statement to be selected from the first name of the popular search asset to the fifteenth name of the popular search asset, and perform carousel following the guidance statement.
In some embodiments, controller 250 controls display 275 to display a voice prompt control in the search interface. The carousel time interval of the guide statement in the voice prompt control can be configured in the server, and for example, the carousel time interval can be set to 3S, that is, the guide statement is replaced every 3S.
In some embodiments, the controller 250 may actively request the server 300 for the relevant configuration of the leading sentence carousel time interval in the voice prompt control after the display device 200 is powered on. After the user opens the search interface, controller 250 requests the relevant configuration of the voice prompt control from server 300.
In the embodiment of the present application, if the focus is located on the prompt icon, the controller 250 may control the search interface to display the voice guidance floating layer shown in fig. 9.
Referring to fig. 11, a timing diagram of voice search function booting for a display device and a server provided in some embodiments of the present application is shown. As shown in connection with fig. 11, the server may include: the system comprises a terminal-oriented subsystem, a database, an operation background, a recommendation subsystem and a search subsystem. In order to implement the voice search function guidance before, during, and after the search, it is necessary to complete the configuration of the relevant settings related to the voice search function guidance in the server. Specifically, the staff can configure the preset display time and the preset timeout time in the voice search guidance control through the operation background, and also configure the carousel time interval of the guidance statement. In addition, a guide statement is also required to be configured through the operation background, and when the guide statement is configured, the operation background can set a recommendation rule of the guide statement and acquire popular search media resources in the current service search from the recommendation subsystem. And the operation background sends the configured time parameters and the guide statements to the database for storage. And then, after the user starts the display equipment, the display equipment can actively send a time parameter acquisition request to the terminal-oriented subsystem, and the terminal-oriented subsystem acquires the time parameter from the database according to the time parameter acquisition request and feeds the time parameter back to the display equipment. Then, after the user controls the display device to enter the search interface through the search instruction, the display device sends a guidance statement acquisition request to the terminal-oriented subsystem, and the terminal-oriented subsystem acquires the guidance statement from the database according to the guidance statement acquisition request. In the voice guidance floating layer, 3 guidance sentences can be randomly selected for display, and in order to ensure that the guidance sentences in the terminal-oriented subsystem are larger than the guidance sentences to be displayed in the display device, the terminal-oriented subsystem needs to judge whether the guidance sentences meet 3 guidance sentences, if the guidance sentences do not meet 3 data, the terminal-oriented subsystem can carry user characteristic messages to request the guidance sentences from the recommendation subsystem, and the recommendation subsystem feeds the guidance sentences back to the terminal-oriented subsystem. And organizing the acquired guide sentences facing the terminal subsystem, and feeding 3 guide sentences back to the display equipment. Before searching, if the display equipment is started, a user enters a search interface for the first time, the voice guide floating layer is displayed, and if the user does not enter the search interface for the first time, the voice guide floating layer is not displayed. In the searching process, as long as the user opens a searching interface, voice searching guidance is carried out through the voice prompt control. When a user searches, the display equipment sends a search media asset acquisition request through the terminal-oriented subsystem and the first search subsystem. And the searching subsystem feeds back corresponding media resources to the display equipment through the terminal-oriented subsystem, and in the searching process, if the time interval from the last time of guidance prompt is greater than the preset time within the preset time, guidance prompt is carried out according to the guidance statement.
Corresponding to the display device, an embodiment of the present application further provides a method for guiding a voice search function, where the method includes: the controller in the display device receives the operation instruction and determines the target search word. The controller sends a search request containing a target search word to the server, so that the server feeds back search result data according to the target search word and controls the display to display the search result control according to the search result data. The controller receives selection of a first control in the search result control by a user, and sends a media resource request containing a first identifier to the server, so that the server feeds back first media resource data to the controller according to the first identifier in the media resource request. And when the time interval from the last time of guidance prompt is greater than the preset time, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to a guidance statement, wherein the guidance statement is generated according to the first identifier, and when the time interval from the last time of guidance prompt is not greater than the preset time, displaying the playing interface according to the received first media asset data without performing guidance prompt.
According to the method for guiding the voice search function, when the user uses the search function, in each periodic detection, as long as the user operation meets the trigger condition, the user can be prompted to use the voice search, so that the times of using the voice search by the user are increased, and the user is guided to use the voice search.
The embodiment of the application also provides another guiding method for the voice search function, and the method comprises the following steps: in the search interface, a controller in the display device receives a selection operation of a virtual keyboard control in the search interface and determines a target search word. The controller sends a search request containing a target search word to the server, so that the server feeds back search result data according to the target search word and controls the display to display the search result control according to the search result data. The controller receives selection of a first control in the search result control by a user, and sends a media resource request containing a first identifier to the server, so that the server feeds back first media resource data to the controller according to the first identifier in the media resource request. When the user operation meets the trigger condition in the periodic detection, the controller displays a playing interface according to the received first media asset data and conducts guidance prompt according to a guidance statement, wherein the guidance statement is generated according to the first identifier, and when the user operation does not meet the trigger condition in the periodic detection, the controller displays the playing interface according to the received first media asset data and does not conduct guidance prompt.
Since the above embodiments are all described by referring to and combining with other embodiments, the same portions are provided between different embodiments, and the same and similar portions between the various embodiments in this specification may be referred to each other. And will not be described in detail herein.
It is noted that, in this specification, relational terms such as "first" and "second," and the like, are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a circuit structure, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such circuit structure, article, or apparatus. Without further limitation, the presence of an element identified by the phrase "comprising an … …" does not exclude the presence of other like elements in a circuit structure, article or device comprising the element.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
The above-described embodiments of the present application do not limit the scope of the present application.

Claims (12)

1. A display device, characterized in that the display device comprises:
a display;
a controller communicatively coupled with the display, the controller configured to:
receiving an operation instruction and determining a target search word;
sending a search request containing the target search word to a server, wherein the server is used for feeding back search result data according to the target search word;
controlling the display to display a search result control according to the search result data;
receiving selection of a user on a first control in the search result control, and sending a media resource request containing a first identifier to the server, wherein the server is used for feeding back first media resource data to the controller according to the first identifier in the media resource request;
when the time interval from the last time of guidance prompt meets the triggering condition, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to a guidance statement, wherein the guidance statement is generated according to the first identifier;
and when the time interval from the last time of guidance prompt does not meet the trigger condition, displaying a playing interface according to the received first media asset data, and not performing guidance prompt.
2. The display device according to claim 1, wherein the trigger condition is satisfied is that: the time interval from the last guiding prompt is longer than the preset time.
3. The display device according to claim 1, wherein the receiving an operation instruction and determining a target search word comprises:
receiving a selection operation of a virtual keyboard control in a search interface, and determining a target search word;
and determining the time interval from the last time of the guidance prompt according to the time interval between the selection operation of the virtual keyboard control in the search interface at the present time and the selection operation of the virtual keyboard control in the search interface corresponding to the last time of the guidance prompt display.
4. The display device according to claim 1, wherein the receiving an operation instruction and determining a target search word comprises:
receiving input selection operation of a search control, and displaying a search interface, wherein the search interface comprises a virtual keyboard control;
receiving a selection operation of a virtual keyboard control in a search interface, and determining a target search word;
determining the time interval from the last time of the guidance prompt according to the time interval between the current selection operation of the search control and the selection operation of the search control corresponding to the last guidance prompt display, or
Determining the time interval from the last time of the guidance prompt according to the time interval between the time of displaying the search interface this time and the time of displaying the search interface corresponding to the last guidance prompt, or
And determining the time interval from the last time of the guidance prompt according to the time interval between the selection operation of the virtual keyboard control in the search interface at the present time and the selection operation of the virtual keyboard control in the search interface corresponding to the last time of the guidance prompt display.
5. The display device of claim 1, wherein after receiving a user selection of a first one of the search result controls, the controller is further configured to:
and determining the time interval from the last time of the guidance prompt according to the time interval between the selection operation of the control in the search result control and the selection operation of the control in the search result control corresponding to the last guidance prompt display.
6. The display device according to claim 1, wherein the time interval from the last guidance prompt is: and the time interval between the time of receiving the operation instruction at this time and the time of receiving the operation instruction corresponding to the time of displaying the guidance prompt at the last time.
7. The display device according to claim 1, wherein the guidance prompt according to the guidance sentence includes:
displaying a voice search guide control in a floating layer above the playing interface, and/or playing the guide sentence through a loudspeaker in a voice mode;
the voice search guide control is used for loading and displaying the guide statement.
8. The display device according to claim 7, wherein the guidance prompt according to the guidance sentence further comprises:
and after the voice search guide control displays the preset display time, canceling a floating layer above the playing interface for displaying the voice search guide control.
9. The display device according to claim 1, wherein a resource request including a first identifier is sent to the server, and the server is further configured to determine a name of a resource corresponding to the first identifier according to the first identifier in the resource request; and generating a guide statement according to the name of the medium resource and a preset statement template, and feeding back the guide statement to the display device when feeding back the first medium resource data.
10. A display device, characterized in that the display device comprises:
a display;
a controller communicatively coupled with the display, the controller configured to:
receiving a selection operation of a virtual keyboard control in a search interface in the search interface, and determining a target search word;
sending a search request containing the target search word to a server, wherein the server is used for feeding back search result data according to the target search word;
controlling the display to display a search result control according to the search result data;
receiving selection of a user on a first control in the search result control, and sending a media resource request containing a first identifier to the server, wherein the server is used for feeding back first media resource data to the controller according to the first identifier in the media resource request;
when user operation meets a trigger condition in periodic detection, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to a guidance statement, wherein the guidance statement is generated according to the first identifier;
and when the user operation does not meet the triggering condition in the periodic detection, displaying a playing interface according to the received first media asset data without guidance prompt.
11. A method for directing a voice search function, the method comprising:
receiving an operation instruction and determining a target search word;
sending a search request containing the target search word to a server, wherein the server is used for feeding back search result data according to the target search word;
controlling a display to display a search result control according to the search result data;
receiving selection of a user on a first control in the search result control, and sending a media resource request containing a first identifier to the server, wherein the server is used for feeding back first media resource data to the controller according to the first identifier in the media resource request;
when the time interval from the last time of guidance prompt meets the triggering condition, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to a guidance statement, wherein the guidance statement is generated according to the first identifier;
and when the time interval from the last time of guidance prompt does not meet the trigger condition, displaying a playing interface according to the received first media asset data, and not performing guidance prompt.
12. A method for directing a voice search function, the method comprising:
receiving a selection operation of a virtual keyboard control in a search interface in the search interface, and determining a target search word;
sending a search request containing the target search word to a server, wherein the server is used for feeding back search result data according to the target search word;
controlling a display to display a search result control according to the search result data;
receiving selection of a user on a first control in the search result control, and sending a media resource request containing a first identifier to the server, wherein the server is used for feeding back first media resource data to a controller according to the first identifier in the media resource request;
when user operation meets a trigger condition in periodic detection, displaying a playing interface according to the received first media asset data, and performing guidance prompt according to a guidance statement, wherein the guidance statement is generated according to the first identifier;
and when the user operation does not meet the triggering condition in the periodic detection, displaying a playing interface according to the received first media asset data without guidance prompt.
CN202010460795.XA 2020-03-31 2020-05-27 Display device and method for guiding voice search function Pending CN113742609A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010460795.XA CN113742609A (en) 2020-05-27 2020-05-27 Display device and method for guiding voice search function
PCT/CN2021/081253 WO2021197068A1 (en) 2020-03-31 2021-03-17 Display device and content recommendation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010460795.XA CN113742609A (en) 2020-05-27 2020-05-27 Display device and method for guiding voice search function

Publications (1)

Publication Number Publication Date
CN113742609A true CN113742609A (en) 2021-12-03

Family

ID=78723695

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010460795.XA Pending CN113742609A (en) 2020-03-31 2020-05-27 Display device and method for guiding voice search function

Country Status (1)

Country Link
CN (1) CN113742609A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116112780A (en) * 2022-05-25 2023-05-12 荣耀终端有限公司 Video recording method and related device
WO2024140339A1 (en) * 2022-12-29 2024-07-04 聚好看科技股份有限公司 Display device and data processing method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101950244A (en) * 2010-09-20 2011-01-19 宇龙计算机通信科技(深圳)有限公司 Method and device for giving prompt for content information on user interface
CN104727411A (en) * 2015-03-06 2015-06-24 江门市地尔汉宇电器股份有限公司 Integrated intelligent electronic toilet with voice guide and control method thereof
CN105100851A (en) * 2014-05-05 2015-11-25 四达时代通讯网络技术有限公司 Intelligent television remote controller operation instruction method and device
CN108965968A (en) * 2018-07-25 2018-12-07 聚好看科技股份有限公司 Methods of exhibiting, device and the computer storage medium of smart television operation indicating
CN109979451A (en) * 2019-03-20 2019-07-05 百度在线网络技术(北京)有限公司 Method and apparatus for output information

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101950244A (en) * 2010-09-20 2011-01-19 宇龙计算机通信科技(深圳)有限公司 Method and device for giving prompt for content information on user interface
CN105100851A (en) * 2014-05-05 2015-11-25 四达时代通讯网络技术有限公司 Intelligent television remote controller operation instruction method and device
CN104727411A (en) * 2015-03-06 2015-06-24 江门市地尔汉宇电器股份有限公司 Integrated intelligent electronic toilet with voice guide and control method thereof
CN108965968A (en) * 2018-07-25 2018-12-07 聚好看科技股份有限公司 Methods of exhibiting, device and the computer storage medium of smart television operation indicating
CN109979451A (en) * 2019-03-20 2019-07-05 百度在线网络技术(北京)有限公司 Method and apparatus for output information

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116112780A (en) * 2022-05-25 2023-05-12 荣耀终端有限公司 Video recording method and related device
CN116112780B (en) * 2022-05-25 2023-12-01 荣耀终端有限公司 Video recording method and related device
WO2024140339A1 (en) * 2022-12-29 2024-07-04 聚好看科技股份有限公司 Display device and data processing method

Similar Documents

Publication Publication Date Title
CN111405333B (en) Display apparatus and channel control method
CN111343490B (en) Display device and content recommendation method
CN111464844A (en) Screen projection display method and display equipment
CN111327931B (en) Viewing history display method and display device
CN111405376A (en) Program language selection method and display device
CN111726673B (en) Channel switching method and display device
CN111291238A (en) Display device and search display method
WO2021109489A1 (en) Display device and electronic program guide presentation method
CN111669634A (en) Video file preview method and display equipment
WO2021232914A1 (en) Display method and display device
CN113742609A (en) Display device and method for guiding voice search function
WO2021212667A1 (en) Multiple media resource data display method and display device
CN111726674B (en) HbbTV application starting method and display equipment
CN111417022B (en) Conflict detection method and display device
CN113115088B (en) Control method of user interface of display equipment and display equipment
WO2021139045A1 (en) Method for playing back media project and display device
CN111324215A (en) Display device and search display method
US12056418B2 (en) Content-based voice output method and display apparatus
CN113115092A (en) Display device and detail page display method
CN113115093B (en) Display device and detail page display method
WO2021227232A1 (en) Method for displaying language options and country options, and display device
WO2021253592A1 (en) Method for starting sports mode and display device
CN113691852B (en) Display equipment and media asset playing method
CN113727162A (en) Display device, server and character introduction display method
CN113542885B (en) Display device, server and processing method for media asset search

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination