WO2018023216A1

WO2018023216A1 - Method for controlling multi-viewing angle image and associated device

Info

Publication number: WO2018023216A1
Application number: PCT/CN2016/092502
Authority: WO
Inventors: 陈明裕; 孙增才; 陈永
Original assignee: 华为技术有限公司
Priority date: 2016-07-30
Filing date: 2016-07-30
Publication date: 2018-02-08
Also published as: JP2019527847A; JP6770100B2; CN109196860A; CN109196860B

Abstract

A method for controlling a multi-viewing angle image and an associated device. The method comprises: a multi-viewing angle display device establishing a connection with a terminal (S301); the terminal dividing a display image on a display screen of the terminal into n viewing angle display images (S302), and determining n display regions corresponding to the n viewing angle display images, where n is a positive integer; the multi-viewing angle display device displaying the n viewing angle display images in the n display regions, respectively (S304); and the multi-viewing angle display device transmitting, when the multi-viewing angle display device has detected a control operation signal in n detection regions corresponding to the n display regions, the control operation signal to the terminal (S305). Thus, the method achieves intelligent interaction with a client, and enhances user experience.

Description

Multi-view image control method and related device

Technical field

The present invention relates to the field of image control technologies, and in particular, to a multi-view image control method and related device.

Background technique

At present, there are multi-view display devices on the market due to display requirements. The multi-view display device converts a planar image displayed on a terminal display screen into a multi-view image by using an optical device such as a lens or a mirror, and the multi-view image can present different images to viewers at different positions, thereby using multi-view display The device can realize the stereoscopic display of the planar image. And easy to carry, easy to display demand. Taking the four perspectives of front, back, left and right as examples, the planar image provided by the terminal is shown in Figure 1-a. After multi-view display device conversion, the multi-view images are from front, back, left and right. The viewing angle is observed, and the displayed effect is shown in Figure 1-b. This makes it possible to present different images to observers at different locations.

However, the current multi-view display device of the present type can only realize that the flat display image on the terminal is converted into a multi-view image and presented to the user, and cannot perform intelligent interaction with the user, thereby reducing the user experience.

Summary of the invention

The embodiment of the invention discloses a multi-view image control method and related device, which can implement intelligent interaction with a user, thereby improving the user experience.

A first aspect of the embodiments of the present invention discloses a method for controlling a multi-view image, which includes: after the multi-view display device establishes a connection with the terminal, displaying images according to n viewing angles divided by the display screen on the display screen of the terminal, Determining n display areas corresponding to the n view display images, n being a positive integer; the multi-view display device respectively displaying the n view display images in the n display areas; the multi-view display After detecting the control operation signal in the n detection areas corresponding to the n display areas, the multi-view display device transmits the control operation signal to the terminal.

It can be seen that the multi-view display device can establish a connection with the terminal and can be divided according to the terminal. The viewing angle display image determines n display areas, so that images can be displayed in n viewing angles in n display areas to form a multi-view viewing angle display image, and control operations can be detected in n detection areas corresponding to n display areas. The signal is transmitted to the terminal, so that the terminal can control the viewing angle display image according to the control operation signal, thereby implementing intelligent interaction with the user and improving the user experience.

In some possible implementation manners of the first aspect, the multi-view display device determines an image corresponding to the n view display images according to n view display images divided by the display screen on the display screen of the terminal. The display area includes: the multi-view display device receives the first split information of the terminal, the first split information includes the number of the terminal divided view display images being n, and the n view display images respectively corresponding to The display angle of view, the multi-view display device determines n display regions corresponding to the n view display images according to the received first split information; or the multi-view display device receives the terminal to send The second division information, the second division information includes the number of the terminal division view display images being n, and the multi-view display device determines to display with the n perspective views according to the received second division information. The n display areas corresponding to the image.

In some possible implementation manners of the first aspect, after the multi-view display device detects the control operation signal in the n detection regions corresponding to the n display regions, the method further includes: the multi-view display The device determines a control operation object corresponding to the control operation signal and a control operation instruction, wherein the control operation object is the display screen or the view display image; wherein the multi-view display device transmits the control operation signal to the The terminal includes: after the multi-view display device determines that the control operation object corresponding to the control operation signal is the display screen, the multi-view display device transmits first control information to the terminal, the first control The information includes a control operation object corresponding to the control operation signal being the display screen, and a control operation instruction corresponding to the control operation signal; and the multi-view display device determines that the control operation object corresponding to the control operation signal is a view angle display After the image, the multi-view display device transmits second control information to the terminal, Second control information comprises a control signal corresponding to the control operation of the operation target image is the viewing angle, and the control operation of a control signal corresponding to the operation instruction.

In some possible implementation manners of the first aspect, after the multi-view display device determines that the control operation object corresponding to the control operation signal is a view display image, the method further includes: if the view display image includes an image An element, the multi-view display device determines whether a control operation object corresponding to the control operation signal is the image element, wherein the image element includes an application icon, At least one of the windows; wherein the multi-view display device transmits the control operation signal to the terminal, comprising: the multi-view display device determining that the control operation object corresponding to the control operation signal is After the image element is described, the multi-view display device transmits third control information to the terminal, the third control information includes a control operation object corresponding to the control operation signal as the image element, and the control operation The control operation instruction corresponding to the signal.

In some possible implementations of the first aspect, the control operation signal includes at least one of a gesture operation signal and a voice operation signal.

The second aspect of the embodiments of the present invention discloses a method for controlling a multi-view image, comprising: after establishing a connection between the terminal and the multi-view display device, dividing the display screen on the display screen of the terminal into n viewing angle display images; The terminal receives the control operation signal transmitted by the multi-view display device, and performs a control operation on the display screen according to the control operation signal.

It can be seen that after the terminal can establish a connection with the multi-view display device, the multi-view display device can intelligently interact with the user, thereby improving the user experience.

In some possible implementation manners of the second aspect, the terminal divides the display screen on the display screen of the terminal into n view display images, including: the terminal supports the n supported by the multi-view display device. The display area is determined to divide the display screen on the display screen of the terminal into n viewing angle display images; or the terminal determines, according to the n display areas currently opened by the multi-view display device, the terminal The display screen on the display screen divides n viewing angle display images; or the terminal determines, on the display screen of the terminal, according to n display viewing angles of the image presented by the display screen on the display screen of the terminal The display screen divides n viewing angle display images.

In some possible implementation manners of the second aspect, after the terminal establishes a connection with the multi-view display device, and the terminal divides the display screen on the display screen of the terminal into n view display images, The method further includes the terminal opening a multi-view image display mode.

In some possible implementation manners of the second aspect, the terminal performs a control operation on the display screen according to the control operation signal, where the terminal determines, according to the control operation signal, a control corresponding to the control operation signal. An operation object, the control operation object including the display screen, at least one of the n view display images, or an image element in the view display image, the image element including an application icon, an application window At least one type; the terminal parses a control operation instruction corresponding to the control operation signal; and the terminal controls the control according to the control operation instruction The operating object performs control operations.

In a third aspect, an embodiment of the present invention discloses a multi-view display device including a unit for performing the method in the first aspect.

In a fourth aspect, an embodiment of the present invention discloses a terminal, where the terminal includes a unit for performing the method in the second aspect.

In a fifth aspect, an embodiment of the present invention discloses a multi-view display device, where the multi-view display device can include a processor configured to support the multi-view display device to perform a corresponding function in the method provided by the first aspect. . The multi-view display device can also include a memory for coupling with the processor that holds the program instructions and data necessary for the communication device. The multi-view display device can also include a communication interface for the multi-view display device to communicate with the terminal or communication network.

In a sixth aspect, an embodiment of the present invention discloses a terminal, where the terminal may include a processor configured to support the terminal to perform a corresponding function in the method provided by the second aspect. The terminal can also include a memory for coupling with the processor that retains the program instructions and data necessary for the terminal. The terminal can also include a communication interface for the terminal to communicate with the multi-view display device or communication network.

In a seventh aspect, the embodiment of the present invention discloses a computer storage medium for storing computer software instructions for the multi-view display device provided in the fifth aspect, which comprises a program designed to execute the method in the first aspect.

In an eighth aspect, the embodiment of the present invention discloses a computer storage medium for storing computer software instructions used by the terminal provided in the sixth aspect, which includes a program designed to execute the method in the second aspect.

These and other aspects of the invention will be more apparent from the following description of the embodiments.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings to be used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.

1 is a schematic diagram of an imaging effect of a terminal display screen after passing through a multi-view display device according to the conventional art;

2 is a schematic perspective view of a multi-view display device according to an embodiment of the present invention;

3 is a schematic flow chart of a method for controlling a multi-view image disclosed in an embodiment of the present invention;

4 is a schematic flow chart of another method for controlling a multi-view image disclosed in an embodiment of the present invention;

FIG. 5 is a schematic flowchart diagram of still another method for controlling a multi-view image according to an embodiment of the present invention; FIG.

6 is a top plan view showing a corresponding positional relationship between a display area and a detection area of a multi-view display device according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a unit composition of a multi-view display device according to an embodiment of the present invention; FIG.

FIG. 8 is a schematic diagram of a unit composition of a terminal according to an embodiment of the present invention; FIG.

FIG. 9 is a schematic structural diagram of a multi-view display device according to an embodiment of the present invention; FIG.

FIG. 10 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly described in conjunction with the drawings in the embodiments of the present invention. Some embodiments of the invention, rather than all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of the present invention.

The terms "first", "second", "third", and "fourth" and the like in the specification and claims of the present invention are used to distinguish different objects, and are not intended to describe a specific order. . Furthermore, the terms "comprises" and "comprising" and "comprising" are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that comprises a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units not listed, or alternatively Other steps or units inherent to these processes, methods, products or equipment.

References to "an embodiment" herein mean that a particular feature, structure, or characteristic described in connection with the embodiments can be included in at least one embodiment of the invention. The appearances of the phrases in various places in the specification are not necessarily referring to the same embodiments, and are not exclusive or alternative embodiments that are mutually exclusive. Those skilled in the art will understand and implicitly understand that the embodiments described herein can be combined with other embodiments.

The technical solution in the embodiment of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention. Said.

The embodiment of the invention discloses a multi-view image control method and related device, which can implement intelligent interaction with a user, thereby improving the user experience. For a better understanding of the embodiments of the present invention, the application scenarios of the embodiments of the present invention are described below.

Please refer to FIG. 2. FIG. 2 is a schematic perspective structural view of a multi-view display device according to an embodiment of the present invention. As shown in FIG. 2, the multi-view display device may include a base, a bracket, and a top seat. The terminal can be placed on the top seat of the multi-view display device, and the display screen of the terminal faces the base, so that the multi-view display device performs multi-view display on the display screen on the terminal display screen. In the embodiment of the present invention, the multi-view display device can display four viewing angles as an example. As shown in FIG. 2, the multi-view display device corresponds to four display areas by four front, rear, left, and right views, and each display area can be Correspondingly, the display screen on the display screen of a part of the terminal is displayed. When the display image of the terminal includes the front, back, left and right images of the same image (as shown in FIG. 1-a), the display can be displayed through multiple viewing angles. The device displays an effect of approximating a stereoscopic image, and the user observes the multi-view image from different viewing angles, and can view an image of the viewing angle corresponding to different viewing angles (as shown in FIG. 1-b). If the display screen on the display screen of the terminal displays images in other forms of view, the multi-view display device may display a portion of the corresponding display screen in different display regions. It should be noted that when the multi-view display device can support four display areas, it can display images in only one to three display areas according to specific needs, or display in all four display areas, which is not in the embodiment of the present invention. Make a limit. Of course, the embodiment of the present invention is only a multi-view display device capable of supporting four display areas. The multi-view display device in the embodiment of the present invention can support n display areas for multi-view display, and is not limited to supporting four views. Corresponding display area.

In the conventional technology, the multi-view display device can only convert the display image on the display screen of the terminal into a multi-view image by optical principles such as refraction and reflection, when the user needs to adjust the multi-view image or in the multi-view image. When the image element is controlled, it needs to be implemented by performing touch operation on the terminal, etc., and the above method may need to be adjusted multiple times to achieve the user satisfaction effect, resulting in low user experience. However, after the multi-view image display device displays the multi-view image, the embodiment can directly detect the user's control operation on the multi-view image, and can transmit the same to the terminal to further control and adjust the multi-view image, thereby realizing the user. Intelligent interaction between them to enhance the user experience.

Of course, the embodiment of the present invention may further include a multi-view display device of other structures, and is not limited to the three-dimensional structure of the multi-view display device shown in FIG. 2 .

The method embodiments in the embodiments of the present invention are described in detail below in conjunction with the application scenarios described above. Description. The terminal in the embodiment of the present invention may be, for example, a mobile phone, a tablet computer, a notebook computer, a UMPC (ultra-mobile PC), a netbook (netbook), a PDA (personal digital assistant), a POS. (point of sales, sales terminal), etc., and is not limited thereto. The display screen in the terminal may be a capacitive touch screen or a resistive touch screen, or other types of display screens.

Please refer to FIG. 3. FIG. 3 is a schematic flowchart diagram of a method for controlling a multi-view image according to an embodiment of the present invention. As shown in FIG. 3, the method can include the following steps.

Step S301, the multi-view display device establishes a connection with the terminal.

In some possible implementations, the multi-view display device may first establish a connection with the terminal. The connection manner may include a wired connection or a wireless connection. If the multi-view display device establishes a wired connection with the terminal, the connection may be made through a connector such as a connection line configured with a USB interface or other common or commonly configured connection interface. If the multi-view display device establishes a wireless connection with the terminal, the magnetic field can be coupled through the configured antenna or wirelessly connected through a wireless protocol technology. The wireless protocol technology can be a general wireless protocol technology, such as WIFI (Wireless Fidelity) technology, Zigbee (Zibebe protocol) technology, Bluetooth technology or NFC (Near Field Communication) technology. Alternatively, the wireless protocol technology may be a proprietary protocol technology between the multi-view display device and the terminal, and the proprietary protocol technology is jointly developed by the multi-view display device and the terminal.

Step S302, the terminal divides the display screen on the display screen of the terminal into n viewing angle display images.

In some possible implementation manners, after the terminal establishes a connection with the multi-view display device, the terminal may divide the display screen on the display screen of the terminal into n view display images, where n is a positive integer.

Specifically, after the terminal establishes a connection with the multi-view display device, the terminal can perform wired or wireless information interaction. For example, the terminal sends a control command to the multi-view display device to control the multi-view display device to execute the control command, and, for example, the terminal controls the multi-view display device to transmit information required by the terminal, etc.; or, the terminal sends the acquisition request to the multi-view display device. To request the multi-view display device current status information and the like. Similarly, the multi-view display device can also control the terminal to execute an operation instruction or request to acquire current status information of the terminal or the like in the above manner. The terminal can obtain the display area that can be supported by the multi-view display device or the display area that is currently turned on by the multi-view display device through information interaction. For example, if the display area supported by the current multi-view display device or the currently displayed display area is n, the terminal It can be determined that the number of divisions of the angle of view display image that needs to be divided in the display screen is n. After the terminal determines the number of divisions, it can pass The processing unit or the image processing unit (GPU) configured in the terminal performs image recognition on the display screen on the display screen. For example, the processing unit or the image processing unit may call the image recognition model pre-stored in the terminal to perform display on the display screen. Image recognition to identify the image contained in the current display and its position in the display. Wherein, the recognized image may include an image element such as an application icon, an application window, or the like; or include a plurality of perspective images. Further, the terminal may divide the display screen into n viewing angle display images according to the recognized image and its position in the display screen, and each of the viewing angle display images may include at least one of the identified images.

Alternatively, the terminal may further determine, according to the n display viewing angles of the image presented by the display screen on the display screen of the terminal, that the number of divisions of the viewing angle display image that needs to be divided in the display screen is n. For example, the terminal may turn on the multi-view display mode after being connected to the multi-view display device or according to the user's operation on the terminal. In the multi-view display mode, the display screen displays a plurality of display angles of view of the same image. Alternatively, after the terminal is connected to the multi-view display device, or according to the operation of the terminal by the user, the multi-view file pre-stored in the terminal is invoked, and the multi-view file may include a multi-view image file or a multi-view video file, that is, the terminal is displayed. When a multi-view image is displayed on the screen, the display screen displays a plurality of display angles of the same image. When the terminal displays the multi-view image, the terminal may perform image recognition on the display screen on the display screen by using a processing unit or a graphic processing unit (GPU) configured in the terminal. For example, the processing unit or the image processing unit may be used. The image recognition model pre-stored in the calling terminal is used to perform image recognition on the display screen to identify n viewing angle images included in the current display screen and their positions in the display screen. Further, the terminal may divide the display screen into n viewing angle display images, and each of the viewing angle display images includes one viewing angle image.

Optionally, after the terminal establishes a connection with the multi-view display device, the terminal may detect the current screen display state. If the display screen of the current terminal is in a dark screen state, after the terminal establishes a connection with the multi-view display device, the terminal The display screen switches to a bright screen state.

Step S303, the multi-view display device determines n display regions corresponding to the n view display images according to n view display images divided by the display screen on the display screen of the terminal.

In some possible implementation manners, after the terminal divides the display screen on the display screen into n viewing angle display images, the multi-view display device may display the image according to the n viewing angles divided by the terminal, and determine the display with the n viewing angles. The n display areas corresponding to the image, that is, the multi-view display device needs to display an image according to the n angles of view divided by the terminal, determine a display area for each view display image, and further control the display of the optical device disposed in the display area. The view angle corresponding to the display area displays an image. Specifically, after the multi-view display device acquires the n view display images by the terminal, the n display regions may be correspondingly determined. Optionally, the terminal may transmit the number n of the divided view display images to the multi-view display device through information interaction after dividing the n view display images, for example, when the terminal is wiredly connected to the multi-view display device, The terminal may transmit the number n of the divided view display images to the multi-view display device through a connection bus or the like; for example, when the terminal performs wireless connection with the multi-view display device, the terminal will carry the quantity n of information in the wireless connection protocol. The prescribed information format, the transmission channel specified in the wireless connection protocol is transmitted to the multi-view display device. The terminal may also transmit information of the view display image to the multi-view display device, such as an image element included in the view display image, a view size, or a view angle corresponding to the view display image. If the display area currently opened by the multi-view display device or the supported display area is n, that is, one display area is determined to correspond to one view display image, for example, when the display area currently supported by the multi-view display device or the supported display area is respectively When the display area x ₁ ～ x _n is displayed, and the multi-view display device knows that the n view display images are respectively the view display images y ₁ ～ y _n , the display area x ₁ may be determined according to a preset rule or other manner. ～x _n and _one- to-one correspondence between the viewing angle display image images y ₁ ～ y _n , for example, the multi-view display device may determine that the display region x _i corresponds to the viewing angle display image y _j ; the multi-view display device may further control the display region x _i The optical device displays the corresponding view display image y _j ; if the display area currently opened by the multi-view display device or the supported display area is greater than n, n display areas can be selected, and n display areas are respectively determined The correspondence relationship with the image displayed by n angles of view. Optionally, the multi-view display device can detect the current observer position, for example, the multi-view display device can detect the current observer position by using a configured camera, or an infrared or ultrasonic sensor to determine n display regions. The correspondence relationship with the image displayed by n angles of view. If the multi-view display device detects that the observer observes in the display area A, or the number of observers in the display area A is large, and the n view display images include the front view view display image, the display area A can be determined. The front view angle is displayed inside to display the image. Optionally, the correspondence between the view display image and the display area may also be determined by the terminal. After acquiring the display area that is currently turned on or supported by the multi-view display device, the terminal determines the view display image corresponding to each display area, and transmits the corresponding relationship to the multi-view display device by means of instructions or information.

Step S304, the multi-view display device displays the n in the n display areas respectively. The angle of view shows the image.

In some possible implementations, after the multi-view display device determines the n display regions corresponding to the n view display images, the multi-view display device may respectively display the n view display images in the n display regions. Specifically, the multi-view display device can adjust the position of the display area in the multi-view display device and the determined position of the image in the terminal corresponding to the display area corresponding to the display area, and adjust the optical device disposed in the display area to It is realized to display its corresponding view display image in the display area. Optionally, the n viewing angle display images may be correspondingly adjusted according to the size of the n display areas, etc., to obtain a better display effect.

Step S305, after the multi-view display device detects a control operation signal in the n detection regions corresponding to the n display regions, the multi-view display device transmits the control operation signal to the terminal.

In some feasible implementation manners, after displaying the n viewing angle display images in the n display regions, the multi-view display device may detect the control operation signal in the n detection regions corresponding to the n display regions, when the control operation is detected. After the signal, the control operation signal may be transmitted to the terminal, so that the terminal performs a control operation according to the viewing angle display image for which the control operation signal is directed. Specifically, when the multi-view display device detects the control operation signal in the one or more display areas, the view display image for which the control operation signal is directed may be determined by determining the display area where the control operation signal is located. For example, when the multi-view display device detects the control operation signal in the display area A, it can be determined that the view angle display image for which the control operation signal is directed is the view display image corresponding to the display area A. Further, the multi-view display device can transmit the control operation signal and the image information of the view display image for which the control signal is directed to the terminal, so that the terminal can perform a control operation on the view display image for the control image according to the control operation signal. Alternatively, the control operation signal includes information about the view display image for the control operation signal. For example, when the control operation signal is the gesture operation signal, the gesture operation signal or the gesture operation track may be determined according to the gesture operation signal, etc., The angle of view display image, such as determining that the gesture shape formed by the gesture operation signal is “X”, determining that the angle of view display image to be targeted is the angle of view display image A; determining that the gesture shape formed by the gesture operation signal is “V”, determining the desired When the viewing angle display image is the viewing angle display image B or the like, the terminal can determine the viewing angle display image to which the control operation signal is to be directed after receiving the control operation signal.

In some feasible implementation manners, each display area of the multi-view display device may correspond to one detection area, as shown in FIG. 6, FIG. 6 is a pair of display area and detection area of the multi-view display device. A top view of the positional relationship. The correspondence shown in FIG. 6 is exemplified by four display areas. As shown in FIG. 6, each display area corresponds to one detection area. Optionally, if the three-dimensional structure of the multi-view display device is as shown in FIG. 1 , a detection sensor may be installed on the base of the multi-view display device to detect the control operation signal. The detection sensors installed in the base corresponding to each display area may be the same or different. Then, the range of the detection area corresponding to each display area and the control operation signals detected in the detection area may be the same or different. For example, the control operation signal may include at least one of a gesture operation signal and a voice operation signal. The detection area A corresponding to the display area A can detect the gesture operation of the user, and the detection area B corresponding to the display area B can detect the voice operation of the user and the like. The multi-view display device can detect a gesture operation signal through an ultrasonic sensor, an infrared sensor, a camera, or the like disposed on the base, or can detect a voice operation signal through a microphone, a voice sensor, or the like provided on the base. Of course, in order to accurately detect the control operation signal, the multi-view display device may be provided with at least one detecting sensor on a surface corresponding to each display area on the base, which is not limited in the embodiment of the present invention. Optionally, the multi-view display device may be provided with different detecting sensors on different base surfaces corresponding to each display area, such as at least one ultrasonic sensor disposed on the base surface corresponding to the display area A, and the corresponding base surface of the display area B Set at least one microphone, etc. on it. Alternatively, the multi-view display device may be provided with the same detecting sensor on different base surfaces corresponding to each display area, that is, each surface can detect the gesture control operation and the voice control operation in the corresponding detection area, and can be displayed by multiple viewing angles. The device determines the detection function in each detection area. For example, the multi-view display device determines that the detection area A corresponding to the display area A is used to detect the gesture control operation, and determines the detection area B corresponding to the display area B to detect the voice control operation or the like.

Step S306, the terminal receives a control operation signal transmitted by the multi-view display device, and performs a control operation on the display screen according to the control operation signal.

In some feasible implementation manners, after receiving the control operation signal transmitted by the multi-view display device, the terminal may perform a control operation on the display screen on the display screen of the terminal according to the control operation. Specifically, the overall display screen can be controlled according to the control operation signal, and the terminal can parse the control operation signal after receiving the control operation signal, and parse out the operation instruction of the control operation signal. For example, when the control operation signal is a gesture operation signal, the operation trajectory of the gesture operation signal, such as the pattern formed by the trajectory, the trajectory direction, etc., may be parsed, and may be determined and operated according to the corresponding relationship between the preset operation trajectory and the operation instruction. The operation instruction corresponding to the track, for example, when the operation track is circular, the corresponding operation instruction is to adjust the display picture format and the like. For another example, when the control operation signal is a voice operation signal At the same time, the keyword in the voice operation signal can be parsed, and an operation instruction is formed according to the keyword; if the keyword in the voice operation signal is analyzed, including the adjustment format and the display screen, the operation instruction can be formed to adjust the display screen format. . The embodiments of the present invention are not limited herein. In the above manner, it is possible to adjust the display screen color, switch the display format to the display screen, or perform a control operation such as zooming in, reducing, and rotating the display screen. Alternatively, a control operation may be performed on at least one view display image in the divided n view display images in the display screen according to the control operation signal, such as performing color adjustment on the at least one view display image or displaying the image on at least one view Switching the display format or performing control operations such as zooming in, zooming out, rotating, etc. on at least one view display image. Alternatively, the image element included in the at least one view display image of the divided n view display images may be controlled according to the control operation signal, wherein the image element included in the view display image may include an application icon and an application window (Widget) And the like, the multi-view display device may open an application icon or an application corresponding to the application window according to the control operation signal, or perform a control operation on the application element in the application window.

Optionally, the multi-view display device can receive different control operation signals in different detection areas at the same time, and the multi-view display device can transmit different control operation signals to the terminal, so that the terminal is independent according to different control operation signals. Controlling a display screen or a partial display screen corresponding to each control operation signal; the multi-view display device can also receive a control operation signal through a plurality of detection areas, and the multi-view display device can perform multiple detections The common control operation signal received by the area is transmitted to the terminal, so that the terminal performs a control operation on the corresponding display screen or part of the display screen according to the control operation signal. For example, the multi-view display device is continuous in the detection area A and the detection area B. A control operation signal is detected, such as when the control operation signal is a gesture operation signal, when the multi-view display device continuously detects the operation trajectory of the gesture operation signal in the detection area A and the detection area B, or when the control operation signal is a voice operation signal When the multi-view display device is in the detection area A and the inspection When the area B is continuously detected audio signal is the speech operation, the terminal performs a control operation based on the rotational operation signal or the entire display screen of the display region A and display region B corresponding to the display image corresponding to the viewing angle control operation.

It can be seen that, in the embodiment of the present invention, the terminal establishes a connection with the multi-view display device, and the terminal divides the display screen on the display screen into n viewing angle display images, and the multi-view display device can display the image according to the divided n viewing angles. The n viewing angles display the display area corresponding to the image, and display the n viewing angle display images correspondingly in the n display areas, and can provide the multi-view image to the user intelligence. And the multi-view display device can detect the control operation signal, and can transmit the control operation signal to the terminal, so that the terminal can control the display screen on the display screen according to the control operation signal, thereby implementing intelligent interaction with the user. , improved user experience.

Please refer to FIG. 4. FIG. 4 is a schematic flowchart diagram of another method for controlling a multi-view image according to an embodiment of the present invention. As shown in FIG. 4, the method can include the following steps.

In step S401, the terminal establishes a connection with the multi-view display device.

Step S402, the terminal turns on the multi-view image display mode.

In some feasible implementation manners, after the terminal establishes a connection with the multi-view display device, the terminal may turn on the multi-view image display mode. Specifically, after detecting that the terminal establishes a connection with the multi-view display device, the terminal may trigger the terminal to turn on the multi-view image display mode, thereby switching from the current normal display mode to the multi-view image display mode. The multi-view image display mode may include calling a preset multi-view view display image, or adjusting a view display image or an image element in the current display picture according to the current display picture. For example, after the terminal turns on the multi-view image display mode, the display position of the view display image in the current display screen may be adjusted to facilitate the observation by the observer after being displayed in the multi-view display device; or the current display screen display terminal The desktop interface has image elements arranged in order, such as an application icon or an application window, etc., and the order of arrangement of image elements or the display position of image elements or the display style of image elements can be adjusted to suit display in multiple views. After being displayed in the device, it is convenient for the observer to observe. The multi-view image display mode further includes the terminal being capable of analyzing the control operation signal transmitted by the multi-view display device, such as the control operation object corresponding to the control operation signal and the control operation instruction corresponding to the control operation signal.

Step S403, the terminal divides the display screen on the display screen of the terminal into n viewing angle display images.

Step S404, the multi-view display device determines n display regions corresponding to the n view display images according to n view display images divided by the display screen on the display screen of the terminal.

In some feasible implementation manners, the specific implementation manner that the multi-view display device determines the n display regions corresponding to the n view display images may be any one of the following manners:

(1) The multi-view display device receives the first split information of the terminal, where the first split information includes a display in which the number of the divided view display images is n and the n view display images respectively correspond to the display a viewing angle, the multi-view display device according to the received first split information, N display areas corresponding to the n view display images are determined.

Specifically, the multi-view display device may receive the first split information sent by the terminal, where the first split information indicates that the terminal divides the display screen on the display screen into n view display images, and the n view display images correspond to Display perspective. That is, the terminal instructs the multi-view display device to determine the manner in which the n view display images and the n display regions are corresponding by the first split information. For example, the display area in the multi-view display device may correspond to the display angle of view. When the multi-view display device acquires n display angles corresponding to the n view display images indicated by the terminal by using the first split information, the n pieces may be determined. Displays the display area corresponding to the angle of view. Alternatively, after receiving the first split information, the multi-view display device can determine the number of display regions according to the number of divisions of the view display image, and can acquire n display viewing angles corresponding to the n view display images, and the multi-view display device The relationship between the display area and the viewing angle display image can be determined by detecting the position of the current observer or determining the number of observers in a certain display area, thereby determining the viewing angle to be displayed in the display area. Therefore, after receiving the first split information, the multi-view display device can determine n display regions corresponding to the n view display images according to the first split information.

(2) The multi-view display device receives the second split information sent by the terminal, where the second split information includes the number of the divided view display images of the terminal is n, and the multi-view display device receives the The obtained second division information determines n display regions corresponding to the n perspective display images.

Specifically, the multi-view display device receives the second split information sent by the terminal, where the second split information is used to instruct the terminal to divide the display screen of the display screen into n view display images. The multi-view display device can only determine the n display regions that the multi-view display device needs to be corresponding by the second split information, and the multi-view display device needs to determine the corresponding relationship between the n display regions and the n view display images. The corresponding relationship may be determined by the optical device configured by the current multi-view display device, or the multi-view display device determines the corresponding relationship according to the image information in the view display image.

Optionally, after the multi-view display device determines the n display regions corresponding to the n view display images according to the first split information or the second split information, the corresponding relationship may be implemented by adjusting an optical device configured by the multi-view display device.

Step S405, the multi-view display device respectively displays the n view display images in the n display regions.

Step S406, the multi-view display device displays n checks corresponding to the images in the n viewing angles. After the control operation signal is detected in the measurement area, the control operation signal is transmitted to the terminal.

Step S407, the terminal determines, according to the control operation signal, a control operation object corresponding to the control operation signal, where the control operation object includes the display screen, and at least one view angle display image in the n view display images, Or a view angle displays an image element in an image, the image element including at least one of an application icon and an application window.

Step S408, the terminal parses a control operation instruction corresponding to the control operation signal;

Step S409, the terminal performs a control operation on the control operation object according to the control operation instruction.

In some feasible implementation manners, after receiving the control operation signal transmitted by the multi-view display device, the terminal may be according to a corresponding relationship between the control operation signal preset by the terminal in the multi-view display mode and the control operation instruction, or a preset control. The corresponding relationship between the operation signal and the control operation object performs a corresponding control operation on the display screen on the display screen. Of course, the correspondence between the control operation signal and the control operation object and the control operation instruction may be embodied in a preset mapping relationship table in a multi-view display mode. For example, when the control operation signal received by the terminal is a gesture operation signal, the pattern may be formed according to the trajectory direction or the trajectory of the operation trajectory of the gesture operation signal, or the gesture shape of the gesture operation or the like may be determined corresponding to the control operation object and the control operation instruction. For example, when the operation track of the gesture operation signal is in a display area, and the track formation pattern of the operation track is circular, the terminal may parse the control operation object corresponding to the gesture operation signal as the corresponding view angle of the display area. Displaying an image, and the corresponding control operation instruction is to rotate the view display image; for example, the operation track of the gesture operation signal is within the display area of the at least one image element in the view display image, and the operation track direction of the gesture operation signal is far And the terminal may parse the control operation object corresponding to the gesture operation signal as at least one image element, and the corresponding control operation instruction is to click to open the application corresponding to the at least one image element; for example, when the terminal parses When the operation trajectory of the gesture operation signal passes through two or more display areas, and the trajectory of the operation trajectory forms a circle, the terminal can parse the control operation object corresponding to the gesture operation signal as the entire display screen, and corresponding Control operation instruction is to rotate the display For example, when the operation track of the gesture operation parsed by the terminal passes through two or more display areas, and the track of the operation track forms a square or "X" shape, the terminal can parse the gesture operation. The control operation object corresponding to the signal is an angle of view display image corresponding to two or more display areas, and the corresponding control operation instruction is a display format for switching the above-mentioned view display image. Alternatively, when the control operation signal is a voice operation signal, the terminal may extract the a keyword corresponding to the control operation object in the voice operation signal and a keyword corresponding to the control operation instruction, thereby determining a control operation object and a control operation instruction corresponding to the voice operation signal, for example, the parsed voice operation signal includes “opening” And the "music application" two keywords, the control operation object corresponding to the voice operation signal is a music application display icon in the view display image, and the corresponding control operation instruction is an open command. The above examples are merely exhaustive and not exhaustive. Of course, the embodiments of the present invention may further include correspondences between other control operation signals and control operation objects and control operation instructions.

After the terminal performs a control operation on the control operation object according to the control operation instruction, the terminal may display the result of the control operation on the display screen. For example, the terminal may display the result of the control operation on the overall display screen on the display screen, or the terminal The result of the image control operation for one or more viewing angles may be displayed on the display screen, or the terminal may display the result of the image element control operation in the one or more viewing angle display images on the display screen. When the terminal displays the result of the control operation on the display screen, since the multi-view display device has determined the correspondence relationship between the display region and the perspective display image divided by the terminal, when the terminal controls the display of one or more viewing angle display images When changing, the multi-view view display image can display the changed one or more view display images in the display area corresponding to the one or more view display images in which the display change occurs according to the above correspondence relationship, thereby enabling the user to intuitively feel Go to its control operation results.

It should be noted that the specific implementation manners of steps S401, S403, S405, and S406 can be referred to the description manners of related steps in the embodiment shown in FIG.

It can be seen that, by using the foregoing implementation manner, the terminal and the multi-view display device can trigger the multi-view display mode of the open terminal after establishing the connection, and can more accurately determine the display area of the multi-view view display image and be smarter by transmitting information with each other. The control operation of displaying the image in a multi-view perspective further simplifies the intelligent interaction with the user, thereby further enhancing the user experience.

In the embodiment shown in FIG. 4, after detecting the control operation signal, the control operation signal can be transmitted to the terminal, and the terminal can analyze the control operation signal. In another method, after detecting the control operation signal, the multi-view display device can analyze the control operation signal by the multi-view display device, and transmit the analysis result to the terminal. After receiving the analysis result, the terminal can directly directly analyze the result. The control operation object corresponding to the control operation signal is controlled.

Please refer to FIG. 5. FIG. 5 is a schematic flowchart diagram of still another method for controlling a multi-view image according to an embodiment of the present invention. The embodiment shown in FIG. 5 focuses on the detection of the control operation signal by the multi-view display device. After that, the analysis process of the control operation signal. As shown in FIG. 5, the method can include the following steps.

Step S501, after the multi-view display device detects the control operation signal in the n detection regions corresponding to the n view display images, the multi-view display device determines the control operation object and the control operation command corresponding to the control operation signal. The control operation object includes at least one of a display screen and a view display image.

In some feasible implementation manners, the multi-view display device may parse the control operation signal after detecting the control operation signal to determine whether the control operation signal is used to control the display screen or to control the view display image. Specifically, the determination may be made according to an operation trajectory of the control operation signal or an operation range of the control operation signal. If the multi-view display device parses the operation trajectory of the control operation signal or the operation range includes the detection regions corresponding to the plurality of display regions, determining the control operation signal for controlling the display screen; and the multi-view display device parses the control operation signal When the operation track or the operation range is only within the detection area corresponding to one display area, it is determined that the control operation signal is used to control the angle of view display image. . After the multi-view display device determines that the control operation signal is used to control the display screen, step S502 may be performed; and after the multi-view display device determines that the control operation signal is used to control the at least one view display image, step S503 may be performed.

Step S502, after the multi-view display device determines that the control operation object corresponding to the control operation signal is the display screen, the multi-view display device transmits the first control information to the terminal, the first control information. The control operation object corresponding to the control operation signal is the display screen, and a control operation instruction corresponding to the control operation signal.

In some embodiments, after the multi-view display device determines the control operation signal for controlling the display screen, the first control information may be transmitted to the terminal, where the first control information is used to instruct the terminal to control the display screen. Operation, further, the first control information may further carry a control operation instruction parsed by the multi-view display device, such as rotating, scaling the display screen, or adjusting a display format of the display screen. Thereby, the processing operation of the image of the terminal can be shared by the multi-view display device. Optionally, after determining the control operation object corresponding to the control operation signal, the multi-view display device may invoke a pre-stored correspondence between the control operation signal and the control operation instruction in the control operation object, such as when the multi-view display device determines the control operation. After the object is a display screen, the track direction, the track formation shape, and the like in the control operation signal are analyzed based on the correspondence relationship described above to determine a control operation command corresponding thereto.

Step S503, after the multi-view display device determines that the control operation object corresponding to the control operation signal is a view display image, if the view display image includes an image element, the multi-view display The display device determines whether the control operation object corresponding to the control operation signal is the image element, wherein the image element includes at least one of an application icon and an application window.

In some possible implementation manners, after the multi-view display device determines that the control operation object corresponding to the control operation signal is the view display image, the multi-view display device may further determine whether the image element is included in the view display image, if the view angle is displayed The image element is included in the image, and the multi-view display device further needs to determine whether the control operation object corresponding to the control operation signal is an overall view display image or an image element in the view display image. Specifically, when the control operation signal is a gesture operation signal, the operation track shape or the gesture shape of the control operation signal may be detected, and if the operation track shape or the gesture shape of the control operation signal is detected as “X”, the control is determined. The operation object of the operation signal is an image element in the view display image. The image element to be targeted can also be determined by further detecting the shape of the operational trajectory of the control operation signal. If it is determined that the operation object is an image element, the shape of the operation track can be obtained. When the operation track shape is a number such as "1" or "2", the shape of the track can be resolved into a corresponding number, thereby indicating the image element corresponding to the control operation object. The label. If it is another shape, it can be determined that the operation object displays the image as a view. The image element may include at least one of an application icon, an application window, or other image elements, and by controlling the image element, the application corresponding to the image element may be opened, or the display format or display position of the image element may be adjusted. Or by controlling the above image elements, calling other viewing angles to display images and the like. If the multi-view display device determines that the control operation object corresponding to the control operation signal is not the image element in the view display image, or the view element does not include the image element, the multi-view display device determines that the control operation object corresponding to the control operation signal is integral The viewing angle display image may be performed in step S504. If the multi-view display device determines that the control operation object corresponding to the control operation signal is an image element, step S505 may be performed.

Step S504, the multi-view display device determines that the control operation object corresponding to the control operation signal is not the image element, the multi-view display device transmits second control information to the terminal, and the second control information includes The control operation object corresponding to the control operation signal is a view angle display image, and a control operation instruction corresponding to the control operation signal.

In some possible implementation manners, when the multi-view display device determines that the control operation object corresponding to the control operation signal is an overall view display image, the second control information may be transmitted to the terminal. The view display image may be determined to be one or more view display images according to the control operation signal, such as determining the number of view display images according to an operation trajectory or an operation range of the control operation signal. Correspondingly, after determining the control operation object, the multi-view display device may further determine the corresponding control operation signal The operation instruction is controlled and transmitted to the terminal through the second control information, so that after receiving the second control information, the terminal can directly perform corresponding control operations on the corresponding view display image. The control operation instruction may be a general operation instruction, or may be a control operation instruction of a private format set by the terminal and the multi-view display device.

Step S505, after the multi-view display device determines that the control operation object corresponding to the control operation signal is the image element, the multi-view display device transmits third control information to the terminal, and the third control information The control operation object corresponding to the control operation signal is the image element, and the control operation instruction corresponding to the control operation signal.

In some feasible implementation manners, after the multi-view display device determines that the control operation object corresponding to the control operation signal is an image element, the multi-view display device may further parse the control operation instruction of the control operation signal on the image element, and may carry The information of the parsed image element and the third control information for the control operation instruction of the image element are transmitted to the terminal. Thereby, the terminal can directly perform control operations on the corresponding image elements according to the received third control information.

Optionally, the control operation object corresponding to the same control operation signal detected by the multi-view display device is different, and the corresponding control operation command may be the same or different, which is not limited in the embodiment of the present invention.

It can be seen that, in the above manner, after detecting the control operation signal, the multi-view display device can further analyze the control operation signal to parse the control operation object corresponding to the control operation signal and the control operation instruction, thereby forming different control. The information is sent to the terminal, and after receiving the different control information, the terminal can determine the control operation object to be controlled and the specific control operation instruction, so that the multi-view view display image can be adjusted. The multi-view display device can realize the function of displaying the multi-view image, and can further realize the detection and analysis of the control operation signal, thereby further improving the intelligent interaction mode with the user and improving the user experience.

The device embodiments in the embodiments of the present invention are described in detail below in conjunction with the foregoing application scenarios and the foregoing method embodiments.

Referring to FIG. 7, FIG. 7 is a schematic diagram of a unit composition of a multi-view display device according to an embodiment of the present invention. The multi-view display device 700 may include a first determining unit 701, a display unit 702, and a transmitting unit 703.

The first determining unit 701 is configured to display, according to the terminal, a connection with the terminal. n viewing angle display images divided by the display screen on the screen, and determining n display regions corresponding to the n viewing angle display images, where n is a positive integer;

The display unit 702 is configured to respectively display the n view display images in the n display areas;

The transmitting unit 703 is configured to: after detecting the control operation signal in the n detection areas corresponding to the n display areas, the multi-view display device transmits the control operation signal to the terminal.

Optionally, the first determining unit 701 includes:

a second determining unit, configured to receive first split information of the terminal, where the first split information includes a number of n divided view angle display images, and a display view angle corresponding to the n view display images respectively, according to Determining, by the received first split information, n display areas corresponding to the n view display images; or

a third determining unit, configured to receive second split information that is sent by the terminal, where the second split information includes the number of the divided view display images of the terminal is n, and according to the received second split information, determine and The n viewing angles display n display areas corresponding to the image.

Optionally, the multi-view display device 700 further includes:

a fourth determining unit 704, configured to determine, after the control operation signal is detected in the n detection areas corresponding to the n display areas, a control operation object corresponding to the control operation signal and a control operation instruction, where the control operation object Displaying an image for the display screen or viewing angle;

The transmission unit 703 is further configured to:

The fourth determining unit 704 determines that the control operation object corresponding to the control operation signal is the display screen, and transmits the first control information to the terminal, where the first control information includes the control operation signal corresponding to Controlling the operation object as the display screen, and a control operation instruction corresponding to the control operation signal;

The fourth determining unit 704 determines that the control operation object corresponding to the control operation signal is a view display image, and transmits second control information to the terminal, where the second control information includes control corresponding to the control operation signal. The operation object is a view display image, and a control operation instruction corresponding to the control operation signal.

Optionally, after the fourth determining unit 704 determines that the control operation object corresponding to the control operation signal is a view display image, the multi-view display device 700 further includes:

a fifth determining unit 705, configured to: if the image is included in the view display image, determine the Controlling whether the control operation object corresponding to the operation signal is the image element, wherein the image element includes at least one of an application icon and an application window;

The transmission unit 703 is further configured to:

The fifth determining unit 705 determines that the control operation object corresponding to the control operation signal is the image element, and transmits third control information to the terminal, where the third control information includes the control operation signal corresponding to The control operation object is the image element, and a control operation instruction corresponding to the control operation signal.

Optionally, the control operation signal includes at least one of a gesture operation signal and a voice operation signal.

In the embodiment of the present invention, the first determining unit 701 is configured to perform the method in steps S301 and S303 in the embodiment of FIG. 3; the display unit 702 is configured to execute the method in step S304 in the embodiment in FIG. 3; The method of step S305 in the embodiment of FIG. 3 is performed.

In the embodiment of the present invention, the first determining unit 701 is further configured to perform the method of steps S401 and S404 in the embodiment of FIG. 4; the display unit 702 is further configured to perform the method of step S405 in the embodiment of FIG. 4; 703 is also used to perform the method of step S406 in the embodiment of FIG.

In the embodiment of the present invention, the fourth determining unit 704 is configured to perform the method in step S501 in the embodiment of FIG. 5; the fifth determining unit 705 is configured to perform the method in step S503 in the embodiment in FIG. 5; A method for performing steps S502, S504, S505 in the embodiment of FIG.

In the embodiment of the present invention, the foregoing transmission unit 703 can send signals, messages, information, and the like to the terminal through the communication interface configured in the multi-view display device 700. The above communication interface is a wired interface or a wireless interface.

Referring to FIG. 8, FIG. 8 is a schematic diagram of a unit structure of a terminal according to an embodiment of the present invention. The terminal 800 may include a dividing unit 801 and a first control unit 802.

The dividing unit 801 is configured to divide the display screen on the display screen of the terminal into n viewing angle display images after establishing a connection with the multi-view display device;

The control unit 802 is configured to receive a control operation signal transmitted by the multi-view display device, and perform a control operation on the display screen according to the control operation signal.

Optionally, the dividing unit 801 includes:

a first determining unit, configured to determine, according to the n display areas supported by the multi-view display device Defining the display screen on the display screen of the terminal into n viewing angle display images; or

a second determining unit, configured to determine, according to the n display areas that are currently turned on by the multi-view display device, to divide the display screen on the display screen of the terminal into n viewing angle display images; or

And a third determining unit, configured to determine, according to the n display viewing angles of the image presented by the display screen on the display screen of the terminal, the display screen on the display screen of the terminal to be divided into n viewing angle display images.

Optionally, the terminal further includes:

The opening unit 803 is configured to enable the multi-view image display mode after the dividing unit establishes a connection with the multi-view display device and divides the display screen on the display screen of the terminal into n viewing angle display images.

Optionally, the first control unit 802 includes:

a fourth determining unit, configured to determine, according to the control operation signal, a control operation object corresponding to the control operation signal, where the control operation object includes the display screen, and at least one view display image of the n view display images Or an angle of view to display an image element in the image, the image element comprising at least one of an application icon and an application window;

a parsing unit, configured to parse a control operation instruction corresponding to the control operation signal;

And a second control unit, configured to perform a control operation on the control operation object according to the control operation instruction.

In the embodiment of the present invention, the dividing unit 801 is configured to perform the method of steps S301 to S302 in the embodiment of FIG. 3; the first control unit 802 is configured to execute the method in step S306 in the embodiment of FIG.

In the embodiment of the present invention, the dividing unit 801 is further configured to perform the method of steps S401 and S403 in the embodiment of FIG. 4; the opening unit 803 is configured to perform the method of step S402 in the embodiment of FIG. 4; The method of step S407 in the embodiment of FIG. 4 is performed.

Referring to the above embodiment, the multi-view display device 700 in the embodiment shown in Fig. 7 or the terminal 800 in the embodiment shown in Fig. 8 is presented in the form of a unit. A "unit" herein may refer to an application-specific integrated circuit (ASIC), a processor and memory that executes one or more software or firmware programs, integrated logic circuits, and/or other devices that provide the functionality described above. . In one embodiment, those skilled in the art will appreciate that the multi-view display device 700 shown in FIG. 7 can take the form shown in FIG. 9 below.

As shown in FIG. 9, the multi-view display device 700 can be implemented in the structure of FIG. 9, and the multi-view display device 900 can include at least one processor 901, at least one memory 902, and at least one communication interface 903. In addition, the multi-view display device 900 may further include a common component such as an antenna, a camera, and various sensors such as an ultrasonic sensor and an infrared sensor, which will not be described in detail herein. The communication interface 903 includes a wired communication interface or a wireless communication interface, and the wired communication interface can be a universal wired interface or a special wired interface jointly developed with the terminal.

The memory 901 is configured to store program code, and the processor 902 can call the program code stored in the memory to perform the following steps:

After the processor 901 establishes a connection with the terminal, the n viewing angle display images are divided according to the display screens on the display screen of the terminal, and n display areas corresponding to the n viewing angle display images are determined, where n is positive Integer

The processor 901 displays the n view display images in the n display areas respectively;

After the processor 901 detects a control operation signal in the n detection areas corresponding to the n display areas, the multi-view display device transmits the control operation signal to the terminal.

The processor 901 can also be called a central processing unit (CPU). The storage unit 902 may include a read only memory and a random access memory, and provides instructions, data, and the like to the processor 901. A portion of storage unit 902 may also include a non-volatile random access memory. The components of the multi-view display device 900 are coupled together, for example, by a bus system, in a particular application. In addition to the data bus, the bus system can also include a power bus, a control bus, and a status signal bus. However, for the sake of clarity, the various buses are labeled as bus systems in the figure. The method disclosed in the foregoing embodiments of the present invention may be applied to the processor 901 or implemented by the processor 901. The processor 901 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method may be completed by an integrated logic circuit of hardware in the processor 901 or an instruction in a form of software. The processor 901 may be a general purpose processor, a digital signal processor, an application specific integrated circuit, an off-the-shelf programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The processor 901 can implement or perform the various methods, steps, and logic blocks disclosed in the embodiments of the present invention. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present invention may be directly implemented as a hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor. Software module It is located in a storage medium mature in the field of random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like. The storage medium is located in the storage unit 902. For example, the processor 901 can read the information in the storage unit 902, and complete the steps of the foregoing method in combination with hardware.

In one embodiment, those skilled in the art will appreciate that the terminal 800 shown in FIG. 7 can take the form shown in FIG. 10 below.

As shown in FIG. 10, the terminal 800 can be implemented in the structure of FIG. 10. The terminal 1000 can include at least one processor 1001, at least one memory 1002, and at least one communication interface 1003. In addition, the terminal 1000 may also include general components such as an antenna, which will not be described in detail herein. The communication interface 1003 includes a wired communication interface or a wireless communication interface, and the wired communication interface can be a universal wired interface or a special wired interface jointly developed with the terminal. The memory 1002 is configured to store program code, and the processor 1001 may call program code stored in the memory to perform the following steps:

After the processor 1001 establishes a connection with the multi-view display device, the display screen on the display screen of the terminal is divided into n view display images;

The processor 1001 receives a control operation signal transmitted by the multi-view display device, and performs a control operation on the display screen according to the control operation signal.

The processor 1001 may also be referred to as a central processing unit (CPU). The storage unit 1002 may include a read only memory and a random access memory, and provides instructions, data, and the like to the processor 1001. A portion of the storage unit 1002 may also include a non-volatile random access memory. The components of terminal 1000 are coupled together, for example, by a bus system, in a particular application. In addition to the data bus, the bus system can also include a power bus, a control bus, and a status signal bus. However, for the sake of clarity, the various buses are labeled as bus systems in the figure. The method disclosed in the foregoing embodiments of the present invention may be applied to the processor 1001 or implemented by the processor 1001. The processor 1001 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method may be completed by an integrated logic circuit of hardware in the processor 1001 or an instruction in a form of software. The processor 1001 may be a general purpose processor, a digital signal processor, an application specific integrated circuit, an off-the-shelf programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The processor 1001 can implement or perform the various methods, steps, and logic blocks disclosed in the embodiments of the present invention. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present invention may be directly embodied as hardware decoding. The execution of the processor is completed or performed by a combination of hardware and software modules in the decoding processor. The software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like. The storage medium is located in the storage unit 1002. For example, the processor 1001 can read the information in the storage unit 1002, and complete the steps of the foregoing method in combination with hardware.

The embodiment of the invention further provides a computer storage medium for storing computer software instructions for the multi-view display device, which comprises a computer program for performing the above method embodiments.

The embodiment of the invention further provides a computer storage medium for storing computer software instructions for the terminal, which comprises a computer program for executing the above method embodiment.

Although the present invention has been described herein in connection with the embodiments of the present invention, it will be understood by those skilled in the <RTIgt; Other variations of the disclosed embodiments are achieved. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill several of the functions recited in the claims. Certain measures are recited in mutually different dependent claims, but this does not mean that the measures are not combined to produce a good effect.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, apparatus (device), or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code. The computer program is stored/distributed in a suitable medium, provided with other hardware or as part of the hardware, or in other distributed forms, such as over the Internet or other wired or wireless telecommunication systems.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of the methods, apparatus, and computer program products of the embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, a special purpose computer, an embedded processor or other programmable data processing device to produce a machine such that it can be The instructions executed by the processor of the programmed data processing device generate means for implementing the functions specified in one or more blocks of the flowchart or in a block or blocks of the flowchart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

While the invention has been described with respect to the specific embodiments and embodiments thereof, various modifications and combinations may be made without departing from the spirit and scope of the invention. Accordingly, the specification and drawings are to be construed as the It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention

Claims

A multi-view display device, comprising: a processor, a memory, a communication interface, and a bus system, wherein the processor, the memory, and the communication interface are connected by the bus system and complete communication with each other;

The memory stores executable program code for wired communication or wireless communication;

The processor is configured to invoke the executable program code in the memory to perform the following operations:

After establishing a connection with the terminal, the n viewing angle display images are divided according to the display screens on the display screen of the terminal, and n display regions corresponding to the n viewing angle display images are determined, where n is a positive integer;

Displaying the n view display images in the n display areas respectively;

After the control operation signal is detected in the n detection areas corresponding to the n display areas, the control operation signal is transmitted to the terminal.
The multi-view display device according to claim 1, wherein the processor displays images corresponding to the n view display images according to n view display images divided by the display screen on the display screen of the terminal. The specific way of n display areas is:

Receiving the first split information of the terminal, where the first split information includes the number of the divided view display images of the terminal is n and the display view angles corresponding to the n view display images respectively, according to the received first view Dividing information to determine n display areas corresponding to the n display images; or

Receiving, by the terminal, the second split information, where the second split information includes the number of the terminal divided view display images being n, and determining, according to the received second split information, the display image with the n perspective views Corresponding n display areas.
The multi-view display device according to claim 1 or 2, wherein the processor is further configured to call after the processor detects a control operation signal in the n detection regions corresponding to the n display regions. The executable program code in the memory to perform the following operations:

Determining, by the control operation signal, a control operation object and a control operation instruction, where the control operation object is the display screen or the view display image;

The specific manner in which the processor transmits the control operation signal to the terminal is:

After determining that the control operation object corresponding to the control operation signal is the display screen, the first control The control information is transmitted to the terminal, and the first control information includes a control operation object corresponding to the control operation signal being the display screen, and a control operation instruction corresponding to the control operation signal;

Determining, after the control operation object corresponding to the control operation signal is a view display image, transmitting the second control information to the terminal, where the second control information includes a control operation object corresponding to the control operation signal as a view display image, And a control operation instruction corresponding to the control operation signal.
The multi-view display device according to claim 3, wherein the processor is further configured to call the memory in the memory after the processor determines that the control operation object corresponding to the control operation signal is a view display image. Executable program code to do the following:

Determining, by the view angle display image, an image element, whether the control operation object corresponding to the control operation signal is the image element, wherein the image element includes at least one of an application icon and an application window;

The specific manner in which the processor transmits the control operation signal to the terminal is:

After determining that the control operation object corresponding to the control operation signal is the image element, transmitting third control information to the terminal, the third control information including the control operation object corresponding to the control operation signal is the image An element, and a control operation instruction corresponding to the control operation signal.
The multi-view display device according to any one of claims 1 to 4, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.
A terminal, comprising: a processor, a memory, a communication interface, and a bus system, wherein the processor, the memory, and the communication interface are connected by the bus system and complete communication with each other;

The memory stores executable program code for wired communication or wireless communication;

The processor is configured to invoke the executable program code in the memory to perform the following operations:

After establishing a connection with the multi-view display device, dividing the display screen on the display screen of the terminal into n viewing angle display images;

Receiving a control operation signal transmitted by the multi-view display device, and performing a control operation on the display screen according to the control operation signal.
The terminal according to claim 6, wherein the specific manner in which the processor divides the display screen on the display screen of the terminal into n viewing angles is:

Determining, according to the n display areas supported by the multi-view display device, dividing the display screen on the display screen of the terminal into n viewing angle display images; or

Determining, according to the n display areas that are currently turned on by the multi-view display device, dividing the display screen on the display screen of the terminal into n view display images; or

Determining, according to n display viewing angles of the image presented by the display screen on the display screen of the terminal, dividing the display screen on the display screen of the terminal into n viewing angle display images.
The terminal according to claim 6 or 7, wherein after the processor establishes a connection with the multi-view display device, the processor divides the display screen on the display screen of the terminal into n viewing angles. Before displaying the image, the processor is further configured to invoke the executable program code in the memory to perform the following operations:

Turn on the multi-view image display mode.
The terminal according to any one of claims 6 to 8, wherein the specific manner in which the processor performs a control operation on the display screen according to the control operation signal is:

Determining, according to the control operation signal, a control operation object corresponding to the control operation signal, the control operation object including the display screen, at least one view display image in the n view display images, or in a view display image An image element, the image element including at least one of an application icon and an application window;

Parsing a control operation instruction corresponding to the control operation signal;

Controlling the control operation object according to the control operation instruction.
A multi-view display device, comprising:

a first determining unit, configured to determine, after the connection with the terminal, the n viewing angles displayed according to the display screen on the display screen of the terminal, and determine n display regions corresponding to the n viewing angle display images, Is a positive integer;

a display unit, configured to respectively display the n view display images in the n display areas;

And a transmitting unit, configured to transmit the control operation signal to the terminal after detecting a control operation signal in the n detection areas corresponding to the n display areas.
The multi-view display device according to claim 10, wherein the first determining unit comprises:

a second determining unit, configured to receive first split information of the terminal, where the first split information includes a number of n divided view angle display images, and a display view angle corresponding to the n view display images respectively, according to Determining, by the received first split information, n display areas corresponding to the n view display images; or

a third determining unit, configured to receive second split information that is sent by the terminal, where the second split information includes the number of the divided view display images of the terminal is n, and according to the received second split information, determine and The n viewing angles display n display areas corresponding to the image.
The multi-view display device according to claim 10 or 11, wherein the multi-view display device further comprises:

a fourth determining unit, configured to determine a control operation object corresponding to the control operation signal and a control operation instruction after detecting a control operation signal in the n detection areas corresponding to the n display areas, where the control operation object is Displaying an image or a viewing angle;

The transmission unit is further configured to:

After the fourth determining unit determines that the control operation object corresponding to the control operation signal is the display screen, transmitting the first control information to the terminal, where the first control information includes a control corresponding to the control operation signal The operation object is the display screen, and a control operation instruction corresponding to the control operation signal;

The fourth determining unit determines that the control operation object corresponding to the control operation signal is a view display image, and transmits second control information to the terminal, where the second control information includes a control operation corresponding to the control operation signal The object displays an image as a view, and a control operation instruction corresponding to the control operation signal.
The multi-view display device according to claim 12, wherein the fourth determining unit determines that the control operation object corresponding to the control operation signal is a view display image, the multi-view display device further includes:

a fifth determining unit, configured to determine whether the control operation object corresponding to the control operation signal is the image element, if the image is included in the view display image, wherein the image element includes an application icon and an application window At least one type;

The transmission unit is further configured to:

After the fifth determining unit determines that the control operation object corresponding to the control operation signal is the image element, the third control information is transmitted to the terminal, and the third control information includes a control corresponding to the control operation signal. The operation object is the image element, and a control operation instruction corresponding to the control operation signal.
The multi-view display device according to any one of claims 10 to 13, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.
A terminal, comprising:

a dividing unit, configured to divide the display screen on the display screen of the terminal into n viewing angle display images after establishing a connection with the multi-view display device;

a first control unit, configured to receive a control operation signal transmitted by the multi-view display device, and perform a control operation on the display screen according to the control operation signal.
The terminal according to claim 15, wherein the dividing unit comprises:

a first determining unit, configured to determine, according to the n display areas supported by the multi-view display device, that the display screen on the display screen of the terminal is divided into n viewing angle display images; or

a second determining unit, configured to determine, according to the n display areas that are currently turned on by the multi-view display device, to divide the display screen on the display screen of the terminal into n viewing angle display images; or

And a third determining unit, configured to determine, according to the n display viewing angles of the image presented by the display screen on the display screen of the terminal, the display screen on the display screen of the terminal to be divided into n viewing angle display images.
The terminal according to claim 15 or 16, wherein the terminal further comprises:

And an opening unit, configured to: after the dividing unit establishes a connection with the multi-view display device, and divide the display screen on the display screen of the terminal into n viewing angle display images, turn on the multi-view image display mode.
The terminal according to any one of claims 15 to 17, wherein the first control unit comprises:

a fourth determining unit, configured to determine, according to the control operation signal, a control operation object corresponding to the control operation signal, where the control operation object includes the display screen, and the n view angle display images At least one of the viewing angles displays an image, or an image element in the viewing angle display image, the image element including at least one of an application icon and an application window;

a parsing unit, configured to parse a control operation instruction corresponding to the control operation signal;

And a second control unit, configured to perform a control operation on the control operation object according to the control operation instruction.
A method for controlling a multi-view image, comprising:

After the multi-view display device establishes a connection with the terminal, the n viewing angle display images are divided according to the display screens on the display screen of the terminal, and n display regions corresponding to the n viewing angle display images are determined, where n is a positive integer. ;

The multi-view display device respectively displays the n view display images in the n display areas;

After the multi-view display device detects a control operation signal in the n detection regions corresponding to the n display regions, the multi-view display device transmits the control operation signal to the terminal.
The method according to claim 19, wherein the multi-view display device determines n images corresponding to the n view display images according to n view display images divided by the display screen on the display screen of the terminal. Display areas, including:

The multi-view display device receives the first split information of the terminal, where the first split information includes a number of n divided view angle display images and a display view angle corresponding to the n view display images respectively. The multi-view display device determines n display regions corresponding to the n view display images according to the received first split information; or

The multi-view display device receives the second split information sent by the terminal, the second split information includes the number of the terminal divided view display images being n, and the multi-view display device according to the received second Dividing the information to determine n display regions corresponding to the n view display images.
The method of claim 19 or 20, wherein after the multi-view display device detects the control operation signal in the n detection regions corresponding to the n display regions, the method further includes:

The multi-view display device determines a control operation object corresponding to the control operation signal and a control operation instruction, and the control operation object is the display screen or the view display image;

The multi-view display device transmits the control operation signal to the terminal, including:

After the multi-view display device determines that the control operation object corresponding to the control operation signal is the display screen, the multi-view display device transmits first control information to the terminal, and the first control information includes the a control operation object corresponding to the control operation signal is the display screen, and a control operation instruction corresponding to the control operation signal;

After the multi-view display device determines that the control operation object corresponding to the control operation signal is a view display image, the multi-view display device transmits second control information to the terminal, and the second control information includes the control The control operation object corresponding to the operation signal is a view display image, and a control operation instruction corresponding to the control operation signal.
The method according to claim 21, wherein after the multi-view display device determines that the control operation object corresponding to the control operation signal is a view display image, the method further includes:

If the view angle display image includes an image element, the multi-view display device determines whether the control operation object corresponding to the control operation signal is the image element, wherein the image element includes an application icon and an application window. At least one

The multi-view display device transmits the control operation signal to the terminal, including:

After the multi-view display device determines that the control operation object corresponding to the control operation signal is the image element, the multi-view display device transmits third control information to the terminal, and the third control information includes the The control operation object corresponding to the control operation signal is the image element, and a control operation instruction corresponding to the control operation signal.
The method according to any one of claims 19 to 22, wherein the control operation signal comprises at least one of a gesture operation signal and a voice operation signal.
A method for controlling a multi-view image, comprising:

After the terminal establishes a connection with the multi-view display device, the terminal divides the display screen on the display screen of the terminal into n viewing angle display images;

The terminal receives a control operation signal transmitted by the multi-view display device, and performs a control operation on the display screen according to the control operation signal.
The method of claim 24, wherein the terminal divides the display screen on the display screen of the terminal into n viewing angle display images, including:

Determining, by the terminal, the end of the n display areas supported by the multi-view display device The display screen on the display screen of the end is divided into n viewing angle display images; or

Determining, by the n display areas that are currently turned on by the multi-view display device, the display screen on the display screen of the terminal into n viewing angle display images; or

The terminal determines, according to the n display viewing angles of the image presented by the display screen on the display screen of the terminal, to divide the display screen on the display screen of the terminal into n viewing angle display images.
The method according to claim 24 or 25, wherein after the terminal establishes a connection with the multi-view display device, the terminal divides the display screen on the display screen of the terminal into n viewing angle display images. Previously, the method further includes:

The terminal turns on the multi-view image display mode.
The method according to any one of claims 24 to 26, wherein the controlling operation of the display screen by the terminal according to the control operation signal comprises:

Determining, by the terminal, a control operation object corresponding to the control operation signal according to the control operation signal, where the control operation object includes the display screen, at least one view display image in the n view display images, or a view display An image element in an image, the image element including at least one of an application icon and an application window;

The terminal parses a control operation instruction corresponding to the control operation signal;

The terminal performs a control operation on the control operation object according to the control operation instruction.