JP2013238930A - Display device and control method of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique that allows for an operation with an operation part even in a mode in which a display part is overlapped on the operation part, and thereby to improve convenience of a user and enable miniaturization of a display device.SOLUTION: A display device according to the present invention includes: an operation part; and a transparent display part that includes a display panel that can transmit a background, and a touch sensor provided on at least one of a front surface of the display panel and a rear surface thereof. The display device is configured to be able to take a first mode in which the transparent display part is not overlapped on the operation part and a second mode in which the transparent display part is overlapped on the operation part such that the touch sensor is positioned on an opposite side of an operation part side, and include: detection means that determines whether the mode of the display device is the first mode or the second embodiment; and control means that allows the operation part to be operated through the touch sensor in a pseudo manner when the mode of the display device is determined to be the second mode by the detection means.

Description

  The present invention relates to a display device and a control method thereof.

  Mobile terminals (cell phones, camcorders, digital cameras, etc.) include foldable mobile terminals. For example, there is a mobile terminal that includes a main body portion and a display portion that can be rotated so as to overlap an operation portion (UI (User Interface) portion; a button, a switch, or the like) included in the main body portion. Hereinafter, of the mobile terminals, a form in which the display unit is overlaid on the main body (ie, a folded form) is referred to as a “closed form”, and a form in which the display unit is not overlaid on the main body (ie, folded). Is called “open form”. In the closed form, the display unit is overlaid on part or all of the operation unit of the main body unit. That is, in the closed form, part or all of the operation unit is hidden by the display unit. Conventionally, in the closed configuration, the operation unit hidden in the display unit could not be operated (the operation unit hidden in the display unit in the closed configuration could be operated only in the open configuration). Therefore, the convenience for the user has been reduced. If the operation unit hidden in the display unit in the closed configuration is limited to the one in the open configuration, the user's convenience can be prevented from being lowered. However, such a restriction on design (arrangement of the operation unit) is a major demerit for mobile terminals that are becoming smaller.

The display unit includes a transparent display unit in which a transparent electrode is disposed on a transparent member such as a glass substrate. In the transparent display unit, the image displayed on the transparent display unit and the background of the transparent display unit (the object existing on the back side of the transparent display unit) can be simultaneously viewed.
A technique related to the transparent display unit is disclosed in Patent Document 1, for example.
Specifically, Patent Document 1 discloses a mobile terminal having a non-transparent display unit (a display unit that is not a transparent display unit) and a transparent display unit that can be rotated to overlap the non-transparent display unit. Yes. In the mobile terminal disclosed in Patent Document 1, a three-dimensional image is obtained by using an image displayed on the non-transparent display unit and an image displayed on the transparent display unit in a form in which the transparent display unit is superimposed on the non-transparent display unit. Is configured.

  If a transparent display unit is used as the display unit of the above-described mobile terminal (a mobile terminal having a main body unit and a display unit), an operation unit on which the display unit is superimposed in a closed configuration is viewed through the screen of the display unit. It becomes possible. However, even in such a configuration, in the closed form, the operation unit on which the display unit is superimposed cannot be operated.

JP 2004-163587 A

  The present invention provides a technique that enables operation by the operation unit even when the display unit is superimposed on the operation unit, thereby improving the convenience of the user and reducing the size of the display device. The purpose is to do.

The display device of the present invention includes:
An operation unit;
A transparent display unit having a display panel capable of transmitting a background, and a touch sensor provided on at least one of a front surface and a back surface of the display panel;
A display device comprising:
The display device includes a first form in which the transparent display unit is not superimposed on the operation unit, and the transparent display unit on the operation unit so that the touch sensor is located on a side opposite to the operation unit side. Can be taken with the second form,
Detecting means for detecting whether the form of the display device is the first form or the second form;
Control means for enabling the operation unit to be operated in a pseudo manner by the touch sensor when the detection means detects that the form of the display device is the second form;
It is characterized by having.

The display device control method of the present invention includes:
An operation unit;
A transparent display unit having a display panel capable of transmitting a background, and a touch sensor provided on at least one of a front surface and a back surface of the display panel;
A display device control method comprising:
The display device includes a first form in which the transparent display unit is not superimposed on the operation unit, and the transparent display unit on the operation unit so that the touch sensor is located on a side opposite to the operation unit side. Can be taken with the second form,
The display device control method includes:
A detection step of detecting whether the display device is in the first form or the second form;
A control step in which the operation unit can be operated in a pseudo manner by the touch sensor when it is detected in the detection step that the form of the display device is the second form;
It is characterized by having.

  According to the present invention, even if the display unit is overlapped with the operation unit, the operation by the operation unit can be performed. As a result, the convenience of the user can be improved and the display device can be downsized.

FIG. 1 is a block diagram illustrating an example of a functional configuration of a display device according to a first embodiment. The figure which shows an example of the form of a display apparatus, and a display area The figure which shows an example of the switching method of the form of a display apparatus The figure which shows an example of the switching method of the form of a display apparatus The figure which shows an example of the switching method of the form of a display apparatus The figure which shows an example of the switching method of the form of a display apparatus 7 is a flowchart illustrating an example of a processing flow of the display device according to the first embodiment. FIG. 6 is a block diagram illustrating an example of a functional configuration of a display device according to a second embodiment. FIG. 10 is a diagram illustrating an example of operations and operations of the display device according to the second embodiment.

<Example 1>
Hereinafter, a display device and a control method thereof according to Embodiment 1 of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating an example of a functional configuration of the display device according to the present embodiment.
The display device 101 includes a main body unit 102 and a transparent display unit 103. As shown in FIG. 2, the display device 101 includes a form in which the transparent display unit 103 is not superimposed on a UI (User Interface) unit 104 included in the main body unit 102 (first form), and a mode in which the UI unit 104 is transparent. There is a form (second form) in which the display unit 103 is overlaid. As the transparent display unit 103 rotates or slides, the form of the display device 101 is switched between the first form and the second form. The transparent display unit 103 may be detachable from the main body unit 102. When the transparent display unit 103 is attached to the main body unit 102, the form of the display device 101 becomes the second form, and when the transparent display unit 103 is detached from the main body part 102, the form of the display device 101 becomes the first form. It may be. FIG. 2 shows an example in which the form of the display device 101 is switched by the rotation of the transparent display unit 103, and the rotation axis direction of the transparent display unit 103 is a direction parallel to the horizontal direction of the display device 101. It is an example.

The main body unit 102 includes a UI unit 104, a form detection unit 105, an input control unit 106, a processing unit 107, an image output unit 108, an illumination unit 109, and the like.
The transparent display unit 103 includes a transparent panel 110, a touch sensor 111, and the like.

  The transparent panel 110 is a display panel that displays an image output from the image output unit 108 of the main body unit 102. Further, the transparent panel 110 is made of a transparent member and has a feature that the background can be transmitted. Therefore, when the user views the image from the front side of the transparent panel 110, the user can visually recognize an object on the back side of the transparent panel 110.

The touch sensor 111 receives a user operation and outputs operation information representing the operation content to the input control unit 106 of the main body unit 102. In the present embodiment, the touch sensor 111 is provided only on one of the front surface and the back surface of the transparent panel 110. Specifically, the touch sensor 111 is provided to be located on the side opposite to the UI unit 104 side (operation unit side) when the display device 101 is in the second mode. In other words, the touch sensor 111 is provided on the surface of the transparent panel 110 on the side viewed by the user in the second form, between the front surface and the back surface. Here, the surface on the side viewed by the user in the first embodiment is the front surface. As shown in FIGS. 3 and 4, when the configuration of the display device 101 is switched by rotating the transparent display unit 103 around the direction parallel to the screen, the surface is the UI unit 104 in the second mode. (The surface on the side viewed by the user is the back surface). Therefore, the touch sensor 111 is provided on the back surface of the transparent panel 110. FIG. 3 is an example in the case where the rotation axis direction of the transparent display unit 103 is parallel to the left-right direction of the display device 101, and FIG. 4 shows the rotation axis direction of the transparent display unit 103 of the display device 101. It is an example in the case where the direction is parallel to the vertical direction. As shown in FIG. 5, when the configuration of the display device 101 is switched by sliding the transparent display unit 103, in the second mode, the back surface faces the UI unit 104 (the surface on the side viewed by the user). Becomes the surface). As shown in FIG. 6, the back surface of the transparent display unit 103 is opposed to the UI unit 104 in the second mode even when the configuration of the display device 101 is switched by rotating the transparent display unit 103 about the direction perpendicular to the screen. (The surface on the side viewed by the user is the surface). Therefore, in the case of the configuration shown in FIGS. 5 and 6, the touch sensor 111 is provided on the surface of the transparent panel 110.
Note that the touch sensor 111 may be provided on both the front surface and the back surface of the transparent panel 110.

  The UI unit 104 is an interface (operation unit) operated by a user. The UI unit 104 is, for example, an operation button, a switch, a keyboard, a touch sensor, or the like. When the user operates the UI unit 104, the UI unit 104 outputs operation information representing the operation content to the input control unit 106.

  The form detection unit 105 detects whether the form of the display device 101 is the first form or the second form. The detection method in the form of the display device 101 may be any method. For example, the form of the display device 101 may be determined according to the state of a switch that is pressed only in one of the first form and the second form. The form of the display device 101 may be determined according to the energization state of a circuit that is energized only in one of the first form and the second form. The form detection unit 105 outputs the detection result of the form of the display device 101 to the input control unit 106 and the image output unit 108 as form information.

The input control unit 106 selects either the UI unit 104 or the touch sensor 111 according to the configuration information input from the configuration detection unit 105. Specifically, the input control unit 106 selects the UI unit 104 when the display device 101 is in the first form, and selects the touch sensor 111 when the display device 101 is in the second form. . Then, the input control unit 106 outputs operation information input from the selected functional unit (UI unit 104 or touch sensor 111) to the processing unit 107.
Moreover, the input control part 106 outputs a lighting signal to the illumination part 109, when operation of the touch sensor 111 is performed in the 2nd form.

  The processing unit 107 performs arithmetic processing according to the operation information input from the input control unit 106, and outputs the processing result to the image output unit 108 as display information. The processing unit 107 enables the UI unit 104 to be operated in a pseudo manner by the touch sensor 111 when the display device 101 is in the second mode. Specifically, when the touch sensor 111 is operated when the display device 101 is in the second form, the processing unit 107 performs the same processing (calculation) as when the UI unit 104 at the operation position is operated. Process). For example, the operation information output from the touch sensor 111 includes operation position information, and the processing unit 107 performs the same calculation process as when the UI unit 104 corresponding to the operation position included in the operation information is operated. . When the touch sensor 111 is operated when the display device 101 is in the second form, the same operation information as the operation information output by the UI unit 104 when the UI unit 104 at the operation position is operated. May be output from the touch sensor 111.

  The image output unit 108 converts the display information input from the processing unit into an image (characters, graphics, icons, still images, moving images, etc.) and outputs the image to the transparent display unit 103 (transparent panel 110).

  In the image output unit 108, an area (display area) where an image is displayed on the transparent panel 110 may be controlled based on the form information input from the form detection unit 105 (area control). For example, as shown in FIG. 2, in the first form, the entire area of the screen may be the display area, and in the second form, a part of the area of the screen (area that does not overlap the UI unit 104) may be the display area. . By controlling the display area so as not to overlap with the UI unit 104 in the second form, it is possible to prevent the visual recognition of the UI unit 104 from being disturbed by the image displayed on the transparent panel 110.

In the case of the configuration in which the form of the display device 101 is switched by the rotation of the transparent display unit 103 (configuration as shown in FIGS. 3, 4, and 6), in the first form and the second form, The direction (up / down / left / right direction) of the transparent display unit 103 is different. For this reason, if the orientation of the image output from the image output unit 108 is constant, the orientation of the image viewed by the user changes between the first form and the second form.
Therefore, the image output unit 108 inverts the image so that the orientation of the image seen by the user does not change between when the display device 101 is in the first form and when the display device 101 is in the second form. It is preferable to perform processing (inversion control). For example, in the configuration of FIG.
An upside down process for turning the image upside down may be performed. In the case of the configuration of FIG. 4, it is only necessary to perform left / right reversal processing for reversing the left / right of the image. In the case of the configuration of FIG. 6, an up / down / left / right inversion process for inverting the up / down and left / right of the image may be performed. In the case of the configuration of FIG. 5, since the direction of the transparent display unit 103 is the same between the first form and the second form, it is not necessary to perform the inversion process.
When one display device has a plurality of operations for changing the form, the operation when the second form is achieved may be determined, and inversion processing may be performed according to the determination result. For example, when one display device can perform the operations shown in FIGS. 3 to 6, it is determined which of the operations shown in FIGS. 3 to 6 causes the display device to be in the second form. Then, the reversal process according to the determination result may be performed.
In the above example, the case where the reversal process is performed on the image in the second form from the first form has been described. However, the reversal process may be performed on the image in the first form from the second form. .
By the inversion control described above, the orientation of the displayed image can always be kept constant.

  Note that the above-described region control and inversion control may be performed by a functional unit different from the image output unit 108. For example, in addition to the function unit illustrated in FIG. 1, an area control unit that performs area control and an inversion control unit that performs inversion control may be further provided.

In the second embodiment, the illumination unit 109 notifies the user that the UI unit 104 can be operated in a pseudo manner by the touch sensor 111. Specifically, the illumination unit 109 is turned on in response to a lighting signal input from the input control unit 106. That is, the illumination unit 109 is lit when the user operates the touch sensor 111 in the second mode. The user can determine that the UI unit 104 can be operated in a pseudo manner when the illumination unit 109 is turned on.
The illumination unit 109 may be provided at the same position as the UI unit 104 (a position where the UI unit 104 appears to be lit), or may be provided at a position different from the position of the UI unit 104. It may be.
In the present embodiment, the user is notified by lighting that the UI unit 104 can be operated in a pseudo manner. However, the present invention is not limited to this. For example, the user may be notified that the UI unit 104 can be operated in a pseudo manner by turning off the lights. The user may be notified that the UI unit 104 can be operated in a pseudo manner by voice, vibration, an image, or the like. The image is, for example, graphics, text, an icon, or the like indicating that the UI unit 104 can be operated in a pseudo manner.
Further, in this embodiment, when the form of the display device 101 is the second form and when the user operates the touch sensor 111, the UI unit 104 can be operated in a pseudo manner. Although it is configured to be notified, it is not limited to this. It may be notified that the UI unit 104 can be operated in a pseudo manner at the timing when the second mode is reached, or that the UI unit 104 can be operated in a pseudo manner during the entire period of the second mode. May be.

A processing flow of the display apparatus 101 according to the present embodiment will be described with reference to the flowchart of FIG.
When the processing flow is started in S601, first, in S602, the form detection unit 105 detects the form of the display device 101.
Next, when the form of the display device 101 is the first form (S603: Yes), the process proceeds to S604, and when the form of the display device 101 is the second form (S603: No), The process proceeds to S608.

In step S <b> 604, the input control unit 106 selects the UI unit 104.
Next, in S605, the illumination unit 109 is turned on. Thereby, the user is notified that the UI unit 104 can be operated.
In step S <b> 606, the display apparatus 101 stands by until there is an operation on the UI unit 104.
When the UI unit 104 has not been operated for a certain period of time (S606: No), the illumination unit 109 is turned off in S607. Thereafter, the process returns to S602.
If the UI unit 104 is operated (S606: Yes), in S613, the processing unit 107 performs arithmetic processing according to the operation of the UI unit 104, and the image output unit 108 generates an image from the arithmetic processing result. To do. Thereafter, the process proceeds to S614.

In step S <b> 608, the input control unit 106 selects the touch sensor 111.
In step S <b> 609, the display apparatus 101 waits until the touch sensor 111 is operated.
If the touch sensor 111 has not been operated for a predetermined time (S609: No), the process returns to S602.
When the touch sensor 111 is operated (S609: Yes), the illumination unit 109 is turned on in S610. Thereafter, the process proceeds to S611.

In step S <b> 611, the display apparatus 101 waits until the touch sensor 111 is operated.
If the touch sensor 111 has not been operated for a certain time (S611: No), the illumination unit 109 is turned off in S612. Thereafter, the process returns to S602.
When the touch sensor 111 is operated (S611: Yes), in S613, the processing unit 107 performs the same calculation process as when the UI unit at the operation position is operated, and the image output unit 108 performs the calculation process. An image is generated from the result. Thereafter, the process proceeds to S614.

If inversion processing is necessary after S613 (S614: Yes), in S615, the image output unit 108 performs inversion processing on the image generated in S613, and the image subjected to inversion processing is displayed. Output to the transparent panel 110. Thereafter, the process proceeds to S616. When the inversion process is not necessary (S614: No), the image output unit 108 outputs the image generated in S613 to the transparent panel 110. Thereafter, the process proceeds to S616.
In S <b> 616, the transparent panel 110 displays the image output from the image output unit 108 on the transparent panel 110.
Then, in S617, the processing flow ends.

  As described above, according to the present embodiment, when the display device 101 is in the second form, the touch sensor 111 is controlled so that the UI unit 104 can be operated in a pseudo manner. Thereby, even if the transparent display unit 103 is overlaid on the UI unit 104, the touch sensor 111 is operated and the UI unit 104 can be operated. As a result, the convenience of the user can be improved and the display device can be downsized.

In addition, although the present Example demonstrated the structure which makes the touch sensor 111 inoperable in the 1st form, the touch sensor 111 may be operable irrespective of a 2nd form or a 1st form. For example, the touch sensor 111 may have a second operation mode for operating the UI unit 104 in a pseudo manner and a first operation mode different from the second operation mode. The operation mode may be the first operation mode in the first form, and the operation mode may be the second operation mode in the second form.
Of the functional units included in the main unit, functional units other than the UI unit may be provided in the transparent display unit.

<Example 2>
Hereinafter, a display device and a control method thereof according to Embodiment 2 of the present invention will be described.
In the first embodiment, the configuration in which the UI unit 104 can be operated in a pseudo manner by operating the touch sensor 111 in the second mode has been described.
In the second embodiment, a configuration in which an operation other than an operation that can be performed using the UI unit 104 can be performed by operating the touch sensor 111 in the second mode will be described. That is, in this embodiment, an example will be described in which the number of operations that can be performed using the touch sensor 111 in the second mode is greater than the number of operations that can be performed using the UI unit 104.

FIG. 8 is a block diagram illustrating an example of a functional configuration of the display device 101 according to the present embodiment. The display apparatus 101 according to the present embodiment includes a function expansion unit 701 in addition to the function unit described in the first embodiment (the function unit in FIG. 1). Note that functional units other than the function expansion unit 701 are the same as those in the first embodiment (FIG. 1), and thus the same reference numerals are given, and descriptions thereof are omitted.
When the form information input from the form detection unit 105 indicates the second form, the function extension unit 701 generates extended operation information representing an operation that can be performed using the touch sensor 111 and outputs the extended operation information to the processing unit 107. In the second mode, the processing unit 107 generates display information based on the operation information from the touch sensor 111 and the extended operation information from the function expansion unit 701 and outputs the display information to the image output unit 108.

For example, the operation using the touch sensor includes a tap operation and a flick operation. The tap operation is an operation of touching the touch sensor for a short time (for a moment), for example. The flick operation is, for example, an operation of flicking the touch sensor with a finger or an operation of sliding the finger while touching the touch sensor.
In this embodiment, the UI unit 104 is a button, and the operation of the UI unit 104 is an operation of pressing the button. In the second mode, the user can perform a pseudo operation of pressing the button of the UI unit 104 by tapping the touch sensor 111.
In the present embodiment, a flick operation as shown in FIG. 9A can also be performed in the second mode. In this embodiment, extended operation information is generated in response to the flick operation being performed. As a result, as shown in FIG. 9B, a GUI (Graphical User Interface) image indicating an operation other than the touch operation corresponding to the pressing of the button of the UI unit 104 is displayed. The user can perform an operation other than the touch operation corresponding to the pressing of the button of the UI unit 104 by operating the GUI image. For example, the processing unit 107 invalidates the pseudo operation of the UI unit 104 in response to the input of the extended operation information, and the operation information from the touch sensor 111 (the tap operation is performed so that the operation of the GUI image is valid). The correspondence relationship between the performed position (touch position) and the processing content is switched. Thereby, the operation of the GUI image becomes possible.

As described above, according to the present embodiment, operations other than those that can be performed using the UI unit 104 can be performed by operating the touch sensor 111 in the second mode. Thereby, user convenience can be improved as compared with the first embodiment.
In the present embodiment, the configuration has been described in which the number of operations other than the pseudo operation of the UI unit 104 is increased by a flick operation (operations that can be performed using the touch sensor 111 are expanded), but the configuration is not limited thereto. Absent. For example, a GUI image (GUI image that can be operated by the user) indicating an operation other than the pseudo operation of the UI unit 104 is displayed in an area other than the area of the UI unit 104 according to the second form. May be.

DESCRIPTION OF SYMBOLS 101: Display apparatus 102: Main-body part 103: Transparent display part 104: UI part 105: Form detection part 107: Processing part 110: Transparent panel 111: Touch sensor

Claims (14)

An operation unit;
A transparent display unit having a display panel capable of transmitting a background, and a touch sensor provided on at least one of a front surface and a back surface of the display panel;
A display device comprising:
The display device includes a first form in which the transparent display unit is not superimposed on the operation unit, and the transparent display unit on the operation unit so that the touch sensor is located on a side opposite to the operation unit side. Can be taken with the second form,
Detecting means for detecting whether the form of the display device is the first form or the second form;
Control means for enabling the operation unit to be operated in a pseudo manner by the touch sensor when the detection means detects that the form of the display device is the second form;
A display device comprising: When the touch sensor is operated when the detection means detects that the display device is in the second form, the control means operates the operation unit at the operation position. The display device according to claim 1, wherein the same processing is performed. The number of operations that can be performed using the touch sensor when the display unit detects that the display device is in the second mode is greater than the number of operations that can be performed using the operation unit. The display device according to claim 1 or 2. Notification means for notifying the user that the operation unit can be operated in a pseudo manner by the touch sensor when the detection means detects that the form of the display device is the second form. The display device according to claim 1, wherein the display device is provided. The notification means is when the detection means detects that the form of the display device is the second form, and when the user operates the touch sensor, the notification means The display device according to claim 4, wherein the display unit notifies the user that the operation unit can be operated in a pseudo manner. An area control means for controlling an area in which an image is displayed on the display panel so as not to overlap the operation section when the detection means detects that the display device is in the second form. The display device according to claim 1, further comprising: Reversing means for performing reversal processing on the image so that the orientation of the image viewed by the user does not change between when the form of the display device is the first form and when the form of the display device is the second form; The display device according to claim 1, wherein the display device is provided. An operation unit;
A transparent display unit having a display panel capable of transmitting a background, and a touch sensor provided on at least one of a front surface and a back surface of the display panel;
A display device control method comprising:
The display device includes a first form in which the transparent display unit is not superimposed on the operation unit, and the transparent display unit on the operation unit so that the touch sensor is located on a side opposite to the operation unit side. Can be taken with the second form,
The display device control method includes:
A detection step of detecting whether the display device is in the first form or the second form;
A control step in which the operation unit can be operated in a pseudo manner by the touch sensor when it is detected in the detection step that the form of the display device is the second form;
A control method for a display device, comprising: In the control step, when the touch sensor is operated when it is detected in the detection step that the form of the display device is the second form, the operation unit at the operation position is operated. The method for controlling a display device according to claim 8, wherein the same processing as that at the time is performed. The number of operations that can be performed using the touch sensor when it is detected in the detection step that the form of the display device is the second form is greater than the number of operations that can be performed using the operation unit. 10. A method for controlling a display device according to claim 8 or 9. A notification step of notifying the user that the operation unit can be operated in a pseudo manner by the touch sensor when it is detected in the detection step that the form of the display device is the second form; The display device control method according to claim 8, wherein the display device control method is provided.   In the notification step, when it is detected in the detection step that the form of the display device is the second form, and when the user operates the touch sensor, the touch sensor 12. The method of controlling a display device according to claim 11, wherein the user is notified that the operation unit can be operated in a pseudo manner. An area control step for controlling an area in which an image is displayed on the display panel so as not to overlap the operation unit when it is detected in the detection step that the form of the display device is the second form. The display device control method according to claim 8, further comprising: A reversing step of performing reversal processing on the image so that the orientation of the image viewed by the user does not change between when the form of the display device is the first form and when the form of the display device is the second form; The display device control method according to claim 8, wherein the display device control method is provided.

Images