JP2017044822A - Display controller, display device, control method for display controller and control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device capable of improving the visibility of a user irrespective of shake.SOLUTION: The display device comprises: a reference point determination section (31) and an adjustment amount determination section (32) that calculate a relative position of a user with respect to a display surface; and a display position adjustment section (33) that adjusts the display position of an object to be displayed on the display surface on the basis of a positional difference between a present relative position when the calculation is made and a relative position at a point prior to the present time.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display device that displays a display object, a display control device that controls the display device, a control method for the display control device, and a control program.

  When viewing the screen of a mobile device such as a mobile phone while riding on a train or the like, it may be difficult to check the screen due to the shaking of the train. As a countermeasure against such shaking, Patent Document 1 discloses an image display device that adjusts and displays screen shake. More specifically, when the image display device swings in the up / down / left / right directions, the display position is adjusted and displayed, and when the image display device swings in the front / rear (far / near) direction, the image display device is adjusted by changing the display magnification. Is disclosed.

JP 2004-128712 A (published April 22, 2004)

  However, the adjustment disclosed in the above-described conventional technique has a problem that the display is not always easy for the user to view because the adjustment amount is calculated by detecting only the movement amount of the image display apparatus itself. For example, when the user shakes in the same manner as the image display device, the image display device itself moves, but the relative position of the image display device with respect to the user does not change. When the user moves in the opposite direction to the image display device, the amount of change in the relative position of the image display device with respect to the user is different from the amount of movement of the image display device itself. As described above, the amount of change in the relative position of the image display device with respect to the user may not necessarily match the amount of movement of the image display device itself.

  The present invention has been made in view of the above problems, and an object of the present invention is to realize a display control device and the like that improve the visibility of the user against shaking.

  In order to solve the above problems, a display control device according to an aspect of the present invention is a display control device that is controlled by a display device including a display surface, and calculates a relative position of a user relative to the display surface. From the position difference, which is the difference between the relative position calculated by the calculation unit and the current relative position calculated by the relative position calculation unit, and the relative position calculated by the relative position calculation unit before the current time, displayed on the display surface And an adjustment unit that adjusts the display position of the target object.

  According to one embodiment of the present invention, since the position of a display object visually recognized by a user can be prevented from being changed by the user, it is possible to prevent the visibility of the user from being lowered even if there is a shake. There is an effect that can be done. That is, there is an effect that it is possible to realize a display device with improved visibility against shaking.

It is a block diagram which shows the principal part structure of the mobile telephone which concerns on Embodiment 1 of this invention. It is a figure which shows the outline | summary of the process in the said mobile telephone, (a) is a figure which shows an initial state, (b) is the state which adjusted the display position with the change of the position of a user and a mobile telephone from an initial state. FIG. It is a figure for demonstrating the content of the process in the said mobile telephone, (a) is a figure explaining the calculation method of the relative distance of a user and a mobile telephone, (b) is a relative angle of a user and a mobile telephone. (C) is a figure explaining the calculation method of the adjustment amount of the display value of a display target object. It is a flowchart which shows the flow of the process in the said mobile telephone. It is a block diagram which shows the principal part structure of the mobile telephone which concerns on Embodiment 2 and Embodiment 3 of this invention. It is a flowchart which shows the flow of a process of the mobile telephone which concerns on the said Embodiment 2. FIG. 10 is a flowchart showing a flow of processing of the mobile phone according to the third embodiment.

Embodiment 1
Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. The mobile phone (display device) 1 according to the present embodiment calculates the relative position of the user with respect to the display unit (display surface) 21 and adjusts the display position of the display object according to the change in the relative position. .

  This will be described with reference to FIG. FIG. 2A shows a state (initial state) where the user's eyes are in the center of the screen of the mobile phone 1. FIG. 2B shows a case where the mobile phone 1 moves from the initial state to the lower right as viewed from the user. As shown in FIG. 2B, when the mobile phone 1 moves as viewed from the user, the display position of the display object is adjusted in accordance with the movement. In the example shown in FIG. 2B, the display position of the display object on the display unit 21 is moved and displayed in the upper left direction. In FIG. 2, D (a) indicates the distance between the user and the mobile phone 1, and α indicates the angle with respect to the vertical plane of the mobile phone 1.

  As a result, the display position of the display object can be adjusted in consideration of not only the movement of the mobile phone 1 but also the movement of the user, so that the display object is only used using the movement of the mobile phone 1 as in the prior art. Compared with the case where the display position is adjusted, the visibility of the user can be further improved.

  Hereinafter, the relative position of the mobile phone 1 with respect to the user is also referred to as “relative position between the mobile phone 1 and the user”, and the relative angle of the user viewed from the mobile phone 1 (viewed from the camera unit 11 of the mobile phone 1. The relative angle between the shooting direction of the camera unit 11 and the position of the eyes of the user is also referred to as “relative angle between the mobile phone 1 and the user”.

[Configuration of mobile phone 1]
Next, with reference to FIG. 1, the structure of the main part of the mobile phone 1 will be described. FIG. 1 is a block diagram showing a main configuration of the mobile phone 1. As shown in FIG. 1, the mobile phone 1 includes an input unit 10, an output unit 20, a control unit (display control device) 30, and a storage unit 40. The input unit 10 includes a camera unit 11, a touch panel unit 13, and a button unit 14, and the output unit 20 includes a display unit 21 and a speaker unit 22. The control unit 30 includes a reference point determination unit (relative position calculation unit) 31, an adjustment amount determination unit (relative position calculation unit) 32, and a display position adjustment unit (adjustment unit) 33. A distance calculation unit 34 and a relative angle calculation unit 35 are provided. The storage unit 40 includes a display memory 41.

  The input unit 10 receives various information input to the mobile phone 1 and transmits it to the control unit 30. In FIG. 1, a camera unit 11, a touch panel unit 13, and a button unit 14 are provided.

  The camera unit 11 acquires a camera acquired image 51 by capturing an image of the user, and transmits the acquired camera image 51 to the reference point determination unit 31 and the adjustment amount determination unit 32 together with the AF information 52. The camera acquisition image 51 includes the eyes of the user, and the reference point determination unit 31 and the adjustment amount determination unit 32 use the camera acquisition image 51 and the AF information 52 to display the display unit 21 of the mobile phone 1. The user's eye position and eye size can be recognized. The AF information 52 is autofocus information including information on the focal length of the camera unit 11.

  The touch panel unit 13 and the button unit 14 receive user input to the mobile phone 1.

  The output unit 20 includes a display unit 21 and a speaker unit 22. The display unit 21 displays an image or the like, and is realized by a liquid crystal display, an organic EL (Electro Luminescence) display, a plasma display, or the like. The display unit 21 performs display based on the adjusted image data 56 transmitted from the display position adjustment unit 33.

  The speaker unit 22 outputs the sound of the mobile phone 1.

  The control unit 30 executes various processes in the mobile phone 1 including adjustment of the display position of the display object, and includes a reference point determination unit 31, an adjustment amount determination unit 32, and a display position adjustment unit 33.

  The reference point determination unit 31 calculates the relative position (relative distance and relative angle) between the user's eyes and the camera unit 11 using the camera acquired image 51 and the AF information 52 received from the camera unit 11, and the reference point Information 53 is transmitted to the adjustment amount determination unit 32. Details of the relative position calculation method will be described later.

  The adjustment amount determination unit 32 determines the adjustment amount of the current display position, and transmits the determined adjustment amount to the display position adjustment unit 33 as adjustment amount information 54. The relative distance calculation unit 34, the relative angle calculation, and the like. Part 35 and adjustment amount calculation part 38.

  The relative distance calculation unit 34 calculates the relative distance between the user's eyes and the camera unit 11 from the camera acquired image 51 and the AF information 52 received from the camera unit 11. A specific calculation method will be described later.

  The relative angle calculation unit 35 calculates the relative angle between the user's eyes and the camera unit 11 from the camera acquired image 51 and the AF information 52 received from the camera unit 11. A specific calculation method will be described later.

  The adjustment amount calculation unit 38 is calculated by the relative distance calculation unit 34 and the relative angle calculation unit 35, and the relative distance and relative angle (including the two) of the user's eyes and the camera unit 11, The reference point information 53 received from the reference point determination unit 31 is compared. Then, a difference (position difference) from the reference point information 53 is calculated, and an adjustment amount of the display position is calculated based on the calculated difference and transmitted to the display position adjustment unit 33 as adjustment amount information 54.

  The display position adjustment unit 33 determines the display position in the pre-adjustment image data 55 based on the adjustment amount information 54 from the pre-adjustment image data 55 read from the display memory 42 and the adjustment amount information 54 received from the adjustment amount calculation unit 38. The adjusted post-adjustment image data 56 is generated and transmitted to the display unit 21.

  The storage unit 40 stores image data to be displayed on the screen of the mobile phone 1 and includes a display memory 41. The storage unit 40 includes a nonvolatile device such as a flash memory and a ROM (Read Only Memory), and a volatile device such as a RAM (Random Access Memory).

  The display memory 41 stores pre-adjustment image data as pre-adjustment image data 55.

[Calculating method of relative position of user viewed from mobile phone 1]
Next, a method for calculating the relative position of the user viewed from the mobile phone 1 will be described with reference to FIG.

  FIG. 3 is a diagram for explaining a method for calculating the relative position of the user as viewed from the mobile phone 1, and FIG. 3A shows a method for calculating the relative distance between the mobile phone 1 and the user. FIG. 3B is a diagram for explaining a method of calculating a relative angle between the mobile phone 1 and the user, and FIG. 3C is a diagram of a display object in the mobile phone 1. It is a figure for demonstrating the method of calculating the adjustment amount of a display position. In FIG. 3, the center of the lens of the camera unit 11 is the reference position.

[Calculation method of relative distance]
First, a method for calculating the relative distance between the mobile phone 1 and the user will be described with reference to FIG. Here, at time t, the distance from the mobile phone 1 to the user is D (t), the length of the user's eyes in the horizontal direction is Mr, and at the time t displayed on the image sensor of the camera unit 11. The horizontal length of the user's eyes is Mi (t), and the focal length of the camera unit 11 is f. The lateral length Mr of the user's eyes may be calculated by calibration, or the user may input age, gender, height information, and the like, and refer to the statistical information. Mi (t) is calculated from the camera acquired image 51, and f is acquired from the AF information 52. In the present embodiment, the distance from the mobile phone 1 to the user's eyes is referred to as the distance from the mobile phone 1 to the user.

  At this time, the relative distance D (t) from the mobile phone 1 to the user can be obtained by the following equation.

  Note that D (0), which is the start time (t = 0) of the adjustment process, represents the relative distance between the mobile phone 1 and the user in the reference point information 53.

[Calculation method of relative angle]
Next, a method for calculating the relative angle between the mobile phone 1 and the user will be described with reference to FIG. An angle formed by a straight line passing through the reference position and parallel to the shooting direction of the camera unit 11 and a straight line connecting the user's eyes and the camera unit 11 is Ar (d, t), and the user's eyes from the reference position in the image sensor. The relative angle between the mobile phone 1 and the user (relative angle between the camera unit 11 of the mobile phone 1 and the user's eyes) Ar (d, t) is given by It can be obtained by an expression.

Here, d indicates a direction on a plane parallel to the display unit 21 of the mobile phone 1. Note that the display direction of the display unit 21 and the shooting direction of the camera unit 11 are the same. For example, if the short direction of the display unit 21 is x and the long direction is y, the distance from the reference position can be calculated separately for the x direction and the y direction.

  Thereby, the relative angle in the x direction and the relative angle in the y direction can be calculated.

  In [Equation 3], Ar (d, 0), which is the start time (t = 0) of the adjustment process, represents the relative angle between the user and the camera unit 11 in the reference point information 53.

  As described above, by calculating the relative distance between the mobile phone 1 and the user and the relative angle of the user viewed from the mobile phone 1, the relative position of the user viewed from the mobile phone 1 can be calculated.

[Calculation method of adjustment amount]
Next, a method for obtaining the adjustment amount information 54 for adjusting the display position of the display object will be described with reference to FIG. First, when the distance between the position facing the reference position on the plane (user surface) parallel to the display unit 21 passing through the user and the user's eyes is Sr (d, t), Sr (d, t) is It can be obtained by an expression.

The adjustment amount information 54 can be calculated from a change in the relative position of the user's eyes and the camera unit 11 at a certain time t with respect to the reference point information 53 (t = 0). When the relative position of the user viewed from the mobile phone 1 changes, the displacement of the user's eye position on a plane parallel to the mobile phone 1 is (Sr (d, t) −Sr (d, 0)) Can be expressed as Therefore, in consideration of the number of pixels constituting the display unit 21, for example, when the number of pixels per unit length is P _disp , the adjustment amount S _disp (d, t) of the display position of the display object is

Can be calculated as

As for the displacement in the front-rear (far-near) direction, the magnification of enlargement / reduction may be calculated from D (t) / D (0), and the display object may be displayed at the calculated magnification.
[Processes performed by the mobile phone 1]
Next, the flow of processing executed by the mobile phone 1 will be described with reference to FIG. FIG. 4 is a flowchart showing a flow of processing executed by the mobile phone 1.

  First, a reference point is set (S2). In the reference point setting, the camera unit 11 images the user and transmits the generated camera acquisition image 51 and the AF information 52 to the reference point determination unit 31 (S3). The reference point determination unit 31 calculates the relative distance between the user's eyes and the camera unit 11 using the acquired camera acquisition image 51 and the AF information 52 (S4), and further, the relative angle between the user's eyes and the camera unit 11 Is calculated (S5). Then, the reference point determination unit 31 determines (sets) the reference point information 53 from the calculated relative distance and relative position (S6).

  Thereafter, in accordance with the change in the relative position between the user's eyes and the camera unit 11, the display position of the display object is adjusted (S7).

  First, the adjustment amount determination unit 32 calculates the adjustment amount (S8, relative position calculation step). In the calculation of the adjustment amount, the camera unit 11 images the user, and transmits the generated camera acquisition image 51 and AF information 52 to the adjustment amount determination unit 32 (S9). Next, the relative distance calculation unit 34 calculates a relative distance from the camera acquired image 51 and the AF information 52 (S10). Further, the relative angle calculation unit 35 calculates the relative angle from the camera acquired image 51 and the AF information 52 (S11). Then, the adjustment amount calculation unit 38 compares the reference point information 53 read from the reference point determination unit 31 with the relative position, calculates a position shake amount (S12), and calculates the adjustment amount information 54 from the calculated position shake amount. Calculate (S13).

  The display position adjustment unit 33 generates adjusted image data 56 in which the display position of the display object is adjusted from the pre-adjustment image data 55 and the adjustment amount information 54 (S14, adjustment step). Then, the adjusted image data 56 is output from the display unit 21 (S15).

A series of adjustment processes in steps S8 to S15 are performed each time the relative position of the user's eyes and the camera unit 11 changes, and the adjustment process is terminated in response to an end instruction from the user (S16).
[Modification of Embodiment 1]
The mobile phone 1 of the first embodiment described above may be configured such that the adjustment process is not performed except for the timing when it is appropriate to perform the adjustment process. For example, it is considered that image data necessary for input from the touch panel unit 13 is being output to the display unit 21 while the touch panel unit 13 receives input. At this time, if the image data is adjusted, the position of the input frame attempted to be input on the touch panel is shifted due to the adjustment, which makes input difficult. Therefore, the configuration may be such that the adjustment process is not executed while the touch panel unit 13 receives an input.

  The screen data to be adjusted may be configured to include only a part of the content output on the screen of the mobile phone 1. According to this, it is possible to adjust other contents while fixing the display position of the contents that are determined to be unnecessary, such as the input frame of the touch panel.

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIGS. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  The mobile phone 2 according to the second embodiment includes the angular velocity detection unit 12, and the mobile phone 2 shakes about an axis that passes through the center of the display unit 21 and is parallel to the display unit 21 (hereinafter, also referred to as angular shake). ), The display position of the display object can be appropriately adjusted.

  When the angular shake occurs, the relative position between the user's eyes and the center of the screen of the mobile phone 2 does not change, but the relative position between the user's eyes and the camera unit 11 changes. As a result, in the configuration of the first embodiment described above, there is a possibility that the position change is recognized as up / down / left / right shake and the display position is adjusted. In the present embodiment, correct adjustment is performed even if an angular shake occurs based on the angular shake information 57 detected by the angular velocity detection unit 12.

[Configuration of mobile phone 2]
The principal part structure of the mobile phone 2 according to the present embodiment will be described with reference to FIG. As shown in FIG. 5, the mobile phone 2 according to the present embodiment is based on the angular velocity detection unit 12 for detecting the tilt of the mobile phone 2 and the amount of displacement between the tilt at the start of adjustment and the tilt at the time of adjustment. An angle shake calculation unit (angle difference calculation unit) 36 that calculates the adjustment amount is provided.

  The angular shake calculation unit 36 acquires the angular shake information 57 from the angular velocity detection unit 12 and stores the inclination degree of the mobile phone 2 as the reference point information 53 at the start of the adjustment process.

  Further, the angular shake calculation unit 36 acquires the camera acquisition image 51, the AF information 52, and the angular shake information 57 indicating the angle detected by the angular velocity detection unit 12 at the time of adjustment.

  Then, the angular shake information 57 at the time of generating the reference point information is compared with the angular shake information 57 at the time of adjustment, and the amount of angular shake (angle difference) is notified to the adjustment amount calculation unit 38.

  The adjustment amount calculation unit 38 calculates the adjustment amount in consideration of the notified angular shake amount.

[Processing performed by the mobile phone 2]
Next, the flow of processing executed by the mobile phone 2 will be described. Here, only differences from the first embodiment will be described.

  First, in the reference point setting (S2), after calculating the relative distance and relative angle between the user's eyes and the camera unit 11 (S4, S5), the relative angular shake amount is calculated (S18). Then, the reference point information 53 including the relative angular shake amount is set (S6).

  Next, in the adjustment amount calculation (S8), after calculating the relative positional shake amount from the relative distance and relative angle between the user's eyes and the camera unit 11 (S10, S11, S12), the relative angular shake amount is calculated. Calculate (S19). Then, the pre-adjustment image data 55 is adjusted from the calculated information and the reference point information 53 (S13, S14, S15).

Thereafter, as in the first embodiment, the adjustment process is terminated in response to a termination instruction from the user (S16).
[Modification of Embodiment 2]
Further, the angular velocity detection unit 12 may include a plurality of detection units. According to this, the angular shake information 57 can be acquired with high accuracy.
[Embodiment 3]
The following will describe still another embodiment of the present invention with reference to FIGS. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

In the mobile phone 3 according to the present embodiment, the mobile phone 3 provided with the angular velocity detection unit 12 rotates without changing the orientation of the surface of the display unit 21 of the mobile phone 3 (hereinafter also referred to as rotational shake). However, the display position of the display object can be adjusted.
[Configuration of mobile phone 3]
In the present embodiment, the angular velocity detection unit 12 used in the second embodiment detects a rotation angle in addition to the angular shake, and notifies the rotation shake calculation unit 37 as the rotation angle information 58.

  The rotation shake calculation unit (rotation angle calculation unit) 37 acquires the rotation shake information 58 from the angular velocity detection unit 12 and stores the rotation state of the mobile phone 2 as the reference point information 53 at the start of the adjustment process.

  Further, the rotational shake calculation unit 37 acquires the camera acquisition image 51, the AF information 52, and the rotational shake information 58 indicating the rotation angle detected by the angular velocity detection unit 12 at the time of adjustment.

  Then, the rotational shake information 57 at the time of generating the reference point information is compared with the rotational shake information 57 at the time of adjustment, and the amount of rotational shake (rotation angle) is notified to the adjustment amount calculation unit 38.

  The adjustment amount calculation unit 38 calculates the adjustment amount in consideration of the notified rotational shake amount. More specifically, the top and bottom of the display object is adjusted in the opposite direction to the rotation direction by the same angle as the rotated angle.

[Processes performed by the mobile phone 3]
Next, the flow of processing executed by the mobile phone 3 will be described. Here, only differences from the second embodiment will be described.

  First, in the reference point setting (S2), after calculating the relative distance and relative angle between the user's eyes and the camera unit 11 and the relative angular shake amount (S4, S5, S18), the relative rotational shake amount is calculated. (S20). Then, reference point information 53 including a relative rotational shake amount is set (S6).

  Next, in the adjustment amount calculation (S8), after calculating the relative positional shake amount from the relative distance and relative angle between the user's eyes and the camera unit 11 (S10, S11, S12), the relative angular shake amount is calculated. Calculate (S19), and calculate the relative rotational shake amount (S21). Then, the pre-adjustment image data 55 is adjusted from the calculated information and the reference point information 53 (S13, S14, S15).

  Thereafter, the adjustment process is terminated (S16), as in the first and second embodiments.

[Other variations]
In Embodiments 1 to 3 described above, the case where the user and the mobile phones 1 to 3 correspond one-to-one has been described. However, the present invention is not limited to this. For example, a plurality of users use one mobile phone. It may be a configuration. In this case, each time the user is switched, the reference point information 53 is recreated, or the reference point information 53 corresponding to each user is stored in the storage unit 40, and the reference point information 53 corresponding to the identified user is used. Good.

  In the first to third embodiments, the method for calculating the relative position (relative distance and relative angle) of the user viewed from the mobile phone 1 using the user's eyes has been described. It is not limited to the user's eyes, and may be any part (facial feature point) that can specify the position of the user's face, such as the user's nose and eyebrows.

[Example of software implementation]
Each block (particularly the reference point determination unit 31 and the adjustment amount determination unit 32) of the mobile phones 1 to 3 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or a CPU It may be realized by software using (Central Processing Unit).

  In the latter case, the mobile phones 1 to 3 include a CPU that executes instructions of a program that is software that realizes each function, and a ROM (Read Only Memory) in which the program and various data are recorded so as to be readable by the computer (or CPU). ) Or a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
A display control device according to an aspect 1 of the present invention is a display control device that controls a display device including a display surface, and includes a relative position calculation unit that calculates a relative position of a user with respect to the display surface, and the relative position calculation unit. The display position of the object to be displayed on the display surface is adjusted from the position difference that is the difference between the relative position at the current time calculated by the above and the relative position calculated by the relative position calculation unit at a time before the current time. And an adjustment unit.

  According to said structure, the display position of a display target object is adjusted based on the difference of the user's relative position with respect to the display surface of a display apparatus of the present time and the previous time. Therefore, even if the positional relationship between the display device and the user is shifted due to shaking or the like, the relationship between the display position of the object displayed on the display surface and the user's position can be prevented. Thereby, since the position of the display target object visually recognized by the user can be prevented from being changed by the user, it is possible to prevent the visibility of the user from being lowered even if there is a shake. That is, a display device with improved visibility against shaking can be realized.

  In the display control apparatus according to aspect 2 of the present invention, in the aspect 1, the relative position calculation unit may calculate a relative position of a feature point of the user's face with respect to the display surface.

  According to said structure, the display position of a display target object can be adjusted using the relative position of the feature point of a user's face with respect to a display surface. Thereby, since the display position seen from the user can be adjusted, a user's visibility can be improved more.

  Note that the facial feature point may be any point as long as the position of the face can be specified, such as eyes, nose, eyebrows, and the like.

  The display control apparatus according to aspect 3 of the present invention is the display control apparatus according to aspect 1 or 2, wherein the angle between the current time and the previous time is an angle between the display surface and a vertical surface that is a surface perpendicular to the horizontal plane. An angle difference calculation unit that calculates a difference is provided, and the adjustment unit adjusts the display position of the object displayed on the display surface by further using the angle difference calculated by the angle difference calculation unit in addition to the position difference. It may be a thing.

  According to the above configuration, when the angle of the display surface is different from the current time and the previous time, the display position of the display object can be adjusted in consideration of the difference. .

  A display control device according to aspect 4 of the present invention is the display surface according to any one of aspects 1 to 3, wherein the display surface is centered on an axis perpendicular to the display surface between the current time point and the previous time point. A rotation angle calculation unit that calculates a rotation angle of the rotation angle, and the adjustment unit rotates the rotation angle by the same angle as the rotation angle calculated by the rotation angle calculation unit in a direction opposite to the rotation direction from the previous time point to the current time point. As described above, the display position of the object may be adjusted.

  According to the above configuration, even when the display surface is rotated so as to be centered on the axis perpendicular to the display surface, the display object is always displayed with the top direction as viewed from the user. Therefore, the visibility of the user can be further improved.

  A display device according to aspect 5 of the present invention includes the display control device and a camera, and the relative position calculation unit calculates the relative position from the image of the user captured by the camera. There may be.

  According to said structure, the display position of the display target object currently displayed with the own apparatus can be adjusted using the image image | photographed with the own apparatus.

  A display control device control method according to an aspect 6 of the present invention is a display control device control method for controlling a display device including a display surface, wherein the relative position calculation unit calculates a relative position of the user with respect to the display surface. From the relative position calculation step, the relative position calculated at the relative position calculation step, and the relative position calculated by the relative position calculation unit at a time prior to the current time Adjusting the display position of the object to be displayed on the surface.

  According to said method, there can exist an effect similar to the said aspect 1. FIG.

  The display control device according to each aspect of the present invention may be realized by a computer. In this case, the display device is operated by the computer by causing the computer to operate as each unit (software element) included in the display control device. A portable device program to be realized and a computer-readable recording medium on which the program is recorded also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  1: mobile phone (display device), 2: mobile phone (display device), 3: mobile phone (display device), 10: input unit, 11: camera unit, 12: angular velocity detection unit, 13: touch panel unit, 14: Button unit, 20: output unit, 21: display unit (display surface), 22: speaker unit, 30: control unit (display control device), 31: reference point determination unit (relative position calculation unit), 32: adjustment amount determination Unit (relative position calculation unit, adjustment unit), 33: display position adjustment unit (adjustment unit), 34: relative distance calculation unit, 35: relative angle calculation unit, 36: angle shake calculation unit (angle difference calculation unit), 37 : Rotational shake calculation unit (rotation angle calculation unit), 38: adjustment amount calculation unit, 40: storage unit, 41: display memory, 51: camera acquired image, 52: AF information, 53: reference point information, 54: adjustment amount Information, 55: Image data before adjustment, 56: Image after adjustment Over data, 57: angle shake information, 58: rotation angle information

Claims (7)

A display control device for controlling a display device including a display surface,
A relative position calculation unit that calculates a relative position of the user with respect to the display surface;
From the position difference, which is the difference between the current relative position calculated by the relative position calculation unit and the relative position calculated by the relative position calculation unit before the current time, the object to be displayed on the display surface is displayed. And a display control device that adjusts the display position.   The display control apparatus according to claim 1, wherein the relative position calculation unit calculates a relative position of a feature point of the user's face with respect to the display surface. An angle difference calculation unit that calculates an angle difference that is a difference between the current time point and the previous time point of an angle between the display surface and a vertical surface that is perpendicular to a horizontal plane;
The display control apparatus according to claim 1, wherein the adjustment unit adjusts the display position by further using the angle difference calculated by the angle difference calculation unit in addition to the position difference. A rotation angle calculation unit that calculates a rotation angle of the display surface about the axis perpendicular to the display surface between the current time point and the previous time point;
The adjustment unit adjusts the display position of the object so as to rotate in the direction opposite to the rotation direction from the previous time point to the current time point by the same angle as the rotation angle calculated by the rotation angle calculation unit. The display control apparatus according to claim 1, wherein the display control apparatus is a display control apparatus. The display control device according to any one of claims 1 to 4,
And a camera,
The display apparatus according to claim 1, wherein the relative position calculation unit calculates the relative position from an image of the user photographed by the camera. A control method of a display control device for controlling a display device including a display surface,
A relative position calculating unit that calculates a relative position of the user with respect to the display surface;
Based on the position difference between the current relative position calculated in the relative position calculation step and the relative position calculated by the relative position calculation unit prior to the current time, the display position of the object to be displayed on the display surface is determined. An adjustment step for adjusting the display control device.   A control program for causing a computer to function as the display control apparatus according to claim 1, wherein the control program causes the computer to function as the relative position calculation unit and the adjustment unit.

Images