JPWO2020084650A1 - Display control device and display control method - Google Patents

Abstract

An object of the present invention is to provide a technique capable of displaying an appropriate image on a display device. The display control device includes an acquisition unit and a control unit. The acquisition unit acquires the display surface direction, which is the direction toward the first display surface, of the display device having the first display surface that can rotate in the facing direction in the vehicle. The control unit is a positive image of the first image captured by the first imaging device and displayed on the first display surface based on the angle of the display surface direction with respect to the first imaging direction of the first imaging device arranged in the vehicle. Controls switching between image and mirror image.

Description

The present invention relates to a display control device and a display control method for controlling the display device.

In recent years, various technologies have been proposed for a display control device that controls a display device in a vehicle to display an image taken by a photographing device arranged in the vehicle and photographing the outside of the vehicle in order to support the driving of the vehicle. Has been done. For example, a technique has been proposed in which a plurality of photographing devices are arranged in a vehicle in a plurality of directions, and images captured by the plurality of photographing devices are switched and displayed. According to such a technique, it is possible to confirm the situation outside the vehicle in a desired direction. Further, for example, Patent Document 1 proposes a technique of making a display device movable in a vehicle and displaying an image in a shooting direction closest to the viewing direction of the display device on the display device among the shooting directions of a plurality of shooting devices. Has been done. According to such a device, it is possible to confirm the situation outside the vehicle in a direction close to the viewing direction of the display device.

Japanese Unexamined Patent Publication No. 2005-184142

Conventionally, in a configuration in which one photographing device is arranged in a vehicle, an image captured by the photographing device is displayed on the display device regardless of the viewing direction of the display device. Even with such a configuration, if the viewing direction of the display surface of the display device and the shooting direction of the photographing device are the same, no particular problem occurs.

However, in the above configuration, when the shooting direction of the photographing device and the viewing direction of the display surface are opposite to each other, the actual position of another vehicle or the like when the display device is viewed from the front and the image displayed on the display device. There is a problem that the position of other vehicles in the above is reversed. In such a case, a configuration in which the image captured by the photographing device is not displayed is conceivable, but such a configuration causes a new problem that the external situation cannot be confirmed in real time.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a technique capable of displaying an appropriate image on a display device.

The display control device according to the present invention includes an acquisition unit that acquires a display surface direction that is a direction toward the first display surface of a display device having a first display surface that can rotate in the facing direction in the vehicle, and a display control device that is arranged on the vehicle. Control of switching between a normal image and a mirror image of a first image photographed by the first imaging device and displayed on the first display surface based on the angle of the display surface direction with respect to the first imaging direction of the first imaging device provided. It is provided with a control unit for performing.

According to the present invention, switching control between a normal image and a mirror image of a first image captured by the first imaging device and displayed on the first display surface is performed based on the angle of the display surface direction with respect to the first imaging direction. According to such a configuration, an appropriate image can be displayed on the display device.

The objects, features, embodiments and advantages of the present invention will be made clearer by the following detailed description and accompanying drawings.

It is a block diagram which shows the structure of the display control device which concerns on Embodiment 1. FIG. It is a figure which shows the display example by the display control device which concerns on Embodiment 1. FIG. It is a figure which shows the display example by the display control device which concerns on Embodiment 1. FIG. It is a figure which shows the display example by the display control device which concerns on Embodiment 1. FIG. It is a figure which shows the display example by the display control device which concerns on Embodiment 1. FIG. It is a block diagram which shows the structure of the display control device which concerns on Embodiment 2. FIG. It is a figure which shows the rotation example of the display device which concerns on Embodiment 2. FIG. It is a figure which shows the rotation example of the display device which concerns on Embodiment 2. FIG. It is a figure which shows the 1st angle range and the 2nd angle range which concerns on Embodiment 2. It is a flowchart which shows the operation of the display control device which concerns on Embodiment 2. It is a figure which shows the display example by the display control device which concerns on the modification 2 of Embodiment 2. It is a figure which shows the display example by the display control device which concerns on the modification 2 of Embodiment 2. It is a figure which shows the display example by the display control device which concerns on the modification 2 of Embodiment 2. It is a figure which shows the display example by the display control device which concerns on the modification 2 of Embodiment 2. It is a figure which shows the 1st angle range and the 2nd angle range which concerns on the modification 3 of Embodiment 2. It is a figure which shows the positional relationship of the display apparatus and the 1st photographing apparatus which concerns on modification 3 of Embodiment 2. It is a figure which shows the 1st angle range to the 3rd angle range which concerns on the modification 4 of Embodiment 2. It is a flowchart which shows the operation of the display control device which concerns on modification 4 of Embodiment 2. It is a figure which shows the rotation example of the display device which concerns on the modification 5 of Embodiment 2. It is a figure which shows the rotation example of the display device which concerns on the modification 5 of Embodiment 2. It is a figure which shows the structure of the display device which concerns on the modification 6 of Embodiment 2. It is a figure which shows the structure of the display device which concerns on the modification 6 of Embodiment 2. It is a block diagram which shows the structure of the display control device which concerns on Embodiment 3. It is a figure which shows the display example by the display control device which concerns on Embodiment 3. It is a figure which shows the display example by the display control device which concerns on Embodiment 3. It is a figure which shows the display example by the display control device which concerns on the modification 1 of Embodiment 3. It is a figure which shows the display example by the display control device which concerns on the modification 1 of Embodiment 3. It is a block diagram which shows the structure of the display control device which concerns on Embodiment 4. FIG. It is a flowchart which shows the operation of the display control device which concerns on Embodiment 4. It is a figure which shows the display example by the display control device which concerns on Embodiment 4. FIG. It is a block diagram which shows the structure of the display control device which concerns on Embodiment 5. It is a flowchart which shows the operation of the display control device which concerns on Embodiment 5. It is a figure which shows the display example by the display control device which concerns on Embodiment 5. It is a figure which shows the display example by the display control device which concerns on Embodiment 5. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 6. It is a figure which shows the display example by the display control device which concerns on Embodiment 6. It is a flowchart which shows the operation of the display control device which concerns on Embodiment 6. It is a block diagram which shows the hardware composition of the display control device which concerns on other modification. It is a block diagram which shows the hardware composition of the display control device which concerns on other modification. It is a block diagram which shows the structure of the server which concerns on other modification. It is a block diagram which shows the structure of the communication terminal which concerns on other modification.

<Embodiment 1>
Hereinafter, the display control device according to the first embodiment of the present invention will be described as being mounted on the vehicle. Then, the vehicle on which the display control device is mounted and is the subject of attention will be described as "own vehicle".

FIG. 1 is a block diagram showing a configuration of a display control device 1 according to a first embodiment. The display control device 1 of FIG. 1 is connected to the display device 31 and the first photographing device 32.

The display device 31 has a first display surface that can rotate in the facing direction in the own vehicle. That is, the display device 31 can rotate around a direction other than the vertical direction of the first display surface as a rotation axis. The display device 31 may be provided integrally with the display control device 1 or may be provided separately from the display control device 1.

The first photographing device 32 is arranged in the vehicle in a state where the first photographing direction of the first photographing device 32 is directed to the outside of the vehicle. The first photographing device 32 photographs the scenery in the first photographing direction as the first image.

Next, the components of the display control device 1 of FIG. 1 will be described. The display control device 1 of FIG. 1 includes an acquisition unit 11 and a control unit 12.

The acquisition unit 11 acquires the display surface direction, which is the direction toward the first display surface of the display device 31. The display surface direction is substantially the same as the direction in which a user such as a driver visually recognizes the first display surface. Hereinafter, the display surface direction will be described as being incident at right angles to the first display surface, but the present invention is not limited to this, and may be a direction that is substantially perpendicular to the first display surface.

The acquisition unit 11 having the above functions may be, for example, an interface in which the display surface direction is input from the outside of the display control device 1. Further, the acquisition unit 11 detects the position of the display device 31 and specifies the display surface direction from the detected position of the display device 31 by using a table in which the position of the display device 31 and the display surface direction are associated in advance. It may be a device.

The control unit 12 obtains an angle α in the display surface direction with respect to the first photographing direction of the first photographing device 32. Then, the control unit 12 controls switching between a normal image and a mirror image of the first image taken by the first photographing device 32 and displayed on the first display surface based on the obtained angle α. The first photographing direction of the first photographing device 32 used by the control unit 12 may be stored in advance in the display control device 1 or may be appropriately input from the outside of the display control device 1.

In FIG. 1, the control unit 12 has an image inversion function of reversing the left and right of the first image captured by the first imaging device 32. As will be described later, the first imaging device 32 inverts the image. It may have a function, or the display device 31 may have an image inversion function.

2 to 5 are diagrams showing a display example by the control unit 12 of the display control device 1 according to the first embodiment. 2 and 4 are plan views showing the periphery of the own vehicle 2, and FIGS. 3 and 5 are views showing a display example of the first image on the first display surface 31a. Here, an example in which the first photographing direction 32a of the first photographing device 32 is the front direction of the own vehicle 2 will be described.

In FIGS. 2 and 4, elements such as the display device 31, the first display surface 31a, and the own vehicle 2 and the first photographing device 32 other than the display surface direction 31b are shown so as to be reversed from each other. The display surface direction 31b of the first display surface 31a is the front direction of the own vehicle 2 in FIG. 2, whereas it is the rear direction of the own vehicle 2 in FIG. Further, in the examples of FIGS. 2 and 4, other vehicles 3a and 3b exist in the vicinity of the own vehicle 2, and the other vehicles 3a and 3b are displayed in the first images of FIGS. 3 and 5.

Here, as shown in FIG. 2, when the display surface direction 31b and the first shooting direction 32a are the same, that is, when the angle α is 0 degrees, the control unit 12 positively displays the first image as shown in FIG. Control is performed so that the image is displayed on the first display surface 31a. In the present specification, the fact that the display surface direction 31b and the first photographing direction 32a are the same includes that the display surface direction 31b and the first photographing direction 32a are the same and are substantially the same. The fact that the angle α is 0 degrees includes that the angle α is 0 degrees and that the angle α is approximately 0 degrees. When the above control is performed, the actual position (right side) of the other vehicle 3b when the first display surface 31a of the display device 31 of FIG. 2 is viewed from the front, and the other vehicle in the first image of FIG. The position where 3b is displayed (on the right side) matches.

On the other hand, when the display surface direction 31b and the first shooting direction 32a are opposite to each other as shown in FIG. 4, that is, when the angle α is 180 degrees, the control unit 12 uses the first image as shown in FIG. Control is performed so that the mirror image of the above is displayed on the first display surface 31a. In the present specification, the fact that the display surface direction 31b and the first imaging direction 32a are opposite includes that the display surface direction 31b and the first imaging direction 32a are opposite and that they are substantially opposite. The fact that the angle α is 180 degrees includes that the angle α is 180 degrees and that the angle α is approximately 180 degrees. When the above control is performed, the actual position (left side) of the other vehicle 3b when the first display surface 31a of the display device 31 of FIG. 4 is viewed from the front, and the other vehicle in the first image of FIG. It coincides with the position where 3b is displayed (left side).

<Summary of Embodiment 1>
According to the display control device 1 according to the first embodiment configured as described above, the first imaging device 32 is based on the angle α of the display surface direction 31b with respect to the first imaging direction 32a of the first imaging device 32. Controls switching between a normal image and a mirror image of the first image taken in 1 and displayed on the first display surface 31a. According to such a configuration, regardless of whether the display surface direction 31b and the first shooting direction 32a of the first shooting device 32 are the same or opposite, the actual position of another vehicle or the like. , The position of another vehicle or the like in the first image can be matched. Therefore, an appropriate image that does not give a sense of discomfort to the user can be displayed on the display device 31.

<Embodiment 2>
FIG. 6 is a block diagram showing the configuration of the display control device 1 according to the second embodiment of the present invention. Hereinafter, among the components according to the second embodiment, the components that are the same as or similar to the above-mentioned components are designated by the same reference numerals, and different components will be mainly described.

The display device 31 and the first photographing device 32 are the same as the display device 31 and the first photographing device 32 of the first embodiment. However, in the second embodiment, as in the examples of FIGS. 2 to 5, the first photographing device 32 is itself so that the first photographing direction 32a of the first photographing device 32 is the front direction of the own vehicle 2. It is fixed to the vehicle 2.

Further, in the second embodiment, the first photographing device 32 has an image inversion function of inverting the left and right of the first image photographed by the first photographing device 32 under the control of the display control device 1. When the image inversion function is on, the first photographing device 32 outputs the first image whose left and right are inverted by the image inversion function to the display device 31 as a mirror image of the first image. On the other hand, when the image inversion function is off, the first photographing device 32 outputs the first image that has not been horizontally inverted by the image inversion function to the display device 31 as a normal image of the first image. The display device 31 displays an image output from the first photographing device 32, that is, a normal image or a mirror image of the first image.

The own vehicle 2 is provided with a structure that rotates the first display surface of the display device 31 in conjunction with the rotation of the front seat, which is at least one of the driver's seat and the passenger seat of the own vehicle 2. In the above structure, as shown in the plan views of FIGS. 7 and 8, when the front seat rotates, the first display surface 31a of the display device 31 is kept facing the front seat, and the front seat is used as an axis in an arc shape. A structure is used in which the front seat and the first display surface 31a are integrally rotated by moving the display device 31. In FIGS. 7 and 8, the display device 31 moves so as to draw an arc from the front seat to the right side, but the display device 31 may move so as to draw an arc from the front seat to the left side. Further, in FIGS. 7 and 8, the display device 31 is installed substantially in front of the driver's seat, but may be installed in front of between the driver's seat and the passenger seat, for example, and the display device 31 is installed at these positions. Not limited to. Further, the installation position of the photographing device 32 may be unevenly distributed on the left side or the right side instead of the center in front of the own vehicle 2. In addition, a display device for the passenger seat may be installed almost in front of the passenger seat, and the passenger seat may rotate independently of the driver's seat, and the display device for the passenger seat may rotate in conjunction with the passenger seat. Good. Then, in that configuration, the display device for the passenger seat may be switched between a mirror image and a normal image. In addition, a display device for the rear seats may be installed almost in front of the rear seats, and the rear seats rotate so that the rear seats can face backward, and the display device for the rear seats rotates in conjunction with the rear seats. It may be configured to be used. Then, in that configuration, switching processing between a mirror image and a normal image may be performed on the display device for the rear seats. The number of rear seats in the front-rear direction of the own vehicle is not limited to one, and may be multiple. Further, although FIGS. 7 and 8 show a configuration in which the driver's seat is on the right side, the second embodiment can be applied to the configuration in which the driver's seat is on the left side as in the configuration in which the driver's seat is on the right side.

As shown in FIG. 6, the display control device 1 is connected to the display device 31 via the display surface direction detection sensor 33. The display surface direction detection sensor 33 detects the display surface direction 31b of the display device 31. For example, the display surface direction detection sensor 33 detects the rotation of the front seat, and detects the display surface direction 31b of the display device 31 based on the rotation.

Next, the components of the display control device 1 of FIG. 6 will be described. The display control device 1 of FIG. 6 includes a display surface direction acquisition unit 11a, a video reversal determination unit 12a, a video reversal control unit 12b, and a shooting direction storage unit 13. The display surface direction acquisition unit 11a is included in the concept of the acquisition unit 11 in FIG. 1, and the image inversion determination unit 12a and the image inversion control unit 12b are included in the concept of the control unit 12 in FIG.

The display surface direction acquisition unit 11a acquires the display surface direction 31b detected by the display surface direction detection sensor 33. The shooting direction storage unit 13 stores the first shooting direction 32a of the first shooting device 32.

The image inversion determination unit 12a displays the display with respect to the first shooting direction 32a based on the first shooting direction 32a stored in the shooting direction storage unit 13 and the display surface direction 31b acquired by the display surface direction acquisition unit 11a. The angle α in the plane direction 31b is obtained. Then, the image inversion determination unit 12a determines whether the obtained angle α is within the predetermined first angle range or the second angle range.

FIG. 9 is a diagram showing a first angle range Φ1 and a second angle range Φ2 according to the second embodiment. The first angle range Φ1 is a range including 0 degrees. The second angle range Φ2 is a range including 180 degrees and does not overlap with the first angle range Φ1. The sum of the first angle range Φ1 and the second angle range Φ2 is an angle range of 360 degrees, and the size of the first angle range Φ1 and the size of the second angle range Φ2 are the same. Specifically, the first angle range Φ1 is a range of 90 degrees or less, which is larger than −90 degrees, and the second angle range Φ2 is a range of 270 degrees or less, which is larger than 90 degrees.

When it is determined that the angle α obtained by the image inversion determination unit 12a is within the first angle range Φ1, the image inversion control unit 12b controls to display the normal image of the first image on the first display surface 31a. I do. In the second embodiment, the image inversion control unit 12b controls the normal image of the first image to be displayed on the first display surface 31a, so that the image inversion control unit 12b inverts the image of the first photographing device 32. Equivalent to turning off the function.

On the other hand, when it is determined that the angle α obtained by the image inversion determination unit 12a is within the second angle range Φ2, the image inversion control unit 12b displays a mirror image of the first image on the first display surface 31a. Take control. In the second embodiment, the image inversion control unit 12b controls to display the mirror image of the first image on the first display surface 31a, so that the image inversion control unit 12b has an image inversion function of the first photographing device 32. Is equivalent to turning on.

Further, in the second embodiment, the own vehicle 2 can be automatically driven. Then, the image inversion control unit 12b performs switching control between the normal image and the mirror image based on the angle α when the own vehicle 2 is performing the predetermined automatic driving. That is, the image inversion control unit 12b does not perform switching control between the normal image and the mirror image based on the angle α when the vehicle 2 does not perform the predetermined automatic driving. For the predetermined automatic operation, for example, fully automatic operation (automatic operation level 5) or highly automatic operation (automatic operation level 4) is used. Even in the manual driving state where the driver is concentrating on driving, in the configuration in which the display device rotates in conjunction with the rotation of the passenger seat or the rear seat, the display device for the passenger seat or the rear seat Switching control between the mirror image and the normal image may be performed on the display device for the passenger seat or the rear seat according to the rotation.

<Operation>
FIG. 10 is a flowchart showing the operation of the display control device 1 according to the second embodiment. It should be noted that this operation starts when the predetermined automatic operation is performed and ends when the predetermined automatic operation is no longer performed.

First, in step S1, the image inversion determination unit 12a reads the first shooting direction 32a from the shooting direction storage unit 13.

In step S2, the display surface direction acquisition unit 11a acquires the display surface direction 31b, and the image inversion determination unit 12a reads the display surface direction 31b acquired by the display surface direction acquisition unit 11a.

In step S3, the image inversion determination unit 12a obtains the angle α of the display surface direction 31b with respect to the first shooting direction 32a.

In step S4, the image inversion determination unit 12a determines whether the angle α is within the first angle range Φ1 or the second angle range Φ2. If it is determined that the angle α is within the first angle range Φ1, the process proceeds to step S5, and if it is determined that the angle α is within the second angle range Φ2, the process proceeds to step S6.

In step S5, the image inversion control unit 12b turns off the image inversion function of the first photographing device 32 as a control for displaying the normal image of the first image on the first display surface 31a. That is, the image inversion control unit 12b requests the first photographing device 32 to output normally. As a result, the normal image of the first image as shown in FIG. 3 is displayed on the first display surface 31a of the display device 31. After that, the process returns to step S2.

In step S6, the image inversion control unit 12b turns on the image inversion function of the first photographing device 32 as a control for displaying the mirror image of the first image on the first display surface 31a. That is, the video inversion control unit 12b requests the first photographing device 32 to invert output. As a result, a mirror image of the first image as shown in FIG. 5 is displayed on the first display surface 31a of the display device 31. After that, the process returns to step S2.

<Summary of Embodiment 2>
According to the display control device 1 according to the second embodiment as described above, the sum of the first angle range Φ1 and the second angle range Φ2 is an angle range of 360 degrees. Therefore, regardless of the angle α, either the normal image or the mirror image of the first image can be displayed on the first display surface 31a.

Further, in the second embodiment, when the own vehicle 2 is performing the predetermined automatic driving, the switching control between the normal image and the mirror image based on the angle α is performed. When a predetermined automatic driving is performed in the own vehicle 2, the driver is released from the driving operation and has a margin to chat with the rear seats. Therefore, the first display surface 31a of the display device 31 is displayed. It is more likely to be rotated. Therefore, the above switching control is particularly effective when the own vehicle 2 is performing a predetermined automatic operation.

Further, in the second embodiment, the own vehicle 2 is provided with a structure in which the first display surface is rotated in conjunction with the rotation of the front seats of the own vehicle 2. According to such a configuration, it is possible to save the user's trouble of rotating the first display surface.

Further, in the second embodiment, the first photographing direction 32a of the first photographing device 32 is the front direction of the own vehicle 2. As a result, it is possible to display an image in which various display objects such as alarms are added to the first image.

<Modification 1 of the second embodiment>
In the second embodiment, the first photographing device 32 has an image reversing function for reversing the left and right of the first image captured by the first photographing device 32, and the display control device 1 switches the image reversing function on and off. Controlled. However, the image inversion function may be provided in any of the display control device 1, the display device 31, and the first photographing device 32.

For example, the display device 31 may have an image reversing function for inverting the left and right of the first image captured by the first photographing device 32, and the display control device 1 may control to switch the image inverting function on and off. ..

Further, for example, the display control device 1 may have an image reversing function for reversing the left and right of the first image captured by the first photographing device 32, and may control to switch the image reversing function on and off. .. In this case, the display control device 1 outputs a normal image or a mirror image of the first image to the display device 31, and the display device 31 displays the image output from the display control device 1.

<Modification 2 of the second embodiment>
In the second embodiment, the first photographing direction 32a of the first photographing device 32 is the front direction of the own vehicle 2. However, the first photographing direction 32a of the first photographing device 32 may be the rear direction of the own vehicle 2. In this case, the first image can be applied as, for example, an electronic mirror.

11 to 14 are views showing a display example by the display control device 1 according to the second modification. 11 and 13 are plan views showing the periphery of the own vehicle 2. In FIG. 11, the display surface direction 31b and the first photographing direction 32a are opposite, and in FIG. 13, the display surface direction 31b and the first photographing direction 32a are the same. 12 and 14 are views showing a display example of the first image on the first display surface 31a.

When the display surface direction 31b and the first shooting direction 32a are opposite to each other as shown in FIG. 11, that is, when the angle α is 180 degrees, the image inversion control unit 12b uses the first image as shown in FIG. Control is performed so that the mirror image of the above is displayed on the first display surface 31a. On the other hand, as shown in FIG. 13, when the display surface direction 31b and the first shooting direction 32a are the same, that is, when the angle α is 0 degrees, the image inversion control unit 12b uses the first image as shown in FIG. Control is performed so that the normal image of is displayed on the first display surface 31a.

Also in the present modification 2 as described above, the actual position (left side) of the other vehicle 3b when the display device 31 of FIG. 11 is viewed from the front and the other vehicle 3b are displayed in the first image (mirror image) of FIG. The position (on the left side) matches. Further, the actual position (right side) of the other vehicle 3b when the display device 31 of FIG. 13 is viewed from the front and the position (right side) where the other vehicle 3b is displayed in the first image (normal image) of FIG. 14 are Match. As described above, according to the display control device 1 according to the second modification, even if the display surface direction 31b and the first photographing direction 32a of the first photographing device 32 are the same, they are opposite. Also, the actual position of the other vehicle and the like can be matched with the position of the other vehicle and the like in the first image.

<Modification 3 of Embodiment 2>
In the second embodiment, the size of the first angle range Φ1 and the size of the second angle range Φ2 are the same. However, the size of the first angle range Φ1 and the size of the second angle range Φ2 may be different.

FIG. 15 is a diagram showing a first angle range Φ1 and a second angle range Φ2 according to the third modification. In this modification 3, the sum of the first angle range Φ1 and the second angle range Φ2 is an angle range of 360 degrees, and the size of the first angle range Φ1 is smaller than the size of the second angle range Φ2. ing. Specifically, the first angle range Φ1 is a range of 70 degrees or less larger than −75 degrees, and the second angle range Φ2 is a range of 285 degrees or less larger than 70 degrees.

FIG. 16 is a plan view showing the positional relationship between the display device 31 and the first photographing device 32 according to the third modification. As shown in FIG. 16, when the display surface direction 31b and the first photographing direction 32a are parallel, the display device 31 is located on the right side with respect to the first photographing device 32, and the display surface direction 31b is The first imaging device 32 is shifted to the right with respect to the first imaging direction 32a. In such a case, as shown in FIG. 15, it is preferable that the first angle range Φ1 is not symmetrical and the range on the left side is larger than the range on the right side. Therefore, the display control device 1 may change the first angle range Φ1 and the second angle range Φ2 as shown in FIG. 15 based on the positional relationship between the display device 31 and the first photographing device 32. In a configuration in which the photographing device 32 is installed in the center in front of the own vehicle 2 and the display device 31 for the driver is installed in front of the driver's seat, it is preferable that the range on the left side is larger than the range on the right side. On the other hand, in a configuration in which the photographing device 32 is installed in the center in front of the own vehicle 2 and the display device for the passenger seat is installed in front of the passenger seat and rotates together with the passenger seat, the range on the right side is larger than the range on the left side. Is preferable. If the driver's seat is installed on the left side instead of the right side, the positional relationship between the photographing device 32 and the display device 31 is opposite to the above positional relationship, so that the range on the left side is larger than the range on the right side. Is preferable.

<Modification 4 of Embodiment 2>
As shown in FIG. 17, in the present modification 4, a third angle range Φ3 that does not overlap with the first angle range Φ1 and the second angle range Φ2 is further formed between the first angle range Φ1 and the second angle range Φ2. It is stipulated. Specifically, the first angle range Φ1 is a range of 75 degrees or less, which is larger than −75 degrees, and the second angle range Φ2 is a range of 250 degrees or less, which is larger than 110 degrees. The third angle range Φ3 is a range of −75 degrees or less, which is larger than −90 degrees, a range of 110 degrees or less, which is larger than 75 degrees, and a range of 270 degrees or less, which is larger than 250 degrees.

FIG. 18 is a flowchart showing the operation of the display control device 1 according to the present modification 4. The operation of FIG. 18 is the same as the operation of FIG. 10 in which step S4 is changed to step S11 and step S12 is added to the operation of FIG. Therefore, in the following, steps S11 and S12 will be mainly described.

After the same processing as in steps S1 to S3 of FIG. 10 is performed, in step S11, the angle α of the image inversion determination unit 12a is within the first angle range Φ1, the second angle range Φ2, and the third. It is determined which of the angle ranges Φ3. If it is determined that the angle α is within the first angle range Φ1, the process proceeds to step S5, and if it is determined that the angle α is within the second angle range Φ2, the process proceeds to step S6. If it is determined that the angle α is within the third angle range Φ3, the process proceeds to step S12.

In step S12, the image inversion control unit 12b controls to display the normal image of the first image on the first display surface 31a on the first display surface 31a, and displays the mirror image of the first image on the first display surface 31a. None of the control to display is performed. For example, the image inversion control unit 12b controls to display a black image on the first display surface 31a, controls to display an appropriate telop or image, and controls to turn off the display of the display device 31. Or something. After that, the process returns to step S2.

According to the display control device 1 according to the present modification 4 as described above, the user can know whether or not the normal image and the mirror image of the first image are controlled.

In addition, the own vehicle 2 may be provided with not only the first photographing device 32 having the first photographing direction 32a but also the second photographing device having a second photographing direction different from the first photographing direction 32a. For example, in a configuration in which the first shooting direction 32a is the front direction of the own vehicle 2, the second shooting device is a right-hand shooting device whose shooting direction is the right direction of the own vehicle 2 and a shooting direction is the left direction of the own vehicle 2. At least one of a left-side imaging device and a rear-side imaging device whose imaging direction is the rear direction of the own vehicle 2 is used.

Then, in the configuration in which the second photographing device is arranged, the image inversion control unit 12b displays and hides the second image photographed by the second photographing device on the first display surface 31a based on the angle α. You may perform control to switch. For example, only when the angle α is in the range of 110 degrees or less, which is larger than 75 degrees, the image inversion control unit 12b causes the first display surface 31a to display a normal image or a mirror image of the image taken by the right side photographing device. Control may be performed. Then, only when the angle α is in the range of -75 degrees or less, which is larger than -90 degrees, or 270 degrees or less, which is larger than 250 degrees, the image inversion control unit 12b is an image taken by the left side photographing device. The normal image or the mirror image of the above may be controlled to be displayed on the first display surface 31a. Further, only when the angle α is in the range of 185 degrees or less, which is larger than 175 degrees, the image inversion control unit 12b controls to display the image taken by the rear side photographing device on the first display surface 31a. May be good.

<Modification 5 of Embodiment 2>
In the second embodiment, the own vehicle 2 is provided with a structure in which the first display surface of the display device 31 is rotated in conjunction with the rotation of the front seats. However, the own vehicle 2 may be provided with a structure that automatically rotates the first display surface 31a at a timing shifted from the timing at which the front seats rotate.

Further, as shown in FIGS. 19 and 20, when the display device 31 is located between the front seat and the rear seat of the own vehicle 2, the first display surface 31a selectively serves as the front seat and the rear seat. It may be rotatable so that it faces. In FIG. 19, since the first display surface 31a is directed to the front seat and the display surface direction 31b and the first shooting direction 32a are opposite, a mirror image of the first image is displayed on the first display surface 31a. To. In FIG. 20, since the first display surface 31a is directed to the rear seat and the display surface direction 31b and the first shooting direction 32a are the same, the normal image of the first image is displayed on the first display surface 31a. Will be done. When the display device 31 is located between the front seat and the rear seat, the display device 31 is moved so as to draw an arc around the front seat as in the second embodiment, or It is assumed that the display device 31 is fixedly arranged between the front seat and the rear seat.

Further, in a configuration in which the display device 31 is fixedly arranged between the front seat and the rear seat, when the front seat faces the front direction of the own vehicle 2, the first display surface 31a is the rear seat. When the front seats are facing the rear of the own vehicle 2, the first display surface 31a may be automatically rotated so that the first display surface 31a is directed toward the front seats.

Further, in the above description, the first display surface 31a is automatically rotated, but the first display surface 31a may be manually rotated.

<Modified Example 6 of Embodiment 2>
In the second embodiment, the display device 31 has only the first display surface 31a as a display surface for displaying an image. However, as shown in FIGS. 21 and 22, the display device 31 may have a first display surface 31a and a second display surface 31c provided on the opposite side of the first display surface 31a.

Then, the image inversion control unit 12b controls to display the mirror image of the first image on the second display surface 31c when the normal image of the first image is displayed on the first display surface 31a, and the first display. When the mirror image of the first image is displayed on the surface 31a, control may be performed to display the normal image of the first image on the second display surface 31c.

For example, as shown in FIG. 21, when the display surface direction 31b and the first shooting direction 32a, which is the front direction of the own vehicle 2, are opposite to each other, that is, when the angle α is 180 degrees, the image inversion control unit 12b Controls to display the mirror image of the first image on the first display surface 31a and controls to display the normal image of the first image on the second display surface 31c. On the other hand, as shown in FIG. 22, when the display surface direction 31b and the first shooting direction 32a which is the rear direction of the own vehicle 2 are the same, that is, when the angle α is 0 degrees, the image inversion control unit 12b The control of displaying the normal image of the first image on the first display surface 31a and the control of displaying the mirror image of the first image on the second display surface 31c are performed.

According to the display control device 1 according to the present modification 6 as described above, an appropriate image can be displayed to the occupants in the front seats and the occupants in the rear seats.

<Embodiment 3>
FIG. 23 is a block diagram showing the configuration of the display control device 1 according to the third embodiment of the present invention. Hereinafter, among the components according to the third embodiment, the same or similar components as those described above will be designated by the same reference numerals, and different components will be mainly described.

The configuration of the display control device 1 of FIG. 23 is the same as the configuration in which the display object addition unit 12c is added to the configuration of the display control device 1 of FIG. The display object addition unit 12c is included in the concept of the control unit 12 of FIG.

The display object addition unit 12c controls to display a display object indicating whether the first image displayed on the first display surface 31a is a normal image or a mirror image on the first display surface 31a. In the third embodiment, when the image inversion determination unit 12a determines that the angle α is within the first angle range Φ1, the display object addition unit 12c generates a display object showing a normal image and performs the first shooting. The display object is superimposed on the image output from the device 32. On the other hand, when the image inversion determination unit 12a determines that the angle α is within the second angle range Φ2, the display object addition unit 12c generates a display object showing a mirror image and outputs it from the first photographing device 32. Superimpose the display object on the image.

The display object addition unit 12c outputs the image obtained by the superimpose to the display device 31, and the display device 31 displays the image output from the display object addition unit 12c on the first display surface 31a.

24 and 25 are diagrams showing display examples of a normal image and a mirror image of the first image on the first display surface 31a, respectively. When the normal image of the first image is displayed as shown in FIG. 24, the display object 31d indicating the normal image is horizontally long and blue-painted (in FIG. 24, the density is high) arranged in the upper center of the first image. An icon indicating a frame (substitute for high dot hatching) and a "normal image" of horizontal writing and normal font arranged in the icon are displayed. On the other hand, when a mirror image of the first image is displayed as shown in FIG. 25, vertically long and yellow paint (white paint in FIG. 25) arranged at the upper end of the first image as a display object 31d showing the mirror image. An icon indicating a frame (substitute for) and a vertical and italic "mirror image" arranged in the icon are displayed.

The display object 31d showing a normal image and the display object 31d showing a mirror image may differ only in characters, and in addition to the characters, the position of the icon in the first image, the longitudinal direction of the icon, and the icon At least one of the color, the character direction, and the character style of the character may be different.

<Summary of Embodiment 3>
According to the display control device 1 according to the third embodiment as described above, the display object 31d indicating whether the first image displayed on the first display surface 31a is a normal image or a mirror image is the first. 1 Displayed on the display surface 31a. Therefore, the user can easily know whether the first image is a normal image or a mirror image.

<Modification 1 of Embodiment 3>
In the third embodiment, the control unit 12 including the display object addition unit 12c first displays the display object 31d indicating whether the first image displayed on the first display surface 31a is a normal image or a mirror image. Control was performed to display on the display surface 31a. Instead of, or in addition to, this control, the control unit 12 outlines the first image based on whether the first image displayed on the first display surface 31a is a normal image or a mirror image. Control to deform the shape may be performed.

26 and 27 are diagrams showing display examples of a normal image and a mirror image of the first image on the first display surface 31a, respectively. When the normal image of the first image is displayed as shown in FIG. 26, the control unit 12 deforms the outer shape of the first image into a quadrangular shape. On the other hand, when the mirror image of the first image is displayed as shown in FIG. 27 as shown in FIG. 27, the control unit 12 changes the outer shape of the first image to a shape like a rearview mirror, for example, a rectangular shape. It transforms into a chamfered shape at each vertex of. In the first image of FIG. 27, a black triangular display object is displayed at each of the quadrangular vertices of the first image of FIG. 26 to indicate whether the first image is a normal image or a mirror image. It can be said that it is added as 31d. Even with the configuration of the present modification 1, the user can easily know whether the first image is a normal image or a mirror image.

<Modification 2 of Embodiment 3>
In the third embodiment, the display object addition unit 12c has a display object generation function and a superimpose function, but more complicated image processing may be performed. For example, the display object addition unit 12c receives the image output from the first photographing device 32, generates an image obtained by synthesizing the image and the display object by relatively complicated image processing, and displays the generated image in the display device 31. It may be output to.

Further, instead of the display control device 1, the first photographing device 32 or the display device 31 may have a display object generation function and a superimpose pause function. When the first photographing device 32 has a display object generation function and a superimpose pause function, the first photographing device 32 executes these functions based on the determination result of the image inversion determination unit 12a. Similarly, when the display device 31 has a display object generation function and a superimpose pause function, the display device 31 executes these functions based on the determination result of the image inversion determination unit 12a.

<Modification 3 of Embodiment 3>
In the third embodiment, the display object addition unit 12c controls to display the display object 31d showing the normal image on the first display surface 31a when the normal image of the first image is displayed, and the first image. When the mirror image of the above is displayed, the display object 31d showing the mirror image is controlled to be displayed on the first display surface 31a.

However, when the normal image of the first image is displayed, that is, when the display device 31 is assumed to be oriented in the normal direction, the display object addition unit 12c sets the display object 31d indicating the normal image. 1 It is not necessary to control the display on the display surface 31a. Then, when the mirror image of the first image is displayed, that is, when it is assumed that the display device 31 is facing in the direction opposite to the normal direction, the display object addition unit 12c displays the display object 31d showing the mirror image. Control to display on the first display surface 31a may be performed.

<Embodiment 4>
FIG. 28 is a block diagram showing the configuration of the display control device 1 according to the fourth embodiment of the present invention. Hereinafter, among the components according to the fourth embodiment, the same or similar components as those described above will be designated by the same reference numerals, and different components will be mainly described.

The configuration of the display control device 1 of FIG. 28 is the same as the configuration in which the operation input device 34 is further connected to the display control device 1 of FIG. The operation input device 34 accepts various operations. As the operation input device 34, for example, a button and a touch panel, a voice input device, a camera capable of detecting a user's gesture operation, and the like are used.

In the fourth embodiment, the image inversion determination unit 12a has a display operation human interface function. Further, in the fourth embodiment, the image inversion determination unit 12a determines whether or not the current image state of the first image and the image state of the first image based on the determination result of this time are the same. The case where the current image state of the first image and the image state of the first image based on the present determination result are the same, the case where both image states are normal images, and the case where both image states are both. Is also one of the cases where it is a mirror image. When the current image state of the first image and the image state of the first image based on the present determination result are different, one of the first images is a normal image and the other image state. Is a mirror image.

When the image inversion determination unit 12a determines that the current image state of the first image and the image state of the first image based on the present determination result are different, it determines that the process shifts to the stage prior to the switching control. The determination result is output to the display object addition unit 12c. The display object addition unit 12c controls to display a display object indicating whether or not to perform switching control on the first display surface 31a when the determination result is received.

After the determination result is output to the display object addition unit 12c, the image inversion determination unit 12a determines whether or not a predetermined operation for performing the switching control has been input to the operation input device 34. Then, when it is determined that a predetermined operation has been input to the operation input device 34, the video inversion control unit 12b performs switching control.

<Operation>
FIG. 29 is a flowchart showing the operation of the display control device 1 according to the fourth embodiment. The operation of FIG. 29 is the same as the operation of FIG. 10 with steps S21 to S30 added. Therefore, in the following, steps S21 and S30 will be mainly described.

In step S21 after step S1, the image inversion determination unit 12a and the image inversion control unit 12b read the image state of the current first image stored in advance. When the operation of FIG. 29 and the step S21 are performed for the first time, the default image state is read as the current image state of the first image.

In step S22, the image inversion control unit 12b turns on or off the image inversion function of the first photographing device 32 based on the current image state of the first image.

After step S22, the processes of steps S2 to S4 are performed. If it is determined in step S4 that the angle α is within the first angle range Φ1, the process proceeds to step S23, and if it is determined that the angle α is within the second angle range Φ2, the process proceeds. The process proceeds to step S28.

When the process proceeds from step S4 to step S23, the video inversion determination unit 12a determines whether or not the current image state of the first image is the same as the image state of the first image based on the determination in step S4, that is. It is determined whether or not the image is a normal image of the first image. Here, the current image state of the first image is the image state read in step S21 when step S21 has been performed most recently among steps S21, S26 and S30, and step S26 has been performed most recently. If this is the case, it is the image state stored in step S26, and if step S30 has been performed most recently, it is the image state stored in step S30.

If it is determined in step S23 that the current image state of the first image is a normal image, the process returns to step S2, and the normal image of the first image as shown in the upper left of the table in FIG. 30 is the first. It is displayed on the display surface 31a. If it is determined that the current image state of the first image is a mirror image, the process proceeds to step S24.

In step S24, the display object addition unit 12c controls to display the display object 31e indicating whether or not to perform the switching control on the first display surface 31a. As a result, a mirror image of the first image with the display object 31e indicating whether or not to perform switching control, as shown in the lower left of the table in FIG. 30, is displayed on the first display surface 31a.

In step S25, the video inversion determination unit 12a determines whether or not a predetermined operation has been input to the operation input device 34. If it is determined that the predetermined operation has been input, the process proceeds to step S5. If it is determined that the predetermined operation has not been input, the process returns to step S2, and the mirror image of the first image is displayed on the first display surface 31a.

In step S5, the image inversion control unit 12b turns off the image inversion function of the first photographing device 32 as a control for displaying the normal image of the first image on the first display surface 31a. As a result, the normal image of the first image is displayed on the first display surface 31a.

In step S26 after step S5, the current image state of the first image is stored as a normal image. After that, the process returns to step S2.

When the process proceeds from step S4 to step S27, the video inversion determination unit 12a determines whether or not the current image state of the first image is the same as the image state of the first image based on the determination in step S4, that is. It is determined whether or not it is a mirror image of the first image. The current image state of the first image referred to here is the same as the current image state of the first image described in step S23.

If it is determined in step S27 that the current image state of the first image is a mirror image, the process returns to step S2, and the mirror image of the first image as shown in the lower right of the table in FIG. 30 is first displayed. It is displayed on the surface 31a. If it is determined that the current image state of the first image is a normal image, the process proceeds to step S28.

In step S28, the display object addition unit 12c controls to display the display object 31e indicating whether or not to perform the switching control on the first display surface 31a. As a result, a normal image of the first image with a display object 31e indicating whether or not to perform switching control, as shown in the upper right of the table in FIG. 30, is displayed on the first display surface 31a.

In step S29, the video inversion determination unit 12a determines whether or not a predetermined operation has been input to the operation input device 34. If it is determined that the predetermined operation has been input, the process proceeds to step S6. If it is determined that the predetermined operation has not been input, the process returns to step S2, and the normal image of the first image is displayed on the first display surface 31a.

In step S6, the image inversion control unit 12b turns on the image inversion function of the first photographing device 32 as a control for displaying the mirror image of the first image on the first display surface 31a. As a result, the mirror image of the first image is displayed on the first display surface 31a.

In step S30 after step S6, the current image state of the first image is stored as a mirror image. After that, the process returns to step S2.

<Summary of Embodiment 4>
According to the display control device 1 according to the fourth embodiment as described above, when the switching control is performed, the display object 31e indicating whether to perform the switching control is controlled to be displayed on the first display surface 31a, and the switching is performed. When a predetermined operation for performing control is input to the operation input device 34, switching control is performed. According to such a configuration, the display of the normal image and the mirror image of the first image can be switched at the will of the user.

<Embodiment 5>
FIG. 31 is a block diagram showing the configuration of the display control device 1 according to the fifth embodiment of the present invention. Hereinafter, among the components according to the fifth embodiment, the same or similar components as those described above will be designated by the same reference numerals, and different components will be mainly described.

In the first to fourth embodiments, it is assumed that the display device 31 is arranged in the own vehicle 2. On the other hand, in the fifth embodiment, the display device 31 is arranged on the mobile communication terminal 35. In the fifth embodiment, the own vehicle 2 does not have to have a function of performing automatic driving, and the display device 31 of the mobile communication terminal 35 may be visually recognized by an occupant other than the driver.

The mobile communication terminal 35 is, for example, any of a mobile phone, a smartphone, a tablet, and a portable display device capable of communicating with the display control device 1 by a wireless LAN (Local Area Network) or the like. Similar to the display surface direction detection sensor 33, the mobile communication terminal 35 has a function of detecting the display surface direction 31b of the display device 31. This function is realized by, for example, any one of a two-axis acceleration sensor, a three-axis acceleration sensor, and an angular velocity sensor, or a combination thereof.

The configuration of the display control device 1 of FIG. 31 is the same as the configuration in which the communication unit 14 is added to the configuration of the display control device 1 of FIG. The communication unit 14 wirelessly communicates with the mobile communication terminal 35 by, for example, Bluetooth (registered trademark) or a wireless LAN. As a result, the display surface direction acquisition unit 11a can acquire the display surface direction 31b detected by the mobile communication terminal 35 from the mobile communication terminal 35 via the communication unit 14. When the mobile communication terminal 35 does not have a function of detecting the display surface direction 31b of the display device 31, and the indoor camera of the own vehicle 2 can detect the display surface direction 31b of the display device 31. The display surface direction acquisition unit 11a may acquire the display surface direction 31b detected by the indoor camera from the indoor camera via the communication unit 14.

Similar to the second embodiment, the image inversion determination unit 12a determines whether the angle α is within the predetermined first angle range or the second angle range. Similar to the second embodiment, the image inversion control unit 12b controls switching between the normal image and the mirror image of the first image based on the determination result of the image inversion determination unit 12a, and the first photographing device 32 performs the first Outputs a normal image and a mirror image of the image. The image output from the first photographing device 32 is transmitted to the mobile communication terminal 35 by the communication unit 14, and the display device 31 of the mobile communication terminal 35 is an image transmitted from the communication unit 14, that is, a normal image of the first image. Or display a mirror image.

<Operation>
FIG. 32 is a flowchart showing the operation of the display control device 1 according to the fifth embodiment. The operation of FIG. 32 is the same as the operation of FIG. 10 in which step S2, step S5, and step S6 are changed to step S41, step S42, and step S43, respectively. Therefore, in the following, steps S41 to S43 will be mainly described.

In step S41 after step S1, the display surface direction acquisition unit 11a acquires the display surface direction 31b from the mobile communication terminal 35 via the communication unit 14, and the image inversion determination unit 12a is the display surface direction acquisition unit 11a. The acquired display surface direction 31b is read.

After that, the processes of steps S3 and S4 are performed. If it is determined in step S4 that the angle α is within the first angle range Φ1, the process proceeds to step S42, and if it is determined that the angle α is within the second angle range Φ2, the process proceeds. The process proceeds to step S43.

In step S42, the image inversion control unit 12b turns off the image inversion function of the first photographing device 32 as a control for displaying the normal image of the first image on the first display surface 31a. That is, the image inversion control unit 12b requests the first photographing device 32 to output normally. As a result, the normal image of the first image is transmitted to the mobile communication terminal 35 by the communication unit 14 and displayed on the first display surface 31a of the display device 31. For example, in the state shown in FIG. 33, the normal image of the first image is displayed on the first display surface 31a. After that, the process returns to step S2.

In step S43, the image inversion control unit 12b turns on the image inversion function of the first photographing device 32 as a control for displaying the mirror image of the first image on the first display surface 31a. That is, the video inversion control unit 12b requests the first photographing device 32 to invert output. As a result, the mirror image of the first image is transmitted by the communication unit 14 to the mobile communication terminal 35 and displayed on the first display surface 31a of the display device 31. For example, in the state shown in FIG. 34, a mirror image of the first image is displayed on the first display surface 31a. After that, the process returns to step S2.

<Summary of Embodiment 5>
According to the display control device 1 according to the fifth embodiment as described above, since the display device 31 is arranged in the mobile communication terminal 35, the mobile communication terminal 35 is also the same as in the first to fourth embodiments. , Appropriate image can be displayed.

<Modification of Embodiment 5>
In the fifth embodiment, the first photographing device 32 has an image reversing function for reversing the left and right of the first image captured by the first photographing device 32, and the display control device 1 switches the image reversing function on and off. Controlled. However, the image inversion function may be provided in any of the display control device 1, the first photographing device 32, and the mobile communication terminal 35.

For example, the display control device 1 may have an image reversing function for reversing the left and right of the first image captured by the first photographing device 32, and may perform control for switching on and off of the image reversing function. In this case, the display control device 1 transmits a normal image or a mirror image of the first image to the mobile communication terminal 35, and the display device 31 displays the image transmitted from the display control device 1.

Further, for example, the mobile communication terminal 35 has an image reversing function for reversing the left and right of the first image captured by the first photographing device 32, and the display control device 1 has a first image captured by the first photographing device 32. , A control signal for controlling to switch the image inversion function on and off may be transmitted to the mobile communication terminal 35.

When the first photographing device 32 has a communication function capable of communicating with the mobile communication terminal 35, the first photographing device 32 transmits the first image to the mobile communication terminal 35 without passing through the display control device 1. You may send it.

<Embodiment 6>
FIG. 35 is a block diagram showing the configuration of the display control device 1 according to the sixth embodiment of the present invention. Hereinafter, among the components according to the sixth embodiment, the same or similar components as those described above will be designated by the same reference numerals, and different components will be mainly described.

The configuration of the display control device 1 of FIG. 35 is the same as the configuration in which the image processing unit 12d is added to the configuration of the display control device 1 of FIG. The image processing unit 12d is included in the concept of the control unit 12 of FIG.

The image processing unit 12d performs image conversion in which the first image output from the first photographing device 32 and displayed on the first display surface 31a is three-dimensionally rotated based on the angle α. This image conversion may be performed by, for example, pixel-by-pixel image mapping processing by custom hardware, or by image conversion processing by an image processing LSI (Large Scale Integrated).

Hereinafter, it is assumed that the display device 31 described in the second embodiment can be rotated (FIGS. 7 and 8). Further, in the following, a display example of a configuration in which the first photographing direction 32a of the first photographing device 32 is in the front direction of the own vehicle 2 will be described, but a display example described below also in a configuration in which the first photographing direction 32a is in the rear direction of the own vehicle 2. Is similar to.

FIG. 36 is a diagram showing a display example by the display control device according to the sixth embodiment. In the example of FIG. 36, there are seven states of the display device 31 that rotates around the central axis 41 corresponding to the position of the front seat, that is, the angles α are 0 degrees, 30 degrees, 60 degrees, 90 degrees, and 120 degrees. The state of 150 degrees and 180 is shown. Then, FIG. 36 shows a plurality of figures arranged in three rows in an arc shape.

The inner view of the three columns of FIG. 36 is a diagram showing the inclination of the display device 31 for each state.

The middle figure of the three columns of FIG. 36 is a diagram showing the inclination of the display device 31 in each state and the pseudo display reference surface 31 ps. The orientation 31pd of the pseudo display reference surface 31 ps is always the same as the first shooting direction 32a when the normal image of the first image is displayed, and the first shooting direction when the mirror image of the first image is displayed. It is always the opposite of 32a. The image processing unit 12d rotates the first image three-dimensionally so that the first display surface 31a is virtually rotated toward the pseudo display reference surface 31 ps.

The outer view of the three columns of FIG. 36 is a view showing a display example of the first image on the first display surface 31a in each state.

When the angle α is 0 degrees, since the first display surface 31a and the pseudo display reference surface 31ps are parallel, the normal image of the first image is displayed without being three-dimensionally rotated.

When the angle α is 30 degrees or 60 degrees, the normal image of the first image is displayed on the first display surface 31a. Further, in this case, the left end of the first display surface 31a is located behind the pseudo display reference surface 31ps and the right end of the first display surface 31a is the pseudo display reference when viewed from the orientation 31pd of the pseudo display reference surface 31ps. It is located in front of the surface 31 ps. Therefore, in the image processing unit 12d, the left end of the normal image of the first image corresponding to the left end of the first display surface 31a is located in front, and the right end of the first image corresponding to the right end of the first display surface 31a is in the back. The normal image of the first image is three-dimensionally rotated so as to be located at.

As a result, the left side portion of the normal image of the first image is in the vertical direction so that the vertical length of the left end of the normal image of the first image is longer than the vertical length of the center of the normal image of the first image. Is expanded to. On the other hand, the right portion of the normal image of the first image is in the vertical direction so that the vertical length of the right end of the normal image of the first image is shorter than the vertical length of the center of the normal image of the first image. It will be reduced. Therefore, when the angle α is larger than 0 degrees and smaller than 90 degrees, the outer shape of the first image is trapezoidal.

When the angle α is 90 degrees, neither the normal image nor the mirror image of the first image is displayed on the first display surface 31a.

When the angle α is 120 degrees or 150 degrees, a mirror image of the first image is displayed on the first display surface 31a. Further, in this case, the left end of the first display surface 31a is located in front of the pseudo display reference surface 31ps and the right end of the first display surface 31a is the pseudo display reference when viewed from the orientation 31pd of the pseudo display reference surface 31ps. It is located deeper than the surface 31 ps. Therefore, in the image processing unit 12d, the right end of the mirror image of the first image corresponding to the left end of the first display surface 31a is located at the back, and the left end of the mirror image of the first image corresponding to the right end of the first display surface 31a is located at the back. The mirror image of the first image is three-dimensionally rotated so that it is located in the foreground.

As a result, the left side portion of the mirror image of the first image is enlarged in the vertical direction so that the vertical length of the left end of the mirror image of the first image is longer than the vertical length of the center of the mirror image of the first image. To. On the other hand, the right portion of the mirror image of the first image is reduced in the vertical direction so that the vertical length of the right end of the mirror image of the first image is shorter than the vertical length of the center of the mirror image of the first image. .. Therefore, when the angle α is larger than 90 degrees and smaller than 180 degrees, the outer shape of the first image is trapezoidal.

When the angle α is 180 degrees, since the first display surface 31a and the pseudo display reference surface 31ps are parallel, the mirror image of the first image is displayed without being three-dimensionally rotated.

In the above description, the configuration in which the display device 31 moves so as to draw an arc from the central axis 41 to the right side has been described, but the configuration in which the display device 31 moves so as to draw an arc from the central axis 41 to the left side is also described below. Is similar to. However, in the configuration in which the display device 31 moves so as to draw an arc from the central axis 41 to the left side, contrary to the example of FIG. 36, the length of the left end of the first image in the vertical direction becomes shorter, and the length of the left end of the first image becomes shorter. The length of the right end in the vertical direction becomes longer.

<Operation>
FIG. 37 is a flowchart showing the operation of the display control device 1 according to the sixth embodiment. The operation of FIG. 37 is the same as the operation of FIG. 10 in which steps S5 and S6 are changed to steps S51 to S55. Therefore, in the following, steps S51 to S55 will be mainly described.

First, the processes of steps S1 to S4 are performed. If it is determined in step S4 that the angle α is within the first angle range Φ1, the process proceeds to step S51, and if it is determined that the angle α is within the second angle range Φ2, the process proceeds. The process proceeds to step S53.

When the process proceeds from step S4 to step S51, the image inversion control unit 12b turns off the image inversion function of the first imaging device 32 as a control for displaying the normal image of the first image on the first display surface 31a. .. That is, the image inversion control unit 12b requests the first photographing device 32 to output normally. As a result, the normal image of the first image is input from the first photographing device 32 to the image processing unit 12d.

In step S52, the image processing unit 12d rotates the normal image of the first image three-dimensionally based on the angle α. After that, the process proceeds to step S55.

When the process proceeds from step S4 to step S53, the image inversion control unit 12b turns on the image inversion function of the first photographing device 32 as a control for displaying the mirror image of the first image on the first display surface 31a. That is, the video inversion control unit 12b requests the first photographing device 32 to invert output. As a result, the mirror image of the first image is input from the first photographing device 32 to the image processing unit 12d.

In step S54, the image processing unit 12d rotates the mirror image of the first image three-dimensionally based on the angle α. After that, the process proceeds to step S55.

In step S55, the image processing unit 12d outputs the image three-dimensionally rotated by step S52 or step S54 to the display device 31. As a result, a normal image or a mirror image of the first image rotated three-dimensionally is displayed on the first display surface 31a of the display device 31. After that, the process returns to step S2.

<Summary of Embodiment 6>
According to the display control device 1 according to the sixth embodiment as described above, the first image displayed on the first display surface 31a is 3 based on the angle α of the display surface direction 31b with respect to the first shooting direction 32a. Dimensionally rotate. According to such a configuration, the user can know the magnitude of the angle α to some extent.

<Modification 1 of Embodiment 6>
In the sixth embodiment, the outer shape of the first image is trapezoidal when the angle α is larger than 0 degrees and smaller than 90 degrees, or when the angle α is larger than 90 degrees and smaller than 180 degrees. However, the outer shape of the first image in that case may be an arbitrary polygon, or a trapezoid or at least one side of the arbitrary polygon may include a curve.

<Modification 2 of Embodiment 6>
In the description here, the angle at which the pseudo display reference surface 31 ps rotates is referred to as an angle Θ psd. In the sixth embodiment, the image processing unit 12d rotates the pseudo display reference surface 31 ps discontinuously based on the angle α so that the angle Θ psd becomes 0 degree or 180. However, the image processing unit 12d may continuously rotate the pseudo display reference surface 31 ps based on the angle α so that the angle Θ psd = the angle α. In this case, the first image that is not three-dimensionally rotated is displayed substantially as in the second embodiment.

Further, the image processing unit 12d may continuously rotate the pseudo display reference surface 31 ps based on the angle α so that the angle Θpsd = f (α). Note that f (α) is a function of the angle α. For example, when F- ₉₀ , F ₀ , F ₉₀ , F ₁₈₀ , and F ₂₇₀ are constants, -90 degrees <f (-90) = F- ₉₀ <f (0) = F ₀ <f (90). A monotonically increasing function satisfying = F ₉₀ <f (180) = F ₁₈₀ <f (270) = F ₂₇₀ may be used as f (α).

<Modification 3 of Embodiment 6>
In the sixth embodiment, the pseudo display reference surface 31 ps was one plane. However, the pseudo display reference surface 31 ps may be a surface obtained by combining a plurality of planes, a single curved surface, or a surface obtained by combining a plurality of curved surfaces.

<Modification 4 of Embodiment 6>
In the sixth embodiment, a normal display device is assumed as the display device 31, but a three-dimensional display such as an autostereoscopic display device using parallax or the like may be used as the display device 31. .. In this case, the display control device 1 may control the display of the first image on the pseudo display reference surface 31 ps which is three-dimensionally displayed as a floating plane or curved surface.

<Modification 5 of Embodiment 6>
So far, the angle α has been described as having only the angle component in the horizontal plane of the own vehicle 2. However, the angle α may have not only the angle component in the horizontal plane of the own vehicle 2 but also the angle component in the vertical plane of the own vehicle 2, that is, the angle component of the elevation / depression angle. Then, the image processing unit 12d may rotate the first image displayed on the first display surface 31a three-dimensionally based on the angle α having the angle component in the horizontal plane and the angle component in the vertical plane.

<Modification 6 of Embodiment 6>
In the sixth embodiment, the configuration in which the three-dimensional rotation is applied to the display device 31 described in the first to fourth embodiments, that is, the first image displayed on the display device 31 of the own vehicle 2 has been described. However, the three-dimensional rotation may be applied to the display device 31 described in the fifth embodiment, that is, the first image displayed on the display device 31 of the mobile communication terminal 35.

<Other variants>
The acquisition unit 11 and the control unit 12 of FIG. 1 described above are hereinafter referred to as “acquisition unit 11 and the like”. The acquisition unit 11 and the like are realized by the processing circuit 81 shown in FIG. 38. That is, the processing circuit 81 has the acquisition unit 11 that acquires the display surface direction 31b, which is the direction toward the first display surface 31a of the display device 31, and the display surface direction 31b with respect to the first imaging direction 32a of the first imaging device 32. A control unit 12 that controls switching between a normal image and a mirror image of the first image taken by the first photographing device 32 and displayed on the first display surface 31a based on the angle α is provided. Dedicated hardware may be applied to the processing circuit 81, or a processor that executes a program stored in the memory may be applied. Examples of the processor include a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), and the like.

When the processing circuit 81 is dedicated hardware, the processing circuit 81 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), or an FPGA (Field Programmable Gate). Array), or a combination of these. Each of the functions of each part such as the acquisition unit 11 may be realized by a circuit in which the processing circuits are dispersed, or the functions of each part may be collectively realized by one processing circuit.

When the processing circuit 81 is a processor, the functions of the acquisition unit 11 and the like are realized by combining with software and the like. The software and the like correspond to, for example, software, firmware, or software and firmware. Software and the like are described as programs and stored in memory. As shown in FIG. 39, the processor 82 applied to the processing circuit 81 realizes the functions of each part by reading and executing the program stored in the memory 83. That is, when the display control device 1 is executed by the processing circuit 81, the step of acquiring the display surface direction 31b, which is the direction toward the first display surface 31a of the display device 31, and the first step of the first photographing device 32. Based on the angle α of the display surface direction 31b with respect to the imaging direction 32a, the step of switching between the normal image and the mirror image of the first image captured by the first imaging device 32 and displayed on the first display surface 31a is A memory 83 for storing a program to be executed as a result is provided. In other words, it can be said that this program causes the computer to execute the procedure or method of the acquisition unit 11 or the like. Here, the memory 83 is, for example, non-volatile such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), and EPROM (Electrically Erasable Programmable Read Only Memory). Volatile semiconductor memory, HDD (Hard Disk Drive), magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disc), its drive device, etc., or any storage medium used in the future. You may.

The configuration in which each function of the acquisition unit 11 and the like is realized by either hardware or software has been described above. However, the present invention is not limited to this, and a configuration may be configured in which a part of the acquisition unit 11 or the like is realized by dedicated hardware and another part is realized by software or the like. For example, the acquisition unit 11 realizes its function by a processing circuit 81 as dedicated hardware, an interface, a receiver, and the like, and other than that, the processing circuit 81 as a processor 82 reads a program stored in the memory 83. It is possible to realize the function by executing it.

As described above, the processing circuit 81 can realize each of the above-mentioned functions by hardware, software, or a combination thereof.

Further, the display control device 1 described above includes a vehicle device such as a PND (Portable Navigation Device) and a navigation device, a communication terminal including a mobile terminal such as a mobile phone, a smartphone and a tablet, and at least the vehicle device and the communication terminal. It can also be applied to a display control system constructed as a system by appropriately combining the functions of an application installed in any one and a server. In this case, each function or each component of the display control device 1 described above may be dispersedly arranged in each device for constructing the system, or may be centrally arranged in any of the devices. Good.

FIG. 40 is a block diagram showing the configuration of the server 91 according to this modification. The server 91 of FIG. 40 includes a communication unit 91a and a control unit 91b, and can perform wireless communication with the display device 31 of the vehicle 92 and the vehicle device 93 connected to the first photographing device 32. There is.

The communication unit 91a, which is an acquisition unit, receives the display surface direction 31b of the display device 31 acquired by the vehicle device 93 by performing wireless communication with the vehicle device 93.

The control unit 91b has the same function as the control unit 12 of FIG. 1 when a processor (not shown) of the server 91 or the like executes a program stored in a memory (not shown) of the server 91. That is, the control unit 91b is a first image captured by the first imaging device 32 and displayed on the first display surface 31a based on the angle α of the display surface direction 31b with respect to the first imaging direction 32a of the first imaging device 32. A control signal for switching between a normal image and a mirror image of an image is generated. Then, the communication unit 91a transmits the control signal generated by the control unit 91b to the vehicle device 93. According to the server 91 configured in this way, the same effect as that of the display control device 1 described in the first embodiment can be obtained.

FIG. 41 is a block diagram showing the configuration of the communication terminal 96 according to this modification. The communication terminal 96 of FIG. 41 includes a communication unit 96a similar to the communication unit 91a and a control unit 96b similar to the control unit 91b, and can perform wireless communication with the vehicle device 98 of the vehicle 97. ing. A mobile terminal such as a mobile phone, a smartphone, or a tablet carried by the driver of the vehicle 97 is applied to the communication terminal 96, for example. According to the communication terminal 96 configured in this way, the same effect as that of the display control device 1 described in the first embodiment can be obtained.

In the present invention, each embodiment and each modification can be freely combined, and each embodiment and each modification can be appropriately modified or omitted within the scope of the invention.

Although the present invention has been described in detail, the above description is exemplary in all embodiments and the present invention is not limited thereto. It is understood that innumerable variations not illustrated can be assumed without departing from the scope of the present invention.

1 Display control device, 2 Own vehicle, 11 Acquisition unit, 12 Control unit, 31 Display device, 31a 1st display surface, 31b Display surface direction, 31c 2nd display surface, 31d, 31e Display object, 32 1st imaging device, 32a 1st shooting direction, 34 operation input device, 35 mobile communication terminal, Φ1 1st angle range, Φ2 2nd angle range, Φ3 3rd angle range.

Claims (15)

An acquisition unit that acquires a display surface direction that is a direction toward the first display surface of a display device having a first display surface that can rotate in a facing direction in a vehicle.
Based on the angle of the display surface direction with respect to the first imaging direction of the first imaging device arranged in the vehicle, the positive image of the first image photographed by the first imaging device and displayed on the first display surface. A display control device including a control unit that controls switching between an image and a mirror image. The display control device according to claim 1.
A first angle range including 0 degrees and a second angle range including 180 degrees and not overlapping the first angle range are defined in advance.
The control unit
When the angle is within the first angle range, control is performed to display a normal image of the first image on the first display surface, and when the angle is within the second angle range, the first image is displayed. A display control device that controls the display of a mirror image of one image on the first display surface. The display control device according to claim 2.
A display control device in which the sum of the first angle range and the second angle range is an angle range of 360 degrees. The display control device according to claim 2.
Between the first angle range and the second angle range, a third angle range that does not overlap with the first angle range and the second angle range is further defined.
The control unit
When the angle is within the third angle range, the control for displaying the normal image of the first image on the first display surface and the mirror image of the first image are displayed on the first display surface. A display control device that does not perform any control. The display control device according to claim 1.
The display device is a display control device arranged in a mobile communication terminal. The display control device according to claim 1.
The vehicle can be driven automatically
The control unit
A display control device that performs the switching control based on the angle when a predetermined automatic driving is performed in the vehicle. The display control device according to claim 1.
A display control device provided in the vehicle with a structure that rotates the first display surface in conjunction with the rotation of the front seat of the vehicle. The display control device according to claim 1.
A display control device that, when the display device is located between the front and rear seats of the vehicle, is rotatable so that the first display surface selectively faces the front and rear seats. The display control device according to claim 1.
The display control device in which the first photographing direction of the first photographing device is the front direction or the rear direction of the vehicle. The display control device according to claim 1.
The vehicle is provided with a second photographing device having a second photographing direction different from the first photographing direction.
The control unit
A display control device that controls switching between display and non-display of a second image captured by the second imaging device on the first display surface based on the angle. The display control device according to claim 1.
The control unit
When the switching control is performed, a display object indicating whether to perform the switching control is controlled to be displayed on the first display surface, and a predetermined operation for performing the switching control is input to the operation input device. A display control device that performs the switching control in such a case. The display control device according to claim 1.
The control unit
A display control device that three-dimensionally rotates the first image displayed on the first display surface based on the angle. The display control device according to claim 1.
The display device has a first display surface and a second display surface provided on the opposite side of the first display surface.
The control unit
When a normal image of the first image is displayed on the first display surface, control is performed to display a mirror image of the first image on the second display surface, and the first image is displayed on the first display surface. A display control device that controls the display of a normal image of the first image on the second display surface when the mirror image of the first image is displayed. The display control device according to claim 1.
The control unit
Control to display a display object indicating whether the first image displayed on the first display surface is a normal image or a mirror image on the first display surface, and display on the first display surface. A display control device that performs at least one of control of deforming the outer shape of the first image based on whether the first image is a normal image or a mirror image. The direction of the display surface, which is the direction toward the first display surface, of the display device having the first display surface that can rotate in the facing direction in the vehicle is acquired.
Based on the angle of the display surface direction with respect to the first imaging direction of the first imaging device arranged in the vehicle, the positive image of the first image photographed by the first imaging device and displayed on the first display surface. A display control method that controls switching between an image and a mirror image.

Images