JP2019202641A - Display device - Google Patents

Abstract

To provide a display device capable of safely providing guidance of a travel route for a vehicle.SOLUTION: A display device constituted of, for example, a head-up display device, displays a route guide image visible to a driver as a virtual image V superimposed on a front road of a vehicle. The display device includes: discrimination means for discriminating whether or not warning factors related to driving the vehicle exist, on the basis of peripheral information of the vehicle; and display control means for performing display control of the route guide image, on the basis of route guide information for providing guidance of a travel route for the vehicle. When discriminated that no warning factors exist, the display control means displays a route guide image G1 of a normal mode. However, when a warning factor is discriminated to exist, the display control means displays a route guide image G2 of an alerting mode in which an alerting portion W for paying attention to a warning factor is changed to a mode differing from the normal mode.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a display device.

  Patent Document 1 discloses a conventional display device that displays a route guidance image that is visually recognized by a viewer (mainly a driver of a vehicle) as a virtual image that overlaps with a front landscape of the vehicle. (See FIG. 5 of the same document).

Japanese Patent Laid-Open No. 2006-60445

  In the display device disclosed in Patent Document 1, for example, the route guidance image itself made up of an arrow indicates whether there is a caution factor (red signal or oncoming vehicle when turning right) on the travel route indicated by the image. Regardless of whether it is displayed in the same manner. Therefore, there is room for improvement in safely guiding the travel route.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a display device that can safely guide a travel route of a vehicle.

In order to achieve the above object, a display device according to the present invention includes:
A display device that displays a route guidance image visually recognized by a viewer as a virtual image overlapping a road ahead of a vehicle,
Determining means for acquiring surrounding information of the vehicle, and determining whether or not there is a caution factor regarding driving of the vehicle based on the acquired surrounding information;
Display control means for acquiring route guidance information for guiding a travel route of the vehicle, and performing display control of the route guidance image based on the acquired route guidance information;
The display control means includes
When it is determined that the attention factor does not exist, the route guidance image is displayed in the first mode,
When it is determined that the attention factor is present, the attention-calling portion for calling the attention factor in the route guidance image is displayed in a second mode that is changed to a mode different from the first mode.

  According to the present invention, a travel route of a vehicle can be safely guided.

It is a figure for demonstrating the mounting aspect to the vehicle of the head up display (HUD) apparatus which concerns on one Embodiment of this invention. It is a block diagram of the display system for vehicles. It is a flowchart which shows an example of a display control process. (A) is a figure which shows an example of the route guidance image in a normal aspect, (b) is a figure which shows an example of the route guidance image in an alerting aspect. (A) And (b) is a figure which shows the other example of the route guidance image in an alerting aspect. (A) And (b) is a figure which shows the other example of the route guidance image in an alerting aspect.

  A display device according to an embodiment of the present invention will be described with reference to the drawings.

  The display device according to the present embodiment is a HUD (Head-Up Display) device 10 included in the vehicle display system 100 shown in FIG. As shown in FIG. 1, the HUD device 10 is provided inside a dashboard 2 of the vehicle 1, and not only information related to the vehicle 1 (hereinafter also referred to as vehicle information) but also information other than vehicle information is integrated. The driver D is notified. The vehicle information includes not only information on the vehicle 1 itself but also information on the outside of the vehicle 1 related to the operation of the vehicle 1.

  The vehicle display system 100 is a system configured in the vehicle 1, and includes a HUD device 10, a peripheral information acquisition unit 40, a front information acquisition unit 50, a line-of-sight detection unit 60, and an ECU (Electronic Control Unit) 70. And a car navigation device 80.

  As shown in FIG. 1, the HUD device 10 is provided inside the dashboard 2 and emits display light L toward the windshield 3 that has been subjected to the combiner process. The display light L reflected by the windshield 3 goes to the driver D side. The driver D can visually recognize the image represented by the display light L as the virtual image V in front of the windshield 3 by placing the viewpoint in the eye box E. That is, the HUD device 10 displays the virtual image V at the front position of the windshield 3. Thereby, the driver D can observe the virtual image V superimposed on the front scenery.

  The HUD device 10 includes the display unit 20 and the control device 30 shown in FIG. 2 and a reflection unit (not shown).

  The display unit 20 displays a superimposed image that is visually recognized by the driver D as a virtual image V under the control of the control device 30. The display unit 20 includes, for example, a TFT (Thin Film Transistor) type LCD (Liquid Crystal Display), a backlight that illuminates the LCD from behind, and the like. The backlight is composed of, for example, an LED (Light Emitting Diode). The display unit 20 generates the display light L when the LCD illuminated by the backlight displays an image under the control of the control device 30. The generated display light L is emitted toward the windshield 3 after being reflected by the reflecting portion. The reflection part is composed of, for example, two mirrors, a folding mirror and a concave mirror. The folding mirror folds the display light L emitted from the display unit 20 and directs it toward the concave mirror. The concave mirror reflects the light L toward the windshield 3 while expanding the display light L from the folding mirror. Thereby, the virtual image V visually recognized by the driver D is an enlarged image displayed on the display unit 20. Note that the number of mirrors constituting the reflecting portion can be arbitrarily changed according to the design.

  In the following description, the display unit 20 displaying an image visually recognized by the driver D as the virtual image V is also referred to as “displaying a superimposed image”. In addition, the control of the display unit 20 performed by the control device 30 is also referred to as “performing superimposed image display control”. In addition, the display unit 20 is not limited to the one using an LCD as long as it can display a superimposed image, such as OLED (Organic Light Emitting Diodes), DMD (Digital Micromirror Device), and LCOS (Liquid Crystal On Silicon). A display device may be used.

  The control device 30 includes a microcomputer that controls the overall operation of the HUD device 10, and includes a control unit 31, a ROM (Read Only Memory) 32, and a RAM (Random Access Memory) 33. Moreover, the control apparatus 30 is provided with the input / output circuit for communicating with a drive circuit and the various systems in the vehicle 1 as a structure which is not shown in figure.

  The ROM 32 stores an operation program and various image data in advance. The RAM 33 temporarily stores various calculation results and the like. The control unit 31 includes a CPU (Central Processing Unit) 31a that executes an operation program stored in the ROM 32, and a GPU (Graphics Processing Unit) 31b that executes image processing in cooperation with the CPU. In particular, the ROM 32 stores an operation program for executing display control processing described later. A part of the control unit 31 may be configured by an ASIC (Application Specific Integrated Circuit). Moreover, the structure of the control apparatus 30 and the control part 31 is arbitrary as long as the function demonstrated below is satisfied.

  The control unit 31 drives and controls the display unit 20. For example, the control unit 31 drives and controls the backlight of the display unit 20 with the CPU 31a, and drives and controls the LCD of the display unit 20 with the GPU 31b that operates in cooperation with the CPU 31a.

  The CPU 31a of the control unit 31 performs display control of the superimposed image based on various image data stored in the ROM 32 in cooperation with the GPU 31b. The GPU 31b determines the control content of the display operation of the display unit 20 based on the display control command from the CPU 31a. The GPU 31 b reads image part data necessary for configuring one screen to be displayed on the display unit 20 from the ROM 32 and transfers it to the RAM 33. Also, the GPU 31b uses the RAM 33 to create picture data for one screen based on the image part data and various image data received from the outside of the HUD device 10 by communication. Then, when the GPU 31b completes the picture data for one screen in the RAM 33, the GPU 31b transfers the picture data to the display unit 20 in accordance with the update timing of the image. Thereby, the superimposed image visually recognized by the driver D as a virtual image V is displayed on the display unit 20. In addition, a layer is assigned in advance to each image constituting an image visually recognized as the virtual image V, and the control unit 31 can individually control display of each image.

  The CPU 31a of the control unit 31 communicates with each of the peripheral information acquisition unit 40, the front information acquisition unit 50, the line-of-sight detection unit 60, the ECU 70, and the car navigation device 80. As the communication, for example, a communication method such as CAN (Controller Area Network), Ethernet, MOST (Media Oriented Systems Transport), or LVDS (Low Voltage Differential Signaling) is applicable.

  The peripheral information acquisition unit 40 acquires information about the periphery (external) of the vehicle 1, and communicates between the vehicle 1 and a wireless network (V2N: Vehicle To cellular Network), and communicates between the vehicle 1 and another vehicle (V2V). : Vehicle To Vehicle), communication between the vehicle 1 and pedestrians (V2P: Vehicle To Pedestrian), and communication between the vehicle 1 and roadside infrastructure (V2I: Vehicle To roadside Infrastructure). That is, the peripheral information acquisition unit 40 enables communication by V2X (Vehicle To Everything) between the vehicle 1 and the outside of the vehicle 1.

  For example, (i) the peripheral information acquisition unit 40 includes a communication module that can directly access a WAN (Wide Area Network), an external device (such as a mobile router) that can access the WAN, an access point of a public wireless LAN (Local Area Network), and the like. A communication module for communication is provided, and Internet communication is performed. The peripheral information acquisition unit 40 includes a GPS controller that calculates the position of the vehicle 1 based on a GPS (Global Positioning System) signal received from an artificial satellite or the like. With these configurations, communication by V2N is enabled. (Ii) In addition, the peripheral information acquisition unit 40 includes a wireless communication module compliant with a predetermined wireless communication standard, and performs communication using V2V or V2P. (Iii) The peripheral information acquisition unit 40 includes a communication device that wirelessly communicates with roadside infrastructure, and is installed as an infrastructure from a base station of a driving safety support system (DSSS), for example. Peripheral information and traffic information are acquired via the roadside wireless device. As a result, communication by V2I becomes possible.

  In this embodiment, the peripheral information acquisition unit 40 is a peripheral that indicates the position, size, attributes, and the like of various objects such as vehicles, traffic lights, and pedestrians that exist outside the vehicle 1 (hereinafter also referred to as the host vehicle 1). Information is acquired by V2I. The peripheral information is not limited to V2I, and may be acquired by any communication in V2X. Moreover, the surrounding information acquisition part 40 acquires the traffic information containing the position and shape of the surrounding road of the vehicle 1 by V2I.

  The front information acquisition unit 50 includes, for example, a stereo camera that captures a landscape in front of the vehicle 1, a sonar that detects an object positioned in front of the vehicle 1, an ultrasonic sensor, and a millimeter wave radar.

  In this embodiment, the front information acquisition part 50 transmits the front image (data which shows a front image) which imaged the front scenery with the stereo camera to CPU31a.

  The line-of-sight detection unit 60 includes, for example, an imaging unit (for example, a stereo camera) that captures the face of the driver D and generates imaging data, and an image processing unit that performs image processing of the captured data. Is detected. For example, the line-of-sight detection unit 60 detects the line-of-sight direction of the driver D by a known image analysis method such as a pattern matching method, and transmits detection data indicating the detection result to the CPU 31a.

  The CPU 31a refers to the table data stored in advance in the ROM 32 in which the line-of-sight direction and the position of the visual recognition target are associated with each other, and identifies the target that the driver D is currently viewing. The line-of-sight direction may be detected based on, for example, either eye of the driver D or may be detected as the center of gravity of both eyes. If the CPU 31a can identify the target that the driver D is viewing, the detection data is arbitrary. Further, the line-of-sight detection unit 60 may detect the direction of the face of the driver D by a known image analysis method, and use the detected data as detection data. In this case, the CPU 31a refers to the table data stored in advance in the ROM 32 in which the face orientation and the position of the visual recognition target are associated with each other, and identifies the target that the driver D is currently viewing. . In addition, you may obtain | require the position of the visual recognition object by numerical formula from a gaze direction, without using table data. Data indicating the mathematical formula may be stored in the ROM 32 in advance.

  The line-of-sight detection unit 60 may be an imaging unit, an electrooculogram sensor, or a motion sensor mounted on a wearable device worn by the driver D on the head. The line-of-sight direction and the face direction can be detected from the imaging data obtained by the imaging means, as described above. In addition, the electrooculogram sensor detects the line-of-sight direction of the driver D based on the measured electrooculogram. Moreover, a motion sensor consists of 1 or a combination of an acceleration sensor, a gyro sensor, and a geomagnetic sensor, for example, and detects the direction of the driver | operator's D face.

  Note that the CPU 31a may be configured to detect the line-of-sight direction and the face direction of the driver D based on signals from the imaging means and various sensors. As long as the CPU 31a can identify the target that the driver D is viewing, the detection method and detection configuration of the driver D's line-of-sight direction and face orientation are arbitrary.

  ECU70 controls each part of the vehicle 1, for example, transmits the vehicle speed information which shows the present vehicle speed of the vehicle 1 to CPU31a. Note that the CPU 31a may acquire vehicle speed information from a vehicle speed sensor. In addition, the ECU 70 transmits a measured amount such as the engine speed, warning information of the vehicle 1 itself (fuel reduction, engine oil pressure abnormality, etc.) and other vehicle information to the CPU 31a. Based on the information acquired from the ECU 70, the CPU 31a can display an image indicating the vehicle speed, the engine speed, various warnings, and the like on the display unit 20 via the GPU 31b. That is, in addition to a route guidance image described later, an image showing various vehicle information can be displayed in the display area of the virtual image V.

  The car navigation device 80 includes a GPS controller that calculates the position of the vehicle 1 based on a GPS (Global Positioning System) signal received from an artificial satellite or the like. The car navigation device 80 has a storage unit that stores map data, reads map data in the vicinity of the current position from the storage unit based on position information from the GPS controller, and displays a guide route to the destination set by the user. decide. Then, the car navigation device 80 outputs information regarding the current position of the vehicle 1 and the determined guide route to the control unit 31. In addition, the car navigation device 80 outputs information indicating the name and type of the facility ahead of the vehicle 1 and the distance between the facility and the vehicle 2 to the control unit 31 by referring to the map data. Map data includes road shape information (lanes, road width, number of lanes, intersections, curves, branch roads, etc.), restriction information on road signs such as speed limits, information about each lane when there are multiple lanes, etc. Various types of information are associated with position data. The car navigation device 80 outputs these various types of information as route guidance information to the control unit 31. The car navigation device 80 is not limited to the one installed in the vehicle 1, and communicates with the control unit 31 by wire or wirelessly and has a car navigation function (smart phone, tablet PC (Personal Computer), etc.) ).

(Display control processing)
Subsequently, a display control process for displaying a route guidance image visually recognized by the driver D as a virtual image overlapping with the road ahead of the vehicle will be described with reference to FIG. The display control process is executed by the control unit 31, and is continuously executed, for example, in a state where the ignition of the vehicle 1 is turned on. In addition to the description of the display control process, a display example of the route guidance image will be described with reference to FIG.

  When the display control process is started, first, the control unit 31 acquires route guidance information from the car navigation device 80 (step S1). Subsequently, the control unit 31 acquires a front image from the front information acquisition unit 50 (step S2).

  Subsequently, the control unit 31 specifies a superimposition target of the route guidance image based on the route guidance information and the front image (step S3). Specifically, the control unit 31 specifies the shape and position coordinates of the front road from the front image by a known image analysis method such as a pattern matching method, and displays a route guidance image drawn based on the route guidance information. Determine the size. In addition, you may identify the front road which is a superimposition target of a route guidance image based on the traffic information acquired by V2I from the roadside infrastructure via the periphery information acquisition part 40. FIG. In addition, traffic information is not restricted to V2I, You may acquire by arbitrary communication (at least any one of V2N, V2V, and V2P) among V2X.

  Subsequently, the control unit 31 determines whether or not there is a caution factor regarding the driving of the vehicle 1 (step S4). The control unit 31 is based on traffic information and surrounding information acquired from the roadside infrastructure via the surrounding information acquisition unit 40 in any communication (at least one of V2I, V2N, V2V, and V2P) of V2X. It is determined whether or not there is. Note that the control unit 31 may specify the presence of the attention factor from the front image by an image analysis method such as a pattern matching method. The attention factors are, for example, the following (1) to (4).

(1) The traffic signal indicates a stop instruction (lighting color is red), or indicates a stop instruction within a predetermined time (lighting color is yellow).
(2) There are pedestrians and bicycles (hereinafter referred to as pedestrians) on the road, and pedestrians are about to jump out on the road. Also, pedestrians are crossing the road, and pedestrians are about to cross the road.
(3) There is an oncoming vehicle heading toward the vehicle 1.
(4) There is a vehicle or other obstacle (for example, an object such as a signboard or a fence related to road construction) parked or stopped on the planned travel route of the vehicle 1

  When it is determined in step S4 that there is no caution factor (step S4; No), the control unit 31 determines whether or not a later-described visually recognized flag is in an on state (step S5). The visually recognized flag is set to the on state by default at the start of the display control process, and the control unit 31 determines that the visually recognized flag is on during the initial process (step S5; Yes), and the process of step S6. Execute.

  In step S <b> 6, the control unit 31 causes the display unit 20 to display a route guidance image in the normal mode (first mode). Specifically, the control unit 31 causes the display unit 20 to display the route guidance image having the display size determined in step S3 according to the identified shape and position coordinates of the front road. As a result, a route guidance image that is visually recognized superimposed on the road ahead is displayed. For example, the control unit 31 provides route guidance based on data for generating a route guidance image according to the distance from the vehicle 1 to the road ahead and traffic information (data indicating a table, a mathematical expression, image parts, etc.). Perform image display control. The data may be stored in the ROM 32 in advance. The control part 31 performs again from the process of step S1 after execution of step S6.

FIG. 4A shows an example of the route guidance image G1 in the normal mode. The route guidance image G1 is an image that prompts a right turn at an intersection, and reaches a second road R2 after a right turn through the intersection from the first road R1 that is the traveling lane of the own vehicle 1 in the front road as a real scene. It is superimposed on the part.
In addition, the rectangular frame which the virtual image V has shown to Fig.4 (a) shows the display area of the virtual image V, and the route guidance image G1 is an image visually recognized as a virtual image in the said display area. This is synonymous with displaying the route guidance image G1 in the display area of the superimposed image on the display unit 20 that displays the superimposed image visually recognized by the driver D as the virtual image V. This correspondence is the same in FIGS. 5 and 6 described later.

  When it is determined in step S4 that there is a caution factor (step S4; Yes), the control unit 31 determines a caution calling part for calling out the caution factor based on the caution factor specified in step S4 (step S7). Subsequently, the control unit 31 causes the display unit 20 to display the determined alerting portion of the route guidance image in the alerting mode (second mode) changed to a mode different from the normal mode (step S8).

FIG. 4B shows an example of the route guidance image G2 in the alert mode. The route guidance image G2 is an image obtained by changing the attention calling portion W to a mode different from the normal mode. In this example, the attention calling portion W is represented by a broken line.
The warning part W in this example is, for example, (a) the lighting color of the traffic light installed at the intersection is red or yellow, and it is impossible or impossible to turn right from the intersection to the second road R2. (B) The oncoming vehicle of the host vehicle 1 exists in the intersection, or is approaching the intersection. (B) A pedestrian or the like exists on the pedestrian crossing C provided on the second road R2, or crosses. It functions as a part indicating that the person is heading to the sidewalk C. Therefore, such a warning part W includes the color of a traffic light specified based on traffic information obtainable by V2I, the behavior of an oncoming vehicle specified based on surrounding information obtainable by V2I or V2V, It is determined by the control unit 31 according to the behavior of a pedestrian or the like specified based on peripheral information that can be acquired by V2I or V2P.

  Note that the alerting portion W may be determined by the control unit 31 based on a front image that can be acquired from the front information acquisition unit 50 or a detection signal from a sonar, an ultrasonic sensor, or a millimeter wave radar. That is, the identification of the attention factor and the determination of the attention calling part W may be performed based on at least one of the information of the surrounding information acquisition unit 40 and the front information acquisition unit 50. However, since only the information from the front information acquisition unit 50 can specify only the attention factor in front of the host vehicle 1, the attention factor is specified based on at least the traffic information and the peripheral information acquired from the peripheral information acquisition unit 40. It is preferable to determine the attention calling portion W according to the specified attention factor. This is because there are caution factors (such as a vehicle overtaking the host vehicle 1 and a motorcycle running alongside the host vehicle 1) that are generated from the side or the rear of the host vehicle 1.

Subsequent to step S8, the control unit 31 acquires line-of-sight information indicating the line-of-sight direction of the driver D from the line-of-sight detection unit 60 (step S9), and determines whether or not an attention factor is visually recognized (step S10). .
Specifically, the control unit 31 determines that the attention factor is visually recognized when the visual recognition target of the driver D identified based on the line-of-sight information is the attention factor identified in step S4 as described above. To do. For example, if the attention factor is a traffic light, it is determined whether the driver D is viewing the traffic signal. If the attention factor is an oncoming vehicle, it is determined whether the driver D is viewing the oncoming vehicle. If is a pedestrian, it is determined whether the driver D is viewing the pedestrian.

  When it is determined that the driver D is visually recognizing the attention factor (step S10; Yes), the control unit 31 sets the visually recognized flag to the on state (step S11), and determines that the attention factor is not visually recognized. When it does (step S10; No), a visual recognition flag is cleared to an OFF state (step S12). The visually recognized flag is stored in a flag storage area in the RAM 33. After executing step S11 or S12, the control unit 31 executes again from the process of step S1.

When it is determined in step S4 that there is no caution factor (step S4; No), and in the subsequent step S5, it is determined that the visible flag is off (step S5; No), the control unit 31 executes a gradual change process. However, the route guidance image is set to the normal mode (step S6).
Thereby, when the attention factor is eliminated while displaying the route guidance image in the alert mode, the route guide image is gradually changed from the alert mode (second mode) to the normal mode (first mode). The By the gradual change process, for example, the route guidance image G2 shown in FIG. 4B is gradually changed to the route guidance image G1 shown in FIG. The gradual change process is a process of fading in the route guidance image in the normal mode while fading out the route guidance image in the alert mode. By doing so, a sudden change in the display mode of the route guidance image can be prevented, and the uncomfortable feeling given to the driver D can be reduced. In addition, the control part 31 sets a visual recognition flag to an ON state with execution of step S6 after execution of a gradual change process.

On the other hand, when it is determined in step S4 that there is no caution factor (step S4; No), and in the subsequent step S5, it is determined that the visually recognized flag is on (step S5; Yes), the control unit 31 immediately determines the route. The guidance image is set to the normal mode (step S6).
As a result, when the attention factor is resolved while displaying the route guidance image in the alert mode, and the driver D identifies that the driver has visually recognized the alert factor, the route guide image is displayed in the alert mode ( The second mode is immediately changed to the normal mode (first mode). In this way, it is possible to immediately confirm the route guidance based on the route guidance image displayed next without bothering the driver D who has already recognized the attention factor. The display control process described above is continuously executed until, for example, the HUD device 10 is turned off.

  Note that the route guidance image G2 in the alert mode is not limited to the example shown in FIG. 4B as long as the alert portion W is different from the normal mode, and various modes are applicable. From here, another display example of the route guidance image G2 in the alert mode will be described with reference to FIGS.

The alerting portion W in the route guidance image G2 in the alerting mode (second mode) may be different in color from before changing from the normal mode (first mode) to the alerting mode.
For example, when the route guidance image G1 in the normal mode shown in FIG. 4A is the first color (for example, green), the attention-calling portion of the route guidance image G2 in the warning mode shown in FIG. W may be a second color (for example, yellow) different from the first color. In this case, the color other than the alerting portion W in the route guidance image G2 in the alerting mode is the first color. Note that various colors can be applied to the first color and the second color as long as they are different from each other. For example, since a portion displayed in a direction different from the traveling direction of the host vehicle 1 (for example, a direction perpendicular to the traveling direction) is not conspicuous, the color is changed in this way when alerting the portion. The route guidance image G2 is effective.

As shown in FIG. 5 (b), the alerting portion W in the route guidance image G2 in the alerting mode (second mode) is wider than before changing from the normal mode (first mode) to the alerting mode. May be narrow.
According to this aspect, for example, it is easy to recognize a change in a portion displayed in the same direction as the traveling direction of the host vehicle 1. Of course, the alerting portion W may be expressed in a broken line shape different from the normal mode, or may have a color different from the normal mode, while narrowing the width in this way.

Further, when it is determined in step S4 that there are a plurality of attention factors, the control unit 31 displays a plurality of attention calling portions W1 and W2 corresponding to the respective attention factors in the normal mode (first mode) as shown in FIG. It is only necessary to display the alerting mode changed to a mode different from (1 mode) and to display each of the plurality of alerting portions W1 and W2 in a distinguishable manner.
FIG. 6 (a) shows that the alert portion W1 is (i) the lighting color of the traffic light installed at the intersection is red or yellow, and it is impossible or impossible to make a right turn from the intersection to the second road R2. (Ii) This is an example showing that an oncoming vehicle of the host vehicle 1 is present in an intersection or heading toward the intersection. Further, the alerting portion W2 is an example indicating that a pedestrian or the like is present on the pedestrian crossing C provided on the second road R2 or is heading toward the pedestrian crossing C. Further, as in the example shown in FIG. 6B, the alerting portions W1 and W2 are narrower than before being changed from the normal mode to the alert mode, and the broken lines are different from the normal mode. May be displayed in a manner distinguishable from each other. In this case, the control unit 31 may draw the attention drawing part W1 and the attention drawing part W2 with different colors or with different patterns (including solid images).

  In addition, this invention is not limited by the above embodiment, a modified example, and drawing. Changes (including deletion of components) can be made as appropriate without departing from the scope of the present invention.

  The projection target of the display light L is not limited to the windshield 3 but may be a combiner configured by a plate-shaped half mirror, a hologram element, or the like. Further, the display device that executes the above display control processing is not limited to the HUD device 10. The display device may be configured as a head mounted display (HMD) that is mounted on the head of the driver D of the vehicle 1. And in the image which HMD displays as a virtual image, you may perform display control of the route guidance images G1 and G2 by the method similar to the above-mentioned. That is, the display device is not limited to the one mounted on the vehicle 1 and may be any device used in the vehicle 1.

  In the above description, the route guidance images G1 and G2 urge the driver D to make a right turn of the vehicle 1. However, the route guidance images G1 and G2 may urge the driver D to go straight or turn left. Needless to say. In addition, the route guidance images G1 and G2 are not limited to the example described above as long as they can guide the travel route of the vehicle 1, and various shapes, sizes, colors, and the like can be applied. It is.

Further, the control unit 31 may display the route guidance images G1 and G2 on the display unit 20 in a manner having a depth. In this way, the appearance is the same as when viewing a real scene, so the display of the route guidance images G1 and G2 is good. For example, in order to display the route guidance images G1 and G2 with the depth, 3D image data is stored in the ROM 32 in advance, and the position of the front road that can be calculated from the data indicating the front image and traffic information The route guidance images G1 and G2 may be controlled to be drawn by a perspective method (for example, a one-point perspective method) based on the distance. Note that the route guidance images G1 and G2 do not have to be strictly drawn by using a perspective method, and may be any aspect that makes the driver D feel the depth.
Further, by arranging the display surface of the display unit 20 (an LCD display surface or a screen in the case of using DMD or LCOS) with an inclination, a virtual surface on which the virtual image V is displayed (on the display surface of the display unit 20). The depth may be given by setting the corresponding surface) to be tilted forward with respect to the vertical direction of the vehicle 1. Then, in consideration of the projection of the image desired to be viewed from the viewpoint of the driver D onto the virtual surface, the control unit 31 may perform drawing control of the route guidance images G1 and G2 with a depth. As the viewpoint position of the driver D, the control unit 31 may use an assumed viewpoint position stored in advance in the ROM 32, or may be appropriately specified based on detection data from a line-of-sight detection unit 60 (not shown).

The HUD device 10 (an example of a display device) described above displays a route guidance image that is visually recognized by the driver D (an example of a viewer) as a virtual image that overlaps the road ahead of the vehicle 1.
The HUD device 10 acquires the surrounding information of the vehicle 1 and determines whether or not there is a caution factor regarding the driving of the vehicle 1 based on the acquired surrounding information (for example, at least from the surrounding information acquisition unit 40 to the surroundings) A control unit 31 for acquiring information, and display control means (for example, a car navigation system) that acquires route guidance information for guiding a travel route of the vehicle 1 and performs display control of a route guidance image based on the acquired route guidance information. A control unit 31 that acquires route guidance information from the device 80 and a display unit 20).
When it is determined that there is no caution factor, the display control means displays the route guidance image as the route guidance image G1 in the normal mode (first mode). On the other hand, when it is determined that the attention factor is present, the route of the alerting mode (second mode) in which the alerting part W for calling the attention factor in the route guidance image is changed to a mode different from the normal mode. A guide image G2 is displayed.
Thus, when there is a caution factor, it is possible to alert the route guidance image G2, so that the travel route of the vehicle 1 can be safely guided.

  In the above description, in order to facilitate understanding of the present invention, descriptions of known technical matters are omitted as appropriate.

DESCRIPTION OF SYMBOLS 100 ... Display system for vehicles 10 ... HUD apparatus 20 ... Display part 30 ... Control apparatus 31 ... Control part (31a ... CPU, 31b ... GPU)
32 ... ROM, 33 ... RAM
40 ... Peripheral information acquisition unit 50 ... Forward information acquisition unit 60 ... Gaze detection unit 70 ... ECU
DESCRIPTION OF SYMBOLS 80 ... Car navigation (car navigation) apparatus 1 ... Vehicle, 2 ... Dashboard, 3 ... Windshield D ... Driver, E ... Eye box, L ... Display light V ... Virtual image G1 ... Route guidance of normal mode (1st mode) Image G2 ... Route guidance image in alerting mode (second mode) W, W1, W2 ... Alerting part R1 ... First road, R2 ... Second road, C ... Crosswalk

Claims (6)

A display device that displays a route guidance image visually recognized by a viewer as a virtual image overlapping a road ahead of a vehicle,
Determining means for acquiring surrounding information of the vehicle, and determining whether or not there is a caution factor regarding driving of the vehicle based on the acquired surrounding information;
Display control means for acquiring route guidance information for guiding a travel route of the vehicle, and performing display control of the route guidance image based on the acquired route guidance information;
The display control means includes
When it is determined that the attention factor does not exist, the route guidance image is displayed in the first mode,
When it is determined that the attention factor is present, the attention-calling part for calling the attention factor in the route guidance image is displayed in a second mode that is changed to a mode different from the first mode.
Display device. The warning part in the second aspect has a different color from that before the first aspect is changed to the second aspect.
The display device according to claim 1. The alerting portion in the second aspect is narrower than before being changed from the first aspect to the second aspect,
The display device according to claim 1. When it is determined that there are a plurality of the caution factors, the display control means displays the plurality of caution parts corresponding to each caution factor in the second mode changed to a mode different from the first mode. And displaying each of the plurality of alert portions in a distinguishable manner.
The display device according to claim 1. The display control means gradually changes the route guidance image from the second mode to the first mode when the attention factor is resolved while displaying the route guidance image of the second mode. ,
The display device according to claim 1. The display control means acquires line-of-sight information from line-of-sight detection means for detecting the line of sight of the viewer,
When the route factor image is displayed in the second mode and the attention factor is resolved, and the viewer is identified based on the line-of-sight information, the route guidance is displayed. Immediately changing the image from the second aspect to the first aspect;
The display device according to claim 1.