JP6504431B2 - IMAGE DISPLAY DEVICE, MOBILE OBJECT, IMAGE DISPLAY METHOD, AND PROGRAM - Google Patents

Description

The present invention relates to an image display equipment, mobile, and an image display side Ho及beauty program.

The image display equipment of this type, the vehicle that moves carrying the driver, a ship, a head-up display for displaying images for providing information aircraft, the driver of the moving body such as an industrial robot ( It is known that a HUD) device or the like is used.

  Patent Document 1 discloses a HUD device that projects an image light on a windshield or the like (light transmission member) and displays an image superimposed on a landscape in front of a driver of a vehicle (moving body) through the windshield. It is done. In this HUD device, a virtual image of a road image schematically representing a road is superimposed on an actual road in the front scenery, or a virtual image of a road sign image representing a road sign or the like near the virtual image of the road image is displayed. Display. And while expressing the road image by perspective, by gradually enlarging the road sign image as the car travels, the driver as if the road sign image is disposed at a specific point on the actual road Can be perceived.

  In recent years, a HUD device that displays an operation instruction image (virtual image) indicating the content of an operation instruction to the driver to a driver of a mobile body, for example, a route navigation image for guiding a route to a preset destination Has been proposed. In such a HUD device, there are cases where a plurality of operation instruction images indicating different operation instruction contents are displayed in a predetermined display area where a virtual image can be displayed. For example, when performing route guidance to turn left at a specific intersection after going straight through several intersections, an operation instruction image for letting the nearest intersection go straight and an operation instruction image for turning left at the specific intersection, It may be displayed at the same time in the display area. As described above, when a plurality of operation instruction images are displayed, it is desirable to avoid as much as possible a situation in which the driver loses the operation sequence of the operation content indicated by each operation instruction image.

  In addition, when displaying a plurality of operation instruction images indicating operation instruction contents different in timing to be operated, not only the route navigation image but providing the driver with a plurality of operation contents, It is desirable to avoid the situation where the driver loses the operation sequence.

In order to solve the problems described above, the present invention is a display that visually displays the moving speed information of the movable body to the driver via the light transmitting member that allows the driver to visually check the outside of the movable body. Means, and control means for causing the display means to display the moving speed information, wherein the control means causes the passive information to be displayed on the upper side of the moving speed information in visual observation from the driver; It is an image display device which is displayed on the upper side in visual observation from the driver as information whose operation order to be operated by the driver is later among the information.

According to the present invention, it is achieved several excellent effects that the operation sequence of the operation content indicated passive information is likely to avoid a situation that would lost the driver which is displayed by the display hand stage.

In embodiment, it is explanatory drawing which shows an example of the virtual image displayed on a display area in piles on the front scenery of the own vehicle seen from a driver | operator over a windshield. BRIEF DESCRIPTION OF THE DRAWINGS It is the model which represented typically the structure of the motor vehicle carrying the HUD apparatus for motor vehicles in embodiment. It is a schematic diagram which represented the internal configuration of the HUD device for the vehicles typically. It is a hardware block diagram of a control system in the HUD device for the same car. BRIEF DESCRIPTION OF THE DRAWINGS It is a block diagram which shows schematic structure of the driver | operator information provision system in embodiment. It is explanatory drawing which shows the hardware constitutions of the object recognition apparatus in the driver | operator information provision system. It is a hardware block diagram which shows the main hardware of the image control apparatus in the HUD apparatus for the said motor vehicles. It is an explanatory view for explaining an image processing method of a virtual image which gave a sense of depth by motion parallax in an embodiment. It is an explanatory view showing an example of a picture of a situation of changing course at a nearest intersection. (A)-(e) is explanatory drawing which shows the example 1 of an image from which the inter-vehicle distance presentation image changes according to the inter-vehicle distance with a leading vehicle. (A) And (b) is explanatory drawing which shows the example 2 of an image which the inter-vehicle distance presentation image changes according to the inter-vehicle distance with a leading vehicle. It is explanatory drawing which shows the image example 3 which displayed the attending school road warning image on the middle step display area, when the road which the own vehicle is drive | working is a attending school road. It is explanatory drawing which shows the image example 4 which displayed the humanoid warning image on the middle stage display area, when the person who is going to cross the pedestrian crossing in the advancing direction of the own vehicle is detected.

Hereinafter, an embodiment in which the present invention is applied to a driver information providing system including an automotive head-up display (HUD) device as an information providing device will be described.
FIG. 1 is an explanatory view showing an example of a virtual image G displayed on the display area 700 in a superimposed manner on the front scenery of the host vehicle 301 viewed from the driver 300 through the windshield 302.
FIG. 2 is a schematic view schematically showing the structure of a car equipped with the car HUD device according to the present embodiment.
FIG. 3 is a schematic view schematically showing an internal configuration of the automotive HUD device in the present embodiment.

  The automotive HUD device 200 in the present embodiment is installed, for example, in the dashboard of the host vehicle 301 which is a traveling body as a moving body. Projection light L, which is image light emitted from the automotive HUD device 200 in the dashboard, is reflected by the windshield 302 as a light transmitting member, and travels to the driver 300. Thus, the driver 300 can visually recognize a HUD display image such as a navigation image described later as a virtual image. A combiner as a light transmitting member may be installed on the inner wall surface of the windshield 302 so that the driver can visually recognize a virtual image by the projection light L reflected by the combiner.

  In the present embodiment, the optical system or the like of the automotive HUD device 200 is configured such that the distance from the driver 300 to the virtual image G is 5 m or more. The conventional and general automotive HUD device has a distance from the driver 300 to the virtual image G of about 2 m. The driver 300 usually looks at an infinity point ahead of the vehicle or looks at a leading vehicle several tens of meters ahead. When the driver 300 focusing on such a distant place tries to visually recognize the virtual image G 2 m ahead, since the focal length is largely different, it is necessary to move the lens of the eyeball to a large extent. Therefore, the focus adjustment time to focus on the virtual image G becomes long, and it takes time to recognize the content of the virtual image G, and there is a problem that the eye of the driver 300 is easily fatigued. In addition, it is difficult for the driver to notice the content of the virtual image G, and it is difficult to appropriately provide information to the driver by the virtual image G.

  As in the present embodiment, if the distance to the virtual image G is 5 m or more, the amount of moving the lens of the eyeball is reduced compared to the prior art, the focus adjustment time to the virtual image G is shortened, and the content of the virtual image G is recognized early As a result, it is possible to reduce fatigue of the driver's 300 eyes. Furthermore, the driver can easily notice the content of the virtual image G, and the virtual image G facilitates the appropriate provision of information to the driver.

  The automotive HUD device 200 includes red, green, and blue laser light sources 201R, 201G, and 201B in the HUD main body 230, collimator lenses 202, 203, and 204 provided for the respective laser light sources, and two dichroic mirrors 205. , A light amount adjustment unit 207, a light scanning device 208 as a light scanning means, a free curved surface mirror 209, a microlens array 210 as a light diverging member, and a projection mirror 211 as a light reflecting member. ing. In the light source unit 220 in the present embodiment, the laser light sources 201R, 201G, 201B, the collimator lenses 202, 203, 204, and the dichroic mirrors 205, 206 are unitized by an optical housing.

  As the laser light sources 201R, 201G, and 201B, LDs (semiconductor laser elements) can be used. The wavelength of the light beam emitted from the red laser light source 201R is, for example, 640 nm, the wavelength of the light beam emitted from the green laser light source 201G is, for example, 530 nm, and the wavelength of the light beam emitted from the blue laser light source 201B is, for example, 445 nm .

  The HUD device 200 for an automobile according to the present embodiment projects an intermediate image formed on the microlens array 210 onto the windshield 302 of the vehicle 301, thereby providing the driver 300 with a magnified image of the intermediate image. Make it visible. Laser beams of respective colors emitted from the laser light sources 201R, 201G, and 201B are collimated by the collimator lenses 202, 203, and 204, respectively, and are combined by two dichroic mirrors 205 and 206, respectively. The combined laser light is subjected to two-dimensional scanning by the mirror of the light scanning device 208 after the light quantity is adjusted by the light quantity adjustment unit 207. The scanning light L 'which has been two-dimensionally scanned by the light scanning device 208 is reflected by the free-form surface mirror 209 to be corrected for distortion, and then collected by the microlens array 210 to draw an intermediate image.

  In the present embodiment, the microlens array 210 is used as a light diverging member for individually diverging and emitting the light flux for each pixel (one point of the intermediate image) of the intermediate image, but another light diverging member is used May be Further, as a method of forming the intermediate image G ′, a method using a liquid crystal display (LCD) or a fluorescent display tube (VFD) may be used.

However, in order to display a large virtual image G with high luminance, a laser scanning method is preferable as in the present embodiment.
Further, in a method using a liquid crystal display (LCD) or a fluorescent display tube (VFD), light is slightly applied to a non-image portion in a display area where a virtual image G is displayed, and this is completely blocked. Is difficult. Therefore, there is a demerit that the visibility of the scenery in front of the own vehicle 301 through the non-image portion is bad. On the other hand, according to the laser scanning method as in the present embodiment, the non-image portion in the display area of the virtual image G is irradiated with light by turning off the laser light sources 201R, 201G, and 201B. Can be completely cut off. Therefore, the situation in which the visibility of the front scenery of the vehicle 301 through the non-image portion is reduced by the light emitted from the automotive HUD device 200 can be avoided, and the visibility of the front scenery is high.

  Furthermore, when the degree of warning is enhanced by gradually increasing the brightness of the warning image for giving a warning to the driver etc., only the brightness of the warning image among the various images displayed in the display area 700 Display control is required to gradually increase the The laser scanning method is also preferable in the case where display control is performed to partially increase the luminance of a partial image in the display area 700 as described above. In the method using a liquid crystal display (LCD) or a fluorescent display tube (VFD), the brightness of the images other than the warning image displayed in the display area 700 also increases, and the warning image and the other images are displayed. This is because the difference in luminance can not be broadened, and the effect of increasing the degree of the warning can not be sufficiently obtained by gradually increasing the luminance of the warning image.

  The optical scanning device 208 tilts the mirror in the main scanning direction and the sub scanning direction by a known actuator drive system such as MEMS (Micro Electro Mechanical Systems) to two-dimensionally scan (raster scan) laser light incident on the mirror. . The drive control of the mirror is performed in synchronization with the light emission timing of the laser light sources 201R, 201G, and 201B. The optical scanning device 208 is not limited to the configuration of the present embodiment, and may be configured by, for example, a mirror system including two mirrors that respectively swing or rotate around two axes orthogonal to each other.

FIG. 4 is a hardware block diagram of a control system in the automotive HUD device 200 of the present embodiment.
The control system of the automotive HUD device 200 mainly includes an FPGA 251, a CPU 252, a ROM 253, a RAM 254, an I / F 255, a bus line 256, an LD driver 257, and a MEMS controller 258. The FPGA 251 controls operation of the laser light sources 201R, 201G, and 201B of the light source unit 220 by the LD driver 257, and controls operation of the MEMS 208a of the light scanning device 208 by the MEMS controller 258. The CPU 252 controls each function of the automotive HUD device 200. The ROM 253 stores various programs such as an image processing program that the CPU 252 executes to control each function of the automotive HUD device 200. The RAM 254 is used as a work area of the CPU 252. The I / F 255 is an interface for communicating with an external controller or the like. For example, the object recognition apparatus 100, the vehicle navigation apparatus 400, various sensors 500, and the like described later via the CAN (Controller Area Network) of the own vehicle 301. Connected

FIG. 5 is a block diagram showing a schematic configuration of a driver information provision system in the present embodiment.
In the present embodiment, an object recognition device 100, a vehicle navigation device 400, a sensor device 500, and the like are provided as information acquisition means for acquiring driver provided information provided to the driver by the virtual image G. The automotive HUD device 200 in the present embodiment mainly includes a HUD main body 230 as an image light projection means and an image control device 250 as a display control means. Although the information acquisition means in the present embodiment is mounted on the own vehicle 301, using the information acquisition means installed outside the own vehicle 301, the information acquired by the information acquisition means is input via the communication means. It may be a configuration.

FIG. 6 is an explanatory view showing a hardware configuration of the object recognition apparatus 100 in the present embodiment.
The object recognition apparatus 100 according to the present embodiment exists in the imaging area based on the stereo camera unit 110 as an imaging unit that images the front area of the vehicle 301 as an imaging area, and the captured image data captured by the stereo camera unit 110 And an information processing unit 120 as an image processing unit that executes image processing for recognizing a predetermined recognition target object. Note that, instead of the stereo camera unit 110, a configuration in which a monocular camera as an imaging unit and a laser radar (millimeter wave radar) as a distance measuring unit may be adopted.

  The stereo camera unit 110 is configured by assembling in parallel two camera units of a first camera unit 110A for the left eye and a second camera unit 110B for the right eye. Each of the camera units 110A and 110B includes a lens 115, an image sensor 116, and a sensor controller 117. The image sensor 116 may be, for example, an image sensor configured of a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS). The sensor controller 117 performs exposure control of the image sensor 116, image reading control, communication with an external circuit, transmission control of image data, and the like. The stereo camera unit 110 is installed near the rearview mirror of the windshield 302 of the vehicle 301.

  The information processing unit 120 includes a data bus line 121, a serial bus line 122, a central processing unit (CPU) 123, a field-programmable gate array (FPGA) 124, a read only memory (ROM) 125, and a random access memory (RAM) 126. A serial IF (Interface) 127 and a data IF 128 are included.

  The stereo camera unit 110 is connected to the information processing unit 120 via the data bus line 121 and the serial bus line 122. The CPU 123 controls execution of control of each sensor controller 117 of the stereo camera unit 110, operation of the entire information processing unit 120, image processing and the like. The luminance image data of the image captured by the image sensor 116 of each of the camera units 110A and 110B is written to the RAM 126 of the information processing unit 120 via the data bus line 121. Sensor exposure value change control data, image read parameter change control data, various setting data, and the like from the CPU 123 or the FPGA 124 are transmitted and received via the serial bus line 122.

  The FPGA 124 performs processing requiring real-time processing on image data stored in the RAM 126, such as gamma correction, distortion correction (parallelization of left and right images), and parallax calculation by block matching to generate a parallax image. Rewrite to the RAM 18 The ROM 125 is a recognition program for recognizing predetermined objects such as three-dimensional objects such as vehicles and pedestrians, lane boundaries such as white lines on the road surface, and curbs and median separators present on the road surface side. Is stored. The recognition program is an example of an image processing program.

  The CPU 123 acquires CAN information such as the vehicle speed, acceleration, steering angle, yaw rate, etc. from the sensor device 500 via the data IF 128, for example, via the CAN of the host vehicle 301. Then, the CPU 123 executes image processing using the luminance image and the parallax image stored in the RAM 126 in accordance with the recognition program stored in the ROM 125, and recognizes the object to be recognized such as the leading vehicle 350 and the lane boundary, for example. I do.

  The recognition result data of the recognition target object is supplied to an external device such as the image control device 250 and the vehicle travel control unit via the serial IF 127, for example. The vehicle travel control unit performs brake control, speed control, steering control, etc. of the vehicle 301 using the recognition result data of the recognition object, and, for example, maintains the vehicle 301 so as to maintain a preset inter-vehicle distance. It realizes cruise control to make the leading vehicle automatically track, and automatic brake control to avoid and reduce a collision with an obstacle ahead.

  The vehicle navigation device 400 in the present embodiment can widely use a known vehicle navigation device mounted on a car or the like. Information necessary for generating a route navigation image to be displayed on the virtual image G is output from the vehicle navigation device 400, and this information is input to the image control device 250. For example, as shown in FIG. 1, the number of lanes (traveling lanes) of the road on which the vehicle 301 is traveling, the distance to the point where the course change (right turn, left turn, branch etc.) is to be made next An image showing information such as the direction to move is included. These pieces of information are input from the vehicle navigation device 400 to the image control device 250, and under the control of the image control device 250, the car HUD device 200 causes the travel lane indication image 711, the route designation image 721, and the remaining distance image. Navigation images such as 722 and intersection name images 723 are displayed in the upper display area A and the middle display area B of the display area 700.

  Further, in the image example shown in FIG. 1, an image indicating road specific information (road name, speed limit, etc.) is displayed in the lower display area C of the display area 700. The specific information of the road is also input from the vehicle navigation device 400 to the image control device 250. The image control device 250 causes the car HUD device 200 to display the road name display image 701, the speed limit display image 702, the overtaking prohibition display image 703, and the like corresponding to the road specific information in the lower display area C of the display area 700. .

  The sensor device 500 in the present embodiment is configured of one or more sensors for detecting various information indicating the behavior of the host vehicle 301, the state of the host vehicle 301, the situation around the host vehicle 301, and the like. The sensor device 500 outputs sensing information necessary to generate an image to be displayed as a virtual image G, and the sensing information is input to the image control device 250. For example, in the image example shown in FIG. 1, a vehicle speed display image 704 (a character image “83 km / h” in FIG. 1) indicating the vehicle speed of the own vehicle 301 is displayed in the lower display area C of the display area 700. Therefore, vehicle speed information included in CAN information of the own vehicle 301 is input from the sensor device 500 to the image control device 250, and a character image indicating the vehicle speed is displayed by the automotive HUD device 200 under control of the image control device 250. It is displayed in the lower display area C of 700.

  In addition to the sensor that detects the vehicle speed of the host vehicle 301, the sensor device 500 may, for example, other vehicles, pedestrians, buildings (guard rails, utility poles, etc.) that exist around (forward, side, rear) the host vehicle 301. Radar sensor and imaging device that detect the distance between the vehicle and sensors for detecting external environment information (such as outside temperature, brightness, weather, etc.) of the vehicle, driving operation of the driver 300 (brake scan, degree of accelerator opening, etc. Sensor for detecting the remaining amount of fuel in the fuel tank of the vehicle 301, and sensors for detecting the state of various in-vehicle devices such as an engine and a battery. When such information is detected by the sensor device 500 and sent to the image control device 250, the information can be displayed as the virtual image G by the automotive HUD device 200 and provided to the driver 300.

FIG. 7 is a hardware block diagram showing the main hardware of the image control device 250. As shown in FIG.
In the image control apparatus 250, the CPU 251, the RAM 252, the ROM 253, the input data IF 254, and the output data IF 255 are mutually connected by a data bus line. Various recognition result data output from the object recognition device 100, sensing information output from the sensor device 500, various information output from the vehicle navigation device 400, and the like are input to the input data IF 254. A control signal or the like of the automotive HUD device 200 is output from the output data IF 255. The CPU 251 executes various computer programs such as an information providing control program stored in the ROM 253 or the like to cause the image control apparatus 250 to perform various controls and various processes described later.

Next, the virtual image G displayed by the automotive HUD device 200 will be described.
In the vehicle HUD device 200 in the present embodiment, the driver provided information provided to the driver by the virtual image G may be any information as long as the information is useful for the driver. In the present embodiment, driver-provided information is roughly divided into passive information and active information. The passive information is information to be provided to the driver at the setting timing of the automotive HUD device 200, and for example, information having a certain relationship between the timing at which the information is provided and the content of the information Be On the other hand, active information is sufficient information if provided to the driver at the driver's desired timing, and for example, the relationship between the timing at which the information is provided and the content of the information is low or absent. Information.

  The passive information includes, for example, information related to safety during driving, route navigation information, and the like. Information related to safety during driving includes, for example, inter-vehicle distance information between the host vehicle 301 and the preceding vehicle 350 (inter-vehicle distance presentation image 712), emergency information related to driving (warning information or alert information, etc.) Etc. Further, the route navigation information is information for guiding a traveling route to a preset destination, and is provided to the driver by a known vehicle navigation device. As route navigation information, traveling lane instruction information (traveling lane instruction image 711) for instructing the traveling lane to be traveled at the nearest intersection, or the course change operation at the intersection or branch point for which the course should be changed next from straight ahead There is a course change operation instruction information to be instructed. More specifically, as route change operation instruction information, route specification information (route specification image 721) for performing route specification of which route should be taken at the intersection or the like, and the remainder to the intersection or the like for which the route change operation is performed. Distance information (remaining distance image 722), name information of the intersection etc. (intersection name image 723), etc. may be mentioned.

  The active information mainly includes information acquired by the driver at a timing desired by the driver, and is thus information that is continuously displayed for a long period of time or at all times. For example, information specific to the road on which the host vehicle 301 is traveling, vehicle speed information of the host vehicle 301 (vehicle speed display image 704), current time information, and the like can be given. As specific information of a road, for example, the road name information (road name display image 701), restriction content information such as the speed limit of the road (speed limit display image 702, overtaking prohibition display image 703), and others related to the road Information is useful to the driver.

  In this embodiment, the passive information and the active information roughly classified in this manner are displayed in the corresponding display areas in the display area 700 capable of displaying the virtual image G. Specifically, in the present embodiment, the display area 700 is vertically divided into three display areas, and in the upper display area A and the middle display area B among them, passive information images corresponding to passive information are displayed, In the lower display area C, an active information image corresponding to the active information is displayed. Although part of the active information image may be displayed in the upper display area A or the middle display area B, in this case, the visibility of the passive information image displayed in the upper display area A or the middle display area B Display the active information image to prioritize.

  The passive information according to the present embodiment includes operation instruction information indicating the content of an operation instruction to the driver 300, such as route navigation information. When providing such a driver's command information to the driver, the driver is usually caused to display not only the driver's command image showing the latest driver's command content but also the user's driver's command image showing the user's subsequent driver's command content. Is preferable in that it can eliminate the anxiety of the subject (anxiety due to the unknown operation to be performed after that). In the example shown in FIG. 1 as well, along with the travel lane indication image 711 indicating the travel lane to be traveled at the nearest intersection, the route change operation at the intersection or branch point to be changed next from straight ahead is instructed The course change operation instruction images 721, 722, 723 are displayed.

  As described above, when a plurality of operation instruction images having different operation orders, that is, the traveling lane instruction image 711 and the course change operation instruction images 721, 722, and 723 are displayed in the display area 700 at the same time, each operation instruction It is desirable to avoid, as much as possible, a situation in which the driver is lost in the operation sequence of the operation instruction content indicated by the image.

  Therefore, in the present embodiment, the image display control is performed such that the operation instruction image for which the driver operates the plurality of operation instruction images different in operation order is displayed on the upper side in the display area 700 as the operation instruction image is later. Is going. That is, course change operation instruction images 721, 722, and 723 whose operation order is later than the traveling lane instruction image 711 are displayed above the traveling lane instruction image 711. As a result, it is possible to avoid a situation in which the driver loses the operation order regarding the operation instruction content of the traveling lane instruction image 711 and the operation instruction content of the course change operation instruction images 721, 722, and 723. This is due to the following reason.

  The driver 300 who is driving usually has an idea of a distance that an object located in front of the traveling vehicle 301 approaches toward the current position with the passage of time. On the other hand, the driver 300 also has an idea of time that future events will approach toward the current time as time passes. An object existing ahead of the own vehicle 301 advancing is faster in time to reach the position of the own vehicle 301 as the distance to the own vehicle 301 is shorter, and as the distance to the own vehicle 301 is longer, the position of the own vehicle 301 The time to reach is slow. Therefore, an object far ahead from the traveling vehicle 301 has a high affinity for cognition with events in the far future, and an object located near the front of the traveling vehicle 301 is a near future event There is a high degree of cognitive affinity between

  An operation instruction image of a distant future (an operation instruction image showing the content of an operation instruction whose operation order will be later), in consideration of this affinity, so as to overlap with a position where an object far away from the traveling vehicle 301 is viewed. That is, course change operation instruction images 721, 722, and 723) are displayed, and the operation of the near future (including the present) is performed so as to overlap with the position where the object located near the front of the own vehicle 301 advancing is viewed. If an instruction image (an operation instruction image indicating the operation instruction content whose operation order comes first, ie, the travel lane instruction image 711) is displayed, the driver can intuitively recognize the operation order of these operation instruction contents Can.

  Here, as described above, the driver 300 while driving is usually gazing at the infinity point ahead of the host vehicle or gazing at the back of the leading vehicle 350 traveling a few tens of meters ahead. And its gaze point is approximately near the vertical center of the front view seen from the windshield 302. In the present embodiment, the display area 700 where the traveling lane indication image 711 and the course change operation indication images 721, 722, and 723 having different operation orders are displayed is positioned under the front scenery seen from the windshield 302. . Therefore, the travel lane instruction image 711 and the course change operation instruction images 721, 722, and 723 are displayed on the lower side than the gaze point of the driver 300 so as to overlap with the front scenery. The forward landscape part below the gaze point of the driver 300 is viewed from above as objects farther from the host vehicle 301 and as viewed from below as objects closer to the host vehicle 301.

  Therefore, in the present embodiment, course change operation instruction images 721, 722, and 723 whose operation order is later than the travel lane instruction image 711 are displayed above the travel lane instruction image 711. Specifically, route change operation instruction images 721, 722, and 723 whose operation order is to be displayed are displayed in the upper display area A of the display area 700 overlapping the view position of an object far away from the host vehicle 301 moving forward. In the middle display area B of the display area 700 overlapping the visual recognition position of the object located near the front of the advancing vehicle 301, a traveling lane indication image 711 whose operation order comes first is displayed. Thus, the driver can intuitively recognize the operation order of these operation instruction contents from the high level of cognitive affinity described above, and the situation where the driver loses the operation order can be avoided. be able to.

  Conversely, for example, the display positions of the traveling lane instruction image 711 and the course change operation instruction images 721, 722, and 723 may be upside down from the present embodiment without considering the affinity of this recognition. When the driver is placed side by side, it is difficult for the driver to intuitively recognize the operation sequence, as the distance idea and the time idea described above interfere.

  In addition, in the present embodiment, a plurality of operation instruction images related to operation instruction contents having the same operation order are arranged side by side using this cognitive affinity. Specifically, with regard to the three course change operation instruction images 721, 722, and 723 displayed in the upper display area A, the course change operation at the intersection or branch point where the course should be changed next from the straight ahead direction Since the route change operation instruction information to be instructed is shown, it is arranged side by side in the upper display area A. According to the idea of the distance and the idea of time described above, the three course change operation instruction images 721, 722, and 723 arranged side by side at the same vertical position are information related to the operation instruction content at the same time. Easy to recognize intuitively. Therefore, the information of course change operation instruction images 721, 722, and 723 can be appropriately recognized.

  Further, in the present embodiment, a stereoscopic image represented using stereoscopic vision is used as the virtual image G displayed in the display area 700. Specifically, as the inter-vehicle distance presentation image 712 and the travel lane instruction image 711 displayed in the middle display area B of the display area 700, a perspective image represented by perspective is used.

  Specifically, the perspective of the inter-vehicle distance presentation image 712 drawn toward a vanishing point is set so that the lengths of the five horizontal lines constituting the inter-vehicle distance presentation image 712 become shorter toward the upper side. It is a legal image. In particular, in the present embodiment, since the inter-vehicle distance presentation image 712 is displayed such that the vanishing point is determined near the driver's gaze point, the driver 300 while driving perceives a sense of depth in the inter-vehicle distance presentation image 712 It is easy to do. Further, in the present embodiment, a perspective image is obtained in which the width of the horizontal line is further reduced toward the upper side, or the luminance of the horizontal line is decreased toward the upper side. As a result, the driver 300 while driving can more easily perceive the sense of depth of the inter-vehicle distance presentation image 712. At this time, in the case of the laser scanning method, since the light of the non-image part can be completely blocked as described above, the driver can easily perceive the sense of depth compared to other methods.

  By giving a sense of depth to the virtual image G displayed in the display area 700 using such a stereoscopic image, the vertical direction position of the image displayed in the display area 700 and the distance to the object in the front landscape It makes it easier for the driver to perceive the relevancy. As a result, the above-described cognitive affinity is more easily obtained, and the operation instruction content of the travel lane instruction image 711 displayed in the middle display area B of the display area 700 is in the upper display area A of the display area 700. The driver can easily intuitively recognize that the content is to be operated prior to the route change operation instruction images 721, 722, 723 displayed.

  Further, as with the inter-vehicle distance presentation image 712, the traveling lane indication image 711 is also drawn by perspective so that the same point as the vanishing point of the inter-vehicle distance presentation image 712 becomes the vanishing point. However, the travel lane instruction image 711 has an aspect of providing the driver with the content of the operation instruction. Therefore, in the case where it is prioritized that the operation instruction content of the traveling lane instruction image 711 is more clearly provided to the driver than giving a sense of depth, for example, three of the traveling lane instruction image 711 are configured. The arrow image may be made to be brighter toward the tip of the arrow. The laser scanning method makes it easy to adjust the brightness of each image area as compared with other methods, and therefore, the contrast between the low and high brightness areas can be largely increased. Therefore, as described above, it is effective in the case where the brightness of the tip of the arrow is increased to clearly provide information to the driver. In this case, the traveling lane indication image 711 has a lower luminance as it goes upward, so it is easier to give a sense of depth if the luminance is lowered as it goes upward, so the sense of depth can not be improved, but the arrow tip By increasing the brightness of the arrow, the visibility of the direction of the arrow is enhanced, and the operation instruction content of the traveling lane instruction image 711 can be provided to the driver more clearly. Even in this case, the travel lane indication image 711 is drawn by perspective, so that the sense of depth is not greatly impaired.

  Further, in the present embodiment, in order to provide a sense of depth, the virtual image G is a motion parallax image represented by motion parallax. Motion parallax means parallax caused by movement of the eye position (viewpoint) of the driver 300. When the eye position of the driver 300 moves, the sense of depth due to motion parallax moves larger as the closer object in the scenery in front, and the distance between the distant object becomes smaller. It perceives the distance to each object (feeling of depth).

  In the present embodiment, as shown in FIG. 2, a driver camera 150 for observing the position (viewpoint) of the driver's 300 eye is installed near the rearview mirror of the windshield 302 of the vehicle 301. The installation position of the driver camera 150 is preferably close to the midline of the driver 300 who sits in the driver's seat in order to accurately acquire the vertical and horizontal movements of the driver 300. However, it is preferable to arrange, for example, at the upper position so as not to block the view of the driver 300.

  The driver camera 150 is a monocular camera set so as to capture an area where the driver 300 sitting in the driver's seat is supposed to move the head during driving as an imaging area, and each of the stereo camera units 110 Like the camera units 110A and 110B, the camera unit 110A includes a lens, an image sensor, a sensor controller, and the like. A stereo camera may be used as the driver camera 150, and the position in the front-rear direction of the driver's eyes may also be grasped.

  The luminance image data of the captured image captured by the driver camera 150 is input to the image control device 250. The image control device 250 recognizes the position of the driver's 300 eye based on the luminance image data from the driver camera 150 by the CPU 251 executing the information providing control program stored in the ROM 253 or the like. In the present embodiment, the head position of the driver 300 is simply recognized based on the luminance image data from the driver camera 150, and the eye position of the driver 300 is estimated from the recognition result. As a method of recognizing the head position of the driver 300, a general recognition processing method can be widely adopted.

FIG. 8 is an explanatory view for explaining an image processing method of a virtual image G which gives a sense of depth by motion parallax in the present embodiment.
As shown in FIG. 8, when the head of the driver 300 moves by Dd, the visible position of the object Oa located at a distance La close to the driver 300 moves by Da, and the position is a distance Lb far from the driver 300 The visual position of the object Ob moves by Db less than Da, and the visual position of the object Oc located at a distance Lc farther from the driver 300 moves by Dc smaller than Db. Due to the difference in movement amounts Da, Db and Dc of the visual recognition position among these objects Oa, Ob and Oc, the driver 300 exists at a position where the object Oa is separated by the distance La and the object Ob is separated by the distance Lb It can be perceived that the object Oc is present at a position, and is present at a position separated by a distance Lc.

  The virtual image G in the present embodiment is displayed at a distance of 5 m from the driver 300, and any image portion on the virtual image G is displayed at a distance of 5 m from the driver 300. In the present embodiment, by using the motion parallax described above, the driver 300 is made to perceive as if a plurality of image portions on the virtual image G are displayed at different distances from one another.

  Specifically, the image control device 250 recognizes the head position of the driver 300 based on luminance image data of a captured image captured by the driver camera 150 at predetermined time intervals. Then, the image control device 250 calculates the driver's head movement amount Dd in which the driver's 300 head moves during the time interval. At this time, the visual recognition position of the virtual image G displayed at the distance 5 m is moved by Da.

  In the present embodiment, the display position in the display area 700 of the image portion displayed in the lower display area C is fixed. Therefore, the visual recognition position of the image portion displayed in the lower display area C moves by the same movement amount Da as the movement amount of the virtual image G. Thus, the image portion displayed in the lower display area C is perceived by the driver 300 as being displayed at the distance La (5 m).

  On the other hand, the image control device 250 controls the driver in the display area 700 for the image portion displayed in the middle display area B of the display area 700 of the virtual image G according to the calculated driver's head movement amount Dd. The head is moved by Da-Db in the direction opposite to the head movement direction of. As a result, for the image portion displayed in the middle display area B, the visual recognition position viewed from the driver 300 moves by the movement amount Db. As a result, the image portion displayed in the middle display area B is perceived by the driver 300 as being displayed at the distance Lb.

  Similarly, the image control device 250 drives the inside of the display area 700 for the image portion displayed in the upper display area A of the display area 700 of the virtual image G according to the calculated driver's head movement amount Dd. The head is moved by Da-Dc in the direction opposite to the head movement direction of the person. As a result, for the image portion displayed in the upper display area A, the visual recognition position viewed from the driver 300 moves by the movement amount Dc. As a result, the image portion displayed in the upper display area A is perceived by the driver 300 as displayed in the distance Lc.

  As described above, the virtual image G is projected while controlling the movement amounts Db and Dc of the visual recognition position of the image portion displayed in the upper display area A and the middle display area B according to the driver's head movement amount Dd. Thus, the driver 300 can display an image portion of the middle display area B (travel lane instruction) at a position farther than the image portion of the lower display area C (the road name display image 701, the speed limit display image 702, the overtaking prohibition display image 703, etc.). Image 711, inter-vehicle distance presentation image 712, etc.) is displayed, and the image portion of the upper display area A (course change operation instruction images 721, 722, 723, etc.) is displayed at a position further away than the image portion of middle display area B. Perception as you are. As described above, since the driver 300 can perceive image portions on the virtual image G displayed at the same distance as if they are displayed at different distances, a sense of depth of the virtual image G can be obtained.

  Particularly, in the present embodiment, the image portion of the middle display area B is divided into a plurality of parts in the vertical direction, and the movement amount is made different for each division according to the driver head movement amount Dd. It is perceived that the image part located at is displayed as far as possible. As a result of using not only the perspective expression but also the motion parallax with regard to the inter-vehicle distance presentation image 712 and the travel lane instruction image 711 displayed in the middle display area B, this makes it possible to further make the inter-depth interval.

FIG. 9 is an explanatory view showing an image example of a situation in which the course is changed at the nearest intersection.
When it becomes the situation of changing course at the nearest intersection, the example image shown in FIG. 1 is switched to the example image shown in FIG. That is, instead of the travel lane indication image 711 displayed in the middle display area B, the course designation image 717 similar to the course specification image 721 displayed in the upper display area A in the image example shown in FIG. Display in display area B. This is because the operation instruction content after the latest is the latest operation instruction. Thereby, the driver 300 can recognize that the driver may operate in accordance with the content of the operation instruction of the route specification image 721 displayed in the middle display area B at the next intersection or branch point.

  Further, in the image example shown in FIG. 9, the driver 300 is displayed on the route specification image 717 displayed in the middle display region B at the position of the route specification image 721 displayed in the upper display region A in the image example shown in FIG. A downward mark image 725 for guiding the gaze of the subject is displayed. This makes it easier for the driver 300 to recognize the route specification image 717 displayed in the middle display area B.

Next, display control of the inter-vehicle distance presentation image 712 that causes the inter-vehicle distance to the preceding vehicle 350 to be recognized will be described.
In the present embodiment, the inter-vehicle distance to the preceding vehicle 350 is recognized by the object recognition device 100 and the sensor device 500. Then, the image control device 250 receives the recognition result data (forward interval information), and changes the brightness, color, image shape, etc. of the inter-vehicle distance presentation image 712 displayed in the middle display area B based on the recognition result data. Execute image display control. In the present embodiment, the change in the inter-vehicle distance presentation image 712 notifies the driver 300 who visually recognizes this to what extent the inter-vehicle distance with the leading vehicle 350 is narrowed.

[Image example 1]
FIGS. 10A to 10E are explanatory diagrams showing an example of an image in which the inter-vehicle distance presentation image 712 changes in accordance with the inter-vehicle distance from the leading vehicle 350 (hereinafter, this image example is referred to as “image example 1”). It is.
In the first image example, the destination is not set in the vehicle navigation device 400, and the operation instruction image according to the route navigation information is not displayed, but even when the operation instruction image according to the route navigation information is displayed And so on.

  In the first image example, when the leading vehicle 350 is not recognized, the image control device 250 has a shorter length and lower luminance in the middle display area B, as shown in FIG. 10A. An overall low brightness inter-vehicle distance presentation image 712 consisting of five horizontal lines is displayed. At this time, nothing is displayed in the upper display area A.

  Further, when the leading vehicle 350 is recognized and the inter-vehicle distance to the leading vehicle 350 is open enough to exceed the predetermined safe distance range, the image control device 250 sets the middle position as shown in FIG. 10B. Display control is performed to increase the brightness of the inter-vehicle distance presentation image 712 displayed in the display area B. Furthermore, in the first image example, the vehicle bumper image 712a is obtained by increasing the thickness of the line instead of the horizontal line image at the bottom of the inter-vehicle distance presentation image 712 and extending the both ends downward and outward. Implement display control to change the shape. The own vehicle bumper image reminds the driver 300 of the front bumper of the own vehicle 301. Further, in the first image example, a low-luminance leading vehicle image 724 imitating a vehicle rear surface is further displayed in the upper display area A.

  When the leading vehicle 350 is recognized and the distance between the leading vehicle 350 and the leading vehicle 350 is within the predetermined safe distance range, the image control device 250 displays in the middle display area B as shown in FIG. Display control is performed to increase the luminance of the displayed inter-vehicle distance presentation image 712 and the luminance of the preceding vehicle image 724 displayed in the upper display area A more than in the case of FIG. Furthermore, in the first image example, display control is also performed to change the second horizontal line image from the bottom to the vehicle bumper image 712a. Thus, the vehicle bumper image 712a is closer to the preceding vehicle image 724 than in the case of FIG. 10 (b), and the driver 300 is compared with the vehicle ahead 301 in the case of FIG. 10 (b). It can be made to recognize that it has approached 350.

  When the leading vehicle 350 is recognized and the distance between the leading vehicle 350 and the leading vehicle 350 is closer than a predetermined safe distance range, but is longer than a predetermined required brake distance, the image control device 250 displays FIG. As shown in FIG. 10, the brightness of the inter-vehicle distance presentation image 712 displayed in the middle display area B and the brightness of the leading vehicle image 724 displayed in the upper display area A are the image example of FIG. Implement more display control than you do. Furthermore, in the first image example, display control is also performed to change the third horizontal line image from the bottom to the vehicle bumper image 712a. As a result, the vehicle bumper image 712a is closer to the preceding vehicle image 724 than in the case of FIG. 10C, and the driver's vehicle 301 is ahead of the case of FIG. 10C with respect to the driver 300. It can be recognized that the vehicle 350 is further approached.

  Further, when the leading vehicle 350 is recognized and the inter-vehicle distance with the leading vehicle 350 is narrowed to within the predetermined required brake distance range, the image control device 250 displays the middle display area B as shown in FIG. Display control is performed to change the inter-vehicle distance presentation image 712 displayed in the inside to a brake warning image 714 in which a character image of "brake!" Is drawn in a red trapezoidal shape. At this time, by lowering the luminance of the leading vehicle image 724 displayed in the upper display area A or stopping the image filling, the visibility of the leading vehicle image 724 is lowered, whereby the brake warning image 714 is further enhanced. It is preferable to make it stand out. The preceding vehicle image 724 in the upper display area A may be hidden so that the brake warning image is noticeable. At this time, in the case of the laser scanning method, since the light of the non-image portion can be completely blocked, the brake warning image can be made more noticeable, and the warning effect can be enhanced.

  The predetermined safety distance and the predetermined brake required distance described above may be a predetermined fixed distance, or may be a distance that fluctuates according to the vehicle speed of the host vehicle 301 or the like.

[Image example 2]
As an expression method for making the driver 300 notice that the inter-vehicle distance with the leading vehicle 350 is narrowed, the present invention is not limited to the above-described first image example. For example, an image example as shown in FIGS. 11 (a) and 11 (b) (Hereinafter, the present image example is referred to as “image example 2”).

  The second image example is also an image example in which the inter-vehicle distance presentation image changes in accordance with the inter-vehicle distance from the leading vehicle 350, as in the image example 1 shown in FIGS. 10 (a) to 10 (e). More specifically, the inter-vehicle distance presentation image 715 of the second image example is a trapezoidal image drawn by a perspective drawing toward the vanishing point instead of the five horizontal lines of the inter-vehicle distance presentation image 712 in the above-described image example 1 The one divided into four in the vertical direction is used. In the first image example described above, the second vehicle 350 and the second image example move in the same manner as the vehicle bumper image 712a moves upward so as to approach the preceding vehicle image 724 as the distance to the preceding vehicle 350 decreases. The high-brightness trapezoidal section 715a moves upward to approach the leading vehicle image 724 as the distance of The image in FIG. 11A corresponds to the image shown in FIG. 10D, and the leading vehicle 350 is recognized, and the distance between the leading vehicle 350 and the leading vehicle 350 is closer than a predetermined safe distance range. Is an example where the distance is longer than the predetermined required brake distance.

  Here, in the second image example, the destination is set in the vehicle navigation device 400, and the operation instruction image according to the route navigation information is displayed. Therefore, in a situation where the leading vehicle 350 is not recognized, a route designation image 721 is displayed near the center in the left-right direction (near the vanishing point) of the upper display area A as shown in FIG. The distance image 722 and the intersection etc name image 723 are displayed respectively.

  Under such circumstances, when the leading vehicle 350 is recognized and the leading vehicle image 724 is displayed in the upper display area A, the route change operation instruction images 721, 722, and 723 are all hidden from the upper display area A. Is also conceivable. However, in this case, the operation instruction content (the operation instruction content after the operation sequence) by the route change operation instruction images 721, 722, and 723 is not provided to the driver 300, which may cause the driver 300 to feel uneasy.

  On the other hand, when moving the course change operation instruction images 721, 722, and 723 displayed in the upper display area A to a display area different from the upper display area A and continuing the display, the driver moves the For example, it takes time to search for the course change operation instruction images 721, 722, and 723. Therefore, there is a possibility that the operation instruction content by the course change operation instruction images 721, 722, and 723 can not be provided appropriately to the driver 300.

  According to the second image example, even when the leading vehicle image 724 is displayed in the upper display area A in which the course change operation instruction images 721, 722, and 723 are displayed, the course change operation instruction images 721, 722, and 723 are displayed. Keep displaying in the upper display area A. Therefore, even when the leading vehicle image 724 is displayed in the upper display area A, the operation instruction content by the route change operation instruction images 721, 722, and 723 can be accurately provided to the driver 300.

  When the leading vehicle image 724 is displayed in the upper display area A in which the course change operation instruction images 721, 722, and 723 are displayed, all of the course change operation instruction images 721, 722, and 723 are in the upper display area A. It is not necessary to display the image continuously, for example, only the intersection etc. name image 723 may be hidden.

  Further, in the second image example, when the inter-vehicle distance with the leading vehicle 350 approaches within the predetermined required brake distance range, the image control device 250, as shown in FIG. A brake warning image 716 across the display area B is displayed. The brake warning image 716 is a combination of a red image obtained by enlarging the preceding vehicle image 724 displayed in the upper display area A and an image obtained by displaying all trapezoidal sections of the inter-vehicle distance presentation image 715 of the present image example 2 in red. It is Moreover, in the second image example, in order to make the brake warning image 716 more noticeable, all of the route change operation instruction images 721, 722, and 723 are not displayed.

[Image example 3]
In addition, of the information related to prohibition, restriction, and designation of traffic on the road on which the vehicle 301 is traveling, information particularly preferred to be provided to the driver 300 is displayed in the middle display area B as a warning image. You may For example, as shown in the image example shown in FIG. 12 (hereinafter, this image example is referred to as “image example 3”), if the road on which the host vehicle 301 is traveling is a attending school, The warning image 718 is displayed in the middle display area B. Specifically, the image control device 250 acquires the specific information of the road on which the vehicle 301 is traveling from the various information and the like output from the vehicle navigation device 400, and the acquired road specific information is in the middle display area B. When the target information is to be displayed on the display control unit 10, display control is performed to display a warning image corresponding to the road specific information in the middle display area B.

  As described above, the middle display area B is an area where the operation instruction image indicating the content of the operation instruction to be operated first among the plurality of operation instruction contents is displayed. Therefore, by displaying a warning image in the middle display area B as in the third image example, the driver prohibits, restricts, or designates traffic on the road on which the vehicle 301 is currently traveling by the warning image. You can intuitively recognize that you are done.

[Image example 4]
In addition, when a person who is trying to cross a pedestrian crossing in the traveling direction of the vehicle 301 is detected, the warning image may be displayed in the middle display area B. Humans are one of the most important targets for vehicles, and they are the ones that should be dealt with immediately. For example, a human-type warning image 719 is displayed in the middle display area B as in an image example shown in FIG. 13 (hereinafter, this image example is referred to as “image example 4”). Specifically, the image control device 250 recognizes a person in front of the own vehicle by the object recognition device 100 and the sensor device 500. Then, the image control device 250 receives the recognition result data, and performs display control for displaying the humanoid warning image 719 in the middle display area B based on the recognition result data. In the fourth image example, the attending school road warning image 718 in the third image example described above is also displayed. In addition, when the information provision apparatus of this embodiment is mounted, for example in ships other than a vehicle, it can replace with a human and can display other ships etc. of the circumference of the own ship.

The above-described one is an example, and each mode has the unique effect.
(Aspect A)
A predetermined display area 700 ahead of the moving object traveling direction in which the driver visually recognizes the operation instruction image indicating the content of the operation instruction to the driver 300 of the moving object such as the own vehicle 301 via the light transmitting member such as the windshield 302 An information providing apparatus such as an automotive HUD device 200 equipped with image light projecting means such as a HUD main body 230 projecting image light to the light transmitting member so as to be displayed on the inside, each indicating different operation instruction contents Within the predetermined display area 700, the display order of the operation instruction for which the driver has to operate the operation lane images for driving the vehicle such as the travel lane instruction image 711 and the course change operation instruction images 721, 722, 723, etc. And display control means such as an image control device 250 for controlling the image light projection means to be displayed on the upper side of the display.
The driver usually thinks of a distance that an object located in front of a moving object approaches toward the current position with the passage of time, and future events approach the current time with the passage of time It combines with the idea of time. And, the time to reach the position of the moving body is quicker as the distance to the moving body is shorter, and the distance to the moving body is faster to reach the position of the moving body. Time is late. Therefore, an object located far from the moving object has high affinity for cognition with events in the far future, and an object located near to the moving object has cognitive affinity between the near future event. Is high. According to this aspect, in consideration of the affinity, the operation instruction image indicating the content of the operation instruction to be performed later by the driver is displayed on the upper side in the predetermined display area, so that these operations It is easy to make the driver intuitively recognize the operation order of the plurality of operation instruction contents indicated by the instruction image, and to avoid the situation where the driver loses the operation order.

(Aspect B)
In the aspect A, the image light projection unit is configured such that the predetermined display area is positioned below the landscape in front of the moving object traveling direction viewed by the driver via the light transmission member. It is characterized in that the image light is projected.
Usually, the driver 300 who visually recognizes the front scenery in the moving object traveling direction via the light transmission member often performs driving while gazing at a vicinity of the vertical center of the scenery in front of the front scenery as a fixation point. In this aspect, since the predetermined display area 700 in which the plurality of operation instruction images are displayed is located at the lower part of the front landscape, the plurality of operation instruction images are displayed vertically below the driver's gaze point It will be done. A landscape portion in which a plurality of operation instruction images displayed at this position overlap is visually recognized at the upper side in the vertical direction as an object farther from the moving body, and is visually recognized at the lower side in the vertical direction as the object closer to the moving body. Therefore, the position at which the object in the landscape part is visually recognized is gradually displaced downward as the moving object approaches the moving object.
When a plurality of operation instruction images are superimposed and displayed on such a landscape portion, as in the present aspect, the operation instruction image indicating the content of the operation instruction to be operated later by the driver is in the predetermined display area The display on the upper side can minimize the driver's confusion regarding the operation sequence. This is an operation instruction image showing the operation instruction content (operation instruction content to which the operation order will be later) which is distant so as to be superimposed on the position where the object distant from the moving object is viewed in consideration of the affinity of recognition described above. Can be displayed, and an operation instruction image can be displayed that indicates the near future operation instruction content (the operation instruction content for which the operation order comes first) so as to overlap the position where the object closer to the moving object is viewed. is there. If displayed in this manner, the driver can intuitively recognize the operation order of the plurality of operation instruction contents indicated by the operation instruction images. Conversely, when the predetermined display area 700 is located at the lower part of the front scenery, for example, the display positions of the plurality of operation instruction images are reversed from the above positions, or the display of the plurality of operation instruction images is performed. When the positions are arranged side by side, it is difficult for the driver to intuitively recognize the operation order, which is disturbed by the above-mentioned idea.

(Aspect C)
In the aspect A or B, the display control means controls the image light projection means to display the plurality of operation instruction images in the predetermined display area with a stereoscopic image represented using stereoscopic vision. It is characterized by
According to this, even when the plurality of operation instruction images are displayed at the same distance from the driver, the driver is made to perceive that the plurality of operation instruction images are displayed at different distance points. Can. Therefore, the driver can intuitively recognize the operation order of the plurality of operation instruction contents indicated by these operation instruction images.

(Aspect D)
The aspect C is characterized in that the stereoscopic image includes a perspective image represented by perspective.
According to this, it is possible to cause the driver to perceive in a simple manner that a plurality of operation instruction images are displayed at points of different distances. In addition, in the perspective referred to here, for example, a line perspective using the fact that things toward the distance are seen toward the vanishing point, an air perspective using the fact that things that are far in the atmosphere look blurry, etc. There is.

(Aspect E)
The aspect D is characterized in that the perspective image is an image drawn by perspective with a vanishing point being determined in the vicinity of the gaze point of the driver 300.
According to this, it is possible to cause the driver to perceive in a simple manner that a plurality of operation instruction images are displayed at points of different distances.

(Aspect F)
In any one of the above aspects C to E, the stereoscopic image includes a motion parallax image represented by motion parallax.
According to this, it can be made easy for the driver to perceive as a plurality of operation instruction images are displayed at points of different distances.

(Aspect G)
In any one of the modes A to F, the image light projection unit is configured to display the operation instruction image as the virtual image G in the predetermined display area 700 by the image light to be projected, from the driver 300 The distance to the virtual image G is 5 m or more.
As mentioned above, the driver often drives while focusing at a distance. If the distance from the driver to the virtual image G is 5 m or more, the amount of movement of the eye lens is smaller than in the case of 2 m, which is a conventional general distance. As a result, the focus adjustment time to the virtual image G can be shortened, the operation instruction content of the operation instruction image by the virtual image G can be recognized early, and fatigue of the driver's eye can be reduced. Furthermore, since the driver can easily notice the operation instruction image, it becomes easy to appropriately provide the driver with the operation instruction content of the operation instruction image.

(Aspect H)
In any one of the above aspects A to G, the image light projection unit scans the image light irradiated from the light irradiation unit such as the light source unit 220 that emits the image light corresponding to the image information of the operation instruction image. It is characterized in that the operation instruction image is displayed in the predetermined display area 700 by performing two-dimensional scanning by light scanning means such as the device 208 and projecting the light to the light transmitting member.
As described above, it is easier to display a large virtual image G with high luminance than a method using a liquid crystal display (LCD), a fluorescent display (VFD) or the like. Further, according to this aspect, with respect to the non-image portion of the virtual image G, it is possible to completely eliminate the light of the non-image portion by not irradiating the image light from the light irradiating means. Therefore, the situation in which the visibility of the front of the moving body through the non-image portion is reduced by the light emitted from the light irradiating means can be avoided, and the visibility of the front landscape is high.

(Aspect I)
In any one of the modes A to H, the plurality of operation instruction images are different points on the moving route of the moving body (the nearest intersection and the intersection or branch point to be changed next in the straight direction) In the above, the content of the operation instruction for instructing the operation content to be operated by the driver is shown.
According to this, it is possible to avoid a situation in which the driver loses the operation order of a plurality of operation instruction contents different in the operation order by the route navigation information.

(Aspect J)
An operation instruction image indicating the content of the operation instruction to the driver of the moving object is displayed in a predetermined display area located below the landscape in front of the moving object traveling direction viewed by the driver via the light transmitting member, An information providing method for providing information of the operation instruction content to the driver by projecting image light onto the light transmitting member such that the driver can visually recognize the scenery through a non-image portion in the display area And a plurality of operation instruction images indicating different operation instruction contents are displayed on the upper side in the predetermined display area so as to indicate the operation instruction contents for which the operation order for the driver is to be performed later. I assume.
According to this, in consideration of the above-mentioned cognitive affinity, the operation instruction image indicating the content of the operation instruction to be operated later by the driver is displayed on the upper side in the predetermined display area, It is easy to make the driver intuitively recognize the operation order of the plurality of operation instruction contents indicated by the operation instruction image, and to avoid the situation where the driver loses the operation order.

(Aspect K)
An operation instruction image indicating the content of the operation instruction to the driver of the moving object is displayed in a predetermined display area located below the landscape in front of the moving object traveling direction viewed by the driver via the light transmitting member, Information for causing a computer of an information providing apparatus having image light projection means to project image light onto the light transmission member so that a driver can view the scenery through a non-image part in the display area It is a control program for provision, and a plurality of operation instruction images showing different operation instruction contents are displayed on the upper side in the predetermined display area so as to indicate the operation instruction contents for which the operation sequence for operating the driver is later The computer is caused to function as display control means for controlling the image light projection means as described above.
According to this, in consideration of the above-mentioned cognitive affinity, the operation instruction image indicating the content of the operation instruction to be operated later by the driver is displayed on the upper side in the predetermined display area, It is easy to make the driver intuitively recognize the operation order of the plurality of operation instruction contents indicated by the operation instruction image, and to avoid the situation where the driver loses the operation order.

  The program can be distributed or obtained in the state of being recorded on a recording medium such as a CD-ROM. This program can also be distributed and obtained by distributing or receiving a signal transmitted by a predetermined transmission device via a transmission medium such as a public telephone line, a dedicated line, or another communication network. Is possible. At the time of this distribution, at least a part of the computer program may be transmitted in the transmission medium. That is, all the data making up the computer program need not be present on the transmission medium at one time. The signal carrying the program is a computer data signal embodied on a predetermined carrier including a computer program. In addition, the transmission method of transmitting a computer program from a predetermined transmission apparatus includes the case of continuously transmitting data constituting the program and the case of intermittently transmitting data.

DESCRIPTION OF SYMBOLS 100 Object recognition apparatus 110 Stereo camera part 120 Information processing part 150 Driver camera 200 HUD device 201R, 201G, 201B for motor vehicles Laser light source 207 Light quantity adjustment part 208 Optical scanning device 209 Free-form surface mirror 210 Micro lens array 211 Projection mirror 220 Light source unit 230 HUD main body 250 image control device 300 driver 301 own vehicle 302 windshield 350 leading vehicle 400 vehicle navigation device 500 sensor device 700 display area 701 road name display image 702 speed limit display image 703 overtaking prohibition display image 704 vehicle speed display image 711 Lane instruction image 712, 715 inter-vehicle distance presentation image 712a own vehicle bumper image 714, 716 brake warning image 718 school attending route warning image 719 human type warning image 717, 7 21 Route designation image 722 Remaining distance image 723 Name image of intersection etc. 724 Preceding vehicle image 725 Downward marking image A Upper display area B Middle display area C Lower display area G Virtual image

JP, 2010-96874, A

Claims (16)

Display means for visually displaying the moving speed information of the movable body to the driver via the light transmitting member that allows the driver to visually check the outside of the movable body;
Control means for displaying the moving speed information on the display means;
The control means causes the driver to display passive information on the upper side of the moving speed information as viewed from the driver, and of the passive information, the more the operation sequence to be operated by the driver is from the driver Display on the upper side in
Image display device. The image display device according to claim 1, wherein the passive information is information presented to a driver at a predetermined timing. The passive information is route navigation information.
The image display apparatus according to any one of claims 1 and 2. The passive information is information related to safety during operation,
The image display apparatus according to any one of claims 1 and 2. The information related to safety during driving is inter-vehicle distance information,
The image display device according to claim 4. The route navigation information is travel route information to a destination,
The image display device according to claim 3. The route navigation information is traveling lane information to be traveled at the nearest intersection.
The image display device according to claim 3. When displaying the route navigation information as the passive information:
The control means displays operation instruction information after the latest operation instruction information on the upper side when viewed by the driver.
The image display device according to claim 3. When displaying route navigation information as the passive information, it becomes necessary to display information related to safety during driving,
The control means hides the route navigation information and displays information related to safety during the driving.
The image display apparatus according to any one of claims 1 and 2. 10. The image display apparatus according to claim 9, wherein the information related to safety during driving is brake warning information. The control means displays road specific information on the lower side in visual observation from the driver than the passive information.
The image display apparatus according to any one of claims 1 to 10. The image display device according to claim 11, wherein the road specific information is speed limit information. The image display device according to claim 11, wherein the road specific information is a road name. A light transmitting member that allows the driver to visually check the outside of the moving body;
Display means for visually displaying the moving speed information of the movable body on the driver via the light transmitting member;
Control means for displaying the moving speed information on the display means;
The control means causes the driver to display passive information on the upper side of the moving speed information as viewed from the driver, and of the passive information, the more the operation sequence to be operated by the driver is from the driver Display on the upper side in
Moving body. It is an image display method for displaying the moving speed information of the moving body visibly to the driver via a light transmitting member which allows the driver to visually check the outside of the moving body,
The passive information is displayed on the upper side in visual observation from the driver than the moving speed information, and the information in which the operation sequence for the driver to operate among the passive information is later on the upper side in visual observation from the driver Display method, image display method. The program is read by control means for controlling display means for visually displaying the moving speed information of the moving body via the light transmitting member which allows the driver to visually check the outside of the moving body,
The passive information is displayed on the upper side in visual observation from the driver than the moving speed information, and the information in which the operation sequence for the driver to operate among the passive information is later on the upper side in visual observation from the driver A program operating the control means to display.