JP6938696B2 - Virtual image display program, virtual image display system and virtual image display method - Google Patents

Description

The present invention relates to a virtual image display program, a virtual image display system, and a virtual image display method for displaying an image in a virtual space on a display.

A virtual reality game is known in which an image of a virtual space is displayed and played on a head-mounted display (hereinafter, HMD) mounted on a player's head (see, for example, Patent Document 1). The HMD is provided with, for example, a gyro sensor or the like, and can detect the movement of the player's head. When the player moves the head, the HMD follows the movement of the head to change the image displayed on the display. In this way, the game image follows the movement of the head, so that the player can further concentrate his / her consciousness on the game. In other words, it is possible to increase the immersive feeling in the game.

Japanese Unexamined Patent Publication No. 7-200162

In the virtual reality game as well, as in other games, information such as displaying hints for the progress of the game and displaying menu items may be provided. However, when the information provision execution button is displayed together with the image of the virtual space, the immersive feeling in the virtual space is greatly impaired. It should be noted that these problems are generally common not only in virtual reality games but also in technologies for displaying images in virtual space on a display.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide information while suppressing loss of immersive feeling in a virtual space.

A virtual image display program that solves the above problems is a virtual image display program for displaying an image on the display by using a control unit, a detection device for specifying the orientation of the player's head, and a display. The control unit is used as a specific unit for specifying an object corresponding to a gaze position based on the orientation of the head, and the object when the gaze time associated with the gaze position reaches a predetermined time. Is made to function as a selection unit in which is selected, and an output control unit that outputs provided information to the display when the gaze position moves to a predetermined area other than the object.

Regarding the virtual image display program, the output control unit provides the above when the elapsed time from the start of the application reaches a certain time and the gaze position moves the object to the predetermined area where the object cannot be selected. It is preferable to output the information to the display.

Regarding the virtual image display program, when the output control unit reaches a certain time elapsed without selecting the object and the gaze position moves the object to the predetermined area where the object cannot be selected. It is preferable to output the provided information to the display.

Regarding the virtual image display program, it is preferable that the output control unit resets the elapsed time when the selection of the object is completed.

In the virtual image display program, when an object corresponding to the gaze position is specified, it is preferable to superimpose the gaze time information indicating the gaze time on the object and display it.

Regarding the virtual image display program, it is preferable that the output control unit displays the provided information on an object in the virtual space.
Regarding the virtual image display program, it is preferable that the output control unit displays the provided information in the moving direction of a moving object that is an object in the virtual space and moves in the virtual space.

A virtual image display system that solves the above problems is a virtual image display system for displaying an image on the display by using a control unit, a detection device for specifying the orientation of the player's head, and a display. Then, when the specific unit that specifies the object corresponding to the gaze position based on the orientation of the head and the gaze time associated with the gaze position reaches a predetermined time, the object is selected. It includes a selection unit and an output control unit that outputs provided information to the display when the gaze position moves to a predetermined area other than the object.
The virtual image display method for solving the above problem is a virtual image display method for displaying an image on the display by using a control unit, a detection device for specifying the orientation of the player's head, and a display. When the control unit reaches a specific step of specifying an object corresponding to the gaze position based on the orientation of the head and the gaze time associated with the gaze position reaches a predetermined time, the object Is executed, and an output control step of outputting provided information to the display when the gaze position moves to a predetermined area other than the object is executed.

According to the present invention, information can be provided while suppressing loss of immersive feeling.

The schematic diagram explaining the structure of the system of 1st Embodiment. The conceptual diagram which shows the game possible area of the virtual space of 1st Embodiment. The flowchart which shows the procedure of the game progress processing of 1st Embodiment. The flowchart which shows the procedure of the information provision processing of 1st to 4th Embodiment. The schematic diagram which shows the image displayed on the display of 1st Embodiment. FIG. 6 is a schematic view showing a state in which hints are displayed, which is an image displayed on the display of the first embodiment. In the image displayed on the display of the second embodiment, (a) shows a state in which the target object is gazed, and (b) is a figure showing a state in which a hint is displayed.

(First Embodiment)
Hereinafter, the first embodiment of the virtual image display program, the virtual image display device, and the virtual image display method will be described. In the present embodiment, the virtual image display device is embodied as a game processing device that advances the game while displaying an image of the virtual space. In this game, it is premised that the player wears a head-mounted display (HMD) on the head.

The configuration of the system including the HMD 10 and the game processing device 20 will be described with reference to FIG. First, the configuration of the HMD 10 connected to the game processing device 20 will be described. The HMD 10 includes an HMD control unit 11, a sensor 12 as a detection device, and an input / output interface unit (I / F unit) 13. The HMD control unit 11 outputs various information to the game processing device 20 via the input / output I / F unit 13, and inputs various information from the game processing device 20. The sensor 12 corresponds to a detection device for identifying the position and orientation of the player's head. The sensor 12 includes at least one sensor such as a gyro sensor, an acceleration sensor, and a geomagnetic sensor, and detects the movement of the player's head. As another embodiment, a sensor 12 may be used as a sensor 12 that directly detects the movement of the player's eyeball, for example, a line-of-sight detection sensor that injects near infrared rays into the iris and detects the reflected light. .. Here, in the present embodiment, the head of the player corresponds to a predetermined part of the body of the player of the present invention.

Further, the HMD 10 includes a display 14 for displaying an image and a speaker 15 for outputting sound. For example, the display 14 displays an image visually recognized by the left eye and an image visually recognized by the right eye with parallax. As a result, the player can visually recognize a three-dimensional image with a sense of depth. The HMD control unit 11 displays an image corresponding to the image signal received from the game processing device 20 on the display 14 via the input / output I / F unit 13. The speaker 15 is a headphone or the like, and outputs sound effects, voices explaining the progress of the game, and the like.

Next, the configuration of the game processing device 20 will be described. The game processing device 20 includes a control unit 21, a storage unit 22, and an input / output unit 23. The control unit 21 is composed of hardware elements such as a CPU, RAM, and ROM. Further, the control unit 21 includes a gaze position specifying unit 24, a game management unit 25, a spatial image output unit 26, and an information providing unit 27. In the present embodiment, the control unit 21 functions as a gaze position specifying unit 24, a game management unit 25, a spatial image output unit 26, and an information providing unit 27 by causing a hardware element to execute a virtual image display program.

The storage unit 22 stores virtual space image information 30, object information 31, provision condition information 32, gaze position information 33, gaze time information 34, and provision information 35.
The virtual space image information 30 is data for drawing an image of a background or an object in the virtual space. Objects include target objects that are selectable objects and non-selectable objects. The target object can be selected by the player continuously gazing for a predetermined time.

The object information 31 is information indicating the attributes of the object. Specifically, the object information 31 includes an identifier of the object, coordinates of the object in the virtual space, the type of the object, and the selected state of the object. The object type is information indicating whether the object is a target object or another object. The selection state of an object is information indicating whether or not the object is selected when it is the target object.

The provision condition information 32 is information that defines information provision conditions that are conditions for providing information to the player. In the present embodiment, the provision condition information 32 is set to information that defines that the gaze position of the player is outside the game-enabled area set in the virtual space when the elapsed time from the start of the game is a certain time or more. It will be described by way of example. The gameable area is an area in which the player can select a target object by gazing, and includes all target objects. For example, the provision condition information 32 includes the coordinate information of the gameable area. Further, when the information provision condition is satisfied, the player is provided with a hint regarding the progress of the game.

The gaze position information 33 is information indicating the gaze position of the specified player in the coordinates of the virtual space. The gaze time information 34 is information indicating the time during which the player continues to gaze at the target object. The provided information 35 includes information indicating the content of hints for clearing the mission of the game.

The gaze position specifying unit 24 inputs the detection signal of the sensor 12 from the HMD control unit 11 of the HMD 10 mounted on the player via the input / output unit 23. Further, the gaze position specifying unit 24 specifies the gaze position according to the input detection signal with the coordinates of the virtual space, and updates the gaze position information 33 based on the specified gaze position.

The game management unit 25 compares the gaze position information 33 with the object information 31 and determines whether or not the gaze position is on the target object. When the game management unit 25 determines that the gaze position is on the target object, the game management unit 25 measures the time during which the player continues to gaze at the target object (gaze time), and obtains the gaze time information 34 based on the gaze time. Update. Further, the game management unit 25 determines whether or not the gaze time indicated by the gaze time information 34 has reached a predetermined time (for example, 3 seconds), and when the gaze time information 34 reaches the predetermined time, the target object is selected. Is judged to be completed.

In addition, the game management unit 25 determines whether or not the mission of the game has been completed. For example, the game management unit 25 determines that the mission is cleared on the condition that there are a predetermined number of objects for which selection has been completed within the time limit of the game. The game management unit 25 determines that the game is over when the elapsed time from the start of the game reaches the time limit without the predetermined number of target objects for which the selection has been completed exist.

Further, the game management unit 25 determines whether or not the information provision condition is satisfied based on the provision condition information 32. In the present embodiment, as the information provision condition, it is used that the elapsed time from the start of the game exceeds a certain time and the gaze position of the player is outside the game playable area. The fixed time is set, for example, by a predetermined time such that the remaining time until the time limit is short, an average time required for the player to clear the mission, or the like. When the game management unit 25 determines that the information provision condition is satisfied, the game management unit 25 outputs an output request for the provision information 35 to the information provision unit 27.

Further, the game management unit 25 extracts voice information such as sound effects and voices explaining the progress of the game from the voice information storage unit (not shown) and transmits the sound information to the HMD 10 via the input / output unit 23.

The spatial image output unit 26 extracts the virtual spatial image information 30 in the visual field range centered on the coordinates indicated by the gaze position information 33, and transmits the virtual spatial image information 30 as an image signal to the HMD 10. Further, the spatial image output unit 26 displays a character corresponding to the player in the virtual space. Further, when the game management unit 25 determines that the target object has been selected, the spatial image output unit 26 changes the display mode of the selected target object.

When the information providing unit 27 inputs the hint display request output from the game management unit 25, the information providing unit 27 reads out the provided information 35. Then, the display corresponding to the provided information 35 is output to the display 14 and displayed on the virtual space image.

Next, the object selection function by the game processing device 20 will be described with reference to FIG.
The gaze position specifying unit 24 inputs the detection signal of the sensor 12 from the HMD 10 and specifies the position and orientation of the head of the player 101 according to the detection signal. Specifically, the gaze position specifying unit 24 sets the position and orientation of the head to the X-axis along the horizontal direction and the pitch θp indicating the rotation direction centered on the X-axis, and the Y-axis and Y along the vertical direction. It is calculated as the yaw θy indicating the rotation direction centered on the axis, the Z axis along the depth direction, the position of the roll θr indicating the rotation direction centered on the Z axis in the three axial directions, and the angle around each axis.

The gaze position specifying unit 24 identifies the gaze position P1 of the player 101 in the virtual space based on the calculated position and orientation of the head. A known method can be used as the method for specifying the gaze position. For example, the gaze position specifying unit 24 virtually sets a straight line connecting the left eye position and the right eye position, extends in a direction orthogonal to the straight line, and passes through the midpoint between the left eye position and the right eye position in the line-of-sight direction D1. And. Further, the gaze position specifying unit 24 specifies the intersection of the line-of-sight direction D1 and the object 102 (or the background) as the gaze position P1. When a sensor 12 that detects the movement of the eyeball or detects the reflected light from within the iris is used, the line-of-sight direction is specified based on the movement of the eyeball and the reflected light.

In addition, a game-enabled area 105 is provided in the virtual space. The gameable area 105 is set around the character corresponding to the player. Since the gameable area 105 includes all the target objects 103, the gaze position P1 is located in the gameable area 105 when the target object 103 is selected by gaze.

The spatial image output unit 26 extracts the virtual space image information 30 in the visual field range centered on the gaze position, and transmits the virtual space image information 30 as an image signal to the HMD control unit 11. The HMD control unit 11 outputs an image corresponding to the received virtual space image information 30 to the display 14.

(Game progress processing)
Next, the game progress process will be described with reference to FIG. The end condition of this process is that either the mission clear condition is satisfied or the elapsed time from the start of the game reaches the time limit. This process is repeated until the end condition is satisfied. The elapsed time is measured by the game management unit 25 based on the system time or the like using the clock signal of the CPU or the like until the game is completed.

When the game is started, the control unit 21 identifies the gaze position of the player (step S1). Specifically, the gaze position specifying unit 24 of the control unit 21 specifies the gaze position of the player by the method described above, and updates the gaze position information 33 according to the specified gaze position.

The control unit 21 uses the gaze position information 33 to determine whether or not the selection of the target object is completed (step S2). Specifically, the game management unit 25 of the control unit 21 reads the object information 31 and the gaze position information 33 of the target object from the storage unit 22, compares the coordinates of the target object with the gaze position, and targets the gaze position. Determine if it exists on the object.

When the gaze position exists on the target object, the game management unit 25 measures the gaze time using the system time or the like, and updates the gaze time information 34 according to the measured gaze time. When the gaze time reaches a predetermined time, the game management unit 25 determines that the selection is completed.

When the gaze position is outside the target object before the gaze time reaches the predetermined time, the game management unit 25 determines that the selection of the target object has not been completed (in the case of "NO" in step S2). , The gaze time is reset, and the process returns to step S1.

When the game management unit 25 determines that the selection of the target object is completed (when “YES” in step S2), the game management unit 25 updates the selection status of the object information 31 to “selection completed” and proceeds to step S3. At this time, the spatial image output unit 26 changes the display mode of the target object for which the selection has been completed.

When the selection of the target object is completed, the control unit 21 determines whether or not the mission clear condition is satisfied (step S3). Specifically, the game management unit 25 of the control unit 21 refers to the selection status of the object information 31 and determines whether or not there are a predetermined number of objects for which selection has been completed within the time limit of the game. ..

When the number of target objects for which selection has been completed is equal to or greater than a predetermined number, the control unit 21 determines that the mission clear condition has been satisfied (when “YES” in step S3). In this case, since the end condition of the game progress process is satisfied, the game ends.

When the number of target objects for which selection has been completed is less than a predetermined number, the control unit 21 determines that the mission clear condition is not satisfied (when “NO” in step S3), and returns to step S1. Specifically, when the game management unit 25 of the control unit 21 determines that the mission clear condition is not satisfied, the gaze position is specified in step S1.

(Information provision processing)
Next, with reference to FIG. 4, the processing procedure of the information providing process will be described. In the present embodiment, this process is a process executed in parallel with the game progress process.

The end condition of this process is that either the mission clear condition is satisfied or the elapsed time measured from the start of the game has reached the time limit before the mission is cleared. This process is repeated until the end condition is satisfied.

The control unit 21 of the game processing device 20 determines whether or not the information provision condition is satisfied (step S10). Specifically, the game management unit 25 of the control unit 21 determines whether or not the elapsed time has reached a certain time and the gaze position is outside the game-enabled area.

For this purpose, the game management unit 25 acquires the elapsed time and determines whether or not the elapsed time has reached a certain time. When it is determined that the elapsed time has reached a certain time, the game management unit 25 reads the gaze position information 33 and the provision condition information 32 from the storage unit 22, and determines whether or not the gaze position is outside the gameable area. .. When it is determined that the gaze position is outside the game-enabled area, the game management unit 25 assumes that the information provision condition is satisfied.

When it is determined that the information provision condition is satisfied (when "YES" in step S10), the control unit 21 executes information provision (step S11). Specifically, the game management unit 25 of the control unit 21 outputs an information provision request to the information providing unit 27. In response to the information provision request, the information providing unit 27 reads the provided information 35 from the storage unit 22 and outputs it to the HMD 10.

On the other hand, when the information provision condition is not satisfied (“NO” in step S10), the control unit 21 repeats the determination of whether or not the information provision condition is satisfied (step S10).
Note that this information providing process may be linked with the game progress process. For example, when the selection of the target object is completed in the game progress process (when "YES" in step S2), when it is determined that the mission clear condition is satisfied (when "YES" in step S3), and the like, information is provided. The elapsed time measured to make the offer may be reset. Alternatively, based on the determination of the completion of selection of the target object in the information providing process (step S2), instead of the elapsed time from the start of the game, the time when no target object is selected from the start of the game is used, and the time is constant. The information provision condition may be that the time is reached and the gaze position is outside the gameable area.

(Display image)
Next, an image displayed on the display 14 of the HMD 10 while the game is in progress will be described with reference to FIGS. 5 and 6. The virtual space images shown in FIGS. 5 and 6 are schematically shown regardless of the visual field range of the HMD 10.

As shown in FIG. 5, the display 14 of the HMD 10 displays a virtual space image 110 centered on the gaze position, which is an image based on the virtual space image information 30. Of the virtual space image 110, the target object 103 is displayed in the gameable area 105. An object 106 other than the target object 103 may be displayed in the gameable area 105.

As shown in FIG. 6, when the gaze position is outside the game-enabled area 105, the information providing display 111 is output so as to be superimposed on the virtual space image 110 outside the game-enabled area 105. The information provision display 111 displays the content of the hint based on the provision information 35. Since the information providing display 111 is displayed so as to be superimposed on the virtual space image 110 outside the gameable area, the information providing display 111 does not overlap with the target object. Therefore, information can be provided so as not to interfere with the selection of the target object. Further, since the information provision display 111 is not displayed until the elapsed time exceeds a certain time, it is possible to suppress giving the player annoyance due to frequent information provision.

In FIG. 6, a moving body 112, which is a bird moving outside the gameable area 105, is displayed so as to hold an information providing display 111 on which hints are written. That is, the information providing display 111 moves according to the moving speed and moving direction of the moving body 112. The moving body 112 and the information providing display 111 are drawn as objects existing in the virtual space in a state where image attributes such as brightness and color tone are matched with the virtual space image. By having the object in the virtual space hold the information provision display 111 in this way, it is possible to provide information without impairing the immersive feeling in the virtual space.

In this way, when the gaze position is outside the gameable area, it is determined that the target object is not smoothly selected, and the information provision display 111 is displayed. Therefore, information can be provided at an appropriate timing for the player. Further, by providing information based on the movement of the gaze position in this way, it is possible to omit the execution button and the like for providing information. Therefore, it is possible to suppress the loss of immersive feeling in the virtual space.

As described above, according to the first embodiment, the effects listed below can be obtained.
(1) In the first embodiment, the information provision is executed on the condition that the movement of the gaze position of the player matches the information provision condition, so that it is necessary to display the information provision execution button on the image of the virtual space. No. Therefore, it is possible to provide information while suppressing the loss of immersive feeling in the virtual space.

(2) In the first embodiment, the information provision is executed when the gaze position of the player deviates from the gameable area including all the target objects. That is, since the information can be provided when the selection of the target object is interrupted, for example, when the player is uncertain about the progress of the game, the information can be provided at an appropriate timing.

(3) In the first embodiment, a hint is displayed on an object (moving body) that moves in the virtual space. Since the player pays attention to what is moving, the player can pay attention to the hint in a natural form.

(Second Embodiment)
Next, a second embodiment of the virtual image display program, the virtual image display device, and the virtual image display method will be described with reference to FIGS. 4 and 7. Since the second embodiment has a configuration in which a part of the information providing process of the first embodiment is changed, the same reference numerals are given to the same parts and detailed description thereof will be omitted.

In the first embodiment, the information provision condition is that the player stops the gaze without completing the selection of the target object, and the gaze position is out of the gameable area after the gaze is stopped. Different from the embodiment.

The information providing process will be described with reference to FIG. The end condition of this process is that either the mission clear condition is satisfied or the elapsed time measured from the start of the game has reached the time limit before the mission is cleared. This process is repeated until the end condition is satisfied.

The control unit 21 of the game processing device 20 determines whether or not the information provision condition is satisfied (step S10). Specifically, the game management unit 25 of the control unit 21 reads the gaze position information 33 and the object information 31 from the storage unit 22 and determines whether or not the gaze position is on the target object. When the gaze position is other than the target object, the game management unit 25 determines that the information provision condition is not satisfied (when “NO” in step S10), and repeats the determination in step S10.

When it is determined that the player has gazed at the target object, the game management unit 25 acquires the gaze time, and whether or not the gaze position is out of the gameable area before the gaze time reaches a predetermined time for selecting the target object. To judge. When the gaze position is on the target object, the game management unit 25 determines that the information provision condition is not satisfied (when “NO” in step S10), and repeats the determination in step S10.

On the other hand, the game management unit 25 provides information when the gaze position is outside the game-enabled area before the gaze time of the target object reaches a predetermined time (step S11).
An image displayed on the display 14 of the HMD 10 while the game is in progress will be described with reference to FIG. 7. The virtual space image shown in FIG. 7 is schematically shown regardless of the visual field range of the HMD 10.

As shown in FIG. 7A, when the player gazes at the target object 103 displayed on the virtual space image 110, the spatial image output unit 26 displays the gauge 120 superimposed on the target object 103. The gauge 120 displays the passage of time from the start of gaze to the time when a predetermined time is reached.

As shown in FIG. 7B, when the gaze position of the target object 103 is outside the gameable area 105, the information provision display 111 is output.
In FIG. 7B, the information providing display 111 is displayed in the moving direction of the bird, which is the moving body 112. The player is more likely to pay attention to the moving object 112 than the stationary object. Therefore, by displaying the information providing display 111 ahead of the moving direction of the moving body 112, the player can easily notice the information providing display 111. Further, since the information providing display 111 is displayed in a stationary state, it is possible for the player to easily confirm the contents of the information providing display 111.

As described above, in the present embodiment, as the information provision condition, the player stops the gaze without completing the selection of the target object, and the gaze position is out of the gameable area after the gaze is stopped. The operation of is specified. Therefore, the situation of the player can be determined more accurately in consideration of a plurality of actions.

As described above, according to the second embodiment, in addition to the effects described in the first embodiment, the effects listed below can be obtained.
(4) In the second embodiment, the information provision condition is that the gaze position of the player moves outside the target object and outside the gameable area without completing the selection of the target object. As a result, information can be provided when the target object cannot be selected, so that information can be provided at an appropriate timing.

(5) In the second embodiment, the information providing display 111 is output in the moving direction of the moving body 112 which is an object in the virtual space and moves in the virtual space such as a bird. As a result, the information provision can be output without impairing the immersive feeling in the virtual space.

(Third Embodiment)
Next, a third embodiment of the virtual image display program, the virtual image display device, and the virtual image display method will be described with reference to FIG. Since the third embodiment has a configuration in which a part of the information providing process of the first embodiment is changed, the same reference numerals are given to the same parts and detailed description thereof will be omitted.

In the present embodiment, the information provision condition is that the range of movement of the predetermined part of the player's body is outside the range of the standard movement of the predetermined part of the body when the target object is selected before the mission is cleared. This is different from the first embodiment. The predetermined part of the player's body is the head. The standard range of head movement when selecting a target object is predetermined. In this embodiment, the gameable area may not be set.

The range of movement of the player's head indicates the range of movement of the head from the time the game is started. Further, the range of movement of the player's head is defined as, for example, a range of pitch θp, yaw θy, and roll θr indicating angular coordinates. The predetermined range of head movement is recorded in the storage unit 22 in a state of being included in the provision condition information 32, for example.

If the range of movement of the player's head is narrower than the defined reference range, the range of gaze of the player may be too narrow. On the other hand, when the range of movement of the player's head is wider than the specified reference range, the mission cannot be cleared even though the range of the player's gaze is sufficiently wide, and the player is required to clear the mission. It is possible that the player does not know the operation method or the player cannot find the target object. In this way, when the range of movement of the player's head is too narrow or too wide, a hint about the progress of the game is provided to encourage the mission to be cleared.

The information providing process will be described with reference to FIG. The end condition of this process is that either the mission clear condition is satisfied or the elapsed time measured from the start of the game has reached the time limit before the mission is cleared. This process is repeated until the end condition is satisfied.

The control unit 21 of the game processing device 20 determines whether or not the information provision condition is satisfied (step S10). Specifically, the game management unit 25 of the control unit 21 calculates the range of movement of the player's head. In this embodiment, it is assumed that the history of the movement of the player's head from the start of the game is accumulated. Further, the game management unit 25 reads out the provision condition information 32 and determines whether or not the range of movement of the player's head is outside the reference range included in the provision condition information 32. For example, as the reference range included in the provision condition information 32, it is assumed that a range is defined for each of the above-mentioned three rotation directions.

Then, when the range of movement of the player's head is out of the reference range for at least one rotation direction, the game management unit 25 determines that the range of movement of the player's head is out of the reference range. ..

If it is determined that the information provision condition is not satisfied (in the case of "NO" in step S10), the control unit 21 repeats the determination regarding the information provision condition (step S10). Specifically, the game management unit 25 of the control unit 21 determines that the information provision condition is not satisfied when the range of movement of the player's head is out of the reference range for at least one rotation direction. The determination in step S10 is repeated.

On the other hand, when the control unit 21 determines that the information provision condition is satisfied (when "YES" in step S10), the information provision is executed (step S11). Specifically, when the range of movement of the player's head is within the reference range for all rotation directions, the game management unit 25 determines that the information provision condition is satisfied, and executes information provision. ..

As described above, according to the third embodiment, in addition to the effects described in the first embodiment, the effects listed below can be obtained.
(6) In the third embodiment, the information provision condition is that the range of movement of the player's head deviates from the defined reference range. As a result, the information provision condition is satisfied when the gaze position of the player is too narrow or too wide, so that the information provision can be executed at an appropriate timing.

(Fourth Embodiment)
Next, a fourth embodiment of the virtual image display program, the virtual image display device, and the virtual image display method will be described with reference to FIG. Since the fourth embodiment has a configuration in which a part of the information providing process of the first embodiment is changed, the same reference numerals are given to the same parts and detailed description thereof will be omitted.

The present embodiment is different from the first embodiment in that the movement of a predetermined part of the player's body corresponds to a predetermined predetermined movement as an information providing condition. The predetermined part of the player's body is the head. In the present embodiment, the predetermined movement is an unstable and peculiar movement different from the normal movement of the player's head when selecting the target object, such as a restless state or a hectic state.

Here, the movement of the player's head is represented by the average of the movement speeds of the player's heads, the maximum or minimum value of the movement speeds of the player's heads, the number of changes in the movement direction per unit time, and the like. The moving speed of the player's head is calculated from the position and orientation of the head specified by the control unit 21 of the game processing device 20. The provision condition information 32 defines a predetermined operation of the player's head. Specifically, the provision condition information 32 defines a peculiar movement of the head that is different from that when the target object is selected.

The information providing process will be described with reference to FIG. Further, the end condition of this process is that either the mission clear condition is satisfied or the elapsed time measured from the start of the game before the mission is cleared reaches the time limit. This process is repeated until the end condition is satisfied.

The control unit 21 of the game processing device 20 determines whether or not the information provision condition is satisfied (step S10). Specifically, the game management unit 25 of the control unit 21 uses, for example, the average moving speed of the player's head, etc., using the position and orientation of the player's head calculated according to the detection signal input from the sensor 12. The movement of the player's head is calculated. Then, the game management unit 25 reads out the provision condition information 32 and determines whether or not the calculated movement of the player's head corresponds to a predetermined movement of the player's head included in the provision condition information 32. ..

When it is determined that the information provision condition is not satisfied (in the case of "NO" in step S10), the control unit 21 repeats the determination regarding the information provision condition (step S10). Specifically, the game management unit 25 of the control unit 21 determines that the information provision condition is not satisfied when the calculated movement of the player's head does not correspond to the predetermined operation included in the provision condition information 32. , The determination in step S10 is repeated.

On the other hand, when it is determined that the information provision condition is satisfied (when "YES" in step S10), the control unit 21 executes the information provision (step S11). Specifically, the game management unit 25 of the control unit 21 determines that the information provision condition is satisfied when the calculated movement of the player's head corresponds to a predetermined operation included in the provision condition information 32. , Execute information provision.

As described above, according to the fourth embodiment, in addition to the effects described in the first embodiment, the effects listed below can be obtained.
(7) In the fourth embodiment, the information provision condition is that the movement of the player's head corresponds to a predetermined movement recorded in the storage unit 22. As a result, the information provision condition is satisfied when the player is at a loss, so that the information provision can be executed at an appropriate timing.

It should be noted that each of the above embodiments can be modified as appropriate and implemented as follows.
-In each of the above embodiments, the gameable area is an area including all target objects, but it may be an area including at least a predetermined number of target objects for clearing the mission.

-In each of the above embodiments, the object includes a selectable target object and a non-selectable object, but all the objects displayed in the virtual space may be selectable objects.

-In each of the above embodiments, the mission clearing condition of the game is that there are a predetermined number of target objects for which selection has been completed within the time limit of the game, but other conditions may be used. For example, the timing of selecting the target object may match the preset timing, the same target object may be selected a predetermined number of times, and the like.

-In the first embodiment, the information provision display 111 is displayed as a paper held by a bird, which is a moving body, and this paper is also moved according to the moving body. In addition to this, the information providing display 111 may be, for example, a moving body other than a bird, such as a vehicle such as an airplane, a living thing such as a butterfly, or a moving body that moves in a virtual space such as a fallen leaf. Further, hints regarding the progress of the game may be written on the moving bodies themselves, or the moving bodies may hold the information providing display 111. Further, a paper falling in the virtual space may be used as a moving body, and hints may be displayed on the paper.

-In the first embodiment, the information provision display 111 is not displayed until the elapsed time exceeds a certain time. In addition to this, the information provision display 111 may be displayed simply when the gaze position is outside the gameable area.

-In the second embodiment, the information provision display 111 is displayed on the condition that the gaze position of the player is outside the gameable area without completing the selection of the target object. In addition to this, the information provision display 111 may be displayed when the gaze position of the player is outside the target object even within the gameable area without completing the selection of the target object.

-In the above-mentioned third embodiment, the range of movement of the head is represented by three rotation directions, but it may be represented by variables other than this. For example, the range of head movement is "90 ° on the left side, 90 ° on the right side" and "30 ° on the upper side, 30 ° on the lower side" based on the position and orientation of the head when the player faces the horizontal direction. It may be expressed as "30 °".

-In the third embodiment, when the range of movement of the player's head is out of the reference range for at least one rotation direction, it is determined that the range of movement of the head is out of the reference range. In addition to this, when the range of movement of the player's head is outside the reference range for all rotation directions, it may be determined that the range of movement of the head is outside the reference range.

-In the third embodiment, the information provision condition is that the range of the movement of the head of the player is outside the range of the standard movement of the head when the target object is selected. In the fourth embodiment, the information provision condition is that the movement of the player's head corresponds to a predetermined predetermined movement. The "head movement" of these information provision conditions may be replaced with the "gaze position". That is, the information provision condition of the third embodiment may be such that the range of movement of the gaze position is outside the range of movement of the reference gaze position when the target object is selected. The information provision condition of the fourth embodiment may be that the movement of the gaze position corresponds to a predetermined predetermined movement.

-In each of the above embodiments, hints related to the game are displayed as information provision, but other information may be provided. For example, information such as menu items, scores, character status, remaining time during which the game can be continued, and the progress stage of the game may be provided.

-The information provision condition of the first embodiment or the information provision condition of the second embodiment includes the information provision condition of the third embodiment, "Before clearing the mission, the range including the movement of the head is included. , Being out of the standard range ”may be added. Alternatively, the information provision condition of the first embodiment or the information provision condition of the second embodiment includes the information provision condition of the fourth embodiment, "the movement of the head corresponds to a predetermined movement". May be added. Alternatively, both the information provision condition of the third embodiment and the information provision condition of the fourth embodiment may be added to the information provision condition of the first embodiment or the information provision condition of the second embodiment. Even in this way, it is possible to provide information while suppressing the loss of immersive feeling in the virtual space.

-In each of the above embodiments, information is provided by outputting an information providing display to the display 14. In addition to this, when the information provision condition is satisfied, the information may be provided by voice, a warning sound, or the like about the hint content.

-The HMD control unit 11 may calculate the position and orientation of the head based on the detection signal of the sensor 12. As described above, it is possible to provide the HMD 10 with a part of the functions of the game processing device 20 described in each of the above embodiments.

-In each of the above embodiments, the gaze position of the player is calculated based on the position and orientation of the head of the player. For example, the gaze direction is calculated based on the position of the pupil, and the gaze position is specified from the gaze direction. You may do so. Further, for example, the line-of-sight direction may be calculated based on the position and direction of the nose or the position and direction of the mouth, and the gaze position may be specified from the line-of-sight direction. The direction of the nose or mouth may be determined as, for example, the direction from the back of the head to the nose or mouth.

-In each of the above embodiments, the virtual image display device is embodied as a game processing device, but the virtual image display device may be applied to a virtual reality system for other purposes. For example, it may be applied to various simulations such as driving and vocational training, training in medical treatment, product monitoring, watching movies and music, and the like. Even if the virtual image display device is applied to a virtual reality system for purposes other than games, it is possible to provide information while suppressing the loss of immersive feeling of the player (user) in the virtual space.
Next, the technical idea that can be grasped from the above embodiment and another example will be added below.
[1] A storage unit that records information provision conditions and provision information, a virtual image display unit provided with a control unit, a detection device for specifying the orientation of the player's head, and a display that displays an image. It is a virtual image display program for displaying an image of a virtual space on the display.
The control unit
A spatial image output unit that displays an image of virtual space on the display according to the orientation of the player's head.
When the image of the virtual space is displayed on the display, a plurality of rotation angles in the rotation direction centered on each of the three-dimensional axes of the player's head are reference ranges that define the range of each rotation angle. When the information provision condition is not satisfied, the determination unit determines that the information provision condition is satisfied, and
A virtual image display program that functions as an information providing unit that outputs the provided information when the information providing condition is satisfied.
[2] A predetermined movement of the player's head is recorded in the storage unit.
The information providing condition includes that the movement of the head of the player corresponds to a predetermined movement recorded in the storage unit.
The virtual image display program according to claim 1, wherein the control unit outputs the provided information when the movement of the head of the player corresponds to the predetermined movement.
[3] The virtual image display program according to claim 1 or 2, wherein the information providing unit displays the provided information on an object in the virtual space.
[4] The method according to any one of claims 1 to 3, wherein the information providing unit displays the provided information in the moving direction of a moving body that is an object in the virtual space and moves in the virtual space. Virtual image display program.
[5] An image of a virtual space is displayed on the display using a detection device for specifying the orientation of the player's head, a display for displaying an image, and a storage unit for recording information provision conditions and provision information. It is a virtual image display device for displaying in
A spatial image output unit that displays an image of virtual space on the display according to the orientation of the player's head.
When the image of the virtual space is displayed on the display, a plurality of rotation angles in the rotation direction centered on each of the three-dimensional axes of the player's head are reference ranges that define the range of each rotation angle. When the information provision condition is not satisfied, the determination unit determines that the information provision condition is satisfied, and
A virtual image display device including an information providing unit that outputs the provided information when the information providing condition is satisfied.
[6] A storage unit that records information provision conditions and provision information, a virtual image display unit provided with a control unit, a detection device for specifying the orientation of the player's head, and a display that displays an image. It is a virtual image display method for displaying an image of a virtual space on the display.
The control unit
An image of the virtual space is displayed on the display according to the orientation of the player's head.
When the image of the virtual space is displayed on the display, a plurality of rotation angles in the rotation direction centered on each of the three-dimensional axes of the player's head are reference ranges that define the range of each rotation angle. If it deviates from the above, it is determined that the above information provision conditions are satisfied, and
A virtual image display method for outputting the provided information when the information providing condition is satisfied.

10 ... HMD, 11 ... HMD control unit, 12 ... tracking sensor, 13 ... input / output I / F unit, 14 ... display, 15 ... speaker, 20 ... game processing device, 21 ... control unit, 22 ... storage unit, 23 ... Input / output unit, 24 ... Gaze position identification unit, 25 ... Game management unit, 26 ... Spatial image output unit, 27 ... Information provision unit, 30 ... Virtual space image information, 31 ... Object information, 32 ... Provision condition information, 33 ... Gaze position information, 34 ... Gaze time information, 35 ... Provided information.

Claims (14)

A virtual image display program for displaying an image on the display using a control unit, a detection device for specifying a player's gaze position, and a display.
The control unit
A specifying unit which specifies an object corresponding to the gaze position,
A selection unit that selects the object when the gaze time associated with the object reaches a predetermined time.
A virtual image display that functions as an output control unit that outputs provided information to the display when the elapsed time from the start of the application reaches a certain time and the gaze position moves to a predetermined area where the object cannot be selected. program. A virtual image display program for displaying an image on the display using a control unit, a detection device for specifying a player's gaze position, and a display.
The control unit
A specifying unit which specifies an object corresponding to the gaze position,
A selection unit that selects the object when the gaze time associated with the object reaches a predetermined time.
A virtual function as an output control unit that outputs provided information to the display when the elapsed time elapsed without selecting the object reaches a certain time and the gaze position moves to a predetermined area where the object cannot be selected. Image display program. A virtual image display program for displaying an image on the display using a control unit, a detection device for specifying a player's gaze position, and a display.
The control unit
A specifying unit which specifies an object corresponding to the gaze position,
A selection unit that selects the object when the gaze time associated with the object reaches a predetermined time.
A virtual image display program that functions as an output control unit that outputs provided information on an object located in the predetermined area when the gaze position moves the object to a predetermined area in which the object cannot be selected. A virtual image display program for displaying an image on the display using a control unit, a detection device for specifying a player's gaze position, and a display.
The control unit
A specifying unit which specifies an object corresponding to the gaze position,
A selection unit that selects the object when the gaze time associated with the object reaches a predetermined time.
A virtual image display program that functions as an output control unit that outputs provided information in the moving direction of an object moving in the predetermined area when the gaze position moves the object to a predetermined area in which the object cannot be selected. The virtual image display program according to claim 1 or 2 , wherein the output control unit resets the elapsed time when the selection of the object is completed. The virtual image display program according to any one of claims 1 to 5 , wherein when an object corresponding to the gaze position is specified, gaze time information indicating the gaze time is superimposed on the object and displayed. A virtual image display system for displaying an image on the display using a detection device for specifying a player's gaze position and a display.
A specifying unit which specifies an object corresponding to the gaze position,
A selection unit that selects the object when the gaze time associated with the object reaches a predetermined time.
A virtual image including an output control unit that outputs provided information to the display when the elapsed time from the start of the application reaches a certain time and the gaze position moves to a predetermined area where an object cannot be selected. Display system. A virtual image display system for displaying an image on the display using a detection device for specifying a player's gaze position and a display.
A specifying unit which specifies an object corresponding to the gaze position,
A selection unit that selects the object when the gaze time associated with the object reaches a predetermined time.
It includes an output control unit that outputs provided information to the display when the elapsed time elapsed without selecting the object reaches a certain time and the gaze position moves to a predetermined area where the object cannot be selected. Virtual image display system. A virtual image display system for displaying an image on the display using a detection device for specifying a player's gaze position and a display.
A specifying unit which specifies an object corresponding to the gaze position,
A selection unit that selects the object when the gaze time associated with the object reaches a predetermined time.
A virtual image display system including an output control unit that outputs provided information on an object located in the predetermined area when the gaze position moves an object to a predetermined area in which the object cannot be selected. A virtual image display system for displaying an image on the display using a detection device for specifying a player's gaze position and a display.
A specifying unit which specifies an object corresponding to the gaze position,
A selection unit that selects the object when the gaze time associated with the object reaches a predetermined time.
A virtual image display system including an output control unit that outputs provided information in the moving direction of an object moving in the predetermined area when the gaze position moves the object to a predetermined area in which the object cannot be selected. It is a virtual image display method for displaying an image on the display by using a control unit, a detection device for specifying a player's gaze position, and a display.
The control unit
A specifying step of specifying the object corresponding to the gaze position,
A selection step in which the object is selected when the gaze time associated with the object reaches a predetermined time.
A virtual execution of an output control step that outputs provided information to the display when the elapsed time from the start of the application reaches a certain time and the gaze position moves to a predetermined area where the object cannot be selected. Image display method. It is a virtual image display method for displaying an image on the display by using a control unit, a detection device for specifying a player's gaze position, and a display.
The control unit
A specifying step of specifying the object corresponding to the gaze position,
A selection step in which the object is selected when the gaze time associated with the object reaches a predetermined time.
An output control step of outputting provided information to the display when the elapsed time elapsed without selecting the object reaches a certain time and the gaze position moves to a predetermined area where the object cannot be selected is executed. Virtual image display method. It is a virtual image display method for displaying an image on the display by using a control unit, a detection device for specifying a player's gaze position, and a display.
The control unit
A specifying step of specifying the object corresponding to the gaze position,
A selection step in which the object is selected when the gaze time associated with the object reaches a predetermined time.
A virtual image display method for executing an output control step of outputting provided information on an object located in the predetermined area when the gaze position moves the object to a predetermined area in which the object cannot be selected. It is a virtual image display method for displaying an image on the display by using a control unit, a detection device for specifying a player's gaze position, and a display.
The control unit
A specifying step of specifying the object corresponding to the gaze position,
A selection step in which the object is selected when the gaze time associated with the object reaches a predetermined time.
A virtual image display method for executing an output control step of outputting provided information in the moving direction of an object moving in the predetermined area when the gaze position moves the object to a predetermined area in which the object cannot be selected.

Images