KR102628667B1 - Virtual reality interface system for imitating solar revolution system - Google Patents

Abstract

The present invention sets a virtual space area, an identification unit that tracks and identifies the gaze position of the head-mounted VR worn by the user, and sets a virtual camera position in the virtual space area of the spherical coordinate system corresponding to the gaze position. A setting module that simulates the solar system orbital system and creates a UI objectified in 2D or 3D in a specific placement area on a spherical coordinate system centered on the camera position in the VR display area, and A vector generation module that generates a first direction vector in the spherical coordinate system to the position of the UI, and generates a second direction vector by changing the phi coordinate of the first direction vector by an angle corresponding to the change in the left and right gaze positions of the VR; Including an interface consisting of a display module that displays the UI in the display area at a direction and angle corresponding to the second direction vector, it eliminates the sense of disparity between the UI in the virtual space and the real object due to the user's gaze change, thereby reducing the user's motion sickness. Disclosed is a VR interface system that simulates the solar system's orbital system and minimizes the phenomenon.

Description

VR interface system that simulates the solar system's orbital system {VIRTUAL REALITY INTERFACE SYSTEM FOR IMITATING SOLAR REVOLUTION SYSTEM}

The present invention places the UI on an orbit in virtual space centered on the position of the VR, and displays the UI so that it always looks at the VR while tracking it from the UI perspective even if the gaze position or movement position of the VR changes, so that the user's gaze is maintained. This is about a VR interface system that simulates the solar system's orbital system, which can minimize users' motion sickness by eliminating the discrepancy between real objects and the UI in virtual space due to changes.

Recently, HMD (Head mounted display) such as VR, which is a display device mounted on the user's head, is used to experience virtual reality or augmented reality such as Metaverse.

However, there is a problem of causing motion sickness in users due to the disharmony of the UI that constitutes the real environment, 3D virtual environment, and objects displayed through VR, and various technologies are being developed to solve this problem.

The real-time simulation system to prevent motion sickness according to Korean Patent Publication No. 10-1855863 provides user experience (UX) by converting the UI used in VR content into a 3D object and placing it in a three-dimensional space, and provides VR content. In order to minimize visual disturbance, transparency adjustment through alpha value is processed step by step to reduce VR motion sickness, and 3D character movement from a first-person perspective is allowed to move at a constant speed along a designated path, thereby minimizing motion sickness. Although we try to prevent this, there is a problem that the UI continues to follow the user's gaze, causing dizziness due to cognitive impairment.

In addition, the control method of VR content and UI template according to Korean Patent Publication No. 10-1958263 includes an input unit (11), a color space conversion unit (12), a UI template selection unit (13), and a VR content synthesis unit (14). The goal is to increase immersion in the 3D virtual world and reduce visual dissonance, which causes dizziness, by using . However, there is a problem in that the UI continues to follow the user's gaze, causing dizziness due to cognitive impairment.

Accordingly, there is a need for technology that can minimize the occurrence of motion sickness by ensuring that the UI faces the user from the same position even if the user moves in the VR space.

Republic of Korea Patent No. 10-1855863 (2018.05.09.) Republic of Korea Patent No. 10-1958263 (2019.03.14.)

The technical problem to be achieved by the idea of the present invention is to place the UI on an orbit in a virtual space centered on the position of the VR, and to keep the UI always tracking the VR in terms of the UI even when the gaze position or movement position of the VR changes. The goal is to provide a VR interface system that simulates the solar system's orbital system, which can minimize the user's motion sickness by displaying it so that the user can look at it, eliminating the gap between the real object and the UI in the virtual space due to the user's change of gaze.

The objects of the present invention are not limited to the objects mentioned above, and other objects not mentioned will be clearly understood by those skilled in the art from the description below.

In order to achieve the above-described object, an embodiment of the present invention includes an identification unit that sets a virtual space area and tracks and identifies the gaze position of the head-mounted VR worn by the user; and a setting module for setting a virtual camera position on the virtual space area of the spherical coordinate system corresponding to the gaze position, and a spherical coordinate system centered on the camera position in the display area of the VR by simulating the solar system orbital system. A UI creation module that generates a UI objectified in 2D or 3D in a specific placement area on the screen, generates a first direction vector in a spherical coordinate system from the gaze position of the VR to the position of the UI, and changes the left and right gaze positions of the VR. A vector generation module that generates a second direction vector by changing the ϕ coordinate of the first direction vector by an angle corresponding to It provides a VR interface system that simulates a solar system orbital system, including an interface consisting of a display module that displays the UI on the display area.

Here, the UI creation module can adjust the r coordinate corresponding to the distance from the camera position to the UI.

Additionally, the UI creation module can generate a plurality of UIs for different distances.

In addition, when the virtual menu of the plurality of UIs is touched, it may further include a sound output module that outputs a sound corresponding to the touch in a sense of distance according to the distance from the gaze position.

Additionally, the UI creation module may change the display position of the UI by adjusting the θ coordinate from the camera position to the UI, and generate a plurality of UIs for different θ coordinates.

Additionally, when the moving position of the VR is changed, the setting module can set the changed moving position as the origin of the spherical coordinate system as the virtual camera position.

Additionally, the interface is equipped with a voice recognition module and can set the placement and size of the UI through the UI creation module according to the user's voice command.

According to the present invention, the UI is placed on an orbit in virtual space centered on the position of the VR, and the UI is displayed so that the user is always looking at the VR while tracking it in terms of the UI even when the gaze position or movement position of the VR changes. User motion sickness can be minimized by eliminating the discrepancy between real objects and the UI in virtual space due to changes in gaze, and user convenience can be improved by placing one or more UIs on the desired orbit according to the user's settings. It works.

Figure 1 shows a schematic configuration diagram of a VR interface system simulating a solar system orbital system according to an embodiment of the present invention.
FIG. 2 illustrates the operation of the interface of the VR interface system simulating the solar system orbital system of FIG. 1.
FIG. 3 illustrates the UI layout of a VR interface system simulating the solar system orbital system of FIG. 1.
Figure 4 illustrates the UI arrangement according to the change in VR movement position of the VR interface system simulating the solar system orbital system of Figure 1.
Figure 5 illustrates a UI applying a VR interface system that simulates the solar system orbital system of Figure 1.

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and will be implemented in various different forms. The present embodiments only serve to ensure that the disclosure of the present invention is complete and that common knowledge in the technical field to which the present invention pertains is not limited. It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims.

Specific details for implementing the present invention will be described in detail with reference to the drawings attached below. Regardless of the drawings, the same reference numerals refer to the same elements, and “and/or” includes each and all combinations of one or more of the mentioned items.

Although first, second, etc. are used to describe various components, these components are of course not limited by these terms. These terms are merely used to distinguish one component from another. Therefore, of course, the first component mentioned below may also be the second component within the technical spirit of the present invention.

The terminology used herein is for describing embodiments and is not intended to limit the invention. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. As used in the specification, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other elements in addition to the mentioned elements.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings that can be commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings.

The VR interface system that simulates the solar system orbital system according to an embodiment of the present invention includes an identification unit 110 that sets a virtual space area and identifies the gaze position of the head-mounted VR 100 worn by the user by tracking it, and A setting module 121 that sets a virtual camera position in the virtual space area of the spherical coordinate system corresponding to the gaze position, and a sphere centered on the camera position in the display area of VR 100 by simulating the solar system orbital system. A UI creation module 122 that generates a UI objectified in 2D or 3D in a specific placement area on the coordinate system, and a first direction vector (V1) on the spherical coordinate system from the gaze position of the VR 100 to the position of the UI is generated, , a vector generation module 123 that generates a second direction vector (V2) by changing the phi coordinate of the first direction vector (V1) by an angle corresponding to a change in the left and right gaze position of the VR (100), and a second direction Including the interface 120, which consists of a display module 124 that displays the UI in the display area at a direction and angle corresponding to the vector (V2), the discrepancy between the real object and the UI in the virtual space due to the user's gaze change The aim is to minimize the user's motion sickness by eliminating .

Hereinafter, with reference to FIGS. 1 to 5, the VR interface system simulating the solar system orbital system of the above-described configuration will be described in detail as follows.

First, the identification unit 110 sets a virtual space area that is displayed to overlap with the real space viewed by the user, recognizes the operation of the VR (100) through a gyro sensor, etc., and recognizes the head-mounted VR (100) worn by the user. ) is identified by tracking the gaze position, that is, the user's front view.

Next, the interface 120 is a program module driven by hardware such as an external computer that communicates wired or wireless with the identification unit 110 provided in the VR 100, and includes a setting module 121, a UI generation module 122, and a vector. Including the creation module 123 and the display module 124, tracking VR 100 in terms of UI so that the UI always faces VR 100, that is, even if the user's gaze direction changes in terms of VR 100. Ensures that the UI is displayed as if it were fixed in real space.

Specifically, the setting module 121 determines the virtual camera position in the virtual space area that displays the UI in the spherical coordinate system (r, θ, ϕ), corresponding to the gaze position of the VR 100. It can be set to the origin (0,0,0) of the coordinate system.

Afterwards, the UI creation module 122 simulates the solar revolution system and creates text objectized in 2D or 3D in a specific arrangement area on the spherical coordinate system centered on the camera position in the display area of VR 100, Create a UI that includes virtual menus such as images.

Afterwards, the vector generation module 123 generates a first direction vector (V1) in the spherical coordinate system from the gaze position of the VR (100) to the position of the UI, and the left and right gaze of the VR (100) by the left and right rotation of the user's head. A second direction vector (V2) is generated by changing the phi coordinate on the XY plane of the first direction vector (V1) by an angle corresponding to the change in position. That is, the vector generation module 123 can change the normal direction of the plane on which the UI is displayed from the direction of the first direction vector (V1) to the direction of the second direction vector (V2).

Afterwards, the display module 124 moves and arranges in the opposite direction and at an opposite angle by the direction and angle corresponding to the second direction vector (V2) in the virtual space to display the UI in the display area, thereby displaying the UI in the display area of the VR (100) in the real space. When the gaze rotates by ϕ, the UI in the virtual space rotates by -ϕ on the orbit of the UI's placement area in the display area as in the solar system orbital system, simulating the UI as if it is always tracking and looking at the VR (100). Thus, the UI can be displayed so that it appears fixed in real space.

Meanwhile, Figure 3 illustrates the UI layout of a VR interface system simulating the solar system orbital system of Figure 1. With reference to this, various layouts of the UI are described in detail as follows.

Referring to (a) of FIG. 3, the UI creation module 122 adjusts the r coordinate corresponding to the distance from the camera position of VR 100, which is the origin of the spherical coordinate system, to the UI to create the UI displayed in virtual space. The orbit of the deployment area can be changed.

Here, the UI creation module 122 generates a plurality of UIs with different sizes of the UI at different distances according to the perspective, and can arrange lower virtual menus linked to the virtual menu or virtual menus of different categories by distance. They can also be placed separately.

In addition, when touching the virtual menu of the plurality of UIs mentioned above, it further includes a sound output module 125 that outputs a sound corresponding to the touch at a distance according to the distance from the gaze position, which is the origin in the virtual space of the VR 100. Thus, multiple UIs can be identified by distance not only by the user's vision but also by hearing.

Referring to (b) of FIG. 3, the UI creation module 122 adjusts the θ coordinate (angle from the Z axis to the direction vector) from the camera position of VR (100), which is the origin of the spherical coordinate system, to the center of the UI. By changing the display position of the UI, the placement area can be changed to suit the user's comfortable gaze, and multiple UIs can be created for different θ coordinates to check various information at the same time.

Figure 4 illustrates the UI layout according to the change in the moving position of the VR of the VR interface system simulating the solar system orbital system of Figure 1. Referring to this, when the moving position of the VR (100) changes according to the user's movement, The setting module 121 can reset the changed movement position to the origin of the spherical coordinate system and set it as a virtual camera position so that the UI is always displayed at a certain size.

Meanwhile, the interface 120 is equipped with a voice recognition module 126 to set the placement and size of the UI in the virtual space through the UI creation module 122 according to the user's voice command, and to set the placement and size of the UI in the virtual space by using a virtual pointer, etc. Instead of relying on input or touching the menu bar, the user can use both hands freely.

Therefore, by constructing a VR interface system that simulates the solar system orbital system as described above, the UI is placed on an orbit in virtual space centered on the VR's position, and the UI is displayed even when the VR's gaze position or movement position changes. By displaying the UI so that it is always visible while tracking the VR from the side, the user's motion sickness phenomenon can be minimized by eliminating the gap between real objects and the UI in the virtual space due to changes in the user's gaze, and more than one UI can be displayed depending on the user's settings. User convenience can be improved by placing it on the desired orbit.

Although embodiments of the present invention have been described with reference to the above and the attached drawings, those skilled in the art will understand that the present invention can be implemented in other specific forms without changing the technical idea or essential features. You will understand that it exists. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive.

110: identification unit
120: interface
121: Setting module
122: UI creation module
123: Vector generation module
124: Display module
125: Sound output module
126: Voice recognition module
100 : VR
V1: First direction vector
V2: Second direction vector

Claims (7)

An identification unit that sets a virtual space area and tracks and identifies the gaze position of the head-mounted VR worn by the user; and
a setting module that sets a virtual camera position in the virtual space area of a spherical coordinate system corresponding to the gaze position;
A UI creation module that simulates the solar system orbital system and generates a 2D or 3D objectified UI in a specific placement area on a spherical coordinate system centered on the camera position in the display area of the VR;
A first direction vector in a spherical coordinate system is generated from the gaze position of the VR to the position of the UI, and the ϕ coordinate of the first direction vector is changed by an angle corresponding to a change in the left and right gaze positions of the VR to create a second direction vector. A vector generation module that generates,
An interface consisting of a display module that displays the UI in the display area by moving and arranging it in the opposite direction and at an opposite angle by the direction and angle corresponding to the second direction vector,
The identification unit sets a virtual space area that overlaps with the actual space viewed by the user and is displayed, and recognizes the motion of the VR (100) through a gyro sensor to determine the gaze position of the head-mounted VR (100) worn by the user, that is, the user's gaze. The front view is tracked and identified,
The interface 120 is a program module driven by external hardware that communicates wired or wirelessly with the identification unit 110 provided in the VR 100, and tracks the VR 100 in terms of UI so that the UI always displays the VR 100. Even if the user's gaze direction changes from the perspective of VR (100), the UI is displayed as if it were fixed in real space,
The setting module 121 sets the virtual camera position in the virtual space area displaying the UI in the spherical coordinate system (r, θ, ϕ) corresponding to the gaze position of the VR 100 in the spherical coordinate system. Set to the origin (0,0,0),
The UI creation module 122 simulates the solar revolution system and displays text and images objectified in 2D or 3D in a specific arrangement area on the spherical coordinate system centered on the camera position in the display area of VR 100. Creates a UI that includes a virtual menu of
The vector generation module 123 generates a first direction vector (V1) in the spherical coordinate system from the gaze position of the VR (100) to the position of the UI, and determines the left and right gaze positions of the VR (100) by left and right rotation of the user's head. The second direction vector (V2) is created by changing the ϕ coordinate on the The direction can be changed to the direction of the second direction vector (V2),
The display module 124 is moved in the opposite direction and at an opposite angle by the direction and angle corresponding to the second direction vector (V2) in the virtual space and displays the UI in the display area, so that the line of sight of the VR (100) is in the real space. When rotated by this ϕ, the UI in the virtual space rotates by -ϕ on the orbit of the UI's placement area in the display area as in the solar system orbital system, simulating the UI as if it is always tracking and looking at the VR (100). , Displays the UI so that it appears fixed in real space,
The UI creation module adjusts the r coordinate corresponding to the distance from the camera position to the UI, and the UI creation module creates a plurality of UIs with different sizes of the UI at different distances according to perspective and links them with the virtual menu. Sub-virtual menus can be placed or virtual menus of different categories can be placed separately by distance.
The UI creation module changes the display position of the UI by adjusting the θ coordinate from the camera position to the UI, and generates a plurality of UIs for different θ coordinates,
When the moving position of the VR is changed, the setting module sets the changed moving position as the virtual camera position as the origin of the spherical coordinate system. A VR interface system that simulates the solar system orbital system. delete delete According to paragraph 1,
A VR interface system simulating a solar system orbital system, further comprising a sound output module that outputs a sound corresponding to the touch in a sense of distance according to the distance from the gaze position when the virtual menu of the plurality of UIs is touched. delete delete According to paragraph 1,
The interface is equipped with a voice recognition module and sets the placement and size of the UI through the UI creation module according to the user's voice command. A VR interface system that simulates the solar system orbital system.