KR20240127555A - Cylindrical three-dimensional image projection apparatus using half-mirror, method and computer program for projecting three-dimensional image - Google Patents

Abstract

A cylindrical space image projection device using a half mirror includes a housing, a display unit accommodated in the housing and outputting a stereoscopic image and a UI image, a half mirror projecting a spatial image corresponding to the stereoscopic image and the UI image inside the housing, and a control unit detecting the position of a user's hand through a camera, determining whether the hand is touching the UI image based on the detected hand position, and selecting a viewpoint image of the stereoscopic image based on the determination result.

Description

{CYLINDRICAL THREE-DIMENSIONAL IMAGE PROJECTION APPARATUS USING HALF-MIRROR, METHOD AND COMPUTER PROGRAM FOR PROJECTING THREE-DIMENSIONAL IMAGE}

The present invention relates to a cylindrical space image projection device, method and computer program using a half mirror.

Recently, development of devices that project holographic images onto a cylindrical or cube-shaped space using floating hologram technology is actively underway.

In conventional floating hologram technology, there is a technology that expresses an image in space by setting up a transparent screen inside a cylindrical structure and projecting the image using a projector. However, in the case of this technology, there was a problem that the entire system became large due to the projector's image projection distance, making it difficult to build a compact system.

Another conventional floating hologram technology is a floating hologram technology that uses a display panel and a half mirror to express a spatial image within a cylindrical structure. In the case of this technology, there is an advantage in that a more compact system can be constructed than when using the projector by expressing a spatial image using a display panel. A method of projecting a hologram image using a display panel and a half mirror will be described in detail with reference to FIGS. 1a and 1b.

Figure 1a is a schematic diagram of a cylindrical space image projection device using a conventional half mirror, and Figure 1b is a cross-sectional view of a cylindrical space image projection device using a half mirror.

Referring to FIG. 1a, a conventional cylindrical space image projection device (100) using a half mirror includes a housing (101), a display unit (110), a half mirror (120), and a control unit (130).

The housing (101) may be configured in a cylindrical shape, but may also be configured in various shapes, such as a cube-shaped housing.

A display unit (110) and a half mirror (120) are placed in the center of the inside of the housing (101).

The display unit (110) outputs a three-dimensional image (140).

The half mirror (120) projects a spatial image corresponding to a stereoscopic image (140). Through this, a conventional cylindrical spatial image projection device (100) can express a stereoscopic image (140) floating in the center of the internal space of a cylindrical housing (101).

Meanwhile, the display unit (110) outputs a UI image (150) that serves as a guide to interact with the stereoscopic image (140).

However, referring to Fig. 1b, since the UI image (150) is positioned on the display portion (110) inside the housing (101), the user cannot directly manipulate the UI with the hand (160). That is, the user cannot directly interact due to the difference between the position of the UI image (150) and the position of the hand (160).

In this way, conventional floating hologram technology can provide holographic images because the images are displayed inside a cylindrical or cube-shaped housing, but since direct interaction through a touch interface is impossible for the user, an additional user interface such as a physical button is required.

To improve this, a method using a sensor capable of spatial touch can also be used, but there was a problem in that the system became larger as the sensor had to be installed and a distance was required for sensing.

Korean Patent Publication No. 10-2019-0080590 (Published on July 8, 2019) Korean Patent No. 10-2290145 (registered on August 10, 2021)

The present invention provides a spatial image projection device, method and computer program that outputs a stereoscopic image and a UI image through a housing, a display unit accommodated within the housing, and projects a spatial image corresponding to the stereoscopic image and the UI image inside the housing through a half mirror.

The present invention provides a spatial image projection device, method and computer program that detects the position of a user's hand through a camera, determines whether the hand touches a UI image based on the detected hand position, and selects a viewpoint image of a stereoscopic image based on the determination result.

However, the technical tasks that this embodiment seeks to accomplish are not limited to the technical tasks described above, and other technical tasks may exist.

As a means for achieving the above-described technical task, one embodiment of the present invention can provide a spatial image projection device including a housing, a display unit accommodated in the housing and outputting a stereoscopic image and a UI image, a half mirror projecting a spatial image corresponding to the stereoscopic image and the UI image inside the housing, and a control unit detecting the position of a user's hand through a camera, determining whether the hand touches the UI image based on the detected hand position, and selecting a viewpoint image of the stereoscopic image based on the determination result.

Another embodiment of the present invention can provide a spatial image projection method including the steps of outputting a stereoscopic image and a UI image through a display unit accommodated in a housing, the step of projecting a spatial image corresponding to the stereoscopic image and the UI image inside the housing through a half mirror, the step of detecting the position of a user's hand through a camera and determining whether the hand touches the UI image based on the detected hand position, and the step of selecting a viewpoint image of the stereoscopic image based on a result of the determination.

Another embodiment of the present invention provides a computer program stored on a computer-readable recording medium including a sequence of commands that, when executed by a computing device, cause the computer program to output a stereoscopic image and a UI image through a display unit accommodated in a housing, project a spatial image corresponding to the stereoscopic image and the UI image inside the housing through a half mirror, detect a position of a user's hand through a camera, determine whether the hand touches the UI image based on the detected hand position, and select a viewpoint image of the stereoscopic image based on a result of the determination.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present invention. In addition to the above-described exemplary embodiments, there may be additional embodiments described in the drawings and detailed description of the invention.

According to any one of the problem solving means of the present invention described above, a spatial image projection device, method and computer program can be provided that can output a three-dimensional image within a housing by using a half mirror and a cylindrical or cube-shaped housing.

A spatial image projection device, method, and computer program can be provided that enable a user to perform precise touch operations by directly touching a UI image by outputting a UI image on the surface of a cylindrical or cube-shaped housing based on a light field display.

The present invention provides a spatial image projection device, method and computer program that enable a user to manipulate a UI image through a touch interface by detecting the position of a user's hand through a camera, determining whether the hand touches a UI image based on the detected hand position, and selecting a viewpoint image of a stereoscopic image based on the determination result.

Figure 1a is a schematic diagram of a cylindrical space image projection device using a conventional half mirror, and Figure 1b is a cross-sectional view of a cylindrical space image projection device using a half mirror.
FIG. 2a is a schematic diagram of a cylindrical space image projection device using a half mirror according to one embodiment of the present invention, and FIG. 2b is a cross-sectional view of a cylindrical space device using a half mirror according to one embodiment of the present invention.
FIG. 3 is an exemplary drawing for explaining a process of restoring a point image constituting a UI image according to one embodiment of the present invention.
FIG. 4 is an exemplary drawing for explaining a process of shifting multiple viewpoint images constituting a UI image according to one embodiment of the present invention.
FIG. 5 is an exemplary drawing for explaining a process of determining whether a hand is touched based on a touch area and a hand position according to one embodiment of the present invention.
FIG. 6 is an exemplary drawing for explaining a process for determining whether a user's hand touches a surface when using a 2D camera according to one embodiment of the present invention.
FIG. 7 is an exemplary drawing for explaining a process in which a UI image changes when a user's hand touches the UI image according to one embodiment of the present invention.
FIG. 8 is an exemplary drawing illustrating a stereoscopic image and a UI image output from a spatial image projection device according to one embodiment of the present invention.
FIG. 9 is an exemplary drawing illustrating a stereoscopic image provided when a user's hand touches a UI image according to one embodiment of the present invention.
FIG. 10 is a flowchart of a method for projecting a spatial image performed in a cylindrical spatial image projection device using a half mirror according to one embodiment of the present invention.

Hereinafter, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily practice the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in order to clearly describe the present invention in the drawings, parts that are not related to the description are omitted, and similar parts are assigned similar drawing reference numerals throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected" but also the case where it is "electrically connected" with another element in between. Also, when a part is said to "include" a certain component, this should be understood to mean that it may further include other components, unless specifically stated to the contrary, and does not preclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

In this specification, the term 'unit' includes a unit realized by hardware, a unit realized by software, and a unit realized using both. In addition, one unit may be realized using two or more pieces of hardware, and two or more units may be realized by one piece of hardware.

Some of the operations or functions described as being performed by a terminal or device in this specification may instead be performed by a server connected to the terminal or device. Similarly, some of the operations or functions described as being performed by a server may also be performed by a terminal or device connected to the server.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the attached drawings.

FIG. 2a is a schematic diagram of a cylindrical space image projection device using a half mirror according to one embodiment of the present invention, and FIG. 2b is a cross-sectional view of a cylindrical space image projection device using a half mirror according to one embodiment of the present invention.

Referring to FIGS. 2A and 2B, the space image projection device (200) may include a housing (201), a display unit (210), a half mirror (220), a camera (230), and a control unit (240).

The housing (201) may be formed in a cylindrical shape and may have a space inside. The shape of the housing (201) is not limited to a cylindrical shape, and may be formed in a semi-cylindrical shape or a polygonal pillar shape, as needed.

A display unit (210) and a half mirror (220) can be placed in the internal space of the housing (201).

The display unit (210) is placed inside the housing (201) and can be placed so that a three-dimensional image (250) is output toward the curved surface of the cylindrical housing (201).

In the present invention, the display unit (210) may be a light field display including a parallax barrier, a lenticular lens, etc. capable of outputting a glasses-free stereoscopic image. In addition, the display unit (210) may be a display capable of outputting a full stereoscopic image, such as an integral image display, a volumetric display, a holographic display, or a display capable of outputting a glasses-type stereoscopic image, such as a polarization method or a shutter glass method, but is not limited thereto.

Here, the display unit (210) is a display panel, and a liquid crystal display (LCD), an organic light emitting diode display (OLED), a quantum dot display, a projection display, etc. can be used.

The display unit (210) can output a three-dimensional image (250) toward the curved surface of the cylindrical housing (201). Here, the three-dimensional image (250) can be a holographic image. For example, the display unit (210) can be a possible light field display capable of expressing a three-dimensional three-dimensional image (250) having a volume in the space within the cylindrical space image projection device (100) as shown in FIG. 2A.

In addition, the display unit (210) can output a UI image (260). For example, the display unit (210) can configure a UI for manipulating a stereoscopic image (250) as a three-dimensional UI image (260) and project it forward.

Here, the display unit (210) can output a three-dimensional UI image (260) through a light field display.

Meanwhile, when using a light field display, many viewpoint images must be rendered to express a stereoscopic image, which has a significant impact on the performance of the entire system.

To solve this problem, the present invention can output a UI image (260) based on a light field display by adjusting the parallax of viewpoint images for a light field display without rendering within a three-dimensional space.

Through this, the display unit (210) can enable the user to directly touch the UI image (260) using his/her hand (270).

The half mirror (220) is located in front of the display unit (210) and can project a spatial image corresponding to a stereoscopic image (250) and UI image (260) output from the display unit (210) according to the ratio of transmittance and reflectivity.

Specifically, the half mirror (220) can form a cylindrical space by reflecting a cylindrical housing (201) to project a spatial image. Through this, the display unit (210) can be made less noticeable to the user, and the stereoscopic image (250) and UI image (260) can be positioned in the central part of the cylindrical space, thereby providing a holographic effect.

A half mirror (220) is placed on the front of the display unit (210), and a spatial image can be projected into the space between the half mirror (220) and the curved surface of the cylindrical housing (201).

More specifically, a cylindrical curved surface of a housing (201) formed of a transparent material may be positioned on one side of the half mirror (220). That is, the half mirror (220) can project a cylindrical spatial image onto the inside of the housing (201).

In addition, the half mirror (220) can improve the holographic effect by making the bezel portion of the display unit (210) less visible depending on the ratio of transmittance and reflectivity.

The camera (230) can be installed at the top or bottom of the housing (201).

The camera (230) can capture the surface of the housing (201) to recognize whether the user touches it within the field of view of the camera (230).

These cameras (230) can be used, for example, to recognize the user's hand, such as a stereo camera capable of measuring depth, a depth camera, or a general 2D camera.

The control unit (240) can detect the position of the user's hand (270) through the camera (230) and determine whether the hand (270) touches the UI image (260) based on the detected position of the hand (270).

The control unit (240) can select a viewpoint image of a stereoscopic image (250) based on the judgment result.

The control unit (240) can shift multiple viewpoint images constituting the UI image (260) so that the UI image (260) is overlaid in front of the stereoscopic image (250). Here, the UI image (260) can be focused on a specific depth plane based on the amount of movement of pixels by which the multiple viewpoint images are shifted.

The control unit (240) can project a spatial image corresponding to the UI image (260) onto the surface of the housing (201) based on projection distance information according to the size information of the housing (201). The process of shifting multiple viewpoint images will be described in detail with reference to FIGS. 3 and 4.

FIG. 3 is an exemplary drawing for explaining a process of restoring a point-of-view image according to one embodiment of the present invention. Referring to FIG. 3, the display unit (210) may include a display panel (210-1) and an element lens array (300) attached to the display panel (210-1). At this time, each light ray passes through the element lens array (300) and is focused on a specific depth plane, thereby restoring a point-of-view image.

For example, in the case of multiple light rays (301) expressed in purple, the viewpoint image can be restored by each light ray (301) passing through each element lens (300) and focusing on the depth plane of D ₀ (310).

Here, in the case of multiple light rays (302) expressed in green, the starting position of the light rays in the light rays (301) expressed in purple is shifted by n pixels according to the relative position of the element lens array (300), so that the point image can be restored by passing through the element lens array (300) and focusing on the depth plane of D ₁ (311).

The control unit (240) can adjust the depth plane on which the viewpoint image is formed by controlling the amount of pixel movement by repeatedly performing this process.

That is, the control unit (240) can horizontally move the viewpoint image used in the light field display based on the movement of pixels.

FIG. 4 is an exemplary diagram for explaining a process of shifting multiple viewpoint images constituting a UI image according to one embodiment of the present invention. Referring to FIGS. 3 and 4, the control unit (240) can output the UI image (260) by shifting five viewpoint images constituting the UI image (260).

In the case of Figure (a)(410), it can be confirmed that all five viewpoint images (400 to 404) are located at the same location. In Figure (a), when the UI image (260) is restored based on a light field display, a 2D-based UI image can be output through the display unit (210).

In the case of Figure (b)(411), the control unit (240) can shift each viewpoint image in the horizontal direction to display the UI image (260) in front of the display unit (210). For example, the control unit (240) can set the first viewpoint image (400) as a reference viewpoint image, and move the second viewpoint image (401) by 1 pixel, the third viewpoint image (402) by 2 pixels, the fourth viewpoint image (403) by 3 pixels, and the fifth viewpoint image (404) by 4 pixels.

In this way, when the control unit (240) moves each point image to restore the light field-based UI image (260), the display unit (210) can output the UI image (260) on the depth plane of D ₁ (311) of FIG. 3.

In addition, the control unit (240) may increase the shift amount of each viewpoint image to increase the distance at which the viewpoint image is restored. For example, in the case of Figure (c) (412), the control unit (240) may increase the shift amount by two times compared to each corresponding viewpoint image compared to Figure (b) (411). At this time, the display unit (210) may output the UI image (260) on the depth plane of D ₂ (312) of Figure 3.

In this way, the control unit (240) can generate each viewpoint image by deriving an appropriate shift amount for expression at a desired depth position, and then restore it to a light field-based UI image (260), and the display unit (210) can output the UI image (260) on the surface of the housing (201) of the spatial image projection device (200).

Returning to FIGS. 2A and 2B again, the control unit (240) can set a touch area based on the number of pixels and location information of the UI image (260), and determine whether the hand (270) touches based on the touch area and the location of the hand (270). The process of determining whether the hand (270) touches will be described in detail with reference to FIG. 5.

FIG. 5 is an exemplary diagram for explaining a process of determining whether a hand is touched based on a touch area and a hand position according to one embodiment of the present invention. Referring to FIG. 5, the drawing (a) (500) shows a front view of a space image projection device (200) in which a display unit (210) capable of touch sensing and a half mirror (220) are arranged, and the display unit (210) can output left/right arrows (502, 504) as a three-dimensional UI image (260). At this time, a camera (230) for touch recognition is installed at the upper part of the housing (201), so that touch recognition can be performed within the field of view of the camera (230).

The control unit (240) can set the touch area (501, 503) based on the number of pixels and location information of the UI image (260), and can extract the three-dimensional coordinates of the user's hand (270) using a camera (230) such as a stereo camera or a depth camera to determine whether the touch area (501, 503) is touched.

For example, as shown in Figure (b) (510) and Figure (c) (520), the control unit (240) can determine whether the left/right arrows (502, 504) are touched based on whether the user's hand (270) is positioned in the touch area (501, 503).

Returning again to FIGS. 2a and 2b, according to one embodiment of the present invention, the camera (230) may be a typical 2D camera for touch recognition.

In this case, the control unit (240) can perform additional calculations for recognizing the touch of the user's hand (270).

The control unit (240) can derive coordinate information for the touch area.

The control unit (240) can calculate the start and end positions of the touch area based on the correlation information about the positions of the camera (230) and the display unit (210) and the shooting range by the angle of view of the camera (230), and can derive x-axis coordinate information for the touch area based on the start and end positions of the touch area.

FIG. 6 is an exemplary drawing for explaining a process of determining whether a user's hand touches a subject when using a 2D camera according to one embodiment of the present invention. Referring to FIG. 6, let us assume that the width of a camera (230) capable of capturing is 2c. Based on the width of the camera (230), a touch area corresponding to a UI image (260) can be calculated using the following mathematical expression 1.

The control unit (240) can derive the touch area corresponding to the UI image (260) as area 2 (602) between d _x1 and d _x2 based on mathematical expression 1.

Here, in order to define the position captured by the camera (230) using the information of the display panel, let us assume that the UI image (260) is a rectangular structure of size d h , d v including (d _x1 , d _y1 ) to (d _x2 , _{d y2 )} on a display panel having a total resolution of R _h , R _{v and} pixel sizes of P _x , P _y . In addition, let us assume that the display panel is positioned below the camera (230) for touch recognition by a distance of L, and the center axes of the display panel and the camera (230) are on the same axis.

The correlation between the positions of the camera (230) and the display panel and the width (2c) that can be captured by the angle of view of the camera (230) can be calculated, for example, using the following mathematical expressions 2 and 3.

The start and end positions of area 2 (602) in the image of the camera (230) can be calculated using the following mathematical expressions 4 and 5.

The x-axis coordinate value for area 2 (602) can be calculated using the following mathematical expressions 6 and 7.

The lower picture of Fig. 6 is the view from the camera, and the part expressed in light green is the area corresponding to the arrow UI. For the convenience of explanation, the right part is explained, and the entire area to the right of the center is expressed as c. c is divided into three parts, and c2 represents the area corresponding to the arrow UI, and c1 and c3 represent areas that do not correspond to arrows. Accordingly, when the hand touches the area corresponding to c2, it operates, and when the touch occurs in the areas c1 and c3, it does not operate.

In the present invention, a configuration for performing touch sensing using a camera (230) has been described, but in addition to the camera (230), a light-emitting unit and a light-receiving unit of an IR sensor may be installed at the upper or lower portion of the housing (201), respectively, to extract the vertical coordinates of the user's hand (270).

FIG. 7 is an exemplary drawing for explaining a process in which a UI image changes when a user's hand touches the UI image according to one embodiment of the present invention. Referring to FIG. 7, a UI image (260) is output on the surface of a housing (201), and the UI image (260) may change when a user touches the UI image (260).

In the figure (a)(700), the UI image (260) can be expressed in the shape of a 'Play button' on the surface of the housing (201). When the 'Play button' of the UI image (260) is expressed on the surface of the housing (201) of the space image projection device (200), if the user touches it using his/her hand (270), various actions provided by a general touch interface can be performed. For example, various animations such as color change, brightness change, rotation, and up/down/left/right movement of the 'Play button' can be applied.

Additionally, when the user touches the 'Play button' of the UI image (260) as shown in Figure (b)(710), some of the brightness may change.

In the case of a general display, a button press effect can be expressed by CG effects to give the effect of the 'Play button' being pressed. However, in the case of using a light field display, since image expression in the depth direction is possible, the effect of the 'Play button' actually being pressed can be expressed by manipulating the input image.

That is, by expressing CG content and rendering it as a light field image when the 'Play button' is pressed in the three-dimensional space of the content, the display unit (210) can provide an effect as if the actual 'Play button' has been pressed.

The display unit (210) can output a stereoscopic image (250) that does not express a three-dimensional image by rendering it in real time, and can output a UI image (260) by overlaying it in front of the stereoscopic image (250).

Below, 'd _c1 ~d _cm ', 'd _d1 ~d _dm ', and 'd _e1 ~d _em ' shown in Figures (c), (d), and (e) respectively represent the parallax values of each viewpoint image.

Figure (c)(730) may be an image in which the 'Play button' of Figure (b)(710) is shifted to suit each viewpoint image. That is, the control unit (240) shifts the n-th viewpoint image (720), which is the center image, by a parallax amount d _c1 to d _cm pixels to suit the viewpoint position, so that the display unit (210) can output the UI image (260) on the surface of the housing (201) of the spatial image projection device (200). Here, since the parallax amount represents a depth expression for a 2D image, the same parallax amount can be had between adjacent viewpoint images.

The control unit (240) can adjust the shift amount of each point image when the user touches the UI image (260) using his/her hand (270). Here, when the parallax amount is reduced, the UI image (260) moves toward the display panel, and when the parallax amount is increased, the UI image (260) can be output outside the housing (201).

Figure (d)(740) shows a case where all viewpoint images are the same, which means that the UI image (260) can move inward and be positioned on the surface of the display unit (210).

Figure (e)(750) shows a case where the parallax is reversed, and can show a case where the UI image (260) moves inward and reaches the back of the display panel.

Accordingly, the control unit (240) can perform movement in the depth direction for the UI image (260) by adjusting the parallax amount according to the output scenario of the stereoscopic image and the UI image.

FIG. 8 is an exemplary diagram illustrating a stereoscopic image and a UI image output from a spatial image projection device according to an embodiment of the present invention. Referring to FIG. 8, the spatial image projection device (200) can provide a front view in an initial state. For example, it can output a main stereoscopic image (801) for a front view (center view) of a user, and output UI images (802, 803) indicating a left direction (802) and a right direction (803) at the top. For example, when the spatial image projection device (200) recognizes a touch of a UI image (811) for a right direction by a user's hand (270), it can output a viewpoint image (821) for a right direction for the main stereoscopic image (801).

For another example, when the space image projection device (200) recognizes a touch of the UI image (812) toward the left by the user's hand (270), it can output a viewpoint image (822) toward the left for the main stereoscopic image (801).

FIG. 9 is an exemplary diagram illustrating a stereoscopic image provided when a user's hand touches a UI image according to one embodiment of the present invention. Referring to FIG. 9, as an example of viewpoint images used in a space image projection device (200) to which a light field display is applied, it is assumed that there are a total of M viewpoint images (900) for explanation. For example, it is assumed that the light field display used in the space image projection device (200) uses m viewpoint images.

With this configuration, in the initial state of Fig. 8, a stereoscopic image (250) can be output using image group 1 (901, m viewpoint images of n to n+m-1) of Fig. 9. Here, the spatial image projection device (200) can output a center viewpoint image (910) of the stereoscopic image (250).

Here, when the user touches the UI image (260) at the top, animation (color change, depth direction movement, rotation, up/down/left/right movement, etc.) for the UI image (260) can be performed, and an action for the main image can be performed.

For example, the user can rotate left/right by touching the UI image (260) in the user's stereoscopic projection. At this time, since the corresponding viewpoint image must be changed for the parasitic image, the image group used can be moved according to the scenario of the stereoscopic image to be provided.

For example, when a user touches a UI image (260) for the right direction, the spatial image projection device (200) can provide a viewpoint image (911) for the right direction by rotating the main stereoscopic image to the right using image group 2 (902, m viewpoint images of M-(m-1) to M). Here, in order to provide a viewpoint image for the right direction, the camera (230) or the main stereoscopic image can be moved to render the viewpoint image when rendering the viewpoint image in real time.

For another example, if the user touches the UI image (260) for the left direction, the spatial image projection device (200) can provide a viewpoint image (912) for the left direction that rotates the main stereoscopic image to the left using image group 3 (903, m viewpoint images from 1 to m).

Such a spatial image projection device (200) can be executed by a computer program stored in a medium including a sequence of commands for projecting a spatial image using a half mirror. When executed by a computing device, the computer program can include a sequence of commands for outputting a stereoscopic image and a UI image through a display unit (210) accommodated in a housing (201), projecting a spatial image corresponding to the stereoscopic image inside the housing (201) through a half mirror (220), detecting the position of a user's hand through a camera (230), determining whether the hand touches the UI image based on the detected hand position, and selecting a viewpoint image of the stereoscopic image based on the determination result.

FIG. 10 is a flowchart of a method for projecting a spatial image using a half mirror performed in a cylindrical spatial image projection device (200) according to one embodiment of the present invention. The method for projecting a spatial image using a half mirror (220) performed in the spatial image projection device (200) illustrated in FIG. 10 includes steps that are processed in time series according to the embodiments illustrated in FIGS. 2A to 9. Therefore, even if the content is omitted below, it is also applied to the method for projecting a spatial image using a half mirror (220) performed in the spatial image projection device (200) according to the embodiments illustrated in FIGS. 2A to 9.

In step S1010, the space image projection device (200) can output a stereoscopic image (250) and a UI image (260) through a display unit (215) accommodated in a housing (201).

In step S1020, the spatial image projection device (200) can project a spatial image corresponding to a stereoscopic image (250) and a UI image (260) inside the housing (201) through a half mirror (220).

In step S1030, the space image projection device (200) detects the position of the user's hand (270) through the camera (230), and based on the detected position of the hand (270), determines whether the hand (270) touches the UI image (260).

In step S1040, the spatial image projection device (200) can select a viewpoint image of a stereoscopic image (250) based on the judgment result.

In the above description, steps S1010 to S1040 may be further divided into additional steps or combined into fewer steps, depending on the implementation of the present invention. In addition, some steps may be omitted as needed, or the order between the steps may be switched.

The method for projecting a spatial image using a half mirror performed in the spatial image projection device described through FIGS. 2A to 10 can also be implemented in the form of a computer program stored in a medium executed by a computer or a recording medium including commands executable by a computer. In addition, the method for projecting a spatial image using a half mirror performed in the spatial image projection device described through FIGS. 2A to 10 can also be implemented in the form of a computer program stored in a medium executed by a computer.

Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Additionally, computer-readable media can include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.

The above description of the present invention is for illustrative purposes, and those skilled in the art will understand that the present invention can be easily modified into other specific forms without changing the technical idea or essential characteristics of the present invention. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single component may be implemented in a distributed manner, and likewise, components described as distributed may be implemented in a combined manner.

The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

200: Cylindrical space image projection device
201: Housing
210: Half Mirror
220: Display section
230: Camera
240: Control Unit

Claims (17)

In a cylindrical space image projection device using a half mirror,
housing;
A display unit accommodated within the housing and outputting stereoscopic images and UI images;
A half mirror that projects a spatial image corresponding to the stereoscopic image and the UI image inside the housing; and
A control unit that detects the position of a user's hand through a camera, determines whether the hand touches the UI image based on the detected hand position, and selects a viewpoint image of the stereoscopic image based on the determination result.
A spatial image projection device comprising:
In paragraph 1,
A spatial image projection device, wherein the control unit shifts a plurality of viewpoint images constituting the UI image so that the UI image is overlaid in front of the stereoscopic image.
In the second paragraph,
A spatial image projection device, wherein the above UI image is projected onto a specific depth plane based on the amount of movement of pixels by which the plurality of viewpoint images are shifted.
In the second paragraph,
A spatial image projection device, wherein the control unit projects a spatial image corresponding to the UI image onto the surface of the housing based on projection distance information according to size information of the housing.
In the first paragraph,
The above control unit sets the touch area based on the number of pixels and location information of the UI image,
A spatial image projection device that determines whether the hand touches the screen based on the touch area and the position of the hand.
In paragraph 5,
The control unit calculates the start and end positions of the touch area based on the correlation information about the positions of the camera and the display unit and the shooting range by the angle of view of the camera.
A spatial image projection device that derives x-axis coordinate information for the touch area based on the start position and end position of the touch area.
In the first paragraph,
The above housing has a cylindrical shape,
A spatial image projection device, wherein the display unit is arranged so that the three-dimensional image is output toward the curved surface of the cylinder.
In paragraph 7,
The above half mirror is placed on the front of the display unit,
A space image projection device, wherein the above space image is projected into the space between the half mirror and the curved surface of the cylinder.
A method for projecting a spatial image using a half mirror in a cylindrical spatial image projection device,
A step of outputting a stereoscopic image and a UI image through a display unit accommodated in a housing;
A step of projecting a spatial image corresponding to the stereoscopic image and the UI image inside the housing through a half mirror;
A step of detecting the position of the user's hand through a camera and determining whether the hand touches the UI image based on the detected hand position; and
A step for selecting a viewpoint image of the stereoscopic image based on the judgment result.
A spatial image projection method comprising:
In Article 9,
The steps for selecting the above time point video are:
A spatial image projection method, comprising a step of shifting a plurality of viewpoint images constituting the UI image so that the UI image is overlaid in front of the stereoscopic image.
In Article 10,
A spatial image projection method, wherein the above UI image is projected onto a specific depth plane based on the amount of movement of pixels by which the multiple viewpoint images are shifted.
In Article 10,
The steps for selecting the above time point video are:
A spatial image projection method, comprising a step of projecting a spatial image corresponding to the UI image onto a surface of the housing based on projection distance information according to size information of the housing.
In Article 9,
The step of determining whether the above hand touches or not is as follows:
A step of setting a touch area based on the number of pixels and location information of the above UI image; and
A spatial image projection method, comprising a step of determining whether the hand is touched based on the touch area and the position of the hand.
In Article 13,
The step of determining whether the above hand touches or not is as follows:
A step of calculating the start and end positions of the touch area based on the correlation information on the positions of the camera and the display unit and the shooting range by the angle of view of the camera; and
A spatial image projection method, comprising a step of deriving x-axis coordinate information for the touch area based on a start position and an end position of the touch area.
In Article 9,
The above housing has a cylindrical shape,
A spatial image projection method, wherein the above stereoscopic image is arranged so as to be output toward the curved surface of the cylinder.
In Article 15,
The above half mirror is placed on the front of the display unit,
A spatial image projection method, wherein the above spatial image is projected into the space between the half mirror and the curved surface of the cylinder.
A computer program stored on a computer-readable recording medium including a sequence of commands for projecting a spatial image using a half mirror,
When the above computer program is executed by a computing device,
Outputs stereoscopic images and UI images through the display unit housed within the housing,
Projecting a spatial image corresponding to the stereoscopic image and the UI image inside the housing through a half mirror,
Detecting the position of the user's hand through the camera, and determining whether the hand touches the UI image based on the detected hand position,
A computer program stored on a computer-readable recording medium, comprising a sequence of commands for selecting a viewpoint image of the stereoscopic image based on the judgment result.