JP3956561B2 - Image data display system and image data generation method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a system for displaying image data, and more particularly to a system for displaying image data using a projector and a screen. The present invention also relates to a method for generating image data from virtual world data.
[0002]
[Prior art]
Conventional techniques related to an image data display system using a projector and a screen include the following.
[0003]
First, there is an “image projection system” described in JP-A-9-326981 and an international publication number WO 99/31877 “multi-projection video display device”. These systems project image data using a plurality of projectors on one large flat screen and provide a large screen image to the user. Based on pre-measured data, the image data to be projected is converted and then projected, so that it appears as if it was projected from one projector on the screen without any positional deviation, color tone, or luminance deviation. It is possible to provide large screen images.
[0004]
Also, video display systems such as the video display system described in Japanese Patent Laid-Open No. 9-311383 are known as systems that give a high sense of presence to the user by covering a wide portion of the user's visual field. These are characterized in that a certain space is surrounded by a screen by using a non-planar screen such as a spherical screen or a cylindrical screen, or by combining a flat screen. When a user views an image in a space surrounded by the screen, a wide portion of the field of view is covered with the image, and a high sense of reality can be obtained.
[0005]
As a method for generating image data to be projected by these systems based on virtual world data, a method using perspective transformation is used in common for both. Here, as an ideal viewpoint parameter used when performing perspective transformation, a case where a unique parameter is determined for each system and a user's head movement (from this, an approximate value of the user's viewpoint position can be obtained. ) To change the ideal viewpoint parameter in real time.
[0006]
[Problems to be solved by the invention]
When a conventional image data display system is used to display a wide range of images that give a high sense of realism to a large number of users, there are the following problems.
[0007]
First, when one large flat screen is used, it is difficult to cover a sufficient range of the user's visual field, and thus it is difficult to give a high sense of presence to the user.
[0008]
Further, when a certain space is surrounded by a screen, the space in which the user exists is surrounded by the screen, so that the range in which the user can move is limited within the apparatus.
[0009]
Here, if the size of the apparatus is increased in order to widen the range in which the user can move, the distance between the user and the screen increases, and it becomes impossible to perceive fine portions of the video. That is, the definition of the image perceived by the user deteriorates.
[0010]
From the above considerations, the present invention has the following objects regarding the image data display system.
[0011]
A first object of the present invention is to provide an image data display system capable of displaying a video that gives a high sense of realism to a large number of users over a wide range.
[0012]
The second object of the present invention is to achieve the first object and to display an image in a correct geometric shape regardless of an error in the arrangement of each element (for example, a projector or a screen) constituting the system. To provide an image data display system.
[0013]
A third object of the present invention is an image data display system provided with a projector and a screen, which can achieve the first object and has little distortion of each pixel of the projector. Is to provide.
[0014]
A fourth object of the present invention is to provide an image data display system that can achieve the third object and that images can be viewed seamlessly.
[0015]
Next, the image data generation method has the following problems.
[0016]
When image data is generated and displayed by a method based on perspective transformation, the user feels a greater sense of incongruity as the user moves away from the ideal viewpoint position. This means that when the viewpoint parameter is fixed, the user who is far from the ideal viewpoint position in a large apparatus (the ideal viewpoint position is one point, so most users are considered to meet this condition). This leads to a reduction in the sense of reality. Many other users who are not following the movement of the head even when the ideal viewpoint position is obtained in real time following the movement of the head of a certain user and video is created based on the viewpoint position. For this, the displayed video feels uncomfortable, leading to a reduction in realism.
[0017]
From the above considerations, the present invention has the following objects regarding the image data generation method.
[0018]
The first object of the present invention is to consider an image that allows a high-quality image to be viewed when viewed from that position in consideration of “from which position the image of this part is the most important image for the viewer” It is to provide a data generation method.
[0019]
Similar to the first object, the second object of the present invention is to consider “from which position the image of this part is important for the viewer”, and to view a high quality image when viewed from that position. It is another object of the present invention to provide an image data generation method that enables a video that is smoothly connected to the entire image display area to be obtained.
[0020]
The third object of the present invention is to provide an image with no discomfort over a wide viewing angle in a portion where the image display surface is concave, leading to a portion where the image display surface is concave. An object of the present invention is to provide an image data generation method in which an image that smoothly connects to an image of an adjacent concave portion can be obtained at a portion where the image display surface is convex.
[0021]
A fourth object of the present invention is to provide an image data generation method that allows easy-to-see video to be obtained according to each content when the display content of time-series image data is changed halfway.
[0022]
[Means for Solving the Problems]
In order to achieve the first object, the image data display system according to the present invention has a waveform on the image display surface.
[0023]
As a result, in the portion where the image display surface is concave, a wide range of the user's visual field can be covered with the video, and it is possible to give the user a high sense of realism in terms of the viewing angle.
[0024]
In addition, the image display surface can be smoothly moved between the concave portion of the image display surface and the concave portion of the image display surface via the convex portion of the image display surface. Therefore, the user can move over a wide range.
[0025]
At that time, the user can move along the image display surface, that is, while viewing the video while keeping the distance from the image display surface substantially constant. That is, there is no deterioration in definition due to the distance from the image display surface.
[0026]
In order to achieve the second object, the image data display system according to the present invention has an image data conversion means for converting the shape of the image display surface into a waveform and converting the image data based on given parameters. The image data is converted by the image data conversion means and displayed on the image display surface.
[0027]
Although it is difficult to install each component of the image data display system (for example, a projector and a screen) as designed, such a configuration makes it possible to install an error without adding new processing when generating image data. It is possible to display an image of a correct geometric shape that absorbs
[0028]
In order to achieve the third object, an image data display system according to the present invention includes a waveform-shaped screen, a plurality of projectors, and further converts image data based on given parameters. The image data converting means is provided. The plurality of projectors are installed so that the entire plurality of projection areas cover a given image display area, and the image data converted by the image conversion means is projected onto each projection area. So that
[0029]
With such a configuration, it is possible to subdivide the image display area and allow the projection light of the projector to strike the partial area from substantially the front. Further, the density of the projector projected onto the portion can be adjusted by the partial shape of the screen. For example, when the screen is viewed from the projector side, the density of the projector that projects onto the convex part of the screen can be higher than the density of the projector that projects onto the concave part. As a result, pixel distortion can be reduced as compared with the case of projecting with a single projector.
[0030]
In order to achieve the fourth object, an image data display system according to the present invention includes a waveform-shaped screen, a plurality of projectors, and further converts image data based on given parameters. The image data converting means is provided. The plurality of projectors are installed so that the whole projection display area covers the entire image display area, and the projectors adjacent to each other in the projection area are arranged so that the projection areas overlap each other. The image data converted by the image conversion means is projected onto the projection area.
[0031]
By adopting such a configuration, in addition to the effect of the configuration for achieving the third object, it is possible to eliminate the joint between the image areas projected from different projectors. That is, it is possible to obtain an image that is smoothly connected over the entire image display area.
[0032]
Next, in order to achieve the first object, the image data generation method according to the present invention classifies the pixels in the image data to be generated into several groups, and independent viewpoint parameters for each group. The pixel value of each pixel is obtained based on the viewpoint parameter corresponding to the group to which the pixel belongs.
[0033]
By adopting such a method, it is possible to divide the display area based on an appropriate standard such as display contents and to determine an ideal viewpoint position for each of the divided display areas. In other words, for each of the divided display areas, an image that allows high quality video to be viewed when viewing from that position, taking into account “from which position the video of this part is the most important video for the viewer” Data can be generated.
[0034]
In addition, the image data generation method according to the present invention achieves the second object, and in the method for achieving the first object, the viewpoint parameter determined independently for each group is set. The position of each pixel is changed smoothly in consideration of the position on the image display surface.
[0035]
By adopting such a method, for each of the divided display areas, the “high-quality video for this part of the image is taken into consideration”, and when viewed from that position, the quality is high. Image data can be generated so that an image can be viewed and a smoothly connected image can be obtained when viewed as an entire image display area.
[0036]
The image data generation method according to the present invention achieves the third object. In the method for achieving the second object, the portion where the image display surface is concave is a large display area. Is divided into one unit, and the pixels in the image data are classified based on the division, and the portion where the image display surface is convex is divided into a fine display area as one unit. Based on this, the pixels in the image data are classified.
[0037]
By adopting such a method, in the part where the image display surface is concave, over the wide viewing angle, an image without a sense of incongruity is obtained by the image data generated based on one viewpoint parameter, In the part where the image display surface is connected to the concave part of the image display surface, the image of the adjacent concave part is generated by the image data generated based on the viewpoint parameter that changes smoothly. You can get images that are connected smoothly.
[0038]
In addition, the image data generation method according to the present invention selects the viewpoint parameter determination method at each time of the time-series image data based on the display contents in order to achieve the fourth object.
[0039]
By adopting such a method, for example, in the case of display contents that have meaning only after appreciating the entire image display area, by defining an ideal viewpoint position as a whole and generating an image, It is possible to make a video that makes it meaningful to appreciate the whole, and when the semantic unit becomes local, subdivide the pixel classification and generate an image based on many viewpoint parameters Thus, it is possible to display an image that is easy to see for those who appreciate each local portion.
[0040]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, the image data display system and the image data generation method according to the first embodiment of the present invention will be described in detail with reference to FIGS.
[0041]
FIG. 1 is a conceptual diagram showing a first embodiment of a system according to the present invention.
[0042]
In FIG. 1, a rear projection screen 101 is a columnar screen standing vertically on a horizontal plane and having a corrugated cross section, and an image of an aquarium is displayed on the image display surface. The picture of the aquarium is that in the order from the left of the figure, there are aquariums, followed by pillars with a sticker called “Fuji”, followed by aquariums. The user can move from the location 111 to the location 113 via the location 112 while watching the video along the screen 101.
[0043]
Here, since the screen 101 is concave with respect to the user at the place 111 and the place 113, the user can view the image of the aquarium with the wide field of view surrounded by the screen. A feeling is obtained.
[0044]
In addition, since the screen 101 and the video are smoothly connected between the location 111 and the location 113 through a convex portion near the location 112, the user moves from the location 111 to the location 113 while watching the video. In addition, the presence of screens and video joints does not reduce the sense of reality.
[0045]
FIG. 2 is a plan view showing a first embodiment of the system according to the present invention.
[0046]
In FIG. 2, a projector 201, a projector 202, a projector 203, a projector 204, a projector 205, a projector 206, and a projector 207 project image data from the back side of the image display surface on the screen 101.
[0047]
For each projector pair adjacent to the projection area, the projector areas are installed so that the projection areas overlap each other. Further, since the image data is finely adjusted by the image data converting means described in detail in FIG. 3 and projected inside the projection area, each projector is projected when the projection area is designed. Install to cover the area.
[0048]
It is very difficult to connect the projection areas with an accuracy finer than one pixel for each pair of projectors adjacent to each other, particularly when a non-planar screen is used. If there is even a slight error, a region that is not projected from any projector is created, and a gap is formed between adjacent images, resulting in a reduction in the sense of reality. With respect to each projector pair in which the projection areas are adjacent to each other, by arranging the projection areas so as to overlap each other, it is possible to prevent a gap from being formed between adjacent images.
[0049]
Further, when installing the projector, it is preferable to install the projector so that its optical axis and the screen intersect at substantially right angles. This is because the degree of distortion of the pixels can be reduced by installing in this way, compared to the case of projecting from an oblique direction with respect to the screen.
[0050]
Further, except for a special case in which there is a difference in the importance of image data to be projected, it is preferable that all projectors are arranged so that the pixel sizes on the image display surface are substantially the same. By doing so, it is possible to provide the user with a video with uniform definition regardless of the place. Specifically, the adjustment can be performed by adjusting the distance from the projector to the screen, zooming, or adjusting the resolution of image data projected from the projector.
[0051]
In addition, when considering pixel distortion, a projector that projects an image onto a convex portion when viewed from the image projection side is used as a projector that projects an image onto a concave portion when viewed from the image projection side. It is better to install densely.
[0052]
FIG. 3 is a system block diagram showing a system configuration in the first embodiment of the present invention. However, although FIG. 2 shows a system including seven projectors, a case where there are three projectors will be described here in order to avoid complicated description.
[0053]
In FIG. 3, the command input unit 300 accepts video playback start and playback end commands from the system administrator and outputs the commands to the image supply unit 310, the image supply unit 320, and the image supply unit 330. Is.
[0054]
The image supply unit 310 includes image data 311 and a synchronization control unit 312. Here, the image data 311 is time-series image data, and may be compressed by some method as long as bitmap data corresponding to the frame number can be generated.
[0055]
The image supply unit 310 manages an appropriate frame in the image data 311 while managing the start and end of video playback and the synchronization of frame numbers with the image supply unit 320 and the image supply unit 330 by the synchronization control unit 312. Bitmap data corresponding to the number is generated and output to the image data conversion means 313.
[0056]
The image data conversion unit 313 includes an image conversion parameter 314, performs conversion based on the image conversion parameter 314 on the bitmap data input from the image supply unit 310, and outputs the converted data to the projector 201.
[0057]
The projector 201 projects the converted bitmap data input from the image data conversion unit 313 onto the screen 101.
[0058]
The image supply unit 320 includes image data 321 and a synchronization control unit 322. Here, the image data 321 is time-series image data, and may be compressed by some method as long as bitmap data corresponding to the frame number can be generated.
[0059]
The image supply unit 320 manages the appropriate frame of the image data 321 while managing the start and end of video playback and the synchronization of the frame numbers with the image supply unit 330 and the image supply unit 310 by the synchronization control unit 322. Bitmap data corresponding to the number is generated and output to the image data conversion means 323.
[0060]
The image data conversion unit 323 includes an image conversion parameter 324, performs conversion based on the image conversion parameter 324 on the bitmap data input from the image supply unit 320, and outputs the converted data to the projector 202.
[0061]
The projector 202 projects the converted bitmap data input from the image data conversion unit 323 toward the screen 101.
[0062]
The image supply unit 330 includes image data 331 and a synchronization control unit 332. Here, the image data 331 is time-series image data, and may be compressed by any method as long as bitmap data corresponding to the frame number can be generated.
[0063]
The image supply unit 330 manages an appropriate frame in the image data 331 while the synchronization control unit 332 manages the start and end of video playback and the synchronization of frame numbers with the image supply unit 310 and the image supply unit 320. Bitmap data corresponding to the number is generated and output to the image data conversion means 333.
[0064]
The image data conversion unit 333 includes an image conversion parameter 334, performs conversion based on the image conversion parameter 334 on the bitmap data input from the image supply unit 330, and outputs the converted data to the projector 203.
[0065]
The projector 203 projects the converted bitmap data input from the image data conversion unit 333 toward the screen 101.
[0066]
A method for generating the image data 311 and the like will be described in detail with reference to FIGS. These data can be created in advance or each frame as needed.
[0067]
Here, the conversion performed on the bitmap data by the image data conversion means includes geometric conversion and color conversion. The geometric transformation is, for example, transformation for correcting an error from a design value of data regarding the shape and arrangement of the screen and the projector. Color conversion is, for example, conversion for correcting color unevenness in the display area of individual projectors or differences in color tone due to individual differences among projectors. This is conversion for performing blending processing so as to obtain the same brightness as that of a portion projected from one projector.
[0068]
Examples of image data conversion means having such a function are disclosed in, for example, “Image Projection System” described in Japanese Patent Laid-Open No. 9-326981 and International Publication No. WO99 / 31877 “Multi-Projection Video Display Device”. Technology can be used. Applying these techniques to a screen having an arbitrary shape is easy if the screen shape is known.
[0069]
It should be noted that the image data 311 or the like previously converted by the emulation software that performs the same conversion as the image data conversion means 313 or the like is stored in advance as the image data 311 or the like. At the time of image reproduction, the bitmap data output from the image supply unit 310 or the like may be directly input to the projector 201 or the like and projected.
[0070]
The projector may be provided with a function of image data conversion means. In that case, for example, bitmap data that has undergone conversion other than “color conversion for luminance adjustment” is projected on the bitmap data input from the image supply means, and color conversion for luminance adjustment is performed. It is also possible to optically convert by an optical filter after projection.
[0071]
Such a configuration has the following effects. For example, when a liquid crystal projector is used as the projector, an image with the pixel values of all pixels (R, G, B) = (0, 0, 0) is displayed due to light leakage from the light source. However, the luminance does not become zero. In this case, the area that is the projection area of two or more projectors is brighter than the area that is the projection area of only one projector. In order to absorb this difference in brightness, in the method of projecting after converting bitmap data, it is necessary to adjust by increasing the brightness of the area that is the projection area of only one projector. , Leading to a decrease in contrast. On the other hand, when performing color conversion for brightness adjustment after projecting bitmap data, the brightness of the area that is the projection area of two or more projectors can be reduced, so the contrast is reduced. Differences in luminance can be absorbed without lowering.
[0072]
When the curvature of the screen is small and the degree of pixel distortion is acceptable, it is possible to use one projector and project an image from the projector onto the entire image display surface of the screen. Good. In that case, if the influence of the error from the design value of the data on the shape and arrangement of the screen and the projector is slight, the bitmap data output from the image supply means is used as it is from the projector without using the image data conversion means. You may make it project.
[0073]
In addition, when a CRT projector is used as the projector, the projection area is adjacent when the shape can be corrected by the distortion correction function provided in the projector to obtain an acceptable image quality with respect to the image at the boundary. With respect to each projector pair, the projection areas do not have to be installed so that they overlap each other, and the bitmap data output from the image supply means is projected as it is from the projector without using the image data conversion means. It may be.
[0074]
In FIG. 3, each projector includes an image supply unit and an image data conversion unit. However, one image supply unit and one single-input multiple-output image data conversion unit are provided for a plurality of projectors. And the image data conversion means inputs bitmap data from the image supply means, converts the bitmap data according to an image conversion parameter, and outputs appropriate bitmap data to each of the plurality of projectors. It is good also as such a structure. In this case, the “conversion” has an independent image conversion parameter for each output to each projector, so that each projector has an image supply unit and an image data conversion unit. Can be implemented.
[0075]
FIG. 4 is a flowchart of image generation processing in the first embodiment of the present invention. This image generation process describes the process for generating one frame of time-series image data. By repeating this process for each frame, the entire time-series image data can be generated. . As described with reference to FIG. 3, the influence of the error on the data regarding the shape and arrangement of the screen and the projector from the design value can be removed by the conversion of the bitmap data by the image data conversion means. Data regarding the shape and arrangement of the screen and projector may be considered using design values.
[0076]
When the image generation process is started in step 400, first, in step 401, a pixel whose pixel value is not yet determined is selected. Next, in step 402, it is calculated at which position on the image display surface of the screen the selected pixel is to be displayed. Next, in step 403, based on the display position calculated in step 402, the viewpoint parameters, particularly where the viewpoint position is set, are calculated. A specific example of the processing in step 403 will be described in detail with reference to FIGS. Next, in step 404, based on the viewpoint position calculated in step 403, Virtual world data Then, the pixel value of the selected pixel is calculated using the principle of perspective transformation.
[0077]
Here, the screen shape in the real world and the shape of the image generation surface in the virtual world have a similarity ratio R, similar to the case of generating images using the principle of perspective transformation in the field of virtual reality. The relationship between the position and orientation between the viewpoint position and the screen in the real world and the relationship between the position and orientation between the viewpoint position and the image generation plane in the virtual world are also similar with the similarity ratio R. Before starting the image generation processing of FIG. 4, after determining what kind of image generation plane arrangement the image of the frame is generated in accordance with the content to be displayed, in step 404 Based on the above relationship, the viewpoint position in the real world calculated in step 403 may be converted into the viewpoint position in the virtual world, and the pixel value may be calculated.
[0078]
Subsequently, in step 405, it is determined whether pixel values have been calculated for all pixels. If there is a pixel whose pixel value has not been obtained, the process returns to step 401 and the above processing is repeated. If pixel values have been obtained for all pixels, the image generation process is terminated (step 406).
[0079]
here, Virtual world data And now virtual It is used widely in fields such as reality, and includes, for example, three-dimensional data (object shape data and position / posture data). Virtual world data Often includes texture data and light source data in addition to the three-dimensional data. These data may change at each time, and may change according to a command from the user. If two-dimensional data such as characters is to be displayed, it may be pasted as a texture on a sign-shaped object and placed in a three-dimensional space representing the virtual world.
[0080]
Also, the display position calculation process in step 402 and the viewpoint parameter calculation process in step 403 can be different processes for each time.
[0081]
Since the display position calculation process can be changed at each time, for example, the resolution of an image to be projected can be changed at each time.
[0082]
Since the viewpoint parameter calculation process can be made different for each time, for example, the viewpoint parameter calculation method can be changed according to the display content.
[0083]
This can be done, for example, as follows. When the present invention is applied to a bank service counter (the portion under the counter desk is a waveform screen), a pattern (pattern 451) for displaying an interest rate, an exchange rate, etc. on the entire image display surface, and an image display area Are divided into a plurality of areas and a pattern (pattern 452) for displaying a plurality of document writing methods is alternately displayed. In this case, one viewpoint parameter is determined for the pattern 451, and the entire image is generated based on the one viewpoint parameter, as in the conventional method. A corresponding viewpoint parameter is determined for each of the images, and an image corresponding to each display area is generated based on the corresponding viewpoint parameter. In this way, for global information such as interest rates, it is possible to generate an image that looks correct when viewed as a whole (from the ideal viewpoint position), and local information such as how to write documents Can generate an image that looks right to the user who will use the information.
[0084]
In addition, since the viewpoint parameter calculation process can be made different at each time, the present invention performs a head tracking technique for each of a plurality of users, for example, and performs a time division to display a stereo image. It can also be applied to such cases. After calculating the viewpoint position of each user (for example, the position of the left eye for odd frames and the position of the right eye for even frames), the image area displayed near the front of each user Determines the pixel value based on the user's viewpoint position, and for other parts, interpolates from the viewpoint position of adjacent users, and determines the viewpoint position so that it changes smoothly as the display position changes. The pixel value may be obtained based on the viewpoint position.
[0085]
When the display position calculation process in step 402 and the viewpoint parameter calculation process in step 403 do not depend on time, the display position calculation process and the viewpoint parameter calculation process can be performed in advance to refer to the viewpoint parameter from the pixel position. Such a table may be created, and the viewpoint parameters may be obtained from the table instead of the processing of Step 402 and Step 403. In this way, the processing per pixel can be reduced.
[0086]
Even if the display position calculation processing in step 402 and the viewpoint parameter calculation processing in step 403 depend on time, if there are few processing patterns, a unique pattern identifier is assigned to each pattern. In addition, a display position calculation process and a viewpoint parameter calculation process are performed in advance for each pattern to create a table in which viewpoint parameters can be referred to from pixels and pattern identifiers. Instead of the processes in steps 402 and 403, The viewpoint parameter may be obtained from the table. In this way, processing can be reduced.
[0087]
In addition, when obtaining the pixel values of a plurality of pixels based on the same viewpoint parameter, the pixels having the same viewpoint parameter for obtaining the pixel value are collected to form each group, and for each group The display position calculation process and the viewpoint parameter calculation process need only be performed once. It goes without saying that this method is compatible with both of the methods for creating the table.
[0088]
As described above, by calculating the pixel value after setting the viewpoint parameter according to the display position of the pixel, for example, for each display position, “the image of this part is the most important image for the viewer from which position. It is possible to generate image data that allows a high-quality video to be viewed when viewed from that position.
[0089]
Hereinafter, a specific example of the processing in step 403 in FIG. 4 will be described with reference to FIGS.
[0090]
5, 6, and 8 are plan views illustrating an enlarged portion of the column from the water tank on the left side of FIG. 1, and FIG. 7 is an enlarged view of only a portion of the water tank. It is a top view.
[0091]
In addition, in the following, for easy understanding, the height of the viewpoint is set to a constant value h with respect to the floor surface. For example, if the video space is intended mainly for adult women as users, the value h may be set to a national average value of the height of the viewpoint of adult women.
[0092]
Hereinafter, a description will be given of how to obtain the remaining two parameters related to the viewpoint position (when the xyz coordinate system is used, the x coordinate and the y coordinate if the z axis is taken in the height direction).
[0093]
FIG. 5 is a diagram showing a first example of how to obtain the viewpoint parameter in the image generation processing according to the first embodiment of the present invention.
[0094]
In FIG. 5, the viewpoint position 502 is used for the area 501 where the aquarium image is displayed, and the viewpoint position 504 is used for the perspective transformation for the area 503 where the pillar image is displayed. Used as a viewpoint parameter (a viewpoint position parameter that is a part of).
[0095]
The viewpoint position 502 can be set to an arbitrary position based on an appropriate evaluation criterion as long as the entire area 501 can be looked over without being blocked by other parts of the screen. The viewpoint position 504 can be set to an arbitrary position based on an appropriate evaluation criterion as long as the entire area 503 can be looked over without being blocked by other portions of the screen.
[0096]
Despite the fact that the area 501 and the area 503 are continuous on the image display surface, the viewpoint position changes greatly, so that the displayed image has a sense of incongruity particularly near the boundary between the area 501 and the area 503. There will be something. However, since the division position of the area coincides with the meaning break in the video, the degree of uncomfortable feeling is small compared to the case where the division position of the area is determined at random.
[0097]
As described above, when the viewpoint positions are set discretely, it is possible to generate an image with a little sense of incongruity by matching an area generated based on each viewpoint position with a semantic break in the video. .
[0098]
Note that, as described with reference to FIG. 4, the viewpoint parameter calculation process of the present invention can be different for each time. Therefore, if the meaning break in the video changes with time, the region generated based on each viewpoint position is also changed according to the meaning break, and the correspondence between the display position and the viewpoint position is changed. You just have to ask for it.
[0099]
FIG. 6 is a diagram showing a second example of how to obtain the viewpoint parameter in the image generation processing according to the first embodiment of the present invention.
[0100]
In FIG. 6, when a display position 601 on the image display surface is given, first, a tangential plane 602 of the screen 101 at the display position 601 is obtained. Next, a plane 603 perpendicular to the tangential plane 602 and the horizontal plane is obtained. On the intersection line between the plane 603 and the horizontal plane passing through the display position 601, a point separated by a given distance d from the display position 601 toward the image display surface is a position of height h while keeping the x and y coordinates. The point 604 brought to is a point 604, and in the second example shown in FIG.
[0101]
In this way, by setting the viewpoint position at a certain distance from the screen surface, it is possible to provide a video with substantially uniform definition to a user who views each video area from the corresponding viewpoint position. be able to.
[0102]
Here, when the height of the viewpoint is a constant value, that is, when the object is clearly “adult female” or the like, the vertical field of view is just the image display on the screen 101. It is preferable to set so as to cover the entire vertical direction of the region. In the case of a smaller value, that is, when the viewpoint position is closer to the screen 101, when the target user views the image from the ideal viewpoint position, the image is left in the vertical direction, and a large image The entire display area cannot be used effectively. When the value is larger than this, that is, when the viewpoint position is further away from the screen 101, the definition of the image perceived by the user becomes low and the entire field of view of the user cannot be covered in the vertical direction. The sense of reality that you feel will be reduced.
[0103]
Note that when the object varies from an adult to a child, and the x-coordinate, y-coordinate, and z-coordinate of the viewpoint position are all changed, the value of the distance d is smaller than that when the viewpoint height is constant. It is good to do. This is because the ideal viewpoint position fluctuates up and down, so that the same value as when the viewpoint height is constant may cover the entire visual field of the user in the vertical direction when viewed from the ideal viewpoint position. Because it becomes impossible.
[0104]
FIG. 7 is a diagram showing a third example of how to obtain the viewpoint parameter in the image generation processing according to the first embodiment of the present invention. FIG. 7 corresponds to the case where the value of the distance d is large in FIG.
[0105]
In FIG. 7, when the viewpoint position parameter is obtained in the same way as in FIG. 6, the display position is displayed on the screen 101 as display position 701 → display position 702 → display position 703 → display position 704 → display position 705 → display position 706 → Along with the movement to the display position 707, the viewpoint position moves in the order of point 711 → point 712 → point 713 → point 714 → point 715 → point 712 → point 717. That is, the trajectory 710 in which the viewpoint position moves crosses halfway. Although it depends on the size of the actual screen, it is difficult to imagine that the locus of the user's viewpoint position actually moves like the locus 710 especially when the screen is not sufficiently large. Therefore, in such a case, regarding the portion from the display position 702 to the display position 706 via the display position 703, the display position 704, and the display position 705, the viewpoint position is collectively generated as the point 712. To do. That is, the locus of movement of the viewpoint position is made linear without crossover.
[0106]
At this time, the user walking while viewing the video from the viewpoint position 711 stops at the viewpoint position 712 and reaches from the display position 702 to the display position 706 via the display position 703, the display position 704, and the display position 705. After viewing a video that is displayed over a wide range and has no sense of incongruity, it is possible to proceed toward the viewpoint position 717.
[0107]
Thus, the method for obtaining the viewpoint parameter for each region may be changed based on the curvature of the screen.
[0108]
FIG. 8 is a diagram showing a fourth example of how to obtain viewpoint parameters in the image generation processing according to the first embodiment of the present invention.
[0109]
FIG. 8 assumes a case where the present system is applied to a side wall of an underground walkway. In this case, it can be assumed that the locus of movement of the user's viewpoint position is a straight line along the road, such as a locus 801.
[0110]
In such a case, for example, the x and y coordinates of the point 804 on the locus 801 closest to the display position 802 on the plan view are used as the x and y coordinates of the viewpoint position corresponding to the display position 802. And In FIG. 8, since the locus 801 is assumed to be a straight line, the point 804 can be obtained as a foot of a perpendicular line 803 drawn from the display position 802 on the plan view with respect to the locus 801.
[0111]
In this way, a trajectory in which the viewpoint position of the user moves is assumed in advance, and the viewpoint position may be determined on the trajectory. In this case, the locus assumed in advance is not limited to a straight line, and the method of determining the viewpoint position from the display position and the locus is “the point on the locus closest to the display position on the plan view”. It is not limited.
[0112]
As described above with reference to FIGS. 6 to 8, by continuously changing the viewpoint position with respect to the continuous change of the display position, the image displayed on the screen is smoothly connected, A high sense of reality can be maintained.
[0113]
Note that the essence of the image generation processing according to the present invention is to determine the pixel value of each pixel in the image using the viewpoint parameter obtained according to the display position of the pixel on the image display surface. The specific implementation method for obtaining the viewpoint parameter from the display position is not limited to the method shown in FIGS. In particular, the height of the viewpoint position is not limited to a fixed value, and the method for determining the distance d on the plan view between the screen and the viewpoint position is not limited to the exemplified one.
[0114]
For example, the present invention can also be applied to a case where a stereo image is generated in advance assuming the position of the user's head. From the display position and the position of the user's head, the direction in which the user's head is facing when the user is gazing at the display position is obtained. What is necessary is just to determine the pixel value of a corresponding pixel.
[0115]
FIG. 9 shows an example in which a corrugated screen is configured by combining a flat screen 901, a flat screen 903, and a flat screen 905 with a cylindrical screen 902 and a cylindrical screen 904. Here, the cylindrical screen means a screen whose image display surface is a part of the cylindrical surface. Here, each flat screen is installed so that the image display surface coincides with the tangential plane of the cylindrical surface at the boundary position at the boundary with the cylindrical screen adjacent thereto.
[0116]
As described above, the “wave screen” in the present invention may include a flat screen. In this case, it is possible to obtain such effects that the flat screen portion has little pixel distortion and that the overlapping in the areas projected from the plurality of projectors is easy.
[0117]
As described above, according to the description based on the embodiment of the present invention, the present invention is a field for displaying an image over a wide display area, for example, a system for displaying a large screen image on a wall of a showroom or the like. The present invention is particularly suitable for a system that displays various information using the lower part of a service counter such as a bank / airport as an image display surface, a system that displays a horizontally long image along an underground walkway, and the like.
[0118]
The present invention is not limited to the embodiment of the invention, and it goes without saying that various changes can be made without departing from the scope of the invention. In particular, the image generation process of the present invention is not limited to the case of generating an image to be displayed on a waveform image display surface, but for displaying an image display surface of an arbitrary shape there. This can be applied when generating an image.
[0119]
【The invention's effect】
As described above, according to the present invention, the following effects can be obtained.
[0120]
First, since the image data display system of the present invention has a corrugated screen, the user walks one after another while watching the video near the screen in a space that covers a wide range of the user's visual field. I can go.
[0121]
In addition, since the image data display system of the present invention includes image data conversion means, and the image data is converted by the image data conversion means and displayed on the screen, the shape and arrangement of the actually installed screen and projector Even when there is an error with respect to the design data, the video intended by the image data producer can be provided to the user.
[0122]
In addition, the image data display system of the present invention includes a plurality of projectors, and the plurality of projectors are arranged according to the shape of the screen, so that an image with less distortion of each pixel can be provided to the user. it can.
[0123]
The image data display system of the present invention includes an image data conversion unit and a plurality of projectors, and is configured to display the image data on the screen after being converted by the image data conversion unit. It is possible to provide a user with a fine image with less pixel distortion.
[0124]
In the image data generation method of the present invention, the pixel value is determined by the viewpoint parameter determined depending on the display position of the pixel at each time, so that “the most beautiful” is displayed according to the display content for each display position. It is possible to generate image data that can display “the most beautiful video for those who want to see it”.
[0125]
In addition, the image data generation method of the present invention is configured so that the viewpoint parameter also changes smoothly with a smooth change in the display position, so that the image data is generated even when the viewpoint position is changed. As a whole display area, a smoothly connected image can be obtained.
[0126]
In addition, the image data generation method of the present invention has no effect at all when the viewpoint parameters are changed discretely by matching the meaning breaks in the video with the boundaries of the display areas generated with different viewpoint parameters. Compared with the case where discrete viewpoint parameters are determined intentionally, the degree of uncomfortable feeling of the entire video can be reduced.
[Brief description of the drawings]
FIG. 1 is a conceptual diagram showing a first embodiment of a system according to the present invention.
FIG. 2 is a plan view showing a first embodiment of the system according to the present invention.
FIG. 3 is a system block diagram showing a system configuration in the first embodiment of the present invention.
FIG. 4 is a flowchart of image generation processing according to the first embodiment of the present invention.
FIG. 5 is a diagram illustrating a first example of how to obtain viewpoint parameters in the image generation processing according to the first embodiment of the present invention.
FIG. 6 is a diagram illustrating a second example of how to obtain viewpoint parameters in the image generation processing according to the first embodiment of the present invention.
FIG. 7 is a diagram illustrating a third example of how to obtain viewpoint parameters in the image generation processing according to the first embodiment of the present invention.
FIG. 8 is a diagram showing a fourth example of how to obtain viewpoint parameters in the image generation processing according to the first embodiment of the present invention.
FIG. 9 is a plan view showing an example of screen arrangement when a flat screen is provided in the system according to the first embodiment of the present invention.
[Explanation of symbols]
101, 901, 902, 903, 904, 905 ... screen
201, 202, 203, 204, 205, 206, 207 ... Projector
313, 323, 333 ... image data conversion means
502, 504, 604, 804 ... viewpoint position
711, 712, 713, 714, 715, 717 ...... Viewpoint position
601 802 ... Display position
701, 702, 703, 704, 705, 706, 707 ... display position
605, 710, 801 ... Trajectory of movement of viewpoint position

Claims (12)

In an image display system for displaying an image generated by an image generation device on a display unit,
The image generation device includes:
A setting unit that sets a viewpoint parameter corresponding to the pixel based on a position on the display unit where each pixel of the image is to be displayed;
A determination unit that determines a pixel value of the pixel based on the viewpoint parameter set by the setting unit;
A calculation unit that calculates a position on the display unit to display each pixel of the image;
The said setting part is an image display system which sets the viewpoint parameter of each pixel based on the position calculated by the said calculation part, and the curvature of the said display part. The setting unit performs different processing every predetermined time.
The image display system according to claim 1 . A detection unit for detecting the viewer's viewpoint position;
The setting unit is based on the position on the display unit and the viewpoint position detected by the detection unit.
The image display system according to claim 2 , wherein a viewpoint parameter of each pixel is set. The display unit includes a concave portion and a convex portion,
Claims 1 to 3 image display system according. In an image display system for displaying an image generated by an image generation device on a display unit,
The image generation device includes:
A setting unit that sets a viewpoint parameter corresponding to the pixel based on a position on the display unit where each pixel of the image is to be displayed;
A determination unit that determines a pixel value of the pixel based on the viewpoint parameter set by the setting unit;
The image display system , wherein the setting unit sets the viewpoint parameter so as to change smoothly with respect to a position on the display unit. The viewpoint parameter is a parameter representing the viewpoint position claims 1 to 5 image display system according. In an image generation apparatus that generates an image to be displayed on a display unit,
A setting unit that sets a viewpoint parameter corresponding to the pixel based on a position on the display unit where each pixel of the image is to be displayed ;
A determination unit that determines a pixel value of the pixel based on the viewpoint parameter set by the setting unit;
A calculation unit that calculates a position on the display unit to display each pixel of the image;
The image generation device, wherein the setting unit sets a viewpoint parameter of each pixel based on the position calculated by the calculation unit and the curvature of the display unit.   In an image generation apparatus that generates an image to be displayed on a display unit,
  A setting unit that sets a viewpoint parameter corresponding to the pixel based on a position on the display unit where each pixel of the image is to be displayed;
  A determination unit that determines a pixel value of the pixel based on the viewpoint parameter set by the setting unit;
  The image display system, wherein the setting unit sets the viewpoint parameter so as to change smoothly with respect to a position on the display unit. In an image generation method for generating an image for display on a display unit,
A setting step for setting a viewpoint parameter corresponding to the pixel based on a position on the display unit where each pixel of the image is to be displayed ;
A determination step of determining a pixel value of the pixel based on the viewpoint parameter set by the setting step;
A calculation step of calculating a position on the display unit where each pixel of the image is to be displayed;
The image generation method in which the setting step sets the viewpoint parameter of each pixel based on the position calculated by the calculation step and the curvature of the display unit.   In an image generation method for generating an image for display on a display unit,
  A setting step for setting a viewpoint parameter corresponding to the pixel based on a position on the display unit where each pixel of the image is to be displayed;
  Determining a pixel value of the pixel based on the viewpoint parameter set by the setting step, and
  The image generation method in which the setting step sets the viewpoint parameter so as to smoothly change with respect to the position on the display unit.   In a storage medium storing a program for causing a computer to realize a function of generating an image to be displayed on a display unit,
  A calculation function for calculating a position on the display unit to display each pixel of the image;
  A setting function for setting a viewpoint parameter corresponding to each pixel based on the position calculated by the calculation function and the curvature of the display unit; and
  A storage medium for storing a program for causing a computer to realize a determination function for determining a pixel value of each pixel based on a viewpoint parameter set by the setting function.   In a storage medium storing a program for causing a computer to realize a function of generating an image to be displayed on a display unit,
  Based on the position on the display unit where each pixel of the image is to be displayed, a setting function for setting a viewpoint parameter corresponding to each pixel so as to change smoothly with respect to the position on the display unit;
  A storage medium for storing a program for causing a computer to realize a determination function for determining a pixel value of each pixel based on a viewpoint parameter set by the setting function.

Images