KR20170029805A - Shooting system for time slice image and image correction method therefor, and providing method thereby - Google Patents

Abstract

The present invention relates to a time slice. The present invention includes: a plurality of cameras which shoot a time slice image; an error correcting unit which is shot by the cameras, respectively and provides an offset reference value for correcting the errors of the time slice images; a terminal which corrects the errors of the images shot by the cameras based on the offset reference value and processes the image into the time slice image by synthesizing each image which is corrected; and a server which provides the time slice image processed in the terminal to be downloaded. The present invention can provide the time slice image whose error is corrected.

Description

Technical Field [0001] The present invention relates to a time slice image capturing system, an image correction method for the time slice image capturing system, and a method of providing image by using the time slice image capturing system,

The present invention relates to a time slice time slice image capturing system, an image correction method therefor, and a method of providing an image thereof. More particularly, the present invention relates to a system for error correction of a time slice image providing a 3D feeling And an image correction method therefor, and a method of providing an image therefrom.

In general, a time slice is a technique of arranging a plurality of cameras around an object in an arcuate shape or a circular shape, and at the same time, picking up an image of a subject, and then synthesizing the images so that the images are continuously connected to each other. Such a time slice is an image captured by a still camera, but since the image is synthesized at the same time from the four sides of the subject, the time slice provides a video image of a moving image of the subject while moving around the subject. That is, the time slice provides a stereoscopic image.

However, the time slice has a problem in that an installation error due to difference in height or distance of cameras installed on all sides of the subject, difference in the inclination angle of the ground, and miss focus in which the focus is not set at the center of the subject, Likewise, inconsistencies of actually captured images occur. That is, the time slice has an inevitable geometrical error due to the error that occurs when the camera is arranged according to the multi-view camera array.

This error represents, inter alia, the geometrical error in one-dimensional parallel camera arrays and one-dimensional arcuate camera arrays. In principle, the multi-view camera array is set to keep the arrangement intervals and angles of the cameras constant. However, when the cameras are arranged according to the multi-view camera array, errors arise due to the problem of placing the cameras by hand. This error refers to the inconsistency of internal parameters such as camera position and direction, and focal length. The resulting geometric error makes it difficult to match the photographed images.

3-D image processing based on matching between images, ie, correlation, affects time and accuracy in depth map generation, intermediate image generation, and so on, which may affect encoding efficiency. In addition, there is a problem that it is difficult to obtain a smooth viewpoint change in viewing the generated multi-view video. Accordingly, there is a need for an apparatus and method for compensating for such geometrical errors.

To improve this, the cameras first take an error correction unit that provides a reference position of an image before capturing an actual object. This error correction unit is typically constituted by a ball 50 installed in the tripod 11 as shown in FIG. 2, which is disclosed in Registration No. 10-1457888 (registered trademark) . The error correction unit composed of the tripod 11 and the ball 50 is picked up by the plurality of cameras 10 before capturing an actual object to be applied to the time slice. The ball 50 is used as an offset reference value for matching the viewpoints of the images captured by the respective cameras 10 when capturing an actual object. That is, the ball 50 substantially provides the offset reference value for the viewpoint correction. Therefore, the time deviation is corrected based on the above-described offset reference value at the time of synthesizing the actual subject images captured by the plurality of cameras 10.

However, since the error correction unit is constituted by one ball 50 and can not identify the center part according to the size or height of the actual object, it can not provide an offset reference value that makes the viewpoint coincide with the center part of the actual object to be imaged, In addition, since the slope of the subject of the image can not be confirmed, an offset reference value for matching the slope can not be provided. Further, information about the size and height of the subject can not be obtained. Even when the objects are picked up at different sizes, they do not provide an offset reference value for matching them. Therefore, the time difference, the tilt deviation, or the size deviation of the subject is not substantially corrected when the captured image is synthesized.

In order to improve this, an error correction unit of a registered patent No. 10-1548236 (registered trademark) of the Korean Intellectual Property Office (KIPO) is a triangular pyramid (triangular pyramid) instead of the ball 50 described above in the tripod 63 62 are provided. The cylinder 61 is tapered to RGB tape of red (R), green (G) and blue (B) on its surface, and is picked up by a plurality of cameras together with the triangular pyramid 62. The RGB tape of the cylinder 61 is used as an offset reference value for matching the colors of the cameras. The line segments or inner angles connecting the vertexes of the triangular pyramid 62 are used as offset reference values to match the viewpoints and tilt of the cameras. That is, the cylinder 61 and the triangular pyramid 62 substantially provide an offset reference value for correcting the color, the viewpoint, or the slope of the images captured by the respective cameras. Accordingly, the color deviation, the time deviation, or the tilt deviation are corrected based on the offset reference value described above when synthesizing the actual subject images captured by a plurality of cameras.

However, since the error correction unit can not identify the center portion according to the size or height of the actual subject, it can not provide an offset reference value that makes the viewpoint coincide with the center of the subject. In addition, It is not possible to provide an offset reference value for matching the subject even if the subject is picked up at a different size due to the difference in distance between the cameras. Therefore, the time difference and the size deviation of the subject are not substantially corrected when the captured image is synthesized.

On the other hand, in the case of a stereo camera system, image rectification can be used to correct the deviation. The image alignment method is a method in which all the epipolar lines of the two images are paralleled and the vertical mismatch is straightened.

When image alignment is performed, the two image planes are located on the same plane and the corresponding points of the two images have the same vertical coordinate. Many algorithms have been proposed for such stereo image alignment.

However, there are relatively few studies on the correction of the geometric error in the time slice, and there are not many available algorithms.

In addition, the time slice has been mostly used in movies or drama, but a system and a method for providing it in various other methods have not been developed.

KR 10-1457888 KT 10-1548236

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above-mentioned problems, and it is an object of the present invention to provide a method and apparatus for displaying a plurality of reference positions corresponding to a height of a subject so as to set offset reference values according to height, tilt and / It is an object of the present invention to provide a time slice photographing system equipped with an apparatus.

In particular, it is possible to provide an error correction unit for a time slice image, which can vary the reference position to a height corresponding to the height of the subject, and furthermore, the constituent elements are constructed in a prefabricated manner and furthermore, The purpose is another purpose.

Another object of the present invention is to provide an image correction method for correcting errors of images for a time slice image due to a geometrical error of a camera array through the above-described system.

It is another object of the present invention to provide a system for providing a time slice image in which errors are corrected by the above-described system and method in various ways.

According to an aspect of the present invention, there is provided a time slice photographing system including: a plurality of cameras installed to photograph a time slice image; An error correction unit which is provided at a position corresponding to a position of a subject of the time slice image and is used to provide an offset reference value for correcting errors of the time slice images to the cameras; At least one of receiving an image of a subject of the time slice image through the cameras, correcting an error of each of the images based on the offset reference value, and synthesizing the corrected images to form a time slice image Terminal; And a server for providing the time slice image processed in the terminal according to a download request of the time slice image processed in the terminal.

Wherein the error correction unit comprises: a stand having a length corresponding to the height of the subject of the time slice image by the cameras and being vertically erected; And a marker member installed on the stand for displaying a plurality of reference positions for setting the offset reference value.

The marker members are spaced apart from each other along the longitudinal direction of the stand, and have a structure in which a plurality of the markers are picked up in the same shape even when picked up from all directions by the cameras.

The marker member is constituted by, for example, at least one of a ball imaged in a circular shape in all directions by the cameras, a cylinder imaged in a square shape in all directions or a cone imaged in a triangular shape in all directions.

The stand may comprise, for example, a pole having a length in the vertical direction; And a base for supporting a lower portion of the pole.

The pawl is required to be composed of, for example, a plurality of bars detachably coupled to each other to form a vertical length.

The base may be constituted by, for example, a tripod in which the pole is vertically coupled to the upper portion, or a plate-shaped member.

The marker member may include, for example, a first marker installed at a lower portion or a center of the stand; And a second marker disposed on the stand so as to be spaced apart from the first marker and aligned with the first marker.

The marker member may further include a third marker provided on the stand so as to be spaced apart from the second marker and aligned with the second marker.

The marker member may be formed in the form of a ball, a cylinder, or a cone having a through-hole through which the stand is penetrated.

The marker member may be configured such that the hue of the first marker and the hue of the second marker are different from each other.

The marker member may include, for example, a circular globe having a through hole through which the stand vertically penetrates; And a fastener detachably attaching the globe to the stand.

The fastener may include, for example, a sleeve fixed to the globe and into which the stand is inserted; And a clamp that couples the sleeve to the stand and restrains the stand to the stand.

The clamp may comprise, for example, a stop screw passing through the sleeve and pressing the stand.

Alternatively, the clamp may include, for example, a collet integrally formed at a lower portion of the sleeve and extending and contracting along the circumferential direction of the sleeve; And an incline nut screwed into the collet and having an inclined surface in the inside.

The marker member needs to further include at least one illumination module that emits illumination of a color set inside the globe to emit the globe

Meanwhile, a method of correcting an image of a time slice image according to the present invention is characterized in that the error correction unit (a multi-sphere correcting device in which two or more spheres are arranged at regular intervals above and below the support) and a time slice image (A) a calibration method for determining a calibration parameter value for a geometrical error of each camera using the multispherical alignment apparatus in the calibration unit, the calibration method comprising the steps of: And (b) an image correction step of correcting and outputting an image of an actual subject photographed using the calibration parameters obtained in the step (a).

 The step (a) includes, for example, (a-1) arranging two or more cameras on the circumference at regular angular intervals with the same radius R on the same center point; (a-2) positioning the multi-ball alignment device at a center point of the circle; (a-3) setting at least one of zoom, iris, ISO, or resolution of each camera so that the center of each camera image is the center of the multi-ball alignment device; (a-4) acquiring an image of the multi-balloon correction device in each camera through the image input unit of the calibration unit, and (a-5) determining calibration variables for each image through the control unit of the calibration unit And storing the generated data.

The calibration value of step (a-5) may be determined by determining at least one calibration variable for XY shift, tilt, or size in the controller, Can be stored in the storage unit as a calibration variable value chart.

The multi-ball alignment apparatus is configured such that three spheres (marker members) are arranged vertically at upper and lower portions on a support stand (upper stand) with an upper sphere (third marker), a middle sphere (second marker) and a lower sphere And the calibration parameter for the XY position movement may be configured such that the center value of the intermediate sphere of the multi-sphere correcting apparatus is determined by the positional shift with respect to the XY coordinates of the actual position and the photographed image.

In the multi-ball alignment apparatus, three spheres (marker members) are vertically arranged at upper and lower sides with a top sphere (third marker), a middle sphere (second marker) and a bottom sphere (third marker) And the center value of the upper sphere is a value in which the position between the actual position and the photographed image is inclined based on the center value of the lower sphere of the multi-sphere correcting apparatus, using the upper sphere and the lower sphere Can be determined.

In the multi-ball alignment apparatus, three spheres (marker members) are vertically arranged at upper and lower sides with a top sphere (third marker), a middle sphere (second marker) and a bottom sphere (third marker) , And the calibration parameter for the size may be determined using a distance between an actual position of the center value of the lower end sphere of the upper sphere and a distance between the actual position of the lower sphere and the center of the multi-sphere correcting device.

The step (b) may include, for example, removing the multi-ball alignment device and positioning the subject in the center of the camera; Acquiring an image of a subject in each camera through an image input unit of the calibration unit; And the control unit of the calibration unit applies a calibration variable value stored in an image of each camera to the image of each subject to output a corrected image.

Meanwhile, in the time slice image providing method according to the present invention, an error correcting unit installed at the center of the cameras is imaged through the cameras to correct errors of the cameras taken by the time slice images A first step of acquiring an error correction image; A second step of calculating an offset reference value applied to the image error correction of each camera based on the error correction images; A third step of capturing an actual object necessary for the time slice image through the cameras and acquiring an object image from each of the cameras; A fourth step of calibrating an error of the subject images based on the offset reference value to generate correction images; A fifth step of synthesizing the correction images to provide a composite image in which the correction images are successively connected; And converting the composite image into a downloadable download file, or printing at least one of the corrected images.

The fifth step includes, for example, a fifth step of synthesizing the corrected images to generate the composite image; And (5-2) displaying the generated composite image.

The sixth step may further include a step 6-1 of providing the download file to the portable storage.

The present invention may further comprise: (6-2) uploading the download file to a preset site; A step (6-3) of setting at least one of information of the site and information of connection of the site; A step of receiving the set information and approving the connection according to whether the set information is matched; And transmitting the download file corresponding to the set information to the requested address if the set information matches.

The present invention may further include a sixth step of transmitting the set information by printing and outputting the set information.

In the sixth to sixth steps, the information may be output to the card through the print.

The sixth step may be configured to downloadably convert the composite image or convert the composite image into a moving image.

The present invention further includes a seventh step of performing at least one of a background image and a foreground image on the corrected image, which is performed after the fourth step.

The present invention may further comprise an eighth step of performing at least one of a background image and a foreground image on the composite image, which is performed after the fifth step.

The time slice image photographing system according to the present invention as described above can provide a more precise offset reference value through the error correction unit.

Since a plurality of marker members for indicating a reference position are provided on a stand having a length corresponding to the height of the subject, at least two reference positions corresponding to the height of the subject to be photographed for time slicing, So that the offset reference value corresponding to the height and slope of the subject can be calculated through the plurality of reference positions.

Particularly, even when a plurality of marker members are photographed from all directions, they are formed in the shape of a cylinder, a cone, or a ball forming the same shape, so that even if a marker member is photographed from any one of cameras disposed on all four sides of the marker member, The center of the marker member can be easily derived.

In addition, since the stand is constituted by the pawl supported by the base, the stand corresponding to the height of the subject can be easily configured. In addition, since the pawl is constituted of a plurality of pawls which are detachably coupled, In addition, the base can be easily assembled and used. Furthermore, the base is made of a teleportible tripod, so that the height of the stand can be adjusted additionally through the tripod if necessary, and the pole can be easily installed vertically on a slope. .

In the case where the plurality of marker members are constituted by the first marker and the second marker which are respectively installed on both sides of the stand, two reference positions are provided to calculate the offset reference value through the separation distance of the reference position, When the three markers are additionally provided, the offset reference value may be calculated through the marker positioned at the middle among the first to third markers.

In addition, when the marker member is fixed to the pole of the stand by interference fit, the marker member can be fixed to the pole without any additional parts. In addition, even if the marker member is moved along the longitudinal direction of the pole, The fixing position of the marker member can be easily changed, and furthermore, when the marker member is formed in a ball shape by the foam foam, the marker member can be easily manufactured at low cost.

In addition, when the plurality of marker members are configured in different colors, the reference position by the marker member can be easily identified, and the offset reference value for color correction can be provided through the hue of the marker member. In particular, The reference position of the marker member can be easily identified even at a long distance and at night when the light is emitted by the illumination module, and the hue of the marker member can be easily converted through the illumination module.

Furthermore, when the marker member is constituted by a circular globe provided on the stand by the fastener, the brittleness of the marker member can be reinforced and durability can be improved. Moreover, when the fastener is constituted by the sleeve and the clamp, It is possible to easily move the glove while sliding the glove along the direction.

In addition, the clamp can be easily configured if the clamp consists of a stop screw, otherwise the collet grips the pawl by tightening the incline nut when the clamp consists of a collet and an incline nut, thereby securing the sleeve to the pawl .

In addition, a chroma key screen can be provided to easily combine a time slice image with another image, and in addition, a time slice image in a state in which a subject is suspended when a wire is added can be provided.

In addition, it is also possible to provide a time slice image in a state in which the subject is seated on a levitated object using a levitated object, or to provide an image of a levitated object in a captured time slice image.

In addition, if the subject is a person, a rotation mechanism that jumps the subject instantaneously is provided, and the time-slice image can be captured by jumping the subject in accordance with the rotation of the rotation mechanism.

On the other hand, a method of correcting an image of a time slice image according to the present invention sets a correction value for a geometrical error of each camera using an error correction unit (multi-sphere correction device) before photographing a subject, Since the correction value for the image input from the camera is reflected for each camera, the geometrical error can be reduced, so that a more accurate image can be obtained.

On the other hand, the time slice image providing method according to the present invention can provide a time slice image that is corrected as described above on the basis of an error correction unit, or can be provided by downloading or printing, .

Particularly, a time slice image can be picked up at a place where a lot of amusement parks or people gather, and a captured image can be downloaded or printed and provided.

In addition, the corrected time slice image may be synthesized and displayed before downloading or printing to confirm the synthesized image. In addition, the downloaded download file may be stored in a portable storage, A file can be uploaded to a specific site and the download file can be transferred according to the set information.

In addition, it is also possible to set information capable of identifying the photographed time slice image and to provide the information by printing it on a card, a souvenir or a thin film material (e.g., paper, vinyl, thin plate) or a specific object.

In addition, the photographed time slice image may be synthesized or the synthesized image may be converted into a moving image so as to be downloadable, so that the photographed image can be provided in various forms.

In addition, since the background image and / or the foreground image separately photographed on the photographed image can be synthesized and provided, it is possible to provide a virtual reality image that exceeds the construction.

1 is a conceptual diagram of a general time slice image taken by a plurality of cameras;
2 is a perspective view showing a state of use of an error correction unit for a time slice image according to the related art;
3 is a perspective view of an error correction unit for a time slice image according to still another prior art;
4 is a perspective view of an error correction unit for a time slice image according to an embodiment of the present invention;
FIG. 5 is a perspective view illustrating a process of extracting a center of the marker member shown in FIG. 4; FIG.
FIG. 6 is an exploded perspective view of the error correction unit shown in FIG. 4; FIG.
FIG. 7 is a perspective view showing another embodiment of the fastener shown in FIG. 6; FIG.
8 is a longitudinal sectional view showing the use state of the fastener shown in Fig. 7; Fig.
Fig. 9 is a front view showing another embodiment of the clamp shown in Fig. 6; Fig.
10 is a perspective view showing the lighting module mounted on the globe shown in Fig. 7; Fig.
11 is a conceptual diagram showing the photographing state of the error correction unit shown in FIG. 4;
FIG. 12 is a conceptual diagram showing an image of an error correction unit photographed by each of the cameras shown in FIG. 11;
FIG. 13 is a conceptual diagram showing setting of a center coordinate offset reference value through the error correction unit shown in FIG. 11; FIG.
FIG. 14 is a conceptual diagram showing another embodiment of the error correction unit shown in FIG. 4; FIG.
FIG. 15 is a conceptual diagram showing setting of a slope offset reference value through the error correction unit shown in FIG. 14; FIG.
FIG. 16 is a conceptual diagram showing setting of a height offset reference value through the error correction unit shown in FIG. 14; FIG.
FIG. 17 is a conceptual diagram showing shooting of a subject by the cameras shown in FIG. 14; FIG.
FIG. 18 is a conceptual diagram showing images of respective cameras photographed by FIG. 17; FIG.
FIG. 19 is a conceptual diagram showing an application state of the reference coordinate offset reference value shown in FIG. 13; FIG.
FIG. 20 is a conceptual diagram showing an application state of the slope offset reference value shown in FIG. 15; FIG.
FIG. 21 is a conceptual diagram showing an application state of the height offset reference value shown in FIG. 16;
FIG. 22 is a conceptual diagram showing the installation state of the camera shown in FIG. 17;
23 is a conceptual diagram showing an installation error of the camera shown in Fig. 22;
FIG. 24 is a conceptual diagram schematically showing various embodiments of the error correction unit shown in FIG. 4; FIG.
25 is an exemplary view for explaining the configuration of the error correction unit shown in Fig. 24; Fig.
FIG. 26 is a plan view schematically showing an installation state of the camera shown in FIG. 17; FIG.
Figs. 27 to 32 are illustrations for explaining a method for obtaining a calibration variable through the error correction unit shown in Fig. 24; Fig.
FIG. 33 is a block diagram showing an apparatus applied to a method of correcting the error correction shown in FIG. 24 based on a unit; FIG.
FIG. 34 is a detailed configuration diagram of the calibration unit shown in FIG. 33; FIG.
35 is a flowchart for explaining a calibration method using the apparatus shown in Fig. 33;
Figs. 36 to 40 are reference drawings for explaining a calibration method using two marker members (two spheres) out of the error correction units shown in Fig. 24;
FIG. 41 is a block diagram showing a configuration of a system according to an embodiment of the present invention to which the error correction unit shown in FIG. 4 is applied; FIG. And
42 to 44 are flowcharts showing a method of providing a time slice image using the system shown in FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a time slice image capturing system according to an embodiment of the present invention, an image correction method therefor, and a method of providing an image according to the present invention will be described with reference to the accompanying drawings.

The time slice image photographing system according to the embodiment of the present invention includes a plurality of cameras, an error correction unit, a terminal, and a server as shown in FIG.

11, 17, and 26, the cameras are installed in such a manner that they can photograph a time slice image. That is, the cameras are arranged in a circular or circular shape around the photographing point.

The error correction unit is provided at a position corresponding to the point where the subject of the time slice image is located, and is used to provide offset reference values for correcting the error of the time slice images respectively captured by the cameras.

The terminal receives each image of the subject of the time slice image through the cameras described above, corrects the error of each image based on the offset reference value, and synthesizes each corrected image to form a time slice image. The terminals may be composed of a single number or a plurality of terminals. For example, such a terminal may include a main terminal that provides a photographing mode so that photographing of a time slice image is possible, and controls all the cameras to operate simultaneously according to an input value according to the photographing mode, A sub terminal for performing correction after applying the offset reference value, and an additional terminal for processing the synthesized image as a moving image as described below.

The server receives the processed time slice image from the terminal and provides the processed time slice image in the terminal according to the download request. Such a server provides downloadable content and provides a time slice image in response to a download request.

On the other hand, the image error correction unit may include, for example, the stand 110 and 120 and the marker member 130 as shown in FIG. The stands 110 and 120 have a length corresponding to the height of an actual subject, such as a human body, as shown in Figs. That is, the stands 110 and 120 have lengths corresponding to the height of the subject of the time slice image by the cameras. The stands 110 and 120 are vertically erected as shown in FIG. 4 to correspond to the height of the subject. The stands 110 and 120 may include a pole 110 having a length as shown in FIG. 4 and a base 120 supporting a lower portion of the pole 110.

The pawls 110 may be constructed of a plurality of bars which are detachably coupled to each other to form a vertical length, for example, as shown in Fig. The plurality of bars are detachably coupled to each other by a coupler. Such a coupler may be composed of, for example, a female screw 112 and a male screw 111 which are formed at both ends of the bars as shown in FIG. That is, the coupler detachably couples the plurality of bars with a screw connection. Thus, the pawl 110 is assembled as needed to form a length corresponding to the height of the actual subject, but is normally kept or carried in a separate state.

The base 120 may be constructed of a conventional tripod having a leg 122 and an upper end 121, for example, as shown in Fig. When the base 120 is constituted by a tripod, the leg 122 can be telescoped to change the vertical position of the pawl 110. If the pawl 120 is supported on the lower portion of the pawl 110 by a telescopic operation, (110) can be vertically erected. However, the base 120 may be formed of a plate-like member as shown in Fig. In this case, the base 120 should be configured to have an area enough to support the pawl 110.

6, the above-mentioned tripod is detachably fixed to the pawl 110 as the upper screw shaft 121a is screwed to the nut hole 110a formed at the lower end of the pawl 110 .

5, the marker member 130 is mounted on the pawl 110 and displays a plurality of reference positions for setting an offset reference value, which will be described later. As shown in FIG. 5, a plurality of marker members 130 are installed to be spaced along the longitudinal direction of the pawls 110. The marker member 130 may be formed of at least one of a ball, a cylinder, and a cone as shown in Fig. 5, for example, so as to provide the same shape even when picked up from all directions as shown in Fig. When the marker member 130 is composed of a ball, a cylinder, or a cone, the marker member 130 is photographed in a circular shape, a square shape, or a triangle in the same direction.

The marker member 130 may include, for example, a first marker 130A and a second marker 130B as shown in FIG. The first marker 130A is installed at the bottom or center of the pawl 110 as shown. The second marker 130B is installed on the pole 110 while being spaced apart from the first marker 130A as shown in the figure. Accordingly, the first marker 130A and the second marker 130B are aligned in a line along the longitudinal direction of the pawl 110 as shown in FIG.

The marker member 130 may further include a third marker 130C disposed on the pawl 110 and positioned between the first marker 130A and the second marker 130B as shown in FIG. The third marker 130C is spaced equally from the first marker 130A and the second marker 130B and is located between the first marker 130A and the second marker 130B. Accordingly, the third marker 130C is aligned in a line along the longitudinal direction of the pawl 110 together with the first marker 130A and the second marker 130B as shown in Fig.

The first to third markers 130A, 130B, and 130C may be configured to have different colors due to surface coloring. Therefore, the first to third markers 130A, 130B, and 130C are easily identified due to the color difference.

As shown in FIG. 6, the marker member 130 has through holes 131 through which the pawls 110 pass, on both sides. The through hole 131 may be formed to have a diameter to which the pawl 110 is interference-fit. Therefore, the marker member 130 can be fixedly fixed to the pawl 110, and is fixed at the naturally moved position even when the marker member 130 is moved in the collapsed state.

The marker member 130 may be a ball, a cylinder, or a conical foam in which the through hole 131 is formed in order to reduce the weight and manufacturing cost. However, in such cases, it may be vulnerable to brittleness. Therefore, it is preferable that the marker member 130 is formed of a globe having the above-described through hole 131 as shown in FIG. Such a globe may be constructed as a glass or a ball-shaped lamp cover made of polycarbonate or plastic. As shown in the drawing, the pawl 110 is vertically penetrated through the through hole 131 and is fixed to a predetermined position of the pawl 110 by being detachably attached to the pawl 110 by a fastener.

Here, the fastener described above can be constituted by, for example, a sleeve 132a and a clamp as shown in Fig. The sleeve 132a is fixed to the marker member 130 composed of a globe as shown, and the pole 110 is inserted through the hollow. The sleeve 132a is provided with a flange 123b as shown to facilitate one end to be attached to the globe. The flange 132b has a curved surface corresponding to the curved surface of the globe as shown in Fig. 8, and is fixed to the globe by a fastening screw 132d.

The clamp couples the sleeve 132a to the pawl 110 to constrain the sleeve 132a to the pawl 110. The clamp can be constituted by, for example, a stop screw 123c as shown in Fig. The stop screw 132c penetrates the sleeve 132a and presses the pawl 110 as shown in Fig. Thus, the sleeve 132a is fixed at the set position of the pawl 110. [

Alternatively, the clamp may comprise a collet CL having a notch N as shown in Fig. 9 and an incline nut 133 coupled to such a collet CL. The collet CL is provided at the lower end of the sleeve 132a as the notch N is formed at the lower end of the sleeve 132a as shown. The collet CL is contracted in the circumferential direction along the circumferential direction of the sleeve 132a when the notch N is narrowed when the incline nut 133 having the inclined inner surface is screwed T1 and T2 as shown in the figure . Thus, the collet CL grasps the pawl 110 on the inner circumferential surface to fix the sleeve 132a to the pawl 110. [ Such a clamp simply secures the sleeve 132a to the pawl 110 by engaging the incline nut 133 so that the sleeve 132a can be more easily secured to the pawl 110 than the stop screw 132c described above.

On the other hand, the marker member 130 composed of the above-described globe can emit light by the illumination module 140 as shown in FIG. As shown in the drawing, the lighting module 140 may be a PCB substrate on which LEDs are mounted, for example. The lighting module 140 is supplied with driving power through a wire connected to the power source unit P as shown in FIG. The illumination module 140 is attached to the interior of the marker member 130 as shown to emit light from inside the marker member 130. Therefore, the marker member 130 emits light by the illumination light of the illumination module 140, so that the marker member 130 can be easily identified at long distances or at night. In particular, the marker member 130 is more easily identified because the lighting module 140 emits various colors when light is emitted in various colors.

On the other hand, the system according to the embodiment of the present invention may further include a chroma key screen and / or a wire as shown in FIG. Since the chroma key screen is used as the background of the subject, it is facilitated when the image captured by each camera is combined with another image. Since the wire can hang the subject in the air, it can shoot the subject in various forms, and it is possible to synthesize the subject in the state of floating while synthesizing with other images.

In addition, the system according to the embodiment of the present invention may further include an object (not shown) suspended by a wire. Such an object can be constituted by, for example, a plate material which is photographed in a state in which the subject is seated. Therefore, the subject can be photographed while floating in the air.

In addition, the system according to an embodiment of the present invention may further include a rotator that rotates on the floor to forcibly jog the subject when the subject is a person. That is, the system according to the embodiment of the present invention can provide an obstacle for jumping people. Such a rotating machine can be composed of a rotating rod (not shown) rotated horizontally on the bottom side and a driving motor (not shown) rotating the rotating rod. Accordingly, the person can jump the rotation bar when the rotation bar rotates. At this time, the cameras can capture a person and pick up the image in a state where the person is floating in the air. Therefore, since the cameras naturally jump by the rotation bar of a person, the cameras can be easily picked up in a levitated state.

The system according to the present invention configured as described above is configured such that the error correction unit 100 picks up images of a plurality of cameras as shown in FIG. 11, and then sets each of the images as shown in FIG. 12 as an offset reference value Is provided to the terminal shown in Fig. At this time, the error correction unit 100 provides the reference position to the terminal through the marker member 130 so that the terminal sets an offset reference value as shown in FIG. Accordingly, the terminal forms a virtual border line on the edge of the marker member 130 based on the shape of the marker member 130 as shown in the enlarged view, and then sets the center C of the border line. 13, when the marker member 130 is composed of two pieces, the point located in the middle of each marker member 130 from the center C of each marker member 130 is positioned at the center of the subject, As an offset reference value. 14, when the marker member 130 is composed of three marker members 130 having equal intervals, as shown in FIG. 14, the center of the marker member at the center is offset from the center C of the marker member, Set as the reference value.

Consequently, the terminal provides an offset reference value corresponding to the center of the actual object because the stand composed of the pawl 110 and the base 120 corresponds to the height of a subject (e.g., a human body) to be actually photographed, as described above.

On the other hand, the terminal sets an offset reference value for tilt correction based on any one of the plurality of marker members 130 as shown in FIG. At this time, the terminal sets an offset reference value for tilt correction through the inclination angle dA of the other marker member 130 or the pawl 110 as shown in the figure. 16, the terminal sets an offset reference value for height correction through the distance between the lowermost marker member 130 and the uppermost marker member 130 among the plurality of marker members 130, as shown in FIG.

Thereafter, the terminal receives an image of an actual object configured as shown in Fig. 18 by a plurality of cameras as shown in Fig. 17, and then, based on the aforementioned offset reference value, As a result, the deviation of the center of the image of the actually photographed object is compared with the slope deviation and the height deviation, and the corrected images are synthesized and provided as a time slice image. Accordingly, since the terminal corrects various deviations of the actually captured images, it can provide a time slice image with various errors corrected.

Here, the terminal may transmit at least one of the images of the synthesized image to the printer as shown in FIG. 41 to print. Accordingly, the terminal can provide an image as a photograph.

In addition, the terminal may synthesize an image of another time slice image, for example, a background image or a foreground image, with the synthesized object image as described above to provide a time slice image synthesized with another place or building. For example, if the subject is a person, the terminal synthesizes the image of the sea taken in the back of the person, composes the image of the animal in front of the person, and creates a time slice image . ≪ / RTI > In addition, the terminal may combine the image of the carpet to provide an image of a shape in which a person sits on the carpet. When the image is captured by a person using the above-described wire in a levitated state, Can also be provided. At this time, the terminal can easily synthesize such a background image and a foreground image, that is, an image other than a person, when using the above-described chromakey screen at the time of photographing of a person. Accordingly, the terminal may provide a time slice image of a virtual reality that exceeds the construction time.

Also, the terminal may convert and provide the time slice image that has been corrected and synthesized as a moving image. Accordingly, the terminal can provide an image in which the subject is automatically rotated when the moving image is driven.

In addition, the terminal may transmit and store the calibrated and synthesized time slice image or the moving image to a portable storage such as a USB, or alternatively, such a video may be uploaded to the server so that the moving image can be downloaded.

On the other hand, when the rotator is driven, the cameras can capture an image of a person (actual subject) jumping by an obstacle of the rotator and provide the image to the terminal. Therefore, the terminal can process and provide a time slice image in the form of a jump in the air. At this time, the terminal deletes the rotator from the image through the unillustrated deletion unit, and provides the time slice image without the rotator.

The cameras may capture images of a person suspended in the air when a person is suspended by the above-mentioned wire, or when a person stands on the above-mentioned suspen- sion object, that is, a plate suspended in the air. Accordingly, the terminal can process and provide a time slice image in a state where the actual subject is floating in the air. At this time, the terminal deletes the wire or the suspending object from the image through the deletion unit, and provides the time slice image in the absence of such a member.

On the other hand, an image correction method according to an embodiment of the present invention will be described below. In the description, the error correction unit described above is referred to as a multi-sphere correction device, and the marker member described above is referred to as a sphere.

Referring to Fig. 17, the multi-camera system is used to photograph a plurality of moving images or images of a subject at different angles.

17 is a system that can be used to photograph a moving image or an image using a moving human being as a subject by using five cameras (cameras 1 to 5). Camera settings such as zoom, iris, ISO, And is set to generate a consistent image.

As shown in FIG. 18, an image photographed from such a camera can arrange moving images or images (hereinafter, referred to as images) of the subject at various angles according to the positions of the respective cameras.

This is because many cameras are used to capture images of the same subject, so that any change in the camera settings can result in inconsistencies of the subject when viewing another image from one image point of view.

The cause of such a discrepancy may occur when a predetermined camera does not correctly point the center of the subject relative to other cameras.

This is caused by the movement of the image relative to the subject when compared with other images.

The cause of the second mismatch may be that the camera is tilted at a certain angle relative to other cameras.

In such a case, it can be said that the tilting of the subject with respect to the image is caused by the comparison with other images.

The third cause of the mismatch is when the camera is at a different distance from the subject than the other camera.

In this case, the cause of the difference in the size of the subject in the image compared to the subject in the other images is the cause.

Another example will be described with reference to the drawings.

FIG. 22 is an exemplary view of four cameras arranged at an angle of 30 degrees, and FIG. 23 is an illustration of an image obtained from the camera of FIG. 3. As shown in the figure, And a camera (a ball shown in blue) is arranged at intervals of 30 degrees over 90 degrees with respect to the subject.

In this case, the same settings are made so that the camera settings (zoom, iris, ISO, resolution, etc.) can produce a consistent image as compared to each other.

If the hardware and configuration of the camera are the same, an ideal image will be obtained from the four cameras, and the ideal image will have the same position, angle and size.

However, when comparing images, there will be defects in the actual captured image due to inconsistencies due to hardware (fixture / camera / lens) and incompleteness of the installation process (human error) (hereinafter referred to as camera geometric error) .

In other words, referring to FIG. 23, the ideal image and the actually photographed image will show a difference at each angle.

Therefore, in the present invention, the multi-sphere correcting device is used to adjust the position, angle, and size of the subject caused by the geometrical errors of each camera when photographing the multi-camera, and these three changes (center shift, tilt angle, Change).

The multi-sphere correcting apparatus and method can be applied to both video and photographic photographing. In the following, an image means to include both a moving image and a photographic image.

First, the calibration parameters used in the present invention will be described.

The present invention uses correction parameters for each camera from an image of a multi-ball correction device, and corrects an image continuously inputted by each camera.

Calibration variables obtained from a multi-sphere calibration device for calibrating the geometrical errors of each camera in the present invention are used to correct the captured continuous images so that the resulting image is an ideal image.

To this end, the present invention uses three calibration variables for "XY Shifts", "Tilt" and "size".

The first is "XY Shifts".

The actual center of the subject is moved relative to the desired center of the subject.

For example, an image photographed by each camera can be shifted by Dx, Dy in the X-axis and Y-axis directions from the center of the ideal image of the subject.

19, it can be seen that the center of the actual photographed image on the right side of the ideal image on the left side is shifted by Dx and Dy.

The second is "Tilt".

The actual photographed image is rotated and displayed compared to an ideal subject.

20, it can be seen that the image of the actually photographed subject is tilted at a certain angle (A-Tilt Angle) than the ideal subject image.

The third is "size".

The size of the subject differs from that of the actual photographed subject.

Referring to the illustrative drawing for explaining the image size of the present invention in FIG. 21, it can be seen that the image actually photographed is smaller than the ideal image by "h" from "H".

Accordingly, in the present invention, the calibration parameters shown in Table 1 can be applied to the multi-sphere calibration apparatus for each camera.

variable Remarks dX Horizontal center movement deviation of the subject dY Vertical center movement deviation of the subject dA Each deviation of the subject t dH Size ratio deviation of subject (h / H)

These calibration variables are used to calibrate the continuous image captured by each camera so that the XY position, tilt angle, and size of the actual image are the same or close to the desired ideal object image.

To this end, the present invention uses a Multi-Sphere Calibration Apparatus (error correction unit) for acquiring calibration variables.

That is, in the present invention, a Multi-Sphere Calibration Apparatus is used to determine each camera calibration variable.

The determined calibration variables are used to correct the input image continuously captured in each camera.

24, the multi-sphere correcting apparatus of the present invention can use 2 to 3 spheres (markers / first to third markers) It should have the following functions.

Two or more spheres must be used first, and spheres must be arranged in a straight line.

Referring to the drawing, in the left drawing, it is understood that three spheres are arranged at a certain interval on one linear supporter, and two spheres are arranged on the one linear supporter on the right side in the vertical direction.

When using a multi-sphere calibration device in a multi-camera system, the multi-sphere calibration device should be placed orthogonal to the camera plane.

Referring to the illustrative drawings for explaining the mechanical positions of the multi-sphere correcting apparatus at the center of the circular camera position, which is perpendicular to the camera setting plane of Fig. 11, the multi- A multi-sphere correcting device is disposed at the center of the position of the multi-

In this arrangement, the image obtained by each camera is almost the same as the image of the multi-sphere correction apparatus.

In addition, it is a matter of course that the multi-sphere correcting apparatus can use various colors and illumination sphere according to the surrounding environment.

25 is a diagram showing an example of a two- or three-sphere calibration apparatus.

The three-point calibration device is a three-point calibration device in which three sphere are arranged on the vertical and vertical lines, and the upper sphere 110, the intermediate sphere 120, The lower ends of the support rods 130 are vertically and vertically spaced apart from the support rods 150 and the lower ends of the support rods 150 are fixed to the pedestal 140 of the calibrating device.

The upper bore 111 and the intermediate bore 121 are vertically and vertically spaced apart from each other on the supporter 150 so that the supporter 150 is spaced apart from the supporter 150, Is fixed to the pedestal (140) of the calibrating device.

Referring to the drawings, a bright color or a light bulb can be used when the shooting environment is dark, and a bright, dark, and saturated color sphere can be used depending on the shooting environment.

Hereinafter, a method of obtaining the calibration variables using the three-point calibration apparatus will be described.

33, the image correction apparatus of the multi-camera system using the multi-sphere correcting apparatus according to the present invention includes a three-sphere correcting apparatus 100 A calibration parameter value is determined and stored based on the images acquired from the plurality of cameras 1 to 5 and the plurality of cameras 1 to 5 and the subject to be actually photographed is positioned at the position of the three- And a calibration unit 200 for receiving the images photographed by the cameras 1 to 5, calibrating the respective images with the stored calibration variable values, and outputting the calibrated images.

Referring to the illustrative drawings for explaining a method of obtaining calibration variables using the three-point calibration apparatus of Fig. 26, in order to obtain the respective camera calibration variable values, the center radius "R" The cameras 1 to 5 are arranged in a circular shape with a radius of R, and a three-point calibration device 110 is disposed at the center of each circular camera.

 The three-point calibration device 110 is constructed by vertically and vertically arranging three spheres as described above. The upper, the middle, and the lower ends 110, 120, And the lower end of the support 150 is fixed to the pedestal 140 of the calibrating device.

An image obtained from the cameras 1 to 5 in this arrangement is shown in Fig.

FIG. 12 is a view showing images obtained from five cameras 1 to 5 arranged in a circular shape. The images of the three-prism correcting apparatus obtained from each camera have a slight difference in photographing position, size and angle Able to know.

Referring to the drawings, an image obtained from the camera 1, an image acquired from the camera 2, an image acquired from the camera 3, an image acquired from the camera 4, and an image acquired from the camera 5 are sequentially shown.

Ideally, if the camera settings are perfect, all images taken from each camera should be the same, but practically each image is not the same.

That is, it can be seen that at least one of XY position shift, slope, or size is changed with respect to a predetermined image of each acquired image.

In order to calibrate them, an image of the three-sphere correcting device acquired by each of the cameras 1 to 5 is input to the calibration unit 200.

The calibration unit 200 may be a terminal or a mixer operating as an image processing unit, and operates as a device for calibrating and outputting an input image.

The calibration unit 200 includes an image input unit 220 for receiving images from the cameras 1 to 5 and an image input unit 220 for inputting images of the three calibration apparatuses A storage unit 240 for storing the calibration values calculated by the calibration parameter calculation unit 230 for each camera as a "calibration variable value chart ", and a storage unit 240 for storing images taken from the actual subject An image calibration unit 250 for reading out the calibration variable value chart for each camera stored in the calibration unit 240 and calibrating and outputting each image, and a controller 250 for controlling each component to determine a calibration value, And a control unit 210 for controlling to generate a calibrated image.

First, the control unit 210 calculates the center value (cXN, cYN) of the three-point calibration apparatus 100.

27, the center value "cXN, cYN" of each of the spheres 110, 120 and 130 is calculated in the three-sphere calibration apparatus.

In other words, the center values (cX1, cY1), (cX2, cY2), (cX3, cY3) of the three spheres for the sphere of the upper sphere 110, the intermediate sphere 120 and the lower sphere 130 are Is determined by a common circle center detection algorithm.

Since the circle center detection algorithm is general, a detailed description thereof will be omitted.

Using these center values, three calibration variables (XY position shift, slope, and size) are calculated for each three-sphere calibration device image.

First, the calibration variables of the XY position movement will be described.

First, the control unit 210 uses the center shift value to determine the calibration variable "XY position shift ".

In the three-point calibration apparatus, the XY position shift value uses the center value "cX2, cY2"

28, the control unit 210 receives an image of the three-point calibration device from each camera and determines an XY position movement value. In this case, For example, if a positional shift with respect to XY in the center value (cX2, cY2) of the middle sphere 120 of the three-sphere calibration device occurs to the "+" point in the drawing, the XY position shift value at the "+" 1 < / RTI >

" cX0 and cY0 "are the center position values of the obtained image," cX2, cY2 ", the calibration device is the center sphere center value, dx is the x- y position shift value, which can be specified as the center point of each camera image or manually.

Referring to Equation (1), it indicates how far the XY position of the image acquired from the camera has moved from the center center value of the calibration device.

The control unit 210 stores the calibration values dx and dy in the "calibration variable value chart" value of the corresponding camera in the storage unit 240.

Calibration parameters of the slope are calculated as follows.

In the present invention, the upper sphere and the lower sphere are used for the tilt calculation.

29, the center values cX3 and cY3 of the upper end sphere are calculated based on the center values cX1 and cY1 of the lower sphere 130 as described above, It is to calculate how tilted it is.

That is, the slope of the center values cX3 and cY3 of the top end hole 110 may be expressed by the following equation (2) based on the center values cX1 and cY1 of the lower end sill 130.

dA is the slope value, and the ideal slope value is "0 ".

At this time, the control unit 210 also stores the calibration values dx and dy in the "calibration variable value chart" value of the corresponding camera of the storage unit 240.

Next, the control unit 210 determines a calibration variable for the size.

The calculation of the size is performed by calculation of the size ratio value, and the calculation of the size ratio value is performed by using the center value of the upper and lower sphere according to the following equation.

H0 is an ideal value and can be calculated from an average value or an individual value from any one image or can be manually specified.

30, the center values CX3 and cY3 of the upper tool 110 and the center values cX1 and cY1 of the lower tool 130 are determined (see FIG. 30) The distance h between the center values CX3 and cY3 of the upper tool 110 and the center values cX1 and cY1 of the lower tool 130 are calculated and the distance value is used to determine a change in the size of the standard size do.

The calibration variable values obtained by the above-described equations are calculated for each camera and stored in the storage unit 210 as a "calibration variable value chart" file.

Calibration Parameter Value Chart is shown in Table 2 below.

Camera Number dX dY dA dH One dX1 dY1 dA1 dH1 2 dX2 dY2 dA2 dH2 3 dX3 dY3 dA3 dH3 * * * * * * * * * * * * * * * n dXn dYn dAn dHn

In Table 2, calibration variables for each camera are stored as a table with values of "dX, dY, dA, dH".

The calibration value stored in the storage unit 240 is applied to an image successively obtained from each camera so as to approximate to an ideal image, and then calibrated to output a calibrated image.

Hereinafter, a method of acquiring a calibration variable using the two-point calibration apparatus will be described with reference to the drawings.

FIG. 31 is a view illustrating a two-point calibration apparatus. As shown in FIG. 31, the two-point calibration apparatus of the present invention has an inclination and an inclination angle using an upper end 111, a lower end 131, The same algorithm as the three-sphere calibration device described above is used to calculate the size calibration parameters.

For the "XY position shift" calibration value, the center value of the two spheres is used in the same way as for the three-point calibration device.

A disadvantage of these two-ball calibration devices is that it is difficult for the cameras to attempt to point to the center of the calibration device without a clear indication, such as an intermediate sphere, such as a three-sphere calibration device.

Fig. 32 is a diagram illustrating another two-point calibration apparatus. Fig.

Referring to the drawing, the slope and the magnitude calculation are performed using the upper spheres (cX3, cY3) and the middle spheres (cX2, cY2) of the two spheres and the middle spheres (cX2, cY2)

The disadvantage of these two-ball calibration devices is that they do not use the full expansion value of the image, so that inaccurate size and slope calculations can occur.

The calibration method using the two-ball alignment device will be described below.

A method for obtaining a calibration image using the multi-ball alignment apparatus using the above-described configuration will be described with reference to the drawings.

35 is a flowchart for explaining a calibration method using the multi-sphere calibration apparatus according to the present invention. As shown in the figure, a method for correcting an image of a multi-camera system using a multi-sphere calibration apparatus according to the present invention, A calibration parameter acquisition step (S100) of determining a calibration parameter value of each camera using a multi-sphere calibration device for calibrating an image of an actual subject using the calibration variable acquired in step S100, and an image correction step S200).

The calibration parameter acquisition step S100 performs a step S110 of arranging a plurality of cameras.

The plurality of cameras 1 to 5 are arranged on the circumference at regular angular intervals A with the same radius R on the same center as shown in Fig.

That is, in step S110, a virtual circle is set, and two or more cameras are arranged at a predetermined angle on the circumference with reference to the origin of the circle.

When the arrangement of the plurality of cameras is completed, a multi-sphere correcting device (three-sphere correcting device in this embodiment) is placed at a center point P of a plurality of cameras (S120).

(Zoom, diaphragm, ISO, resolution, etc.) are set so that the center value (cX2, cY2) of the intermediate aperture 120 of the three-sphere calibration apparatus is the center of the camera image at the center of the calibration apparatus .

When the setting of the camera is completed in step S130, the control unit 210 of the calibration unit 200 acquires an image of the three-sphere calibration device from each camera through the image input unit 220 (S140).

Thereafter, the control unit 210 determines a center value, which is a center value of the sphere for the acquired image (S150).

In other words, in step S150, the center value "cX2, cY2" of the midpoint 120 of the calibration apparatus is determined.

If the center value is determined in step S150, the controller 210 determines a correction value for the XY shift, XY shift, and size of each camera image (S160).

When three calibration variable values (XY position shift, slope, and size) for each camera are determined, the control unit 210 stores the values in the "calibration variable value chart" in the storage unit 240, respectively.

When the values for the calibration variables are determined and stored in the storage unit 240 in step S100, an image correction step S200 for correcting the image by photographing an actual subject is performed.

In the image correction step (S200), the three-point calibration device is first removed, and the subject is positioned at the center of the three-point calibration device (S210).

Each of the cameras 1 to 5 acquires an image of a subject and outputs the image to the calibration unit 200. The control unit 210 performs an image calibration step (S220).

Specifically, the control unit 210 calibrates the image of the subject inputted from each of the cameras 1 to 5 to the image of the corresponding camera from the "calibration variable value chart" stored in the storage unit 240 and outputs the calibrated image .

Hereinafter, a two-point calibration method will be briefly described with reference to the drawings.

36 to 40 are reference drawings for explaining a calibration method using a two-sphere calibration apparatus. A calibration method using a two-sphere calibration apparatus can also be performed by the same procedure as the three-sphere calibration.

That is, the procedure goes to a calibration variable acquisition step (S100) of determining the calibration variable values of each camera and an image correction step (S200) of correcting the image of the actual object photographed using the calibration variables obtained in step S100.

The calibration parameter acquisition step S100 performs a step S110 of arranging a plurality of cameras.

The plurality of cameras 1 to 5 are arranged on the circumference at regular angular intervals A with the same radius R on the same center as shown in Fig.

That is, in step S110, a virtual circle is set, and two or more cameras are arranged at a predetermined angle on the circumference with reference to the origin of the circle.

When the arrangement of the plurality of cameras is completed, the two-point calibration device is positioned at the center point P of the plurality of cameras (S120) (see FIG. 36).

(Zoom, diaphragm, ISO, resolution, etc.) are set so that the center value of the center of the intermediate bulb of the two-bulb calibration apparatus becomes the center of the calibration apparatus (S130) (see FIG.

When the setting of the camera is completed in step S130, the control unit 210 of the calibration unit 200 acquires an image of the three-sphere calibration device from each camera through the image input unit 220 (S140).

Thereafter, the control unit 210 determines a center value, which is a center value of the sphere for the acquired image (S150).

In other words, in step S150, the center value "cX2, cY2" of the midpoint 120 of the calibration apparatus is determined.

If the center value is determined in step S150, the controller 210 determines a correction value for the XY shift, XY shift, and size of each camera image (S160).

When three calibration variable values (XY position shift, slope, and size) for each camera are determined, the control unit 210 stores the values in the "calibration variable value chart" in the storage unit 240, respectively.

Referring to FIG. 38, the calibration setting values for the acquired image are displayed on the lower right side of the screen together with the center value.

In step S100, the values for the calibration variables are determined and stored in the storage unit 240.

Referring to FIG. 39, it is shown on the screen that the determined calibration variable value is stored.

When the calibration variable value is stored, an image correcting step (S200) of correcting the image by photographing an actual subject is performed.

In the image correction step (S200), the two-point calibration device is first removed, and the subject is positioned at the center of the two-point calibration device (S210).

Referring to FIG. 40, when an actual object (in this embodiment, the same two-point calibration device is used) is positioned, each of the cameras 1 to 5 acquires an image of a subject and outputs it to the calibration unit 200, 210 performs an image correction step (S220).

Specifically, the control unit 210 calibrates the image of the subject inputted from each of the cameras 1 to 5 to the image of the corresponding camera from the "calibration variable value chart" stored in the storage unit 240 and outputs the calibrated image .

A method of providing a time slice image according to an embodiment of the present invention will now be described.

First, the above-described cameras pick up an error correction unit as shown in FIG. 41 and provide an error correction image necessary for error correction to the above-mentioned terminal (first step). (Second step). Then, the cameras acquire an image of an actual subject necessary for a time slice image, and acquire an image of a subject from each of the cameras. (Third Step) That is, the cameras pick up a person when the actual subject to be applied to the time slice image is a person (user), and provide them to the above-mentioned terminal.

Then, the terminal calibrates the error of the subject images provided from the cameras based on the offset reference value to generate correction images (Step 4). Then, the terminal synthesizes the correction images as shown in FIG. 42, (Step 5) At this time, the terminal synthesizes the corrected images to generate a synthesized image, and then displays the synthesized image on a screen (not shown) as shown in FIG. 42 to confirm the synthesized image (Steps 5-1 and 5-2) Of course, the terminal may synthesize and provide images of different time slice images as described above. That is, the terminal may synthesize the above-mentioned composite image or the above-mentioned background image and / or foreground image in the above-described corrected image to the object image (steps 7 and 8). Thus, The time slice image can be confirmed through the display image, and if there is an error in the image, the new time slice image can be confirmed again by the above-described method.

When the composite image is generated as described above, the terminal converts the composite image into a downloadable download file or provides at least one of the corrected images to the printer to perform printing (step 6). At this time, The terminal can store the download file in a portable storage such as a USB (step 6-1). Thus, the user (person) can store a time slice video or a time slice video as described later.

Here, the terminal may convert the synthesized image into a moving image so as to provide a time slice moving image. Accordingly, when the user activates the downloaded file, the user can receive an image of the subject rotated by itself through the terminal or the server.

Meanwhile, the terminal uploads the download file to the server so that the download file can be downloaded (step 6-2). In other words, the terminal transmits the download file to the predetermined site.

On the other hand, the terminal or the server sets at least one of the site information and the site connection information as shown in FIG. 43 (step 6-3). At this time, the terminal or the server is set by the administrator The address of the site is set. The terminal or server receives and stores the user ID and password required for connection.

The terminal or the server can output the set information by printing the set information as described above as shown in FIG. 41 (step 6-6). In other words, the terminal can recognize the address of the site, / Or print a password. At this time, the terminal can print the set information on a general printing paper, but it can also be printed on a card such as a credit card or a business card and provided as a souvenir. For this purpose, it is preferable that the terminal is provided with a separate card printer for printing a card, rather than a print for printing a general photograph or print paper.

On the other hand, as shown in FIG. 43, the server receives the set information as described above and approves the connection according to the set information. (Step 6-4) In other words, the server downloads the download file It confirms whether the ID and password input at site connection matches the ID and password of the stored user, and approves the connection if they match. Then, the server transmits the information set according to the approval, that is, the download file corresponding to the connected user, to the requested address (step 6-5). Thus, the user can download his time slice video or a time slice video .

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to be illustrative of the present invention and are not intended to limit the scope of the present invention. Change, partial omission, or supplement). In addition, the above-described embodiments may combine some or many of the features with each other. Therefore, the structure and configuration of each component shown in the embodiments of the present invention can be implemented by modifications or combinations, and it goes without saying that modifications and combinations of these structures and configurations fall within the scope of the appended claims of the present invention.

110: pole 120: base
130: marker member 130A: first marker
130B: second marker 130C: third marker

Claims (27)

A time slice photographing system installed for photographing a time slice image,
A plurality of cameras provided so as to photograph the time slice image;
An error correction unit which is provided at a position corresponding to a position of a subject of the time slice image and is used to provide an offset reference value for correcting errors of the time slice images to the cameras;
At least one of receiving an image of a subject of the time slice image through the cameras, correcting an error of each of the images based on the offset reference value, and synthesizing the corrected images to form a time slice image Terminal; And
And a server for providing the time slice image processed by the terminal according to a download request of the time slice image processed in the terminal. The apparatus of claim 1, wherein the error correction unit comprises:
A stand having a length corresponding to the height of the subject of the time slice image by the cameras and standing upright; And
And a marker member installed on the stand for displaying a plurality of reference positions for setting the offset reference value,
The marker member
Wherein the plurality of cameras are spaced apart from each other along the longitudinal direction of the stand and are configured to be picked up in the same shape even when picked up from all directions by the cameras. The ink cartridge according to claim 2,
A camera for capturing a circular image in all directions by the cameras, a cylinder imaged in a square shape in all directions, or a cone imaged in a triangular shape in all directions. The stand according to claim 2,
A pole having a length in a vertical direction; And
And a base for supporting a lower portion of the pole. 5. The apparatus of claim 4,
And a tripod in which the pole is vertically coupled to an upper portion of the tripod image. The ink cartridge according to claim 2,
A first marker installed at a lower portion or a center of the stand; And
And a second marker disposed on the stand and spaced apart from the first marker and aligned with the first marker. The ink cartridge according to claim 6,
And a third marker installed on the stand and spaced apart from the second marker and aligned with the second marker. The ink cartridge according to claim 4,
Wherein the stand is formed in the form of a ball, a cylinder, or a cone having a through hole into which the stand is inserted in a forced manner. The ink cartridge according to claim 4,
A circular globe provided with a through hole through which the stand vertically penetrates; And
And a fastener detachably attaching the globe to the stand. 10. The fastener according to claim 9,
A sleeve fixed to the globe and into which the stand is inserted; And
And a clamp that couples the sleeve to the stand and restrains the stand to the stand. 11. The clamping device according to claim 10,
And a stop screw passing through the sleeve and pressing the stand. A method of correcting an image of a time slice image using an error correction unit (multi-sphere correction device) according to claim 2 and an error correction unit for correcting an error of images for a time slice image based on the error correction unit,
(a) acquiring a calibration parameter for the geometric error of each camera using the multispherical alignment apparatus in the calibration unit; and
(b) an image correction step of correcting and outputting an image of an actual subject photographed using the calibration parameter acquired in the step (a) by the calibration unit. 13. The method of claim 12, wherein step (a)
(a-1) arranging two or more cameras on the circumference at regular angular intervals with the same radius (R) based on the same center point;
(a-2) positioning the multi-ball alignment device at a center point of the circle;
(a-3) setting at least one of zoom, iris, ISO, or resolution of each camera so that the center of each camera image is the center of the multi-ball alignment device;
(a-4) obtaining an image of the multi-balloon correction device in each camera through an image input unit of the calibration unit; and
(a-5) determining and storing calibration variables for each image through the controller of the calibration unit. 14. The method of claim 13, wherein the calibration value of step (a-5)
The control unit determines one or more calibration variables for XY shift, tilt, or size and stores the calibration variable values for each camera in a storage unit as a calibration variable value chart Image correction method of slice image. 15. The method of claim 14,
The multi-ball alignment apparatus is configured such that three spheres (marker members) are arranged vertically at upper and lower portions on a support stand (upper stand) with an upper sphere (third marker), a middle sphere (second marker) and a lower sphere and,
The calibration variables for the X, Y,
Wherein a center value of an intermediate sphere of the multi-sphere correcting apparatus is determined as a positional shift with respect to an XY coordinate between an actual position and a photographed image. 15. The method of claim 14,
In the multi-ball alignment apparatus, three spheres (marker members) are vertically arranged at upper and lower sides with a top sphere (third marker), a middle sphere (second marker) and a bottom sphere (third marker) ,
The calibration variable for this slope is
An image correction method of a time slice image in which a center value of an upper end sphere is determined to be a value where an actual position and a position of a photographed image are inclined based on a center value of a lower end sphere of the multi- . 15. The method of claim 14,
In the multi-ball alignment apparatus, three spheres (marker members) are vertically arranged at upper and lower sides with a top sphere (third marker), a middle sphere (second marker) and a bottom sphere (third marker) ,
The calibration variable for this size is
Wherein the distance between the center of the upper sphere and the center of the upper sphere and the distance between the center of the upper sphere and the actual position of the sphere is determined by using the upper sphere and the lower sphere. 13. The method of claim 12, wherein step (b)
Removing the multi-ball alignment device and positioning the subject in the center of the camera;
Acquiring an image of a subject in each camera through an image input unit of the calibration unit;
Wherein the control unit of the calibration unit applies a calibration variable value stored in an image of each camera to the image of each subject to output a calibrated image. A first step of acquiring an error-corrected image by capturing an error correction unit provided at the center of the cameras through the cameras to correct errors of the images taken by the cameras used in the imaging of the time slice image;
A second step of calculating an offset reference value applied to the image error correction of each camera based on the error correction images;
A third step of capturing an actual object necessary for the time slice image through the cameras and acquiring an object image from each of the cameras;
A fourth step of calibrating an error of the subject images based on the offset reference value to generate correction images;
A fifth step of synthesizing the correction images to provide a composite image in which the correction images are successively connected; And
Converting the composite image into a downloadable download file, or printing at least one of the corrected images. 20. The method of claim 19,
A fifth step of synthesizing the corrected images to generate the composite image; And
And displaying the generated composite image in step 5-2. 20. The method of claim 19,
And providing the download file to the portable storage. 22. The method of claim 21,
(6-2) uploading the download file to a preset site;
A step (6-3) of setting at least one of information of the site and information of connection of the site;
A step of receiving the set information and approving the connection according to whether the set information is matched; And
And if the set information matches, downloading the download file corresponding to the set information to the requested address. 23. The method of claim 22,
And outputting the set information by transmitting the set information in a print mode. 24. The method of claim 23,
And outputting the information to the card through the print. 20. The method of claim 19,
Converting the synthesized image into downloadable content, or converting the synthesized image into a downloadable video. 20. The method of claim 19,
And a seventh step of performing at least one of a background image and a foreground image in the corrected image after the fourth step. 20. The method of claim 19,
The method of any preceding claim, further comprising the step of synthesizing at least one of a background image and a foreground image in the composite image after the fifth step.

Images