JP2019169915A - Projection control device, projection apparatus, projection method and program - Google Patents

Abstract

To provide a projection control device capable of projecting a beautiful projection image, regardless of a projection object, while improving robustness.SOLUTION: A projection apparatus 10 as a projection control device, includes: storage means for storing a correction image 70 consisting of a measurement image 30 for use in correction of a projection image, and multiple marker images 40 for position identification of images different in at least one of size, shape and orientation; projection control means for controlling projection means to project the correction image 70, to be stored in the storage means, on a projection object; marker determination means for detecting the marker image 40 for use in correction of the projection image from the multiple marker images 40 of the correction image 70 projected on the projection object; and projection condition determination means for determining projection conditions of the image projected by the projection means on the basis of the marker image determined by the marker determination means.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a projection control device, a projection device, a projection method, and a program.

  In a projection apparatus that projects a color image, a technique has been proposed for displaying an image projected by a projection apparatus in a correct color or shape when a projection surface such as a wall has color, pattern, distortion, or the like (for example, Patent Document 1).

JP 2007-259472 A

  In order to correct the projection image by accurately grasping the color reproduction state in the projection range of the projection apparatus, including the technique described in the above-mentioned patent document, the color information of the image projected on the projection plane by the projection apparatus is used. It is necessary to provide means for obtaining (a color sensor in the case of Patent Document 1). In this case, if the position of the projection apparatus is different from the position of the viewer of the projection image, it may be difficult to correct the image reflecting the position of the viewer even if the projection apparatus captures the projection image.

  Thus, as a means for accurately obtaining the color information of the image, a separate photographing apparatus such as a digital camera used by the user of the projection apparatus can be considered. If the color correction of the projection apparatus can be executed by taking a projection image with a general digital camera, the initial setting of the projection apparatus can be realized easily and accurately.

  However, in order to correct the image more accurately, a plurality of correction image patterns including the shape correction of the projected image in addition to the color correction are continuously projected by the projection device, and the plurality of correction image patterns are projected. It is necessary to photograph an image pattern with a digital camera. If these projected images are photographed with a digital camera in a handheld state, the photographing position of the digital camera itself is not stable, and there is a concern about the occurrence of camera shake.

  Therefore, it becomes difficult to accurately detect a range projected by the projection device in continuously obtained captured images. There is a method of fixing the digital camera with a tripod or the like in order to accurately capture the projected image, but the labor and time required for the initial setting becomes much more complicated.

  It is an object of the present invention to provide a projection control device, a projection device, a projection method, and a program with improved robustness capable of projecting a clean projection image having no sense of incongruity regardless of the projection target.

  The projection control apparatus of the present invention stores a correction image composed of a measurement image used for correcting a projection image and a plurality of marker images for identifying image positions that differ in at least one of color, size, shape, and orientation. Storage means, projection control means for projecting the correction image stored in the storage means onto a projection target by the projection means, and the projection from the plurality of marker images of the correction image projected on the projection target Marker determining means for determining a marker image to be used for image correction, and projection condition determining means for determining a projection condition of an image projected by the projecting means based on the marker image determined by the marker determining means. It is characterized by having.

  A projection apparatus according to the present invention includes the projection control apparatus described above and a projection unit.

  The projection method of the present invention comprises a measurement image used for correcting a projected image and a plurality of marker images for image position identification that differ in at least one of color, size, shape, and orientation, and are stored in a storage means. A projection step of projecting the correction image to be projected onto the projection target by the projecting means, and marker determination for determining a marker image to be used for correcting the projection image from the plurality of marker images of the correction image projected onto the projection target And a projection condition determination step of determining a projection condition of an image projected by the projection unit based on the marker image determined in the marker determination step.

  The program of the present invention is a program executed by a computer for identifying an image position that is different from a measurement image used for correcting a projection image stored in a storage unit, in at least one of color, size, shape, and orientation. Projection control means for projecting a correction image stored in the storage means onto a projection target by the projection means, and from the plurality of marker images of the correction image projected on the projection target. Marker determining means for determining a marker image to be used for correcting the projected image. Function as projection condition determining means for determining a projection condition of an image projected by the projecting means based on the marker image determined by the marker determining means. It is characterized by that.

  According to the present invention, it is possible to provide a projection control device, a projection device, a projection method, and a program with improved robustness capable of projecting a beautiful projection image without a sense of incongruity regardless of the projection target.

It is a figure which shows the outline | summary of the projection system which concerns on embodiment of this invention. It is a figure which shows the structure of the projection system which concerns on embodiment of this invention. It is a figure which shows the image for a measurement which concerns on embodiment of this invention, (a)-(c) is a measurement image for color correction of a projection image, (d)-(f) is the shape correction of a projection image It is an image for measurement for. It is a figure which shows the structure of the marker which concerns on embodiment of this invention. It is a flowchart figure of the marker determination program which concerns on embodiment of this invention. It is a flowchart figure of the marker analysis in the marker determination program which concerns on embodiment of this invention. It is a figure which shows an example of the image for a correction | amendment which concerns on embodiment of this invention. It is a figure which shows an example of the image for a correction | amendment which concerns on embodiment of this invention.

  Hereinafter, modes for carrying out the present invention will be described. FIG. 1 is a diagram showing an outline of the projection system 1. The projection system 1 includes a projection device 10 (projection control device) that projects an image onto a projection surface 26 of a projection object 25 such as a curtain and a wall, a digital camera that captures an image projected on the projection surface 26, and a camera-equipped mobile phone. And a photographing device 20 such as a telephone. The photographing device 20 may be any digital device with a portable image input function, and may be a video camera, a smartphone (high-function mobile phone), a tablet terminal, or the like. In the present embodiment, a curtain is shown as the projection object 25. The projection object 25 is suspended by a rail or the like (not shown), and has a wave-like undulation mainly on the surface along the lateral direction. Further, colors and patterns are formed on the projection surface 26.

  The projection device 10 is arranged at a different position from the imaging device 20. The projector 10 in FIG. 1 is arranged on the left side with respect to the projection plane 26 and projects an image from an oblique direction. The imaging device 20 is arranged at the position of the user who views the image projected on the projection surface 26, such as substantially in front of the projection surface 26. Therefore, the image captured by the image capturing device 20 and the image visually recognized by the user can be configured so that the angle of view substantially matches. The imaging device 20 may be held by a user.

  An outline of the operation of the projection system 1 will be described. When the projection image projected by the projection apparatus 10 remains projected, the projection image 26 is affected by the shape and pattern of the projection surface 26 and the difference between the projection direction of the projection apparatus 10 and the user's line-of-sight direction. From this viewpoint, it is observed in a color and shape different from the original image data. Therefore, in the present embodiment, the projection control unit 100 corrects the image data so that the user can appropriately view the projected image from the user's viewpoint. The image data is corrected by projecting a correction image 70, which will be described later, onto the projection surface 26 by the projection device 10 and photographing the correction image 70 projected by the photographing device 20. The imaging device 20 transmits a captured image including the correction image 70 to the projection device 10 via a wired or wireless communication unit 400. The projection device 10 corrects the image data based on the received correction image 70 of the captured image. In this way, the projection apparatus 10 can project an image so that the image data is visually recognized in a manner intended for a user who is an observer.

  FIG. 2 is a diagram showing a configuration of the projection system 1. The projection apparatus 10 includes a projection control unit 100 that is a projection control unit, a projection unit 200 that is a projection unit, and a storage unit 300 that is a storage unit. The projection control unit 100 includes a video processing unit 110 and a video correction unit 120 that receive the image data 50 of the projection image, and a detection unit that receives a captured image from the imaging device 20 via the wired or wireless communication unit 400 and performs marker detection. A measuring unit 130 as marker determining means for determining a marker image to be used for correcting the projected image, and determining a projection condition of the image projected by the projecting unit 200 based on the marker image determined by the measuring unit 130 A pattern generation unit 140 is provided as projection condition determination means. The projection unit 200 includes a light source 210, a projection element 220, and a projection lens 230.

  The projection control unit 100 can be configured as a program stored in the storage unit 300 and executed by a computer (not shown) included in the projection apparatus 10. The video processing unit 110 of the projection control unit 100 processes the ornamental image data 50 sent from a personal computer (not shown) or a USB memory connected to the projection device 10 at a frame rate according to a predetermined format. Image data for projection is generated. The video correction unit 120 receives the image correction information from the measurement unit 130, corrects the image data for projection from the video processing unit 110, and drives the projection element 220 of the projection unit 200 to display.

  The measurement unit 130 of the projection control unit 100 analyzes the captured image including the correction image 70 captured by the imaging device 20 and generates image correction information and the like. The pattern generation unit 140 stores a correction image 70, which is stored in the storage unit 300 and includes a measurement image 30 (described later) used for correcting the projection image and a plurality of marker images 40 (described later) for image position identification. The projection element 220 of the projection unit 200 is driven to perform projection.

  The light source 210 of the projection unit 200 includes an LED or an LD (laser diode) that is a semiconductor light emitting element, and irradiates the projection element 220 with light source light of red, green, and blue wavelength bands. The projection element 220 uses a DMD (digital micromirror device), and displays the red, green, and blue wavelength band light in a time-sharing manner according to the image data to be projected, thereby allowing the projection target object to pass through the projection lens 230. 25 can project a color image. The projection element 220 may be other types such as a liquid crystal projector.

  The storage unit 300 includes, for example, an SSD (Solid State Drive) or an SRAM (Static Random Access Memory). The storage unit 300 stores control programs such as the correction image 70 and the projection control unit 100.

  Next, the measurement image 30 stored in the storage unit 300 of the projection apparatus 10 will be described with reference to FIG. The measurement image 30 can be a rectangular image having an aspect ratio corresponding to the projection mode, and the entire image has a horizontally long rectangular shape in FIG.

  3A to 3C show measurement images 31, 32, and 33 for color correction of the projected image. The measurement images 31, 32, and 33 are a black measurement image 31, a gray measurement image 32, and a white measurement image 33 in which the measurement region 30 a on the substantially entire surface is black, gray, and white, respectively. The projection apparatus 10 projects the measurement images 31, 32, and 33 together with a plurality of marker images 40, which will be described later, onto the projection plane 26, causes the imaging apparatus 20 to shoot, and causes the projection control unit 100 (measurement unit 130) to project the projection plane. The color change caused by the pattern formed on the projection 26 and the distortion of the projection surface 26 is detected.

  3D to 3F show measurement images 34, 35, and 36 for distortion correction (for shape correction) of the projection image projected on the projection object 25. FIG. Each of the measurement images 34, 35, and 36 has a checkered pattern in which approximately square white squares and black squares are alternately arranged in the vertical and horizontal directions on a substantially entire measurement region 30 a, thereby obtaining a large checkered pattern. A measurement image 34, a medium-sized checkered pattern measurement image 35, and a small checkered pattern measurement image 36 were used. The projection control unit 100 (measurement unit 130) can detect distortion of the projection surface 26 with different resolutions according to the checkered pattern size in the measurement images 34, 35, and 36. The projection device 10 projects the measurement images 34, 35, and 36 together with a plurality of marker images 40, which will be described later, onto the projection surface 26, causes the image capturing device 20 to capture images, and causes the projection control unit 100 (measurement unit 130) to project the projection surface. 26, the entire distortion is detected. At this time, the square corners of the checkered images 34, 35, and 36 having different sizes are positioned so as not to overlap each other during projection.

  Next, a plurality of marker images 40 for image position identification stored in the storage unit 300 will be described with reference to FIG. The plurality of marker images 40 are projected onto the projection surface 26 as the correction image 70 together with the measurement image 30 described above, and are photographed by the photographing apparatus 20. A plurality of captured images including the correction image 70 of the imaging device 20 are analyzed by the measurement unit 130. At this time, the measurement unit 130 analyzes the measurement image 30 by matching the positions of the detected marker images 40 among the plurality of captured images. The plurality of marker images 40 for image position identification are formed such that at least one of color, size, shape, and orientation is different.

Specifically, the marker images 41-1, 41-2, 41-3, and 41-4 are formed in a rectangular shape, and the marker images 42-1, 42-2, 42-3, and 42-4 are formed in a rectangular shape. Each of the marker images 43-1, 43-2, and 43-3 has a quadrangular shape and a triangular shape that are overlapped at the center. The marker images 41-3, 42-2, and 43-1 have a white background, the marker images 41-1, 41-2, and 43-3 have a green background, and the marker images 43-2, 41- 4, 42-4 has a red background, and marker images 42-1, 42-3 have a blue background. All the marker images 40 have different sizes. Further, the plurality of marker images 40 are arranged so that their orientations and positions are different in the measurement region 30 a of the measurement image 30.
Of course, the shape of the marker image 40 is not limited to the above example, and various shapes may be used.

  Next, correction of the projected image by the projection apparatus 10 will be described. In the present embodiment, the correction of the projected image is performed first by shape correction and then by color correction. As another form, color correction may be performed first. As shown in FIG. 5, first, in step S <b> 101, the pattern generation unit 140 generates and projects a first correction image 71 according to an instruction from the measurement unit 130. The correction image 71 is stored in the storage unit 300. In step S101, as shown in FIG. 7, a large checkerboard measurement image 34 (see FIG. 3D) is superimposed on all the marker images 40 in FIG. 4 as the first correction image 71. An image is projected. Next, in step S <b> 105, the image for correction 71 projected on the projection surface 26 is captured by the imaging device 20, and this captured image is transmitted to the measurement unit 130 via the communication unit 400. In the next step S110, the captured image transmitted in step S105 is analyzed, and the marker image 40 used for image position identification is determined from the plurality of marker images 40.

  The determination of the marker image 40 is performed according to the flowchart of FIG. 6 by detecting the marker image 40 using a detection unit included in the measurement unit 130. First, in step S201, the captured image is converted to a gray scale. In step S205, the grayscale captured image is binarized. In step S201 or step S205, each process can be performed with priority given to a predetermined parameter. In the present embodiment, the predetermined parameter can be arbitrarily selected from the color, size, shape, orientation, and position of the marker image 40. For example, when priority is given to red for “color” as a predetermined parameter, only the red marker images 43-2, 41-4, and 42-4 are extracted from the captured image, and the process of step S201 or step S205 is performed. be able to. Note that the process using the predetermined parameter may be performed by either the process of step S201 or step S205.

  In the next step S210, contour extraction is performed on the binarized captured image. In the contour extraction process, for example, a boundary that is a closed region of a black image and a white image of a binarized image is detected as a contour. In step S215, the marker image 40 in the image is identified from the detected contour, and candidates for the marker image 40 used for image position identification are listed. In step S220, the enumerated candidates for the marker image 40 are analyzed, and the marker image 40 that is difficult to be used for image position identification as an error value is removed. As the error value, the accuracy of the shape of the marker image 40 can be set with a predetermined threshold.

  In this way, for example, if one or more marker images 40 remain, the process of determining the marker image 40 ends (step S225). If the marker image 40 that can be used for image position identification cannot be obtained, the process returns to step S201, and the grayscale (step S201) or binarization (step S205) process is performed by changing the predetermined priority parameter. Do. For example, if the marker image 40 that can be used for image position identification cannot be determined even if processing is performed with priority given to color as a predetermined parameter, the next step is to prioritize the gray scale (step S201). Alternatively, binarization (step S205) can be performed.

  Moreover, even if the contour extraction (step S210) is performed on the marker images 43-2, 41-4, and 42-4 with priority given to red as a predetermined parameter, an error occurs (step S220) and the image position is identified. When the marker image 40 that can be used for the purpose cannot be determined, the contour extraction of the marker images 41-1, 41-2, 41-3, and 41-4 is performed with priority given to the rectangular shape as the predetermined parameter. Processing can be performed. In this manner, the marker image 40 that can be used for identifying the image position can be determined by sequentially performing predetermined priority parameters for color, size, shape, orientation, and position. The marker image 40 can be identified if at least one marker image 40 can be detected. However, the alignment accuracy of each captured image is better when the plurality of marker images 40 are used for identifying the image position. Therefore, the correction accuracy of the projected image is improved.

  Here, in step S225 of FIG. 6, it is assumed that red marker images 43-2, 41-4, and 42-4 are determined as the marker image 40 for image position identification. Returning to FIG. 5, when the first correction image 71 is analyzed in step S110 and the marker image 40 (marker images 43-2, 41-4, and 42-4) that can be used for image position identification is determined. In step S115, the projection apparatus 10 projects the second and subsequent correction images 72. As shown in FIG. 8, the second correction image 72 generated by the pattern generation unit 140 is an image position identification marker image 43-2, 41-4, 42-4 determined by the measurement unit 130. And a medium-sized checkered pattern measurement image 35 (see FIG. 3E). The correction image 72 is stored in the storage unit 300. In step S 120, the projected correction image 72 is photographed by the photographing device 20. In this manner, the third and subsequent correction images 70 are sequentially determined as the image position identification marker images 43-2, 41-4, and 42-4 and the measurement images 36, 31, 32, and 32, respectively. 33 and is stored in the storage unit 300. That is, the pattern generation unit 140 determines the projection condition of the image projected by the projection unit 200 based on the marker image 40 determined by the measurement unit 130. Accordingly, the correction images 70 formed with the projection conditions determined are sequentially projected and sequentially photographed by the photographing device 20. In the present embodiment, the image captured by the image capturing device 20 is a correction image 70 formed by the measurement images 31, 32, 33, 34, 35, 36 and the marker images 43-2, 41-4, 42-4. And a total of 6 images.

  In addition to the above, the generation of the second and subsequent correction images 70 can be performed as follows. That is, the storage unit 300 stores in advance six correction images 70 formed by superimposing the measurement images 31 to 36 and the plurality of marker images 40 of FIG. When the marker image 40 to be used for correcting the projection image is determined by the correction image 70 projected on the first sheet by performing the processing of steps S201 to S225 in FIG. 6, the correction image 70 projected on the second and subsequent sheets. Is a region where the marker image 40 that could not be detected by the image processing means included in the measuring unit 130 (the marker image 40 other than the marker images 43-2, 41-4, and 42-4 in the example of FIG. 4). It is also possible to generate the second and subsequent correction images 70 (for example, the correction image 72 in FIG. 8) by changing to the region of the measurement image 30 (35).

  In step S125, image correction information for correcting the shape and color of the projection image is generated by the measurement unit 130 based on the measurement images 30 of the correction images 70 in the six captured images. As the image correction information, the measurement images 30 are analyzed by matching the marker images 40 of the plurality of correction images 70 photographed by the photographing device 20. Therefore, even a captured image in which camera shake has occurred can be used for correcting the projected image. That is, in the shape correction of the projected image, the position of the marker image 40 in each captured image is matched with respect to the captured images obtained by capturing the three correction images 70 including the measurement images 34, 35, and 36 for shape correction. The degree of distortion of each measurement image 34, 35, 36 can be obtained by detecting the coordinates of the checkered intersection of each measurement image 34, 35, 36 of each captured image. Similarly, in the color correction of the projected image, the positions of the marker images 40 in the respective photographed images are matched, and black, gray, white at the coordinates of the projection element 220 specified by the checkered pattern measurement images 34, 35, 36 are used. Then, the light amounts of the measurement images 31, 32, and 33 are measured, and red, green, and blue light amounts that are target values of the coordinate positions are obtained. In this way, the image correction information of the projection image relating to the shape and color is generated. In step S130, the generated image correction information is transmitted to the video correction unit 120. Then, the video correction unit 120 corrects the projection image based on the image data, and projects the projection image corrected by the projection unit 200.

  As mentioned above, although embodiment of this invention was described, this invention is not limited by this embodiment, It can implement with a various form. For example, the arrangement of the plurality of marker images 40 shown in FIG. 4 is performed by arranging the marker images 40 having a high detection rate from a plurality of accumulated past detection results at the four corners of the measurement region 30a of the measurement image 30. Other marker images 40 that do not have a high rate can be arranged on the side or center of the measurement region 30a. Thereby, the marker images 40 unnecessary for the analysis of the measurement image 30 are arranged at the four corners as much as possible, and the accuracy of image correction near the center of the projection surface 26 is improved for the projection object 25 whose pattern or shape is not complicated. In addition, the image correction can be performed using the various marker images 40 for the projection target object 25 that has many patterns confusing with the marker image 40 or has a complicated shape.

  Further, only the marker image 40 determined for image position identification in step S225 in FIG. 6 is used for the second and subsequent correction images 70, but the marker image 40 that has not been determined is displayed. However, the marker image 40 that is not used can be removed from the second and subsequent correction images 70 as in the present embodiment, thereby reducing noise and correcting the color and shape. The effect of expanding the image display range can be expected. In addition, when there are many marker images 40 determined for image position identification in step S225 of FIG. 6, the marker image 40 with higher accuracy is left. For example, it is possible to leave only the marker image 40 near the four corners of the measurement region 30a or leave only the small marker image 40 in consideration of the influence on the measurement area 30a.

In the present embodiment, the projection apparatus 10 that is the own apparatus is illustrated as having the measurement unit 130, but the present invention is not limited thereto. The projection control unit 100 communicates with an external device (for example, the imaging device 20) including the measurement unit 130 via the communication unit 400, thereby detecting a marker image detected by the external device including a detection unit that detects the marker image 40. The detection result information may be acquired.
With this configuration, it is possible to reduce the burden of control processing performed by the projection control unit 100 of the projection apparatus 10.

  As described above, the projection apparatus 10 as the projection control apparatus according to the embodiment of the present invention is different from the measurement image 30 used for correcting the projection image in the image position in which at least one of color, size, shape, and orientation is different. A storage unit (storage unit 300) that stores a correction image 70 including a plurality of identification marker images 40, and a correction image 70 that is stored in the storage unit is projected by the projection unit (projection unit 200). The marker image 40 to be used for correcting the projection image is determined from the projection control means (projection control unit 100) for projecting onto the object 25) and the plurality of marker images 40 of the correction image 70 projected onto the projection object 25. Projection condition determination for determining the projection condition of the image projected by the projection means based on the marker determination means (measurement unit 130) and the marker image 40 determined by the marker determination means It has a stage (pattern generation unit 140), the. As a result, it is possible to provide the projection apparatus 10 with improved robustness capable of projecting a clean projection image with no sense of incongruity regardless of the pattern or color applied to the projection object 25.

  Further, the marker determining means determines the marker image 40 of the correction image 72 to be projected next, which is the second and subsequent images, using the marker image 40 detected from the correction image 71 previously projected as the first image. . Thereby, the processing time of the second and subsequent correction images 70 can be shortened.

  The marker determining unit determines a marker image used for correcting the projection image from the marker image detected by the detecting unit provided in the own device (projection device 10) or the external device (imaging device 20). Thereby, if this detection means is provided in one of its own device or an external device, a general-purpose device can be used as the other device.

  The marker determining means includes image processing means for changing the area where the marker image 40 that could not be detected from the projected correction image 70 is changed to the area of the measurement image 30. Thereby, the marker image 40 which cannot be detected can be excluded, and the area | region of the image 30 for a measurement which contributes to correction | amendment of a projection image can be expanded.

  The marker determining means detects the marker image 40 with priority given to a predetermined parameter. This predetermined parameter may be the color or size of the marker image 40, or other shape, orientation, and position. Thereby, the detection processing time of the marker image 40 by the marker determining means can be shortened. If the predetermined parameter to be prioritized is color, the projection object 25 may be used when the pattern of the projection object 25 is close to the marker image 40 and it is difficult to detect the marker image 40 (contour extraction). The influence of the pattern can be reduced. For example, in the case of a red and white screen, the red component reflects both the white portion and the red portion. Therefore, if the red plane is projected and the red plane is viewed, the influence of the screen pattern can be reduced. Further, by giving priority to the size, for example, if the marker image 40 is large, a crease or a pattern of the screen may enter the marker image 40 and an extra line may be detected. It is preferable to prioritize the marker image 40. On the contrary, if the marker image 40 is small, the straight line of the marker image 40 may be too short to be detected or the marker image 40 itself may be crushed. In this case, priority is given to the large marker image 40. Is preferred.

  Further, the projection apparatus 10 may be configured to include a projection unit 200 as a projection unit and a projection control apparatus. Thereby, the projection system 1 can be comprised in various aspects.

  The projection method by the projection apparatus 10 includes a measurement image 30 used for correcting the projection image, and a plurality of marker images 40 for image position identification that are different in at least one of color, size, shape, and orientation. A projection step of projecting the correction image 70 stored in the storage unit onto the projection target (projection target 25) by the projection unit (projection unit 200), and a plurality of marker images 40 of the correction image 70 projected onto the projection target. A marker determining step for detecting a marker image 40 to be used for correcting the projected image, and a projection condition determining step for determining a projection condition of an image projected by the projection means based on the marker image 40 determined in the marker determining step. . Accordingly, it is possible to provide a projection method with improved robustness capable of projecting a clean projection image without a sense of incongruity regardless of the pattern or color applied to the projection object 25.

  In addition, the program executed by the computer includes a plurality of image position identifications that are different in at least one of color, size, shape, and orientation from the measurement image 30 used for correcting the projection device 10 (computer) for the correction of the projection image. Projection control means for projecting a correction image 70 consisting of the marker image 40 and stored in the storage means (storage unit 300) onto the projection target (projection target 25) by the projection means, on the projection target (projection target 25) A marker determining unit that determines a marker image to be used for correcting the projected image from the plurality of marker images 40 of the projected correction image 70, and an image projected by the projecting unit based on the marker image determined by the marker determining unit. It functions as a projection condition determining means (image correction unit 120) for determining the projection condition. As a result, it is possible to provide a computer program with improved robustness capable of projecting a clean projection image with no sense of incongruity regardless of the pattern or color applied to the projection object 25.

  The embodiment described above is presented as an example, and is not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

The invention described in the first claim of the present application will be appended below.
[1] Storage means for storing a correction image composed of a measurement image used for correcting a projected image and a plurality of marker images for image position identification that are different in at least one of color, size, shape, and orientation;
Projection control means for projecting the correction image stored in the storage means onto a projection target by the projection means;
Marker determining means for determining a marker image to be used for correcting the projection image from the plurality of marker images of the correction image projected on the projection target;
Projection condition determining means for determining a projection condition of an image projected by the projecting means based on the marker image determined by the marker determining means;
A projection control apparatus comprising:
[2] The marker determination unit according to [1], wherein the marker determination unit determines a marker image of the correction image to be projected next using the marker image detected from the correction image projected last time. Projection control device.
[3] The marker determining unit determines a marker image to be used for correcting the projection image from a marker image detected by a detecting unit included in the own device or an external device.
The projection control apparatus according to [1] or [2], wherein:
[4] The marker determining means includes image processing means for changing an area where the marker image that could not be detected from the projected correction image is changed to an area of the measurement image. The projection control device according to any one of [1] to [3].
[5] The projection control apparatus according to any one of [1] to [4], wherein the marker detection unit detects the marker image in preference to a predetermined reference.
[6] The projection control apparatus according to [5], wherein the predetermined reference is a color of the marker image.
[7] The projection apparatus according to [5], wherein the predetermined reference is a size of the marker image.
[8] The projection control device according to any one of [1] to [7];
Projection means;
A projection apparatus comprising:
[9] A correction image that is stored in the storage unit and includes a measurement image used for correcting the projected image and a plurality of marker images for image position identification that are different in at least one of color, size, shape, and orientation Projecting onto the projection object by the projecting means,
A marker determining step of determining a marker image to be used for correcting the projection image from the plurality of marker images of the correction image projected on the projection target;
A projection condition determination step of determining a projection condition of an image projected by the projection unit based on the marker image determined in the marker determination step;
A projection method comprising:
[10] A program executed by a computer, wherein the computer is
The measurement image used for correcting the projection image stored in the storage unit and a plurality of marker images for identifying image positions having different colors, sizes, shapes, and orientations are stored in the storage unit. Projection control means for projecting the correction image onto the projection target by the projection means,
Marker determining means for determining a marker image used for correcting the projection image from the plurality of marker images of the correction image projected on the projection target;
Projection condition determining means for determining a projection condition of an image projected by the projecting means based on the marker image determined by the marker determining means;
A program characterized by functioning as

DESCRIPTION OF SYMBOLS 1 Projection system 10 Projection apparatus 20 Imaging device 25 Projection object 26 Projection surface 30-36 Measurement image 30a Measurement area 40, 41-1 to 4, 42-1 to 4, 43-1 to 3 Marker image 50 , 71, 72 Correction image 100 Projection control unit 110 Video processing unit 120 Video correction unit 130 Measurement unit 140 Pattern generation unit 200 Projection unit 210 Light source 220 Projection element 230 Projection lens 300 Storage unit 400 Communication unit

Claims (10)

Storage means for storing a correction image composed of a measurement image used for correcting a projection image and a plurality of marker images for image position identification that differ in at least one of color, size, shape, and orientation;
Projection control means for projecting the correction image stored in the storage means onto a projection target by the projection means;
Marker determining means for determining a marker image to be used for correcting the projection image from the plurality of marker images of the correction image projected on the projection target;
Projection condition determining means for determining a projection condition of an image projected by the projecting means based on the marker image determined by the marker determining means;
A projection control apparatus comprising:   The projection control apparatus according to claim 1, wherein the marker determining unit determines a marker image of the correction image to be projected next using the marker image detected from the correction image projected last time. . The marker determining means determines a marker image used for correcting the projection image from a marker image detected by a detecting means provided in the own apparatus or an external apparatus.
The projection control apparatus according to claim 1, wherein:   The said marker determination means is provided with the image process means to change the area | region where the said marker image which was not able to be detected from the projected said image for a correction | amendment is arrange | positioned to the area | region of the said image for a measurement. The projection control apparatus according to any one of the above.   5. The projection control apparatus according to claim 1, wherein the marker detection unit detects the marker image by giving priority to a predetermined reference. 6.   The projection control apparatus according to claim 5, wherein the predetermined reference is a color of the marker image.   The projection control apparatus according to claim 5, wherein the predetermined reference is a size of the marker image. A projection control device according to any one of claims 1 to 7,
Projection means;
A projection apparatus comprising: Projecting means for correcting a correction image stored in a storage means comprising a measurement image used for correcting a projected image and a plurality of marker images for identifying image positions having different colors, sizes, shapes, and orientations A projection step of projecting onto the projection object by
A marker determining step of determining a marker image to be used for correcting the projection image from the plurality of marker images of the correction image projected on the projection target;
A projection condition determination step of determining a projection condition of an image projected by the projection unit based on the marker image determined in the marker determination step;
A projection method comprising: A program executed by a computer, wherein the computer is
The measurement image used for correcting the projection image stored in the storage unit and a plurality of marker images for identifying image positions having different colors, sizes, shapes, and orientations are stored in the storage unit. Projection control means for projecting the correction image onto the projection target by the projection means,
Marker determining means for determining a marker image used for correcting the projection image from the plurality of marker images of the correction image projected on the projection target;
Projection condition determining means for determining a projection condition of an image projected by the projecting means based on the marker image determined by the marker determining means;
A program characterized by functioning as

Images