JP4724637B2 - Imaging apparatus, imaging system, imaging method, program, and recording medium - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging system, an imaging method, a program, and a recording medium, and more particularly, to a technique suitable for use in reducing the amount of generated code when interframe predictive coding is likely to fail.

  Generally, in inter-frame predictive coding, code amount control is performed so that the transmission code amount does not exceed a certain rate. That is, the residual amount of the output buffer is sequentially monitored, and when the generated code amount is likely to exceed the residual amount, control is performed to reduce the code amount by coarse quantization. However, in moving image shooting, a large amount of code is often required due to camera shake or the like. In such a case, since quantization is performed roughly, block noise or the like appears and the image quality is greatly deteriorated.

  Therefore, conventionally, an imaging apparatus has been proposed that controls the compression coding so as not to fail by setting a threshold value for the AF evaluation value and adjusting the coding accuracy according to the set threshold. (For example, refer to Patent Document 1).

JP 2003-219416 A

  However, in the video camera device described in Patent Document 1, it is difficult to set a threshold value for controlling the compression encoding so as not to fail. In addition, since a process for setting a threshold value is required, there is a problem in that the process for reducing the amount of generated codes becomes complicated. Furthermore, if setting the threshold value fails, there is a problem that the process for reducing the generated code amount is unstable.

  An object of the present invention is to make it possible to easily and stably reduce the amount of generated codes when compression encoding is likely to fail.

  An image pickup apparatus according to the present invention includes an image pickup unit that photoelectrically converts a subject image formed by an image pickup optical system and outputs an image signal, a signal processing unit that processes the image signal into image data, and the signal processing unit. Evaluation value acquisition means for acquiring an evaluation value indicating the in-focus state of the imaging optical system based on the image data processed by the signal processing, and adjusting the focus by moving the imaging optical system according to the evaluation value A focus adjustment unit for controlling the image data, and a compression encoding unit for compressing and encoding the image data signal-processed by the signal processing unit, wherein the evaluation value acquisition unit is a compressed code output from the compression encoding unit. According to the quantity information, the evaluation value is obtained by changing a ratio of RGB components of the image data signal-processed by the signal processing means.

  An imaging system according to the present invention includes the imaging device and an imaging optical system.

  An image pickup method of the present invention includes a signal processing step for performing signal processing on image data obtained by photoelectrically converting a subject image formed by an image pickup optical system, and image data subjected to signal processing in the signal processing step. An evaluation value acquisition step of acquiring an evaluation value indicating the in-focus state of the imaging optical system based on the focus, and a focus adjustment step of controlling the focus adjustment by moving the imaging optical system according to the evaluation value; A compression encoding step of compressing and encoding image data signal-processed by the signal processing step, and in the evaluation value acquisition step, according to the compression code amount information output by the compression encoding step, The evaluation value is obtained by changing a ratio of RGB components of the image data subjected to signal processing in the signal processing step.

  A program according to the present invention causes a computer to execute the imaging method.

  The recording medium of the present invention is characterized in that the program is recorded.

  According to the present invention, it is possible to easily and stably reduce the amount of generated code when compression encoding is likely to fail.

(First embodiment)
DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a block diagram illustrating a functional configuration example of the imaging apparatus according to the present embodiment.
In FIG. 1, 1 is a lens (including a focus lens), and 2 is a stop. Reference numeral 3 denotes an image sensor, and 4 denotes an analog front end unit (shown as AFE) including a CDS circuit and an A / D converter.

  Reference numeral 5 denotes a drive circuit that drives the lens 1, the diaphragm 2, and the image sensor 3, and reference numeral 6 denotes a camera signal processing circuit that generates a luminance signal and a color difference signal from the captured image data. Reference numeral 7 denotes an image memory for storing image data, and reference numeral 8 denotes an inter-frame prediction encoding processing circuit that performs inter-frame prediction encoding processing on the image data processed by the camera signal processing circuit 6.

  Reference numeral 9 denotes an AF evaluation value generation circuit that generates an AF evaluation value based on the code amount information sent from the inter-frame prediction encoding processing circuit 8, and reference numeral 11 denotes a recording medium that can be detached from the imaging apparatus. This AF evaluation value indicates the in-focus state of the imaging optical system including the lens 1. Reference numeral 10 denotes a recording processing circuit that records image data subjected to inter-frame predictive encoding processing on the recording medium 11, and 12 denotes a system control unit that controls the entire imaging apparatus. Reference numeral 15 denotes a bus that performs communication between the system control unit 12 and each block in the imaging apparatus.

  Reference numeral 13 denotes a nonvolatile memory (ROM) that stores a program describing a control method executed by the system control unit 12 and control data such as parameters and tables used when executing the program. Reference numeral 14 denotes a volatile memory (RAM) that transfers and stores the program and control data stored in the nonvolatile memory 13 and is used when the system control unit 12 controls the imaging apparatus.

  Hereinafter, an imaging operation in the imaging apparatus configured as described above will be described. Prior to the imaging operation, necessary programs, control data, and correction data are transferred from the nonvolatile memory 13 to the volatile memory 14 and stored at the start of the operation of the system control unit 12 such as when the imaging apparatus is turned on. Shall. These programs and data are used when the system control unit 12 controls the imaging apparatus. Furthermore, it is assumed that an additional program or data is transferred from the nonvolatile memory 13 to the volatile memory 14 or the data in the nonvolatile memory 13 is directly read and used as necessary. .

  First, the aperture 2 and the lens 1 are driven by a control signal sent from the system control unit 12 to form a subject image set to an appropriate brightness on the image sensor 3. The image pickup device 3 is driven by a drive pulse controlled by the system control unit 12, converts the subject image into an electrical signal by photoelectric conversion, and outputs it as an analog image signal.

  The analog image signal output from the image pickup device 3 is subjected to an operation pulse controlled by the system control unit 12 to remove clock synchronous noise by the CDS circuit inside the AFE 4, and is converted into a digital image by the A / D converter inside the AFE 4. Converted to a signal. The camera signal processing circuit 6 controlled by the system control unit 12 generates image data of luminance color difference from the digital image signal which is the output of the AFE 4.

  The image memory 7 is used for temporarily storing a digital image signal during signal processing or for storing image data which is a digital image signal subjected to signal processing. The inter-frame predictive encoding processing circuit 8 compresses and encodes the digital image signal subjected to signal processing. The image data encoded by the inter-frame prediction encoding processing circuit 8 is converted into data suitable for the recording medium 11 (for example, file system data having a hierarchical structure) by the recording processing circuit 10 and recorded on the recording medium 11. The Further, the AF evaluation value generation circuit 9 performs control so as to change the way of calculating the AF evaluation value according to the code amount information output from the inter-frame prediction encoding processing circuit 8.

  The system control unit 12 controls the drive circuit 5, the camera signal processing circuit 6, the inter-frame prediction encoding processing circuit 8, the AF evaluation value generation circuit 9, and the recording processing circuit 10 via the bus 15. Information such as control parameters necessary for each signal processing circuit and a program for controlling the circuit is read from the nonvolatile memory 13 connected to the system control unit 12.

  Next, FIG. 2 shows a configuration example of the camera signal processing circuit 6 in the present embodiment. In the present embodiment, a single plate imaging apparatus having an imaging element in which primary color filters are arranged in a Bayer shape will be described as an example.

  For each pixel, digital image data (indicated as RAW) of a color corresponding to the color filter of the image sensor 3 is input from the AFE 4 to the camera signal processing circuit 6. In this RAW data state, each pixel position has only a color value corresponding to one of RGB color filters. Therefore, in the synchronization processing circuit 600, the input RAW data is separated into RGB pixels, and then interpolation processing is performed so as to have RGB values at all pixel positions.

  The RGB image signal generated by the synchronization processing circuit 600 is converted into a luminance signal YL and color difference signals CR and CB by, for example, calculations shown in the following equations 1 to 3 in the YC matrix processing circuit 601. .

  The contour compensation circuit 602 performs a process of extracting a high frequency component YH of luminance after separating G pixels from RAW data input from the AFE 4. In addition, in addition circuit 603, YL and YH are combined and output as Y ′ to interframe predictive coding processing circuit 8.

FIG. 3 shows a configuration example of the inter-frame prediction encoding processing circuit 8 in the present embodiment.
In FIG. 3, the blocking circuit 800 divides the image data signal-processed by the camera signal processing circuit 6 into 8 × 8 pixel input blocks and outputs the input blocks to the first adder 801.

  The first adder 801 adds the input block divided by the blocking circuit 800 and the predicted value output from the frame memory 809 and outputs a difference image to the orthogonal transform circuit 802 as the difference between the two. Then, the orthogonal transform circuit 802 performs orthogonal transform on the difference image, and outputs the transform coefficient subjected to the orthogonal transform to the quantization circuit 803.

  The quantization circuit 803 quantizes the orthogonally transformed transform coefficient using a table determined by rate setting or the like. The quantized transform coefficient is output to the inverse quantization circuit 806 and the run length encoding circuit 804. Run-length encoding circuit 804 performs run-length encoding on the transform coefficient quantized by quantization circuit 803 and outputs the result to multiplexing circuit 805.

  The multiplexing circuit 805 multiplexes the result encoded by the run length encoding circuit 804 and the motion vector detected by the motion vector detection circuit 810. The multiplexed signal is temporarily stored in the buffer 811 and output to the recording processing circuit 10 at a certain rate.

  On the other hand, the inverse quantization circuit 806 inversely quantizes the transform coefficient quantized by the quantization circuit 803 to return it to the orthogonal transform coefficient, and outputs it to the inverse orthogonal transform circuit 807. The inverse orthogonal transform circuit 807 performs inverse orthogonal transform on the orthogonal transform coefficient inversely quantized by the inverse quantization circuit 806, and outputs a difference image obtained by the inverse orthogonal transform to the second adder 808.

  The second adder 808 adds the predicted value output from the frame memory 809 and the difference image output from the inverse orthogonal transform circuit 807, and outputs the reproduced pixel to the frame memory 809. The frame memory 809 generates and stores a reproduction image from the reproduction pixel value output from the second adder 808, and outputs the reproduction image to the motion vector detection circuit 810 as a predicted value of the next frame.

  The motion vector detection circuit 810 obtains a motion vector from the image data signal-processed by the camera signal processing circuit 6 and the reproduced image output from the frame memory 809, and outputs the motion vector to the multiplexing circuit 805 and the frame memory 809. The code amount information calculation circuit 812 outputs the code amount information converted from the occupation amount of the buffer 811 to the AF evaluation value generation circuit 9.

  Here, the code amount information is information on how much the generated code amount is smaller or smaller than the target code amount, or information on whether or not the inter-frame predictive coding will fail. In this embodiment, the code amount information is converted from the buffer occupancy, but it is only necessary to know the state of the code amount, such as conversion from the quantization coefficient at the time of quantization.

Next, the control operation of the AF evaluation value generation circuit 9 of this embodiment will be described with reference to the flowchart of FIG.
First, in step S400, the code amount information is read from the code amount information calculation circuit 812 in the interframe predictive coding processing circuit 8.

  Here, as shown in FIG. 5, the high-frequency component and the generated code amount of the image data have a relationship that the generated code amount decreases when the high-frequency component is small. That is, when it is desired to reduce the amount of generated code, it is only necessary to reduce the high frequency component of the image data. Here, the lens has axial chromatic aberration due to its optical characteristics, and the position of the best focus focus lens when viewed in RGB single color is slightly shifted as shown in FIG.

  In a general AF operation, the peak position of the high-frequency component of G is the best focus for the human eye. Therefore, for example, G such as Rg: Gg: Bg = 0.25: 0.5: 0.25 The AF evaluation value is generated at a higher ratio. Further, since the luminance signal has a high G ratio, the closer the AF evaluation value is to the peak position of the G high-frequency component, the more high-frequency components are included in the video signal and the amount of generated code increases.

  Therefore, in step S401, gains of Rg, Gg, and Bg are set according to the code amount as shown in FIG. Next, in step S402, the color component signals RGB are read from the synchronization processing circuit 600 inside the camera signal processing circuit 6, respectively. In step S403, for example, the luminance signal YAF is generated by the calculation shown in the following equation 4.

  Next, in step S404, high frequency components are extracted, and in step S405, the high frequency components are integrated. Next, in step S406, it is determined whether or not the integration of the high frequency components has been completed. If the result of this determination is that it has not been completed, processing returns to step S402. On the other hand, if the integration is completed as a result of the determination in step S406, the integrated value is output to the system control unit 12 in step S407 as the AF evaluation value.

  As described above, the RGB gain at the time of AF evaluation value control is changed according to the code amount information, and the peak position of the AF evaluation value is stably shifted from the best peak, thereby blurring the input image and generating the generated code amount. Can be reduced. In addition, since the shift range is a range of axial chromatic aberration, the shift is not excessively blurred. Rg, Gg, and Bg may be stored as a table in the AF evaluation value generation circuit 9 or may be calculated. Further, specific numerical values are not limited to this, and may be those that can be controlled from the outside.

(Second Embodiment)
Next, the present embodiment will be described with reference to FIGS.
FIG. 8 is a block diagram of the imaging apparatus in the present embodiment. FIG. 9 is a block diagram of the camera signal processing circuit 6 in the present embodiment.

  This embodiment is substantially the same as the first embodiment, and the same members are denoted by the same reference numerals, and the description of the overlapping configuration is omitted. The difference from the first embodiment is that the camera signal processing circuit 6 includes a hue detection circuit 604. The hue detection circuit 604 detects the hue of the subject and outputs a control signal COL corresponding to the hue to the AF evaluation value generation circuit 9. Then, the control method of the AF evaluation value generation circuit 9 is changed using the control signal COL and the code amount information calculation circuit 812 inside the inter-frame prediction encoding processing circuit 8.

  In FIG. 9, the hue detection circuit 604 calculates the hue θ of the subject by using the color difference signals CB and CR from the YC matrix processing circuit 601, for example, by the calculation shown in Equation 5 below.

  When the hue θ is as follows, the control signal COL is output as shown in the following equation (6).

  Further, π represents a circumference ratio. That is, when the control signal COL is “1”, the subject is relatively red, and when the control signal COL is “0”, the subject is relatively blue.

Next, the control operation of the AF evaluation value generation circuit 9 in the present embodiment will be described with reference to the flowchart of FIG.
First, in step S900, the code amount information is read from the code amount information calculation circuit 812 in the interframe predictive coding processing circuit 8.

  In step S901, the control signal COL corresponding to the hue of the subject is read from the hue detection circuit 604 inside the camera signal processing circuit 6. Then, it is determined whether the read control signal COL is “0” or “1”. If the result of this determination is that the control signal COL is “0”, in step S902, the RGB gain is set so that the ratio of Rg is high as shown in FIG. On the other hand, if the result of determination in step S901 is that the control signal COL is “1”, in step S903, the RGB gain is set so that the ratio of Bg is increased as shown in FIG.

  For example, if the control signal COL is “0”, that is, if the subject is blue, the image data has many B high frequency components. Here, if the ratio of B of the AF evaluation value is increased, the high frequency component cannot be reduced efficiently, and the generated code amount cannot be reduced efficiently. Therefore, by increasing the Rg ratio of the RGB gain and increasing the R ratio of the AF evaluation value, the peak of the AF evaluation value is shifted in the R direction, and the high-frequency component of the image data is efficiently reduced. Thereby, the amount of generated codes can be efficiently reduced.

  Next, in step S904, the color component signals RGB are read from the synchronization processing circuit 600 inside the camera signal processing circuit 6, respectively. In step S905, for example, the luminance signal YAF is generated by the calculation shown in Equation 4.

  Next, in step S906, high frequency components are extracted, and in step S907, the high frequency components are integrated. In step S908, it is determined whether or not the integration of high frequency components is complete. If the integration is not completed as a result of this determination, the process returns to step S904. On the other hand, if the integration is completed as a result of the determination in step S908, the integrated value is output to the system control unit 12 in step S909 as the AF evaluation value.

  As described above, in the present embodiment, it is determined whether the subject is relatively blue or relatively red from the hue detected using the hue detection circuit 604. It is possible to prevent a state where the code amount cannot be reduced efficiently.

(Third embodiment)
Next, the present embodiment will be described with reference to FIG.
This embodiment is substantially the same as the second embodiment, and the same members are denoted by the same reference numerals, and the description of the overlapping configuration is omitted. The difference is that the hue detection circuit 604 of the camera signal processing circuit 6 outputs not only the control signal COL corresponding to the hue but also the hue θ, and according to the compression code amount information, the control signal COL and the hue θ, The point is that the evaluation value generation method of the AF evaluation value generation circuit 9 is changed.

FIG. 11 shows a flowchart of an evaluation value generation method of the AF evaluation value generation circuit 9 in the present embodiment.
First, in step S1100, code amount information is read from the code amount information calculation circuit 812 inside the inter-frame predictive coding processing circuit 8.

  In step S1101, hue information including the control signal COL and the hue θ is read from the hue detection circuit 604 inside the camera signal processing circuit 6. Then, it is determined whether the read control signal COL is “0” or “1”. If the control signal COL is “0” as a result of this determination, the process proceeds to step S1102, and the RGB gain is set so that the ratio of Rg is high as shown in FIG. If the result of determination in step S1101 is that the control signal COL is “1”, processing proceeds to step S1103, and the RGB gain is set so that the ratio of Bg is increased as shown in FIG. 7B. .

  Next, in step S1104, coefficients α, β, and γ necessary for calculation of the luminance signal are set as shown in FIG. For example, if the subject is magenta, it has many red and blue high frequency components. In this case, in order to reduce the amount of generated codes, the AF evaluation value is adjusted to the G peak position where the high frequency component is small. Therefore, by setting α = 0, β = 1, and γ = 0 and increasing the ratio of G in the AF evaluation value, the AF evaluation value is adjusted to the peak position of G with a small number of high-frequency components.

  In step S 1105, the color components are read from the synchronization processing circuit 600 inside the camera signal processing circuit 6. In step S1106, for example, the luminance signal YAF is generated by the calculation shown in the following Expression 7.

  Next, in step S1107, high frequency components are extracted, and in step S1108, the high frequency components are integrated. Next, in step S1109, it is determined whether or not the integration of high frequency components has been completed. If the result of this determination is that it has not been completed, processing returns to step S1105. On the other hand, if the integration is completed as a result of the determination in step S1109, the integrated value is output to the system control unit 12 in step S1110 as the AF evaluation value.

  As described above, by using the control signal COL and the hue θ, an AF evaluation value suitable for each hue can be generated. Thereby, the peak position of the AF evaluation value can be effectively shifted from the best peak, the input image can be effectively blurred, and the generated code amount can be reduced.

  In addition, since the shift range is a range of axial chromatic aberration, the shift is not excessively blurred. Α, β, and γ may be stored as a table in the AF evaluation value control circuit or may be calculated. Further, specific numerical values are not limited to this, and may be those that can be controlled from the outside.

(Fourth embodiment)
Next, the present embodiment will be described with reference to FIGS.
FIG. 13 is a block diagram of the imaging apparatus according to the present embodiment. FIG. 14 is a block diagram of the camera signal processing circuit 6 in the present embodiment.
This embodiment is substantially the same as the third embodiment, and the same members are denoted by the same reference numerals, and the description of the overlapping configuration is omitted. The difference is that the camera signal processing circuit 6 includes a color suppression circuit 605, and the evaluation value generation information T is input from the AF evaluation value generation circuit 9.

  In FIG. 14, the color suppression circuit 605 receives the color difference signal CB and the color difference signal CR from the YC matrix processing circuit 601, the AF evaluation value generation information from the AF evaluation value generation circuit 9, and the high frequency component YH of the luminance signal from the contour compensation circuit 602. input. Then, using these, when the RGB ratio of the AF evaluation value is changed, the color blur that occurs around the edge of the brightness is read using the CRg and CBg read from the system control unit 12, for example, And suppression by the calculation shown in Equation 9.

The control operation of the color suppression circuit 605 in this embodiment will be described with reference to the flowchart shown in FIG.
First, in step S1400, the high frequency component YH of the luminance signal is read from the contour compensation circuit 602. Next, in step S1401, it is determined whether the pixel of interest is in the vicinity of the high luminance part. If the result of this determination is that it is in the vicinity of the high luminance part, the process proceeds to step S1402 in order to perform color suppression processing. On the other hand, if the result of the determination in step S1401 is not the vicinity of the high luminance part, the process proceeds to step S1406.

  In step S1402, AF evaluation value generation information is read from the AF evaluation value generation circuit 9. Next, in step S1403, RGB gain setting information is read from the AF evaluation value generation information, and it is determined how the RGB gain is set. Here, the RGB gain setting information indicates information on how to set the RGB gain ratio set from the hue as shown in FIG. 7 of the second embodiment.

  As a result of this determination, when the RGB gain setting is set so that the ratio of Rg is high, the peak of the AF evaluation value is shifted in the direction of the peak of R, so that B is blurred and input. B color blur occurs. Therefore, the process proceeds to step S1404, where CBg, which is a CB suppression gain, is set to 0, and B color blurring that occurs around the high-luminance portion is set to be suppressed.

  On the other hand, as a result of the determination in step S1403, when the RGB gain setting is set so that the ratio of Bg is increased, the AF evaluation value peak is shifted in the B peak direction, so that R is blurred and input. In the vicinity of the high-luminance portion, a color blur of R occurs. Accordingly, the process proceeds to step S1405, where CRg, which is a CR suppression gain, is set to 0 and is set so as to suppress the R color blurring that occurs around the high luminance portion. Here, although CBg and CRg are set to 0, suppression may be controlled from the outside.

  Next, in step S1406, calculation is performed using the set CBg and CRg, and the process ends. In the present embodiment, the color blur that occurs around the high luminance portion is suppressed. On the other hand, the high frequency component of the color component signal RGB input from the synchronization processing circuit 600 and the high frequency component of the color difference signals CB and CR input from the YC matrix circuit 601 are extracted to suppress the color blur generated at the color boundary. You may make it do.

  As described above, according to the present embodiment, by using the color suppression circuit 605, it is possible to suppress the color blur that occurs around the high-luminance portion when the RGB ratio of the AF evaluation value is changed.

(Other embodiments according to the present invention)
Each means constituting the image pickup apparatus and each step of the image pickup method in the embodiment of the present invention described above can be realized by operating a program stored in a RAM or ROM of a computer. This program and a computer-readable recording medium recording the program are included in the present invention.

  Further, the present invention can be implemented as, for example, a system, apparatus, method, program, or recording medium. Specifically, the present invention may be applied to a system including a plurality of devices. The present invention may be applied to an apparatus composed of a single device.

  In the present invention, a software program (in the embodiment, a program corresponding to the flowcharts shown in FIGS. 4, 10, 11, and 15) for realizing the functions of the above-described embodiments is directly or remotely supplied to the system or apparatus. To do. This includes the case where the system or apparatus computer also achieves by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the recording medium for supplying the program include a floppy (registered trademark) disk, a hard disk, an optical disk, and a magneto-optical disk. Further, there are MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R) and the like.

  As another program supply method, there is a method of connecting to a homepage on the Internet using a browser of a client computer. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  As another method, the program of the present invention is encrypted, stored in a recording medium such as a CD-ROM, distributed to users, and encrypted from a homepage via the Internet to users who have cleared predetermined conditions. Download the key information to be solved. It is also possible to execute the encrypted program by using the key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. Furthermore, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can be realized by the processing.

  As another method, the program read from the recording medium is first written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Then, based on the instructions of the program, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are also realized by the processing.

1 is a block diagram illustrating a configuration example of an imaging device according to a first embodiment of the present invention. It is a block diagram which shows the structural example of the camera signal processing circuit in the 1st Embodiment of this invention. It is a block diagram which shows the structural example of the inter-frame prediction encoding process circuit in the 1st Embodiment of this invention. It is a flowchart which shows an example of the process sequence of AF evaluation value generation circuit in the 1st Embodiment of this invention. In the 1st Embodiment of this invention, it is a figure which shows the relationship between the high frequency component of image data, and the generated code amount. In the 1st Embodiment of this invention, it is a figure which shows the relationship between a high frequency component and the position of a focus lens. In the 1st Embodiment of this invention, it is a figure which shows the relationship between the amount of generated codes and the gain amount of Rg, Gg, and Bg. It is a block diagram which shows the structural example of the imaging device in the 2nd Embodiment of this invention. It is a block diagram which shows the structural example of the camera signal processing circuit in the 2nd Embodiment of this invention. It is a flowchart which shows an example of the process sequence of AF evaluation value generation circuit in the 2nd Embodiment of this invention. It is a flowchart which shows an example of the process sequence of AF evaluation ground generation circuit in the 3rd Embodiment of this invention. In the 3rd Embodiment of this invention, it is a figure which shows the relationship between a hue, (alpha), (beta), and (gamma). It is a block diagram which shows the structural example of the imaging device in the 4th Embodiment of this invention. It is a block diagram which shows the structural example of the camera signal processing circuit in the 4th Embodiment of this invention. It is a flowchart which shows an example of the process sequence of AF evaluation value generation circuit in the 4th Embodiment of this invention.

Explanation of symbols

1 Lens 2 Aperture 3 Image Sensor 4 AFE
DESCRIPTION OF SYMBOLS 5 Drive circuit 6 Camera signal processing circuit 7 Image memory 8 Inter-frame prediction encoding processing circuit 9 AF evaluation value generation circuit 10 Recording processing circuit 11 Recording medium 12 System control part 13 Non-volatile memory (ROM)
14 Volatile memory (RAM)
15 Bus 600 Synchronization processing circuit 601 YC matrix processing circuit 602 Contour compensation circuit 603 Addition circuit 604 Hue detection circuit 605 Color suppression circuit 800 Blocking circuit 801 First adder 802 Orthogonal transformation circuit 803 Quantization circuit 804 Run length coding Circuit 805 Multiplexing circuit 806 Inverse quantization circuit 807 Inverse orthogonal transformation circuit 808 Second adder 809 Frame memory 810 Motion vector detection circuit 811 Buffer 812 Code amount information calculation circuit

Claims (8)

Imaging means for photoelectrically converting a subject image formed by an imaging optical system and outputting an image signal;
Signal processing means for processing the image signal into image data;
Evaluation value acquisition means for acquiring an evaluation value indicating an in-focus state of the imaging optical system based on image data signal-processed by the signal processing means;
Focus adjusting means for controlling the focus by moving the imaging optical system according to the evaluation value;
Compression encoding means for compressing and encoding the image data signal-processed by the signal processing means,
The evaluation value acquisition unit changes the RGB component ratio of the image data signal-processed by the signal processing unit according to the compression code amount information output from the compression encoding unit, and acquires the evaluation value. An imaging apparatus characterized by that. Color information detecting means for detecting color information of the subject;
The evaluation value acquisition unit acquires the evaluation value by changing a ratio of the RGB components according to color information detected by the color information detection unit and the compression code amount information. Item 2. The imaging device according to Item 1.   The evaluation value acquisition unit increases the ratio of R or B among the RGB components of the image data signal-processed by the signal processing unit according to the compression code amount information output from the compression encoding unit. The imaging apparatus according to claim 1, wherein the evaluation value is acquired.   The signal processing means includes color suppression means for suppressing a color signal of the image data, and extraction means for extracting a high-frequency component of luminance of the image data. The color suppression means is obtained by the evaluation value acquisition means. The imaging apparatus according to claim 1, wherein the color signal is suppressed based on information on the acquired evaluation value and a high-frequency component of luminance extracted by the extraction unit. The imaging device according to any one of claims 1 to 4,
An imaging system comprising: an imaging optical system. A signal processing step of signal-processing image signals obtained by photoelectrically converting a subject image formed by an imaging optical system into image data;
An evaluation value acquisition step of acquiring an evaluation value indicating the in-focus state of the imaging optical system based on the image data signal-processed in the signal processing step;
A focus adjustment step for controlling the focus by moving the imaging optical system according to the evaluation value;
A compression encoding step of compression encoding the image data signal-processed by the signal processing step,
In the evaluation value acquisition step, the evaluation value is acquired by changing a ratio of RGB components of the image data signal-processed by the signal processing step according to the compression code amount information output by the compression encoding step. An imaging method characterized by the above.   A program causing a computer to execute the imaging method according to claim 6.   A computer-readable recording medium, wherein the program according to claim 7 is recorded.

Images