JP2006203566A - Imaging apparatus, image processing apparatus and image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To form an optimum viewed image in accordance with a photographing scene without causing information losses of picked-up image information. <P>SOLUTION: An imaging apparatus 51 performs photographing to generate scene reference raw data. An apparatus characteristic correction information processing part 10 generates imaging apparatus characteristic correction data, and a photographing information data processing part 9 generates photographing information data. A scene discrimination index data generating part 12 generates scene discrimination index data that quantitatively shows a light source condition and an exposure condition. The imaging apparatus characteristic correction data, the photographing information data and the scene discrimination index data are attached to a file header of the scene reference raw data as tag information, and the attached data file is recorded and stored in a recording medium of a storage device 16. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing apparatus and an image processing method for performing image processing to form an appreciation image on an output medium with respect to an image capturing apparatus such as a digital camera and digital image data obtained by the image capturing apparatus.

  In recent years, digital image data photographed by an imaging device such as a digital camera is displayed on a display device such as a CRT (Cathode Ray Tube), a liquid crystal display, a plasma display, or a small liquid crystal monitor of a mobile phone, or a digital printer, an inkjet There are a variety of display / printing methods such as printing as a hard copy image from an output device such as a printer or a thermal printer.

  When displaying and printing digital image data for viewing purposes, gradation adjustment, brightness adjustment, color balance adjustment, sharpness enhancement to obtain the desired image quality on the display monitor or hard copy used for viewing. In general, various image processes represented by the above are performed.

  For example, a technique for generating versatile image data by recording reproduction reference data for standardizing scene reference raw data attached to scene reference raw data depending on imaging device characteristics is disclosed. (See Patent Document 1).

In recent years, a standard (CIPA DC-001) called PictBridge has been proposed in which image data captured by a digital camera is directly transmitted to an inkjet printer or the like without using a personal computer or the like for output. In addition, RAW data is directly output by an ink jet printer or the like without using development software.
JP 2004-96500 A

  However, in general, in digital camera shooting, not all shooting is performed under optimal light source conditions and exposure conditions. When the scene state of the photographed image is not suitable for viewing such as so-called backlight, under, high contrast, etc., it is difficult to obtain an optimal viewing image.

  The present invention has been made in view of the above-described problems in the prior art, and is an imaging apparatus and image processing capable of forming an optimal appreciation image according to a shooting scene without accompanying information loss of captured image information. It is an object to provide an apparatus and an image processing method.

  In order to solve the above-described problem, the invention described in claim 1 is directed to a scene reference raw data generation unit that generates scene reference raw data depending on device characteristics of the imaging device by imaging, and the scene reference raw data. Reproduction auxiliary data generation means for generating reproduction auxiliary data used when performing processing for correcting the device characteristics specific to the imaging apparatus to data, and shooting information data generation means for generating shooting information data which is shooting condition settings at the time of shooting And scene discrimination index data generating means for generating scene discrimination index data for discriminating a shooting scene, and attaching the reproduction auxiliary data, the shooting information data, and the scene determination index data to the scene reference raw data, And a recording control means for recording on a medium.

  Here, in the description of the present specification, “generation” means that a program or a processing circuit that operates in the imaging apparatus and the image processing apparatus according to the present invention newly creates an image signal and data. “Create” may be used as a synonym.

  The “imaging device” is a device including an imaging element (image sensor) having a photoelectric conversion function, and includes a so-called digital camera and scanner. As an example of the image pickup device, there is a CCD type image pickup device provided with a color sensitivity by combining a CCD (Charge Coupled Device), a charge transfer mechanism, and a checkered color filter, or a CMOS type image pickup device. Can be mentioned. The output currents of these image sensors are digitized by an A / D converter. The contents of each color channel at this stage are signal intensities based on the spectral sensitivity unique to the image sensor.

  The “scene reference raw data depending on the device characteristics of the imaging device” is a raw output signal directly recorded on the imaging device in which information faithful to the subject is recorded, and the data itself digitized by the A / D converter. Or data obtained by performing noise correction such as fixed pattern noise and dark current noise on the data, and includes RAW data. This scene reference raw data is generated by image processing that modifies the contents of the data to improve the effects during image viewing such as gradation conversion, sharpness enhancement, and saturation enhancement, and each color channel based on the spectral sensitivity inherent to the image sensor. The signal intensity of RIM RGB (Reference Input Medium Metric RGB) or ERIM RGB (Extended Reference Input Medium Metric RGB) (see Journal of Imaging Science and Technology 45, pp. 418-426 (2001)), sRGB (IEC61966-2- 1) The process of mapping to a standardized color space such as scRGB (IEC61966-2-2) is omitted. The information amount (for example, the number of gradations) of the scene reference raw data is preferably equal to or greater than the information amount (for example, the number of gradations) required for the viewing image reference data in accordance with the performance of the A / D converter. . For example, when the number of gradations of the viewing image reference data is 8 bits per channel, the number of gradations of the scene reference raw data is preferably 12 bits or more, more preferably 14 bits or more, and even more preferably 16 bits or more.

  Further, “processing for correcting device characteristics unique to the imaging device” means processing for converting the above-described “scene reference raw data” into “scene reference image data” described later. The content of this process depends on the state of the scene reference raw data, but includes a process of mapping the signal intensity of each color channel based on at least the spectral sensitivity unique to the image sensor to a standard color space such as RIM RGB or ERIMM RGB. For example, when the scene reference raw data is not subjected to interpolation processing based on the color filter array, it is necessary to perform the processing (for details of the interpolation processing based on the color filter array, see, for example, “Fine (Imaging and digital photography ", page 51 of the publishing committee of the Japan Photographic Society). As a result, it is possible to obtain scene reference image data having the same amount of information as the scene reference raw data, but in which the difference in signal value between different imaging devices is corrected.

  In addition, “reproduction assistance data” means data that can be used to correct the device characteristics unique to the imaging device by using only the information described in the data. Information that makes it possible to map at least the signal intensity of each color channel based on the spectral sensitivity of the image sensor itself to a standard color space such as RIM RGB or ERIMM RGB, that is, the spectral sensitivity characteristic specific to the image sensor or RIMM RGB It is necessary to describe matrix coefficients to be used when converting to a specific standard color space. For example, if only the model name of the imaging device is described, the image processing device performing this processing may not have a correspondence table between the model name and the matrix coefficient, so it can be said that the data is sufficient. Absent. Also, for example, even if sufficient information is not directly described when performing this processing, if the URL indicating the location of the information on the Internet is described, sufficient information is sufficient to perform this processing. It can be regarded as data. These “reproduction auxiliary data” are preferably recorded as tag information to be written in the header portion of the image file, such as a DNG tag according to the image format Digital Negative (DNG) recommended by Adobe Systems.

  In addition, when the “reproduction auxiliary data” is stored in the media independently of the “scene reference raw data”, either “reproduction auxiliary data”, “scene reference raw data”, or both On the other hand, it is necessary to attach information for associating the two or attach a status information file in which related information is separately described.

  The “shooting information data” is a record of shooting condition settings at the time of shooting, and may include the same tag information written in the header portion of the Exif file. Specifically, exposure time, shutter speed, aperture value (F number), ISO sensitivity, brightness value, subject distance range, light source, strobe emission, subject area, white balance, zoom magnification, subject composition, shooting scene type, A tag (code) or the like indicating information on the amount of reflected light of the strobe light source, shooting saturation, type of subject, and the like.

  “Photographing information data” is a value obtained at the time of photographing by a sensor provided in the camera, data processed from the value of the sensor, or a value of the sensor in order to automate the exposure setting and focus function of the imaging device. It is classified into the camera shooting conditions set on the basis of this, but in addition to this, a shooting mode dial (for example, portrait, sports, macro shooting mode, etc.), a strobe forced flash setting switch, etc. Also included is information manually set by the photographer.

  The “photographing scene” means a state of a photographed image according to a light source condition or an exposure condition at the time of photographing. For example, there are states such as “appropriate”, “backlight”, “under”, and “high contrast”.

  The “scene discrimination index data” represents the degree of the above-described shooting scene, and includes, for example, the backlight intensity, the under degree, the high contrast degree, and the like. The “scene discrimination index data” is preferably recorded as tag information written in a header portion in an image file, such as a DNG tag according to the DNG format.

  The “media” is a storage medium used to store scene reference raw data output from the imaging apparatus, and is a compact flash (registered trademark), memory stick, smart media, multimedia card, hard disk, floppy (registered trademark). ) Any of disk, magnetic storage medium (MO), CD-R, etc. In addition, the unit for writing to the storage medium is installed in a wired state via a cord even if it is integrated with the imaging device, installed independently or remotely in a wireless state via communication or the Internet Any aspect of the unit or the like may be used. The file format when recording to media is not a format specific to the imaging device, but is a standardized standard such as TIFF (Tagged Image File Format), JPEG (Joint Photographic Experts Group), Exif (Exchangeable Image File Format) The file format is preferably recorded.

  According to a second aspect of the present invention, in the imaging device according to the first aspect, display image data generating means for generating display image data based on the scene reference raw data, and the display image data are displayed. Display means, wherein the scene determination index data generation means generates scene determination index data using the display image data.

  According to a third aspect of the present invention, in the image processing apparatus, the scene reference raw data depending on the device characteristics of the imaging device, and the reproduction used when performing processing for correcting the device characteristics unique to the imaging device to the scene reference raw data. Input means for inputting auxiliary data, shooting information data that is shooting condition settings at the time of shooting, and scene determination index data for determining a shooting scene, and the scene reference raw data, based on the reproduction auxiliary data, A scene reference image data generating unit that generates scene reference image data by performing a process for correcting device characteristics unique to the imaging device, and the scene reference image data generated by the scene reference image data generating unit Based on the information data and the scene discrimination index data, image processing for forming an optimal viewing image on the output medium is performed. Characterized in that and a referred image data generating means for generating a referred image data Te.

  Here, “input” refers to “scene reference raw data”, “reproduction assistance data”, “imaging information data”, and “scene discrimination index data” output from the imaging apparatus, from the imaging apparatus to the image processing apparatus of the present invention. Means to communicate.

  For example, when the image processing apparatus has a function of reading “scene reference raw data” directly from the image capturing apparatus when the image capturing apparatus and the above-described storage medium writing unit are connected, this The image processing apparatus of the present invention has a connection means for connecting to the imaging apparatus, and this connection means corresponds to the input means of the present invention. When using portable “media” such as CompactFlash (registered trademark), memory stick, smart media, multimedia card, floppy (registered trademark) disk, magneto-optical storage medium (MO), or CD-R The image processing apparatus of the present invention has corresponding reading means, and this reading means corresponds to the input means of the present invention. Further, when the writing unit is an independent or remotely installed state connected wirelessly via communication or the Internet, the image processing apparatus of the present invention has communication means for connecting to the communication or the Internet. This communication means corresponds to the input means of the present invention.

  The “scene reference image data” means that the signal intensity of each color channel based on at least the spectral sensitivity of the image sensor itself has been mapped to a standard color space such as RIM RGB, ERIMM RGB, etc., and gradation conversion / sharpness enhancement / It means image data in a state in which image processing for modifying data contents in order to improve the effect at the time of image viewing such as saturation enhancement is omitted. In addition, scene reference image data is a correction of photoelectric conversion characteristics of the imaging device (opto-electronic conversion function defined by ISO1452; for example, “Fine Imaging and Digital Photography” of Corona Co., Ltd., page 449 of the Japan Photographic Society Publishing Committee). It is preferable to have performed. The information amount (for example, the number of gradations) of the scene reference image data is preferably equal to or greater than the information amount (for example, the number of gradations) required for the viewing image reference data in accordance with the performance of the A / D converter. . For example, when the number of gradations of the viewing image reference data is 8 bits per channel, the number of gradations of the scene reference image data is preferably 12 bits or more, more preferably 14 bits or more, and even more preferably 16 bits or more.

  The “output medium” is, for example, a display device such as a CRT, a liquid crystal display, or a plasma display, or a paper for generating a hard copy image such as a silver salt photographic paper, an inkjet paper, or a thermal printer paper.

  Here, “appreciation image reference data” means appreciation image formation on an output medium such as a display device such as a CRT, a liquid crystal display, or a plasma display, or an output device such as a silver salt photographic paper, an ink jet paper, or a thermal printer paper. This means digital image data used for.

  “Image processing to form an optimal viewing image” is optimal on display devices such as CRTs, liquid crystal displays, and plasma displays, and on output media such as silver halide photographic paper, inkjet paper, and thermal printer paper. This is a process for obtaining a clear image. For example, when it is assumed that the image is displayed on a CRT display monitor compliant with the sRGB standard, processing is performed so as to obtain an optimum color reproduction within the color gamut of the sRGB standard. If output to silver salt photographic paper is assumed, processing is performed so that optimum color reproduction is obtained within the color gamut of silver salt photographic paper. In addition to color gamut compression, gradation compression from 16 bits to 8 bits, reduction of the number of output pixels, and processing for handling output characteristics (LUT) of the output device are also included. Furthermore, it goes without saying that image processing such as noise suppression, sharpening, color balance adjustment, saturation adjustment, or dodging is performed.

  According to a fourth aspect of the present invention, in the image processing apparatus according to the third aspect, the appreciation image reference data generation means is a gradation adjustment method applied to the scene reference image data based on the scene discrimination index data, and The adjustment amount is determined.

  According to a fifth aspect of the present invention, in the imaging apparatus, scene reference raw data generating means for generating scene reference raw data depending on the device characteristics of the imaging apparatus by imaging, and an apparatus specific to the imaging apparatus for the scene reference raw data Reproduction auxiliary data generation means for generating reproduction auxiliary data used when performing processing for correcting characteristics, shooting information data generation means for generating shooting information data that is shooting condition settings at the time of shooting, and for determining a shooting scene Scene discrimination index data generating means for generating the scene discrimination index data, tone conversion data generating means for generating tone conversion data based on the scene discrimination index data, and the reproduction auxiliary data in the scene reference raw data And recording control means for attaching the photographing information data and the gradation conversion data, and further recording on a medium. And butterflies.

  According to a sixth aspect of the present invention, in the imaging device according to the fifth aspect, display image data generating means for generating display image data based on the scene reference raw data, and the display image data are displayed. Display means, wherein the scene determination index data generation means generates scene determination index data using the display image data.

  According to the seventh aspect of the present invention, in the image processing apparatus, the scene reference raw data depending on the device characteristics of the imaging device, and the reproduction used when performing processing for correcting the device characteristics specific to the imaging device to the scene reference raw data. Auxiliary data, input means for inputting photographing information data and gradation conversion data that are photographing condition settings at the time of photographing, and device characteristics specific to the imaging device based on the reproduction auxiliary data with respect to the scene reference raw data Scene reference image data generation means for generating scene reference image data by performing processing for correcting the image, and the shooting information data and the gradation conversion for the scene reference image data generated by the scene reference image data generation means Appreciation image that generates appreciation image reference data by performing image processing to form an optimal appreciation image on the output medium based on the data A reference data generating means, characterized by comprising a.

  According to an eighth aspect of the present invention, in the image processing method, a scene reference raw data generation step for generating scene reference raw data depending on device characteristics of the imaging device by imaging, and the scene reference raw data is unique to the imaging device. A reproduction auxiliary data generation step for generating reproduction auxiliary data used when performing processing for correcting the apparatus characteristics, a shooting information data generation step for generating shooting information data which is shooting condition setting at the time of shooting, and a shooting scene are determined. A scene discrimination index data generating step for generating scene discrimination index data for recording, and a recording step of attaching the reproduction auxiliary data, the shooting information data, and the scene discrimination index data to the scene reference raw data, and further recording the data on a medium It is characterized by including these.

  According to a ninth aspect of the present invention, in the image processing method according to the eighth aspect, a display image data generating step for generating display image data based on the scene reference raw data, and the display image data are displayed. And displaying the scene determination index data using the display image data in the scene determination index data generation step.

  According to the tenth aspect of the present invention, in the image processing method, the scene reference raw data depending on the device characteristics of the imaging device, and the reproduction used when the scene reference raw data is subjected to processing for correcting the device characteristics unique to the imaging device. Auxiliary data, input process of inputting scene determination index data for determining shooting information data and shooting scene settings that are shooting conditions at the time of shooting, and the scene reference raw data, based on the reproduction auxiliary data, A scene reference image data generation step for generating scene reference image data by performing a process for correcting device characteristics unique to the imaging device, and the shooting for the scene reference image data generated in the scene reference image data generation step Image processing for forming an optimal viewing image on the output medium based on the information data and the scene discrimination index data Characterized in that it comprises a and a referred image data generating step of generating a referred image data by performing.

  According to an eleventh aspect of the present invention, in the image processing method according to the tenth aspect, in the appreciation image reference data generation step, a gradation adjustment method applied to the scene reference image data based on the scene discrimination index data, and The adjustment amount is determined.

  According to a twelfth aspect of the present invention, in the image processing method, a scene reference raw data generation step of generating scene reference raw data depending on device characteristics of the imaging device by imaging, and the scene reference raw data is unique to the imaging device. A reproduction auxiliary data generation step for generating reproduction auxiliary data used when performing processing for correcting the apparatus characteristics, a shooting information data generation step for generating shooting information data which is shooting condition setting at the time of shooting, and a shooting scene are determined. A scene discrimination index data generating step for generating scene discrimination index data for generating, a tone conversion data generating step for generating tone conversion data based on the scene discrimination index data, and the reproduction assistance for the scene reference raw data A recording step of attaching data, the photographing information data, and the gradation conversion data, and further recording the data on a medium. And butterflies.

  A thirteenth aspect of the present invention is the image processing method according to the twelfth aspect of the present invention, wherein a display image data generating step for generating display image data based on the scene reference raw data and the display image data are displayed. And displaying the scene determination index data using the display image data in the scene determination index data generation step.

  According to the fourteenth aspect of the present invention, in the image processing method, the scene reference raw data depending on the device characteristics of the imaging device, and the reproduction used when performing processing for correcting the device characteristics unique to the imaging device to the scene reference raw data. An input process for inputting auxiliary data, shooting information data that is a shooting condition setting at the time of shooting, and gradation conversion data, and device characteristics specific to the imaging device based on the reproduction auxiliary data with respect to the scene reference raw data A scene reference image data generation step for generating scene reference image data by performing a process of correcting the image, and the shooting information data and the gradation conversion for the scene reference image data generated in the scene reference image data generation step Based on the data, the image processing for generating the optimum viewing image on the output medium is performed to generate the viewing image reference data. Characterized in that it comprises an image reference data generating step.

  According to the first and eighth aspects of the present invention, the scene reference raw data depending on the device characteristics of the imaging device, the reproduction auxiliary data used when performing processing for correcting the device characteristics unique to the imaging device to the scene reference raw data, Shooting information data, which is the shooting condition setting at the time of shooting, and scene discrimination index data for discriminating the shooting scene are generated, and these are attached to the scene reference raw data and recorded on the media. In addition, information for forming an optimal appreciation image according to the shooting scene can be provided to an external device.

  According to the second and ninth aspects of the present invention, since the display image data having a smaller image size than the scene reference raw data is used, the scene determination index data can be generated efficiently.

  According to the third and tenth aspects of the present invention, the scene reference raw data that depends on the device characteristics of the imaging device, the reproduction assistance data that is used when the scene reference raw data is subjected to processing for correcting the device characteristics unique to the imaging device, Inputs shooting information data, which is shooting condition settings at the time of shooting, and scene discrimination index data for discriminating the shooting scene, and corrects the device characteristics specific to the imaging device based on the reproduction assistance data for the scene reference raw data To generate scene reference image data, and to form an optimal viewing image on the output medium based on the shooting information data and the scene determination index data with respect to the generated scene reference image data Appreciation image reference data is generated by performing image processing, so that an optimal appreciation image can be formed according to the shooting scene without any information loss of captured image information. Can.

  According to the fourth and eleventh aspects of the present invention, since the gradation adjustment method and the adjustment amount to be applied to the scene reference image data are determined based on the scene discrimination index data, the optimum gradation adjustment is performed according to the shooting scene. It can be carried out.

  According to the inventions described in claims 5 and 12, the scene reference raw data depending on the device characteristics of the imaging device, the reproduction assistance data used when performing processing for correcting the device characteristics unique to the imaging device to the scene reference raw data, Shooting information data and gradation conversion data, which are shooting condition settings at the time of shooting, are generated, attached to the scene reference raw data, and recorded on the media. Accordingly, information for forming an optimal viewing image can be provided to an external device.

  According to the sixth and thirteenth aspects of the present invention, since the display image data having an image size smaller than the scene reference raw data is used, the scene discrimination index data can be efficiently generated.

  According to the invention described in claims 7 and 14, scene reference raw data depending on the device characteristics of the imaging device, reproduction auxiliary data used when processing for correcting the device characteristics specific to the imaging device is performed on the scene reference raw data, Inputs shooting information data and gradation conversion data, which are shooting condition settings at the time of shooting, and performs scene correction processing for correcting the device characteristics specific to the imaging device based on the reproduction assistance data for the scene reference raw data The image data is generated, and the generated scene reference image data is subjected to image processing for forming an optimal viewing image on the output medium based on the shooting information data and the gradation conversion data. Since the reference data is generated, it is possible to form an optimal appreciation image according to the shooting scene without accompanying information loss of the captured image information.

[First Embodiment]
The imaging device 51 and the image processing device 131 according to the first embodiment of the present invention will be described with reference to FIGS.

<Configuration of Imaging Device 51>
First, the configuration of the imaging device 51 will be described.
FIG. 1 is a block diagram illustrating a functional configuration of the imaging device 51. As shown in FIG. 1, the imaging device 51 includes a lens 1, an aperture 2, a CCD 3, an analog processing circuit 4, an A / D converter 5, a temporary storage memory 6, an image processing unit 7, a control unit 8, and photographing information data processing. Unit 9, device characteristic correction information processing unit 10, display image data generation unit 11, scene discrimination index data generation unit 12, operation unit 13, display unit 14, header information processing unit 15, storage device 16, CCD drive circuit 17, A focal length adjustment circuit 18, an automatic focus drive circuit 19, a motor 20, a strobe drive circuit 21, a strobe 22 and the like are provided.

The optical system of the imaging device 51 includes a lens 1, a diaphragm 2, and a CCD (solid-state imaging device) 3.
The lens 1 adjusts the focus and forms an optical image of the subject. The diaphragm 2 adjusts the amount of light beam that has passed through the lens 1. The CCD 3 photoelectrically converts subject light imaged on the light receiving surface by the lens 1 into an electrical signal (imaging signal) of an amount corresponding to the amount of incident light for each sensor in the CCD 3. The CCD 3 is sequentially controlled by the timing pulse output from the CCD drive circuit 17 to sequentially output the image pickup signal to the analog processing circuit 4.

  The analog processing circuit 4 performs R, G, B signal amplification, noise reduction processing, and the like on the image pickup signal input from the CCD 3. The processing in the analog processing circuit 4 is switched ON / OFF via the control unit 8 in accordance with an operation signal from the operation unit 13.

The A / D converter 5 converts the imaging signal input from the analog processing circuit 4 into digital image data and outputs it.
The temporary storage memory 6 is a buffer memory or the like, and temporarily stores the digital image data output from the A / D converter 5.

  The image processing unit 7 performs image quality change processing such as gradation correction of digital image data, crosstalk correction of spectral sensitivity, dark current noise suppression, sharpening, white balance adjustment, saturation adjustment, image size change, and trimming. Processing such as aspect conversion is performed. The processing in the image processing unit 7 is switched on / off via the control unit 8 in accordance with an operation signal from the operation unit 13.

  The control unit 8 is configured by a CPU (Central Processing Unit) or the like, reads a control program of the imaging device 51 stored in the storage device 16, and controls the entire imaging device 51 according to the read program. Specifically, the control unit 8 includes an automatic focus drive circuit 19, a focal length adjustment circuit 18, a CCD drive circuit 17, an analog processing circuit 4, a temporary storage memory 6, an image processing unit 7, an imaging information data processing unit 9, and a device. The characteristic correction information processing unit 10, the display image data generation unit 11, the scene discrimination index data generation unit 12, the operation unit 13, the display unit 14, and the strobe drive circuit 21 are controlled to perform photographing.

  When the output of scene reference raw data is specified by the operation unit 13, the control unit 8 performs a scene reference raw data storage process A described later, and performs signal amplification and noise reduction processing or image processing in the analog processing circuit 4 at the time of shooting. The processing in the processing unit 7 is omitted, and the imaging device characteristic correction data d1, the shooting information data d3, and the scene discrimination index data d6 are written as header information in the recording medium of the storage device 16, and the shot digital image data is referred to the scene. Record as raw data d2. For example, the imaging device characteristic correction data d1 and the scene discrimination index data d6 are written in the DNG tag, and the shooting information data d3 is written in the Exif tag. The control unit 8 has a function as a scene reference raw data generation unit and a recording control unit of the imaging apparatus described in the claims.

  The shooting information data processing unit 9 generates shooting information data d3. The shooting information data d3 includes information directly related to the camera type (model) such as camera name and code number, or exposure time, shutter speed, aperture value (F number), ISO sensitivity, luminance value, subject distance range, light source, etc. Information on the shooting conditions such as the presence / absence of strobe light emission, the subject area, white balance, zoom magnification, subject composition, shooting scene type, amount of reflected light from the strobe light source, shooting saturation, and the like. The photographing information data processing unit 9 has a function as photographing information data generation means of the imaging device described in the claims.

  In response to an operation signal from the operation unit 13, the apparatus characteristic correction information processing unit 10 stores the scene reference raw data d <b> 2 that is not processed by the analog processing circuit 4 and the image processing unit 7 under the control of the control unit 8. When recording on a recording medium, imaging device characteristic correction data d1 used to perform processing for correcting device characteristics specific to the imaging device (hereinafter referred to as imaging device characteristic correction processing) is generated on the scene reference raw data d2. To the header information processing unit 15. The imaging device characteristic correction data d1 corresponds to “reproduction assistance data” recited in the claims. The apparatus characteristic correction information processing unit 10 has a function as reproduction auxiliary data generation means of the imaging apparatus described in the claims.

  The display image data generation unit 11 generates viewing image reference data d5 from the scene reference raw data d2 based on the imaging device characteristic correction data d1 and shooting information data d3, and displays the viewing image reference data d5 by reducing the viewing image reference data d5. Image data is generated. In general, since the image size of the display device is smaller than the viewing image reference data d5, a known image size reduction method, for example, an interpolation method such as thinning, averaging of a plurality of pixels, bilinear, bicubic method, or the like is used. it can. The display image data generation unit 11 outputs the generated display image data to the display unit 14 and the scene determination index data generation unit 12. The display image data may be subjected to sharp enhancement processing, noise removal processing, or the like as necessary. However, in order to generate the scene determination index data d6 in the scene determination index data generation unit 12, the display image data is displayed. Therefore, it is preferable not to perform sharp enhancement processing, noise removal processing, or the like. However, these processes may be performed after the scene discrimination index data is generated.

  The scene determination index data generation unit 12 generates scene determination index data d6 for determining a photographic scene using the display image data generated by the display image data generation unit 11. Since the smaller image size allows efficient processing in terms of processing time and memory, when generating the scene discrimination index data d6, display image data is used instead of the scene reference raw data d2. It is preferable to use it. The scene determination index data generation unit 12 has a function as a scene determination index data generation unit of the imaging apparatus described in the claims.

  FIG. 2 shows an internal configuration of the scene discrimination index data generation unit 12. As shown in FIG. 2, the scene determination index data generation unit 12 includes a ratio calculation unit 31 and an index calculation unit 32. The ratio calculation unit 31 includes a color system conversion unit 33, a histogram creation unit 34, and an occupation rate calculation unit 35.

  The color system conversion unit 33 converts RGB (Red, Green, Blue) values of the display image data into the HSV color system. The HSV color system is a representation of image data in terms of three elements: Hue, Saturation, and Lightness (Value or Brightness), and is based on the color system proposed by Munsell. It has been devised.

  “Lightness” means “brightness” that is generally used unless otherwise noted. In the following description, V (0 to 255) of the HSV color system is used as “brightness”, but a unit system representing the brightness of any other color system may be used.

  The histogram creation unit 34 creates a two-dimensional histogram by dividing the image data into regions each having a predetermined hue and brightness combination and calculating the cumulative number of pixels for each of the divided regions. In addition, the histogram creation unit 34 divides the image data into predetermined regions composed of a combination of the distance from the outer edge of the screen of the image data and the brightness, and calculates the cumulative number of pixels for each divided region. Create a dimensional histogram.

  The occupancy ratio calculation unit 35 is a first occupancy ratio indicating the ratio of the cumulative number of pixels calculated by the histogram creation unit 34 to the total number of pixels (the entire image data) for each region divided by the combination of brightness and hue. Is calculated. Further, the occupancy ratio calculation unit 35 calculates the total number of pixels (total image data) of the cumulative number of pixels calculated in the histogram generation unit 34 for each region divided by the combination of the distance from the outer edge of the screen of the image data and the brightness. A second occupancy ratio indicating the ratio of occupying is calculated.

  The index calculation unit 32 calculates scene determination index data d6 for determining a shooting scene. Specifically, the index calculation unit 32 sets a first coefficient (for example, by discriminant analysis) set in advance (for example, by discriminant analysis) to the first occupancy calculated for each region in the occupancy calculation unit 35. The index 1 for discriminating the shooting scene is calculated by multiplying the sum (see Table 1). The shooting scene indicates a light source condition when shooting a subject, such as forward light, backlight, strobe light, and exposure conditions such as under shooting. The index 1 indicates characteristics at the time of strobe shooting such as indoor shooting degree, close-up shooting degree, face color high brightness, and the like, and is for separating an image to be distinguished from a strobe shooting scene from other shooting scenes.

  In addition, the index calculation unit 32 sets a second coefficient (Table 2) that is set in advance (for example, by discriminant analysis) to the first occupancy calculated for each region by the occupancy calculation unit 35 in accordance with the shooting conditions. The index 2 for discriminating the shooting scene is calculated by multiplying (see) and taking the sum. Index 2 is a composite indication of characteristics at the time of backlight shooting, such as outdoor shooting degree, sky blue high brightness, facial color low brightness, etc., for separating an image that should be identified as a backlight shooting scene from other shooting scenes It is.

  Furthermore, the index calculation unit 32 sets a third coefficient (Table 3) that is set in advance (for example, by discriminant analysis) in accordance with the imaging condition in the second occupancy calculated for each region in the occupancy calculation unit 35. The index 3 for discriminating the shooting scene is calculated by multiplying (see) and taking the sum. The index 3 indicates the difference in contrast between the center and the outside of the screen of the image data between the backlight and the flash, and quantitatively indicates only the image that should be distinguished from the backlight shooting scene or the flash shooting scene. is there.

  In addition, the index calculation unit 32 is an average brightness value of the skin color in the screen center portion of the image data, a difference value between the maximum brightness value and the average brightness value of the image data, a brightness standard deviation, an average brightness value in the screen center portion, Each of the comparison values (see equation (6) described later) between the difference value between the skin color maximum brightness value and the skin color minimum brightness value and the skin color average brightness value is multiplied by a fourth coefficient set in advance according to the shooting conditions. Then, an index 4 for discriminating the shooting scene is calculated. The index 4 indicates not only the difference between the brightness and darkness of the center and outside of the screen of the image data in the flash shooting scene and the under shooting scene, but also the distribution information in the luminance histogram, and the flash shooting scene or the under shooting scene. Only the image to be discriminated is quantitatively shown.

  Further, the index calculation unit 32 multiplies the average brightness value of skin color (hereinafter referred to as index 4 ′) in the index 1, index 3 and the center of the screen by a coefficient set in advance according to the shooting conditions. The index 5 is calculated by taking the sum (see formula (8) described later). Further, the index calculation unit 32 calculates the index 6 by multiplying the index 2, the index 3 and the index 4 ′ by a coefficient set in advance according to the shooting condition, and taking the sum (the following formula ( 9)). Note that a specific calculation method of the indexes 1 to 6 in the index calculation unit 32 will be described in detail in the operation description of the present embodiment described later.

  The operation unit 13 is provided with a release button (not shown), various function buttons such as a power ON / OFF button, a zoom button, cursor keys, and the like, and an operation signal corresponding to each button or key is input to the control unit 8 as an input signal. Output. The operation unit 13 includes function buttons for designating output of scene reference raw data.

  The display unit 14 displays display image data in accordance with a control signal from the control unit 8 and also displays information for the user of the imaging device 51 to confirm settings and conditions related to shooting.

  The header information processing unit 15, for the digital image data stored in the temporary storage memory 6, the shooting information data d3 generated by the shooting information data processing unit 9, the imaging device generated by the device characteristic correction information processing unit 10. The characteristic correction data d1 and the scene determination index data d6 generated by the scene determination index data generation unit 12 are written as header information.

  The storage device 16 is configured by a non-volatile semiconductor memory or the like, and includes a recording medium such as a memory card that records captured digital image data, and a readable memory that stores a control program for the imaging device 51. It is configured.

  The CCD drive circuit 17 outputs a timing pulse based on the control signal output from the control unit 8 and controls the drive of the CCD 3.

The focal length adjustment circuit 18 controls the motor 20 for adjusting the focal length by moving the lens 1 in accordance with a control signal from the control unit 8.
The automatic focus driving circuit 19 controls the motor 20 for adjusting the focus (focus) by moving the lens 1 in accordance with a control signal from the control unit 8.

The strobe drive circuit 21 drives and controls the strobe 22 to emit light when the subject brightness is low according to a control signal from the control unit 8.
The strobe 22 boosts the battery voltage to a predetermined high voltage and stores the electric charge in a capacitor. Then, when driven by the strobe drive circuit 21, the X tube is caused to emit light by the electric charge stored in the capacitor, and the subject is irradiated with auxiliary light.

<Operation of Imaging Device 51>
Next, the operation of the imaging device 51 will be described.
FIG. 3 shows the control of the control unit 8 when the output of the photographed digital image data by the scene reference raw data is set by the operation unit 13 and the release switch is pressed in the imaging device 51 shown in FIG. It is a flowchart which shows the scene reference raw data preservation | save process A performed. Hereinafter, the scene reference raw data storage process A will be described with reference to FIG.

  When the release button of the operation unit 13 is pressed, the control unit 8 controls each unit and performs shooting (step S1). The imaging signal obtained from the CCD 3 is converted into digital image data by the A / D converter 5, and scene reference raw data d2 is generated (step S2). The apparatus characteristic correction information processing unit 10 generates imaging apparatus characteristic correction data d1 (step S3), and the shooting information data processing unit 9 generates shooting information data d3 (step S4). In addition, display image data is generated by the display image data generation unit 11, and scene determination index data d6 is generated by using the display image data by the scene determination index data generation unit 12 (step S5).

Here, with reference to FIG. 4, the scene discrimination index data generation process will be described.
As shown in FIG. 4, first, the ratio calculation unit 31 divides the display image data into predetermined image areas, and an occupancy ratio (first occupancy ratio, first occupancy ratio) indicating the ratio of each divided area to the entire image data. (Occupancy ratio of 2) is calculated (step S11). Details of the occupation rate calculation process will be described later with reference to FIGS.

  Subsequently, the occupation ratio (first occupation ratio, second occupation ratio) calculated in the ratio calculation unit 31, at least the average luminance value of the skin color in the center of the screen of the image data, and the shooting conditions are set in advance. Based on the obtained coefficient, scene discrimination index data d6 (indexes 1 to 6) for discriminating the shooting scene (quantitatively representing the light source condition and the exposure condition) is calculated (step S12). The index calculation process in step S12 will be described in detail later.

  Next, the first occupancy rate calculation process executed in the ratio calculation unit 31 will be described in detail with reference to FIG.

  First, RGB (Red, Green, Blue) values of image data are converted into the HSV color system (step S21). Next, the image data is divided into regions composed of a combination of predetermined brightness and hue, and a two-dimensional histogram is created by calculating the cumulative number of pixels for each divided region (step S22).

  Lightness (V) is 0-25 (v1), 26-50 (v2), 51-84 (v3), 85-169 (v4), 170-199 (v5), 200-224 (v6) , 225 to 255 (v7). Hue (H) is a skin hue hue area (H1 and H2) with a hue value of 0 to 39, 330 to 359, a green hue area (H3) with a hue value of 40 to 160, and a blue hue area with a hue value of 161 to 250 It is divided into four areas (H4) and a red hue area (H5). Note that the red hue region (H5) is not used in the following calculation because it is found that the contribution to the discrimination of the shooting scene is small. The flesh color hue area is further divided into a flesh color area (H1) and other areas (H2). Hereinafter, among the flesh-colored hue areas (H = 0 to 39, 330 to 359), the hue '(H) that satisfies the following formula (2) is defined as the flesh-colored area (H1), and the area that does not satisfy the formula (2) is ( H2). However, the values of the input image data are InR, InG, and InB.

10 <Saturation (S) <175,
Hue '(H) = Hue (H) + 60 (when 0 ≤ Hue (H) <300),
Hue '(H) = Hue (H)-300 (when 300 ≤ Hue (H) <360),
Luminance (Y) = InR x 0.30 + InG x 0.59 + InB x 0.11 (1)
As
Hue '(H) / Luminance (Y) <3.0 × (Saturation (S) / 255) + 0.7 (2)

  Therefore, the number of divided areas of the image data is 4 × 7 = 28. In addition, it is also possible to use the brightness (V) in the expressions (1) and (2).

  When the two-dimensional histogram is created, a first occupancy ratio indicating the ratio of the cumulative number of pixels calculated for each divided region to the total number of pixels (the entire captured image) is calculated (step S23). Let Rij be the first occupancy calculated in the divided area composed of the combination of the lightness area vi and the hue area Hj.

Next, a method for calculating the index 1 and the index 2 will be described.
Table 1 shows, for each divided area, the first coefficient necessary for calculating the index 1 that quantitatively indicates the accuracy of strobe shooting, that is, the brightness state of the face area at the time of strobe shooting. The coefficient of each divided area shown in Table 1 is a weighting coefficient by which the first occupation ratio Rij of each divided area is multiplied, and is set in advance according to the shooting conditions.

When the first coefficient in the lightness region vi and the hue region Hj is Cij, the index 1 is defined as in Expression (3).

Table 2 shows, for each divided region, the second coefficient necessary for calculating the index 2 that quantitatively indicates the accuracy as backlight photographing, that is, the brightness state of the face region at the time of backlight photographing. The coefficient of each divided area shown in Table 2 is a weighting coefficient by which the first occupancy rate Rij of each divided area is multiplied, and is set in advance according to the shooting conditions.

When the second coefficient in the lightness area vi and the hue area Hj is Dij, the index 2 is defined as in Expression (4).

  Next, the second occupancy ratio calculation process executed in the ratio calculation unit 31 to calculate the index 3 will be described in detail with reference to FIG.

  First, the RGB values of the image data are converted into the HSV color system (step S31). Next, the image data is divided into regions each composed of a combination of the distance from the outer edge of the captured image screen and the brightness, and a two-dimensional histogram is created by calculating the cumulative number of pixels for each divided region (step S32).

  7A to 7D show four regions n1 to n4 divided according to the distance from the outer edge of the screen of the image data. A region n1 illustrated in FIG. 7A is an outer frame, a region n2 illustrated in FIG. 7B is a region inside the outer frame, and a region n3 illustrated in FIG. A region n4 shown in FIG. 7D is an inner region and is a central region of the captured image screen. Further, the lightness is divided into seven regions v1 to v7 as described above. Therefore, when the image data is divided into regions each having a combination of the distance from the outer edge of the captured image screen and the brightness, the number of divided regions is 4 × 7 = 28.

  When the two-dimensional histogram is created, a second occupancy ratio indicating the ratio of the cumulative number of pixels calculated for each divided region to the total number of pixels (the entire captured image) is calculated (step S33). The second occupancy calculated in the divided area composed of the combination of the brightness area vi and the screen area nj is defined as Qij.

Next, a method for calculating the index 3 will be described.
Table 3 shows the third coefficient necessary for calculating the index 3 for each divided region. The coefficient of each divided area shown in Table 3 is a weighting coefficient by which the second occupancy rate Qij of each divided area is multiplied, and is set in advance according to the shooting conditions.

If the third coefficient in the lightness area vi and the screen area nj is Eij, the index 3 is defined as shown in Expression (5).

Next, a method for calculating the index 4 will be described.
First, the luminance Y is calculated from the RGB (Red, Green, Blue) values of the image data using Equation (1). Also, the average luminance value x1 of the skin color area in the center of the screen of the image data is calculated. Here, the center of the screen is, for example, an area configured by an area n3 and an area n4 in FIG. Next, a difference value x2 between the maximum luminance value and the average luminance value of the image data is calculated.

Next, the standard deviation x3 of the luminance of the image data is calculated, and the average luminance value x4 at the center of the screen is calculated. Also, a comparison value x5 between the difference value between the maximum luminance value Yskin_max and the minimum luminance value Yskin_min of the skin color area in the image data and the average luminance value Yskin_ave of the skin color area is calculated. This comparison value x5 is expressed as the following equation (6).
x5 = (Yskin_max−Yskin_min) / 2−Yskin_ave (6)

Next, the index 4 is calculated by multiplying each of the calculated values x1 to x5 by a fourth coefficient set in advance according to the photographing condition and taking the sum. The index 4 is defined as the following formula (7).
Index 4 = 0.06 × x1 + 1.13 × x2 + 0.02 × x3 + (− 0.01) × x4 + 0.03 × x5−6.50 (7)

  Further, the average luminance value of the skin color area in the center of the screen of the image data is set as an index 4 '. Here, the center of the screen is, for example, an area composed of the area n2, the area n3, and the area n4 in FIG.

In addition, the index 5 is defined as in Expression (8) using the index 1, index 3, and index 4 ′, and the index 6 is defined as in Expression (9) using the index 2, index 3, and index 4 ′. Defined in
Index 5 = 0.46 × Index 1 + 0.61 × Index 3 + 0.01 × Index 4′−0.79 (8)
Indicator 6 = 0.58 x Indicator 2 + 0.18 x Indicator 3 + (-0.03) x Indicator 4 '+ 3.34 (9)
Here, the weighting coefficient by which each index is multiplied in Expression (8) and Expression (9) is set in advance according to the shooting conditions.

  Returning to FIG. 3, after generating the scene reference raw data d2, the imaging device characteristic correction data d1, the shooting information data d3, and the scene discrimination index data d6, the imaging device characteristic correction data d1 and the shooting information are added to the file header of the scene reference raw data d2. Data d3 and scene discrimination index data d6 are recorded and attached as tag information (step S6), and an attached data file is created (step S7). The attached data file is recorded and stored in the recording medium of the storage device 16 configured to be detachable from the imaging device 51 (step S8).

  FIG. 8 is a diagram showing a data structure of the digital image data recorded on the recording medium of the storage device 16 in step S8. As shown in FIG. 8, the captured digital image data is recorded as scene reference raw data d2, and imaging device characteristic correction data d1, shooting information data d3, and scene discrimination index data d6 are recorded in the header area. Yes. By taking out this recording medium from the imaging device 51 and mounting it on an external device such as an image processing device or an image recording device, the scene reference raw data d2, the imaging device characteristic correction data d1, the shooting information data d3, and the scene discrimination index data d6 can be output to these external devices. Therefore, according to the imaging device 51, it is possible to provide information for forming an optimal appreciation image according to the shooting scene to an external device without any information loss of the captured image information.

  The imaging device 51 has been described above. However, this is merely an example of a device that generates scene reference raw data, reproduction assistance data, shooting information data, and scene determination index data. A color negative film, a color reversal film, a black and white negative film, Reproduced on black and white reversal film and other film scanners that input photographic photosensitive material frame image data recorded by analog cameras, image data reproduced on silver paper, color paper, other reflective originals, and transparent originals The image data may be acquired using a flatbed scanner or the like for inputting the image data, and the data may be generated based on the acquired image data.

<Configuration of Image Processing Device 131>
Next, the configuration of the image processing apparatus 131 will be described.
FIG. 9 is a block diagram illustrating a functional configuration of the image processing apparatus 131. As illustrated in FIG. 9, the image processing device 131 performs an imaging device characteristic correction process on the scene reference raw data d2 based on the input unit 101, the header information analysis unit 102, and the imaging device characteristic correction data d1, and performs scene reference image data. The imaging device characteristic correction processing unit 114 that generates d4, and image processing (hereinafter referred to as optimization processing) for forming an optimal appreciation image for the scene reference image data d4 generated by the imaging device characteristic correction processing unit 114. And an optimization processing unit 115 that generates appreciation image reference data d5. The header information analysis unit 102 is connected to the imaging device characteristic correction processing unit 114 and the optimization processing unit 115, respectively, and the storage device 111, the output device 112, and the display device 113 are respectively connected to the optimization processing unit 115. Connection is possible. Each of the above components operates under the overall control of the control unit 116 configured by a CPU or the like.

  The input unit 101 includes a recording medium mounting unit (not shown). When a recording medium on which a data file (see FIG. 8) recorded by the imaging device 51 described above is mounted on the mounting unit, the input unit 101 reads out the recorded data file to obtain header information. The data is output to the analysis unit 102. In the present embodiment, the input unit 101 is described as reading data from an attached recording medium. However, the input unit 101 includes a data communication cable and a wireless or wired communication unit, and through these communication units. Data may be input. The input unit 101 has a function as an input unit of the image processing apparatus described in the claims.

  The header information analysis unit 102 analyzes the data input from the input unit 101 and divides the data into scene reference raw data d2, imaging device characteristic correction data d1, shooting information data d3, and scene discrimination index data d6. The device characteristic correction data d1 is converted into the device characteristic correction processing unit 103a, the scene reference raw data d2 is input into the scene reference image data generation unit 104, the shooting information data d3 is input into the shooting information data processing unit 106, and the scene determination index data d6 is determined as the scene determination. The data is output to the index data processing unit 107.

  As shown in FIG. 9, the imaging device characteristic correction processing unit 114 includes a device characteristic correction processing unit 103a, a processing condition table 103b, a scene reference image data generation unit 104, and a temporary storage memory 105. The imaging device characteristic correction processing unit 114 has a function as a scene reference image data generation unit of the image processing device described in the claims.

  When the imaging device characteristic correction data d1 is input from the header information analysis unit 102, the device characteristic correction processing unit 103a determines a generation condition of the scene reference image data d4 by referring to the processing condition table 103b. The processing condition table 103b is a table that stores the processing conditions for generating the scene reference image data d4 in association with each characteristic of the imaging apparatus.

  The scene reference image data generation unit 104 performs imaging device characteristic correction processing on the scene reference raw data d2 input from the header information analysis unit 102 according to the generation conditions determined by the device characteristic correction processing unit 103a, and performs imaging The scene reference image data d4 independent of the characteristics is generated and output to the temporary storage memory 105. Specifically, in the imaging device characteristic correction process, the signal intensity of each color channel based on at least the spectral sensitivity inherent to the imaging device of the imaging device that generated the scene reference raw data d2 is set to a standard color such as RIMM RGB or ERIMM RGB, for example. Includes mapping to space.

  The temporary storage memory 105 temporarily stores the scene reference image data d4 generated by the scene reference image data generation unit 104.

  As illustrated in FIG. 9, the optimization processing unit 115 includes a shooting information data processing unit 106, a scene determination index data processing unit 107, an appreciation image reference data generation unit 108, a temporary storage memory 109, and a setting input unit 110. It is configured. The optimization processing unit 115 has a function as an appreciation image reference data generation unit of the image processing apparatus described in the claims.

  The shooting information data processing unit 106 determines a generation condition for generating the viewing image reference data d5 according to the shooting condition based on the shooting information data d3 input from the header information analysis unit 102, and the viewing image reference data. The data is output to the generation unit 108.

  The scene discrimination index data processing unit 107 discriminates a shooting scene based on the scene discrimination index data d6 (indexes 1 to 6), and generates generation conditions for generating appreciation image reference data d5 corresponding to the determined shooting scene. It is determined and output to the appreciation image reference data generation unit 108.

  FIG. 10 shows the internal configuration of the scene discrimination index data processing unit 107. As shown in FIG. 10, the scene determination index data processing unit 107 includes a scene determination unit 121, a gradation adjustment method determination unit 122, a gradation adjustment parameter calculation unit 123, and a gradation adjustment amount calculation unit 124.

  The scene determination unit 121 determines a shooting scene (light source condition and exposure condition) of the image data based on the scene determination index data d6.

  The gradation adjustment method determination unit 122 determines the gradation adjustment method for the image data according to the shooting scene determined by the scene determination unit 121. For example, when the photographic scene is front light, as shown in FIG. 11A, a method (tone adjustment method A) for correcting the translation (offset) of the pixel value of the input image data is applied. . When the shooting scene is backlit, as shown in FIG. 11B, a method (grayscale adjustment method B) for applying gamma correction to the pixel value of the input image data is applied. When the shooting scene is a strobe, as shown in FIG. 11C, a method (gradation adjustment method C) for applying gamma correction and translation (offset) correction to the pixel value of the input image data is applied. . When the shooting scene is under, as shown in FIG. 11B, a method (grayscale adjustment method B) for applying gamma correction to the pixel value of the input image data is applied.

  The tone adjustment parameter calculation unit 123 calculates parameters (key correction value and the like) necessary for tone adjustment based on the scene discrimination index data d6.

  The tone adjustment amount calculation unit 124 calculates a tone adjustment amount for the image data based on the tone adjustment parameter calculated by the tone adjustment parameter calculation unit 123. Specifically, the gradation adjustment amount calculation unit 124 selects a gradation adjustment parameter from a plurality of gradation conversion curves set in advance corresponding to the gradation adjustment method determined by the gradation adjustment method determination unit 122. A gradation conversion curve corresponding to the gradation adjustment parameter calculated by the calculation unit 123 is selected. Note that the tone conversion curve (tone adjustment amount) may be calculated based on the tone adjustment parameter calculated by the tone adjustment parameter calculation unit 123.

  When the operation information regarding the types of the storage device 111, the output device 112, and the display device 113 that outputs the digital image data generated by the image processing device 131 is input, the setting input unit 110 illustrated in FIG. The image is output to the appreciation image reference data generation unit 108.

  The appreciation image reference data generation unit 108 reads the scene reference image data d4 from the temporary storage memory 105, and the generation condition of the appreciation image reference data d5 determined by the shooting information data processing unit 106 is determined by the scene determination index data processing unit 107. Optimum for obtaining an optimal image at the output destination based on the generation conditions of the viewing image reference data d5 and the operation information regarding the types of the storage device 111, the output device 112, and the display device 113 input from the setting input unit 110 The viewing image reference data d5 is generated by performing the conversion process, and is output to the temporary storage memory 109 together with the operation information. The optimization processing includes, for example, compression to the output destination color gamut, gradation compression from 16 bits to 8 bits, reduction of the number of output pixels, processing to cope with output characteristics (LUT) of output devices and display devices, and the like. It is. Furthermore, image processing such as noise suppression, sharpening, color balance adjustment, saturation adjustment, and dodging processing is included.

  The temporary storage memory 109 stores the appreciation image reference data d5 input from the appreciation image reference data generation unit 108 under the control of the control unit 116 according to the operation information from the setting input unit 110, the storage device 111, the output device 112, and the display device. To any of 113.

<Operation of Image Processing Device 131>
FIG. 12 is a flowchart showing an image data generation process A executed by the cooperation of the respective units of the image processing apparatus 131. Hereinafter, the operation of the image processing apparatus 131 will be described with reference to FIG.

  When the recording medium on which the image data file having the data structure shown in FIG. 8 is recorded, the digital image data file recorded on the recording medium is input by the input unit 101 (step 41). The contents of the input digital image data are analyzed by the header information analysis unit 102 (step S42), raw scene reference data d2 (step S43), imaging device characteristic correction data d1 (step S44), and shooting information data d3 ( Step S45) is divided into scene discrimination index data d6 (step S46). The scene reference raw data d2 and the imaging device characteristic correction data d1 are sent to the imaging device characteristic correction processing unit 114, and the imaging information data d3 and the scene discrimination index data d6 are The data is output to the optimization processing unit 115.

  When the imaging apparatus characteristic correction data d1 is input to the imaging apparatus characteristic correction processing unit 114, the processing condition table 103b is referred to by the apparatus characteristic correction processing unit 103a, and a processing condition for generating the scene reference image data d4 is determined. The The scene reference image data generation unit 104 performs imaging device characteristic correction processing on the scene reference raw data d2 based on this processing condition (step S47), and scene reference image data d4 is generated and optimized processing unit. 115 (step S48).

  Further, when the shooting information data d3 is input to the optimization processing unit 115, the shooting information data processing unit 106 uses the shooting information data d3 to generate viewing image reference data d5 corresponding to the shooting conditions. Is determined.

  When the scene determination index data d6 is input to the optimization processing unit 115, the scene determination index data processing unit 107 performs image processing condition determination processing based on the scene determination index data d6 (indexes 1 to 6). (Step S49).

The image processing condition determination process will be described in detail with reference to FIG.
First, based on the value of the scene determination index data d6 (for example, index 4, index 5 and index 6), the shooting scene (light source condition and exposure condition) of the image data is determined (step S61). Hereinafter, a method for determining a shooting scene (light source condition and exposure condition) will be described.

  In FIG. 14A, 60 images are taken under each light source condition of forward light, backlight, and strobe, and index 5 and index 6 are calculated for a total of 180 digital image data. The values of index 6 are plotted. According to FIG. 14A, when the value of the index 5 is larger than 0.5, there are many flash shooting scenes, the value of the index 5 is 0.5 or less, and the value of the index 6 is larger than −0.5. It can be seen that there are many backlight scenes. In this way, the shooting scene can be determined quantitatively based on the values of the index 5 and the index 6.

  FIG. 14B is a graph in which index 4 and index 5 of an image with index 5 larger than 0.5 are calculated and plotted among 60 captured images of the strobe shooting scene and the under shooting scene. According to FIG. 14B, it can be seen that when the value of the index 4 is greater than 0, there are many flash shooting scenes, and when the value of the index 4 is 0 or less, there are many under shooting scenes.

  When the shooting scene is determined, a gradation adjustment method for the image data is determined in accordance with the determined shooting scene (step S62). For example, the gradation adjustment method A (FIG. 11 (a)) is selected when the shooting scene is a direct light, and the gradation adjustment method B (FIG. 11 (b)) is selected when the shooting scene is a backlight, and the strobe is used. In some cases, the gradation adjustment method C (FIG. 11C) is selected, and in the case of under, the gradation adjustment method B (FIG. 11B) is selected.

  When the gradation adjustment method is determined, parameters (gradation adjustment parameters) necessary for gradation adjustment are calculated based on the index (step S63). In the following, it is assumed that 8-bit image data is converted to 16-bit in advance, and the unit of the image data value is 16-bit.

The following P1-P9 parameters are calculated as tone adjustment parameters.
P1: Average luminance of the entire photographing screen P2: Block division average luminance P3: Average luminance of the skin color area (H1) P4: Luminance correction value 1 = P1-P2
P5: Reproduction target correction value = luminance reproduction target value (30360) -P4
P6: Offset value 1 = P5-P1
P7: Key correction value P7 ': Key correction value 2
P8: Brightness correction value 2
P9: Offset value 2 = P5-P8-P1

The key correction value of parameter P7, the key correction value 2 of parameter P7 ′, and the luminance correction value 2 of parameter P8 are defined as shown in equations (10), (11), and (12), respectively.
P7 (key correction value) = [P3-((index 6/6) × 18000 + 22000)] / 24.78 (10)
P7 ′ (key correction value 2) = [P3 − ((index 4/6) × 10000 + 30000)] / 24.78 (11)
P8 (Luminance correction value 2) = (Index 5/6) × 17500 (12)

  When the tone adjustment parameter is calculated, the tone adjustment amount for the image data is determined based on the calculated tone adjustment parameter (step S64). Then, a gradation conversion curve corresponding to the gradation adjustment parameter calculated in step S63 is selected from a plurality of gradation conversion curves set in advance corresponding to the gradation adjustment method determined in step S62 ( It is determined. Note that the gradation conversion curve (gradation adjustment amount) may be calculated based on the gradation adjustment parameter calculated in step S63.

Hereinafter, a method for determining a gradation conversion curve for each shooting scene (light source condition and exposure condition) will be described.
When the photographic scene is front light, offset correction (parallel shift of 8-bit value) for matching the parameter P1 with P5 is performed by the following equation (13).
RGB value of output image = RGB value of input image + P6 (13)
Therefore, when the photographic scene is a continuous light, a gradation conversion curve corresponding to Expression (13) is selected from the plurality of gradation conversion curves shown in FIG. Alternatively, the gradation conversion curve may be calculated (determined) based on Expression (13).

  When the shooting scene is backlit, a gradation conversion curve corresponding to the parameter P7 (key correction value) shown in Expression (10) is selected from the plurality of gradation conversion curves shown in FIG. When the shooting scene is backlit, it is preferable to perform a dodging process together with the gradation conversion process. In this case, it is desirable to adjust the degree of dodging processing according to the index 6 indicating the backlight intensity.

  When the shooting scene is under, a gradation conversion curve corresponding to the parameter P7 ′ (key correction value 2) shown in Expression (11) is selected from the plurality of gradation conversion curves shown in FIG. The When the shooting scene is under, the dodging process as shown in the case of backlight is not performed.

When the shooting scene is a strobe, offset correction (parallel shift of 8-bit value) is performed by Expression (14).
RGB value of output image = RGB value of input image + P9 (14)
Therefore, when the shooting scene is a strobe, a gradation conversion curve corresponding to Expression (14) is selected from a plurality of gradation conversion curves shown in FIG. Alternatively, the gradation conversion curve may be calculated (determined) based on Expression (14).

  Returning to FIG. 12, the scene reference image data d4 input from the imaging device characteristic correction processing unit 114 is processed by the viewing image reference data generation unit 108 in the processing conditions determined by the shooting information data processing unit 106, and scene determination index data processing. Based on the processing conditions determined by the unit 107 and the operation information input from the setting input unit 110, optimization processing according to the output destination is performed (step S50), and the viewing image reference data d5 is generated and set. The data is output to the device set by the input unit 110 (step S51).

  As described above, according to the image processing device 131, the scene reference raw data d2, the imaging device characteristic correction data d1, the shooting information data d3, and the scene determination index data d6 are input, and the scene reference raw data d2 is Based on the imaging device characteristic correction data d1, an imaging device characteristic correction process is performed to generate scene reference image data d4. Based on the shooting information data d3 and the scene determination index data d6, the scene reference image data d4 is generated. Since the viewing image reference data d5 is generated by performing the optimization process, it is possible to form an optimum viewing image according to the shooting scene without any information loss of the captured image information. Also, since the gradation adjustment method and adjustment amount to be applied to the scene reference image data d4 are determined based on the scene discrimination index data d6, optimal gradation adjustment can be performed according to the shooting scene.

[Second Embodiment]
Next, an imaging device 52 and an image processing device 132 according to the second embodiment of the present invention will be described with reference to FIGS.

<Configuration of Imaging Device 52>
FIG. 15 is a block diagram illustrating a functional configuration of the imaging device 52 according to the second embodiment. The imaging device 52 has a configuration in which a gradation conversion data generation unit 23 is added to the imaging device 51 shown in the first embodiment. In the imaging device 52, the same components as those of the imaging device 51 shown in the first embodiment are denoted by the same reference numerals, and description of the configuration is omitted. Hereinafter, a configuration and processing characteristic of the second embodiment will be described.

  When the output of scene reference raw data is specified by the operation unit 13, the control unit 8 performs a scene reference raw data storage process B described later, and performs signal amplification and noise reduction processing and image processing in the analog processing circuit 4 at the time of shooting. Processing in the processing unit 7 is omitted, and the imaging device characteristic correction data d1, the shooting information data d3, and the gradation conversion data d7 are written as header information on the recording medium of the storage device 16, and the shot digital image data is referred to the scene. Record as raw data d2. For example, the imaging device characteristic correction data d1 and the gradation conversion data d7 are written in the DNG tag, and the shooting information data d3 is written in the Exif tag.

  The gradation conversion data generation unit 23 generates gradation conversion data d7 based on the scene determination index data d6 generated by the scene determination index data generation unit 12. The gradation conversion data d7 is data defining values before and after gradation conversion, and may be a lookup table or conversion formula data indicating gradation conversion. The gradation conversion data generation unit 23 has the same configuration as that of the scene determination index data processing unit 107 of the image processing apparatus 131 described in the first embodiment, and thus description thereof is omitted. The gradation conversion data generation unit 23 has a function as gradation conversion data generation means of the imaging apparatus described in the claims.

  The header information processing unit 15, for the digital image data stored in the temporary storage memory 6, the shooting information data d3 generated by the shooting information data processing unit 9, the imaging device generated by the device characteristic correction information processing unit 10. The characteristic correction data d1 and the gradation conversion data d7 generated by the gradation conversion data generation unit 23 are written as header information.

<Operation of Imaging Device 52>
Next, the operation of the imaging device 52 will be described.
FIG. 16 shows an image pickup apparatus 52 shown in FIG. 15, in which the operation unit 13 sets the output of the captured digital image data based on the scene reference raw data, and the control unit 8 controls the release switch when the release switch is pressed. It is a flowchart which shows the scene reference raw data preservation | save process B performed. Hereinafter, the scene reference raw data storage process B will be described with reference to FIG.

  When the release button of the operation unit 13 is pressed, the control unit 8 controls each unit and performs photographing (step S71). The imaging signal obtained from the CCD 3 is converted into digital image data by the A / D converter 5 to generate scene reference raw data d2 (step S72). Further, the apparatus characteristic correction information processing unit 10 generates imaging apparatus characteristic correction data d1 (step S73), and the shooting information data processing unit 9 generates shooting information data d3 (step S74). In addition, the scene determination index data generation unit 12 generates scene determination index data d6, and the gradation conversion data generation unit 23 generates gradation conversion data d7 based on the scene determination index data d6 (step S75).

Here, the gradation conversion data generation processing will be described with reference to FIG.
First, based on the value of the scene determination index data d6 (for example, index 4, index 5 and index 6), the shooting scene (light source condition and exposure condition) of the image data is determined (step S81). The method for determining the shooting scene is the same as that in step S61 in the image processing condition determination process (see FIG. 13) according to the first embodiment.

  When the shooting scene is determined, a gradation adjustment method for the image data is determined according to the determined shooting scene (step S82). The determination of the gradation adjustment method is the same as step S62 in the image processing condition determination process (see FIG. 13) of the first embodiment.

  When the gradation adjustment method is determined, parameters (gradation adjustment parameters) necessary for gradation adjustment are calculated based on the index (step S83). The calculation of the gradation adjustment parameter is the same as step S63 in the image processing condition determination process (see FIG. 13) of the first embodiment.

  When the tone adjustment parameter is calculated, the tone adjustment amount for the image data is determined based on the calculated tone adjustment parameter (step S84). Then, a gradation conversion curve corresponding to the gradation adjustment parameter calculated in step S83 is selected from a plurality of gradation conversion curves set in advance corresponding to the gradation adjustment method determined in step S82 ( The gradation conversion data d7 is generated (step S85). Note that the gradation conversion curve (gradation adjustment amount) may be calculated based on the gradation adjustment parameter calculated in step S83, and the gradation conversion data d7 may be generated.

  Returning to FIG. 16, after generating the scene reference raw data d2, the imaging device characteristic correction data d1, the shooting information data d3, and the gradation conversion data d7, the imaging device characteristic correction data d1 and the shooting information are added to the file header of the scene reference raw data d2. Data d3 and gradation conversion data d7 are recorded and attached as tag information (step S76), and an attached data file is created (step S77). The attached data file is recorded and stored in the recording medium of the storage device 16 configured to be detachable from the imaging device 52 (step S78).

  FIG. 18 is a diagram showing a data structure of the digital image data recorded on the recording medium of the storage device 16 in step S78. As shown in FIG. 18, the captured digital image data is recorded as scene reference raw data d2, and imaging device characteristic correction data d1, shooting information data d3, and gradation conversion data d7 are recorded in the header area. Yes. By taking out this recording medium from the imaging device 51 and mounting it on an external device such as an image processing device or an image recording device, the scene reference raw data d2, the imaging device characteristic correction data d1, the shooting information data d3, and the gradation conversion data d7 can be output to these external devices. Therefore, according to the imaging device 52, information for forming an optimal appreciation image according to the shooting scene can be provided to an external device without accompanying information loss of the captured image information.

<Configuration of Image Processing Device 132>
FIG. 19 is a block diagram illustrating a functional configuration of the image processing apparatus 132 according to the second embodiment. The image processing device 132 includes a gradation conversion data processing unit 117 instead of the scene determination index data processing unit 107 of the image processing device 131 shown in the first embodiment. In the image processing apparatus 132, the same components as those of the image processing apparatus 131 shown in the first embodiment are denoted by the same reference numerals, and the description of the configuration is omitted. Hereinafter, a configuration and processing characteristic of the second embodiment will be described.

  The input unit 101 includes a recording medium mounting unit (not shown). When a recording medium in which a data file (see FIG. 18) recorded by the imaging device 52 described above is mounted on the mounting unit, the input unit 101 reads out the recorded data file to obtain header information. Output to analysis unit 102

  The header information analysis unit 102 analyzes the data input from the input unit 101 and divides the data into scene reference raw data d2, imaging device characteristic correction data d1, shooting information data d3, and gradation conversion data d7. The apparatus characteristic correction data d1 is input to the apparatus characteristic correction processing unit 103a, the scene reference raw data d2 is input to the scene reference image data generation unit 104, the shooting information data d3 is input to the shooting information data processing unit 106, and the gradation conversion data d7 is input to the gradation. The converted data processing unit 117 outputs the result.

  The gradation conversion data processing unit 117 determines a generation condition for generating the viewing image reference data d5 based on the gradation conversion data d7 input from the header information analysis unit 102, and the viewing image reference data generation unit 108. Output to.

  The appreciation image reference data generation unit 108 reads the scene reference image data d4 from the temporary storage memory 105, and the generation condition of the appreciation image reference data d5 determined by the shooting information data processing unit 106 is determined by the gradation conversion data processing unit 117. Optimum for obtaining an optimal image at the output destination based on the generation conditions of the viewing image reference data d5 and the operation information regarding the types of the storage device 111, the output device 112, and the display device 113 input from the setting input unit 110 The viewing image reference data d5 is generated by performing the conversion process, and is output to the temporary storage memory 109 together with the operation information.

<Operation of Image Processing Device 132>
FIG. 20 is a flowchart showing an image data generation process B executed by cooperation of the units of the image processing apparatus 132. Hereinafter, the operation of the image processing apparatus 132 will be described with reference to FIG.

  When the recording medium on which the image data file having the data structure shown in FIG. 18 is loaded, the digital image data file recorded on the recording medium is input by the input unit 101 (step 91). The contents of the input digital image data are analyzed by the header information analysis unit 102 (step S92), raw scene reference data d2 (step S93), imaging device characteristic correction data d1 (step S94), and shooting information data d3 ( Step S95) and gradation conversion data d7 (step S96). The scene reference raw data d2 and the imaging device characteristic correction data d1 are sent to the imaging device characteristic correction processing unit 114, and the imaging information data d3 and the gradation conversion data d7 are The data is output to the optimization processing unit 115.

  When the imaging apparatus characteristic correction data d1 is input to the imaging apparatus characteristic correction processing unit 114, the processing condition table 103b is referred to by the apparatus characteristic correction processing unit 103a, and a processing condition for generating the scene reference image data d4 is determined. The The scene reference image data generation unit 104 performs imaging device characteristic correction processing on the scene reference raw data d2 based on this processing condition (step S97), and scene reference image data d4 is generated and optimized. 115 (step S98).

  Further, when the shooting information data d3 is input to the optimization processing unit 115, the shooting information data processing unit 106 uses the shooting information data d3 to generate viewing image reference data d5 corresponding to the shooting conditions. Is determined.

  When the gradation conversion data d7 is input to the optimization processing unit 115, the gradation conversion data processing unit 117 sets processing conditions for generating the viewing image reference data d5 based on the gradation conversion data d7. It is determined.

  Then, the scene reference image data d4 input from the imaging device characteristic correction processing unit 114 is processed by the appreciation image reference data generation unit 108 at the processing conditions determined by the shooting information data processing unit 106, and at the gradation conversion data processing unit 117. Based on the determined processing conditions and the operation information input from the setting input unit 110, an optimization process corresponding to the output destination is performed (step S99), and the viewing image reference data d5 is generated. The data is output to the set device (step S100).

  As described above, according to the image processing device 132, the scene reference raw data d2, the imaging device characteristic correction data d1, the shooting information data d3, and the gradation conversion data d7 are input, and the scene reference raw data d2 is Based on the imaging device characteristic correction data d1, an imaging device characteristic correction process is performed to generate scene reference image data d4. Based on the shooting information data d3 and the gradation conversion data d7 with respect to the scene reference image data d4, Since the viewing image reference data d5 is generated by performing the optimization process, it is possible to form an optimum viewing image according to the shooting scene without any information loss of the captured image information.

  In the second embodiment, in the imaging device 52, the imaging device characteristic correction data d1, the shooting information data d3, and the gradation conversion data d7 are attached to the scene reference raw data d2. The discrimination index data d6 may be attached.

[Third Embodiment]
<Configuration of Image Recording Apparatus 201>
Next, an image recording apparatus 201 according to the third embodiment of the present invention will be described with reference to FIGS.
FIG. 21 is a perspective view illustrating an overview configuration of the image recording apparatus 201. The image recording apparatus 201 includes an image recording unit that forms an image as an output device, and a CRT display monitor as a display device.

  As shown in FIG. 21, the image recording apparatus 201 includes a magazine loading unit 203 on one side of the main body 202. Inside the main body 202, an exposure processing unit 204 that exposes the silver salt photographic paper as an output medium and a print creation unit 205 that develops the exposed silver salt photographic paper, dries and creates a print are provided. The produced print is discharged to a tray 206 provided on the other side of the main body 202.

  In addition, a CRT 208 as a display device, a film scanner unit 209 that is a device for reading a transparent original, a reflective original input device 210, and an operation unit 211 are provided on the upper portion of the main body 202. The CRT 208 constitutes display means for displaying an image of image data to be printed on the screen. Further, the main body 202 includes an image reading unit 214 that can read image data recorded on various digital recording media, and an image writing unit 215 that can write (output) image signals to various digital recording media. . In addition, a control unit 207 that centrally controls each of these units is provided inside the main body 202.

  The image reading unit 214 includes a PC card adapter 214a and a floppy (registered trademark) disk adapter 214b, and a PC card 213a and a floppy disk 213b can be inserted therein. The PC card 213a has a memory in which a plurality of frame image data captured by a digital camera is recorded. For example, a plurality of frame image data captured by a digital camera is recorded on the floppy disk 213b. In addition, examples of the recording medium having frame image data include a multimedia card, a memory stick, and a CD-ROM.

  The image writing unit 215 includes a floppy disk adapter 215a, an MO adapter 215b, and an optical disk adapter 215c. The FD 216a, the MO 216b, and the optical disk 216c can be inserted into the image writing unit 215, respectively. You can write. Examples of the optical disk 216c include a CD-R and a DVD-R.

  In FIG. 21, the operation unit 211, the CRT 208, the film scanner unit 209, the reflective original input device 210, and the image reading unit 214 are integrally provided in the main body 202, but any one of these is provided. Two or more may be provided separately.

  In the image recording apparatus 201 shown in FIG. 21, there is illustrated an apparatus that creates a print by exposing to a photosensitive material and developing it. However, the print creation method is not limited to this. A method such as a photographic method, a thermal method, or a sublimation method may be used.

<Internal Configuration of Image Recording Apparatus 201>
FIG. 22 is a block diagram showing an internal configuration of the image recording apparatus 201. As shown in FIG. 22, the image recording apparatus 201 includes a control unit 207, an exposure processing unit 204, a print creation unit 205, a film scanner unit 209, a reflection original input device 210, an image reading unit 214, a communication means (input) 240, An image writing unit 215, a data storage unit 271, an operation unit 211, a CRT 208, and a communication unit (output) 241 are included.

  The control unit 207 is configured by a microcomputer, and the image recording apparatus 201 is cooperated with various control programs such as an image processing program stored in a storage unit (not shown) such as a ROM and a CPU (not shown). The operation of each part constituting the is controlled.

  The control unit 207 includes an image processing unit 270, and based on an input signal from the operation unit 211, image data acquired by the film scanner unit 209 and the reflective original input device 210, and image data read from the image reading unit 214. The image data input from the external device via the communication means (input) 240 is subjected to image processing to generate output image data, which is output to the exposure processing unit 204. Further, the image processing unit 270 performs a conversion process corresponding to the output form on the image processed image data, and outputs the converted image data. Output destinations of the image processing unit 270 include a CRT 208, an image writing unit 215, a communication unit (output) 241 and the like.

  The exposure processing unit 204 exposes an image on the photosensitive material and outputs the photosensitive material to the print creating unit 205. The print creating unit 205 develops and exposes the exposed photosensitive material to create prints P1, P2, and P3. The print P1 is a service size, high-definition size, panoramic size print, the print P2 is an A4 size print, and the print P3 is a business card size print.

  The film scanner unit 209 reads frame image data from a developed negative film N obtained by developing an image obtained by imaging with an analog camera. The reflection original input device 210 reads frame image data from the print P that has been developed by printing the frame image on photographic paper.

  An original read from the film scanner unit 209 or the reflective original input device 210 includes a photographic photosensitive material. Examples of the photographic photosensitive material include a color negative film, a color reversal film, a black and white negative film, and a black and white reversal film. Frame image data captured by an analog camera is recorded on the photographic material. It can be converted into digital image data by the film scanner of the film scanner unit 209 and used as frame image data. Further, when the photographic photosensitive material is a color paper which is a silver salt photographic paper, it can be converted into frame image data by the flatbed scanner of the reflective original input device 210.

  The image reading unit 214 reads frame image data recorded on the PC card 213 a and the floppy disk 213 b and transfers the frame image data to the control unit 207. The image reading unit 214 includes a PC card adapter 214a, a floppy disk adapter 214b, and the like as the image transfer means 230. The image reading unit 214 reads frame image data recorded on the PC card 213 a inserted into the PC card adapter 214 a and the floppy disk 213 b inserted into the floppy disk adapter 214 b and transfers the frame image data to the control unit 207. For example, a PC card reader or a PC card slot is used as the PC card adapter 214a.

  The communication means (input) 240 receives image data representing a captured image and a print command signal from another computer in the facility where the image recording apparatus 201 is installed, or a remote computer via the Internet or the like.

  The image writing unit 215 includes a floppy disk adapter 215a, an MO adapter 215b, and an optical disk adapter 215c as the image transport unit 231. The image writing unit 215 is inserted into the floppy disk 216a inserted into the floppy disk adapter 215a, the MO 216b inserted into the MO adapter 215b, and the optical disk adapter 215c according to the write signal input from the control unit 207. The generated image data is written on the optical disk 216c.

  The data storage unit 271 stores information such as image data and order information corresponding to the image data (information on how many prints are to be created from images of which frames, print size information, and the like) and sequentially stores them.

  The operation unit 211 includes information input means 212. The information input unit 212 is configured by a touch panel, for example, and outputs a press signal of the information input unit 212 to the control unit 207 as an input signal. The operation unit 211 may include a keyboard, a mouse, and the like. The CRT 208 displays image data and the like according to a display control signal input from the control unit 207.

  The communication means (output) 241 transfers the image data after the image processing and the accompanying order information to another computer in the facility where the image recording apparatus 201 is installed, or a remote computer via the Internet or the like. Send to.

<Configuration of Image Processing Unit 270>
FIG. 23 is a block diagram illustrating a functional configuration of the image processing unit 270 of the image recording apparatus 201. As shown in FIG. 23, the image processing unit 270 includes a film scan data processing unit 701, a reflection original scan data processing unit 702, an image data format decoding processing unit 703, an image adjustment processing unit 704, a CRT specific processing unit 705, a printer specific Processing unit (1) 706, printer-specific processing unit (2) 707, image data format creation processing unit 708, header information analysis unit 302, device characteristic correction processing unit 303a, processing condition table 303b, scene reference image data generation unit 304, The imaging information data processing unit 306, the scene discrimination index data processing unit 307, and the appreciation image reference data generation unit 308 are included.

  The film scan data processing unit 701 performs a calibration operation specific to the film scanner unit 209, negative / positive reversal in the case of a negative document, dust flaw removal, gray balance adjustment, contrast adjustment, and granular noise on the image data input from the film scanner unit 209. Removal, sharpening, and the like are performed, and the result is output to the image adjustment processing unit 704. The film scan data processing unit 701 also includes information on film size, negative / positive type, ISO sensitivity optically or magnetically recorded on the film, manufacturer name, information on main subjects, and shooting conditions (for example, description information content of APS) ) And the like are also output to the image adjustment processing unit 704.

  The reflected original scan data processing unit 702 performs a calibration operation unique to the reflective original input device 210, negative / positive reversal in the case of a negative original, dust flaw removal, gray balance adjustment, and contrast adjustment for the image data input from the reflective original input device 210. , Noise removal, sharpening enhancement, and the like, and output to the image adjustment processing unit 704.

  The image data format decoding processing unit 703 performs compression code restoration, color data expression method conversion, and the like as necessary in accordance with the data format of the image data input from the image transfer unit 230 or the communication unit (input) 240. Then, the data is converted into a data format suitable for calculation in the image processing unit 270 and output to the image adjustment processing unit 704. Also, the image data format decoding processing unit 703 determines whether the image data file (see FIG. 8) in the format by the imaging device 51 shown in the first embodiment is input from the image transfer unit 230 or the communication unit (input) 240. The input image data is output to the header information analysis unit 302.

  Further, the information from the operation unit 211 is supplemented and supplemented with information on the main subject and information on the photographing conditions from the film scanner unit 209, the reflection original input device 210, the image transfer unit 230, and the communication unit (input) 240. Can also be sent to the image adjustment processing unit 704.

  The designation about the size of the output image is input from the operation unit 211. In addition, when the size of the output image acquired from the communication unit (input) 240 is specified, or the size of the output image embedded in the header information or tag information of the image data acquired by the image transfer unit 230. Is specified, the image data format decoding processing unit 703 detects the information and outputs it to the image adjustment processing unit 704.

  The header information analysis unit 302 analyzes the input image data and divides it into scene reference raw data d2, imaging device characteristic correction data d1, shooting information data d3, and scene discrimination index data d6. Then, the scene reference raw data d2 is sent to the scene reference image data generation unit 304, the imaging device characteristic correction data d1 is sent to the device characteristic correction processing unit 303a, the shooting information data d3 is sent to the shooting information data processing unit 306, and the scene discrimination index data d6. Is output to the scene discrimination index data processing unit 307.

  When the imaging device characteristic correction data d1 is input from the header information analysis unit 302, the apparatus characteristic correction processing unit 303a determines a generation condition of the scene reference image data d4 by referring to the processing condition table 303b. The processing condition table 303b is a table that stores the processing conditions for generating the scene reference image data d4 in association with each characteristic of the imaging apparatus.

  The scene reference image data generation unit 304 performs an imaging device characteristic correction process on the scene reference raw data d2 input from the header information analysis unit 302 according to a generation condition determined by the device characteristic correction processing unit 303a. Scene reference image data d4 that does not depend on characteristics is generated and output to the appreciation image reference data generation unit 308 and the data storage unit 271.

  The shooting information data processing unit 306 determines a generation condition for generating the viewing image reference data d5 corresponding to the shooting condition based on the shooting information data d3 input from the header information analysis unit 302, and the viewing image reference data The data is output to the generation unit 308.

  The scene discrimination index data processing unit 307 discriminates a shooting scene based on the scene discrimination index data d6, determines a generation condition for generating appreciation image reference data d5 corresponding to the discriminated shooting scene, and refers to the appreciation image. The data is output to the data generation unit 308. The scene determination index data processing unit 307 has the same configuration as the scene determination index data processing unit 107 of the image processing apparatus 131 according to the first embodiment.

  The image adjustment processing unit 704, based on commands from the operation unit 211 and the control unit 207, sets image processing conditions for generating the viewing image reference data d5 adapted to the output destination device and the output medium, as viewing image reference data. Transfer to the generation unit 308.

  The appreciation image reference data generation unit 308 includes the image processing conditions determined by the shooting information data processing unit 306, the image processing conditions determined by the scene determination index data processing unit 307, and the image processing transmitted from the image adjustment processing unit 704. Based on the conditions, the viewing image reference data d5 is generated from the scene reference image data d4.

  The image adjustment processing unit 704 operates on image data received from the film scanner unit 209, the reflective original input device 210, the image transfer unit 230, and the communication unit (input) 240 based on a command from the operation unit 211 or the control unit 207. The digital image data for output is generated by performing image processing so as to give an image that gives a favorable impression when observing the image on the output medium, and the CRT specific processing unit 705, the printer specific processing unit (1) 706, the printer The processed image signal is sent to the unique processing unit (2) 707, the image data format creation processing unit 708, and the data storage unit 271.

  The CRT specific processing unit 705 performs processing such as changing the number of pixels and color matching on the image data input from the image adjustment processing unit 704 as necessary, and combines the information with information that needs to be displayed, such as control information. Image data is output to the CRT 208.

  A printer-specific processing unit (1) 706 performs printer-specific calibration processing, color matching, pixel number change, and the like on the image data input from the image adjustment processing unit 704 as necessary. Output.

  When an external printer 251 such as a large-format ink jet printer is connected to the image recording apparatus 201, a printer specific processing unit (2) 707 is provided for each connected printer. The printer-specific processing unit (2) 707 performs appropriate printer-specific calibration processing, color matching, pixel number change, and the like on the image data input from the image adjustment processing unit 704.

  The image data format creation processing unit 708 converts the image data input from the image adjustment processing unit 704 into various general-purpose image formats represented by JPEG, TIFF, Exif, and the like as necessary. The data is output to the transport unit 231 and the communication means (output) 241.

  Note that the image data generated by the appreciation image reference data generation unit 308 is the CRT specific processing unit 705, the printer specific processing unit (1) 706, the printer specific processing unit (2) 707, and the image data format creation processing unit 708. The image data format creation processing unit 708 is optimal for CRT, exposure processing unit, external printer, communication means (output), etc., based on the format of the viewing image reference data d5. After attaching a status file indicating that the image data has been converted, the image data can be individually transmitted to the image transport unit 231 and stored.

  The above-described film scan data processing unit 701, reflection original scan data processing unit 702, image data format decoding processing unit 703, image adjustment processing unit 704, CRT specific processing unit 705, printer specific processing unit (1) 706, printer specific processing Section (2) 707 and image data format creation processing section 708 are sections provided to help understanding of the function of the image processing section 270, and are not necessarily realized as physically independent devices. For example, it may be realized as a type of software processing in a single CPU.

  The header information analysis unit 302, device characteristic correction processing unit 303a, scene reference image data generation unit 304, shooting information data processing unit 306, scene discrimination index data processing unit 307, and appreciation image reference data generation unit 308 are classified into image This section is provided to help the understanding of the function of the present invention in the processing unit 270 and does not necessarily have to be realized as a physically independent device. For example, it is realized as a kind of software processing type in a single CPU. May be.

<Operation of Image Processing Unit 270>
FIG. 24 is a flowchart showing an image forming process executed by cooperation of the units of the image processing unit 270. Hereinafter, the operation of each unit of the image processing unit 270 will be described with reference to FIG.

  Data is input to the image processing unit 270 from the image transfer unit 230 or the communication unit (input) 240 (step S101), and the input data is an image data file in the format shown in FIG. 8 by the image data format decoding processing unit 703. (Step S102), the contents of the input digital image data file are analyzed by the header information analysis unit 302 (step S103), the scene reference raw data d2 (step S104), and the imaging device characteristic correction data d1. (Step S105), shooting information data d3 (step S106), and scene discrimination index data d6 (step S107).

  The imaging device characteristic correction data d1 is output to the device characteristic correction processing unit 303a, and processing conditions for generating the scene reference image data d4 are determined by referring to the processing condition table 303b by the device characteristic correction processing unit 303a. The raw scene reference data d2 is output to the scene reference image data generation unit 304 and subjected to an imaging device characteristic correction process based on the processing conditions determined by the device characteristic correction processing unit 303a (step S108). d4 is generated and output to the appreciation image data generation unit 308 (step S109).

  The shooting information data d3 is output to the shooting information data processing unit 306. Based on the shooting information data d3, the shooting information data processing unit 306 determines processing conditions for generating viewing image reference data d5 corresponding to shooting conditions. The Further, based on commands from the operation unit 211 and the control unit 207, the image adjustment processing unit 704 determines an image processing condition for generating appreciation image reference data d5 adapted to the output device and the output medium.

  The scene discrimination index data d6 is output to the scene discrimination index data processing unit 307, and the scene discrimination index data processing unit 307 performs image processing condition determination processing based on the scene discrimination index data d6 (step S110). The image processing condition determination process is the same as the image processing condition determination process (see FIG. 13) shown in the first embodiment, and a description thereof will be omitted.

The scene reference image data d4 input from the scene reference image data generation unit 304 is determined by the appreciation image reference data generation unit 308 by the image processing condition determined by the shooting information data processing unit 306 and the scene determination index data processing unit 307. Optimization processing is performed based on the set image processing conditions and the image processing conditions determined by the image adjustment processing unit 704 (step S111), and appreciation image reference data d5 is generated (step S112). The viewing image reference data d5 is sent to any one of the CRT specific processing unit 705, the printer specific processing unit (1) 706, the printer specific processing unit (2) 707, and the image data format creation processing unit 708 according to the output destination. Is output. The appreciation image reference data d5 is subjected to processing specific to the output destination in the output processing unit (step S113), and is output from the output destination specified by the operation unit 211 (step S114).
This completes the image forming process.

  As described above, according to the image recording apparatus 201, the scene reference raw data d2 to which the imaging apparatus characteristic correction data d1, the shooting information data d3, and the scene determination index data d6 are attached is acquired, and the information of the captured image information is acquired. Appearance image reference data d5 is generated without loss, and output of display devices such as CRT, liquid crystal display, plasma display, and hard copy image generation paper such as silver salt photographic paper, inkjet paper, thermal printer paper, etc. An optimal viewing image can be formed on the medium according to the shooting scene.

  In the third embodiment, the scene discrimination index data processing unit 307 discriminates a shooting scene based on the scene discrimination index data d6 and generates appreciation image reference data d5 corresponding to the determined shooting scene. However, the image data file (see FIG. 18) generated by the imaging device 52 is acquired and the gradation conversion data d7 is acquired, as in the case of the image processing device 132 in the second embodiment. Gradation conversion may be performed based on the above.

It is a block diagram which shows the functional structure of the imaging device 51 in 1st Embodiment. 3 is a block diagram showing an internal configuration of a scene discrimination index data generation unit 12. FIG. It is a flowchart which shows the scene reference raw data preservation | save process A performed by the imaging device 51. FIG. 6 is a flowchart showing a scene determination index data generation process executed by a scene determination index data generation unit 12. 5 is a flowchart showing a first occupancy rate calculation process executed in a ratio calculation unit 31. 10 is a flowchart showing a second occupancy rate calculation process executed in the ratio calculation unit 31. It is a figure which shows the area | region n1-n4 divided | segmented according to the distance from the outer edge of the screen of image data. It is a figure which shows the data structure of the digital image data recorded on the recording medium of the storage device 16 by step S8. It is a block diagram which shows the functional structure of the image processing apparatus 131 in 1st Embodiment. 3 is a block diagram showing an internal configuration of a scene discrimination index data processing unit 107. FIG. It is a figure which shows the gradation conversion curve corresponding to each gradation adjustment method. It is a flowchart which shows the image data generation process A performed by the image processing apparatus 131. It is a flowchart which shows the image processing condition determination process performed by the scene discrimination | determination parameter | index data process part. It is a plot figure which shows the relationship between an imaging | photography scene (forward light, strobe, backlight, under) and the indices 4-6. It is a block diagram which shows the functional structure of the imaging device 52 in 2nd Embodiment. 10 is a flowchart showing scene reference raw data storage processing B executed by the imaging device 52. 5 is a flowchart showing a gradation conversion data generation process executed by a gradation conversion data generation unit 23. It is a figure which shows the data structure of the digital image data recorded on the recording medium of the storage device 16 by step S78. It is a block diagram which shows the functional structure of the image processing apparatus 132 in 2nd Embodiment. It is a flowchart which shows the image data generation process B performed by the image processing apparatus 132. It is a perspective view which shows the general-view structure of the image recording device 201 in 3rd Embodiment. 2 is a block diagram showing an internal configuration of an image recording apparatus 201. FIG. 3 is a block diagram illustrating a functional configuration of an image processing unit 270 of the image recording apparatus 201. FIG. FIG. 10 is a flowchart showing image forming processing executed by an image processing unit 270.

Explanation of symbols

1 Lens 2 Aperture 3 CCD
4 Analog processing circuit 5 A / D converter 6 Temporary storage memory 7 Image processing unit 8 Control unit 9 Shooting information data processing unit 10 Device characteristic correction information processing unit 11 Display image data generation unit 12 Scene discrimination index data generation unit 13 Operation Unit 14 Display unit 15 Header information processing unit 16 Storage device 17 CCD drive circuit 18 Focal length adjustment circuit 19 Automatic focus drive circuit 20 Motor 21 Strobe drive circuit 22 Strobe 23 Gradation conversion data generation unit 31 Ratio calculation unit 32 Index calculation unit 33 Color system conversion unit 34 Histogram creation unit 35 Occupancy rate calculation unit 51 Imaging device 52 Imaging device 101 Input unit 102 Header information analysis unit 103a Device characteristic correction processing unit 103b Processing condition table 104 Scene reference image data generation unit 105 Temporary storage memory 106 Imaging information data processing unit 107 Scene discrimination index data processing unit 108 Appreciation image reference data generation unit 109 Temporary storage memory 110 Setting input unit 111 Storage device 112 Output device 113 Display device 114 Imaging device characteristic correction processing unit 115 Optimization processing unit 116 Control unit 117 Tone conversion data Processing unit 121 Scene determination unit 122 Gradation adjustment method determination unit 123 Gradation adjustment parameter calculation unit 124 Gradation adjustment amount calculation unit 131 Image processing device 132 Image processing device 201 Image recording device 202 Main body 203 Magazine loading unit 204 Exposure processing unit 205 Print creation unit 206 Tray 207 Control unit 208 CRT
209 Film scanner unit 210 Reflected document input device 211 Operation unit 212 Information input unit 214 Image reading unit 215 Image writing unit 230 Image transfer unit 231 Image transport unit 240 Communication unit (input)
241 Communication means (output)
251 External Printer 270 Image Processing Unit 701 Film Scan Data Processing Unit 702 Reflected Original Scan Data Processing Unit 703 Image Data Format Decoding Processing Unit 704 Image Adjustment Processing Unit 705 CRT Specific Processing Unit 706 Printer Specific Processing Unit (1)
707 Printer-specific processing unit (2)
708 Image data format creation processing unit 302 Header information analysis unit 303a Device characteristic correction processing unit 303b Processing condition table 304 Scene reference image data generation unit 306 Shooting information data processing unit 307 Scene discrimination index data processing unit 308 Appreciation image reference data generation unit 271 Data storage means d1 imaging device characteristic correction data d2 scene reference raw data d3 shooting information data d4 scene reference image data d5 appreciation image reference data d6 scene discrimination index data d7 gradation conversion data

Claims (14)

Raw scene reference data generation means for generating raw scene reference data depending on the device characteristics of the imaging device by imaging;
Reproduction auxiliary data generating means for generating reproduction auxiliary data used when performing processing for correcting the device characteristics specific to the imaging apparatus to the scene reference raw data;
Shooting information data generating means for generating shooting information data which is shooting condition settings at the time of shooting;
Scene discrimination index data generating means for generating scene discrimination index data for discriminating a shooting scene;
Attached to the scene reference raw data, the reproduction auxiliary data, the shooting information data and the scene determination index data, and further recording control means for recording on the medium,
An imaging apparatus comprising: The imaging device according to claim 1,
Display image data generating means for generating display image data based on the scene reference raw data;
Display means for displaying the display image data;
With
The scene determination index data generation means generates scene determination index data using the display image data. Scene reference raw data depending on the device characteristics of the imaging device, auxiliary reproduction data used when processing the device characteristics specific to the imaging device is applied to the scene reference raw data, and shooting information data that is a shooting condition setting at the time of shooting And input means for inputting scene discrimination index data for discriminating the shooting scene;
Scene reference image data generating means for generating scene reference image data by performing processing for correcting device characteristics specific to the imaging device based on the reproduction assistance data with respect to the scene reference raw data;
Image processing for forming an optimal viewing image on an output medium is performed on the scene reference image data generated by the scene reference image data generation unit based on the shooting information data and the scene determination index data. Appreciation image reference data generating means for generating appreciation image reference data,
An image processing apparatus comprising: The image processing apparatus according to claim 3.
The image processing apparatus characterized in that the appreciation image reference data generation means determines a gradation adjustment method and an adjustment amount to be applied to the scene reference image data based on the scene discrimination index data. Raw scene reference data generation means for generating raw scene reference data depending on the device characteristics of the imaging device by imaging;
Reproduction auxiliary data generating means for generating reproduction auxiliary data used when performing processing for correcting the device characteristics specific to the imaging apparatus to the scene reference raw data;
Shooting information data generating means for generating shooting information data which is shooting condition settings at the time of shooting;
Scene discrimination index data generating means for generating scene discrimination index data for discriminating a shooting scene;
Gradation conversion data generating means for generating gradation conversion data based on the scene determination index data;
Attached to the scene reference raw data, the reproduction auxiliary data, the shooting information data and the gradation conversion data, and further recording control means for recording on a medium,
An imaging apparatus comprising: The imaging apparatus according to claim 5,
Display image data generating means for generating display image data based on the scene reference raw data;
Display means for displaying the display image data;
With
The scene determination index data generation means generates scene determination index data using the display image data. Scene reference raw data depending on the device characteristics of the imaging device, auxiliary reproduction data used when processing the device characteristics specific to the imaging device is applied to the scene reference raw data, and shooting information data that is a shooting condition setting at the time of shooting And input means for inputting gradation conversion data;
Scene reference image data generating means for generating scene reference image data by performing processing for correcting device characteristics specific to the imaging device based on the reproduction assistance data with respect to the scene reference raw data;
For the scene reference image data generated by the scene reference image data generation means, image processing for forming an optimal viewing image on an output medium based on the shooting information data and the gradation conversion data. Appreciation image reference data generating means for generating appreciation image reference data,
An image processing apparatus comprising: A scene reference raw data generation step for generating scene reference raw data depending on device characteristics of the imaging device by imaging,
A reproduction auxiliary data generation step for generating reproduction auxiliary data used when performing processing for correcting device characteristics specific to the imaging apparatus to the scene reference raw data;
A shooting information data generation step for generating shooting information data that is shooting condition settings at the time of shooting;
A scene determination index data generation step for generating scene determination index data for determining a shooting scene;
Attaching the reproduction assistance data, the shooting information data, and the scene determination index data to the scene reference raw data, and further recording the medium,
An image processing method comprising: The image processing method according to claim 8.
A display image data generation step of generating display image data based on the scene reference raw data;
A display step of displaying the display image data;
Including
In the scene discrimination index data generation step, scene discrimination index data is generated using the display image data. Scene reference raw data depending on the device characteristics of the imaging device, auxiliary reproduction data used when processing the device characteristics specific to the imaging device is applied to the scene reference raw data, and shooting information data which is a shooting condition setting at the time of shooting And an input process for inputting scene discrimination index data for discriminating a shooting scene,
A scene reference image data generation step for generating scene reference image data by performing processing for correcting device characteristics specific to the imaging device based on the reproduction assistance data with respect to the scene reference raw data;
For the scene reference image data generated in the scene reference image data generation step, image processing for forming an optimal viewing image on an output medium based on the shooting information data and the scene determination index data Appreciation image reference data generation step for generating appreciation image reference data by performing,
An image processing method comprising: The image processing method according to claim 10,
In the appreciation image reference data generation step, a gradation adjustment method and an adjustment amount to be applied to the scene reference image data are determined based on the scene determination index data. A scene reference raw data generation step for generating scene reference raw data depending on device characteristics of the imaging device by imaging,
A reproduction auxiliary data generation step of generating reproduction auxiliary data used when performing processing for correcting device characteristics specific to the imaging apparatus to the scene reference raw data;
A shooting information data generation step for generating shooting information data that is shooting condition settings at the time of shooting;
A scene determination index data generation step for generating scene determination index data for determining a shooting scene;
A gradation conversion data generation step for generating gradation conversion data based on the scene determination index data;
Attaching the reproduction assistance data, the shooting information data and the gradation conversion data to the scene reference raw data, and further recording on a medium,
An image processing method comprising: The image processing method according to claim 12.
A display image data generation step of generating display image data based on the scene reference raw data;
A display step of displaying the display image data;
Including
In the scene discrimination index data generation step, scene discrimination index data is generated using the display image data. Scene reference raw data depending on the device characteristics of the imaging device, auxiliary reproduction data used when processing the device characteristics specific to the imaging device is applied to the scene reference raw data, and shooting information data that is a shooting condition setting at the time of shooting And an input process for inputting gradation conversion data;
A scene reference image data generating step for generating scene reference image data by performing a process for correcting device characteristics specific to the imaging device based on the reproduction assistance data with respect to the scene reference raw data;
For the scene reference image data generated in the scene reference image data generation step, image processing for forming an optimal viewing image on an output medium based on the shooting information data and the gradation conversion data. Appreciation image reference data generation step for generating appreciation image reference data by performing,
An image processing method comprising:

Images