JP2014085377A - Image display system, imaging device, image display device and control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress deterioration of dynamic range when image data is displayed on a display device, the image data being acquired by, when imaging, variably controlling a light emission amount of a light source irradiating a subject according to each division area.SOLUTION: An image display device displays image data imaged by an imaging device which images transmitted light or reflected light when a subject is irradiated with a light source. The image display device comprises: a control means for controlling a light emission amount of a backlight according to the backlight, the image data and light source information on a light emission amount of the light source when the imaging device has imaged the image data; a correction means for correcting the image data according to the light emission amount of the backlight; and a display means for displaying image data corrected by the correction means.

Description

  The present invention relates to an image display system, an imaging device, an image display device, and a control method thereof.

  In recent years, in pathological image diagnosis, pathological diagnosis is performed using images obtained by digitizing images of living cells, tissues, organs, etc. obtained by an optical microscope by using a scanner in place of a conventional microscope-based diagnosis. A system has been proposed. Such a system is generally called a virtual microscope.

  When capturing cells used for pathological diagnosis as a high-resolution image with a scanner, it is difficult to capture all regions simultaneously, so there is a technique for capturing images for each divided region while changing the imaging position. In Patent Literature 1, when a subject is scanned for each divided area, the light emission amount of the light source is reduced when imaging a bright part, and the light emission amount of the light source is increased when imaging a dark part. In addition, the brightness of the light source is adaptively variably controlled for imaging. Image data corresponding to a wide dynamic range in the image can be obtained by synthesizing the captured image data for each divided region and outputting the entire image data.

JP 2003-309766 A

  In the conventional technology described above, the amount of light emitted from the light source is reduced during imaging of a bright part, so that overexposure of a bright part is suppressed and image data with good gradation is obtained, but the image data is displayed on a liquid crystal panel. In such a case, the absolute luminance becomes lower compared to other parts. That is, there is a problem that the dynamic range of the display image when displayed on the liquid crystal panel is narrowed.

  Therefore, the present invention provides a technique for suppressing a decrease in dynamic range when image data obtained by variably controlling the light emission amount of a light source that irradiates a subject for each divided region during imaging is displayed on an image display device. For the purpose.

The present invention is an image display device that displays image data captured by an imaging device that captures transmitted light or reflected light when a subject is illuminated by a light source,
With backlight,
Control means for controlling the light emission amount of the backlight based on the image data and light source information relating to the light emission amount of the light source when the image data is captured by the imaging device;
Correction means for correcting the image data based on the light emission amount of the backlight;
Display means for displaying the image data corrected by the correction means;
It is an image display apparatus provided with.

The present invention includes a light source for illuminating a subject,
Imaging means for imaging transmitted light or reflected light when a subject is illuminated by a light source and generating image data;
Control means for controlling the light emission amount of the light source at the time of imaging a subject;
Transmitting means for transmitting light source information relating to the light emission amount of the light source to an image display device;
It is an imaging device provided with.

The present invention is a method of controlling an image display device that displays image data captured by an imaging device that captures transmitted light or reflected light when a subject is illuminated by a light source,
With backlight,
A control step of controlling the light emission amount of the backlight based on the image data and light source information relating to the light emission amount of the light source when the image data is captured by the imaging device;
A correction step of correcting the image data based on the light emission amount of the backlight;
A display step for displaying the image data corrected by the correction step;
Is a control method of an image display apparatus having

The present invention provides an imaging process for imaging transmitted light or reflected light when a subject is illuminated by a light source and generating image data;
A control step of controlling the light emission amount of the light source when imaging a subject;
A transmission step of transmitting light source information relating to the light emission amount of the light source to the image display device;
The control method of the imaging device having

  According to the present invention, it is possible to suppress a decrease in dynamic range when image data obtained by variably controlling the light emission amount of a light source that irradiates a subject for each divided region during imaging is displayed on an image display device. Become.

The figure which shows the system configuration | structure of Example 1. FIG. Arrangement conceptual diagram of LED light source of backlight of liquid crystal display device of embodiment 1 1 is a diagram illustrating a configuration of an imaging apparatus according to a first embodiment. Arrangement conceptual diagram of light source of imaging apparatus of embodiment 1 FIG. 3 is a schematic diagram illustrating a lighting state of a light source and a subject of the imaging apparatus according to the first embodiment. Schematic diagram of imaging data at the time of divided imaging according to the first embodiment 7 is a flowchart illustrating light source control of the imaging apparatus according to the first embodiment. The figure which shows the division area at the time of calculating the feature-value of the image of Example 1. The figure which shows the calculation result of the image feature-value of Example 1. The figure which shows the backlight lighting pattern calculation result before correction | amendment of Example 1. FIG. The figure which shows the relationship between the backlight light emission level of Example 1, and a lighting luminance value. The figure which shows the gain received in the light source information receiving part of Example 1. The figure which shows the backlight lighting pattern calculation result after the correction | amendment of Example 1. FIG. The figure which shows the mode of correction | amendment with the imaging device of Example 1. FIG. The figure which shows the relationship of the gradation and light source luminance in the imaging device of Example 1. The figure which shows the mode of correction | amendment in the liquid crystal display device of Example 1. FIG. The figure which shows the relationship between the gradation in the liquid crystal display device of Example 1, and light source luminance. The figure which shows the system configuration | structure of Example 2. FIG. FIG. 6 is a diagram illustrating an example of a light source division block of the imaging apparatus according to the second embodiment. The figure which shows an example of the division | segmentation block of the backlight of the liquid crystal display device of Example 2. FIG. FIG. 10 is a diagram illustrating a luminance profile of a light source of the imaging apparatus according to the second embodiment The figure which shows the luminance profile of the light source of the liquid crystal display device of Example 2. The figure explaining the brightness | luminance difference in the block of Example 2. The figure explaining the brightness | luminance difference of the block boundary of Example 2. FIG.

Example 1
In this embodiment, when the subject is bright (the transmittance is high), the light emission amount (irradiation light amount) of the light source that irradiates the subject is reduced to suppress overexposure, and when the subject is dark (the transmittance is low), the irradiation light amount A method for displaying image data picked up so as to suppress blackouts by increasing the number will be described. The image data obtained in this way has good gradation in any part, whether the subject is bright or dark, and even if the same subject contains both bright and dark parts. Image data. However, in the image data obtained by imaging in this way, even when the pixel values are the same, the original subject is bright and the amount of irradiation light during imaging is reduced, and the original subject is dark. There may be a case where the irradiation light quantity at the time of imaging is increased. For this reason, when this image data is displayed on a liquid crystal display device by conventional local dimming control, images corresponding to subjects with originally different brightness are displayed with the same brightness, and the brightness of the subject cannot be accurately reproduced. .

  Therefore, in this embodiment, the light emission amount of each block of the backlight by the local dimming control is determined based on not only the pixel value of the image data but also the brightness information of the original subject. Specifically, even if the pixel values are the same, the backlight emission amount is increased when the original subject is bright, and the backlight emission amount is decreased when the original subject is dark. In this way, even if the pixel values of the image data are the same, the display brightness can be varied according to the brightness of the original subject, so that the actual brightness of the subject can be faithfully reproduced and displayed. Become. That is, it is possible to achieve both good gradation and accurate reproducibility.

  Information on the brightness of the original subject can be acquired based on the light source information at the time of imaging. This is because when the subject is bright, the amount of light emitted from the light source during imaging is reduced, and when the subject is dark, the amount of light emitted from the light source during imaging is increased. That is, the light source information at the time of imaging is information on adjustment gain with respect to the default irradiation light amount (reference light emission amount). When the original subject is bright, the gain is a small value, and when the original subject is dark, the gain is a large value. In this embodiment, when the original subject is bright, the backlight emission amount in the local dimming control is increased, and when the original subject is dark, the backlight emission amount is decreased in the local dimming control. For this purpose, the light emission amount for each block by the local dimming control determined based on the pixel value is corrected by the reciprocal of the gain of the light source information at the time of imaging. That is, when the light emission amount at the time of imaging is larger than the reference light emission amount, correction is made to reduce the light emission amount of the backlight block, and when the light emission amount at the time of imaging is smaller than the reference light emission amount, the backlight block Correction to increase the amount of light emission. As a result, since the subject is bright, the adjustment gain for the irradiation light amount is reduced, and the light emission amount of the block corresponding to the divided area imaged is increased. In addition, since the subject is dark, the adjustment gain for the irradiation light amount is increased, and the light emission amount of the block corresponding to the divided area imaged is reduced.

  Embodiments of the present invention will be described below with reference to the drawings. In addition, this invention is not limited to the Example demonstrated below, A various deformation | transformation is possible within the scope of the invention.

  FIG. 1 shows a block diagram of a first embodiment of the present invention, and the outline will be described. The imaging device 10 will be described with reference to FIG. The microscope 101 has a light source (not shown) that irradiates a subject (pathological specimen) placed on a slide, and outputs an optical image of light from the light source that has passed through the subject to the scanner unit 102.

The scanner unit 102 captures an optical image output from the microscope 101 and stores it as image data. The scanner unit 102 images a subject for each of a plurality of divided areas, and outputs image data in which the entire subject is captured by combining the image data of the divided areas.
The light source control unit 103 analyzes the image data picked up by the scanner unit 102, and the microscope 1
The light emission amount of 01 light source is controlled. Details will be described later.

  The light source information transmission unit 104 transmits the light source information from the light source control unit 103 and information on the divided areas when the scanner unit 102 images the subject in a divided manner to the liquid crystal display device 20. The light source information is information on the light emission amount (irradiation light amount) of the light source at the time of imaging of each divided area, and the divided area information is information on the number of divisions and the size of the divided areas.

Next, the liquid crystal display device 20 will be described.
The image feature amount calculation unit 201 calculates and outputs the feature amount of the image data input from the imaging device 10 for each divided region.

  The backlight lighting pattern generation unit 202 generates and outputs a backlight lighting pattern based on the image feature amount for each divided region extracted by the image feature amount calculation unit 201. Here, the backlight of the liquid crystal display device 20 includes a plurality of blocks, and the light emission amount of each block is variably controlled independently. The backlight lighting pattern is information on the light emission amount (light emission level) for each block of the backlight.

  The light source information receiving unit 203 receives light source information and divided area information output from the imaging device 10.

  The backlight correction gain calculation unit 204 calculates a correction gain for correcting the backlight lighting pattern generated by the backlight lighting pattern generation unit 202 based on the light source information acquired by the light source information reception unit 203. The correction gain is calculated for each block of the backlight.

  The backlight lighting pattern correction unit 205 corrects and outputs the backlight lighting pattern generated by the backlight lighting pattern generation unit 202 using the correction gain output from the backlight correction gain calculation unit 204.

  The backlight drive control unit 206 outputs a control signal for causing the light sources arranged in each of the plurality of blocks of the backlight module 207 to emit light according to the lighting pattern calculated by the backlight lighting pattern correction unit 205. The light source is, for example, an LED (light-emitting diode). When current control is performed on the LEDs of each block, a control signal for applying a drive current corresponding to the light emission level of each block is output to the backlight module 207. Further, in the case of performing pulse width modulation control (PWM (pulse-width modulation) control) on the LEDs of each block, a signal modulated with a duty ratio according to the light emission level of each block is supplied to the backlight module 207.

  The backlight module 207 irradiates the LCD module 210 when the light source of each block of the backlight emits light according to the control signal output from the backlight drive control unit 206. As shown in FIG. 2, the backlight module 207 is divided into a plurality of blocks that are divided into x in the horizontal direction and y in the vertical direction, and a light emitting diode (LED) is disposed in each block. The LED of the m-th block in the horizontal direction and the n-th block in the vertical direction from the upper left block is represented by LED (m, n). In this embodiment, the LEDs can be individually controlled for each block. Thereby, the local light control process (local dimming) mentioned later is implement | achieved. In this embodiment, each block of the backlight module 207 corresponds to each divided area of the image data processed by the image feature amount calculation unit 201.

  The image data correction unit 208 corrects and outputs the input image data based on the backlight lighting pattern output from the backlight lighting pattern correction unit 205.

  The LCD drive control unit 209 transmits a control signal for controlling each pixel so that the transmittance of each pixel of the LCD module 210 becomes a transmittance according to the pixel value output from the image data correction unit 208. Output to 210. That is, a signal is supplied to the LCD module 210 so that display is performed at the brightness level of the pixel adjusted by the image data correction unit 208.

  The LCD module 210 displays an image based on the image data output from the image data correction unit 208 by controlling the transmittance of each pixel according to the output of the LCD drive control unit 209.

Hereinafter, the configuration of the microscope 101 will be described in detail with reference to FIG.
The pathological specimen 301 is a pathological cell to be diagnosed that is a subject.

  The preparation 302 is a glass substrate on which a pathological specimen as a subject is placed.

The light source 303 is a light source that irradiates the pathological specimen 301 through the preparation 302. By irradiating the preparation 302 from the side opposite to the scanner unit 102, transmitted light is incident on the scanner unit 102. Here, as shown in FIG. 4, the light source 303 is divided into a plurality of blocks that are divided into x in the horizontal direction and y in the vertical direction, and the light emission amount (irradiation light amount) can be controlled independently for each block. Light source. In FIG. 4, for example, the light source 303 may be configured such that one or a plurality of LEDs arranged for each block independently emit light for each block, or a surface light source such as an organic EL arranged for each block is independently used for each block. It may be configured to emit light.

  The lens 304 collects the light emitted from the light source 303 and transmitted through the pathological specimen 301 and outputs it to the scanner unit 102.

FIG. 5 and FIG. 6 schematically show how the light source 303 of the microscope 101 emits light for each block and irradiates the pathological specimen 301. FIG. 5 is a diagram showing the positional relationship between the entire pathological specimen 301 and the blocks (1, 1) to (x, y) constituting the light source 303. FIG. 6 is a diagram showing a case where only the light source located in the block (5, 2) among the blocks (1, 1) to (x, y) of the light source 303 is turned on and the pathological specimen 301 is irradiated. . Of the entire pathological specimen shown in FIG. 5, only the portion located in the block (5, 2) is irradiated, and the other portions are not irradiated. Therefore, by performing imaging with the scanner unit 102 in this state, it is possible to acquire only image data (partial image data) of a region corresponding to the block (5, 2) in the pathological specimen. In this way, imaging in a state where only the light source of one block is turned on and the light sources of the other blocks are turned off is executed for each block of all the blocks (1, 1) to (x, y). Thereby, partial images corresponding to the number of block divisions are obtained. By combining these plurality of partial images, one piece of digital image data in which the entire pathological specimen is copied can be obtained.

Next, the details of the light source control unit 103 will be described with reference to FIG.
FIG. 7 is a diagram illustrating a flowchart of processing for determining the light emission amount (irradiation light amount) of the light source 303 when the imaging apparatus 10 captures the pathological specimen 301 as a subject.
In S101, the imaging process starts.
In step S102, the light source control unit 103 determines the light emission amount of the light source at the time of first imaging. The light emission amount may be a predetermined default value or may be determined by accepting designation by the user.
In step S103, the scanner unit 102 performs imaging in a state where the light source 303 is turned on with the light emission amount determined in step S102.
In step S104, the light source control unit 103 analyzes a luminance histogram for the image captured in step S103. Here, the analysis of the luminance histogram of the image is performed in order to determine whether the gradation on the high gradation side and the low gradation side is impaired.
In S <b> 105, the light source control unit 103 performs overexposure (the gradation property on the high gradation side is impaired) and blackening (the gradation on the low gradation side) on the image captured in S <b> 103 based on the analysis result in S <b> 104. To determine whether or not the If neither occurs (the gradation is good on both the high gradation side and the low gradation side), the scanner unit 102 outputs the image data obtained by the imaging in S107.
If overexposure or underexposure occurs in S105, the light source control unit 103 adjusts the light emission amount of the light source (adjusts the correction gain) in S106. Specifically, when it is determined in S105 that “out of focus” is detected, the light source control unit 103 adjusts the light emission amount of the light source in a decreasing direction (for example, multiplying by a correction gain of 0.9).
If it is determined in S105 that “blackout has occurred”, the light source control unit 103 performs adjustment in the direction of increasing the light emission amount of the light source (for example, multiplying by the correction gain 1.1). And the process of S103-S105 is performed again. If the overexposure or underexposure occurs after the light emission amount adjustment, the above process is repeated. When an image with good gradation with no overexposure or blackout is obtained by the imaging in S103, the scanner unit 102 outputs the image data in S107.

  The light emission amount adjustment result in S106 is output as correction gain information to the liquid crystal display device 20 by the light source information transmission unit 104 via a different path (for example, a USB cable or a LAN cable) from the image data. The above processing is performed for each block of the light source 303. That is, the light emission amount (correction gain for the first light emission amount determined in S102) is determined for each block of the light source 303. Therefore, the image data obtained by imaging each block is image data of an image (partial image) of the divided area corresponding to each block. The imaging device 10 synthesizes the image data of the partial image based on the position of the partial image (the position of the block corresponding to the partial image), and sends it to the liquid crystal display device 20 as one piece of image data showing the entire pathological specimen 301. Output.

Next, details of the operation of the liquid crystal display device 20 will be described.
In FIG. 1, an image feature amount calculation unit 201 divides an input image into divided regions corresponding to the respective blocks of the backlight module 207 and calculates image feature amounts for each divided region. In this embodiment, the unit of division by the divided areas is x division in the horizontal direction and y division in the vertical direction.

FIG. 8 shows an example of coordinate assignment to each divided area when the input image is divided into x in the horizontal direction and y in the vertical direction. As the feature amount of the image calculated for each divided region, for example, the maximum value of the pixel values belonging to the divided region, the pixel value having a large distribution in the divided region, or the like can be considered. In the present embodiment, the maximum value of the RGB pixel values belonging to the divided area is calculated as the feature amount Y (m, n) of the image (partial image) in the divided area according to the following calculation formula.


Y (m, n) = maximum value in divided area (R pixel value, G pixel value, B pixel value) (Expression 1)

  Here, the coordinates (m, n) represent the coordinates of the m-th divided region in the horizontal direction and the n-th divided region in the vertical direction when the coordinate of the upper left divided region is (1, 1) (1 ≦ m ≦ x, 1 ≦ n ≦ y). Therefore, in the case of the present embodiment, x × y pieces of image feature amount data Y as shown in FIG. 9 are output from the image feature amount calculation unit 201.

The backlight lighting pattern generation unit 202 uses the x × y pieces of image feature amount data Y (m, n) output from the image feature amount calculation unit 201 to generate x × y pieces of backlight emission levels B (m, n,
n) is calculated. A method for calculating the backlight emission level B (m, n) will be described below.

The backlight lighting pattern generation unit 202 generates the x × y image feature amounts Y (m
, N), the backlight emission level B (m, n) for each block as shown in FIG. 10 is calculated. In order to calculate the backlight emission level B (m, n) of all the blocks of the backlight, data of image feature amount Y (m, n) for one screen (x × y) is required. The value of the backlight emission level B (m, n) is calculated by the following equation.

For example, when the number of gradations of the input image is 256 (8 bits) and the image feature amount Y (m, n) = 150, the backlight emission level B (m, n) = 59. Backlight emission level B (
m, n) takes a value from 0 to 100. When the value is 0, the backlight is turned off. When the value is 100, the backlight is turned on at the maximum light emission amount. FIG. 11 shows the relationship between the backlight emission level B (m, n) and the backlight lighting luminance value. As shown in FIG. 11, the backlight emission level B (m,
The larger the value of n), the larger the backlight lighting luminance value. That is, RG in the divided area
The smaller the maximum value of the B pixel value (the darker the partial image), the darker the backlight emission level of the corresponding block. In addition, the backlight emission level of the corresponding block becomes brighter as the maximum value of the RGB pixel values in the divided area is larger (the partial image is brighter). The backlight lighting pattern generation unit 202 uses, as backlight lighting pattern data, data including information on the values of the backlight emission levels B (m, n) (1 ≦ m ≦ x, 1 ≦ n ≦ y) of all blocks. Generate and output.

  The light source information receiving unit 203 receives the position information (coordinates of the divided areas corresponding to each block) of each block of the light source 303 and the correction gain information of each block at the time of imaging, which are output from the light source information transmitting unit 104. To do.

  The backlight correction gain calculation unit 204 determines the light emission level of each block of the backlight module 207 of the liquid crystal display device 20 from the position information of each block and the correction gain information of each block at the time of imaging received by the light source information reception unit 203. A correction gain for correcting is calculated. The backlight correction gain calculation unit 204 calculates a correction gain G (m, n) for each block of the backlight module 207 as shown in FIG. G (m, n) represents a correction gain value for correcting the light emission level of the block at the coordinates (m, n) of the backlight module 207. This correction gain is a small value in order to suppress the light emission amount of the light source at the time of imaging so that the subject is not bright when the subject is bright. In addition, when the subject is dark, the light source emission amount at the time of imaging is increased so as not to be blackened, so the value is large. That is, the correction gain of a block with a bright subject at the time of imaging is small, and the correction gain of a block with a dark subject at the time of imaging is large.

The backlight lighting pattern correction unit 205 uses the backlight emission level B (m, n) generated by the backlight lighting pattern generation unit 202 as the correction gain G (m) output from the backlight correction gain calculation unit 204. , N) to correct and output. The formula for calculating the backlight emission level B ′ (m, n) after correction of the block of coordinates (m, n) is as follows.

B ′ (m, n) = B (m, n) × 1 / G (m, n) (Formula 3)

  The corrected backlight emission level B ′ (m, n) is calculated for each block of the backlight module 207 as shown in FIG. 13. The backlight lighting pattern correction unit 205 backlights data including information on values of backlight emission levels B ′ (m, n) (1 ≦ m ≦ x, 1 ≦ n ≦ y) after correction of all blocks. The data is output to the drive control unit 206 and the image data correction unit 208. With this correction, the light emission level B ′ of the backlight block corresponding to the block in which the light source light emission amount during imaging is smaller than the default value (the subject is bright) is greater than the light emission level B determined based on the pixel value. Become. Further, the light emission level B ′ of the backlight block corresponding to the block in which the light source light emission amount at the time of imaging is larger than the default value (the subject is dark) is smaller than the light emission level B determined based on the pixel value. Therefore, even if the pixel values are the same, the backlight block can be turned on at a light emission level corresponding to the brightness of the original subject, so that it is possible to accurately reproduce and display the brightness of the original subject.

The image data correction unit 208 corrects the pixel value of each pixel of the input image data based on the light emission level of the block corresponding to the divided area to which each pixel belongs, calculated by the backlight lighting pattern correction unit 205. The transmittance of each pixel of the LCD module 210 is a transmittance according to the pixel value of each corrected pixel. Assuming that the pixel value of the correction target pixel of the input image data is d, the maximum luminance of the backlight is Bmax, and the coordinates of the divided region to which the correction target pixel belongs are (m, n), the image data correction unit 208 The pixel value d ′ is calculated by the following calculation formula.

d ′ = d × Bmax / B ′ (m, n) (Formula 4)

  The correction of the pixel value of the image data input according to the light emission level of the backlight block by Expression 4 is the same as in normal local dimming control. As a result, it is possible to display with brightness according to the pixel value of the input image data.

Next, specific operation flows of the imaging device 10 and the liquid crystal display device 20 will be described.
Here, the block division of the light source 303 of the imaging apparatus 10, the block division of the backlight module 207, and the area division of the image data by the image feature amount calculation unit 201 are divided into five in the horizontal direction and three in the vertical direction as shown in FIG. Suppose that This will be described with reference to the flowchart of FIG.

  The imaging process starts in S101, and the processes from S102 to S107 are repeated for the number of block divisions (15 in this case). First, in step S102, a default light source emission amount is set for the block (1, 1). Imaging is performed in S103, and luminance histogram analysis of the image obtained by imaging is performed in S104. If there is no problem in the gradation of the image (overexposure or blackout), the image is output in S107.

Next, it is assumed that the light emission amount is adjusted in S106 when the block (1, 2) is imaged. In the imaging of the block (1, 2), as described above, a default light source emission amount is set in S102, imaging is performed in S103, and luminance histogram analysis of an image obtained by imaging is performed in S104. As a result of analyzing the luminance histogram in S104, it is determined in S105 that the image is overexposed. In this case, the light emission amount is adjusted in S106. For example, when 10% is saturated with respect to the high gradation, the adjustment for multiplying the default light source light emission amount set in S102 by the correction gain 0.9 is performed in S106. Then S
Imaging is performed again in 103, luminance histogram analysis is performed in S104, and if no overexposure or underexposure is detected in the determination in S105, an image is output in S107. The correction gain 0.9 calculated in S106 is transmitted from the light source information transmitting unit 104 to the light source information receiving unit 203 as the light source information of the block (1, 2). The light source information is correction gain information for the number of blocks. In this example, correction gain information for 15 blocks is transmitted to the liquid crystal display device 20.

  FIG. 14 schematically shows the brightness of the subject. FIG. 14A shows the brightness of the transmitted light of the subject (light incident on the scanner unit 102) when all the blocks of the light source 303 are set to the default light emission amount. FIG. 14B shows the brightness of the transmitted light of the subject when the subject is irradiated with the light emission amount corrected by the above control. That is, the original brightness of the subject is FIG. 14 (a), but the brightness of the obtained image data is FIG. 14 (b). In FIG. The brightness of is not reproduced. In the present embodiment, when the image data of FIG. 14B is finally displayed on the liquid crystal display device 20, the target is to reproduce and display the brightness as shown in FIG.

  FIG. 15 shows the relationship between the gradation of the image before and after the correction of the light source emission amount of the block (1, 2) and the luminance L of the subject. Although the high gradation side was saturated before the correction, the high gradation side also has good gradation characteristics after the correction.

Next, details of backlight control in the liquid crystal display device 20 will be described.
In the liquid crystal display device 20, the backlight gain calculation unit 204 calculates a correction gain based on the light source information received by the light source information reception unit 203. FIG. 16C shows the luminance of the image data input to the liquid crystal display device 20. As described above, since the divided areas (1, 2) are picked up with the light emission amount of the light source being reduced at the time of image pickup, the divided areas (1, 2) are picked up with luminance lower than the original luminance. In the backlight correction gain calculation unit 204, the correction gain 0.9 of the light source emission amount at the time of imaging of the block (1, 2) corresponding to the divided area (1, 2) acquired from the imaging device 10 is set to the divided area (1, It is assumed that the correction gain G (1, 2) of 2). Then, the backlight lighting pattern correction unit 205 calculates the light emission level B ′ (1, 2) of the backlight block (1, 2) according to Equation 3 as follows.

B ′ (1,2) = B (1,2) × (1 / G (1,2))
= B (1,2) × (1 / 0.9)

That is, the backlight lighting pattern correction unit 205 corrects the brightness to 1.1 times the backlight emission level B (1, 2) calculated by the backlight lighting pattern generation unit 202. As a result, the display brightness in the divided area of the LCD module 210 corresponding to the block (1, 2) is increased, and the original brightness of the subject can be accurately reproduced and displayed (FIG. 16 (d)).

  FIG. 17 shows the relationship between the gradation of the image and the display luminance L before and after correcting the light emission level of the backlight block (1, 2) in the liquid crystal display device 20. In FIG. 17, the relationship is L ′ = L × 1.1.

  As described above, by correcting the backlight lighting pattern at the time of display on the liquid crystal display device 20 by using the light source information at the time of image pickup by the image pickup device 10, it is possible to achieve good gradation and the original brightness of the subject. It is possible to achieve both accurate reproducibility.

(Example 2)
In Example 1, the number of light source divisions of the imaging device is the same as the number of light source divisions of the backlight of the display device (
An example of the case where the division mode is the same) is shown. In the second embodiment, an example in which the number of light source divisions of the imaging device is different from the number of light source divisions of the backlight of the display device will be described.

  FIG. 18 shows a block diagram of Embodiment 2 of the present invention, and the outline will be described. In the second embodiment, blocks having the same configuration and the same operation as those of the first embodiment are denoted by the same reference numerals, detailed description of the operation is omitted, and portions different in operation from those of the first embodiment will be described.

  First, the configuration of the imaging device 40 will be described. The storage element 401 is a storage medium in which luminance profile information corresponding to the number of block divisions of the light source of the imaging device 40 is stored in advance. Details of the luminance profile information will be described later. The light source information transmission unit 402 receives light source information that is control information of the light emission amount of the light source by the light source control unit 103, the number of block divisions of the light source, and luminance profile information corresponding to the number of block divisions stored in the storage element 401 in advance. It transmits to the liquid crystal display device 50.

Next, the operation of the liquid crystal display device 50 will be described.
The light source information receiving unit 501 receives light source information, the number of block divisions, and luminance profile information output from the imaging device 40.

  The backlight correction gain calculation unit 502 calculates a correction gain for correcting the backlight lighting pattern generated by the backlight lighting pattern generation unit 202 based on the light source information acquired by the light source information reception unit 501. The correction gain is calculated for each block of the backlight.

  The storage element 503 is a storage medium in which brightness profile information corresponding to the number of block divisions of the backlight in the liquid crystal display device 50 is stored in advance.

  Based on the number of block divisions of the light source of the imaging device 40 output from the light source information receiving unit 501 and the luminance profile information output from the storage element 503, the luminance profile analysis unit 504 converts the input image data into the input image data. Determine the amount of correction to apply.

  The LCD drive control unit 209 transmits a control signal for controlling each pixel so that the transmittance of each pixel included in the LCD module 210 becomes a transmittance corresponding to the pixel value output from the image data correction unit 505. Output to 210. That is, a signal is supplied to the LCD module 210 so that display is performed at the pixel brightness level adjusted by the image data correction unit 505.

  FIG. 19 shows a case where the number of divisions of the light source that irradiates the subject when the image is captured by the imaging device 40 is horizontal division × vertical division. In this case, the light source of the imaging device 40 is configured by four blocks in total from the block (1, 1) to the block (2, 2).

  FIG. 20 shows the case where the number of block divisions of the backlight when displaying on the liquid crystal display device 50 is horizontal 4 divisions × vertical 4 divisions. In this case, the backlight of the liquid crystal display device 50 is composed of 16 blocks in total from the blocks (1, 1) to (4, 4).

Next, FIG. 21 shows an example of a luminance profile for each block of the light source of the imaging device 40. The luminance profile indicates a luminance distribution in the light emitting surface when each block emits light. FIG. 21 shows a case where the LED element is arranged at the center of the block. As shown in FIG. 21, the luminance at the center position of the block is 100%, and the luminance gradually decreases as the distance from the center increases. In the example of FIG. 21, the luminance at the middle position between the block center and the block boundary is 75%, and the luminance at the block boundary position is 50%. This luminance profile information is information indicating the relationship between the position (pixel position) in the block and the relative value of the luminance distribution in the block. FIG. 21 shows the relationship between the horizontal position and the relative luminance, but the relationship between the vertical position and the relative luminance is the same. May be included in the luminance profile information. The luminance profile information may be table data that defines the relationship between the coordinates of the pixels in the block and the relative luminance.

The light source information transmission unit 402 in the imaging device 40 transmits the following information.

Block division information of light source: horizontal 2 divisions × vertical 2 divisions Light source gain information: correction gains GA (1, 1) to GA (2, 2) at the time of imaging of each of the blocks (1, 1) to (2, 2) 2)
Luminance profile information: The luminance profiles PA (1, 1) to PA (2, 2) of the blocks (1, 1) to (2, 2) read from the storage element 401.

  The light source information receiving unit 501 of the liquid crystal display device 50 receives the information transmitted from the light source information transmitting unit 402.

The backlight correction gain calculation unit 502 corrects the light emission level of each block of the backlight module 207 of the liquid crystal display device 50 based on the divided region information acquired from the light source information reception unit 501 and the light source correction gain information at the time of imaging. Calculate the correction gain. In this embodiment, the imaging device 40 is “horizontal 2 division × vertical 2 division”, and the liquid crystal display device 50 is “horizontal 4 division × vertical 4 division”. Therefore, the correction gain GA (1,1) of the light source of the imaging device 40 is set to the liquid crystal display device 50.
The backlight correction gains GB (1,1), GB (1,2), GB (2,1), and GB (2,2) are assigned. Thus, the same correction gain is applied to the blocks of the backlight of the liquid crystal display device 50 that have the same light emission amount of the light source during imaging. Similarly, the backlight correction gain is determined by assigning the correction gain value of one block of the imaging device 40 to the correction gain values of the four blocks of the backlight of the liquid crystal display device 50.

Next, the luminance profile analysis unit 504 analyzes the luminance profile as shown in FIG. 22 and calculates a correction gain to be output to the image data correction unit 505. FIG. 22 is a luminance profile of blocks constituting the backlight module 207 of the liquid crystal display device 50. In this embodiment, as shown in FIGS. 21 and 22, the luminance profile of the block constituting the light source of the imaging device 40 is different from the luminance profile of the block constituting the backlight of the liquid crystal display device 50 of FIG. Suppose that Even in such a case, since the luminance profile of the backlight block of the liquid crystal display device 50 is analyzed by the luminance profile analyzing unit 504, the degree of diffusion and the degree of light diffusion in the block due to the configuration of the LED and the backlight are different. It is possible to deal with cases.

Next, differences in light source luminance with respect to the same display position in the imaging device 40 and the liquid crystal display device 50 will be described with reference to FIG. FIG. 23A shows one block when the light source of the imaging device 40 is divided into blocks of horizontal 2 divisions × vertical 2 divisions. FIG. 23B shows four blocks when the backlight of the liquid crystal display device 50 is divided into blocks of 4 horizontal divisions and 4 vertical divisions. 23 (a) and 23 (b) are the same size as the display area size of the screen.

The position of the black circle A in the light source block of the imaging device 40 shown in FIG. 23A is an intermediate position between the center and the block boundary in both the horizontal direction and the vertical direction. Therefore, according to the luminance profile of the block of the light source of the imaging device 40 shown in FIG. 21, the luminance at the position of the black circle A is 75%. In contrast, in the backlight block of the liquid crystal display device 50 shown in FIG. 23 (b), the position of the black circle B at the position corresponding to the black circle A in FIG. 23 (a) is the center of the block. A light source is arranged. Therefore, according to the luminance profile of the backlight block of the liquid crystal display device 50 shown in FIG. 22, the luminance at the position of the black circle B is 100%.

Further, when the number of block divisions and the luminance profile are different between the imaging device 40 and the liquid crystal display device 50, the luminance differs depending on the image area. For example, the luminance at the position of the black circle C in the light source block of the imaging device 40 shown in FIG. The luminance at the position of the black circle D in the backlight block of the liquid crystal display device 50 shown in FIG. 24B is the luminance of the LED of the block (1, 1) and the luminance of the LED of the block (2, 1). Combined. Therefore, the luminance is 60% + 60% = 120% from FIG. Therefore, even if the light emission amount of each block of the backlight is the same as the light emission amount of the light source block of the imaging device 40 at the position corresponding to each block, the light source of the imaging device 40 and the liquid crystal display device depending on the position The brightness of 50 backlights is not the same.

  The luminance profile analysis unit 504 analyzes the luminance distribution in such a backlight based on the luminance profile information and outputs it to the image data correction unit 505.

The image data correction unit 505 corrects the input image data based on the luminance distribution output from the luminance profile analysis unit 504. In the example of FIG. 24, the image data correction unit 505 has a higher luminance than the black circle D in FIG. 24A because the black circle D in FIG.

Gain = 75/120

Is multiplied by the pixel value corresponding to the position of the black circle D in FIG. 24B, the image data is corrected, and output to the LCD drive control unit 209.

  As described above, by correcting the input image data using the information of the luminance profile, appropriate image data in which luminance variations are suppressed can be obtained.

  As described above, the present embodiment is characterized by the processing in the case where image data having good gradation obtained by adjusting the light emission amount of the light source for each block is displayed on the liquid crystal display device during imaging. is there. That is, the light emission level for each block of the backlight for local dimming calculated based on the pixel value of the image data is corrected using the adjustment gain of the light emission amount of the light source at the time of imaging. As a result, the luminance of each block of the backlight is made to correspond to the luminance of the original subject. Furthermore, when the number of block divisions of the light source of the imaging device and the number of block divisions of the backlight of the liquid crystal display device are different, the light emission level of each block of the backlight is the light source at the time of imaging the image data of the divided area corresponding to that block. Correct using the adjustment gain. As a result, even when the number of block divisions of the light source of the imaging device and the number of block divisions of the backlight of the liquid crystal display device are different, both good gradation in the displayed image and reproducibility of the original brightness of the subject are achieved. Can do. In the present embodiment, an example in which the ratio of the number of block divisions of the imaging device 40 and the liquid crystal display device 50 is 1: 2 has been described. However, the process of correcting the image data according to the luminance distribution based on the luminance profile information can be similarly applied to the configuration of the first embodiment in which the number of block divisions is the same between the imaging device and the liquid crystal display device. Further, the ratio of the number of block divisions between the imaging device and the liquid crystal display device can take an arbitrary value.

  In this embodiment, the image data is corrected in consideration of the luminance distribution in each block of the light source of the imaging device and each block of the backlight of the liquid crystal display device. Thereby, even when the luminance distribution in the block is not uniform, it is possible to suppress unintentional variations in luminance in the display image due to the distribution.

  In the above-described embodiment, the configuration in which the microscope image is captured by the scanner is illustrated as the imaging device. However, the present invention is generally applicable to displaying an image of the entire subject generated by capturing the subject for each divided region while adjusting the light emission amount of the light source that illuminates the subject, and synthesizing the obtained partial images. . Further, although the imaging device that captures the transmitted light of the light irradiated on the subject is illustrated, the imaging device may capture the reflected light of the light irradiated on the subject. Further, although a pathological sample is illustrated as a subject, the subject is not limited to this.

  In the above-described embodiment, the example in which the light source information from the imaging device is supplied to the liquid crystal display device through a communication path different from the image data has been described. However, the light source information is added to the image data as metadata and is combined with the image data. The structure supplied to a liquid crystal display device may be sufficient. Further, in the above-described embodiment, the configuration in which the imaging device and the liquid crystal display device are separate is illustrated, but the imaging device and the liquid crystal display device may be integrated. In that case, the present invention is an image display system capable of displaying captured image data using light source information at the time of imaging. The present invention is not limited to a liquid crystal display device, and can be applied to general image display devices capable of local dimming display. Further, the example in which the image feature amount calculation unit sets the maximum value of the RGB pixel values in the divided region as the image feature amount Y has been described, but the image feature amount used to determine the light emission level of the block in local dimming is Not limited to examples. Further, in the above-described embodiment, the case where the number of block divisions of the light source of the imaging device and the number of block divisions of the backlight of the liquid crystal display device are plural, that is, the case where local dimming is performed is illustrated. Also good. For example, when the subject is a dark sample with low overall transmittance, imaging is performed with the overall light emission amount of the light source of the imaging device being increased in order to improve gradation during imaging. When displaying the image data captured in this manner, the display can be performed with faithful reproduction of the original luminance of the subject by performing display with the overall light emission amount of the backlight being reduced.

DESCRIPTION OF SYMBOLS 10 Imaging device, 20 Liquid crystal display device, 104 Light source information transmission part, 203 Light source information reception part, 205 Backlight lighting pattern correction part, 208 Image data correction part

Claims (43)

An image display device that displays image data captured by an imaging device that captures transmitted light or reflected light when a subject is illuminated by a light source,
With backlight,
Control means for controlling the light emission amount of the backlight based on the image data and light source information relating to the light emission amount of the light source when the image data is captured by the imaging device;
Correction means for correcting the image data based on the light emission amount of the backlight;
Display means for displaying the image data corrected by the correction means;
An image display device comprising: The light source information includes information on adjustment of the light emission amount of the light source when the image data is captured by the imaging device with respect to a reference light emission amount,
The control means calculates the light emission amount of the backlight based on the image data,
When the light emission amount of the light source at the time of imaging of the image data by the imaging device is adjusted to be larger than a reference light emission amount, correction to reduce the calculated light emission amount of the backlight,
The correction is performed to increase the calculated light emission amount of the backlight when the light emission amount of the light source when the image data is captured by the imaging device is adjusted to be smaller than a reference light emission amount. The image display device described in 1.   The image display apparatus according to claim 2, wherein the adjustment with respect to the light emission amount serving as a reference is an adjustment that is controlled so that overexposure and underexposure do not occur in the image data.   The image display apparatus according to claim 1, wherein the control unit controls the light emission amount of the backlight based on a feature amount of the image data and the light source information.   The correction means includes the light emission amount of the backlight, information on the luminance distribution in the light emitting surface when the backlight emits light, and information on the luminance distribution in the light emitting surface when the light source of the imaging device emits light. The image display device according to any one of claims 1 to 4, wherein the image data is corrected based on. Further comprising storage means for storing information on luminance distribution in the light emitting surface when the backlight emits light,
The image display apparatus according to claim 5, wherein the correction unit acquires information on a luminance distribution in a light emitting surface when the backlight emits light from the storage unit.   The image display device according to claim 5, wherein the correction unit acquires information on a luminance distribution in a light emitting surface when the light source of the imaging device emits light from the imaging device.   The image display device according to claim 1, wherein the control unit acquires the light source information from the imaging device. The backlight is divided into a plurality of blocks, the light emission amount can be independently controlled for each block,
The control means controls a light emission amount for each block of the backlight based on the image data and the light source information,
The image display device according to claim 1, wherein the correction unit corrects the image data based on a light emission amount for each block of the backlight. The control means divides the image data by a divided area corresponding to each block of the backlight, and is based on the feature amount of the image data of the divided area corresponding to each block of the backlight and the light source information. Control the amount of light emitted by each block of the backlight,
The image display device according to claim 9, wherein the correction unit corrects image data of a divided region corresponding to each block of the backlight based on a light emission amount of each block of the backlight. The light source of the imaging device is divided by a plurality of blocks each capable of independently controlling the light emission amount,
The imaging device generates the image data by synthesizing partial image data obtained by imaging only the light source of the block corresponding to the divided area for each divided area corresponding to the block. Is,
The image display device according to claim 9, wherein the light source information includes control information of a light emission amount for each block of the light source of the imaging device. The light source information includes information on adjustment of a light emission amount of each block of the light source when the image data is captured by the imaging device with respect to a reference light emission amount,
The control means calculates the light emission amount of each block of the backlight based on partial image data corresponding to each block of the backlight;
When the light emission amount of the light source block when the partial image data is captured by the imaging device is adjusted to be larger than a reference light emission amount, the calculated light emission amount of the backlight block is decreased. Make corrections
In the case where the light emission amount of the light source block at the time of capturing the partial image data by the imaging device is adjusted to be smaller than a reference light emission amount, the calculated light emission amount of the backlight block is increased. The image display device according to claim 11, wherein correction is performed.   The correction means includes a light emission amount of each block of the backlight, information on luminance distribution in the block when each block of the backlight emits light, and a case where each block of the light source of the imaging device emits light. The image display device according to claim 11 or 12, wherein image data of a divided region corresponding to each block of the backlight is corrected based on information on luminance distribution in the block. The aspect of division by the block of the backlight and the aspect of division by the block of the light source of the imaging device are the same,
The image data of the divided region corresponding to each block of the backlight is partial image data corresponding to the light source block of the imaging device corresponding to each block of the backlight,
The control means is based on the feature amount of the partial image data corresponding to each block of the backlight and the control information of the light emission amount of the light source block of the imaging device corresponding to each block of the backlight. The image display apparatus of any one of Claims 11-13 which controls the light emission amount of each block of a backlight. The number of divisions by the block of the backlight and the number of divisions by the block of the light source of the imaging device are different,
The control means includes the feature amount of the image data of the divided area corresponding to each block of the backlight and the imaging device that emits light when the partial image including the image data of the divided area is captured by the imaging device. The image display device according to claim 11, wherein the light emission amount of each block of the backlight is controlled based on the control information of the light emission amount of the light source block. A light source that illuminates the subject;
Imaging means for imaging transmitted light or reflected light when a subject is illuminated by a light source and generating image data;
Control means for controlling the light emission amount of the light source at the time of imaging a subject;
Transmitting means for transmitting light source information relating to the light emission amount of the light source to an image display device;
An imaging apparatus comprising:   The imaging device according to claim 16, wherein the control unit controls the light emission amount of the light source so that overexposure and underexposure do not occur in image data when an object is imaged. An analysis unit for analyzing a luminance distribution of the image data captured by the imaging unit;
The control means controls to decrease the light emission amount of the light source when the high gradation side is saturated in the luminance distribution of the image data captured by emitting the light source with the reference light emission amount, and the low gradation side The imaging apparatus according to claim 16, wherein when the saturation is achieved, control is performed so as to increase a light emission amount of the light source.   The imaging device according to any one of claims 16 to 18, wherein the transmission unit further transmits information on a luminance distribution in a light emitting surface when the light source emits light. Further comprising storage means for storing information on luminance distribution in the light emitting surface when the light source emits light,
The imaging device according to claim 19, wherein the transmission unit acquires and transmits information on luminance distribution in a light emitting surface when the light source emits light from the storage unit. The light source is divided into a plurality of blocks each capable of independently controlling the light emission amount,
The imaging means generates the image data by synthesizing partial image data obtained by imaging only the light source of the block corresponding to the divided area for each divided area corresponding to the block. ,
The imaging device according to any one of claims 16 to 20, wherein the light source information includes control information of a light emission amount for each block of a light source of the imaging device. The image display device according to any one of claims 1 to 15,
The imaging device according to any one of claims 16 to 21,
An image display system comprising: A control method of an image display device that displays image data captured by an imaging device that captures transmitted light or reflected light when a subject is illuminated by a light source,
With backlight,
A control step of controlling the light emission amount of the backlight based on the image data and light source information relating to the light emission amount of the light source when the image data is captured by the imaging device;
A correction step of correcting the image data based on the light emission amount of the backlight;
A display step for displaying the image data corrected by the correction step;
A method for controlling an image display apparatus having The light source information includes information on adjustment of the light emission amount of the light source when the image data is captured by the imaging device with respect to a reference light emission amount,
In the control step, the light emission amount of the backlight is calculated based on the image data,
When the light emission amount of the light source at the time of imaging of the image data by the imaging device is adjusted to be larger than a reference light emission amount, correction to reduce the calculated light emission amount of the backlight,
24. When the light emission amount of the light source when the image data is captured by the imaging device is adjusted to be smaller than a reference light emission amount, correction is performed to increase the calculated light emission amount of the backlight. The control method of the image display apparatus as described in any one of Claims 1-3.   25. The method of controlling an image display device according to claim 24, wherein the adjustment with respect to the reference light emission amount is an adjustment controlled so that overexposure and underexposure do not occur in image data.   26. The method of controlling an image display device according to claim 23, wherein, in the control step, a light emission amount of the backlight is controlled based on a feature amount of the image data and the light source information.   In the correction step, the amount of light emitted from the backlight, information on the luminance distribution in the light emitting surface when the backlight emits light, and information on the luminance distribution in the light emitting surface when the light source of the imaging device emits light 27. The method of controlling an image display device according to claim 23, wherein the image data is corrected on the basis of.   28. The method of controlling an image display device according to claim 27, wherein in the correction step, information on a luminance distribution in a light emitting surface when the backlight emits light is acquired from a storage unit provided in the image display device.   29. The method of controlling an image display device according to claim 27 or 28, wherein in the correction step, information on a luminance distribution in a light emitting surface when the light source of the imaging device emits light is acquired from the imaging device.   30. The method of controlling an image display device according to claim 23, wherein the light source information is acquired from the imaging device in the control step. The backlight is divided into a plurality of blocks, the light emission amount can be independently controlled for each block,
In the control step, the light emission amount for each block of the backlight is controlled based on the image data and the light source information,
31. The method of controlling an image display device according to claim 23, wherein in the correction step, the image data is corrected based on a light emission amount for each block of the backlight. In the control step, the image data is divided by a divided region corresponding to each block of the backlight, and based on the feature amount of the image data of the divided region corresponding to each block of the backlight and the light source information. Control the amount of light emitted by each block of the backlight,
32. The method of controlling an image display device according to claim 31, wherein in the correction step, image data of a divided area corresponding to each block of the backlight is corrected based on a light emission amount of each block of the backlight. The light source of the imaging device is divided by a plurality of blocks each capable of independently controlling the light emission amount,
The imaging device generates the image data by synthesizing partial image data obtained by imaging only the light source of the block corresponding to the divided area for each divided area corresponding to the block. Is,
The method of controlling an image display device according to claim 31 or 32, wherein the light source information includes control information of a light emission amount for each light source block of the imaging device. The light source information includes information on adjustment of a light emission amount of each block of the light source when the image data is captured by the imaging device with respect to a reference light emission amount,
In the control step, the light emission amount of each block of the backlight is calculated based on partial image data corresponding to each block of the backlight,
When the light emission amount of the light source block when the partial image data is captured by the imaging device is adjusted to be larger than a reference light emission amount, the calculated light emission amount of the backlight block is decreased. Make corrections
In the case where the light emission amount of the light source block at the time of capturing the partial image data by the imaging device is adjusted to be smaller than a reference light emission amount, the calculated light emission amount of the backlight block is increased. 34. The method for controlling an image display device according to claim 33, wherein correction is performed.   In the correction step, the amount of light emitted from each block of the backlight, information on the luminance distribution in the block when each block of the backlight emits light, and the case where each block of the light source of the imaging device emits light 35. The method of controlling an image display device according to claim 33 or 34, wherein image data of a divided area corresponding to each block of the backlight is corrected based on information on a luminance distribution in the block. The aspect of division by the block of the backlight and the aspect of division by the block of the light source of the imaging device are the same,
The image data of the divided region corresponding to each block of the backlight is partial image data corresponding to the light source block of the imaging device corresponding to each block of the backlight,
In the control step, based on the feature amount of the partial image data corresponding to each block of the backlight and the control information of the light emission amount of the block of the light source of the imaging device corresponding to each block of the backlight 36. The method of controlling an image display device according to any one of claims 33 to 35, wherein the light emission amount of each block of the backlight is controlled. The number of divisions by the block of the backlight and the number of divisions by the block of the light source of the imaging device are different,
In the control step, the feature amount of the image data of the divided area corresponding to each block of the backlight and the partial image including the image data of the divided area are emitted when the image pickup apparatus emits light. 36. The method of controlling an image display device according to any one of claims 33 to 35, wherein the light emission amount of each block of the backlight is controlled based on the control information of the light emission amount of the light source block. An imaging process for imaging transmitted light or reflected light when a subject is illuminated by a light source and generating image data;
A control step of controlling the light emission amount of the light source when imaging a subject;
A transmission step of transmitting light source information relating to the light emission amount of the light source to the image display device;
A method for controlling an imaging apparatus having   39. The method of controlling an imaging apparatus according to claim 38, wherein, in the control step, the light emission amount of the light source is controlled so that overexposure and underexposure do not occur in image data when the subject is imaged. An analysis step of analyzing the luminance distribution of the image data imaged by the imaging step;
In the control step, when the high gradation side is saturated in the luminance distribution of the image data captured by emitting the light source with the reference light emission amount, the light emission amount of the light source is controlled to decrease, and the low gradation side 40. The method of controlling an imaging apparatus according to claim 38 or 39, wherein control is performed to increase the light emission amount of the light source when saturated. 41. The method of controlling an imaging apparatus according to any one of claims 38 to 40, wherein in the transmitting step, information on a luminance distribution in a light emitting surface when the light source emits light is further transmitted.   42. The method of controlling an imaging apparatus according to claim 41, wherein in the transmission step, information on a luminance distribution in a light emitting surface when the light source emits light is acquired from a storage unit included in the imaging apparatus and transmitted. The light source is divided into a plurality of blocks each capable of independently controlling the light emission amount,
In the imaging step, for each divided area corresponding to the block, the image data is generated by synthesizing partial image data obtained by imaging only the light source of the block corresponding to the divided area. ,
43. The imaging device control method according to any one of claims 38 to 42, wherein the light source information includes light emission amount control information for each light source block of the imaging device.

Images