JP4702015B2 - Image display apparatus and program - Google Patents

Description

  The present invention relates to an image display device and a program for detecting a human face from an image and displaying the face in an enlarged manner.

In the case of a photographic image that contains multiple persons, the face size of the person may be too small for the entire image. In such a case, the details of the face cannot be seen when the entire image is displayed on the screen. There is a fear. Therefore, an image display device that detects a human face from an image, detects the position and size of the face, and zooms (enlarges) an image area including the face is known (for example, Patent Document 1). reference).
Further, when displaying the faces of a plurality of persons, the image display device continuously displays images while slowly moving from one face to another.
JP 2005-182196 A

By the way, in order to properly display an image by the method described in Patent Document 1 or the like, it is necessary to appropriately detect a face from within the image.
However, since face detection requires advanced image recognition processing, it is difficult to make the accuracy 100%. In other words, if the face determination accuracy is lowered so that more faces can be detected in order to detect all faces in the image, an image area other than the face such as a candle may be erroneously detected. In such a case, there is a problem that if an erroneously detected image area is zoomed and displayed for a long time, it becomes unnatural. Further, if the accuracy of the face determination is increased so that an image area other than the face is not erroneously detected, there arises a problem that all faces in the image cannot be detected.

  Therefore, an object of the present invention is to display images of a plurality of persons in an image properly and to reduce the unnaturalness of display contents caused by erroneous detection of an image area other than the face. A display device and a program are provided.

The image display device according to the first aspect of the invention (for example, the imaging device 100 of FIG. 1)
A face for detecting the faces of the plurality of persons (for example, the face F in FIG. 2) from the image based on the image information of the image representing the plurality of persons (for example, the photographic image G in FIG. 2). Detection means (for example, the face detection unit 3 in FIG. 1);
An enlarged display means (for example, the display unit 7 in FIG. 1) for enlarging and displaying a part of the image area (for example, the image area R in FIG. 4) constituting the image;
Moving display means (for example, the display unit 7 in FIG. 1) for continuously moving the image area enlarged and displayed by the enlarged display means in the image;
Position detecting means for detecting the position of each of the faces detected by the face detecting means (for example, the face detecting unit 3 in FIG. 1);
Movement locus determination means for determining a movement locus (for example, movement locus L in FIG. 2) for moving the image area by the movement display means so as to pass through each of the plurality of faces detected by the position detection means. (For example, the locus determination unit 4 in FIG. 1);
Reliability determination means (for example, the face detection unit 3 in FIG. 1) for determining whether or not the reliability of face detection by the face detection means is equal to or higher than a predetermined threshold;
Among the image areas that are moved and displayed along the movement locus determined by the movement locus determination means, a stationary display means (for example, the display unit 7 in FIG. 1) that statically displays the image area including each of the faces. Etc.)
The static display time of the image area by the static display means is equal to or greater than the predetermined threshold for the static display time related to the face having the reliability determined by the reliability determination means to be less than the predetermined threshold. The static display time determining means (for example, the static time determining unit 6 in FIG. 1) determines that the reliability is determined to be shorter than or substantially zero than the static display time related to the face of the reliability. Etc.)
It is characterized by having.

  Here, examples of the image representing a person include a photographic image showing a captured person, a CG image drawn by high-definition computer graphics (CG), and the like.

The invention according to claim 2 is the image display device according to claim 1,
Size calculation means (for example, the face detection unit 3 in FIG. 1) for calculating the size of each of the faces detected by the face detection means with respect to the entire image;
Based on the size of each of the plurality of faces calculated by the size calculating means, an enlargement ratio determining means for determining an enlargement ratio by the enlarged display means of the image area including each of the faces (for example, FIG. 1 zoom magnification determination unit 5 etc.),
It is characterized by having.

The invention according to claim 3 is the image display device according to claim 2,
The still display time determining means is further characterized in that the still display time is determined based on the face size calculated by the size calculating means.

The program of the invention according to claim 4 is:
In an image display device (for example, the imaging device 100 in FIG. 1),
A function for detecting the faces of the plurality of persons (for example, the face F in FIG. 2) from the image based on the image information of the image representing the plurality of persons (for example, the photographic image G in FIG. 2). When,
A function for enlarging and displaying a part of the image area constituting the image (for example, the image area R in FIG. 4);
A function of continuously moving the image area to be enlarged and displayed within the image;
A function of detecting the position of each of the detected faces;
A function of determining a movement locus (for example, movement locus L in FIG. 2) for moving the image region so as to pass through each of the detected faces;
A function of determining whether the reliability of face detection is equal to or higher than a predetermined threshold;
A function of statically displaying the image area including each of the faces among the image areas that are moved and displayed along the determined movement locus;
The still display time of the image area, the reliability of the face determined to be less than the predetermined threshold, the still display time of the face of the reliability determined to be greater than or equal to the predetermined threshold. A function of determining to be shorter than the stationary display time for the face or to be substantially zero;
It is characterized by realizing.

  According to the first aspect of the present invention, it is possible to determine the static display time of an image area including each face according to the reliability of face detection, and thereby an image including a face with low reliability of face detection. When displaying an area, that is, an image area in which a part other than the face is likely to be erroneously detected, it is displayed as if moving to an image area including a face with high face detection reliability. Therefore, the unnaturalness of the display content caused by the erroneous detection of the image area other than the face can be reduced. In addition, even if the face is actually a face but the reliability is low, the display time is shortened, but the face can be displayed reliably, so that the faces of a plurality of persons in the image can be displayed properly. It can be carried out.

  According to the second aspect of the present invention, it is obvious that the same effect as the first aspect of the invention can be obtained, and in particular, based on the calculated size of each of the plurality of faces. Thus, it is possible to appropriately determine the enlargement ratio when displaying the image area including each of the image areas, and it is possible to more appropriately display the faces of a plurality of persons in the image.

  Of course, the invention described in claim 3 can obtain the same effect as that of the invention described in claim 2, and in particular, in consideration of the size of the detected face, the image area including the face can be obtained. The determination of the static display time can be performed more appropriately, and thereby, the faces of a plurality of persons in the image can be displayed more appropriately.

  According to the fourth aspect of the present invention, it is possible to determine the still display time of an image area including each face according to the reliability of face detection, and thereby an image including a face with low reliability of face detection. When displaying an area, that is, an image area in which a part other than the face is likely to be erroneously detected, it is displayed as if moving to an image area including a face with high face detection reliability. Therefore, the unnaturalness of the display content caused by the erroneous detection of the image area other than the face can be reduced. In addition, even if the face is actually a face but the reliability is low, the display time is shortened, but the face can be displayed reliably, so that the faces of a plurality of persons in the image can be displayed properly. It can be carried out.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.
Here, FIG. 1 is a block diagram showing a main configuration of an imaging apparatus 100 exemplified as a preferred embodiment of an image display apparatus to which the present invention is applied.

The imaging apparatus 100 of the present embodiment detects, for example, a plurality of human faces F in the photographic image G and enlarges and displays an image region R including the faces F on the display unit 7 (described later) (FIG. 2). (See FIG. 4 (a) to FIG. 4 (c)). The image display processing is performed while continuously moving from one face F to another in the image G. .
Specifically, as illustrated in FIG. 1, the imaging apparatus 100 includes an imaging unit 1 that images a subject, and an image recording unit 2 that records image data 2 a related to a photographic image G of the subject captured by the imaging unit 1. A face detection unit 3 that detects a person's face F from within the photographic image G related to the image data 2a recorded in the image recording unit 2, and a locus that determines the movement locus L of the image region R constituting the photographic image G A determination unit 4, a zoom magnification determination unit 5 for determining the zoom magnification of the image region R, a still time determination unit 6 for determining a still display time of the image region R to be moved and displayed, a photographic image G, an image region R, etc. Is provided with a display unit 7 or the like.

  For example, although not shown, the imaging unit 1 includes an imaging lens group having a focus function and a zoom function, and a CCD (Charge Coupled Device) that converts a subject image that has passed through the imaging lens group into two-dimensional image data. An electronic imaging unit composed of a CMOS (Complementary Metal-oxide Semiconductor), a signal processing unit that performs predetermined image processing on the image data 2a output from the electronic imaging unit, an electronic imaging unit, a signal processing unit, and the like An imaging control unit and the like for controlling are provided.

The image recording unit 2 records, for example, image data 2a in a predetermined format in which the vertical and horizontal directions of the photographic image G (see FIG. 2) of the subject captured by the imaging unit 1 are each composed of a predetermined number of pixels.
Here, as the photographic image G, for example, as shown in FIG. 2, an image in which a plurality of persons (for example, seven persons in FIG. 2) are reflected can be applied.

  The image recording unit 2 may be, for example, a removable memory card or the like, or a built-in recording device.

The face detection unit (face detection means) 3 acquires, for example, predetermined image data 2a recorded in the image recording unit 2, and based on the image data 2a, a plurality of human faces from the photographic image G F is detected.
Here, as a face detection algorithm, for example, the method of “Neural Network-Based Face Detection”, Henry A. Rowley, Shumet Baluja, Takeo Kanade, (PAMI, January 1998) can be mentioned.
In this algorithm, a discriminator for determining whether or not an arbitrary image region R of the photographic image G is the face F is used. That is, for example, image parts of various sizes are cut out from various positions in the photographic image G, all these image parts are input to the classifier, and the classifier determines whether each is a face F. By doing so, the positions and sizes of all the faces F appearing in the photographic image G are detected. More specifically, the classifier calculates an evaluation value (reliability) for the input image portion, compares the evaluation value with a predetermined threshold value, and the evaluation value is equal to or greater than the threshold value. Is determined to be the face F, and if it is less than the threshold value, it is determined that the face is not the face F, and the determination result is output. In this way, all positions and sizes of the plurality of faces F in the photographic image G are detected.
For example, as shown in FIG. 2, in the case of a photographic image G in which several human faces F are reflected behind a subject lined up by several people (for example, four people), there are also several human faces F behind them. It may be detected. In this case, since the faces F of the people behind are not facing the camera, hidden, or too small, the reliability of face detection is low.
In FIG. 2, a square frame represents the detected face F, but a solid line corresponds to a face whose reliability is greater than or equal to the threshold T, and a broken line corresponds to a face whose reliability is less than the threshold T.

Thus, the face detection unit 3 constitutes a position detection unit that detects the position of each of the plurality of faces F in the entire photographic image G. Note that position information relating to the detected position of each face F is output to the trajectory determination unit 4.
Further, the face detection unit 3 constitutes a size calculating means for calculating the size of each of the plurality of faces F with respect to the entire photographic image G. Note that the size information related to the calculated size of each face F is output to the zoom magnification determination unit 5.
Further, the face detection unit 3 constitutes a reliability determination unit that determines whether or not the reliability of face detection is equal to or greater than a predetermined threshold T. Here, in the present embodiment, it is preferable that the detection leak of the face F be reduced by setting the threshold value lower. The reliability information related to the determination result of the reliability is output to the stationary time determination unit 6.

Moreover, instead of the above algorithm, for example, eigenfaces by principal component analysis (M. Turk and A. Pentland, Eigenfaces for recognition ", Journal of Cognitive Neuroscience, Vol. 3, No. 1, pp. 71-86, 1991), Support Vector Machine (B. Heisele, P. Ho, and T. Poggio, “Face Recognition with Support Vector Machines: Global versus Component-based Approach,” In Proc. Of Internation Conference on Computer Vision, vol. 2. , pp.688-694, 2001), Gabor wavelet and graph matching (E. Ellagin, J. Steffens, and H. Neven. utomatic Real-Time Pose Estimation System for Human Faces Based on Bunch Graph Matching Technology. Proceedings of the International Conference on Automatic Face and Gesture Recognition '98, 1998) can also be used.
In any of these methods, for example, it is determined whether or not the face is F by evaluating a predetermined continuous numerical value calculated by the discriminator.

For example, the trajectory determining unit 4 calculates the center of gravity C of each face F based on the position information output from the face detecting unit 3, and then passes through the center of gravity C of each of the plurality of faces F. A process of determining a movement locus L (see FIG. 2) for moving and displaying R is performed.
Here, as the movement trajectory L, for example, a movement trajectory L in which the image region R moves in one direction (for example, the horizontal direction) from left to right (or from right to left) (see FIG. 3 ( a)), or a movement locus L (see FIG. 3B) that makes the total movement distance the shortest. Note that these movement trajectories L are examples, and are not limited to these.
In this way, the trajectory determining unit 4 constitutes a moving trajectory determining unit that determines the moving trajectory L that moves the image region R so as to pass through the center of gravity C of each of the plurality of faces F.
The determined movement locus L of the image region R is output to the display unit 7.

The zoom magnification determination unit 5 is, for example, among the image regions R that are moved and displayed along the predetermined movement locus L determined by the locus determination unit 4 based on the size information output from the face detection unit 3. A process of determining the zoom magnification (enlargement ratio) of the image region R including each of the plurality of faces F is performed.
Here, any method may be used for determining the zoom magnification. However, the zoom magnification is, for example, a natural magnification in which the ratio of the area of the face F to the entire screen of the display unit 7 is about 30 to 50%. It is preferable. That is, if the face F after zooming is too large, the surrounding situation becomes difficult to understand, and if it is too small, the face F cannot be properly confirmed. Furthermore, if the zoom magnification is too large, the display of the face F after zooming may become rough. Therefore, the zoom magnification is preferably determined in consideration of the resolution of the image data 2a.
As described above, the zoom magnification determining unit 5 constitutes an enlargement factor determining unit that determines an enlargement factor (zoom magnification) of the image region R including each of the plurality of faces F. Then, by displaying the image region R on the display unit 7 in accordance with the zoom magnification determined by the zoom magnification determining unit 5, the faces F of a plurality of persons in the photographic image G can be displayed more appropriately. It becomes.
Note that the determined zoom magnification of the image region R is output to the display unit 7.

The still time determination unit 6 performs, for example, a process of determining the still display time of the image region R including each of the plurality of faces F to be moved and displayed based on the reliability information output from the face detection unit 3. It is.
That is, the stationary time determination unit 6 displays the image region R that is moved along the predetermined movement locus L determined by the locus determination unit 4 at a position corresponding to the center of gravity C of the face F. Are determined according to the reliability of face detection. Specifically, for example, as illustrated in FIGS. 4A to 4B, the still time determination unit 6 includes an image region R <b> 1 including the face F for which the reliability of face detection is determined to be greater than or equal to the threshold T. 4 is determined so that the stationary display time is a predetermined time (for example, 3 seconds) (see FIGS. 4A and 4C), and the reliability is determined to be less than the threshold T. The still display time is determined so that the still display time related to the image region R2 including the face F is approximately zero seconds, that is, a state in which the display is moved and displayed at the same speed without being stopped (see FIG. 4 (b)).
As described above, the still time determination unit 6 determines the still display time related to the image region R2 including the face F, whose reliability is determined to be less than the predetermined threshold T by the face detection unit 3, to be substantially zero. It constitutes time determination means.
The determined still display time of the image area R is output to the display unit 7.

The display unit 7 is configured by, for example, a liquid crystal display panel, and displays a photographic image G, an image region R constituting the photographic image G, and the like based on the image data 2a acquired from the image recording unit 2. .
Specifically, the display unit 7 displays a part of the image area R constituting the photographic image G, that is, the image area R including the face F of the person, the image area R other than the face F between the persons, and the like. In accordance with each corresponding zoom magnification determined by the zoom magnification determination unit 5, zoom (enlargement) display is performed on substantially the entire display area. Here, the display unit 7 constitutes an enlarged display unit that enlarges and displays the image region R.
In addition, the display unit 7 is configured to display the image region R while moving continuously in the photographic image G as a moving display means. In other words, the display unit 7 is configured to move and display the image region R at a predetermined movement speed (for example, 300 pixels / second) along the movement locus L determined by the locus determination unit 4.
Further, the display unit 7 serves as a stationary display unit for each of the plurality of faces F determined by the stationary time determination unit 6 among the image regions R that move along the movement track L determined by the track determination unit 4. The image region R including the face F is displayed stationary according to the stationary display time. That is, for example, the display unit 7 corresponds to the center of gravity C of each of the faces F, including the image area R1 including the face F whose reliability is determined to be greater than or equal to the threshold value T among the image areas R that are moved and displayed. The position is displayed at rest for 3 seconds (see FIGS. 4A and 4C), and the image region R2 including the face F whose reliability is determined to be less than the threshold T is not stopped (approximately zero seconds). ) Move and display as it is.

Next, the image display process will be described in detail with reference to FIG.
Here, FIG. 5 is a flowchart showing an example of an operation related to the image display processing.

As shown in FIG. 5, for example, when an instruction to execute image display processing of a predetermined photographic image G is instructed based on a predetermined operation such as an operation unit (not shown) by a user, the face detection unit 3 performs image recording. Image data 2a related to the photographic image G (see FIG. 2) recorded in the unit 2 is acquired (step S1).
Subsequently, the face detection unit 3 detects the faces F of a plurality of persons in the photographic image G based on the acquired image data 2a. Specifically, the face detection unit 3 detects the position of each face F (step S21), calculates the size of each face F (step S22), and determines the reliability of each face detection (step S23). I do. Then, the face detection unit 3 outputs the position information related to the detected position of each face F to the locus determination unit 4, outputs the size information related to the detected size of each face F to the zoom magnification determination unit 5, and The reliability information related to the reliability determination result is output to the stationary time determination unit 6.

Next, the trajectory determination unit 4 calculates the centroid C of each face F based on the position information output from the face detection unit 3 and input, and calculates the centroid C of each of the plurality of faces F. A movement locus L for moving the image region R so as to pass is determined (see FIGS. 2 and 3), and the movement locus L is output to the display unit 7 (step S31).
Further, the zoom magnification determination unit 5 determines the zoom magnification of the image area R including each face F based on the size information output from the face detection unit 3 and displays the zoom magnification. Output to the unit 7 (step S32).
In addition, the still time determination unit 6 determines the still display time of the image region R including each face F based on the reliability information output from the face detection unit 3 and input, and the still display time Is output to the display unit 7 (step S33).

Next, in the display unit 7, the movement locus L output and input from the locus determination unit 4, the zoom magnification output and input from the zoom magnification determination unit 5, and the stationary time determination unit 6 output and input. Based on the displayed still display time, zoom display and movement display of the image region R including the faces F of a plurality of persons in the photographic image G are performed (step S4).
Specifically, the display unit 7 moves the image region R including the face F zoomed according to the zoom magnification determined by the zoom magnification determination unit 5 to the image region R determined by the locus determination unit 4. The image is displayed while continuously moving in the image along the locus L (see FIG. 4). At this time, the display unit 7 displays the image region R1 including the face F with high face detection reliability based on the still display time determined by the still time determination unit 6 (FIGS. 4A and 4C). )) Is displayed stationary for a predetermined time (for example, 3 seconds), and the image region R2 (see FIG. 4B) including the face F with low face detection reliability is displayed without moving.

As described above, according to the imaging apparatus 100 of the present embodiment, the still display time of the image region R including each face F can be determined according to the reliability of face detection. That is, the reliability of the face detection reliability is less than the threshold T when the enlarged image area R is moved along the movement locus L that passes through the center of gravity C of each of the faces F of the plurality of persons. The stationary display time of the image region R2 including the low face F is set to approximately zero seconds and is displayed without moving, and the stationary region of the image region R1 including the highly reliable face F whose face detection reliability is equal to or higher than the threshold T is displayed. The display time can be 3 seconds.
As a result, even if the image region R2 including the face F with low face detection reliability, that is, the image region R with a high possibility that a part other than the face F is erroneously detected is enlarged and displayed, the face F with high reliability is obtained. Can be displayed as if moving to the image area R1 including the image area R1, and unnaturalness of display contents caused by erroneous detection of the image area R other than the face F can be reduced.
In addition, since all the faces F detected by the face detection unit 3 are displayed in an enlarged manner, even if the face F is actually a face F, even if the reliability is low, the display time is shortened, but it is surely displayed. Thus, the faces F of a plurality of persons in the image can be properly displayed. Therefore, it is possible to provide the imaging device 100 that is technically superior and more attractive than the conventional image display device in which the image region R2 including the face F with low reliability of face detection is not displayed at all.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, the static display time of the image region R including each face F is determined based only on the reliability of face detection. However, the present invention is not limited to this. For example, in addition to the reliability, the entire photographic image G The stationary display time may be determined in consideration of the size of the face F with respect to.
That is, in a group photo or the like in which a plurality of person's faces F are shown, the size of each face F is generally constant, but the face detection unit 3 makes a predetermined threshold value. When an extremely large face F or an extremely small face F is calculated, it is highly likely that the face F is a part other than the face F or is not the face F photographed intentionally. . Therefore, the stationary time determination unit 6 selects the face F for a face F that is extremely large or extremely small with respect to a predetermined threshold based on the size information output from the face detection unit 3 and input. The still display time is determined so that the moving image is displayed without moving in the including image region R.
Specifically, in the image display process (see FIG. 6), the face detection unit 3 sends the size information related to the calculated size of each face F to the still time determination unit 6 together with the zoom magnification determination unit 5. (Step S222), and the stationary time determination unit 6 performs stationary of the image region R including each face F based on the size information in addition to the reliability information output from the face detection unit 3 and input. The display time is determined (step S233).
In this way, by considering the size of each face F detected by the face detection unit 3, it is possible to more appropriately determine the stationary display time of the image region R including the face F. It is possible to more appropriately display the faces F of a plurality of persons in the image.

Further, in the above embodiment, the stationary display time related to the image region R2 including the face F determined that the reliability of face detection is less than the threshold T is set to substantially zero. However, the present invention is not limited to this. For example, the still display time may be shorter than the still display time related to the image region R1 including the face F whose reliability is determined to be equal to or greater than the threshold T.
Even in such a configuration, when the image area R2 including the face F with low face detection reliability, that is, the image area R in which a part other than the face F is likely to be erroneously detected is enlarged and displayed, Can be displayed as if moving to the image area R1 including the face F having a high height, thereby reducing the unnaturalness of the display content caused by erroneous detection of the image area R other than the face F. Can do.
In addition, even if the face F is actually low, the display time is shortened even if the reliability is low, but it can be surely displayed, and the display of the faces F of a plurality of persons in the image is appropriate. Can be done.

Furthermore, in determining the resting time, the atmosphere of a photograph or the atmosphere (rhythm) of the BGM may be taken into consideration when the BGM is used for image display. That is, for example, when the BGM tempo is faster than a predetermined speed, the stationary time may be shortened, and when the tempo is slow, the stationary time may be set longer.
In addition, the moving speed of the image region R between the faces F may be set in consideration of the atmosphere of the photograph, the atmosphere of BGM, and the like, similar to the above-described stationary time.

In the above embodiment, the image data 2a recorded in the image recording unit 2 is used for face detection, enlarged display of a predetermined image region R, and the like. However, the present invention is not limited to this. Alternatively, the image data 2a transmitted from and received via a predetermined communication cable may be used. That is, instead of the image data 2a recorded in the image recording unit 2 in advance, the image data 2a acquired by the imaging apparatus 100 at any time using predetermined means when performing face detection or the like may be used.
Further, the image data 2a has been described by taking the photographic image G taken by the imaging apparatus 100 as an example. However, the image data 2a is not limited to this. It may be image data 2a read by an image reading apparatus such as a scanner.
The image is not limited to the photographic image G, and any image can be used as long as it represents a plurality of persons and can detect a face. For example, it is created by computer graphics (CG). It may be a high-definition CG image or the like.

In addition, in the above-described embodiment, the person's face F is detected. However, the present invention is not limited to this. For example, each process similar to the above is performed on an image representing an arbitrary object. It is good also as a structure which detects the said object by this.
Furthermore, in the above-described embodiment, the imaging device 100 is illustrated as the image display device according to the present invention. However, the present invention is not limited to this, and any device may be used as long as the device includes the display unit 7 that displays at least image data. It may be. Further, for example, image data is taken into a personal computer (PC; not shown) having a display as an image display device, and based on execution of a predetermined program by the PC, as described above, face detection processing, The present invention is realized by performing position detection processing, face detection reliability determination processing, image region movement trajectory determination processing, image region enlargement display processing, movement display processing, still display processing, and the like. You may make it do.

It is a block diagram which shows the principal part structure of the imaging device illustrated as suitable one Embodiment of the image display apparatus to which this invention is applied. It is the figure which showed typically the photographic image which concerns on the image display process by the imaging device of FIG. It is the figure which showed typically the movement locus | trajectory of the image area | region which comprises the photographic image which concerns on the image display process of FIG. It is the figure which showed typically the movement of the image area which concerns on the image display process of FIG. 3 is a flowchart illustrating an example of an operation related to the image display process of FIG. 2. 10 is a flowchart illustrating an example of an operation related to an image display process performed by an imaging apparatus according to a first modification.

Explanation of symbols

100 Imaging device (image display device)
DESCRIPTION OF SYMBOLS 1 Image pick-up part 2 Image recording part 2a Image data 3 Face detection part (a face detection means, a position detection means, a size calculation means, a reliability determination means)
4 Trajectory determination unit (moving trajectory determination means)
5 Zoom magnification determination unit (magnification rate determination means)
6 Stationary time determination unit (stationary display time determination means)
7 Display section (enlarged display means, moving display means, stationary display means)
F Face G Photo image L Movement trajectory R Image area

Claims (4)

Face detection means for detecting faces of the plurality of persons from the image based on the image information of the image representing the plurality of persons;
An enlarged display means for enlarging and displaying a part of the image area constituting the image;
Moving display means for continuously moving the image area enlarged and displayed by the enlarged display means within the image;
Position detecting means for detecting the position of each of the faces detected by the face detecting means;
A movement trajectory determining means for determining a movement trajectory for moving the image area by the movement display means so as to pass through each of the plurality of faces detected by the position detection means;
Reliability determination means for determining whether or not the reliability of face detection by the face detection means is equal to or greater than a predetermined threshold;
A stationary display unit that statically displays the image region including each of the faces among the image regions that are moved and displayed along the movement locus determined by the movement locus determination unit;
The static display time of the image area by the static display means is equal to or greater than the predetermined threshold for the static display time related to the face having the reliability determined by the reliability determination means to be less than the predetermined threshold. Static display time determining means for determining to be shorter than or substantially zero than the static display time related to the face of the reliability determined to be,
An image display device comprising: Size calculating means for calculating the size of each of the faces detected by the face detecting means with respect to the entire image;
An enlargement ratio determining means for determining an enlargement ratio by the enlargement display means of the image area including each of the faces based on the size of each of the plurality of faces calculated by the size calculating means;
The image display apparatus according to claim 1, further comprising:   The image display device according to claim 2, wherein the still display time determination unit further determines the still display time based on the size of the face calculated by the size calculation unit. In the image display device,
A function of detecting faces of the plurality of persons from the image based on image information of the image representing the plurality of persons;
A function of enlarging and displaying a part of the image area constituting the image;
A function of continuously moving the image area to be enlarged and displayed within the image;
A function of detecting the position of each of the detected faces;
A function of determining a movement trajectory for moving the image region so as to pass through each of the detected faces;
A function of determining whether the reliability of face detection is equal to or higher than a predetermined threshold;
A function of statically displaying the image area including each of the faces among the image areas that are moved and displayed along the determined movement locus;
The still display time of the image area, the reliability of the face determined to be less than the predetermined threshold, the still display time of the face of the reliability determined to be greater than or equal to the predetermined threshold. A function of determining to be shorter than the stationary display time for the face or to be substantially zero;
A program to realize

Images