KR101398474B1 - Display apparatus using face-recognition and method of controlling the same - Google Patents

Abstract

The present invention relates to a display device capable of displaying an image desired by an observer and reducing power consumption by using a face recognition technology and a body sensing technology, and a control method thereof.

Display device, face recognition, playback mode setting, playback mode change, body detection

Description

[0001] The present invention relates to a display apparatus using face recognition and a method of controlling the same,

The present invention relates to a display device using face recognition and a control method thereof.

With the recent development of a digital photographing apparatus, it has become easy to take a picture and confirm a photographed image. Compared with a conventional film camera, images photographed with a film camera must be developed to be sure, but images photographed by a digital photographing device can easily be confirmed on an LCD window or an external display device provided by itself. In other words, there is no need for development to confirm the photographed image.

However, even if an image is photographed by a digital photographing apparatus, it is usually developed and produced as a photograph for exhibition, and the photograph is put on a frame and displayed in a house or a company. The general frame can display only one photograph, and in order to display other pictures, the user has to insert the picture into the frame.

In order to solve the inconvenience, a display device such as an electronic frame capable of displaying image data photographed, not a photograph, has been developed. Therefore, the phenomenon is no longer required to display images. That is, the image photographed by the digital photographing device can be displayed on the photographed image by directly providing the image data to the electronic frame without a development process. In addition, the electronic frame can store a large number of images at the same time, and can display a plurality of images without inconvenience that the user has to replace the photographs.

However, since a plurality of images are stored in the electronic frame, there is another inconvenience that the user must search for and select and classify the images in order to view and display desired images.

Accordingly, the present applicant has developed an electronic frame and a control method thereof capable of displaying a desired image according to a user or an observer.

The present invention provides a display device capable of displaying a desired image according to an observer and a control method thereof.

The present invention also provides a display device capable of reducing power consumption and a control method thereof.

A face recognizing unit recognizing a face of the object from the image data and generating face recognition information; and a signal setting unit for setting a signal for setting a reproduction mode according to the face recognition information, And a display unit for displaying an image corresponding to the reproduction mode.

The display apparatus further includes a memory in which face recognition information of a subject is stored, and a reproduction mode according to the face recognition information is set and registered. Further, priority information of the subject can be stored in the memory.

The display device may further include a body sensing unit for sensing a body of a subject. At this time, the signal processing unit selects or maintains the playback mode when the body of the subject is sensed by the body sensing unit, terminates the playback mode when the body of the subject is not sensed, or turns off the power of the electronic frame Can be controlled.

In addition, the present invention provides a display device including a step of recognizing a face of a subject to generate face recognition information, a step of selecting a reproduction mode corresponding to the face recognition information, and a step of displaying an image corresponding to the selected reproduction mode A method of controlling a device is provided.

The control method further includes setting a face recognition information of the subject and a reproduction mode corresponding to the face recognition information.

The control method includes a first determination as to whether or not to set a face recognition mode, a step of selecting a first reproduction mode when the face recognition mode is not set according to the first determination result, And generating face recognition information by recognizing the face of the subject when the recognition mode is set. In this case, the control method may further include photographing and storing the subject when the face recognition mode is not set according to the first determination result.

The control method comprising the steps of: determining whether the generated face recognition information is registered; selecting the first reproduction mode if the face recognition information is not registered according to the second determination result; Determining whether a face recognition information corresponding to the face recognition information is registered according to a result of the determination; and if the face recognition information is not registered, And selecting a second reproduction mode if the reproduction mode is set according to the third determination result. In this case, the control method may further include photographing and storing the subject if the face recognition information is not registered according to the second determination result.

The control method may further include setting priority information of a subject. In this case, when the subject recognizes a plurality of faces including a plurality of human beings, the control method can select a reproduction mode corresponding to a human having a high priority. If no priority is set, an image including all the faces can be selected and displayed when a plurality of faces are recognized.

The control method includes the steps of: determining whether the body of the subject is sensed; selecting and maintaining a reproduction mode when the body of the subject is sensed according to the determination result; and when the body of the subject is not sensed, And turning off the power of the electronic frame.

As described above, the display device of the present invention and the control method thereof can recognize an observer and display an image in a desired reproduction mode according to an observer.

Further, since there is no need to display an image in the absence of an observer (subject), the power consumption of the display device can be reduced by automatically turning off the playback mode or turning off the power (OFF).

Furthermore, when the face is not recognized or registered, the photographed subject is photographed and the photographed image is stored, so that the photographed image can be effectively used for crime prevention.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention will be described in more detail with reference to the accompanying drawings.

Fig. 1 is a perspective view of an electronic frame according to an embodiment of the present invention, and Fig. 2 is a block diagram of the electronic frame shown in Fig. 1. Fig. In the present embodiment, an electronic frame is exemplified as a display device. However, the present invention is not limited to this, and a PC or a TV capable of displaying an image can be included in the present invention. It is.

Referring to FIGS. 1 and 2 together, the electronic frame 100 according to the present invention is driven by receiving a predetermined power from the power supply unit 10. FIG.

In addition, the electronic frame 100 may be controlled by receiving an external signal from a user through the input unit 20.

The electronic frame 100 includes a photographing unit 30, a memory 40, and a face recognizing unit 50. Specifically, the photographing section 30 photographs a subject and generates image data. The image data may be temporarily stored in the memory 40. [

In addition, a program for driving the electronic frame 100 may be stored in the memory 40. Particularly, the memory 40 can store face recognition information of a subject and can set and register a reproduction mode according to the face recognition information. Furthermore, the memory 40 may further store the priority information of the subject. The playback mode, priority information, and the like according to the face recognition information and the face recognition information can be stored and set and registered in advance by the user. For example, a first reproduction mode which is a basic reproduction mode, a second reproduction mode which reproduces images including A when a human face is recognized, a third reproduction mode which reproduces images of recent one month by recognizing a human face B, Mode can be registered. In addition, the priorities can be preset between the A human and the B human, respectively, second and first.

The face recognition unit 50 analyzes the image data to recognize a face of a subject and generates face recognition information. The face recognition information may be a geometric factor such as the position or size of each component of a face, for example, facial feature points such as eyes, nose, mouth, or the distance between them. The face may be recognized by matching with a previously stored database using such a geometric factor or a face image inputted to the geometric factors may be projected and then compared with or correlated with a projected image of the stored face image to acquire features Face recognition can be performed. Alternatively, the face image can be recognized by comparing the face image with a template image representing the entire face, and analyzing the degree of correlation therebetween. In addition, the face recognition information is not necessarily made up of geometric factors as described above, and may include information about learning and recognition of a neural network for a learning-type recognition method using an artificial neural network. Such face recognition information can be stored in the header portion of the image file.

The electronic frame 100 includes a display unit 65 for displaying an image, and a display driver 60 for driving the display unit 65. The display unit 65 displays an image corresponding to the set reproduction mode according to the face recognition information. The display unit 65 may include flat panel display devices such as a liquid crystal display (LCD), an organic light emitting display (OLED), and the like. For example, the display driver 60 may include a scan driver, a data driver, and the like in order to drive the display unit 60 displaying an image sequentially.

The electronic frame 100 includes an audio processing unit 70 which processes a voice signal input from a microphone MI or processes a voice output to the outside through a speaker SP.

In addition, the electronic frame 100 may further include a body sensing unit 80 for sensing the body of the subject. The body detecting unit 80 may use a sensor for detecting a thermal change. The body sensing unit 80 senses whether a subject is present outside and controls the operation of the electronic frame 100 according to a sensing signal from the body sensing unit 80, thereby reducing power consumption.

The electronic frame 100 may store an image to be displayed in the built-in memory 40. However, when the size or number of the image is large and the capacity increases, the built-in memory 40 has a limitation. Therefore, the storage medium 200 storing the image can be used as the external memory. In order to display an image stored in the storage medium 200 in the electronic frame 100, the electronic frame 100 may have a storage medium interface 90 that can be electrically connected to the storage medium 200. [ The storage medium 200 may store not only the image but also the face recognition information, the play mode information according to the face recognition information, the priority information, and the like. The information can be stored in the electronic frame 100 ).

In addition, the electronic frame 100 according to the present invention may include a communication unit 95 that can receive the information from external sources. For example, the communication unit 95 can transmit desired information to an external device such as a digital camera, a mobile phone, or a computer using a cable or the like, or transmit the desired information to the external device through a wireless communication technology such as Bluetooth, Zigbee, , ≪ / RTI >

In addition, the electronic frame 100 includes a signal processing unit 150 that performs signal processing to control the overall operation of the electronic frame 100. The signal processing unit 150 controls the entire operation of the electronic frame 100 according to the program stored in the memory 40. [ For example, the signal processing unit 150 may perform gamma correction of the image data input from the photographing unit 30, and may control the setting or conversion of the electronic frame 100 to the standby mode, the face recognition mode, . In the present invention, the signal processor 150 may determine whether to set the face recognition mode, and may control the shooting unit 30 to operate when setting the face recognition mode. If the face is not recognized, the photographing section 30 photographs the subject and stores the photographed image data in the memory 40, As shown in FIG. In addition, it is possible to determine whether or not the face recognition information is registered. If the face recognition information is not registered, the photographing section 30 can control the photographing of the photographed subject and the photographed image data to be stored in the memory 40.

When the body of the subject is detected by the body detection unit 80, the signal processing unit 150 selects the playback mode to display the image on the subject, or maintains the already- . Or if the body of the subject is not detected by the body detection unit 80, the signal processing unit 150 may control to end the playback mode or the face recognition mode or turn off the power of the electronic frame. When the reproduction mode is ended, the camera can be switched to the standby mode. When the face recognition mode is terminated, the photographing unit 30 can not photograph the subject, that is, the camera operation can be turned off. The signal processing unit 150 may include a timer and may control the power of the electronic frame to be turned off if a sensing signal is not inputted from the body sensing unit 80 for a reference time or more.

3 is a flowchart illustrating a method of controlling an electronic frame according to an embodiment of the present invention. The control method of the electronic frame according to the present embodiment illustrates a control method of the electronic frame including the step of converting the reproduction mode using face recognition.

Referring to FIG. 3, when the electronic frame is turned on (S10), the standby mode is performed (S11). Then, it is determined whether to set the face recognition mode (S12).

The face recognition mode setting may be set manually by the user or may be set automatically under a predetermined condition. When the face recognition mode is set, the shooting section operates. The face recognition mode is not set, and the first reproduction mode is selected (S13). The first reproduction mode is a basic reproduction mode, and may be a reproduction mode for sequentially displaying images stored in, for example, a storage medium, a built-in memory, or the like. When the face recognition mode is set, the shooting section operates and the subject (observer) is photographed by the shooting section.

At this time, it is determined whether the face of the subject is recognized (S14). The face recognition is not performed, and the first reproduction mode is selected (S13).

When the face is recognized and the face recognition information is generated, it is determined whether the face recognition information is registered (S15). That is, it is determined whether the face recognition information exists in the existing database. The database may be stored in an external storage medium, a built-in memory, or may be stored in an external device or the like to receive facial recognition information through a communication unit. If the face recognition information is not registered, the first reproduction mode is selected (S13).

If the face recognition information is registered, it is determined whether a reproduction mode corresponding to the face recognition information is registered (S16). First, it is determined whether or not a database of a reproduction mode according to face recognition information exists, and if the database exists, it can be determined whether a reproduction mode corresponding to previously generated face recognition information is registered.

For example, it is determined whether or not there is a reproduction mode database corresponding to the face recognition information after generating the information of the interval A between the eyes of the A human face as the A face recognition information. If the database exists, it is determined whether a second reproduction mode corresponding to the A person's face recognition information is registered from the database. The database in the playback mode according to the face recognition information may be stored in advance in an external storage medium or an internal memory, or may be stored in an external device or the like and transmitted through a communication unit. Therefore, it is determined whether or not the second reproduction mode according to the face information of the human A is registered from the database.

If the database does not exist or the database exists but the second reproduction mode according to human face recognition information is not registered, the first reproduction mode is selected (S13). If the second reproduction mode is registered according to the human face information of the A person in the database, the second reproduction mode corresponding to the A person is selected (S17).

The reproduction mode according to human face recognition information can be set and registered in advance. For example, when the A person wishes to set and register a desired reproduction mode, the A person's face is recognized and the face recognition information is generated and stored, that is, the A person's face is registered. If there is already A human face recognition information, A human face registration can be avoided. Then, a reproduction mode according to the face recognition information of the human A is set. For example, the second reproduction mode desired by the A person may be an image including the A person and an image selected by the A person on the trip spot. The image including the human A can selectively classify only the image including the human face recognition information. Alternatively, there may be a method of selecting and classifying images for a predetermined period, for example, recent one month, using tagging time information, and classifying the images using a tag, , A family image, a friend image, and the like.

Then, an image corresponding to the selected reproduction mode is displayed (S18). Accordingly, the second reproduction mode corresponding to the face recognition information corresponding to the A person is recognized by recognizing the A person's face, and the image including the A person and the image photographed by the A person on the destination in accordance with the second reproduction mode And display images in a slideshow type by selecting and sorting them. Or the face recognition mode is not set, the face is not recognized, or the face recognition information or the face recognition information is not set, the image can be displayed in the basic reproduction mode.

Although not shown in the present embodiment, the face mode registration and face recognition information generating face recognition information can be set in advance.

4 is a flowchart for explaining a control method of an electronic frame according to another embodiment of the present invention. In the present embodiment, the electronic frame control method is exemplified in a case where a plurality of subjects (observers) are photographed after the electronic frame is powered on and the face recognition mode is set.

Referring to FIG. 4, the electronic frame performs a face recognition mode (S21). Then, face recognition information is generated by recognizing the face of the subject (S22). It is determined whether there are two or more recognized faces according to the face recognition information (S23). If the number is not two or more, that is, if there is one person, a playback mode corresponding to the recognized face recognition information is selected (S24). It is assumed that face recognition is possible, and the recognized face recognition information and the reproduction mode according to the face recognition information are set in advance.

If there are two or more persons, it is determined whether there is priority information corresponding to the face recognition information (S25). If there is priority information, the playback mode corresponding to the high priority human is selected (S26). For example, the pre-stored database includes information as shown in Table 1 below. The database includes information that the first human face information of the human face A includes information that the distance between the human face eyes is a and the second face face recognition information of the human B includes information that the distance between the human face eyes of the human B is b do. In addition,

 When a human face is recognized, a first reproduction mode for displaying an image including a human being is set and registered, and the priority information of the human A includes information of a second one. In addition, when the face of the human B is recognized, the database records a second playback mode for displaying an image photographed in the last one month, and the priority information includes the first information.

[table]

human Face recognition information Playback mode Priority A (x1, y1), a Images containing A human 2 B (x2, y2), b Recent 1 month image One

Therefore, according to the database, since the priority of the human B is high, the second reproduction mode corresponding to the human B is selected. That is, the second reproduction mode for displaying the image of the last one month is selected.

Or if there is no priority information, images including recognized faces are selected and classified (S27). That is, the images including the face recognition information of human A and human B are selected and classified.

Then, images corresponding to the selected reproduction mode are displayed (S28). The image display may be performed in a slide show type in which other images are displayed at predetermined time intervals.

5 is a flowchart for explaining a control method of an electronic frame according to another embodiment of the present invention. In this embodiment, a method of detecting the body of a subject (an observer) and controlling the electronic frame according to the body is exemplified.

Referring to FIG. 5, the electronic frame is powered on (S31) and enters a standby mode (S32). Then, it is determined whether the body of the subject (observer) is sensed (S33). If the body of the subject is not detected, it remains in standby mode. When the body of the subject is sensed, the mode is switched to the reproduction mode (S34), and the image is displayed in the reproduction mode (S35). At this time, an image can be displayed in the slide show type. It is determined whether the subject's body is sensed while displaying the image, that is, while the reproduction mode is being performed (S36). Alternatively, after all desired images are displayed, it is determined whether the subject's body is sensed (S36). When the body of the subject is sensed, the reproduction mode is performed. Or if the body of the subject is not sensed, it is determined whether the time that is not sensed is the reference time, in this embodiment, 30 minutes or more (S37). If it is less than 30 minutes, it is judged again whether or not the subject senses the body. If it is longer than 30 minutes, the reproduction mode is terminated or the electronic frame is turned off (S38).

Therefore, the electronic frame according to the present invention can reduce the power consumption by displaying a desired image on an external observer (subject) while controlling not to display an image in the absence of an observer.

6 is a flowchart for explaining a control method of an electronic frame according to still another embodiment of the present invention. In this embodiment, a control method of an electronic frame that performs body detection of a subject and facial recognition is exemplified. In addition, the present embodiment illustrates a control method of an electronic frame that further includes a function of photographing and storing a face of a subject not recognized or registered. This can also be useful for security purposes to arrest trespassers.

Referring to FIG. 6, the electronic frame is powered on (S41) and enters a standby mode (S42). Then, it is determined whether the body of the subject (observer) is sensed (S43). If the body is not detected, the standby mode is maintained. When the body of the subject (observer) is detected, the mode is switched to the first reproduction mode which is the basic reproduction mode (S44). Then, the image is displayed in the first reproduction mode (S45). Then, it is determined whether or not the face recognition mode is set (S46). If the face recognition mode is not set, it is determined whether or not the body of the subject (observer) is sensed (S55). If the face recognition mode is set, it is determined whether the face of the subject (observer) is recognized (S47). If the face is not recognized, that is, the subject (observer) is photographed and the face recognition information is not generated, the subject (observer) is photographed and the photographed image data is stored (S48). Then, it is determined whether the body of the subject (observer) is detected (S55). When the face of the object (observer) is recognized and the face recognition information is generated, it is determined whether the face recognition information exists in the existing database, that is, whether the recognized face is registered (S50). If not registered, the subject (observer) is photographed and stored (S51), and it is determined whether or not the body of the subject (observer) is sensed (S55). If the face recognition information is registered, it is determined whether or not the reproduction mode corresponding to the face recognition information is set and registered (S52). If the reproduction mode according to the face recognition information is set and registered, the second reproduction mode corresponding to the face recognition information is selected (S53). If not registered, it is determined whether the body of the subject (observer) is detected (S55).

If the body of the subject (observer) is detected, it is determined whether the face of the subject (observer) is recognized (S47). Or if the body is not sensed, it is judged whether or not it is sensed longer than the reference time. In this embodiment, the reference time is set to 2, and the time is set to 5 minutes and 30 minutes, respectively. Therefore, it is judged whether or not the body of the subject (observer) is not detected for 5 minutes or more (S56). If it is not detected for 5 minutes or more, the face recognition mode is ended (S57). The termination of the face recognition mode may be, for example, turning off the power of the photographing unit, covering the lens of the camera, and the like. When the body of the subject (observer) is detected in less than 5 minutes, it is judged again whether or not the subject (observer) senses the body (S55). When the face recognition mode is terminated and the body of the subject (observer) is not detected for 30 minutes or more, the reproduction mode is exited or the electronic frame is powered off (S59). If the body of the subject (observer) is detected for less than 5 minutes and less than 30 minutes, the face recognition mode is maintained.

Therefore, in the present embodiment, an observer can display a desired image, and furthermore, a face recognition or an unregistered subject is photographed and recorded, so that it can be also useful for crime prevention.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

1 is a perspective view of an electronic frame according to an embodiment of the present invention.

2 is a block diagram of the electronic frame shown in Fig.

3 is a flowchart illustrating a method of controlling an electronic frame according to an embodiment of the present invention.

4 is a flowchart for explaining a control method of an electronic frame according to another embodiment of the present invention.

5 is a flowchart for explaining a control method of an electronic frame according to another embodiment of the present invention.

6 is a flowchart for explaining a control method of an electronic frame according to still another embodiment of the present invention.

Claims (14)

delete delete A photographing unit for photographing a subject to generate image data, A memory for storing the face recognition information of the subject and the priority information of the subject and registering the reproduction mode according to the face recognition information, A face recognition unit for recognizing the face of the subject from the image data and generating face recognition information, A signal processing unit for setting a reproduction mode in accordance with the face recognition information, And a display unit for displaying an image corresponding to the reproduction mode. delete A photographing unit for photographing a subject to generate image data, A body sensing unit for sensing the body of the subject, A face recognition unit for recognizing the face of the subject from the image data and generating face recognition information, A signal processing unit for setting a reproduction mode in accordance with the face recognition information, And a display unit for displaying an image corresponding to the reproduction mode, The signal processing unit, Wherein the body detection unit selects or maintains the reproduction mode when the body of the subject is sensed, and if not, ends the reproduction mode or turns off the power. delete Generating face recognition information by recognizing a face of a subject; Selecting a playback mode corresponding to the face recognition information; And And displaying an image corresponding to the selected reproduction mode, And setting a reproduction mode corresponding to the face recognition information and the face recognition information of the subject. The method according to claim 7, further comprising: determining whether to set a face recognition mode; Selecting a first reproduction mode when the face recognition mode is not set according to the first determination result; And And generating face recognition information by recognizing a face of the subject when the face recognition mode is set according to the first determination result. The method of claim 8, further comprising capturing and storing the subject when the face recognition mode is not set according to the first determination result. The method of claim 8 or 9, further comprising: determining whether the generated face recognition information is registered; Selecting the first reproduction mode if the face recognition information is not registered according to the second determination result; If the face recognition information is registered according to a result of the second determination, determining whether a reproduction mode corresponding to the face recognition information is set; Selecting the first reproduction mode if the reproduction mode is not set according to the third determination result; And And selecting a second reproduction mode if the reproduction mode is set according to the third determination result. The method of claim 10, further comprising capturing and storing the subject if the face recognition information is not registered according to the second determination result. 8. The method according to claim 7, further comprising setting priority information of the subject. 13. The method according to claim 12, wherein, when the subject recognizes a plurality of faces including a plurality of human beings, the control unit selects a reproduction mode according to the set priority information. 8. The method of claim 7, further comprising: determining whether the subject is sensed; And And selecting and maintaining the playback mode when the body of the subject is sensed according to the determination result and terminating the playback mode or turning off the power when the body of the subject is not sensed Control method.

Images