KR101635102B1 - Digital photographing apparatus and controlling method thereof - Google Patents

Abstract

The present invention relates to a digital photographing apparatus and a control method thereof, wherein a digital photographing apparatus having a first display unit and a second display unit according to an embodiment of the present invention includes a first display unit, And a digital signal processing unit provided on the front surface of the digital photographing apparatus and generating composition guide information based on the reference composition information and the input image and displaying the generated composition guide information on the second display unit, It can detect the subject and shoot the image according to the desired composition through the front display unit. It also enables the interaction between the camera and the photographer and the subject, You can give.

Composition, guide, second display

Description

[0001] Digital photographing apparatus and controlling method [0002]

The present invention relates to a digital photographing apparatus, and more particularly, to a digital photographing apparatus having a plurality of display units and a control method thereof.

A digital camera (digital camera, digital camcorder) equipped with a dual display displays the same image on each display. For example, a live view image, a preview image, a playback image, and the like are displayed equally on a dual display.

On the other hand, it was possible to set a general grid guide to help a photographer to compose a picture, but there was no special grid for each different composition, and it was difficult to shoot a picture even if there was a picture that I wanted to refer to for composition. In addition, the photographer was able to adjust the camera, and there was not enough way to adjust the composition by moving the subject directly to the composition.

A conventional method of assisting self-photographing is to notify a user when a condition is imaged by inputting an angle at which a person faces the best face. Recognition of this angle is calculated by using a hardware sensor, for example an acceleration sensor, by reading the current tilted angle of the camera and using the information from the face detector to calculate the tilted angle of the face.

It is an object of the present invention to provide a digital photographing apparatus and a control method thereof that can provide a composition guide through a front display unit.

According to an aspect of the present invention, there is provided a digital photographing apparatus including a first display unit and a second display unit, wherein the first display unit is disposed on a rear surface of the digital photographing apparatus, And a digital signal processing unit provided on the front surface of the photographing apparatus, for generating composition guide information based on the reference composition information and the input image, and displaying the generated composition guide information on the second display unit.

The digital signal processing unit may include a picture recognition unit for extracting composition information of the sample picture, an image synthesis unit for synthesizing the sample picture and the input image, and composition guide information based on the composition information of the sample picture and the input image And a composition guide unit for displaying the generated composition guide information on the second display unit.

Wherein the image synthesizing unit activates the contour of the subject of the sample photograph and synthesizes the contour with the input image.

Wherein the control unit generates guide guidance information on whether or not the contour matches the subject in the input image.

And the composition guide information is expressed by color information.

The reference composition information is composition information extracted from the input image, and the composition guide information is information on which the subject must move in order to match a subject of the input image with the reference composition information.

And the control unit generates composition guide information based on the composition image of the sample photograph and the input image according to whether it is a far-distance photographing or a near-field photographing.

The photograph recognition unit extracts the person information from the sample photograph, reduces the size of the photograph, or processes the front photograph.

And the digital signal processing unit performs automatic photographing when the composition guide information displayed on the second display unit matches the subject information of the input image.

According to another aspect of the present invention, there is provided a method of controlling a digital photographing apparatus including a first display unit and a second display unit, the method comprising: generating reference composition information; Generating composition guide information based on the generated reference composition information and the input image; And displaying the generated composition guide information on the second display unit.

Wherein the step of generating the reference guide information further comprises the steps of: synthesizing the sample image and the input image; extracting composition information of the sample image and the input image; And the composition guide information is generated based on the information.

The method may further include automatically photographing the subject when the subject information of the input image coincides with the composition guide information displayed on the second display unit.

And the synthesizing step activates the contour of the subject of the sample photograph and synthesizes the contour with the input image.

The generating step may generate the composition guide information as to whether or not the active contour line matches the subject in the input image.

And the composition guide information is expressed by color information.

The reference composition information is composition information extracted from the input image, and the composition guide information is information on which the subject must move in order to match a subject of the input image with the reference composition information.

The method may further include determining whether the photographing is a long-distance photographing or a short-distance photographing, and the generating step generates the composition guide information based on the composition information of the sample photograph and the input image according to the determination result do.

The extracting step extracts the person information from the sample photograph, reduces the size of the photograph, or processes the front photograph.

According to still another aspect of the present invention, there is provided a recording medium having recorded thereon a program for causing a computer to execute the method of controlling the digital photographing apparatus according to another embodiment of the present invention.

The digital photographing apparatus according to an embodiment of the present invention can detect a subject in a photographed image and photograph the photographed image according to a desired composition through a front display unit. It is also possible to perform an interaction between a camera and a photographer or a subject, It is possible to supplement the problem of shooting the preview screen at a long distance as a composition guide information.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, only parts necessary for understanding the operation according to the present invention will be described, and descriptions of other parts may be omitted so as not to disturb the gist of the present invention.

In addition, terms and words used in the following description and claims should not be construed to be limited to ordinary or dictionary meanings, but are to be construed in a manner consistent with the technical idea of the present invention As well as the concept.

Fig. 1 is a view showing the external appearance of the digital photographing apparatus 100 according to the present invention. The first display section 164 and the second display section 168 can be formed on the back and front surfaces of the digital photographing apparatus, respectively. 1A, the first display portion 164 is disposed on the opposite surface of the surface on which the lens barrel 109 is disposed, and the second display portion 168 is disposed on the same surface as the surface on which the lens barrel 109 is disposed As shown in FIG.

2 is a diagram showing a schematic internal structure of the digital photographing apparatus 100 shown in FIG.

The digital photographing apparatus 100 according to the present invention includes a lens 110, a lens driving unit 111, a diaphragm 112, a diaphragm driving unit 113, an imaging device 115, an imaging device control unit 116, The first display driver 164, the second display driver 166, the second display driver 160, the first display driver 160, the first display driver 160, the second display driver 160, the program storage unit 130, the buffer storage unit 140, the data storage unit 150, A digital signal processing unit 170, and an operating unit 180. [

The lens 110 condenses the optical signal. The lens 110 includes a zoom lens for controlling the angle of view to be narrowed or widened according to the focal length, a focus lens for focusing the subject, etc. These lenses may be each composed of one lens, And may be a group of a plurality of lenses.

The diaphragm 112 adjusts the degree of opening and closing thereof to adjust the amount of incident light.

The lens driving unit 111 and the diaphragm driving unit 113 receive a control signal from the digital signal processing unit 170 and drive the lens 110 and the diaphragm 112, respectively. The lens driving unit 111 adjusts the position of the lens to adjust the focal length, and performs operations of auto focusing, zoom change, and focus change. The diaphragm driving unit 113 adjusts the opening / closing degree of the diaphragm and adjusts the f number to perform autofocus, automatic exposure correction, focus change, depth of field adjustment, and the like.

The optical signal transmitted through the optical unit 110 reaches the light-receiving surface of the image pickup element 115 to form an image of the object. The image pickup device 115 may be a charge coupled device (CCD) or a complementary metal oxide semiconductor image sensor (CIS) that converts an optical signal into an electric signal. The sensitivity of the image pickup device 115 can be adjusted by the image pickup device control unit 116. The image pickup element control unit 116 can control the image pickup element 115 in accordance with a control signal automatically generated by the video signal inputted in real time or a control signal manually inputted by the user's operation.

The exposure time of the imaging element 115 is adjusted by a shutter (not shown). The shutter has a mechanical shutter for moving the screen to adjust the incidence of light, and an electronic shutter for controlling exposure by supplying an electric signal to the imaging element 115.

The analog signal processing unit 120 performs noise reduction processing, gain adjustment, waveform shaping, and analog-to-digital conversion processing on the analog signal supplied from the image pickup element 115.

The digital photographing apparatus 100 includes a program storage unit 130 for storing programs such as an operating system and an application system, a buffer storage unit 140 for temporarily storing data or result data necessary for performing an operation, And a data storage unit 150 for storing various information necessary for the program including the image file.

The digital photographing apparatus 100 includes a first display section 164 and a second display section 168 for displaying an operation state of the digital photographing apparatus 100 or image information photographed by the digital photographing apparatus 100. [ The first display portion 164 and the second display portion 168 can provide visual information and / or auditory information to the user. The first display portion 164 and the second display portion 168 may be formed of, for example, a liquid crystal display panel (LCD), an organic light emitting display panel (OLED), or the like to provide visual information. The first display driver 162 and the second display driver 166 provide driving signals to the first display unit 164 and the second display unit 168, respectively. The first display driver 164 and the second display driver 166 driving the first display portion 164 and the second display portion 168 are separately driven in the embodiment of the present invention. The first display unit 164 and the second display unit 168 may be driven together by the display driver.

The digital photographing apparatus 100 includes a digital signal processor 170 that processes input image signals and controls each of the components according to an external input signal. The digital signal processor 170 reduces the noise of input image data and performs a gamma correction, a color filter array interpolation, a color matrix, a color correction, And image signal processing for improving image quality such as color enhancement can be performed. In addition, image data generated by performing image signal processing for image quality improvement can be compressed and processed to generate an image file, or image data can be restored from an image file. The compression format of the image may be reversible or irreversible. As an example of a suitable format, conversion to JPEG (Joint Photographic Experts Group) format or JPEG 2000 format is also possible. The compressed image file can be stored in the data storage unit 150. In addition, the digital signal processing unit 170 can functionally perform blurring processing, color processing, blur processing, edge emphasis processing, image analysis processing, image recognition processing, image effect processing, and the like. The face recognizing process, the scene recognizing process, and the like can be performed by the image recognizing process. In addition, the digital signal processing unit 170 can perform display video signal processing for display on the first display unit 164 and the second display unit 168. [ For example, brightness level adjustment, color correction, contrast adjustment, outline enhancement adjustment, screen division processing, character image generation, and image synthesis processing can be performed. The digital signal processing unit 170 may be connected to an external monitor to process a predetermined image signal to be displayed on an external monitor, and transmit the processed image data to display the corresponding image on an external monitor.

The digital signal processor 170 may also execute a program stored in the program storage unit 130 or may include a separate module to generate a control signal for controlling autofocus, zoom change, focus change, automatic exposure correction, and the like The lens driving unit 111, the diaphragm driving unit 113 and the imaging device control unit 116 so that the operation of the components of the digital imaging device 100 such as the shutter and the flash can be collectively controlled.

The operation unit 180 may include a member for the photographer (user) to operate the digital camera or perform various settings when photographing. For example, it can be implemented in the form of a button, a key, a touch panel, a touch screen, a dial, and the like. , A selection operation or the like can be inputted. For example, the shutter button can be half-pressed, fully pressed, and released by the photographer. When the shutter button is half-pressed (S1 operation), the focus control start operation signal is outputted, and the focus control is ended by half-pressing. When the shutter button is fully depressed (S2 operation), a shooting start operation signal can be outputted. The operation signal is transmitted to the DSP 170 or the like, thereby driving the corresponding component.

3 is a specific block diagram of the digital signal processing unit 170 shown in FIG.

The digital signal processing unit 170 generates composition guide information based on the reference composition information and the input image, and displays the generated composition guide information on the second display unit 168. Here, the reference composition information means information about the angle or size of the subject's face in a previously acquired image, for example, a sample photograph. In addition, the reference composition information may be composition information using the position of the center point of the object as the reference point of the composition through the input image, that is, the preview image, or may include not only the person in the preview image but also a general composition, And may be composition information that utilizes information based on the information. Further, information directly specifying a point at which the face of the subject is located by the user or the photographer can be used as the reference composition information.

3, the digital signal processing unit 170 includes a control unit 171, a photo recognition unit 172, an image synthesis unit 173, a composition determination unit 174, and a composition guide unit 175.

The controller 171 controls the overall operation of the digital signal processor 170.

The photo recognition unit 172 extracts the composition information of the sample photograph. Here, the sample photograph means a photograph selected by the user as the best composition, which means a previously taken photograph or a stored photograph. The photograph recognizing unit 172 extracts the person information from the sample photograph, reduces the size of the photograph, or processes it as a front photograph.

The photograph recognizing unit 172 recognizes the photograph and stores it in a memory when photographing. After taking the picture, the corner can be found in the captured image through Conner Detection, and the picture can be recognized through the convex hull. Corner detection and convex hulling are well known techniques and will not be described in detail. In addition, a perspective algorithm can be applied to photographs obliquely photographed due to tilting of the camera or distortion of the lens when the photograph is taken, so that the photograph viewed from the front can be stored. In addition, since the stored image is only required to be viewed by the front display unit 168, it is stored in the minimum size, for example, 1M, irrespective of the resolution of the photographed image. Because of this size reduction, it is possible to reduce the speed limit for performing other processing algorithms and photo retrieval algorithms.

The image synthesis unit 173 synthesizes the sample image and the input image. In the sample photograph, composition information, for example, only the outline image of the subject of the photograph is left, and the remaining parts are deactivated and overlapped with the input image.

The control unit 171 generates composition guide information based on the composition information and the input image. The control unit 171 generates composition guide information as to whether or not the outline, which is the composition information of the sample photograph, matches the subject in the input image. Here, the composition guide information may include information indicating whether the subject matches with the outline and the input image, or whether the match is represented by color information, or information that the subject must move in order to match the subject of the input image with the composition information of the sample photograph Lt; / RTI > Here, as shown in FIGS. 5A and 5B, the controller 171 can determine the position of the person in the input image and set the reference point of the composition based on the face position information from the face detection. In addition, information may be utilized based on not only the person in the photographed photograph but also a general composition, for example, a golden division point of a golden division.

The composition guide unit 175 displays the composition guide information generated by the control unit 171 on the second display unit 168.

The control unit 171 generates composition guide information based on the composition image of the sample photograph and the input image according to whether it is a long distance photographing or a short distance photographing. That is, in the case of long-distance photographing, information indicating that the subject should be moved as composition guide information is informed to the user as an arrow, or in the case of close-up photographing, the outline is expressed as color information so as to match the input image to the outline of the sample photograph. If they are not in green, they can be displayed in yellow to inform the user.

If the composition guide information displayed on the second display unit 168 matches the subject information of the input image, the control unit 171 controls the automatic shooting.

4 is a flowchart illustrating a method of controlling a digital photographing apparatus according to another embodiment of the present invention.

Referring to FIG. 4, in step 400, a composition guide mode is set. In step 402, the second display unit is turned on. Here, the second display unit is a display unit located on the front surface of the digital photographing apparatus and performs a function for displaying composition guide information.

A preview image is displayed on the second display unit 168, and in step 406, a sample guide sample guide is selected. In step 408, the outline of the selected photograph is extracted. In step 410, only the outline is extracted from the selected sample photograph, the remaining part is deactivated, and is synthesized with the input image. In step 412, it is determined whether it is near or far away. In the case of close-up photographing, photographing is performed in steps 416 and 418 and recorded. In the case of the long-distance photographing, the composition guide is made in step 414, and the photographing and recording are performed in steps 416 and 418. That is, in the case of close-up photographing, only the matching of the subject of the input image according to the outline is indicated, or the user is notified of the matching with the color information, and the photograph is automatically photographed when they match.

However, in the case of the long-distance photographing, as the composition guide information, an arrow or the like is displayed on the second display portion, and when the user, that is, the subject moves, the automatic photographing is performed. The composition guide information and arrows corresponding thereto are shown in Fig.

7A to 7E are flowcharts for explaining a control method of a digital photographing apparatus according to another embodiment of the present invention.

Figures 7a-7c illustrate extracting composition information from a sample photograph. In FIG. 7A, a sample photograph is displayed on the first display section 164, FIG. 7B shows the composition information of the sample limb, and FIG. 7C is an example of extracting new composition information of the sample photograph.

In FIG. 7D, a plurality of sample photographs are displayed on the first display portion 164, and a user's selected sample photograph is shown on the second display portion 168 of FIG. 7E.

In Fig. 7F, the outlines of the sample photographs are shown in bold lines, and the input images are displayed together. Here, the input image and the outline of the sample photograph as the composition guide information are shown together. If not, the outline can be displayed in yellow. In Fig. 7G, when the user coincides with the outline while moving his / her position while viewing the outline, the outline turns green and is automatically photographed. The photographing is completed in Fig. 7H.

In the embodiment of FIG. 7, the color information of the outline is used as the composition guide information, but in the case of the long distance shooting, the composition guide information can be displayed as an arrow, as shown in FIG. In the embodiment described with reference to FIG. 7, the pre-photographed photograph is inactivated through the front display unit and overlapped with the preview image. If the photographed person is a close-up photographed photograph, the person's position If the subject of the picture to be photographed is remote shooting, for example, on a tripod, it is difficult to compose it by looking at the front display part, so that the guide information coming out through the front display part can be used to compose .

Although the embodiments described above have been described with reference to digital photographing apparatus to which the present invention can be applied, the present invention is not limited thereto. Those skilled in the art will appreciate that the present invention is also applicable to a camera phone, a personal digital assistant (PDA), and a portable multimedia player (PMP) with a camera function.

An apparatus according to the present invention may include a processor, a memory for storing and executing program data, a permanent storage such as a disk drive, a communication port for communicating with an external device, a user such as a touch panel, a key, Interface devices, and the like. Methods implemented with software modules or algorithms may be stored on a computer readable recording medium as computer readable codes or program instructions executable on the processor. Here, the computer-readable recording medium may be a magnetic storage medium such as a read-only memory (ROM), a random-access memory (RAM), a floppy disk, a hard disk, ), And a DVD (Digital Versatile Disc). The computer-readable recording medium may be distributed over networked computer systems so that computer readable code can be stored and executed in a distributed manner. The medium is readable by a computer, stored in a memory, and executable on a processor.

All documents, including publications, patent applications, patents, etc., cited in the present invention may be incorporated into the present invention in the same manner as each cited document is shown individually and specifically in conjunction with one another, .

In order to facilitate understanding of the present invention, reference will be made to the preferred embodiments shown in the drawings, and specific terminology is used to describe the embodiments of the present invention. However, the present invention is not limited to the specific terminology, Lt; / RTI > may include all elements commonly conceivable by those skilled in the art.

The present invention may be represented by functional block configurations and various processing steps. These functional blocks may be implemented in a wide variety of hardware and / or software configurations that perform particular functions. For example, the present invention may include integrated circuit configurations, such as memory, processing, logic, look-up tables, etc., that may perform various functions by control of one or more microprocessors or other control devices Can be adopted. Similar to the components of the present invention that may be implemented with software programming or software components, the present invention may be implemented as a combination of C, C ++, and C ++, including various algorithms implemented with data structures, processes, routines, , Java (Java), assembler, and the like. Functional aspects may be implemented with algorithms running on one or more processors. Further, the present invention can employ conventional techniques for electronic environment setting, signal processing, and / or data processing. Terms such as "mechanism", "element", "means", "configuration" may be used broadly and are not limited to mechanical and physical configurations. The term may include the meaning of a series of routines of software in conjunction with a processor or the like.

The specific acts described in the present invention are, by way of example, not intended to limit the scope of the invention in any way. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of such systems may be omitted. Also, the connecting or connecting elements of the lines between the components shown in the figures are illustrative of functional connections and / or physical or circuit connections, which may be replaced or additionally provided by a variety of functional connections, physical In connection, or circuit connections. Also, unless stated otherwise such as " essential ", " importantly ", etc., it may not be a necessary component for application of the present invention.

The use of the terms " above " and similar indication words in the specification of the present invention (particularly in the claims) may refer to both singular and plural. In addition, in the present invention, when a range is described, it includes the invention to which the individual values belonging to the above range are applied (unless there is contradiction thereto), and each individual value constituting the above range is described in the detailed description of the invention The same. Finally, the steps may be performed in any suitable order, unless explicitly stated or contrary to the description of the steps constituting the method according to the invention. The present invention is not necessarily limited to the order of description of the above steps. The use of all examples or exemplary language (e.g., etc.) in this invention is for the purpose of describing the present invention only in detail and is not to be limited by the scope of the claims, It is not. It will also be appreciated by those skilled in the art that various modifications, combinations, and alterations may be made depending on design criteria and factors within the scope of the appended claims or equivalents thereof.

FIGS. 1A and 1B are views showing the front and rear views of the digital photographing apparatus 100 according to an embodiment of the present invention.

2 is a schematic block diagram of the digital photographing apparatus 100 shown in FIG.

3 is a specific block diagram of the digital signal processing unit 170 shown in FIG.

4 is a flowchart illustrating a method of controlling a digital photographing apparatus according to another embodiment of the present invention.

5A and 5B are exemplary diagrams for explaining the function of judging composition of an input image.

Fig. 6 is an exemplary view for explaining the function of the composition guide section 174 shown in Fig.

7A to 7H are flowcharts for explaining a control method of a digital photographing apparatus according to another embodiment of the present invention.

Description of the Related Art

100: digital photographing apparatus 164: first display section

168: second display section 170: digital signal processing section

171: Control section 172:

173: image synthesizing unit 174: composition guide unit

Claims (19)

In the digital photographing apparatus having the first display section and the second display section, Wherein the first display unit is provided on a rear surface of the digital photographing apparatus and the second display unit is provided on a front surface of the digital photographing apparatus, And a digital signal processing unit for generating composition guide information based on the reference composition information and the input image and displaying the generated composition guide information on the second display unit, Wherein the digital signal processor comprises: A picture recognition unit for extracting composition information of the sample photograph as the reference composition information; An image synthesizer for synthesizing the sample image and the input image; A control unit for generating composition guide information based on the composition image of the sample photograph and the input image; And And a composition guide unit for displaying the generated composition guide information on the second display unit, When the composition guide mode is selected, the second display unit is turned on, It is judged whether it is a long distance shooting or a short distance shooting, In the case of the long-distance photographing, information indicating that the subject should be moved as the composition guide information is displayed as an arrow, And displays the outline as color information so as to match the input image to the outline of the sample photograph when the close-up photographing is performed. delete The method according to claim 1, Wherein the image synthesizer comprises: And activates the contour of the subject of the sample photograph to synthesize the contour with the input image. The method of claim 3, Wherein, And generates whether or not the contour and the subject match with the input image as composition guide information. delete The method according to claim 1, Wherein the reference composition information comprises: And is composition information extracted from the input image, The composition guide information includes: Wherein the information is information that the subject must move in order to match the subject of the input image with the reference composition information. delete The method according to claim 1, The image recognition unit may include: Characterized in that the person information is extracted from the sample photograph, the size of the photograph is reduced, or the front photograph is processed. The method according to claim 1, Wherein the digital signal processor comprises: And the automatic photographing is performed when the composition guide information displayed on the second display unit matches the subject information of the input image. A control method of a digital photographing apparatus having a first display section and a second display section, Generating reference composition information; Generating composition guide information based on the generated reference composition information and the input image; And And displaying the generated composition guide information on the second display unit, The reference composition generation step may include: Further comprising extracting composition information of a predetermined sample photograph, In the composition guide information generation step, Synthesizing the sample photograph and the input image, generating composition guide information based on the composition information of the sample photograph and the input image, When the composition guide mode is selected, the second display unit is turned on, It is judged whether it is a long distance shooting or a short distance shooting, In the case of the long-distance photographing, information indicating that the subject should be moved as the composition guide information is displayed as an arrow, Wherein when the close-up photographing is performed, an outline is displayed as color information so that an input image matches an outline of the sample photograph. delete 11. The method of claim 10, Further comprising the step of automatically photographing the subject when the subject of the input image matches the composition guide information displayed on the second display unit. 11. The method of claim 10, The synthesizing step includes: Wherein the contour of the subject of the sample photograph is activated and synthesized with the input image. 14. The method of claim 13, Wherein the generating comprises: Wherein the generated guide information is generated as composition guide information on whether or not the active contour and the subject match in the input image. delete 11. The method of claim 10, Wherein the reference composition information comprises: And is composition information extracted from the input image, The composition guide information includes: Wherein the information is information that the subject must move in order to match the subject of the input image with the reference composition information. delete 12. The method of claim 11, Wherein the extracting step comprises: Extracting the person information from the sample photograph, reducing the size of the photograph, or processing the front photograph into a front photograph. A recording medium on which a program for causing a computer to execute the method according to any one of claims 10, 12, 14, 16, 19, and 18 is recorded.

Images