JP2005073161A - Processing apparatus and image recording method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To concurrently pick up images of an object and a photographer. <P>SOLUTION: The processing apparatus comprises a first image pickup unit (main camera) C1 and a second image pickup unit (sub camera) C2. The first image pickup unit C1 and the second image pickup unit C2 are disposed to be turned in mutually different directions and are configured to concurrently perform image pickup. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a processing apparatus and an image recording method, and more particularly to a processing apparatus having a function of capturing an optical image as electrical image information and an image recording method of capturing an optical image as electrical image information and recording it on a recording medium.

  An electronic camera such as a digital still camera or a digital movie camera that records a moving image or a still image as a digital signal, an imaging unit that captures a subject image (optical image), an image processing unit that processes a captured image signal, It can be composed of a monitor unit for displaying images, a recording / reproducing unit for recording and reproducing captured images, and the like. The imaging unit converts, for example, an image formed on an imaging surface of an imaging element such as a CCD sensor or a CMOS sensor by an optical system (such as a lens) into an electrical image signal and outputs the electrical image signal. The image processing unit converts, for example, an image signal provided from the imaging unit into a digital image signal, and further converts the image signal into a predetermined format after various image processing such as shading correction, color correction, contour enhancement, pixel interpolation, and the like. Provide to etc. The monitor unit displays, for example, a captured image signal or an image signal recorded on a recording medium as a visible image. The recording / reproducing unit converts, for example, a captured image signal into a recording format such as a DV format and records it on a recording medium such as a tape or a memory card, or reads out an image signal recorded on the recording medium.

  Conventional electronic cameras generally include only one image sensor. When using such an electronic camera, a photographer typically shoots a subject while checking the subject on a monitor or a viewfinder. Specifically, the photographer records the subject image on the recording medium while performing the zoom operation and the panning operation while capturing the subject in the field of view with a desired size.

  Electronic cameras are often used to record travel destinations, buildings, people, etc., children's growth processes, school events, and the like. In particular, in such a usage pattern, it is considered that there is a demand for recording a photographer's image together with a subject image during photographing. In response to such a request, in general, the electronic camera is fixed on a tripod or the like, or the photographer holds it by hand, and the subject (the subject that the photographer intends to shoot) and the photographer (operation for photographing) The person who performs the shooting will be in the field of view of the electronic camera. If the electronic camera is fixed with a tripod, it may be convenient to use a remote control.

As a prior art related to an electronic camera including two imaging elements, there is an electronic camera (imaging apparatus) having an imaging optical system and an imaging element on two parallel optical axes (see Patent Document 1).
Japanese Patent Laid-Open No. 05-110939

  In an electronic camera having only one image sensor or an electronic camera having an imaging unit arranged on two parallel optical axes, the electronic camera is pointed at the subject according to the movement of the subject and the photographer is in the field of view of the electronic camera. You must move. When the electronic camera is fixed with a tripod, it is necessary to change the direction and angle of view of the electronic camera while reciprocating between the field of view of the electronic camera and the electronic camera each time the subject moves. In addition, it can be said that it is very difficult for the photographer to hold the electronic camera with his hand and take a picture while putting the subject and the photographer within the field of view of the electronic camera.

  In other words, the conventional electronic camera is unsuitable for use in which the subject and the photographer are photographed at the same time in a situation where the field of view of the electronic camera needs to be constantly changed, such as when the subject moves around. Therefore, in general, the photographer's confidence will be given up, and only the voice of the photographer himself / herself will be recorded at the same time as the subject image.

  In addition, in the imaging apparatus described in Patent Document 1, although two imaging elements are used, they are arranged on optical axes parallel to each other, so that they are generally positioned in different directions as viewed from the imaging apparatus. It is not suitable for capturing a subject to be photographed and a photographer at the same time.

  The present invention has been made on the basis of the above problem recognition, and is capable of simultaneously imaging objects that may exist in different directions, for example, enabling simultaneous imaging of a subject and a photographer. Objective.

  A first aspect of the present invention relates to a processing apparatus having a function of capturing an optical image as electrical image information, and the processing apparatus includes a first imaging unit, a second imaging unit, and the first imaging unit. An imaging unit and a controller for controlling the second imaging unit, wherein the first imaging unit and the second imaging unit are arranged so that they can be directed in different directions, and the controller The first imaging unit and the second imaging unit can be configured to simultaneously perform imaging.

  According to a preferred embodiment of the present invention, the processing device combines an image captured by the first imaging unit and an image captured by the second imaging unit, and the image It is preferable to further include a recording unit that records the image combined by the combining unit on a recording medium.

  According to a preferred embodiment of the present invention, the processing apparatus further includes a recording unit that records images simultaneously captured by the first imaging unit and the second imaging unit on a single recording medium. Is preferred.

  According to a preferred embodiment of the present invention, it is preferable that the processing device further includes an image display unit and a panel in which the image display unit and the second imaging unit are incorporated.

  According to a preferred embodiment of the present invention, it is preferable that the processing apparatus further includes a frame that supports the panel, and the panel is supported by the frame so that the direction can be changed.

  According to a preferred embodiment of the present invention, the panel is supported by the frame so as to be openable and closable, and the processing device further includes a sensor that detects opening and closing of the panel, and the second imaging unit includes: The ON / OFF switching is preferably permitted when the sensor detects that the panel has been opened. According to a preferred embodiment of the present invention, it is preferable that ON / OFF switching of the second imaging unit can be performed not only during non-shooting but also during shooting.

  According to a preferred embodiment of the present invention, it is preferable that the processing apparatus further includes a switching unit that switches an image composition method by the image composition unit. According to a preferred embodiment of the present invention, the switching unit combines an image captured by the first imaging unit or an image captured by the second imaging unit with a parent image as a parent image. Is preferably configured to be switchable.

  According to a preferred embodiment of the present invention, it is preferable that the processing device further includes a unit for switching on / off an image composition function by the image composition unit.

  According to a preferred embodiment of the present invention, the processing device includes a first image display unit, a second image display unit, the first image display unit, and the second image display unit. It is preferable to further include a controller that controls which of the image captured by the first imaging unit, the image captured by the second imaging unit, and the image generated by the image composition unit is displayed.

  According to a preferred embodiment of the present invention, the first image display unit and the second image display unit are configured so that the photographer can move the first image display unit toward the object to be imaged. The image displayed on the image display unit and the image displayed on the second image display unit can be observed, and the second image capturing unit is arranged to face the photographer in the state. Preferably it is.

  According to a preferred embodiment of the present invention, the processing device further includes an image display unit that displays a captured image, and the image display unit is configured such that the first imaging unit is directed to a photographing object. It is configured so that the photographer can observe the image displayed on the image display unit in a state, and the second imaging unit is arranged to face the photographer in the state. preferable.

  According to a preferred embodiment of the present invention, it is preferable that at least one of the first imaging unit and the second imaging unit is configured to be changeable in direction.

  The processing apparatus of the present invention can be configured as, for example, an electronic camera or a movie camera.

  The second aspect of the present invention relates to an image recording method for capturing an optical image as electrical image information and recording it on a recording medium. The image recording method is provided in one apparatus and is directed in different directions. An image capturing step of simultaneously capturing images by the first image capturing unit and the second image capturing unit, and an image including two images captured simultaneously by the first image capturing unit and the second image capturing unit are recorded on one recording medium. And a recording process.

  According to a preferred embodiment of the present invention, the image recording method further includes a combining step of combining the two images captured by the first imaging unit and the second imaging unit to generate a combined image. In the recording step, the composite image is preferably recorded on the one recording medium.

  According to a preferred embodiment of the present invention, the image recording method includes: a detection step of detecting opening / closing of an openable / closable panel incorporating the image display unit and the second imaging unit; It is preferable to further include a permission step of permitting the second image pickup unit to be turned on / off when it is detected that the second image pickup unit is opened.

  According to a preferred embodiment of the present invention, it is preferable that the image recording method further includes a step of switching ON / OFF of the second imaging unit not only during non-shooting but also during shooting.

  According to a preferred embodiment of the present invention, it is preferable that the method further includes a switching step of switching an image synthesis method in the synthesis step.

  According to a preferred embodiment of the present invention, in the switching step, which of the image captured by the first imaging unit and the image captured by the second imaging unit is used as a parent image is combined. It is preferable to include the process of switching.

  According to a preferred embodiment of the present invention, it is preferable that the image recording method further includes a step of switching whether to execute the synthesis step.

  According to a preferred embodiment of the present invention, the image recording method includes an image captured by the first imaging unit on a first image display unit and a second image display unit provided in the apparatus, The method further includes a step of controlling which of the image picked up by the second image pickup unit and the image generated in the combining step is displayed.

  According to the present invention, it is possible to simultaneously image objects that may exist in different directions, for example, to simultaneously image a subject and a photographer.

  In the following, an embodiment which is considered to be the best for carrying out the present invention will be described. The processing apparatus and the image recording method of the present invention are applied to, for example, an electronic camera such as a digital still camera or a digital movie camera, an image processing apparatus including such an electronic camera, an information processing apparatus (for example, a personal computer, a portable terminal), or the like. Can be applied. Below, the example which applied the processing apparatus and image recording method of this invention to the electronic camera as a suitable application example of this invention is demonstrated.

(First embodiment)
FIG. 1 is a diagram schematically showing a configuration of an electronic camera according to a preferred embodiment of the present invention. The electronic camera 100 can be embodied as, for example, an electronic camera (for example, a digital movie camera or a digital video camera having a still image recording function) capable of recording moving images and still images.

  The electronic camera 100 includes a plurality of imaging units that can be directed in different directions. In the example shown in FIG. 1, the electronic camera 100 includes two imaging units. Each of these imaging units is configured to convert an optical image into an electrical image signal. An imaging element such as a CCD sensor or a CMOS sensor, or a subject (photographing object) on the imaging surface of the imaging element. In addition to the optical system for forming the optical image, an automatic exposure function, an automatic focus function, and the like may be included as necessary. Hereinafter, the first imaging unit of the two imaging units is referred to as a main camera C1, and the second imaging unit is referred to as a sub camera C2. Typically, the main camera C1 can be used to photograph a subject that the photographer intends to photograph (generally, a subject other than the photographer himself). On the other hand, the sub camera C2 can typically be used to photograph the photographer himself.

  Therefore, the main camera C1 is preferably designed so that its optical axis can be easily directed parallel to a virtual line connecting the photographer and the subject (subject other than the photographer), or can be easily directed to the subject. On the other hand, the sub camera C2 is preferably designed so that its optical axis can be easily directed parallel to a virtual line connecting the sub camera C2 and the photographer, or the optical axis can be easily directed to the photographer. . According to the best embodiment, the sub-camera C2 is a component generally directed to the photographer, preferably an image display unit (typically an LCD panel described below) or a component integral with it (open / close panel). ).

  In addition to the main camera C1 and the sub camera C2, the electronic camera 100 receives image signals (or video signals) from the system controller B2, the main camera C1, and the sub camera C2 that control each block in the electronic camera 100. The image processing circuit B1 that individually processes or synthesizes these image signals, the image signal (or image data) provided from the image processing circuit B1 is converted into a predetermined format such as DV data, and the DV tape. The tape controller B3 for recording on the tape (tape type recording medium) M1 such as the above and reading the image signal from the tape M1, and the image signal (or image data) provided from the image processing circuit B1 are stored in a memory card (for example, Recorded on a memory card (semiconductor type recording medium) M2 such as an SD card or an MMC card) And a card controller B4, etc. and read an image signal from the memory card M2. Here, the system controller B2 controls the main camera C1 and the sub camera C2 to perform imaging simultaneously, and selectively causes the main camera C1 and the sub camera C2 to perform imaging. So that they can be controlled.

  The electronic camera 100 displays an image (video) currently captured by the main camera C1 and / or the sub camera C2, reproduces and displays an image recorded on the tape M1 and the memory card M2, and a shooting mode. As an image display unit for displaying an image (video) currently captured by the LCD panel V1, the main camera C1, and / or the sub camera C2 as an image display unit for displaying information for setting such as Electronic viewfinder (EVF) V2, switch unit (operation unit) SW including a plurality of switches SW1 to SW4 for setting and confirming a shooting mode, character data indicating information to be provided to the photographer, etc. Is provided with a synthesis data generation circuit (CG) B5.

  A user interface for setting and confirming a shooting mode and the like can be configured by the switch unit SW and the LCD panel V1, and other operation members and displays as necessary. For example, a menu screen including a plurality of selection items is displayed on the LCD panel V1 by pressing the switch SW1, the item selected on the menu screen is switched by pressing the SW2 and SW3, and the item selection is confirmed by pressing the SW4. Can be made.

  FIG. 2 is a diagram conceptually illustrating a display method of images captured by the main camera C1 and the sub camera C2 in the electronic camera 100. FIG. The electronic camera 100 combines an image captured simultaneously by the main camera C1 and the sub camera C2 with a PinP (picture in picture) image according to a mode set by the operator operating the switch unit SW, and is an LCD panel. V1 and the electronic viewfinder V2 are displayed, or the image of the main camera C1 is displayed on the LCD panel V1 and the electronic viewfinder V2 without performing such image composition, and the image of the sub camera C2 is displayed on the LCD panel V1. It can be displayed on the electronic viewfinder V2.

  In FIG. 2, an image D1 is a PinP image that can be displayed on the LCD panel V1 or the electronic viewfinder V2, and the image D1S of the sub camera C2 in the image D1M of the main camera C1 is subjected to PinP processing (picture-in-picture processing). It is an example of an embedded image. "Simultaneous recording (main)" in the image D1 is performed by the main camera C1 and the sub camera C2 simultaneously, and the image D1M of the main camera C1 is used as a parent image, and the image D1S of the sub camera C2 is included in the child image. As shown, a mode (simultaneous recording (main) mode) for recording an image on a recording medium (for example, the tape M1 and the memory card M2) while fitting and combining is shown. Such a mode can be set by operating the switch unit SW.

  In FIG. 2, an image D2 is a PinP image that can be displayed on the LCD panel V1 or the electronic viewfinder V2, and the image D2M of the main camera C1 is inserted into the image D2S of the sub camera C2 by PinP processing (picture in picture processing). This is an example of an image. "Simultaneous recording (sub)" in the image D2 is performed by the main camera C1 and the sub camera C2 simultaneously, the image D2S of the sub camera C2 is used as a parent image, and the image D2M of the main camera C1 is included in the child image. As shown, a mode (simultaneous recording (sub) mode) in which an image is recorded on a recording medium (for example, tape M1, memory card M2) while being embedded and combined is shown. Such a mode can be set by operating the switch unit SW.

  FIG. 5 is a block diagram schematically showing a configuration example of the image processing circuit B1. In the main camera C1, a subject image (typically, an image of a subject to be photographed by a photographer) is formed on an imaging surface of an imaging element (for example, a CCD sensor or a CMOS sensor) 21S by a lens (optical unit) 21L. Then, it is converted into an electrical image signal by the imaging device 21S, subjected to predetermined image processing in the processing circuit 21P, and sequentially stored in the main camera image memory 31 as image data. Here, the image data stored in the image memory 31 is overwritten with new image data in a predetermined cycle. Here, the image sensor 21S, the processing circuit 21P, and the image memory 31 are controlled by the system controller B2.

  In the sub camera C2, a subject image (typically a photographer's image) is imaged on an imaging surface of an image sensor (for example, a CCD sensor or a CMOS sensor) 22S by a lens (optical unit) 22L, and is imaged by the image sensor 22S. It is converted into an electrical image signal, subjected to predetermined image processing in the processing circuit 22P, and sequentially stored in the sub camera image memory 32 as image data. Here, the image data stored in the image memory 32 is overwritten with new image data in a predetermined cycle. Here, the image sensor 22S, the processing circuit 22P, and the image memory 32 are controlled by the system controller B2.

  As described above, the processing circuit 21P and the image memory 31 are provided for the main camera C1, and the processing circuit 22P and the image memory 32 are provided for the sub camera C2. The system controller B2 controls these simultaneously, thereby the main camera C1 and Imaging can be performed simultaneously by the sub camera C2.

  The image data stored in the image memories 31 and 32 can be provided to the tape controller B3 and the card controller B4 as main camera image data and sub camera image data, respectively, and can be recorded on the tape M1 and the memory card M2.

  When the image composition mode is selected, the main image data and the sub image data are resized by the resizing processing circuits 41 and 42 as necessary, and then the image composition circuit 50 performs PinP composition on the image composition memory 60. Recorded. As a result, PinP synthesized image data is generated on the image synthesis memory 60. The synthesized image data is provided to the tape controller B3 and / or the card controller B4, and can be recorded on the tape M1 and / or the memory card M2.

  FIG. 6 is a flowchart showing a flow of processing relating to image display and recording in the electronic camera 100, and this processing is controlled by the system controller B2.

  In step S601, the system controller B2 determines whether an image to be a parent image of the PinP image is an image captured by the main camera C1 or an image captured by the sub camera C2. This means that it is determined whether the mode set by the operation of the switch unit SW is the simultaneous recording (main) mode or the simultaneous recording (sub) mode. Here, the simultaneous recording (main) mode is a mode in which images simultaneously captured by the main camera C1 and the sub camera C2 are combined and recorded on one recording medium (or each of a plurality of recording media). In this mode, an image captured by the main camera C1 is used as a parent image. On the other hand, the simultaneous recording (sub) mode is a mode in which images simultaneously captured by the main camera C1 and the sub camera C2 are combined and recorded on one recording medium (or each of a plurality of recording media), and In this mode, an image captured by the sub camera C2 is used as a parent image. Further, the parent image is a main image or an image larger than a child image among images constituting the whole of one screen. Typically, the child image can be arranged inside a rectangular area defined by the outer peripheral edge of the parent image.

  As a result of the determination in step S601, when the image captured by the main camera C1 is used as a parent image, the system controller B2 advances the process to step S602 and sets the image captured by the sub camera C2 as a parent image. In step S603, the system controller B2 advances the process.

  In step S602, under the control of the system controller B2, the image data of the main camera C1 stored in the main camera image memory 31 is image synthesized by the image synthesis circuit 50 in the synthesis processing block 70 of the image image processing circuit B1. The image data of the sub camera C2 stored in the sub camera image memory 32 is resized by the resizing processing circuit 42 (resized to reduce the number of pixels to obtain child image data). Later, the image composition circuit 50 transfers to an address corresponding to the PinP position in the image composition memory 60. Thereby, image data of a composite image (PinP image) in which an image captured by the main camera C1 is a parent image and an image captured by the sub camera C2 is a child image is generated. When this composite image is displayed on the LCD panel V1 and / or the electronic viewfinder V2, as shown in FIG. 7A, “simultaneous recording (main It is preferable to further synthesize ")" or equivalent information. Such information is generated by the synthesis data generation circuit (CG) B5. Whether or not to synthesize such information may be made selectable by the photographer operating the switch unit SW. The display of images by the LCD panel V1 and the electronic viewfinder V2 can typically be selectively performed for reducing power consumption, but may be performed by both.

  In step S603, under the control of the system controller B2, the image data of the sub camera C2 stored in the sub camera image memory 32 is resized by the resize processing circuit 42 in the image processing or color image synthesis processing block 70 of color B1. The image of the main camera C1 stored in the main camera image memory 31 is transferred to the image composition memory 60 by the image composition circuit 50 after being resized to increase the number of pixels in order to obtain parent image data. After the data is resized (resized to reduce the number of pixels to obtain child image data), it is transferred to an address corresponding to the PinP position in the image composition memory 60. Thereby, image data of a composite image (PinP image) in which an image captured by the sub camera C2 is a parent image and an image captured by the main camera C1 is a child image is generated. When this composite image is displayed on the LCD panel V1 and / or the electronic viewfinder V2, as shown in FIG. 7B, “simultaneous recording (sub- It is preferable to further synthesize ")" or equivalent information. Such information is generated by the synthesis data generation circuit (CG) B5. Whether or not to synthesize such information may be made selectable by the photographer operating the switch unit SW. The display of images by the LCD panel V1 and the electronic viewfinder V2 can typically be selectively performed for reducing power consumption, but may be performed by both.

  In step S604, under the control of the system controller B2, the synthesized image data synthesized in step S602 or step S603 is recorded on a recording medium (for example, tape M1, memory card M2) by the tape controller B3 and / or the card controller B4. Is done. Here, it is preferable that the image data to be recorded on the recording medium does not include information indicating the mode as described above. However, whether or not to add such information is determined by the photographer operating the switch unit SW. May be selectable.

(Second Embodiment)
Hereinafter, as the second embodiment of the present invention, parts different from the first embodiment will be described. Note that matters not specifically mentioned here are the same as those in the first embodiment. Specifically, FIG. 1, FIG. 2, FIG. 5 and the explanation related thereto are common to the first embodiment and the second embodiment.

  FIG. 3 is a diagram for explaining a design example and functions of an overview of the electronic camera 100 according to a preferred embodiment of the present invention. In the simultaneous recording (main) mode, similar to the description in the first embodiment, the main camera C1 and the sub camera C2 simultaneously perform imaging, and the image of the subject M captured by the main camera C1 is set as a parent image D1M. A composite image D1 is generated as a child image D1S using the image of the photographer S captured by the sub camera C2, and recorded on a recording medium. In the simultaneous recording (sub) mode, similarly to the description in the first embodiment, the main camera C1 and the sub camera C2 perform image capturing simultaneously, and the image of the subject (photographer) S captured by the sub camera C2 is the parent image. The composite image D2 is generated as an image D2S, and the image of the subject M captured by the main camera C1 is used as the child image D2M, and is recorded on the recording medium.

  The sub camera C2 is arranged on the open / close panel P in which the LCD panel V1 is incorporated so that the optical axis thereof is parallel to the normal direction of the display surface of the LCD panel V1. When a photographer takes a picture while viewing a captured image displayed on the LCD panel V1, normally, the LCD panel V1 can be adjusted in direction so that the normal direction of the display surface faces the photographer's eyes. Therefore, according to such a normal photographing style, the photographer can be photographed by the sub camera C2.

  The open / close panel P is supported by the frame (or casing) F of the electronic camera 100 via a coupling mechanism such as a hinge H so that the direction can be changed. Therefore, the sub camera C2 is configured to change the direction together with the LCD panel V1. The electronic camera 100 has an open / close detection sensor (for example, a switch) PSW that detects opening / closing of the open / close panel P of the open / close panel P in which the LCD panel V1 is incorporated, and the system controller B2 is based on the output of the open / close detection sensor PSW. Thus, opening / closing of the open / close panel P can be detected. In a state where the open / close panel P is opened and the photographer can see the LCD panel V1, the image being captured can be displayed on the LCD panel V1. Therefore, typically, in a state in which the open / close panel P is opened, the photographer takes a picture while viewing an image displayed on the LCD panel V1. In this state, the sub camera C2 typically captures the photographer within the field of view.

  In this embodiment, when the system controller B2 detects that the open / close panel P is opened based on the output of the open / close detection sensor PSW, the photographer can turn on the sub camera C2. On the other hand, when the system controller B2 detects that the open / close panel P is closed based on the output of the open / close detection sensor PSW, the system controller B2 prohibits the sub camera C2 from being turned on (the sub camera C2 is in the on state). If it is, it is forcibly turned off).

  Therefore, according to this embodiment, the photographer operates the switch unit SW to open / close the sub camera C2 by opening / closing the open / close panel P or turning on / off the LCD panel V1. It becomes a state that can be switched.

  When the sub camera C2 is turned on, the photographer can photograph the photographer himself / herself with the sub camera C2 while photographing the subject (typically, a subject other than the photographer) with the main camera C1. When the simultaneous recording (main) mode or the simultaneous recording (sub) mode is selected, the images photographed by the main camera C1 and the sub camera C2 are combined to form one image as one image (for example, , Tape M1, memory card M2) or each of a plurality of recording media.

  FIG. 4 is a diagram exemplarily showing an LCD panel display example and a recorded image according to ON / OFF of the sub camera C2 of the electronic camera 100. When the sub camera C2 is OFF, only the main camera C1 functions and the display on the LCD panel V1 and the recorded image recorded on the recording medium are images taken by the main camera C1.

  On the other hand, when the sub camera C2 is ON, both the main camera C1 and the sub camera C2 function, and the image captured by the main camera C1 and the image captured by the sub camera C2 are combined on the LCD panel V1. The displayed image is displayed. Here, in the simultaneous recording (main) mode, a composite image having an image taken by the main camera C1 as a parent image is displayed on the LCD panel V1, and in the simultaneous recording (sub) mode, it is taken by the sub camera C2. A composite image having the obtained image as a parent image is displayed on the LCD panel V1. Further, when the simultaneous recording (main) mode or the simultaneous recording (sub) mode is selected (simultaneous recording ON), information indicating it is displayed on the LCD panel V1.

  When the simultaneous recording (main) mode or the simultaneous recording (sub) mode is selected (simultaneous recording ON), the recording medium (for example, the tape M1 and the memory card M2) has an image captured by the main camera C1. An image obtained by combining the image taken by the sub camera C2 is recorded.

  FIG. 8 is a flowchart showing a flow of processing relating to image display and recording in the electronic camera 100, and this processing is controlled by the system controller B2.

  In step S801, the system controller B2 detects the state (open / close) of the open / close panel P based on the output of the open / close detection sensor PSW of the open / close panel P. The system controller B2 advances the process to step S802 when the open / close panel P is opened, and advances the process to step S808 when the open / close panel P is closed.

  As described above, in this embodiment, it is permitted to switch ON / OFF of the sub camera C2 in a state where the open / close panel P is opened. ON / OFF of the sub camera C2 can be switched by, for example, the photographer operating the switch unit SW. In step S802, it is determined whether an instruction to turn on the sub camera C2 or an instruction to turn it off is given by an operation of the switch unit SW or a mode selection. The system controller B2 proceeds to step S803 when instructed to turn on the sub camera C2, and proceeds to step S808 when instructed to turn off the sub camera C2. Proceed.

  In step S804, the system controller B2 selects a method for combining the image captured by the main camera C1 and the image captured by the sub camera C2 according to the mode selected by operating the switch unit SW. . In step S805, the system controller B2 displays an image on the LCD panel V1 and the electronic viewfinder V2 according to the image composition method selected in step S804. A specific example in step S804 and step S805 will be described later with reference to FIGS.

  In step S806, the system controller B2 determines whether the simultaneous recording mode is selected by operating the switch unit SW, that is, whether the simultaneous recording (main) mode or the simultaneous recording (sub) mode is selected. To do. The system controller B2 advances the process to step S807 when the simultaneous recording mode is selected, and advances the process to step S810 when the simultaneous recording mode is selected. ON / OFF of the simultaneous recording mode can be switched not only during non-shooting (a state where no image is recorded on the recording medium) but also during shooting (a state where an image is recorded on the recording medium). The simultaneous recording (main) mode can be selected by turning on the image composition mode, setting the parent image as the image of the main camera C1, and turning on the simultaneous recording mode. On the other hand, the simultaneous recording (sub) mode can be selected by turning on the image composition mode, setting the parent image as the image of the sub camera C2, and turning on the simultaneous recording mode.

  In step S807, the image (display selected from display 1 to display 4 in FIG. 10) displayed on LCD panel V1 is recorded on a recording medium (for example, tape M1, memory card M2), and the process returns to step S801. However, it is preferable that whether or not information for allowing the photographer to recognize a mode such as “simultaneous recording (main)” is recorded on the recording medium together with the image can be switched according to the selection by the photographer. Typically, it will be preferred not to record such information on a recording medium.

  In step S809 executed when the open / close panel P is closed or when the open / close panel P is open but the sub camera C2 is set to OFF, the LCD panel V1 is controlled under the control of the system controller B2. (Only when the open / close panel P is opened) and / or an image taken by the main camera C1 is displayed on the electronic viewfinder V2.

  In step S810, an image captured by the main camera C1 is recorded on a recording medium (for example, tape M1, memory card M2) under the control of the system controller B2, and the process returns to step S801.

  The processing shown in steps S801 to S810 is repeated, for example, by recording a predetermined number of frames of image data on a recording medium. Each time the processing returns to step S801, the opening / closing panel P is used in step S801 and subsequent steps. The designation of the state and the mode is confirmed, and the mode and the like are switched during the recording of the moving image (during the execution of photographing) according to the confirmation result.

  FIG. 9 is a flowchart showing a specific example of processing in steps S804 and S805 of FIG. The photographer operates the switch unit SW to synthesize the image of the main camera C1 and the image of the sub camera C2, whether to use the parent image as the image of the main camera C1, or the image of the sub camera C2. Can be selected.

  In step S901, the system controller B2 determines whether the mode selected by the operation of the switch unit SW is the image composition mode (PinP mode). If the image composition mode is selected, step S902 is performed. If the image composition mode is not selected, the process proceeds to step S903.

  In step S902, the system controller B2 determines whether an image to be a parent image of the composite image (PinP image) is selected as an image of the main camera C1 or an image of the sub camera C2. Such selection or setting can be performed by operating the switch unit SW. If the image that should be the parent image of the composite image (PinP image) is selected as the image of the main camera C1, the system controller B2 advances the process to step S906 to set the parent image of the composite image (PinP image). If the image is selected as the image of the sub camera C2, the process proceeds to step S907.

  In step S903, the system controller B2 determines whether the image to be displayed on the LCD panel V1 (the image to be recorded on the recording medium) should be the image of the main camera C1 or the image of the sub camera C2. The determination is made according to the mode selected by the SW operation. When the image to be displayed on the LCD panel V1 (image to be recorded on the recording medium) is the image of the main camera C1, the system controller B2 advances the process to step S905 to display the image to be displayed on the LCD panel V1 (recording). If the image to be recorded on the medium is the image of the sub camera C2, the process proceeds to step S904.

  In step S904, the system controller B2 displays the “display 4” (image of the sub camera C2) shown in FIG. 10D on the LCD panel V1 and the “display” shown in FIG. 10C on the electronic viewfinder V2. The image processing circuit B1 is set to display 3 ″ (image of the main camera C1). At this time, information for specifying a camera (main camera C1 or sub-camera C2) that captures a display image such as “main camera”, “sub-camera”, or the like is displayed by the synthesis data generation circuit CG as an image to be displayed. It is preferably generated and added.

  In step S905, the system controller B2 displays the “display 3” (image of the main camera C1) shown in FIG. 10C on the LCD panel V1, and the “display” shown in FIG. 10D on the electronic viewfinder V2. The image processing circuit B1 is set so as to display 4 ″ (image of the sub camera C2). At this time, information for specifying the camera (main camera C1 or sub camera C2) that is capturing the display image such as “main camera”, “sub camera”, etc. is generated by the synthesis data generation circuit CG. It is preferable to add them.

  In step S906, the system controller B2 displays a composite image (PinP image) (“Display 1” in FIG. 10A) having the parent image as the image of the main camera C1 and the child image as the image of the sub camera C2 on the LCD panel. The image processing circuit B1 is set to display on V1 (and the electronic viewfinder V2 if necessary). At this time, it is preferable that information for specifying a mode such as “simultaneous recording (main)” is generated and added to the combined image to be displayed by the combining data generation circuit CG.

  In step S907, the system controller B2 displays a composite image (PinP image) (“Display 2” in FIG. 10B) having the parent image as the image of the sub camera C2 and the child image as the image of the main camera C1 on the LCD panel. The image processing circuit B1 is set to display on V1 (and the electronic viewfinder V2 if necessary). At this time, it is preferable that information for specifying a mode such as “simultaneous recording (sub)” is generated and added to the combined image to be displayed by the combining data generation circuit CG.

It is a figure which shows schematically the structure of the electronic camera of suitable embodiment of this invention. It is a figure which shows notionally the display method of the image each imaged with the main camera (C1) and the subcamera (C2) in the electronic camera of suitable embodiment of this invention. It is a figure for demonstrating the design example and function of the external appearance of the electronic camera of suitable embodiment of this invention. It is a figure which shows the example of an LCD panel display according to ON / OFF of the sub camera (C2) of an electronic camera, and a recorded image. It is a block diagram which shows roughly the structural example of an image processing circuit (B1). It is a flowchart which shows the flow of the process regarding the display and recording of an image in an electronic camera. It is a figure which shows illustratively the display image of a LCD panel and / or an electronic finder (EVF). It is a flowchart which shows the flow of the process regarding the display and recording of an image in an electronic camera. It is a flowchart which shows the specific example of the process in FIG.8 S804 and step S805. It is a figure which shows illustratively the display image of a LCD panel and / or an electronic finder (EVF).

Explanation of symbols

C1 Main camera C2 Sub camera V1 LCD panel V2 Electronic viewfinder (EVF)
B5 Composition data generation circuit F Frame (housing)
P Opening / closing panel H Hinge (coupling mechanism)

Claims (24)

A processing apparatus having a function of capturing an optical image as electrical image information,
A first imaging unit;
A second imaging unit;
A controller for controlling the first imaging unit and the second imaging unit;
The first imaging unit and the second imaging unit are arranged so that they can be directed in different directions,
The processing apparatus, wherein the controller is configured to cause the first imaging unit and the second imaging unit to perform imaging simultaneously. An image synthesis unit that synthesizes an image captured by the first imaging unit and an image captured by the second imaging unit;
A recording unit for recording the image combined by the image combining unit on a recording medium;
The processing apparatus according to claim 1, further comprising:   The processing apparatus according to claim 1, further comprising a recording unit that records images simultaneously captured by the first imaging unit and the second imaging unit on a single recording medium. An image display unit;
A panel incorporating the image display unit and the second imaging unit;
The processing apparatus according to claim 1, further comprising: A frame for supporting the panel;
The processing apparatus according to claim 4, wherein the panel is supported by the frame so that a direction thereof can be changed. The panel is supported by the frame so as to be openable and closable,
The processing apparatus further includes a sensor that detects opening and closing of the panel,
5. The processing apparatus according to claim 4, wherein ON / OFF switching of the second imaging unit is permitted when the sensor detects that the panel has been opened.   The processing apparatus according to claim 1, wherein ON / OFF switching of the second imaging unit is possible not only when shooting but also when shooting.   The processing apparatus according to claim 2, further comprising a switching unit that switches an image composition method by the image composition unit.   The switching unit is configured to be able to switch which of the image captured by the first imaging unit and the image captured by the second imaging unit is to be combined as a parent image. The processing apparatus according to claim 8.   The processing apparatus according to claim 2, further comprising a unit that switches on / off an image composition function of the image composition unit. A first image display unit;
A second image display unit;
Images captured by the first imaging unit, images captured by the second imaging unit, and images generated by the image composition unit on the first image display unit and the second image display unit A controller to control which of
The processing apparatus according to claim 2, further comprising:   The first image display unit and the second image display unit are configured so that a photographer can make the first image display unit and the second image display in a state where the first image pickup unit is directed to a shooting target. 12. The processing device according to claim 11, wherein the processing device is configured so that an image displayed on the unit can be observed, and the second imaging unit is arranged to face the photographer in the state. . An image display unit for displaying the captured image;
The image display unit is configured so that a photographer can observe an image displayed on the image display unit in a state where the first imaging unit is directed to the object to be imaged. The processing apparatus according to claim 1, wherein the imaging unit is arranged to face the photographer in the state.   The processing apparatus according to claim 1, wherein at least one of the first imaging unit and the second imaging unit is configured to be changeable in direction.   The processing apparatus according to any one of claims 1 to 14, wherein the processing apparatus is configured as an electronic camera.   The processing apparatus according to claim 1, wherein the processing apparatus is configured as a movie camera. An image recording method for capturing an optical image as electrical image information and recording it on a recording medium,
An imaging step in which imaging is simultaneously performed by a first imaging unit and a second imaging unit that are provided in one device and are directed in different directions;
A recording step of recording an image including two images simultaneously captured by the first imaging unit and the second imaging unit on one recording medium;
An image recording method comprising:   The method further includes a synthesizing step of synthesizing two images captured by the first imaging unit and the second imaging unit to generate a synthesized image. In the recording step, the synthesized image is stored on the one recording medium. The image recording method according to claim 17, wherein recording is performed. A detection step of detecting opening and closing of an openable panel incorporating the image display unit and the second imaging unit;
A permission step of permitting ON / OFF switching of the second imaging unit when it is detected that the panel is opened in the detection step;
The image recording method according to claim 17, further comprising:   The image recording method according to claim 17, further comprising a step of switching ON / OFF of the second image pickup unit not only during non-shooting but also during shooting.   The image recording method according to claim 18, further comprising a switching step of switching an image combining method in the combining step.   The switching step includes a step of switching which of an image captured by the first imaging unit and an image captured by the second imaging unit is used as a parent image. Item 22. The image recording method according to Item 21.   The image recording method according to claim 17, further comprising a step of switching whether to perform the synthesis step.   An image captured by the first imaging unit, an image captured by the second imaging unit on the first image display unit and the second image display unit provided in the apparatus, generated in the synthesis step 19. The image recording method according to claim 18, further comprising a step of controlling which of the displayed images is displayed.

Images