JP6071358B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  Conventionally, as an image processing apparatus, an imaging apparatus capable of recording and reproducing a moving image is known. In these imaging apparatuses, for example, as disclosed in Patent Document 1, an imaging apparatus capable of reproducing a moving image file and a still image file and recording association information in response to a still image shooting instruction during moving image shooting appears. Have been doing. When an image capturing apparatus disclosed in Patent Document 1 displays a still image of a still image file and there is an associated moving image file, the associated moving image file can be reproduced.

JP 2002-300445 A

  However, in the imaging device disclosed in Patent Document 1, a still image file and a moving image file are associated one-to-one, and for example, a plurality of still image files are associated with one moving image file. It was not a thing.

  Therefore, an object of the present invention is to provide an image processing apparatus that can solve a problem that occurs when, for example, a plurality of still image files are associated with one moving image file.

  In order to achieve such an object, the image processing apparatus of the present invention records a plurality of image files including a moving image file including moving image data composed of a plurality of scenes and a still image file corresponding to each scene. Reading means for reading an image file from the recorded recording medium, specifying means for specifying a moving image file corresponding to the specified still image file among the still image files recorded on the recording medium, and moving image data of the specified moving image file Display control means for displaying the image on the display means and playing back the moving picture data, and in the first mode, the moving picture file specified in response to the end of the playback of the moving picture data of the specified moving picture file In the second mode, the designated still image is displayed in response to the end of the reproduction of the moving image data of the specified moving image file. Control means for controlling to select a file, and in the first mode, the display control means displays, on the display means, a screen for selecting whether or not to play the specified moving image file, In the second mode, a screen for selecting whether or not to play the specified moving image file is not displayed on the display means.

  According to the present invention, for example, it is possible to solve a problem that occurs when a plurality of still image files are associated with one moving image file.

It is a figure which shows the structure of the imaging device of a present Example. It is a flowchart which shows control of the imaging device of digest movie mode. It is a figure for demonstrating the state of the still image file recorded by digest movie mode, and a moving image file. It is a figure which shows the format of the moving image file of a present Example. It is a figure which shows the information of the image file of a present Example. It is a figure which shows the operation | movement flow in the reproduction | regeneration mode of a present Example. It is a figure which shows the operation | movement flow in the reproduction | regeneration mode of a present Example. It is a figure which shows the operation | movement flow in the reproduction | regeneration mode of a present Example. It is a figure which shows the operation | movement flow in the reproduction | regeneration mode of a present Example.

  Hereinafter, examples of the present invention will be described in detail with reference to the drawings. However, the present invention is not limited to the following embodiments. The following embodiments do not limit the invention according to the claims, and all combinations of features described in the embodiments are not necessarily essential to the solution means of the invention.

  Note that each functional block described in the present embodiment is not necessarily separate hardware. That is, for example, the functions of some functional blocks may be executed by one piece of hardware. In addition, the function of one functional block or the functions of a plurality of functional blocks may be executed by some hardware linked operations.

Example 1
In this embodiment, an image pickup apparatus will be described as an example of the image processing apparatus.

  In the normal “moving image shooting mode”, the image pickup apparatus 100 of the present embodiment can record moving image data shot from the start to the end of one moving image shooting as a single file on a recording medium. In the normal “still image shooting mode”, still image data shot in response to one shooting instruction can be recorded on a recording medium as one file. Furthermore, the imaging apparatus of the present embodiment has a “digest movie mode”. In this “digest movie mode”, not only the recorded still image data is recorded on the recording medium in response to the still image shooting instruction, but also for a predetermined time period until the still image shooting instruction is input. The moving image data can be recorded on a recording medium as a moving image file. The moving image data is temporarily stored in an encoded state in a memory provided in the imaging apparatus.

  Further, in the “digest movie mode”, for example, one moving image data obtained by connecting all moving image data shot on the same date can be created and recorded on a recording medium. In this case, the newly captured moving image data is connected (added) to the moving image data of the moving image file already recorded on the recording medium every time a still image shooting instruction is given. In addition, each time they are connected, moving image data corresponding to each still image shooting is handled as corresponding to one chapter. Therefore, chapter data for indicating a chapter is recorded in the moving image file. Further, in the chapter data, time information indicating the timing at which the still image shooting is performed is recorded.

  When the mode transitions to the “digest movie mode”, the imaging apparatus 100 creates encoded moving image data in which a plurality of images obtained by the imaging unit are frame images of a moving image, and sequentially stores them in the memory. The past moving image data for a predetermined time or more is discarded or overwritten on the memory. When a still image shooting instruction is input, still image data is created based on the image signal obtained by the imaging unit and recorded on a recording medium. At this time, the moving image data for a predetermined time stored in the memory until then is recorded on the recording medium as a moving image file. When the video data for the predetermined time is connected to the video data of the video file (existing video file) already recorded on the recording medium, the video data for the predetermined time temporarily stored in the memory is stored. First record on the recording medium. After that, the moving image data of the existing moving image file is analyzed, and the connection position is specified, and then the moving image data is linked and edited. Note that the imaging apparatus 100 according to the present embodiment stores chapter information in a moving image file in order to distinguish moving images corresponding to still image shooting instructions as separate chapters. At this time, in the chapter data, time information indicating the timing at which the still image shooting is performed is described as text data.

  The imaging apparatus 100 according to the present embodiment can associate a moving image file and a still image file recorded in the “digest movie mode” with each other in the reproduction mode. In addition, when a still image file is being played back, a related moving image file can be played back, and the played back still image file can be displayed again after the playback ends.

  Hereinafter, such an imaging apparatus will be described.

  First, the overall configuration of the imaging apparatus 100 of the present embodiment will be described with reference to FIG.

  As illustrated in FIG. 1, the imaging apparatus 100 according to the present exemplary embodiment includes a CPU 101, a RAM 102, a ROM 103, and an operation unit 104. The imaging apparatus 100 includes an imaging unit 110, an image processing unit 111, a microphone unit 120, an audio processing unit 121, and a speaker unit 122. In addition, the imaging apparatus 100 includes an encoding / decoding processing unit 130, a display unit 140, a display control unit 141, a recording / playback unit 150, a recording medium 151, and a communication unit 160.

  CPU is an abbreviation for Central Processing Unit. RAM is an abbreviation for Random Access Memory.

  In the imaging apparatus 100 according to the present exemplary embodiment, the CPU 101 develops various programs recorded in the ROM 103 using the RAM 102 as a work memory, and controls each block of the imaging apparatus 100 according to the program. The operation unit 104 includes switches for inputting various operations such as a power button, a record button, a zoom adjustment button, an autofocus button, a menu display button, a mode switch, and a determination button. Further, any type of operation element such as a cursor key, a pointing device, a touch panel, and a dial may be used. The operation unit 104 transmits an operation signal to the CPU 101 when these keys, buttons, and touch panel are operated by the user. Each operation member of the operation unit 104 is appropriately assigned a function for each scene by selecting and operating various function icons displayed on the display unit, and functions as various function buttons. Examples of the function buttons include an end button, a return button, an image advance button, a jump button, a narrowing button, and an attribute change button. For example, when a menu button is pressed, various setting menu screens are displayed on the display unit. The user can make various settings intuitively using the menu screen displayed on the display unit, and the four-way buttons and the SET button. Note that the operation unit 104 may be a touch panel that can detect contact with the display unit. The touch panel may be any of various types of touch panels such as a resistive film method, a capacitance method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an image recognition method, and an optical sensor method. .

  The imaging unit 110 converts an optical image of a subject captured by a lens into an image signal using an imaging element such as a CCD sensor or a CMOS sensor by controlling a light amount by a diaphragm, and converts the obtained analog image signal into a digital image signal. And temporarily stored in the RAM 102. The digital image signal stored in the RAM 102 is then transmitted to the image processing unit 111. The image processing unit 111 performs an image quality adjustment process for adjusting the white balance, color, brightness, and the like of the digital image signal based on a setting value set by the user or a setting value automatically determined from the characteristics of the image. The digital image signal that has been processed is stored in the RAM 102 again. In addition, a digital image signal that has undergone image quality adjustment processing or an unprocessed digital image signal can be transmitted to a display control unit 141 described later and displayed on the display unit 140 as an image being captured. At the time of reproduction, the image processing unit 111 reads the image quality of the image data included in the still image file or the moving image file read from the recording medium 151 by the recording / reproducing unit 150 and decoded by the encoding / decoding processing unit 130. Make adjustments. Then, an image quality adjusted or unprocessed digital image signal can be transmitted to a display control unit 141 described later and displayed on the display unit 140 as an image.

  At the time of recording, the encoding / decoding processing unit 130 performs image compression processing on the digital image signal processed by the image processing unit 111 and stored in the RAM 102 to generate compressed moving image data and still image data. Then, a process of temporarily storing in the RAM 102 is performed. Further, at the time of reproduction, a process is performed in which the compressed moving image data and still image data of the image file read from the recording medium 151 is decoded to extract a digital image signal and stored in the RAM 102.

  For example, when generating moving image data, each frame of the moving image data is intra-frame encoded to generate compression-encoded moving image data. Moreover, you may produce | generate the moving image data compression-coded using the difference between several flame | frames of moving image data, a motion estimation, etc. For example, Motion JPEG, MPEG, H.264. H.264 (MPEG4-Part10 AVC), H.264. It is possible to generate moving image data of various compression encoding schemes such as H.265 / HEVC. In general, intra-frame encoded frame image data is referred to as an I picture, and inter-frame encoded image data using a difference from the front frame is referred to as a P picture, and the difference from the front and rear frames is used. The inter-frame encoded image data is called a B picture. These compression methods use well-known methods and are not related to the features of the present invention, so the description is omitted. Further, when generating still image data, a general compression encoding method such as JPEG is used, but these compression encoding methods use known methods and are not related to the features of the present invention. Therefore, explanation is omitted. The still image data may be so-called RAW image data in which the digital image signal obtained by the imaging unit 110 is recorded as it is.

  The microphone unit 120 includes, for example, an omnidirectional microphone built in the housing of the imaging apparatus 100 and an AD conversion unit. In the microphone unit 120, ambient sound is collected (collected) by the microphone, and the acquired analog sound signal is converted into a digital signal by the AD converter and temporarily stored in the RAM 102. The digital audio signal stored in the RAM 102 is then transmitted to the audio processing unit 121. At the time of recording, the audio processing unit 121 performs processing such as level optimization processing and noise reduction processing on the digital audio signal stored in the RAM 102, and stores the processed digital audio signal in the RAM 102 again. Moreover, the process which compresses an audio | voice signal is performed as needed. As for the audio compression method, a general audio compression method such as AC3 or AAC is used, and the description thereof will be omitted. Further, at the time of reproduction, a process for decoding the compressed audio data included in the audio file or the moving image file read from the recording medium 151 by the recording / reproducing unit 150, a process for optimizing the audio level, and the like are performed and sequentially stored in the RAM Processing is also performed. The speaker unit 122 includes a speaker and a DA converter. In the speaker unit 122, the digital audio signal stored in the RAM 102 is read out by the audio processing unit 121 and converted into an analog audio signal, and audio is output from the speaker using the analog audio signal.

  The display unit 140 includes, for example, a liquid crystal panel and a backlight, and displays an image under the control of the display control unit 141. The display unit 140 is not limited to a liquid crystal display device, and may be any device that can provide an image to a user, such as an organic EL display or an LED display. The display control unit 141 displays an image on the display unit 140 based on the digital image signal processed by the image processing unit 111 and stored in the RAM 102.

  In the recording / reproducing unit 150, when recording a moving image, the compressed moving image data generated by the encoding / decoding processing unit 130, the audio data generated by the audio processing unit 121, the shooting date, and the like stored in the RAM 102 are stored. Along with various information, it is written in the recording medium 151 as a moving image file. At the time of recording a still image, the still image data stored in the RAM 102 is recorded on the recording medium 151 as a still image file together with various information such as the shooting date. When recording a moving image file on the recording medium 151, a data stream composed of compressed moving image data and audio data is formed and sequentially recorded on the recording medium 151, and a file header or the like is added to a file such as FAT or exFAT. Record a video file on a recording medium in a form that conforms to the format. Further, at the time of reproduction, a moving image file or a still image file recorded on the recording medium 151 is read according to the aforementioned file format. The read moving image file and still image file are analyzed for headers by the CPU 101, and compressed moving image data and still image data are extracted. The extracted compressed moving image data and still image data are stored in the RAM 102 and decoded by the encoding / decoding processing unit 130.

  Further, the recording medium 151 may be a recording medium built in the imaging apparatus or a removable recording medium. For example, the recording medium includes all types of recording media such as a hard disk, an optical disk, a magneto-optical disk, a CD-R, a DVD-R, a magnetic tape, a nonvolatile semiconductor memory, and a flash memory. When using removable recording media, the recording / reproducing unit 150 includes a mechanism for loading and unloading the removable recording media.

  The communication unit 160 transmits and receives control signals, moving image files, still image files, various data, and the like to and from an external device different from the imaging device 100, and can be connected regardless of wired connection or wireless connection. It is. Note that any communication method may be used.

  Here, each of the image processing unit 111, the audio processing unit 121, the encoding / decoding processing unit 130, the display control unit 141, and the recording / reproducing unit 150 described above is a microcomputer on which a program for executing each of the above-described functions is mounted. It may be. Further, the program for executing the above-described processing recorded in the ROM 103 by the CPU 101 may be loaded into the RAM 102 and executed.

  Note that the imaging apparatus 100 according to the present exemplary embodiment records a moving image file in the “QuickTime (registered trademark) format” as an example, but any format may be used.

  In this embodiment, the file management system of the recording medium 151 will be described as using a FAT file system generally used in embedded devices. Since the technology of the FAT file system itself is widely known, only the characteristic operation of this embodiment will be described. Further, the NTFS format or the exFAT format which is a FAT file format may be used.

  Next, the operation of the imaging apparatus 100 according to the present embodiment will be described.

  The imaging apparatus 100 according to the present exemplary embodiment supplies power to each block of the imaging apparatus from a power supply unit (not illustrated) in response to an instruction to turn on the power by operating the operation unit 104 by the user. .

  When power is supplied, the CPU 101 determines whether the camera mode set by the operation unit 104 is a playback mode, a “digest movie mode”, a still image recording mode, or a moving image recording mode. In the present embodiment, the still image recording mode and the moving image recording mode are not related to the characteristic configuration, and thus description thereof is omitted.

  Next, the “digest movie mode” will be described with reference to the flowchart of FIG. The flowchart in FIG. 2 is a flowchart that starts when the digest movie mode is set, and is executed by the CPU 101 controlling each unit of the imaging apparatus 100 based on a program developed in the RAM 102. It is. In the present embodiment, whether or not to add the moving image data sequentially is determined after recording the still image and before recording the moving image data on the recording medium 151. That is, the CPU 101 reads out the moving image file that was last shot in the digest movie mode from the recording / playback unit 150 and confirms the information on the date when the movie was shot. If the read moving image file is taken on the same day, it is added. If it is taken on a different day, it is not added. The moving image shot in the digest movie mode is, for example, a file name obtained by sequentially incrementing a 4-digit integer in an identifier “MDG” for indicating that the moving image was shot in the digest movie mode. By doing in this way, it can be easily identified that the moving image having the largest number including the identifier MDG recorded on the recording medium 151 was taken last. The conditions for whether or not to add data will be described later, but confirmation of whether or not to add data may be performed when the imaging apparatus 100 is activated or when the mode is switched to the digest movie mode.

  In the present embodiment, the description will be made assuming that the thumbnail image is generated every time a still image shooting instruction is input. In this case, a plurality of thumbnail images are associated with the added moving image file. However, in the case of additional recording, a thumbnail image may be generated only when a moving image file is newly generated without generating a thumbnail image.

  When the digest movie mode is set by the operation unit 104, the CPU 101 controls each block of the imaging apparatus 100 and causes the following operations to be executed.

  First, the imaging unit 110 transmits the obtained digital image signal to the RAM 102 and temporarily stores it. Then, the display control unit 141 reads the digital image signal stored in the RAM 102 and causes the display unit 140 to display the digital image signal. The image processing unit 111 sequentially reads out the digital image signals stored in the RAM 102, performs the above-described various image quality adjustment processes, and stores the processed digital image signals in the RAM 102 again. The image processing unit 111 repeats this process every time an image is captured by the imaging unit 110.

  The encoding / decoding processing unit 130 performs an encoding process for encoding the digital image signal processed by the image processing unit 111 as moving image data (S201). For example, the encoding process includes Motion JPEG, MPEG, H.264, and so on. There are various well-known compression encoding system processes such as H.264 (MPEG4-Part10 AVC). In the present embodiment, for example, H.264. It is assumed that the encoding process is performed so that the moving image data includes an intra-frame predictive encoded image in H.264.

  At this time, the CPU 101 applies various adjustment processes to the digital audio signal input to the microphone unit in the audio processing unit 121, and then executes the encoding process according to a preset audio encoding method. The encoded audio signal obtained is stored in the RAM 102.

  Then, the encoding / decoding processing unit 130 and the audio processing unit 121 store the encoded moving image data and audio data in the RAM 102 (S202). In the following description, although explanation of audio data is omitted, it is assumed that it is processed together with moving image data.

  In the imaging apparatus 100 according to the present embodiment, the RAM 102 always stores the moving image data for the predetermined time immediately before the predetermined time among the moving image data stored in the RAM 102 so that the moving image data for the predetermined time is stored. The moving image data picked up at the time is deleted. For this reason, the CPU 101 determines whether or not moving image data for a predetermined time or more has been stored in the RAM 102 (S203), and if it has been stored for a predetermined time or longer (Yes in S203), at a point in time that is earlier than the predetermined time. The moving image data indicating the photographed image is discarded. Since the size of the data to be deleted is defined in encoding units, the size of the data to be deleted can be determined as a frame or a reproduction time depending on the encoding method. In addition, when it is not stored for a predetermined time or longer (No in S203), the moving image data is not discarded. In the present embodiment, the predetermined time may be any time, but may be selected by the user, for example, 4 seconds, 6 seconds, 8 seconds, or the like. Then, the CPU 101 determines whether or not a still image shooting instruction is input from the operation input unit 112 (S205). If a still image shooting instruction is not input (No in S205), the process returns to S201 again. The generation processing and temporary storage of moving image data are continued.

  In the present embodiment, it is assumed that moving image data for a predetermined time immediately before is always stored in the RAM 102, but the present invention is not limited to this. That is, the size of the moving image data stored in the RAM 102 may be anything that can be quantified, and may be a predetermined amount defined by, for example, the number of frames, the number of GOPs (Group Of Pictures), the data size, and the like. . In other words, when the moving image data stored in the RAM 102 is larger than the predetermined size, the moving image data is stored in the frames of the moving image data until the size becomes less than the predetermined size. The shooting time may be deleted in order from the oldest frame.

  When a still image shooting instruction is input (Yes in S205), the CPU 101 controls the recording / playback unit 150 to check the recordable capacity of the recording medium 151, and is temporarily stored in the RAM 102. It may be determined whether or not the moving image data can be recorded. This determination is made by comparing whether the sum of the size of the moving image data temporarily stored in the RAM 102 and the expected size of the still image data to be recorded is smaller than the recordable capacity of the recording medium 151. Determined. The expected size of the still image data may be 4 MB, for example, or may be changed according to the recording size, image quality, or the like.

  If it is determined that the moving image data and the still image data cannot be recorded on the recording medium 151, only the still image shooting may be performed and the moving image data may not be recorded.

  Also, when a still image shooting instruction is input in S205, if only a short amount of moving image data such as less than 1 second or less than 2 seconds is stored in the RAM 102, the still image shooting instruction is invalidated. You may make it. You may enable it to set a user image also during this time.

  Next, when a still image shooting instruction is input (Yes in S205), the CPU 101 causes the imaging unit 110 to perform shooting for still image data (S210). At this time, the CPU 101 causes the encoding / decoding processing unit 130 to decode the image of the first frame of the moving image data stored in the RAM 102 and execute the thumbnail image generation processing (S211). In this embodiment, the thumbnail image of the moving image data to be recorded is described as being generated from the image of the first frame. However, the present invention is not limited to this, and any of the frames of the moving image data to be recorded is used. It may be generated from an image of such a frame. That is, a thumbnail image using any frame of the moving image data stored in the RAM 102 may be generated when a still image shooting instruction is given. In this way, it is possible to generate a thumbnail of the moving image data without reading the moving image file from the recording medium after the file recording of the moving image data to the recording medium is finished once, so that the processing is quick. Become. If it is determined that a still image shooting instruction has been issued, the CPU 101 performs control so that the instruction is not accepted even if a still image shooting instruction is issued.

  Next, the CPU 101 determines whether or not the thumbnail image generation processing by the encoding / decoding processing unit 130 has been completed (S212). If the processing has been completed, next, the digital image captured in S210 is determined. In order to convert the image signal into still image data, the image processing unit 111 sequentially executes development processing and the encoding / decoding processing unit 130 sequentially executes encoding processing (S220). At this time, in parallel, the CPU 101 includes the thumbnail image generated by the thumbnail generation process in the header information of the encoded moving image data temporarily stored in the RAM 102 and records it on the recording medium 151. 150 is controlled (S221). Here, the still image development process (S220) is a “demosaic” process for creating a full-color image by complementing color information by collecting and giving missing color information from its surrounding pixels to each pixel during shooting. In addition to this, processing such as gamma correction and white balance adjustment may be included.

  When the above-described development processing is completed, the CPU 101 stores the developed digital image data in the RAM 102 again, causes the display control unit 141 to read it, and causes the display unit 140 to display it. This is a so-called “rec review” display in which a photographed image is displayed on the display unit 140 immediately after photographing with a digital camera. Incidentally, no image is displayed on the display unit 140 and a black image is displayed until the still image development process is completed after an instruction to shoot a still image is given. Alternatively, a display for presenting a status such as “processing” to the user may be displayed.

  When the development process is completed, the CPU 101 causes the encoding / decoding processing unit 130 to execute the encoding process according to a preset encoding method for still image recording. Next, the CPU 101 determines whether or not the still image development process and the encoding process have been completed (S222). If it is determined that the still image encoding process has been completed (Yes in S222), the CPU 101 sends the generated still image data to the recording / playback unit 150 to be recorded on the recording medium 151 (S223). Then, unless the user operates the operation input unit 102 to give an instruction to exit the digest movie mode (No in S224), the CPU 101 captures and encodes a moving image in parallel with recording a still image (S201). ). At this time, the CPU 101 causes the display control unit 141 to read out the digital image signal stored in the RAM 102 and displays the through image on the display unit 140 again.

  As described above, the imaging apparatus 100 according to the present exemplary embodiment records a moving image file and a still image file in the “digest movie mode”.

  Here, in the “digest movie mode” of the present embodiment, the newly captured video data (new video data) is added to the video data of the video file (existing video file) already recorded on the recording medium 151. An example of connection (additional writing) will be described. For example, if the date when the existing video file was recorded and the date when the new video data was acquired (the camera date setting at the time of shooting may be the same), the video data should be concatenated as shown in FIG. Recorded as shown. FIG. 3 shows the shooting timing and the recording state of the moving image file and the still image file.

  Still image files P1, P2, and P3 having the same shooting date are recorded in one folder (in the same folder) of the recording medium 151, and the moving image data stored in the RAM 102 immediately before shooting each still image is stored in the same folder. It is recorded as one linked moving image file. Further, P4 and P5 having shooting dates different from those of the still image files P1 to P3 are recorded in a folder different from the folder in which the still image file P1 is recorded. At this time, the moving image data stored in the RAM 102 immediately before shooting the still image file P4 is stored in the same folder as the shooting date of the still image file P4 even if the shooting date is changed in the middle of the moving image data. It shall be controlled to be recorded. That is, it is determined whether to link the moving image data or to newly save the moving image data, based on the date information at the timing when the shooting instruction is input.

  Further, in the present embodiment, it has been described that a thumbnail image corresponding to moving image data is generated every time a still image shooting instruction is input. However, for example, moving image data M1 generated at the time of shooting P1 still image data. The thumbnails corresponding to may be generated, and the thumbnail images of the M2 and M3 moving image data to be added may not be generated. In this way, it is possible to have one thumbnail image for each moving image file.

  Next, the file format of the moving image file recorded on the recording medium 151 will be described. FIG. 4 is a diagram for explaining the file format of the moving image according to the present embodiment.

  In this embodiment, the moving image file is recorded in the MOV format. In the MOV format, data recorded in a file is described in a data structure called “Atom” and recorded in the file in units of atoms. Each atom has a “Size field” and a “Type field”. The “Size field” is a 4-byte field that represents the data size of the entire atom including the Size field. The “Type field” is a 4-byte type identifier field indicating the kind of atom. In each atom, the fields after the “Type field” are optional depending on the atom, and the description thereof is omitted here. Further, it is possible to include other atoms in the atom, thereby realizing a nested structure. The moving image file recorded in the MOV format stores each atom in a structure as shown in FIG.

As shown in FIG. 4, a moving image file in the MOV format has the following atoms.
Ftyp (file type atom) 701 representing the type of file. A moov (movie atom) 702 that stores information about audio and video, including mvhd (movie header atom) 706 and trak (track atom) 707, 708, 709, which will be described later. Mdat (movie data atom) 703 that stores actual data such as voice, video, and text.

The moov (movie atom) 702 stores the following atoms.
Udta (user data atom) 704 in which arbitrary data is stored. A meta (metadata atom) 705 in which metadata such as the model name of the image capturing apparatus 100, position information of the image capturing apparatus 100 received by the communication unit 152, and UTC time are stored. An mvhd (movie header atom) 706 that stores the creation date / time, modification date / time, time scale, duration, etc. of the movie. Trak (track atom) 707 for video. An audio trak (track atom) 708. A trak (track atom) 709 for text.

Further, the following atoms are stored in each trak (track atom) 707 to 709.
A tkhd (track header atom) 710 in which the creation date and time of the track, Duration (time interval between samples in a chunk to be described later), ID, and the like are stored. In this embodiment, the video track ID is 1, the audio track ID is 2, and the text track ID is 3. Tref 711 storing reference information between tracks. In the present embodiment, since the video track refers to the text track as a chapter, the video tref 711 describes 3 as the ID of the text track, and in order to refer to it as a chapter, describes “chap” as an identifier. Has been. The same applies to the audio track. In this embodiment, tref does not have to exist in the text track.

Further, the following atoms are also stored in each trak (track atom) 707 to 709.
A stsc (sample chunk atom) 712 that indicates how many samples (frames in the case of video) each chunk is composed of. In this embodiment, it is assumed that all video chunks are composed of 1 chunk = 1 sample (frame). A stts (synchronous sample atom) 713 storing the number of samples and the time interval (Duration) between each sample. Stsz (sample size atom) 714 storing the data size of each sample. Stco (chunk offset) 715 storing the file offset of each chunk.

The following atoms are stored in mdat (movie data atom) 703 in which actual data such as audio, video, and text is stored.
Text chunks 716 and 717 storing the title of each chapter as text data. In the text chunks 716 and 717, data indicating the data size (hexadecimal number) of the text data that follows is stored in the first area. Text data is stored in the text data area in ASCII code. In this embodiment, the shooting time when a still image was shot in the “digest movie mode” is described as text data. In other words, in the “digest movie mode”, when there is an instruction to shoot a still image at 12:34:56, the moving image recorded on the recording medium corresponds to 12:34:52 to 12:34:56. It is a video to be. However, text data corresponding to 12:34:56 when a still image shooting instruction is given is written as text data of a text chunk indicating the title of the chapter of the moving image.

In addition, the following atoms are also stored in mdat (movie data atom) 703 in which actual data such as voice, video, and text is stored.
Audio data chunks 718, 719. Video data chunks 720, 721, 722, etc. In FIG. 7, alphabets indicate the types of pictures. That is, it indicates either an I picture that has been subjected to intraframe prediction encoding, a P picture that has been subjected to interframe prediction encoding for forward prediction, or a B picture that has been subjected to interframe prediction encoding for bidirectional prediction. In the present embodiment, I is added because it is an I picture that has been intra-frame prediction encoded. Further, the alphabetic subscript number represents the frame number from the beginning. That is, the video data chunk 720 indicates that the first frame is an I picture (intra-frame predictive coded picture).

  Here, the data storage state of the mdat atom 703 will be described.

  As described above, the mdat atom 703 stores text chunks, audio chunks, and video chunks. In the present embodiment, one audio chunk and 15 video chunks are stored as a set. This is recorded in this way so that 0.5 seconds of audio data corresponds to 15 frames of video. However, the storage method is not limited to this method. Furthermore, text chunks 716 and 717 are stored for each chapter as in this embodiment. This corresponds to one text chunk per chapter. That is, when shooting is repeated in the “digest movie mode” as in this embodiment, a text chunk is stored in the mdat atom every time shooting is performed. A text chunk corresponds to one chapter. In addition, a text chunk sample playback interval (Duration) is also stored in the text stts atom of the text trak atom.

  Movie files are recorded in this format.

  Therefore, for example, when accessing an arbitrary video frame, audio data, or chapter in mdat, information stored in stsz 714 and stco 715 of moov 702 may be used.

  Here, information recorded in the headers and chapters of still images and moving images will be described.

  FIG. 5 is a diagram for explaining the contents of a moving image file and a still image file recorded on the recording medium 151. In FIG. 5, header information and the like unnecessary for describing the present embodiment are omitted.

  As shown in FIG. 5, in the header area of a still image file shot in “digest movie mode”, information on the shooting date and time and “MDG flag” indicating that the movie was shot in “digest movie mode” are described. ing. In addition, information on the shooting date and time of the moving image file is recorded in the header area of the moving image file shot in the “digest movie mode”. However, this shooting date / time information also describes the same date / time as the shooting date / time information of the still image first shot in the “digest movie mode”. In the imaging apparatus 100 according to the present exemplary embodiment, in “digest movie mode”, a moving image is connected every time a still image is shot. The connected moving image data is handled as different chapters. Therefore, the frame number of the moving image data corresponding to each chapter is described in the header area of the moving image file shot in the “digest movie mode”. In the present embodiment, these chapter numbers are described in association with date / time information when the still image was taken. At the time of reproduction, it is possible to specify a frame number corresponding to the specified chapter number and shooting date / time information, and perform reproduction from the specified frame number.

  Information indicating the date and time when the still image was taken is also recorded as text data recorded together with the moving image data.

  Next, the playback mode will be described.

  The imaging apparatus 100 according to the present embodiment displays a list screen of still image files and moving image files on the display unit 140 in the reproduction mode. The list screen displays a list screen of only still image files, a list screen of only moving image files, a list screen in which still image files and moving image files are mixed, and the like. Then, the designated still image file is reproduced, and the image of the still image file is displayed on the display unit 140. At this time, when a still image file shot in the “digest movie mode” is being reproduced, information indicating the presence of a moving image file shot in the corresponding “digest movie mode” is displayed. When the user gives an instruction to play the corresponding moving image file, a screen for confirming whether to start playing the corresponding moving image file is displayed. When the user permits, the playing of the corresponding moving image file is started. When the reproduction of the corresponding moving image file is completed, the moving image file list screen is displayed, and the user's instruction is waited with the moving image file displayed last being selected.

  When the playback mode is designated by the operation unit 104, the CPU 101 transmits a control signal to each block of the imaging apparatus 100 so as to shift to the playback state, and starts the playback control flow shown in FIGS. Note that the processing shown in the flowcharts of FIGS. 6 and 7 is processing that is executed by the CPU 101 controlling each unit of the imaging apparatus 100 based on a program developed in the RAM 102.

  When the playback mode is designated, the CPU 101 controls the recording / playback unit 150 to read the file list information from the recording medium 151, and the display control unit 141 displays the information indicating each file on the display unit 140. To control. The information indicating each file is, for example, a representative image included in each file. Further, the CPU 101 controls the display control unit 141 to display a selection image indicating the selection state of each file on the display unit 140 (S601).

  Note that in this embodiment, when the shooting mode is switched to the playback mode after shooting in the shooting mode, the selected image is displayed so that the last shot image file is selected. In addition, when playback is performed in the playback mode, the selected image is displayed so that the last played image is selected.

  Next, the CPU 101 controls the recording / reproducing unit 150 to read from the recording medium 151 still image data or moving image data of a still image file or a moving image file selected based on an operation signal from the operation unit 104. Then, the CPU 101 controls the encoding / decoding processing unit 130 to decode still image data and moving image data, and controls the display control unit 141 to display these images on the display unit 140 (S602).

  At this time, if the read file is a still image file, the CPU 101 determines whether or not the MDG flag is included in the header of the still image file. That is, it is determined whether or not the selected still image file is a still image shot in the “digest movie mode” (S603).

  As a result of the determination, when the MDG flag is not included in the header of the still image file (when the still image is not captured in the “digest movie mode”), the CPU 101 plays the specified file until another instruction is given. (No in S604). When there is another instruction, the display control unit 141 is controlled so that an image indicating still image data or moving image data included in another processing or another designated image file is displayed on the display unit 140. (Yes in S604).

  On the other hand, as a result of the determination, when the MDG flag is included in the header of the still image file (when the still image is shot in the “digest movie mode”), the CPU 101 displays that a related moving image file exists. The display control unit 141 is controlled to do so (S611).

  Then, the CPU 101 determines whether or not an instruction to play a related moving image file is input from the operation unit 104 (S612). If the result of determination is that there is no input, the process moves to S604. As a result of the determination, if an instruction to play the related video file is input (Yes in S612), the display control unit 141 is displayed so as to display a confirmation screen for asking whether to play the related video file. Control is performed (S613). Then, when the confirmation screen is displayed in S613, the CPU 101 determines whether an instruction for permitting reproduction of the moving image file is input from the operation unit 104 (S614). If an instruction to permit reproduction of the moving image file is not input in S614, the process proceeds to S611 (No in S614). If an instruction permitting the reproduction of the moving image file is input in S614, the recording / reproducing unit 150 is controlled to reproduce the related moving image file (S621).

  As described above, the reason for inquiring whether or not to reproduce a related moving image file while reproducing a still image shot in the “digest movie mode” is as follows.

  For example, if you have taken a number of shots in "Digest Movie Mode". The image pickup apparatus according to the present embodiment stops after selecting the moving image file that has been reproduced after the reproduction of the moving image file, and does not return to the state in which the original image is selected. Therefore, in order to return to the state of selecting the original still image file, many operations must be performed in order to search for the image again. Therefore, when a related moving image file is reproduced, a confirmation screen is displayed as in S613. In addition, on the confirmation screen, a notification that “the reproduction of the currently displayed still image file is not automatically performed after the reproduction of the moving image file” may be made.

  When the process of S621 ends, the CPU 101 determines whether or not the playback mode is ended (S622). If not, the process is repeated from S602.

  Next, processing (S621) in the case of reproducing a moving image corresponding to the still image file being reproduced will be described with reference to the flowchart of FIG.

  When there is a request for reproduction of a moving image file corresponding to the still image file being reproduced, the CPU 101 controls the recording / reproducing unit 150 to read the shooting date / time information recorded in the header of the still image file (S701). . Next, the CPU 101 specifies a moving image file including “MDG” in the file name among moving image files (files with an extension “MOV”) recorded on the recording medium 151. Next, the CPU 101 analyzes the shooting date / time information of the specified moving image file, and specifies a moving image file having the same date as the shooting date / time information of the still image file being played back (S702).

  Next, the CPU 101 controls the recording / reproducing unit 150 to read the moving image data of the specified moving image file, and controls the encoding / decoding processing unit 130 to sequentially decode the read moving image data from the top. At the same time, the display control unit 141 is controlled to display the decoded image (S703).

  Next, the CPU 101 determines whether the reproduction of the moving image data of the reproduced moving image file has been completed to the end or has been interrupted by an instruction from the user operation unit 104 (S704). If not interrupted or terminated (No in S704), the CPU 101 controls the recording / playback unit 150, the encoding / decoding processing unit 130, and the display control unit 141 so as to continue playback of the moving image. When interrupted or terminated, as in S601, the CPU 101 controls the recording / playback unit 150 to read the file list information from the recording medium 151, and displays information indicating each file on the display unit 140. The controller 141 is controlled. At this time, since the moving image file has been reproduced, in this embodiment, the selected image is displayed so that the moving image file that has been reproduced last is selected (S705).

  As described above, the imaging apparatus 100 according to the present embodiment can reproduce a related moving image file while reproducing a still image file shot in the “digest movie mode”. When the playback of the image file being played ends, the screen returns to the image selection screen with the image file being played selected, so whether or not to play the movie file immediately before playing the associated movie file. Display the inquiry screen. In this way, when multiple still image files are associated with a movie file, and the still image file originally played after the associated movie file cannot be played automatically, It is possible to prevent file selection not to be performed.

  In this embodiment, an inquiry screen as to whether or not to reproduce a moving image file is displayed immediately before reproducing a related moving image file. However, for example, if the number of still image files associated with a moving image file is less than a predetermined threshold value, or if the difference in the number added to the file name of the associated moving image file is smaller than a predetermined threshold value, an inquiry is made. May not display the surface.

  In the present embodiment, the example in which the corresponding moving image file is reproduced while the still image file shot in the “digest movie mode” is reproduced has been described. However, for example, when a plurality of still image files correspond to one moving image file or scene, the reproduction method of this embodiment can be applied. That is, the image processing in the playback modes of the first and second embodiments can also be applied to image processing of still image files and moving image files recorded by a recording method other than the “digest movie mode”.

  In this embodiment, the image pickup apparatus has been described as an example. However, the present invention can be applied as long as the reproduction processing of this embodiment can be executed. For example, it may be a computer, a tablet terminal, a smartphone, a mobile phone, a television, or the like. A program for causing a computer to execute the deletion process of this embodiment is also included in the concept of the present invention.

(Example 2)
Also in this embodiment, an image pickup apparatus will be described as an example of the image processing apparatus. The image pickup apparatus of the present embodiment performs the same operation as that of the image pickup apparatus 100 of the first embodiment except for the operation in the reproduction mode, and the block configuration is the same as FIG. Therefore, description will be made using the block configuration of FIG.

  The description of the block configuration and the description of the “digest movie mode” are the same as those in the first embodiment, and thus the description thereof is omitted.

  Next, the playback mode will be described.

  The imaging apparatus 100 according to the present embodiment displays a list screen of still image files and moving image files on the display unit 140 in the reproduction mode. The list screen displays a list screen of only still image files, a list screen of only moving image files, a list screen in which still image files and moving image files are mixed, and the like. Then, the designated still image file is reproduced, and the image of the still image file is displayed on the display unit 140. At this time, when a still image file shot in the “digest movie mode” is being reproduced, information indicating the presence of a moving image file shot in the corresponding “digest movie mode” is displayed. When the user instructs the reproduction of the corresponding moving image file, the reproduction of the corresponding moving image file is started.

  When the reproduction of the corresponding moving image file is completed, the imaging apparatus according to the present embodiment returns to a state where the originally displayed still image file is selected or reproduced. When the reproduction of the moving image file is interrupted by the operation of the operation unit 104 by the user, the state returns to the state where the still image file corresponding to the scene (chapter) in the interrupted moving image file is selected or reproduced. .

  When the playback mode is designated by the operation unit 104, the CPU 101 transmits a control signal to each block of the imaging apparatus 100 so as to shift to the playback state, and starts the playback control flow shown in FIGS. Note that the processing shown in the flowcharts of FIGS. 6 and 7 is processing that is executed by the CPU 101 controlling each unit of the imaging apparatus 100 based on a program developed in the RAM 102.

  When the playback mode is designated, the CPU 101 controls the recording / playback unit 150 to read the file list information from the recording medium 151, and the display control unit 141 displays the information indicating each file on the display unit 140. To control. The information indicating each file is, for example, a representative image included in each file. In addition, the CPU 101 controls the display control unit 141 to display a selection image indicating the selection state of each file on the display unit 140 (S801).

  Note that in this embodiment, when the shooting mode is switched to the playback mode after shooting in the shooting mode, the selected image is displayed so that the last shot image file is selected. Basically, when playback is performed in the playback mode, the selected image is displayed so that the last played image is selected. However, after playback of a movie file shot in “digest movie mode”, the still image file corresponding to the scene (chapter) where playback was interrupted is selected. The selected image is displayed so that Note that the still image data of the still image file may be reproduced and displayed on the display unit 140 instead of the selected state.

  Next, the CPU 101 controls the recording / reproducing unit 150 to read from the recording medium 151 still image data or moving image data of a still image file or a moving image file selected based on an operation signal from the operation unit 104. Then, the CPU 101 controls the encoding / decoding processing unit 130 to decode still image data and moving image data, and controls the display control unit 141 to display these images on the display unit 140 (S802).

  At this time, if the read file is a still image file, the CPU 101 determines whether or not the MDG flag is included in the header of the still image file. That is, it is determined whether or not the selected still image file is a still image shot in the “digest movie mode” (S803).

  As a result of the determination, when the MDG flag is not included in the header of the still image file (when the still image is not captured in the “digest movie mode”), the CPU 101 plays the specified file until another instruction is given. (No in S804). When there is another instruction, the display control unit 141 is controlled so that an image indicating still image data or moving image data included in another processing or another designated image file is displayed on the display unit 140. (Yes in S804).

  On the other hand, as a result of the determination, when the MDG flag is included in the header of the still image file (when the still image is shot in the “digest movie mode”), the CPU 101 displays that a related moving image file exists. The display control unit 141 is controlled to do so (S811).

  Then, the CPU 101 determines whether or not an instruction to play a related moving image file is input from the operation unit 104 (S812). If the result of determination is that there is no input, the process moves to S804. As a result of the determination, if an instruction to play the related video file is input (Yes in S812), the recording / playback unit 150 is controlled to play back the related video file (S821). In this embodiment, at this time, the CPU 101 temporarily stores in the RAM 102 information specifying the displayed still image file. For example, the information for specifying the displayed still image file may be shooting date / time information, a file name or a file path, or any information that can be specified.

  When the process of S821 ends, the CPU 101 determines whether or not the playback mode has ended (S822). If not, the process repeats from S802.

  Next, a process (S821) in the case of reproducing a moving image corresponding to a still image file being reproduced will be described with reference to the flowchart of FIG.

  When there is a request for reproduction of a moving image file corresponding to the still image file being reproduced, the CPU 101 controls the recording / reproducing unit 150 to read the shooting date / time information recorded in the header of the still image file (S901). . Next, the CPU 101 specifies a moving image file including “MDG” in the file name among moving image files (files with an extension “MOV”) recorded on the recording medium 151. Next, the CPU 101 analyzes the shooting date / time information of the specified moving image file, and specifies a moving image file having the same date as the shooting date / time information of the still image file being played back (S902).

  Next, the CPU 101 analyzes the header of the specified moving image file and specifies a scene (chapter) at the same time as the shooting date / time information of the still image file being reproduced. Then, the recording / playback unit 150 is controlled so as to read the moving image data of the specified scene (chapter), and the encoding / decoding processing unit 130 is controlled so as to sequentially decode the read moving image data, and the decoded data is decoded. The display control unit 141 is controlled to display the displayed image (S903). Note that, as in the first embodiment, the encoding / decoding processing unit 130 is controlled to sequentially decode the moving image data of the specified moving image file from the top, and the display control unit 141 displays the decoded image. May be controlled.

  Next, the CPU 101 determines whether the reproduction of the moving image data of the reproduced moving image file has been interrupted by an instruction from the operation unit 104 of the user (S911). When interrupted (Yes in S911), the CPU 101 controls the recording / playback unit 150 to read the file list information from the recording medium 151, and displays the information indicating each file on the display unit 140. 141 is controlled. At this time, the CPU 101 displays a file list in a state where the still image file corresponding to the interrupted scene (chapter) of the moving image file is selected (S912).

  For this purpose, the CPU 101 reads out the shooting time information corresponding to the interrupted scene (chapter) of the moving image file from the information associated with the frame number, the chapter, and the shooting time of the still image recorded in the header of the moving image file. . Then, the CPU 101 identifies a still image file (file with extension “JPG”) recorded on the recording medium 151. Next, the CPU 101 analyzes shooting date / time information of the specified moving image file, and specifies a still image file having a recording time associated with the interrupted scene (chapter). Then, the CPU 101 controls the display control unit 141 so as to display the selected image so that the specified still image file is selected. Note that the display control unit 141 may be controlled so that still image data of a still image file is reproduced and displayed on the display unit 140 instead of being selected. In this embodiment, the still image file corresponding to the interrupted scene is displayed. However, the still image file corresponding to the scene immediately before the interrupted scene may be displayed. In that case, the same processing may be performed by reading the information of the photographing time corresponding to the previous chapter.

  On the other hand, when the reproduction of the moving image data of the reproduced moving image file is not interrupted by an instruction from the operation unit 104 of the user and the reproduction is finished (Yes in S921). The CPU 101 controls the recording / playback unit 150 to read the file list information from the recording medium 151, and controls the display control unit 141 to display information indicating each file on the display unit 140. At this time, the CPU 101 displays a file list in a state where the still image file displayed before the reproduction of the moving image file is selected (S922).

Therefore, the CPU 101 temporarily stores the data in the RAM 102 in the process of S812.
Information for specifying the still image file being displayed is read.

  Then, the CPU 101 specifies information for specifying the displayed still image file stored in the RAM among the still image files (files with the extension “JPG”) recorded in the recording medium 151. . Then, the CPU 101 controls the display control unit 141 so as to display the selected image so that the specified still image file is selected. Note that the display control unit 141 may be controlled so that still image data of a still image file is reproduced and displayed on the display unit 140 instead of being selected.

  As described above, the image pickup apparatus according to the present embodiment can play back a related moving image file while playing back a still image file shot in the “digest movie mode”. Then, after the reproduction of the reproduced moving image file, the still image file that was originally reproduced can be displayed immediately. In addition, when the user interrupts playback of a moving image file, a still image file corresponding to the interrupted scene can be displayed immediately.

  In this embodiment, when the user interrupts the playback of the moving image file, the list screen is displayed with the still image file corresponding to the interrupted scene being selected. However, after the reproduction is finished, the list screen may be displayed with the still image file that was originally displayed being selected.

  In this embodiment, when a moving image file corresponding to the displayed still image file is reproduced, the reproduction is performed from the beginning of the moving image data or the corresponding chapter. However, for example, only the moving image data of the corresponding chapter of the moving image file may be reproduced, and then the image of the still image file that was originally reproduced may be displayed.

  In addition, the first mode returns to the state where the image file that has been reproduced is selected by the end or interruption of the reproduction of the image file as in the first embodiment, or the corresponding still image file as in the second embodiment. The user may be able to freely set the second mode for returning to the selected state. In this case, if the setting is in the first embodiment (first mode), the confirmation screen in S613 is displayed. If the setting is in the second embodiment (second mode), the confirmation screen is not displayed. In this way, a smooth operation image according to the setting is possible.

  In the present embodiment, the example in which the corresponding moving image file is reproduced while the still image file shot in the “digest movie mode” is reproduced has been described. However, for example, when a plurality of still image files correspond to one moving image file or scene, the reproduction method of this embodiment can be applied. That is, the image processing in the playback modes of the first and second embodiments can also be applied to image processing of still image files and moving image files recorded by a recording method other than the “digest movie mode”.

  In this embodiment, the image pickup apparatus has been described as an example. However, the present invention can be applied as long as the reproduction processing of this embodiment can be executed. For example, it may be a computer, a tablet terminal, a smartphone, a mobile phone, a television, or the like. A program for causing a computer to execute the deletion process of this embodiment is also included in the concept of the present invention.

Note that the imaging apparatus 100 according to the first and second embodiments basically appends new moving image data to the moving image data of the existing moving image file. I try not to.
When an existing moving image file to be added is protected When a specific moving image file “MDG — 000X.MOV” recorded on the recording medium 151 is protected, the user does not want to modify the file. Since there is a high possibility, appending is impossible.
When the file size exceeds a predetermined size due to additional recording The recording medium 151 is managed by, for example, the FAT file system as described above. In that case, for example, in FAT32, when it becomes 4 GB or more per file, reading becomes impossible. For this reason, if the “additional video file” exceeds 4 GB in the next shooting, the additional recording is impossible.
・ When there is an abnormality in the GOP structure of the movie of the existing movie file that is the target of additional recording. Since there is a possibility that moving image data to be additionally recorded may be affected, it is assumed that additional recording is impossible.
When there is no file to be additionally recorded A moving image shot in the digest movie mode is added with an MDG identifier “MDG — 000X.MOV” and a 4-digit serial number as a file name. However, if there is no moving image with an identifier including “MDG” in the file name, there is no moving image file shot in the digest movie mode, so that additional writing is impossible. Further, the file name of the moving image file recorded last in the digest movie mode is recorded in the non-illustrated non-volatile memory of the imaging apparatus 100, and additional recording is impossible even if the file does not exist.
・ When the shooting date of the movie file to be added is different from the date set on the imaging device When adding movie data shot on the same shooting date sequentially in digest movie mode, a different date will be added as the date changes. Since a moving image file is recorded, it is impossible to append.
・ When the region setting associated with the video file to be added is different from the region set in the imaging device When adding video data shot in the same region in digest movie mode sequentially, Since another video file is to be recorded, it is not possible to append. For example, the location information obtained using the GPS unit may be used as the area information, or “country” information selected when setting the clock of the imaging apparatus may be used.
・ When the information of the imaging device associated with the video file to be added is different from the imaging device that captures the new video data When adding only the video data shot in the digest movie mode with the same imaging device, It is confirmed whether the identification information of the imaging device associated with the moving image file to be added recorded on the recording medium matches the imaging device that performs shooting. If they are different, additional writing is impossible.
-When the video recording settings are not the same as the existing video file of the append source When adding new video data to the existing video file as in this embodiment, the frame rate, image size, GOP configuration, If the moving image encoding method is changed, there is a possibility that seamless playback cannot be performed. For this reason, when the moving image data of the existing moving image file and the moving image recording setting of the new moving image data are not the same, additional recording is impossible. Information such as a frame rate, an image size, a GOP configuration, and a moving image encoding method is recorded in a file header of an existing moving image file.
-When the audio recording settings are not the same as the existing video file of the append source When adding new video data to the existing video file as in this example, the audio sampling rate, number of channels, bit If the depth, the audio encoding method, or the like is changed, there is a possibility that playback cannot be performed. Therefore, when the moving image data of the existing moving image file and the audio recording setting of the new moving image data file are not the same, additional recording is impossible. Information such as an audio sampling rate and audio encoding method is recorded in a file header of an existing moving image file.
When there is an insertion / extraction history of the recording medium 151 When the imaging apparatus 100 is activated, the CPU 101 records the history of the insertion / extraction of the recording medium 151 in the non-illustrated non-volatile memory after the last shooting in the continuous movie shooting mode If it is, appending is impossible. This is to reduce the possibility that “MDG — 000X.MOV” recorded on the recording medium 151 is edited by a computer or the like, the image size or the like is changed, and the moving image file itself is broken due to additional writing. For this purpose, the shooting date / time information recorded in the file header of “MDG — 000X.MOV” to be added is compared with the time information of the insertion / removal history remaining in the nonvolatile memory. In the additional recording moving image file “MDG — 000X.MOV”, time information first captured among moving image data of a plurality of scenes recorded in the moving image is recorded in a file header.
When the moving image playback time exceeds a predetermined time due to additional recording, the imaging apparatus 100 takes a new shooting in the continuous moving image shooting mode in consideration of the case where shooting exceeding a predetermined time (for example, 30 minutes) is not desired. Thus, when the reproduction time of the moving image data of the “additional recording moving image file” exceeds 30 minutes, the additional recording is impossible. For this purpose, for example, the playback time of the “additional video file” described in the file header is read out, and if it is 29 minutes 58 seconds or the like, additional recording is impossible.
-When the number of files in the folder in which the moving image file of the additional recording is recorded exceeds a predetermined number In the imaging apparatus 100, the number of files for recording still image files and moving image files on the recording medium 151 is based on a standard called DCF Is recorded. In this DCF standard, a maximum of 9999 files can be recorded in one folder. However, since a still image file is newly generated when shooting is performed as in the present embodiment, Recording may not be possible in the folder in which the original video file is stored. In that case, the related still image file and the moving image file that is the additional recording source are stored in different folders, which makes it difficult for the user to view later. Therefore, in such a case, it is assumed that the moving image is recorded as a new file without additional writing and stored in a new folder. Here, 999 files are described as the upper limit, but 999 files, 900 files, 100 files, or 100 files may be used.

  Further, even when the recording medium 151 or the existing moving image file cannot be normally checked due to a cause such as corruption, it is determined that additional writing is impossible.

  In this embodiment, the imaging apparatus has been described. Examples of the imaging device include a general compact digital camera, a digital single-lens camera, a video camera, and a mobile phone. An apparatus to which the technology of the present invention can be applied is not limited to an imaging apparatus, and may be a computer, for example.

(Other embodiments)
The above-described embodiment can also be realized in software by a computer of a system or apparatus (or CPU, MPU, etc.). Therefore, the computer program itself supplied to the computer in order to implement the above-described embodiment by the computer also realizes the present invention. That is, the computer program itself for realizing the functions of the above-described embodiments is also one aspect of the present invention.

  The computer program for realizing the above-described embodiment may be in any form as long as it can be read by a computer. For example, it can be composed of object code, a program executed by an interpreter, script data supplied to the OS, but is not limited thereto. A computer program for realizing the above-described embodiment is supplied to a computer via a storage medium or wired / wireless communication. Examples of the storage medium for supplying the program include a magnetic storage medium such as a flexible disk, a hard disk, and a magnetic tape, an optical / magneto-optical storage medium such as an MO, CD, and DVD, and a nonvolatile semiconductor memory.

  As a computer program supply method using wired / wireless communication, there is a method of using a server on a computer network. In this case, a data file (program file) that can be a computer program forming the present invention is stored in the server. The program file may be an executable format or a source code. Then, the program file is supplied by downloading to a client computer that has accessed the server. In this case, the program file can be divided into a plurality of segment files, and the segment files can be distributed and arranged on different servers. That is, a server apparatus that provides a client computer with a program file for realizing the above-described embodiment is also one aspect of the present invention.

  In addition, a storage medium in which the computer program for realizing the above-described embodiment is encrypted and distributed is distributed, and key information for decrypting is supplied to a user who satisfies a predetermined condition, and the user's computer Installation may be allowed. The key information can be supplied by being downloaded from a homepage via the Internet, for example. Further, the computer program for realizing the above-described embodiment may use an OS function already running on the computer. Further, a part of the computer program for realizing the above-described embodiment may be configured by firmware such as an expansion board attached to the computer, or may be executed by a CPU provided in the expansion board. Good.

Claims (14)

Reading means for reading an image file from a recording medium on which a plurality of image files including a moving image file including moving image data composed of a plurality of scenes and a still image file corresponding to each scene are recorded ;
A specifying means for specifying a moving image file corresponding to a specified still image file among the still image files recorded on the recording medium ;
Display control means for displaying the image of the moving image data of the specified moving image file on a display means, and reproducing the moving image data ;
In the first mode, the specified video file is selected in response to the end of reproduction of the video data of the specified video file, and in the second mode, the specified video file is selected . in response to the video data playback is completed, have a control unit for controlling to select the designated still image file,
The display control means displays on the display means a screen for selecting whether or not to play the specified moving image file in the first mode, and in the second mode, the specified control means. An image processing apparatus , wherein a screen for selecting whether or not to reproduce a moving image file is not displayed on the display means . In the second mode, the control means controls to select the designated still image file in response to the interruption of the reproduction of the moving image data of the specified moving image file. The image processing apparatus according to claim 1. In the second mode, the control means, in response to the interruption of the reproduction of the moving image data of the specified moving image file, the still image corresponding to the interrupted scene or the scene immediately before the interrupted scene. The image processing apparatus according to claim 1, wherein the image processing apparatus is controlled to select a file. The image processing apparatus according to claim 1, wherein the display control unit reproduces the moving image data of the identified moving image file from the beginning. The image according to any one of claims 1 to 3, wherein the display control means reproduces from a scene corresponding to the specified still image file in the moving image data of the specified moving image file. Processing equipment. The said display control means reproduces | regenerates only the scene corresponding to the said specified still image file among the moving image data of the specified moving image file. Image processing device. A step of reading out an image file from a recording medium on which a plurality of image files including a moving image file including moving image data composed of a plurality of scenes and a still image file corresponding to each scene are recorded ;
A specifying step of specifying a moving image file corresponding to a specified still image file among the still image files recorded on the recording medium ;
A reproduction step of displaying an image of the moving image data of the identified moving image file on a display means, and reproducing the moving image data ;
In the first mode, the specified video file is selected in response to the end of reproduction of the video data of the specified video file, and in the second mode, the specified video file is selected . A control step for controlling to select the designated still image file in response to the end of reproduction of the video data ;
In the first mode, a screen for selecting whether or not to play back the specified moving image file is displayed on the display means, and in the second mode, the specified moving image file is played back. And a display control step for controlling so that a screen for selecting whether or not to be displayed on the display means . The control step includes performing control so that the designated still image file is selected in response to interruption of reproduction of moving image data of the specified moving image file in the second mode. Item 8. The image processing method according to Item 7 . In the control step , the still image file corresponding to the interrupted scene or the scene immediately before the interrupted scene in response to the interrupt of the reproduction of the moving image data of the specified moving image file in the second mode. The image processing method according to claim 7 , wherein control is performed so as to select. The regeneration step, the image processing method according to any one of claims 7 9, characterized in that the playback from the beginning of the moving image data of the identified video file. The regeneration step, the image processing according to any one of claims 7 9, characterized in that play from the scene corresponding to the designated still image file of the moving image data of the identified video file Method. The image according to any one of claims 7 to 9 , wherein the reproduction step reproduces only a scene corresponding to the designated still image file among the moving image data of the specified moving image file. Processing method. A program that causes a computer to function as each unit of the image processing apparatus according to any one of claims 1 to 6 . A program for causing a computer to execute the image processing method according to any one of claims 7 to 12.

Images