JP2006157492A - Multi stream multiplexing recording device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device capable of synchronizing the timing of multiplexing in consideration of delay in moving video image transfer among devices when the moving video image photographed by two or more devices is subjected to multiplexing recording on real time. <P>SOLUTION: When receiving a recording initiation signal from an outer device, buffering of self-device stream data is started. Upon arrival of the stream data from the outer device, the same time stream data are taken from the buffered self-device stream data and from the stream data from the outer device, and multiplexed. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a digital recording apparatus that records stream data such as moving image data and audio data, and more particularly to a digital recording apparatus that multiplexes stream data at the same time.

  With the advent of video cameras, it has become easy for ordinary people to shoot movies. Since its advent, video cameras have become widespread as video cameras have become higher in image quality, more functional, smaller, and at the same time lower in price. Recently, mobile phones and digital still cameras have been added with a function for capturing moving images, and the number of devices capable of capturing moving images is increasing.

  Many people bring digital video cameras and digital still cameras when holding events such as athletic meet and weddings, so there are many devices that can shoot movies. Therefore, when they operate simultaneously, the same scene at the same time is shot from various angles.

  Current digital video cameras and digital still cameras do not have a network function, so only videos shot with the device can be recorded on the device. However, if the network function is added, the same scene at the same time can be recorded at different angles. Therefore, it is possible to record a moving image shot by another device on the own device. Not only can recording be performed, but it is also possible to multiplex and record a moving image being shot by the own device and a moving image shot by another device.

As a device that multiplexes and records videos shot by multiple cameras, input from multiple cameras is multiplexed in real time by matching the timing of input, encoding, and multiplexing with the signal from the synchronization means. A technique for recording data is disclosed (for example, see Patent Document 1).
Japanese Patent Laid-Open No. 11-103444

  However, in the above prior art, when there is a delay in the transfer of moving images taken by a specific camera, the timing of input, encoding and multiplexing from a plurality of cameras cannot be synchronized by the synchronization means, and the multiplexing is performed in real time. It has a problem that it cannot be recorded.

  When a moving image shot by another device is received via a wired or wireless network and multiplexed and recorded by the own device, a network delay associated with the transfer, a processing delay on the other device, or the like occurs. In other words, there is a gap of at least these delay times between the video shot by the device and the video received from another device, and even when synchronized at the input timing of the video, the time when each video was shot correctly matches. I can't.

  SUMMARY OF THE INVENTION The present invention solves the above-described conventional problems, and has an object to provide a function of recording a plurality of cameras on a network by multiplexing and recording their inputs in real time.

  In order to solve the above-described conventional problems, a multi-stream multiplexed recording apparatus according to the present invention includes a control unit that outputs a control signal related to stream data recording processing, a clock unit that holds current time information, a stream An input unit that receives data input and adds a time stamp obtained from the clock unit to the stream data; an external control signal communication unit that receives a control signal from the control unit and transmits / receives the control signal to / from an external device; An external input unit that receives stream data from an external device, an encoding unit that receives a control signal from the control unit, receives stream data from the input unit, and performs encoding; and stream data encoded by the encoding unit Is stored in a buffer and the buffer from the external control signal communication unit is In response to a ring start instruction, multiplexing is performed by extracting a plurality of stream data stored in the buffer management unit and the buffer management unit that stores the stream data input in the external input unit in a buffer, and performing multiplexing And a plurality of streams are multiplexed in consideration of encoding processing delay and transfer delay.

  With this configuration, when there is a delay in moving image transfer between devices, a moving image shot by another device and a moving image shot by the own device can be multiplexed and recorded in real time.

  According to the multi-stream multiplexed recording apparatus of the present invention, when there are a plurality of devices that can shoot a moving image and there is a delay in transferring a moving image between the devices, the moving image captured by another device and the own device The moving images can be multiplexed and recorded in real time according to the shooting time.

  Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment 1)
FIG. 1 is a diagram showing a configuration of a multi-stream multiplexed recording apparatus according to Embodiment 1 of the present invention.

  In FIG. 1, an apparatus 100 shows the entire multiple stream multiplexed recording apparatus.

  The input unit 10 is means for converting external information such as visible light and sound into stream data that is an electrical signal so that the device can handle the external information, and corresponds to a camera, a microphone, or the like. The time information obtained from the clock unit 20 is added to the acquired stream data and sent to the encoder unit 40. Note that the camera can shoot not only still images but also moving images, and the input target stream data may be either moving image data / audio data or both.

  The clock unit 20 holds time information and provides it to the input unit 10 and the control unit 30. The time information may be generated by incorporating hardware called a real-time clock inside, a GPS receiver may be incorporated, and information obtained from GPS may be used, or NTP (Network Time Protocol) may be used. You may obtain it via the Internet. Note that this time information is always kept the same in the devices 100, 200, and 300.

  The control unit 30 is a recording start switch, a recording stop switch, or the like, and receives an operation from the user. The received operation is converted into a signal and transmitted to the encoder unit 40 and the external control signal communication unit 60.

  When receiving the recording start signal from the control unit 30, the encoding unit 40 receives stream data from the input unit 10 and encodes it using an encoding method such as MPEG2, MPEG4, AAC, A3C, MP3. The encoded data is sent to the external output unit 50 and the buffer management unit 70.

  The external output unit 50 transmits the stream data encoded by the encoding unit 40 to an external device connected by a method such as Ethernet, wireless LAN, IEEE1394, USB, or Bluetooth.

  The external input unit 51 receives encoded stream data from an external device connected by a method such as Ethernet, wireless LAN, IEEE 1394, USB, or Bluetooth.

  The external control signal communication unit 60 transmits and receives control signals to and from an external device connected by a method such as Ethernet, wireless LAN, IEEE 1394, USB, and Bluetooth. A control signal is also received from the control unit 30. Further, it issues a buffering start instruction and a buffering stop instruction to the buffer management unit 70.

  The buffer management unit 70 receives the stream data received from the encoding unit 40 and the external input unit 51, receives a buffering start instruction and a buffering stop instruction from the external control signal communication unit 60, and receives a RAM or a secondary storage device. The buffering is started and stopped in the recording area.

  The multiplexing unit 80 takes out a plurality of stream data recorded by the buffer management unit 70 and performs multiplexing processing if there is stream data at the same time.

  The recording unit 90 records the data multiplexed by the multiplexing unit 80 on an optical disk such as a DVD-RAM, a memory card such as an SD card, and a magnetic disk such as a hard disk.

  FIG. 2 shows a connection configuration when connecting by a method such as Ethernet, wireless LAN, IEEE 1394, USB, Bluetooth, etc. when there are three multi-stream multiplexed recording apparatuses in the first embodiment of the present invention.

  In FIG. 2, the devices 100, 200, and 300 are the same as the device 100 shown in FIG. The external output units 50, 250, and 350 are the same as the external output unit 50 shown in FIG. 1, and the external input units 51, 251, and 351 are the same as the external output unit 51 shown in FIG. The external control signal communication units 60, 260, and 360 are the same as the external control signal communication unit 60 shown in FIG.

  The connection 501 indicates that the external output unit 50 is connected to the external input units 251 and 351, and that the stream data output from the external output unit 50 is transmitted to the external input units 251 and 351. It is obvious that the connections 502 and 503 indicate the same connection as the connection 501.

  The connection 600 connects the external control signal communication units 60, 260, and 360, and transmits and receives control signals generated from the devices 100, 200, and 300, respectively.

  The operation of the multi-stream multiplexed recording apparatus configured as described above will be described.

(Recording of stream data of apparatus 100)
First, a case where stream data is acquired only from the input unit of the apparatus 100 and recorded in the recording unit of the apparatus 100 will be described.

  FIG. 3 shows a sequence in which stream data is acquired from the input unit 10 of the apparatus 100 and recorded in the recording unit 90. At this time, stream data is not input from the external input unit 51. In addition, the apparatus 100 is activated here, and stream data such as a moving image and audio is created in the input unit 10, time information acquired from the clock unit 20 is added to the stream data, and transmitted to the encoding unit 40. Will be described.

  When the user of the apparatus 100 presses the recording start button, the control unit 30 senses that the recording start button has been pressed, and acquires the current recording start time T31 from the clock unit 20 (S301). Next, the control unit 30 notifies the encoding unit 40 of recording start (S302). Next, the control unit 30 notifies the external control signal communication unit 60 of the recording start notification and the recording start time T31 (S303).

  When receiving the recording start signal and the recording start time T31 from the control unit 30, the external control signal communication unit 60 transmits the recording start signal and the recording start time T31 to the other devices connected to the connection 600 ( S304). Next, the external control signal communication unit 60 notifies the buffer management unit 70 of a buffering start instruction and a recording start time T31 (S305).

  When receiving the recording start signal from the control unit 30, the encoding unit 40 receives stream data from the input unit 10 and starts encoding (S306). The encoded stream data is sent to the buffer management unit 70 and the external output control unit 50 (S307). The stream data sent to the external output unit 50 is sent to the device 200 or 300 through the connection 500 (S308).

  When the buffer management unit 70 receives a buffering start request from the external control signal communication unit 60, the buffer management unit 70 adds 1 to the number of buffering. In this case, the buffering number changes from 0 to 1. When the buffering number is 1, the buffer management unit determines that there is no stream data to be buffered, and transmits the stream data obtained from the encoding unit 40 to the multiplexing unit 80 as it is (S309). A detailed sequence of the buffer management unit 70 will be described later.

  Since the stream data received from the buffer management unit 70 is a single stream data, the multiplexing unit 80 transmits the stream data to the recording unit without multiplexing (S310).

  The recording unit 90 records the stream data received from the multiplexing unit 80 on a recording medium (S311).

(Multiple recording of stream data of apparatus 100 and apparatus 200)
Subsequently, recording of the device 200 starts from the above state, and stream data acquired by the input unit of the device 200 and encoded by the encoding unit is input to the external input unit 51 of the device 100 through the external output unit 250 and multiplexed. A case of recording will be described.

  FIG. 4 shows a sequence in which stream data is acquired from the input unit 10 of the apparatus 100, stream data is also acquired from the external input unit 51, multiplexed by the multiplexing unit 80, and then recorded in the recording unit 90. Represents.

  When the recording start button of the apparatus 200 is pressed, the apparatus 200 transmits a recording start signal and its recording start time T32 from the external control signal communication unit 260. The recording start signal and the recording start time T32 are sent to the external control signal communication unit 60 of the apparatus 100 through the connection 600. The stream data acquired from the input unit of the apparatus 200 is encoded and transmitted from the external output unit 250. The transmitted stream data is sent to the external input control unit 51 of the apparatus 100 through the connection 502. Note that transfer of stream data requires a long time for encoding and a large amount of data compared to a still image or the like, so that a network delay is large at the time of transfer. Therefore, there is a time delay from the arrival of the recording start signal to the external control signal communication unit 60 until the stream data reaches the external input unit 51.

  When receiving the recording start signal and the recording start time T32 (S401), the external control signal communication unit 60 sends a buffering start request and the recording start time T32 to the buffer management unit 70 (S402).

  When the buffer management unit 70 receives a buffering start request from the external control signal communication unit 60, the buffer management unit 70 adds 1 to the number of buffering (S403). In this case, the buffering number changes from 1 to 2. When the buffering number is 2, the buffer management unit 70 determines that the buffering of the encoder unit 40 needs to be started, and starts buffering the stream data obtained from the encoding unit 40 (S404). A detailed sequence of the buffer management unit 70 will be described later.

  When the external input unit 51 receives the stream data through the connection 502 (S405), it sends the received stream data to the buffer management unit 70 (S406).

  The buffer management unit 70 that has received the stream data from the external input unit 51 starts buffering the stream data (S407). Next, the buffer management unit 70 searches for stream data at the recording start time T32 in the buffer, and transmits the searched stream data to the multiplexing unit 80 (S408). It should be noted that the stream data at the time after the recording start time T32 is also searched for and transmitted to the multiplexing unit 80. A detailed sequence of the buffer management unit 70 will be described later.

  The multiplexing unit 80 multiplexes the stream data at the same time received from the buffer management unit 70. The multiplexed data is transmitted to the recording unit 90 (S408).

  The recording unit 90 records the received stream data on a recording medium (S409).

  As described above, the stream data acquired by the other device and the stream data acquired by the own device in an environment where there is a network delay and in addition, the recording start timing of the other device cannot be controlled by the own device side. Multiplexed recording is possible.

(Buffer manager when receiving a buffering start request)
FIG. 5 shows a sequence of the buffer management unit 70 until a buffering start request is received from the external control signal communication unit 60, buffering is performed, and stream data is transmitted to the multiplexing unit 80.

  First, when receiving a buffering start request and a recording start time T10 from the external control signal communication unit 60, the buffer management unit 70 adds 1 to the number of buffering (S501).

  Next, the buffer management unit 70 checks the current number of buffering (S502). At this time, if the buffering number is 1, it can be determined that the recording is only from the input of the own device, so the stream data is received from the encoding unit 40 and transmitted to the multiplexing unit 80 as it is (S503). If the number of buffering is 2 or more, it can be determined that there is an input from another device in addition to the input from the own device, so buffering is started. At this time, if the buffering of the stream data received from the encoding unit 40 is not performed, the buffering is started (S504).

  When the external input unit 51 receives the stream data, it transmits it to the buffer management unit 70. The buffer management unit 70 receives the stream data and performs buffering (S505).

  Next, the buffer management unit 70 checks whether or not the same number of stream data as the buffering request exists in the buffer (S506). If not, it waits for stream data to be transmitted from the external input unit 51. If there is, the stream data at the recording start time T10 is searched from the buffer (S507) and transmitted to the multiplexing unit 80 (S508). It should be noted that the stream data at the time after the recording start time T10 is also searched and the transmission to the multiplexing unit 80 is continued.

  Then, the stream data transmitted to the multiplexing unit is deleted from the buffer (S509).

(Multi-recording stop when device 200 stops recording)
Subsequently, from the above state, the recording of the device 200 is stopped, the output of the stream data from the external output unit 250 is stopped, the multiplexed recording of the device 100 is finished, and only the stream from the input unit of the device 100 is recorded. A description will be given of the case.

  FIG. 6 shows that the stream data from the external input unit 51 out of the stream data acquired from the input unit 10 and the external input unit 51 of the apparatus 100 is stopped, and only the input unit 10 records stream data from the multiplexed recording. It shows the sequence to switch.

  When the recording stop button of the apparatus 200 is pressed, the apparatus 200 transmits a recording stop signal and its recording start time T33 from the external control signal communication unit 260. The recording stop signal and the recording stop time T33 are sent to the external control signal communication unit 60 of the apparatus 100 through the connection 600. In addition, the apparatus 200 stops encoding the stream data acquired from the input unit, and also stops transmission to the external output unit 250. For this reason, transmission of stream data transmitted from the external output unit 250 is also stopped. Note that transfer of stream data requires a long time for encoding and a large amount of data compared to a still image or the like, so that a network delay is large at the time of transfer. Therefore, there is a time delay from when the recording stop signal arrives at the external control signal communication unit 60 until when the final stream data arrives at the external input unit 51.

  The external control signal communication unit 60 receives the recording stop signal and the recording stop time T11 through the connection 600 (S601). Next, the buffering stop request and the recording stop time T11 are sent to the buffer management unit 70 (S602).

  Upon receiving the buffering stop request and the recording stop time T11, the buffer management unit 70 decreases the buffering number by one. At this time, the buffering number is changed from 2 to 1 (S603). However, buffering is not stopped immediately, but stream data at the same time is searched and transmission to the multiplexing unit 80 is continued (S604). After that, if the time of the searched stream data becomes the same as the recording stop time T11, the stream data from the external input unit 51 does not reach (S605), so the stream data received from the encoder unit 40 is sent to the multiplexing unit 80. Only, and buffering of the stream data from the encoder unit 40 is stopped (S606).

  Next, since the number of stream data received by the buffer management unit 70 changes from two to one, the multiplexing unit 80 stops multiplexing and sends the stream data to the recording unit 90 as it is.

  The recording unit 90 records the stream data received from the multiplexing unit 80 on a recording medium.

(Buffer manager when receiving a buffering stop request)
FIG. 7 shows a sequence of the buffer management unit 70 from when the buffering stop request is received from the external control signal communication unit 60 until the buffering is stopped.

  First, when receiving a buffering stop request and the recording stop time T11 from the external control signal communication unit 60, the buffer management unit 70 subtracts 1 from the buffering number (S701).

  Next, the number of buffering is checked (S702). If the buffering number is 0, it means that no stream data has been input from anywhere, and therefore reception of stream data from the encoder unit 40 is stopped (S703).

  Here, if the buffering number is 1 or more, it is checked whether the time of the currently searched stream data is the recording stop time T11 (S704). If they are different as a result of the examination, the stream data at the same time is extracted from the buffer (S705), the extracted stream data is sent to the multiplexing unit 80 (S706), and the transmitted stream data is deleted from the buffer (S707). ). In the same case, the number of stream data is reduced by one.

  Next, the buffering number is checked again (S708). If the number of buffering is 1, it can be determined that only the stream data from the encoding unit 40, so the buffering of the stream data from the encoding unit 40 is stopped (S709), and the input from the encoding unit 40 is directly multiplexed. It is sent to 80 as it is (S710). When the number of buffering is 2 or more, the multiplexing is continued for the stream data other than the one stopped this time.

  As described above, when there are multiple devices that can shoot movies, there is a delay in transferring movies between devices, and when the recording start and stop of other devices cannot be controlled from the own device, the image was taken with the other device. It is possible to multiplex and record a moving picture and a moving picture taken with the device itself in real time.

(Embodiment 2)
FIG. 8 is a diagram showing the configuration of the multiple stream multiplexed recording apparatus according to the second embodiment of the present invention. In FIG. 8, the same components as those in FIGS. 1 and 2 are denoted by the same reference numerals, and description thereof is omitted. Hereinafter, the apparatus 100 according to the first embodiment will be described by replacing the apparatus 101 with the apparatus 101.

  In FIG. 8, the negotiation unit 800 adjusts the recording start timing through the external device connected via the connection 600 and the external control signal communication unit 60. Note that a delay occurs even in communication using the connection 600.

  The operation of the multi-stream multiplexed recording apparatus configured as described above will be described. The stream data recording processing sequence of the apparatus 101 and the recording stop process sequence of the apparatus 200 are the same as those in the first embodiment, so here the stream data of the apparatus 101 and the apparatus 200 are recorded. Only multiplexed recording will be described.

  FIG. 9 is a flowchart showing the processing sequence of the multiple stream multiplexing recording apparatus according to the second embodiment of the present invention. 9, the same processes as those in FIG. 4 are denoted by the same reference numerals, and the description thereof is omitted.

  In the device 101, the stream data is acquired from the input unit 10, encoded by the encoder unit 40, and recorded by the recording unit 90 through the buffer management unit 70 and the multiplexing unit 80. A case will be described in which stream data acquired by the input unit of the apparatus 200 and encoded by the encoding unit is input to the external input unit 51 of the apparatus 100 through the external output unit 250 and is multiplexed and recorded.

  First, when a recording start button is pressed in the apparatus 200, a recording start preparation signal reaches the external control signal communication section 60 of the apparatus 101 from the external control signal communication section 260. The external control signal communication unit 60 sends it to the negotiation unit 800. However, the recording of the apparatus 200 has not started at this time.

  The negotiation unit 800 sends a recording start acceptance signal to the apparatus 200 through the external control signal communication unit 60 (S901), and sends a recording start signal to the external control signal communication unit 60 (S903).

  Next, when receiving the recording start signal (S904), the external control signal communication unit 60 issues a buffering start request to the buffer management unit 70 (S905).

  The subsequent steps are the same as those after S403 in FIG.

  As described above, when there are multiple devices that can shoot movies, there is a delay in transferring movies between devices, and when the recording start and stop of other devices cannot be controlled from the own device, the image was taken with the other device. It is possible to multiplex and record a moving picture and a moving picture taken with the device itself in real time.

(Embodiment 3)
FIG. 10 is a diagram showing the configuration of the multiple stream multiplexed recording apparatus according to the third embodiment of the present invention. 9, the same components as those in FIGS. 1 and 2 are denoted by the same reference numerals, and description thereof is omitted. Hereinafter, the apparatus 100 according to the first embodiment will be described by replacing the apparatus 102 with the apparatus 102.

  In FIG. 10, the delay amount measuring unit 1000 measures the delay amount related to communication of the control signal with the external device through the external control signal communication unit 60 and the external device connected by the connection 600. Note that a delay occurs even in communication using the connection 600.

  The delay buffer unit 1010 receives the stream data transmitted from the encoding unit 40, stores the stream data in the buffer for the delay time received from the delay time measurement unit 1000, and transmits the stream data that has passed the delay time to the buffer management unit 70. To do.

  The operation of the multi-stream multiplexed recording apparatus configured as described above will be described. The processing sequence for multiplexing recording of the stream data of the apparatus 102 and the apparatus 200 and the processing sequence for stopping the multiplexing recording when the recording stop of the apparatus 200 are the same as those in the first embodiment. Only the recording processing sequence will be described.

  FIG. 11 is a flowchart showing a stream data recording process sequence of the apparatus 102 in the multiple stream multiplexed recording apparatus according to the third embodiment of the present invention.

  When the apparatus 102 is activated, stream data such as a moving image or sound is created in the input unit 10, the time acquired by the clock unit 20 is added to the created stream data, and the encoded data is transmitted to the encoding unit 40.

  When the user of the apparatus 102 presses the recording start button in this state, the control unit 30 senses that the recording start button has been pressed, and acquires the current recording start time T31 from the clock unit 20 (S1101). ). Next, the control unit 30 notifies the encoding unit 40 of recording start (S1102). Next, the control unit 30 notifies the delay time measurement unit 1000 of a recording start notification and a recording start time T31 (S1103).

  The delay time measurement unit 1000 checks the time required for communication with the external device through the external control signal communication unit 60 (S1104). Specifically, measurement is performed using a Ping command or the like. If the delay time can be measured, the delay time is notified to the delay buffer unit 1010 (S1105). The delay time measurement unit 1000 measures the delay time at regular intervals and notifies the delay buffer unit 1010 of the results one by one. Then, the recording start notification and the recording start time T31 are notified to the external control signal communication unit 60 (S1106).

  When receiving the recording start signal and the recording start time T31 from the control unit 30, the external control signal communication unit 60 transmits the recording start signal and the recording start time T31 to the other devices connected to the connection 600 ( S1107). Next, the external control signal communication unit 60 notifies the buffer management unit 70 of a buffering start instruction and a recording start time T31 (S1108).

  When receiving the recording start signal from the control unit 30, the encoding unit 40 receives stream data from the input unit 20 and starts encoding (S1109). The stream data that has been encoded is sent to the buffer management unit 70 and the external output control unit 50 (S1110). The stream data sent to the external output unit 50 is sent to the device 200 or the device 300 through the connection 500 (S1111).

  The delay buffer unit 1010 accumulates the stream data received from the encoding unit 40 in the internal delay buffer for the delay time + margin notified from the delay time measurement unit 1000 (S1112). Stream data accumulated in the delay buffer after the delay time is sequentially transmitted to the buffer management unit 70 (S1113). The delay buffer unit 1010 receives a delay time report from the delay time measurement unit 1000, and changes the amount of stream data stored in the delay buffer each time.

  When the buffer management unit 70 receives a buffering start request from the external control signal communication unit 60, the buffer management unit 70 adds 1 to the number of buffering. In this case, the buffering number changes from 0 to 1. When the buffering number is 1, the buffer management unit determines that there is no stream data to be buffered, and transmits the stream data obtained from the encoding unit 40 to the multiplexing unit 80 as it is (S1114). A detailed sequence of the buffer management unit 70 will be described later.

  Since the stream data received from the buffer management unit 70 is a single stream data, the multiplexing unit 80 transmits the stream data to the recording unit without multiplexing (S1115).

  The recording unit 90 records the stream data received from the multiplexing unit 80 on a recording medium (S1116).

  The subsequent processing sequence is the same as the processing sequence of the multiplexed recording of the stream data of the mobile device 1 and the device 200 of the embodiment, and the processing sequence of the multiplexed recording stop accompanying the recording stop of the device 200.

  As described above, when there are multiple devices that can shoot movies, there is a delay in transferring movies between devices, and when the recording start and stop of other devices cannot be controlled from the own device, the image was taken with the other device. It is possible to multiplex and record a moving picture and a moving picture taken with the device itself in real time.

  The multi-stream multiplexing recording apparatus according to the present invention is useful for a video camera having a camera and a microphone and having a recording device in its own device. Further, it can be applied to uses such as a mobile phone, a digital still camera, a PC, and an information processing terminal having a camera function capable of shooting a moving image.

The figure which shows the structure of the multiple stream multiplexing recording device in Embodiment 1 of this invention. The figure which shows the connection between the multiple stream multiplexing recording apparatuses in Embodiment 1 of this invention The flowchart which shows the processing sequence of the recording of the stream data of the apparatus 100 in Embodiment 1 of this invention. The flowchart which shows the process sequence of the multiplexing recording of the stream data of the apparatus 100 and the apparatus 200 in Embodiment 1 of this invention The flowchart which shows the process sequence of the buffer management part at the time of buffering start request reception in Embodiment 1 of this invention The flowchart which shows the process sequence of a multiplexed recording stop with the recording stop of the apparatus 200 in Embodiment 1 of this invention. The flowchart which shows the processing sequence of the buffer management part at the time of buffering stop request | requirement reception in Embodiment 1 of this invention The figure which shows the structure of the multiple stream multiplexing recording device in Embodiment 2 of this invention. The flowchart which shows the process sequence of the multiplexing recording of the stream data of the apparatus 101 and the apparatus 200 in Embodiment 2 of this invention The figure which shows the structure of the multiple stream multiplexing recording device in Embodiment 3 of this invention. The flowchart which shows the processing sequence of the recording of the stream data of the apparatus 102 in Embodiment 3 of this invention.

Explanation of symbols

100, 101, 102, 200, 300 Multiple stream multiplexing recording apparatus 10 Input unit 20 Clock unit 30 Control unit 40 Encoding unit 50, 250, 350 External output unit 51,251,351 External input unit 60,360,360 External control Signal communication unit 70 Buffer management unit 80 Multiplexing unit 90 Recording unit 800 Negotiation unit 1000 Delay time measurement unit 1010 Delay buffer unit

Claims (5)

An apparatus for multiplexing and recording a plurality of stream data,
A control unit that outputs a control signal related to the recording process of the stream data;
A clock section holding current time information;
An input unit that receives stream data input and adds a time stamp obtained from the clock unit to the stream data;
An external control signal communication unit that receives a control signal from the control unit and transmits / receives a control signal to / from an external device;
An external input unit for receiving stream data from an external device;
An encoding unit that receives a control signal from the control unit, receives stream data from the input unit, and performs encoding;
Buffer management for storing the stream data encoded by the encoding unit in a buffer and storing the stream data input by the external input unit in response to a buffering start instruction from the external control signal communication unit And
A multi-stream multiplexed recording apparatus comprising: a multiplexing unit that extracts and multiplexes a plurality of stream data stored in the buffer management unit. 2. The buffer management unit according to claim 1, wherein the buffer management unit stops storing the stream data input by the external input unit in a buffer in response to a buffering stop instruction from the external control signal communication unit. Multiple stream multiplexing recording apparatus. The multi-stream multiplexed recording apparatus according to claim 1, further comprising an external output unit that outputs the stream data output from the encoding unit to an external device. When the external control signal communication unit receives a recording start preparation completion signal from an external device, the external control signal communication unit includes a negotiation unit that notifies a recording start signal to another device via the external control signal communication unit. The multi-stream multiplexed recording apparatus according to claim 1. A delay time measuring unit that measures a delay time generated when the external control signal communication unit receives a control signal from an external device based on time information from the clock unit;
A delay buffer unit is provided that stores the stream data received from the encoding unit in a delay buffer for a delay time measured by the delay time measuring unit, and sends the data to the buffer management unit when the delay time elapses. The multi-stream multiplexed recording apparatus according to claim 1.

Images