JP3552538B2 - Data retrieval device - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention provides a multimedia title playback system that multiplexes multimedia data into stream data, and plays back a multimedia title using the data. In a multimedia title playback method, data management that implements a forward jump and a backward jump is provided. And a data search method.
[0002]
[Prior art]
As a data format for reproducing a multimedia title, there is a method of multiplexing all data necessary for a title and storing the multiplexed data in one stream data. The stream data is transmitted from the server to the client, and the client demultiplexes the stream and reproduces the title. As a multiplexing method, H.264 used in a TV conference system or the like is used. H.223 and RTP used in LAN systems and the like are known.
[0003]
The multimedia title is for displaying a moving image, a sound, a still image, a text (character), or the like at a predetermined time according to the elapsed playback time of the title, or turning off the display. Therefore, in order to reproduce a multimedia title, all of the data must be present at the title reproduction terminal (client terminal) by the time at which the respective data is displayed. That is, all of the data must be transmitted from the server to the client, which is the title playback terminal, through the transmission of the stream data before the display time of each data. Therefore, when multiplexing each data to generate stream data, a transmission schedule is set in consideration of a data transmission band and a data capacity of each data, and each data is multiplexed accordingly.
[0004]
[Problems to be solved by the invention]
Usually, in the reproduction of a moving image, it is not difficult to perform a forward or backward jump (forward or backward). It is only necessary to seek and change the playback position. However, when a multimedia title is reproduced using the above-mentioned stream data, it is difficult to jump in the forward direction or the backward direction. This is because the stream data to be sought is set in advance with a transmission schedule in accordance with the display time of each data and multiplexed accordingly. This is illustrated in FIG.
Here, a title in which one moving image, two still images, and one text are displayed in time is taken as an example. Along with the time axis, a still image 1 is displayed where a moving image is displayed, a still image 2 is displayed later, and finally a text is displayed. each Material data Depends on each data capacity and transmission band. Material data The time required for data transmission is known for each case. So each Material data A time obtained by subtracting the required data transmission time from the displayed time is scheduled as the data transmission start time. Furthermore, according to this schedule, Material Multiplex the data.
[0005]
In the reproduction of this title, if a forward or backward jump is performed, data that would have been transmitted through stream data from the server to the client due to seek will not be transmitted. This is illustrated in FIG.
If the title is reproduced by reading or acquiring the stream data, and the position of the acquired stream data is changed by a jump, data that is not read or acquired by the jump occurs. Therefore, if the reproduction is continued as it is, the data necessary for display is insufficient even at the display time, and the display cannot be performed.
[0006]
On the other hand, isochronous data such as video and audio multiplexed in a stream differs from still images and texts (hereinafter referred to as non-video data) when compared to non-video data. Only the data multiplexed in the stream after the destination by the seek is required regardless of the display time. Data that is no longer transmitted to the client due to the seek is unnecessary. In the case of a moving image or the like of inter-frame correlation such as MPEG, when the specified jump position is a P frame or the like (difference data), micro adjustment such as jumping to an I frame (basic data) near the time position is performed. Is performed.
[0007]
As described above, in order to realize the forward and backward jumps, it is necessary to transmit still image and text data which are not transmitted by the jump to the client and correct the schedule inconsistency caused by the jump. . However, some untransmitted data that will not be transmitted due to a jump may be unnecessary on the client side depending on the title display status at the destination of the title playback position. This means that the jump destination already Material data Is completed. In the playback after the jump destination, Material data Will not be displayed after that, so there is no problem if you leave it without enough data. If data including unnecessary data is sent to the client and the data is complemented for reproduction after jumping, unnecessary data transfer time is required, and the response is deteriorated by this lag time.
[0008]
FIG. 14 shows supplementary data for correcting a schedule mismatch in a forward jump. Here, an example of jumping from time t1 to t2 is described. After the time t2, the display of the still image 1 is finished. Therefore, in the transmission time of the still image 1, the data in the gray portion is data that is not transmitted due to the jump, but becomes unnecessary after the time t2 at the jump destination. On the other hand, since the display end time of the still image 2 is after the time t2, it is necessary to complement a black portion not transmitted by the jump.
[0009]
An example of a backward jump is shown in FIG. Here, it is assumed that the client does not discard once acquired data but retains it. (Of course, there is a case where the data is discarded and not retained, but this is omitted here.) At this time, no problem occurs even if the reproduced portion is reproduced again by the backward jump. This is because the client holds that part of the data and no data to supplement is generated. However, a problem arises when a stream in a certain section is skipped by performing a forward jump, and then the section is returned to the corresponding section by a backward jump.
[0010]
In FIG. 15, first, a forward jump is performed from time b1 to b2. In the still image 1, data until time b1 is transmitted. In the forward jump, the black portion of the data of the still image data 2 needs to be complemented as supplementary data. After this jump, playback is performed a little, and at time b4, a backward jump is performed to b3. After this backward jump, normal reproduction is started from b3, but since the display end time is after b3, data complementation is required. However, since the gray part is the data transmitted in the past, it is held by the client and does not need to be supplemented. However, the black areas need to be complemented. In order to distinguish between them, the history of data transmitted in the past must be managed.
[0011]
As described above, in the jump operation in which necessary data is transmitted from the server to the client to complement the data, and then the reproduction is continued using the stream after the jump destination position, the data which is not transmitted due to the jump Among them, there arises a problem that it is necessary to identify unnecessary data and necessary data in reproducing the title and to extract data to be supplemented.
[0012]
Therefore, in the present invention,
An object of the present invention is to provide a data management and retrieval method for realizing forward and backward jump reproduction in a multimedia title reproduction method using a stream in which multimedia data is multiplexed.
[0013]
[Means for Solving the Problems]
The present invention solves the above problems, the present invention first,
When creating stream data in which multimedia data is multiplexed mainly in order to realize a forward jump, stream generation information including information on storage positions of non-moving image data such as multiplexed still images and texts, Searching for data to be complemented from information on the current playback position and jump destination playback position from the client using scenario information consisting of information on the time at which non-video data is displayed and the time at which the display is turned off and not displayed It was done.
As a result, in the multimedia title playback method using a stream in which multimedia data is multiplexed, an effect is obtained that a forward jump during title playback can be realized.
[0014]
The present invention secondly
In the client terminal, if the data sent from the server is discarded (not retained) when the display is completed, the search range of data to be complemented is changed in order to realize a jump in the reverse direction (; (The backward jump is treated as a forward jump from the head position of the data to the jump position).
As a result, the client terminal discards the data sent from the server after the display is completed and does not hold the data. In a multimedia title playback method using a stream in which multimedia data is multiplexed, a backward jump during title playback is prevented. realizable
The effect is obtained.
[0015]
Third, the present invention
In the client terminal, if data once sent from the server is not discarded (it is always held until title playback is completed), a data transmission end table creating means and a previous It has original position information management means for managing the position at which playback has started, and transmission history management table management means.
As a result, the client terminal always retains the data sent from the server without discarding it until the title reproduction is completed. In the multimedia title reproduction method using a stream in which multimedia data is multiplexed, the title being reproduced during the title reproduction is used. An effect that a backward jump can be realized is obtained.
[0016]
In other words, in the present invention, by the above-described mechanism,
In a multimedia title playback method using a stream in which multimedia data is multiplexed, the client terminal does not hold the data transmitted from the server until the end of the title playback. There is an effect that data to be complemented can sometimes be searched from the server to the client terminal.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to FIGS. The present invention is not limited to these embodiments at all, and can be implemented in various modes without departing from the gist thereof.
[0018]
(Embodiment 1)
FIG. 1 is a configuration diagram showing the configuration of the present invention.
In FIG. 1, reference numeral 11 denotes stream data. stream The stream generation information management means 12 for managing the generation information includes the stream generation information managed by the stream generation information management means 11 for the stream being reproduced. stream A stream generation information table generating means for generating a stream generation information table from the generation information; stream A data transmission start table generating means for generating a data transmission start table from the generated information; data Information management means for managing scenario information including information on the display time and the display cancellation time of the title. Reference numeral 15 denotes a scenario of the title being reproduced from the scenario information management means. information A scenario information table creating means 16 for creating a scenario information table from the data is a supplementary data search means for searching for data to be complemented from the table, the input jump destination position information and the current reproduction position information.
[0019]
FIG. 2 is an example of a stream generation information table created by the stream generation information table creation means 12. This table is multiplexed with stream data Material data And a block number indicating a position on the stream data where each piece of material data is stored. In the example of FIG. Material data Is that Material data Are stored in six blocks of block numbers 3, 6, 9, 12, 15, and 18 on the stream data. Material data Indicates that it is composed of these six blocks. Block numbers not described here, for example, blocks of block numbers 1, 2, 4, and 5 indicate that data other than non-moving image data, such as moving images and audio, is stored.
[0020]
FIG. 3 is an example of a data transmission start table created by the data transmission start table creating means 13. This table is multiplexed with stream data Material data And a block number for starting transmission of each piece of material data.
[0021]
FIG. 4 is an example of a scenario information table created by the scenario information table creating means 15. This table is multiplexed with stream data Material data Material ID or material identifier and Material data It consists of the display end time of. Here, the display end time is converted into a block number on the stream data.
[0022]
When a forward jump occurs during title playback, transmission of stream data between the server and the client terminal is stopped first. Next, complementary data is searched from the jump destination position information and the current reproduction position information, and data to be complemented is transmitted from the server to the client. Then, in order to change the reproduction position, the server starts transmission again from the stream data at the jump destination position.
[0023]
FIG. 5 is a flowchart showing a flow of a process of searching for complementary data performed by the complementary data searching means from the jump destination position information and the current reproduction position information. The operation will be described below with reference to FIGS.
[0024]
In FIG. 5, first, a stream generation table is created (step 501). An example of the stream generation table is shown in FIG. 2 and described above. Next, a data transmission start table is created (step 502). An example of the data transmission start table created here is shown in FIG. 3 and described above. This table is sorted in ascending order of transmission start block number. Further, a scenario information table is created (step 503). An example of the scenario information table is shown in FIG. Tashi Create based on nario information.
Here, the scenario information is at least Material data It consists of information of display start time and end time for each. When creating a scenario information table from this scenario (information), each time is converted to a block number on the stream. If each block has a fixed length, the display time is T, and the block number k on the stream is k = TxN from the number N of blocks stored in the stream data transmitted per unit time from the server to the client during title playback. Required by If each block has a variable length, a correspondence table of each block number and time is created when the stream is created, and based on this, the display time and block number may be converted. This table is sorted by the display end block number. The processing order of steps 501 to 503 up to this point does not matter.
[0025]
Next, when a jump occurs, the jump destination position information and the current reproduction position information are input to the complementary data search means (step 504). The positions of these two pieces of information are also assumed to be block numbers. The conversion between the time and the block number has been described above. Here, as an example, the current playback position is block number 16 and the jump destination position is block number 64.
[0026]
Information supplementary data search means,
(1) The transmission start block number from the data transmission start table is before the jump destination position Material data (Step 505). From the data transmission start table example of FIG. 3, the transmission start block number is earlier than the jump destination position block number 64. Material data Are the four material IDs 1, 2, 3, and 4. Material data It can be seen that it is. further,
(2) If the display end block number from the scenario information table is Material data (Step 506). From the example of the scenario information table of FIG. 4, the display end block number is after the jump destination position block number 64. Material data Are two of material ID4 and 5. Material data It can be seen that it is.
When a duplicate material ID is extracted by these two searches (step 506), the material ID 4 Material data It turns out that only applies.
[0027]
So I extracted Material data Only from the stream generation information table Material data Each time, a block number between the jump destination position and the current reproduction position is searched (step 508). In other words, it can be seen from FIG. 2 of the stream generation information table that the blocks of the material ID 4 between the block numbers 16 and 64 are four blocks of 45, 50, 55, and 60. Should be supplemented from this result Material data Then, the data portion is calculated (step 509), and it can be understood that the data from the top four blocks in the material file corresponding to the material ID 4 should be complemented from the server to the client as supplementary data. Here, the data amount of the data for the four blocks from the beginning can be easily understood if the block length is fixed. Even if the block length is variable, it can be obtained by creating a correspondence table between each block number and the block length when the stream is generated.
[0028]
Note that, in FIG. 5, the part A, that is, steps 501 to 503 may be processed in step B between steps 504 and 505. Further, the processing of the part A does not need to be performed in the second and subsequent searches.
[0029]
As described above, in the present embodiment,
Stream generation information management means for managing stream generation information comprising information of material data multiplexed with stream data and material data storage position information, and data transmission start table creation means for creating a data transmission start table from the stream generation information ,each Material data Scenario information management means for managing scenario information consisting of information on display time and display cancellation time, scenario information table creation means for creating a scenario information table from the scenario information, jump position information and current playback position information Complementary data search means to search for data to be complemented with information as input (; (1) (2) See etc. )
In a multimedia title playback system using a stream in which multimedia data is multiplexed, an effect that a search for complementary data for a forward jump during title playback can be realized is obtained, and the practical effect is great.
[0030]
(Embodiment 2) ) FIG. 6 is a functional block diagram of the data search device according to the present embodiment. The components denoted by reference numerals 61 to 66 are the same as the components 11 to 16 in FIG. 1 described in the first embodiment. The difference is that when the position information of the jump destination and the information of the current playback position are input to the complementary data search means 66, the current playback position is set as the head of the stream data, and the complementary data search for changing the search range of the complementary data is performed. That is, a range changing means 67 is provided.
[0031]
FIG. 7 is a flowchart showing a flow of processing for searching for complementary data performed by the complementary data search means from the jump destination position information and the current reproduction position information. This will be described in conjunction with FIGS.
[0032]
FIG. 7 is substantially the same as FIG. 5 described in the first embodiment, except that the search range changing means changes the current playback position to the beginning of the title, that is, block number 0 (step 705). From the scenario information table, the current playback position block input to the complementary data search means in step 704 is earlier than the display end block. Material data , And delete this material ID from the material ID group extracted in step 708 (step 709). Set That's it.
[0033]
Hereinafter, the complementary data search processing will be described by taking an example of performing a jump in the reverse direction with the block number 57 as the current playback position and the block number 42 as the jump destination position.
Steps 701, 702, 703, and 704 are the same as steps 501, 502, 503, and 504 in FIG. 5 of the first embodiment, and the order of steps 701, 702, and 703 does not matter. It is the same as in the first embodiment that the part B in steps 704 and 705 may be used. Further, the processing of the part A does not need to be performed in the second and subsequent searches. In the present embodiment, it is mainly assumed that, of the data once transmitted from the server to the client, the data whose display has been completed is not retained (; discarded) by the client. It does not matter if it is not destroyed).
[0034]
In step 705, the current playback position input to the supplementary data search means is changed to the beginning of the title, that is, 0. That is, the input current playback position block number 57 is changed to 0, and the processing is continued thereafter.
[0035]
First, in step 706, the transmission start block number is earlier than the jump destination position block number 42. Material data Search for material IDs of 1, 2, 3 Material data It can be seen that this applies. Next, from step 707, the display end block number after the jump destination position block number 42 Material data Is searched, the material ID is 2,3,4,5 Material data It can be seen that this applies. Further, from step 708, if duplicate material IDs are extracted in these two searches, it can be understood that material IDs 2 and 3 correspond.
[0036]
In step 709, the data extracted in the previous step 708 Material data From the group, the current playback position block input in step 704, that is, 57 is the previous (after; 57) from the display end block number in the scenario information table. Material data Remove. From FIG. 4, the material ID 2 Material data Indicates that the display end block number is 60, Material data It is deleted from the group, and the rest is only the material ID3. This is the end of the display Material data Data has been discarded and this Material data Data needs to be completed, and the display is not finished Material data Is not yet destroyed, and there is no need to supplement this data.
[0037]
Step 711 should supplement Material data It is understood from FIG. 2 of the stream generation table that the data to be complemented is all data of the material ID 3. Whether the jump is a forward jump or a backward jump can be determined by comparing the jump destination position block number with the current reproduction position block number.
[0038]
As described above, in the present embodiment,
The client terminal discards the data sent from the server when the display is completed (; it is assumed that the data is not retained). In the case of the multimedia title playback method using a stream in which the multimedia data is multiplexed,
The data search device according to the first embodiment includes a search range changing unit that changes a search range from the position information of the jump destination input to the complementary data search unit and the information on the current playback position.
[0039]
By paying attention to the fact that the multiplexed multimedia data to be transmitted is discarded when the display is completed, a backward jump during title playback (; it is regarded as a forward jump from the beginning to the jump position). ) Can be realized, and the practical effect is large.
[0040]
(Embodiment 3)
FIG. 8 is a configuration diagram of the third embodiment. Ah Reference numerals 801 to 807 are the same as reference numerals 601 to 607 in FIG. 6 described in the second embodiment. The difference is the material ID and each Material data A data transmission end table generating means 808 for generating a table of the last block number for transmitting the data from the stream generation information, a reproduction start position information managing means 88 for storing a reproduction start position when jump reproduction is performed, Data already transmitted Material data That is, a transmission history management table management means 89 for managing each transmission history management table is provided.
[0041]
FIG. 9 is an example of a data transmission end table created by the data transmission end table creating means 808. This table contains the material ID and its Material data The largest block number is stored among the block numbers in which is stored.
[0042]
FIG. 10 is an example of a transmission history management table managed by the transmission history management table management unit 810. This table contains the material ID and its Material data The largest block number that has already been transmitted among the block numbers that make up is stored. This table is dynamically changed, and changes in the following description in the order of (a), (b), (c), and (d).
[0043]
FIG. 11 is a flowchart showing a flow of a process of searching for complementary data performed by the complementary data search means from the jump destination position information and the current reproduction position information. This will be described in conjunction with FIGS.
[0044]
In the present embodiment, it is assumed that data once transmitted from the server to the client is retained (; not discarded) by the client. For this reason, it is necessary to manage the transmission history assuming that data once transmitted has been transmitted. This indicates that it is necessary to manage the history of transmitted data not only when a backward jump occurs, but also when a forward jump occurs or in a normally reproduced section. Therefore, when a jump is instructed, the section that has been normally reproduced up to that point is determined based on the current reproduction position information and the reproduction start position information generated at the time of the jump instruction. Manage in a table.
[0045]
In this embodiment, after the reproduction of the title is started, a forward jump is performed from the transmission block number 26 to 61, and then the normal reproduction is performed to 70, and then, a reverse jump is performed from the block numbers 70 to 32. This will be described below by taking a scene as a specific example.
[0046]
Steps 1101 to 1103 are the same as steps 701 to 703 described in FIG. 7 of the second embodiment. After these three steps, the data transmission end table creating means 808 creates a data transmission end table (step 1104). Further, the reproduction start position managed by the reproduction start position information management means is set to an initial value 0 (step 1105). This indicates the head of the title by the block number. The reproduction start position information management means manages only this value. This is the preparation stage, and the order of steps 1101 to 1105 does not matter.
[0047]
When a forward or backward jump occurs, the jump destination position information and the current reproduction position information are input to the complementary data search means (step 1106).
[0048]
Next, a normal reproduction section is calculated from the reproduction start position information and the current reproduction position information (step 1108). Since the reproduction start position information contains an initial value of 0, it can be understood that normal reproduction has been performed up to the current reproduction position, that is, the block number 26. Therefore, the transmitted block of the normal reproduction section is searched from the data transmission start table, the data transmission end table, and the scenario information table (step 1108). That is, the data between the normally reproduced block numbers 0 to 26 and the block numbers Material data Search every time.
[0049]
First, in FIG. 3, the data transmission start table indicates that the transmission start block number is less than 26. Material data Search for. Material IDs 1 and 2 apply Material data It can be seen that it is. Next, in FIG. 9, the transmission end block number is Material data Search for. Material IDs 1, 2, 3, 4, and 5 correspond Material data It can be seen that it is. Overlapping from these two searches are material IDs 1 and 2, and between the normal playback sections 0 to 26, these two Material data It can be seen that the data transmission was performed.
[0050]
In addition, these two Material data , The stream generation information table is searched, and each of the block numbers 0 to 26 is searched. Material data Search for the block of material ID1 Material data Transmitted six blocks of block numbers 3, 6, 9, 12, 15, and 18. On the other hand, Material data Transmitted three blocks of block numbers 21, 23, and 25. Therefore, these are recorded in the transmission history management table as transmitted blocks (step 1109).
[0051]
Here each Material data Each time, only the number of the block with the largest number among the transmitted block numbers is recorded. In other words, the material ID 1 Material data Is 18, material ID2 Material data Records 25 in the table. This example is shown in FIG. In FIG. 10, 0 indicates that nothing has been transmitted yet. Up to this point, the calculation of the normal reproduction section and the transmission history management work of the data transmitted in the section have been described.
[0052]
Next, it is determined from the jump destination position information and the current reproduction position information whether or not a forward jump is performed (step 1110). The jump destination position information is compared with the current reproduction position information. If the jump destination position block number is larger than the current reproduction position block, the jump is in the forward direction.
[0053]
If it is a forward jump, the procedure should be complemented by the procedure described in the first embodiment, FIG. 5, and steps 505 to 508. Material data (Step 1111). Should be supplemented from this result Material data And its data portion are calculated (step 1115). This step is the same as in FIGS. From this, it can be seen that the data corresponding to the block numbers 45, 50, 55, and 60 of the material ID 4 is data that must be complemented.
[0054]
Furthermore, these supplementary data must also be managed in the transmission history management table as transmitted. That is, assuming that the material ID 4 has been transmitted to the block number 60, the largest number 60 of the transmitted blocks is recorded in the transmission history management table (step 1116). FIG. 10B shows this transmission history management table. Further, for the next jump instruction, the jump destination position input in step 1106, that is, the block number 61 is stored as the reproduction start position. This is because, after completion of data complement, normal reproduction is started from the block number at the jump destination position.
[0055]
Steps 1116 and 1117 may be performed after the search for the complementary data and after transmitting the complementary data from the server to the client. Then, after normal reproduction to the block number 70, the program jumps in the reverse direction from the block numbers 70 to 32. Steps 1101 to 1105 need only be performed once, and are not necessary for the second and subsequent times.
[0056]
The jump destination position information is input to the complementary data search means as the block number 32 and the current reproduction position information as the block number 70 (step 1106). In step 1107, it is understood that the section from the reproduction start position block number 61 and the current reproduction position block number 70 has been normally reproduced from the block numbers 61 to 70. When the block transmitted in this section is searched (step 1108), it is found that the block numbers 65 and 70 of the material ID 4 have been transmitted, and this block is recorded as a transmitted block in the transmission history management table (step 1109). The transmission history management table at this time is shown in FIG.
[0057]
It can be seen from the jump destination position block number and the current reproduction position block number that the jump is in the reverse direction (step 1110). Then, the procedure described in the second embodiment, FIG. 7, and steps 705 to 708 should be complemented thereafter. Material data (Step 1111). Material IDs 1 and 2 should be complemented from this search Material data It can be seen that it is. Furthermore this Material data Only from the stream generation information table, Material data Each time, a block number between the jump destination position and the current reproduction position is searched (step 1113).
[0058]
As a result, it is understood that the material ID 1 is the block number 3, 6, 9, 12, 15, 18 and the material ID 2 is the block number 21, 23, 25, 27, 29, 31 to be complemented. . This block includes a block that has already been transmitted. Therefore, these block numbers are compared with the transmission history management table, and untransmitted blocks are extracted (step 1114). From the transmission history table, it can be seen from FIG. 10C that the material ID 1 has been transmitted to the block number 18 and the material ID 2 has been transmitted to the block number 25. Therefore, it can be understood that the data to be complemented without being transmitted are the blocks 27, 29, and 31 of the material ID2.
[0059]
Should be supplemented from this result Material data Is the material ID2 Material data And the Material data Of the data, the data having a data length of three blocks from the offset position corresponding to the fourth block from the head is set as complementary data (step 1115). Then, the block to be complemented, that is, the largest block number 31 among the blocks 27, 29, and 31 of the material ID 2 is recorded in the transmission history management table (step 1116). FIG. 10D shows the transmission history management table at this time. Finally, the jump destination position and the block number 32 are stored as reproduction start position information (step 1117).
In the supplementary data search device of the second embodiment, the material ID and each Material data Data transmission end table creating means for creating a table of the last block number for transmitting the data, original position information managing means for managing the position at which reproduction was started last time, and transmission history management table managing means. is there.
[0060]
As described above, the complementary data is searched from the four static tables of the stream generation table, the data transmission start table, the scenario information table, and the data transmission end table, and one dynamic table of the transmission history management table.
[0061]
As described above, in the present embodiment,
Assume that the client terminal does not discard the data once sent from the server but always retains it until the title reproduction is completed. In a multimedia title reproduction method using a stream in which multimedia data is multiplexed,
Data transmission end table creating means for creating a table of material ID and last block number for transmitting data of each material in the supplementary data search device of the second embodiment, and original position information for managing the position at which the reproduction was started last time It is provided with management means and transmission history management table management means.
[0062]
Thus, by utilizing the transmitted data management performed on the server side, it is possible to obtain an effect that a backward jump during title playback can be realized without retransmitting the transmitted data, and the practical effect is great. .
[0063]
【The invention's effect】
According to the present invention as described above,
First, stream generation information management means for managing stream generation information including information of material data multiplexed with stream data and material data storage position information, and data transmission start for creating a data transmission start table from the stream generation information Table creation means and each Material data Scenario information management means for managing scenario information consisting of display time and display cancellation time information, scenario information table creation means for creating a scenario information table from the scenario information, jump position information and current playback position By providing complementary data search means for searching for data to be complemented with information as input,
In a multimedia title playback method using a stream in which multimedia data is multiplexed, it is possible to obtain an effect that a search for complementary data for a forward jump during title playback can be realized.
[0064]
Secondly, by providing the data search device of the first invention with a search range changing unit that changes a search range from the position information of the jump destination input to the complementary data search unit and the information of the current playback position,
At the client terminal, the data sent from the server is discarded and not retained when the display is completed, and a reverse jump during title playback can be realized in a multimedia title playback method using a stream multiplexed with multimedia data. Effective Re You.
[0065]
Third, the data retrieval device of the second invention stores the material ID and Material data Data transmission end table creating means for creating a table of the last block number for transmitting the data, original position information managing means for managing the position at which reproduction was started last time, and transmission history management table managing means.
In the client terminal, the data once sent from the server is not discarded and is always retained until the title reproduction is completed. In the multimedia title reproduction method using a stream in which multimedia data is multiplexed, a backward jump during title reproduction is performed. Is obtained.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a first embodiment.
FIG. 2 is a diagram illustrating an example of a stream generation table according to the first embodiment;
FIG. 3 is a diagram illustrating an example of a data transmission start table according to the first embodiment;
FIG. 4 is an example diagram of a scenario information table according to the first embodiment;
FIG. 5 is a search flowchart according to the first embodiment;
FIG. 6 is a configuration diagram of a second embodiment.
FIG. 7 is a search flowchart according to the second embodiment.
FIG. 8 is a configuration diagram of a third embodiment.
FIG. 9 is a diagram illustrating an example of a data transmission end table according to the third embodiment;
FIG. 10 is a diagram illustrating an example of a transmission history management table according to the third embodiment;
FIG. 11 is a search flowchart according to the third embodiment.
FIG. 12 shows an example of transmission schedule and data multiplexing.
FIG. 13 is an example diagram of a jump of stream data.
FIG. 14 is an example diagram of complementary data in a forward jump
FIG. 15 shows an example of complementary data in a backward jump.
[Explanation of symbols]
11, 61, 801: Stream generation information management means
12, 62, 802: means for creating stream generation information
13, 63, 803: data transmission start table creation means
14, 64, 804: scenario information management means
15, 65, 805: means for creating scenario information table
16, 66, 806: complementary data search means
67, 807: search range changing means
808: Data transmission end table creation means
809: playback start position information management means
810: Transmission history management table management means

Claims (3)

Stream generation information management means for managing stream generation information comprising storage position information of the block data in which the material data of the stream data generated by multiplexing the material data being multimedia data and the material data is stored ; , from the stream generation information of the stream data being played, and the stream generation information table creation means for creating a stream generation information table including the storage location information and the material data, from said stream generation information, of the material data a data transmission start table creating means for creating a data transmission start table of the block data and the material data starts transmitting, the material display time data, the scenario information management for managing a scenario information composed of information of the display cancellation time Means and said system Rio information, and scenario information table creation means for creating a scenario information table of the block data and the material data corresponding to the display end time of the material data, as input position information of a jump destination information of the current playback position From the data transmission start table and the scenario information table, transmission is started before the jump destination, and further, material data that has not been displayed is set as complementary data as material data to be complemented, and the stream generation information table data retrieval apparatus and a complementary data retrieval means for retrieving the supplemental data. Search range changing means for changing the current playback position to the beginning of stream data when the jump destination is in the reverse direction based on the jump destination position information and the current playback position information input to the complementary data search means. the further data retrieval apparatus 請 Motomeko 1, further comprising. Playback position information management means for managing previous playback start position information, which is information on the position at which the previous playback was started , and blocks storing material data between the previous playback start position information and the current playback position information A transmission history management table managing means for managing the largest block data from the data as a transmission history of the material data, and a data transmission end including the block data for ending the transmission of the material data and the material data from the stream generation information. further comprising a data transmission end table creation means for creating a table, a supplemental data retrieval means, as input position information and information of the current reproduction position of the jump destination, the stream generation table, the data transmission start table, the scenario information table Using the data transmission end table and the transmission history management table, If the jump destination is in the reverse direction, the untransmitted block data from the block data in which the material data is stored is used as supplementary data based on the position information of the jump destination and the information on the current playback position, and the stream Generate
Data retrieval apparatus according to claim 2, wherein retrieving said complementary data from the information table.

Images