CN101848381B

CN101848381B - System for providing visible message during replay of PVR trick mode

Info

Publication number: CN101848381B
Application number: CN201010176607.7A
Authority: CN
Inventors: 科林·约翰·戴维斯
Original assignee: NDS Ltd
Current assignee: Synamedia Ltd
Priority date: 2004-04-02
Filing date: 2004-04-02
Publication date: 2014-04-16
Anticipated expiration: 2024-04-02
Also published as: CN101848381A

Abstract

The invention relates a method and a system, which are used for embedding a message into compressed contents which comprise at least one key frame and at least one non-key frame. The method comprises the following step of: embedding the message into at least one key frame. A relevant method and a relevant device are also described.

Description

For the system of visible message is provided at PVR trick mode during playback

Present patent application is the divisional application proposing according to following patent application:

Application number: 200480042685.0

The applying date: on April 2nd, 2004

Denomination of invention: for the system of visible message is provided at PVR trick mode during playback

Invention field

The present invention relates to the apparatus and method for distributing video content, especially but and be not exclusively involved in advertisement, more particularly but and be not exclusively involved in the apparatus and method for being produced on the advertisement that personal video recorder trick mode during playback obtains.

Background of invention

The people's such as published Beekmans U.S. Patent application 2003/0002672 has been described the method and system for detection of the watermark in MPEG-2 (Motion Picture Experts Group-2) coding video frequency data.This detection occurs in the high speed duplicating process of video data.Bus detective select independently coded frame and selected frame offered to watermark detector from video data.By only some frame being offered to watermark detector, the data transfer rate of the average input data transfer rate of watermark detector during than high speed duplicating is low.

The people's such as Schumann United States Patent (USP) 6,078,328 has been described the system and method for the employing format compression image with the number format of target video identical.By application, carry out frame and revise or soverlay technique, this image is combined with dynamic object video.In a preferred embodiment, the video image format of compression meets MPEG-2 compression standard.Revise I-frame and produce a primary image, and by revising I-frame or forming MPEG-2 element by covering I-frame with one or more P-frames.

In the people's such as published Plotnick United States Patent (USP), ask 2002/0144262 described when their F.F. by or while skipping the advertisement that (or any other special play-back event) record, for the method and system that brief selectivity of recorded advertisement version is presented to televiewer.This selective advertisement can replace recorded advertisement or jointly shown with recorded advertisement.The brief version of selectivity of advertisement can be marketing message, and this version is to present a part for recorded advertisement or the static state projection of sign language, or can be the compressed version of true advertisement.

From the following document description of Moving Picture Experts Group-2 relevant understanding grammer of the present invention and method:

The grammer of transmission of digital multimedia or other data-signals: ISO/IEC13818-1;

The grammer of encoding digital video signal: ISO/IEC13818-2;

The 312M of SMPTE (SMPTE) file " for the junction point of MPEG-2 transmitting data stream " has been described " junction point " of MPEG-2 transmitting data stream, by headend being inserted to these junction points, promotes to link up smoothly between data flow.

SMPTE12M file " TV, audio frequency and film-time control routine " has illustrated digit time and the control routine in TV, film and appended audio system, used.

MPEG-2 editing machine of the prior art is known, and in various value scope, is can be business-like, is also used on internet and downloads.For example, be not defined as aforesaid generality, MediawareSolutions company provides MyFlix XE montage software, and for the desktop editing of MPEG-2, in network address, being www.MediawareSolutions.com/MyFlixXE.html has described this software on internet.(Matrox) step the DigiSuite MAX video frequency collection card product line of opening up video product portion sale real-time MPEG-2 editing platform.Under (having) general public licence, can download GOPChopMPEG-2 editing machine at outflux.net/unix/software/GOPchop/.

Therefore, here by reference to, by above-mentioned all references and disclosure whole specification, and those with reference in the disclosure combination of mentioned all references.

Summary of the invention

In a preferred embodiment of the invention, attempt to provide a kind of improved method, the method is guaranteed F.F. or the televiewer of the advertisement that falls back still can watch presented advertisement.According to a preferred embodiment of the invention, advertisement is embedded in the key frame of video of compression.

The extensive employing of personal video recorder (PVR) equipment expects to create a kind of world, the content that people watch the most contents of magnetic disc store rather than watch live broadcast there.Commercial-break is passed through in many PVR user's F.F.s.Because increasing televiewer has obtained the ability of skip advertisements, so expect the effect of current advertisement business mode.

PVR is known as " trick mode " using the ability of the Speed display video different from normal speed in the prior art.In the trick mode playback of some type, only show key frame.According to a preferred embodiment of the invention, advertisement is preferably embedded in key frame.When playback key frame, adopt the method in key frame, to embed advertisement, embedded advertisement is visible by what preferentially become.On the other hand, when with normal speed playback, advertisement is preferential keeps hiding.

On the contrary, the method for prior art depends on marking for the advertisement showing, or depends on application rule and produce selective advertisement.

With reference to Fig. 3, defined term " key frame " below.

In integrated digital PVR, content is generally stored on disk with digital compression form.Generally, content is stored on disk with the form identical with the content of broadcast.

PVR can carry out F.F. with one of two kinds of patterns:

Level and smooth trick mode-with lower fast forward speed, such as 2 or 4 times of normal playback speed, generally each frame of video of decode content rapidly of Video Decoder, but only actually shows a frame every one or three frames.

Key frame trick mode-with higher fast forward speed, Video Decoder may be for not carrying out process or the data bandwidth of above-mentioned level and smooth trick mode method.But Video Decoder is identified the key frame in compressed video and is only decoded and show key frame.

During F.F., the advertisement information comprising in traditional tv advertisement does not send televiewer to.Owing to only showing key frame during high speed F.F., so as described below, the advertisement embedding in key frame becomes visible for televiewer.

Therefore, provide according to a preferred embodiment of the invention a kind of method, its for by messages embedding to the compressed content that comprises at least one key frame and at least one non-key frame, the method is included at least one key frame and embeds message.

Further according to a preferred embodiment of the invention, this embedding comprises substantially only embedding information at least one key frame.

Further according to a preferred embodiment of the invention, at least one key frame comprises multiple key frames.

In addition, according to a preferred embodiment of the invention, embed in each that is included in described multiple key frames and embed message.

In addition, according to a preferred embodiment of the invention, embed and only comprise in some of described multiple key frames and embed message.

Further according to a preferred embodiment of the invention, provide incompressible content, and produced the content of compression according to this incompressible content, generation wherein comprises embedding.

Still further according to a preferred embodiment of the invention, provide the content of compression, wherein embedded and comprise at least one key frame of identification, and embed message in the key frame of identifying at least one.

In addition, according to a preferred embodiment of the invention, distribute the data flow of compressed content on the storage medium of terminal use unit, this content comprises multiple key frames, and wherein each independent key frame comprises embedded message.

In addition, according to a preferred embodiment of the invention, storage medium comprises movable storage medium.

Further according to a preferred embodiment of the invention, storage medium is outside for terminal use unit.

Still further according to a preferred embodiment of the invention, storage medium comprises the medium of prerecording.

In addition, according to a preferred embodiment of the invention, adopt MPEG-2 compression standard to compress compressed content.

In addition, according to a preferred embodiment of the invention, key frame comprises I-frame.

According to a further advantageous embodiment of the invention, the compressed content receiving with subscriber equipment is also provided, this compressed content comprises multiple frame of video, this frame of video comprises multiple key frames and multiple non-key frame, some key frame of at least multiple key frames comprises the message of embedding, from compressed content, select at least one of multiple key frames, thereby produce at least one selected key frame, the message embedding is included at least one selected key frame, at least one from selected multiple key frames produces non-compressed content, and output comprises the non-compressed content that embeds message.

Further according to a preferred embodiment of the invention, from broadcasting video data stream, receive multiple frame of video.

Further according to a preferred embodiment of the invention, from digital record, receive multiple frame of video.

In addition, according to a preferred embodiment of the invention, on medium, prerecord digital record.

Further according to a preferred embodiment of the invention, contain the multiple key frames that embed message and comprise multiple I-frames.

Still according to a further advantageous embodiment of the invention, provide digital compression content, this content comprises multiple frame of video, and this frame of video comprises at least one key frame and a non-key frame, and this at least one key frame comprises the message of embedding.

Further according to a preferred embodiment of the invention, substantially only at least one key frame, embed embedded message.

Further according to a preferred embodiment of the invention, comprise that at least one key frame that embeds message comprises multiple key frames.

In addition, according to a preferred embodiment of the invention, comprise that at least one key frame that embeds message is I-frame.

Further according to a preferred embodiment of the invention, medium comprises DVD.

Therefore, according to a preferred embodiment of the invention, provide a kind of messages embedding device, it can be used to messages embedding in the compressed content that contains at least one key frame and at least one non-key frame, and this embedded device embeds message at least one key frame.

Therefore, according to a preferred embodiment of the invention, a kind of method that embeds message in compressed content comprising at least one key frame and at least one non-key frame is provided, this embedding is included at least one key frame and embeds message, with subscriber equipment, receive compressed content, described compressed content comprises described at least one key frame, and described at least one key frame comprises described embedding message; From compressed content, select at least one key frame, thereby produce at least one selected key frame, embedding message is included at least one selected key frame, from at least one selected key frame, produce incompressible content, and output contains the non-compressed content that embeds message.

According to a further advantageous embodiment of the invention, a kind of embedded device is also provided, it can be used to messages embedding in the compressed content that contains at least one key frame and at least one non-key frame, embedded device wherein embeds message at least one key frame, a kind of receiver, it can be used to receive compressed content with subscriber equipment, the compressed content that comprises at least one key frame comprises embedding message, a kind of selector, it can be used to select at least one key frame from compressed content, thereby produce at least one selected key frame, embedding message is included at least one selected key frame, a kind of generator, it can be used to produce non-compressed content by least one selected key frame, and a kind of follower, it can be used to output and comprises the non-compressed content that embeds message.

According to a further advantageous embodiment of the invention, a kind of subscriber equipment is also provided, it can be used to receive compressed content, this compressed content comprises multiple frame of video, this frame of video comprises multiple key frames and multiple non-key frame, some key frame at least multiple key frames comprises embedding message, a kind of selector being included in subscriber equipment, it can be used to select from compressed content multiple key frames at least one, thereby produce at least one selected key frame, embedding message is included at least one selected key frame, a kind of generator being included in user, it can be used to produce non-compressed content by least one in selected multiple key frames, and a kind of follower being included in subscriber equipment, it can be used to output and comprises the non-compressed content that embeds message.

Brief Description Of Drawings

By reference to the accompanying drawings, according to detailed description below, will understand more fully and understand the present invention, wherein:

Figure 1A-1D is according to a preferred embodiment of the invention, effectively, schematically, watches the part block diagram of the parts of images of the simplification of the system of advertisement during PVR trick mode;

Fig. 2 is the flow chart of the simplification of the preferred method of operation of the system of Figure 1A-1D;

Fig. 3 is the simplified illustration flowing for the useful typical video requency frame data of the system of understanding Figure 1A-1D;

Fig. 4 A is during trick mode is play while watching, the simplified illustration of the typical video requency frame data stream of Fig. 3;

Fig. 4 B is the system according to Figure 1A-1D, the text of the example based on embedding message;

Fig. 4 C is the text based on select the example of the sampling predictive frame of output from the example of Fig. 4 B;

Fig. 4 D is the text based on only select the example of exporting I-frame from the example of Fig. 4 B;

Fig. 4 E is the simplified illustration of the exemplary video data flow frame useful for some preferred embodiment of system of understanding Figure 1A-1D;

Fig. 4 F is the simplified illustration of only selecting output I-frame from the video data stream frame of Fig. 4 E;

Fig. 5 A is when watching the exemplary video frame data stream of Fig. 3 with trick mode, the simplified illustration of the composograph on TV;

Fig. 5 B is the part block diagram of the parts of images of an implementation of real-time MPEG-2 coding of the broadcasting video data stream of the system of Figure 1A-1D;

Fig. 5 C is the block diagram of an implementation of the MPEG-2 coding of the storage content of the selectivity preferred embodiment of the system of Figure 1A-1D;

Fig. 6 is the simplified block diagram of the preferred equipment of the Set Top Box/PVR of the system of Figure 1A-1D, shows independently frame of video; And

Fig. 7 is the simplified flow chart that produces the method for optimizing that comprises the video requency frame data stream that embeds message, such as the exemplary video frame data stream of Fig. 3.

The detailed description of preferred embodiment

Referring now to Figure 1A-1D, it is constructed according to a preferred embodiment of the invention and operates, for watch the part block diagram of the parts of images of the simplification of the system of advertisement during personal video recorder (PVR) trick mode.Be understandable that, in a preferred embodiment of the invention, for example, the present invention, with other trick mode operations, is not defined as aforesaid generality, such as rewinding.

The system of Figure 1A-1D preferentially comprises remote control 10 or similar equipment, and it can be used to pass the signal to PVR20, and PVR20 is also preferably incorporated in the system of Figure 1A-1D.In hardware and/or software appropriately combined, preferentially carry out this PVR20, this PVR20 preferentially comprises storage medium 30, demodulation multiplexer 40, mpeg decoder 45 and digital/analog converter 60.

PVR20 receives the digital stream (not shown) as input, comprises multiplexing video, audio frequency and the data of compression, as is known in the art.PVR20 preferentially stores digital stream in storage medium 30.At reasonable time, and conventionally respond the input of initial user, storage medium 30 preferentially outputs to demodulation multiplexer 40 by stored digital stream.The demodulation multiplexer 40 preferentially single frame using the digital stream of demultiplexing storage 50 as Audio and Video is sent to mpeg decoder 45.Decode stored digital stream and the single frame of Audio and Video is sent to digital/analog converter 60 of mpeg decoder 45.Digital/analog converter 60 preferentially outputs to TV 80 by video 70 and audio frequency.Generally, TV 80 is connected to PVR20 by suitable cable (not shown), as is known in the art.

This specification and claims from start to finish, have been described MPEG-2 as just example, and are not used in restriction effect.The system and method for describing in the present invention also can be used in the Video Coding Scheme that comprises key frame.Comprise key frame and do not comprise that the example of the Video Coding Scheme of MPEG-2 comprises, but be not defined as MPEG-1 video (ISO/IEC11172-2), MPEG-4 vision (ISO/IEC14496-1) and MPEG-4 high-level vision coding (ISO/IEC14496-10).

Be understandable that, each sub-portfolio below comprises selectivity preferred embodiment of the present invention, there is no other elements shown in Figure 1A:

1. remote control 10, PVR20, storage medium 30, demodulation multiplexer 40, digital stream 50, mpeg decoder 45, digital/analog converter 60 and output video 70;

2. remote control 10, PVR20, storage medium 30, demodulation multiplexer 40, mpeg decoder 45, digital stream 50 and output video 70;

3.PVR20, storage medium 30, demodulation multiplexer 40, digital stream 50, mpeg decoder 45, digital/analog converter 60, output video 70 and TV 80;

4.PVR20, storage medium 30, demodulation multiplexer 40, digital stream 50, mpeg decoder 45, output video 70 and TV 80;

5.PVR20, storage medium 30, demodulation multiplexer 40, digital stream 50, mpeg decoder 45, digital/analog converter 60 and output video 70;

6.PVR20, storage medium 30, demodulation multiplexer 40, digital stream 50, mpeg decoder 45 and output video 70.

Be understandable that, in some preferred embodiment of the present invention, storage medium 30 can comprise movable storage medium and/or exterior storage medium.

The operation of the system of Figure 1A-1D is described now briefly.With particular reference to Figure 1A, someone 90 sees TV 80.This person 90 holds remote control 10, and this remote control can be used to pass the signal to PVR20.This everybody 90 TV programme of seeing on TV 80, shown in is here football match.A mark, for example leg-of-mutton voussoir 100 is preferentially presented on TV 80.Leg-of-mutton voussoir 100 represents that football match has been stored in the storage medium 30 that PVR20 comprises, and playback from storage medium 30.

At reasonable time, the video data stream of storing on storage medium is sent to demodulation multiplexer 40.The single frame of video that comprises demultiplexed digital video stream 50 is preferentially sent to mpeg decoder 45 from demodulation multiplexer 40.Demultiplexed decoded video is sent to digital/analog converter 60 from mpeg decoder 45.The single frame comprising in demultiplexed decoded video digital stream 50 preferentially comprises key frame and predictive frame, as described with reference to figure 3 below.

This specification and claims from start to finish, for the purpose of simplifying the description, have been discussed the process of video, are understandable that, PVR20 preferentially inputs, exports, stores and process video, audio frequency and data.Further be understandable that, the sequence of the frame shown in the accompanying drawing of present disclosure and number be only for illustration purpose, and be not used in restriction effect.For example, be not defined as aforesaid generality, the digital stream 50 in Figure 1A is from following the I-frame of two B-frames and a P-frame, and with another two B-frame ends, altogether six frames.Given I, B, B, P, B, B sequence is only for illustration purpose, and is not used in restriction effect.The application's accompanying drawing from start to finish, with mark the rectangle of letter " I " represent I-frame, with mark the rectangle of letter " P " represent P-frame, and with mark the rectangle of alphabetical " B " represent B-frame.Below with reference to Fig. 3, I frame, P frame and B frame are described in more detail.

The output video 70 of PVR20 comprises a series of single frames.

In the example of giving at Figure 1A-1D, the video data stream of coding can be risen in broadcast source, such as cable or satellite broadcasting, but is not defined as aforesaid generality.Be understandable that, video can, for prerecording the selective video on medium, such as DVD or digital magnetic tape, but not be defined as aforesaid generality.

Now especially with reference to Figure 1B.Figure 1B has described the continuation part of the scene of describing in Figure 1A.TV 80 starts to show advertisement now.In order to skip over advertisement, watch the continuation part of advertisement football match afterwards, this person 90 is by the fast forward button 130 in remote control 10.The example of a kind of mode of skip advertisements is wanted in the F.F. of giving as someone, and is not used in restriction effect.

Video is sent to demodulation multiplexer 40 continuously from storage medium 30.Comprise that the demultiplexed frame of video that the frame of video digital stream 50 of I-frame 210 comprises preferentially comprises an add ons now: preferentially added to the message 270 of I-frame on the horizon, with asterisk, described, below with reference to Fig. 3 explanation here.Demultiplexed frame of video is sent to mpeg decoder 45.The frame of video of decoded demultiplexing is sent to digital/analog converter 60, and video 70 is preferentially outputed to TV 80.

Now with particular reference to Fig. 1 C.Fig. 1 C has described the continuation part of the scene of describing in Figure 1A and 1B.As someone, 90 by the result of the fast forward button 130 in remote control 10, remote control 10 signaling PVR20 start, to use key frame special-effect mode that video is sent to demodulation multiplexer 40 from storage medium 30.I-frame 210 is the unique type that are preferentially sent to the frame of video of mpeg decoder 45 from demodulation multiplexer 40 now.The frame of video of decoded demultiplexing is sent to digital/analog converter 60.Video 70 from PVR20 is preferentially sent to TV 80.

TV 80 shows that reading is × 30 mark 300 now, and it represents the thirtyfold F.F. of video with normal playback speed.Be understandable that, in commercialization STB/PVR, carry out various fast forward speed, and this thirtyfold normal playback speed is as nonrestrictive example.As the result that preferentially embeds message 270 in multiple I-frames 210, on TV 80, there is corresponding pictorial element 310.It will be appreciated by those skilled in the art that, even if be not that each I-frame has embedded images, if enough I-frames have embedded images, embedded image is appreciable for eyes.On the contrary, as will be illustrated in further detail with reference to Fig. 3 below, the image in single frame is non for eyes.Preferentially comprise that the image existing on several frames of successive frame makes image visible.

Now with particular reference to Fig. 1 D.Fig. 1 D has described the continuation part of the scene of describing in Figure 1A-1C.Once advertisement finishes, this person 90 is by the broadcast button 170 in remote control 10.By the broadcast button 170 in remote control 10, to PVR20, send signal and with normal speed, start to make video to be sent to demodulation multiplexer 40 from storage medium 30 to stop F.F. video.The digital stream 50 of demultiplexing comprises multiple frame of video.In the frame of video comprising at the digital stream 50 of demultiplexing, be to comprise the last I-frame 210 that embeds message 270.Demultiplexed digital stream 50 is sent to mpeg decoder 45 from demodulation multiplexer 40.The frame of video of decoding demultiplexing is sent to digital/analog converter 60.Digital/analog converter 60 outputs to TV 80 by video 70.

Again on TV 80, see football match.In the upper left corner of TV 80, there is leg-of-mutton voussoir mark 100.Leg-of-mutton voussoir 100 represents with normal speed from storage medium 30 playback football matches.

With reference now to Fig. 2,, it is the simplified flow chart of the method for optimizing of the system operation of Figure 1A-1D.The method of Fig. 2 preferentially comprises the following steps:

Subscriber equipment receives compressed content (step 600), and this content comprises multiple frame of video, and this frame of video comprises at least one key frame and a non-key frame, and this at least one key frame comprises the message of embedding.

Subscriber equipment produces incompressible content (step 610) according to the content of compression.

Subscriber equipment is selected at least one key frame.This at least one key frame preferentially comprises the message (step 620) of embedding.

Subscriber equipment output selected at least one key frame (step 630) in step 620.

Referring now to examining 3, it is the simplified illustration of the typical video requency frame data stream 280 useful for the system of understanding Figure 1A-1D.Typical data flow 280 preferentially comprises the single frame of video 210,230,250 that contains MPEG-2 key frame of video and predictive frame.Especially, key frame is called as " in-line coding " frame in Moving Picture Experts Group-2, or I-frame 210 preferentially comprises the frame that uses pure in-line coding and encode, the non-other field of reference or frame information.The preferential reference with acting on other frames of compression of I-frame.

In the explanation of MPEG-2, there is the predictive frame of two types: P-frame 230 and B-frame 250.For the purpose of simplifying the description, only have some P-frame and some B-frame to adopt reference number to show in Fig. 3.The P-frame that is more formally called " prediction " frame is the frame that uses prediction above to produce.P-frame preferentially comprises and uses the prediction of encoding from the motion compensated prediction of I-frame above or P-frame above.P-frame is used as the reference of P-below or B-frame.B-frame or " two-way " frame are bidirectionally predictive coded picture/frames: use the image of encoding from the motion compensated prediction of I-frame and/or below or P-frame above.In any prediction, do not use B-frame.

Be understandable that, although quote especially MPEG-2 here, described the present invention,, in a preferred embodiment of the invention, the present invention can be used in any suitable compressibility based on key frame and predictive frame.The description of MPEG-2 example is just for as an example rather than for limiting effect.

Be understandable that equally, for example, only include data flow, such as the typical data stream of Fig. 3, and be not defined as aforesaid general sub-portfolio and can comprise the preferred embodiments of the present invention.

Usually, in transmission of television, preferentially comprise and following the key frame of a series of predictive frames or one group of image of I-frame comprises 15 frames in 12 frames or signal per second 30 frames in signal 25 frames per second.Be understandable that, if transfer source changes, may be forced to the new sequence that appearance starts with I-frame.For example, if the video of unexpected mobile camera broadcast, even if frame of video in the centre of one group of image, also could be forced to produce new I-frame.

In the typical data stream 280 of Fig. 3, show the data flow of frame of video.Typical data flow 280 comprises four groups of images 291,292,293,294, and the every group of image that comprises an I-frame 210 followed 14 predictive frames that comprise P-frame 230 and B-frame 250.Four groups of images 291,292,293,294 of Fig. 3 represent the video of about 2 seconds together.Each of four I-frames 210 of Fig. 3 comprises message 270, describes this message with asterisk in Fig. 3.Can use techniques well known in the art that the combination of any suitable image or image is embedded in I-frame.For example, be not defined as aforesaid generality, can use the image editor combining with above-mentioned any MPEG editing machine that image is embedded in I-frame.When watching the exemplary video of Fig. 3, each I-frame 210 only has about 0.033 second on TV 80 (referring to Figure 1A), and (supposing each signal 30 frames) or 0.04 second (supposing signal 25 frames per second) is visible.When there is the so short time on screen, people's eyes can not detect this message 270.

Can adopt one of two kinds of methods, in one of multiple I-frames 210, preferentially embed the message 270 embedding in multiple I-frames 210 of Fig. 3.Or use the MPEG-2 editing machine of off line, in non real-time mode, message 270 is embedded into in multiple I-frames 210, or by MPEG-2 decoder, preferentially, during MPEG-2 decoding, in real-time mode, embed message.The situation of MPEG-2 is be only described as an example and be not used in restriction effect.

As known in the art, PVR is used two kinds of technology to be used for F.F.:

Level and smooth trick mode-with low speed F.F., such as 2 or 4 times of normal playback speed, the preferential each frame of video of decode content rapidly of PVR Video Decoder, but only actually shows a frame every one or three frames.

Key frame trick mode-with high speed F.F., Video Decoder may not have process or data bandwidth to carry out above-mentioned level and smooth fast forward method.But Video Decoder is preferentially identified the key frame in compressed video and is preferentially only decoded and show key frame.

With reference now to Fig. 4 A,, it is when watching during trick mode is play, the diagram of the simplification illustration of the exemplary video frame data stream of Fig. 3.When using key frame trick mode to play the typical data stream of Fig. 3, only preferentially select I-frame 210 for playing.In Fig. 4 A, only there is the I-frame 210 of Fig. 3.The synthetic new data stream of I-frame preferentially comprises the I-frame 210 that has wherein embedded message 270.Be understandable that, when watching this message on TV 80, as illustrated with reference to figure 5A below, if the position of message 270 and multiple I-frame 210 exchange, message 270 looks like motion.Further be understandable that, can use technology known in the art to obtain other visual effects, be not defined as aforesaid generality, for example, by changing outward appearance, position and/or the light and shade of message 270, or by dividing message 270.

With reference now to Fig. 4 B,, it is the system according to Figure 1A-1D, the text of the example based on embedding message.Fig. 4 B comprises multiple frames 411 that comprise frame 0-13.For ease of reference, at the left column 413 of Fig. 4 B, shown the number of frame.Using arbitrary I-from the secondary series 415 on the left side, the multiple frames 411 of P-or B-frame identification.Message " HERE IS THETEST MESSAGE " is included in the I-frame 419 of multiple frames 411 of Fig. 4 B.Except frame 0 and 12, the message in all frames is random.Frame 0 and 12 is encoded as I-frame 419.When watching multiple frame 411 with normal broadcasting speed, televiewer only perceives random character.For nonrestrictive example is provided in the context of Fig. 4 B, pointed out a kind of non-I-frame 421, frame 7, B-frame, when watching non-I-frame 421, show them on TV, as illustrated with reference to figure 4C below.

With reference now to Fig. 4 C,, it is the text of the example of the sampling predictive frame based on selecting from the example of Fig. 4 B.In Fig. 4 C, on TV 80, there is the text of non-I-frame 421.Televiewer's text equally fuzzy with independent frame that feel only can be watched one second some points several on TV, as illustrated in the above with reference to figure 3.Be understandable that, the text of Fig. 4 is as just example, and any one non-I-frame of the text of the example based on Fig. 4 B can be the equivalent example of Fig. 4 C.

With reference now to Fig. 4 D,, it be based on from the example of Fig. 4 B, select based on the text of the example of I-frame only.For example, be not defined as aforesaid generality, when I-frame 419 with the PVR trick mode frame that only playback comprises Fig. 4 B 0 and 12, show the message " HERE IS THE TESTTEXT " embedding according to the system of Figure 1A-1D.Be understandable that, televiewer clearly feels message " THERE IS THE TEST TEXT ", as all I-frames all comprise identical message.

Referring now to Fig. 4 E, it is the simplified illustration of the exemplary video frame data stream useful for some preferred embodiment of system of understanding Figure 1A-1D.In the more complicated preferred embodiment of the present invention, can adopt the true unit of the method configuration messages in multiple continuous I-frames 210, this unit looks and moves, and finally risks word or form image.For example, be not defined as aforesaid generality, in Fig. 4 E, video shows marine day reflection of light.In Fig. 4 E, round dot represents marine sunlight spot.Fig. 4 E does not have display background sea.Multiple I-frames 410 of Fig. 4 E have shown the word " SEA " of sunlight reflected.Predictive frame 420 shows a series of random round dot.When with the playback of key frame trick mode, can only see multiple I-frames 410, as illustrated with reference to figure 4F below.

Be understandable that, the example of Fig. 4 E is also not used in restriction effect.Another example (not shown) can comprise containing to look it is the fireworks display video of unit that part fireworks show, under this unit stochastic model from the teeth outwards, looks and moves.The I-frame that fireworks video shows is edited in advance, while watching separately with trick mode with box lunch, for example, is not defined as aforesaid generality, and unit is by moving together in the mode of coordinating, to risk gray name.

Be understandable that, the present invention is conceived to use normal video production process editor's video content.According to the character of content, editing process can comprise simple computer generated image, or, as selection, disclose the product operation of actual video length.Below with reference to Fig. 5 A and 5B, editing process is described in further detail.For example, be not defined as aforesaid generality, under current video editing technology, in order to make it appear to actor just floating, editor comprise similarly be through quick shooting just in floating actor's content, to erase, support actor's line.After having taken this scene, video is loaded on computer and uses software kit operation so that the line that editor supports.In a preferred embodiment of the invention, carry out similar process, thus, editing video after taking is to obtain the effect that embeds message in video.

Referring now to Fig. 4 F, it is the simplified illustration of multiple I-frames 410 of only selecting from the frame of the video data stream of Fig. 4 E.During trick mode is watched, only select from multiple I-frames 410 of the video data stream output of Fig. 4 E, as shown in Fig. 4 F.When watch shown in Fig. 4 F multiple I-frame 410 time, televiewer will see similarly be the image " SEA " of the sunlight of marine reflection.The outward appearance of selected I-frame has been described in further detail with reference to figure 5A.

With reference now to Fig. 5 A,, it is when watching the data flow of typical video frame of Fig. 3 with trick mode, the diagram of the simplified image of composograph on TV 80.When playing the I-frame 210 (Fig. 3 and 4) of suitable high-quality, do not play predictive frame, for example, be not defined as aforesaid generality, during the F.F. of PVR key frame, TV 80 epigraph elements 310 become visible.This pictorial element 310 preferably includes by decoding and comprises the screen picture that the I-frame 210 (Fig. 3 and 4) of message 270 (Fig. 3 and 4) produces.In some preferred embodiment of the present invention, pictorial element preferentially comprises advertisement.

The discussion of the preferred embodiments of the present invention turns to editor to be adapted at the content of using in the system of Figure 1A-1D now.

With reference now to Fig. 5 B,, it is the part block diagram of the parts of images of an implementation of real-time MPEG-2 coding of the broadcasting video data stream of the system of Figure 1A-1D.Be understandable that, the content that editor is applicable to using in the present invention generally includes two step processing.

1. first must create video.

2. then preferentially encode this video to guarantee the configuration of desirable key frame.

Use the industry standard tool that creates and operate video preferentially to carry out the establishment of video.The preferential generation in interval with frame in key frame has the video that embeds message, at preferential this key frame that uses of coding stage.For example, be not defined as aforesaid generality, if 12 frames comprise one group of image, the interval of key frame is 12 frames.Equally, if 15 frames comprise one group of image, the interval of key frame is 15 frames.The establishment that is adapted at the video of using in the system of Figure 1A-1D preferentially causes representing to have the Audio and Video that arrange correlation time by industrial standard time code, such as, for example, be not defined as aforesaid generality, the time code defining in SMPTE standard 12M.Its form is hour: point: second: the SMPTE standard time code of frame allows the independent frame of video of identification.In content, comprise and embed message, the time code that need to be encoded as the individual frames of key frame preferentially identified.

In Fig. 5 B, comprise that the video playback 565 of video data stream 568, audio data stream 569 and time code information 570 is sent to MPEG-2 encoder 573.The structure 575 of mpeg video encoder comprises the structure of desired image sets and will be encoded as the time code of frame of I-frame.The video and audio content 578 of MPEG-2 encoder 573 output squeezings.The video and audio content 578 of compression is input to MPEG-2 multiplexer 580.MPEG-2 multiplexer 580 is exported multiplexing multiprogram data flow 582.Multiplexing multiprogram data flow 582 is input to broadcast modulation and transmission system 584.Broadcast modulation and transmission system 584, for example, be not defined as aforesaid generality, and broadcast system 586 preferentially transmits the modulated multiplexing multiprogram data flow for broadcasting via satellite.Be understandable that, multiple can business-like MPEG-2 encoder 573, MPEG-2 multiplexer 580 and broadcast modulation and transmission system 584 be applicable to using in a preferred embodiment of the invention.

With reference now to Fig. 5 C,, it is the block diagram for an implementation of the MPEG-2 coding of the storage content of the selectivity preferred embodiment of the system of Figure 1A-1D.The video playback 565 that comprises video data stream 568, audio data stream 569 and time code information 570 is sent to MPEG-2 encoder 573.The structure 575 of mpeg video encoder comprises the structure of desired image sets and will be encoded as the time code of frame of I-frame.The video and audio content 578 of MPEG-2 encoder 573 output squeezings.The video and audio content 578 of compression is preferentially transferred to removable medium, and for example DVD, is not defined as aforesaid generality.As selection, by internet, shift the video and audio content 578 of compression.

With reference now to Fig. 6,, it is the simplified block diagram of the preferred equipment of the Set Top Box/PVR20 of the system of Figure 1A-1D, shows independently frame of video.For the present invention's function in Set Top Box/PVR20 and Fig. 6 is provided in a preferred embodiment is in depth described.Preferentially carry out Set Top Box/PVR20 with hardware and software, and preferentially comprise the tuner 510 of preferential receiving video data stream 520.Be understandable that, Set Top Box/PVR20 also can be integrated in TV 80 (Figure 1A).If Set Top Box/PVR20 stored video data stream 520, preferentially stores video data stream on storage medium 30 into.When playback, storage medium 30 is sent to descrambler 530 by stored video data stream, and it initiatively removes any scramble that may be applied to video data stream 520.As selection, in order to play immediately, tuner 510 can preferentially directly be sent to descrambler 530 by video data stream 520.

Descrambler is sent to demodulation multiplexer 40 by video.Be understandable that, if data flow is not disturbed, anti-scramble does not occur, and descrambler be optional; In this case, data flow is directly sent to demodulation multiplexer 40.Demodulation multiplexer 40 transmits digital stream 50, as independent I-frame 210, P-frame 230 and B-frame 250; For convenience of explanation, in Fig. 6, not all frame has all marked reference number.The digital video of demultiplexing is sent to mpeg decoder 45.Numeral by video 540 and audio frequency 550 is converted to analog video and audio signal to video converter by the digital video frame 210,230,250 of decoding demultiplexing.The analog data flow of output video 70 and output audio 560 is preferentially outputed to TV 80 (Figure 1A).

Be understandable that, the preferred execution of the Set Top Box/PVR20 of the system of Figure 1A-1D shown in Fig. 6 can itself comprise the preferred embodiments of the present invention.

With reference now to Fig. 7,, it is to produce to comprise embedding message, such as the simplified flow chart of the method for optimizing of the video requency frame data stream of the exemplary video frame data stream of Fig. 3.The method of Fig. 7 preferentially comprises the following steps:

The non-compressed content (step 660) with at least one key frame and a non-key frame is provided.

In at least one key frame, embed message (step 670).Can use off line MPEG-2 editing machine in key frame, to embed message in non real-time mode, or can, preferentially during MPEG-2 coding, by MPEG-2 encoder, embed in real time message.As just example, discussed MPEG-2 and be not for limiting effect.

Be understandable that, for clear, also can in the combination of indivedual embodiment, provide the various features of the invention described in the context of single embodiment.On the contrary, for briefly, also can provide respectively or provide the various features of the invention described in the context of single embodiment in any suitable sub-portfolio.

It will be appreciated by those skilled in the art that, above the special content showing and describe is not intended to limit the present invention.And scope of the present invention is only defined by appended claim.

Claims

1. for embed a method for message at video content, the method comprises:

At video production process inediting video content, therefore produce the video content of having been edited, described editor comprises:

The preferential generation in interval with frame in key frame has the video that embeds message;

By industrial standard time code, represent to there is the Audio and Video that arrange correlation time;

In described video content, preferential identification comprises described embedding message, need to be encoded as the time code of the individual frames of key frame; With

The described video that comprises video data stream, audio data stream and time code information is sent to Motion Picture Experts Group's video encoder, and described Motion Picture Experts Group video encoder is encoded to described video, the video and audio content of output squeezing;

Wherein only when using the playback of key frame trick mode to have at least one key frame of described embedding message, described message is visible.

2. method according to claim 1, also comprises:

The video and audio content of described compression is input to Motion Picture Experts Group-2 multiplexer, and described Motion Picture Experts Group-2 multiplexer is exported multiplexing multiprogram data flow;

Described multiplexing multiprogram data flow is input to broadcast modulation and transmission system;

The described multiplexing multiprogram data flow of broadcast modulation; With

Broadcast described multiplexing multiprogram data flow.

3. method according to claim 1, also comprises the video and audio content of described compression is stored on storage medium.

4. according to the method described in any one in claim 1 to 3, wherein said coding comprises in Motion Picture Experts Group-2 coding and Motion Picture Experts Group-4 coding.

5. method according to claim 1, wherein said key frame comprises I-frame.

6. method according to claim 1, wherein said embedding message comprises text message.

7. method according to claim 1, wherein said embedding message comprises pictorial element.

8. method according to claim 1, wherein the frame of the video content being encoded except described key frame comprises P frame and B frame.

9. one for embedding the system of message at video content, and this system comprises:

For the device of the edit video content at video production process inediting video, wherein, described device comprises:

Messages embedding device, this messages embedding device has for preferential generation the in the interval with key frame frame the video that embeds message;

Processor, this processor is for the treatment of the Audio and Video that arrange correlation time that has being represented by industrial standard time code, in described video content, preferential identification comprises described embedding message, need to be encoded as the time code of the individual frames of key frame; With

Motion Picture Experts Group's video encoder, the described video that comprises video data stream, audio data stream and time code information is sent to described Motion Picture Experts Group video encoder, described Motion Picture Experts Group video encoder is encoded to described video, the video and audio content of output squeezing;