CN1383543A

CN1383543A - Karaoka system

Info

Publication number: CN1383543A
Application number: CN01801723A
Authority: CN
Inventors: I·科尔塞特
Original assignee: Koninklijke Philips Electronics NV
Current assignee: Koninklijke Philips NV
Priority date: 2000-06-20
Filing date: 2001-06-15
Publication date: 2002-12-04
Also published as: US20020007718A1; EP1297692A2; KR20020026374A; WO2001099413A3; JP2004501576A; WO2001099413A2

Abstract

The concept of singing karaoke exclusively relies on audio based techniques. The invention consists of developing the concept of video immersion: the user will see his (her) image inserted into the video clip or movie at the place of his (her) favorite dancer, singer or player, and will therefore be able to play clip/song on video tape, and replace any famous star. More precisely, the invention relates to a karaoke system in which are provided successive means for picking up an image of the user and his/her voice, analyzing and processing the obtained signals, mixing the audio/video signals thus analyzed and processed and a pre-recorded material and displaying the combination signals thus obtained.

Description

A kind of karaoke OK system

The present invention relates to a kind of karaoke OK system, it is used for a performance as the sequence of video clipping (videoclip) or film.

In the karaoke OK system described in the European patent application EP 0782338 for example, the voice data of music, the lyrics or any kind of is transferred to distribution plant by transfer station.The music controller of the primary module of system broadcasts music by establishing loudspeaker in the monitor, and sound is broadcasted by described loudspeaker from a unshowned microphone.Image controller is presented at background images (as video image or the still image that extracts) on the monitor from the background images memory storage, and lyrics control device shows the lyrics by the lyrics are superimposed on the background images.Image pick-up equipment as a ccd video camera, picks up singer's image, and it is superimposed on the monitor screen as the image that superposes by the video image control device.Such system may be defined as in the Karaoke notion so-called " video mix ".

The objective of the invention is to propose the karaoke OK system that possesses additional functionality of another type.

For this purpose, this system relates to a kind of karaoke OK system of singing as the sequence process of video clipping or film of being used for, and comprise a series of pick devices that are used to pick up user's pictures and sounds, one is used for the analysis of user's at least a portion and background separation and treatment facility, one is used for the output signal and mixing and reproduction (rendering) equipment and the display device that be used to show this composite signal that the combination of materials prerecorded get up of described analysis with treatment facility.

Even to this day, the notion of sing karaoke only depends on the technology based on audio frequency, and it provides limited function and can not really be inserted into the user in the video virtual world.The introducing of being advised the solution of notion of video mix (video mixing), permission with this Karaoke conceptual expansion in video, and usually, allow the complete audio-video of development to insert notion: according to described notion, sound in the video clipping of song and face can be replaced (after this also claiming the user, because he or she in fact can be singer, performing artist, dancer etc. by chance (fortuitous) singer's sound and face ...).The technology of same suggestion can be found similar application in other environment, for example e-commerce field or the video editing that is used to prerecord content.

Below with reference to the accompanying drawings, the present invention is described by example, wherein:

Fig. 1: according to the block scheme of karaoke OK system of the present invention.

Fig. 2: according to another embodiment of karaoke OK system of the present invention.

As shown in Figure 1, realize that the necessary different subsystem of karaoke OK system according to the present invention mainly is that an analysis mixes with treatment facility 11 and one and reproducer 12.

The analysis and the treatment facility 11 that are used to receive the user's (people shown in the black) who is picked up by pick device 10 pictures and sounds comprise a partitioning circuitry, it is used for for example user's face and background separation, thereby limit an Alpha (alpha) plane (if the user is placed on the stage, such circuit can based on the chroma key technology before the Blue screen for example).Mix with reproducer 12 are circuit (the described material of prerecording illustrates in the medium left side) that utilize the shape information analyzed in the equipment 11 that user and video of prerecording that is transmitted by medium 13 or audio-video background are combined.This is synthetic has finished the audio frequency that is used for described user's sound mixes with the music background of prerecording from song and has synthesized.Then, utilize the alpha plane that limits by equipment 11, according to the relational expression of following type, easily two sources are combined: [(video 1 * Alpha)+(video 2 * (255-Alpha))]/255=final video.At last, a display device 14 as monitor, be used for showing at last net result (material of promptly prerecording and belong to especially the user combination).

Obviously, for improving the quality, the analysis of finishing in equipment 11 can produce 8 bit alpha plane, and it can had mixing preferably by the target edges of frosting (fronteer).In addition, be pointed out that also system can only replace user's head or his or her whole health.

With respect to the type in audio-video source, can consider different situations:

(a) two audio/video sources are not compressed: this selection can be used for for example playing Karaoka the restaurant, whole healths of singer are by frosting in montage/film the time (data of prerecording can be stored on the tape, and accidental singer's video can analyzed and directly be transferred in the vision mixer);

(b) one or two source is compressed: to one of this situation adaptive framework (framework) is the newly-developed MPEG-4 standard of getting up, and it can be encoded-(the MPEG-4 standard has defined one can make the synthetic total system framework of Voice ﹠ Video object) to the accidental user's of the shape of object and alpha plane-be here face.

Also can consider the different situations that the present invention uses:

(a) user may want to write down the result of married operation, and this is shown in Figure 2, and Fig. 2 shows the system similar to Fig. 1 embodiment, has just comprised an extra recording arrangement 25;

(b) in some cases, karaoke OK system can work online: the montage of then prerecording can be stored on the database (for example internet), and the user records his or her performance at home and plan to produce the combination of Karaoke montage and put it on the his or her personal homepage (in this case, the use of compress technique is particularly useful, and more at large, it all runs in the environment that bandwidth limits in all are used);

(c) in addition, in some cases, the user may plan only his or her head to be placed on the position of original singer's head, its be included in mix with reproducer 12 in further processing because the position of user's head need with the orientation and the posture coupling of original singer's health.

Claims

1. karaoke OK system, it is used for singing a sequence process as video clipping or film, and comprise a series of pick devices that are used to pick up user's pictures and sounds, one is used for the analysis of user's at least a portion and background separation and treatment facility, one is used for the output signal and mixing and reproducer that the combination of materials prerecorded get up of described analysis with treatment facility, and a display device that is used to show this composite signal.