JP2003108168A - Karaoke device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a karaoke device which makes it possible to enjoy karaoke with rich presence by importing sound effects matching a background picture. SOLUTION: An effect sound address for specifying an effect sound to be generated in a scene and a sound field control parameter for controlling a sound field are added before each piece of scene data constituting picture data. Consequently, various effect sounds specified with effect sound addresses are added to a performance of karaoke in timing to the reproduction of a picture of corresponding scene data and the delay time, etc., of a reflected sound is controlled with the sound field control parameter to create a sound field corresponding to the scene.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a karaoke device for displaying a background image while playing karaoke.

[0002]

2. Description of the Related Art Conventionally, a karaoke device has been known which displays a background image of a karaoke song along with the performance of the karaoke song.
In this type of karaoke device, since the amount of background video data is enormous, instead of holding the video data of the background video corresponding to each song, the video data of several types of background video is held. It is common to select and display a background image suitable for the genre of the song (attributes such as the music genre and the season of the song). For example, in a sound source type karaoke device, genre information is included in the header of karaoke music data (MIDI data, etc.), and image data suitable for the music is used as a search key in an LD (laser disk) or CD- By searching from a ROM or the like and reproducing this, a background image matching the music is displayed.

[0003]

By the way, the background images displayed along with the performance of karaoke are various such as place, mood, characters and objects, and the progression of the song is performed even in the image data corresponding to one song. The scene changes one after another.
However, in the conventional karaoke device, as described above, the background image peculiar to the karaoke song is not played back in synchronization with the performance, but only the background image that matches the genre of the song is selected and concurrently played. Although the sound effect was given only by the reproduction, the sound effect was not given along with the scene of the background image although the sound effect was given along with the progress of the song. Therefore, the background image is simply BGV (background
It was only effective as a video), and it was not realistic.

The present invention has been made under such a background, and an object of the present invention is to provide a karaoke apparatus capable of enjoying karaoke full of realism by imparting a sound effect suitable for a background image. I am trying.

[0005]

In order to solve the above-mentioned problems, the present invention provides a video reproducing means for reproducing a background video in parallel with the performance of karaoke, and a sound effect to be generated during the reproduction of the background video. Storage means for storing the first data for specifying, the second data for specifying the generation timing thereof, and the third data for controlling the sound field of the sound effect, in association with the background image, respectively. When the video playback means is playing back the background video, the sound effect designated by the first data associated with the background video, and the timing designated by the second data associated with the background video And sound field control means for performing sound field control on the sound effect generated by the sound effect generation means in accordance with the third data associated with the background image. Sound effect sound field control has been performed by the Kion field control means, characterized by comprising an output means for mixing the tone of the karaoke.

Further, according to the present invention, the first data for designating a sound effect to be generated during the reproduction of the background video based on the video data and the second data for designating the generation timing thereof are respectively the video data. Storage means for pairing and storing, a video reproducing means for reproducing the background video by reading the video data from the storage means in parallel with the performance of karaoke, and the video reproducing means for reproducing the background video. Sometimes, a sound effect designated by the first data stored corresponding to the background image is generated at a timing designated by the second data stored corresponding to the background image. And generating means.

[0007]

DETAILED DESCRIPTION OF THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

A: Configuration of the embodiment FIG. 1 is a block diagram showing an embodiment of the present invention.

(1) Overall Configuration FIG. 1 is a block diagram showing the overall configuration of an embodiment of the present invention. In the figure, reference numeral 1 is a host computer installed in the center station, and has a database DB that stores karaoke song data (details will be described later). A plurality of karaoke terminals 2, 2, ... Installed in each karaoke store are connected to the host computer 1 via a communication line (public telephone line or ISDN) N, and music data is periodically transmitted to each karaoke terminal. It is designed to be delivered to karaoke terminals.

(2) Structure of Karaoke Terminal 2 Next, FIG. 2 is a block diagram showing the structure of the karaoke terminal 2. In the figure, 21 is a CPU, which is a bus BUS.
It controls each part of the terminal connected via. Also, 22 is R
It is an OM and stores the control program executed by the CPU 21 and the font data corresponding to the lyrics code included in the music data. Furthermore, 23 is a RAM, and CP
Used as a work area for U21.

A hard disk 24 stores the music data distributed from the host computer 1. That is, in each karaoke terminal, the music data supplied from the host computer 1 is temporarily stored in the hard disk 24 and read out for use.

A communication I / F (interface) 25 receives music data transmitted from the host computer 1 and transfers it to the hard disk 24 by DMA (direct memory access).

Reference numeral 26 denotes a panel I / F, which is a key input operation (for example, input of a song number, instruction to start or stop playing, volume, tempo, etc.) on an operation panel of the karaoke apparatus main body or a remote control terminal (not shown) Setting, etc.), and this detection result is used as input data for the CPU 2
Supply to 1.

Next, 27 is a sound source, which synthesizes a tone signal corresponding to the tone control data (included in the music data) supplied by the CPU 21 and outputs it to the mixer 28. Reference numeral 29 denotes an audio decoder, which generates an audio signal corresponding to the ADPCM data (audio data such as back chorus included in music data, or sound effect data referred to from video data described later) supplied by the CPU 21. This is output to the mixer 28. Mixer 28
Is a musical sound signal supplied from the sound source 27, the audio decoder 2
Back chorus and sound effect audio signals supplied from 9
And the voice signal of the singer input from the microphone M is mixed and output.

Reference numeral 30 is an effector, and the CPU 2
Various effects such as echo, reverb, delay, etc. are added to the output of the mixer 28 based on the effect-added control data (included in the music data or video data) supplied by 1. Further, 31 is a sound system, which removes noise components and the like from the output of the effector 31 and then outputs the sound from a speaker (not shown).

Next, reference numeral 32 is a background image reproducing device which reproduces image data (details will be described later) for displaying the background image of karaoke stored in an image storage medium such as a moving image CD. A video mixer 33 superimposes the lyrics font data read from the ROM 22 on the background video and outputs the composite image. further,
A display 34 displays a composite image of the background and lyrics corresponding to the output of the video mixer 33.

(3) Details of music data Next, details of the music data will be described. As shown in FIG. 3, the music data for one music consists of a header, a musical sound track, a display track, a sound track, an effect control track, and a sound data area. The header is
This is a portion where various data relating to the song are written, and data such as song number, song name, genre, and playing time of the song are described.

On the musical tone track, sequence data for controlling the musical tone synthesis by the sound source 27 is described, and it is composed of event data for controlling sounding, muting, etc. and duration data for controlling timing. Code information corresponding to the lyrics of karaoke to be displayed on the display 34 in synchronization with the progress of the song is described in the display track. In the audio track, ADPC of sound effects such as back chorus from the audio data area is synchronized with the progress of the song
Address information and the like for reading M data are described. Further, the effect control track describes control data for controlling the effect to be given to the musical sound such as echo and reverb.

(4) Details of Video Data Next, details of the video data will be described. As shown in FIG. 4, the video data for one song is composed of a header including genre information, followed by video data of a predetermined time unit (hereinafter referred to as scene data) that constitutes a background video. In front of each scene data, data designating a sound effect to be generated in the scene (hereinafter referred to as a sound effect address) and data controlling a sound field (hereinafter referred to as a sound field control parameter) are added.

Here, as shown in FIG. 5, the sound data for generating the sound effect includes various sound effects (sound of a whistle, squealing of a seagull, walking, etc.) referred to by a sound effect address designated from the video data. (Such as sound) and is stored as a data file of ADPCM data in the hard disk 24. Note that this data file is distributed from the host computer 1 of the center station to each karaoke terminal 2 via the communication line N, similarly to the music data.

The sound field control parameter is a parameter for controlling the delay time of the sound reflected by the effector 30 and the like. For example, if a background image is an open area such as a harbor or coast, sound field control parameters that increase the delay time (for example, make it infinite) are set accordingly. It In this case, a sound field is formed such that the sound penetrates far away. On the contrary, if a narrow place such as a room is displayed as the background image, the sound field control parameter for reducing the delay time is set correspondingly. In this case, a sound field in which the sound is muffled in a narrow place is formed.

B: Operation of Embodiment Next, the operation of the karaoke apparatus having the above configuration will be described. First, when the user inputs the song number of karaoke from the remote control terminal, this song number is taken into the CPU 21 via the panel I / F 26. As a result, the CPU 21
Is the hard disk 24 that stores the music data corresponding to the music number.
Search from.

When the music data is searched, the header is referenced to read the genre information. Then, the address of the video data is obtained from the read genre information via a predetermined conversion table, and this is specified to the background video reproduction device 32. As a result, the background video playback device 32 searches the video storage medium for video data corresponding to the genre of the designated music and plays back the searched video data.

When music data and video data are searched in this way, both data are reproduced in parallel. First, for music data, a musical sound track, a display track, a sound track, and an effect control track are played back in a time-divisionally synchronized manner. As a result, the musical tone control data read from the musical tone track is supplied to the sound source 27, the font data corresponding to the lyrics code read from the display track is supplied from the ROM 22 to the video mixer 23, and from the audio data area designated by the audio track. AD to be read
The PCM data is supplied to the audio decoder 29, and the control data read from the effect control track is supplied to the effector 30.

On the other hand, for the video data, the sound effect address and the sound field control parameter are read out and the scene data is reproduced in parallel with the reproduction of the music data. As a result, the ADPCM data of the sound effect designated by the sound effect address is transferred from the hard disk 24 to the audio decoder 29, the sound field control parameters are supplied to the effector 30, and the video signal obtained by reproducing the scene data is a video mixer. 23. The generation timing of each sound effect is determined by a generation command (not shown) included in the video data.

Thus, in the sound source 27, the karaoke tone corresponding to the tone control data is synthesized, and
In the audio decoder 29, sound such as back chorus and sound effects corresponding to background video are restored. further,
These musical sounds are mixed with the singing voice input from the microphone M in the mixer 28, and echoed by the effector 30.
After effects such as reverb are applied and sound field control corresponding to the background image is performed, the sound is emitted from the speaker via the sound system 31. On the other hand, in parallel with the karaoke performance, the font image of the lyrics is superimposed on the background video in the video mixer 23, and the composite image is displayed on the display 34.

As described above, according to this embodiment, the sound effect corresponding to the background image displayed along with the performance of karaoke can be added to the musical sound of karaoke, and the sound field corresponding to the background image can be formed. it can. As a result, for example, when a background image of the port is displayed, it is possible to add sound effects such as the sound of a whistle and the sound of seagulls to create a sound field that allows the sound to pass through. You can enjoy overflowing karaoke.

C: Modification (1) In the above embodiment, after all the music sounds of karaoke, sound effects corresponding to the background image, singing voice, etc. are mixed in the mixer 23, the sound corresponding to the background image is generated in the effector 30. I tried to control the field. As described above, the sound field control may not be performed on all the sounds, but may be performed on some of the sound effects and the singing voice.
For example, when it is desired to perform sound field control only on the sound effect corresponding to the background image, the output of the audio decoder 29 is changed to the back chorus sound V1 and the sound effect V2 corresponding to the background image, as shown in FIG. Separately, an effector 30 'for performing sound field control only on the sound effect V2 may be provided in the preceding stage of the mixer 28, and the effector 30 may give only the effect specified by the music data.

(2) In the above embodiment, both the effect sound corresponding to the background image and the sound field control are performed. However, the present invention is not limited to such a configuration, and only one of them is performed. Even if it does so, it is possible to enjoy the realism corresponding to the background image. In this case, there is an advantage that the data amount can be reduced as compared with the embodiment and the configuration is simple.

(3) Further, the parameter for controlling the sound field is not limited to the delay time of the reflected sound, but its strength and the direction of arrival may be controlled.

(4) Further, the video data and the sound effect data file are not limited to the data format of the above-mentioned embodiment, and other data formats may be adopted as long as the function of the present invention can be realized. .

(5) Further, although the present invention is applied to communication karaoke in the above-described embodiment, the present invention is not limited to this, and any background image can be displayed in parallel with the performance of karaoke.
It is also applicable to other karaoke devices.

[0033]

As described above, according to the present invention, a sound effect and a sound field suitable for a background image can be formed, so that the user can enjoy karaoke full of realism.

[Brief description of drawings]

FIG. 1 is a block diagram showing an overall configuration of a karaoke device according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of a karaoke terminal in the same embodiment.

FIG. 3 is a format diagram for explaining details of music data in the same embodiment.

FIG. 4 is a format diagram for explaining details of video data in the same embodiment.

FIG. 5 is a format diagram showing the contents of a sound effect data file in the same embodiment.

FIG. 6 is a block diagram showing a modified example of the present invention.

[Explanation of symbols]

1 ... Host computer, 2 ... Karaoke terminal, 21 ... C
PU, 22 ... ROM, 23 ... RAM, 24 ... Hard disk, 25 ... Communication I / F, 26 ... Panel I / F, 27 ...
Sound source, 28 ... Mixer, 29 ... Audio decoder, 30 ... Effector, 31 ... Sound system, 32 ... Background video playback device, 33 ... Video mixer, 34 ... Display, M ... Microphone.

Claims (2)

[Claims] 1. A video reproduction means for reproducing a background video in parallel with the performance of karaoke, first data for designating a sound effect to be generated during the reproduction of the background video, and second data for designating its generation timing. data,
And storage means for respectively storing the third data for controlling the sound field of the sound effect in association with the background video, and the background video when the video playback means is playing back the background video. A sound effect generating unit that generates a sound effect specified by the associated first data at a timing specified by the second data associated with the background image, and an effect generated by the sound effect generating unit. A sound field control means for performing sound field control on the sound according to the third data associated with the background image, and a sound effect for which the sound field control is performed by the sound field control means are mixed with a musical sound of karaoke. A karaoke device comprising: 2. A first data designating a sound effect to be generated during the reproduction of a background image based on the video data, and a second data designating the generation timing thereof are respectively paired with the video data. Storage means for storing, video reproduction means for reproducing the background video by reading the video data from the storage means in parallel with the performance of karaoke, and when the video reproduction means is reproducing the background video, Sound effect generation means for generating a sound effect designated by the first data stored corresponding to the background image at a timing designated by the second data stored corresponding to the background image. A karaoke device characterized by being provided.