JPH09288681A - Background video retrieval, and display device, and background video retrieval method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically select background video images suited to the contents of music data from a background video data base. SOLUTION: Words relating to events appearing in the respective background video data stored 111 an external storage device 3 are managed as key words, and when the music data of a playing object are down-loaded through a communication channel, the key word such as the word included there is extracted from the lyrics data and the background video data corresponding to the extracted key word are retrieved by referring to the key words made to correspond to the respective background video data. Thus, the background video image corresponding to the contents of the lyrics data is automatically selected and the background video image suited to the contents of the music data is retrieved and displayed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a background video search display device and a background video search method, and more particularly to a background video search display device and background video for searching background video data corresponding to music data input from the outside. Regarding the search method.

[0002]

2. Description of the Related Art Generally, in a music performance device such as a karaoke performance device, an image corresponding to the music to be played is displayed as a background image in association with the music to be played. In the early system, music data and background video data were previously stored in a one-to-one correspondence and stored together in a storage medium such as an optical disk, and both were played back simultaneously during performance. It was

According to this method, however, for each music piece, song data is created by associating the lyrics data for subtitles, which is composed of the song data and text data, with the background video data, and then creates the song data on the optical disc. It is required to store and distribute it in etc. There is a limit to the number of song data that can be stored on one optical disc, and there is also a limit to the number of optical discs that can be stored in the music playing device. It was difficult to supply the user immediately.

Further, since the data size of the background image is very large, it has been difficult to comprehensively supply the music data requested by the user onto one optical disk or the like. Therefore, recently, a host manages a large amount of music data,
A method of downloading necessary data to a performance device on the user side via a communication line has begun to be used.
However, with the current standard method for background video data, it takes a huge amount of time to communicate, so the background video is managed by the user using an optical disk or the like.

Since it is difficult for the user to prepare background video data corresponding to all music data, only a small number of general-purpose video data are prepared and one video data is associated with a plurality of music data. The method is used. As a method of associating, a code indicating a rough genre such as pops, enka, and folk song is added to both the video data and the music data in advance, and when the music data is designated, the corresponding genre A method of randomly selecting one of video data having a code is used.

[0006]

As described above, in the method in which the music data and the background video data are stored in a storage medium such as an optical disc in a one-to-one correspondence and are distributed, an optimum background for each music data is obtained. Although it has an advantage of being able to display an image, it has a drawback that the music data desired by the user cannot be sufficiently supplied due to a problem such as capacity limitation of a storage medium such as an optical disk. Although the method of downloading music data using a communication line can provide the music data desired by the user to some extent, on the other hand, the background video data corresponding to the music data is roughly genre. Since only the division attribute is added, it is difficult to select the optimum one corresponding to the content of the music data.

The present invention has been made in view of the above points, and a background image search and display device and a background image search capable of automatically selecting, from the background image database, one suitable for the content of music data. The purpose is to provide a method.

[0008]

A background image search and display apparatus according to the present invention relates to a storage means for storing a plurality of background video data and an event appearing in the video in association with each background video data of the storage means. A means for managing related words as a keyword, a means for externally inputting lyrics data and song data that compose music data to be played, a means for extracting a keyword from the input lyrics data, and a means for responding to the extracted keyword A means for searching the background video data by referring to a keyword associated with each of the stored background video data, and a means for displaying the searched background video data when playing the input music data. It is characterized by having.

In this background image search and display device, words related to an event appearing in each background image data stored in the storage means are managed as keywords. When the music data to be played is input from the outside via a communication line, keywords such as words contained therein are extracted from the lyrics data, and the background image data corresponding to the extracted keywords is used as the background image for each background image. The search is performed by referring to the keyword associated with the data. Therefore, it becomes possible to automatically select the background video corresponding to the content of the lyrics data, and the background video suitable for the content of the music data can be searched and displayed. In addition, since the optimum background image data can be selected only from the content of the lyrics, it is not necessary to add genre information or the like to the music data side in advance, and the labor for creating the music data can be reduced.

Also, the present invention manages a thesaurus dictionary that expresses a semantic upper-lower relation or a relational relation between words and phrases, and refers to the thesaurus dictionary to search for keywords extracted from the input lyrics data. The method further comprises means for deriving a high-order word or a related word and searching the background video data corresponding to the high-order word or the related word with reference to the keyword associated with each of the stored background video data. .

Thus, even if the keyword associated with the background image data does not include a keyword such as a word extracted from the lyrics data, the background image data associated with the content of the lyrics is included. Can be singled out.

Further, it is preferable that this thesaurus dictionary is managed independently of the keywords managed in association with the background video data. As a result, the thesaurus dictionary and the keyword of the background video data can be individually corrected and changed.

[0013]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows the configuration of a background image search / display device according to an embodiment of the present invention. This background image search display device is connected to a host device via a communication line, receives music data (song data and lyrics data) to be played specified by a user from the host device via the communication line, and When playing the music data, the background video corresponding to the music data is automatically searched from the background video database and displayed on the screen. As shown in the figure, the audio output device 1,
The image display device 2, the external storage device 3, the control device 4, the memory 5, the communication device 6, and the command input device 7 are included.
The audio output device 1, the video display device 2, the external storage device 3, the control device 4, the memory 5, the communication device 6, and the command input device 7 are connected via a bus.

The audio output device 1 outputs audio data (here, song data) sent from the control device 4 via the bus.
Is a device that outputs a signal, and includes, for example, a digital-analog converter, a voice amplifier, and a speaker.

The image display device 2 is a device for displaying an image and a character string on the screen, and for example, a video memory (V
RAM) and a controller and a display for displaying the bit information stored in the VRAM as a dot string on the screen. When the music data is played, the character strings forming the lyrics and the background video are displayed on the screen by the video display device 2 in synchronization with the reproduction of the music data by the audio output device 1.

The external storage device 3 is composed of, for example, a digital video disk (DVD), a DVD drive device, and the like, and a plurality of background image data are stored in a database in this. As shown in the figure, one piece of background video data is composed of a video body data section and a keyword data section. In the image data section of the image body, image data displayed as a background image is, for example, M
It is stored after being compressed and encoded in the PEG2 format or the like. The keyword data section stores a plurality of words (general nouns) related to the phenomenon appearing in the corresponding video data.

Further, in the external storage device 3, the vocabulary thesaurus data is stored as a dictionary for analogizing the related words, the superordinate words and the like of the words included in the lyrics data. The vocabulary thesaurus data is tabular data, and stores the ID number of the superordinate word or related word for each headword. Here, the number of the column in which the entry word is stored is used as the ID number. The ID number of each word is stored for words that do not have a broader term / related word. A storage example of vocabulary thesaurus data is shown in FIG. Here, as a headword, "spring",
"Flower", "Sakura", "Autumn", "Cosmos", ... Are stored, and the ID number of "Flower" is stored in the broader word / related word storage field corresponding to "Sakura". .

The control device 4 is composed of, for example, a CPU, is connected to each hardware device by a bus, and performs processing such as controlling each device and transferring data between the devices. The control device 4 also executes a background image search program stored in the memory 5 to execute a search process of searching the external storage device 3 for a background image corresponding to the music data downloaded from the host device. . In this search process, a keyword is extracted from the lyrics data included in the music data, and the extracted keyword and
The optimum background image is selected based on the keyword of each background image data.

The memory 5 is composed of, for example, a dynamic RAM, and as shown in FIG. 3, a program section for storing programs for the control device 4 to execute various controls and processes, and data necessary for the processes. It consists of a buffer section for doing.

The program section includes the music number input section 4a, the music data input section 4b, the music data development section 4c, the lyrics code analysis section 4d, the background video data loading section 4e, and the background video data loading section 4e which compose the background video search program. The performance execution unit 4f is stored. In addition, the buffer section includes a music number input buffer 4r, a music data input buffer 4s, a music data storage buffer 4t, a lyrics code data storage buffer 4u, a timing table storage buffer 4v, a keyword storage buffer 4w, a candidate video storage buffer 4x, and a collation. A word number storage buffer 4y, a background video data input buffer 4z, and a background video storage buffer 4p are provided.

The communication device 6 is, for example, a modem, and is a device for exchanging data by communicating with an external host computer via a public telephone line or the like. The command input device 7 is, for example, an infrared receiving device, and is a device that processes a signal received from a portable infrared transmitting device and allows a user to input the number of a music piece to be played.

Next, referring to the flow chart of FIG.
The overall flow of the music performance process in this embodiment will be described. When the song number is input by the user, first,
The song number input 4a is activated, and the number of the song to be played is stored in the song number input buffer 4r (step 5).
a). Here, a unique number is assigned to each music data in advance.

Next, the music data input section 4b is activated (step 5b). Here, communication is performed with the host computer connected by the public telephone line via the communication device 6, and the music data corresponding to the music number is downloaded from the storage device of the host computer.
It is stored in the music data input buffer 4s. The format of the data downloaded here is shown in FIG. As shown in FIG. 6, one piece of music data is composed of a piece of music data, a piece of lyrics data, and a portion for storing a timing table showing a temporal correspondence between lyrics and pieces of music. Is compressed.

Subsequently, the music data expansion unit 4c is activated (step 5c), the data compressed and stored in the music data input buffer 4s is expanded, and the music data storage buffer 4t, the lyrics code data storage buffer 4u, The corresponding data is stored in the timing table storage buffer 4v.

In the following step 5d, the lyrics code analysis unit 4d is activated, and morphological analysis is performed on the character string data representing the lyrics stored in the lyrics code data storage buffer 4u, and general lyrics included in the lyrics are included. Extract nouns,
Of these, the eight with the highest appearance frequency are shown in FIG.
As shown in FIG. 5, the keyword is stored in the keyword storage buffer 4w in association with the appearance frequency.

Thereafter, the background image data loading section 4e is activated (step 5e). The processing flow of the background video data loading unit e will be described in detail with reference to FIG. Here, the j-th keyword of the keyword data portion corresponding to the i-th background video data stored in the external storage device 3 is PicWord [i] [j], and the k-th keyword stored in the keyword storage buffer 4w. Riff Wor
A variable called d [k] will be used for the description.

First, 0 is stored in the value of i (step 6a). Next, 0 is stored in the value of the matching word number storage buffer 4y (step 6b), then 0 is stored in the value of j (step 6c), and 0 is further stored in the value of k (step 6d). After this, PicWord
It is determined whether [i] [j] and RiffWord [k] are equal (step 6e). The determination is successful, that is, PicWord [i] [j] and RiffWord
If [k] matches, control is transferred to step 6f, and if it fails, control is transferred to step 6k.

At step 6f, the value of the collation word number storage buffer 4y is incremented, then the value of j is incremented (step 6g), and the value of j is stored in the keyword data portion of the i-th background video data. Or more ”(step 6h), and a series of processes from step 6d is repeated until the value of j becomes equal to or more than the total number of keywords.

When the value of j exceeds the total number of keywords, the contents of the matching word number storage buffer 4y are stored in the candidate video storage buffer 4x together with the value of i at that time (step 6s). Here, the candidate video storage buffer 4x has a structure capable of storing the number of matching words in association with the number (i) of the background video data. The structure of this buffer is shown in FIG.

Next, the value of i is incremented (step 6i), and it is checked whether the value of i is "total number of background image data stored in the external storage device" or more (step 6j).
If the value of is greater than or equal to the total number of background video data, step 6n
If not, the process is repeated from step 6d.

In step 6k, the value of k is incremented to check whether the value of k is greater than or equal to "the total number of keywords stored in the keyword storage buffer 4w" (step 6).
The series of processes from step 6e is repeated until the values of m) and k reach or exceed the "total number of keywords stored in the keyword storage buffer 4w". When the value of k exceeds the "total number of keywords stored in the keyword storage buffer 4w", the process proceeds to step 6g.

In this way, all the keywords and all the words extracted from the lyrics data are sequentially matched for each of all the background video data, and the value of the number of matching words is incremented each time they match. To be done. As a result, the candidate video storage buffer 4x as described in FIG.
Can be obtained.

As described with reference to FIG. 7, the word extracted from the lyrics data is associated with a value indicating the appearance frequency thereof. Therefore, the value of the number of matching words to be incremented when the words match is associated with the corresponding word. It is preferable to perform weighting according to the value of the appearance frequency.

In step 6n, the number of the background image data having the largest number of matching words is specified by sequentially referring to the contents of the candidate image storage buffer 4x. Further, the data of the image body data portion of the background image data corresponding to the number obtained here is loaded from the external storage device 3 and stored in the background image data input buffer 4z (step 6).
p). Next, the data stored in the background video data input buffer 4z is decompressed, and the result is stored in the background video storage buffer 4p (step 6q).

The above is the details of the processing of the background image data loading unit 4e. In the subsequent step 5f in FIG. 4, it is determined whether or not the video data satisfying the conditions is obtained by the above process. This is determined by whether or not the number of matching words is equal to or larger than a predetermined value. When the video data satisfying the conditions is obtained, the control is transferred to step 5h, and when the video data is not obtained, the process of the background video data loading unit 4e shown in FIG. 5 is re-executed (step 5g). .
However, at this stage, when word matching is performed in step 6e of FIG. 5, the vocabulary thesaurus stored in the external device 3 is referred to recursively derive a superordinate word or a related word of RiffWord [k], In order PicWord
Matching with [i] [j] is performed. As a result, not only the word extracted from the lyrics data, but also its higher-order word or related word is compared with the keyword of each background video data.

After the processing in step 5g, the control proceeds to step 5h. At step 5h, the performance executing section 4f is activated. Here, the background video data stored in the above processing is displayed on the video display device 2, and at the same time, the content of the music data is reproduced from the audio output device 1, and further, the lyrics code data and the timing table are referred to. do it,
The lyrics character string synchronized with the music data is displayed on the video display device 2 after being combined with the background video.

As described above, in this embodiment,
Words related to events appearing in each background video data stored in the external storage device 3 are managed as keywords, and when the music data to be played is downloaded via the communication line, the lyrics data is stored there. Keywords such as included words are extracted, and the background image data corresponding to the extracted keywords are searched with reference to the keywords associated with each background image data. Therefore,
The background image can be automatically selected according to the content of the lyrics data, and the background image suitable for the content of the music data can be searched and displayed. In addition, since the optimum background image data can be selected only from the content of the lyrics, it is not necessary to add genre information or the like to the music data side in advance, and the labor for creating the music data can be reduced.

Further, since the vocabulary thesaurus data is used to derive the upper word or the related word of the keyword extracted from the lyrics data, and this is compared with the keyword associated with each background video data, the background Even if the keywords corresponding to the video data do not include the same keywords as the words extracted from the lyrics data, or the degree of matching is low, the background video data related to the lyrics content is selected. be able to.

Since the thesaurus data is managed independently of the keywords managed in association with the background video data, the thesaurus data and the keywords of the background video data are separately corrected and changed. can do.

[0040]

As described above, according to the present invention, since the background image is searched according to the content of the lyrics data, the background image suitable for the content of the music data is automatically extracted from the background image database. It becomes possible to select the target.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a background image search / display device according to an embodiment of the present invention.

FIG. 2 is an exemplary view showing a structure of vocabulary thesaurus data managed by the background image search / display apparatus of the embodiment.

FIG. 3 is a diagram showing a configuration of a memory provided in the background image search / display device of the embodiment.

FIG. 4 is an exemplary flowchart showing the procedure of the entire music playing process in the background image search and display device of the embodiment.

FIG. 5 is a flowchart showing a specific procedure of background video search processing performed by the background video search display device of the embodiment.

FIG. 6 is an exemplary view showing a structure of music data downloaded to the background image search / display device of the embodiment.

FIG. 7 is an exemplary view showing an analysis result of lyrics data in the background image search display device of the embodiment.

FIG. 8 is a view showing a structure of a candidate video storage buffer provided in the background video search / display device of the embodiment.

[Description of Codes] 1 ... Audio output device, 2 ... Image display device, 3 ... External storage device, 4 ... Control device, 5 ... Memory, 6 ... Communication device, 7 ... Command input device, 4a ... Music number input section, 4b ... Song data input unit, 4c ... Song data expansion unit, 4d ... Lyric code analysis unit, 4e ... Background video data loading unit, 4f ... Performance execution unit, 4r ... Song number input buffer, 4s ... Song data input buffer, 4t ... song data storage buffer, 4u ... lyrics code data storage buffer, 4v ... timing table storage buffer, 4w ... keyword storage buffer, 4x ...
Candidate video storage buffer, 4y ... Matching word number storage buffer, 4z ... Background video data input buffer, 4p ... Background video storage buffer.

Claims (3)

[Claims] 1. A storage means for storing a plurality of background image data, a means for managing a word associated with an event appearing in the image as a keyword in association with each background image data of the storage means, and a performance object. Means for inputting lyrics data and music data constituting music data from the outside, means for extracting a keyword from the input lyrics data, and background video data corresponding to the extracted keyword 2. A background image search and display device comprising: a unit for searching with reference to a keyword associated with the item; and a unit for displaying the searched background image data when the input music data is played. 2. A means for managing a thesaurus dictionary showing a semantic vertical relation or a relational relation between words and phrases, and a superordinate word or a relation of a keyword extracted from the inputted lyrics data with reference to the thesaurus dictionary. The method further comprising means for deriving a word and searching for background image data corresponding to the word by referring to a keyword associated with each of the stored background image data. Background video search and display device. 3. A background video data retrieval method for retrieving background video data corresponding to music data to be played from among a plurality of background video data, wherein an event appearing in the video in association with each background video data is detected. The related words are managed as keywords, the lyrics data included in the music data to be played is extracted from the lyrics data, and the background image data corresponding to the extracted keywords is associated with each of the background image data. A method for retrieving background video data, characterized by performing a search by referring to.