JP6492933B2 - CONTROL DEVICE, SYNTHETIC SINGING SOUND GENERATION DEVICE, AND PROGRAM - Google Patents

Description

  The present invention relates to a technique for changing a setting when generating a synthesized singing sound.

  In an electronic musical instrument such as an electronic keyboard device, in addition to generating an electronic sound that assumes a musical instrument sound or the like, a singing sound is synthesized and generated. Such a singing sound (to be distinguished from an actual singing, hereinafter referred to as a synthesized singing sound) is synthesized with a waveform so that a specified pitch is obtained, for example, by combining speech segments corresponding to characters such as lyrics. By doing so, a synthesized sound that sounds like the character is generated. Conventionally, a technique for generating a synthesized singing sound by combining a musical score (sequence data or the like) prepared in advance with a character has been used. However, as in Patent Documents 1 and 2, it is used for performance operation on an electronic keyboard device. In response to this, a technique for generating a synthesized singing sound in real time has been developed.

JP 2008-170592 A JP 2014-62969 A

  By the way, in karaoke, by using a device that outputs an accompaniment sound of a song to be sung, the user can sing and enjoy the song. On the other hand, like the electronic musical instruments disclosed in Patent Documents 1 and 2 above, it has become possible to generate a singing voice in real time according to a performance operation. Instead, there is a desire to use synthetic singing sounds.

  If you have your own singing voice, you can easily enjoy karaoke in a room equipped with karaoke equipment without any prior preparation. On the other hand, in the techniques of Patent Documents 1 and 2, various prior settings such as registering a character string of lyrics in the electronic keyboard device in advance are necessary, and karaoke cannot be enjoyed easily. In addition, if a duet song is enjoyed by a plurality of people at the same time, the setting becomes more complicated. Therefore, even when karaoke is performed using an electronic keyboard device, it is desired to facilitate the setting for generating a synthesized singing sound and improve convenience so that karaoke can be easily enjoyed.

  One of the objects of the present invention is to improve the convenience of an apparatus for generating a synthesized singing sound in karaoke.

  According to one embodiment of the present invention, a lyrics data acquisition unit that acquires lyrics data of a plurality of parts that defines lyrics to be sung in a song designated as an accompaniment target, an operation of a performance operator, and the lyrics data A setting information acquisition unit that acquires the timbre setting information from a synthesized singing sound generation device that generates an audio signal based on characters specified based on the operation and the preset timbre setting information in the defined lyrics And lyrics setting provision for selecting one of a plurality of parts based on the received timbre setting information and providing lyric data of the selected part to the synthesized singing sound generation apparatus in which the timbre setting information is set And a control unit.

  The lyric setting providing unit transmits the timbre setting information to the lyric data of the part selected based on the timbre setting information when the timbre setting information is not changeable in the synthetic singing sound generation device. May be transmitted to the synthesized singing sound generation apparatus.

  The lyrics setting providing unit selects, from the plurality of parts, a part to be assigned to the synthetic singing sound generation device according to a predetermined rule when the timbre setting information is changeable in the synthetic singing sound generation device. You may transmit the identification information which shows the part allocated to the said synthetic song sound production | generation apparatus, and the lyrics data of the said part to the said synthetic song sound production | generation apparatus.

  According to an embodiment of the present invention, a lyrics setting acquisition unit that acquires lyrics data defining lyrics to be sung and identification information corresponding to a part of the lyrics data, and a plurality of tone settings based on the identification information A timbre selection unit for selecting one of the information, an operation of the performance operator, a character specified based on the operation among the lyrics defined in the acquired lyric data, and the selected timbre setting information There is provided a synthetic singing sound generation device comprising a signal generation unit for generating an audio signal.

  The lyrics setting acquisition unit includes a part selection unit that acquires the lyrics data of a plurality of parts and the identification information corresponding to the lyrics data of each part, and selects any of the plurality of parts, and the timbre selection The unit selects one of a plurality of timbre setting information based on the identification information corresponding to the selected part, and the signal generation unit selects the lyrics data corresponding to the selected part. The audio signal may be generated based on the tone color setting information and the operation of the performance operator.

  According to one embodiment of the present invention, a plurality of parts of lyric data specifying the lyrics to be sung in the music designated as the accompaniment target are acquired, the operation of the performance operator, the lyrics specified in the lyric data The timbre setting information is acquired from the synthesized singing sound generation device that generates the audio signal based on the character specified based on the operation and the timbre setting information set in advance, and based on the received timbre setting information A program for causing a computer to select one of a plurality of parts and to provide the lyrics data of the selected part to the synthetic singing sound generation apparatus in which the timbre setting information is set is provided. The

  According to an embodiment of the present invention, lyric data defining the lyrics to be sung and identification information corresponding to a part of the lyric data are obtained, and any one of a plurality of timbre setting information is obtained based on the identification information. Selecting and operating a performance operator, generating lyrics based on the selected timbre setting information and the lyrics specified based on the operation of the acquired lyrics data, and causing the computer to execute A program is provided.

  According to one embodiment of the present invention, in karaoke, the convenience of an apparatus that generates a synthesized singing sound can be improved.

It is a block diagram which shows the structure of the karaoke system in one Embodiment of this invention. It is a block diagram which shows the structure of the karaoke apparatus in one Embodiment of this invention. It is a block diagram which shows the structure of the control terminal in one Embodiment of this invention. It is a block diagram which shows the structure of the electronic keyboard apparatus in one Embodiment of this invention. It is a block diagram which shows the function implement | achieved by the karaoke apparatus in one Embodiment of this invention. It is a block diagram which shows the function implement | achieved by the control terminal in one Embodiment of this invention. It is a figure explaining the lyrics data of a plurality of parts in one embodiment of the present invention. It is a flowchart explaining the process in the lyrics setting provision part in one Embodiment of this invention. It is a figure explaining the example of the data for lyrics setting transmitted to each by the combination of the electronic keyboard apparatus in one Embodiment of this invention. It is a block diagram which shows the function implement | achieved by the 1st example of the electronic keyboard apparatus in one Embodiment of this invention. It is a flowchart explaining the process in the signal generation part in one Embodiment of this invention. It is a block diagram which shows the function implement | achieved by the 2nd example of the electronic keyboard apparatus in one Embodiment of this invention. It is a block diagram which shows the function implement | achieved by the 3rd example of the electronic keyboard apparatus in one Embodiment of this invention.

  Hereinafter, a karaoke system according to an embodiment of the present invention will be described in detail with reference to the drawings. The following embodiments are examples of the embodiments of the present invention, and the present invention is not limited to these embodiments.

<Embodiment>
[overall structure]
A karaoke system according to an embodiment of the present invention will be described in detail with reference to the drawings. The karaoke system according to an embodiment can easily set the electronic keyboard device by specifying a target music piece when performing karaoke using the electronic keyboard device capable of generating a synthesized singing sound. It has a function. In addition, this karaoke system has a function that allows easy setting even when a duet is sung using a plurality of electronic keyboard devices.

  FIG. 1 is a block diagram showing a configuration of a karaoke system in an embodiment of the present invention. The karaoke system 100 includes a karaoke device 1, a control terminal 2, an electronic keyboard device 3, a karaoke server 1000, and a song synthesis server 2000. In this example, the karaoke device 1, the control terminal 2, the karaoke server 1000, and the singing composition server 2000 are connected via a network NW such as the Internet. In this example, the control terminal 2 is a remote controller that sends an instruction to the karaoke apparatus 1, but may be a mobile terminal such as a smartphone or a notebook computer, or a terminal such as a desktop personal computer. In the case of a computer such as a smartphone, the function of the control terminal 2 described below may be realized by installing and executing a control program. In this example, the control terminal 2 is connected to the karaoke device 1 and the electronic keyboard device 3 by short-range wireless communication without going through the network NW, but may be connected by communication through the network NW. The short-range wireless communication is communication using, for example, Bluetooth (registered trademark), infrared communication, LAN (Local Area Network), or the like.

  The karaoke server 1000 includes a storage device that stores music data necessary for providing karaoke in the karaoke apparatus 1 in association with the music ID. The music data includes data related to the karaoke song, for example, guide melody data, accompaniment data, and lyrics data. The guide melody data is data indicating the melody of the song. Accompaniment data is data indicating the accompaniment of a song. The guide melody data and accompaniment data may be data expressed in the MIDI format. The lyric data is data that defines the lyrics (characters) to be sung. When the song is a song sung by a plurality of people such as duet, lyrics data exists corresponding to the part corresponding to each person. For example, in the case of a song sung by two men and women, there are lyric data of a male voice part and lyric data of a female voice part. Further, the music data may include timing data indicating the timing of changing the color of the lyrics telop displayed based on the lyrics data. According to this timing data, the progress position of the song can be associated with the lyrics to be sung at the progress position.

  The singing voice synthesizing server 2000 includes a storage device that stores setting data for setting the electronic keyboard device 3 according to the singing song in association with the song ID. The setting data includes lyric data of each song part (hereinafter, simply referred to as “part”) of the song corresponding to the song ID. The part of the lyrics data is specified by the identification information corresponding to the part. Note that the lyrics data stored in the song synthesis server 2000 and the lyrics data stored in the karaoke server 1000 may be the same or different. That is, the lyric data stored in the singing voice synthesizing server 2000 is the same in that it is data defining the lyrics (characters) to be sung, but is adjusted to a format that is easy to use in the electronic keyboard device 3. Yes. This format may include, for example, information for identifying a case where two characters are sung with one sound, information for identifying a phrase break, and the like.

  Next, the hardware configuration of the karaoke device 1, the control terminal 2, and the electronic keyboard device 3 will be described.

[Karaoke equipment hardware configuration]
FIG. 2 is a block diagram showing the configuration of the karaoke apparatus in one embodiment of the present invention. The karaoke apparatus 1 includes a control unit 101, a storage unit 103, an operation unit 105, a display unit 107, a communication unit 109, and a signal processing unit 111. Each of these components is connected via a bus. The signal processing unit 111 is connected to an input terminal 113 for receiving audio signal input and a speaker 115. In this example, the audio signal input to the input terminal 113 is supplied by the electronic keyboard device 3 or supplied from a microphone.

  The control unit 101 includes an arithmetic processing circuit such as a CPU. The control unit 101 causes the CPU to execute a control program stored in the storage unit 103 to realize various functions in the karaoke apparatus 1. A part of the realized function (karaoke function) will be described separately. The storage unit 103 is a storage device such as a nonvolatile memory or a hard disk. The storage unit 103 stores the control program. The control program may be downloaded via a network, but may be provided in a state stored in a computer-readable recording medium such as a magnetic recording medium, an optical recording medium, a magneto-optical recording medium, or a semiconductor memory. Control programs used in the control terminal 2 and the electronic keyboard device 3 described below may be provided in the same manner. The storage unit 103 is also a buffer that temporarily stores music data downloaded from the karaoke server 1000.

  The operation unit 105 is a device such as an operation panel, and outputs a signal corresponding to the input operation to the control unit 101. The display unit 107 is a display device such as a liquid crystal display or an organic EL display, and displays a screen based on control by the control unit 101. Note that the operation unit 105 and the display unit 107 may be integrated into a touch panel. Based on the control of the control unit 101, the communication unit 109 connects to an external device via the network NW or connects to the control terminal 2 by short-range wireless communication.

  The signal processing unit 111 includes a sound source that generates an audio signal from a MIDI format signal, an A / D converter, a D / A converter, and the like. The audio signal input from the input terminal 113 is output to the signal processing unit 111, subjected to A / D conversion in the signal processing unit 111, and output to the control unit 101. The input audio signal may be buffered in the storage unit 103 and used for singing evaluation or the like. The accompaniment data is read by the control unit 101, converted into an audio signal by the signal processing unit 111, and output from the speaker 115 as an accompaniment sound of the song. At this time, the audio signal input to the input terminal 113 is also synthesized with the accompaniment sound and output.

[Hardware configuration of control terminal]
The control terminal 2 executes control on the karaoke device 1 (for example, designation of a song, volume, transpose, etc.) and control on the electronic keyboard device 3 (for example, setting of lyrics, setting of tone, etc.) To do.

  FIG. 3 is a block diagram showing the configuration of the control terminal in one embodiment of the present invention. The control terminal 2 includes a control unit 201, a storage unit 203, an operation unit 205, a display unit 207, and a communication unit 209. Each of these components is connected via a bus.

  The control unit 201 includes an arithmetic processing circuit such as a CPU. The control unit 201 executes a control program stored in the storage unit 203 by the CPU, and realizes various functions in the control terminal 2. A part of the realized function (setting control function) will be described separately. The storage unit 203 is a storage device such as a nonvolatile memory or a hard disk. The storage unit 203 stores the control program.

  The operation unit 205 is a device such as an operation panel, and outputs a signal corresponding to the input operation to the control unit 201. The display unit 207 is a display device such as a liquid crystal display or an organic EL display, and displays a screen based on control by the control unit 201. Note that the operation unit 205 and the display unit 207 may be integrated with each other as a touch panel. Based on the control of the control unit 201, the communication unit 209 connects to an external device via the network NW, or connects to the karaoke device 1 and the electronic keyboard device 3 through short-range wireless communication.

[Hardware configuration of electronic keyboard device]
The electronic keyboard device 3 is a device that generates a synthesized singing sound according to the set contents in accordance with the operation of the keyboard (performance operator). In this example, the generated synthesized singing sound is output from the speaker 115 of the karaoke apparatus 1 via the input terminal 113.

  FIG. 4 is a block diagram showing the configuration of the electronic keyboard device according to one embodiment of the present invention. The electronic keyboard device 3 includes a control unit 301, a storage unit 303, an operation unit 305, a display unit 307, a communication unit 309, an interface 317, and a keyboard 321. Each of these components is connected via a bus.

  The control unit 301 includes an arithmetic processing circuit such as a CPU. The control unit 301 causes the CPU to execute a control program stored in the storage unit 303 to realize various functions in the electronic keyboard device 3. Some of the realized functions will be described separately. The storage unit 303 is a storage device such as a nonvolatile memory. The storage unit 303 stores the control program. In addition, the storage unit 303 stores setting information (lyric data, timbre, etc.) used when generating an audio signal indicating a synthesized singing sound, a speech element for generating a synthesized singing sound, and the like. This timbre indicates the type of synthesized singing sound (type of voice such as male voice or female voice). In the following description, the types of synthesized singing sounds are male voice and female voice, but there may be various voice types such as children, adults, Japanese, English, etc., or a combination thereof.

  The operation unit 305 is a device such as a switch or a volume knob, and outputs a signal corresponding to the input operation to the control unit 301. The display unit 307 is a display device such as a liquid crystal display or an organic EL display, and displays a screen based on control by the control unit 301. Note that the operation unit 305 and the display unit 307 may be integrated with each other as a touch panel. The communication unit 309 connects to the control terminal 2 by short-range wireless communication based on the control of the control unit 301.

  The interface 317 includes a terminal that outputs the generated audio signal. A plurality of keys are arranged on the keyboard 321. When each key is operated, a performance signal corresponding to the operation is output to the control unit 301. The performance signal includes information indicating the position of the operated key (key number), information indicating that the key is pressed (key on), information indicating that the key is released (key off), key pressing speed (velocity), and the like. Specifically, when a key is pressed, key-on, velocity, and key number are output in association with each other, and when the key is released, key-off is output. The control part 301 produces | generates a synthetic song sound using this performance signal.

  The electronic keyboard device 3 may not be able to be changed when the tone color (the type of synthesized singing sound to be generated) can be changed. This difference depends on the function realized by the control program. This difference will be described in detail in the description of the function of the electronic keyboard device 3.

  Next, functions realized by executing a control program in each of the karaoke device 1, the control terminal 2, and the electronic keyboard device 3 will be described. A part or all of the configuration for realizing each function described below may be realized by hardware. With these functions, the user designates the target music piece, and the electronic keyboard device 3 is set according to the music piece.

[Functions of karaoke equipment]
FIG. 5 is a block diagram illustrating functions realized by the karaoke apparatus according to the embodiment of the present invention. The karaoke function 10 includes a music selection unit 11, an accompaniment sound generation unit 13, a lyrics display unit 15, and a scoring unit 17. The music selection unit 11 acquires the song ID of the singing song designated by the control terminal 2 and acquires the song data corresponding to the song ID from the karaoke server 1000. Of the music data acquired by the music selection unit 11, accompaniment data is provided to the accompaniment sound generation unit 13, and lyrics data is provided to the lyrics display unit 15. The accompaniment sound generation unit 13 generates an accompaniment sound based on the accompaniment data and causes the speaker 115 to generate a sound. The lyrics display unit 15 displays lyrics on the display unit 107 based on the lyrics data. At this time, the information (wipe etc.) indicating the position to be sung in accordance with the progress of the music is displayed together with the lyrics.

  The scoring unit 17 evaluates the input audio signal and calculates an evaluation score corresponding to the evaluation. The calculated evaluation score is displayed on the display unit 107, for example. This evaluation is performed as follows, for example. First, the time change of the pitch of the synthesized singing sound (when acquired from the electronic keyboard device 3) or the singing voice (when acquired from the microphone) is calculated from the audio signal and compared with the pitch of the guide melody. An evaluation score is calculated based on the degree of coincidence of these pitches. The pitch may be calculated by a known method such as a method using a zero cross of the waveform of an audio signal or a method using FFT (Fast Fourier Transform).

[Function of control terminal]
FIG. 6 is a block diagram illustrating functions implemented by the control terminal according to the embodiment of the present invention. The setting control function 20 includes a song designation unit 21, a lyrics data acquisition unit 23, a setting information acquisition unit 25, and a lyrics setting provision unit 27. That is, the control terminal 2 includes a control device having the setting control function 20. The song designation unit 21 receives designation of a song to be enjoyed as karaoke from the user and notifies the karaoke device 1 (the song selection unit 11) of a song ID that identifies the song.

  The lyric data acquisition unit 23 acquires lyric data corresponding to the song with the song ID. In this example, the lyrics data is acquired from the song synthesis server 2000. Note that lyrics data used in the karaoke device 1 may be used in the electronic keyboard device 3 in some cases. In this case, the lyrics data acquisition unit 23 may acquire the lyrics data from the karaoke server 1000 or may acquire it from the karaoke apparatus 1.

  FIG. 7 is an explanatory diagram showing lyrics data of a plurality of parts in one embodiment of the present invention. In the example shown in FIG. 7, the song data is the lyrics data of the song with the song ID “ABC0401”. This song has two parts, “male voice” and “female voice”. The lyric data includes lyric data 1 corresponding to the “male voice” part and lyric data 2 corresponding to the “female voice” part.

  Returning to FIG. 6, the description will be continued. The setting information acquisition unit 25 acquires setting information from the communicable electronic keyboard device 3. As shown in FIG. 1, when there are two electronic keyboard devices 3, the setting information acquisition unit 25 acquires setting information in association with information for identifying each of the two electronic keyboard devices 3. This setting information includes information on whether or not the timbre can be changed in the electronic keyboard device 3 (tone color change information), and information on the currently set timbre (tone color setting if at least the timbre cannot be changed). Information). Note that the timbre change information is not limited to indicating whether or not the timbre setting can be directly changed, such as the model number of the electronic keyboard device 3 (cannot be changed if it is a predetermined model number) and the timbre setting. This indicates whether the timbre can be changed indirectly depending on whether information is included (cannot be changed if it is included), the type of timbre that can be set (cannot be changed if there is one), etc. May be.

  The lyrics setting providing unit 27 provides the lyrics data acquired by the lyrics data acquiring unit 23 to the electronic keyboard device 3. At this time, the lyrics setting providing unit 27 assigns the part of the lyrics data to be provided according to the setting information acquired by the setting information acquiring unit 25. The part assignment method will be described.

[Singing part assignment process]
FIG. 8 is a flowchart for explaining processing in the lyrics setting providing unit according to the embodiment of the present invention. When the lyric data is acquired by the lyric data acquisition unit 23 and the setting information is acquired by the setting information acquisition unit 25, the singing part is assigned to each of the electronic keyboard devices 3, and the process shown in FIG. 8 is started. . First, the lyrics setting providing unit 27 refers to the setting information and determines whether or not the timbre setting can be changed (step S201). If it is possible to change the timbre setting for all the electronic keyboard devices 3 (step S201; Yes), a singing part to be assigned to each electronic keyboard device 3 is determined (step S203). At this time, it is desirable that the parts assigned to each electronic keyboard device 3 are selected from a plurality of singing parts so as not to overlap as much as possible. That is, if the number of electronic keyboard devices 3 whose settings can be changed is larger than the number of singing parts, it is desirable that all of the singing parts are assigned to any one of the electronic keyboard devices 3. On the other hand, if the number of electronic keyboard devices 3 whose settings can be changed is smaller than the number of singing parts, it is desirable that one singing part is not assigned to a plurality of electronic keyboard devices 3. A plurality of singing parts may be assigned to one electronic keyboard device 3, or all the singing parts may be assigned to one of the electronic keyboard devices 3 in this way.

  Subsequently, the identification information of the singing part assigned to this device and the lyrics data of this singing part are associated with the electronic keyboard device 3 (step S205), and are provided as data for setting lyrics (step S207). ), The process is terminated. In this example, the identification information is indicated by the type of synthetic singing sound (voice type) such as “male voice” and “female voice”. If the electronic keyboard device 3 includes a device that cannot change the timbre setting (step S201; No), the singing part assigned to the electronic keyboard device 3 whose setting cannot be changed is the part corresponding to the set timbre. (Step S209). For example, when the timbre set in the electronic keyboard device 3 is a female timbre, the female voice part is determined as a singing part to be assigned. Then, the lyric data corresponding to the singing part is provided as the lyrics setting data to the electronic keyboard device 3 whose settings cannot be changed (step S211). At this time, since the setting cannot be changed in the electronic keyboard device 3, the identification information of the singing part need not be provided.

  Subsequently, it is determined whether or not a device whose setting can be changed remains in the electronic keyboard device 3 (step S213). If there is no electronic keyboard device 3 that can be changed (step S213; No), the process is terminated. On the other hand, when the electronic keyboard device 3 whose settings can be changed remains (step S213; Yes), the singing part to be assigned to the remaining electronic keyboard device 3 while giving priority to the singing part that has not been assigned yet is set to step S203. The method is determined in the same manner as in (Step S215). Then, the processing of steps S205 and S207 is executed for the electronic keyboard device 3 whose settings can be changed, and the process ends.

  When lyrics data as shown in FIG. 7 is acquired, examples of singing parts assigned to the respective combinations of electronic keyboard devices 3 and examples of transmitted lyrics setting data will be described.

[Example of song part assignment]
FIG. 9 is a diagram for explaining an example of lyrics setting data transmitted to each of the combinations of the electronic keyboard devices according to the embodiment of the present invention. As shown in FIG. 7, in this example, it is assumed that the lyrics data includes two parts, a male voice part and a female voice part.

(1) FIG. 9A shows a case in which the two electronic keyboard devices 3 are devices A and B in which setting change is possible. In this case, a male voice part is assigned to either one and a female voice part is assigned to the other.
(2) FIG. 9B shows a case where one of the two electronic keyboard devices 3 is a device A that can be changed in setting, and the other is a device B in which a male voice tone is set and cannot be changed. In this case, the male voice part is preferentially assigned to the device B whose setting cannot be changed. The remaining female voice part is assigned to the device A. In this example, the song setting data transmitted to the device B does not include the identification information of the song part.
(3) FIG. 9C shows the case of the devices A, B, and C in which the three electronic keyboard devices 3 can change their settings. In this case, the singing part is assigned to the devices A and B as in FIG. 9A, and either the male voice part or the female voice part is assigned to the remaining device C. Which one to assign may be determined according to a preset rule. In this example, a male voice part is assigned.
(4) FIG. 9D shows the case where one electronic keyboard device 3 is a device A in which a female voice color is set and cannot be changed. In this case, the female voice part is assigned to the device A. At this time, the male voice part is not assigned to any electronic keyboard device 3. Therefore, for the male voice part, the display of the display unit 107 may be controlled so as to prompt input of the singing voice by the microphone. For the male voice part, the karaoke device 1 or the control is performed using the lyrics data 1. The terminal 2 may generate a synthesized singing sound and output it from the speaker 115.
(5) FIG. 9 (e) shows a case in which one electronic keyboard device 3 is a device A whose settings can be changed. In this case, either the male voice or the female voice singing part may be assigned, but in this example, both the male voice part and the female voice part are assigned. Although details will be described later, this is applied when the user can switch the singing part by operating the electronic keyboard device 3.

  The above is the description of the function of the control terminal 2.

[Functions of electronic keyboard device]
Next, functions of the electronic keyboard device 3 will be described. As described above, the electronic keyboard device 3 includes a device that cannot change the timbre setting (first example), a device that can change the timbre setting (second example), and a timbre set by the control terminal 2. An example of a device (third example) capable of switching (singing part) will be described.

[First example (cannot be changed)]
FIG. 10 is a block diagram showing functions realized by the first example of the electronic keyboard device according to the embodiment of the present invention. The synthesized singing sound generation function 30 includes a lyrics setting acquisition unit 31, a lyrics setting unit 33, a signal generation unit 35, and a setting information output unit 37. In other words, the electronic keyboard device 3 includes a synthetic singing sound generation device provided with a synthetic singing sound generation function 30. The lyrics setting acquisition unit 31 acquires lyrics setting data transmitted from the control terminal 2. In the first example, since the device cannot change the timbre setting, the lyrics setting data may include only the lyrics data. This is because the setting cannot be changed even if the identification information of the singing part is acquired. The lyrics setting unit 33 sets the lyrics data used in the signal generation unit 35 in the signal generation unit 35.

  The signal generation unit 35 uses the lyrics data set by the lyrics setting unit 33 and preset timbre (male voice, female voice, etc.) to generate an audio signal indicating a synthesized singing sound according to the operation of the keyboard 321. . The setting information output unit 37 outputs setting information based on the contents set in the signal generation unit 35 in response to a request from the control terminal 2. In this example, the setting information includes at least tone color setting information. Next, the outline of the synthetic singing sound generation processing in the signal generation unit 35 will be briefly described. In addition, about the technique which produces | generates a synthetic song sound using an electronic keyboard apparatus, it is disclosed by said patent document 1 (Unexamined-Japanese-Patent No. 2008-170592) and patent document 2 (Unexamined-Japanese-Patent No. 2014-62969), for example. ing.

[Synthetic song generation process]
FIG. 11 is a flowchart illustrating processing in the signal generation unit according to the embodiment of the present invention. When lyrics data is set in the signal generator 35, the processing shown in FIG. 11 is started. First, the signal generator 35 designates the first character of the lyrics indicated by the set lyrics data (step S301). The designated character and the characters before and after the character may be distinguished from each other and displayed on the display unit 307. The presence / absence of a performance operation (key depression) is determined based on a performance signal output from the keyboard 321 and waits until a key depression is performed (step S303; No).

  If a performance operation has been performed (step S303; Yes), the designated character is read (step S305), and is read with the pitch specified for the key (key number) on which the performance operation (key depression) has been performed. An audio signal indicating a synthesized singing sound for uttering a character is generated (step S307). For example, when the read character is “ka (ka)” and the performance-operated key is “C4”, a synthesized singing sound that generates “ka (ka)” at the pitch of C4 is generated. The

  When the designated character (read character) is not the last character of the lyrics (step S309; No), the next character is designated (step S311) and the next performance operation is awaited (step S303; No). . If the next character is sequentially designated and becomes the last character (step S309; Yes), the process returns to step S301 again. By doing in this way, the synthetic singing sound by which the lyrics adjusted to the pitch according to performance operation are uttered sequentially is produced | generated. Then, an audio signal indicating the synthesized singing sound is output to the karaoke apparatus 1. When a predetermined operation on the operation unit 305 or the like is received, the next character may be forcibly designated. Also, if you have acquired information that categorizes the lyrics in phrase units, you can force the first character of one of the phrases (immediately before or after) to be specified when a given operation is accepted. Also good.

[Second example (setting can be changed)]
FIG. 12 is a block diagram illustrating functions realized by the second example of the electronic keyboard device according to the embodiment of the present invention. The synthesized singing sound generation function 30A includes a lyrics setting acquisition unit 31, a lyrics setting unit 33, a signal generation unit 35, a setting information output unit 37, and a timbre selection unit 39. The lyric setting acquisition unit 31, the lyric setting unit 33, and the signal generation unit 35 have the same functions as the synthetic singing sound generation function 30 described in the first example, and thus description thereof is omitted.

  The timbre selection unit 39 specifies the singing part of the lyric data based on the lyric setting data acquired by the lyric setting acquisition unit 31, selects the timbre corresponding to the singing part, and sets it in the signal generation unit 35. For example, if the selectable timbre is “male voice” or “female voice” and the singing part based on the lyrics setting data is “male voice part”, the timbre of “male voice” is selected and the signal generation unit 35 is selected. Set to The set timbre may be presented to the user via the display unit 307.

  When there are a plurality of selectable timbres due to the presence of timbre groups classified in the same manner, for example, when “male voice A” and “male voice B” exist as timbres classified as “male voice” The tone color may be determined according to a predetermined rule (random, predetermined order, etc.). Alternatively, a candidate timbre may be presented via the display unit 307 and the user may select any timbre via the operation unit 305.

  The setting information output unit 37 is the same as the first example in that setting information based on the content set in the signal generation unit 35 is output in response to a request from the control terminal 2. On the other hand, in the second example, the content of the setting information includes information (tone color change information) indicating that the timbre setting can be changed. The tone color setting information may or may not be included. Note that the electronic keyboard device 3 may not want to change the timbre set in advance via the operation unit 305 even if the timbre setting can be changed. In such a case, control may be performed so that the setting cannot be changed. In this case, the setting information similar to the first example, that is, the timbre setting information indicating the timbre set in advance is output, assuming that the setting cannot be changed from the timbre set in advance. do it.

[Third example (setting can be changed, singing part can be switched)]
FIG. 13 is a block diagram showing functions implemented by the third example of the electronic keyboard device according to the embodiment of the present invention. The synthesized song sound generation function 30B includes a lyrics setting acquisition unit 31, a part selection unit 32, a lyrics setting unit 33, a signal generation unit 35, a setting information output unit 37, and a timbre selection unit 39. Since the components other than the part selection unit 32 have the same functions as the synthetic singing sound generation function 30 described in the first example and the synthetic singing sound generation function 30A described in the second example, description thereof is omitted.

  The part selection unit 32 is used when a plurality of singing parts are assigned to one electronic keyboard device 3 as shown in FIG. When a plurality of singing parts are assigned to one electronic keyboard device 3, the lyrics setting acquisition unit 31 acquires lyrics setting data including lyrics data of the plurality of singing parts. Therefore, in order for the lyrics setting unit 33 and the tone color selection unit 39 to set the signal generation unit 35, one of the singing parts must be selected. Therefore, the part selection unit 32 selects one of the allocated singing parts based on a user instruction (for example, input via the operation unit 305). At this time, the name of the singing part may be selected to select the singing part directly, or by selecting any character of the lyric data, the singing part corresponding to the lyric data is indirectly selected. May be. The timbre selection unit 39 selects a timbre corresponding to the selected singing part and sets it in the signal generation unit 35. The lyrics setting unit 33 sets lyrics data corresponding to the selected singing part in the signal generation unit 35.

  This completes the description of the functions of the electronic keyboard device 3.

  As described above, according to the karaoke system 100 according to the embodiment of the present invention, when the tune to be sung is specified for the karaoke device 1 in the control terminal 2, the electronic keyboard device 3 also corresponds to the singing tune. Lyric data and the like for generating a synthesized singing sound are set. Moreover, in a duet song in which a plurality of singing parts exist, even if a singing part is assigned to each of the plurality of electronic keyboard devices 3 or only one electronic keyboard device 3 is provided, the optimal singing part Therefore, the convenience of the electronic keyboard device 3 can be improved.

<Other embodiments>
In the description of the above embodiment, when lyrics setting data is provided to the electronic keyboard device 3, it is provided in a state where the lyrics data of the entire song is included. May be provided in real time. When provided in real time, for example, when a performance operation is performed, lyrics may be provided one by one from the control terminal 2, several characters may be provided, or provided in phrases. May be. Moreover, when provided in real time, the identification information of a song part may be changed. According to this, the timbre can be changed in the middle of the music piece by changing the identification information.

  Although the identification information of the singing part mentioned above was shown by the kind (voice type) of the synthetic singing sound, it may be shown in another form. For example, it may not be a format representing the type of singing sound, such as a combination of “Part 1” and “Part 2”, and a combination of “Main” and “Sub”. In the case of such a format, information for identifying the highest and lowest sounds of the melody for each singing part (key number or the like) may be further included in the identification information. By this identification information, the range of each singing part may be determined and associated with the type of singing sound.

  In the karaoke system 100 described above, the karaoke device 1, the control terminal 2, and the electronic keyboard device 3 have their respective functions realized in their respective devices, but some or all of the functions of each device are different. It may be realized by an apparatus. For example, part or all of the setting control function 20 in the control terminal 2 may be realized in the electronic keyboard device 3. When the entire setting control function 20 in the control terminal 2 is realized in the electronic keyboard device 3, it is equivalent to the control terminal 2 and the electronic keyboard device 3 being an integrated device. On the contrary, each function may be realized by using more devices. For example, in the electronic keyboard device 3, a synthetic singing sound generation device provided with the synthetic singing sound generation function 30 and a device (for example, a MIDI keyboard) provided with a keyboard 321 portion may be configured separately. At this time, the synthetic singing sound generation device may be included in the control terminal 2.

  The synthesized singing sound was generated when the user pressed the key on the keyboard 321. That is, the key is an example of a performance operator for generating a synthesized singing sound. On the other hand, the performance operator may be other than a key, for example, a string of a guitar synthesizer (guitar type controller) or a key of a wind synthesizer (wind instrument type controller).

DESCRIPTION OF SYMBOLS 1 ... Karaoke apparatus, 2 ... Control terminal, 3 ... Electronic keyboard apparatus, 10 ... Karaoke function, 11 ... Music selection part, 13 ... Accompaniment sound generation part, 15 ... Lyric display part, 17 ... Scoring part, 20 ... Setting control function, DESCRIPTION OF SYMBOLS 21 ... Song designation | designated part, 23 ... Lyrics data acquisition part, 25 ... Setting information acquisition part, 27 ... Lyric setting provision part, 30, 30A, 30B ... Synthetic song sound generation function, 31 ... Lyric setting acquisition part, 32 ... Part selection 33, lyrics setting unit, 35 ... signal generation unit, 37 ... setting information output unit, 39 ... tone color selection unit, 100 ... karaoke system, 101, 201, 301 ... control unit, 103, 203, 303 ... storage unit, 105, 205, 305 ... operation unit, 107, 207, 307 ... display unit, 109, 209, 309 ... communication unit, 111 ... signal processing unit, 113 ... input terminal, 115 ... speaker, 317 ... interface 321 ... keyboard, 1000 ... karaoke server, 2000 ... server for singing synthesis

Claims (7)

A lyric data acquisition unit that acquires lyric data of a plurality of parts, defining the lyrics to be sung in the music designated as the accompaniment target;
From the operation of the performance operator, the character specified based on the operation of the lyrics defined in the lyrics data, and the synthesized singing sound generation device that generates an audio signal based on preset tone color setting information, A setting information acquisition unit for acquiring timbre setting information;
A lyrics setting providing unit that selects any one of a plurality of parts based on the received timbre setting information, and provides lyric data of the selected part to the synthetic singing sound generation device in which the timbre setting information is set; ,
A control device comprising:   The lyric setting providing unit transmits the timbre setting information to the lyric data of the part selected based on the timbre setting information when the timbre setting information is not changeable in the synthetic singing sound generation device. The control device according to claim 1, wherein the control device transmits the synthesized singing sound generation device.   The lyrics setting providing unit selects, from the plurality of parts, a part to be assigned to the synthetic singing sound generation device according to a predetermined rule when the timbre setting information is changeable in the synthetic singing sound generation device. The control device according to claim 1 or 2, wherein identification information indicating a part to be assigned to the singing sound generation device and lyrics data of the part are transmitted to the synthetic singing sound generation device. A lyrics setting acquisition unit for acquiring lyrics data defining lyrics to be sung and identification information corresponding to a part of the lyrics data;
A timbre selection unit that selects one of a plurality of timbre setting information based on the identification information;
A signal generator for generating an audio signal based on the operation of the performance operator, the character specified based on the operation among the lyrics defined in the acquired lyrics data, and the selected timbre setting information;
A synthetic singing sound generating apparatus comprising: The lyrics setting acquisition unit acquires the identification data corresponding to the lyrics data of each part and the lyrics data of each part,
A part selection unit for selecting one of the plurality of parts;
The timbre selection unit selects one of a plurality of timbre setting information based on the identification information corresponding to the selected part,
5. The signal generation unit according to claim 4, wherein the signal generation unit generates an audio signal based on the lyrics data corresponding to the selected part, the selected timbre setting information, and an operation of a performance operator. Synthetic singing sound generator. Acquire lyrics data for multiple parts that specify the lyrics that should be sung in the music designated as the accompaniment.
From the operation of the performance operator, the character specified based on the operation of the lyrics defined in the lyrics data, and the synthesized singing sound generation device that generates an audio signal based on preset tone color setting information, Obtain tone setting information,
Selecting any one of a plurality of parts based on the received timbre setting information and providing the lyric data of the selected part to the synthetic singing sound generating apparatus in which the timbre setting information is set; A program to be executed. Acquire lyrics data defining the lyrics to be sung and identification information corresponding to the parts of the lyrics data,
Based on the identification information, select one of a plurality of timbre setting information,
A program for causing a computer to generate an audio signal based on operation of a performance operator, lyrics specified based on the operation among the acquired lyrics data, and selected tone color setting information.

Images