JP6051075B2 - A communication karaoke system that can continue duet singing in the event of a communication failure - Google Patents

Description

  The present invention relates to a communication karaoke system that includes a server and a plurality of karaoke apparatuses that are communicably connected via a communication line and is configured to perform a duet song.

  A communication karaoke system configured to perform a duet singing using a plurality of karaoke apparatuses that are communicably connected via a communication line is known. For example, in Patent Document 1, an information management server is connected to a communication line (communication network), and a user's music performance communication device or a mobile phone is connected to the communication line, so that the remote management can be performed at many remote locations. A system for realizing a duet or choral karaoke is disclosed.

  When video and audio are transmitted and received using a communication line, communication delay and failure become a problem. With respect to such a problem, in the system of Patent Document 1, the acoustic signal is distributed to the communication line in preference to other signals or the like in order to suppress an excessive delay.

  Patent Document 2 discloses a technique for automatically playing back alternative video content when a communication line (network) is disconnected during playback of the video content. This technique is difficult to apply to a communication karaoke system that performs real-time duet singing because the buffered video content is played before the network disconnection.

  Patent Document 3 discloses a technique for storing vocal sounds of a plurality of songs and automatically switching to a performance with vocals when a singer's voice is interrupted. Since this technique is a technique for a singer who has not completely mastered the music, no consideration is given to a communication karaoke system for performing a duet song.

JP 2005-77485 A JP 2006-279544 A JP-A-4-298793

  As described above, regarding the communication karaoke system that performs duet singing, an effective countermeasure against a communication line failure has not yet been proposed. The present invention has been made in view of such circumstances, and an object of the present invention is to continuously perform duet singing even when a failure occurs in a communication line.

  In order to achieve the above-mentioned object, the present invention connects a plurality of karaoke apparatuses and servers to each other through a communication line, and transmits singing video data and singing voice data based on singing at the transmitting side karaoke apparatus through the communication line. A communication karaoke system for performing a duet singing of a certain piece of music by playing it on the playback side karaoke apparatus, wherein the server indicates the singing video data acquired along with the singing of the karaoke piece A song that is stored in association with a user ID and a song ID that indicates the karaoke song, and the playback-side karaoke device is selected based on the user ID and the song ID. Singing video data storage means for receiving from the server and storing singing video data at the time of singing a certain piece of music by a person, and the communication A failure determining means for determining the presence or absence of communication failure on the line, and a playback control means for playing back the singing video data instead of the singing video data and the singing voice data when it is determined that there is a communication failure. Features.

  According to the present invention, when it is determined that there is a communication failure, the singing video data stored in the singing video data storage unit is read by the reproduction control unit, and the singing video data and the singing voice from the transmitting side karaoke apparatus are read out. Since it is reproduced instead of data, a duet song can be continuously performed even if the singing video data and the singing voice data cannot be received. And since the singing animation data currently reproduced | regenerated are those of a singing partner, the atmosphere of a duet song is hard to be impaired.

  In the communication karaoke system described above, the playback side karaoke apparatus determines that the communication failure has been recovered based on the playback volume of the singing voice data after the failure determination means determines that there is a communication failure. Preferably, the reproduction control means reproduces the singing video data and the singing voice data instead of the singing video data when it is determined that the communication failure has been recovered. In this communication karaoke system, when a communication failure is recovered, a duet song can be performed again with the singer of the transmitting side karaoke apparatus.

  In the communication karaoke system described above, the playback side karaoke apparatus determines that the communication failure has been recovered based on the playback volume of the singing voice data after the failure determination means determines that there is a communication failure. The singing video data storage means stores the singing video data separately into a video part and an audio part, and when the reproduction control means determines that the communication failure has recovered, the singing video data storage means Preferably, the singing voice data is reproduced instead of the voice part of the moving picture data, and the reproduction of the video part of the singing moving picture data is continued. In this communication karaoke system, when a communication failure is recovered, a duet song can be performed again with the singer of the transmitting side karaoke apparatus. And about the large capacity | capacitance song video data which is easy to cause a communication failure, since it is not transmitted / received through a communication line, communication stability can be improved.

  In the communication karaoke system described above, the recovery determination means determines that the recovery from the communication failure has been made on the condition that the playback volume of the singing voice data has increased over a predetermined time from a preset threshold value. Is preferred. In this communication karaoke system, it is possible to perform a duet singing again with the singer of the transmitting side karaoke apparatus while the communication is stable.

  In the above communication karaoke system, the failure determination means transmits a confirmation request to the transmitting karaoke apparatus through the communication line on condition that the playback volume of the singing voice data is smaller than a preset threshold value. It is preferable to determine that there is a communication failure when the response from the transmitting karaoke apparatus cannot be received within a specified time. In this communication karaoke system, the presence or absence of a communication failure can be reliably determined.

  According to the communication karaoke system of the present invention, duet singing can be performed continuously even if a failure occurs in the communication line.

It is a conceptual diagram explaining schematic structure of a communication karaoke system. It is a block diagram explaining the structure of a host apparatus. It is a conceptual diagram explaining historical data. It is a block diagram explaining the structure of a karaoke apparatus. It is a block diagram explaining the structure of a karaoke main body. It is a block diagram explaining the structure of a sound processing part. It is a block diagram explaining the structure of a user terminal. It is a block diagram explaining the state where a pair of karaoke apparatus which performs a duet was connected via the communication line. It is a figure explaining the mode of each karaoke room at the time of a communication duet. It is a figure explaining the outline of the processing at the time of failure occurrence. It is a flowchart explaining the process of the reproduction | regeneration side karaoke apparatus. It is a figure explaining the determination sound volume.

  Hereinafter, embodiments of the present invention will be described. The communication karaoke system shown in FIG. 1 has a host device 1, a karaoke device 2, and a user terminal 3. And these are connected via the communication line 4 so that communication is possible. The karaoke apparatus 2 is installed in each karaoke room RM of the karaoke store KB, for example. When performing a duet singing through the communication line 4 (hereinafter referred to as a communication duet), the pair of karaoke devices 2 and 2 are connected to each other via the communication line 4 and the singing video distributed from the host device 1 Data is stored in each karaoke device 2. Hereinafter, each apparatus which comprises a communication karaoke system is demonstrated.

  First, the host device 1 will be described. The host device 1 functions as a server and accumulates and manages various information such as customer information. As illustrated in FIG. 2, the host device 1 includes a host-side control unit 11, a host-side communication unit 12, and a host-side storage unit 13. The host-side control unit 11 is a central part of control in the host device 1 and includes a CPU 11a and a memory 11b. The CPU 11a executes various controls according to the operation program stored in the memory 11b. The memory 11b is a storage element that stores a program to be executed by the CPU 11a and temporarily stores various types of information when the program is executed. The host-side communication unit 12 provides an interface for connecting the host device 1 to the communication line 4.

  The host-side storage unit 13 is a storage device that stores a large amount of information, and includes a hard disk drive or the like. A partial area of the host-side storage unit 13 is used as a customer information storage area, a singing voice data storage area, a singing video data storage area, and a browsing moving image data storage area.

  The customer information storage area is an area in which personal information and history data of the user (singer) are stored. For example, as shown in FIG. 3, a user ID for identifying a user, a song ID indicating a karaoke song sung in the past, use store information indicating a store used, singing date information indicating a singing date and time of the karaoke song And the scoring result information etc. which show the scoring result of the said karaoke music are stored.

  In the singing voice data storage area and the singing video data storage area shown in FIG. 2, singing voice data uploaded from the karaoke apparatus 2 (hereinafter referred to as singing voice data) and singing video data (hereinafter referred to as singing video data) are stored. Area. These singing voice data and singing video data are singing video data that is the basis of the singing video content.

  Singing voice data and singing video data are stored in a state associated with the above-described user ID and music ID. That is, the host side memory | storage part 13 accumulate | stores and memorize | stores the song animation data acquired with the song of karaoke music in the state matched with user ID which shows a singer, and music ID which shows karaoke music. It corresponds to moving image data storage means. In this embodiment, MP3 format data is used for singing voice data, and MPEG2 format data is used for singing video data.

  In the browsing moving image data storage area, browsing moving image data for allowing the user terminal 3 to browse is stored. This browsing moving image data is data serving as a basis for the singing moving image content reproduced on the user terminal 3. The browsing moving image data of the present embodiment is WMV format or MP4 format moving image data, and is data having a smaller file size than the singing moving image data (a set of singing voice data and singing video data) from the karaoke apparatus 2. The browsing moving image data is generated by the host-side control unit 11 with the uploading of the singing moving image data from the karaoke apparatus 2.

  Next, the karaoke apparatus 2 will be described. The karaoke device 2 performs karaoke performances and singing scores. For example, as shown in FIG. 4, the karaoke main body 21, the speaker 22, the monitor 23, the microphone 24, the video camera 25, and the remote control device 26 are provided. The video communication terminal 27 and the audio communication terminal 28 are provided.

  The karaoke main body 21 is a part that performs various controls relating to karaoke singing, such as performance control of selected karaoke music, display control of lyrics and background video, and processing of a singing voice signal input through the microphone 24. The karaoke main body 21 will be described in detail later.

  The speaker 22 is connected to the karaoke main body 21 and emits sound based on the sound emission signal from the karaoke main body 21. The monitor 23 is also connected to the karaoke main body 21 and displays video on the screen based on the video signal from the karaoke main body 21. The microphone 24 is also connected to the karaoke main body 21, and converts the voice of the singer into an analog singing voice signal and causes the karaoke main body 21 to input it. The video camera 25 is also connected to the karaoke main body 21 and causes the karaoke main body 21 to input photographed video (for example, video during singing) as singing video data.

  The remote control device 26 includes a short-range wireless communication unit capable of bidirectional communication for transmitting and receiving information to and from the karaoke main body 21, and reservation of karaoke music, acquisition of a user ID of a singer, etc. This is done via the interface of the remote control device 26.

  When an operation signal including the user ID of the singer and the song ID is output from the remote control device 26 at the time of karaoke song reservation, the main body control unit 31 stores the user ID and song ID of the singer inside. It is stored in the memory 31b and managed in a performance processing queue. Then, the user ID and the music ID are transmitted to the host device 1. Based on these user ID and music ID, the host device 1 can recognize a state in which a user (singer) who sings and a music to be sung are associated with each other.

  The remote control device 26 of the present embodiment also functions as a start signal transmission unit that transmits a start signal in a communication duet. Although details will be described later, in this communication karaoke system, a certain karaoke device 2 functions as a parent device and another karaoke device 2 functions as a child device when a communication duet is executed. Then, a start signal from the remote control device 26 of the parent-side karaoke device 2 is transmitted to each of the parent-side karaoke main body 21 and the child-side karaoke main body 21. In this case, a start signal is directly input to the karaoke main body 21 on the parent side, and an access point (not shown) and a communication line 4 (general-purpose communication) are input to the karaoke main body 21 on the child side. Is transmitted via the line 4A).

  Further, the remote control device 26 also functions as the user terminal 3. In this case, the remote control device 26 is connected to the host device 1 via the access point and the general-purpose communication line 4A. For this reason, the user can access my page while staying at the karaoke store KB.

  The video communication terminal 27 and the audio communication terminal 28 are connected to the other party's karaoke apparatus 2 via the communication line 4 when a communication duet is performed, and the singing video shot by the video camera 25 Data and singing voice data acquired through the microphone 24 and the like are transmitted and received. Specifically, the video communication terminal 27 transmits and receives the singing video data to and from the video communication terminal 27 included in the karaoke device 2 on the other side via the video communication line 4B. Similarly, the voice communication terminal 28 transmits / receives the singing voice data to / from the voice communication terminal 28 of the other party karaoke apparatus 2 via the voice communication line 4C. In these video communication line 4B and audio communication line 4C, the karaoke apparatus 2 to be connected can be selected by a telephone number, an IP address, or the like.

  The singing video data from the other party's karaoke apparatus 2 received by the video communication terminal 27 is input to the karaoke main body 21. Similarly, singing voice data from the karaoke device 2 on the other side received by the voice communication terminal 28 is also input to the karaoke main body 21. The karaoke main body 21 is communicably connected to the counterpart karaoke main body 21 and the host device 1 via the general-purpose communication line 4A. Various data and information other than the singing video data and singing voice data at the time of the communication duet are transmitted / received via the general-purpose communication line 4A. Thus, in the communication karaoke system of this embodiment, the singing video data and the singing voice data at the time of the communication duet are transmitted and received via the dedicated video communication line 4B and the audio communication line 4C.

  Next, the karaoke main body 21 will be described in detail. As shown in FIG. 5, the karaoke main body 21 includes a main body side control unit 31, a main body side communication unit 32, a main body side storage unit 33, an acoustic processing unit 34, a display processing unit 35, and a video input unit 36. And an operation unit 37. These units are connected to a communicable state via the bus BS.

  The main body side control unit 31 is a central part of control in the karaoke main body 21, and includes a CPU 31a and a memory 31b. The CPU 31a executes various controls according to the operation program stored in the memory 31b. For example, an operation input process for receiving an operation from the operation unit 37 and a sequencer process that operates as a sequencer are performed. The memory 31b is a storage element that stores a program to be executed by the CPU 31a and temporarily stores various types of information when the program is executed. The main body side communication unit 32 provides an interface for connecting the karaoke main body 21 to the communication line 4 (general-purpose communication line 4A). The operation of the main body side communication unit 32 is controlled by the main body side control unit 31.

  The main body side storage unit 33 is a large-capacity storage device that stores various types of data, and includes, for example, a hard disk drive. In the main body side storage unit 33, for example, a music data storage area, a background video data storage area, a singing video data storage area, and a singing voice data storage area are provided.

  The music data storage area stores music data for playing the karaoke music selected by the remote control device 26, and the background video data storage area stores background video data for displaying the background video on the monitor 23. Is done. In the singing video data storage area, singing video data of a duet target song sung in the past by the duet partner is downloaded from the host device 1 and stored. Similarly, in the singing voice data storage area, singing voice data of a duet target song sung in the past by the duet partner is downloaded from the host device 1 and stored. For this reason, the main body side storage unit 33 (singing video data storage area, singing voice data storage area) corresponds to singing video data storage means.

  The acoustic processing unit 34 is a part that performs performance control for karaoke music, processing of a singing voice signal input through the microphone 24, and processing of singing voice data input through the voice communication terminal 28. As shown in FIG. 6, the acoustic processing unit 34 includes an audio reproduction unit 41, an audio level adjustment unit 42, a sound source device 43, a mixer 44, and an amplifier 45.

  The sound reproducing unit 41 is a part that generates a singing sound signal (referred to as a moving image sound signal for convenience) based on the singing sound data stored in the singing sound data storage area. The audio level adjustment unit 42 is a part that adjusts the volume of each of the singing voice of the singer, the singing voice of the duet partner, and the video voice of the singing video (referred to as singing video voice for convenience). The audio level adjustment unit 42 receives the moving image audio signal from the audio reproduction unit 41, the singing audio signal from the microphone 24, and the singing audio data from the audio communication terminal 28. And the audio | voice level adjustment part 42 outputs the audio | voice audio | voice audio | voice signal, singing audio | voice signal, and the other party singing audio | voice signal obtained by analog conversion of singing audio | voice data in the state which adjusted the sound volume.

  The sound source device 43 is a MIDI sound source, for example, and generates a musical sound signal based on music data. The mixer 44 mixes various signals output from the sound source device 43 and the audio level adjustment unit 42 at an appropriate ratio and outputs the mixed signal to the amplifier 45. In the present embodiment, a moving image audio signal, a singing audio signal, a counterpart singing audio signal, and a musical sound signal are appropriately input to the mixer 44. The amplifier 45 amplifies the mixing signal from the mixer 44 and outputs it to the speaker 22 as a sound emission signal. Thereby, the karaoke performance sound and singing sound based on the sound emission signal are emitted from the speaker 22.

  The display processing unit 35 shown in FIG. 5 performs control such as display of a background video during karaoke performance. At the time of karaoke performance, background video data is input to the display processing unit 35, and the background video data is decoded. Then, the display processing unit 35 combines the lyrics telop with the video signal of the background video generated by the decoding, and outputs the combined video signal to the monitor 23. As a result, the monitor 23 displays a video in which lyrics telop is superimposed on the background video.

  Further, the display processing unit 35 causes the monitor 23 to display the other party's singing video data received via the video communication terminal 27 when a communication duet is being performed. At this time, a predetermined position on the monitor 23 is overwritten (superimposed) with a video based on video data directly input from the video camera 25, that is, a singer's singing video.

  The video input unit 36 is a part that performs a process of taking in singing video data from the video camera 25 and is configured by a so-called video card. The video input unit 36 includes, for example, an external interface for connecting to the video camera 25 and the video communication terminal 27, an internal interface for connecting to the main body side control unit 31 and the like through the bus BS, and a video as a frame buffer. It has a memory (both not shown).

  The operation unit 37 includes a panel switch, a remote control receiving circuit, and the like, and outputs an operation signal corresponding to the operation of the panel switch or the remote control device 26 by the user to the main body side control unit 31. The main body side control unit 31 detects an operation signal by performing an operation input process, and executes a corresponding process. Note that the panel switch and the remote control device 26 include various key switches (not shown) for selecting an operation. The execution of the communication duet can be selected by an operation through the remote control device 26.

  Next, the user terminal 3 will be described. The user terminal 3 is a communication terminal operated by a karaoke user, and is operated when browsing the singing video content. As shown in FIG. 1, the user terminal 3 includes a personal computer 3A, a tablet computer 3B, a mobile phone 3C, and the like. Further, as described above, the remote control device 26 is also included in the user terminal 3.

  As illustrated in FIG. 7, the user terminal 3 includes a terminal-side control unit 51, a terminal-side communication unit 52, a terminal-side storage unit 53, a display unit 54, and an input unit 55.

  The terminal-side control unit 51 is a central part of control in the user terminal 3, and includes a CPU 51a and a memory 51b. The CPU 51a executes various controls according to the operation program stored in the memory 51b. The memory 51b is a storage element that stores a program to be executed by the CPU 51a and temporarily stores various types of information when the program is executed. The terminal-side communication unit 52 provides an interface for connecting the user terminal 3 to the communication line 4 (general-purpose communication line 4A). The terminal-side storage unit 53 is a storage device that stores various types of information, and includes a nonvolatile memory, a hard disk drive, and the like.

  The display unit 54 and the input unit 55 are both parts that provide a user interface. The display unit 54 is a part that displays various menus, operation radio buttons, and the like, and is configured by a liquid crystal display device or a cathode ray tube, for example. The input unit 55 is a part that captures an operation performed by a user as operation information, and includes, for example, a keyboard, a mouse, and a touch panel. In the tablet computer 3B and the remote control device 26 that require portability, a liquid crystal display panel with a touch panel in which the display unit 54 and the input unit 55 are integrated is preferably used.

  Next, the operation of the communication karaoke system having the above configuration will be described. This karaoke system is characterized by communication duet processing. For this reason, the description will focus on the operation of the communication duet.

  FIG. 8 is a block diagram illustrating a state in which a pair of karaoke apparatuses 2A and 2B that perform a communication duet are connected via the communication line 4 (4A to 4C). At the time of execution of the communication duet, one karaoke device 2A is the parent side and the other karaoke device 2B is the child side. For convenience, in the following description, the parent-side karaoke device 2 is referred to as a parent-side karaoke device 2A, and the child-side karaoke device 2 is referred to as a child-side karaoke device 2B. And each part with which the parent side karaoke apparatus 2A is provided is shown with the word “parent side”, and each part with the child side karaoke apparatus 2B is shown with the word “child side”.

  When a communication duet is selected by operating the parent-side remote control device 26A or the child-side remote control device 26B, the parent-side video communication terminal 27A and the child-side video communication terminal 27B can communicate with each other via the video communication line 4B. The parent-side voice communication terminal 28A and the child-side voice communication terminal 28B are connected to be communicable via the voice communication line 4C. As a result, the video shot by the parent video camera 25A can be viewed on the child monitor 23B, and the sound collected by the parent microphone 24A is emitted from the child speaker 22B. Similarly, the video shot by the child video camera 25B can be viewed on the parent monitor 23A, and the sound collected by the child microphone 24B is emitted from the parent speaker 22A.

  That is, singing video data and singing voice data acquired by the karaoke apparatus 2 on the transmission side are transmitted through the communication line 4. Then, the karaoke device 2 on the reproduction side receives the singing video data and the singing voice data, and reproduces these data. Since the parent side karaoke main body 21A and the child side karaoke main body 21B are connected so as to be always communicable via the general-purpose communication line 4A, necessary information can be transmitted and received via the general-purpose communication line 4A.

  When the communication duet is selected, the song ID of the karaoke music that is the subject of the communication duet and the singer singing using the karaoke device 2 between the parent side karaoke device 2A and the child side karaoke device 2B. The user ID of the user and the user ID of the duet partner are shared. These pieces of information are transmitted to the host device 1. Based on these pieces of information, the host device 1 selects singing video data (a set of singing video data and singing voice data) when each singer has sung in the past for the selected karaoke piece. And the duet partner's song moving image data is distributed to each karaoke apparatus 2A, 2B. Thereby, in each karaoke apparatus 2A, 2B, the singing video data and singing voice data of a duet partner are memorize | stored in a singing video data storage area and a singing voice data storage area.

  Thereafter, when the angles of the video cameras 25A and 25B and the input sensitivities of the microphones 24A and 24B are adjusted and the communication duet is ready, the parent remote control device 26A instructs the start of the communication duet. . Thereby, the start signal is transmitted from the parent-side remote control device 26A and received by the parent-side karaoke main body 21A and the child-side karaoke main body 21B. The start signal in the present embodiment is directly transmitted to the parent karaoke main body 21A, and is transmitted to the child karaoke main body 21B through the access point and the general-purpose communication line 4A. And if a start signal is received in each karaoke main body 21A, 21B, a communication duet will be started. That is, karaoke accompaniment is started in each of the parent-side karaoke main body 21A and the child-side karaoke main body 21B. Each singer can perform a duet song by singing along with the karaoke accompaniment.

  FIG. 9 is a diagram for explaining a communication duet. As shown in the figure, in the parent-side karaoke room RM (parent), the child-side singing video XB and the parent-side singing video XA are displayed on the parent-side monitor 23A. Similarly, in the child side karaoke room RM (child), the parent side singing video XA and the child side singing video XB are displayed on the child side monitor 23B. Further, in the parent side karaoke room RM (parent) and the child side karaoke room RM (child), a synthesized voice obtained by synthesizing the parent side singing voice and the child side singing voice is emitted from the parent side speaker 22A and the child side speaker 22B. Is done. Thus, a communication duet is realized by sharing the singing video and the singing voice between the pair of karaoke apparatuses 2A and 2B connected by the communication line 4.

  In this communication karaoke system, the song moving image data of the duet partner is used when the communication duet is executed. For example, the presence or absence of a communication failure is determined based on the singing volume of the duet partner, and when it is determined that there is a communication failure, the song video data is reproduced instead. In addition, when the singing volume of the duet partner is equal to or higher than the threshold over a specified time, the reproduction of the singing moving image data is stopped.

  For convenience, in the following description, when a communication duet is performed, a state in which the singing voice of the other party singer is played is referred to as a duet mode, and the singing video data is replaced with the singing video and the singing voice of the other party singer. The state of being played is called a moving image playback mode.

  For example, in the example shown in FIG. 10, a duet song is started at time t0. The duet mode is set at the start of singing. Then, when the volume of the other party's singing voice decreases to less than the threshold at time t1, and when it is determined that there is a communication failure at time t2, the mode shifts to the moving image playback mode. Thereby, reproduction | regeneration of the song animation data of a duet partner is performed in time with the timing from the middle of a music.

  After that, at time t3, the volume of the other party's singing voice returns to the threshold value or more and continues until time t4, so that the communication is determined to be stable. Accordingly, the duet mode is restored. That is, at time t4, the reproduction of the singing voice data constituting the singing moving image data is stopped and the reproduction of the other party singing voice is started. In addition, reproduction | regeneration is continued about song video data which comprises song moving image data. Thereafter, a duet song is performed until time t5. In this duet singing, the singing voice after time t4 is based on the singing voice data received through the communication line 4, but the singing video is a reproduction of the singing video data.

  By performing such control, even if the singing voice data cannot be received due to communication failure, the singing video data is reproduced over the period, and the duet singing can be continued. And since the duet song is not interrupted, the singer can sing well. Further, since the singing video after returning to the duet mode is a reproduction of the singing video data, the communication load is reduced.

  Hereinafter, the above control will be described in detail with reference to the flowchart of FIG. This flowchart explains the reproduction-side operation of each karaoke apparatus 2A, 2B that performs a duet song. In other words, the operation of the karaoke device 2 on the playback side will be described.

  When performing the communication duet, the user of the parent side karaoke apparatus 2A and the user (singer) of the child side karaoke apparatus 2B perform a pre-operation (S1). In this preliminary operation, the parent-side remote control device 26A and the child-side remote control device 26B are operated to set the karaoke devices 2A and 2B to the communication duet mode. As a result of this pre-operation, song video data is transmitted and received between the parent video communication terminal 27A and the child video communication terminal 27B, and the parent audio communication terminal 28A and the child audio communication terminal 28B. Singing voice data is transmitted to and received from each other. In addition, karaoke music to be sung duet is selected and preparation for performance is performed.

  In this preliminary operation, in each karaoke apparatus 2A, 2B, the user ID of the singer and the music ID of the karaoke music to be sung duet are shared and transmitted to the host device 1. Based on the received user ID and music ID, the host device 1 selects singing video data (a set of singing video data and singing voice data) of the karaoke music acquired in the past singing by each singer, and the other party Download to the karaoke apparatus 2 that the side singer sings is started (S2). That is, transmission of the singing video data by the singer of the child karaoke device 2B is started to the parent karaoke device 2A, and the singing movie data of the singer of the parent karaoke device 2A is transmitted to the child karaoke device 2B. Is started.

  When downloading of the singing moving image data is started, each karaoke apparatus 2A, 2B waits for reception of a start signal (S3). Here, when the reproduction-side karaoke device 2 is the parent-side karaoke device 2A, the start signal from the parent-side remote control device 26A is directly received. On the other hand, when the playback-side karaoke apparatus 2 is the child-side karaoke apparatus 2B, the start signal transmitted through the access point and the general-purpose communication line 4A is received. If a start signal is received, it will be judged whether download of song animation data was completed, and it will wait until download is completed (S4).

  The performance of karaoke music is started on the condition that downloading of each singing video data is completed (S5). Here, reading of music data stored in the main body side storage unit 33 is started by sequence control by the main body side control unit 31 and input to the acoustic processing unit 34 and the display processing unit 35. Thereby, karaoke accompaniment and a lyric display are started by each karaoke apparatus 2A, 2B. At the same time, the playback of the song video data is also started in the background so that video and audio are not output.

  Next, the main body side control unit 31 functions as a counterpart singing voice acquisition unit and acquires the singing voice of the counterpart singer (S6). For example, the counterpart singing voice signal obtained by the conversion in the acoustic processing unit 34 is sampled for measurement. If the singing voice is acquired, the main body side control unit 31 functions as a mode determination unit and determines the mode of the duet singing (S7). Here, it is determined whether the duet mode or the moving image playback mode is being performed. For example, the main body control unit 31 determines the duet mode when the other party singing voice signal is output based on the operation status of the audio level adjustment unit 42, and when the moving image audio signal is output. The video playback mode is determined. Note that the mode determination is not limited to this method, and other methods may be used.

  When it is determined that the duet mode is set in the mode determination process in step S7, the main body side control unit 31 functions as a volume determination unit, and determines the volume of the opponent singing voice (S8). For example, as shown in FIG. 12, the first threshold TH1 for failure determination set based on the volume VL of the singing video sound is compared with the volume of the other-side singing voice (reproduction volume of the singing voice data), It is determined whether or not the volume of the side singing voice is greater than or equal to the first threshold value TH1. If it is equal to or greater than the first threshold TH1, it is determined that no communication failure has occurred, and the process proceeds to step S14. On the other hand, if it is less than the first threshold TH1, it is determined that a communication failure may have occurred, and the process proceeds to the communication failure determination process in step S9.

  Note that the first threshold value TH1 is used when determining the presence or absence of a communication failure, and thus a value that is sufficiently lower than the volume VL of the singing moving image audio is set. For example, it is set to about 20 to 30% of the volume VL. The first threshold TH1 is not limited to a numerical value based on the volume VL, and may be set to a constant value.

  In the communication failure presence / absence determination process (S9), the main body control unit 31 functions as a failure determination unit and determines the presence / absence of a communication failure. In the present embodiment, confirmation requests (such as ping) are transmitted from the audio communication terminals 28A and 28B through the audio communication line 4C. Thereafter, it is determined that there is no communication failure when a response from the karaoke device 2 on the other side can be received within a specified time, and it is determined that there is a communication failure when it cannot be received. The specified time in this case can be arbitrarily set, but is set to 0.5 to 1.0 seconds, for example. This is because it is considered that there will be no major hindrance to the duet singing at this time. And when it determines with there being no communication failure, it transfers to step S14. When it is determined that there is a communication failure, the duet mode is switched to the moving image playback mode. That is, the process proceeds to the first mode switching process (S11) in which the downloaded song moving image data is reproduced.

  In the first mode switching process (S11), the main body side control unit 31 functions as a reproduction control unit, and reproduces downloaded song video data instead of the other party song video and the other party song voice. Here, the main body side control unit 31 controls the sound processing unit 34 and the display processing unit 35 to reproduce the downloaded singing video data and singing voice data that have been reproduced in the background in the foreground. If the first mode switching process is performed, the process proceeds to step S14.

  Further, when the moving image playback mode is determined in the mode determination process in step S7 described above, the main body side control unit 31 functions as a recovery determination unit, and the volume of the opponent singing voice is equal to or higher than the determination volume over a specified time. Is determined (S12). For example, as shown in FIG. 12, the second threshold value TH2 for recovery determination set based on the volume VL of the singing video sound is compared with the volume of the opponent singing voice, and the volume of the opponent singing voice is the second. It is determined whether or not the threshold value TH2 is exceeded.

  If the state is equal to or higher than the second threshold TH2 and this state continues for about 5 seconds, the communication failure is recovered and the video playback mode is switched to the duet mode. That is, the process proceeds to the second mode switching process (S13) for emitting the other party singing voice. On the other hand, if it is less than the second threshold TH2, or if the period equal to or longer than the second threshold TH2 has not reached the specified time, it is determined that the communication failure has not been recovered and the process proceeds to step S14.

  Note that the second threshold value TH2 is used when determining recovery from a communication failure, and thus a value relatively close to the volume VL of the singing video sound is set. For example, it is set to about 60 to 80% of the volume VL. The second threshold TH2 is not limited to a numerical value based on the volume VL, and may be set to a constant value.

  Also in the second mode switching process (S13), the main body side control unit 31 functions as a reproduction control unit, and releases the other party singing voice received via the voice communication line 4C instead of the singing voice data being reproduced. Let it sound. At this time, the singing voice data being played back is shifted to playback in the background with the playback volume reduced.

  As for the singing video, the singing video data is continuously reproduced. This is to improve the stability of the communication line 4. That is, in an environment where a communication failure occurs, the communication line 4 is considered to be unstable, and even a dedicated line may be affected in some way. Therefore, the large-capacity song video data is not transmitted / received, and the relatively small-capacity song audio data is transmitted / received. If the second mode switching process is performed, the process proceeds to step S14.

  In step S14, it is determined whether or not the karaoke music has ended. For example, the main body side control unit 31 determines whether or not the sequence control for the karaoke piece being reproduced has been performed to the end. Then, when the performance is in progress, the process proceeds to the above-described step S6, and the above-described process is repeated in order from the acquisition process of the opponent singing voice. On the other hand, when the performance is finished, the series of processing is finished.

  According to the communication karaoke system of the present embodiment that performs the above processing, the host device 1 (server) uses the singing video data acquired with the singing of the karaoke music, the user ID indicating the singer and the karaoke music. It has the host side memory | storage part 13 (singing moving image data storage means) which matches and memorize | stores in relation to music ID to show. And each karaoke apparatus 2 receives from the host apparatus 1 and memorize | stores the song moving image data at the time of the past singing of a certain music by the singer of a duet partner selected based on user ID and music ID. Singing video data instead of singing video data and singing voice data when it is determined that there is a communication fault in the main body side storage unit 33 (singing video data storage means) and the communication line 4 and when there is a communication fault. Since it has the main body side control part 31 (failure determination means, reproduction control means) that reproduces the singing voice data from the karaoke device 2 on the transmission side cannot be received, the duet singing is continuously performed. Can do. And since the singing animation data currently reproduced | regenerated are those of a singing partner, the atmosphere of a duet song is hard to be impaired.

  In addition, after determining that there is a communication failure, the main body side control unit 31 (recovery determination means), based on the playback volume of the singing voice data from the other party, this playback volume is set to be greater than a preset second threshold TH2. Since it is determined that the communication failure has been recovered on the condition that it has become larger over the specified time, it is possible to perform a duet singing again with the singer of the karaoke apparatus 2 on the other side while the communication is stable. .

  The main body side storage unit 33 (singing video data storage means) stores the singing video data separately into singing video data (video part) and singing voice data (sound part), and the main body side control unit 31 (reproduction control). Means) reproduces the singing voice data received through the voice communication line 4C instead of the singing voice data stored in the main body side storage unit 33 when it is determined that the communication failure has been recovered, and the main body side storage unit Since the reproduction of the song moving image data stored in 33 is continued, large-capacity song video data is not subject to transmission / reception through the video communication line 4B, and communication stability can be improved.

  Moreover, the main body side control unit 31 (failure determination means) sends the other party through the voice communication line 4C on the condition that the reproduction volume of the singing voice data from the other party is lower than the preset first threshold TH1. When the confirmation request is transmitted to the karaoke device 2 on the side and the response from the karaoke device 2 is not received within the specified time, it is determined that there is a communication failure, so the presence or absence of a communication failure is reliably determined. be able to.

  The above description of the embodiment is for facilitating the understanding of the present invention, and does not limit the present invention. The present invention can be changed and improved without departing from the gist thereof, and the present invention includes equivalents thereof. For example, you may comprise as follows.

  First, regarding the past song moving image data of the duet partner, a plurality of song moving image data may be accumulated in the host device 1 for the selected karaoke piece. In this case, it is preferable to distribute the latest singing moving image data to the karaoke apparatus 2 based on the singing date and time. If it does in this way, a duet song can be continued in the state nearest to the present song technique. Moreover, you may distribute the singing moving image data of the highest score to the karaoke apparatus 2 based on a scoring result. If it does in this way, a duet song can be continued in the state near the best of a duet partner.

  In the above-described embodiment, the example in which the reproduction of the song video data stored in the main body storage unit 33 is continued even after it is determined that the communication failure has been recovered is not limited to this configuration. For example, after the restoration determination, the singing video data may be transmitted / received through the video communication line 4B.

  Moreover, regarding the singing moving image data, in the above-described embodiment, the singing video data and the singing voice data are exemplified, but the configuration is not limited thereto. Singing video data in a format in which video and audio are integrated may be used. In this case, it is preferable to use browsing moving image data having a relatively small capacity because the transfer time from the host device 1 can be shortened.

  Regarding the communication line 4, in the above-described embodiment, the video communication line 4B and the audio communication line 4C are illustrated as dedicated lines. However, these may be configured as general-purpose lines or singing video data. The communication line 4 for transmitting and receiving singing voice data may be configured as a dedicated line.

DESCRIPTION OF SYMBOLS 1 ... Host apparatus, 2 ... Karaoke apparatus, 2A ... Parent side karaoke apparatus, 2B ... Child side karaoke apparatus, 3 ... User terminal, 3A ... Personal computer, 3B ... Tablet computer, 3C ... Mobile phone, 4 ... Communication line, 4A ... General-purpose communication line, 4B ... Video communication line, 4C ... Audio communication line, 11 ... Host side control unit, 11a ... CPU, 11b ... Memory, 12 ... Host side communication unit, 13 ... Host side storage unit, 21 ... Karaoke main body, 21A ... parent side karaoke main body, 21B ... child side karaoke main body, 22 ... speaker, 22A ... parent side speaker, 22B ... child side speaker, 23 ... monitor, 23A ... parent side monitor, 23B ... child side monitor, 24 ... Mic, 24A ... Parent microphone, 24B ... Slave microphone, 25 ... Video camera, 25A ... Parent video camera, 25B ... Slave video camera, 6 ... remote control device, 26A ... parent side remote control device, 26B ... child side remote control device, 27 ... video communication terminal, 27A ... parent video communication terminal, 27B ... child video communication terminal, 28 ... audio communication terminal 28A ... Parent-side voice communication terminal, 28B ... Slave-side voice communication terminal, 31 ... Main body side control unit, 31a ... CPU, 31b ... Memory, 32 ... Body side communication unit, 33 ... Body side storage unit, 34 ... Acoustic processing unit, 35 ... display processing unit, 36 ... video input unit, 37 ... operation unit, 41 ... audio reproduction unit, 42 ... audio level adjustment unit, 43 ... sound source device, 44 ... mixer, 45 ... amplifier, 51 ... terminal Side control unit, 51a ... CPU, 51b ... Memory, 52 ... Terminal side communication unit, 53 ... Terminal side storage unit, 54 ... Display unit, 55 ... Input unit, KB ... Karaoke shop, RM ... Karaoke room, XA ... Parent side Singing video, XB ... Child side song Video, BS ... bus

Claims (5)

A plurality of karaoke apparatuses and servers are connected to each other via a communication line, singing video data and singing voice data based on singing on the transmitting side karaoke apparatus are transmitted through the communication line, and reproduced on the reproducing side karaoke apparatus, or A communication karaoke system for performing duet singing of music,
The server
The song video data acquired along with the singing of the karaoke music is stored in association with the user ID indicating the singer and the music ID indicating the karaoke music,
The playback side karaoke device
Singing video data that is selected based on the user ID and the music ID and that receives the singing video data of the singing song in the past by the singer of the transmitting side karaoke apparatus from the server and stores it. Storage means;
Failure determination means for determining the presence or absence of a communication failure in the communication line;
A communication karaoke system comprising reproduction control means for reproducing the singing video data instead of the singing video data and the singing voice data when it is determined that there is a communication failure. The playback-side karaoke apparatus has recovery determination means for determining that the communication failure has been recovered based on the playback volume of the singing voice data after the failure determination means determines that there is a communication failure,
2. The communication karaoke according to claim 1, wherein the reproduction control unit reproduces the singing video data and the singing voice data instead of the singing video data when it is determined that the communication failure is recovered. system. The playback-side karaoke apparatus has recovery determination means for determining that the communication failure has been recovered based on the playback volume of the singing voice data after the failure determination means determines that there is a communication failure,
The singing video data storage means stores the singing video data separately for a video part and an audio part,
When it is determined that the reproduction control unit has recovered from a communication failure, the reproduction control unit reproduces the singing voice data instead of the voice part of the singing video data, and continues to reproduce the video part of the singing video data. The communication karaoke system according to claim 1, wherein   3. The recovery determination unit determines that the recovery from the communication failure is performed on the condition that a reproduction volume of the singing voice data is increased over a predetermined time from a preset threshold value. Or the communication karaoke system of 3. The failure determination means includes
On the condition that the playback volume of the singing voice data is smaller than a preset threshold value, a confirmation request is transmitted to the transmitting side karaoke device through the communication line, and a response from the transmitting side karaoke device is set to a specified time. 5. The communication karaoke system according to claim 1, wherein the communication karaoke system determines that there is a communication failure when the data cannot be received.

Images