TWI755805B - Multimedia scoring system and method - Google Patents

Abstract

The present invention provides a multimedia scoring system and method. The multimedia scoring system includes a database, a karaoke host system, a mixing module, and an auxiliary scoring system. The karaoke host system obtains a specified song data and a specified song scoring timing data from the database according to a song designation command, and calculates a synchronization starting point based on a synchronization timing and the specified song scoring timing data to generate and transmit a corresponding starting point indication signal and the designated song scoring timing data. The auxiliary scoring system samples vocal information and executes a song scoring procedure in response to the synchronization start point being reached according to the starting point indication signal.

Description

Multimedia scoring system and method

The present invention relates to a multimedia scoring system and method, in particular to a multimedia scoring system and method which can greatly improve the range of applicable platforms for karaoke scoring techniques and functions.

Although most of the existing karaoke systems have been commercialized, most of them do not have a professional smart scoring function, and many electronic devices such as smart TVs or TV boxes cannot or are not easy to record for scoring when running the karaoke system, so it is impossible to obtain recording files for real-time scoring. analyze.

On the other hand, most of the existing karaoke scoring technologies use the karaoke application running on the karaoke system to score after the complete recording of the singing voice. When the accompaniment player is OK, many systems do not fully consider supporting the recording function, so that the scoring software cannot obtain the singing voice for analysis and scoring, so it is impossible to realize the K song scoring function. Or, when the device for recording singing voice and the karaoke system operate independently, it is difficult to achieve the goal of real-time scoring due to the delay in timing.

Therefore, there is an urgent need for a multimedia scoring system and method that can greatly improve the range of applicable platforms for karaoke scoring technology and functions, and can accurately achieve timing synchronization for real-time scoring.

The technical problem to be solved by the present invention is to provide a multimedia scoring system and method which can greatly improve the range of applicable platforms for karaoke scoring technology and functions, aiming at the deficiencies of the prior art.

In order to solve the above technical problems, one of the technical solutions adopted by the present invention is to provide a multimedia scoring system, which includes a database, a first timing unit, a karaoke master system, a mixing module and an auxiliary scoring system. The database stores a plurality of song data and a plurality of corresponding song score time series data. The first timing unit is used for generating a synchronization timing signal for indicating a synchronization timing. The K-song master system is electrically connected to the database and includes a first communication module and a first processing unit. The first communication module is configured to transmit a synchronization request signal and obtain the synchronization timing signal. The first processing unit is configured to obtain a specified song data and a specified song scoring time series data from the database according to a song specifying command, and control the karaoke master system to play the specified song data specified song according to the song specifying command , and calculates a synchronization starting point according to the synchronization timing and the specified song scoring timing data, so as to generate a corresponding starting point indicating signal for indicating the synchronization starting point. The mixing module is configured to pick up and generate vocal data. The auxiliary scoring system is electrically connected to the main karaoke system and the mixing module and includes a second communication module, a sampling unit and a second processing unit. The second communication module is configured to obtain the synchronization timing signal from the first communication module, and to receive the starting point indication signal and the assigned song rating timing data. The sampling unit is configured to sample the vocal data. The second processing unit is configured to obtain the specified song scoring time series data, and according to the synchronization starting point indicated by the starting point indicating signal, execute a song scoring program when the synchronization starting point is reached, wherein the song scoring The procedure includes: controlling the sampling unit to continuously sample the part of the vocal data after the starting point to generate a sampled audio data; comparing the sampled audio data with the specified song scoring time series data to obtain a comparison result ; according to the comparison result, perform scoring and correspondingly generate a scoring result data; and transmit the scoring result data to the karaoke host system through the second communication module.

In order to solve the above-mentioned technical problems, another technical solution adopted by the present invention is to provide a multimedia scoring method, which includes the following steps: configuring a first processing unit of a karaoke master system to select a song from the database according to a song specifying command Obtain a specified song data and a specified song scoring time sequence data; configure a first timing unit to generate a synchronization sequence signal for indicating a synchronization sequence; configure a first communication module of the K-song master system and the auxiliary scoring system A second communication module is connected through a first communication protocol, and the first communication module and the second communication module are configured to obtain the synchronization timing signal; the first processing unit is configured according to the synchronization timing and the specified song The scoring time series data calculates a synchronization starting point, so as to correspondingly generate a starting point indicating signal for indicating the synchronization starting point; the starting point indicating signal and the specified song scoring time series data are transmitted through the first communication module to The auxiliary scoring system; configuring a sound mixing module to collect and generate vocal data; and configuring a second processing unit of the auxiliary scoring system to obtain the specified song scoring time series data, and according to the starting point indication signal indicates the signal A synchronization starting point, when the synchronization starting point is reached, a song scoring program is executed, which includes the following steps: controlling the sampling unit to continuously sample the part of the vocal data after the starting point to generate a sampled audio data; compare the sampled audio data with the specified song scoring time series data to obtain a comparison result; carry out scoring according to the comparison result and generate a scoring result data correspondingly; and use the second communication module to obtain the scoring result data transmitted to the K-song master system.

One of the beneficial effects of the present invention is that, with the multimedia scoring system and method provided by the present invention, the K-song master system itself does not need to support the recording function, as long as the k-song master system and the auxiliary scoring system can communicate with each other and synchronize the time sequence. , and can transmit specific data by playing the codec of the audio. Therefore, the range of applicable platforms for karaoke scoring technology and functions can be greatly improved, including smart TVs or TV set-top boxes, karaoke accompaniment players, etc.

For a further understanding of the features and technical content of the present invention, please refer to the following detailed descriptions and drawings of the present invention. However, the drawings provided are only for reference and description, and are not intended to limit the present invention.

The following are specific embodiments to illustrate the implementation of the "multimedia scoring system and method" disclosed in the present invention, and those skilled in the art can understand the advantages and effects of the present invention from the content disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and various details in this specification can also be modified and changed based on different viewpoints and applications without departing from the concept of the present invention. In addition, the drawings of the present invention are merely schematic illustrations, and are not drawn according to the actual size, and are stated in advance. The following embodiments will further describe the related technical contents of the present invention in detail, but the disclosed contents are not intended to limit the protection scope of the present invention.

It should be understood that although terms such as "first", "second" and "third" may be used herein to describe various elements or signals, these elements or signals should not be limited by these terms. These terms are primarily used to distinguish one element from another element, or a signal from another signal. In addition, the term "or", as used herein, should include any one or a combination of more of the associated listed items, as the case may be.

Referring to FIG. 1 , an embodiment of the present invention provides a multimedia scoring system 1 , which includes a database 10 , a K-song master system 12 , a mixing module 14 and an auxiliary scoring system 16 .

The database 10 stores a plurality of song data 100 and a plurality of corresponding song score time series data 102 . In the embodiment of the present invention, a plurality of song data 100 to be used in the karaoke master system 12 may be stored in the database 10, and the song data 100 may include, for example, song data sung by a specific singer, unvoiced accompaniment data , lyrics data and music video data. On the other hand, the song scoring time series data 102 may include original singing audio data corresponding to the above-mentioned plurality of song data 100 and subsequently used for scoring the singing content of the user, and edited to have a time tag corresponding to each lyric, and a corresponding The original singing audio data, pitch, tempo, length, volume data and score data, etc. at these time stamps.

The karaoke master system 12 of the present invention will be further described. Devices implementing the karaoke master system 12 may include hardware, firmware, and/or software, and may take any of a variety of forms. Typical examples of such form factors include notebook computers, smart phones, small personal computers, personal digital assistants, smart TVs, OTT set-top boxes, and the like. The functions described herein can also be implemented on peripheral devices or built-in cards. By way of further example, this function may also be implemented on different chips or circuit boards with different programs executing on a single device. For example, the karaoke master system 12 can be used to execute karaoke software in the above-mentioned device, or play backing songs.

As shown in FIG. 1 , the karaoke host system 12 is electrically connected to the database 10 and includes a user interface 120 , a first communication module 122 and a first processing unit 124 . The karaoke master system 12 may include at least one controllable display device for displaying the user interface 120 , and may be, for example, an interface for the user to control, such as a touch interface, and the user can input input through the user interface 120 . Various commands, such as K-song software execution command, play command, stop command, and song designation command, etc. The user interface 120 may further provide a form corresponding to the song data 100 for the user to select a specific song to be sung.

The first communication module 122 can be used to electrically connect the karaoke main system 12 to the database 10 . Alternatively, the database 10 may be built in the device for executing the karaoke host system 12, directly electrically connected to the karaoke host system 12, or connected via wired network or wireless network communication, but is not limited to the above methods. The first communication module 122 can be, for example, a USB communication module, an Ethernet communication module, a wireless network communication module or a wireless Bluetooth communication module. Another purpose of the first communication module 122 is to transmit the synchronization request signal S1 to obtain the synchronization timing signal S2 for indicating the synchronization timing, and the synchronization timing signal S2 will be used for subsequent time synchronization of song playback and scoring, and will be explained below.

Continuing, the first processing unit 124 can be configured to obtain the specified song data 20 and the specified song rating time series data 22 from the database 10 according to the song specifying command received from the user interface 120, and control the user according to the song specifying command The interface 120 plays the specified song data 20 . Specifically, the specified song data 20 and the specified song score time series data 22 are designated by the user, and one song data 100 and its corresponding song score time series data 102 are selected from the plurality of song data 100 .

On the other hand, the functions of the first processing unit 124 may be implemented by using one or more processing units. The first processing unit 124 may be a programmable unit, such as a microprocessor, a microcontroller, a digital signal processor (DSP) chip, a field-programmable gate array (FPGA), etc. . The functions of the first processing unit 124 can also be implemented by one or several electronic devices or ICs. In other words, the functions performed by the first processing unit 124 may be implemented in the hardware domain or the software domain or a combination of the hardware domain and the software domain.

Further, the sound mixing module 14 of the present invention will be described first. The sound mixing module 14 is electrically connected to the sound pickup unit 18 , and can be configured to receive sound through the sound pickup unit 18 and generate vocal data 24 . The mixing module 14 can integrate sounds from multiple sources into a stereo sound track (Stereo) or monophonic sound track (Mono), and can adjust the frequency, dynamics, sound quality, positioning of each original signal according to the needs. , reverb and soundstage are individually adjusted to optimize each track and then layered with the vocal profile 24. The mixing module 14 may include a Synthesizer, a Signal Processor and a Mixing Console, or may use software mixing to achieve the effects of the above devices.

In addition, the sound-receiving unit 18 can be, for example, a microphone, and can be electrically connected to the sound mixing module 14 in a wired or wireless manner. The mixing module 14 can be electrically connected to the main K-song system 12 and the auxiliary scoring system 16 by wire or wirelessly.

In a specific embodiment, the mixing module 14 may simply transmit the unmixed vocal data 24 to the karaoke host system 12 , and after mixing the vocal data 24 through the karaoke host system 12 to generate the mixed data, The mixing material is broadcast through the audio playing unit (eg, speakers) of the karaoke master system 12 .

In an alternative embodiment, the mixing module 14 itself can optimize the mixing of the vocal data 24 and the specified song data 20 to generate the mixed data, and transmit the mixed data to the karaoke master system 12 for passing through the karaoke master system 12 The audio playback unit (eg, speakers) broadcasts the mixed data. Therefore, the singer can listen to his own singing voice after being broadcasted by the audio playback unit. Meanwhile, in the above embodiment, the mixing module 14 also simultaneously transmits the unmixed vocal data 24 to the auxiliary scoring system 16 for analysis, comparison and scoring in subsequent singing scoring.

Before describing the details of song scoring, the auxiliary scoring system 16 of the present invention is first described. In order to solve the problem that the existing karaoke master system has no professional intelligence scoring function, the multimedia scoring system 1 of the present invention further provides an auxiliary scoring system 16, which is electrically connected to the karaoke master system 12 and the mixing module 14, and includes The second communication module 160 , the first timing unit 162 , the sampling unit 164 and the second processing unit 166 . Devices implementing auxiliary scoring system 16 may include hardware, firmware, and/or software, and may take any of a variety of forms. Typical examples of such forms include notebook computers, smart phones, small personal computers, personal digital assistants, or plug-and-play USB devices, among others. The functions described herein can also be implemented on peripheral devices or built-in cards. By way of further example, this function may also be implemented on different chips or circuit boards with different programs executing on a single device. In this embodiment, although the first timing unit 162 is included in the auxiliary scoring system 16 and is used to provide the synchronization timing signal S2, the present invention is not limited to this, and the main K-song system 12 may also be provided with another A timing unit, which will be described in subsequent embodiments.

The second communication module 160 is used for connecting with the first communication module 122 through a first communication protocol, such as USB communication protocol, and the second communication module 160 can be used for obtaining the synchronization timing signal S2 from the first timing unit 162 . Similarly, the second communication module 160 can be, for example, a USB communication module, an Ethernet communication module, a wireless network communication module or a wireless Bluetooth communication module.

Generally speaking, when performing real-time song scoring between the K-song master system 12 and the auxiliary scoring system 16, the difficulty lies in the different timings of the two, and it is difficult to achieve the goal of real-time feedback of song scoring. Usually, the entire song must be scored. Recording, the singing score will not be known until the end of the song. Therefore, in order to synchronize the signal streams of the two, in the embodiment of the present invention, when the first processing unit 124 controls the user interface 120 to play the specified song data 20 according to the song specifying command, firstly controls the first communication module 122 The synchronization request signal S1 is sent to the second communication module 160 , and in response to this, the second communication module 160 transmits the obtained synchronization timing signal S2 to the first communication module 122 . After obtaining the synchronization timing, the first processing unit 124 calculates the synchronization starting point according to the synchronization timing and the specified song scoring timing data 22 at the same time, so as to correspondingly generate the starting point indicating signal S3 for indicating the synchronization starting point, and pass the first signal S3. The communication module 122 transmits the starting point indication signal S3 and the specified song scoring time sequence signal S4 with the specified song scoring time sequence data 22 to the auxiliary scoring system 16 . For example, the first processing unit 124 can obtain the timing data 22 of the rating of the specified song, and use the time point when the lyrics of the first sentence start as the synchronization start point, so as to generate the corresponding start point indication signal S3.

Next, the second communication module 160 further receives the start point indication signal S3 and the specified song scoring time sequence signal S4. The sampling unit 164 may receive the vocal data 24 from the mixing module 14 and sample the vocal data 24 . Sampling may include converting the vocal data 24, which is originally an analog signal, into a digital signal that can be recognized or processed by the second processing unit 166 for use in subsequent song scoring.

Similarly, the functions of the second processing unit 166 may be implemented using one or more processing units. The second processing unit 166 may be a programmable unit, such as a microprocessor, a microcontroller, a digital signal processor (DSP) chip, a field-programmable gate array (FPGA), and the like . The functions of the second processing unit 166 can also be implemented by one or several electronic devices or ICs. In other words, the functions performed by the second processing unit 166 may be implemented in the hardware domain or the software domain or a combination of the hardware domain and the software domain.

Further, the designated song scoring time sequence signal S4 may have a specific signal format, so the second processing unit 166 must first decode the designated song scoring time sequence signal S4 to obtain the designated song scoring time series data 22, which includes the corresponding designated song data 20 The time label of each sentence of the lyrics, and the original singing audio data, pitch, beat, length, volume data and score data corresponding to these time labels, and according to the synchronization start point indicated by the start point indication signal S3, The song scoring procedure is performed when the synchronization start point is reached.

The song scoring program will be described together with the embodiment of the multimedia scoring method provided by the present invention. Please refer to FIG. 2 , which is a flowchart of a multimedia scoring method according to an embodiment of the present invention. It should be noted that, the multimedia scoring method of this embodiment is applicable to the multimedia scoring system of the above-mentioned embodiment, but is not limited thereto.

As shown in FIG. 2 , for the convenience of description, the process is divided according to the configuration of the main K-song system and the auxiliary scoring system, and the repeated description in some steps will be omitted. And the multimedia scoring method of the embodiment of the present invention comprises the following steps:

Step S100: Configuring the user interface 120 to receive a song specifying command input by the user.

Step S101 : configure the first processing unit 124 to obtain the specified song data 20 and the specified song scoring time series data 22 from the database 10 according to the song specifying command.

Step S102: Configure the first timing unit 162 to generate a synchronization timing signal S2 for indicating the synchronization timing.

Step S103: Configuring the first communication module 122 and the second communication module 160 to be connected through the first communication protocol for obtaining the synchronization timing signal S2.

Step S104 : Configuring the first processing unit 124 to control the user interface 120 to play the specified song data 20 .

Step S105: Configure the first processing unit 124 to calculate the synchronization starting point according to the synchronization timing and the specified song scoring timing data 22, so as to correspondingly generate the starting point indication signal S3 for indicating the synchronization starting point.

Step S106 : Send the start point indication signal S3 and the assigned song scoring time sequence signal S4 to the auxiliary scoring system 16 through the first communication module 122 .

Step S107: Configure the second processing unit 166 to decode the specified song rating timing signal S4. Here, the assigned song rating time sequence signal S4 has the encoded assigned song rating time sequence data 22, so the assigned song rating time sequence data 22 can be obtained by decoding it.

Step S108: Configure the second processing unit 166 to execute the song scoring process when the synchronization start point is reached according to the synchronization start point indicated by the start point indication signal S3. For example, the second processing unit 166 can obtain from the karaoke master system 12 the time-series data 22 for the rating of the specified song, and use the time point when the lyrics of the first sentence begin as the synchronization start point, and the singer is usually in the first sentence. Begin singing at the point in time when the lyrics begin. The song scoring program starts to score the vocal data after the synchronization starting point, which includes the following steps:

Step S109 : Control the sampling unit 164 to continuously sample the portion of the vocal data 24 after the starting point to generate sampled audio data.

Step S110: Compare the sampled audio data with the specified song scoring time series data 22 to obtain a comparison result. In this step, the sampled audio data is the data obtained by sampling the singing voice of the singer. This data is based on the time label of each lyric in the specified song scoring time series data 22, and the original time label corresponding to the time label. The above comparison results can be obtained by comparing the singing audio data, pitch, tempo, length, volume data and score data.

Step S111: According to the comparison result, perform scoring and correspondingly generate scoring result data S5. In this step, in order to generate the scoring result data in real time, the data is usually collected and analyzed in units of one lyric sentence. The second processing unit 166 can judge whether the currently obtained sampled audio data is sufficient according to the time tag of each lyric sentence. For example, , whether the sampled audio data of a complete lyric has been obtained, and then decide to output the comparison result.

Step S112 : Send the scoring result data S5 to the karaoke host system 12 through the second communication module 160 . In some embodiments, in response to receiving the scoring result data S5 , the karaoke master system 12 may display the scoring result data S5 on the user interface 120 .

It should be noted that although the above process is to score a complete sentence of lyrics, the present invention is not limited to this. In practice, the scoring result data S5 of each lyric can be stored in advance, and a more accurate score will be presented until a certain amount is accumulated (for example, when the song has been performed 1/3 or 1/2). Really present the pros and cons of this song.

Through the above steps, it can be ensured that the K-song master system can synchronize the timing with the auxiliary scoring system in real time after starting to play the specified song, and the auxiliary scoring system can sample, compare and score the vocal data in real time, and immediately transmit the scoring results to the The karaoke master system is for its use, and the karaoke master system itself does not need to support the recording function, as long as data communication and timing synchronization are possible between the karaoke master system and the auxiliary scoring system, and the audio can be transmitted through the codec of the playback audio. specific data. Therefore, the range of applicable platforms for karaoke scoring technology and functions can be greatly improved, including smart TVs or TV set-top boxes, karaoke accompaniment players, etc.

Please refer to FIG. 3 , which is a schematic structural diagram of a multimedia scoring system according to another embodiment of the present invention. As shown in the figure, the auxiliary scoring system 16 and the mixing module 14 are arranged in the additional mixing device 30, and the additional mixing device 30 is connected to the K-song master system 12 through the USB communication protocol, and the additional mixing device 30 is further It is electrically connected to the sound pickup unit 18 , and the sound pickup unit 18 can be, for example, a microphone.

In this embodiment, the additional mixing device 30 can be connected to the main karaoke system 12 as a peripheral device, and the synchronization request signal S1 mentioned in the foregoing embodiment can be transmitted multiple times through the first communication module, so as to The synchronization timing signal S2 is obtained multiple times. The synchronization request signal S1 can be, for example, a request signal for requesting to transmit a Start Of Frame (SOF) type packet. The SOF type packet includes a frame number (Frame Number) with a length of 11 bits, and in the USB communication protocol , an SOF packet will be sent out every predetermined time interval, so it can be used as a reference for the synchronization timing during the synchronization of the main K-song system 12 and the auxiliary scoring system 16 .

Please refer to FIG. 4 , which is a system block diagram of a multimedia scoring system according to another embodiment of the present invention. As shown in the figure, in this embodiment, the first communication module 122 and the second communication module 160 are configured to be connected to the first timing unit 162 through the network 34 and obtain the first timing unit 162 through the network 34 The generated synchronization timing signal S2 may be, for example, the network clock timing signal 26 . Therefore, when the karaoke master system 12 and the auxiliary scoring system 16 need to be synchronized for song scoring, the karaoke master system 12 and the auxiliary scoring system 16 can be synchronized with the first timing unit 162 (eg, a third-party network clock), The first processing unit 124 of the karaoke master system 12 calculates the synchronization starting point according to the synchronization timing provided by the third-party network clock, and then transmits the starting point indicating signal S3 to the auxiliary scoring system 16 .

On the other hand, in this embodiment, the database 10 is set in the network server 32, and the first processing unit 124 can control the first communication module 122 to obtain from the database 10 of the network server 32 through the network Designated song data 20 and designated song rating time series data 22.

The karaoke master system 12 may include an audio playback module 126 (eg, a speaker), and the first processing unit 124 may control the audio playback module 126 to play the specified song data 20 . Meanwhile, the mixing module 14 further includes a third communication module 142 and a fourth communication module 144. The third communication module 142 can be used to transmit the vocal data 24 to the karaoke host system, and the karaoke host system 12 responds to receiving To the vocal data 24, the first processing unit 124 can mix the specified song data 20 with the vocal data 24 to generate the mixed data, and control the audio playing module 126 to play the mixed data.

The first communication module 122 and the second communication module 160 can be connected to each other through the first network interface 36, the first network interface 36 can be, for example, a wireless network interface, and the first communication module 122 and the second communication module 160 The communication module 160 can be connected to the network 34 through the first network interface 36 . In some embodiments, the first network interface 36 can be, for example, a router or a sharer with an indoor network structure, and the first communication module 122 can be an Ethernet module connected to the router through a wired network. The second communication module 160 can be a wireless network module, and is connected to the router through a WIFI network interface.

In addition, the auxiliary scoring system 16 may include a fifth communication module 168 and is connected to the fourth communication module 144 through the second network interface 38 . The fourth communication module 144 and the fifth communication module 168 may be Bluetooth communication modules, and the second network interface 38 may be a Bluetooth transmission interface.

Under this structure, different signal paths are provided for the synchronization request signal S1, the synchronization timing signal S2, the start point indication signal S3, the assigned song scoring timing signal S4, and the scoring result data S5. For example, different from the previous embodiment, the synchronization request signal S1 and the synchronization timing signal S2 can be transmitted through the network 34 , and the designated song rating timing signal S4 can be transmitted through the first network interface 36 between the K-song master system 12 and the auxiliary system 12 . Transfer between scoring systems 16 .

In a specific embodiment, the specified song data 20 and the specified song scoring time series data 22 may be further transmitted to the mixing module 14 through the third communication module 142, and the mixing module 14 may further transmit the specified song data 20 and the specified song according to the specified song data 20 and the specified song. Score the timing data 22, adjust the frequency, dynamics, sound quality, positioning, reverberation and sound field of each original signal individually according to the needs, so as to optimize each track, and then superimpose and mix with the vocal data 24 , to generate the mixing data, and then return the mixing data to the audio playback module 126 through the third communication module 142 for broadcasting, and at the same time, the unmixed vocal data 24 and the specified song are scored through the second network interface 38 The timing data 22 is also transmitted to the auxiliary scoring system 16 . Thereby, the multimedia scoring system and method provided by the present invention can be applied to different network architectures and meet different requirements.

For an example of the multimedia scoring system in FIG. 4 , reference may be made to FIG. 5 , which is a schematic structural diagram of a multimedia scoring system according to another embodiment of the present invention. As shown in the figure, the auxiliary scoring system 16 is installed in the mobile device 33, or the mobile device 33 executes an application program including the functions of the auxiliary scoring system 16, and the display interface 330 of the mobile device 33 displays the data analyzed by the auxiliary scoring system 16. Scoring results. On the other hand, the mixing module 14 can be installed in the mixing add-on device 30, which can be connected to an Over the top (OTT) set-top box 35 via USB, and the K-song master system 12 can be installed on the OTT machine The application program including the functions of the karaoke main system 12 is executed in the box 35 or by the OTT set-top box 35, and the present invention is not limited thereto.

Furthermore, the fifth communication module 168 may be a built-in Bluetooth wireless transmission module of the mobile device 33, and the fourth communication module 144 may also be a Bluetooth wireless transmission module, so that the additional audio mixing device 30 can communicate with the mobile device. 33 wireless transmission through the Bluetooth transmission interface. In addition, the first communication module 122 and the second communication module 160 can be wireless communication modules, which can be connected through a wireless network interface.

Please refer further to FIGS. 6A and 6B , which are flowcharts of a multimedia scoring method according to another embodiment of the present invention. According to the multimedia scoring system provided by FIG. 4 and FIG. 5 , the multimedia scoring method of the present invention may further comprise the following steps:

Step S200 : configure the first communication module 122 and the second communication module 160 to connect with the first timing unit 162 through the network 34 , and obtain the synchronization timing signal S2 generated by the first timing unit 162 through the network 34 to synchronize the timing The signal S2 can be, for example, the network clock timing signal 26 .

Step S201 : Synchronize the K-song master system 12 and the auxiliary scoring system 16 with the first timing unit 162 .

Step S202 : configure the first processing unit 124 to calculate the synchronization starting point according to the synchronization timing provided by the first timing unit 162 , and then transmit the starting point indicating signal S3 to the auxiliary scoring system 16 .

On the other hand, the multimedia scoring method of the present invention may further comprise the following steps:

Step S203 : configuring the first processing unit 124 to transmit the specified song data 20 and the specified song rating time series data 22 to the mixing module 14 through the third communication module 142 first.

Step S204: Configuring the mixing module 14 to mix the vocal data 24 according to the specified song data 20 to generate mixed data.

Step S205: Configure the third communication module 142 to return the mixing data to the audio playback module 126 for playback, and simultaneously transmit the vocal data 24 and the specified song scoring time sequence data 22 to the auxiliary scoring system through the second network interface 38 16.

In addition, in the above-mentioned embodiment, the sound mixing module 14 can be further connected to the sound pickup unit 18 by wire or wirelessly. For example, the sound mixing module 14 can be connected to the sound pickup unit 18 through an ultra high frequency (UHF). (eg, a microphone), or the mixing add-on device 30 can be attached to the radio unit 18 as a dongle, so that the radio unit 18 has a microphone capable of communicating with the main karaoke system 12 and the auxiliary scoring system 16, thereby improving the Application flexibility.

Please refer to FIG. 7 , which is a system block diagram of a multimedia scoring system according to another embodiment of the present invention. As shown, the karaoke master system 12 further includes a second timing unit 128 configured to generate another timing synchronization signal. For example, the first communication module 122 and the second communication module 160 can be based on a first communication protocol, such as IEEE-1588 Precision Time Protocol (PTP), such as IEEE-1588v2 PTP, so as to The system 12 and the auxiliary scoring system 16 are assigned as a primary synchronization device (eg PTP Master) and a slave synchronization device (PTP Slave) to determine the timing synchronization signal S2 generated by the first timing unit 126 or another timing generated by the second timing unit 128 The sequence synchronization signal is synchronized between the main karaoke system 12 and the auxiliary scoring system 16 . For example, when the karaoke master system 12 is used as the main synchronization device and the auxiliary scoring system 16 is used as the slave synchronization device, the timing synchronization signal of the second timing unit 128 is used as the synchronization reference to calculate the synchronization start point, and vice versa.

On the other hand, in this embodiment, the main K-song system 12 and the auxiliary scoring system 16 are in different network environments. For example, the main karaoke system 12 is connected to the network 34 through a first communication module 122, such as an Ethernet module, and the auxiliary scoring system 16 is connected to the network 34 through a second communication module 160, such as 3G/4G/ The 5G network communication module is connected to the network 34, and the mixing module 14 may further include a sixth communication module 146, such as a wireless network module, connected through a first network interface (such as a WIFI network interface) In the K-song master system 12. At this time, the main karaoke system 12 and the mixing module 14 are in the internal network, and the auxiliary scoring system 16 is in the external network. The auxiliary scoring system 16 is further connected to the fourth communication module 144 of the mixing module 14 by the fifth communication module 168 through the second network interface 38 . The fourth communication module 144 and the fifth communication module 168 may be Bluetooth communication modules, and the second network interface 38 may be a Bluetooth transmission interface.

In this embodiment, in order to solve the problem of timing synchronization between internal and external networks, the aforementioned first communication protocol, such as the IEEE-1588 Precision Time Protocol (PTP), can still be used to achieve the K-song master system 12 and the auxiliary scoring system 16 synchronization between. To this end, the first communication module 122 and the second communication module 160 are further configured to communicate with the karaoke master system 12 and The secondary scoring system 16 is assigned as a primary synchronization device (eg PTP Master) and a slave synchronization device (PTP Slave).

In other words, after determining the primary synchronization device (eg PTP Master) and the slave synchronization device (PTP Slave) through the above signal paths, the karaoke master system 12 can obtain the corresponding synchronization timing signal S2 to calculate the synchronization start point and generate the start point Click on the indication signal S3. It is conceivable that the starting point indication signal S3, the assigned song scoring time sequence signal S4 and the scoring result data S5 can be transmitted directly through the network 34, or through the fourth communication module 144, the fifth communication module 168 and the sixth communication module 144. The signal path of the communication module 146 is used for transmission. The K-song master system 12 and the auxiliary scoring system 16 can select a faster transmission path to transmit the start point indication signal S3, the assigned song scoring time sequence signal S4 and the scoring result data S5 according to the current network transmission state.

[Advantageous effects of the embodiment]

One of the beneficial effects of the present invention is that, with the multimedia scoring system and method provided by the present invention, the K-song master system itself does not need to support the recording function, as long as the k-song master system and the auxiliary scoring system can communicate with each other and synchronize the time sequence. , and can transmit specific data by playing the codec of the audio. Therefore, the range of applicable platforms for karaoke scoring technology and functions can be greatly improved, including smart TVs or TV set-top boxes, karaoke accompaniment players, etc.

Furthermore, the multimedia scoring system and method provided by the present invention can ensure that the K-song master system synchronizes with the auxiliary scoring system in real time after starting to play the specified song, and the auxiliary scoring system can sample and compare the vocal data in real time. Correct and score, and immediately send the score to the K-song master system for its use.

The contents disclosed above are only preferred feasible embodiments of the present invention, and are not intended to limit the scope of the present invention. Therefore, any equivalent technical changes made by using the contents of the description and drawings of the present invention are included in the application of the present invention. within the scope of the patent.

1: Multimedia scoring system 10: Database 100: Song Information 102: Song scoring time series data 12: K-song master system 120: User Interface 122: The first communication module 124: first processing unit 126: Audio playback module 128: Second timing unit 14: Mixing module 142: The third communication module 144: Fourth Communication Module 16: Auxiliary Scoring System 160: Second communication module 162: First timing unit 164: Sampling unit 166: Second processing unit 168: Fifth Communication Module 18: Radio unit 20: Specify song information 22: Specify song scoring time series data 24: Vocal Profile 26: Network clock timing signal 30: Mixing Add-ons 32: web server 33: Mobile Devices 330: Display interface 34: Internet 35: Cloud STB 36: The first network interface 38: Second network interface S1: Synchronization request signal S2: Synchronous timing signal S3: start point indication signal S4: Specified song rating timing signal S5: Score result data 146: Sixth Communication Module

FIG. 1 is a system block diagram of a multimedia scoring system according to a first embodiment of the present invention.

FIG. 2 is a flowchart of a multimedia scoring method according to an embodiment of the present invention.

FIG. 3 is a schematic structural diagram of a multimedia scoring system according to another embodiment of the present invention.

FIG. 4 is a system block diagram of a multimedia scoring system according to another embodiment of the present invention.

FIG. 5 is a schematic structural diagram of a multimedia scoring system according to another embodiment of the present invention.

6A and 6B are flowcharts of a multimedia scoring method according to another embodiment of the present invention.

FIG. 7 is a system block diagram of a multimedia scoring system according to another embodiment of the present invention.

1: Multimedia scoring system 10: Database 100: Song Information 102: Song scoring time series data 12: K-song master system 120: User Interface 122: The first communication module 124: first processing unit 14: Mixing module 16: Auxiliary Scoring System 160: Second communication module 162: First timing unit 164: Sampling unit 166: Second processing unit 18: Radio unit 20: Specify song information 22: Specify song scoring time series data 24: Vocal Profile S1: Synchronization request signal S2: Synchronous timing signal S3: start point indication signal S4: Specified song rating timing signal S5: Score result data

Claims (26)

A multimedia scoring system comprising: a database, storing a plurality of song data and a plurality of corresponding song scoring time series data; a first timing unit for generating a synchronization timing signal for indicating a synchronization timing; A karaoke master system electrically connected to the database and including: a first communication module configured to transmit a synchronization request signal and obtain the synchronization timing signal; a first processing unit configured to obtain a specified song data and a specified song scoring time series data from the database according to a song specifying command, and calculate a synchronization start point according to the synchronization sequence and the specified song scoring time series data, correspondingly generating a start point indication signal for indicating the synchronization start point; a mixing module configured to pick up and generate vocal data; and An auxiliary scoring system is electrically connected to the K-song master system and the mixing module and includes: a second communication module configured to obtain the synchronization timing signal from the first communication module, and receive the starting point indication signal and the assigned song scoring timing data; a sampling unit configured to sample the vocal data; a second processing unit configured to obtain the specified song scoring time series data, and according to the synchronization starting point indicated by the starting point indicating signal, execute a song scoring program when the synchronization starting point is reached, wherein the song Scoring procedures include: controlling the sampling unit to continuously sample the part of the vocal data after the starting point to generate a sampled audio data; comparing the sampled audio data with the specified song scoring time series data to obtain a comparison result; According to the comparison result, perform scoring and correspondingly generate a scoring result data; and The scoring result data is transmitted to the karaoke host system through the second communication module. The multimedia scoring system of claim 1, wherein the karaoke master system further comprises a user interface for a user to input the song specifying command, and play the specified song data according to the song specifying command. The multimedia scoring system of claim 1, wherein the first communication module is configured to transmit the synchronization request signal multiple times to obtain the synchronization timing signal multiple times. The multimedia scoring system of claim 1, wherein the second communication module is configured to transmit the synchronization timing signal to the first communication module. The multimedia scoring system of claim 1, wherein the first communication module and the second communication module are configured to be connected with the first timing unit through a network to obtain the synchronization timing signal, and the synchronization timing signal It is a network clock timing signal. The multimedia scoring system of claim 1, wherein the karaoke master system further comprises an audio playing module, and the first processing unit is configured to control the audio playing module to play the specified song data. The multimedia scoring system of claim 6, wherein the mixing module further includes a third communication module configured to transmit the vocal data to the karaoke host system, and in response to receiving the vocal data, the The first processing unit is further configured to mix the specified song data and the vocal data to generate a mix data, and control the audio playing module to play the mix data. The multimedia scoring system of claim 1, wherein the karaoke master system further comprises a second timing unit configured to generate another timing synchronization signal, and the first communication module and the second communication module is further configured to allocate the karaoke master system and the auxiliary scoring system as a master synchronization device and a slave synchronization device according to the first communication protocol to determine whether to use the timing synchronization signal or the other timing synchronization signal in the karaoke Synchronization between the song master system and the auxiliary scoring system. The multimedia scoring system of claim 1, wherein the database is set in a network server, and the first processing unit is configured to control the first communication module to obtain the designation from the database through a network Song data and time series data of the specified song's rating. The multimedia scoring system according to claim 1, wherein the auxiliary scoring system and the sound mixing module are arranged in an additional sound mixing device, and the additional sound mixing device is further electrically connected to a sound receiving unit. The multimedia scoring system of claim 1, wherein the auxiliary scoring system includes a fifth communication module, the sound mixing module includes a third communication module and a fourth communication module, the third communication module connected to the karaoke host system, and the fourth communication module is configured to be connected to the fifth communication module through a second network interface, Wherein, the second communication module is connected with the first communication module through a first network interface. The multimedia scoring system of claim 1, wherein the sound mixing module includes a third communication module, a fourth communication module and a sixth communication module, and the auxiliary scoring system further includes a fifth communication module group, the third communication module is configured to be connected to the karaoke host system through a first network interface, the second communication module is connected to the first communication module through a network, the sixth communication module The group is configured to connect with the fifth communication module through a second network interface. The multimedia scoring system of claim 12, wherein the karaoke master system further comprises a second timing unit configured to generate another timing synchronization signal, and the first communication module and the second communication module is further configured to distribute the karaoke main system and the auxiliary scoring system as a main synchronization device according to the first communication protocol through the fourth communication module, the fifth communication module and the sixth communication module and a slave synchronization device for determining synchronization between the karaoke master system and the auxiliary scoring system by the timing synchronization signal or the other timing synchronization signal. A multimedia scoring method, comprising the following steps: A first processing unit configured with a karaoke master system obtains a specified song data and a specified song rating time series data from the database according to a song specifying command; configuring a first timing unit to generate a synchronization timing signal for indicating a synchronization timing; A first communication module of the main K-song system is configured to be connected with a second communication module of the auxiliary scoring system through a first communication protocol, and the first communication module and the second communication module are configured to obtain the synchronization timing signal; configuring the first processing unit to calculate a synchronization start point according to the synchronization time sequence and the specified song scoring time sequence data, so as to correspondingly generate a start point indication signal for indicating the synchronization start point; Send the starting point indication signal and the assigned song scoring time series data to the auxiliary scoring system through the first communication module; Configure a mixing module to receive sound and generate vocal data; and A second processing unit configuring the auxiliary scoring system obtains the specified song scoring time series data, and according to the synchronization starting point indicated by the starting point indication signal, executes a song scoring program when the synchronization starting point is reached, which Include the following steps: controlling the sampling unit to continuously sample the part of the vocal data after the starting point to generate a sampled audio data; comparing the sampled audio data with the specified song scoring time series data to obtain a comparison result; According to the comparison result, perform scoring and correspondingly generate a scoring result data; and The scoring result data is transmitted to the karaoke host system through the second communication module. The multimedia scoring method of claim 14 further includes configuring a user interface for a user to input the song specifying command, and configuring the user interface to play the specified song data according to the song specifying command. The multimedia scoring method according to claim 14, further comprising configuring the first communication module to transmit the synchronization request signal multiple times to obtain the synchronization timing signal multiple times. The multimedia scoring method of claim 14, further comprising configuring the second communication module to transmit the synchronization timing signal to the first communication module. The multimedia scoring method of claim 14, further comprising configuring the first communication module and the second communication module to be connected to the first timing unit through a network, and obtaining the synchronization timing signal through the network, wherein The synchronization timing signal is a network clock timing signal. The multimedia scoring method according to claim 14, further comprising configuring the first processing unit to control an audio playing module of the karaoke master system to play the specified song data. The multimedia scoring method as claimed in claim 19, further comprising: configuring a third communication module of the mixing module to transmit the vocal data to the karaoke host system; and In response to receiving the vocal data, the first processing unit is configured to mix the specified song data and the vocal data to generate a mixed data, and control the audio playing module to play the mixed data. The multimedia scoring method as claimed in claim 14, further comprising: A second timing unit of the karaoke master system is configured to generate another timing synchronization signal; the first communication module and the second communication module are configured to the karaoke master system and the auxiliary scoring system according to the first communication protocol Distributed as a master synchronization device and a slave synchronization device to determine synchronization between the karaoke master system and the auxiliary scoring system by the timing synchronization signal or the other timing synchronization signal. The multimedia scoring method as claimed in claim 14, wherein the database is set in a network server, and the multimedia scoring method further comprises configuring the first processing unit to control the first communication module from the data through the network The library obtains the specified song data and the specified song scoring time series data. The multimedia scoring method of claim 14, wherein the auxiliary scoring system and the sound mixing module are arranged in an additional sound mixing device, and the additional sound mixing device is further electrically connected to a sound receiving unit. The multimedia scoring method of claim 14, wherein the auxiliary scoring system includes a fifth communication module, the sound mixing module includes a third communication module and a fourth communication module, and the multimedia scoring method further includes : configuring the second communication module to connect with the first communication module through a first network interface; configuring the third communication module to be connected to the karaoke host system; and The fourth communication module is configured to be connected to the fifth communication module through a second network interface. The multimedia scoring method of claim 14, wherein the sound mixing module includes a third communication module, a fourth communication module and a sixth communication module, and the auxiliary scoring system further includes a fifth communication module group, the multimedia scoring method further includes: configuring the third communication module to be connected to the karaoke host system through a first network interface; configuring the second communication module to connect with the first communication module through a network; The sixth communication module is configured to be connected with the fifth communication module through a second network interface. The multimedia scoring method as claimed in claim 25, further comprising: configuring a second timing unit of the karaoke master system to generate another timing synchronization signal; and Configure the first communication module and the second communication module to pass the fourth communication module, the fifth communication module and the sixth communication module, according to the first communication protocol, the karaoke host system and the The auxiliary scoring system is allocated as a master synchronization device and a slave synchronization device to determine synchronization between the karaoke master system and the auxiliary scoring system by the timing synchronization signal or the other timing synchronization signal.

Images