CN101345047B - Sound mixing system and method for automatic human voice correction - Google Patents
Sound mixing system and method for automatic human voice correction Download PDFInfo
- Publication number
- CN101345047B CN101345047B CN200710129423A CN200710129423A CN101345047B CN 101345047 B CN101345047 B CN 101345047B CN 200710129423 A CN200710129423 A CN 200710129423A CN 200710129423 A CN200710129423 A CN 200710129423A CN 101345047 B CN101345047 B CN 101345047B
- Authority
- CN
- China
- Prior art keywords
- song
- voice
- time
- recording
- time mark
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
The invention provides a sound-mixing system with automatically corrected voice, and a sound-mixing method thereof, aiming at solving the problem that the voice is not easy to be aligned to accompanied songs during the recording process; the sound-mixing method with automatically corrected voice and disclosed by the invention comprises the steps as follows: all different starting time of accompanied songs and corresponding original songs are recorded as a first time mark; recorded songs with voices are read; the starting time of voice appearing in the recorded song is analysed and recorded as a second time mark; each first time mark is sequentially corresponding to each second time mark; according to the corresponding relationship of all the first time marks and al the second time marks, the recorded songs are mixed into the accompanied songs; the starting time when voice appears in the recorded song is corresponding to the starting time when voice is supposed to appear in the accompanied song, and the recorded song and the accompanied song are mixed further, thus achieving the efficacy of automatic voice correction.
Description
Technical field
The present invention relates to a kind of mixer system and sound mixing method, be meant mixer system and the sound mixing method thereof of a kind of voice especially from NMO correction.
Background technology
Singing has become one of stress-relieving activity of modern; Therefore after the people has certain confidence to oneself sound and singing skills; Just can further want to get off the SoundRec of oneself, use being shared with other people, therefore the demand of recording also just constantly improves.
Recording is meant the process that sound is transferred to anaiog signal or numerical digit signal.The quality of recording receives the influence of sampling frequency and sampling resolution.For different audio, suitable sampling frequency is also different: the sampling frequency of music is 10 to 20000 hertz (Hz); And the sampling frequency of voice is 300 to 3400 hertz.
Though the demand of recording increases; But sound pick-up outfit too costliness so that common people cannot afford; Therefore the method for at present common recording typically uses computer and plays accompanying song, and uses the microphone that connects computer to record, and such mode but causes voice and accompanying song can't sing in the only time because of artificial error easily; Cause the asynchronous of voice and accompanying song, make that the song after recording is unsatisfactory.
Summary of the invention
Voice and the nonsynchronous present situation of accompanying song take place in common record type easily in view of proposing at present in the above technology formerly; The object of the invention is to provide a kind of mixer system and sound mixing method that can automatically voice be aligned, and can can't sing the problem in the only time with solving voice.
In voice that the present invention the disclosed mixer system from NMO correction, it includes: storage module, analysis module, audio mixing module.
In voice that the present invention the disclosed sound mixing method from NMO correction, it includes: record accompanying song and all zero-times that do not exist together of corresponding original song are very first time mark; Read the recording song that includes voice; The zero-time of voice occurs in the analysis recording song, and be recorded as second time mark; In regular turn each very first time mark is corresponded to each second time mark; Be mixed in the accompanying song according to the corresponding relation of each very first time mark and each the second time mark song of will recording.
The recording system of the present invention and the way of recording are through the mode of the zero-time of voice is arranged in the zero-time that voice is arranged in the corresponding accompanying song and the song of recording; Mix accompanying song and recording song, use solution voice and can't sing problem in the only time.
Contrasting is beyond one's reach in known use computer and microphone location aligns the effect of voice; The present invention can be automatically with people's acoustic correction to the correct time; Make the voice in the recording song can correspond to optimal position in the accompanying song automatically, solve known technology the effect that can't reach.
About detailed features of the present invention and real the work; Now cooperate to be shown in the embodiment and specify as follows; Its content is enough to make any related art techniques person of haveing the knack of to understand technology contents of the present invention and implements according to this; And according to content that this instructions disclosed and graphic, any related art techniques person of haveing the knack of can understand purpose and the advantage that the present invention is correlated with easily.
Description of drawings
Fig. 1 is the system architecture diagram of the voice carried of the present invention from the mixer system of NMO correction.
Fig. 2 is the method flow diagram of the voice carried of the present invention from the sound mixing method of NMO correction.
Fig. 3 A is the accompanying song synoptic diagram that the embodiment of the invention is carried.
Fig. 3 B is the recording song synoptic diagram that the embodiment of the invention is carried.
Fig. 3 C is the audio mixing song synoptic diagram that the embodiment of the invention is carried.
Embodiment
Following elder generation explains System Operation of the present invention with the voice that Fig. 1 the present invention is carried from the mixer system Organization Chart of NMO correction.As shown in the figure, system of the present invention contains storage module 110, analysis module 120, audio mixing module 130.
The original song that the present invention carried is meant and includes the voice that the original singer sings and the song of the melody of having powerful connections; The accompanying song that the present invention carried is meant the song of having powerful connections melody and not having the voice that the original singer sings; And the recording song that the present invention carried be by recording person follow accompanying song hum the sound under the record, voice possibly only arranged, also possibly include voice and accompanying song.
The zero-time of voice corresponds to has voice in the recording song that second time mark comprised zero-time should be arranged in the accompanying song that audio mixing module 130 is responsible in regular turn very first time mark is comprised; And according to the corresponding relation of the very first time mark and second time mark, the song of will recording is mixed in the accompanying song.
Then explain orally operation system of the present invention and method, and the voice that please the present invention is carried with reference to Fig. 2 is from the sound mixing method process flow diagram of NMO correction with an embodiment.
Because accompanying song 310 is that with corresponding original song difference accompanying song 310 does not have voice, and original song has original singer's voice, therefore; At prelude and part such as play; The part that does not just have voice, accompanying song 310 and corresponding original song will be identical at the sound of the time point of same broadcast; And when the original singer sent voice and sings, accompanying song 310 can be different at the sound of the time point of same broadcast with original song.The accompanying song of being carried in the present embodiment 310 shown in Fig. 3 A, is located at 0:22 to 2:13,2:33 to 3:59 and 4:15 to 4:33, with accompanying song 310 corresponding original songs voice is arranged.
In the present invention, storage module 110 can store accompanying song 310 and very first time mark (step 210) in advance.Generally speaking, the voice of original song has a plurality of paragraphs, so very first time mark normally should be made up of the zero-time of voice by several, therefore, the very first time of present embodiment is labeled as 0:22,2:33 and 4:15.
Then; Audio mixing module 130 of the present invention can correspond to second time mark with very first time mark respectively in regular turn; And carry out audio mixing according to corresponding relationship; Just audio mixing module 130 2:33 that can the 0:22 of accompanying song 310 be corresponded to 0:23, the accompanying song 310 of recording song 320 4:15 that corresponds to the 2:33 of recording song 320, accompanying song 310 corresponds to the 4:15 of recording song 320, and after correspondence was accomplished, audio mixing module 130 can be begun accompanying song 310 by 0:22; Begin to carry out audio mixing to recording song 320 by 0:23; The meaning song 320 of promptly recording is the 0:22 place that is begun to sneak into accompanying song 310 by 0:23 place, and is same, audio mixing module 130 can be in regular turn recording song 320 by 2:33, reach 2:33 that the 4:15 place begins to sneak into accompanying song 310, reach 4:15 place (step 260); Can produce the audio mixing song 330 that audio mixing is accomplished after the mixing, shown in Fig. 3 C.
In Fig. 3 C, can also find,, but finish in 3:58 in advance though the voice that the recording song begins in the 2:33 place is not to finish at 3:59; Finish in 4:33 by the voice of 4:15 place beginning is also non-in addition, finish, the part that finishes in advance or delay end is not carried out extra processing but the present invention only carries out audio mixing but delay in 4:34.
So, the present invention promptly can be automatically correspond to optimal time point in the accompanying song 310 to the voice in the recording song 320, causes the nonsynchronous problem of voice and accompanying song when solving the recording that prior art proposes easily because of human error.
In fact; The present invention is not limited in the passive wait very first time mark person of being used and is stored in the storage module 110; Therefore the present invention has more comprised detecting module 160, is responsible for when storage module 110 stores original song, detects original song and accompanying song 310 sound played differences; And it is recorded to use in the storage module 110 forms very first time mark; Said when the principle of detecting module 160 detectings such as present embodiment begin, whether the time point accompanying song 310 of detecting same broadcast is identical with the sound that original playback of songs goes out, in case sound is different; Detecting module 160 promptly can be detected out with the sound different time point that accompanying song 310 and original playback of songs go out, and it is recorded as very first time mark.And the mode of detecting can directly be opened the original song that is stored in the storage module 110 and the archives of accompanying song 310 are compared by detecting module 160; Not necessarily need original song and accompanying song 310 be play just and can compare; Because the mode of comparison is a known technology, therefore do not specify in the present embodiment.In addition; Detecting module 160 also can directly be detected the part that voice is arranged in the accompanying song 310 pairing original songs; Use the zero-time that voice will be arranged and be recorded as very first time mark; Using provides audio mixing module 130 to mix accompanying songs 310 and recording song 320, and the technology of wherein detecting voice is also for known, therefore additional description no longer.
The present invention can also comprise recording module 170; In order to receive the sound that the user sent; And it be stored in the storage module 110 form recording song 320 (step 220), make analysis module 120 be able to read recording song 320 (step 230) go forward side by side pedestrian's sound analysis and obtain second time mark and with it record (step 240).That is to say that the recording song 320 that the present invention carried can be stored in the storage module 110 in advance, also can store via voice under recording module 170 records.
In addition; The present invention more can comprise filtering module 190; In order to by reading recording song 320 in the storage module 110, and analyze the noise (step 250) of the part of no voice in the temporal filtering recording song of being learnt the back 320 that does not have voice, make audio mixing module 130 when mixing accompanying song 310 and recording song 320 according to analysis module 120; Noise in the recording song 320 can be filtered module 190 and remove, the quality behind the raising audio mixing.
When the present invention comprises filtering module 190; Comprise voice if recording song 320 has more than, and also comprised accompanying song 310, then analysis module 120 is being read recording song 320 backs (step 230); To analyze recording song 320; Using to analyze in the recording song 320 has the part of voice, and will have the zero-time of the part of voice to be recorded as second time mark (step 240), and then filtering module 190 just can be according to the analysis result of analysis module 120; Do not have the part filtration of voice to become quiet (step 250) with having only accompaniment, so audio mixing module 130 just can be mixed the part that voice is arranged in accompanying song 310 and the recording song 320.
Moreover voice of the present invention can be implemented in the combination of hardware, software or hardware and software from the sound mixing method of NMO correction, and the dispersing mode of also can be in computer system realizing or intersperse among with different elements the computer system of several interconnected with centralized system is realized.
Though the present invention discloses as above with aforesaid embodiment; Right its is not in order to limit the present invention; Any art of haveing the knack of the affiliated technical field of the present invention is not breaking away from the spirit and scope of the present invention change of doing and retouching; Therefore all belong to scope of patent protection of the present invention, scope of patent protection of the present invention must be looked the appended claim scope person of defining of this instructions and is as the criterion.
Claims (10)
1. a voice is from the sound mixing method of NMO correction, and this sound mixing method comprises the following step:
Write down that in the corresponding original song of an accompanying song zero-time of each paragraph of voice to be arranged be very first time mark;
Read a recording song that includes at least one voice, wherein should recording song to should accompanying song;
Analyzing should recording song, and the zero-time that occurs the each several part of this voice in the song of will recording is recorded as second time mark;
In regular turn will be respectively this second time mark correspond to respectively should very first time mark; And
According to respectively should very first time mark being mixed in this accompanying song with the song of should recording of the corresponding relation of this second time mark respectively.
2. voice as claimed in claim 1 is from the sound mixing method of NMO correction; The step that wherein writes down this very first time mark more comprises this original song of comparison and this accompanying song; When this original song and this accompanying song in same time point institute sound played not simultaneously, write down the step of this zero-time that does not exist together for this very first time mark.
3. voice as claimed in claim 1 is from the sound mixing method of NMO correction, and the step that wherein writes down this very first time mark more comprises the zero-time that voice is arranged in this original song of detecting, writes down the step of this zero-time for this very first time mark.
4. voice as claimed in claim 1 more comprises the part of filtering no voice in this recording song from the sound mixing method of NMO correction, makes the part of this no voice form quiet step.
5. voice as claimed in claim 4 is from the sound mixing method of NMO correction; Wherein the step of the part of no voice more comprises the part of analyzing no voice in this recording song earlier in this recording song of this filtration, filters the step of the part of no voice in this recording song again according to analysis result.
6. a voice is from the mixer system of NMO correction, and this mixer system comprises:
One storage module, in order to storing an accompanying song, corresponding with this accompanying song and include a recording song of at least one voice, and in the record original song corresponding with this accompanying song the zero-time of each paragraph of voice to be arranged be very first time mark;
One analysis module the zero-time of the each several part of this voice occurs in order to analyze in this recording song, and is recorded as second time mark; And
One audio mixing module, in order to will be respectively this second time mark correspond in regular turn respectively should very first time mark, and according to respectively should very first time mark being mixed in this accompanying song with the song of should recording of the corresponding relation of this second time mark respectively.
7. voice as claimed in claim 6 is from the mixer system of NMO correction, and wherein this storage module is more in order to store this original song.
8. voice as claimed in claim 7 is from the mixer system of NMO correction; More comprise a detecting module; In order to compare this original song and this accompanying song sound at the same time by broadcast the time; When the sound of this original song and this accompanying song not simultaneously, this zero-time that does not exist together is defined as this very first time mark and is stored in this storage module.
9. voice as claimed in claim 7 more comprises a detecting module from the mixer system of NMO correction, and in order to detect the zero-time that voice is arranged in this original song, this zero-time is stored to becomes this very first time mark in this storage module.
10. voice as claimed in claim 6 more comprises a filtering module from the mixer system of NMO correction, and in order to analyze the result of this recording song according to this analysis module, the part of filtering no voice in this recording song makes the part of this no voice form quiet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200710129423A CN101345047B (en) | 2007-07-12 | 2007-07-12 | Sound mixing system and method for automatic human voice correction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200710129423A CN101345047B (en) | 2007-07-12 | 2007-07-12 | Sound mixing system and method for automatic human voice correction |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101345047A CN101345047A (en) | 2009-01-14 |
| CN101345047B true CN101345047B (en) | 2012-09-05 |
Family
ID=40247039
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200710129423A Active CN101345047B (en) | 2007-07-12 | 2007-07-12 | Sound mixing system and method for automatic human voice correction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101345047B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103377649B (en) * | 2012-04-20 | 2015-09-09 | 上海渐华科技发展有限公司 | A kind of method realizing real-time network Karaoke antiphonal singing |
| US9224374B2 (en) | 2013-05-30 | 2015-12-29 | Xiaomi Inc. | Methods and devices for audio processing |
| CN103295568B (en) * | 2013-05-30 | 2015-10-14 | 小米科技有限责任公司 | A kind of asynchronous chorus method and apparatus |
| CN104332166B (en) * | 2014-10-21 | 2017-06-20 | 福建歌航电子信息科技有限公司 | Can fast verification recording substance accuracy, the method for synchronism |
| CN105741830B (en) * | 2014-12-12 | 2020-12-04 | 广州酷狗计算机科技有限公司 | Audio synthesis method and device |
| CN105788581B (en) * | 2014-12-15 | 2019-05-31 | 深圳Tcl新技术有限公司 | Karaoke Marking method and apparatus |
| CN108010503B (en) * | 2017-12-27 | 2021-12-03 | 北京酷我科技有限公司 | K song recording method |
| CN112017622B (en) * | 2020-09-04 | 2023-02-21 | 广州趣丸网络科技有限公司 | Audio data alignment method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0501483A2 (en) * | 1991-02-27 | 1992-09-02 | Ricos Co., Ltd. | Backing chorus mixing device and karaoke system incorporating said device |
| CN1170924A (en) * | 1996-06-19 | 1998-01-21 | 雅马哈株式会社 | Sound reproducing device and method for use in karaoke, game machine or the like |
| CN1386358A (en) * | 2000-05-15 | 2002-12-18 | 松下电器产业株式会社 | Voice storage system, exchanger and voice storage apparatus |
| CN1573920A (en) * | 2003-06-02 | 2005-02-02 | 三星电子株式会社 | Device and method for separating music and speech using independent component analysis algorithm |
| US7134876B2 (en) * | 2004-03-30 | 2006-11-14 | Mica Electronic Corporation | Sound system with dedicated vocal channel |
-
2007
- 2007-07-12 CN CN200710129423A patent/CN101345047B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0501483A2 (en) * | 1991-02-27 | 1992-09-02 | Ricos Co., Ltd. | Backing chorus mixing device and karaoke system incorporating said device |
| CN1170924A (en) * | 1996-06-19 | 1998-01-21 | 雅马哈株式会社 | Sound reproducing device and method for use in karaoke, game machine or the like |
| CN1386358A (en) * | 2000-05-15 | 2002-12-18 | 松下电器产业株式会社 | Voice storage system, exchanger and voice storage apparatus |
| CN1573920A (en) * | 2003-06-02 | 2005-02-02 | 三星电子株式会社 | Device and method for separating music and speech using independent component analysis algorithm |
| US7134876B2 (en) * | 2004-03-30 | 2006-11-14 | Mica Electronic Corporation | Sound system with dedicated vocal channel |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101345047A (en) | 2009-01-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101345047B (en) | Sound mixing system and method for automatic human voice correction | |
| CN101714380B (en) | Testing device and testing method of audio file formats supported by audio player | |
| CN102969010A (en) | Recording and playback device, storage medium, and recording and playback method | |
| WO2010024426A1 (en) | Sound recording device | |
| US20200013422A1 (en) | System, Method, and Apparatus for Morphing of an Audio Track | |
| JP2006330170A (en) | Recording document preparation support system | |
| CN101488356B (en) | Overdubbing device | |
| US20100222905A1 (en) | Electronic apparatus with an interactive audio file recording function and method thereof | |
| JP6326822B2 (en) | Recording method | |
| CN101154175A (en) | Audio testing method and system combining with voice recognition | |
| JP2013073323A (en) | Method and device for conference data integrated management | |
| CN102044238B (en) | Music reproducing system | |
| JP2007221574A (en) | Voice processing apparatus, voice processing method, and program | |
| JP2001283516A (en) | Method for writing reproducible data on data carrier | |
| CN1047901C (en) | Device and method for controlling OSD of a karaoke system | |
| JP2000137490A (en) | Karaoke sing-along machine | |
| KR20210105735A (en) | Apparatus for taking the minutes of a meeting | |
| JP4229446B2 (en) | Karaoke recording system for group participants | |
| JP6920489B1 (en) | Karaoke equipment | |
| JPS5814189A (en) | Performance recording controller | |
| JPS5991391A (en) | Message timepiece | |
| JP2000268545A (en) | Voice reproducing device | |
| JP3727574B2 (en) | Karaoke device and karaoke recording system used together with a recording device | |
| JP2947184B2 (en) | Karaoke system | |
| JPH10111149A (en) | Data recorder |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right |
Owner name: I VALLEY HOLDINGS CO., LTD. Free format text: FORMER OWNER: YINGYEDA CO., LTD., TAIWAN Effective date: 20150730 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20150730 Address after: Cayman Islands, George Town Patentee after: IValley Holding Co., Ltd. Address before: Taipei City, Taiwan Chinese Shilin District Hougang Street No. 66 Patentee before: Inventec Corporation |