WO2015184893A1 - Mobile terminal call voice noise reduction method and device - Google Patents
Mobile terminal call voice noise reduction method and device Download PDFInfo
- Publication number
- WO2015184893A1 WO2015184893A1 PCT/CN2015/074770 CN2015074770W WO2015184893A1 WO 2015184893 A1 WO2015184893 A1 WO 2015184893A1 CN 2015074770 W CN2015074770 W CN 2015074770W WO 2015184893 A1 WO2015184893 A1 WO 2015184893A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- microphone
- sound source
- mobile terminal
- microphones
- call mode
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/725—Cordless telephones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
Definitions
- This paper relates to the field of mobile communications, and in particular to a method and apparatus for voice noise reduction of a mobile terminal.
- Voice call is a basic function of mobile terminals.
- the improvement of voice call quality is a topic that all mobile terminals are committed to.
- the noise reduction algorithm has evolved from previous single microphone (MIC) noise reduction to dual MIC noise reduction, and even microphone array algorithms.
- the number of MICs on mobile terminals has also evolved from a single MIC to a now-current dual MIC.
- Even some mobile terminals have already been 3MIC or 4MIC layouts.
- the signal-to-noise ratio of the main MIC is required to be 6 dB larger than the signal-to-noise ratio of the sub-MIC.
- 1 is a schematic diagram of a dual MIC layout manner in the prior art. As shown in FIG. 2, due to the vocal characteristics of a conventional receiver, when the end user uses the handset mode to talk, the main MIC is closer to the mouth than the sub MIC, so It is easy to meet the requirements of the noise reduction algorithm.
- the terminal user uses the hands-free mode to make a call
- the signal-to-noise ratio of the primary and secondary MICs changes, so that the signal-to-noise ratio difference between the primary and secondary MICs cannot meet the requirements of the noise reduction algorithm.
- the noise reduction algorithm is invalidated, and the noise reduction performance of the call is drastically deteriorated. Therefore, a method is needed to identify such changes, and the noise reduction performance of the voice call is ensured, thereby improving the user experience and increasing the market competitiveness of the product.
- Embodiments of the present invention provide a method and apparatus for voice noise reduction of a mobile terminal.
- a mobile terminal call voice noise reduction method includes:
- the microphone that is closer to the sound source is set as the primary microphone, and the other microphone is set as the secondary microphone;
- the noise reduction algorithm is used to perform noise reduction processing on the call voice of the mobile terminal.
- the foregoing method further includes:
- the mobile terminal When the mobile terminal enters the call mode, it is determined by the voice path whether the call mode of the mobile terminal is a hands-free call mode, a hand-held call mode, or a headset call mode, and if it is determined to be a hand-held call mode or a headset call mode, the voice call is directly performed, if When it is determined that the hands-free call mode is activated, the primary and secondary microphone determination operations are started.
- the calculating the delay of data collected by the two microphones of the mobile terminal includes:
- the collected data of the two microphone samples are respectively filtered by the band pass filter to remove the high frequency noise, and the filtered collected data is subjected to fast Fourier transform FFT to calculate two sets of speech spectra respectively corresponding to the two microphones;
- ⁇ corresponds to the maximum value of R12( ⁇ ) is the time delay ⁇ 12 between two microphones
- x1(kT) s(kT- ⁇ 1)+n1(kT)
- x2(kT) s(kT- ⁇ 2 ) +n2(kT)
- s(kT) is the sound source signal
- n1(kT) is the background noise of the first microphone
- n2(kT) is the background noise of the second microphone
- ⁇ 1 and ⁇ 2 are the sound waves from the sound source to
- the delay between the data collected, E[] represents the autocorrelation function between x1(kT) and x2(kT).
- determining, according to the calculated delay, the relative location between the sound source of the mobile terminal user and the two microphones includes:
- ⁇ is the delay of the data collected by the two microphones
- c is the speed of sound
- d is the difference in sound path
- the elevation angle of the sound source Determine the relative position between the source of the mobile terminal user and the two microphones.
- the microphone that is closer to the sound source is set as the primary microphone, and the other microphone is set as the secondary microphone, including:
- a mobile terminal call voice noise reduction device includes:
- the obtaining module is configured to: obtain a delay of data collected by two microphones of the mobile terminal;
- Determining a module configured to: determine a relative position between the sound source of the mobile terminal user and the two microphones according to the delay;
- Set the module set to: set the microphone closer to the sound source as the primary microphone and the other microphone as the secondary microphone according to the relative position;
- the noise reduction module is configured to: perform noise reduction processing on the call voice of the mobile terminal by using a noise reduction algorithm based on the primary microphone and the secondary microphone.
- the foregoing apparatus further includes:
- the judging module is configured to: when the mobile terminal enters the call mode, determine, by using the voice path, whether the call mode of the mobile terminal is a hands-free call mode, a handheld call mode, or a headset call mode, such as If it is determined to be the handheld call mode or the headset call mode, the voice call is directly performed, and if it is determined to be the hands-free call mode, the primary and secondary microphone determination operations are started.
- the above obtaining module is set to:
- the collected data of the two microphone samples are respectively filtered by the band pass filter to remove the high frequency noise, and the filtered collected data is subjected to fast Fourier transform FFT to calculate two sets of speech spectra respectively corresponding to the two microphones;
- ⁇ corresponds to the maximum value of R12( ⁇ ) is the time delay ⁇ 12 between two microphones
- x1(kT) s(kT- ⁇ 1)+n1(kT)
- x2(kT) s(kT- ⁇ 2 ) +n2(kT)
- s(kT) is the sound source signal
- n1(kT) is the background noise of the first microphone
- n2(kT) is the background noise of the second microphone
- ⁇ 1 and ⁇ 2 are the sound waves from the sound source to
- E[] represents the autocorrelation function between x1(kT) and x2(kT).
- the determining module is configured to:
- ⁇ is the delay of the data collected by the two microphones
- c is the speed of sound
- d is the difference in sound path
- the elevation angle of the sound source Determine the relative position between the source of the mobile terminal user and the two microphones.
- the above setting module is set to:
- a computer readable storage medium storing program instructions that, when executed, implement the methods described above.
- the primary and secondary MICs of the mobile terminal are dynamically adjusted according to the relative position changes of the user and the mobile terminal, and the noise reduction algorithm is implemented in the related art when the terminal user uses the hands-free mode for talking.
- the problem of failure can improve the sound quality of hands-free call reception voice without increasing the design cost and space of the mobile communication terminal.
- the noise reduction performance of the mobile terminal is maintained in a better state, thereby improving the voice quality of the call and improving the user experience.
- FIG. 1 is a schematic diagram of a dual MIC layout manner in the related art
- FIG. 2 is a flowchart of a method for reducing voice of a call of a mobile terminal according to an embodiment of the present invention
- FIG. 3 is a basic basic principle diagram of a far field sound source localization according to an embodiment of the present invention.
- FIG. 4 is a schematic diagram of calculating a delay of data collected by two microphones according to an embodiment of the present invention
- FIG. 5 is a flow chart showing the detailed processing of the embodiment of the present invention.
- FIG. 6 is a flow chart showing the judgment of the primary and secondary MICs according to an embodiment of the present invention.
- FIG. 7 is a schematic structural diagram of a call voice noise reduction apparatus of a mobile terminal according to an embodiment of the present invention.
- the invention provides a method and a device for reducing voice of a mobile terminal call voice, which are described below with reference to the accompanying drawings. Embodiments of the present invention will be described in detail. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
- FIG. 2 is a flowchart of a mobile terminal call voice noise reduction method according to an embodiment of the present invention. As shown in FIG. 2, according to an embodiment of the present invention, The mobile terminal call voice noise reduction method includes the following processing:
- Step 201 Obtain a delay of data collected by two microphones of the mobile terminal.
- step 201 when the mobile terminal enters the call mode, it is determined by the voice path whether the call mode of the mobile terminal is a hands-free call mode, a hand-held call mode, or a headset call mode, if it is determined In the handheld call mode or the headset call mode, the voice call is directly performed. If it is determined to be the hands-free call mode, the primary and secondary microphone determination operations are initiated (ie, steps 201-204 are performed).
- step 201 calculating the delay of data collected by the two microphones of the mobile terminal may include:
- Step 1 respectively, the collected data of the two microphone samples are filtered by the band pass filter to remove the high frequency noise, and the filtered collected data is subjected to fast Fourier transform FFT to calculate two sets of voices respectively corresponding to the two microphones.
- Step 2 Calculate power spectrum data of two sets of audio spectrums, and perform frequency domain weighting, and perform inverse fast Fourier transform IFFT after the power spectrum data is accumulated to a predetermined number of frames, and obtain an autocorrelation function;
- Step 3 Calculate the delay of the data collected by the two microphones according to Equation 1 based on the calculated autocorrelation function:
- ⁇ corresponds to the maximum value of R12( ⁇ ) is the time delay ⁇ 12 between two microphones
- x1(kT) s(kT- ⁇ 1)+n1(kT)
- x2(kT) s(kT- ⁇ 2 ) +n2(kT)
- s(kT) is the sound source signal
- n1(kT) is the background noise of the first microphone
- n2(kT) is the background noise of the second microphone
- ⁇ 1 and ⁇ 2 are the sound waves from the sound source to
- E[] represents the autocorrelation function between x1(kT) and x2(kT).
- Step 202 Determine a relative position between the sound source of the mobile terminal user and the two microphones according to the delay; and include the following processing:
- Step 1 Calculate the elevation angle of the sound source when the microphone array is used as the reference coordinate according to Formula 2.
- ⁇ is the delay of the data collected by the two microphones
- c is the speed of sound
- d is the difference in sound path
- Step 2 according to the elevation angle of the sound source Determine the relative position between the source of the mobile terminal user and the two microphones.
- Step 203 according to the relative position, the microphone that is closer to the sound source is set as the primary microphone, and the other microphone is set as the secondary microphone;
- the microphone located at the bottom of the mobile terminal is closer to the sound source when the elevation angle of the sound source It can be determined that the microphone located at the top of the mobile terminal is closer to the sound source;
- Step 204 Perform noise reduction processing on the call voice of the mobile terminal by using a noise reduction algorithm based on the primary microphone and the secondary microphone.
- FIG. 3 is a basic basic principle diagram of a far-field sound source localization according to an embodiment of the present invention.
- the mobile phone is The relative position of the microphone and the sound source can be regarded as the far field range, so the acoustic signal can be regarded as being transmitted in the form of a plane wave.
- a horizontal angle can be obtained. That is to say, the delay of the signal received by the two microphones can be used to calculate and determine the orientation of the sound source.
- the correlation function R12( ⁇ ) of x1(kT) and x2(kT) can be expressed as:
- the ⁇ corresponding to the maximum value of R12( ⁇ ) is the time delay ⁇ 12 between the two microphones.
- the elevation angle of the sound source that is, the relative position between the sound source and the microphone, can be obtained from the time delay R12 between the two microphones.
- the delay between the two microphones of the mobile phone can be calculated by using the existing microphone array and the processing chip of the mobile phone.
- FIG. 4 is a schematic diagram of calculating a delay of data collected by two microphones according to an embodiment of the present invention.
- the voice data sampled by the microphone is first filtered by a bandpass filter of 300 to 4 kHz to remove high frequency noise, and then The filtered speech signal is subjected to fast Fourier transform to obtain the speech spectrum; then the power spectrum data (cross-power spectrum) of the signal is obtained for the two sets of audio spectra obtained by the two microphones, and frequency domain weighting is performed, and the power spectrum data is accumulated.
- the inverse Fourier transform is used to find the autocorrelation function.
- the obtained autocorrelation function is used to obtain the delay of the data collected by the two microphones.
- the relative position between the sound source (speaker) and the microphone can be obtained according to the delay of the microphone, and the microphone closer to the sound source (speaker) is set as the main MIC, and the other MIC is set as the sub MIC, thereby Guaranteed noise reduction performance and improved hands-free calling sound quality.
- FIG. 5 is a flowchart of detailed processing of an embodiment of the present invention. As shown in FIG. 5, the following specifically includes the following processing:
- Step 501 The mobile terminal enters a call mode.
- Step 502 The voice path is used to determine whether the mobile terminal is in the hands-free mode or the handheld or headset mode. If the call is in the handheld or headset mode, step 503 is performed to directly perform a voice call. If the voice is in the hands-free mode, step 504 is performed.
- Step 503 directly performing a voice call
- Step 504 starting a primary and secondary MIC determination module
- Step 505 the process shown in FIG. 6 includes the following steps: Step 601, MIC1 and MIC2 receive a voice signal from a sound source (speaker); Step 602, using the above calculation method to calculate when the sound source reaches MIC1 and MIC2 ⁇ 12; Step 603, after obtaining the delay between MIC1 and MIC2, the formula can be utilized Calculate the elevation angle between the sound source and MIC1 and MIC2 Finally, according to the elevation angle The relative position between the sound source (speaker) and the MIC can be obtained when the elevation angle When determining that the MIC1 in Figure 1 is closer to the sound source (speaker), when the elevation angle At this time, the MIC2 distance sound source (speaker) in Fig. 1 is determined; in step 604, the main and sub MICs are determined.
- the MIC that is closer to the sound source (speaker) is set as the main MIC. If the main MIC setting of the original call is consistent with the calculated main MIC, the execution is performed. In step 507, if the main MIC setting of the original call does not match the calculated main MIC, steps 508 and 509 are performed.
- Step 507 returning to the voice call
- Step 508 adjusting a noise reduction algorithm
- step 509 a voice call is returned.
- the primary and secondary MIC information used in the hands-free call is constant, so when the relative position of the person and the terminal changes, the signal-to-noise ratio of the primary and secondary MIC may deteriorate, thereby affecting the noise reduction of the mobile terminal. Performance and voice quality of the call.
- the technical solution of the embodiment of the invention enables the user to update the primary and secondary MIC settings in real time when the position of the person changes with the relative position of the mobile terminal during the hands-free call, thereby keeping the noise reduction algorithm in a stable state and ensuring that the noise reduction algorithm is always in a stable state.
- the noise reduction performance of the mobile terminal compensates for the influence of the change of the position of the person on the performance of the noise reduction algorithm, thereby improving the sound quality.
- FIG. 7 is a schematic structural diagram of a mobile terminal call voice noise reduction device according to an embodiment of the present invention.
- the mobile terminal call voice noise reduction device includes: an obtaining module 70, a determining module 72, a setting module 74, and a noise reduction module 76.
- the following is a detailed description of each module of the embodiment of the present invention. Detailed instructions.
- the obtaining module 70 is configured to obtain a time delay of data collected by the two microphones of the mobile terminal; the obtaining module 70 is configured to:
- the collected data of the two microphone samples are respectively filtered by the band pass filter to remove the high frequency noise, and the filtered collected data is subjected to fast Fourier transform FFT to calculate two sets of speech spectra respectively corresponding to the two microphones;
- ⁇ corresponds to the maximum value of R12( ⁇ ) is the time delay ⁇ 12 between two microphones
- x1(kT) s(kT- ⁇ 1)+n1(kT)
- x2(kT) s(kT- ⁇ 2 ) +n2(kT)
- s(kT) is the sound source signal
- n1(kT) is the background noise of the first microphone
- n2(kT) is the background noise of the second microphone
- ⁇ 1 and ⁇ 2 are the sound waves from the sound source to
- E[] represents the autocorrelation function between x1(kT) and x2(kT).
- the determining module 72 is configured to determine a relative position between the sound source of the mobile terminal user and the two microphones according to the calculated time delay; the determining module 72 may be configured to:
- ⁇ is the delay of the data collected by the two microphones
- c is the speed of sound
- d is the difference in sound path
- the elevation angle of the sound source Determine the relative position between the source of the mobile terminal user and the two microphones.
- the setting module 74 is configured to set the microphone closer to the sound source as the primary microphone and the other microphone as the secondary microphone according to the determined relative position; the setting module 74 may be configured as:
- the noise reduction module 76 is configured to perform noise reduction processing on the call voice of the mobile terminal by using a noise reduction algorithm based on the determined primary microphone and the secondary microphone.
- the determining module further includes: when the mobile terminal enters the call mode, determining, by using the voice path, whether the call mode of the mobile terminal is a hands-free call mode, a handheld call mode, or a headset call mode, if it is determined to be handheld In the call mode or the headset call mode, the voice call is directly performed, and if it is determined to be the hands-free call mode, the primary and secondary microphone determination operations are started.
- the primary and secondary MICs of the mobile terminal are dynamically adjusted according to the relative position changes of the user and the mobile terminal, and the noise reduction algorithm is implemented in the related art when the terminal user uses the hands-free mode for talking.
- the problem of failure can improve the sound quality of hands-free call reception voice without increasing the design cost and space of the mobile communication terminal.
- the noise reduction performance of the mobile terminal is maintained in a better state, thereby improving the voice quality of the call and improving the user experience.
- all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.
- the devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.
- each device/function module/functional unit in the above embodiment When each device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium.
- the above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.
- the embodiment of the invention keeps the noise reduction performance of the mobile terminal in a better state, thereby improving the voice quality of the call and improving the user experience.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
Abstract
A mobile terminal call voice noise reduction method and device, the method comprising: data acquisition delays of two microphones of a mobile terminal are obtained; the relative positions between a sound source of a mobile terminal user and the two microphones are determined according to the delays; according to the relative positions, the microphone closer to the sound source is set as a main microphone, and the other microphone is set as an auxiliary microphone; on the basis of the main microphone and the auxiliary microphone, noise reduction processing is performed on a call voice of the mobile terminal via a noise reduction algorithm.
Description
本文涉及移动通讯领域,特别是涉及一种移动终端通话语音降噪方法及装置。This paper relates to the field of mobile communications, and in particular to a method and apparatus for voice noise reduction of a mobile terminal.
目前,移动终端的应用已经非常广泛,普及程度非常高。语音通话是移动终端的一项基本功能,语音通话音质的提升是所有移动终端都致力于努力研究的课题。At present, the application of mobile terminals has been very extensive and the popularity is very high. Voice call is a basic function of mobile terminals. The improvement of voice call quality is a topic that all mobile terminals are committed to.
由于通话环境的不确定性及复杂性,环境噪音是影响通话语音音质的一个重要因素,因此移动终端的降噪性能成为各大运营商评判手机一个关键指标,如何消除或降低环境噪音也成为各芯片厂商及终端厂商致力研究一个重点课题。Due to the uncertainty and complexity of the call environment, environmental noise is an important factor affecting the voice quality of the call. Therefore, the noise reduction performance of the mobile terminal has become a key indicator for the major operators to judge the mobile phone. How to eliminate or reduce the environmental noise has become Chip manufacturers and terminal manufacturers are committed to researching a key topic.
对于移动终端而言,降噪算法已经从以往的单麦克风(MIC)降噪发展到双MIC降噪,甚至麦克风阵列算法。移动终端上MIC的数量也早已由单MIC发展成现成现在普遍的双MIC,甚至有的移动终端上已经是3MIC或者4MIC布局,这些新技术都在推动着移动终端降噪技术的发展及性能的提升。For mobile terminals, the noise reduction algorithm has evolved from previous single microphone (MIC) noise reduction to dual MIC noise reduction, and even microphone array algorithms. The number of MICs on mobile terminals has also evolved from a single MIC to a now-current dual MIC. Even some mobile terminals have already been 3MIC or 4MIC layouts. These new technologies are driving the development and performance of mobile terminal noise reduction technology. Upgrade.
目前的降噪算法中,为了达到最优降噪性能,要求主MIC的信噪比要比副MIC的信噪比大6dB。图1是现有技术中双MIC布局方式的示意图,如图2所示,由于传统听筒(Receiver)的发声特点,终端用户在使用听筒模式通话时,主MIC比副MIC更靠近嘴,因此很容易满足降噪算法要求。但如果终端用户使用免提模式进行通话时,当人与终端的相对位置不同时,主副MIC的信噪比会发生变化,使得主副MIC的信噪比差值无法满足降噪算法要求,从而导致降噪算法失效,通话的降噪性能急剧恶化。因此需要一种方法来辨识这种变化,保证语音通话的降噪性能,从而提升用户体验效果,增加产品的市场竞争力。
In the current noise reduction algorithm, in order to achieve optimal noise reduction performance, the signal-to-noise ratio of the main MIC is required to be 6 dB larger than the signal-to-noise ratio of the sub-MIC. 1 is a schematic diagram of a dual MIC layout manner in the prior art. As shown in FIG. 2, due to the vocal characteristics of a conventional receiver, when the end user uses the handset mode to talk, the main MIC is closer to the mouth than the sub MIC, so It is easy to meet the requirements of the noise reduction algorithm. However, if the terminal user uses the hands-free mode to make a call, when the relative position of the person and the terminal is different, the signal-to-noise ratio of the primary and secondary MICs changes, so that the signal-to-noise ratio difference between the primary and secondary MICs cannot meet the requirements of the noise reduction algorithm. As a result, the noise reduction algorithm is invalidated, and the noise reduction performance of the call is drastically deteriorated. Therefore, a method is needed to identify such changes, and the noise reduction performance of the voice call is ensured, thereby improving the user experience and increasing the market competitiveness of the product.
发明内容Summary of the invention
本发明实施例提供一种移动终端通话语音降噪方法及装置。Embodiments of the present invention provide a method and apparatus for voice noise reduction of a mobile terminal.
一种移动终端通话语音降噪方法,包括:A mobile terminal call voice noise reduction method includes:
获取移动终端的两个麦克风所采集数据的时延;Obtaining a delay of data collected by two microphones of the mobile terminal;
根据时延确定移动终端用户的声源与两个麦克风之间的相对位置;Determining a relative position between the sound source of the mobile terminal user and the two microphones according to the delay;
根据相对位置,将距离声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风;According to the relative position, the microphone that is closer to the sound source is set as the primary microphone, and the other microphone is set as the secondary microphone;
基于主麦克风和副麦克风,通过降噪算法对移动终端的通话语音进行降噪处理。Based on the primary microphone and the secondary microphone, the noise reduction algorithm is used to perform noise reduction processing on the call voice of the mobile terminal.
可选地,上述方法还包括:Optionally, the foregoing method further includes:
当移动终端进入通话模式时,通过语音通路判断移动终端的通话模式是免提通话模式、手持通话模式、还是耳机通话模式,如果判断为手持通话模式或耳机通话模式,则直接进行语音通话,如果判断为免提通话模式,则启动主副麦克风判定操作。When the mobile terminal enters the call mode, it is determined by the voice path whether the call mode of the mobile terminal is a hands-free call mode, a hand-held call mode, or a headset call mode, and if it is determined to be a hand-held call mode or a headset call mode, the voice call is directly performed, if When it is determined that the hands-free call mode is activated, the primary and secondary microphone determination operations are started.
可选地,上述计算移动终端的两个麦克风所采集数据的时延包括:Optionally, the calculating the delay of data collected by the two microphones of the mobile terminal includes:
分别将两个麦克风采样的采集数据通过带通滤波器滤除高频噪声,并对滤波后的采集数据进行快速傅里叶变换FFT,计算出分别对应于两个麦克风的两组语音频谱;The collected data of the two microphone samples are respectively filtered by the band pass filter to remove the high frequency noise, and the filtered collected data is subjected to fast Fourier transform FFT to calculate two sets of speech spectra respectively corresponding to the two microphones;
计算两组音频频谱的功率谱数据,并进行频域加权,在功率谱数据累计达到预定数量的帧数后进行快速傅里叶逆变换IFFT,获取自相关函数;Calculating power spectrum data of two sets of audio spectrums, and performing frequency domain weighting, performing inverse fast Fourier transform IFFT after the power spectrum data is accumulated to a predetermined number of frames, and obtaining an autocorrelation function;
基于计算的自相关函数,根据公式1计算两个麦克风所采集数据的时延:Based on the calculated autocorrelation function, calculate the delay of the data collected by the two microphones according to Equation 1:
R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2)) 公式1;R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2)) Equation 1;
其中,R12(τ)的最大值对应的τ为两个麦克风之间的时延τ12,x1(kT)=s(kT-τ1)+n1(kT),x2(kT)=s(kT-τ2)+n2(kT),s(kT)为声源信号,n1(kT)为第一麦克风的背景噪声,n2(kT)为第二麦克风的背景噪声,τ1和τ2分别是声波从声源到第一麦克风和第二麦克风的传播时间,τ12=τ1-τ2为两个麦克风
之间所采集数据的时延,E[]表示x1(kT)和x2(kT)之间的自相关函数。Where τ corresponds to the maximum value of R12(τ) is the time delay τ12 between two microphones, x1(kT)=s(kT-τ1)+n1(kT), x2(kT)=s(kT-τ2 ) +n2(kT), s(kT) is the sound source signal, n1(kT) is the background noise of the first microphone, n2(kT) is the background noise of the second microphone, and τ1 and τ2 are the sound waves from the sound source to The propagation time of the first microphone and the second microphone, τ12=τ1-τ2 are two microphones
The delay between the data collected, E[] represents the autocorrelation function between x1(kT) and x2(kT).
可选地,上述根据计算的时延确定移动终端用户的声源与两个麦克风之间的相对位置包括:Optionally, determining, according to the calculated delay, the relative location between the sound source of the mobile terminal user and the two microphones includes:
根据公式2计算以麦克风阵列为参考坐标时声源的仰角
Calculate the elevation angle of the sound source when the microphone array is used as the reference coordinate according to Formula 2.
其中,a为两个麦克风之间的距离,τ为两个麦克风所采集数据的时延,c为声速,d为声程差;Where a is the distance between two microphones, τ is the delay of the data collected by the two microphones, c is the speed of sound, and d is the difference in sound path;
根据声源的仰角确定移动终端用户的声源与两个麦克风之间的相对位置。According to the elevation angle of the sound source Determine the relative position between the source of the mobile terminal user and the two microphones.
可选地,上述根据确定的相对位置,将距离声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风包括:Optionally, according to the determined relative position, the microphone that is closer to the sound source is set as the primary microphone, and the other microphone is set as the secondary microphone, including:
当声源的仰角时,确定位于移动终端底端的麦克风距离声源较近,当声源的仰角时,确定位于移动终端顶端的麦克风距离声源较近;When the elevation angle of the sound source When determining that the microphone at the bottom of the mobile terminal is closer to the sound source, when the elevation angle of the sound source When it is determined that the microphone located at the top of the mobile terminal is closer to the sound source;
将距离声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风。Set the microphone that is closer to the source to the primary microphone and the other microphone to the secondary microphone.
一种移动终端通话语音降噪装置,包括:A mobile terminal call voice noise reduction device includes:
获取模块,设置为:获取移动终端的两个麦克风所采集数据的时延;The obtaining module is configured to: obtain a delay of data collected by two microphones of the mobile terminal;
确定模块,设置为:根据时延确定移动终端用户的声源与两个麦克风之间的相对位置;Determining a module, configured to: determine a relative position between the sound source of the mobile terminal user and the two microphones according to the delay;
设置模块,设置为:根据相对位置,将距离声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风;Set the module, set to: set the microphone closer to the sound source as the primary microphone and the other microphone as the secondary microphone according to the relative position;
降噪模块,设置为:基于主麦克风和副麦克风,通过降噪算法对移动终端的通话语音进行降噪处理。The noise reduction module is configured to: perform noise reduction processing on the call voice of the mobile terminal by using a noise reduction algorithm based on the primary microphone and the secondary microphone.
可选地,上述装置还包括:Optionally, the foregoing apparatus further includes:
判断模块,设置为:当移动终端进入通话模式时,通过语音通路判断移动终端的通话模式是免提通话模式、手持通话模式、还是耳机通话模式,如
果判断为手持通话模式或耳机通话模式,则直接进行语音通话,如果判断为免提通话模式,则启动主副麦克风判定操作。The judging module is configured to: when the mobile terminal enters the call mode, determine, by using the voice path, whether the call mode of the mobile terminal is a hands-free call mode, a handheld call mode, or a headset call mode, such as
If it is determined to be the handheld call mode or the headset call mode, the voice call is directly performed, and if it is determined to be the hands-free call mode, the primary and secondary microphone determination operations are started.
可选地,上述获取模块是设置为:Optionally, the above obtaining module is set to:
分别将两个麦克风采样的采集数据通过带通滤波器滤除高频噪声,并对滤波后的采集数据进行快速傅里叶变换FFT,计算出分别对应于两个麦克风的两组语音频谱;The collected data of the two microphone samples are respectively filtered by the band pass filter to remove the high frequency noise, and the filtered collected data is subjected to fast Fourier transform FFT to calculate two sets of speech spectra respectively corresponding to the two microphones;
计算两组音频频谱的功率谱数据,并进行频域加权,在功率谱数据累计达到预定数量的帧数后进行快速傅里叶逆变换IFFT,获取自相关函数;Calculating power spectrum data of two sets of audio spectrums, and performing frequency domain weighting, performing inverse fast Fourier transform IFFT after the power spectrum data is accumulated to a predetermined number of frames, and obtaining an autocorrelation function;
基于计算的自相关函数,根据公式1计算两个麦克风所采集数据的时延:Based on the calculated autocorrelation function, calculate the delay of the data collected by the two microphones according to Equation 1:
R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2)) 公式1;R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2)) Equation 1;
其中,R12(τ)的最大值对应的τ为两个麦克风之间的时延τ12,x1(kT)=s(kT-τ1)+n1(kT),x2(kT)=s(kT-τ2)+n2(kT),s(kT)为声源信号,n1(kT)为第一麦克风的背景噪声,n2(kT)为第二麦克风的背景噪声,τ1和τ2分别是声波从声源到第一麦克风和第二麦克风的传播时间,τ12=τ1-τ2为两个麦克风之间所采集数据的时延,E[]表示x1(kT)和x2(kT)之间的自相关函数。Where τ corresponds to the maximum value of R12(τ) is the time delay τ12 between two microphones, x1(kT)=s(kT-τ1)+n1(kT), x2(kT)=s(kT-τ2 ) +n2(kT), s(kT) is the sound source signal, n1(kT) is the background noise of the first microphone, n2(kT) is the background noise of the second microphone, and τ1 and τ2 are the sound waves from the sound source to The propagation time of the first microphone and the second microphone, τ12=τ1-τ2 is the time delay of the data collected between the two microphones, and E[] represents the autocorrelation function between x1(kT) and x2(kT).
可选地,上述确定模块是设置为:Optionally, the determining module is configured to:
根据公式2计算以麦克风阵列为参考坐标时声源的仰角
Calculate the elevation angle of the sound source when the microphone array is used as the reference coordinate according to Formula 2.
其中,a为两个麦克风之间的距离,τ为两个麦克风所采集数据的时延,c为声速,d为声程差;Where a is the distance between two microphones, τ is the delay of the data collected by the two microphones, c is the speed of sound, and d is the difference in sound path;
根据声源的仰角确定移动终端用户的声源与两个麦克风之间的相对位置。According to the elevation angle of the sound source Determine the relative position between the source of the mobile terminal user and the two microphones.
可选地,上述设置模块是设置为:Optionally, the above setting module is set to:
当声源的仰角时,确定位于移动终端底端的麦克风距离声源较近,当声源的仰角时,确定位于移动终端顶端的麦克风距离声源较近;
When the elevation angle of the sound source When determining that the microphone at the bottom of the mobile terminal is closer to the sound source, when the elevation angle of the sound source When it is determined that the microphone located at the top of the mobile terminal is closer to the sound source;
将距离声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风。Set the microphone that is closer to the source to the primary microphone and the other microphone to the secondary microphone.
一种计算机可读存储介质,存储有程序指令,当该程序指令被执行时可实现上面所述的方法。A computer readable storage medium storing program instructions that, when executed, implement the methods described above.
借助于本发明实施例的技术方案,移动终端的主副MIC会随着用户与移动终端的相对位置变化而进行动态调整,解决了相关技术中在终端用户使用免提模式进行通话时降噪算法失效的问题,能够在不增加移动通信终端设计成本和空间的条件下,提高免提通话接收语音的音质。使移动终端的降噪性能保持在一个较佳状态,从而提高通话音质,提升了用户体验效果。With the technical solution of the embodiment of the present invention, the primary and secondary MICs of the mobile terminal are dynamically adjusted according to the relative position changes of the user and the mobile terminal, and the noise reduction algorithm is implemented in the related art when the terminal user uses the hands-free mode for talking. The problem of failure can improve the sound quality of hands-free call reception voice without increasing the design cost and space of the mobile communication terminal. The noise reduction performance of the mobile terminal is maintained in a better state, thereby improving the voice quality of the call and improving the user experience.
附图概述BRIEF abstract
附图仅用于示出实施方式的目的,而并不认为是对本发明的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:The drawings are only for the purpose of illustrating the embodiments, and are not intended to limit the invention. Throughout the drawings, the same reference numerals are used to refer to the same parts. In the drawing:
图1是相关技术中双MIC布局方式的示意图;1 is a schematic diagram of a dual MIC layout manner in the related art;
图2是本发明实施例的移动终端通话语音降噪方法的流程图;2 is a flowchart of a method for reducing voice of a call of a mobile terminal according to an embodiment of the present invention;
图3是本发明实施例的远场声源定位的基本的基本原理图;3 is a basic basic principle diagram of a far field sound source localization according to an embodiment of the present invention;
图4是本发明实施例的计算两麦克风采集数据的时延的示意图;4 is a schematic diagram of calculating a delay of data collected by two microphones according to an embodiment of the present invention;
图5是本发明实施例的详细处理的流程图;Figure 5 is a flow chart showing the detailed processing of the embodiment of the present invention;
图6是本发明实施例的主副MIC判断的流程图;6 is a flow chart showing the judgment of the primary and secondary MICs according to an embodiment of the present invention;
图7是本发明实施例的移动终端通话语音降噪装置的结构示意图。FIG. 7 is a schematic structural diagram of a call voice noise reduction apparatus of a mobile terminal according to an embodiment of the present invention.
下面将参照附图更详细地描述本公开的示例性实施例。Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings.
本发明提供了一种移动终端通话语音降噪方法及装置,以下结合附图,
对本发明的实施方式进行详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不限定本发明。The invention provides a method and a device for reducing voice of a mobile terminal call voice, which are described below with reference to the accompanying drawings.
Embodiments of the present invention will be described in detail. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
方法实施例Method embodiment
根据本发明的实施例,提供了一种移动终端通话语音降噪方法,图2是本发明实施例的移动终端通话语音降噪方法的流程图,如图2所示,根据本发明实施例的移动终端通话语音降噪方法包括如下处理:According to an embodiment of the present invention, a mobile terminal call voice noise reduction method is provided. FIG. 2 is a flowchart of a mobile terminal call voice noise reduction method according to an embodiment of the present invention. As shown in FIG. 2, according to an embodiment of the present invention, The mobile terminal call voice noise reduction method includes the following processing:
步骤201,获取移动终端的两个麦克风所采集数据的时延;Step 201: Obtain a delay of data collected by two microphones of the mobile terminal.
在实际应用中,在执行步骤201之前,首先进行如下处理:当移动终端进入通话模式时,通过语音通路判断移动终端的通话模式是免提通话模式、手持通话模式、还是耳机通话模式,如果判断为手持通话模式或耳机通话模式,则直接进行语音通话,如果判断为免提通话模式,则启动主副麦克风判定操作(即,执行步骤201-204)。In the actual application, before performing step 201, the following processing is first performed: when the mobile terminal enters the call mode, it is determined by the voice path whether the call mode of the mobile terminal is a hands-free call mode, a hand-held call mode, or a headset call mode, if it is determined In the handheld call mode or the headset call mode, the voice call is directly performed. If it is determined to be the hands-free call mode, the primary and secondary microphone determination operations are initiated (ie, steps 201-204 are performed).
在步骤201中,计算移动终端的两个麦克风所采集数据的时延可以包括:In step 201, calculating the delay of data collected by the two microphones of the mobile terminal may include:
步骤1,分别将两个麦克风采样的采集数据通过带通滤波器滤除高频噪声,并对滤波后的采集数据进行快速傅里叶变换FFT,计算出分别对应于两个麦克风的两组语音频谱;Step 1: respectively, the collected data of the two microphone samples are filtered by the band pass filter to remove the high frequency noise, and the filtered collected data is subjected to fast Fourier transform FFT to calculate two sets of voices respectively corresponding to the two microphones. Spectrum
步骤2,计算两组音频频谱的功率谱数据,并进行频域加权,在功率谱数据累计达到预定数量的帧数后进行快速傅里叶逆变换IFFT,获取自相关函数;Step 2: Calculate power spectrum data of two sets of audio spectrums, and perform frequency domain weighting, and perform inverse fast Fourier transform IFFT after the power spectrum data is accumulated to a predetermined number of frames, and obtain an autocorrelation function;
步骤3,基于计算的自相关函数,根据公式1计算两个麦克风所采集数据的时延:Step 3: Calculate the delay of the data collected by the two microphones according to Equation 1 based on the calculated autocorrelation function:
R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2)) 公式1;R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2)) Equation 1;
其中,R12(τ)的最大值对应的τ为两个麦克风之间的时延τ12,x1(kT)=s(kT-τ1)+n1(kT),x2(kT)=s(kT-τ2)+n2(kT),s(kT)为声源信号,n1(kT)为第一麦克风的背景噪声,n2(kT)为第二麦克风的背景噪声,τ1和τ2分别是声波从声源到第一麦克风和第二麦克风的传播时间,τ12=τ1-τ2为两个麦克风之间所采集数据的时延,E[]表示x1(kT)和x2(kT)之间的自相关函数。
Where τ corresponds to the maximum value of R12(τ) is the time delay τ12 between two microphones, x1(kT)=s(kT-τ1)+n1(kT), x2(kT)=s(kT-τ2 ) +n2(kT), s(kT) is the sound source signal, n1(kT) is the background noise of the first microphone, n2(kT) is the background noise of the second microphone, and τ1 and τ2 are the sound waves from the sound source to The propagation time of the first microphone and the second microphone, τ12=τ1-τ2 is the time delay of the data collected between the two microphones, and E[] represents the autocorrelation function between x1(kT) and x2(kT).
步骤202,根据时延确定移动终端用户的声源与两个麦克风之间的相对位置;包括如下处理:Step 202: Determine a relative position between the sound source of the mobile terminal user and the two microphones according to the delay; and include the following processing:
步骤1,根据公式2计算以麦克风阵列为参考坐标时声源的仰角
Step 1. Calculate the elevation angle of the sound source when the microphone array is used as the reference coordinate according to Formula 2.
其中,a为两个麦克风之间的距离,τ为两个麦克风所采集数据的时延,c为声速,d为声程差;Where a is the distance between two microphones, τ is the delay of the data collected by the two microphones, c is the speed of sound, and d is the difference in sound path;
步骤2,根据声源的仰角确定移动终端用户的声源与两个麦克风之间的相对位置。 Step 2, according to the elevation angle of the sound source Determine the relative position between the source of the mobile terminal user and the two microphones.
步骤203,根据的相对位置,将距离声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风; Step 203, according to the relative position, the microphone that is closer to the sound source is set as the primary microphone, and the other microphone is set as the secondary microphone;
可选地,在实际应用中,当声源的仰角时,可以确定位于移动终端底端的麦克风距离声源较近,当声源的仰角时,可以确定位于移动终端顶端的麦克风距离声源较近;Optionally, in practical applications, when the elevation angle of the sound source When it is determined, the microphone located at the bottom of the mobile terminal is closer to the sound source when the elevation angle of the sound source It can be determined that the microphone located at the top of the mobile terminal is closer to the sound source;
将距离声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风。Set the microphone that is closer to the source to the primary microphone and the other microphone to the secondary microphone.
步骤204,基于主麦克风和副麦克风,通过降噪算法对移动终端的通话语音进行降噪处理。Step 204: Perform noise reduction processing on the call voice of the mobile terminal by using a noise reduction algorithm based on the primary microphone and the secondary microphone.
以下结合附图,对本发明实施例的上述技术方案进行详细说明。The above technical solutions of the embodiments of the present invention are described in detail below with reference to the accompanying drawings.
图3是本发明实施例的远场声源定位的基本的基本原理图,首先,如图3所示,对于免提通话来讲,由于声源与手机麦克风之间的距离较远,因此手机麦克风相对与声源位置可以看做远场范围,因此声信号可以看做是以平面波的形式传播。3 is a basic basic principle diagram of a far-field sound source localization according to an embodiment of the present invention. First, as shown in FIG. 3, for a hands-free call, since the distance between the sound source and the mobile phone microphone is far, the mobile phone is The relative position of the microphone and the sound source can be regarded as the far field range, so the acoustic signal can be regarded as being transmitted in the form of a plane wave.
假设a为两MIC之间的距离,τ为信号到达两个MIC的时延,c为声速,d为声程差,那么由几何关系得到以麦克风阵列为参考坐标时声源的仰角:Suppose a is the distance between two MICs, τ is the delay of the signal reaching the two MICs, c is the speed of sound, and d is the difference of the sound path, then the elevation angle of the sound source when the microphone array is taken as the reference coordinate is obtained by the geometric relationship:
所以,通过时延为τ,能够得到水平角也就是说可以由两个麦克风接收信号的时延来计算并确定声源的方位。
Therefore, by using a delay of τ, a horizontal angle can be obtained. That is to say, the delay of the signal received by the two microphones can be used to calculate and determine the orientation of the sound source.
假设不考虑声强的衰减与混响,则图3中两个麦克风接收信号的离散模型为:Assuming that the attenuation and reverberation of the sound intensity are not considered, the discrete models of the signals received by the two microphones in Figure 3 are:
x1(kT)=s(kT-τ1)+n1(kT),x2(kT)=s(kT-τ2)+n2(kT),其中,其中s(kT)为声源信号,n1(kT)和n2(kT)为背景噪声。s(kT)、n1(kT)和n2(kT)互不相关。τ1和τ2是声波从声源到麦克风1和麦克风2的传播时间,τ12=τ1-τ2就是两个麦克风之间的时间延迟。X1(kT)=s(kT-τ1)+n1(kT), x2(kT)=s(kT-τ2)+n2(kT), where s(kT) is the sound source signal, n1(kT) And n2(kT) is the background noise. s(kT), n1(kT), and n2(kT) are not related to each other. Τ1 and τ2 are the propagation times of sound waves from the sound source to the microphone 1 and the microphone 2, and τ12=τ1-τ2 is the time delay between the two microphones.
x1(kT)和x2(kT)的相关函数R12(τ)可以表示成:The correlation function R12(τ) of x1(kT) and x2(kT) can be expressed as:
R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2));R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2));
由自相关函数性质可知,当τ-(τ1-τ2)=0时,R12(τ)达到最大值。所以求得R12(τ)的最大值对应的τ就是两个麦克风之间的时延τ12。根据两个麦克风之间的时延R12可以获得声源的仰角,即声源与麦克风之间的相对位置。It can be seen from the nature of the autocorrelation function that when τ-(τ1-τ2) = 0, R12(τ) reaches a maximum value. Therefore, the τ corresponding to the maximum value of R12(τ) is the time delay τ12 between the two microphones. The elevation angle of the sound source, that is, the relative position between the sound source and the microphone, can be obtained from the time delay R12 between the two microphones.
再次,当移动终端处于免提通话状态时,可利用手机现有的麦克风阵列及处理芯片计算获得手机两个麦克风之间的时延。Again, when the mobile terminal is in the hands-free call state, the delay between the two microphones of the mobile phone can be calculated by using the existing microphone array and the processing chip of the mobile phone.
图4是本发明实施例的计算两麦克风采集数据的时延的示意图,如图4所示,麦克风采样出的语音数据首先通过一个300~4KHz的带通滤波器滤除高频噪声,然后对滤波后的语音信号做快速傅里叶变换,求出语音频谱;然后对两个麦克风获得的两组音频频谱求出信号的功率谱数据(互功率谱)并进行频域加权,功率谱数据累计达到一帧后做傅里叶逆变换求自相关函数;最后利用获得的自相关函数求得两麦克风采集数据的时延。最后,根据麦克风的时延可以获得声源(讲话人)与麦克风之间的相对位置,并将距离声源(讲话人)较近的麦克风设置为主MIC,另一MIC设置为副MIC,从而保证降噪性能,提升免提通话音质。4 is a schematic diagram of calculating a delay of data collected by two microphones according to an embodiment of the present invention. As shown in FIG. 4, the voice data sampled by the microphone is first filtered by a bandpass filter of 300 to 4 kHz to remove high frequency noise, and then The filtered speech signal is subjected to fast Fourier transform to obtain the speech spectrum; then the power spectrum data (cross-power spectrum) of the signal is obtained for the two sets of audio spectra obtained by the two microphones, and frequency domain weighting is performed, and the power spectrum data is accumulated. After reaching one frame, the inverse Fourier transform is used to find the autocorrelation function. Finally, the obtained autocorrelation function is used to obtain the delay of the data collected by the two microphones. Finally, the relative position between the sound source (speaker) and the microphone can be obtained according to the delay of the microphone, and the microphone closer to the sound source (speaker) is set as the main MIC, and the other MIC is set as the sub MIC, thereby Guaranteed noise reduction performance and improved hands-free calling sound quality.
图5是本发明实施例的详细处理的流程图,如图5所示,具体包括如下处理:FIG. 5 is a flowchart of detailed processing of an embodiment of the present invention. As shown in FIG. 5, the following specifically includes the following processing:
步骤501,移动终端进入通话模式;Step 501: The mobile terminal enters a call mode.
步骤502,可通过语音通路判断移动终端通话是免提模式还是手持或耳机模式,如果为手持或耳机模式通话,执行步骤503,直接进行语音通话,如果为免提模式,则执行步骤504。
Step 502: The voice path is used to determine whether the mobile terminal is in the hands-free mode or the handheld or headset mode. If the call is in the handheld or headset mode, step 503 is performed to directly perform a voice call. If the voice is in the hands-free mode, step 504 is performed.
步骤503,直接进行语音通话; Step 503, directly performing a voice call;
步骤504,启动主副MIC判定模块; Step 504, starting a primary and secondary MIC determination module;
步骤505,处理如图6所示,包括如下处理:步骤601,MIC1与MIC2接收到声源(讲话人)发出的语音信号;步骤602,利用上述计算方法计算出声源到达MIC1与MIC2的时延τ12;步骤603,得到MIC1与MIC2之间的时延后,可利用公式计算出声源与MIC1、MIC2之间的仰角最后,根据仰角可以获得声源(讲话人)与MIC之间的相对位置,当仰角时,确定图1中的MIC1距离声源(讲话人)较近,当仰角时,确定图1中的MIC2距离声源(讲话人);步骤604,确定主副MIC。 Step 505, the process shown in FIG. 6 includes the following steps: Step 601, MIC1 and MIC2 receive a voice signal from a sound source (speaker); Step 602, using the above calculation method to calculate when the sound source reaches MIC1 and MIC2 Ττ12; Step 603, after obtaining the delay between MIC1 and MIC2, the formula can be utilized Calculate the elevation angle between the sound source and MIC1 and MIC2 Finally, according to the elevation angle The relative position between the sound source (speaker) and the MIC can be obtained when the elevation angle When determining that the MIC1 in Figure 1 is closer to the sound source (speaker), when the elevation angle At this time, the MIC2 distance sound source (speaker) in Fig. 1 is determined; in step 604, the main and sub MICs are determined.
506,骤根据计算出来的MIC1与MIC2之间的相对位置,将距离声源(讲话人)较近的MIC设置为主MIC,如果原有通话的主MIC设置与计算出来的主MIC一致,执行步骤507,如果原有通话的主MIC设置与计算出来的主MIC不一致,则执行步骤508、509。506. According to the calculated relative position between the MIC1 and the MIC2, the MIC that is closer to the sound source (speaker) is set as the main MIC. If the main MIC setting of the original call is consistent with the calculated main MIC, the execution is performed. In step 507, if the main MIC setting of the original call does not match the calculated main MIC, steps 508 and 509 are performed.
步骤507,返回语音通话; Step 507, returning to the voice call;
步骤508,调整降噪算法; Step 508, adjusting a noise reduction algorithm;
步骤509,返回语音通话。In step 509, a voice call is returned.
在相关技术中,免提通话时使用的主副MIC信息是不变的,因此当人与终端的相对位置发生变化时,主副MIC的信噪比可能出现恶化,从而影响移动终端的降噪性能及通话语音音质。本发明实施例的技术方案能够使用户在免提通话时,当人的位置与移动终端相对位置发生变化时,实时更新主副MIC设置,从而保持降噪算法始终处于一种稳定的状态,保证移动终端的降噪性能,弥补了因为人的位置变化对降噪算法性能的影响,从而提升了音质。In the related art, the primary and secondary MIC information used in the hands-free call is constant, so when the relative position of the person and the terminal changes, the signal-to-noise ratio of the primary and secondary MIC may deteriorate, thereby affecting the noise reduction of the mobile terminal. Performance and voice quality of the call. The technical solution of the embodiment of the invention enables the user to update the primary and secondary MIC settings in real time when the position of the person changes with the relative position of the mobile terminal during the hands-free call, thereby keeping the noise reduction algorithm in a stable state and ensuring that the noise reduction algorithm is always in a stable state. The noise reduction performance of the mobile terminal compensates for the influence of the change of the position of the person on the performance of the noise reduction algorithm, thereby improving the sound quality.
装置实施例Device embodiment
根据本发明的实施例,提供了一种移动终端通话语音降噪装置,图7是本发明实施例的移动终端通话语音降噪装置的结构示意图,如图7所示,根据本发明实施例的移动终端通话语音降噪装置包括:获取模块70、确定模块72、设置模块74、以及降噪模块76,以下对本发明实施例的各个模块进行详
细的说明。According to an embodiment of the present invention, a mobile terminal call voice noise reduction device is provided. FIG. 7 is a schematic structural diagram of a mobile terminal call voice noise reduction device according to an embodiment of the present invention. As shown in FIG. 7, according to an embodiment of the present invention, The mobile terminal call voice noise reduction device includes: an obtaining module 70, a determining module 72, a setting module 74, and a noise reduction module 76. The following is a detailed description of each module of the embodiment of the present invention.
Detailed instructions.
获取模块70,设置为获取移动终端的两个麦克风所采集数据的时延;上述获取模块70是设置为:The obtaining module 70 is configured to obtain a time delay of data collected by the two microphones of the mobile terminal; the obtaining module 70 is configured to:
分别将两个麦克风采样的采集数据通过带通滤波器滤除高频噪声,并对滤波后的采集数据进行快速傅里叶变换FFT,计算出分别对应于两个麦克风的两组语音频谱;The collected data of the two microphone samples are respectively filtered by the band pass filter to remove the high frequency noise, and the filtered collected data is subjected to fast Fourier transform FFT to calculate two sets of speech spectra respectively corresponding to the two microphones;
计算两组音频频谱的功率谱数据,并进行频域加权,在功率谱数据累计达到预定数量的帧数后进行快速傅里叶逆变换IFFT,获取自相关函数;Calculating power spectrum data of two sets of audio spectrums, and performing frequency domain weighting, performing inverse fast Fourier transform IFFT after the power spectrum data is accumulated to a predetermined number of frames, and obtaining an autocorrelation function;
基于计算的自相关函数,根据公式1计算两个麦克风所采集数据的时延:Based on the calculated autocorrelation function, calculate the delay of the data collected by the two microphones according to Equation 1:
R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2)) 公式1;R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2)) Equation 1;
其中,R12(τ)的最大值对应的τ为两个麦克风之间的时延τ12,x1(kT)=s(kT-τ1)+n1(kT),x2(kT)=s(kT-τ2)+n2(kT),s(kT)为声源信号,n1(kT)为第一麦克风的背景噪声,n2(kT)为第二麦克风的背景噪声,τ1和τ2分别是声波从声源到第一麦克风和第二麦克风的传播时间,τ12=τ1-τ2为两个麦克风之间所采集数据的时延,E[]表示x1(kT)和x2(kT)之间的自相关函数。Where τ corresponds to the maximum value of R12(τ) is the time delay τ12 between two microphones, x1(kT)=s(kT-τ1)+n1(kT), x2(kT)=s(kT-τ2 ) +n2(kT), s(kT) is the sound source signal, n1(kT) is the background noise of the first microphone, n2(kT) is the background noise of the second microphone, and τ1 and τ2 are the sound waves from the sound source to The propagation time of the first microphone and the second microphone, τ12=τ1-τ2 is the time delay of the data collected between the two microphones, and E[] represents the autocorrelation function between x1(kT) and x2(kT).
确定模块72,设置为根据计算的时延确定移动终端用户的声源与两个麦克风之间的相对位置;上述确定模块72可以是设置为:The determining module 72 is configured to determine a relative position between the sound source of the mobile terminal user and the two microphones according to the calculated time delay; the determining module 72 may be configured to:
根据公式2计算以麦克风阵列为参考坐标时声源的仰角
Calculate the elevation angle of the sound source when the microphone array is used as the reference coordinate according to Formula 2.
其中,a为两个麦克风之间的距离,τ为两个麦克风所采集数据的时延,c为声速,d为声程差;Where a is the distance between two microphones, τ is the delay of the data collected by the two microphones, c is the speed of sound, and d is the difference in sound path;
根据声源的仰角确定移动终端用户的声源与两个麦克风之间的相对位置。According to the elevation angle of the sound source Determine the relative position between the source of the mobile terminal user and the two microphones.
设置模块74,设置为根据确定的相对位置,将距离声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风;上述设置模块74可以是设置为:
The setting module 74 is configured to set the microphone closer to the sound source as the primary microphone and the other microphone as the secondary microphone according to the determined relative position; the setting module 74 may be configured as:
当声源的仰角时,确定位于移动终端底端的麦克风距离声源较近,当声源的仰角时,确定位于移动终端顶端的麦克风距离声源较近;When the elevation angle of the sound source When determining that the microphone at the bottom of the mobile terminal is closer to the sound source, when the elevation angle of the sound source When it is determined that the microphone located at the top of the mobile terminal is closer to the sound source;
将距离声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风。Set the microphone that is closer to the source to the primary microphone and the other microphone to the secondary microphone.
降噪模块76,设置为基于确定的主麦克风和副麦克风,通过降噪算法对移动终端的通话语音进行降噪处理。The noise reduction module 76 is configured to perform noise reduction processing on the call voice of the mobile terminal by using a noise reduction algorithm based on the determined primary microphone and the secondary microphone.
在本发明实施例中,还包括判断模块,设置为当移动终端进入通话模式时,通过语音通路判断移动终端的通话模式是免提通话模式、手持通话模式、还是耳机通话模式,如果判断为手持通话模式或耳机通话模式,则直接进行语音通话,如果判断为免提通话模式,则启动主副麦克风判定操作。In the embodiment of the present invention, the determining module further includes: when the mobile terminal enters the call mode, determining, by using the voice path, whether the call mode of the mobile terminal is a hands-free call mode, a handheld call mode, or a headset call mode, if it is determined to be handheld In the call mode or the headset call mode, the voice call is directly performed, and if it is determined to be the hands-free call mode, the primary and secondary microphone determination operations are started.
借助于本发明实施例的技术方案,移动终端的主副MIC会随着用户与移动终端的相对位置变化而进行动态调整,解决了相关技术中在终端用户使用免提模式进行通话时降噪算法失效的问题,能够在不增加移动通信终端设计成本和空间的条件下,提高免提通话接收语音的音质。使移动终端的降噪性能保持在一个较佳状态,从而提高通话音质,提升了用户体验效果。With the technical solution of the embodiment of the present invention, the primary and secondary MICs of the mobile terminal are dynamically adjusted according to the relative position changes of the user and the mobile terminal, and the noise reduction algorithm is implemented in the related art when the terminal user uses the hands-free mode for talking. The problem of failure can improve the sound quality of hands-free call reception voice without increasing the design cost and space of the mobile communication terminal. The noise reduction performance of the mobile terminal is maintained in a better state, thereby improving the voice quality of the call and improving the user experience.
本领域普通技术人员可以理解上述实施例的全部或部分步骤可以使用计算机程序流程来实现,所述计算机程序可以存储于一计算机可读存储介质中,所述计算机程序在相应的硬件平台上(如系统、设备、装置、器件等)执行,在执行时,包括方法实施例的步骤之一或其组合。One of ordinary skill in the art will appreciate that all or a portion of the steps of the above-described embodiments can be implemented using a computer program flow, which can be stored in a computer readable storage medium, such as on a corresponding hardware platform (eg, The system, device, device, device, etc. are executed, and when executed, include one or a combination of the steps of the method embodiments.
可选地,上述实施例的全部或部分步骤也可以使用集成电路来实现,这些步骤可以被分别制作成一个个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。Alternatively, all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.
上述实施例中的各装置/功能模块/功能单元可以采用通用的计算装置来实现,它们可以集中在单个的计算装置上,也可以分布在多个计算装置所组成的网络上。The devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.
上述实施例中的各装置/功能模块/功能单元以软件功能模块的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。上述提到的计算机可读取存储介质可以是只读存储器,磁盘或光盘等。
When each device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. The above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.
本发明实施例使移动终端的降噪性能保持在一个较佳状态,从而提高通话音质,提升了用户体验效果
The embodiment of the invention keeps the noise reduction performance of the mobile terminal in a better state, thereby improving the voice quality of the call and improving the user experience.
Claims (11)
- 一种移动终端通话语音降噪方法,包括:A mobile terminal call voice noise reduction method includes:获取移动终端的两个麦克风所采集数据的时延;Obtaining a delay of data collected by two microphones of the mobile terminal;根据所述时延确定移动终端用户的声源与所述两个麦克风之间的相对位置;Determining, according to the time delay, a relative position between a sound source of the mobile terminal user and the two microphones;根据所述相对位置,将距离所述声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风;According to the relative position, a microphone that is closer to the sound source is set as a primary microphone, and another microphone is set as a secondary microphone;基于所述主麦克风和所述副麦克风,通过降噪算法对所述移动终端的通话语音进行降噪处理。And performing noise reduction processing on the call voice of the mobile terminal by using a noise reduction algorithm based on the primary microphone and the secondary microphone.
- 如权利要求1所述的方法,所述方法还包括:The method of claim 1 further comprising:当所述移动终端进入通话模式时,通过语音通路判断所述移动终端的通话模式是免提通话模式、手持通话模式、还是耳机通话模式,如果判断为手持通话模式或耳机通话模式,则直接进行语音通话,如果判断为免提通话模式,则启动主副麦克风判定操作。When the mobile terminal enters the call mode, it is determined by the voice path that the call mode of the mobile terminal is a hands-free call mode, a handheld call mode, or a headset call mode, and if it is determined to be a handheld call mode or a headset call mode, directly The voice call, if it is determined to be the hands-free call mode, the primary and secondary microphone determination operations are initiated.
- 如权利要求1所述的方法,其中,计算移动终端的两个麦克风所采集数据的时延包括:The method of claim 1, wherein calculating the delay of data collected by the two microphones of the mobile terminal comprises:分别将两个麦克风采样的采集数据通过带通滤波器滤除高频噪声,并对滤波后的采集数据进行快速傅里叶变换FFT,计算出分别对应于两个麦克风的两组语音频谱;The collected data of the two microphone samples are respectively filtered by the band pass filter to remove the high frequency noise, and the filtered collected data is subjected to fast Fourier transform FFT to calculate two sets of speech spectra respectively corresponding to the two microphones;计算所述两组音频频谱的功率谱数据,并进行频域加权,在功率谱数据累计达到预定数量的帧数后进行快速傅里叶逆变换IFFT,获取自相关函数;Calculating power spectrum data of the two sets of audio spectrums, and performing frequency domain weighting, performing inverse fast Fourier transform IFFT after the power spectrum data is accumulated to a predetermined number of frames, and obtaining an autocorrelation function;基于计算的自相关函数,根据公式1计算两个麦克风所采集数据的时延:Based on the calculated autocorrelation function, calculate the delay of the data collected by the two microphones according to Equation 1:R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2))公式1;R 12 (τ)=E[x 1 (kT)x 2 (kT-τ)]=E[s(kT-τ 1 )s(kT-τ 1 -τ)]=R ss (τ-(τ 1 -τ 2 )) Formula 1;其中,R12(τ)的最大值对应的τ为两个麦克风之间的时延τ12,x1(kT)=s(kT-τ1)+n1(kT),x2(kT)=s(kT-τ2)+n2(kT),s(kT)为声源信号,n1(kT)为 第一麦克风的背景噪声,n2(kT)为第二麦克风的背景噪声,τ1和τ2分别是声波从声源到第一麦克风和第二麦克风的传播时间,τ12=τ1-τ2为两个麦克风之间所采集数据的时延,E[]表示x1(kT)和x2(kT)之间的自相关函数。Where τ corresponds to the maximum value of R 12 (τ) is the time delay τ 12 between the two microphones, x 1 (kT)=s(kT-τ 1 )+n 1 (kT), x 2 (kT) =s(kT-τ 2 )+n 2 (kT), s(kT) is the sound source signal, n 1 (kT) is the background noise of the first microphone, and n 2 (kT) is the background noise of the second microphone. τ 1 and τ 2 are the propagation times of sound waves from the sound source to the first microphone and the second microphone, respectively, τ 12 = τ 1 - τ 2 is the time delay of the data collected between the two microphones, and E[] represents x 1 The autocorrelation function between (kT) and x 2 (kT).
- 如权利要求3所述的方法,其中,根据计算的所述时延确定移动终端用户的声源与所述两个麦克风之间的相对位置包括:The method of claim 3, wherein determining the relative position between the sound source of the mobile terminal user and the two microphones according to the calculated time delay comprises:根据公式2计算以麦克风阵列为参考坐标时所述声源的仰角 Calculating the elevation angle of the sound source when the microphone array is used as a reference coordinate according to Formula 2其中,a为两个麦克风之间的距离,τ为两个麦克风所采集数据的时延,c为声速,d为声程差;Where a is the distance between two microphones, τ is the delay of the data collected by the two microphones, c is the speed of sound, and d is the difference in sound path;
- 如权利要求4所述的方法,其中,根据确定的所述相对位置,将距离所述声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风包括:The method of claim 4, wherein, according to the determined relative position, a microphone that is closer to the sound source is set as a primary microphone, and setting another microphone as a secondary microphone includes:当声源的仰角时,确定位于移动终端底端的麦克风距离声源较近,当声源的仰角时,确定位于移动终端顶端的麦克风距离声源较近;When the elevation angle of the sound source When determining that the microphone at the bottom of the mobile terminal is closer to the sound source, when the elevation angle of the sound source When it is determined that the microphone located at the top of the mobile terminal is closer to the sound source;将距离所述声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风。A microphone that is closer to the sound source is set as the primary microphone and another microphone is set as the secondary microphone.
- 一种移动终端通话语音降噪装置,包括:A mobile terminal call voice noise reduction device includes:获取模块,设置为:获取移动终端的两个麦克风所采集数据的时延;The obtaining module is configured to: obtain a delay of data collected by two microphones of the mobile terminal;确定模块,设置为:根据所述时延确定移动终端用户的声源与所述两个麦克风之间的相对位置;a determining module, configured to: determine, according to the time delay, a relative position between a sound source of the mobile terminal user and the two microphones;设置模块,设置为:根据所述相对位置,将距离所述声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风;以及Setting a module, configured to: set a microphone closer to the sound source as a primary microphone and another microphone as a secondary microphone according to the relative position;降噪模块,设置为:基于所述主麦克风和所述副麦克风,通过降噪算法对所述移动终端的通话语音进行降噪处理。 The noise reduction module is configured to: perform noise reduction processing on the call voice of the mobile terminal by using a noise reduction algorithm based on the primary microphone and the secondary microphone.
- 如权利要求6所述的装置,所述装置还包括:The apparatus of claim 6 further comprising:判断模块,设置为:当所述移动终端进入通话模式时,通过语音通路判断所述移动终端的通话模式是免提通话模式、手持通话模式、还是耳机通话模式,如果判断为手持通话模式或耳机通话模式,则直接进行语音通话,如果判断为免提通话模式,则启动主副麦克风判定操作。The judging module is configured to: when the mobile terminal enters the call mode, determine, by using a voice path, whether the call mode of the mobile terminal is a hands-free call mode, a handheld call mode, or a headset call mode, if it is determined to be a handheld call mode or a headset In the call mode, the voice call is directly performed, and if it is determined to be the hands-free call mode, the primary and secondary microphone determination operations are started.
- 如权利要求5所述的装置,其中,所述获取模块是设置为:The apparatus of claim 5 wherein said obtaining module is configured to:分别将两个麦克风采样的采集数据通过带通滤波器滤除高频噪声,并对滤波后的采集数据进行快速傅里叶变换FFT,计算出分别对应于两个麦克风的两组语音频谱;The collected data of the two microphone samples are respectively filtered by the band pass filter to remove the high frequency noise, and the filtered collected data is subjected to fast Fourier transform FFT to calculate two sets of speech spectra respectively corresponding to the two microphones;计算所述两组音频频谱的功率谱数据,并进行频域加权,在功率谱数据累计达到预定数量的帧数后进行快速傅里叶逆变换IFFT,获取自相关函数;Calculating power spectrum data of the two sets of audio spectrums, and performing frequency domain weighting, performing inverse fast Fourier transform IFFT after the power spectrum data is accumulated to a predetermined number of frames, and obtaining an autocorrelation function;基于计算的自相关函数,根据公式1计算两个麦克风所采集数据的时延:Based on the calculated autocorrelation function, calculate the delay of the data collected by the two microphones according to Equation 1:R12(τ)=E[x1(kT)x2(kT-τ)]=E[s(kT-τ1)s(kT-τ1-τ)]=Rss(τ-(τ1-τ2)) 公式1;R 12 (τ)=E[x 1 (kT)x 2 (kT-τ)]=E[s(kT-τ 1 )s(kT-τ 1 -τ)]=R ss (τ-(τ 1 -τ 2 )) Formula 1;其中,R12(τ)的最大值对应的τ为两个麦克风之间的时延τ12,x1(kT)=s(kT-τ1)+n1(kT),x2(kT)=s(kT-τ2)+n2(kT),s(kT)为声源信号,n1(kT)为第一麦克风的背景噪声,n2(kT)为第二麦克风的背景噪声,τ1和τ2分别是声波从声源到第一麦克风和第二麦克风的传播时间,τ12=τ1-τ2为两个麦克风之间所采集数据的时延,E[]表示x1(kT)和x2(kT)之间的自相关函数。Where τ corresponds to the maximum value of R 12 (τ) is the time delay τ 12 between the two microphones, x 1 (kT)=s(kT-τ 1 )+n 1 (kT), x 2 (kT) =s(kT-τ 2 )+n 2 (kT), s(kT) is the sound source signal, n 1 (kT) is the background noise of the first microphone, and n 2 (kT) is the background noise of the second microphone. τ 1 and τ 2 are the propagation times of sound waves from the sound source to the first microphone and the second microphone, respectively, τ 12 = τ 1 - τ 2 is the time delay of the data collected between the two microphones, and E[] represents x 1 The autocorrelation function between (kT) and x 2 (kT).
- 如权利要求8所述的装置,其中,所述确定模块是设置为:The apparatus of claim 8 wherein said determining module is configured to:根据公式2计算以麦克风阵列为参考坐标时所述声源的仰角 Calculating the elevation angle of the sound source when the microphone array is used as a reference coordinate according to Formula 2其中,a为两个麦克风之间的距离,τ为两个麦克风所采集数据的时延,c为声速,d为声程差;Where a is the distance between two microphones, τ is the delay of the data collected by the two microphones, c is the speed of sound, and d is the difference in sound path;
- 如权利要求9所述的装置,其中,所述设置模块是设置为:The apparatus of claim 9 wherein said setting module is configured to:当声源的仰角时,确定位于移动终端底端的麦克风距离声源较近,当声源的仰角时,确定位于移动终端顶端的麦克风距离声源较近;When the elevation angle of the sound source When determining that the microphone at the bottom of the mobile terminal is closer to the sound source, when the elevation angle of the sound source When it is determined that the microphone located at the top of the mobile terminal is closer to the sound source;将距离所述声源较近的麦克风设置为主麦克风,将另一麦克风设置为副麦克风。A microphone that is closer to the sound source is set as the primary microphone and another microphone is set as the secondary microphone.
- 一种计算机可读存储介质,存储有程序指令,当该程序指令被执行时可实现权利要求1-5任一项所述的方法。 A computer readable storage medium storing program instructions that, when executed, can implement the method of any of claims 1-5.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410674724.4A CN105611014A (en) | 2014-11-21 | 2014-11-21 | Method and device for mobile terminal call voice noise reduction |
CN201410674724.4 | 2014-11-21 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015184893A1 true WO2015184893A1 (en) | 2015-12-10 |
Family
ID=54766117
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2015/074770 WO2015184893A1 (en) | 2014-11-21 | 2015-03-20 | Mobile terminal call voice noise reduction method and device |
PCT/CN2015/079214 WO2016078369A1 (en) | 2014-11-21 | 2015-05-18 | Mobile terminal conversation voice noise reduction method and apparatus and storage medium |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2015/079214 WO2016078369A1 (en) | 2014-11-21 | 2015-05-18 | Mobile terminal conversation voice noise reduction method and apparatus and storage medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN105611014A (en) |
WO (2) | WO2015184893A1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105872898A (en) * | 2016-04-12 | 2016-08-17 | 北京奇虎科技有限公司 | Noise reduction processing method and apparatus based on double microphones |
CN107592600A (en) * | 2016-07-06 | 2018-01-16 | 深圳市三诺声智联股份有限公司 | A kind of pickup screening technique and sound pick up equipment based on distributed microphone |
CN109087648A (en) * | 2018-08-21 | 2018-12-25 | 平安科技(深圳)有限公司 | Sales counter voice monitoring method, device, computer equipment and storage medium |
WO2022143119A1 (en) * | 2020-12-29 | 2022-07-07 | 华为技术有限公司 | Sound collection method, electronic device, and system |
CN117768816A (en) * | 2023-11-15 | 2024-03-26 | 兴科迪科技(泰州)有限公司 | Method and device for realizing sound collection based on small-size PCBA |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107181845A (en) * | 2016-03-10 | 2017-09-19 | 中兴通讯股份有限公司 | A kind of microphone determines method and terminal |
CN106453835B (en) * | 2016-09-09 | 2019-10-22 | 深圳市金立通信设备有限公司 | A kind of method and terminal switching answering mode |
CN107566953A (en) * | 2016-12-12 | 2018-01-09 | 北京数科技有限公司 | The switching method and device of dual microphone |
CN106941549A (en) * | 2017-04-28 | 2017-07-11 | 苏州科技大学 | The communication device for mobile phone and its processing method of a kind of dual microphone noise reduction |
CN107979790A (en) * | 2017-11-28 | 2018-05-01 | 上海与德科技有限公司 | One kind call noise-reduction method, device, equipment and medium |
CN107948857B (en) * | 2017-12-19 | 2021-07-16 | 联想(北京)有限公司 | Sound processing method and electronic equipment |
CN110166879B (en) | 2019-06-28 | 2020-11-13 | 歌尔科技有限公司 | Voice acquisition control method and device and TWS earphone |
CN111510903B (en) * | 2020-04-27 | 2023-06-09 | 广州市一横电子有限公司 | Microphone and mobile terminal interaction method, storage medium and microphone intelligent device |
CN113726947B (en) * | 2020-05-26 | 2022-09-09 | Oppo广东移动通信有限公司 | Voice communication method, device, terminal and storage medium |
CN112261201B (en) * | 2020-10-20 | 2022-08-05 | Oppo广东移动通信有限公司 | Call method, device, mobile terminal and storage medium |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050239516A1 (en) * | 2004-04-27 | 2005-10-27 | Clarity Technologies, Inc. | Multi-microphone system for a handheld device |
CN101771923A (en) * | 2009-01-07 | 2010-07-07 | 王青云 | Sound source positioning method for glasses type digital hearing aid |
CN102165521A (en) * | 2008-09-30 | 2011-08-24 | 苹果公司 | Multiple microphone switching and configuration |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102033223B (en) * | 2010-12-29 | 2012-10-03 | 北京信息科技大学 | Method for positioning sound source by using microphone array |
CN103219012B (en) * | 2013-04-23 | 2015-05-13 | 中国人民解放军总后勤部军需装备研究所 | Double-microphone noise elimination method and device based on sound source distance |
CN104270489A (en) * | 2014-09-10 | 2015-01-07 | 中兴通讯股份有限公司 | Method and system for determining main microphone and auxiliary microphone from multiple microphones |
-
2014
- 2014-11-21 CN CN201410674724.4A patent/CN105611014A/en active Pending
-
2015
- 2015-03-20 WO PCT/CN2015/074770 patent/WO2015184893A1/en active Application Filing
- 2015-05-18 WO PCT/CN2015/079214 patent/WO2016078369A1/en active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050239516A1 (en) * | 2004-04-27 | 2005-10-27 | Clarity Technologies, Inc. | Multi-microphone system for a handheld device |
CN102165521A (en) * | 2008-09-30 | 2011-08-24 | 苹果公司 | Multiple microphone switching and configuration |
CN101771923A (en) * | 2009-01-07 | 2010-07-07 | 王青云 | Sound source positioning method for glasses type digital hearing aid |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105872898A (en) * | 2016-04-12 | 2016-08-17 | 北京奇虎科技有限公司 | Noise reduction processing method and apparatus based on double microphones |
CN107592600A (en) * | 2016-07-06 | 2018-01-16 | 深圳市三诺声智联股份有限公司 | A kind of pickup screening technique and sound pick up equipment based on distributed microphone |
CN107592600B (en) * | 2016-07-06 | 2024-04-02 | 深圳市三诺声智联股份有限公司 | Pickup screening method and pickup device based on distributed microphones |
CN109087648A (en) * | 2018-08-21 | 2018-12-25 | 平安科技(深圳)有限公司 | Sales counter voice monitoring method, device, computer equipment and storage medium |
CN109087648B (en) * | 2018-08-21 | 2023-10-20 | 平安科技(深圳)有限公司 | Counter voice monitoring method and device, computer equipment and storage medium |
WO2022143119A1 (en) * | 2020-12-29 | 2022-07-07 | 华为技术有限公司 | Sound collection method, electronic device, and system |
CN117768816A (en) * | 2023-11-15 | 2024-03-26 | 兴科迪科技(泰州)有限公司 | Method and device for realizing sound collection based on small-size PCBA |
Also Published As
Publication number | Publication date |
---|---|
WO2016078369A1 (en) | 2016-05-26 |
CN105611014A (en) | 2016-05-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2015184893A1 (en) | Mobile terminal call voice noise reduction method and device | |
KR101337695B1 (en) | Microphone array subset selection for robust noise reduction | |
CN111418010B (en) | Multi-microphone noise reduction method and device and terminal equipment | |
US10269369B2 (en) | System and method of noise reduction for a mobile device | |
EP2966841B1 (en) | Communication device and method for adapting to audio accessories | |
JP6400566B2 (en) | System and method for displaying a user interface | |
JP6505252B2 (en) | Method and apparatus for processing audio signals | |
CN109845288B (en) | Method and apparatus for output signal equalization between microphones | |
KR101340215B1 (en) | Systems, methods, apparatus, and computer-readable media for dereverberation of multichannel signal | |
TWI435318B (en) | Method, apparatus, and computer readable medium for speech enhancement using multiple microphones on multiple devices | |
US9489963B2 (en) | Correlation-based two microphone algorithm for noise reduction in reverberation | |
WO2017152601A1 (en) | Microphone determination method and terminal | |
US20140270231A1 (en) | System and method of mixing accelerometer and microphone signals to improve voice quality in a mobile device | |
US20140219471A1 (en) | User voice location estimation for adjusting portable device beamforming settings | |
WO2014101429A1 (en) | Noise reduction method and device for bi-microphone of terminal | |
US10978086B2 (en) | Echo cancellation using a subset of multiple microphones as reference channels | |
KR20120027510A (en) | Systems, methods, apparatus, and computer-readable media for phase-based processing of multichannel signal | |
US20140037100A1 (en) | Multi-microphone noise reduction using enhanced reference noise signal | |
KR20110099269A (en) | Methods and apparatus for suppressing ambient noise using multiple audio signals | |
US11380312B1 (en) | Residual echo suppression for keyword detection | |
TWI506620B (en) | Communication apparatus and voice processing method therefor | |
US20140341386A1 (en) | Noise reduction | |
US20140365212A1 (en) | Receiver Intelligibility Enhancement System | |
WO2015184828A1 (en) | Terminal having plurality of mics, mic setting method therefor and sound quality enhancement method | |
WO2019112467A1 (en) | Method and apparatus for acoustic echo cancellation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15803648 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15803648 Country of ref document: EP Kind code of ref document: A1 |