CN105679300A - Mobile terminal and noise reduction method - Google Patents
Mobile terminal and noise reduction method Download PDFInfo
- Publication number
- CN105679300A CN105679300A CN201511017236.7A CN201511017236A CN105679300A CN 105679300 A CN105679300 A CN 105679300A CN 201511017236 A CN201511017236 A CN 201511017236A CN 105679300 A CN105679300 A CN 105679300A
- Authority
- CN
- China
- Prior art keywords
- signal
- noise
- mobile terminal
- noisemaker
- sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1783—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase handling or detecting of non-standard events or conditions, e.g. changing operating modes under specific operating conditions
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1787—General system configurations
- G10K11/17873—General system configurations using a reference signal without an error signal, e.g. pure feedforward
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1787—General system configurations
- G10K11/17885—General system configurations additionally using a desired external signal, e.g. pass-through audio such as music or speech
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/18—Methods or devices for transmitting, conducting or directing sound
- G10K11/20—Reflecting arrangements
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Telephone Function (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The invention discloses a mobile terminal. The mobile terminal includes a first acquisition module, a second acquisition module, a determination module and a noise reduction module, wherein the first acquisition module is used for acquiring audio signals and identifying a noise signal in the audio signals; the second acquisition module is used for acquiring the noise source position corresponding to the noise signal, and acquiring the position of the user; the determination module is used for determining the noise reduction signal according to the noise signal, the noise source position and the position of the user; and the noise reduction module is used for adjusting the audio signals according to the noise reduction signal to perform noise reduction on the audio signals. The invention also discloses a noise reduction method. The noise reduction method can perform active noise reduction of the audio signals, can use the mobile terminal, and can be applied to various environments.
Description
Technical field
The present invention relates to technical field of mobile terminals, particularly relate to a kind of mobile terminal and noise-reduction method.
Background technology
At present, in car in the scheme of active noise reduction, it is all utilize the microphone of vehicle intelligent equipment and auto-body assembly to carry out data transmission, the algorithm on vehicle intelligent equipment and calculation resources (CPU, internal memory etc.) is utilized to carry out calculating and reverse sound wave superposition broadcasting, algorithm and arithmetic capability to mobile unit require very high, at present only vehicle-mounted in the high-end vehicle of part has this ability, the vehicle-mounted of major part low and middle-end automobile outfit does not have noise reduction algorithm and corresponding arithmetic capability, cannot realize active noise reduction in car.
Summary of the invention
The main purpose of the present invention is to propose a kind of mobile terminal and noise-reduction method, it is intended to utilize mobile terminal to realize active noise reduction.
For achieving the above object, a kind of mobile terminal provided by the invention, described mobile terminal comprises:
First acquisition module, for obtaining sound signal, and identifies the noise signal in described sound signal;
2nd acquisition module, for obtaining noisemaker position corresponding to described noise signal, and obtains user position;
Determination module, for determining de-noising signal according to described noise signal, described noisemaker position and user position;
Noise reduction module, for adjusting described sound signal according to described de-noising signal, makes an uproar described sound signal to be fallen.
Preferably, described 2nd acquisition module is also for obtaining noisemaker position corresponding to described noise signal, and obtains the position of user position and sound equipment;
Described determination module is also for determining de-noising signal according to the position of described noise signal, described noisemaker position, user position and described sound equipment;
Described noise reduction module is also play for described de-noising signal is sent to described sound equipment, makes an uproar described sound signal to be fallen.
Preferably, described 2nd acquisition module comprises:
Acquiring unit, poor for the phase differential and acoustic pressure obtaining the corresponding waveform of described noise signal;
Calculate unit, for calculating the three-dimensional space position of noisemaker corresponding to described noise signal relative to described mobile terminal according to described phase differential and acoustic pressure difference, and obtain the three-dimensional space position of the relatively described mobile terminal of user.
Preferably, described determination module comprises:
Determining unit, for calculating time delay corresponding to described noise signal according to the three-dimensional space position of described noisemaker described mobile terminal relative to user;
Generate unit, for generating the de-noising signal anti-phase with described noise signal according to described time delay.
Preferably, described first acquisition module is also for receiving the sound signal that automobile sends, and identifies the noise signal in described sound signal.
, for achieving the above object, in addition the present invention also provides a kind of noise-reduction method, and described method is applied to mobile terminal, and described method comprises the following steps:
Obtain sound signal, and identify the noise signal in described sound signal;
Obtain the noisemaker position that described noise signal is corresponding, and obtain user position;
De-noising signal is determined according to described noise signal, described noisemaker position and user position;
Adjust described sound signal according to described de-noising signal, make an uproar so that described sound signal is fallen.
Preferably, the noisemaker position that described acquisition described noise signal is corresponding, and the step obtaining user position comprises:
Obtain the noisemaker position that described noise signal is corresponding, and obtain the position of user position and sound equipment;
Described determine that the step of de-noising signal comprises according to described noise signal, described noisemaker position and user position:
De-noising signal is determined in position according to described noise signal, described noisemaker position, user position and described sound equipment;
Described adjust described sound signal according to described de-noising signal, comprise described sound signal to be fallen the step made an uproar:
Described de-noising signal is sent to described sound equipment play, makes an uproar so that described sound signal is fallen.
Preferably, the noisemaker position that described acquisition described noise signal is corresponding, and the step obtaining user position comprises:
The phase differential and the acoustic pressure that obtain the corresponding waveform of described noise signal are poor;
Calculate the three-dimensional space position of noisemaker corresponding to described noise signal relative to described mobile terminal according to described phase differential and acoustic pressure difference, and obtain the three-dimensional space position of the relatively described mobile terminal of user.
Preferably, described determine that the step of de-noising signal comprises according to described noise signal, described noisemaker position and user position:
Three-dimensional space position according to described noisemaker described mobile terminal relative to user calculates time delay corresponding to described noise signal;
The de-noising signal anti-phase with described noise signal is generated according to described time delay.
Preferably, described acquisition sound signal, and the step identifying the noise signal in described sound signal also comprises:
Receive the sound signal that automobile sends, and identify the noise signal in described sound signal.
Mobile terminal of the present invention comprises the first acquisition module, for obtaining sound signal, and identifies the noise signal in described sound signal; 2nd acquisition module, for obtaining noisemaker position corresponding to described noise signal, and obtains user position; Determination module, for determining de-noising signal according to described noise signal, described noisemaker position and user position; Noise reduction module, for adjusting described sound signal according to described de-noising signal, makes an uproar described sound signal to be fallen. By the way, the present invention utilizes the resource of mobile terminal, determines de-noising signal according to the sound signal obtained, noisemaker position and user position, it is achieved sound signal is carried out active noise reduction, user can be ensured not by the puzzlement of noise, and use mobile terminal can be suitable for multiple environment.
Accompanying drawing explanation
Fig. 1 is the hardware architecture diagram of the preferred mobile terminal realizing each embodiment of the present invention;
Fig. 2 is the electrical structure block diagram of camera in Fig. 1;
Fig. 3 is the high-level schematic functional block diagram of mobile terminal first embodiment of the present invention;
Fig. 4 is that in the embodiment of the present invention, in mobile terminal, microphone array arranges schematic diagram;
Fig. 5 is a kind of schematic diagram applying scene in the embodiment of the present invention;
Fig. 6 is a kind of high-level schematic functional block diagram of the 2nd acquisition module in the embodiment of the present invention;
Fig. 7 is a kind of high-level schematic functional block diagram of determination module in the embodiment of the present invention;
Fig. 8 is the schematic flow sheet of noise-reduction method first embodiment of the present invention;
Fig. 9 obtains noisemaker position corresponding to described noise signal in the embodiment of the present invention, and obtains a kind of schematic flow sheet of user position;
Figure 10 is a kind of schematic flow sheet determining de-noising signal in the embodiment of the present invention according to described noise signal, described noisemaker position and user position;
Figure 11 is the schematic flow sheet of noise-reduction method of the present invention 2nd embodiment.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Embodiment
It is to be understood that specific embodiment described herein is only in order to explain the present invention, it is not intended to limit the present invention.
The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing. In follow-up description, it may also be useful to for representing that the suffix of such as " module ", " parts " or " unit " of element is only in order to be conducive to the explanation of the present invention, itself is specific meaning not. Therefore, " module " and " parts " can mixedly use.
Mobile terminal can be implemented in a variety of manners. Such as, the terminal described in the present invention can comprise the mobile terminal of such as mobile telephone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP (portable media player), Nvgtl aids etc. and the fixed terminal of such as numeral TV, desk-top computer etc. Below, it is assumed that terminal is mobile terminal. But, skilled person will appreciate that, except being used in particular for the element of mobile object, structure according to the embodiment of the present invention also can be applied to the terminal of fixed type.
Fig. 1 is the hardware structure signal of the preferred mobile terminal realizing each embodiment of the present invention.
Mobile terminal 100 can comprise wireless communication unit 110, A/V (audio/video) inputs unit 120, user input unit 130, output unit 150, storer 160, controller 180 and power subsystem 190 etc. Fig. 1 shows the mobile terminal with various assembly, but it is understood that do not require to implement all assemblies illustrated. Can alternatively implement more or less assembly. Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assembly, and it allows the wireless communication between mobile terminal 100 and radio communication device or network. Such as, wireless communication unit can comprise mobile communication module 112, wireless Internet module 113 and communicates with short distance at least one in module 114.
Mobile communication module 112 such as, tick is sent in base station (access point, Node B etc.), exterior terminal and server at least one and/or from its receive tick. Various types of data that such tick can comprise voice call signal, video speech signal or send according to text and/or multi-media message and/or receive.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal. This module can be couple to terminal innerly or outside. Wi-Fi (Wireless Internet Access) technology involved by this module can comprise WLAN (WLAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high-speed downlink packet access) etc.
Short distance communication module 114 is the module for supporting short distance to communicate. Some examples of short-range communication technology comprise bluetoothTM, RF identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybeeTMEtc..
A/V inputs unit 120 for receiving audio or video signal. A/V inputs unit 120 can comprise camera 121 and microphone 122, and the view data of the static images obtained by image capture apparatus in Video Capture pattern or image capture mode or video is processed by camera 121. Image frame after process may be displayed on display unit 151. Image frame after camera 121 processes can be stored in and send in storer 160 (or other storage media) or via wireless communication unit 110, it is possible to provide two or more cameras 121 according to the structure of mobile terminal. Such acoustic processing can via microphones sound (audio frequency data) in phone call mode, record pattern, speech recognition pattern etc. operational mode, and can be audio frequency data by microphone 122. Audio frequency (voice) data after process can be converted to the formatted output that can be sent to mobile communication base station via mobile communication module 112 when phone call mode. Microphone 122 can implement various types of noise elimination (or suppression) algorithm to eliminate noise or the interference of (or suppression) generation in the process receiving and sending sound signal.
User input unit 130 can generate key input data to control the various operations of mobile terminal according to the order of user's input. User input unit 130 allows user to input various types of information, and can comprise keyboard, the young sheet of pot, touch pad (such as, detect cause owing to being touched resistance, pressure, electric capacity etc. the sensitive component of change), roller, rocking bar etc. Especially, when touch pad is superimposed upon on display unit 151 as a layer, it is possible to form touch-screen.
In addition, when mobile terminal 100 is connected with external base, interface unit 170 can be used as to allow by it from base, electric power be provided to the path of mobile terminal 100 or can be used as to allow the various command signals from base input be transferred to the path of mobile terminal by it. The signal identifying whether mobile terminal is arranged on base accurately can be used as from the various command signal of base input or electric power. Such as, output unit 150 is constructed to provide output signal (sound signal, vision signal, warning signal, vibration signal etc.) with vision, audio frequency and/or tactile manner. Output unit 150 can comprise display unit 151, dio Output Modules 152, alarm unit 153 etc.
Display unit 151 may be displayed on the information of process in mobile terminal 100. Such as, when mobile terminal 100 is in phone call mode, such as, display unit 151 can show communicate with call or other (text messaging, multimedia file download etc.) relevant user interface (UI) or graphic user interface (GUI). When being in video call mode or image capture mode when mobile terminal 100, display unit 151 can the image of display capture and/or reception image, video is shown or UI or GUI of image and correlation function etc.
Meanwhile, when superposition is to form touch-screen each other as a layer for display unit 151 and touch pad, display unit 151 can be used as input unit and take-off equipment. Display unit 151 can comprise at least one in liquid-crystal display (LCD), thin film transistor LCD (TFT-LCD), Organic Light Emitting Diode (OLED) indicating meter, flexible display, three-dimensional (3D) indicating meter etc. Some in these indicating meters can be constructed to transparent shape, and to allow, user watches from outside, and this can be called transparent display, and typical transparent display can be such as TOLED (transparent organic light emitting diode) indicating meter etc. According to the specific enforcement mode wanted, mobile terminal 100 can comprise two or more display units (or other display unit), such as, mobile terminal can comprise outernal display unit (not shown) and inner display unit (not shown). Touch-screen can be used for detection touch input pressure and touch input position and touch and inputs area.
Dio Output Modules 152 can when mobile terminal be under call signal receiving mode, call mode, record pattern, speech recognition pattern, the broadcast isotype such as receiving mode, audio frequency data convert audio signals that is that wireless communication unit 110 is received or that store in storer 160 and to export be sound. And, such as, the audio frequency that the specific function that dio Output Modules 152 can provide to mobile terminal 100 performs is relevant exports (call signal receives sound, message reception sound etc.). Dio Output Modules 152 can comprise sound pick-up, hummer etc.
Software program that storer 160 can store the process performed by controller 180 and control operates etc., or can temporarily store data that oneself maybe will export through exporting (such as, telephone book, message, static image, video etc.). And, storer 160 can store about the vibration of various modes exported when touching and be applied to touch-screen and the data of sound signal.
Storer 160 can comprise the storage media of at least one type, such as, described storage media comprises flash memory, hard disk, multi-media card, card-type storer (SD or DX storer etc.), accesses storer (RAM), static random-access memory (SRAM), read-only storage (ROM), electrically erasable read-only storage (EEPROM), programmable read only memory (PROM), magnetic storage device, disk, CD etc. at random. And, mobile terminal 100 can be connected the network storage device cooperation of the storage function performing storer 160 with by network.
Controller 180 controls the overall operation of mobile terminal usually. Such as, controller 180 performs and voice call, data corresponding, video call etc. relevant control and process. Controller 180 can pattern recognition process, and is identified as character or image so that the handwriting input performed on the touchscreen or picture are drawn input.
Power subsystem 190 receives external power or internal power under the control of controller 180 and offer operates the suitable electric power needed for each element and assembly.
Various enforcement mode described herein can to use the computer-readable medium of such as computer software, hardware or its any combination to implement. Hardware is implemented, enforcement mode described herein can be implemented with the use of specific end use unicircuit (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field-programmable gate array (FPGA), treater, controller, microcontroller, microprocessor, at least one that is designed to perform in the electronic unit of function described herein, in some cases, such enforcement mode can be implemented in controller 180.For implement software, the enforcement mode of such as process or function can be implemented with allowing the independent software module performing at least one function or operation. Software code can be implemented by the software application (or program) write with any suitable programming language, and software code can be stored in storer 160 and perform by controller 180.
So far, oneself is through the mobile terminal according to its functional description. Below, for the sake of brevity, by the slide type mobile terminal in the various types of mobile terminals describing such as folding type, straight-plate type, oscillating-type, slide type mobile terminal etc. exemplarily. Therefore, the present invention can be applied to the mobile terminal of any type, and is not limited to slide type mobile terminal.
With reference to the electrical structure block diagram that Fig. 2, Fig. 2 are camera in Fig. 1.
Photography camera lens 1211 is made up of the multiple optical lens for the formation of shot object image, is single-focus lens or zoom lens. Photography camera lens 1211 can move in the direction of the optical axis under the control of lens driver 1221, lens driver 1221 is according to the control signal from lens driving pilot circuit 1222, the focus position of control photography camera lens 1211, when zoom lens, it is possible to control focus distance. Lens driving pilot circuit 1222 carries out the drived control of lens driver 1221 according to the control command from minicomputer 1217.
Shooting element 1212 it is configured with near the position of the shot object image formed on the optical axis of photography camera lens 1211, by photography camera lens 1211. Shooting element 1212 for being made a video recording by shot object image and obtains image data. Making a video recording two-dimentional on element 1212 and it is being arranged in a matrix the photorectifier forming each pixel. Each photorectifier produces the opto-electronic conversion electric current corresponding with by light quantity, and this opto-electronic conversion electric current carries out electric charge accumulation by the electrical condenser being connected with each photorectifier. The front surface of each pixel is configured with the RGB colour filter of Bayer arrangement.
Shooting element 1212 is connected with imaging circuit 1213, this imaging circuit 1213 carries out electric charge accumulation control in shooting element 1212 and figure image signal reads control, the figure image signal (analog picture signal) of this reading is reduced and after resetting noise, carries out wave shaping, and then carry out gain raising etc. to become suitable signal level. Imaging circuit 1213 is connected with A/D converter 1214, and analog picture signal is carried out analog to digital conversion by this A/D converter 1214, to bus 1227 output digital image signal (hereinafter referred to as view data).
Bus 1227 is the transmission path of the various data that the inside for being transmitted in camera reads or generates. Above-mentioned A/D converter 1214 is connected in bus 1227, connect image procossing device 1215, jpeg processor 1216, minicomputer 1217, SDRAM (SynchronousDynamicrandomaccessmemory in addition, synchronous dynamic random-access internal memory) 1218, storer interface (hereinafter referred to as memory I/F) 1219, LCD (LiquidCrystalDisplay, liquid-crystal display) driving mechanism 1220.
The view data of the output based on shooting element 1212 is carried out OB and subtracts each other the various image procossing such as process, blank level adjustment, color matrix computing, gamma conversion, aberration signal processing, noise removal process, change process simultaneously, Edge Finish by image procossing device 1215. Jpeg processor 1216, when by Imagery Data Recording in recording medium 1225, compresses the view data read from SDRAM1218 according to JPEG compression mode.In addition, jpeg processor 1216 carries out the decompression of jpeg image data to carry out image to reproduce display. When decompressing, read the file being recorded in recording medium 1225, after implementing decompression in jpeg processor 1216, the view data of decompression is temporarily stored in SDRAM1218 and shows on LCD1226. H.264 in addition, in the present embodiment, what adopt as compression of images decompression mode is JPEG mode, but compressed and decompressed mode is not limited to this, it is of course possible to adopt MPEG, TIFF, other the compressed and decompressed mode such as.
Minicomputer 1217 plays the function in the control portion as this camera entirety, the various process sequences of unified control camera. Minicomputer 1217 connects operation unit 1223 and flash memory 1224.
Operation unit 1223 includes but not limited to physical button or virtual key, this entity or virtual key can be the operational controls such as various input button and various input keys such as power knob, key of taking pictures, edit key, dynamically image button, reproduction button, menu button, cross key, OK button, deletion button, amplification button, detect the operational stage of these operational controls.
Detected result is exported to minicomputer 1217. In addition, the front surface at the LCD1226 as indicating meter is provided with touch panel, and the touch location of detection user, exports this touch location to minicomputer 1217. Minicomputer 1217, according to the detected result of the work point from operation unit 1223, performs the various process sequences corresponding with the operation of user.
Flash memory 1224 stores the program of the various process sequences for performing minicomputer 1217. Minicomputer 1217 carries out the control of camera entirety according to this program. In addition, flash memory 1224 stores the various adjusted values of camera, and minicomputer 1217 reads adjusted value, carries out the control of camera according to this adjusted value.
SDRAM1218 is can the volatile memory rewritten of electricity for what view data etc. carried out temporarily storage. This SDRAM1218 temporarily stores the view data from A/D converter 1214 output and has carried out the view data after processing image procossing device 1215, jpeg processor 1216 etc.
Storer interface 1219 is connected with recording medium 1225, carries out the control of view data and the first-class data write recording medium 1225 of file being attached in view data and reading from recording medium 1225. Recording medium 1225 be such as can on camera main-body the recording medium such as storer card of disassembled and assembled freely, but be not limited to this, it is also possible to be the hard disk etc. being built in camera main-body.
Lcd driver 1210 is connected with LCD1226, it is stored in SDRAM1218 by the view data after image procossing device 1215 processes, when needing display, read the view data that SDRAM1218 stores also to show on LCD1226, or, the compressed view data of jpeg processor 1216 is stored in SDRAM1218, when needs show, jpeg processor 1216 reads the compressed view data of SDRAM1218, then decompresses, and the view data after decompressing is shown by LCD1226.
The back side that LCD1226 is configured in camera main-body carries out image display. This LCD1226LCD), but it is not limited to this, it is also possible to adopt the various display panels (LCD1226) such as organic EL, but it is not limited to this, it is also possible to adopt the various display panels such as organic EL.
Based on the electrical structure schematic diagram of above-mentioned mobile terminal hardware structure and camera, it is proposed to apparatus of the present invention and each embodiment of method.
The present invention provides a kind of mobile terminal.
With reference to Fig. 3, Fig. 3 be mobile terminal first embodiment of the present invention high-level schematic functional block diagram in the present embodiment, this mobile terminal comprises:
First acquisition module 10, for obtaining sound signal, and identifies the noise signal in described sound signal.
The present invention is mainly used in mobile terminal, mobile terminal comprises the electronics that smart mobile phone, pad etc. can carry out calculating, described mobile equipment at least assembles following device: controller 180 as shown in Figure 1, certainly can also comprise one or several combinations in wireless communication unit 110, A/V input unit 120, user input unit 130, output unit 150 etc. in embody rule scene. The present invention will be described to apply scene for two kinds:
Scene one, to carrying out active noise reduction in room:
The mobile terminal being applied to this scene at least comprises: for the controller 180 in CPU or GPU that calculate and Fig. 1, camera 121 and microphone 122. Specifically, in this scene, the quantity of microphone is at least 3 suitable positions being separately positioned on mobile terminal, such as lays respectively at the two ends of mobile terminal, as shown in Figure 4. Owing to current software can reach 0.1DBA for the accuracy of detection of sound pressure level, the accuracy of detection of phase differential can reach 0.1 degree, so during shift in position, software has stronger stability, it is not necessary to change corresponding technology. The noisemaker of this scene can by square wave the noise etc. that sends of generation noise, car horn. When user is in room, being easy to be subject to extraneous noise harassing and wrecking, as shown in Figure 5, now user can be operated by user input unit on mobile terminal, starts active noise reduction function.
By opening microphone on mobile terminal in this scene, receive extraneous sound, obtain sound signal, extraneous sound comprises noise and effective sound, mobile terminal is when obtaining described sound signal, signal in described sound signal is carried out Classification and Identification and goes out noise signal in described sound signal, specifically, detect algorithm according to general noise and distinguish extraneous noise, such as the noise etc. produced is waved on square, certainly the effective sound in described sound signal can also be identified, such as voice etc., if the noise in the external world has multiple, then can sort out according to noise spectrum sequence, extract one by one, power such as the frequency component of white Gaussian noise is all uniform in whole audible range (0~20KHZ), and the energy of pink noise is constantly decayed from low frequency to high frequency, curve is 1/f, it is generally every 8 degree of declines 3 decibels, the frequency component power of brown noise mainly concentrates on low-frequency range. its energy downcurve is 1/f^2, and its waveform is unusual self similarity.
Scene two, to carrying out active noise reduction in car:
In car, motor car engine noise is overriding noise source during main running car, in this scene, mobile terminal at least can comprise the controller 180 in CPU or GPU for calculating and Fig. 1 and at least one in wireless communication unit 110, specifically, the present embodiment comprises short distance communication module 114, such as bluetooth or wifi. In this scene, automobile at least comprises the microphone array arranged in the car, and the quantity of described microphone is at least 3. Owing to the velocity of propagation of sound is than very fast, the position that the multiple microphones arranged in the car are separated by can be distant, much larger than the microphone array arranged on mobile terminals, automobile is arranged the result that the data that microphone array records carry out calculating can carry out calculating the resultant error obtained than the data obtained by microphone on mobile terminal can be little.
Now, the first acquisition module 10 may be used for receiving the sound signal of automobile transmission, and identifies the noise signal in described sound signal.
By the microphones that arranges in automobile after described sound signal, described sound signal is sent to described mobile terminal, specifically, it is sent to described mobile terminal by bluetooth or wifi, concrete enforcement can also be sent to described mobile terminal by communication operation business. Described mobile terminal receives the sound signal that automobile sends, and identifies the noise signal in described sound signal.
It should be noted that carrying out active noise reduction in car can also obtain described sound signal by the microphone array on described mobile terminal.
2nd acquisition module 20, for obtaining noisemaker position corresponding to described noise signal, and obtains user position.
When identifying noise signal in described sound signal according to the first acquisition module 10, the noisemaker position that noise signal according to described noise signal acquisition is corresponding.
Specifically, with reference to Fig. 6, the 2nd acquisition module 20 comprises:
Acquiring unit 21, poor for the phase differential and acoustic pressure obtaining the corresponding waveform of described noise signal.
Calculate unit 22, for calculating the three-dimensional space position of noisemaker corresponding to described noise signal relative to described mobile terminal according to described phase differential and acoustic pressure difference, and obtain the three-dimensional space position of the relatively described mobile terminal of user.
Phase differential harmony pressure reduction according to the corresponding waveform of noise signal described in the described noise signal acquisition that microphone obtains, poor by the phase differential of microphone array typing waveform and acoustic pressure, calculating noise sound source is relative to the three-dimensional space position of terminal. Owing to there is position difference with sound source in each typing waveform, square being inversely proportional to of sound pressure level intensity and distance, phase differential is then relevant with reception time delay, subtracted each other by each typing waveform, obtain phase differential harmony pressure reduction, according to the speed formula that sound wave is propagated in atmosphere, can be regarded as out sound source to the positional distance of each MIC, find intersection point by drawing circle, can judge that current sound source is arranged in the particular location in space relative to terminal.
Simultaneously, can the position of consumer positioning by the way, specifically, detect algorithm VAD by voice and distinguish voice, then phase differential and acoustic pressure according to voice waveform is poor, determine the position of people, can also be by other means in concrete enforcement, find range as by dual camera positioning distance measuring in mobile terminal or by single camera on mobile terminal and infrared distance measurement unit matching, thus position, certainly can also by the dual camera in being arranged in automobile or room, or single camera and infrared distance measurement unit position. More enforcement can also be located by sonar.
Determination module 30, for determining de-noising signal according to described noise signal, described noisemaker position and user position.
De-noising signal is determined according to described noise signal, described noisemaker position and user position that above-mentioned module obtains, if there is multiple noise signal, then sort out according to noise spectrum, extract one by one, determining corresponding de-noising signal respectively, described de-noising signal is and described noise signal inversion compensation sound wave.
Specifically, with reference to Fig. 7, it is determined that module 30 comprises:
Determining unit 31, calculates time delay corresponding to described noise signal according to the three-dimensional space position of described noisemaker described mobile terminal relative to user;
Generate unit 32, generate the de-noising signal anti-phase with described noise signal according to described time delay.
In the present embodiment after determining described noisemaker and the user three-dimensional space position relative to described mobile terminal, calculate the time delay that the distance that noise corresponding to described noise signal reach user reaches the distance of user relative to de-noising signal described in described mobile terminal playing, namely obtain described de-noising signal and the phase differential of described noise signal. If when there is multiple noise sound source, calculate the time delay of correspondence that the distance described de-noising signal multiple relative to described mobile terminal playing that noise corresponding to multiple described noise signal reach user reaches the distance of user.
The de-noising signal anti-phase with described noise signal is generated, so that the noise that described noisemaker sends can be offset when described de-noising signal arrives user according to the time delay calculated.
Noise reduction module 40, for adjusting described sound signal according to described de-noising signal, makes an uproar described sound signal to be fallen.
According to the described de-noising signal that determination module 30 is determined, the present embodiment is play by mobile terminal, thus can superpose with the noise of the arrival user that described noisemaker sends when described mobile terminal playing arrives user with the described de-noising signal of described noise signal inversion, thus offset, reach the object fallen and make an uproar, effectively avoid the interference of noise.
Mobile terminal of the present invention comprises the first acquisition module, for obtaining sound signal, and identifies the noise signal in described sound signal; 2nd acquisition module, for obtaining noisemaker position corresponding to described noise signal, and obtains user position; Determination module, for determining de-noising signal according to described noise signal, described noisemaker position and user position; Noise reduction module, for adjusting described sound signal according to described de-noising signal, makes an uproar described sound signal to be fallen. By the way, the present invention utilizes the resource of mobile terminal, determines de-noising signal according to the sound signal obtained, noisemaker position and user position, it is achieved sound signal is carried out active noise reduction, user can be ensured not by the puzzlement of noise, and use mobile terminal can be suitable for multiple environment.
Continue to consult Fig. 3, in mobile terminal of the present invention 2nd embodiment, described mobile equipment at least assembles following device: controller 180 as shown in Figure 1, certainly can also comprise one or several combinations in wireless communication unit 110, A/V input unit 120, user input unit 130, output unit 150 etc. in embody rule scene. The present invention will be described to apply scene for two kinds:
Scene one, to carrying out active noise reduction in room:
The mobile terminal being applied to this scene at least comprises: for the controller 180 in CPU or GPU that calculate and Fig. 1 and camera 121. Specifically, in this scene, the quantity of microphone is at least 3 suitable positions being separately positioned on mobile terminal, such as lays respectively at the two ends of mobile terminal, as shown in Figure 4. Owing to current software can reach 0.1DBA for the accuracy of detection of sound pressure level, the accuracy of detection of phase differential can reach 0.1 degree, so during shift in position, software has stronger stability, it is not necessary to change corresponding technology. The noisemaker of this scene can by square wave the noise etc. that sends of generation noise, car horn. When user is in room, being easy to be subject to extraneous noise harassing and wrecking, as shown in Figure 5, now user can be operated by user input unit on mobile terminal, starts active noise reduction function.
By opening microphone on mobile terminal in this scene, receive extraneous sound, obtain sound signal, extraneous sound comprises noise and effective sound, mobile terminal is when obtaining described sound signal, signal in described sound signal is carried out Classification and Identification and goes out noise signal in described sound signal, specifically, detect algorithm according to general noise and distinguish extraneous noise, such as the noise etc. produced is waved on square, certainly the effective sound in described sound signal can also be identified, such as voice etc., if the noise in the external world has multiple, then can sort out according to noise spectrum sequence, extract one by one, power such as the frequency component of white Gaussian noise is all uniform in whole audible range (0~20KHZ), and the energy of pink noise is constantly decayed from low frequency to high frequency, curve is 1/f, it is generally every 8 degree of declines 3 decibels, the frequency component power of brown noise mainly concentrates on low-frequency range. its energy downcurve is 1/f^2, and its waveform is unusual self similarity.
Scene two, to carrying out active noise reduction in car:
In car, motor car engine noise is overriding noise source during main running car, in this scene, mobile terminal at least can comprise the controller 180 in CPU or GPU for calculating and Fig. 1 and at least one in wireless communication unit 110, specifically, the present embodiment comprises short distance communication module 114, such as bluetooth or wifi. In this scene, automobile at least comprises the microphone array arranged in the car, and the quantity of described microphone is at least 3. Owing to the velocity of propagation of sound is than very fast, the position that the multiple microphones arranged in the car are separated by can be distant, much larger than the microphone array arranged on mobile terminals, automobile is arranged the result that the data that microphone array records carry out calculating can carry out calculating the resultant error obtained than the data obtained by microphone on mobile terminal can be little.
Now, this step can comprise: receives the sound signal that automobile sends, and identifies the noise signal in described sound signal.
By the microphones that arranges in automobile after described sound signal, described sound signal is sent to described mobile terminal, specifically, it is sent to described mobile terminal by bluetooth or wifi, concrete enforcement can also be sent to described mobile terminal by communication operation business. Described mobile terminal receives the sound signal that automobile sends, and identifies the noise signal in described sound signal.
It should be noted that carrying out active noise reduction in car can also obtain described sound signal by the microphone array on described mobile terminal.
Described 2nd acquisition module 20 is also for obtaining noisemaker position corresponding to described noise signal, and obtains the position of user position and sound equipment.
When identifying noise signal in described sound signal according to step S10, the noisemaker position that noise signal according to described noise signal acquisition is corresponding.
Specifically, according to the phase differential harmony pressure reduction of the corresponding waveform of noise signal described in the described noise signal acquisition that microphone obtains, poor by the phase differential of microphone array typing waveform and acoustic pressure, calculating noise sound source is relative to the three-dimensional space position of terminal. Owing to there is position difference with sound source in each typing waveform, square being inversely proportional to of sound pressure level intensity and distance, phase differential is then relevant with reception time delay, subtracted each other by each typing waveform, obtain phase differential harmony pressure reduction, according to the speed formula that sound wave is propagated in atmosphere, can be regarded as out sound source to the positional distance of each MIC, find intersection point by drawing circle, can judge that current sound source is arranged in the particular location in space relative to terminal.
Simultaneously, can the position of consumer positioning by the way, specifically, detect algorithm VAD by voice and distinguish voice, then phase differential and acoustic pressure according to voice waveform is poor, determine the position of people, can also be by other means in concrete enforcement, find range as by dual camera positioning distance measuring in mobile terminal or by single camera on mobile terminal and infrared distance measurement unit matching, thus position, certainly can also by the dual camera in being arranged in automobile or room, or single camera and infrared distance measurement unit position. More enforcement can also be located by sonar.
With reason, play the sound of test position, record the position of the sound equipment for playing follow-up de-noising signal by the way, naturally it is also possible to the application scene in car is preset the position playing sound equipment. In concrete enforcement, user can also input the position of described sound equipment by input menu.
Described determination module 30 is also for determining de-noising signal according to the position of described noise signal, described noisemaker position, user position and described sound equipment.
De-noising signal is determined according to described noise signal, described noisemaker position and user position that above-mentioned steps obtains, if there is multiple noise signal, then sort out according to noise spectrum, extract one by one, determining corresponding de-noising signal respectively, described de-noising signal is and described noise signal inversion compensation sound wave.
Specifically, after determining described noisemaker and the user three-dimensional space position relative to described mobile terminal, calculate distance that noise corresponding to described noise signal reach user and play, relative to described sound equipment, the time delay that described de-noising signal reaches the distance of user, namely obtain sound equipment and play described de-noising signal and the phase differential of described noise signal. If when there is multiple noise sound source, calculating distance that noise corresponding to multiple described noise signal reach user and playing, relative to described sound equipment, the time delay of correspondence that multiple described de-noising signal reaches the distance of user.
The de-noising signal anti-phase with described noise signal is generated, so that the noise that described noisemaker sends can be offset when described de-noising signal arrives user according to the time delay calculated.
Described noise reduction module 40 is also play for described de-noising signal is sent to described sound equipment, makes an uproar described sound signal to be fallen.
According to the described de-noising signal that step S60 determines, described de-noising signal is sent to described sound equipment and plays, make an uproar so that described sound signal is fallen.
The present embodiment is play by sound equipment, thus play when the described de-noising signal with described noise signal inversion arrives user can superpose with the noise of the arrival user that described noisemaker sends at described sound equipment, thus offset, reach the object fallen and make an uproar, effectively avoid the interference of noise.
Concrete implement in consider that the electricity of mobile terminal and volume may not satisfy the demands, described sound equipment can be family expenses sound equipment in the sound equipment of automotive interior or room. Carry out falling in the scene made an uproar in car, the microphone of mobile terminal and automobile assembling is used to coordinate active noise reduction in the car carried out, utilize the noise reduction algorithm on mobile terminal and calculation resources, in real time car external environment sound is gathered, analytical calculation, therefrom identify noise, and control automobile and play reverse de-noising signal and weaken, thus reach the effect of active noise reduction, mobile terminal can adaptive various, to the calculation resources of mobile unit without requiring, meet the comfortable driving experience requirements that user is growing, hommization more.
The present invention further provides a kind of noise-reduction method.
With reference to the schematic flow sheet that Fig. 8, Fig. 8 are noise-reduction method first embodiment of the present invention.
In the present embodiment, this noise-reduction method comprises:
Step S10, obtains sound signal, and identifies the noise signal in described sound signal;
The present invention is mainly used in mobile terminal, mobile terminal comprises the electronics that smart mobile phone, pad etc. can carry out calculating, described mobile equipment at least assembles following device: controller 180 as shown in Figure 1, certainly can also comprise one or several combinations in wireless communication unit 110, A/V input unit 120, user input unit 130, output unit 150 etc. in embody rule scene. The present invention will be described to apply scene for two kinds:
Scene one, to carrying out active noise reduction in room:
The mobile terminal being applied to this scene at least comprises: for the controller 180 in CPU or GPU that calculate and Fig. 1, camera 121 and microphone 122. Specifically, in this scene, the quantity of microphone is at least 3 suitable positions being separately positioned on mobile terminal, such as lays respectively at the two ends of mobile terminal, as shown in Figure 4. Owing to current software can reach 0.1DBA for the accuracy of detection of sound pressure level, the accuracy of detection of phase differential can reach 0.1 degree, so during shift in position, software has stronger stability, it is not necessary to change corresponding technology. The noisemaker of this scene can by square wave the noise etc. that sends of generation noise, car horn. When user is in room, being easy to be subject to extraneous noise harassing and wrecking, as shown in Figure 5, now user can be operated by user input unit on mobile terminal, starts active noise reduction function.
By opening microphone on mobile terminal in this scene, receive extraneous sound, obtain sound signal, extraneous sound comprises noise and effective sound, mobile terminal is when obtaining described sound signal, signal in described sound signal is carried out Classification and Identification and goes out noise signal in described sound signal, specifically, detect algorithm according to general noise and distinguish extraneous noise, such as the noise etc. produced is waved on square, certainly the effective sound in described sound signal can also be identified, such as voice etc., if the noise in the external world has multiple, then can sort out according to noise spectrum sequence, extract one by one, power such as the frequency component of white Gaussian noise is all uniform in whole audible range (0~20KHZ), and the energy of pink noise is constantly decayed from low frequency to high frequency, curve is 1/f, it is generally every 8 degree of declines 3 decibels, the frequency component power of brown noise mainly concentrates on low-frequency range. its energy downcurve is 1/f^2, and its waveform is unusual self similarity.
Scene two, to carrying out active noise reduction in car:
In car, motor car engine noise is overriding noise source during main running car, in this scene, mobile terminal at least can comprise the controller 180 in CPU or GPU for calculating and Fig. 1 and at least one in wireless communication unit 110, specifically, the present embodiment comprises short distance communication module 114, such as bluetooth or wifi. In this scene, automobile at least comprises the microphone array arranged in the car, and the quantity of described microphone is at least 3. Owing to the velocity of propagation of sound is than very fast, the position that the multiple microphones arranged in the car are separated by can be distant, much larger than the microphone array arranged on mobile terminals, automobile is arranged the result that the data that microphone array records carry out calculating can carry out calculating the resultant error obtained than the data obtained by microphone on mobile terminal can be little.
Now, this step can comprise: receives the sound signal that automobile sends, and identifies the noise signal in described sound signal.
By the microphones that arranges in automobile after described sound signal, described sound signal is sent to described mobile terminal, specifically, it is sent to described mobile terminal by bluetooth or wifi, concrete enforcement can also be sent to described mobile terminal by communication operation business. Described mobile terminal receives the sound signal that automobile sends, and identifies the noise signal in described sound signal.
It should be noted that carrying out active noise reduction in car can also obtain described sound signal by the microphone array on described mobile terminal.
Step S20, obtains the noisemaker position that described noise signal is corresponding, and obtains user position;
When identifying noise signal in described sound signal according to step S10, the noisemaker position that noise signal according to described noise signal acquisition is corresponding.
Specifically, with reference to Fig. 9, the present embodiment obtains the noisemaker position that described noise signal is corresponding, and the process obtaining user position comprises:
Step S21, the phase differential and the acoustic pressure that obtain the corresponding waveform of described noise signal are poor;
Step S22, calculates the three-dimensional space position of noisemaker corresponding to described noise signal relative to described mobile terminal according to described phase differential and acoustic pressure difference, and obtains the three-dimensional space position of the relatively described mobile terminal of user.
Phase differential harmony pressure reduction according to the corresponding waveform of noise signal described in the described noise signal acquisition that microphone obtains, poor by the phase differential of microphone array typing waveform and acoustic pressure, calculating noise sound source is relative to the three-dimensional space position of terminal. Owing to there is position difference with sound source in each typing waveform, square being inversely proportional to of sound pressure level intensity and distance, phase differential is then relevant with reception time delay, subtracted each other by each typing waveform, obtain phase differential harmony pressure reduction, according to the speed formula that sound wave is propagated in atmosphere, can be regarded as out sound source to the positional distance of each MIC, find intersection point by drawing circle, can judge that current sound source is arranged in the particular location in space relative to terminal.
Simultaneously, can the position of consumer positioning by the way, specifically, detect algorithm VAD by voice and distinguish voice, then phase differential and acoustic pressure according to voice waveform is poor, determine the position of people, can also be by other means in concrete enforcement, find range as by dual camera positioning distance measuring in mobile terminal or by single camera on mobile terminal and infrared distance measurement unit matching, thus position, certainly can also by the dual camera in being arranged in automobile or room, or single camera and infrared distance measurement unit position. More enforcement can also be located by sonar.
Step S30, determines de-noising signal according to described noise signal, described noisemaker position and user position;
De-noising signal is determined according to described noise signal, described noisemaker position and user position that above-mentioned steps obtains, if there is multiple noise signal, then sort out according to noise spectrum, extract one by one, determining corresponding de-noising signal respectively, described de-noising signal is and described noise signal inversion compensation sound wave.
Specifically, with reference to Figure 10, according to described noise signal, described noisemaker position and user position, the present embodiment determines that the process of de-noising signal comprises:
Step S31, calculates time delay corresponding to described noise signal according to the three-dimensional space position of described noisemaker described mobile terminal relative to user;
Step S32, generates the de-noising signal anti-phase with described noise signal according to described time delay.
In the present embodiment after determining described noisemaker and the user three-dimensional space position relative to described mobile terminal, calculate the time delay that the distance that noise corresponding to described noise signal reach user reaches the distance of user relative to de-noising signal described in described mobile terminal playing, namely obtain described de-noising signal and the phase differential of described noise signal. If when there is multiple noise sound source, calculate the time delay of correspondence that the distance described de-noising signal multiple relative to described mobile terminal playing that noise corresponding to multiple described noise signal reach user reaches the distance of user.
The de-noising signal anti-phase with described noise signal is generated, so that the noise that described noisemaker sends can be offset when described de-noising signal arrives user according to the time delay calculated.
Step S40, adjusts described sound signal according to described de-noising signal, makes an uproar described sound signal to be fallen.
According to the described de-noising signal that step S30 determines, the present embodiment is play by mobile terminal, thus can superpose with the noise of the arrival user that described noisemaker sends when described mobile terminal playing arrives user with the described de-noising signal of described noise signal inversion, thus offset, reach the object fallen and make an uproar, effectively avoid the interference of noise.
Mobile terminal of the present invention comprises the first acquisition module, for obtaining sound signal, and identifies the noise signal in described sound signal; 2nd acquisition module, for obtaining noisemaker position corresponding to described noise signal, and obtains user position; Determination module, for determining de-noising signal according to described noise signal, described noisemaker position and user position; Noise reduction module, for adjusting described sound signal according to described de-noising signal, makes an uproar described sound signal to be fallen. By the way, the present invention utilizes the resource of mobile terminal, determines de-noising signal according to the sound signal obtained, noisemaker position and user position, it is achieved sound signal is carried out active noise reduction, user can be ensured not by the puzzlement of noise, and use mobile terminal can be suitable for multiple environment.
With reference to the schematic flow sheet that Figure 11, Figure 11 are noise-reduction method of the present invention 2nd embodiment.
In the present embodiment, described noise-reduction method can comprise:
Step S10, obtains sound signal, and identifies the noise signal in described sound signal;
The present invention is mainly used in mobile terminal, mobile terminal comprises the electronics that smart mobile phone, pad etc. can carry out calculating, described mobile equipment at least assembles following device: controller 180 as shown in Figure 1, certainly can also comprise one or several combinations in wireless communication unit 110, A/V input unit 120, user input unit 130, output unit 150 etc. in embody rule scene. The present invention will be described to apply scene for two kinds:
Scene one, to carrying out active noise reduction in room:
The mobile terminal being applied to this scene at least comprises: for the controller 180 in CPU or GPU that calculate and Fig. 1 and camera 121. Specifically, in this scene, the quantity of microphone is at least 3 suitable positions being separately positioned on mobile terminal, such as lays respectively at the two ends of mobile terminal, as shown in Figure 4. Owing to current software can reach 0.1DBA for the accuracy of detection of sound pressure level, the accuracy of detection of phase differential can reach 0.1 degree, so during shift in position, software has stronger stability, it is not necessary to change corresponding technology.The noisemaker of this scene can by square wave the noise etc. that sends of generation noise, car horn. When user is in room, being easy to be subject to extraneous noise harassing and wrecking, as shown in Figure 5, now user can be operated by user input unit on mobile terminal, starts active noise reduction function.
By opening microphone on mobile terminal in this scene, receive extraneous sound, obtain sound signal, extraneous sound comprises noise and effective sound, mobile terminal is when obtaining described sound signal, signal in described sound signal is carried out Classification and Identification and goes out noise signal in described sound signal, specifically, detect algorithm according to general noise and distinguish extraneous noise, such as the noise etc. produced is waved on square, certainly the effective sound in described sound signal can also be identified, such as voice etc., if the noise in the external world has multiple, then can sort out according to noise spectrum sequence, extract one by one, power such as the frequency component of white Gaussian noise is all uniform in whole audible range (0~20KHZ), and the energy of pink noise is constantly decayed from low frequency to high frequency, curve is 1/f, it is generally every 8 degree of declines 3 decibels, the frequency component power of brown noise mainly concentrates on low-frequency range. its energy downcurve is 1/f^2, and its waveform is unusual self similarity.
Scene two, to carrying out active noise reduction in car:
In car, motor car engine noise is overriding noise source during main running car, in this scene, mobile terminal at least can comprise the controller 180 in CPU or GPU for calculating and Fig. 1 and at least one in wireless communication unit 110, specifically, the present embodiment comprises short distance communication module 114, such as bluetooth or wifi. In this scene, automobile at least comprises the microphone array arranged in the car, and the quantity of described microphone is at least 3. Owing to the velocity of propagation of sound is than very fast, the position that the multiple microphones arranged in the car are separated by can be distant, much larger than the microphone array arranged on mobile terminals, automobile is arranged the result that the data that microphone array records carry out calculating can carry out calculating the resultant error obtained than the data obtained by microphone on mobile terminal can be little.
Now, this step can comprise: receives the sound signal that automobile sends, and identifies the noise signal in described sound signal.
By the microphones that arranges in automobile after described sound signal, described sound signal is sent to described mobile terminal, specifically, it is sent to described mobile terminal by bluetooth or wifi, concrete enforcement can also be sent to described mobile terminal by communication operation business. Described mobile terminal receives the sound signal that automobile sends, and identifies the noise signal in described sound signal.
It should be noted that carrying out active noise reduction in car can also obtain described sound signal by the microphone array on described mobile terminal.
Step S50, obtains the noisemaker position that described noise signal is corresponding, and obtains the position of user position and sound equipment;
When identifying noise signal in described sound signal according to step S10, the noisemaker position that noise signal according to described noise signal acquisition is corresponding.
Specifically, according to the phase differential harmony pressure reduction of the corresponding waveform of noise signal described in the described noise signal acquisition that microphone obtains, poor by the phase differential of microphone array typing waveform and acoustic pressure, calculating noise sound source is relative to the three-dimensional space position of terminal. Owing to there is position difference with sound source in each typing waveform, square being inversely proportional to of sound pressure level intensity and distance, phase differential is then relevant with reception time delay, subtracted each other by each typing waveform, obtain phase differential harmony pressure reduction, according to the speed formula that sound wave is propagated in atmosphere, can be regarded as out sound source to the positional distance of each MIC, find intersection point by drawing circle, can judge that current sound source is arranged in the particular location in space relative to terminal.
Simultaneously, can the position of consumer positioning by the way, specifically, detect algorithm VAD by voice and distinguish voice, then phase differential and acoustic pressure according to voice waveform is poor, determine the position of people, can also be by other means in concrete enforcement, find range as by dual camera positioning distance measuring in mobile terminal or by single camera on mobile terminal and infrared distance measurement unit matching, thus position, certainly can also by the dual camera in being arranged in automobile or room, or single camera and infrared distance measurement unit position. More enforcement can also be located by sonar.
With reason, play the sound of test position, record the position of the sound equipment for playing follow-up de-noising signal by the way, naturally it is also possible to the application scene in car is preset the position playing sound equipment. In concrete enforcement, user can also input the position of described sound equipment by input menu.
Step S60, determines de-noising signal according to the position of described noise signal, described noisemaker position, user position and described sound equipment;
De-noising signal is determined according to described noise signal, described noisemaker position and user position that above-mentioned steps obtains, if there is multiple noise signal, then sort out according to noise spectrum, extract one by one, determining corresponding de-noising signal respectively, described de-noising signal is and described noise signal inversion compensation sound wave.
Specifically, after determining described noisemaker and the user three-dimensional space position relative to described mobile terminal, calculate distance that noise corresponding to described noise signal reach user and play, relative to described sound equipment, the time delay that described de-noising signal reaches the distance of user, namely obtain sound equipment and play described de-noising signal and the phase differential of described noise signal. If when there is multiple noise sound source, calculating distance that noise corresponding to multiple described noise signal reach user and playing, relative to described sound equipment, the time delay of correspondence that multiple described de-noising signal reaches the distance of user.
The de-noising signal anti-phase with described noise signal is generated, so that the noise that described noisemaker sends can be offset when described de-noising signal arrives user according to the time delay calculated.
Step S70, is sent to described de-noising signal described sound equipment and plays, make an uproar described sound signal to be fallen.
According to the described de-noising signal that step S60 determines, described de-noising signal is sent to described sound equipment and plays, make an uproar so that described sound signal is fallen.
The present embodiment is play by sound equipment, thus play when the described de-noising signal with described noise signal inversion arrives user can superpose with the noise of the arrival user that described noisemaker sends at described sound equipment, thus offset, reach the object fallen and make an uproar, effectively avoid the interference of noise.
Concrete implement in consider that the electricity of mobile terminal and volume may not satisfy the demands, described sound equipment can be family expenses sound equipment in the sound equipment of automotive interior or room. Carry out falling in the scene made an uproar in car, the microphone of mobile terminal and automobile assembling is used to coordinate active noise reduction in the car carried out, utilize the noise reduction algorithm on mobile terminal and calculation resources, in real time car external environment sound is gathered, analytical calculation, therefrom identify noise, and control automobile and play reverse de-noising signal and weaken, thus reach the effect of active noise reduction, mobile terminal can adaptive various, to the calculation resources of mobile unit without requiring, meet the comfortable driving experience requirements that user is growing, hommization more.
These are only the preferred embodiments of the present invention; not thereby the patent scope of the present invention is limited; every utilize specification sheets of the present invention and accompanying drawing content to do equivalent structure or equivalence flow process conversion; or directly or indirectly it is used in other relevant technical fields, all it is included in the scope of patent protection of the present invention with reason.
Claims (10)
1. a mobile terminal, it is characterised in that, described mobile terminal comprises:
First acquisition module, for obtaining sound signal, and identifies the noise signal in described sound signal;
2nd acquisition module, for obtaining noisemaker position corresponding to described noise signal, and obtains user position;
Determination module, for determining de-noising signal according to described noise signal, described noisemaker position and user position;
Noise reduction module, for adjusting described sound signal according to described de-noising signal, makes an uproar described sound signal to be fallen.
2. mobile terminal as claimed in claim 1, it is characterised in that,
Described 2nd acquisition module is also for obtaining noisemaker position corresponding to described noise signal, and obtains the position of user position and sound equipment;
Described determination module is also for determining de-noising signal according to the position of described noise signal, described noisemaker position, user position and described sound equipment;
Described noise reduction module is also play for described de-noising signal is sent to described sound equipment, makes an uproar described sound signal to be fallen.
3. mobile terminal as claimed in claim 1, it is characterised in that, described 2nd acquisition module comprises:
Acquiring unit, poor for the phase differential and acoustic pressure obtaining the corresponding waveform of described noise signal;
Calculate unit, for calculating the three-dimensional space position of noisemaker corresponding to described noise signal relative to described mobile terminal according to described phase differential and acoustic pressure difference, and obtain the three-dimensional space position of the relatively described mobile terminal of user.
4. mobile terminal as claimed in claim 3, it is characterised in that, described determination module comprises:
Determining unit, for calculating time delay corresponding to described noise signal according to the three-dimensional space position of described noisemaker described mobile terminal relative to user;
Generate unit, for generating the de-noising signal anti-phase with described noise signal according to described time delay.
5. mobile terminal as claimed in claim 1, it is characterised in that, described first acquisition module is also for receiving the sound signal that automobile sends, and identifies the noise signal in described sound signal.
6. a noise-reduction method, it is characterised in that, described method is applied to mobile terminal, and described method comprises the following steps:
Obtain sound signal, and identify the noise signal in described sound signal;
Obtain the noisemaker position that described noise signal is corresponding, and obtain user position;
De-noising signal is determined according to described noise signal, described noisemaker position and user position;
Adjust described sound signal according to described de-noising signal, make an uproar so that described sound signal is fallen.
7. method as claimed in claim 6, it is characterised in that, the noisemaker position that described acquisition described noise signal is corresponding, and the step obtaining user position comprises:
Obtain the noisemaker position that described noise signal is corresponding, and obtain the position of user position and sound equipment;
Described determine that the step of de-noising signal comprises according to described noise signal, described noisemaker position and user position:
De-noising signal is determined in position according to described noise signal, described noisemaker position, user position and described sound equipment;
Described adjust described sound signal according to described de-noising signal, comprise described sound signal to be fallen the step made an uproar:
Described de-noising signal is sent to described sound equipment play, makes an uproar so that described sound signal is fallen.
8. method as claimed in claim 6, it is characterised in that, the noisemaker position that described acquisition described noise signal is corresponding, and the step obtaining user position comprises:
The phase differential and the acoustic pressure that obtain the corresponding waveform of described noise signal are poor;
Calculate the three-dimensional space position of noisemaker corresponding to described noise signal relative to described mobile terminal according to described phase differential and acoustic pressure difference, and obtain the three-dimensional space position of the relatively described mobile terminal of user.
9. method as claimed in claim 8, it is characterised in that, described determine that the step of de-noising signal comprises according to described noise signal, described noisemaker position and user position:
Three-dimensional space position according to described noisemaker described mobile terminal relative to user calculates time delay corresponding to described noise signal;
The de-noising signal anti-phase with described noise signal is generated according to described time delay.
10. method as claimed in claim 6, it is characterised in that, described acquisition sound signal, and the step identifying the noise signal in described sound signal also comprises:
Receive the sound signal that automobile sends, and identify the noise signal in described sound signal.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201511017236.7A CN105679300A (en) | 2015-12-29 | 2015-12-29 | Mobile terminal and noise reduction method |
PCT/CN2016/102388 WO2017113937A1 (en) | 2015-12-29 | 2016-10-18 | Mobile terminal and noise reduction method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201511017236.7A CN105679300A (en) | 2015-12-29 | 2015-12-29 | Mobile terminal and noise reduction method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105679300A true CN105679300A (en) | 2016-06-15 |
Family
ID=56297937
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201511017236.7A Pending CN105679300A (en) | 2015-12-29 | 2015-12-29 | Mobile terminal and noise reduction method |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN105679300A (en) |
WO (1) | WO2017113937A1 (en) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106205585A (en) * | 2016-07-28 | 2016-12-07 | 海信集团有限公司 | Noise cancellation method and device |
CN106205592A (en) * | 2016-06-24 | 2016-12-07 | 努比亚技术有限公司 | A kind of denoising device and method |
CN106251856A (en) * | 2016-07-26 | 2016-12-21 | 惠州Tcl移动通信有限公司 | A kind of environment noise based on mobile terminal eliminates system and method |
WO2017113937A1 (en) * | 2015-12-29 | 2017-07-06 | 努比亚技术有限公司 | Mobile terminal and noise reduction method |
CN108806659A (en) * | 2017-04-27 | 2018-11-13 | 北京小米移动软件有限公司 | Noise-reduction method and device, the electronic equipment of air purifier |
CN109451165A (en) * | 2018-11-26 | 2019-03-08 | 努比亚技术有限公司 | Mobile terminal noise processing method, device, mobile terminal and storage medium |
CN109637517A (en) * | 2017-10-06 | 2019-04-16 | 松下电器(美国)知识产权公司 | Control device, control system and control method |
CN110033754A (en) * | 2018-01-11 | 2019-07-19 | 深圳市诚壹科技有限公司 | A kind of noise-reduction method, device, terminal device and computer readable storage medium |
CN111696513A (en) * | 2020-05-19 | 2020-09-22 | Oppo广东移动通信有限公司 | Audio signal processing method and device, electronic equipment and storage medium |
CN113450755A (en) * | 2021-04-30 | 2021-09-28 | 青岛海尔科技有限公司 | Method, device, storage medium and electronic device for reducing noise |
CN114788304A (en) * | 2019-12-09 | 2022-07-22 | 杜比实验室特许公司 | Method for reducing errors in an ambient noise compensation system |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112885323A (en) * | 2021-02-22 | 2021-06-01 | 联想(北京)有限公司 | Audio information processing method and device and electronic equipment |
CN116153281A (en) * | 2021-11-23 | 2023-05-23 | 华为技术有限公司 | Active noise reduction method and electronic equipment |
CN114464203B (en) * | 2022-01-18 | 2022-10-25 | 小米汽车科技有限公司 | Noise filtering method, device, system, vehicle and storage medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050254664A1 (en) * | 2004-05-13 | 2005-11-17 | Kwong Wah Y | Noise cancellation methodology for electronic devices |
US20110274283A1 (en) * | 2009-07-22 | 2011-11-10 | Lewis Athanas | Open Air Noise Cancellation |
US20120237049A1 (en) * | 2011-03-18 | 2012-09-20 | Brown Christopher A | Wide area noise cancellation system and method |
CN104318919A (en) * | 2014-10-22 | 2015-01-28 | 上海斐讯数据通信技术有限公司 | Environment noise elimination method and system and mobile terminal |
CN104508738A (en) * | 2012-07-24 | 2015-04-08 | 皇家飞利浦有限公司 | Directional sound masking |
WO2015066926A1 (en) * | 2013-11-11 | 2015-05-14 | 赵春宁 | Noise reduction method |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105679300A (en) * | 2015-12-29 | 2016-06-15 | 努比亚技术有限公司 | Mobile terminal and noise reduction method |
-
2015
- 2015-12-29 CN CN201511017236.7A patent/CN105679300A/en active Pending
-
2016
- 2016-10-18 WO PCT/CN2016/102388 patent/WO2017113937A1/en active Application Filing
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050254664A1 (en) * | 2004-05-13 | 2005-11-17 | Kwong Wah Y | Noise cancellation methodology for electronic devices |
US20110274283A1 (en) * | 2009-07-22 | 2011-11-10 | Lewis Athanas | Open Air Noise Cancellation |
US20120237049A1 (en) * | 2011-03-18 | 2012-09-20 | Brown Christopher A | Wide area noise cancellation system and method |
CN104508738A (en) * | 2012-07-24 | 2015-04-08 | 皇家飞利浦有限公司 | Directional sound masking |
US20150194144A1 (en) * | 2012-07-24 | 2015-07-09 | Koninklijke Philips N.V. | Directional sound masking |
WO2015066926A1 (en) * | 2013-11-11 | 2015-05-14 | 赵春宁 | Noise reduction method |
CN104318919A (en) * | 2014-10-22 | 2015-01-28 | 上海斐讯数据通信技术有限公司 | Environment noise elimination method and system and mobile terminal |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017113937A1 (en) * | 2015-12-29 | 2017-07-06 | 努比亚技术有限公司 | Mobile terminal and noise reduction method |
CN106205592A (en) * | 2016-06-24 | 2016-12-07 | 努比亚技术有限公司 | A kind of denoising device and method |
CN106205592B (en) * | 2016-06-24 | 2020-07-28 | 努比亚技术有限公司 | Noise reduction device and method |
CN106251856A (en) * | 2016-07-26 | 2016-12-21 | 惠州Tcl移动通信有限公司 | A kind of environment noise based on mobile terminal eliminates system and method |
CN106251856B (en) * | 2016-07-26 | 2021-03-09 | Tcl通讯科技(成都)有限公司 | Environmental noise elimination system and method based on mobile terminal |
CN106205585B (en) * | 2016-07-28 | 2020-06-02 | 海信集团有限公司 | Noise elimination method and device |
CN106205585A (en) * | 2016-07-28 | 2016-12-07 | 海信集团有限公司 | Noise cancellation method and device |
CN108806659A (en) * | 2017-04-27 | 2018-11-13 | 北京小米移动软件有限公司 | Noise-reduction method and device, the electronic equipment of air purifier |
CN109637517A (en) * | 2017-10-06 | 2019-04-16 | 松下电器(美国)知识产权公司 | Control device, control system and control method |
CN109637517B (en) * | 2017-10-06 | 2023-05-26 | 松下电器(美国)知识产权公司 | Control device, control system, and control method |
CN110033754A (en) * | 2018-01-11 | 2019-07-19 | 深圳市诚壹科技有限公司 | A kind of noise-reduction method, device, terminal device and computer readable storage medium |
CN109451165A (en) * | 2018-11-26 | 2019-03-08 | 努比亚技术有限公司 | Mobile terminal noise processing method, device, mobile terminal and storage medium |
CN114788304A (en) * | 2019-12-09 | 2022-07-22 | 杜比实验室特许公司 | Method for reducing errors in an ambient noise compensation system |
US12136432B2 (en) | 2019-12-09 | 2024-11-05 | Dolby Laboratories Licensing Corporation | Methods for reducing error in environmental noise compensation systems |
CN111696513A (en) * | 2020-05-19 | 2020-09-22 | Oppo广东移动通信有限公司 | Audio signal processing method and device, electronic equipment and storage medium |
CN113450755A (en) * | 2021-04-30 | 2021-09-28 | 青岛海尔科技有限公司 | Method, device, storage medium and electronic device for reducing noise |
Also Published As
Publication number | Publication date |
---|---|
WO2017113937A1 (en) | 2017-07-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105679300A (en) | Mobile terminal and noise reduction method | |
CN110970057B (en) | Sound processing method, device and equipment | |
CN113192527B (en) | Method, apparatus, electronic device and storage medium for canceling echo | |
KR102326275B1 (en) | Image displaying method and apparatus | |
CN114631306B (en) | Method for providing preview and electronic device for displaying preview | |
CN105635452A (en) | Mobile terminal and contact person identification method thereof | |
CN109616135B (en) | Audio processing method, device and storage medium | |
CN103871051A (en) | Image processing method, device and electronic equipment | |
CN105681894A (en) | Device and method for displaying video file | |
CN108335703B (en) | Method and apparatus for determining accent position of audio data | |
CN110970050B (en) | Voice noise reduction method, device, equipment and medium | |
CN109003621B (en) | Audio processing method and device and storage medium | |
CN111488273A (en) | Test verification method, test verification device, storage medium, and electronic apparatus | |
CN108156374A (en) | A kind of image processing method, terminal and readable storage medium storing program for executing | |
CN111445901A (en) | Audio data acquisition method and device, electronic equipment and storage medium | |
KR20160039400A (en) | Method for reproducing contents and an electronic device thereof | |
CN108909717B (en) | Method and device for determining lightweight level of electric vehicle, and storage medium | |
CN109961802B (en) | Sound quality comparison method, device, electronic equipment and storage medium | |
US10388301B2 (en) | Method for processing audio signal and electronic device for supporting the same | |
CN111341307A (en) | Voice recognition method and device, electronic equipment and storage medium | |
CN105791558A (en) | Mobile terminal and method thereof for controlling terminal device | |
WO2023087774A1 (en) | Electric vehicle's low-speed pedestrian alert sound design method and system, and terminal and storage medium | |
CN111341317A (en) | Method and device for evaluating awakening audio data, electronic equipment and medium | |
CN111916105B (en) | Voice signal processing method, device, electronic equipment and storage medium | |
CN114936420A (en) | Method and device for simulating vibration envelope of automobile power assembly, terminal and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160615 |