Nothing Special   »   [go: up one dir, main page]

US10601998B2 - Efficient reutilization of acoustic echo canceler channels - Google Patents

Efficient reutilization of acoustic echo canceler channels Download PDF

Info

Publication number
US10601998B2
US10601998B2 US16/242,616 US201916242616A US10601998B2 US 10601998 B2 US10601998 B2 US 10601998B2 US 201916242616 A US201916242616 A US 201916242616A US 10601998 B2 US10601998 B2 US 10601998B2
Authority
US
United States
Prior art keywords
audio
filter coefficients
signal
filter
audio system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US16/242,616
Other versions
US20190141195A1 (en
Inventor
Cristian Marius Hera
Vigneish Kathavarayan
Jeffery R. Vautin
Elie Bou Daher
Paraskevas Argyropoulos
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bose Corp
Original Assignee
Bose Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bose Corp filed Critical Bose Corp
Priority to US16/242,616 priority Critical patent/US10601998B2/en
Publication of US20190141195A1 publication Critical patent/US20190141195A1/en
Assigned to BOSE CORPORATION reassignment BOSE CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ARGYROPOULOS, PARASKEVAS, BOU DAHER, ELIE, Hera, Cristian Marius, KATHAVARAYAN, VIGNEISH, VAUTIN, JEFFERY R
Application granted granted Critical
Publication of US10601998B2 publication Critical patent/US10601998B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M9/00Arrangements for interconnection not involving centralised switching
    • H04M9/08Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
    • H04M9/082Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B1/00Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/3822Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving specially adapted for use in vehicles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B3/00Line transmission systems
    • H04B3/02Details
    • H04B3/20Reducing echo effects or singing; Opening or closing transmitting path; Conditioning for transmission in one direction or the other
    • H04B3/23Reducing echo effects or singing; Opening or closing transmitting path; Conditioning for transmission in one direction or the other using a replica of transmitted signal in the time domain, e.g. echo cancellers

Definitions

  • aspects and examples of the present disclosure are directed generally to voice and audio systems and methods, and in some examples, more specifically to systems and methods for removing acoustic echo signals from microphone signals.
  • Audio systems are used to produce acoustic signals for various purposes such as entertainment (e.g., music, talk radio, sports), navigation (e.g., route guidance), and communication (e.g., telephone calls).
  • Some such audio systems include one or more microphones intended to pick up a user's voice for certain applications, such as the near end of a telephone call or for commands to a virtual personal assistant.
  • the acoustic signals produced by the audio system also contribute to the microphone signals, and may undesirably interfere with processing the user's voice signal.
  • aspects and examples are directed to audio systems and methods that make efficient use of echo cancellers, to reduce echo content in an audio signal, by storing filter coefficients associated with particular sound stage configurations.
  • the audio systems and methods select from among the stored filter coefficients and load them into one or more echo cancellation filters when the particular (or similar) sound stage configuration is selected for operation.
  • a method of reducing echo content of an audio signal includes receiving an audio program content signal, receiving a sound stage rendering parameter, selecting a set of filter coefficients from among a plurality of stored sets of filter coefficients based upon the sound stage rendering parameter, filtering the audio program content signal using the selected set of filter coefficients to generate a filtered signal, receiving a microphone signal configured to include a signal component representative of an echo of the audio program content signal, and subtracting the filtered signal from the microphone signal to generate an output audio signal.
  • Some examples include loading the selected set of filter coefficients to an audio filter and activating the audio filter to perform the filtering. Some examples include loading the selected set of filter coefficients to an adaptive filter, adapting the adaptive filter coefficients, and copying the adaptive filter coefficients to an active audio filter that performs the filtering.
  • Some examples include loading the selected set of filter coefficients to an adaptive filter that performs the filtering. Certain examples include detecting double-talk and disabling an adaptive component of the adaptive filter while double-talk is detected.
  • Some examples include rendering the audio program content signal into an acoustic signal, based upon the selected sound stage rendering parameter.
  • Certain examples include storing adapted filter coefficients and associating the stored filter coefficients with the sound stage rendering parameter.
  • Some examples include receiving a second sound stage rendering parameter, selecting a second set of filter coefficients based upon the second sound stage rendering parameter, and filtering the audio program content signal using the second selected set of filter coefficients to generate the filtered signal.
  • an audio system includes an input to receive an audio content signal, a loudspeaker output configured to provide a processed version of the audio content signal to a loudspeaker for rendering an acoustic signal in accord with a selected sound stage configuration, a microphone input to receive a microphone signal having an echo component of the acoustic signal, from one or more microphones, an audio filter configured to filter the audio content signal according to a set of filter coefficients, the set of filter coefficients selected from among a plurality of sets of filter coefficients based upon the selected sound stage configuration, and a memory configured to store the plurality of sets of filter coefficients.
  • Some examples include a combiner configured to subtract the filtered audio content signal from the microphone signal to provide an output signal.
  • Some examples include a processor configured to select the selected set of filter coefficients and to copy the selected set of filter coefficients from the memory to the audio filter.
  • Some examples include an adaptive filter to filter the audio content signal according to the set of filter coefficients and to provide an updated set of filter coefficients.
  • Certain examples include a processing block configured to determine whether an updated set of filter coefficients performs better than the selected set of filter coefficients, and to copy the updated set of filter coefficients to at least one of the audio filter and the memory.
  • Some examples include a processing block configured to copy a set of filter coefficients from the audio filter to the memory and to associate the copied filter coefficients with the sound stage configuration.
  • Some examples include a processing block configured to select a second set of filter coefficients and to copy the second selected set of filter coefficients from the memory to the audio filter in response to a second selected sound stage configuration.
  • a multi-channel audio system includes a sound stage processor having one or more outputs configured to provide processed signals, a plurality of content channels, each of the plurality of content channels configured to convey a selected audio content signal from a source to the sound stage processor, and a plurality of echo canceling filters, each of the echo canceling filters associated with one of the plurality of content channels, and each of the echo canceling filters configured to filter the associated selected audio content signal into an estimated echo signal using a set of filter coefficients selected from among a plurality of sets of filter coefficients, the selected set of filter coefficients based upon a selected sound stage configuration associated with the selected audio content signal.
  • Certain examples include one or more loudspeakers coupled to the one or more outputs to receive the processed signals and to produce acoustic signals responsive to the processed signals.
  • Certain examples include a microphone input to receive a microphone signal and a signal combiner configured to subtract the plurality of estimated echo signals from the microphone signal.
  • Certain examples include one or more microphones to receive acoustic signals and configured to provide at least one microphone signal from which the plurality of estimated echo signals is subtracted to produce an output signal.
  • Some examples include a memory to store the plurality of sets of filter coefficients.
  • FIG. 1 is a schematic diagram of an example audio system including echo cancellation
  • FIG. 2 is a schematic diagram of an example audio system including multi-channel echo cancellation
  • FIG. 3 is a flow diagram of an example method of controlling a multi-channel audio system.
  • aspects of the present disclosure are directed to audio systems and methods that provide echo cancellation in a multi-channel environment. Aspects and examples disclosed herein achieve multi-channel echo cancellation using fewer acoustic echo cancellers than conventional systems and methods.
  • Audio systems may produce acoustic signals in an environment, e.g., a vehicle compartment, for the benefit of people in the environment.
  • the acoustic signals may be for entertainment, information, communication, and navigation, for example.
  • Such audio systems may also accept acoustic input from the occupants, e.g., one or more people may verbally speak and their voices may be picked up by the audio system, e.g., via one or more microphones, for various purposes such as telephone conversations, verbal commands to a navigation system or a virtual personal assistant, and the like.
  • the microphone(s) may also pick up the rendered acoustic signal in addition to the user's voice.
  • the user may be having a phone conversation and listening to the radio at the same time, and the microphone will pick up both the user's voice and the radio program.
  • a portion of the microphone signal may therefore be due to the audio system's own acoustic production, and that portion of the microphone signal is deemed an echo signal.
  • an acoustic echo canceller may be used to reduce or remove the echo signal portion from the microphone signal.
  • the audio system may provide various signal processing, such as equalization and sound stage programming, to prepare an audio signal to be converted into an acoustic signal by, e.g., a loudspeaker, and acoustic echo cancellers may use various adaptive algorithms to estimate the echo created by the audio system processing, the loudspeaker, and the environment in which the system operates.
  • Multiple loudspeakers, multiple audio signal sources, and multiple signal processing options e.g., equalization, sound stage
  • aspects and examples disclosed herein reduce the number of acoustic echo cancellers required, at least in part by resetting and/or re-loading individual echo cancellers with previously determined and stored filter coefficients based upon a selected combination of audio source and sound-stage options.
  • references to “or” may be construed as inclusive so that any terms described using “or” may indicate any of a single, more than one, and all of the described terms. Any references to front and back, left and right, top and bottom, upper and lower, and vertical and horizontal are intended for convenience of description, not to limit the present systems and methods or their components to any one positional or spatial orientation.
  • FIG. 1 illustrates an example audio system 100 that includes an echo canceller 110 , one or more acoustic drivers 120 , and one or more microphones 130 .
  • the audio system 100 receives a program content signal 102 , p(t), that is converted into an acoustic program signal 122 by the one or more acoustic drivers 120 .
  • the acoustic drivers 120 may have further processing component(s) 140 associated with them, such as may provide array processing, amplification, equalization, mixing, etc.
  • the program content signal 102 may include multiple tracks, such as a stereo left and right pair, or multiple program content signals to be mixed or processed in various ways.
  • the program content signal 102 may be an analog or digital signal and may be provided as a compressed and/or packetized stream, and additional information may be received as part of such a stream, such as instructions, commands, or parameters from another system for control and/or configuration of the processing component(s) 140 , the echo canceller 110 , or other components.
  • each of the echo canceller(s) 110 , the processing component(s) 140 , and other components and/or any portions or combinations of these may be implemented in one set of circuitry, such as a digital signal processor, a controller, or other logic circuitry, and may include instructions for the circuitry to perform the functions described herein.
  • a microphone such as the microphone 130 may receive each of an acoustic echo signal 124 , an acoustic voice signal 126 from a user 128 , and other acoustic signals such as background noise and/or road noise.
  • the microphone 130 converts acoustic signals into, e.g., electrical signals, and provides them to the echo canceller 110 .
  • the microphone 130 provides a voice signal 136 , v(t), and an echo signal 134 , e(t), as part of a combined signal to the echo canceller 110 .
  • the echo canceller 110 functions to attempt to remove the echo signal 134 from the combined signal to provide an estimated voice signal 116 , ⁇ circumflex over (v) ⁇ (t).
  • the echo canceller 110 works to remove the echo signal 134 by processing the program content signal 102 through a filter 112 to produce an estimated echo signal 114 , ê(t), which is subtracted from the signal provided by the microphone 130 .
  • the acoustic program signal 122 causes the echo signal 134 . If the filter 112 performs well at providing an estimated echo signal 114 , it will perform well at removing the echo signal 134 from the signal provided by the microphone 130 . As a result, the estimated voice signal 116 , ⁇ circumflex over (v) ⁇ (t), will be a good representation of the actual voice signal 136 , v(t).
  • the echo canceller 110 may include an adaptive algorithm to update the filter 112 , at intervals, to improve the estimated echo signal 114 . Over time, the adaptive algorithm causes the filter 112 to converge on satisfactory parameters that produce a sufficiently accurate estimated echo signal 114 . Generally, the adaptive algorithm updates the filter during times when the user 128 is not speaking, but in some examples the adaptive algorithm may make updates at any time. When the user 128 speaks, such is deemed “double talk,” and the microphone 130 picks up both the acoustic echo signal 124 and the acoustic voice signal 126 . Regarding the terminology, the user 128 is “talking” at the same time as one or more acoustic drivers 120 are producing acoustic program content, or “talking,” hence, “double talk.”
  • the filter 112 may apply a set of filter coefficients to the program content signal 102 to produce the estimated echo signal 114 , ê(t).
  • the adaptive algorithm may use any of various techniques to determine the filter coefficients and to update, or change, the filter coefficients to improve performance of the filter 112 .
  • the adaptive algorithm may operate on a background filter, separate from the filter 112 , to seek out a set of filter coefficients that performs better than an active set of coefficients being used in the filter 112 . When a better set of coefficients is identified, they may be copied to the filter 112 in active operation.
  • Such adaptive algorithms may include, for example, a least mean squares (LMS) algorithm, a normalized least mean squares (NLMS) algorithm, a recursive least square (RLS) algorithm, or any combination or variation of these or other algorithms.
  • LMS least mean squares
  • NLMS normalized least mean squares
  • RLS recursive least square
  • the filter 112 converges to apply an estimated transfer function 118 , ⁇ (t), which is representative of the overall response of the processing 140 , the acoustic driver(s) 120 , the acoustic environment, and the microphone(s) 130 , to the program content signal 102 .
  • the transfer function is a representation of how the program content signal 102 is transformed from its received form into the echo signal 134 .
  • FIG. 2 illustrates an example multi-channel audio system 200 that includes source selection switching 210 to allow selection from among multiple sources 212 to provide one or more program content signals for rendering as acoustic signals.
  • the audio system 200 also includes a sound stage processor 220 to control a number of acoustic transducers 222 , at least one microphone input and/or at least one microphone 230 to pick up acoustic signals in the environment, including user voices and audio system echoes, an echo cancellation subsystem 240 for estimating the echo signal content of the audio signal provided by the microphone 230 , and a controller 250 to manage one or more components of the source selection switching 210 , the sound stage processor 220 , and/or the echo cancellation subsystem 240 .
  • the echo cancellation subsystem 240 may operate on signals or signal channels after processing by the sound stage processor 220 , rather than prior to sound stage processing as shown in the figures.
  • the echo cancellation subsystem 240 may operate on signals provided directly to the acoustic transducers 222 , before or after amplification.
  • the microphone 230 may be an array of microphones, having array processing to steer beams toward sources of desired acoustic signals and/or away from noise sources, and may additionally or alternately steer nulls toward noise sources.
  • the controller 250 may further control such array processing components, or such array processing components may be alternately controlled and/or may be pre-configured for various operating characteristics.
  • the microphone 230 may be a microphone input or other signal input suitable to receive an audio signal from a microphone, whether pre-processed, filtered, combined, etc.
  • any of the sources 212 may include hardware for providing an audio signal, such as a radio tuner, navigation system, telephone system, and the like, or may include inputs to accept audio signals from an external device.
  • any of the sources 212 may include one or more physical electrical connections or wireless connections, or any combination of wired and wireless connections, and may include network interfaces to receive (and optionally to provide) various audio signals. Examples include audio jacks, such as 3.5 mm audio jacks, for example, Bluetooth® wireless interfaces and hardware, or the like, network interface jacks and/or connectors, such as an RJ-45 connector, for example, and wireless local area network (WLAN) interfaces and hardware, or any combination of these or other interfaces suitable for conveying audio signal content. Various of these or other interfaces may also include inputs to receive commands and control parameters, such as filter settings, equalization, volume control, or other sound stage parameters, etc.
  • the echo cancellation subsystem includes a number of echo cancellation filters 242 , each of which is associated with a particular content channel 214 .
  • the content channels 214 provide content signals to the sound stage processor 220 , from among the sources 212 (as selected by the source selection switching under the control of the controller 250 ).
  • the sound stage processor 220 provides various processing, such as equalization and loudspeaker routing, to drive the acoustic transducers 222 to generate acoustic sound fields in accordance with the various program content signals and sound stage parameters.
  • the various sources 212 may provide audio content to be rendered within the environment, such as an interior occupant compartment of a vehicle, and may include numerous types of audio sources, such as radios, telephones, navigation systems, etc. Each of the sources 212 and each sub-channel provided by the sources 212 may have differing requirements for sound stage rendering, such as equalization settings and routing to various acoustic transducers 222 or groups of acoustics transducers 222 .
  • any of the sources 212 may have numerous sub-channels, such as left and right, front and rear, center, sub, or the like, and any of the sources 212 may have differing sub-channels based upon a mode of operation, such as a radio receiver may operate in different modes to receive audio content in a mono, stereo, or multi-channel surround format.
  • a video entertainment device may provide audio content in any of mono, stereo, surround, or other formats.
  • a video entertainment device may be selected to provide program content to be rendered in the rear of the vehicle while an audio entertainment device is selected to provide program content to be rendered in the front of the vehicle.
  • a telephone conversation may be selected to provide program content to be rendered acoustically near a passenger
  • a navigation device may be selected to provide program content to be rendered acoustically near a driver.
  • a warning system e.g., lane drift, blind-spot detection, etc.
  • a navigation system may use multiple sets of sound stage parameters to render announcements to come from various positions within the vehicle. For example, differing sound stage rendering parameters may produce an announcement “turn right” from the right side of the vehicle, and “turn left” from the left side of the vehicle, or a “continue ahead” announcement may come from the front center of the vehicle.
  • the “turn right” may be routed to one or more acoustic transducers 222 so that the acoustic presentation sounds like it comes from the right side of the vehicle, and may include equalization appropriate for the particular acoustic transducers 222 to which it is routed.
  • the “turn left” announcement may similarly be routed to one or more acoustic transducers 222 to sound like it comes from the left side of the vehicle, with appropriate equalization(s), and the “continue ahead” announcement may be routed to one or more acoustic transducers 222 so that a balanced acoustic signal is produced that sounds like it comes from a center position.
  • Each of the acoustic transducers 222 may have its own equalization parameters, which may also vary based upon which of the sources 212 any particular audio signal originates. Further, each of the acoustic transducers 222 may have a limited frequency range. Additionally, a different equalization for a specific acoustic transducer 222 may be applied when that acoustic transducer 222 is grouped with other particular combinations of acoustic transducers 222 , and so on.
  • each of a number of occupants may be listening to music at different volume levels, e.g., rendered by various acoustic transducers 222 in such manner to cause each occupant to hear a different volume level.
  • one of the occupants may adjust his/her listening experience, such as by changing the volume or turning off the music altogether at his/her position.
  • each of the occupants may be able to listen to different music or audio sources at the same time.
  • an incoming telephone call may arrive and the driver may answer the telephone call.
  • the audio system 200 may be configured to render the incoming audio of the telephone call so that the driver hears it well but the other occupants don't. Additionally, the sound system 200 may simultaneously cease or reduce the playback volume of other audio content at the driver's position. Further, the audio system 200 may allow the driver to “transfer” the call to a particular passenger, e.g, make a selection so that the sound stage processor 220 routes the incoming telephone audio to appropriate acoustic transducers 222 , with appropriate equalization and/or playback volume, so that the selected passenger can hear it but it does not disturb the other occupants.
  • the driver may make a selection to have the telephone audio play for all the occupants to hear. Any other audio content currently playing may then be stopped by the audio system 200 , or may have reduced playback volume.
  • the audio system 200 may accommodate multiple phones, for example via multiple Bluetooth® connections, and associate each phone with a particular occupant's position in a passenger compartment. An incoming telephone call may then be rendered by the audio system 200 to the particular passenger whose phone was called.
  • Each of the above example program content sources 212 and sub-channels may have unique sound stage rendering 220 requirements at any given time, and every possible combination of source sub-channel and sound stage rendering parameters may exhibit a different transfer function from the source 212 to the microphone 230 where an echo of the source sub-channel may be received.
  • audio systems and methods in accord with aspects and examples disclosed herein are capable of operation with a minimal number of echo canceller channels by adapting, storing, and loading sets of filter coefficients at appropriate times, and associating combinations of sources 212 , sub-channels, and sound stage rendering parameters with stored filter coefficients.
  • a first source 212 may provide stereo (left and right) audio content to be rendered by the sound stage processor 220 through various of the acoustic transducers 222 .
  • two content channels 214 are used, a first content channel 214 to convey the left program content signal to the sound stage processor 220 , and a second content channel 214 to convey the right program content signal to the sound stage processor 220 .
  • the sound stage processor may be programmed, controlled, or otherwise configured to produce (e.g., render) the left channel from the left of a vehicle (or other environment in which the audio system 200 is operated) and to produce the right channel from the right of the vehicle.
  • a first echo cancellation filter 242 a receives the left program content signal from the first content channel 214 and produces a first estimated echo signal 244 a associated with the left of the vehicle.
  • a second echo cancellation filter 242 b receives the right program content signal from the second content channel 214 and produces a second estimated echo signal 244 b associated with the right of the vehicle.
  • no more program content is being rendered. Accordingly, no additional content channels 214 or echo cancellation filters 242 are used.
  • the first and second estimated echo signals 244 a , 244 b are added together to produce a combined estimated echo signal.
  • the combined estimated echo signal is subtracted from the microphone signal 232 to produce an estimated voice signal 216 , similar to that described above with reference to FIG. 1 .
  • Adaptation of the first and second echo cancellation filters 242 a , 242 b may be carried out by one or more adaptation blocks 246 , in a manner similar to the adaptive algorithm(s) described above with reference to FIG. 1 . It should be understood the adaptation block 246 receives the various program content signals from the content channels 214 , though for simplicity in FIG. 2 such is not explicitly illustrated.
  • a navigation system may be a second source 212 that may provide content to rendered to the left, to the right, or to the center, each with differing sound stage rendering parameters, as previously described.
  • the audio system 200 is capable to take advantage of the fact that the navigation system will only use one of the left, right, or center sound stage combinations at any given time. Additionally, the navigation system may be idle for some time before a navigation announcement needs to be rendered by the sound stage processor.
  • the audio system 200 may allocate a single content channel 214 and a single echo cancellation filter 242 to the navigation system.
  • the echo cancellation filter 242 to be allocated has not been in operation until this point (in this example) and does not have an appropriate set of filter coefficients to cancel an echo component from the navigation system.
  • the echo cancellation subsystem 240 includes storage 248 that contains an appropriate set of filter coefficients to cancel an echo component from the navigation system, for a given sound stage rendering configuration.
  • the controller 250 and/or the echo cancellation subsystem 240 may locate the appropriate set of filter coefficients to cancel an echo component from the navigation system for the given sound stage parameters. If the navigation system indicates that an announcement is to be acoustically rendered from the left, a previously stored set of filter coefficients is selected from the storage 248 and copied to the appropriate echo cancellation filter 242 , and used to cancel (or reduce) echo content in the microphone signal 232 due to the left-rendered navigation announcement.
  • the filter adaptation block 246 may operate to adapt (e.g., adjust) the filter coefficients, in the foreground or background as described previously. If the adaptation block 246 converges on new filter coefficients, the new filter coefficients may be copied into the storage 248 and associated with, e.g., left-rendered navigation announcements, for future use the next time the navigation system has an announcement to rendered in a similar manner.
  • a user may adjust certain audio system controls, such as tone, balance, or others, that effect the transfer function between a source 212 and an echo component of a microphone signal 232 .
  • certain audio system controls such as tone, balance, or others
  • filter coefficients stored in the storage 248 may be updated, e.g., by copying new filter coefficients determined by the adaptation block 246 , either at intervals or at the end of use of one of the echo cancellation filters 242 , or both.
  • certain user adjustment, such as tone or others may be applied at various locations, such as before provision of the content signal to an echo cancellation filter 242 , which may reduce the need for adaptation of filter coefficients when the user makes such adjustments.
  • FIG. 3 illustrates an example operational method 300 that may be performed by an audio system such as the audio system 200 of FIG. 2 to allow reallocation of echo cancellation filters to various combinations of content signals and sound stage rendering parameters, on demand, to thereby reduce the total number of echo cancellation filters needed in a particular system.
  • the method 300 includes receiving one or more program content signals (block 310 ) and rendering the program content signals (block 320 ) according to one or more sound stage parameters, for example by the sound stage processor 220 via one or more acoustic transducers 222 .
  • echo cancellation filters 242 are operated normally to reduce echo from a microphone signal and to adapt their filter coefficients.
  • the method 300 allocates a content channel 214 and an echo cancellation filter 242 to the new request (block 350 ), locates appropriate filter coefficients in storage 248 and copies the filter coefficients to the echo cancellation filter (block 360 ), and continues to render all requested program content material (block 320 ), including the new source sub-channel.
  • filter coefficients may be copied (block 380 ) from the allocated echo cancellation filter 242 to the storage 248 , the content channel 214 and the echo cancellation filter 242 are de-allocated (block 390 ), and rendering continues for any remaining program content channels (block 320 ).
  • a program content signal may have any suitable spectral range, such as, for example, 20 Hz to 20,000 Hz being an acoustic range typically accepted as matching that of the human ear. In some examples, however, removing an echo signal based upon the program content signal may be limited to a narrower spectrum.
  • the microphone signal may be filtered to a narrower bandwidth because it may be intended to pick up human vocal activity, and may only require a lower frequency bound as low as, e.g., 60 Hz, and/or an upper frequency bound as high as, e.g., 8,000 Hz or 10,000 Hz, for example.
  • the microphone signal may be filtered, controlled, or otherwise limited to a frequency spectrum in the range of 60 Hz to 8,000 Hz, or from 100 Hz to 4,000 Hz, or any other suitable range.
  • an audio system may include a plurality of acoustic drivers and/or a plurality of microphones, and may include various processing, which may include array processing, to process signals to the acoustic drivers and/or to process signals from the microphones, or a sub-set of either the acoustic drivers or microphones, as appropriate for various applications and/or changing operational requirements.
  • various processing which may include array processing, to process signals to the acoustic drivers and/or to process signals from the microphones, or a sub-set of either the acoustic drivers or microphones, as appropriate for various applications and/or changing operational requirements.
  • DSP digital signal processor
  • a microprocessor a logic controller, logic circuits, field programmable gate array(s) (FPGA), application-specific integrated circuit(s) (ASIC), general computing processor(s), micro-controller(s), and the like, or any combination of these, may be suitable, and may include analog or digital circuit components and/or other components with respect to any particular implementation.
  • ADC analog-to-digital converter
  • DAC digital-to-analog converter
  • Any suitable hardware and/or software, including firmware and the like, may be configured to carry out or implement components of the aspects and examples disclosed herein, and various implementations of aspects and examples may include components and/or functionality in addition to those disclosed.
  • Various implementations may include stored instructions for a digital signal processor and/or other circuitry to enable the circuitry, at least in part, to perform the functions described herein.
  • an acoustic transducer, driver, or loudspeaker may be any of many types of transducers known in the art.
  • an acoustic structure coupled to a magnetic coil positioned in a magnetic field, to cause motion in response to electrical signals received by the coil may be a suitable acoustic transducer.
  • a piezoelectric material may respond to electrical signals by expanding or contracting in one or more dimensions and may be a suitable acoustic transducer.
  • acoustic transducers may take other forms.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Telephone Function (AREA)

Abstract

Audio systems and methods are provided to reduce echo content in an audio signal. The systems and methods receive an audio signal and sound stage rendering parameter(s), and select a set of filter coefficients to filter the audio signal to provide an estimated echo signal. The estimated echo signal is subtracted from a microphone signal to provide an output signal with reduced echo content. The set of filter coefficients are selected based upon the sound stage rendering parameter(s) from among a plurality of stored sets of filter coefficients.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
This application is a continuation of U.S. patent application Ser. No. 15/667,988 filed on Aug. 3, 2017 which is incorporated herein by reference in its entirety for all purposes.
This application is also related to U.S. patent application Ser. No. 15/668,073 titled MULTI-CHANNEL RESIDUAL ECHO SUPPRESSION filed on Aug. 3, 2017 and to U.S. patent application Ser. No. 15/668,237 titled MITIGATING IMPACT OF DOUBLE TALK FOR RESIDUAL ECHO SUPPRESSORS filed on Aug. 3, 2017 which are also incorporated herein by reference in their entirety for all purposes.
TECHNICAL FIELD
Aspects and examples of the present disclosure are directed generally to voice and audio systems and methods, and in some examples, more specifically to systems and methods for removing acoustic echo signals from microphone signals.
BACKGROUND
Audio systems, especially automobile audio systems, are used to produce acoustic signals for various purposes such as entertainment (e.g., music, talk radio, sports), navigation (e.g., route guidance), and communication (e.g., telephone calls). Some such audio systems include one or more microphones intended to pick up a user's voice for certain applications, such as the near end of a telephone call or for commands to a virtual personal assistant. The acoustic signals produced by the audio system also contribute to the microphone signals, and may undesirably interfere with processing the user's voice signal.
SUMMARY
Aspects and examples are directed to audio systems and methods that make efficient use of echo cancellers, to reduce echo content in an audio signal, by storing filter coefficients associated with particular sound stage configurations. The audio systems and methods select from among the stored filter coefficients and load them into one or more echo cancellation filters when the particular (or similar) sound stage configuration is selected for operation.
According to one aspect, a method of reducing echo content of an audio signal is provided and includes receiving an audio program content signal, receiving a sound stage rendering parameter, selecting a set of filter coefficients from among a plurality of stored sets of filter coefficients based upon the sound stage rendering parameter, filtering the audio program content signal using the selected set of filter coefficients to generate a filtered signal, receiving a microphone signal configured to include a signal component representative of an echo of the audio program content signal, and subtracting the filtered signal from the microphone signal to generate an output audio signal.
Some examples include loading the selected set of filter coefficients to an audio filter and activating the audio filter to perform the filtering. Some examples include loading the selected set of filter coefficients to an adaptive filter, adapting the adaptive filter coefficients, and copying the adaptive filter coefficients to an active audio filter that performs the filtering.
Some examples include loading the selected set of filter coefficients to an adaptive filter that performs the filtering. Certain examples include detecting double-talk and disabling an adaptive component of the adaptive filter while double-talk is detected.
Some examples include rendering the audio program content signal into an acoustic signal, based upon the selected sound stage rendering parameter.
Certain examples include storing adapted filter coefficients and associating the stored filter coefficients with the sound stage rendering parameter.
Some examples include receiving a second sound stage rendering parameter, selecting a second set of filter coefficients based upon the second sound stage rendering parameter, and filtering the audio program content signal using the second selected set of filter coefficients to generate the filtered signal.
According to another aspect, an audio system is provided that includes an input to receive an audio content signal, a loudspeaker output configured to provide a processed version of the audio content signal to a loudspeaker for rendering an acoustic signal in accord with a selected sound stage configuration, a microphone input to receive a microphone signal having an echo component of the acoustic signal, from one or more microphones, an audio filter configured to filter the audio content signal according to a set of filter coefficients, the set of filter coefficients selected from among a plurality of sets of filter coefficients based upon the selected sound stage configuration, and a memory configured to store the plurality of sets of filter coefficients.
Some examples include a combiner configured to subtract the filtered audio content signal from the microphone signal to provide an output signal.
Some examples include a processor configured to select the selected set of filter coefficients and to copy the selected set of filter coefficients from the memory to the audio filter.
Some examples include an adaptive filter to filter the audio content signal according to the set of filter coefficients and to provide an updated set of filter coefficients.
Certain examples include a processing block configured to determine whether an updated set of filter coefficients performs better than the selected set of filter coefficients, and to copy the updated set of filter coefficients to at least one of the audio filter and the memory.
Some examples include a processing block configured to copy a set of filter coefficients from the audio filter to the memory and to associate the copied filter coefficients with the sound stage configuration.
Some examples include a processing block configured to select a second set of filter coefficients and to copy the second selected set of filter coefficients from the memory to the audio filter in response to a second selected sound stage configuration.
According to yet another aspect, a multi-channel audio system is provided that includes a sound stage processor having one or more outputs configured to provide processed signals, a plurality of content channels, each of the plurality of content channels configured to convey a selected audio content signal from a source to the sound stage processor, and a plurality of echo canceling filters, each of the echo canceling filters associated with one of the plurality of content channels, and each of the echo canceling filters configured to filter the associated selected audio content signal into an estimated echo signal using a set of filter coefficients selected from among a plurality of sets of filter coefficients, the selected set of filter coefficients based upon a selected sound stage configuration associated with the selected audio content signal.
Certain examples include one or more loudspeakers coupled to the one or more outputs to receive the processed signals and to produce acoustic signals responsive to the processed signals.
Certain examples include a microphone input to receive a microphone signal and a signal combiner configured to subtract the plurality of estimated echo signals from the microphone signal.
Certain examples include one or more microphones to receive acoustic signals and configured to provide at least one microphone signal from which the plurality of estimated echo signals is subtracted to produce an output signal.
Some examples include a memory to store the plurality of sets of filter coefficients.
Still other aspects, examples, and advantages are discussed in detail below. Examples disclosed herein may be combined with other examples in any manner consistent with at least one of the principles disclosed herein, and references to “an example,” “some examples,” “an alternate example,” “various examples,” “one example” or the like are not necessarily mutually exclusive and are intended to indicate that a particular feature, structure, or characteristic described may be included in at least one example. The appearances of such terms herein are not necessarily all referring to the same example.
BRIEF DESCRIPTION OF THE DRAWINGS
Various aspects of at least one example are discussed below with reference to the accompanying figures, which are not intended to be drawn to scale. The figures are included to provide illustration and a further understanding of the various aspects and examples, and are incorporated in and constitute a part of this specification, but are not intended as a definition of the limits of the invention. In the figures, identical or nearly identical components illustrated in various figures may be represented by a like numeral. For purposes of clarity, not every component may be labeled in every figure. In the figures:
FIG. 1 is a schematic diagram of an example audio system including echo cancellation;
FIG. 2 is a schematic diagram of an example audio system including multi-channel echo cancellation; and
FIG. 3 is a flow diagram of an example method of controlling a multi-channel audio system.
DETAILED DESCRIPTION
Aspects of the present disclosure are directed to audio systems and methods that provide echo cancellation in a multi-channel environment. Aspects and examples disclosed herein achieve multi-channel echo cancellation using fewer acoustic echo cancellers than conventional systems and methods.
Audio systems, especially automotive audio systems, may produce acoustic signals in an environment, e.g., a vehicle compartment, for the benefit of people in the environment. The acoustic signals may be for entertainment, information, communication, and navigation, for example. Such audio systems may also accept acoustic input from the occupants, e.g., one or more people may verbally speak and their voices may be picked up by the audio system, e.g., via one or more microphones, for various purposes such as telephone conversations, verbal commands to a navigation system or a virtual personal assistant, and the like. When the audio system renders an acoustic signal, e.g., via a loudspeaker, the microphone(s) may also pick up the rendered acoustic signal in addition to the user's voice. For example, the user may be having a phone conversation and listening to the radio at the same time, and the microphone will pick up both the user's voice and the radio program. A portion of the microphone signal may therefore be due to the audio system's own acoustic production, and that portion of the microphone signal is deemed an echo signal. In such cases, an acoustic echo canceller may be used to reduce or remove the echo signal portion from the microphone signal. When multiple loudspeakers and/or multiple audio signal sources are used, there may be multiple acoustic echo cancellers involved.
The audio system may provide various signal processing, such as equalization and sound stage programming, to prepare an audio signal to be converted into an acoustic signal by, e.g., a loudspeaker, and acoustic echo cancellers may use various adaptive algorithms to estimate the echo created by the audio system processing, the loudspeaker, and the environment in which the system operates. Multiple loudspeakers, multiple audio signal sources, and multiple signal processing options (e.g., equalization, sound stage) conventionally require a number of acoustic echo cancellers, each of which works to estimate the echo of a particular channel combination of audio source and sound-stage options. Aspects and examples disclosed herein reduce the number of acoustic echo cancellers required, at least in part by resetting and/or re-loading individual echo cancellers with previously determined and stored filter coefficients based upon a selected combination of audio source and sound-stage options.
Examples of the methods and apparatuses discussed herein are not limited in application to the details of construction and the arrangement of components set forth in the following description or illustrated in the accompanying drawings. The methods and apparatuses are capable of implementation in other examples and of being practiced or of being carried out in various ways. Examples of specific implementations are provided herein for illustrative purposes only and are not intended to be limiting. In particular, functions, components, elements, and features discussed in connection with any one or more examples are not intended to be excluded from a similar role in any other examples.
Also, the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. Any references to examples, components, elements, acts, or functions of the systems and methods herein referred to in the singular may also embrace embodiments including a plurality, and any references in plural to any example, component, element, act, or function herein may also embrace examples including only a singularity. Accordingly, references in the singular or plural form are not intended to limit the presently disclosed systems or methods, their components, acts, or elements. The use herein of “including,” “comprising,” “having,” “containing,” “involving,” and variations thereof is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. References to “or” may be construed as inclusive so that any terms described using “or” may indicate any of a single, more than one, and all of the described terms. Any references to front and back, left and right, top and bottom, upper and lower, and vertical and horizontal are intended for convenience of description, not to limit the present systems and methods or their components to any one positional or spatial orientation.
FIG. 1 illustrates an example audio system 100 that includes an echo canceller 110, one or more acoustic drivers 120, and one or more microphones 130. The audio system 100 receives a program content signal 102, p(t), that is converted into an acoustic program signal 122 by the one or more acoustic drivers 120. The acoustic drivers 120 may have further processing component(s) 140 associated with them, such as may provide array processing, amplification, equalization, mixing, etc. Additionally, the program content signal 102 may include multiple tracks, such as a stereo left and right pair, or multiple program content signals to be mixed or processed in various ways. The program content signal 102 may be an analog or digital signal and may be provided as a compressed and/or packetized stream, and additional information may be received as part of such a stream, such as instructions, commands, or parameters from another system for control and/or configuration of the processing component(s) 140, the echo canceller 110, or other components.
The block diagrams illustrated in the figures, such as the example audio system 100 of FIG. 1, are schematic representations and not necessarily illustrative of individual hardware elements. For instance, in some examples, each of the echo canceller(s) 110, the processing component(s) 140, and other components and/or any portions or combinations of these, may be implemented in one set of circuitry, such as a digital signal processor, a controller, or other logic circuitry, and may include instructions for the circuitry to perform the functions described herein.
A microphone, such as the microphone 130, may receive each of an acoustic echo signal 124, an acoustic voice signal 126 from a user 128, and other acoustic signals such as background noise and/or road noise. The microphone 130 converts acoustic signals into, e.g., electrical signals, and provides them to the echo canceller 110. Specifically, when a user 128 is speaking, the microphone 130 provides a voice signal 136, v(t), and an echo signal 134, e(t), as part of a combined signal to the echo canceller 110. The echo canceller 110 functions to attempt to remove the echo signal 134 from the combined signal to provide an estimated voice signal 116, {circumflex over (v)}(t). The echo canceller 110 works to remove the echo signal 134 by processing the program content signal 102 through a filter 112 to produce an estimated echo signal 114, ê(t), which is subtracted from the signal provided by the microphone 130.
For example, the acoustic program signal 122 causes the echo signal 134. If the filter 112 performs well at providing an estimated echo signal 114, it will perform well at removing the echo signal 134 from the signal provided by the microphone 130. As a result, the estimated voice signal 116, {circumflex over (v)}(t), will be a good representation of the actual voice signal 136, v(t).
The echo canceller 110 may include an adaptive algorithm to update the filter 112, at intervals, to improve the estimated echo signal 114. Over time, the adaptive algorithm causes the filter 112 to converge on satisfactory parameters that produce a sufficiently accurate estimated echo signal 114. Generally, the adaptive algorithm updates the filter during times when the user 128 is not speaking, but in some examples the adaptive algorithm may make updates at any time. When the user 128 speaks, such is deemed “double talk,” and the microphone 130 picks up both the acoustic echo signal 124 and the acoustic voice signal 126. Regarding the terminology, the user 128 is “talking” at the same time as one or more acoustic drivers 120 are producing acoustic program content, or “talking,” hence, “double talk.”
The filter 112 may apply a set of filter coefficients to the program content signal 102 to produce the estimated echo signal 114, ê(t). The adaptive algorithm may use any of various techniques to determine the filter coefficients and to update, or change, the filter coefficients to improve performance of the filter 112. In some examples, the adaptive algorithm may operate on a background filter, separate from the filter 112, to seek out a set of filter coefficients that performs better than an active set of coefficients being used in the filter 112. When a better set of coefficients is identified, they may be copied to the filter 112 in active operation.
Such adaptive algorithms, whether operating on an active filter or a background filter, may include, for example, a least mean squares (LMS) algorithm, a normalized least mean squares (NLMS) algorithm, a recursive least square (RLS) algorithm, or any combination or variation of these or other algorithms. The filter 112, as adapted by the adaptive algorithm, converges to apply an estimated transfer function 118, ĥ(t), which is representative of the overall response of the processing 140, the acoustic driver(s) 120, the acoustic environment, and the microphone(s) 130, to the program content signal 102. The transfer function is a representation of how the program content signal 102 is transformed from its received form into the echo signal 134.
FIG. 2 illustrates an example multi-channel audio system 200 that includes source selection switching 210 to allow selection from among multiple sources 212 to provide one or more program content signals for rendering as acoustic signals. The audio system 200 also includes a sound stage processor 220 to control a number of acoustic transducers 222, at least one microphone input and/or at least one microphone 230 to pick up acoustic signals in the environment, including user voices and audio system echoes, an echo cancellation subsystem 240 for estimating the echo signal content of the audio signal provided by the microphone 230, and a controller 250 to manage one or more components of the source selection switching 210, the sound stage processor 220, and/or the echo cancellation subsystem 240.
In some examples, the echo cancellation subsystem 240 may operate on signals or signal channels after processing by the sound stage processor 220, rather than prior to sound stage processing as shown in the figures. For example, the echo cancellation subsystem 240 may operate on signals provided directly to the acoustic transducers 222, before or after amplification. In other examples, there may be various signal processing before, after, or both before and after the provision of such signals to the echo cancellation subsystem 240.
In some examples, the microphone 230 may be an array of microphones, having array processing to steer beams toward sources of desired acoustic signals and/or away from noise sources, and may additionally or alternately steer nulls toward noise sources. In such examples, the controller 250 may further control such array processing components, or such array processing components may be alternately controlled and/or may be pre-configured for various operating characteristics. In other examples, the microphone 230 may be a microphone input or other signal input suitable to receive an audio signal from a microphone, whether pre-processed, filtered, combined, etc.
Any of the sources 212 may include hardware for providing an audio signal, such as a radio tuner, navigation system, telephone system, and the like, or may include inputs to accept audio signals from an external device. For example, any of the sources 212 may include one or more physical electrical connections or wireless connections, or any combination of wired and wireless connections, and may include network interfaces to receive (and optionally to provide) various audio signals. Examples include audio jacks, such as 3.5 mm audio jacks, for example, Bluetooth® wireless interfaces and hardware, or the like, network interface jacks and/or connectors, such as an RJ-45 connector, for example, and wireless local area network (WLAN) interfaces and hardware, or any combination of these or other interfaces suitable for conveying audio signal content. Various of these or other interfaces may also include inputs to receive commands and control parameters, such as filter settings, equalization, volume control, or other sound stage parameters, etc.
The echo cancellation subsystem includes a number of echo cancellation filters 242, each of which is associated with a particular content channel 214. The content channels 214 provide content signals to the sound stage processor 220, from among the sources 212 (as selected by the source selection switching under the control of the controller 250). The sound stage processor 220 provides various processing, such as equalization and loudspeaker routing, to drive the acoustic transducers 222 to generate acoustic sound fields in accordance with the various program content signals and sound stage parameters.
The various sources 212 may provide audio content to be rendered within the environment, such as an interior occupant compartment of a vehicle, and may include numerous types of audio sources, such as radios, telephones, navigation systems, etc. Each of the sources 212 and each sub-channel provided by the sources 212 may have differing requirements for sound stage rendering, such as equalization settings and routing to various acoustic transducers 222 or groups of acoustics transducers 222.
Any of the sources 212 may have numerous sub-channels, such as left and right, front and rear, center, sub, or the like, and any of the sources 212 may have differing sub-channels based upon a mode of operation, such as a radio receiver may operate in different modes to receive audio content in a mono, stereo, or multi-channel surround format. Similarly, a video entertainment device may provide audio content in any of mono, stereo, surround, or other formats. Further, a video entertainment device may be selected to provide program content to be rendered in the rear of the vehicle while an audio entertainment device is selected to provide program content to be rendered in the front of the vehicle. At the same time, a telephone conversation may be selected to provide program content to be rendered acoustically near a passenger, and a navigation device may be selected to provide program content to be rendered acoustically near a driver. At any time, a warning system (e.g., lane drift, blind-spot detection, etc.) may provide content to be rendered at various locations.
As an example, a navigation system may use multiple sets of sound stage parameters to render announcements to come from various positions within the vehicle. For example, differing sound stage rendering parameters may produce an announcement “turn right” from the right side of the vehicle, and “turn left” from the left side of the vehicle, or a “continue ahead” announcement may come from the front center of the vehicle. In the first instance, the “turn right” may be routed to one or more acoustic transducers 222 so that the acoustic presentation sounds like it comes from the right side of the vehicle, and may include equalization appropriate for the particular acoustic transducers 222 to which it is routed. The “turn left” announcement may similarly be routed to one or more acoustic transducers 222 to sound like it comes from the left side of the vehicle, with appropriate equalization(s), and the “continue ahead” announcement may be routed to one or more acoustic transducers 222 so that a balanced acoustic signal is produced that sounds like it comes from a center position. Each of the acoustic transducers 222 may have its own equalization parameters, which may also vary based upon which of the sources 212 any particular audio signal originates. Further, each of the acoustic transducers 222 may have a limited frequency range. Additionally, a different equalization for a specific acoustic transducer 222 may be applied when that acoustic transducer 222 is grouped with other particular combinations of acoustic transducers 222, and so on.
As another example, each of a number of occupants may be listening to music at different volume levels, e.g., rendered by various acoustic transducers 222 in such manner to cause each occupant to hear a different volume level. At any time, one of the occupants may adjust his/her listening experience, such as by changing the volume or turning off the music altogether at his/her position. In some examples, each of the occupants may be able to listen to different music or audio sources at the same time.
As another example, while listening to music, an incoming telephone call may arrive and the driver may answer the telephone call. The audio system 200 may be configured to render the incoming audio of the telephone call so that the driver hears it well but the other occupants don't. Additionally, the sound system 200 may simultaneously cease or reduce the playback volume of other audio content at the driver's position. Further, the audio system 200 may allow the driver to “transfer” the call to a particular passenger, e.g, make a selection so that the sound stage processor 220 routes the incoming telephone audio to appropriate acoustic transducers 222, with appropriate equalization and/or playback volume, so that the selected passenger can hear it but it does not disturb the other occupants. Alternately, the driver may make a selection to have the telephone audio play for all the occupants to hear. Any other audio content currently playing may then be stopped by the audio system 200, or may have reduced playback volume. In some examples, the audio system 200 may accommodate multiple phones, for example via multiple Bluetooth® connections, and associate each phone with a particular occupant's position in a passenger compartment. An incoming telephone call may then be rendered by the audio system 200 to the particular passenger whose phone was called.
In accordance with all the above discussion and examples, the number of possible sound processing combinations and potential transitions may easily become substantial, even for an audio system having relatively few distinct audio sources.
Each of the above example program content sources 212 and sub-channels may have unique sound stage rendering 220 requirements at any given time, and every possible combination of source sub-channel and sound stage rendering parameters may exhibit a different transfer function from the source 212 to the microphone 230 where an echo of the source sub-channel may be received. Advantageously, not every combination will be in use at the same time, and audio systems and methods in accord with aspects and examples disclosed herein are capable of operation with a minimal number of echo canceller channels by adapting, storing, and loading sets of filter coefficients at appropriate times, and associating combinations of sources 212, sub-channels, and sound stage rendering parameters with stored filter coefficients.
With continued reference to FIG. 2, a particular example is described wherein a first source 212 may provide stereo (left and right) audio content to be rendered by the sound stage processor 220 through various of the acoustic transducers 222. In this example, two content channels 214 are used, a first content channel 214 to convey the left program content signal to the sound stage processor 220, and a second content channel 214 to convey the right program content signal to the sound stage processor 220. The sound stage processor may be programmed, controlled, or otherwise configured to produce (e.g., render) the left channel from the left of a vehicle (or other environment in which the audio system 200 is operated) and to produce the right channel from the right of the vehicle. A first echo cancellation filter 242 a receives the left program content signal from the first content channel 214 and produces a first estimated echo signal 244 a associated with the left of the vehicle. A second echo cancellation filter 242 b receives the right program content signal from the second content channel 214 and produces a second estimated echo signal 244 b associated with the right of the vehicle. In this example, no more program content is being rendered. Accordingly, no additional content channels 214 or echo cancellation filters 242 are used. The first and second estimated echo signals 244 a, 244 b are added together to produce a combined estimated echo signal. The combined estimated echo signal is subtracted from the microphone signal 232 to produce an estimated voice signal 216, similar to that described above with reference to FIG. 1. Adaptation of the first and second echo cancellation filters 242 a, 242 b may be carried out by one or more adaptation blocks 246, in a manner similar to the adaptive algorithm(s) described above with reference to FIG. 1. It should be understood the adaptation block 246 receives the various program content signals from the content channels 214, though for simplicity in FIG. 2 such is not explicitly illustrated.
Expanding upon the above example, while the first source 212 is providing left and right content on two content channels 214, respectively, a navigation system may be a second source 212 that may provide content to rendered to the left, to the right, or to the center, each with differing sound stage rendering parameters, as previously described. Rather than dedicate three additional content channels 214 and echo cancellation filters 242 to the second source 212, the audio system 200 is capable to take advantage of the fact that the navigation system will only use one of the left, right, or center sound stage combinations at any given time. Additionally, the navigation system may be idle for some time before a navigation announcement needs to be rendered by the sound stage processor. Accordingly, upon a signal from the navigation system that it has content to be rendered in accord with a particular set of sound stage parameters, the audio system 200 may allocate a single content channel 214 and a single echo cancellation filter 242 to the navigation system. The echo cancellation filter 242 to be allocated, however, has not been in operation until this point (in this example) and does not have an appropriate set of filter coefficients to cancel an echo component from the navigation system. Accordingly, the echo cancellation subsystem 240 includes storage 248 that contains an appropriate set of filter coefficients to cancel an echo component from the navigation system, for a given sound stage rendering configuration.
For example, upon the signal from the navigation system that it has content to be rendered in accord with a particular set of sound stage parameters, the controller 250 and/or the echo cancellation subsystem 240 may locate the appropriate set of filter coefficients to cancel an echo component from the navigation system for the given sound stage parameters. If the navigation system indicates that an announcement is to be acoustically rendered from the left, a previously stored set of filter coefficients is selected from the storage 248 and copied to the appropriate echo cancellation filter 242, and used to cancel (or reduce) echo content in the microphone signal 232 due to the left-rendered navigation announcement. While the navigation system is providing content to be left-rendered, the filter adaptation block 246 may operate to adapt (e.g., adjust) the filter coefficients, in the foreground or background as described previously. If the adaptation block 246 converges on new filter coefficients, the new filter coefficients may be copied into the storage 248 and associated with, e.g., left-rendered navigation announcements, for future use the next time the navigation system has an announcement to rendered in a similar manner.
In some cases, a user may adjust certain audio system controls, such as tone, balance, or others, that effect the transfer function between a source 212 and an echo component of a microphone signal 232. One advantage of the above example of operation of the audio system 200 is that filter coefficients stored in the storage 248 may be updated, e.g., by copying new filter coefficients determined by the adaptation block 246, either at intervals or at the end of use of one of the echo cancellation filters 242, or both. Additionally or alternately, certain user adjustment, such as tone or others, may be applied at various locations, such as before provision of the content signal to an echo cancellation filter 242, which may reduce the need for adaptation of filter coefficients when the user makes such adjustments.
FIG. 3 illustrates an example operational method 300 that may be performed by an audio system such as the audio system 200 of FIG. 2 to allow reallocation of echo cancellation filters to various combinations of content signals and sound stage rendering parameters, on demand, to thereby reduce the total number of echo cancellation filters needed in a particular system. The method 300 includes receiving one or more program content signals (block 310) and rendering the program content signals (block 320) according to one or more sound stage parameters, for example by the sound stage processor 220 via one or more acoustic transducers 222. At block 330, echo cancellation filters 242 are operated normally to reduce echo from a microphone signal and to adapt their filter coefficients. If a new source sub-channel is requested (block 340), the method 300 allocates a content channel 214 and an echo cancellation filter 242 to the new request (block 350), locates appropriate filter coefficients in storage 248 and copies the filter coefficients to the echo cancellation filter (block 360), and continues to render all requested program content material (block 320), including the new source sub-channel. Whenever a source sub-channel is no longer needed, e.g., terminated (block 370), filter coefficients may be copied (block 380) from the allocated echo cancellation filter 242 to the storage 248, the content channel 214 and the echo cancellation filter 242 are de-allocated (block 390), and rendering continues for any remaining program content channels (block 320).
A program content signal may have any suitable spectral range, such as, for example, 20 Hz to 20,000 Hz being an acoustic range typically accepted as matching that of the human ear. In some examples, however, removing an echo signal based upon the program content signal may be limited to a narrower spectrum. In certain examples, the microphone signal may be filtered to a narrower bandwidth because it may be intended to pick up human vocal activity, and may only require a lower frequency bound as low as, e.g., 60 Hz, and/or an upper frequency bound as high as, e.g., 8,000 Hz or 10,000 Hz, for example. In certain embodiments, the microphone signal may be filtered, controlled, or otherwise limited to a frequency spectrum in the range of 60 Hz to 8,000 Hz, or from 100 Hz to 4,000 Hz, or any other suitable range.
In some examples, an audio system may include a plurality of acoustic drivers and/or a plurality of microphones, and may include various processing, which may include array processing, to process signals to the acoustic drivers and/or to process signals from the microphones, or a sub-set of either the acoustic drivers or microphones, as appropriate for various applications and/or changing operational requirements.
It should be understood that many, if not all, of the functions, methods, and/or components of the systems disclosed herein according to various aspects and examples may be implemented or carried out in a digital signal processor (DSP) and/or other circuitry, analog or digital, suitable for performing signal processing and other functions in accord with the aspects and examples disclosed herein. Additionally or alternatively, a microprocessor, a logic controller, logic circuits, field programmable gate array(s) (FPGA), application-specific integrated circuit(s) (ASIC), general computing processor(s), micro-controller(s), and the like, or any combination of these, may be suitable, and may include analog or digital circuit components and/or other components with respect to any particular implementation. Functions and components disclosed herein may operate in the digital domain, the analog domain, or a combination of the two, and certain examples include analog-to-digital converter(s) (ADC) and/or digital-to-analog converter(s) (DAC) where appropriate, despite the lack of illustration of ADC's or DAC's in the various figures. Any suitable hardware and/or software, including firmware and the like, may be configured to carry out or implement components of the aspects and examples disclosed herein, and various implementations of aspects and examples may include components and/or functionality in addition to those disclosed. Various implementations may include stored instructions for a digital signal processor and/or other circuitry to enable the circuitry, at least in part, to perform the functions described herein.
It should be understood that an acoustic transducer, driver, or loudspeaker, may be any of many types of transducers known in the art. For example, an acoustic structure coupled to a magnetic coil positioned in a magnetic field, to cause motion in response to electrical signals received by the coil, may be a suitable acoustic transducer. Additionally, a piezoelectric material may respond to electrical signals by expanding or contracting in one or more dimensions and may be a suitable acoustic transducer. In various examples, acoustic transducers may take other forms.
Having described above several aspects of at least one example, it is to be appreciated various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure and are intended to be within the scope of the invention. Accordingly, the foregoing description and drawings are by way of example only, and the scope of the invention should be determined from proper construction of the appended claims, and their equivalents.

Claims (20)

What is claimed is:
1. A method of reducing echo content of an audio signal, comprising:
receiving an audio program content signal;
receiving a plurality of microphone signals;
identifying an audio system configuration;
selecting a set of filter coefficients from among a plurality of stored sets of filter coefficients based upon the audio system configuration, the selected set of filter coefficients representing an estimated echo response of the audio system including an array processing configuration of the plurality of microphone signals;
array processing the plurality of microphone signals in accord with the array processing configuration to provide an arrayed microphone signal;
filtering the audio program content signal, using the selected set of filter coefficients, to generate an estimated echo signal; and
subtracting the estimated echo signal from the arrayed microphone signal to generate an output audio signal.
2. The method of claim 1 further comprising loading the selected set of filter coefficients to an audio filter and activating the audio filter to perform the filtering.
3. The method of claim 1 further comprising rendering the audio program content signal into an acoustic signal, based upon the identified audio system configuration.
4. The method of claim 1 further comprising loading the selected set of filter coefficients to an adaptive filter, adapting the adaptive filter coefficients, and copying the adaptive filter coefficients to an active audio filter that performs the filtering.
5. The method of claim 1 further comprising loading the selected set of filter coefficients to an adaptive filter, the adaptive filter performing the filtering.
6. The method of claim 5 further comprising detecting double-talk and disabling an adaptive component of the adaptive filter while double-talk is detected.
7. The method of claim 1 further comprising storing adapted filter coefficients and associating the stored filter coefficients with the identified audio system configuration.
8. The method of claim 1 further comprising changing the audio system configuration by identifying a second audio system configuration, selecting a second set of filter coefficients based upon the second audio system configuration, the second selected set of filter coefficients representing an estimated echo response of the audio system including a second array processing configuration of the plurality of microphone signals, array processing the plurality of microphone signals in accord with the second array processing configuration, and filtering the audio program content signal using the second selected set of filter coefficients to generate the estimated echo signal.
9. An audio system comprising:
a first input to receive an audio content signal;
a loudspeaker output configured to provide a processed version of the audio content signal to a loudspeaker for rendering an acoustic signal in accord with a sound stage of an audio system configuration;
a second input to receive a plurality of microphone signals;
an array processor configured to provide an arrayed microphone signal as an arrayed combination of the plurality of microphone signals, the arrayed combination being in accord with the audio system configuration;
an audio filter configured to filter the audio content signal according to a set of filter coefficients, the set of filter coefficients selected from among a plurality of sets of filter coefficients based upon the audio system configuration; and
a memory configured to store the plurality of sets of filter coefficients.
10. The audio system of claim 9 further comprising a combiner configured to subtract the filtered audio content signal from the microphone signal to provide an output signal.
11. The audio system of claim 9 further comprising a processor configured to select the selected set of filter coefficients and to copy the selected set of filter coefficients from the memory to the audio filter.
12. The audio system of claim 9 further comprising an adaptive filter to filter the audio content signal according to the set of filter coefficients and to provide an updated set of filter coefficients.
13. The audio system of claim 9 further comprising a processing block configured to determine whether an updated set of filter coefficients performs better than the selected set of filter coefficients, and to copy the updated set of filter coefficients to at least one of the audio filter and the memory.
14. The audio system of claim 9 further comprising a processing block configured to copy a set of filter coefficients from the audio filter to the memory and to associate the copied filter coefficients with the audio system configuration.
15. The audio system of claim 9 further comprising a processing block configured to select a second set of filter coefficients and to copy the second selected set of filter coefficients from the memory to the audio filter in response to a second audio system configuration.
16. A multi-channel audio system comprising:
a sound stage processor having one or more outputs configured to provide processed signals;
a plurality of content channels, each of the plurality of content channels configured to convey a selected audio content signal from a source to the sound stage processor; and
a plurality of echo canceling filters, each of the echo canceling filters associated with one of the plurality of content channels, and each of the echo canceling filters configured to filter the associated selected audio content signal into an estimated echo signal using a set of filter coefficients selected from among a plurality of sets of filter coefficients, the selected set of filter coefficients representing an estimated echo response of the audio system to the selected audio content signal, including an array processing configuration of a plurality of microphone signals.
17. The multi-channel audio system of claim 16 further comprising one or more loudspeakers coupled to the one or more outputs to receive the processed signals and to produce acoustic signals responsive to the processed signals.
18. The multi-channel audio system of claim 16 further comprising a microphone input to receive an arrayed combination of microphone signals and a signal combiner configured to subtract the plurality of estimated echo signals from the arrayed combination of microphone signals.
19. The multi-channel audio system of claim 16 further comprising a plurality of microphones configured to receive acoustic signals and to provide at least one microphone signal from which the plurality of estimated echo signals is subtracted to produce an output signal.
20. The multi-channel audio system of claim 16 further comprising a memory to store the plurality of sets of filter coefficients.
US16/242,616 2017-08-03 2019-01-08 Efficient reutilization of acoustic echo canceler channels Active US10601998B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/242,616 US10601998B2 (en) 2017-08-03 2019-01-08 Efficient reutilization of acoustic echo canceler channels

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/667,988 US10200540B1 (en) 2017-08-03 2017-08-03 Efficient reutilization of acoustic echo canceler channels
US16/242,616 US10601998B2 (en) 2017-08-03 2019-01-08 Efficient reutilization of acoustic echo canceler channels

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US15/667,988 Continuation US10200540B1 (en) 2017-08-03 2017-08-03 Efficient reutilization of acoustic echo canceler channels

Publications (2)

Publication Number Publication Date
US20190141195A1 US20190141195A1 (en) 2019-05-09
US10601998B2 true US10601998B2 (en) 2020-03-24

Family

ID=63407516

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/667,988 Active US10200540B1 (en) 2017-08-03 2017-08-03 Efficient reutilization of acoustic echo canceler channels
US16/242,616 Active US10601998B2 (en) 2017-08-03 2019-01-08 Efficient reutilization of acoustic echo canceler channels

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US15/667,988 Active US10200540B1 (en) 2017-08-03 2017-08-03 Efficient reutilization of acoustic echo canceler channels

Country Status (3)

Country Link
US (2) US10200540B1 (en)
EP (1) EP3662649B1 (en)
WO (1) WO2019028111A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10938994B2 (en) * 2018-06-25 2021-03-02 Cypress Semiconductor Corporation Beamformer and acoustic echo canceller (AEC) system

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10200540B1 (en) * 2017-08-03 2019-02-05 Bose Corporation Efficient reutilization of acoustic echo canceler channels
EP3692704B1 (en) 2017-10-03 2023-09-06 Bose Corporation Spatial double-talk detector
US11046256B2 (en) 2019-06-17 2021-06-29 Bose Corporation Systems and methods for canceling road noise in a microphone signal
CN111726464B (en) * 2020-06-29 2021-04-20 珠海全志科技股份有限公司 Multichannel echo filtering method, filtering device and readable storage medium

Citations (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5371789A (en) * 1992-01-31 1994-12-06 Nec Corporation Multi-channel echo cancellation with adaptive filters having selectable coefficient vectors
US5960077A (en) * 1996-03-28 1999-09-28 Mitsubishi Denki Kabushiki Kaisha Echo canceller
US6049607A (en) * 1998-09-18 2000-04-11 Lamar Signal Processing Interference canceling method and apparatus
US6246760B1 (en) * 1996-09-13 2001-06-12 Nippon Telegraph & Telephone Corporation Subband echo cancellation method for multichannel audio teleconference and echo canceller using the same
US20010024499A1 (en) * 2000-03-03 2001-09-27 Nec Corporation Adaptive filter and echo canceller using the same
US6381272B1 (en) * 1998-03-24 2002-04-30 Texas Instruments Incorporated Multi-channel adaptive filtering
US20030039353A1 (en) * 2001-08-13 2003-02-27 Fujitsu Limited Echo cancellation processing system
US6553122B1 (en) * 1998-03-05 2003-04-22 Nippon Telegraph And Telephone Corporation Method and apparatus for multi-channel acoustic echo cancellation and recording medium with the method recorded thereon
US6678376B1 (en) * 1999-12-07 2004-01-13 Mitsubishi Denki Kabushiki Kaisha Echo canceling apparatus
US20040071284A1 (en) * 2002-08-16 2004-04-15 Abutalebi Hamid Reza Method and system for processing subband signals using adaptive filters
US20040174991A1 (en) * 2001-07-11 2004-09-09 Yamaha Corporation Multi-channel echo cancel method, multi-channel sound transfer method, stereo echo canceller, stereo sound transfer apparatus and transfer function calculation apparatus
US20060153360A1 (en) * 2004-09-03 2006-07-13 Walter Kellermann Speech signal processing with combined noise reduction and echo compensation
US20060245583A1 (en) * 2003-07-17 2006-11-02 Matsushita Electric Industrial Co., Ltd. Speech communication apparatus
US20070263849A1 (en) * 2006-04-28 2007-11-15 Microsoft Corporation Integration of a microphone array with acoustic echo cancellation and center clipping
US20070263850A1 (en) * 2006-04-28 2007-11-15 Microsoft Corporation Integration of a microphone array with acoustic echo cancellation and residual echo suppression
US20080008333A1 (en) * 2006-07-06 2008-01-10 Tsuyoki Nishikawa Multichannel echo canceller
US20080107281A1 (en) * 2006-11-02 2008-05-08 Masahito Togami Acoustic echo canceller system
US7433908B2 (en) * 2002-07-16 2008-10-07 Tellabs Operations, Inc. Selective-partial-update proportionate normalized least-mean-square adaptive filtering for network echo cancellation
US20090046866A1 (en) * 2007-08-15 2009-02-19 Fortemedia, Inc. Apparatus capable of performing acoustic echo cancellation and a method thereof
US7657038B2 (en) * 2003-07-11 2010-02-02 Cochlear Limited Method and device for noise reduction
US20100074432A1 (en) * 2008-09-25 2010-03-25 Magor Communications Corporation Double-talk detection
US7831036B2 (en) * 2005-05-09 2010-11-09 Mitel Networks Corporation Method to reduce training time of an acoustic echo canceller in a full-duplex beamforming-based audio conferencing system
US20100290615A1 (en) * 2009-05-13 2010-11-18 Oki Electric Industry Co., Ltd. Echo canceller operative in response to fluctuation on echo path
US20110091031A1 (en) * 2008-06-11 2011-04-21 Mitsubishi Electric Corporation Echo canceler
US20110135105A1 (en) * 2008-09-24 2011-06-09 Atsuyoshi Yano Echo canceller
US20110211706A1 (en) 2008-11-05 2011-09-01 Yamaha Corporation Sound emission and collection device and sound emission and collection method
US8213596B2 (en) * 2005-04-01 2012-07-03 Mitel Networks Corporation Method of accelerating the training of an acoustic echo canceller in a full-duplex beamforming-based audio conferencing system
US20120288100A1 (en) * 2011-05-11 2012-11-15 Samsung Electronics Co., Ltd. Method and apparatus for processing multi-channel de-correlation for cancelling multi-channel acoustic echo
US20130035777A1 (en) * 2009-09-07 2013-02-07 Nokia Corporation Method and an apparatus for processing an audio signal
US8385557B2 (en) * 2008-06-19 2013-02-26 Microsoft Corporation Multichannel acoustic echo reduction
US20130294611A1 (en) * 2012-05-04 2013-11-07 Sony Computer Entertainment Inc. Source separation by independent component analysis in conjuction with optimization of acoustic echo cancellation
US8787560B2 (en) * 2009-02-23 2014-07-22 Nuance Communications, Inc. Method for determining a set of filter coefficients for an acoustic echo compensator
US20140349638A1 (en) * 2013-05-24 2014-11-27 Broadcom Corporation Signal processing control in an audio device
US20150030172A1 (en) * 2013-07-24 2015-01-29 Mh Acoustics, Llc Inter-Channel Coherence Reduction for Stereophonic and Multichannel Acoustic Echo Cancellation
US20160275961A1 (en) * 2015-03-18 2016-09-22 Qualcomm Technologies International, Ltd. Structure for multi-microphone speech enhancement system
US9554210B1 (en) * 2015-06-25 2017-01-24 Amazon Technologies, Inc. Multichannel acoustic echo cancellation with unique individual channel estimations
US9754605B1 (en) * 2016-06-09 2017-09-05 Amazon Technologies, Inc. Step-size control for multi-channel acoustic echo canceller
US9928847B1 (en) * 2017-08-04 2018-03-27 Revolabs, Inc. System and method for acoustic echo cancellation
US9966059B1 (en) * 2017-09-06 2018-05-08 Amazon Technologies, Inc. Reconfigurale fixed beam former using given microphone array
US9973849B1 (en) * 2017-09-20 2018-05-15 Amazon Technologies, Inc. Signal quality beam selection
US20180331719A1 (en) * 2015-11-16 2018-11-15 Mitsubishi Electric Corporation Echo canceller device and voice telecommunications device
US20180343345A1 (en) * 2015-11-16 2018-11-29 Mitsubishi Electric Corporation Echo canceller device and voice telecommunications device
US20180350379A1 (en) * 2017-06-02 2018-12-06 Apple Inc. Multi-Channel Speech Signal Enhancement for Robust Voice Trigger Detection and Automatic Speech Recognition
US10200540B1 (en) * 2017-08-03 2019-02-05 Bose Corporation Efficient reutilization of acoustic echo canceler channels
US20190045065A1 (en) * 2017-08-03 2019-02-07 Bose Corporation Multi-channel residual echo suppression
US20190045066A1 (en) * 2017-08-03 2019-02-07 Bose Corporation Mitigating impact of double talk for residual echo suppressors

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9211756D0 (en) * 1992-06-03 1992-07-15 Gerzon Michael A Stereophonic directional dispersion method
JP3385221B2 (en) * 1998-11-16 2003-03-10 沖電気工業株式会社 Echo canceller
US7310425B1 (en) * 1999-12-28 2007-12-18 Agere Systems Inc. Multi-channel frequency-domain adaptive filter method and apparatus
US8605911B2 (en) * 2001-07-10 2013-12-10 Dolby International Ab Efficient and scalable parametric stereo coding for low bitrate audio coding applications
DE10153188C2 (en) * 2001-10-27 2003-08-21 Grundig Ag I Ins Device and method for multi-channel acoustic echo cancellation with a variable number of channels
CN1826797A (en) * 2003-05-27 2006-08-30 皇家飞利浦电子股份有限公司 Loudspeaker-microphone system with echo cancellation system and method for echo cancellation
US20050213747A1 (en) * 2003-10-07 2005-09-29 Vtel Products, Inc. Hybrid monaural and multichannel audio for conferencing
EP1761110A1 (en) * 2005-09-02 2007-03-07 Ecole Polytechnique Fédérale de Lausanne Method to generate multi-channel audio signals from stereo signals
KR100636248B1 (en) * 2005-09-26 2006-10-19 삼성전자주식회사 Apparatus and method for cancelling vocal
ATE448638T1 (en) * 2006-04-13 2009-11-15 Fraunhofer Ges Forschung AUDIO SIGNAL DECORRELATOR
DE602006009770D1 (en) 2006-05-08 2009-11-26 Harman Becker Automotive Sys Echo reduction for time variant systems
US9560448B2 (en) * 2007-05-04 2017-01-31 Bose Corporation System and method for directionally radiating sound
JP5071480B2 (en) 2007-08-24 2012-11-14 富士通株式会社 Echo suppression device, echo suppression system, echo suppression method, and computer program
US8126172B2 (en) * 2007-12-06 2012-02-28 Harman International Industries, Incorporated Spatial processing stereo system
US8605890B2 (en) * 2008-09-22 2013-12-10 Microsoft Corporation Multichannel acoustic echo cancellation
CN102687536B (en) * 2009-10-05 2017-03-08 哈曼国际工业有限公司 System for the spatial extraction of audio signal
US8219394B2 (en) * 2010-01-20 2012-07-10 Microsoft Corporation Adaptive ambient sound suppression and speech tracking
JP5391103B2 (en) 2010-02-10 2014-01-15 日本電信電話株式会社 Multi-channel echo canceling method, multi-channel echo canceling apparatus, multi-channel echo canceling program and recording medium therefor
EP2418874B1 (en) * 2010-08-11 2012-10-31 Sony Computer Entertainment Europe Ltd. Apparatus and method of audio reproduction
US8824709B2 (en) * 2010-10-14 2014-09-02 National Semiconductor Corporation Generation of 3D sound with adjustable source positioning
EP2477188A1 (en) * 2011-01-18 2012-07-18 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Encoding and decoding of slot positions of events in an audio signal frame
EP2984763B1 (en) * 2013-04-11 2018-02-21 Nuance Communications, Inc. System for automatic speech recognition and audio entertainment
US9866986B2 (en) * 2014-01-24 2018-01-09 Sony Corporation Audio speaker system with virtual music performance
US9712866B2 (en) * 2015-04-16 2017-07-18 Comigo Ltd. Cancelling TV audio disturbance by set-top boxes in conferences
US10063962B2 (en) * 2015-06-30 2018-08-28 Apple Inc. Vented acoustic enclosures and related systems

Patent Citations (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5371789A (en) * 1992-01-31 1994-12-06 Nec Corporation Multi-channel echo cancellation with adaptive filters having selectable coefficient vectors
US5960077A (en) * 1996-03-28 1999-09-28 Mitsubishi Denki Kabushiki Kaisha Echo canceller
US6246760B1 (en) * 1996-09-13 2001-06-12 Nippon Telegraph & Telephone Corporation Subband echo cancellation method for multichannel audio teleconference and echo canceller using the same
US6553122B1 (en) * 1998-03-05 2003-04-22 Nippon Telegraph And Telephone Corporation Method and apparatus for multi-channel acoustic echo cancellation and recording medium with the method recorded thereon
US6381272B1 (en) * 1998-03-24 2002-04-30 Texas Instruments Incorporated Multi-channel adaptive filtering
US6049607A (en) * 1998-09-18 2000-04-11 Lamar Signal Processing Interference canceling method and apparatus
US6678376B1 (en) * 1999-12-07 2004-01-13 Mitsubishi Denki Kabushiki Kaisha Echo canceling apparatus
US20010024499A1 (en) * 2000-03-03 2001-09-27 Nec Corporation Adaptive filter and echo canceller using the same
US20040174991A1 (en) * 2001-07-11 2004-09-09 Yamaha Corporation Multi-channel echo cancel method, multi-channel sound transfer method, stereo echo canceller, stereo sound transfer apparatus and transfer function calculation apparatus
US20030039353A1 (en) * 2001-08-13 2003-02-27 Fujitsu Limited Echo cancellation processing system
US7433908B2 (en) * 2002-07-16 2008-10-07 Tellabs Operations, Inc. Selective-partial-update proportionate normalized least-mean-square adaptive filtering for network echo cancellation
US20040071284A1 (en) * 2002-08-16 2004-04-15 Abutalebi Hamid Reza Method and system for processing subband signals using adaptive filters
US7657038B2 (en) * 2003-07-11 2010-02-02 Cochlear Limited Method and device for noise reduction
US20060245583A1 (en) * 2003-07-17 2006-11-02 Matsushita Electric Industrial Co., Ltd. Speech communication apparatus
US20060153360A1 (en) * 2004-09-03 2006-07-13 Walter Kellermann Speech signal processing with combined noise reduction and echo compensation
US8213596B2 (en) * 2005-04-01 2012-07-03 Mitel Networks Corporation Method of accelerating the training of an acoustic echo canceller in a full-duplex beamforming-based audio conferencing system
US7831036B2 (en) * 2005-05-09 2010-11-09 Mitel Networks Corporation Method to reduce training time of an acoustic echo canceller in a full-duplex beamforming-based audio conferencing system
US20070263850A1 (en) * 2006-04-28 2007-11-15 Microsoft Corporation Integration of a microphone array with acoustic echo cancellation and residual echo suppression
US20070263849A1 (en) * 2006-04-28 2007-11-15 Microsoft Corporation Integration of a microphone array with acoustic echo cancellation and center clipping
US20080008333A1 (en) * 2006-07-06 2008-01-10 Tsuyoki Nishikawa Multichannel echo canceller
US20080107281A1 (en) * 2006-11-02 2008-05-08 Masahito Togami Acoustic echo canceller system
US20090046866A1 (en) * 2007-08-15 2009-02-19 Fortemedia, Inc. Apparatus capable of performing acoustic echo cancellation and a method thereof
US20110091031A1 (en) * 2008-06-11 2011-04-21 Mitsubishi Electric Corporation Echo canceler
US8385557B2 (en) * 2008-06-19 2013-02-26 Microsoft Corporation Multichannel acoustic echo reduction
US20110135105A1 (en) * 2008-09-24 2011-06-09 Atsuyoshi Yano Echo canceller
US20100074432A1 (en) * 2008-09-25 2010-03-25 Magor Communications Corporation Double-talk detection
US20110211706A1 (en) 2008-11-05 2011-09-01 Yamaha Corporation Sound emission and collection device and sound emission and collection method
US8787560B2 (en) * 2009-02-23 2014-07-22 Nuance Communications, Inc. Method for determining a set of filter coefficients for an acoustic echo compensator
US20100290615A1 (en) * 2009-05-13 2010-11-18 Oki Electric Industry Co., Ltd. Echo canceller operative in response to fluctuation on echo path
US20130035777A1 (en) * 2009-09-07 2013-02-07 Nokia Corporation Method and an apparatus for processing an audio signal
US20120288100A1 (en) * 2011-05-11 2012-11-15 Samsung Electronics Co., Ltd. Method and apparatus for processing multi-channel de-correlation for cancelling multi-channel acoustic echo
US20130294611A1 (en) * 2012-05-04 2013-11-07 Sony Computer Entertainment Inc. Source separation by independent component analysis in conjuction with optimization of acoustic echo cancellation
US20140349638A1 (en) * 2013-05-24 2014-11-27 Broadcom Corporation Signal processing control in an audio device
US20150030172A1 (en) * 2013-07-24 2015-01-29 Mh Acoustics, Llc Inter-Channel Coherence Reduction for Stereophonic and Multichannel Acoustic Echo Cancellation
US20160275961A1 (en) * 2015-03-18 2016-09-22 Qualcomm Technologies International, Ltd. Structure for multi-microphone speech enhancement system
US9554210B1 (en) * 2015-06-25 2017-01-24 Amazon Technologies, Inc. Multichannel acoustic echo cancellation with unique individual channel estimations
US20180343345A1 (en) * 2015-11-16 2018-11-29 Mitsubishi Electric Corporation Echo canceller device and voice telecommunications device
US20180331719A1 (en) * 2015-11-16 2018-11-15 Mitsubishi Electric Corporation Echo canceller device and voice telecommunications device
US9754605B1 (en) * 2016-06-09 2017-09-05 Amazon Technologies, Inc. Step-size control for multi-channel acoustic echo canceller
US20180350379A1 (en) * 2017-06-02 2018-12-06 Apple Inc. Multi-Channel Speech Signal Enhancement for Robust Voice Trigger Detection and Automatic Speech Recognition
US10200540B1 (en) * 2017-08-03 2019-02-05 Bose Corporation Efficient reutilization of acoustic echo canceler channels
US20190045065A1 (en) * 2017-08-03 2019-02-07 Bose Corporation Multi-channel residual echo suppression
US20190045066A1 (en) * 2017-08-03 2019-02-07 Bose Corporation Mitigating impact of double talk for residual echo suppressors
US9928847B1 (en) * 2017-08-04 2018-03-27 Revolabs, Inc. System and method for acoustic echo cancellation
US9966059B1 (en) * 2017-09-06 2018-05-08 Amazon Technologies, Inc. Reconfigurale fixed beam former using given microphone array
US9973849B1 (en) * 2017-09-20 2018-05-15 Amazon Technologies, Inc. Signal quality beam selection

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10938994B2 (en) * 2018-06-25 2021-03-02 Cypress Semiconductor Corporation Beamformer and acoustic echo canceller (AEC) system

Also Published As

Publication number Publication date
EP3662649A1 (en) 2020-06-10
US10200540B1 (en) 2019-02-05
US20190141195A1 (en) 2019-05-09
US20190045064A1 (en) 2019-02-07
WO2019028111A1 (en) 2019-02-07
EP3662649B1 (en) 2023-06-28

Similar Documents

Publication Publication Date Title
US10601998B2 (en) Efficient reutilization of acoustic echo canceler channels
CN110476208B (en) Audio system and method for disturbance signal compensation
US10904396B2 (en) Multi-channel residual echo suppression
US10594869B2 (en) Mitigating impact of double talk for residual echo suppressors
US10115412B2 (en) Signal processor with side-tone noise reduction for a headset
JP4697553B2 (en) Sound playback device with hands-free call function
JP2007235943A (en) Hands-free system for speech signal acquisition
US11146887B2 (en) Acoustical in-cabin noise cancellation system for far-end telecommunications
US11600287B2 (en) Cancellation of vehicle active sound management signals for handsfree systems
JP2001095083A (en) Method and device for compensating loss of signal
US20200372926A1 (en) Acoustical in-cabin noise cancellation system for far-end telecommunications
EP3742714B1 (en) Mitigating impact of double talk for residual echo suppressors
US11678114B2 (en) Sound collection loudspeaker apparatus, method and program for the same
JP2010163054A (en) Conversation support device and conversation support method
WO2018222683A1 (en) Dynamic spectral filtering
US11516584B2 (en) Sound collection loudspeaker apparatus, method and program for the same
JP4162860B2 (en) Unnecessary sound signal removal device
GB2558529A (en) Dynamically increased noise suppression based on input noise characteristics
US7751856B2 (en) Coordination of apparatus and mobile terminal media processing circuitry

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

AS Assignment

Owner name: BOSE CORPORATION, MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HERA, CRISTIAN MARIUS;KATHAVARAYAN, VIGNEISH;VAUTIN, JEFFERY R;AND OTHERS;SIGNING DATES FROM 20170830 TO 20171204;REEL/FRAME:051832/0201

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4