Nothing Special   »   [go: up one dir, main page]

EP3602538A2 - Compensation and automatic gain control in active noise reduction devices - Google Patents

Compensation and automatic gain control in active noise reduction devices

Info

Publication number
EP3602538A2
EP3602538A2 EP18718353.8A EP18718353A EP3602538A2 EP 3602538 A2 EP3602538 A2 EP 3602538A2 EP 18718353 A EP18718353 A EP 18718353A EP 3602538 A2 EP3602538 A2 EP 3602538A2
Authority
EP
European Patent Office
Prior art keywords
signal
anr
compensator
input signal
filter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP18718353.8A
Other languages
German (de)
French (fr)
Other versions
EP3602538B1 (en
Inventor
Joseph H. CATTELL
Michael O'connell
Ricardo F. Carreras
David WARKENTIN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bose Corp
Original Assignee
Bose Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/473,889 external-priority patent/US10553195B2/en
Priority claimed from US15/473,939 external-priority patent/US10614790B2/en
Priority claimed from US15/473,926 external-priority patent/US10580398B2/en
Application filed by Bose Corp filed Critical Bose Corp
Priority to EP19201902.4A priority Critical patent/EP3627493B1/en
Priority to EP19201934.7A priority patent/EP3618058B1/en
Publication of EP3602538A2 publication Critical patent/EP3602538A2/en
Application granted granted Critical
Publication of EP3602538B1 publication Critical patent/EP3602538B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1781Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
    • G10K11/17821Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the input signals only
    • G10K11/17827Desired external signals, e.g. pass-through audio such as music or speech
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787General system configurations
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787General system configurations
    • G10K11/17879General system configurations using both a reference signal and an error signal
    • G10K11/17881General system configurations using both a reference signal and an error signal the reference signal being an acoustic signal, e.g. recorded with a microphone
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787General system configurations
    • G10K11/17885General system configurations additionally using a desired external signal, e.g. pass-through audio such as music or speech
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083Reduction of ambient noise
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10Applications
    • G10K2210/108Communication systems, e.g. where useful sound is kept and noise is cancelled
    • G10K2210/1081Earphones, e.g. for telephones, ear protectors or headsets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1041Mechanical or electronic switches, or control elements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2410/00Microphones
    • H04R2410/05Noise reduction with a separate noise microphone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/01Hearing devices using active noise cancellation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/005Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Definitions

  • This disclosure generally relates to technology for controlling overload conditions in active noise reducing (ANR) devices.
  • ANR active noise reducing
  • ANR devices can utilize one or more digital signal processors (DSPs) for implementing various signal flow topologies. Examples of such DSPs are described in U.S. Patents 8,073, 150 and 8,073, 151 , which are incorporated herein by reference in their entirety.
  • this document features a method that includes receiving an input signal representing audio captured by a microphone of an active noise reduction (ANR) headphone, and processing, by a first compensator, a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone.
  • the method also includes processing, by a second compensator disposed in parallel to the first compensator, a second frequency range of the input signal to generate a second signal for the acoustic transducer.
  • the first frequency range includes frequencies higher than the frequencies in the second frequency range.
  • the method also includes detecting, by one or more processing devices, that the second signal satisfies a threshold condition, and attenuating the second signal responsive to determining that the second signal satisfies the threshold condition.
  • this document features an active noise reduction (ANR) device that includes one or more sensors configured to generate an input signal indicative of an external environment of the ANR device.
  • the device also includes a first compensator configured to process a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone, and a second compensator disposed in parallel to the first compensator.
  • the second compensator filter is configured to process a second frequency range of the input signal to generate a second signal for the acoustic transducer, wherein the first frequency range includes frequencies higher than the frequencies in the second frequency range.
  • the device further includes one or more processing devices configured to detect that the second signal satisfies a threshold condition, and attenuate the second signal responsive to determining that the second signal satisfies the threshold condition.
  • this document features one or more machine- readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations.
  • the operations include receiving an input signal representing audio captured by a microphone of an active noise reduction (ANR) headphone, causing a first compensator to process a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone, and causing a second compensator to process a second frequency range of the input signal to generate a second signal for the acoustic transducer.
  • the second compensator is disposed in parallel to the first compensator, and the first frequency range includes frequencies higher than the frequencies in the second frequency range.
  • the operations further include detecting that the second signal satisfies a threshold condition, and responsive to determining that the second signal satisfies the threshold condition, attenuating the second signal.
  • Implementations of the above aspects may include one or more of the following features.
  • a combined signal for the acoustic transducer can be generated by summing the second signal and the first signal, or by summing the attenuated second signal and the first signal.
  • the acoustic transducer can be driven using the combined signal.
  • An upper limit of the second frequency range can be substantially equal to 100 Hz.
  • the first frequency range can include at least a portion of the second frequency range.
  • Detecting that the second signal satisfies the threshold condition can include determining that a voltage level representing the second signal reaches or exceeds a threshold to indicate an overload condition. Detecting that the second signal satisfies the threshold condition can include filtering the second signal using a digital filter, and comparing the filtered second signal to a value associated with the threshold condition.
  • a set of coefficients of the digital filter can be selectable based on a mode of operation of the ANR headphone.
  • Attenuating the second signal can include adjusting a variable gain amplifier (VGA) that processes the second signal.
  • Processing the first frequency range of the input signal to generate the first signal can include processing the input signal by a first filter to generate a first filtered signal, and processing the first filtered signal by the first compensator to generate the first signal.
  • the first filter can have a passband that includes the first frequency range, and the first signal can represent an anti-noise signal configured to reduce a noise signal in the first filtered signal.
  • Processing the second frequency range of the input signal to generate the second signal can include processing the input signal by a second filter to generate a second filtered signal, and processing the second filtered signal by the second compensator to generate the second signal.
  • the second filter can have a passband that includes the second frequency range, and the second signal can represent an anti-noise signal configured to reduce a noise signal in the second filtered signal.
  • the input signal can represent audio captured by a feedforward microphone of the ANR headphone.
  • Each of the first compensator and the second compensator can be a feedforward compensator disposed in a feedforward signal flow path of the ANR headphone.
  • Each of the first compensator and the second compensator can be a feedback compensator disposed in a feedback signal flow path of the ANR headphone.
  • this document features a method that includes receiving an input signal representing audio captured by one or more sensors of an active noise reduction (ANR) headphone, and generating, based on the input signal, a first signal by a compensator disposed in an ANR signal flow path of the ANR headphone.
  • the method also includes determining one or more characteristics of the first signal, and selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the compensator in the ANR signal flow path. The filter coefficients are selected in accordance with a target frequency response of the digital filter.
  • the method further includes generating, by processing the input signal using the plurality of filter coefficients of the digital filter, a feedback control signal for an electroacoustic transducer of the ANR headphone.
  • this document features an active noise reduction (ANR) device that includes one or more sensors configured to generate an input signal indicative of an external environment of the ANR device, and a compensator disposed in an ANR signal flow path of the ANR device.
  • the compensator is configured to generate a first signal based on the input signal.
  • the ANR device also includes a tunable digital filter disposed in series with the compensator in the ANR signal flow path, wherein the tunable digital filter is configured to generate a control signal for an electroacoustic transducer of the ANR device.
  • the ANR device further includes one or more processing devices that are configured to determine one or more characteristics of the first signal, and select, based on the one or more characteristics of the first signal, a plurality of filter coefficients for the tunable digital filter in accordance with a target frequency response of the tunable digital filter.
  • this document features one or more machine- readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations.
  • the operations include receiving an input signal representing audio captured by one or more sensors of an active noise reduction (ANR) headphone, and causing a compensator disposed in an ANR signal flow path of the ANR headphone to generate a first signal based on the input signal.
  • the operations also include determining one or more characteristics of the first signal, and selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the compensator in the ANR signal flow path. The filter coefficients are selected in accordance with a target frequency response of the digital filter.
  • the operations further include generating a feedback control signal for an electroacoustic transducer of the ANR headphone by causing the digital filter to process the input signal using the plurality of filter coefficients.
  • Implementations of the above aspects may include one or more of the following features.
  • the digital filter can be disposed before or after the compensator in a signal flow path.
  • a determination can be made, based on the one or more characteristics, that a portion of the input signal in a particular frequency range is causing the first signal to trigger an overload condition in the acoustic transducer, and the plurality of filter coefficients can be selected such that the selected filter coefficients configure the digital filter to attenuate the portion of the input signal in the particular frequency range.
  • the one or more characteristics can include a voltage level.
  • the electroacoustic transducer can be driven using the feedback control signal.
  • the digital filter can be a high-pass filter or a notch filter.
  • the digital filter can be an infinite impulse response (MR) filter.
  • the ANR signal flow path can include a feedforward path disposed between a feedforward microphone of the ANR headphone and the electroacoustic transducer.
  • the ANR signal flow path can include a feedback path disposed between a feedback microphone of the ANR headphone and the electroacoustic transducer.
  • this document features a method that includes receiving an input signal captured by one or more sensors associated with an ANR headphone, and determining, by one or more processing devices in an ANR signal flow path, one or more characteristics of a first portion of the input signal.
  • the method also includes automatically adjusting, by the one or more processing devices based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path, and selecting, by the one or more processing devices, a set of coefficients for a tunable digital filter disposed in the ANR signal flow path.
  • the set of coefficients are selected in accordance with the gain of the VGA.
  • the method further includes processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone.
  • this document features an active noise reduction (ANR) device.
  • the device includes one or more sensors configured to generate an input signal indicative of an external environment of the ANR device, and a variable gain amplifier (VGA) and a tunable digital filter disposed in an ANR signal flow path of the ANR device.
  • the ANR signal flow path is connected to an electroacoustic transducer of the ANR device.
  • the device further includes one or more processing devices configured to determine one or more characteristics of a first portion of the input signal, automatically adjust, based on the one or more characteristics of the first portion of the input signal, a gain of the VGA, and select a set of coefficients for the tunable digital filter, wherein the set of coefficients are selected in accordance with the gain of the VGA.
  • this document features one or more machine- readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations.
  • the operations include receiving an input signal captured by one or more sensors associated with an ANR headphone, and determining one or more characteristics of a first portion of the input signal.
  • the operations further include automatically adjusting, based on the one or more
  • the operations also include processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone.
  • VGA variable gain amplifier
  • Implementations of the above aspects may include one or more of the following features. Determining the one or more characteristics of the first portion of the input signal can include processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR device, and determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal.
  • the one or more sensors can include one of: a feedforward microphone of the ANR device, a feedback microphone of the ANR device, a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the electroacoustic transducer.
  • the ANR signal flow path can include a feedforward path disposed between a feedforward microphone of the ANR device and the electroacoustic transducer.
  • the ANR signal flow path can include a feedback path disposed between a feedback microphone of the ANR headphone and the
  • the VGA gain adjustments may be deactivated responsive to a first user-input received by an input-device of the ANR device.
  • the VGA gain adjustments may also be reactivated responsive to a second user-input received by the input-device of the ANR headphone.
  • the gain of the VGA can be adjusted periodically during an operation of the ANR headphone.
  • the gain of the VGA can be adjusted responsive to determining that the one or more characteristics of the first portion of the input signal satisfies a threshold condition.
  • the one or more characteristics of the first portion of the input signal can be indicative of a noise floor of an external environment of the ANR headphone. Determining the one or more
  • characteristics of the first portion of the input signal based on one or more characteristics of the first output signal can include determining that the first output signal is clipped.
  • the one or more characteristics of the first portion of the input signal can be indicative of a likelihood that an output signal resulting from processing of the first portion of the input signal by the ANR signal flow path would be clipped.
  • selective throttling in the low frequency range may allow for mitigating overload conditions while avoiding potentially objectionable noise modulations that may occur due to turning off the entire feedforward compensation.
  • the human ear is relatively less sensitive to low frequencies (e.g., sub-100 Hz)
  • throttling the compensation at such low frequencies upon detection of an overload condition may have an insignificant effect on the psychoacoustic experience of the user, and therefore may improve the overall user experience as compared to a device that completely shuts off the compensation in an ANR signal flow path (e.g., a feedforward path or a feedback path) upon detection of overload.
  • a tunable filter may be disposed in the same or another ANR signal flow path (e.g., a feedback path) to mitigate overload conditions due to low frequency stimuli detected by a corresponding microphone (e.g., a feedback microphone in this particular example).
  • the tunable filter (which may be implemented, for example, as a high-pass or notch filter) may improve user experience and driver-life by reducing low frequency displacement of the driver resulting from, for example, jaw motion or walking.
  • VGA variable gain amplifier
  • SNR signal-to-noise ratio
  • FIG. 1 shows an in-the-ear active noise reduction (ANR) headphone.
  • ANR active noise reduction
  • FIG. 2 is a block diagram of an ANR device.
  • FIG. 3A is an example of a block diagram of an ANR device with feedforward compression.
  • FIG. 3B is an example of a block diagram of an ANR device with parallel feedforward compression.
  • FIG. 4 is a plot showing pressure variations in the ear canal due to the jaw motion of a user using a sealed in-ear headphone.
  • FIG. 5A is a block diagram of a feedback path filter that includes a tunable filter configured to mitigate overload conditions due to low frequency stimuli.
  • FIG. 5B is a block diagram of an example combination of a variable gain amplifier (VGA) and a tunable filter disposed in a signal flow path of an ANR device.
  • VGA variable gain amplifier
  • FIGs. 6A-6C are magnitude responses of different tunable high-pass filters.
  • FIG. 7 is a block diagram of an example bi-quad notch filter that can be used as a tunable filter in an ANR signal flow path.
  • FIG. 8A shows magnitude and phase responses of the bi-quad notch filter of FIG. 7 for different combinations of filter coefficients.
  • FIG. 8B shows the variation of poles and zeros of the bi-quad notch filter with respect to a tuning parameter n.
  • FIGs. 8C and 8D show the variations in coefficient values of the bi- quad notch filter with respect to the tuning parameter n.
  • FIG. 9A shows magnitude and phase responses of a feedback path loop gain of an example ANR device without a tunable filter.
  • FIG. 9B shows magnitude and phase responses of the feedback path loop gain of FIG. 9A, but with a tunable filter.
  • FIG. 10A shows the sensitivity of a feedback path of an example ANR device without a tunable filter.
  • FIG. 10B shows the sensitivity of the feedback path of FIG. 10A, but with a tunable filter.
  • FIG. 1 1 shows the variation in output voltage of a feedback
  • FIG. 12A shows the magnitude response of another example of a notch filter that can be used as a tunable filter in an ANR signal flow path.
  • FIG 12B shows the variation in coefficient values of the notch filter represented in FIG. 12A.
  • FIG. 13 is a flowchart of an example process for implementing parallel feedforward compression in accordance with technology described herein.
  • FIG. 14 is a flowchart of an example process for implementing a tunable filter in a feedback path of an ANR device in accordance with technology described herein.
  • FIG. 15 is a flowchart of an example process for implementing a combination of a variable gain amplifier (VGA) in combination with a tunable filter in a signal flow path of an ANR device.
  • VGA variable gain amplifier
  • An active noise reduction (ANR) device can include a configurable digital signal processor (DSP), which can be used for implementing various signal flow topologies and filter configurations. Examples of such DSPs are described in U.S. Patents 8,073, 150 and 8,073, 151 , which are incorporated herein by reference in their entirety. U.S. Patent 9,082,388, also incorporated herein by reference in its entirety, describes an acoustic implementation of an in-ear active noise reducing (ANR) headphone, as shown in FIG. 1 .
  • DSP digital signal processor
  • This headphone 100 includes a feedforward microphone 102, a feedback microphone 104, an output transducer 106 (which may also be referred to as an electroacoustic transducer or acoustic transducer), and a noise reduction circuit (not shown) coupled to both microphones and the output transducer to provide anti-noise signals to the output transducer based on the signals detected at both microphones.
  • An additional input (not shown in FIG. 1 ) to the circuit provides additional audio signals, such as music or communication signals, for playback over the output transducer 106 independently of the noise reduction signals.
  • the term headphone which is interchangeably used herein with the term headset, includes various types of personal acoustic devices such as in- ear, around-ear or over-the-ear headsets, earphones, and hearing aids.
  • the headsets or headphones can include an earbud or ear cup for each ear.
  • the earbuds or ear cups may be physically tethered to each other, for example, by a cord, an over-the-head bridge or headband, or a behind-the-head retaining structure.
  • the earbuds or ear cups of a headphone may be connected to one another via a wireless link.
  • the signal flow topologies can include a feedforward noise reduction path 1 10 that drives the output transducer 106 to generate an anti-noise signal (using, for example, a feedforward compensator 1 12) to reduce the effects of a noise signal picked up by the feedforward microphone 102.
  • a feedforward noise reduction path 1 10 that drives the output transducer 106 to generate an anti-noise signal (using, for example, a feedforward compensator 1 12) to reduce the effects of a noise signal picked up by the feedforward microphone 102.
  • the signal flow topologies can include a feedback noise reduction path 1 14 that drives the output transducer 106 to generate an anti-noise signal (using, for example, a feedback compensator 1 16) to reduce the effects of a noise signal picked up by the feedback microphone 104.
  • the signal flow topologies can also include an audio path 1 18 that includes circuitry (e.g., equalizer 120) for processing input audio signals 108 such as music or communication signals, for playback over the output transducer 106.
  • the acoustic noise energy that the ANR device attempts to reduce is small enough to keep the system hardware within capacity.
  • discrete acoustic signals or low frequency pressure disturbances e.g., loud pops, bangs, door slams, etc.
  • picked up by the feedforward or feedback microphones can cause the noise reduction circuitry to overrun the capacity of the electronics or the output transducer 106 in trying to reduce the resulting noise, thereby creating audible artifacts which may be deemed objectionable by some users.
  • overload conditions can be manifested by, for example, clipping of amplifiers, hard excursion limits of acoustic drivers or transducers, or levels of excursion that cause sufficient change in the acoustics response so as to cause oscillation.
  • the problem of overload conditions can be particularly significant in small form-factor ANR devices such as in-ear headphones.
  • the feedforward compensator may generate a signal that would require the acoustic transducer to exceed the corresponding physical excursion limit.
  • a particular acoustic transducer may need to be displaced 1 mm to generate an anti-noise signal for a 100 Hz noise, 2 mm to generate an anti-noise signal for a 50 Hz noise, and so on.
  • Many acoustic transducers, particularly small transducers used in small form-factor AN R devices are physically incapable of producing such large displacements.
  • the demand of the high displacement by a compensator can cause the transducer to generate sounds that cause audible artifacts, which may contribute to an objectionable user experience.
  • the audible artifacts can include oscillations, potentially objectionable transient sounds (e.g., "thuds,” "cracks,” “pops,” or “clicks"), or
  • the feedforward path 1 10 can include a variable gain amplifier (VGA) 125, the gain of which can be reduced (throttled) upon detection of a signal that can potentially overload the output transducer 106.
  • VGA variable gain amplifier
  • a sidechain filter 128, which is a filter that is applied to a signal sampled from the main signal flow to generate a test signal for determining whether or not to throttle the gain of the VGA 125.
  • the output of the VGA 125 can be passed through the sidechain filter 128 (the transfer function of which is denoted as Ksc_ff) connected to the feedforward path 1 10, and the output of the sidechain filter is compared (using, for example, a comparator 130) to a pre-determined threshold, Tff 132 to decide whether an overload condition exists.
  • the output of the comparator 130 is provided to the variable gain amplifier (VGA) 125.
  • the gain of the VGA 125 is adjusted to throttle the signal in the feedforward path 1 10 to mitigate the overload condition.
  • FIG. 3A shows a sidechain filter only for the feedforward path, a similar sidechain filter may also be implemented in the feedback path. Also, the sidechain filters may be disposed in the feedforward or feedback paths before or after the
  • main compensators 1 12 or 1 16 respectively.
  • reducing the gain of the entire feedforward or feedback path may also generate some undesirable audible artifacts and/or noise modulations. For example, if the noise that causes an overload condition has significant energy at low and high frequencies, turning off or significantly reducing the gain of the feedforward compensator may allow the noise to pass through un-attenuated and may create an uncomfortable or
  • the technology described herein may improve user experience in such cases by allowing gain adjustments in only selected frequency ranges upon detection of an overload condition, while allowing compensation signals to be generated at frequencies outside of the selected range. For example, because noise reduction compensation in the lower end of the frequency spectrum (e.g. , below 100 Hz) is often the dominant reason for creating overload conditions, the feedforward
  • compensation may be throttled only in the low frequency portion of the spectrum, while allowing feedforward compensation to continue for other frequencies. This may provide an improved psychoacoustic experience for users because upon detection of a low frequency disturbance, the
  • feedforward compensation is temporarily suspended only in a selected portion of the frequency range. If the selected frequency range is in the sub-100 Hz region, the user experience is not significantly degraded for most users because human ears are typically not very sensitive to noise in that frequency range.
  • FIG. 3B is a block diagram of an example of an ANR device 350 with parallel feedforward compression, in which feedforward compensation is throttled in only a portion of the operating frequency range upon detection of an overload condition in that frequency range.
  • the device 350 includes, in the feedforward path 1 10, at least two parallel paths each processing a different portion of the operating frequency range.
  • the feedforward path 1 10 can include a main feedforward compensator 133 (denoted by the transfer function KffM) which processes a frequency range that substantially excludes frequencies where overload conditions are expected to occur.
  • the feedforward path 1 10 also includes an auxiliary feedforward compensator 134 (denoted by the transfer function Kffp) connected in parallel to the main feedforward compensator 133.
  • the auxiliary feedforward compensator 134 processes the frequency range in which overload conditions are expected to occur.
  • a VGA 125, sidechain filter 128, and comparator 130 are connected to the output of the auxiliary compensator 134 to throttle the compensation in the corresponding frequency range upon detection of an overload condition.
  • the main feedforward compensator 133 continues to provide compensation in the corresponding frequency range.
  • the auxiliary compensator can be configured to process signals only in the sub-100 Hz range, such that feedforward compensation due to low frequency pressure disturbances are throttled using the VGA 125.
  • the main feedforward compensator 133 (which can be configured to process signals above 100 Hz) continues to provide feedforward compensation to reduce noise in the corresponding frequency range. In some implementations, this improves the overall noise reduction performance of the corresponding ANR device, while limiting audible artifacts that could be caused by low frequency pressure
  • the threshold 132 associated with the comparator 130 may be determined in various ways. In some implementations, the threshold 132 may be determined based on the characteristics of the output transducer. For example, the threshold 132 might be set as a voltage reference point to prevent the drive voltage output by the VGA 125 from causing the output transducer 106 to hit a mechanical limit, or reaching a drive level where the acoustic distortion due to mechanical, magnetic or electrical characteristics is deemed undesirable. In some cases, these limits may be related to equivalent pressure levels in the ear canal. For example, as the size of the output transducer gets smaller, these limits may occur at lower equivalent pressure levels in the ear canal.
  • the main feedforward compensator 133 and auxiliary feedforward compensator 134 can include filters for isolating corresponding operating frequency ranges.
  • the auxiliary compensator 134 can include a low-pass filter with a passband cut-off frequency substantially equal to 100 Hz.
  • the main feedforward compensator 133 can include, for example, a high pass filter with a stopband cut-off frequency substantially equal to 100 Hz.
  • Other configurations may also be used depending, for example, on the corresponding applications.
  • the main feedforward compensator 133 can include a band-pass filter to isolate a frequency range that excludes frequencies where overload conditions are expected to occur.
  • the passbands of the main and auxiliary feedforward compensators may overlap partially.
  • FIG. 3B describes the filter topologies only in the feedforward path 1 10, a similar parallel topology may also be used in the feedback path.
  • multiple sidechain filters can be used in conjunction with the auxiliary compensator 134.
  • the sidechain filter can be implemented as a filter bank, where a particular sidechain filter is selected based on a mode of operation of the ANR device. For example, if the ANR device is being used in mode where some ambient sounds (e.g., human voice) are allowed to pass through, the sidechain filter selected can be different from one that is selected in a mode in which feedforward
  • the filter bank can be implemented using a DSP where a different set of filter coefficients and/or threshold value are selected for the sidechain filter based on an identified operating mode.
  • the main feedforward compensator 133 can be configured to provide noise attenuation in the corresponding frequency range as long as the signal from the feedforward microphone 102 is not clipped.
  • the sidechain filter can be operated based on input from one or more additional sensors. For example, an accelerometer may be used to identify movements by a user (e.g., running, jogging etc.) that may cause an overload condition. In some implementations, historical information on user- behavior may be used to anticipate events that may cause an overload condition.
  • this information may be used in enabling a proactive throttling of the low frequency portion of the feedforward signal path.
  • the compensation in an ANR signal flow path (e.g., a feedforward path or a feedback path) corresponding to the acoustic transducer for one ear may be coordinated with the compensation in the corresponding signal flow path of the acoustic transducer for the other ear.
  • the sidechain filters of a signal flow path may be adjusted based on determining whether both earbuds of a headphone are being worn by a user. Sensors that can be used for this purpose include, for example, capacitive sensors or infrared sensors disposed on earbuds or ear cups to determine whether an earbud or ear cup is being worn by a user.
  • the above discussions describe the overloading problem of the acoustic transducer primarily with respect to the feedforward path 1 10.
  • the electroacoustic transducer 106 may also be driven to an overload condition due to stimuli picked up by the feedback microphone 104.
  • stimuli picked up by the feedback microphone 104 For example, in the case of in-ear ANR headphones that are tightly sealed in the ear canal, low frequency stimuli like jaw motion can create large pressure variations that are picked up by the feedback microphone 104.
  • FIG. 4 is a plot showing the pressure variations in the ear canal over a two second time period, which are detected by a feedback microphone. In some cases, for tightly sealed in-ear headphones, low frequency pressure variations (at approximately 15 Hz) may be generated when the user walks on a firm surface.
  • Such low frequency pressure variations of high magnitude upon being detected by a feedback microphone 104, may cause the feedback compensator 1 16 to generate a feedback compensation signal that drives the acoustic transducer to an overload condition. This in turn may cause the acoustic transducer 106 to generate audible artifacts and degrade the performance of the ANR device. While the example of a user walking on a firm surface, which generates low frequency variations at approximately 15 Hz, is used herein as one example, other events may cause low frequency variations at different frequencies. The techniques described herein are generally applicable to events that cause low frequency variations that may lead to an overdrive condition, regardless of the particular frequency.
  • FIG. 5A is a block diagram of an example of such a feedback compensator 500, which includes a tunable filter 502 configured to mitigate overload conditions due to low frequency stimuli picked up by the feedback microphone 104.
  • the feedback compensator 500 also includes a fixed filter 504 configured to generate the feedback
  • the tunable filter 502 upon detection of high-magnitude low-frequency stimuli (resulting, for example, from jaw motion or walking), can be configured to filter out such stimuli from the input signal provided to the fixed filter 504 to generate the feedback compensation signal. Under such a signal flow scheme, the feedback compensator can continue to generate feedback compensation signals for noise reduction even in the presence of high- magnitude low-frequency stimuli without being driven to an overload condition.
  • the parameters for the tunable filter can be selected, for example, by a parameter selector module 508 that determines an appropriate set of parameters based on the output of an estimator 506.
  • the estimator 506 determines, from the feedback
  • the parameter selector module 508 can be configured to select one or more parameters (or a set of filter coefficients) for the tunable filter 502, such that the tunable filter 502 filters out the stimuli that is causing the generation of the large feedback compensation signal.
  • the parameter selector module 508 can be configured to access a look-up table to select the one or more parameters (or set of filter coefficients) for the tunable filter 502, based on the extent of driver displacement reported by the estimator 506.
  • the estimator can be configured to monitor the output of the fixed filter 504 to reduce the chances of the output voltage exceeding a threshold condition associated with, for example, driving the output transducer 106 to an unacceptably high displacement, or clipping the electrical output.
  • the parameter selector module 508 can be configured to select the one or more parameters or coefficients of the tunable filter 502 such that the tunable filter 502 acts as a high-pass filter.
  • FIGs. 6A- 6C show magnitude responses of different tunable high-pass filters
  • the transfer function of the filter corresponding to FIG. 6B is given by:
  • the transfer function of the filter corresponding to FIG. 6C is given by:
  • the parameter selector module 508 can be configured to select the one or more parameters or filter coefficients of the tunable filter 502 such that the tunable filter 502 acts as a notch filter.
  • This can be useful, for example, when the pressure variations causing an overload condition is in a narrow frequency range. For example, when a user walks on a firm surface wearing tightly-sealed in-ear headphones, high-magnitude pressure variations can occur at about 15 Hz. In such cases, a notch filter can be used to prevent such pressure variations from generating feedback signals that could drive the acoustic transducer to an overload. Because only a narrow range of frequencies are suppressed using notch filter, such a filter may only insignificantly degrade the feedback compensation performance of the ANR device.
  • FIG. 5B shows a block diagram of another system that may be used in either of a feedforward or a feedback ANR signal flow path. Specifically, FIG.
  • FIG. 5B is a block diagram of an example system 550 that uses a combination of a variable gain amplifier (VGA) 552 and a tunable filter 554 disposed in a signal flow path of an ANR device.
  • the signal flow path which includes a sensor (e.g. , a microphone 557 and/or a non-microphone sensor 555) at one end and an acoustic transducer 106 at the other end, can include, for example, a feedback path or a feedforward path of the ANR device. If the signal flow path in which the system 550 is disposed is a feedforward path, the tunable filter 554 may be referred to as a feedforward compensator. If the signal flow path in which the system 550 is disposed is a feedback path, the tunable filter 554 may be referred to as a feedback compensator.
  • the noise reduction performance of the ANR device may be balanced against its overload performance by adaptively adjusting the VGA 552 and the tunable filter 554 based on the environment of the ANR device.
  • the noise reduction performance may be improved by increasing the gain of the VGA 552.
  • the ANR device may introduce system-generated noise (e.g., noise generated by the electronics disposed in the signal flow path), which may be manifested as a substantially constant audible "hiss" generated by the acoustic transducer 106.
  • increasing the gain of the VGA 552 may in some cases improve the signal-to-noise ratio (SNR), and decrease the undesirable hissing audio generated by the acoustic transducer 106. This may also be referred to as lowering of the "noise floor,” and improve user experience particularly in low-noise environments.
  • pre-amplifying the gain of the VGA 552 boosts any signals captured using the microphones 557 (e.g., feedback and/or feedforward microphones), which in some cases may result in clipping of the incoming signal.
  • the dynamic range of the system may also be reduced, causing the system (e.g., the electronics of the signal flow path and/or the acoustic transducer 106) to overload more easily.
  • the system e.g., the electronics of the signal flow path and/or the acoustic transducer 106
  • overload conditions may cause the acoustic transducer 106 to produce audible pops and clicks, which in turn may detract from the improved user- experience resulting from the lowered noise floor.
  • the signal flow path illustrated in FIG. 5B is an example of a system that can be used to balance the noise reduction performance with the overload performance of an ANR device.
  • the gain of the VGA can be adjusted to a relatively high value that reduces the audible noise floor. This in turn may expose the ANR device to a higher likelihood of being driven to overload conditions.
  • the parameter selector 558 may be configured to adjust the gain of the VGA to a lower value to reduce the chances of the system being driven to an overload condition.
  • the VGA gain is reduced in a noisier environment, a psychoacoustic effect of the increased noise floor may not be significantly noticeable to a user.
  • the adaptive reducing of the gain of the VGA 552 may result in mitigating audible pops and clicks that may otherwise have degraded the user experience due to the occurrence of overload conditions.
  • the filter coefficients of the tunable filter 554 are also adjusted accordingly to compensate for the change in gain of the VGA 552. For example, if the parameter selector 558 increases the gain of the VGA 552 by 6 dB, the parameter selector 558 may also be configured to select an appropriate set of filter coefficients for the tunable filter 554, such that the magnitude response of the tunable filter is reduced by about 6 dB to compensate for the increased gain of the VGA 552. In some cases, such simultaneous adjustment of the VGA and the tunable filter ensures that the overall gain of the signal flow path is substantially constant, and the user experience is substantially uniform.
  • the VGA 552 is configured to process signals captured by one or more sensors such as microphones 557 and/or non-microphone sensors 555.
  • the microphones 557 can be of various types, possibly depending on, for example, the signal flow path in which the system 550 is disposed. For example, if the system 550 is disposed in a feedforward ANR path, the microphone 557 can include the feedforward microphone of the ANR device, such as the microphone 102 described above. In another example, if the system 550 is disposed in a feedback ANR path, the microphone 557 can include a feedback microphone such as the microphone 104 described above.
  • the sensors 555 can also be of various types.
  • the non-microphone sensors 555 can include, for example, a pressure sensor, an accelerometer, or a gyroscope. Such non-microphone sensors 555 may be used, for example, to detect pressure changes or activities that may prompt a change in the settings of the VGA 552 and/or the tunable filter 554. For example, based on the output of an accelerometer disposed in an ANR headphone, a determination may be made that the user is running or jogging, which in turn may produce low frequency pressure variations at a particular frequency. Based on such a determination, the parameter selector 558 may be configured to adjust the gain associated with the VGA and the filter coefficients of the tunable filter 554. While the system 550 illustrated in FIG. 5B includes both non-microphone sensors 555 and microphones 557, systems that include only microphones 557 or only non-microphone sensors 555 are also possible.
  • the adjustments to the gain of the VGA 552 and the filter coefficients of the tunable filter 554 may be made based on predicting the onset of a particular event.
  • the environment of a user may be determined based on the output of a global positioning system (GPS) (e.g., one disposed either in the ANR device or in a mobile phone connected to the ANR device), and the settings of the VGA 552 and the tunable filter 554 may be adjusted in accordance with the GPS.
  • GPS global positioning system
  • the parameter selector 558 can be configured to adjust the settings of the ANR device in accordance with that typically used in quiet environments. Conversely, if the user is determined to be in a train during commuting hours, the parameter selector 558 can be configured to adjust the settings of the ANR device in accordance with that typically used in noisy environments.
  • the user's environment may be detected based on one or more applications executing on the ANR device and/or a mobile device connected to the ANR device. For example, upon determining that the user has just started an application that tracks the user's running steps, an inference may be made that the user is about to start a run.
  • the parameter selector 558 can be configured to adjust the VGA 552 and the tunable filter 554 to account for the corresponding expected low- pressure variations in the ANR device.
  • information about both the environment and the activity of the user may be used in determining that operating parameters of the VGA 552 and the filter coefficients of the tunable filter.
  • the parameter selector 558 can be configured to select the operating parameters of the VGA 552 and the tunable filter 554 in various ways.
  • the parameter selector may be configured to access a computer-readable storage device that stores a representation of a look-up table that stores different sets of filter coefficients of the tunable filter 554 linked to different gain values of the VGA 552.
  • the parameter selector can be configured to calculate the filter coefficients of the tunable filter 554 based on a pre-defined relationship with the selected gain values.
  • the gain values to be used in different environments may be empirically determined or calculated as a function of the outputs of one or more sensors such as a pressure sensor or microphone.
  • the gain level of the VGA 552 may also be changed based on user-input received via a user interface.
  • the user interface can be a control such as a switch, knob, or dial disposed on the ANR device, or a software-based graphical user interface displayed on a display device such as one displayed on a connected mobile device.
  • the estimator 556 can be configured to determine whether any adjustments to the VGA 552 and/or the tunable filter 554 are needed.
  • the estimator 556 can be configured to signal the parameter selector 558 to adjust one or both of the VGA 552 and the tunable filter 554.
  • the estimator 556 is substantially similar to the estimator 506 described above with reference to FIG. 5A. In some
  • the estimator 556 can be a displacement estimator configured to estimate whether the drive signal for the acoustic transducer can potentially cause the transducer to exceed its excursion limit.
  • the estimator 556 can include a pressure estimator configured to detect the occurrence of pressure disturbances in the
  • the system 550 may be operated in various modes.
  • the system 550 can be configured to run substantially continuously upon initialization. For example, if the system 550 is disposed in a feedforward or feedback path of an ANR headphone, the system may be initialized when the ANR functionality of the headphone is activated, and then allowed to run during the operating period of the headphone. In some cases though, such a mode of operation may cause multiple pops and clicks, which could degrade the user experience to some extent.
  • the system 550 can include a control (e.g., a button) to deactivate/activate the system 550 based on user-input.
  • the system 550 could be configured such that the parameter selector 558 adjusts the VGA 552 and the tunable filter 554 in accordance with the current environment, and then either shuts off or goes into standby mode.
  • the system may be reactivated based on a user-input which indicates that the environment has changed, or that a readjustment is otherwise desired.
  • the system 550 or the ANR device in which it is deployed may include one or more controls (e.g., hardware buttons and/or software controls presented on a user interface) for selecting the mode of operation of the system 550.
  • the adjustments may be performed in various ways.
  • the adjustments are performed substantially periodically.
  • the adjustments may be performed with a time period of about 100 ms or more.
  • the frequency of adjustments may be selected empirically, for example, to allow the system 550 to adequately adjust to changing environments.
  • the adjustments can be performed upon detection of a change in the environment.
  • the estimator 556 may signal the parameter selector 558 to adjust the VGA 552 and the tunable filter 554 accordingly.
  • a decision threshold may be associated with the adjustments.
  • an adjustment may be made only if the amount of required change in the gain of the VGA 552 exceeds a threshold amount. For example, an adjustment may be made only if the gain adjustment is 2.25 dB or higher.
  • the threshold amount may be determined empirically, for example, to prevent overly frequent adjustments.
  • the adjustments to the gain level of the VGA 552 can be performed in various ways.
  • the adjustments may be made in a single step.
  • the adjustments may be made as a series of multiple steps. For example, if an adjustment of 6 dB needs to be made, the adjustments may be made as a single step change of 6 dB, or a series of six steps each implementing a 1 dB change, or another combination of steps.
  • the step sizes may be determined empirically, for example, based on the tolerance for any associated audible artifacts generated by the step changes.
  • the time gap between the steps may also be adjusted, for example, to reduce the possibility of multiple audible artifacts to be merged into a single louder artifact.
  • increasing the gap between the steps also increases the total adjustment time.
  • the spacing between the steps can therefore be selected empirically in accordance with a target tradeoff between the adjustment time and the tolerable audible artifacts.
  • FIG. 7 is a block diagram of an example bi-quad notch filter that can be used as a tunable filter in an ANR signal flow path.
  • the transfer function of the filter is given by:
  • FIG. 8A shows magnitude and phase responses of a single bi-quad notch filter (as shown in FIG. 7) for different combinations of filter coefficients.
  • the filter coefficients are parameterized by the parameter s.
  • FIG. 8B shows the variation of poles and zeros of the bi-quad notch filter with respect to a tuning parameter n in terms of frequency and bi-quad
  • the Q is also known as the quality factor.
  • the curves describing the pole and zero frequency and Qs as a function of tuning variation show that the notch sharpness and notch center frequency are coupled. To maintain desirable feedback ANR performance, the notch depth increases with increasing frequency.
  • FIGs. 8C and 8D show the variations in filter coefficient values of the bi-quad notch filter with respect to the tuning parameter n.
  • the values of the coefficients b1 and a1 are in the vicinity of 2, and the values of the coefficients b2 and a2 are in the vicinity of unity.
  • the filter coefficient values e.g. , b1 , b2, a1 and a2, in the present example
  • FIGs. 9A-9B, and FIGs. 10A-10B illustrate the performance of a tunable filter in the feedback path.
  • FIGs. 9A and 9B show magnitude and phase responses of the loop gain (provided as a product of the driver-voltage-to-feedback-microphone-voltage transfer function and the feedback compensator transfer function K3 ⁇ 4) of the feedback path without a tunable filter and with a tunable filter, respectively.
  • the particular tunable filter used in this example included twelve cascaded bi-quad notch filters, each of which were substantially similar to the bi-quad notch filter illustrated in FIG. 7.
  • the tunable filter remains stable and exhibits consistent loop gain behavior for the various values of the tuning parameter n.
  • FIGs. 10A and 10B which show the sensitivity of a feedback path of the example ANR device without a tunable filter (FIG. 10A), and with a tunable filter (FIG. 10B), the sensitivity of the filters also remains consistent for the various values of the tuning parameter.
  • FIG. 1 1 shows the variation in output voltage of the feedback compensator 1 16 for the various values of the tuning parameter n.
  • the parameter value can be adjusted to get different levels of suppression at around the desired 15 Hz frequency, without significantly affecting the feedback compensator output at other frequencies.
  • FIG. 12A shows the magnitude response of another example of a notch filter that can be used as a tunable filter in the feedback path.
  • This notch filter is another single bi-quad notch filter such as the one illustrated in FIG. 7, but with the coefficients a1 and a2 held to be constants.
  • the frequency of the complex poles and zeros were equal and the Q of the zeros was varied to change the depth of the notch, which resulted in changes to the coefficients b1 and b2 only.
  • FIG. 12B Such variations of the coefficients are illustrated in FIG. 12B.
  • FIG. 13 is a flowchart of an example process 1300 for implementing parallel feedforward compression in accordance with technology described above. At least a portion of the process 1300 can be implemented using one or more processing devices such as DSPs described in U.S. Patents
  • Operations of the process 1300 include receiving an input signal representing audio captured by a feedforward microphone of an ANR device such as an ANR headphone (1302).
  • the ANR device can be an in-ear headphone such as the one described with reference to FIG. 1 .
  • the ANR device can include, for example, around-the- ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices.
  • the ANR device can include, for example, around-the- ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices.
  • feedforward microphone can be a part of an array of microphones.
  • Operations of the process 1300 also include processing a first frequency range of the input signal to generate a first feedforward signal for an acoustic transducer of the ANR headphone (1304). This can be done using a first feedforward compensator disposed in the ANR device to generate anti-noise signals to reduce or cancel noise signals picked up by the feedforward microphone.
  • generating the first feedforward signal includes processing the input signal by a first filter to generate a first filtered signal, and processing the first filtered signal by the first feedforward compensator to generate the first feedforward signal.
  • the first filter can be a high-pass or band-pass filter having a passband that includes the first frequency range.
  • the first feedforward signal represents an anti-noise signal configured to reduce a noise signal in the first filtered signal.
  • the process 1300 also includes processing a second frequency range of the input signal to generate a second feedforward signal for the acoustic transducer (1306). This can be done, for example, by a second feedforward compensator disposed in parallel to the first feedforward compensator.
  • the first frequency range includes frequencies higher than the frequencies in the second frequency range. For example, an upper limit of the second frequency range can be substantially equal to 100 Hz, whereas the lower limit of the first frequency range can be greater than or substantially equal to 100 Hz.
  • the first frequency range can include at least a portion of the second frequency range.
  • generating the second feedforward signal includes processing the input signal by a second filter to generate a second filtered signal, and processing the second filtered signal by the second feedforward compensator to generate the second feedforward signal.
  • the second filter can have a passband that includes the second frequency range, and the second feedforward signal can represent an anti-noise signal configured to reduce a noise signal in the second filtered signal.
  • Operations of the process 1300 further include detecting that the second feedforward signal satisfies a threshold condition (1308).
  • a threshold condition can include, for example, determining that a voltage level representing the second feedforward signal reaches or exceeds a threshold to indicate an overdrive condition of the electroacoustic transducer.
  • This can also include, for example, filtering the second feedforward signal using a digital filter, and comparing the filtered second feedforward signal to a value associated with the threshold condition.
  • the set of coefficients of the digital filter can be selected based on a mode of operation of the ANR headphone.
  • Operations of the process 1300 also include attenuating the second feedforward signal responsive to determining that the second feedforward signal satisfies the threshold condition (1310). For example, if the second feedforward signal satisfies the threshold condition, a determination is made that the second feedforward signal would drive the acoustic transducer, or other portions of the associated electronics, to overload, and accordingly, a variable gain amplifier in the signal path of the second feedforward signal is adjusted to attenuate the second feedforward signal.
  • Operations of the process can also include, for example, generating a combined feedforward signal for the acoustic transducer by summing the second feedforward signal and the first feedforward signal, or by summing the attenuated second feedforward signal and the first feedforward signal.
  • the acoustic transducer can then be driven using, in part, the combined feedforward signal.
  • All of the various signal topologies and filter designs described above can be implemented in the configurable digital signal processor described in the cited patents. These topologies and filter designs may also be
  • FIG. 14 is a flowchart of an example process 1400 for implementing a tunable filter in a feedback path of an ANR device in accordance with technology described above. At least a portion of the process 1400 can be implemented using one or more processing devices such as DSPs described in U.S. Patents 8,073, 150 and 8,073,151 , incorporated herein by reference in their entirety. Operations of the process 1400 include receiving an input signal representing audio captured by a feedback microphone of an ANR device such as an ANR headphone (1402). In some implementations, the ANR device can be an in-ear headphone such as one described with reference to FIG. 1 .
  • the ANR device can include, for example, around-the-ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices.
  • the feedback microphone can be a part of an array of microphones.
  • Operations of the process 1400 also include generating, by a feedback compensator and based on the input signal, a first signal (1404).
  • the feedback compensator can be substantially similar to the fixed filter 504 described above with reference to FIG. 5A.
  • the first signal can include an anti-noise signal generated in response to a noise detected by a feedback microphone, wherein the anti-noise signal is configured to cancel or at least reduce the effect of the noise.
  • the operations of the process 1400 include determining one or more characteristics of the first signal (1406). This can be done, for example, using a module substantially similar to the estimator 506 described above with reference to FIG. 5A.
  • the one or more characteristics can include a voltage level of the first signal, the voltage level being indicative of an amount of excursion or driver displacement of the corresponding acoustic transducer 106.
  • the one or more characteristics can be indicative of a frequency or frequency range of the input signal where the underlying noise is detected.
  • the operations of the process 1400 further include selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the feedback
  • the plurality of filter coefficients can be selected, for example, in accordance with a target frequency response of the digital filter. For example, if the one or more characteristics of the first signal indicate that the voltage level of the first signal can potentially drive the corresponding acoustic transducer to an overload condition, and that the underlying noise in the input signal is in the vicinity of 15 Hz, the plurality of coefficients can be chosen to configure the digital filter as a high-pass or notch filter to suppress or attenuate components of the input signal around 15 Hz. In some implementations, selecting the plurality of coefficients can be done by accessing a pre-stored look-up table that includes parameter or coefficient values for the digital filter for various combinations of the one or more characteristics determined for the first signal. In some implementations, the digital filter is substantially similar to the tunable filter described above with reference to FIGs. 5A and 5B.
  • the digital filter may be disposed in the feedback path of an ANR device in series with a feedback compensator, and either before or after the feedback compensator.
  • the digital filter may be integrated together with the feedback compensator in the form of a combined set of coefficients.
  • the tunable filter 502 and the fixed filter 504 may be combined in the form of a unified filter providing feedback compensation.
  • the digital filter may be implemented in various forms, including for example, as an infinite impulse response (MR) filter or a finite impulse response (FIR filter).
  • Operations of the process 1400 also include generating, by processing the input signal using the plurality of filter coefficients of the digital filter, a feedback compensation signal for an acoustic transducer of the ANR headphone (1410).
  • a portion of the input signal causing the generation of out-of-range feedback compensation signals may be attenuated, thereby preventing any potential overload conditions in the acoustic transducer. In some implementations, this may improve user experience by avoiding audible artifacts that are otherwise generated by such overload conditions.
  • FIG. 15 is a flowchart of an example process 1500 for implementing a combination of a variable gain amplifier (VGA) in combination with a tunable filter in a signal flow path of an ANR device in accordance with technology described above. At least a portion of the process 1500 can be implemented using one or more processing devices such as DSPs described in U.S.
  • VGA variable gain amplifier
  • Operations of the process 1500 include receiving an input signal captured by one or more sensors associated with an ANR device such as an ANR headphone (1502).
  • the one or more sensors can include one or more of a feedforward microphone and feedback microphone of the ANR headphone.
  • the one or more sensors include one or more of a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the electroacoustic transducer.
  • Operations of the process 1500 also include determining one or more characteristics of the first portion of the input signal (1506).
  • the one or more characteristics of the first portion of the input signal is indicative of a noise floor associated with the external environment of the ANR headphone.
  • determining the one or more characteristics of the first portion of the input signal includes processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR headphone, and determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal.
  • determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal can include determining that the first output signal is clipped.
  • the one or more characteristics of the first portion of the input signal is indicative of a likelihood that an output signal resulting from processing of the first portion of the input signal by the ANR signal flow path would be clipped.
  • determining the one or more characteristics of the first portion of the input signal includes determining a non-linear relationship between the first portion of the input signal and the first output signal.
  • a non-linear relationship may be manifested by an output signal that causes an acoustic transducer to generate an audible artifact such as a pop or click.
  • Operations of the process 1500 also include automatically adjusting based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path (1508).
  • VGA variable gain amplifier
  • the gain of the VGA is adjusted periodically during an operation of the ANR headphone. The time period of the
  • the gain of the VGA is adjusted responsive to determining that the one or more characteristics of the first portion of the input signal or the first output signal satisfies a threshold condition.
  • the threshold condition can include, for example, an amount of required gain adjustment.
  • the gain of the VGA may be adjusted only if the required adjustment is at least 2.25 dB.
  • Operations of the process 1500 also include selecting a set of coefficients for a tunable digital filter disposed in the ANR signal flow path in accordance with the gain of the VGA (1510). For example, if the gain of the VGA is adjusted by a particular amount (e.g., 5 dB), the set of coefficients for the tunable digital filter may be selected such that the magnitude response of the filter due to the selected coefficients compensates for the gain adjustment of the VGA. This may be done, for example, to keep the overall gain of the signal flow path substantially unchanged.
  • a particular amount e.g., 5 dB
  • Operations of the process 1500 further include processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone (1512).
  • the second output signal reduces the chances of the system 550 being driven to an overload condition, as compared to the first output signal.
  • the process 1500 may therefore be used for mitigating overload conditions in a feedforward or feedback path of the ANR headphone.
  • the functionality described herein, or portions thereof, and its various modifications can be implemented, at least in part, via a computer program product, e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine- readable media or storage device, for execution by, or to control the operation of, one or more data processing apparatus, e.g. , a programmable processor, a computer, multiple computers, and/or programmable logic components.
  • a computer program product e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine- readable media or storage device, for execution by, or to control the operation of, one or more data processing apparatus, e.g. , a programmable processor, a computer, multiple computers, and/or programmable logic components.
  • a computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
  • a computer program can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by a network.
  • Actions associated with implementing all or part of the functions can be performed by one or more programmable processors executing one or more computer programs to perform the functions of the calibration process. All or part of the functions can be implemented as, special purpose logic circuitry, e.g., an FPGA and/or an ASIC (application-specific integrated circuit). In some implementations, at least a portion of the functions may also be executed on a floating point or fixed point digital signal processor (DSP) such as the Super Harvard Architecture Single-Chip Computer (SHARC) developed by Analog Devices Inc.
  • DSP floating point or fixed point digital signal processor
  • SHARC Super Harvard Architecture Single-Chip Computer
  • Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer.
  • a processor will receive instructions and data from a read-only memory or a random access memory or both.
  • Components of a computer include a processor for executing instructions and one or more memory devices for storing instructions and data.
  • the parallel feedforward compensation may be combined with a tunable digital filter in the feedback path.
  • a tunable digital filter in the feedforward path may be combined with a parallel compensation scheme in the feedback path.
  • various combinations of the parallel compensation technique, tunable filter technique, and the VGA technique may be used in the ANR signal flow paths (e.g., a feedback path or a feedforward path) of an ANR device.
  • an ANR signal flow path can include a tunable digital filter as well as a parallel compensation scheme to attenuate generated control signal in a specific portion of the frequency range.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Headphones And Earphones (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The technology described in this document can be embodied in a method that includes receiving an input signal representing audio captured by a microphone of an active noise reduction (ANR) headphone, and processing, by a first compensator, a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone. The method also includes processing, by a second compensator disposed in parallel to the first compensator, a second frequency range of the input signal to generate a second signal for the acoustic transducer. The first frequency range includes frequencies higher than the frequencies in the second frequency range. The method also includes detecting, by one or more processing devices, that the second signal satisfies a threshold condition, and attenuating the second signal responsive to determining that the second signal satisfies the threshold condition.

Description

Compensation and Automatic Gain Control in Active Noise
Reduction Devices
TECHNICAL FIELD
[0001] This disclosure generally relates to technology for controlling overload conditions in active noise reducing (ANR) devices.
BACKGROUND
[0002] ANR devices can utilize one or more digital signal processors (DSPs) for implementing various signal flow topologies. Examples of such DSPs are described in U.S. Patents 8,073, 150 and 8,073, 151 , which are incorporated herein by reference in their entirety.
SUMMARY
[0003] In general, in one aspect, this document features a method that includes receiving an input signal representing audio captured by a microphone of an active noise reduction (ANR) headphone, and processing, by a first compensator, a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone. The method also includes processing, by a second compensator disposed in parallel to the first compensator, a second frequency range of the input signal to generate a second signal for the acoustic transducer. The first frequency range includes frequencies higher than the frequencies in the second frequency range. The method also includes detecting, by one or more processing devices, that the second signal satisfies a threshold condition, and attenuating the second signal responsive to determining that the second signal satisfies the threshold condition.
[0004] In another aspect, this document features an active noise reduction (ANR) device that includes one or more sensors configured to generate an input signal indicative of an external environment of the ANR device. The device also includes a first compensator configured to process a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone, and a second compensator disposed in parallel to the first compensator. The second compensator filter is configured to process a second frequency range of the input signal to generate a second signal for the acoustic transducer, wherein the first frequency range includes frequencies higher than the frequencies in the second frequency range. The device further includes one or more processing devices configured to detect that the second signal satisfies a threshold condition, and attenuate the second signal responsive to determining that the second signal satisfies the threshold condition.
[0005] In another aspect, this document features one or more machine- readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations. The operations include receiving an input signal representing audio captured by a microphone of an active noise reduction (ANR) headphone, causing a first compensator to process a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone, and causing a second compensator to process a second frequency range of the input signal to generate a second signal for the acoustic transducer. The second compensator is disposed in parallel to the first compensator, and the first frequency range includes frequencies higher than the frequencies in the second frequency range. The operations further include detecting that the second signal satisfies a threshold condition, and responsive to determining that the second signal satisfies the threshold condition, attenuating the second signal.
[0006] Implementations of the above aspects may include one or more of the following features.
[0007] A combined signal for the acoustic transducer can be generated by summing the second signal and the first signal, or by summing the attenuated second signal and the first signal. The acoustic transducer can be driven using the combined signal. An upper limit of the second frequency range can be substantially equal to 100 Hz. The first frequency range can include at least a portion of the second frequency range. Detecting that the second signal satisfies the threshold condition can include determining that a voltage level representing the second signal reaches or exceeds a threshold to indicate an overload condition. Detecting that the second signal satisfies the threshold condition can include filtering the second signal using a digital filter, and comparing the filtered second signal to a value associated with the threshold condition. A set of coefficients of the digital filter can be selectable based on a mode of operation of the ANR headphone. Attenuating the second signal can include adjusting a variable gain amplifier (VGA) that processes the second signal. Processing the first frequency range of the input signal to generate the first signal can include processing the input signal by a first filter to generate a first filtered signal, and processing the first filtered signal by the first compensator to generate the first signal. The first filter can have a passband that includes the first frequency range, and the first signal can represent an anti-noise signal configured to reduce a noise signal in the first filtered signal. Processing the second frequency range of the input signal to generate the second signal can include processing the input signal by a second filter to generate a second filtered signal, and processing the second filtered signal by the second compensator to generate the second signal. The second filter can have a passband that includes the second frequency range, and the second signal can represent an anti-noise signal configured to reduce a noise signal in the second filtered signal. The input signal can represent audio captured by a feedforward microphone of the ANR headphone. Each of the first compensator and the second compensator can be a feedforward compensator disposed in a feedforward signal flow path of the ANR headphone. Each of the first compensator and the second compensator can be a feedback compensator disposed in a feedback signal flow path of the ANR headphone.
[0008] In another aspect, this document features a method that includes receiving an input signal representing audio captured by one or more sensors of an active noise reduction (ANR) headphone, and generating, based on the input signal, a first signal by a compensator disposed in an ANR signal flow path of the ANR headphone. The method also includes determining one or more characteristics of the first signal, and selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the compensator in the ANR signal flow path. The filter coefficients are selected in accordance with a target frequency response of the digital filter. The method further includes generating, by processing the input signal using the plurality of filter coefficients of the digital filter, a feedback control signal for an electroacoustic transducer of the ANR headphone.
[0009] In another aspect, this document features an active noise reduction (ANR) device that includes one or more sensors configured to generate an input signal indicative of an external environment of the ANR device, and a compensator disposed in an ANR signal flow path of the ANR device. The compensator is configured to generate a first signal based on the input signal. The ANR device also includes a tunable digital filter disposed in series with the compensator in the ANR signal flow path, wherein the tunable digital filter is configured to generate a control signal for an electroacoustic transducer of the ANR device. The ANR device further includes one or more processing devices that are configured to determine one or more characteristics of the first signal, and select, based on the one or more characteristics of the first signal, a plurality of filter coefficients for the tunable digital filter in accordance with a target frequency response of the tunable digital filter.
[0010] In another aspect, this document features one or more machine- readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations. The operations include receiving an input signal representing audio captured by one or more sensors of an active noise reduction (ANR) headphone, and causing a compensator disposed in an ANR signal flow path of the ANR headphone to generate a first signal based on the input signal. The operations also include determining one or more characteristics of the first signal, and selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the compensator in the ANR signal flow path. The filter coefficients are selected in accordance with a target frequency response of the digital filter. The operations further include generating a feedback control signal for an electroacoustic transducer of the ANR headphone by causing the digital filter to process the input signal using the plurality of filter coefficients.
[0011] Implementations of the above aspects may include one or more of the following features.
[0012] The digital filter can be disposed before or after the compensator in a signal flow path. A determination can be made, based on the one or more characteristics, that a portion of the input signal in a particular frequency range is causing the first signal to trigger an overload condition in the acoustic transducer, and the plurality of filter coefficients can be selected such that the selected filter coefficients configure the digital filter to attenuate the portion of the input signal in the particular frequency range. The one or more characteristics can include a voltage level. The electroacoustic transducer can be driven using the feedback control signal. The digital filter can be a high-pass filter or a notch filter. The digital filter can be an infinite impulse response (MR) filter. The ANR signal flow path can include a feedforward path disposed between a feedforward microphone of the ANR headphone and the electroacoustic transducer. The ANR signal flow path can include a feedback path disposed between a feedback microphone of the ANR headphone and the electroacoustic transducer.
[0013] In another aspect, this document features a method that includes receiving an input signal captured by one or more sensors associated with an ANR headphone, and determining, by one or more processing devices in an ANR signal flow path, one or more characteristics of a first portion of the input signal. The method also includes automatically adjusting, by the one or more processing devices based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path, and selecting, by the one or more processing devices, a set of coefficients for a tunable digital filter disposed in the ANR signal flow path. The set of coefficients are selected in accordance with the gain of the VGA. The method further includes processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone.
[0014] In another aspect, this document features an active noise reduction (ANR) device. The device includes one or more sensors configured to generate an input signal indicative of an external environment of the ANR device, and a variable gain amplifier (VGA) and a tunable digital filter disposed in an ANR signal flow path of the ANR device. The ANR signal flow path is connected to an electroacoustic transducer of the ANR device. The device further includes one or more processing devices configured to determine one or more characteristics of a first portion of the input signal, automatically adjust, based on the one or more characteristics of the first portion of the input signal, a gain of the VGA, and select a set of coefficients for the tunable digital filter, wherein the set of coefficients are selected in accordance with the gain of the VGA.
[0015] In another aspect, this document features one or more machine- readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations. The operations include receiving an input signal captured by one or more sensors associated with an ANR headphone, and determining one or more characteristics of a first portion of the input signal. The operations further include automatically adjusting, based on the one or more
characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path, and selecting, a set of coefficients for a tunable digital filter disposed in the ANR signal flow path. The set of coefficients are selected in accordance with the gain of the VGA. The operations also include processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone.
[0016] Implementations of the above aspects may include one or more of the following features. Determining the one or more characteristics of the first portion of the input signal can include processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR device, and determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal. The one or more sensors can include one of: a feedforward microphone of the ANR device, a feedback microphone of the ANR device, a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the electroacoustic transducer. The ANR signal flow path can include a feedforward path disposed between a feedforward microphone of the ANR device and the electroacoustic transducer. The ANR signal flow path can include a feedback path disposed between a feedback microphone of the ANR headphone and the
electroacoustic transducer. The VGA gain adjustments may be deactivated responsive to a first user-input received by an input-device of the ANR device. The VGA gain adjustments may also be reactivated responsive to a second user-input received by the input-device of the ANR headphone. The gain of the VGA can be adjusted periodically during an operation of the ANR headphone. The gain of the VGA can be adjusted responsive to determining that the one or more characteristics of the first portion of the input signal satisfies a threshold condition. The one or more characteristics of the first portion of the input signal can be indicative of a noise floor of an external environment of the ANR headphone. Determining the one or more
characteristics of the first portion of the input signal based on one or more characteristics of the first output signal can include determining that the first output signal is clipped. The one or more characteristics of the first portion of the input signal can be indicative of a likelihood that an output signal resulting from processing of the first portion of the input signal by the ANR signal flow path would be clipped. [0017] Various implementations described herein may provide one or more of the following advantages. By throttling compensation under overload conditions only in a selected portion of the frequency range, the performance of small form-factor AN R devices (e.g., in-ear headsets) may be improved. For example, selective throttling in the low frequency range may allow for mitigating overload conditions while avoiding potentially objectionable noise modulations that may occur due to turning off the entire feedforward compensation. Because the human ear is relatively less sensitive to low frequencies (e.g., sub-100 Hz), throttling the compensation at such low frequencies upon detection of an overload condition may have an insignificant effect on the psychoacoustic experience of the user, and therefore may improve the overall user experience as compared to a device that completely shuts off the compensation in an ANR signal flow path (e.g., a feedforward path or a feedback path) upon detection of overload. In addition to, or independently of the processing in one ANR signal flow path (e.g., a feedforward path), a tunable filter may be disposed in the same or another ANR signal flow path (e.g., a feedback path) to mitigate overload conditions due to low frequency stimuli detected by a corresponding microphone (e.g., a feedback microphone in this particular example). In some cases, the tunable filter (which may be implemented, for example, as a high-pass or notch filter) may improve user experience and driver-life by reducing low frequency displacement of the driver resulting from, for example, jaw motion or walking. In some implementations, by providing a variable gain amplifier (VGA) disposed in series with a tunable filter in a signal flow path (e.g., a feedback path or a feedforward path), the noise reduction performance of an ANR device may be adaptively balanced with its overload characteristics. For example, in some cases, increasing the gain of the VGA may result in a better signal-to-noise ratio (SNR) at the cost of a decreased dynamic range and/or an increased likelihood of being driven to overload conditions. Automatic and simultaneous adjustments of both the VGA and the tunable filter may therefore be used in making an ANR device adaptive to various different environments, thereby improving the overall user experience. [0018] Two or more of the features described in this disclosure, including those described in this summary section, may be combined to form
implementations not specifically described herein. The details of one or more implementations are set forth in the accompanying drawings and the description below. Other features, objects, and advantages will be apparent from the description and drawings, and from the claims.
BRIEF DESCRIPTION OF THE DRAWINGS
[0019] FIG. 1 shows an in-the-ear active noise reduction (ANR) headphone.
[0020] FIG. 2 is a block diagram of an ANR device.
[0021] FIG. 3A is an example of a block diagram of an ANR device with feedforward compression.
[0022] FIG. 3B is an example of a block diagram of an ANR device with parallel feedforward compression.
[0023] FIG. 4 is a plot showing pressure variations in the ear canal due to the jaw motion of a user using a sealed in-ear headphone.
[0024] FIG. 5A is a block diagram of a feedback path filter that includes a tunable filter configured to mitigate overload conditions due to low frequency stimuli.
[0025] FIG. 5B is a block diagram of an example combination of a variable gain amplifier (VGA) and a tunable filter disposed in a signal flow path of an ANR device.
[0026] FIGs. 6A-6C are magnitude responses of different tunable high-pass filters.
[0027] FIG. 7 is a block diagram of an example bi-quad notch filter that can be used as a tunable filter in an ANR signal flow path.
[0028] FIG. 8A shows magnitude and phase responses of the bi-quad notch filter of FIG. 7 for different combinations of filter coefficients. [0029] FIG. 8B shows the variation of poles and zeros of the bi-quad notch filter with respect to a tuning parameter n.
[0030] FIGs. 8C and 8D show the variations in coefficient values of the bi- quad notch filter with respect to the tuning parameter n.
[0031] FIG. 9A shows magnitude and phase responses of a feedback path loop gain of an example ANR device without a tunable filter.
[0032] FIG. 9B shows magnitude and phase responses of the feedback path loop gain of FIG. 9A, but with a tunable filter.
[0033] FIG. 10A shows the sensitivity of a feedback path of an example ANR device without a tunable filter.
[0034] FIG. 10B shows the sensitivity of the feedback path of FIG. 10A, but with a tunable filter.
[0035] FIG. 1 1 shows the variation in output voltage of a feedback
compensator for various values of the tuning parameter of a tunable filter connected in series.
[0036] FIG. 12A shows the magnitude response of another example of a notch filter that can be used as a tunable filter in an ANR signal flow path.
[0037] FIG 12B shows the variation in coefficient values of the notch filter represented in FIG. 12A.
[0038] FIG. 13 is a flowchart of an example process for implementing parallel feedforward compression in accordance with technology described herein.
[0039] FIG. 14 is a flowchart of an example process for implementing a tunable filter in a feedback path of an ANR device in accordance with technology described herein. [0040] FIG. 15 is a flowchart of an example process for implementing a combination of a variable gain amplifier (VGA) in combination with a tunable filter in a signal flow path of an ANR device.
DETAILED DESCRIPTION
[0041] An active noise reduction (ANR) device can include a configurable digital signal processor (DSP), which can be used for implementing various signal flow topologies and filter configurations. Examples of such DSPs are described in U.S. Patents 8,073, 150 and 8,073, 151 , which are incorporated herein by reference in their entirety. U.S. Patent 9,082,388, also incorporated herein by reference in its entirety, describes an acoustic implementation of an in-ear active noise reducing (ANR) headphone, as shown in FIG. 1 . This headphone 100 includes a feedforward microphone 102, a feedback microphone 104, an output transducer 106 (which may also be referred to as an electroacoustic transducer or acoustic transducer), and a noise reduction circuit (not shown) coupled to both microphones and the output transducer to provide anti-noise signals to the output transducer based on the signals detected at both microphones. An additional input (not shown in FIG. 1 ) to the circuit provides additional audio signals, such as music or communication signals, for playback over the output transducer 106 independently of the noise reduction signals.
[0042] The term headphone, which is interchangeably used herein with the term headset, includes various types of personal acoustic devices such as in- ear, around-ear or over-the-ear headsets, earphones, and hearing aids. The headsets or headphones can include an earbud or ear cup for each ear. The earbuds or ear cups may be physically tethered to each other, for example, by a cord, an over-the-head bridge or headband, or a behind-the-head retaining structure. In some implementations, the earbuds or ear cups of a headphone may be connected to one another via a wireless link.
[0043] Various signal flow topologies can be implemented in an ANR device to enable functionalities such as audio equalization, feedback noise cancellation, feedforward noise cancellation, etc. For example, as shown in the example block diagram of an ANR device 200 in FIG. 2, the signal flow topologies can include a feedforward noise reduction path 1 10 that drives the output transducer 106 to generate an anti-noise signal (using, for example, a feedforward compensator 1 12) to reduce the effects of a noise signal picked up by the feedforward microphone 102. In another example, the signal flow topologies can include a feedback noise reduction path 1 14 that drives the output transducer 106 to generate an anti-noise signal (using, for example, a feedback compensator 1 16) to reduce the effects of a noise signal picked up by the feedback microphone 104. The signal flow topologies can also include an audio path 1 18 that includes circuitry (e.g., equalizer 120) for processing input audio signals 108 such as music or communication signals, for playback over the output transducer 106.
[0044] During most operating conditions, the acoustic noise energy that the ANR device attempts to reduce is small enough to keep the system hardware within capacity. However, in some circumstances, discrete acoustic signals or low frequency pressure disturbances (e.g., loud pops, bangs, door slams, etc.) picked up by the feedforward or feedback microphones can cause the noise reduction circuitry to overrun the capacity of the electronics or the output transducer 106 in trying to reduce the resulting noise, thereby creating audible artifacts which may be deemed objectionable by some users. These conditions, which are referred to herein as overload conditions, can be manifested by, for example, clipping of amplifiers, hard excursion limits of acoustic drivers or transducers, or levels of excursion that cause sufficient change in the acoustics response so as to cause oscillation. The problem of overload conditions can be particularly significant in small form-factor ANR devices such as in-ear headphones. For example, in order to compensate for low frequency pressure disturbances (e.g., a bus going over a pothole, a door slam, or the sound of an airplane taking off), the feedforward compensator may generate a signal that would require the acoustic transducer to exceed the corresponding physical excursion limit. Due to acoustic leaks, the excursion or driver displacement to create a given pressure typically increases with decreasing frequencies. For example, a particular acoustic transducer may need to be displaced 1 mm to generate an anti-noise signal for a 100 Hz noise, 2 mm to generate an anti-noise signal for a 50 Hz noise, and so on. Many acoustic transducers, particularly small transducers used in small form-factor AN R devices are physically incapable of producing such large displacements. In such cases, the demand of the high displacement by a compensator can cause the transducer to generate sounds that cause audible artifacts, which may contribute to an objectionable user experience. The audible artifacts can include oscillations, potentially objectionable transient sounds (e.g., "thuds," "cracks," "pops," or "clicks"), or
crackling/buzzing sounds.
[0045] In some cases, such artifacts can be reduced by temporarily lowering the gain along selected portions of the signal processing pathways (also referred to herein as "throttling"), such that a transient increase in noise from the lowering of the gain is potentially less objectionable to a user than the artifact being addressed. For example, as shown in the block diagram of an example ANR device 300 in FIG. 3A, the feedforward path 1 10 can include a variable gain amplifier (VGA) 125, the gain of which can be reduced (throttled) upon detection of a signal that can potentially overload the output transducer 106. This can be done, for example, using a sidechain filter 128, which is a filter that is applied to a signal sampled from the main signal flow to generate a test signal for determining whether or not to throttle the gain of the VGA 125. For example, the output of the VGA 125 can be passed through the sidechain filter 128 (the transfer function of which is denoted as Ksc_ff) connected to the feedforward path 1 10, and the output of the sidechain filter is compared (using, for example, a comparator 130) to a pre-determined threshold, Tff 132 to decide whether an overload condition exists. The output of the comparator 130 is provided to the variable gain amplifier (VGA) 125. If the comparator 130 detects that the filtered output signal is greater than the threshold Tff, the gain of the VGA 125 is adjusted to throttle the signal in the feedforward path 1 10 to mitigate the overload condition. While FIG. 3A shows a sidechain filter only for the feedforward path, a similar sidechain filter may also be implemented in the feedback path. Also, the sidechain filters may be disposed in the feedforward or feedback paths before or after the
corresponding main compensators 1 12 or 1 16, respectively.
[0046] In some cases, reducing the gain of the entire feedforward or feedback path may also generate some undesirable audible artifacts and/or noise modulations. For example, if the noise that causes an overload condition has significant energy at low and high frequencies, turning off or significantly reducing the gain of the feedforward compensator may allow the noise to pass through un-attenuated and may create an uncomfortable or
objectionable experience for some users. The technology described herein may improve user experience in such cases by allowing gain adjustments in only selected frequency ranges upon detection of an overload condition, while allowing compensation signals to be generated at frequencies outside of the selected range. For example, because noise reduction compensation in the lower end of the frequency spectrum (e.g. , below 100 Hz) is often the dominant reason for creating overload conditions, the feedforward
compensation may be throttled only in the low frequency portion of the spectrum, while allowing feedforward compensation to continue for other frequencies. This may provide an improved psychoacoustic experience for users because upon detection of a low frequency disturbance, the
feedforward compensation is temporarily suspended only in a selected portion of the frequency range. If the selected frequency range is in the sub-100 Hz region, the user experience is not significantly degraded for most users because human ears are typically not very sensitive to noise in that frequency range.
[0047] FIG. 3B is a block diagram of an example of an ANR device 350 with parallel feedforward compression, in which feedforward compensation is throttled in only a portion of the operating frequency range upon detection of an overload condition in that frequency range. The device 350 includes, in the feedforward path 1 10, at least two parallel paths each processing a different portion of the operating frequency range. For example, the feedforward path 1 10 can include a main feedforward compensator 133 (denoted by the transfer function KffM) which processes a frequency range that substantially excludes frequencies where overload conditions are expected to occur. The feedforward path 1 10 also includes an auxiliary feedforward compensator 134 (denoted by the transfer function Kffp) connected in parallel to the main feedforward compensator 133. The auxiliary feedforward compensator 134 processes the frequency range in which overload conditions are expected to occur. A VGA 125, sidechain filter 128, and comparator 130 are connected to the output of the auxiliary compensator 134 to throttle the compensation in the corresponding frequency range upon detection of an overload condition. However, even when the VGA 125 throttles the feedforward compensation of the auxiliary compensator 134, the main feedforward compensator 133 continues to provide compensation in the corresponding frequency range. For example, the auxiliary compensator can be configured to process signals only in the sub-100 Hz range, such that feedforward compensation due to low frequency pressure disturbances are throttled using the VGA 125. Even when the feedforward compensation by the auxiliary compensator 134 is throttled, the main feedforward compensator 133 (which can be configured to process signals above 100 Hz) continues to provide feedforward compensation to reduce noise in the corresponding frequency range. In some implementations, this improves the overall noise reduction performance of the corresponding ANR device, while limiting audible artifacts that could be caused by low frequency pressure
disturbances.
[0048] The threshold 132 associated with the comparator 130 may be determined in various ways. In some implementations, the threshold 132 may be determined based on the characteristics of the output transducer. For example, the threshold 132 might be set as a voltage reference point to prevent the drive voltage output by the VGA 125 from causing the output transducer 106 to hit a mechanical limit, or reaching a drive level where the acoustic distortion due to mechanical, magnetic or electrical characteristics is deemed undesirable. In some cases, these limits may be related to equivalent pressure levels in the ear canal. For example, as the size of the output transducer gets smaller, these limits may occur at lower equivalent pressure levels in the ear canal.
[0049] In some implementations, the main feedforward compensator 133 and auxiliary feedforward compensator 134 can include filters for isolating corresponding operating frequency ranges. For example, the auxiliary compensator 134 can include a low-pass filter with a passband cut-off frequency substantially equal to 100 Hz. The main feedforward compensator 133 can include, for example, a high pass filter with a stopband cut-off frequency substantially equal to 100 Hz. Other configurations may also be used depending, for example, on the corresponding applications. For example, the main feedforward compensator 133 can include a band-pass filter to isolate a frequency range that excludes frequencies where overload conditions are expected to occur. In some implementations, the passbands of the main and auxiliary feedforward compensators may overlap partially.
While FIG. 3B describes the filter topologies only in the feedforward path 1 10, a similar parallel topology may also be used in the feedback path.
[0050] In some implementations, multiple sidechain filters can be used in conjunction with the auxiliary compensator 134. For example, the sidechain filter can be implemented as a filter bank, where a particular sidechain filter is selected based on a mode of operation of the ANR device. For example, if the ANR device is being used in mode where some ambient sounds (e.g., human voice) are allowed to pass through, the sidechain filter selected can be different from one that is selected in a mode in which feedforward
compensation is performed for the entire operating frequency range. In some implementations, the filter bank can be implemented using a DSP where a different set of filter coefficients and/or threshold value are selected for the sidechain filter based on an identified operating mode. In some
implementations, the main feedforward compensator 133 can be configured to provide noise attenuation in the corresponding frequency range as long as the signal from the feedforward microphone 102 is not clipped. In some implementations, the sidechain filter can be operated based on input from one or more additional sensors. For example, an accelerometer may be used to identify movements by a user (e.g., running, jogging etc.) that may cause an overload condition. In some implementations, historical information on user- behavior may be used to anticipate events that may cause an overload condition. For example, if it is known that a user enters her car every morning at 7:30 am and again every evening at 5 pm, and each time the slamming of the car door results in an overload condition, this information may be used in enabling a proactive throttling of the low frequency portion of the feedforward signal path.
[0051] In some implementations, the compensation in an ANR signal flow path (e.g., a feedforward path or a feedback path) corresponding to the acoustic transducer for one ear may be coordinated with the compensation in the corresponding signal flow path of the acoustic transducer for the other ear. For example, if a user is wearing both earbuds of a headphone, such coordination between the corresponding signal flow paths may ensure that the ANR performance in the two ears are substantially similar. In some implementations, the sidechain filters of a signal flow path may be adjusted based on determining whether both earbuds of a headphone are being worn by a user. Sensors that can be used for this purpose include, for example, capacitive sensors or infrared sensors disposed on earbuds or ear cups to determine whether an earbud or ear cup is being worn by a user.
[0052] The above discussions describe the overloading problem of the acoustic transducer primarily with respect to the feedforward path 1 10. The electroacoustic transducer 106 may also be driven to an overload condition due to stimuli picked up by the feedback microphone 104. For example, in the case of in-ear ANR headphones that are tightly sealed in the ear canal, low frequency stimuli like jaw motion can create large pressure variations that are picked up by the feedback microphone 104. FIG. 4 is a plot showing the pressure variations in the ear canal over a two second time period, which are detected by a feedback microphone. In some cases, for tightly sealed in-ear headphones, low frequency pressure variations (at approximately 15 Hz) may be generated when the user walks on a firm surface. Such low frequency pressure variations of high magnitude, upon being detected by a feedback microphone 104, may cause the feedback compensator 1 16 to generate a feedback compensation signal that drives the acoustic transducer to an overload condition. This in turn may cause the acoustic transducer 106 to generate audible artifacts and degrade the performance of the ANR device. While the example of a user walking on a firm surface, which generates low frequency variations at approximately 15 Hz, is used herein as one example, other events may cause low frequency variations at different frequencies. The techniques described herein are generally applicable to events that cause low frequency variations that may lead to an overdrive condition, regardless of the particular frequency.
[0053] In some implementations, audible artifacts generated due to the low frequency pressure variations in the ear canal may be mitigated by using a tunable filter in the feedback compensator. FIG. 5A is a block diagram of an example of such a feedback compensator 500, which includes a tunable filter 502 configured to mitigate overload conditions due to low frequency stimuli picked up by the feedback microphone 104. The feedback compensator 500 also includes a fixed filter 504 configured to generate the feedback
compensation signal for the transducer 106. In some implementations, upon detection of high-magnitude low-frequency stimuli (resulting, for example, from jaw motion or walking), the tunable filter 502 can be configured to filter out such stimuli from the input signal provided to the fixed filter 504 to generate the feedback compensation signal. Under such a signal flow scheme, the feedback compensator can continue to generate feedback compensation signals for noise reduction even in the presence of high- magnitude low-frequency stimuli without being driven to an overload condition.
[0054] The parameters for the tunable filter can be selected, for example, by a parameter selector module 508 that determines an appropriate set of parameters based on the output of an estimator 506. In some implementations, the estimator 506 determines, from the feedback
compensation signal generated by the fixed filter 504, whether the feedback compensation signal could potentially drive the acoustic transducer 106 into an overload condition. Based on the output of the estimator 506, the parameter selector module 508 can be configured to select one or more parameters (or a set of filter coefficients) for the tunable filter 502, such that the tunable filter 502 filters out the stimuli that is causing the generation of the large feedback compensation signal. The parameter selector module 508 can be configured to access a look-up table to select the one or more parameters (or set of filter coefficients) for the tunable filter 502, based on the extent of driver displacement reported by the estimator 506. In some implementations, the estimator can be configured to monitor the output of the fixed filter 504 to reduce the chances of the output voltage exceeding a threshold condition associated with, for example, driving the output transducer 106 to an unacceptably high displacement, or clipping the electrical output.
[0055] In some implementations, the parameter selector module 508 can be configured to select the one or more parameters or coefficients of the tunable filter 502 such that the tunable filter 502 acts as a high-pass filter. FIGs. 6A- 6C show magnitude responses of different tunable high-pass filters
parameterized by a parameter a. The transfer function of the filter
corresponding to FIG. 6A is given by:
//(z,a) =
1 -^az > (1 )
The transfer function of the filter corresponding to FIG. 6B is given by:
H(z,a) = ^ -r (2)
\ - a z
The transfer function of the filter corresponding to FIG. 6C is given by:
\ - ^ az
H(z, a) . (3)
1 - aV1 For each of the above transfer functions, selecting the value of a to be equal to unity results in an all-pass filter. However, upon detection of low frequency stimuli that drives the acoustic transducer to an overload condition, the value of a (or a resulting set of filter coefficients) may be chosen in accordance with a desired magnitude response that would filter out the low frequency stimuli.
[0056] In some implementations, the parameter selector module 508 can be configured to select the one or more parameters or filter coefficients of the tunable filter 502 such that the tunable filter 502 acts as a notch filter. This can be useful, for example, when the pressure variations causing an overload condition is in a narrow frequency range. For example, when a user walks on a firm surface wearing tightly-sealed in-ear headphones, high-magnitude pressure variations can occur at about 15 Hz. In such cases, a notch filter can be used to prevent such pressure variations from generating feedback signals that could drive the acoustic transducer to an overload. Because only a narrow range of frequencies are suppressed using notch filter, such a filter may only insignificantly degrade the feedback compensation performance of the ANR device.
[0057] While the description so far uses examples where the parallel compression is used in a feedforward signal flow path (FIG. 3B) and the tunable filter is used in a feedback signal path (FIG. 5A), each of these techniques may be used in other signal flow paths. For example, the feedforward compression technique may be used in a feedback ANR signal flow path, and a tunable filter may be used in a feedforward ANR signal flow path. FIG. 5B shows a block diagram of another system that may be used in either of a feedforward or a feedback ANR signal flow path. Specifically, FIG. 5B is a block diagram of an example system 550 that uses a combination of a variable gain amplifier (VGA) 552 and a tunable filter 554 disposed in a signal flow path of an ANR device. The signal flow path, which includes a sensor (e.g. , a microphone 557 and/or a non-microphone sensor 555) at one end and an acoustic transducer 106 at the other end, can include, for example, a feedback path or a feedforward path of the ANR device. If the signal flow path in which the system 550 is disposed is a feedforward path, the tunable filter 554 may be referred to as a feedforward compensator. If the signal flow path in which the system 550 is disposed is a feedback path, the tunable filter 554 may be referred to as a feedback compensator.
[0058] In some implementations, the noise reduction performance of the ANR device may be balanced against its overload performance by adaptively adjusting the VGA 552 and the tunable filter 554 based on the environment of the ANR device. In some implementations, the noise reduction performance may be improved by increasing the gain of the VGA 552. For example, the ANR device may introduce system-generated noise (e.g., noise generated by the electronics disposed in the signal flow path), which may be manifested as a substantially constant audible "hiss" generated by the acoustic transducer 106. In such cases, increasing the gain of the VGA 552 may in some cases improve the signal-to-noise ratio (SNR), and decrease the undesirable hissing audio generated by the acoustic transducer 106. This may also be referred to as lowering of the "noise floor," and improve user experience particularly in low-noise environments. However, pre-amplifying the gain of the VGA 552 boosts any signals captured using the microphones 557 (e.g., feedback and/or feedforward microphones), which in some cases may result in clipping of the incoming signal. For example, if the gain of the VGA 552 is increased to lower the noise floor, the dynamic range of the system may also be reduced, causing the system (e.g., the electronics of the signal flow path and/or the acoustic transducer 106) to overload more easily. In some cases, such overload conditions may cause the acoustic transducer 106 to produce audible pops and clicks, which in turn may detract from the improved user- experience resulting from the lowered noise floor.
[0059] The signal flow path illustrated in FIG. 5B is an example of a system that can be used to balance the noise reduction performance with the overload performance of an ANR device. For example, in quiet environments, where the likelihood of low frequency disturbances (e.g., those caused by low frequency pressure variations in the environment) is low, the gain of the VGA can be adjusted to a relatively high value that reduces the audible noise floor. This in turn may expose the ANR device to a higher likelihood of being driven to overload conditions. Therefore, as soon as an overload condition is detected by the estimator 556, or when the ANR device is moved to an environment where the likelihood of low frequency pressure variations is higher, the parameter selector 558 may be configured to adjust the gain of the VGA to a lower value to reduce the chances of the system being driven to an overload condition. In some cases, if the VGA gain is reduced in a noisier environment, a psychoacoustic effect of the increased noise floor may not be significantly noticeable to a user. However, the adaptive reducing of the gain of the VGA 552 may result in mitigating audible pops and clicks that may otherwise have degraded the user experience due to the occurrence of overload conditions.
[0060] In some implementations, when the gain of the VGA 552 is adjusted to a particular level, the filter coefficients of the tunable filter 554 are also adjusted accordingly to compensate for the change in gain of the VGA 552. For example, if the parameter selector 558 increases the gain of the VGA 552 by 6 dB, the parameter selector 558 may also be configured to select an appropriate set of filter coefficients for the tunable filter 554, such that the magnitude response of the tunable filter is reduced by about 6 dB to compensate for the increased gain of the VGA 552. In some cases, such simultaneous adjustment of the VGA and the tunable filter ensures that the overall gain of the signal flow path is substantially constant, and the user experience is substantially uniform.
[0061] The VGA 552 is configured to process signals captured by one or more sensors such as microphones 557 and/or non-microphone sensors 555. The microphones 557 can be of various types, possibly depending on, for example, the signal flow path in which the system 550 is disposed. For example, if the system 550 is disposed in a feedforward ANR path, the microphone 557 can include the feedforward microphone of the ANR device, such as the microphone 102 described above. In another example, if the system 550 is disposed in a feedback ANR path, the microphone 557 can include a feedback microphone such as the microphone 104 described above. The sensors 555 can also be of various types. In some implementations, the non-microphone sensors 555 can include, for example, a pressure sensor, an accelerometer, or a gyroscope. Such non-microphone sensors 555 may be used, for example, to detect pressure changes or activities that may prompt a change in the settings of the VGA 552 and/or the tunable filter 554. For example, based on the output of an accelerometer disposed in an ANR headphone, a determination may be made that the user is running or jogging, which in turn may produce low frequency pressure variations at a particular frequency. Based on such a determination, the parameter selector 558 may be configured to adjust the gain associated with the VGA and the filter coefficients of the tunable filter 554. While the system 550 illustrated in FIG. 5B includes both non-microphone sensors 555 and microphones 557, systems that include only microphones 557 or only non-microphone sensors 555 are also possible.
[0062] In some implementations, the adjustments to the gain of the VGA 552 and the filter coefficients of the tunable filter 554 may be made based on predicting the onset of a particular event. In some implementations, the environment of a user may be determined based on the output of a global positioning system (GPS) (e.g., one disposed either in the ANR device or in a mobile phone connected to the ANR device), and the settings of the VGA 552 and the tunable filter 554 may be adjusted in accordance with the
determination. For example, if the user of the ANR device is determined to be in a library or office, the parameter selector 558 can be configured to adjust the settings of the ANR device in accordance with that typically used in quiet environments. Conversely, if the user is determined to be in a train during commuting hours, the parameter selector 558 can be configured to adjust the settings of the ANR device in accordance with that typically used in noisy environments. In some implementations, the user's environment may be detected based on one or more applications executing on the ANR device and/or a mobile device connected to the ANR device. For example, upon determining that the user has just started an application that tracks the user's running steps, an inference may be made that the user is about to start a run. Accordingly, the parameter selector 558 can be configured to adjust the VGA 552 and the tunable filter 554 to account for the corresponding expected low- pressure variations in the ANR device. In some implementations, information about both the environment and the activity of the user may be used in determining that operating parameters of the VGA 552 and the filter coefficients of the tunable filter.
[0063] The parameter selector 558 can be configured to select the operating parameters of the VGA 552 and the tunable filter 554 in various ways. In some implementations, the parameter selector may be configured to access a computer-readable storage device that stores a representation of a look-up table that stores different sets of filter coefficients of the tunable filter 554 linked to different gain values of the VGA 552. In some implementations, the parameter selector can be configured to calculate the filter coefficients of the tunable filter 554 based on a pre-defined relationship with the selected gain values. The gain values to be used in different environments may be empirically determined or calculated as a function of the outputs of one or more sensors such as a pressure sensor or microphone. In some
implementations, the gain level of the VGA 552 may also be changed based on user-input received via a user interface. The user interface can be a control such as a switch, knob, or dial disposed on the ANR device, or a software-based graphical user interface displayed on a display device such as one displayed on a connected mobile device.
[0064] The estimator 556 can be configured to determine whether any adjustments to the VGA 552 and/or the tunable filter 554 are needed.
Accordingly, the estimator 556 can be configured to signal the parameter selector 558 to adjust one or both of the VGA 552 and the tunable filter 554. In some implementations, the estimator 556 is substantially similar to the estimator 506 described above with reference to FIG. 5A. In some
implementations, the estimator 556 can be a displacement estimator configured to estimate whether the drive signal for the acoustic transducer can potentially cause the transducer to exceed its excursion limit. In some implementations, the estimator 556 can include a pressure estimator configured to detect the occurrence of pressure disturbances in the
environment.
[0065] The system 550 may be operated in various modes. In some implementations, the system 550 can be configured to run substantially continuously upon initialization. For example, if the system 550 is disposed in a feedforward or feedback path of an ANR headphone, the system may be initialized when the ANR functionality of the headphone is activated, and then allowed to run during the operating period of the headphone. In some cases though, such a mode of operation may cause multiple pops and clicks, which could degrade the user experience to some extent. In some implementations, the system 550 can include a control (e.g., a button) to deactivate/activate the system 550 based on user-input. In some implementations, instead of performing continuous adjustments upon activation, the system 550 could be configured such that the parameter selector 558 adjusts the VGA 552 and the tunable filter 554 in accordance with the current environment, and then either shuts off or goes into standby mode. The system may be reactivated based on a user-input which indicates that the environment has changed, or that a readjustment is otherwise desired. In some implementations, the system 550 or the ANR device in which it is deployed may include one or more controls (e.g., hardware buttons and/or software controls presented on a user interface) for selecting the mode of operation of the system 550.
[0066] In a mode of operation in which the system 550 automatically adjusts the gain of the VGA 552 and the filter coefficients of the tunable filter 554, the adjustments may be performed in various ways. In some implementations, the adjustments are performed substantially periodically. For example, the adjustments may be performed with a time period of about 100 ms or more. The frequency of adjustments may be selected empirically, for example, to allow the system 550 to adequately adjust to changing environments. In some implementations, the adjustments can be performed upon detection of a change in the environment. For example, if the estimator 556 detects a signal indicative of a change in the environment (e.g., the occurrence of a low frequency pressure event), the estimator may signal the parameter selector 558 to adjust the VGA 552 and the tunable filter 554 accordingly.
[0067] In some implementations, in order to prevent the system 550 from adjusting too frequently, a decision threshold may be associated with the adjustments. In some implementations, an adjustment may be made only if the amount of required change in the gain of the VGA 552 exceeds a threshold amount. For example, an adjustment may be made only if the gain adjustment is 2.25 dB or higher. The threshold amount may be determined empirically, for example, to prevent overly frequent adjustments.
[0068] The adjustments to the gain level of the VGA 552 can be performed in various ways. In some implementations, the adjustments may be made in a single step. In some implementations, the adjustments may be made as a series of multiple steps. For example, if an adjustment of 6 dB needs to be made, the adjustments may be made as a single step change of 6 dB, or a series of six steps each implementing a 1 dB change, or another combination of steps. The step sizes may be determined empirically, for example, based on the tolerance for any associated audible artifacts generated by the step changes. In some implementations, the time gap between the steps may also be adjusted, for example, to reduce the possibility of multiple audible artifacts to be merged into a single louder artifact. However, increasing the gap between the steps also increases the total adjustment time. The spacing between the steps can therefore be selected empirically in accordance with a target tradeoff between the adjustment time and the tolerable audible artifacts.
[0069] FIG. 7 is a block diagram of an example bi-quad notch filter that can be used as a tunable filter in an ANR signal flow path. The transfer function of the filter is given by:
[0070] In practice, multiple bi-quad notch filters may be cascaded to achieve the desired level of suppression. FIG. 8A shows magnitude and phase responses of a single bi-quad notch filter (as shown in FIG. 7) for different combinations of filter coefficients. The filter coefficients are parameterized by the parameter s. Specifically, the curves 802, 804, 806, and 808 represent the magnitude responses for parameter values n=1 , n=2, n=3, and n=4, respectively. The curves 810, 812, 814, and 816 represent the phase responses for parameter values n=1 , n=2, n=3, and n=4, respectively. FIG. 8B shows the variation of poles and zeros of the bi-quad notch filter with respect to a tuning parameter n in terms of frequency and bi-quad
singularities Q. The Q is also known as the quality factor. In figure 8B the curves describing the pole and zero frequency and Qs as a function of tuning variation show that the notch sharpness and notch center frequency are coupled. To maintain desirable feedback ANR performance, the notch depth increases with increasing frequency.
[0071] FIGs. 8C and 8D show the variations in filter coefficient values of the bi-quad notch filter with respect to the tuning parameter n. In the particular example shown in FIGs. 8C and 8D, the values of the coefficients b1 and a1 are in the vicinity of 2, and the values of the coefficients b2 and a2 are in the vicinity of unity. This is related to the particular implementation which uses a sample rate of 384000 samples per second, which is greater than the desired 15 Hz notch frequency. In some implementations, the filter coefficient values (e.g. , b1 , b2, a1 and a2, in the present example) can be stored in a look-up table, or derived from mapping rules such as the frequency/Q mapping illustrated in FIG. 8B.
[0072] FIGs. 9A-9B, and FIGs. 10A-10B illustrate the performance of a tunable filter in the feedback path. Specifically, FIGs. 9A and 9B show magnitude and phase responses of the loop gain (provided as a product of the driver-voltage-to-feedback-microphone-voltage transfer function and the feedback compensator transfer function K¾) of the feedback path without a tunable filter and with a tunable filter, respectively. The particular tunable filter used in this example included twelve cascaded bi-quad notch filters, each of which were substantially similar to the bi-quad notch filter illustrated in FIG. 7. As illustrated by FIG. 9B, the tunable filter remains stable and exhibits consistent loop gain behavior for the various values of the tuning parameter n. Further, as illustrated by FIGs. 10A and 10B, which show the sensitivity of a feedback path of the example ANR device without a tunable filter (FIG. 10A), and with a tunable filter (FIG. 10B), the sensitivity of the filters also remains consistent for the various values of the tuning parameter.
[0073] FIG. 1 1 shows the variation in output voltage of the feedback compensator 1 16 for the various values of the tuning parameter n.
Specifically, the curves 1 102, 1 104, 1 106, and 1 108 represent the variations in the feedback compensator output for parameter values n=1 , n=2, n=3, and n=4, respectively. As illustrated by these curves, the parameter value can be adjusted to get different levels of suppression at around the desired 15 Hz frequency, without significantly affecting the feedback compensator output at other frequencies.
[0074] FIG. 12A shows the magnitude response of another example of a notch filter that can be used as a tunable filter in the feedback path. This notch filter is another single bi-quad notch filter such as the one illustrated in FIG. 7, but with the coefficients a1 and a2 held to be constants. In this example, the frequency of the complex poles and zeros were equal and the Q of the zeros was varied to change the depth of the notch, which resulted in changes to the coefficients b1 and b2 only. Such variations of the coefficients are illustrated in FIG. 12B.
[0075] FIG. 13 is a flowchart of an example process 1300 for implementing parallel feedforward compression in accordance with technology described above. At least a portion of the process 1300 can be implemented using one or more processing devices such as DSPs described in U.S. Patents
8,073, 150 and 8,073,151 , incorporated herein by reference in their entirety. Operations of the process 1300 include receiving an input signal representing audio captured by a feedforward microphone of an ANR device such as an ANR headphone (1302). In some implementations, the ANR device can be an in-ear headphone such as the one described with reference to FIG. 1 . In some implementations, the ANR device can include, for example, around-the- ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices. In some implementations, the
feedforward microphone can be a part of an array of microphones.
[0076] Operations of the process 1300 also include processing a first frequency range of the input signal to generate a first feedforward signal for an acoustic transducer of the ANR headphone (1304). This can be done using a first feedforward compensator disposed in the ANR device to generate anti-noise signals to reduce or cancel noise signals picked up by the feedforward microphone. In some implementations, generating the first feedforward signal includes processing the input signal by a first filter to generate a first filtered signal, and processing the first filtered signal by the first feedforward compensator to generate the first feedforward signal. The first filter can be a high-pass or band-pass filter having a passband that includes the first frequency range. The first feedforward signal represents an anti-noise signal configured to reduce a noise signal in the first filtered signal.
[0077] The process 1300 also includes processing a second frequency range of the input signal to generate a second feedforward signal for the acoustic transducer (1306). This can be done, for example, by a second feedforward compensator disposed in parallel to the first feedforward compensator. In some implementations, the first frequency range includes frequencies higher than the frequencies in the second frequency range. For example, an upper limit of the second frequency range can be substantially equal to 100 Hz, whereas the lower limit of the first frequency range can be greater than or substantially equal to 100 Hz. In some implementations, the first frequency range can include at least a portion of the second frequency range. In some implementations, generating the second feedforward signal includes processing the input signal by a second filter to generate a second filtered signal, and processing the second filtered signal by the second feedforward compensator to generate the second feedforward signal. The second filter can have a passband that includes the second frequency range, and the second feedforward signal can represent an anti-noise signal configured to reduce a noise signal in the second filtered signal.
[0078] Operations of the process 1300 further include detecting that the second feedforward signal satisfies a threshold condition (1308). This can include, for example, determining that a voltage level representing the second feedforward signal reaches or exceeds a threshold to indicate an overdrive condition of the electroacoustic transducer. This can also include, for example, filtering the second feedforward signal using a digital filter, and comparing the filtered second feedforward signal to a value associated with the threshold condition. The set of coefficients of the digital filter can be selected based on a mode of operation of the ANR headphone.
[0079] Operations of the process 1300 also include attenuating the second feedforward signal responsive to determining that the second feedforward signal satisfies the threshold condition (1310). For example, if the second feedforward signal satisfies the threshold condition, a determination is made that the second feedforward signal would drive the acoustic transducer, or other portions of the associated electronics, to overload, and accordingly, a variable gain amplifier in the signal path of the second feedforward signal is adjusted to attenuate the second feedforward signal.
[0080] Operations of the process can also include, for example, generating a combined feedforward signal for the acoustic transducer by summing the second feedforward signal and the first feedforward signal, or by summing the attenuated second feedforward signal and the first feedforward signal. The acoustic transducer can then be driven using, in part, the combined feedforward signal. [0081] All of the various signal topologies and filter designs described above can be implemented in the configurable digital signal processor described in the cited patents. These topologies and filter designs may also be
implemented in analog circuits, or in a combination of analog and digital circuits, using conventional circuit design techniques, though the resulting product may be larger or less flexible than one implemented using an integrated, configurable digital signal processor.
[0082] FIG. 14 is a flowchart of an example process 1400 for implementing a tunable filter in a feedback path of an ANR device in accordance with technology described above. At least a portion of the process 1400 can be implemented using one or more processing devices such as DSPs described in U.S. Patents 8,073, 150 and 8,073,151 , incorporated herein by reference in their entirety. Operations of the process 1400 include receiving an input signal representing audio captured by a feedback microphone of an ANR device such as an ANR headphone (1402). In some implementations, the ANR device can be an in-ear headphone such as one described with reference to FIG. 1 . In some implementations, the ANR device can include, for example, around-the-ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices. In some implementations, the feedback microphone can be a part of an array of microphones.
[0083] Operations of the process 1400 also include generating, by a feedback compensator and based on the input signal, a first signal (1404). In some implementations, the feedback compensator can be substantially similar to the fixed filter 504 described above with reference to FIG. 5A. For example, the first signal can include an anti-noise signal generated in response to a noise detected by a feedback microphone, wherein the anti-noise signal is configured to cancel or at least reduce the effect of the noise.
[0084] The operations of the process 1400 include determining one or more characteristics of the first signal (1406). This can be done, for example, using a module substantially similar to the estimator 506 described above with reference to FIG. 5A. The one or more characteristics can include a voltage level of the first signal, the voltage level being indicative of an amount of excursion or driver displacement of the corresponding acoustic transducer 106. In some implementations, the one or more characteristics can be indicative of a frequency or frequency range of the input signal where the underlying noise is detected.
[0085] The operations of the process 1400 further include selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the feedback
compensator (1408). The plurality of filter coefficients can be selected, for example, in accordance with a target frequency response of the digital filter. For example, if the one or more characteristics of the first signal indicate that the voltage level of the first signal can potentially drive the corresponding acoustic transducer to an overload condition, and that the underlying noise in the input signal is in the vicinity of 15 Hz, the plurality of coefficients can be chosen to configure the digital filter as a high-pass or notch filter to suppress or attenuate components of the input signal around 15 Hz. In some implementations, selecting the plurality of coefficients can be done by accessing a pre-stored look-up table that includes parameter or coefficient values for the digital filter for various combinations of the one or more characteristics determined for the first signal. In some implementations, the digital filter is substantially similar to the tunable filter described above with reference to FIGs. 5A and 5B.
[0086] The digital filter may be disposed in the feedback path of an ANR device in series with a feedback compensator, and either before or after the feedback compensator. In some implementations, the digital filter may be integrated together with the feedback compensator in the form of a combined set of coefficients. For example, with reference to FIG. 5A, the tunable filter 502 and the fixed filter 504 may be combined in the form of a unified filter providing feedback compensation. The digital filter may be implemented in various forms, including for example, as an infinite impulse response (MR) filter or a finite impulse response (FIR filter).
[0087] Operations of the process 1400 also include generating, by processing the input signal using the plurality of filter coefficients of the digital filter, a feedback compensation signal for an acoustic transducer of the ANR headphone (1410). In some implementations, once the input signal is processed by the digital filter with selected coefficients, a portion of the input signal causing the generation of out-of-range feedback compensation signals may be attenuated, thereby preventing any potential overload conditions in the acoustic transducer. In some implementations, this may improve user experience by avoiding audible artifacts that are otherwise generated by such overload conditions.
[0088] FIG. 15 is a flowchart of an example process 1500 for implementing a combination of a variable gain amplifier (VGA) in combination with a tunable filter in a signal flow path of an ANR device in accordance with technology described above. At least a portion of the process 1500 can be implemented using one or more processing devices such as DSPs described in U.S.
Patents 8,073, 150 and 8,073, 151 , incorporated herein by reference in their entirety. Operations of the process 1500 include receiving an input signal captured by one or more sensors associated with an ANR device such as an ANR headphone (1502). In some implementations, the one or more sensors can include one or more of a feedforward microphone and feedback microphone of the ANR headphone. In some implementations, the one or more sensors include one or more of a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the electroacoustic transducer.
[0089] Operations of the process 1500 also include determining one or more characteristics of the first portion of the input signal (1506). In some implementations, the one or more characteristics of the first portion of the input signal is indicative of a noise floor associated with the external environment of the ANR headphone. In some implementations, determining the one or more characteristics of the first portion of the input signal includes processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR headphone, and determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal. For example, determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal can include determining that the first output signal is clipped. In some implementations, the one or more characteristics of the first portion of the input signal is indicative of a likelihood that an output signal resulting from processing of the first portion of the input signal by the ANR signal flow path would be clipped. In some
implementations, determining the one or more characteristics of the first portion of the input signal includes determining a non-linear relationship between the first portion of the input signal and the first output signal. For example, a non-linear relationship may be manifested by an output signal that causes an acoustic transducer to generate an audible artifact such as a pop or click.
[0090] Operations of the process 1500 also include automatically adjusting based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path (1508). In some implementations, the gain of the VGA is adjusted periodically during an operation of the ANR headphone. The time period of the
adjustments may be determined empirically, and can be, for example, at least about 100 ms. In some implementations, the gain of the VGA is adjusted responsive to determining that the one or more characteristics of the first portion of the input signal or the first output signal satisfies a threshold condition. The threshold condition can include, for example, an amount of required gain adjustment. For example, the gain of the VGA may be adjusted only if the required adjustment is at least 2.25 dB.
[0091] Operations of the process 1500 also include selecting a set of coefficients for a tunable digital filter disposed in the ANR signal flow path in accordance with the gain of the VGA (1510). For example, if the gain of the VGA is adjusted by a particular amount (e.g., 5 dB), the set of coefficients for the tunable digital filter may be selected such that the magnitude response of the filter due to the selected coefficients compensates for the gain adjustment of the VGA. This may be done, for example, to keep the overall gain of the signal flow path substantially unchanged.
[0092] Operations of the process 1500 further include processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone (1512). In some
implementations, the second output signal reduces the chances of the system 550 being driven to an overload condition, as compared to the first output signal. The process 1500 may therefore be used for mitigating overload conditions in a feedforward or feedback path of the ANR headphone.
[0093] The functionality described herein, or portions thereof, and its various modifications (hereinafter "the functions") can be implemented, at least in part, via a computer program product, e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine- readable media or storage device, for execution by, or to control the operation of, one or more data processing apparatus, e.g. , a programmable processor, a computer, multiple computers, and/or programmable logic components.
[0094] A computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by a network.
[0095] Actions associated with implementing all or part of the functions can be performed by one or more programmable processors executing one or more computer programs to perform the functions of the calibration process. All or part of the functions can be implemented as, special purpose logic circuitry, e.g., an FPGA and/or an ASIC (application-specific integrated circuit). In some implementations, at least a portion of the functions may also be executed on a floating point or fixed point digital signal processor (DSP) such as the Super Harvard Architecture Single-Chip Computer (SHARC) developed by Analog Devices Inc.
[0096] Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. Components of a computer include a processor for executing instructions and one or more memory devices for storing instructions and data.
[0097] Other embodiments and applications not specifically described herein are also within the scope of the following claims. For example, the parallel feedforward compensation may be combined with a tunable digital filter in the feedback path. In another example, a tunable digital filter in the feedforward path may be combined with a parallel compensation scheme in the feedback path. In some implementations, various combinations of the parallel compensation technique, tunable filter technique, and the VGA technique may be used in the ANR signal flow paths (e.g., a feedback path or a feedforward path) of an ANR device. In some implementations, an ANR signal flow path can include a tunable digital filter as well as a parallel compensation scheme to attenuate generated control signal in a specific portion of the frequency range.
[0098] Elements of different implementations described herein may be combined to form other embodiments not specifically set forth above.
Elements may be left out of the structures described herein without adversely affecting their operation. Furthermore, various separate elements may be combined into one or more individual elements to perform the functions described herein.

Claims

WHAT IS CLAIMED IS:
1 . A method comprising:
receiving an input signal representing audio captured by a microphone of an active noise reduction (ANR) headphone;
processing, by a first compensator, a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone;
processing, by a second compensator disposed in parallel to the first compensator, a second frequency range of the input signal to generate a second signal for the acoustic transducer, wherein the first frequency range includes frequencies higher than the frequencies in the second frequency range;
detecting, by one or more processing devices, that the second signal satisfies a threshold condition; and
responsive to determining that the second signal satisfies the threshold condition, attenuating the second signal.
2. The method of claim 1 , further comprising generating a combined
signal for the acoustic transducer by summing the second signal and the first signal, or by summing the attenuated second signal and the first signal.
3. The method of claim 2, further comprising driving the acoustic
transducer using the combined signal.
4. The method of claim 1 , wherein an upper limit of the second frequency range is substantially equal to 100 Hz.
5. The method of claim 1 , wherein the first frequency range includes at least a portion of the second frequency range.
6. The method of claim 1 , wherein detecting that the second signal satisfies the threshold condition comprises determining that a voltage level representing the second signal reaches or exceeds a threshold to indicate an overload condition.
7. The method of claim 1 , wherein detecting that the second signal
satisfies the threshold condition comprises filtering the second signal using a digital filter, and comparing the filtered second signal to a value associated with the threshold condition.
8. The method of claim 7, wherein a set of coefficients of the digital filter is selectable based on a mode of operation of the ANR headphone.
9. The method of claim 1 , wherein attenuating the second signal
comprises adjusting a variable gain amplifier that processes the second signal.
10. The method of claim 1 , wherein processing the first frequency range of the input signal to generate the first signal comprises:
processing the input signal by a first filter to generate a first filtered signal, the first filter having a passband that includes the first frequency range; and
processing the first filtered signal by the first compensator to generate the first signal, wherein the first signal represents an anti- noise signal configured to reduce a noise signal in the first filtered signal.
11 . The method of claim 1 , wherein processing the second frequency
range of the input signal to generate the second signal comprises: processing the input signal by a second filter to generate a second filtered signal, the second filter having a passband that includes the second frequency range; and processing the second filtered signal by the second
compensator to generate the second signal, wherein the second signal represents an anti-noise signal configured to reduce a noise signal in the second filtered signal.
12. The method of claim 1 , wherein the input signal represents audio
captured by a feedforward microphone of the ANR headphone.
13. The method of claim 1 , wherein each of the first compensator and the second compensator is a feedforward compensator disposed in a feedforward signal flow path of the ANR headphone.
14. The method of claim 1 , wherein each of the first compensator and the second compensator is a feedback compensator disposed in a feedback signal flow path of the ANR headphone.
15. An active noise reduction (ANR) device comprising:
one or more sensors configured to generate an input signal indicative of an external environment of the ANR device;
a first compensator configured to process a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone;
a second compensator disposed in parallel to the first compensator, the second compensator filter configured to process a second frequency range of the input signal to generate a second signal for the acoustic transducer, wherein the first frequency range includes frequencies higher than the frequencies in the second frequency range; and
one or more processing devices configured to:
detect that the second signal satisfies a threshold condition, and attenuate the second signal responsive to determining that the second signal satisfies the threshold condition.
16. The ANR device of claim 15, further comprising an adder configured to generate a combined signal for the acoustic transducer by summing the second signal and the first signal, or by summing the attenuated second signal and the first signal.
17. The ANR device of claim 15, wherein an upper limit of the second
frequency range is substantially equal to 100 Hz.
18. The ANR device of claim 15, wherein detecting that the second signal satisfies the threshold condition comprises determining that a voltage level representing the second signal reaches or exceeds a threshold to indicate an overload condition.
19. The ANR device of claim 17, further comprising:
a digital filter for filtering the second signal; and
a comparator configured to comparing the filtered second signal to a value associated with the threshold condition.
20. The ANR device of claim 18, wherein a set of coefficients of the digital filter is selectable based on a mode of operation of the ANR device.
21 . The ANR device of claim 15, further comprising a variable gain
amplifier (VGA) that processes the second signal, and the one or more processing devices are configured to adjust a gain of the VGA to attenuate the second signal.
22. The ANR device of claim 15, further comprising: a first filter configured to process the input signal to generate a first filtered signal, the first filter having a passband that includes the first frequency range,
wherein the first filtered signal is processed by the first compensator to generate the first signal, the first signal representing an anti-noise signal configured to reduce an effect of ambient noise on the first filtered signal as compared to an effect of the ambient noise on the input signal.
23. The ANR device of claim 15, further comprising:
a second filter configured to process the input signal to generate a second filtered signal, the second filter having a passband that includes the second frequency range,
wherein the second filtered signal is processed by the second compensator to generate the second signal, the second signal representing an anti-noise signal configured to reduce an effect of ambient noise on the second filtered signal as compared to an effect of the ambient noise on the input signal.
24. The ANR device of claim 15, wherein each of the first compensator and the second compensator is a feedforward compensator disposed in a feedforward signal flow path of the ANR headphone.
25. The ANR device of claim 15, wherein each of the first compensator and the second compensator is a feedback compensator disposed in a feedback signal flow path of the ANR headphone.
26. One or more machine-readable storage devices having encoded
thereon computer readable instructions for causing one or more processing devices to perform operations comprising:
receiving an input signal representing audio captured by a microphone of an active noise reduction (ANR) headphone; causing a first compensator to process a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone;
causing a second compensator, disposed in parallel to the first compensator, to process a second frequency range of the input signal to generate a second signal for the acoustic transducer, wherein the first frequency range includes frequencies higher than the frequencies in the second frequency range;
detecting that the second signal satisfies a threshold condition; and
responsive to determining that the second signal satisfies the threshold condition, attenuating the second signal.
27. A method comprising:
receiving an input signal representing audio captured by one or more sensors of an active noise reduction (ANR) headphone;
generating, by a compensator disposed in an ANR signal flow path of the ANR headphone and based on the input signal, a first signal;
determining one or more characteristics of the first signal;
selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the compensator in the ANR signal flow path, in accordance with a target frequency response of the digital filter;
generating, by processing the input signal using the plurality of filter coefficients of the digital filter, a feedback control signal for an electroacoustic transducer of the ANR headphone.
28. The method of claim 27, wherein the digital filter is disposed after the compensator in a signal flow path.
29. The method of claim 27, wherein the digital filter is disposed before the compensator in a signal flow path.
30. The method of claim 27, further comprising:
determining, based on the one or more characteristics, that a portion of the input signal in a particular frequency range is causing the first signal to trigger an overload condition in the electroacoustic transducer; and
selecting the plurality of filter coefficients such that the selected filter coefficients configure the digital filter to attenuate the portion of the input signal in the particular frequency range.
31 . The method of claim 27, wherein the one or more characteristics
comprise a voltage level.
32. The method of claim 27, further comprising driving the electroacoustic transducer using the feedback control signal.
33. The method of claim 27, wherein the digital filter is a high-pass filter.
34. The method of claim 27, wherein the digital filter is a notch filter.
35. The method of claim 27, wherein the digital filter is an infinite impulse response (MR) filter.
36. The method of claim 27, wherein the ANR signal flow path comprises a feedforward path disposed between a feedforward microphone of the ANR headphone and the electroacoustic transducer.
37. The method of claim 27, wherein the ANR signal flow path comprises a feedback path disposed between a feedback microphone of the ANR headphone and the electroacoustic transducer.
38. An active noise reduction (ANR) device comprising:
one or more sensors configured to generate an input signal indicative of an external environment of the ANR device; a compensator disposed in an ANR signal flow path of the ANR device, the compensator configured to generate a first signal based on the input signal;
a tunable digital filter disposed in series with the compensator in the ANR signal flow path, wherein the tunable digital filter is configured to generate a control signal for an electroacoustic transducer of the ANR device; and
one or more processing devices configured to:
determine one or more characteristics of the first signal, and
select, based on the one or more characteristics of the first signal, a plurality of filter coefficients for the tunable digital filter in accordance with a target frequency response of the tunable digital filter.
39. The ANR device of claim 38, wherein the tunable digital filter is
disposed after the compensator in a signal flow path.
40. The ANR device of claim 38, wherein the digital filter is disposed before the compensator in a signal flow path.
41 . The ANR device of claim 38, wherein the one or more processing devices are further configured to:
determine, based on the one or more characteristics, that a portion of the input signal in a particular frequency range is causing the first signal to trigger an overload condition in the electroacoustic transducer; and
select the plurality of filter coefficients such that the selected filter coefficients configure the tunable digital filter to attenuate the portion of the input signal in the particular frequency range.
42. The ANR device of claim 38, wherein the one or more characteristics comprise a voltage level.
43. The ANR device of claim 38, wherein the tunable digital filter is one of: a high-pass filter or a notch filter.
44. The ANR device of claim 38, wherein the ANR signal flow path
comprises a feedforward path disposed between a feedforward microphone of the ANR device and the electroacoustic transducer.
45. The ANR device of claim 38, wherein the ANR signal flow path
comprises a feedback path disposed between a feedback microphone of the ANR device and the electroacoustic transducer.
46. One or more machine-readable storage devices having encoded
thereon computer readable instructions for causing one or more processing devices to perform operations comprising:
receiving an input signal representing audio captured by one or more sensors of an active noise reduction (ANR) headphone;
causing a compensator disposed in an ANR signal flow path of the ANR headphone to generate a first signal based on the input signal;
determining one or more characteristics of the first signal;
selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the compensator in the ANR signal flow path, in accordance with a target frequency response of the digital filter; and
generating a feedback control signal for an electroacoustic transducer of the ANR headphone by causing the digital filter to process the input signal using the plurality of filter coefficients.
47. A method comprising:
receiving an input signal captured by one or more sensors associated with an ANR headphone; determining, by one or more processing devices in an ANR signal flow path, one or more characteristics of a first portion of the input signal;
automatically adjusting, by the one or more processing devices based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path;
selecting, by the one or more processing devices, a set of coefficients for a tunable digital filter disposed in the ANR signal flow path, wherein the set of coefficients are selected in accordance with the gain of the VGA; and
processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for an electroacoustic transducer of the ANR headphone.
48. The method of claim 47, wherein determining the one or more
characteristics of the first portion of the input signal comprises:
processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR headphone; and
determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal.
49. The method of claim 47, wherein the one or more sensors comprise a feedforward microphone of the ANR headphone.
50. The method of claim 47, wherein the one or more sensors comprise a feedback microphone of the ANR headphone.
51 . The method of claim 47, wherein the one or more sensors comprise one or more of a pressure sensor, an accelerometer, and a
displacement sensor configured to sense an amount of excursion of the electroacoustic transducer.
52. The method of claim 47, wherein the ANR signal flow path comprises a feedforward path disposed between a feedforward microphone of the ANR headphone and the electroacoustic transducer.
53. The method of claim 47, wherein the ANR signal flow path comprises a feedback path disposed between a feedback microphone of the ANR headphone and the electroacoustic transducer.
54. The method of claim 47, further comprising deactivating VGA gain adjustments responsive to a first user-input received by an input-device of the ANR headphone.
55. The method of claim 54, further comprising reactivating VGA gain
adjustments responsive to a second user-input received by the input- device of the ANR headphone.
56. The method of claim 47, wherein the gain of the VGA is adjusted
periodically during an operation of the ANR headphone.
57. The method of claim 47, wherein the gain of the VGA is adjusted
responsive to determining that the one or more characteristics of the first portion of the input signal satisfies a threshold condition.
58. The method of claim 47, wherein the one or more characteristics of the first portion of the input signal is indicative of a noise floor of an external environment of the ANR headphone.
59. The method of claim 48, wherein determining the one or more
characteristics of the first portion of the input signal based on one or more characteristics of the first output signal comprises determining that the first output signal is clipped.
60. The method of claim 47, wherein the one or more characteristics of the first portion of the input signal is indicative of a likelihood that an output signal resulting from processing of the first portion of the input signal by the ANR signal flow path would be clipped.
61 . An active noise reduction (ANR) device comprising:
one or more sensors configured to generate an input signal indicative of an external environment of the ANR device;
a variable gain amplifier (VGA) and a tunable digital filter disposed in an ANR signal flow path of the ANR device, wherein the ANR signal flow path is connected to an electroacoustic transducer of the ANR device; and
one or more processing devices configured to:
determine one or more characteristics of a first portion of the input signal,
automatically adjust, based on the one or more characteristics of the first portion of the input signal, a gain of the VGA,
select a set of coefficients for the tunable digital filter, wherein the set of coefficients are selected in accordance with the gain of the VGA.
62. The ANR device of claim 61 , wherein determining the one or more characteristics of the first portion of the input signal comprises:
processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR device; and determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal.
63. The ANR device of claim 61 , wherein the one or more sensors
comprise one or more of: a feedforward microphone, a feedback microphone, a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the
electroacoustic transducer.
64. The ANR device of claim 61 , wherein the ANR signal flow path
comprises a feedforward path disposed between a feedforward microphone of the ANR device and the electroacoustic transducer.
65. The ANR device of claim 61 , wherein the ANR signal flow path
comprises a feedback path disposed between a feedback microphone of the ANR device and the electroacoustic transducer.
66. The ANR device of claim 61 , further comprising an input-device
configured to receive a first user-input, wherein the one or more processing devices are further configured to deactivate VGA gain adjustments responsive to the first user-input.
67. The ANR device of claim 66, wherein the input device is configured to receive a second user-input, wherein the one or more processing devices are further configured to reactivate VGA gain adjustments responsive to the second user-input.
68. The ANR device of claim 61 , wherein the one or more processing
devices are configured to adjust the gain of the VGA periodically during an operation of the ANR device.
69. The ANR device of claim 61 , wherein the one or more processing
devices are configured to adjust the gain of the VGA responsive to determining that the one or more characteristics of the first portion of the input signal satisfies a threshold condition.
70. The ANR device of claim 61 , wherein the one or more characteristics of the first portion of the input signal is indicative of a noise floor of an external environment of the ANR device. One or more machine-readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform operations comprising:
receiving an input signal captured by one or more sensors associated with an active noise reduction (ANR) device;
determining one or more characteristics of a first portion of the input signal;
automatically adjusting, based on the one or more
characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in an ANR signal flow path of the ANR device;
selecting, a set of coefficients for a tunable digital filter disposed in the ANR signal flow path, wherein the set of coefficients are selected in accordance with the gain of the VGA; and
processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for an electroacoustic transducer of the ANR headphone.
EP18718353.8A 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices Active EP3602538B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP19201902.4A EP3627493B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices
EP19201934.7A EP3618058B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US15/473,889 US10553195B2 (en) 2017-03-30 2017-03-30 Dynamic compensation in active noise reduction devices
US15/473,939 US10614790B2 (en) 2017-03-30 2017-03-30 Automatic gain control in an active noise reduction (ANR) signal flow path
US15/473,926 US10580398B2 (en) 2017-03-30 2017-03-30 Parallel compensation in active noise reduction devices
PCT/US2018/025196 WO2018183714A2 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices

Related Child Applications (4)

Application Number Title Priority Date Filing Date
EP19201902.4A Division EP3627493B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices
EP19201902.4A Division-Into EP3627493B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices
EP19201934.7A Division-Into EP3618058B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices
EP19201934.7A Division EP3618058B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices

Publications (2)

Publication Number Publication Date
EP3602538A2 true EP3602538A2 (en) 2020-02-05
EP3602538B1 EP3602538B1 (en) 2024-06-05

Family

ID=62002483

Family Applications (3)

Application Number Title Priority Date Filing Date
EP19201902.4A Active EP3627493B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices
EP19201934.7A Active EP3618058B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices
EP18718353.8A Active EP3602538B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices

Family Applications Before (2)

Application Number Title Priority Date Filing Date
EP19201902.4A Active EP3627493B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices
EP19201934.7A Active EP3618058B1 (en) 2017-03-30 2018-03-29 Compensation and automatic gain control in active noise reduction devices

Country Status (3)

Country Link
EP (3) EP3627493B1 (en)
CN (2) CN110720121B (en)
WO (1) WO2018183714A2 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11651759B2 (en) * 2019-05-28 2023-05-16 Bose Corporation Gain adjustment in ANR system with multiple feedforward microphones
US10741164B1 (en) * 2019-05-28 2020-08-11 Bose Corporation Multipurpose microphone in acoustic devices
US10748521B1 (en) * 2019-06-19 2020-08-18 Bose Corporation Real-time detection of conditions in acoustic devices
US10937410B1 (en) * 2020-04-24 2021-03-02 Bose Corporation Managing characteristics of active noise reduction
CN111741407B (en) * 2020-06-12 2021-08-10 瑞声科技(新加坡)有限公司 Loudspeaker compensation method, device, storage medium and equipment
US11564035B1 (en) * 2021-09-08 2023-01-24 Cirrus Logic, Inc. Active noise cancellation system using infinite impulse response filtering
CN113794965B (en) * 2021-10-28 2022-11-01 歌尔科技有限公司 Earphone frequency response calibration method and device, earphone equipment and storage medium
CN115278438B (en) * 2022-07-27 2024-08-27 北京爱德发科技有限公司 Noise reduction earphone, noise reduction method and device, storage medium and processor
CN116908886B (en) * 2023-09-13 2023-12-26 北京凯芯微科技有限公司 System and method for automatically detecting gain range of GNSS module
CN116994545B (en) * 2023-09-25 2023-12-08 苏州至盛半导体科技有限公司 Dynamic original sound adjusting method and device for K song system

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006157130A (en) * 2004-11-25 2006-06-15 Globo Technology:Kk Regular dodecahedron loudspeaker apparatus
TW200627999A (en) * 2005-01-05 2006-08-01 Srs Labs Inc Phase compensation techniques to adjust for speaker deficiencies
TWI310177B (en) * 2006-12-29 2009-05-21 Ind Tech Res Inst Noise canceling device and method thereof
JP5082517B2 (en) * 2007-03-12 2012-11-28 ヤマハ株式会社 Speaker array device and signal processing method
US8699719B2 (en) * 2009-03-30 2014-04-15 Bose Corporation Personal acoustic device position determination
US8189799B2 (en) * 2009-04-09 2012-05-29 Harman International Industries, Incorporated System for active noise control based on audio system output
US8532310B2 (en) * 2010-03-30 2013-09-10 Bose Corporation Frequency-dependent ANR reference sound compression
US8073151B2 (en) 2009-04-28 2011-12-06 Bose Corporation Dynamically configurable ANR filter block topology
US8073150B2 (en) 2009-04-28 2011-12-06 Bose Corporation Dynamically configurable ANR signal processing topology
US8737636B2 (en) * 2009-07-10 2014-05-27 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for adaptive active noise cancellation
US8494185B2 (en) * 2010-07-18 2013-07-23 Bose Corporation Electro-acoustic transducer tuning and data storage
US9082388B2 (en) 2012-05-25 2015-07-14 Bose Corporation In-ear active noise reduction earphone
CN102932710B (en) * 2012-10-10 2015-06-03 广州创维平面显示科技有限公司 Method and device for bass compensation
US9445184B2 (en) * 2013-12-03 2016-09-13 Bose Corporation Active noise reduction headphone
CN105025418B (en) * 2014-04-17 2018-10-09 山东共达电声股份有限公司 A kind of active noise reduction controller
WO2016054186A1 (en) * 2014-09-30 2016-04-07 Avnera Corporation Acoustic processor having low latency
JP6611512B2 (en) * 2015-08-07 2019-11-27 株式会社オーディオテクニカ Noise canceling headphones

Also Published As

Publication number Publication date
CN110720121B (en) 2024-04-30
EP3627493A1 (en) 2020-03-25
EP3602538B1 (en) 2024-06-05
EP3618058B1 (en) 2022-08-17
WO2018183714A2 (en) 2018-10-04
EP3618058A1 (en) 2020-03-04
CN116741138A (en) 2023-09-12
EP3627493B1 (en) 2024-05-15
WO2018183714A3 (en) 2018-11-22
CN110720121A (en) 2020-01-21

Similar Documents

Publication Publication Date Title
US11636841B2 (en) Automatic gain control in an active noise reduction (ANR) signal flow path
US10553195B2 (en) Dynamic compensation in active noise reduction devices
US10580398B2 (en) Parallel compensation in active noise reduction devices
EP3627493B1 (en) Compensation and automatic gain control in active noise reduction devices
EP3704688B1 (en) Compressive hear-through in personal acoustic devices
EP3720144B1 (en) Headset with active noise cancellation
AU2020203567B2 (en) Ambient sound enhancement and acoustic noise cancellation based on context
EP3008724B1 (en) Controlling stability in anr devices
US11785382B2 (en) Gain-adaptive active noise reduction (ANR) device
CN113630684B (en) Earphone with active noise reduction function and noise reduction method thereof
US20240021185A1 (en) Gain Adjustment in ANR System with Multiple Feedforward Microphones
WO2020223554A1 (en) Wind noise suppression for active noise cancelling systems and methods
CN113645532A (en) Adaptive processing method of earphone with ANC and earphone with ANC
US11961502B1 (en) Wearable audio device with feedback instability control
US20240303031A1 (en) Ambient sound level control
EP4428852A1 (en) Ambient sound level control
CN118632162A (en) Ambient sound level control
WO2024054487A1 (en) Active noise reduction with impulse detection and suppression
CN118476243A (en) Audio device with perceptual mode auto leveler

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20191001

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: BOSE CORPORATION

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20220317

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 3/00 20060101ALI20240102BHEP

Ipc: H04R 1/10 20060101ALI20240102BHEP

Ipc: G10K 11/178 20060101AFI20240102BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20240208

RIN1 Information on inventor provided before grant (corrected)

Inventor name: WARKENTIN, DAVID

Inventor name: CARRERAS, RICARDO F.

Inventor name: O'CONNELL, MICHAEL

Inventor name: CATTELL, JOSEPH H.

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018070264

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240605

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20240605

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240605

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240605

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240906

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240605

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240605

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240905

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240605

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240605

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240906

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240605

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240605

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240605

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240905