EP2658289B1 - Method for controlling an alignment characteristic and hearing aid - Google Patents
Method for controlling an alignment characteristic and hearing aid Download PDFInfo
- Publication number
- EP2658289B1 EP2658289B1 EP13164027.8A EP13164027A EP2658289B1 EP 2658289 B1 EP2658289 B1 EP 2658289B1 EP 13164027 A EP13164027 A EP 13164027A EP 2658289 B1 EP2658289 B1 EP 2658289B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- hearing
- microphone device
- value
- directional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 19
- 230000008569 process Effects 0.000 claims description 2
- 230000006870 function Effects 0.000 description 10
- 238000012545 processing Methods 0.000 description 4
- 210000000988 bone and bone Anatomy 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 210000000613 ear canal Anatomy 0.000 description 2
- 210000005069 ears Anatomy 0.000 description 2
- 230000002349 favourable effect Effects 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 208000032041 Hearing impaired Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000037213 diet Effects 0.000 description 1
- 235000005911 diet Nutrition 0.000 description 1
- 210000000883 ear external Anatomy 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000007794 irritation Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 210000003454 tympanic membrane Anatomy 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/40—Arrangements for obtaining a desired directivity characteristic
- H04R25/407—Circuits for combining signals of a plurality of transducers
Definitions
- the present invention relates to a method for controlling a directional characteristic of a microphone device of an optional (binaural) hearing system having a first hearing device and a second hearing device. Moreover, the present invention relates to a corresponding (binaural) hearing system.
- a hearing device here means any device which can be worn in or on the ear and causes a sound stimulus, in particular a hearing device, a headset, headphones and the like.
- Hearing aids are portable hearing aids that are used to care for the hearing impaired.
- different types of hearing aids such as behind-the-ear hearing aids (BTE), hearing aid with external receiver (RIC: receiver in the canal) and in-the-ear hearing aids (ITE), e.g. Concha hearing aids or canal hearing aids (ITE, CIC).
- BTE behind-the-ear hearing aids
- RIC hearing aid with external receiver
- ITE in-the-ear hearing aids
- ITE in-the-ear hearing aids
- ITE in-the-ear hearing aids
- ITE concha hearing aids or canal hearing aids
- the hearing aids listed by way of example are worn on the outer ear or in the ear canal.
- bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
- Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer.
- the input transducer is usually a sound receiver, z. As a microphone, and / or an electromagnetic receiver, for. B. an induction coil.
- the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized.
- the amplifier is usually integrated in a signal processing unit. This basic structure is in FIG. 1 shown using the example of a behind-the-ear hearing aid. In a hearing aid housing 1 for Carrying behind the ear, one or more microphones 2 are installed for recording the sound from the environment.
- a signal processing unit 3 which is also integrated in the hearing aid housing 1, processes the microphone signals and amplifies them.
- the output signal of the signal processing unit 3 is transmitted to a loudspeaker or earpiece 4, which outputs an acoustic signal.
- the sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the device carrier.
- the power supply of the hearing device and in particular the signal processing unit 3 is effected by a likewise integrated into the hearing aid housing 1 battery. 5
- US 2010/158290 A1 is a hearing aid and a method for operating a hearing aid is known, which has a microphone system that can be switched to a first and a second directional characteristics.
- a signal-to-noise ratio (SNR) is determined for the first and second directivity characteristics.
- a switching device Switches the directional microphone to the higher SNR mode.
- the document US 2008/0086309 A1 relates to a hearing aid and a method for tracking and selecting a speech source in an ambient sound mixture (summary of D2).
- a preprocessor generates n audio signals from n microphone signals.
- Post-processing determines for the n audio signals a probability of whether they contain speech. The post-processing then selects the signal with the highest probability for an acoustic output.
- document US 2006/0160254 A1 relates to a system and a method of communication in which a spectacle frame has at least one directional microphone for receiving voice signals of the wearer and a communication device.
- One or more directional microphones are provided whose directional characteristics can be controlled.
- the recorded speech signals are interpreted and evaluated by a controller and the directional characteristics and / or the position of the microphones are set to the voice of the wearer.
- signal parameters which influence the directional characteristic are set as a function of the result of a signal analysis of the input signal.
- the signal analysis includes a modulation analysis. Upon recognition of speech by the modulation analysis is switched from an omnidirectional reception to the reception in the direction of the hearing aid wearer.
- the object of the present invention is therefore to be able to more stably control a hearing system with at least one hearing device with regard to the directional characteristic.
- a corresponding (optionally binaural) hearing system is to be provided.
- the signals from two different directions are analyzed with respect to speech features, i. H. one or more properties characteristic of speech, analyzed.
- This analysis leads to feature values whose difference or other combination can be used to control the directional characteristic of the hearing system.
- the difference between values characteristic of speech serves as a reliable decision criterion for the formation of the directional characteristic of a hearing system.
- the first direction is opposite to the second direction.
- signals from opposite directions are analyzed.
- This has the advantage that thereby two half-spaces can be analyzed separately from each other, and the directional characteristic can be designed accordingly.
- the hearing device is intended to be carried in or on the two ears of a user, and the first direction points to the left or the front with respect to the user.
- the second direction then points to the right or rear with respect to the user.
- the feature values can each represent a probability with which speech is present in the respective signal of the microphone device. In addition, they can too simply represent an amplitude or level of a signal qualified as speech.
- the difference between the two feature values can be related to the minimum of the two feature values.
- the reference should be made by dividing the difference by the minimum of the two feature values. This results in a pure numerical value, in which signal-to-noise ratios are taken into account.
- the control value can be obtained according to an embodiment by means of a freely selectable assignment rule from the minimum difference.
- a freely selectable assignment rule from the minimum difference.
- the decision-making can be made even clearer.
- a hysteresis can also be installed.
- the directional characteristic is formed by superimposing a directional signal and an omnidirectional signal of the microphone device, and thereby weighting the directional signal and the omnidirectional signal by means of the control value. This makes it possible that the microphone device is blended from a directional operation in an omnidirectional operation or vice versa.
- the method can be implemented such that the directionality of the directional characteristic increases with increasing control value on the basis of omnidirectionality.
- the system can also be designed such that, depending on the increasing control value, it is superimposed from one direction to another direction.
- a data connection between the at least one and a further hearing device of the hearing system is activated and / or deactivated as a function of the directional characteristic. This makes it possible that, if the automatic control of the directional characteristic specifies an omnidirectional diet of the microphone device, a data exchange between the two hearing devices is prevented, which leads to significant energy savings.
- a hearing aid system with two hearing aids (first hearing device and second hearing device) is provided.
- There is a data connection between the two hearing aids so that the output signals of both hearing aids can be processed together.
- the directional characteristic in the entire room is almost arbitrarily variable, provided that the two hearing aids are intended to be worn in or on the ears of the hearing aid wearer.
- the directional characteristic can be directed more or less sharply to a source.
- the microphone device here the directional microphone
- the directional microphone has a higher sensitivity, while it is more or less damped in other directions.
- two different output signals of the directional microphone are examined with regard to speech components or speech characteristics.
- These output signals of the directional microphone come from different operating modes of the directional microphone. For example, they come from the two concrete modes that the reception lobe is on the one hand to the left and the other to the right.
- the operating modes may also be defined by the directional lobes being directed forward or backward relative to the hearing aid wearer.
- speech features are examined in the signals from the left and the right and in the other case in the signals from the front and the back.
- a value f is calculated which indicates how large the difference in the speech characteristics between the two signals is.
- Speech features are for example the 4 Hz modulation, the so-called voice onset (level increase at the beginning of speech) or a speech-related signal-to-noise ratio.
- the absolute value of the difference is then normalized with the minimum of the feature values of both speech features.
- the difference between the two feature values m1 and m2 will be small.
- the minimum of both values on the other hand, will be relatively high. This leads to a low value f.
- the directional microphone will not be useful. Moreover, it is also advantageous to switch to omnidirectional operation when the signal-to-noise ratio is low and, for example, strong voice signals are registered from both sides. The omnidirectional operation then leads to improved speech perception. In both cases, the value f is small and it should be generated from a control signal for omnidirectional operation.
- the value f can be converted into a control value w.
- the assignment rule may be an analytic function that maps the value f to the control value w.
- the assignment rule can also be a value table or a lookup table with which the control value w is determined from a value f. Such a lookup table is in FIG. 3 indicated.
- the microphone device or its directional characteristic can now be controlled.
- the omnidirectional operation or the directional operation can be switched.
- the following examples always refer to the fact that is switched back and forth between a directional operation and an omnidirectional operation, for example, using the control value and a certain direction of the directional characteristic can be set.
- This algorithm ensures that the directional microphone is used only in unique situations, such as having only one speaker in the current listening situation. This facilitates rapid switching in unique situations over the known concepts of slow crossfading to mask switching fluctuations. In multi-speaker situations, the hearing aid remains in omnidirectional mode and does not constantly switch back and forth. This reduces corresponding irritations in the hearing aid wearer.
- the invention makes it possible that the audio transmission between the two hearing aids is not activated or deactivated when they are in the respective Situation is not necessary or not advantageous. In this way, energy can be saved significantly.
- a binaural audio data transfer can be dispensed with if omnidirectional operation is desired or set in both hearing aids.
- the above embodiments relate to binaural hearing systems.
- the directional characteristic of a microphone device can also be controlled in a monaural hearing system in the manner described.
- the quotient is supplied on the one hand via an amount unit 15 a changeover switch 16 and on the other hand directly to the changeover switch 16.
- the changeover switch 16 is driven accordingly.
- the changeover switch 16 is followed by a smoothing unit 18, with which the value f is smoothed in order to avoid frequent switching between different operating modes of the microphone device.
- an amount is formed in an absolute value unit 19. If necessary, therefore, the upstream unit 14 can be dispensed with. So far, the function for calculating the value f has now been realized.
- the lookup table 20 represents an assignment rule here An example of this is in FIG. 3 played. In the concrete example, it is a function, according to the values f to about 0.45, to be transformed to a very small control value w less than 0.1. For values below a predetermined threshold value, an audio data connection can be dispensed with.
- the microphone device is to be used here essentially in omnidirectional operation. Only from values of f> 0.75 the situation is safely classified as favorable for directional operation, and these values are assigned a high control value close to 1. For values f between 0.45 and 0.75, a transition region which proceeds relatively steeply passes over.
- two signals can now be weighted according to the formula given above.
- a directional signal S_dir and an omnidirectional signal S_omni or another signal from a defined direction can thus be mixed with one another.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Description
Die vorliegende Erfindung betrifft ein Verfahren zum Steuern einer Richtcharakteristik einer Mikrophoneinrichtung eines optional (binauralen) Hörsystems mit einer ersten Hörvorrichtung und einer zweiten Hörvorrichtung. Darüber hinaus betrifft die vorliegende Erfindung ein entsprechendes (binaurales) Hörsystem. Unter einer Hörvorrichtung wird hier jedes im oder am Ohr tragbare, einen Schallreiz verursachende Gerät, insbesondere ein Hörgerät, ein Headset, Kopfhörer und dergleichen verstanden.The present invention relates to a method for controlling a directional characteristic of a microphone device of an optional (binaural) hearing system having a first hearing device and a second hearing device. Moreover, the present invention relates to a corresponding (binaural) hearing system. A hearing device here means any device which can be worn in or on the ear and causes a sound stimulus, in particular a hearing device, a headset, headphones and the like.
Hörgeräte sind tragbare Hörvorrichtungen, die zur Versorgung von Schwerhörenden dienen. Um den zahlreichen individuellen Bedürfnissen entgegenzukommen, werden unterschiedliche Bauformen von Hörgeräten wie Hinter-dem-Ohr-Hörgeräte (HdO), Hörgerät mit externem Hörer (RIC: receiver in the canal) und In-dem-Ohr-Hörgeräte (IdO), z.B. auch Concha-Hörgeräte oder Kanal-Hörgeräte (ITE, CIC), bereitgestellt. Die beispielhaft aufgeführten Hörgeräte werden am Außenohr oder im Gehörgang getragen. Darüber hinaus stehen auf dem Markt aber auch Knochenleitungshörhilfen, implantierbare oder vibrotaktile Hörhilfen zur Verfügung. Dabei erfolgt die Stimulation des geschädigten Gehörs entweder mechanisch oder elektrisch.Hearing aids are portable hearing aids that are used to care for the hearing impaired. In order to meet the numerous individual needs, different types of hearing aids such as behind-the-ear hearing aids (BTE), hearing aid with external receiver (RIC: receiver in the canal) and in-the-ear hearing aids (ITE), e.g. Concha hearing aids or canal hearing aids (ITE, CIC). The hearing aids listed by way of example are worn on the outer ear or in the ear canal. In addition, bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
Hörgeräte besitzen prinzipiell als wesentliche Komponenten einen Eingangswandler, einen Verstärker und einen Ausgangswandler. Der Eingangswandler ist in der Regel ein Schallempfänger, z. B. ein Mikrofon, und/oder ein elektromagnetischer Empfänger, z. B. eine Induktionsspule. Der Ausgangswandler ist meist als elektroakustischer Wandler, z. B. Miniaturlautsprecher, oder als elektromechanischer Wandler, z. B. Knochenleitungshörer, realisiert. Der Verstärker ist üblicherweise in eine Signalverarbeitungseinheit integriert. Dieser prinzipielle Aufbau ist in
Viele Hörgeräte haben heute die Möglichkeit, das Direktionalmikrofon zwischen einem Direktionalmodus, einem Anti-Direktionalmodus und einem Omni-Direktionalmodus automatisch zu steuern. Dementsprechend wird der Schall eher von vorne oder von hinten verstärkt, oder aber er wird von allen Richtungen ohne Direktionalität gleich verarbeitet. Das automatische Steuern basiert in der Regel auf der Ermittlung von Sprachmerkmalen, die aus den Mikrofonsignalen extrahiert werden. In einer kritischen Situation, wenn sich beispielsweise mehrere Leute in einem Raum befinden, kann diese automatische Steuerfunktion zu inakzeptablen Entscheidungen führen. Speziell, wenn zwei Sprecher aus unterschiedlichen Richtungen bezüglich des Hörgeräteträgers sprechen, kann dies zu häufigen Schaltvorgängen führen. Daraus ergibt sich ein ständig fluktuierender Schalleindruck, der den Hörgeräteträger verwirrt.Many hearing aids today have the ability to automatically control the directional microphone between a directional mode, an anti-directional mode, and an omni-directional mode. Accordingly, the sound is amplified from the front or the rear, or it is processed equally from all directions without directionality. Automatic control is usually based on the detection of speech features extracted from the microphone signals. In a critical situation, such as having multiple people in a room, this automatic control function can lead to unacceptable decisions. Specifically, when two speakers speak from different directions with respect to the hearing aid wearer, this can lead to frequent switching operations. This results in a constantly fluctuating sound impression that confuses the hearing aid wearer.
Aus dem Dokument
Das Dokument
Dokument
Dokument
Wenn in einem konkreten Beispiel ein Direktionalmikrofon dazu verwendet wird, den Schall von einer Seite des Hörgeräteträgers zu verstärken, kann das Schalten zwischen den Richtungen "links" und "rechts" zu sehr unangenehmen Schwankungen im Schalleindruck führen. Insbesondere würde das
Hörgerät bei einer sprechenden Person auf der linken Seite und einer sprechenden Person auf der rechten Seite des Hörgeräteträgers ständig zum lauteren Sprecher schaltet. Wenn beide Sprecher einen vergleichbaren Pegel besitzen, würde zwischen ihnen
einen vergleichbaren Pegel besitzen, würde zwischen ihnen hin- und hergeschaltet werden, was hinsichtlich eines Sprechers zu starken Differenzen des jeweiligen Schallpegels führen würde.In a concrete example, when a directional microphone is used to amplify the sound from one side of the hearing aid wearer, switching between the "left" and "right" directions can lead to very unpleasant fluctuations in the sound impression. In particular, that would
Hearing aid constantly switches to a louder speaker for a person speaking on the left and a person speaking on the right side of the hearing aid wearer. If both speakers have a comparable level, there would be between them
have a comparable level would be switched back and forth between them, which would lead to a speaker to strong differences in the respective sound level.
Dieser Problematik ist man bislang dadurch begegnet, dass zwischen beiden Mikrofonrichtungen sehr langsam hin- und hergeblendet wurde. Hierdurch sind rasche Änderungen hinsichtlich der Richtungsentscheidung für den Träger nicht so sehr wahrnehmbar.This problem has been encountered by the fact that was very slowly back and forth between the two microphone directions. As a result, rapid changes in the direction decision for the wearer are not so noticeable.
Die Aufgabe der vorliegenden Erfindung besteht somit darin, ein Hörsystem mit mindestens einer Hörvorrichtung hinsichtlich der Richtcharakteristik stabiler steuern zu können. Darüber hinaus soll ein entsprechendes (optional binaurales) Hörsystem bereitgestellt werden.The object of the present invention is therefore to be able to more stably control a hearing system with at least one hearing device with regard to the directional characteristic. In addition, a corresponding (optionally binaural) hearing system is to be provided.
Erfindungsgemäß wird diese Aufgabe gelöst durch ein Verfahren zum Steuern einer Richtcharakteristik einer Mikrofoneinrichtung eines Hörsystems mit mindestens einer Hörvorrichtung durch
- Ermitteln eines ersten Merkmalwerts bezüglich Sprache in einem einer ersten Richtung zugeordneten ersten Signal der Mikrofoneinrichtung,
- Ermitteln eines zweiten Merkmalwerts bezüglich Sprache in einem einer zweiten Richtung zugeordneten zweiten Signal der Mikrofoneinrichtung,
- Gewinnen eines Steuerwerts aus den beiden Merkmalswerten und
- Steuern der Richtcharakteristik der Mikrofoneinrichtung anhand des Steuerwerts.
- Determining a first feature value with respect to speech in a first signal of the microphone device associated with a first direction,
- Determining a second feature value with respect to speech in a second signal of the microphone device associated with a second direction,
- Obtaining a control value from the two feature values and
- Controlling the directional characteristic of the microphone device based on the control value.
Darüber hinaus wird erfindungsgemäß bereitgestellt ein (binaurales) Hörsystem mit
- mindestens einer Hörvorrichtung, wobei
- die Hörvorrichtung eine Mikrofoneinrichtung mit einer Richtcharakteristik aufweist, wobei
- die Mikrofoneinrichtung ausgebildet ist zum Ermitteln eines ersten Merkmalwerts bezüglich Sprache in einem einer ersten Richtung zugeordneten ersten Signal der Mikrofoneinrichtung und zum Ermitteln eines zweiten Merkmalwerts bezüglich Sprache in einem einer zweiten Richtung zugeordneten zweiten Signal der Mikrofoneinrichtung,
- in der mindestens einen Hörvorrichtung eine Steuereinrichtung ausgebildet ist zum Gewinnen eines Steuerwerts aus den beiden Merkmalswerten und zum Steuern der Richtcharakteristik der Mikrofoneinrichtung anhand des Steuerwerts.
- at least one hearing device, wherein
- the hearing device has a microphone device with a directional characteristic, wherein
- the microphone device is designed to determine a first feature value with respect to speech in a first signal of the microphone device assigned to a first direction and to determine a second feature value with respect to speech in a second signal of the microphone device assigned to a second direction;
- in the at least one hearing device, a control device is designed to obtain a control value from the two feature values and to control the directional characteristic of the microphone device on the basis of the control value.
In vorteilhafter Weise werden also die Signale von zwei verschiedenen Richtungen analysiert im Hinblick auf Sprachmerkmale, d. h. eine oder mehrere für Sprache charakteristische Eigenschaften, analysiert. Diese Analyse führt zu Merkmalswerten, deren Differenz oder andere Verknüpfung zur Steuerung der Richtcharakteristik des Hörsystems verwendet werden kann. Somit dient also der Unterschied zwischen Werten, die für Sprache charakteristisch sind, als zuverlässiges Entscheidungskriterium für die Ausbildung der Richtcharakteristik eines Hörsystems.Advantageously, therefore, the signals from two different directions are analyzed with respect to speech features, i. H. one or more properties characteristic of speech, analyzed. This analysis leads to feature values whose difference or other combination can be used to control the directional characteristic of the hearing system. Thus, therefore, the difference between values characteristic of speech serves as a reliable decision criterion for the formation of the directional characteristic of a hearing system.
Vorzugsweise ist die erste Richtung zur zweiten Richtung entgegengesetzt. Es werden hinsichtlich der sprachcharakteristischen Eigenschaften also Signale aus entgegengesetzten Richtungen analysiert. Dies hat den Vorteil, dass dadurch zwei Halbräume separat voneinander analysiert werden können, und die Richtcharakteristik entsprechend ausgebildet werden kann. Insbesondere ist es günstig, wenn die Hörvorrichtung bestimmungsgemäß in oder an den beiden Ohren eines Nutzers getragen wird, und die erste Richtung bezüglich des Nutzers nach links oder vorne weist. Dementsprechend weist dann die zweite Richtung bezüglich des Nutzers nach rechts oder hinten.Preferably, the first direction is opposite to the second direction. Thus, with regard to the characteristics of speech characteristics, signals from opposite directions are analyzed. This has the advantage that thereby two half-spaces can be analyzed separately from each other, and the directional characteristic can be designed accordingly. In particular, it is favorable if the hearing device is intended to be carried in or on the two ears of a user, and the first direction points to the left or the front with respect to the user. Accordingly, the second direction then points to the right or rear with respect to the user.
Die Merkmalswerte können jeweils eine Wahrscheinlichkeit darstellen, mit der Sprache im jeweiligen Signal der Mikrofoneinrichtung vorhanden ist. Darüber hinaus können sie auch einfach eine Amplitude oder einen Pegel eines als Sprache qualifizierten Signals darstellen.The feature values can each represent a probability with which speech is present in the respective signal of the microphone device. In addition, they can too simply represent an amplitude or level of a signal qualified as speech.
Zum Gewinnen des Steuerwerts kann die Differenz der beiden Merkmalswerte auf das Minimum der beiden Merkmalswerte bezogen werden. Der Bezug sollte insbesondere durch Division der Differenz durch das Minimum der beiden Merkmalswerte hergestellt werden. Dadurch ergibt sich ein reiner Zahlenwert, bei dem auch Signal-Rausch-Verhältnisse berücksichtigt sind.To obtain the control value, the difference between the two feature values can be related to the minimum of the two feature values. In particular, the reference should be made by dividing the difference by the minimum of the two feature values. This results in a pure numerical value, in which signal-to-noise ratios are taken into account.
Der Steuerwert kann gemäß einer Ausführungsform mittels einer frei wählbaren Zuordnungsvorschrift aus der auf das Minimum bezogenen Differenz gewonnen werden. Damit kann die Entscheidungsfindung noch eindeutiger gestaltet werden. Beispielsweise kann auch eine Hysterese eingebaut werden.The control value can be obtained according to an embodiment by means of a freely selectable assignment rule from the minimum difference. Thus, the decision-making can be made even clearer. For example, a hysteresis can also be installed.
Vorteilhaft ist außerdem, wenn die Richtcharakteristik durch Überlagern eines Direktionalsignals und eines Omnidirektionalsignals der Mikrofoneinrichtung gebildet wird, und dabei das Direktionalsignal und das Omnidirektionalsignal mit Hilfe des Steuerwerts gewichtet werden. Dadurch ist es möglich, dass die Mikrofoneinrichtung von einem Direktionalbetrieb in einen Omnidirektionalbetrieb oder umgekehrt übergeblendet wird.It is also advantageous if the directional characteristic is formed by superimposing a directional signal and an omnidirectional signal of the microphone device, and thereby weighting the directional signal and the omnidirectional signal by means of the control value. This makes it possible that the microphone device is blended from a directional operation in an omnidirectional operation or vice versa.
Speziell kann das Verfahren so realisiert sein, dass die Direktionalität der Richtcharakteristik mit steigendem Steuerwert ausgehend von der Omnidirektionalität zunimmt. Das System kann aber auch so ausgebildet sein, dass abhängig vom steigenden Steuerwert von einer Richtung auf eine andere Richtung übergeblendet wird.In particular, the method can be implemented such that the directionality of the directional characteristic increases with increasing control value on the basis of omnidirectionality. However, the system can also be designed such that, depending on the increasing control value, it is superimposed from one direction to another direction.
Besonders vorteilhaft ist, wenn eine Datenverbindung zwischen der mindestens einen und einer weiteren Hörvorrichtung des Hörsystems in Abhängigkeit von der Richtcharakteristik aktiviert und/oder deaktiviert wird. Hierdurch ist es möglich, dass, falls die automatische Steuerung der Richtcharakteristik eine Omnidirektionaliät der Mikrofoneinrichtung vorgibt, ein Datenaustausch zwischen den beiden Hörvorrichtungen unterbunden wird, was zu erheblichen Energieeinsparungen führt.It is particularly advantageous if a data connection between the at least one and a further hearing device of the hearing system is activated and / or deactivated as a function of the directional characteristic. This makes it possible that, if the automatic control of the directional characteristic specifies an omnidirectional diet of the microphone device, a data exchange between the two hearing devices is prevented, which leads to significant energy savings.
Die vorliegende Erfindung wird anhand der beigefügten Zeichnungen näher erläutert, in denen zeigen:
- FIG 1
- den prinzipiellen Aufbau eines Hörgeräts gemäß dem Stand der Technik;
- FIG 2
- ein Blockschaltdiagramm eines erfindungsgemäßen Ausführungsbeispiels und
- FIG 3
- eine beispielhafte Lookup-Tabelle für die Gewinnung eines Steuersignals.
- FIG. 1
- the basic structure of a hearing aid according to the prior art;
- FIG. 2
- a block diagram of an embodiment of the invention and
- FIG. 3
- an exemplary lookup table for obtaining a control signal.
Die nachfolgend näher geschilderten Ausführungsbeispiele stellen bevorzugte Ausführungsformen der vorliegenden Erfindung dar.The embodiments described in more detail below represent preferred embodiments of the present invention.
Gemäß einer Ausführungsform ist ein Hörgerätesystem mit zwei Hörgeräten (erste Hörvorrichtung und zweite Hörvorrichtung) vorgesehen. Zwischen beiden Hörgeräten besteht eine Datenverbindung, sodass die Ausgangssignale beider Hörgeräte gemeinsam verarbeitbar sind. Insbesondere lässt sich durch die datentechnisch miteinander verbundenen Hörgeräte eine Mikrofoneinrichtung realisieren, deren Richtcharakteristik im gesamten Raum nahezu beliebig variierbar ist, sofern die beiden Hörgeräte bestimmungsgemäß in oder an den Ohren des Hörgeräteträgers getragen werden. Die Richtcharakteristik kann mehr oder weniger scharf auf eine Quelle gerichtet werden. Man spricht von einem direktionalen "Beamformer" (Strahlformer), dessen Intensität bzw. Strahlbreite variierbar ist. Im omnidirektionalen Betrieb wird von allen Richtungen gleichmäßig Schall aufgenommen, während im Direktionalbetrieb der Empfangsstrahl in eine bestimmte Richtung ausgerichtet ist. In dieser Vorzugsrichtung hat die Mikrofoneinrichtung (hier das Richtmikrofon) eine höhere Empfindlichkeit, während sie in anderen Richtungen mehr oder weniger stark gedämpft ist.According to one embodiment, a hearing aid system with two hearing aids (first hearing device and second hearing device) is provided. There is a data connection between the two hearing aids so that the output signals of both hearing aids can be processed together. In particular, can be realized by the data technically interconnected hearing aids a microphone device, the directional characteristic in the entire room is almost arbitrarily variable, provided that the two hearing aids are intended to be worn in or on the ears of the hearing aid wearer. The directional characteristic can be directed more or less sharply to a source. One speaks of a directional "beamformer" (beam former) whose intensity or beam width can be varied. In omnidirectional operation, sound is received uniformly from all directions, while in directional mode the reception beam is directed in a certain direction. In this preferred direction, the microphone device (here the directional microphone) has a higher sensitivity, while it is more or less damped in other directions.
Um nun die Richtung und/oder die Breite der Empfangskeule einzustellen, werden zwei verschiedene Ausgangssignale des Richtmikrofons hinsichtlich Sprachanteilen bzw. Sprachmerkmalen untersucht. Diese Ausgangssignale des Richtmikrofons stammen von verschiedenen Betriebsmodi des Richtmikrofons. So stammen sie beispielsweise von den beiden konkreten Modi, dass die Empfangskeule zum einen nach links und zum anderen nach rechts ausgerichtet ist. Alternativ können die Betriebsmodi auch dadurch definiert sein, dass die Richtkeulen nach vorne oder hinten bezogen auf den Hörgeräteträger gerichtet sind. Es werden also in einem Fall Sprachmerkmale in den Signalen von links und rechts und im anderen Fall in den Signalen von vorne und hinten untersucht.In order to adjust the direction and / or the width of the reception lobe, two different output signals of the directional microphone are examined with regard to speech components or speech characteristics. These output signals of the directional microphone come from different operating modes of the directional microphone. For example, they come from the two concrete modes that the reception lobe is on the one hand to the left and the other to the right. Alternatively, the operating modes may also be defined by the directional lobes being directed forward or backward relative to the hearing aid wearer. Thus, in one case speech features are examined in the signals from the left and the right and in the other case in the signals from the front and the back.
Anschließend wird ein Wert f berechnet, der angibt, wie groß die Differenz der Sprachmerkmale zwischen beiden Signalen ist. Sprachmerkmale sind beispielsweise die 4 Hz-Modulation, das so genannte Sprach-Onset (Pegelanstieg bei Sprachbeginn) oder ein auf Sprache bezogenes Signal-Rausch-Verhältnis. Der Absolutwert der Differenz wird dann mit dem Minimum der Merkmalswerte beider Sprachmerkmale normiert. Für den Wert f ergibt sich damit folgende Formel:
Der Wert f ist groß für große Differenzen zwischen beiden Merkmalswerten m1 und m2. Ist beispielsweise m1 = 0,1 und m2 = 0,8, so ergibt sich f = 0,7/0,1 = 7. Dies ist der Fall, wenn beispielsweise Rauschen von einer anderen Seite kommt als das gewünschte Signal und wenn der Signal-Rausch-Abstand gering ist.The value f is large for large differences between both feature values m1 and m2. For example, if m1 = 0.1 and m2 = 0.8, then f = 0.7 / 0.1 = 7. This is the case, for example, if noise comes from a side other than the desired signal and if the signal Noise ratio is low.
Ist das Signal-Rausch-Verhältnis hingegen gut, so wird die Differenz zwischen beiden Merkmalswerten m1 und m2 klein sein. Das Minimum beider Werte wird hingegen verhältnismäßig hoch sein. Dies führt zu einem geringen Wert f. Beispielsweise betragen die Merkmalswerte m1 = 0,8 und m2 = 0,7. Daraus ergibt sich ein f = 0,1/0,7 = 0,14.On the other hand, if the signal-to-noise ratio is good, the difference between the two feature values m1 and m2 will be small. The minimum of both values, on the other hand, will be relatively high. This leads to a low value f. For example, the characteristic values are m1 = 0.8 and m2 = 0.7. This results in f = 0.1 / 0.7 = 0.14.
Ist hingegen das Signal-Rausch-Verhältnis schlecht, so wird das Minimum beider Merkmalswerte den Wert f erhöhen. Dies ist beispielsweise der Fall, wenn m1 = 0,1 und m2 = 0,2 ist. Es ergibt sich dann der Wert f = 0,1/0,1 = 1.If, on the other hand, the signal-to-noise ratio is poor, the minimum of both feature values will increase the value f. This is the case, for example, when m1 = 0.1 and m2 = 0.2. The result then is the value f = 0.1 / 0.1 = 1.
Wenn das Signal-Rausch-Verhältnis zu schlecht ist, wird das direktionale Mikrofon keinen Nutzen bieten. Darüber hinaus ist es auch vorteilhaft, in den Omnidirektional-Betrieb zu schalten, wenn das Signal-Rausch-Verhältnis gering und beispielsweise von beiden Seiten starke Sprachsignale registriert werden. Der Omnidirektional-Betrieb führt dann zu einer verbesserten Sprachwahrnehmung. In beiden Fällen ist der Wert f klein und es sollte daraus ein Steuersignal für den Omnidirektional-Betrieb generiert werden.If the signal-to-noise ratio is too poor, the directional microphone will not be useful. Moreover, it is also advantageous to switch to omnidirectional operation when the signal-to-noise ratio is low and, for example, strong voice signals are registered from both sides. The omnidirectional operation then leads to improved speech perception. In both cases, the value f is small and it should be generated from a control signal for omnidirectional operation.
Wenn andererseits, wie oben geschildert, lediglich auf einer Seite ein Sprecher vorhanden ist, ist der Wert f hoch und es sollte der Direktional-Betrieb genutzt werden.On the other hand, if, as described above, there is only one speaker on one side, the value f is high and the directional operation should be used.
Mit einer Zuordnungsvorschrift kann der Wert f in einen Steuerwert w gewandelt werden. Die Zuordnungsvorschrift kann eine analytische Funktion sein, die den Wert f auf den Steuerwert w abbildet. Darüber hinaus kann die Zuordnungsvorschrift auch eine Wertetabelle bzw. eine Lookup-Tabelle sein, mit der der Steuerwert w aus einem Wert f ermittelt wird. Eine derartige Lookup-Tabelle ist in
Mit dem Steuersignal w lässt sich nun die Mikrofoneinrichtung bzw. ihre Richtcharakteristik steuern. Dabei kann beispielsweise in den Omnidirektional-Betrieb oder den Direktional-Betrieb geschaltet werden. Obwohl sich die vorhergehenden und auch die nachfolgenden Beispiele immer darauf beziehen, dass zwischen einem Direktional-Betrieb und einem Omnidirektional-Betrieb hin und her geschaltet wird, kann beispielsweise mithilfe des Steuerwerts auch eine bestimmte Richtung der Richtcharakteristik eingestellt werden. So kann es Vorteile bieten, bei niedrigen Werten f bzw. w den Strahlformer frontal nach vorne auszurichten, sodass bei schlechten Verhältnissen immer die Vorne-Richtung verstärkt wird.With the control signal w, the microphone device or its directional characteristic can now be controlled. In this case, for example, in the omnidirectional operation or the directional operation can be switched. Although the previous and Also, the following examples always refer to the fact that is switched back and forth between a directional operation and an omnidirectional operation, for example, using the control value and a certain direction of the directional characteristic can be set. Thus, at low values f and w, it may be advantageous to align the beam former frontally forward, so that in poor conditions, the front direction is always strengthened.
Die Steuerung der Richtcharakteristik kann auch dahingehend optimiert werden, dass nicht zwischen zwei Zuständen hin- und hergeschaltet wird, sondern dass ein allmählicher Übergang zwischen beiden Zuständen gemäß einer vorgegebenen Funktion erfolgt. Werden beispielsweise durch die Mikrofoneinrichtung ein direktionales Signal und ein omnidirektionales Signal erzeugt, so können beide Signale für ein Ausgangssignal S_out das omnidirektionale Signal S_omni und das direktionale Signal S_dir miteinander gemischt werden. Das Mischen erfolgt beispielsweise in Abhängigkeit des Steuerwerts w gemäß folgender Formel:
Dieser Algorithmus stellt sicher, dass das direktionale Mikrofon nur in eindeutigen Situationen verwendet wird, wenn beispielsweise nur ein Sprecher in der aktuellen Hörsituation vorhanden ist. Dies erleichtert das rasche Schalten in eindeutigen Situationen gegenüber den bekannten Konzepten des langsamen Überblendens, um Schaltschwankungen zu maskieren. In Situationen mit mehreren Sprechern bleibt das Hörgerät in einem Omnidirektional-Modus und schaltet nicht ständig hin und her. Dies reduziert entsprechende Irritationen beim Hörgeräteträger.This algorithm ensures that the directional microphone is used only in unique situations, such as having only one speaker in the current listening situation. This facilitates rapid switching in unique situations over the known concepts of slow crossfading to mask switching fluctuations. In multi-speaker situations, the hearing aid remains in omnidirectional mode and does not constantly switch back and forth. This reduces corresponding irritations in the hearing aid wearer.
Bei Verwendung eines Beamformer mit binauraler Datenverbindung zwischen beiden Hörgeräten ermöglicht es die Erfindung, dass die Audioübertragung zwischen den beiden Hörgeräten nicht aktiviert bzw. deaktiviert wird, wenn sie in der jeweiligen Situation nicht notwendig bzw. nicht vorteilhaft ist. Auf diese Weise kann deutlich Energie eingespart werden. So kann beispielsweise auf einen binauralen Audiodatentransfer verzichtet werden, wenn in beiden Hörgeräten Omnidirektional-Betrieb gewünscht bzw. eingestellt wird.When using a beamformer with binaural data connection between the two hearing aids, the invention makes it possible that the audio transmission between the two hearing aids is not activated or deactivated when they are in the respective Situation is not necessary or not advantageous. In this way, energy can be saved significantly. For example, a binaural audio data transfer can be dispensed with if omnidirectional operation is desired or set in both hearing aids.
Die obigen Ausführungsbeispiele beziehen sich auf binaurale Hörsysteme. Prinzipiell kann die Steuerung der Richtcharakteristik einer Mikrofoneinrichtung aber auch in einem monauralen Hörsystem in der geschilderten Weise erfolgen.The above embodiments relate to binaural hearing systems. In principle, the directional characteristic of a microphone device can also be controlled in a monaural hearing system in the manner described.
Anhand der
Mithilfe einer Lookup-Tabelle 20 wird schließlich der Steuerwert w erzeugt. Die Lookup-Tabelle 20 stellt hierbei eine Zuordnungsvorschrift dar. Ein Beispiel hiervon ist in
Mit den resultierenden Steuerwerten w können nun zwei Signale entsprechend der oben angegebenen Formel gewichtet werden. Insbesondere können damit ein direktionales Signal S_dir und ein omnidirektionales Signal S_omni oder ein anderes Signal aus einer festgelegten Richtung miteinander gemischt werden.With the resulting control values w, two signals can now be weighted according to the formula given above. In particular, a directional signal S_dir and an omnidirectional signal S_omni or another signal from a defined direction can thus be mixed with one another.
Claims (9)
- Method for controlling a directional characteristic of a microphone device in a hearing system having at least one hearing apparatus, which method has the steps of:- ascertaining a first feature value (m1) for speech in a first signal, associated with a first direction, from the microphone device,- ascertaining a second feature value (m2) for speech in a second signal, associated with a second direction, from the microphone device,- obtaining a control value (w) from the two feature values, and- controlling the directional characteristic of the microphone device on the basis of the control value,characterized in that
the control value (w) is obtained by relating the difference (10) between the two feature values to the minimum (11) of the two feature values. - Method according to Claim 1, wherein the first direction is opposite the second direction.
- Method according to Claim 2, wherein the at least one hearing apparatus is worn, as intended, in or on one ear of a user, and the first direction points to the left of or in front of the user.
- Method according to one of the preceding claims, wherein the feature values (m1, m2) each represent a probability of speech being present in the respective signal from the microphone device.
- Method according to one of the preceding claims, wherein the control value is obtained from the difference based on the minimum by means of a freely selectable association specification (20).
- Method according to one of the preceding claims, wherein the directional characteristic is formed by overlaying a directional signal and an omnidirectional signal from the microphone device, and, in the process, the directional signal and the omidirectional signal are weighted using the control value (w).
- Method according to one of the preceding claims, wherein a value for the directionality of the directional characteristic increases starting from omnidirectionality as the control value (w) rises.
- Method according to one of the preceding claims, wherein a data link between the at least one and a further hearing apparatus of the hearing system is activated and/or deactivated in dependence on the control value (w).
- Hearing system having- at least one hearing apparatus, wherein- the hearing apparatus has a microphone device having a directional characteristic,- the microphone device is designed to ascertain a first feature value (m1) for speech in a first signal, associated with a first direction, from the microphone device and to ascertain a second feature value (m2) for speech in a second signal, associated with a second direction, from the microphone device, and- in the at least one hearing apparatus, a control device is designed to obtain a control value (w) from the two feature values, (m1, m2) and to control the directional characteristic of the microphone device on the basis of the control value,characterized in that
the control device obtains the control value (w) by relating the difference (10) between the two feature values to the minimum (11) of the two feature values.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102012206759.0A DE102012206759B4 (en) | 2012-04-25 | 2012-04-25 | Method for controlling a directional characteristic and hearing system |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2658289A1 EP2658289A1 (en) | 2013-10-30 |
EP2658289B1 true EP2658289B1 (en) | 2016-07-06 |
Family
ID=48128164
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13164027.8A Active EP2658289B1 (en) | 2012-04-25 | 2013-04-17 | Method for controlling an alignment characteristic and hearing aid |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP2658289B1 (en) |
AU (1) | AU2013203174B2 (en) |
DE (1) | DE102012206759B4 (en) |
DK (1) | DK2658289T3 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102016225207A1 (en) * | 2016-12-15 | 2018-06-21 | Sivantos Pte. Ltd. | Method for operating a hearing aid |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102017221006A1 (en) | 2017-11-23 | 2019-05-23 | Sivantos Pte. Ltd. | Method for operating a hearing aid |
DE102020207579A1 (en) * | 2020-06-18 | 2021-12-23 | Sivantos Pte. Ltd. | Method for direction-dependent noise suppression for a hearing system which comprises a hearing device |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE10114101A1 (en) * | 2001-03-22 | 2002-06-06 | Siemens Audiologische Technik | Processing input signal in signal processing unit for hearing aid, involves analyzing input signal and adapting signal processing unit setting parameters depending on signal analysis results |
ATE513408T1 (en) * | 2004-03-31 | 2011-07-15 | Swisscom Ag | GLASSES FRAME WITH INTEGRATED ACOUSTIC COMMUNICATION SYSTEM FOR COMMUNICATION WITH A MOBILE TELEPHONE DEVICE AND CORRESPONDING METHOD |
EP1912472A1 (en) * | 2006-10-10 | 2008-04-16 | Siemens Audiologische Technik GmbH | Method for operating a hearing aid and hearing aid |
EP2107826A1 (en) * | 2008-03-31 | 2009-10-07 | Bernafon AG | A directional hearing aid system |
DE102008064484B4 (en) * | 2008-12-22 | 2012-01-19 | Siemens Medical Instruments Pte. Ltd. | Method for selecting a preferred direction of a directional microphone and corresponding hearing device |
-
2012
- 2012-04-25 DE DE102012206759.0A patent/DE102012206759B4/en not_active Expired - Fee Related
-
2013
- 2013-04-09 AU AU2013203174A patent/AU2013203174B2/en not_active Ceased
- 2013-04-17 DK DK13164027.8T patent/DK2658289T3/en active
- 2013-04-17 EP EP13164027.8A patent/EP2658289B1/en active Active
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102016225207A1 (en) * | 2016-12-15 | 2018-06-21 | Sivantos Pte. Ltd. | Method for operating a hearing aid |
Also Published As
Publication number | Publication date |
---|---|
DE102012206759A1 (en) | 2013-10-31 |
DE102012206759B4 (en) | 2018-01-04 |
DK2658289T3 (en) | 2016-10-24 |
AU2013203174B2 (en) | 2015-01-22 |
EP2658289A1 (en) | 2013-10-30 |
AU2013203174A1 (en) | 2013-11-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3222057B1 (en) | Method and apparatus for fast recognition of a user's own voice | |
EP2603018B1 (en) | Hearing aid with speaking activity recognition and method for operating a hearing aid | |
EP1771038B1 (en) | Method for operating a hearing-aid system for binaural treatment of a user | |
EP2506603B1 (en) | Hearing aid system with a directional microphone system and method for operating such a hearing aid system with said directional microphone system | |
EP2164283B1 (en) | Hearing aid and operation of a hearing aid with frequency transposition | |
EP2991379B1 (en) | Method and device for improved perception of own voice | |
EP3104627B1 (en) | Method for improving a recording signal in a hearing system | |
EP1962556A2 (en) | Method for improving spatial awareness and corresponding hearing device | |
EP2070384B1 (en) | Hearing device controlled by a perceptive model and corresponding method | |
DE102013207149A1 (en) | Controlling the effect size of a binaural directional microphone | |
EP2226795A1 (en) | Hearing aid and method for reducing interference in a hearing aid | |
EP2182741B1 (en) | Hearing aid with special situation recognition unit and method for operating a hearing aid | |
EP2811762B1 (en) | Logic-based binaural beam forming system | |
DE102007035171A1 (en) | Method for adapting a hearing aid by means of a perceptive model | |
EP2658289B1 (en) | Method for controlling an alignment characteristic and hearing aid | |
EP2161949A2 (en) | Method for operating a hearing aid with directional effect and accompanying hearing aid | |
EP2200345A1 (en) | Method for selecting a preferred direction of a directional microphone and corresponding hearing device | |
EP2584795B1 (en) | Method for determining a compression characteristic curve | |
DE102009004185B3 (en) | Method for converting input signal into output signal in e.g. headphone, involves forming output signal formed from intermediate signals with mixing ratio that depends on result of classification | |
EP4149121A1 (en) | Method for operating a hearing aid | |
EP2373063A1 (en) | Hearing device and method for setting the same for acoustic feedback-free operation | |
DE102007035173A1 (en) | Method for adjusting a hearing system with a perceptive model for binaural hearing and hearing aid | |
EP3048813A1 (en) | Method and device for suppressing noise based on inter-subband correlation | |
EP2885926A1 (en) | Hearing system and transmission method | |
DE102010021609A1 (en) | Method for wireless transmission of data in e.g. in-the-ear hearing aid, involves determining phase value when quality of receiving signal reaches maximum or exceeds threshold value, and adjusting phase depending on determined phase value |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
17P | Request for examination filed |
Effective date: 20140428 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SIVANTOS PTE. LTD. |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20160310 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 811441 Country of ref document: AT Kind code of ref document: T Effective date: 20160715 Ref country code: CH Ref legal event code: EP Ref country code: CH Ref legal event code: NV Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502013003581 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20161017 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160706 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161106 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161006 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161007 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161107 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502013003581 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 5 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161006 |
|
26N | No opposition filed |
Effective date: 20170407 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170417 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20170430 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170417 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 811441 Country of ref document: AT Kind code of ref document: T Effective date: 20180417 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20130417 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180417 Ref country code: CY Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160706 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160706 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240423 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240418 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DK Payment date: 20240422 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20240501 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240422 Year of fee payment: 12 |