JP2021026098A - Communication support device - Google Patents

Abstract

To provide a communication support device which supports communication for persons with auditory information processing disorders.SOLUTION: A communication support device comprises a plurality of front microphones provided on front members of glasses at lateral intervals, side microphones provided on right and left side members of the glasses, speakers provided on the right and left side members of the glasses, sound source direction determining means for determining a sound source direction based on a sound signal input from each microphone, sound amplifier means which amplifies the sound signal input from a microphone facing the sound source direction determined by the sound source direction determining means and gives the same to the speaker, and noise eliminating means for reducing or extinguishing a sound signal input from a microphone other than the microphone facing the sound source direction determined by the sound source direction determining means.SELECTED DRAWING: Figure 3

Description

The present invention relates to a communication support device, and more particularly to a communication support device for an auditory processing disorder person and an elderly deaf person.

There are quite a few people who have symptoms of communication disorders, such as auditory information processing disorders.
Auditory Processing Disorder (hereinafter referred to as APD) is a disorder in which it is difficult to hear in daily life even though no abnormality is found in a normal auditory test. Hereinafter, a person having a symptom of an auditory processing disorder is referred to as an auditory processing disorder person or an APD holder.

The following are known auditory symptoms of APD.
(a) The speaker's first words cannot be heard, and there are many hearing backs and mistakes.
(b) It is difficult to hear in a bad listening environment such as noise.
(c) It is difficult to forget or understand what is said orally.
(d) When it comes to long stories, it is difficult to keep listening carefully.
(e) It is more difficult to hear and understand auditory information than visual information.
Such symptoms are associated with impaired auditory function such as auditory discrimination, noisy listening, auditory nomenclature, listening to degraded speech, auditory attention, and visual dominance.

Presbycusis is one of the hearing impairments. Presbycusis is a hearing disorder caused by aging, and is often sensory deafness. Presbycusis is particularly difficult to hear in the high register (2000 to 8000 Hz). Therefore, it is often difficult to clearly hear high-pitched words. FIG. 15 is a graph showing the general tendency of hearing with age. Looking at this graph, in the 60s, 70s, and 80s, the deterioration of hearing is clear in the range of 1000 to 4000 Hz.

The relationship between hearing and cognitive function is thought to be as follows. That is, when (G1) becomes hard to hear, (G2) it becomes embarrassing to listen back, and it becomes awkward. Next, (G3) communication becomes difficult, danger detection becomes difficult, and the amount of information decreases. In the next stage, psychological effects such as (G4) isolation, anxiety, anxiety, and diminished motivation will occur. Furthermore, in the next stage, the connection with (G5) society will decrease, which will eventually affect cognitive function.

In view of the above situation, the following are desired as ingenuity or countermeasures that can be taken by people around the auditory processing disorder.
1. Speak in a quiet environment. That is, talk one-on-one in a quiet room.
2. Turn off TV, music, etc. to reduce ambient noise.
3. Talk over and over again what you cannot hear.
4. Do not explain in words, but give notes to the main points.
5. Do not choose work to listen to or work in noisy conditions as much as possible.
6. Be especially careful when making mistakes in proper nouns and numbers such as names and company names.

Many elderly people with presbycusis suffer from presbycusis due to the phenomenon of aging. The majority of presbycusis is deafness caused by disorders of the inner ear or the nervous system beyond the inner ear, and is called sensory deafness. Presbycusis is a nerve in which the hair cells of the inner ear, which play a role in converting sound signals into signals transmitted to the brain, are deformed, weakened, or disappeared with aging, and the converted signals are transmitted to the brain. Damage results from the difficulty of propagating sound signals to the brain.

Sensitive deafness is characterized by a decrease in the ability to distinguish speech as words, rather than simply being unable to hear the speech in volume.

Decreased ability of sensorineural deafness includes decreased frequency selectivity and decreased time resolution.

Due to the decrease in frequency selectivity, the effect of masking between frequency band components, especially the masking of high frequency components by low frequency components, increases in the sound-sensitive hearing-impaired person, and the sound in the high range is higher than the sound in the low range. Is hard to hear.
Due to the reduced temporal resolution, it becomes difficult for a person with deafness to keep up with rapid changes in sound. Therefore, when a plurality of sounds are continuously applied, one sound is easily affected by the temporal masking in which the other sound is masked. That is, it is difficult to perceive sounds that change rapidly over time and to distinguish sounds that are close in time.

There are two types of temporal masking: forward masking and reverse masking. In forward masking, the preceding sound masks the following sound, and when the preceding sound reacts to a certain sound, even if the sound disappears, the reaction does not stop immediately, and the succeeding sound generated during that period becomes difficult to hear. In retrograde masking, the following sound masks the preceding sound, and the stronger the sound, the faster the nerve reaction occurs. Therefore, if a strong sound comes after a weak sound, the two sounds cannot be distinguished and a weak preceding sound can be heard. It becomes difficult.

In addition, since it is difficult for a person with deafness to follow the rapid changes in the sound due to the decrease in time resolution, the consonant may be missed as a result even if there is no temporal masking by the sound before and after the consonant. There are many. It is considered that this is because the consonant disappears before the hair cells of the sensitive hearing-impaired person react to the consonant that changes rapidly with time and has a short duration.

Furthermore, in normal times, vowels are characterized by high energy, little time change, and long duration, whereas consonants are characterized by low energy, rapid time change, and short duration. is there. This is also the reason why people with deafness are more likely to have temporal masking with vowels before and after consonants, making it difficult to hear consonants.

It has been proposed that known hearing aids can be heard by the deaf person by using a hearing aid whose sound collection frequency is adjusted according to the characteristics of the deaf person.
However, simply adjusting the sound collection frequency of the hearing aid according to the characteristics of each deaf person does not improve the problem of temporal masking. In addition, the adjustment of the sound collection frequency alone does not sufficiently improve the treble words to the extent that they can be clearly heard regardless of the age group of the elderly.

Even if the above measures and measures are taken, there is a limit to the reduction of auditory symptoms of APD in persons with auditory information processing disorders.

This is because conventional hearing aids and sound collectors collect sounds around 360 degrees to make them easier to hear, so not only the speaker's voice but also all the surrounding sounds are raised. This is because only the voice of the person is not easy to hear, and it is not effective for assisting the conversation of the APD holder. Hearing aids with a noise killer function have also come to be used, but among the auditory symptoms (a) to (e) of the above APD, (a) the speaker's first words cannot be heard, and there are backtracking and misunderstandings. Many, (c) forgetting or difficult to understand what was said verbally, (d) difficult to keep listening carefully when it comes to long stories, (e) auditory information compared to visual information The difficulty of listening and understanding is that conventional APD holder support devices such as hearing aids and sound collectors cannot be expected to provide sufficient communication support.

The first object of the present invention is to provide a communication support device (communication support device for APD holders) that can not only eliminate the drawbacks of the conventional support device but also obtain the communication support effect of the APD holder. To do.

The communication support effect is an effect of improving listening ability, which includes (a) making it easier to hear only the voice of the front speaker without including environmental sounds, and (b) summarizing the conversation of the other party. Can be recognized by letters and / or voice, and listening ability (speaking ability) is improved, (c) it is possible to deal with sudden conversations, and (d) words that cannot be heard can be confirmed by letters and / or voice. , (E) It includes the fact that it is possible to confirm the conversation after the fact.

A second aspect of the present invention is to provide a communication support device (communication support device for elderly deaf people) in which an elderly deaf person can clearly hear a high-pitched voice that is particularly difficult to hear regardless of the age group of the user. The purpose.

The first and second objectives are achieved by an invention having the following configuration.
[First invention]
The first invention is a support device that realizes the effect (a) among the above communication support effects, and is characterized in that all the components are provided in the spectacles. The spectacles have or does not have a lens. Does not matter. With or without a lens, it doesn't matter. The components of this support device include, at least, a plurality of front microphones (microphones) provided on the front members of the glasses at lateral intervals, and side microphones provided on the left and right side members of the glasses. , The sound source direction determining means for determining the sound source direction based on the sound signal input from each of the microphones, and the sound signal input from the microphone facing the sound source direction determined by the sound source direction determining means are amplified and used in the speaker described later. The sound amplifying means for giving, the noise eliminating means for extinguishing the sound signal input from the microphone other than the microphone facing the sound source direction determined by the sound source direction determining means, and the left and right side surface members of the glasses are provided and amplified. It is a speaker that emits a sound.
With the above configuration, the wearer of the spectacles can clearly hear only the front or side voice in the direction of the sound source.

It is desirable that the speaker is an array speaker in which a plurality of small speakers with acoustic tubes are arranged in close proximity to each other.
As a result, only the voice in the direction of the sound source can be clearly heard, and other environmental sounds (noise) cannot be heard.

[Second invention]
The second invention is a support device for realizing the effect (a) among the above-mentioned communication support effects, which comprises glasses and a smartphone (smartphone), and the glasses collect at least frontal conversation. A first short-range wireless communication including a conversion means for converting a voice signal, a first transmission unit for transmitting the converted voice signal to a smartphone, and a first reception unit for receiving an important point of conversation transmitted from the smartphone. Means, a first important point saving means for storing important points received from the smartphone, an output means for outputting the saved important points to an output device provided on the glasses, and a timing for outputting the important points to an output device. The smartphone includes a voice signal recording means for recording a voice signal received from the first short-range wireless communication means of the glasses, and an important point of conversation is extracted from the recorded voice signal. An important point extracting means, a second important point saving means for storing the important points extracted by the important point extracting means, and a second receiving unit for receiving an audio signal from the first short-range wireless communication means of the glasses. It is characterized by including a second short-range wireless communication means including a second transmission unit that transmits important points stored in the second important point storage means to the first short-range wireless communication means of the glasses.
Even if the wearer of the above-mentioned spectacles cannot hear the content of the speaker's story, the important points are output to the spectacle output device, so that the speaker's story can be understood. Therefore, one of the communication support effects can be obtained.

In the second invention, the smartphone has a text conversion means for converting important points stored in the second important point storage means into text, and a third important point storage for storing the important points converted into text by the text conversion means. Further provided with means, when the spectacles receive a textualized important point from the smartphone, the spectacles have a fourth important point saving means for storing the textualized important point and the saved important point text. It is characterized in that it is further provided with a display means for displaying on the output device provided in the above.
Even if the wearer of the above-mentioned glasses cannot hear the contents of the speaker's story, the important points of the story are displayed in characters on the display portion of the glasses, so that the speaker can communicate with the speaker. Therefore, one of the communication support effects can be obtained.

In the second invention, the output device displays the important point text as an image provided on a speaker or a lens of the spectacles which is provided near the ear of the temple of the spectacles and outputs the important point text in exchange for an audio signal. It is characterized by being an LCD (liquid crystal monitor) for displaying.

In the second invention, further, when the indicating means provided on the spectacles is operated, the display means of the spectacles is important stored in the fourth important point saving means after a certain time before the operation time. It is desirable to display the points on the display unit.

This embodiment of the second invention is a support device that realizes the effect of (c) above. That is, when the above glasses are worn, the instruction means is operated when the speaker is suddenly spoken and cannot hear the speaker's story, or when the talk continues for a long time and the speaker's story cannot be heard due to fatigue or the like. Since the important points of the content spoken after a certain period of time from the time of operation are displayed on the display unit, it is possible to prevent a blank of understanding from occurring.

[Third invention]
The third invention is a support device that realizes the effect of the above (d) (words that cannot be heard can be confirmed by letters and / or voice), and comprises glasses and a smartphone, and the glasses are conversations with the other party. A first short-range wireless communication means including a sound collecting means for collecting sound, a first transmitting unit for wirelessly transmitting the collected voice signal to the smartphone described later, and a first receiving unit for wirelessly receiving a summary from the smartphone described later. The smartphone has a display means provided on the lens of the glasses and displays a summary received from the smartphone described later, and the smartphone has a second receiving unit that receives an audio signal transmitted from the first transmitting unit of the glasses. A second short-range wireless communication means including a second transmitter for transmitting the summary sentence to the first receiver of the glasses, a recording means for storing the voice signal received by the second receiver, and a recorded voice. It is characterized by having a voice character conversion means (text conversion means) for converting a signal into text in word units, and a summary creation means for creating a summary sentence from the text.
With the above configuration, even if the spectacle wearer cannot hear the other party's voice, the content of the voice is converted into a text and a summary of the text is displayed on the display means of the spectacles. It is expected that those with hearing disabilities will be able to understand the content of the story well.

As another embodiment of the third invention, instead of providing the spectacles with means for displaying the summary in characters, it is preferable to provide means for outputting the summary to the spectacles by voice so as to be located near the ear canal when the spectacles are worn. ..
In the case of the present invention, the content of the story can be well understood when the auditory information processing impaired person is also a visually impaired person.

As still another embodiment of the third invention, the spectacles are provided with a liquid crystal monitor for displaying the summary in characters, and a speaker (built-in type or external speaker) for outputting the summary by voice is located near the ear canal when the spectacles are worn. It can also be provided as follows.
In this case, the understanding of the summary character display on the liquid crystal monitor is assisted by the summary voice output by the speaker, so that the other party's story becomes easier to understand.

As still another embodiment of the third invention, it is desirable to provide a selection means for selecting one or both of the summary sentence display on the liquid crystal monitor and the summary audio output from the speaker.
By providing such a selection means, the spectacle wearer can select the optimum support according to the degree of his / her auditory processing disorder or visual impairment.

The communication support device for elderly hearing-impaired persons according to the fourth aspect of the present invention has, in one aspect, a voice input means for inputting a voice signal, a frequency analysis means for analyzing the frequency of the voice signal input to the voice input means, and an analysis target. There are an amplification means for amplifying the voice signal output by the frequency analysis means when the frequency band of the voice signal is 1000 Hz to 4000 Hz, a voice output means for outputting the voice amplified by the amplification means, and a selection means. The amplification means include a first amplification means that amplifies the voice signal output by the frequency analysis means to 25 to 35 dB, a second amplification means that amplifies the voice signal to 30 to 40 dB, and a third amplification means that amplifies the voice signal to 35 to 45 dB. The selection means is characterized in that it selects which of the first amplification means, the second amplification means, and the third amplification means is operated by the operation of the user.
With the above configuration, the user of this support device operates the selection means according to whether he / she is in his / her 60s, 70s, or 80s, and operates the first amplification means and the second amplification means. If either the means or the third amplification means is selected, the high-pitched voice, which is particularly difficult for the elderly deaf person to hear, is output at a volume suitable for the individual user, so that the words can be clearly heard.

Further, the communication support device for elderly hearing-impaired persons according to the fourth invention has, in other aspects, a voice input means for inputting a voice signal, a frequency analysis means for analyzing the frequency of the voice signal input to the voice input means, and the like. Amplifying means for amplifying the voice signal output by the frequency analysis means when the frequency band of the voice signal to be analyzed is 1000 Hz to 4000 Hz, a voice output means for outputting the voice amplified by the amplification means, and a selection means. , And the selection means, the user sets the amplification factor of the amplification means to one of a first amplification factor of 25 to 35 dB, a second amplification factor of 30 to 40 dB, and a third amplification factor of 35 to 45 dB. It is operated to select, and the control means causes the amplification means to amplify at any one of the first amplification factor, the second amplification factor, and the third amplification factor based on the selection operation of the selection means. It is characterized by being.
With the above configuration, the user can select one of the first amplification factor, the second amplification factor, and the third amplification factor by the selection means according to whether he / she corresponds to the 60s, 70s, or 80s. If selected, the high-pitched voice, which is particularly difficult for the elderly to hear, is output at a volume suitable for the individual user, so that the words can be heard clearly.

The communication support device for elderly hearing-impaired persons according to the fourth aspect detects a voice input means into which a voice signal is input and a sound section and a silent section of the voice signal input to the voice input means in another aspect. , The voice analysis means for detecting the vowel section and the consonant section in the detected sound section, the consonant section detected by the voice analysis means is extended in time, and the vowel section detected by the voice analysis means is temporally extended. The frequency of the consonant extended by the audio signal processing means and the frequency of the vowel compressed by the audio signal processing means are analyzed, and when the frequency band is 1000 Hz to 4000 Hz, the audio signal is analyzed. The frequency analysis means for outputting the sound signal, the amplification means for amplifying the sound signal output by the frequency analysis means when the frequency band of the sound signal to be analyzed is 1000 Hz to 4000 Hz, and the sound amplified by the amplification means are output. It has an audio output means and a selection means, and the amplification means includes a first amplification means that amplifies the audio signal output by the frequency analysis means to 25 to 35 dB, and a second amplification means that amplifies the audio signal to 30 to 40 dB. The selection means includes a third amplification means that amplifies to 35 to 45 dB, and the selection means selects whether the user operates the first amplification means, the second amplification means, or the third amplification means. It is a feature.
With the above configuration, the user operates the selection means according to whether he / she is in his / her 60s, 70s, or 80s, and operates the first amplification means, the second amplification means, and the third amplification means. If one of the amplification means is selected, the high-pitched voice that is particularly difficult for the elderly deaf person to hear is output at a volume that is easy to hear that is suitable for the individual user, so that the user is not affected by the temporal masking. In addition, the words including consonants can be heard clearly.

The communication support device for elderly hearing-impaired persons according to the fourth aspect detects a voice input means into which a voice signal is input and a sound section and a silent section of the voice signal input to the voice input means in another aspect. , The voice analysis means for detecting the vowel section and the consonant section in the detected sound section, the consonant section detected by the voice analysis means is extended in time, and the vowel section detected by the voice analysis means is temporally extended. The frequency of the consonant extended by the audio signal processing means and the frequency of the vowel compressed by the audio signal processing means are analyzed, and when the frequency band is 1000 Hz to 4000 Hz, the audio signal is analyzed. The frequency analysis means for outputting the sound signal, the amplification means for amplifying the sound signal output by the frequency analysis means when the frequency band of the sound signal to be analyzed is 1000 Hz to 4000 Hz, and the sound amplified by the amplification means are output. It has an audio output means, a selection means, and a control means, and the selection means allows the user to select one of the first amplification factor, the second amplification factor, and the third amplification factor for the amplification factor of the amplification means. The control means is operated, and the control means has one of a first amplification factor of 25 to 35 dB, a second amplification factor of 30 to 40 dB, and a third amplification factor of 35 to 45 dB based on the selection operation of the selection means. It is characterized in that it is amplified by one amplification factor.
With the above configuration, the user operates the selection means according to whether he / she is in his / her 60s, 70s, or 80s, and operates the first amplification means, the second amplification means, and the third amplification means. If one of the amplification means is selected, the high-pitched voice that is particularly difficult for the elderly deaf person to hear is output at a volume that is easy to hear that is suitable for the individual user, so that the user is not affected by the temporal masking. In addition, the words including consonants can be heard clearly.

The communication support device for elderly hearing-impaired persons according to the fourth aspect detects a voice input means into which a voice signal is input and a sound section and a silent section of the voice signal input to the voice input means in another aspect. , The voice analysis means for detecting the vowel section and the consonant section in the detected sound section, the consonant section detected by the voice analysis means is extended in time, and the vowel section detected by the voice analysis means is temporally extended. Audio signal processing means that compresses to, adjustment means that adjusts the time to extend the consonant section based on time resolution information that represents the time resolution of the user's hearing, frequency of the consonant that is extended by the audio signal processing means, and A frequency analysis means that analyzes the frequency of a vowel compressed by an audio signal processing means and outputs the audio signal when the frequency band is 1000 Hz to 4000 Hz, and a frequency band of the audio signal to be analyzed is 1000 Hz to 4000 Hz. It has an amplification means for amplifying an audio signal output by a frequency analysis means at a certain time, an audio output means for outputting the sound amplified by the amplification means, and a selection means. The amplification means is provided by the frequency analysis means. The selection means includes a first amplification means for amplifying the output audio signal to 25 to 35 dB, a second amplification means for amplifying to 30 to 40 dB, and a third amplification means for amplifying to 35 to 45 dB. Is characterized in that it selects whether to operate the first amplification means, the second amplification means, or the third amplification means.
With the above configuration, the user operates the selection means according to whether he / she is in his / her 60s, 70s, or 80s, and operates the first amplification means, the second amplification means, and the third amplification means. If one of the amplification means is selected, the high-pitched voice, which is particularly difficult for the elderly deaf person to hear, is output at a volume that is easy to hear according to the time resolution of the user's individual hearing. You can hear the words clearly, including the consonants, without being affected by.

The communication support device for elderly hearing-impaired persons according to the fourth aspect detects a voice input means into which a voice signal is input and a sound section and a silent section of the voice signal input to the voice input means in another aspect. , The voice analysis means for detecting the vowel section and the consonant section in the detected sound section, the consonant section detected by the voice analysis means is extended in time, and the vowel section detected by the voice analysis means is temporally extended. Audio signal processing means that compresses to, adjustment means that adjusts the time to extend the consonant section based on time resolution information that represents the time resolution of the user's hearing, frequency of the consonant that is extended by the audio signal processing means, and A frequency analysis means that analyzes the frequency of a vowel compressed by an audio signal processing means and outputs the audio signal when the frequency band is 1000 Hz to 4000 Hz, and a frequency band of the audio signal to be analyzed is 1000 Hz to 4000 Hz. It has an amplification means for amplifying an audio signal output by a frequency analysis means at a certain time, an audio output means for outputting the sound amplified by the amplification means, and a selection means, and the user selects the selection means. The amplification factor is manipulated to select one of a first amplification factor of 25 to 35 dB, a second amplification factor of 30 to 40 dB, and a third amplification factor of 35 to 45 dB, and the control means is of the selection means. Based on the selection operation, the amplification means is characterized in that it amplifies at any one of the first amplification factor, the second amplification factor, and the third amplification factor.
With the above configuration, the user can use any of the first amplification factor, the second amplification factor, and the third amplification factor depending on whether he / she is in his / her 60s, 70s, or 80s. If you select, the high-pitched voice that is particularly difficult for elderly hearing-impaired people to hear is output at a volume that is easy to hear that is suitable for the individual user, so the user is not affected by temporal masking and also consonants. You can clearly hear the words including.

According to the present invention, it is possible to provide a support device for an auditory information processing disorder person who can expect a communication support effect for the auditory information processing disorder person.

According to the present invention, it is possible to provide a support device for the elderly who can clearly hear a high-pitched voice that is particularly difficult for the elderly to hear.

It is a perspective view of the eyeglasses provided with the support device which concerns on embodiment of 1 invention. It is a side view of the eyeglasses with a built-in speaker, (a) is a left side view, and (b) is a right side view. It is a block diagram which shows the embodiment of the eyeglass which is one of the basic configurations of 1st invention. 2 and 3 are views showing an example of the small speaker, where FIG. 2A is a front view and FIG. 3B is a plan view. 2 and 3 are views showing other examples of the small speakers, where FIG. 2A is a front view and FIG. 3B is a plan view. It is a side view of the external speaker type eyeglasses, (a) is a left side view, and (b) is a right side view. It is a perspective view which shows the non-contact eyeglass charging system. It is a perspective view which shows the basic structure of the 2nd invention. It is a block diagram which shows the structure provided in the spectacles of FIG. It is a block diagram which shows the structure provided in the smartphone of FIG. It is a figure which shows the other embodiment of the 2nd invention. It is a block diagram which shows 1st Embodiment of 3rd invention. It is a block diagram which shows the 2nd Embodiment of a 3rd invention. It is a block diagram which shows the 3rd Embodiment of a 3rd invention. It is a graph which shows the general tendency of hearing by aging. It is a block diagram which illustrates the structure of 1st Embodiment of 4th invention. It is a block diagram which illustrates the structure of 2nd Embodiment of 4th invention. It is a block diagram which illustrates the structure of 3rd Embodiment of 4th invention. It is a flowchart explaining the operation of the signal processing unit of the support device of FIG. It is a block diagram which illustrates the structure of 4th Embodiment of 4th invention. It is a block diagram which illustrates the structure of 5th Embodiment of 4th invention. It is a figure which shows an example of the expansion rate table of the time expansion / compression adjustment means. It is a block diagram which illustrates the structure of 6th Embodiment of 4th invention.

Subsequently, an embodiment of the communication support device (hereinafter, simply referred to as a support device) according to the present invention will be described with reference to the drawings.
[First invention]
As shown in FIGS. 1 to 3, in the support device A1 according to the first invention, the glasses 10 are provided with components of the support device other than the glasses. The components of the support device other than the glasses 10 will be described below.

On the front member of the spectacles 10, for example, the front frame 11, a plurality of front microphones fm1. fm2 are provided at lateral intervals. Further, the left and right side members of the spectacles 10, for example, the temple 12a. The 12b is provided with side microphones sm1 and sm2. These microphones fm1. It is desirable that fm2; sm1 and sm2 are highly directional microphones such as a MEMS microphone. The spectacles 10 preferably have temples 12a. A control board 13 composed of an IC chip is attached to either one of 12b, and a CPU (Central Processing Unit) is mounted on the control board 13.

The CPU is a microphone fm1. fm2; Sound source direction determining means 14a for determining the sound source direction based on the voice signals input from sm1 and sm2, and each microphone fm1. fm2; Facing the sound amplifier means 14b that amplifies the sound signal input from sm1, sm based on the control from the control means 14d described later, and the sound source direction determined by the sound source direction determining means 14a based on the control from the control means 14d described later. A noise eliminating means 14c for extinguishing or attenuating an audio signal input from a microphone other than the microphone to be used, a control means 14d for controlling each of the means 14a, 14b, 14c, and a sound modulation unit 14e are configured.

The temples 12a and 12b of the eyeglasses 10 are provided with a touch sensor type volume 15a, a battery 15b, a power switch 15c for turning on / off the battery 15b, and a directional touch sensor 15d, which are electrically connected to the control board 13. It is connected to the.

The sound source direction determining means 14a uses a well-known technique, and each microphone fm1. fm2; The sound source direction is determined based on the time difference of the sounds arriving at sm1 and sm2, and the determination signal is given to the control means 14d.

The control means 14d causes the sound amplification means 14b to amplify the sound signal input from the microphone in the determined sound source direction so as to have a predetermined volume in response to the determination signal input from the sound source direction determination means 14a.
The sound modulation unit 15e is a digital signal processor (DSP), and automatically adjusts the sound to be optimally heard according to the amount of operation of the touch sensor type volume 15a.
Further, the control means 14d eliminates or attenuates an audio signal input from a microphone other than the microphone facing the sound source direction by the noise eliminating means 14e according to the determination signal input from the sound source direction determination means 14a.

As illustrated in FIG. 2, small speakers sp1 and 12b on the left and right temples 12a and 12b of the spectacles 10 are provided with a sound signal amplified by the sound amplifier means 14b at a position close to the ear canal of the wearer of the spectacles 10. It is equipped with sp2.

By the action of the noise eliminating means 14e, environmental sounds other than the sound source direction are prevented from entering the ear canal from the speaker, but the sound directly approaching the ear from the outside world is noise that obscures the sound emitted from the speakers sp1 and sp2. There is a risk of external noise).

4 and 5 show novel small speakers SP1 and SP2 in which the influence of external noise is minimized. This small speaker is a small speaker with an acoustic tube (pipe), and the small speaker SP1 illustrated in FIG. 4 is, for example, one or a plurality (four in the illustrated example) circular small speaker msp1 having a diameter of 5 mm or less. An array speaker is configured by providing one acoustic tube (pipe) p in each of ~ msp4 so that the tip thereof extends in parallel from the temple of the eyeglass in the direction of the ear canal.
The small speaker SP2 illustrated in FIG. 5 is provided with one acoustic tube (pipe) p for each of the four rectangular small speakers msp1 to msp4 so that the tips thereof open side by side from the temples of the eyeglasses in the direction of the ear canal. Array speakers are configured.

In such small speakers sp1 and sp2 with acoustic tubes (pipes), since the acoustic tubes (pipes) p connected to the small speakers mps1 to msp4 extend to the ear, the influence of external noise should be minimized. And the sound coming out of the speaker can be heard very clearly.

When the wearer of the spectacles 10 is a mildly hearing-impaired person, the speakers sp1 and sp2 may have temples 12a. As illustrated in FIG. It may be attached (built-in) to 12b. However, if the wearer of these spectacles is a severely hearing impaired person, as illustrated in FIG. 6, the temple 12a. It is desirable to attach the speakers sp1 and sp2 to the tips of the extension members 16a and 16b extending downward from 12b so that the speakers sp1 and sp2 are located close to the ear canal of the spectacle wearer when wearing spectacles.

FIG. 7 illustrates an eyeglass case 10C for charging the battery 15b of the eyeglasses 10. This eyeglass case 10C is a non-contact charger-combined eyeglass case in which a large-capacity lithium battery (2000 mAh as an example) is built in the bottom of the case. Simply put the eyeglass 10 in the case 10C, and the temple 12a or 12b of the eyeglass 10 can be used. The battery 15b can be charged via the built-in non-contact charging coil 15e. It can be charged about 10 times. When the capacity is reduced, you can charge the lithium battery by connecting the cable cb with a USB tab to the power connector.

If the support device A1 of the present invention is in the power-on state, when the spectacle wearer speaks from either direction, the sound source is not known because the spectacle wearer is a hearing impaired person. Since only the voice of the speaker in the direction is amplified and the sound other than the direction of the sound source is attenuated or extinguished, it is possible to clearly hear the speaker's speech. Even if the spectacle wearer knows from the movement of the speaker's mouth that the direction of the sound source is the direction of the speaker and turns to the direction of the speaker, he / she can hear the speaker's story more clearly. it can. Therefore, a communication support effect can be obtained.

[Second Invention, First Embodiment]
FIG. 8 is a perspective view of an example of the support device A2 according to the second invention, FIG. 9 is a block diagram showing a configuration of eyeglasses 100 which is one component of the support device A2, and FIG. 10 is a block diagram of the support device A2. It is a block diagram which shows the structure of the smartphone (smartphone) 200 which is another component.

The support device A2 includes glasses 100 and a smartphone 200.
As shown in FIG. 9, the glasses 100 include a conversion means 101, a sound source direction determination means 102, a control means 103, a sound amplification means 104, a sound modulation unit 104a, a noise elimination means 105, and a sound output means 106. It has a first short-range wireless communication means 107, a first important point storage means 108, an output means 109, and an output device 110.

The sound source direction determination means 102, the control means 103, the voice amplification means 104, the noise elimination means 105, the voice output means 106, the first short-range wireless communication means 107, the first important point storage means 108, and the output means 109 are The function is realized by a microcomputer including a CPU.

The conversion means 101 collects a conversation at least in the front direction of the spectacle wearer and converts the sound into a voice signal. A microphone (microphone) can be used as the conversion means 101.
The conversion means 101 is the same front microphone fm1 as in the support device A1 according to the first invention. It is desirable that it is composed of fm2 and side microphones sm1 and sm2. Further, the sound source direction determination means 102, the control means 103, the sound amplification means 104, the sound modulation unit 104a, and the noise elimination means 105 are the sound source direction determination means 14a and the sound amplification means 14b in FIG. 3 of the support device A1 according to the first invention. , The noise eliminating means 14c, the control means 14d, and the sound modulation unit 14e.
Therefore, only the voice in the sound source direction is amplified by the sound modulation unit 104a from the voice amplification means 104 at the amplification factor defined by the sound modulation unit 104a, and is input to the first short-range wireless communication means 107 via the voice output means 106.

The first short-range wireless communication means 107 has a first transmission unit 107a that transmits an audio signal converted by the conversion means 101 to the smartphone 200, and a first reception unit 107b that receives important points of conversation described later from the smartphone 200. And include. Bluetooth (registered trademark) can be used as the first short-range wireless communication means 107.

In this way, the voice signal output from the voice output means 106 is transmitted to the smartphone 200 from the first transmission unit 107a of the first short-range wireless communication means 107.

The first important point saving means 108 stores important points of conversation transmitted from the smartphone 200, and constitutes a character information memory (108a) and / or important points for storing character information constituting important points. It is composed of a voice information memory (108b) for storing voice information.

The output means 109 outputs the important points of the conversation stored in the first important point storage means 108 to the output device 110 provided in the spectacles 100.

When the important point is composed of character information, the output means 109 outputs the character information read from the character information memory (108a) to the output device 110. In this case, the output device 110 uses a device that displays important points in characters, for example, an LCD (liquid crystal display device). As illustrated in FIG. 8, the LCD is provided at a position where the influence on the visual field of the lens 111 of the spectacles 100 is minimized. When a see-through monitor is used for the output device 110, there is an advantage that important points of the speaker can be visually recognized without obstructing the field of view.

When the important point is composed of voice information, the output means 109 outputs the voice information read from the voice information memory (108b) to the output device 110. In this case, the output device 110 uses devices that output important points by voice, for example, small speakers sp1 and sp2. It is desirable that the small speakers sp1 and sp2 be provided at the position closest to the ear canal of the spectacle wearer on the temple 112 of the spectacle 100. In this case, there is an advantage that the existence of the small speakers sp1 and sp2 does not have to be easily known to the other party or a person in the vicinity.

As in the case of the first invention, when the spectacle wearer is a mildly hearing impaired person, the small speakers sp1 and sp2 may be attached to the temple 112 of the spectacles. In this case, there is an advantage that the existence of the small speakers sp1 and sp2 is not noticed. When the spectacle wearer is a severely hearing impaired person, it is preferable to attach the small speakers sp1 and sp2 to the tip of the extension member 113 extending from the temple of the spectacles to the vicinity of the ear canal, as illustrated in FIG.

The control means 103 has a timing of transmitting the audio signal converted from the sound collected by the glasses 100 to the smartphone 200 via the first short-range wireless communication means 107, and the control means 103 via the first short-range wireless communication means 107. It controls the timing of receiving from the smartphone 200 and outputting the important points stored in the first important point saving means 108 to the output device 110.

As shown in FIG. 10, the smartphone 200 has a second short-range wireless communication means 201, a voice recording means 202, an important point extraction means 203, and a second important point storage means 204.

The second short-range wireless communication means 201 performs short-range wireless communication with the first short-range wireless communication means 107 of the eyeglasses 100, and transmits an audio signal transmitted from the first transmission unit 107a of the eyeglasses 100. The second receiving unit 201a for receiving and the second transmitting unit 201b for transmitting the important points of the conversation stored in the second important point storing means 204 to the first receiving unit 107a of the glasses 100 are included. Bluetooth (registered trademark) can be used for the second short-range wireless communication means 201.

The voice recording means 202 temporarily stores the voice signal received from the first short-range wireless communication means 107 of the glasses 100, and is composed of a voice memory. The important point extracting means 203 extracts important points of conversation from the voice signal stored in the voice recording means 202. The extraction of this important point is performed by converting the voice from the voice signal into words on a word-by-word basis using well-known voice character conversion software.

The second important point saving means 204 stores the important points of the conversation extracted by the important point extracting means 203. When the output device 110 of the eyeglasses 100 displays important points in characters, the second important point storage means 204 is configured by a character memory that sequentially stores characters converted from voice to word units.
On the other hand, when the output device 110 of the glasses 100 displays the important points by voice, the second important point storage means 204 sequentially stores the voice converted from the voice signal into the important points in word units. Consists of.

Subsequently, the operation of the first embodiment of the second invention configured as described above will be described.
The voice (speaking voice) delivered from the speaker to the wearer of the spectacles is converted into a voice signal by the conversion means 101 of the spectacles 100, and the voice signal is transmitted to the smartphone 200 by the first transmission unit 107a of the first short-range communication means 107. Will be done.

The transmitted voice signal is received by the second receiving unit 201a of the second short-range wireless communication means 201 of the smartphone 200, and is temporarily stored in the voice recording means 202 as voice data. The temporarily stored voice data is sequentially given to the important point extraction means 203, and important points of conversation are extracted from the voice data. The extraction of this important point is performed by converting the voice data into character data in word units. Then, the converted character data is stored in the second important point storage means 204, and subsequently transmitted to the glasses 100 by the second transmission unit 201b of the second short-range wireless communication means 201.

When the character data, which is an important point of the transmitted conversation, is received by the first receiving unit 107b of the first short-range communication means 107 of the glasses 100, the important point is sent to the first important point storing means 108 of the glasses 100. It is saved and output to the output device 110 by the output means 109.

In one example, the output device 110 is a monitor having a character display capability, and the monitor is provided at a position that does not obstruct the field of view of the lens 111 of the spectacles 100, and is miniaturized to a size that does not obstruct the field of view. ing.
By using such a monitor, the spectacle wearer can face the speaker with the same appearance and appearance as a normal spectacle wearer, and can recognize the important points of the story. .. Therefore, the spectacle wearer who is an auditory processing disorder can receive the communication support effect.

The output device 110 can be a speaker that displays the important points of the story by voice instead of the monitor that displays the important points of the story by characters. In this case, the output means 109 converts the character data, which is an important point of the conversation input from the first important point storage means 108, into voice data and inputs it to the speaker).
In this embodiment, when the spectacle wearer is a visually impaired person, the communication support effect can be well received.

[Second Invention, Second Embodiment]
As illustrated in FIG. 11, after the first important point storage means 108, a monitor (110a) for displaying the important points of the story in characters and a speaker (110b) for displaying the important points of the story by voice as an output device. In addition to the above, a selection switch 109a for selectively operating either or both of these may be provided. Output means 109b, 109c for controlling character display or voice display are provided between the selection switch 109a, the monitor (110a), and the speaker (110b).

With such a configuration, the spectacle wearer can select the optimum support mode and receive the communication support effect according to the situation at that time, the situation of hearing impairment, and the like.

[Third Invention First Embodiment]
In the third invention, as shown in FIG. 12, the smartphone 200 is provided with the text conversion means 205 for converting the important points stored in the second important point storage means 204 in the second invention into text, and the text conversion means. A third important point saving means 206 for storing the important points converted into text by 205 is provided, and every time the important point text is saved in the third important point saving means 206, the important point text is transmitted to the second short-range wireless communication. It is transmitted to the glasses 100 by the second transmission unit 201b of the means 201.
On the other hand, on the eyeglass 100 side, the important point text transmitted from the smartphone 200 by the first receiving unit 107b of the first short-distance communication means 107 is stored in the fourth important point saving means 120, and the saved important points are stored. The text is read out and displayed on the display unit (monitor) 122 provided on the spectacle lens 111 by the display means 121.

In a preferred embodiment (second embodiment), as shown in FIG. 13, the eyeglasses 100 are provided with an instruction means 123 and a control unit 124 made of a touch sensor, and each time the designating means 123 is touch-operated, the control unit The 124 causes the important point text stored in the fourth important point saving means 120 to be read out and displayed on the display unit 122 after a certain time before the touch operation time.

With this configuration, when a deaf person using this support device is suddenly spoken and cannot hear, or when he / she misses the voice of the speaker, when the instruction means 123 is touched, it is constant from that point. The important point text of the story after the time ago is displayed on the display unit 122. Therefore, communication with the speaker can be continued without interruption.

[Third Invention, Third Embodiment]
In the third embodiment of the third invention, as shown in FIG. 14, the summarization creating means 207 is added to the latter stage of the third important point saving means 206 on the smartphone 200 side.

That is, important points are extracted by the important point extracting means 203 of the smartphone 200 from the voice data transmitted from the glasses 100 to the smartphone 200, and are stored in the second important point saving means 204. After the important point text is subsequently created by the text conversion means 205, it is stored in the third important point storage means 206. Then, the summarizing means 207 creates a summarizing sentence using the well-known summarizing sentence creating software based on the stored important point text, and the glasses 100 are produced by the second transmitting unit 201b of the second short-range wireless communication means 201. Send to.
On the eyeglasses 100 side, the first receiving unit 107b of the first short-distance communication means 107 receives the summary sentence (text) transmitted from the smartphone 200, stores the summary sentence (text) in the summary sentence storage means 120', and stores the summary sentence (text). The summarized text is read out and displayed on the display unit (monitor) 122 provided on the spectacle lens 111 by the display means 121.

As a result, the user of the spectacles 100 can check the summary of the story of the other speaker on the monitor 122 provided on the lens of the spectacles. Since the summary is displayed, it is possible to grasp the content of the conversation more easily and quickly than when the important points of the conversation are displayed word by word. Therefore, even a person with an auditory information processing disorder can smoothly communicate.

[Fourth Invention, First Embodiment]
FIG. 16 is a block diagram showing the configuration of the communication support device A41 for the elderly deaf person according to the first embodiment of the present invention.

The support device A41 shown in FIG. 16 includes a voice input means 301, a frequency analysis means 302, a first amplification means 303, a second amplification means 304, a selection means 305, and a voice output means 306. It can also be called a hearing aid for the elderly with hearing loss.

The voice input means 301 is, for example, an external input terminal for inputting an output of a microphone, an induction coil, a voice communication device, or a voice reproduction device. An external voice signal is input to the voice input means 301, and the input voice signal is output to the frequency analysis means 302.

The frequency analysis means 302 analyzes the frequency of the input voice signal, and a frequency analyzer using electronics, a digital analyzer using a fast Fourier transform (FFT), or the like can be used. When the frequency of the input audio signal is in the frequency band of 1000 Hz to 4000 Hz, the frequency analysis means 302 inputs the audio signal to the first amplification means 303. Further, when the frequency analysis means 302 detects an audio signal other than the frequency band of 1000 Hz to 4000 Hz, that is, an audio signal in the frequency band of less than 1000 Hz and exceeding 4000 Hz, the frequency analysis means 302 inputs this to the second amplification means 304.

The first amplification means 303 includes a first amplifier 303a, a second amplifier 303b, and a third amplifier 303c. The first amplifier 303a amplifies the audio signal input from the frequency analysis means 302 so that the sound pressure level of the sound output from the audio output means 306 is 25 to 35 dB, and inputs the audio signal to the audio output means 306. The second amplifier 303b amplifies the audio signal input from the frequency analysis means 302 so that the sound pressure level of the sound output from the audio output means 306 is 30 to 40 dB, and inputs the audio signal to the audio output means 306. The third amplifier 303c amplifies the audio signal input from the frequency analysis means 302 so that the sound pressure level of the sound output from the audio output means 306 becomes 35 to 45 dB, and inputs the audio signal to the audio output means 306.

25 to 35 dB, 30 to 40 dB, and 35 to 45 dB are in the range of sound pressure levels that make it easy for hearing-impaired people in their 60s, 70s, and 80s to hear the voice output from the voice output means 306, respectively.

The selection means 305 is for selecting which of the three-stage amplification factors of the first amplification means 303 is enabled by the operation of the user. The selection means 305 has an operation unit including, for example, a dial or a slider, and when the operation unit is selectively moved to three stop positions, the first amplifier 303a, the second amplifier 103b, or the third amplifier 303c is performed at each stop position. Can be operated. The selection means 305 is composed of three buttons corresponding to each of the first amplifier 303a, the second amplifier 303b, and the third amplifier 303c, and when a predetermined button is operated, any of the predetermined amplifiers (303a, 303b, 303c) Either one) may be made operational.

The second amplification means 304 outputs voice signals in the frequency bands of less than 1000 Hz and more than 4000 Hz input from the frequency analysis means 302, and the voice output means 306 outputs voice with a sound intensity (sound pressure level) that is easy for elderly hearing-impaired people to hear. The amplification factor that can be output, for example, 20 to 30 dB, is amplified and input to the audio output means 306.
The audio output means 306 may use, for example, not only an earphone, a speaker, headphones, or the like, but also an oscillator such as a bone conduction oscillator, an electrode for the inner ear, or the like.

According to the first embodiment, when the elderly deaf person is in his / her 60s, 70s, or 80s with one type of support device A41 (hearing aid), he / she operates the selection means 305 to himself / herself. By selecting an amplifier (any one of 303a, 303b, 303c) suitable for the age group of the elderly, the elderly deaf person can clearly hear the high-pitched voice that is particularly difficult to hear.

[Fourth Invention, Second Embodiment]
FIG. 17 is a block diagram showing a configuration of a communication support device A42 for an elderly deaf person according to a second embodiment of the fourth invention.

The difference between the second embodiment A42 and the first embodiment A41 described above is that the first amplification means 303 in the first embodiment includes three amplifiers 303a, 303b, 303c having different amplification factors, and the user. Selects one amplifier corresponding to one's age group (60's, 70's or 80's) by the selection means 305 operated by the user, and determines the amplification factor of the input audio signal. On the other hand, in the second embodiment A42, the first amplification means 303 uses one amplifier to output the audio signal output by the frequency analysis means 302 when the frequency band of the audio signal to be analyzed is 1000 Hz to 4000 Hz. The point is that amplification is possible in three stages: amplification factor, second amplification factor, and third amplification factor.

The selection means 305 and the control means 107 are connected to the first amplification means 303. The selection means 305 is operated so that the user selects one of the first amplification factor, the second amplification factor, and the third amplification factor for the amplification factor of the first amplification means 303. The control means 107 has a first amplification factor of 25 to 35 dB, a second amplification factor of 30 to 40 dB, and a third of 35 to 45 dB in the first amplification means 303 based on the selection signal input by the selection operation of the selection means 305. Amplify with any one of the amplification factors.

According to the second embodiment A42, the language can be clearly heard as in the first embodiment, and the effect that a low-cost one can be used for the first amplification means can be obtained.

[Fourth Invention, Third Embodiment]
FIG. 18 is a block diagram showing a configuration of a communication support device A43 for an elderly deaf person according to a third embodiment of the present invention.
The third embodiment A43 includes a voice analysis means 401, a control means 402, and a signal processing unit 403 between the voice input means 301 and the frequency analysis means 302 in the first embodiment A41. In FIG. 18, the same components as those in FIG. 16 are used with the same reference numerals, and the description thereof will be omitted.

Since the frequency analysis means 302 to the voice output means 306 are the same as those from the frequency analysis means 302 to the voice output means 306 in the first embodiment A41 described above, redundant description will be omitted. However, since the voice output from the voice output means 306 is different from the voice output from the voice output means 306 in the first embodiment in clarity, it will be described in detail later.

The voice input means 301 receives an external voice signal and outputs the input voice signal to the voice analysis means 401 and the signal processing unit 403.

The voice analysis means 401 analyzes the type of sound of the voice signal input to the voice input means 301. Specifically, the voice analysis means 401 determines whether the input voice signal is a sound section or a silent section. Further, the voice analysis means 401 determines the consonant section and the vowel section by detecting the consonant section and the vowel section following the consonant section in the section determined to be the sounded section.

The voice analysis means 401 determines the sounded section and the silent section as follows as an example. That is, the voice analysis means 401 calculates the power of the voice signal in a unit time, and if the time when the power value is equal to or more than the predetermined threshold value continues for more than the predetermined time, it determines that it is a sound section. If the duration is less than the predetermined threshold value or less than the predetermined time, it is determined as a silent section (a section that can be acoustically regarded as silent).
As a method for determining a sounded section and a silent section, a known determination method other than the above example can also be used.

The voice analysis means 401 determines the consonant section and the vowel section in the section determined to be the sound section as follows as an example. That is, the voice analysis means 401 extracts the formant frequency or the pitch period in the section determined to be a sound section, and determines the consonant and the vowel from the respective characteristics of the consonant and the vowel. Here, since it is difficult to distinguish a consonant signal from other noise by itself, a consonant section is estimated and a judgment is made when a subsequent vowel is detected in order to determine a consonant section.
A known determination method other than the above may be used for determining the consonant section and the vowel section.

The control means 402 controls the signal processing unit 403 based on the analysis result of the voice analysis means 401. Specifically, the control means 402 determines the processing content (should be expanded or compressed) of the sound based on the type of sound (vowel, consonant, other, etc.) analyzed by the voice analysis means 401. Do. Then, the signal processing unit 403 is controlled by sending a control signal including information on the sound section and the processing content to the signal processing unit 403.

Specifically, when the voice analysis means 401 detects a consonant section or a vowel section following the consonant section, the control means 402 performs signal processing according to the detected consonant section or the vowel section following the consonant section. Control unit 403.

The signal processing unit 403 has a time extending means 404 and a time compressing means 405. In response to the control signal from the control means 402, the time extension means 404 and the time compression means 405 perform signal processing of the voice signal output from the voice input means 301 as described later.

When the consonant section is detected by the voice analysis means 401, the control means 402 inputs to the signal processing unit 403 a control signal including information for the time extending means 404 to extend the consonant section (time extension). Further, when the control means 402 has a vowel section following the consonant section detected by the voice analysis means 401, the control means 402 transmits a control signal including information for the time compression means 405 to compress the vowel section (time compression). Input to the signal processing unit 403.

It should be noted that how the control means 402 and the signal processing unit 403 share the processing can be variously implemented depending on the mounting method, and is not limited to the processing sharing of the present embodiment. For example, the control means 402 may be configured to send only the sound type and the processing content to the signal processing unit 403, determine the processing time by the signal processing unit 403, and transmit the processing time to the control means 402 if necessary. It is possible.

Further, the information for the time extending means 404 to extend the time of the consonant section may be determined for each type of detected consonants, or the consonants are classified into a certain group and determined for each group. May be good. Further, it may be determined for each type of consonant or for each group of classified consonants according to the deterioration of the time resolution of the user.

In the signal processing unit 403, a voice signal is input from the voice input means 301, and a control signal is input from the control means 402. Based on the control signal from the control means 402, the signal processing unit 403 processes the voice signal input from the voice input means 301 by the time extension means 404 and the time compression means 405 as follows.

That is, when the consonant section is detected by the voice analysis means 401 from the voice signal output from the voice input means 301, the signal processing unit 403 extends the consonant section of the voice signal in time. When at least one of the vowel section and the silence section is detected by the voice analysis means 401 from the voice signal output from the voice input means 301, the signal processing unit 403 sets the vowel section and the silence section of the voice signal for time. Compress.

When the subsequent vowel needs to be input to the voice analysis means 401 in order to determine the consonant, the control signal input from the control means 402 to the signal processing unit 403 has a consonant section determination delay. Occurs. Therefore, it is desirable to provide a delay buffer in the signal processing unit 403 or in front of the signal processing unit 403 so that the time can be compressed and expanded according to the determination delay.

The time extension means 404 extends the time of the consonant section designated by the control signal from the control means 402. The time extension of the consonant section can be performed, for example, by cutting out the audio signal of the consonant section in time and repeating the portion.
It should be noted that the time extension of the consonant section can be made smooth at the joint by performing a crossfade that fades in and out. Further, the method of extending the consonant section is not limited to the above-mentioned consonant extension method. Other consonant extension methods may be used.

As described above, by extending the consonant section, even deteriorated inner ear hair cells can respond to consonants, and the effect of temporal masking by vowels before and after the consonant can be reduced. .. This makes it possible to improve the consonant recognition rate of the deaf person who has difficulty hearing consonants.

The time compression means 405 compresses the time obtained by extending the consonant section from at least one of the vowel section and the silence section. More specifically, the time compression means 405 performs time compression of the vowel section or the silence section following the consonant section, or time compression of both the vowel section and the silence section following the consonant section, based on the control signal from the control means 402. I do. Further, the time compression means 405 compresses the vowel section in time by deleting a part of the time of the extended consonant section from the vowel section in pitch units, and the rest of the time of the extended consonant section. , The silent section is compressed by deleting the signal in the silent section. In this way, the time compression means 405 compresses not the consonant section itself but the time increased by the expansion process, that is, the time extended in the consonant section in the subsequent section.

By doing so, even if the time extending means 404 extends the time of the consonant section, there is a difference between the visual information and the auditory information, and the hearing assistance by lip sync (synchronization of visual and auditory senses) cannot be performed. Occurrence can be prevented.

The voice analysis means 401, the control means 402, and the signal processing unit 403 extend the consonant section included in the voice signal input to the voice input means 301, and compress the vowel section or the silent section following the consonant section. Therefore, it is considered that the voice signal output from the signal processing unit 403 is a signal capable of hearing consonants.

However, since the frequency of the voice signal output from the signal processing unit 403 covers a wide range from the low range to the high range, the problem that the words in the high range cannot be clearly heard is not eliminated.

In FIG. 18 showing the third embodiment A43, the configuration from the frequency analysis means 302 to the voice output means 306 following the signal processing unit 403 is the same as the frequency analysis means 302 to the voice output means 306 in the first embodiment A41. Is. Therefore, among the voice signals that can hear the consonants output from the signal processing unit 403, the voice of 1000 to 4000 Hz, which is a high frequency range that is particularly difficult for elderly hearing-impaired people to hear, is amplified by the user operating the selection means 305. By setting the rate, the voice output means 306 outputs clear consonant voices at a volume suitable for the individual user and is easy to hear, so that the words can be heard clearly.

An example of the operation of the voice analysis means 401, the control means 402, and the signal processing unit 403 of the third embodiment will be described with reference to the flowchart shown in FIG.

The voice analysis means 401 determines whether or not the voice input to the voice input means 301 is a sound section (S21. In FIG. 19, S means a step). When the voice analysis means 401 determines that the input voice is a sound section (in the case of Y in S21. Y is an abbreviation for Yes), the voice analysis means 401 determines whether or not the determined sound section is a consonant section. Step (S22).

When the voice analysis means 401 determines in S22 that the voice in the sounded section has a consonant section (in the case of Y in S22), the consonant detection flag F is set to 1, and the process proceeds to step S23 for time extension control. .. In step S23, the control means 402 controls the time extension means 404 of the signal processing unit 403 to extend the time for a predetermined time.

On the other hand, if the voice analysis means 401 determines in step S22 that the sounded section is not a consonant section (in the case of N in S22), the voice analysis means 401 proceeds to step S24 for determining whether or not time compression processing is necessary. In step S24, when the voice analysis means 401 determines that the consonant detection flag F is 1, that is, determines that time compression processing is necessary (in the case of Y in S24), the sounded section is a vowel. The process proceeds to step S25 for determining whether or not the section is a section. If it is N in S25, the process ends. When the voice analysis means 401 determines in step S25 that the sounded section is a vowel section (in the case of Y in S25), the voice analysis means 401 proceeds to step S26 for performing time compression control in pitch units.
In step S26, the control means 402 controls the time compression means 405 to delete the vowel sections for the extended time of the consonant or longer in pitch units to perform time compression, and the consonant detection flag F Substitute 0 for.

After the time extension control is finished in step S23, or after the time compression control is finished in step S26, the process returns to step S21 and the same process is repeated for the subsequent input voice.

Although not shown in FIG. 18, in the third embodiment A43, between the frequency analysis means 302 and the voice output means 306, and between the frequency analysis means 302 and the voice output means 306 in FIG. The second amplification means 304 is provided in the same manner as the second amplification means 304 provided.

[Fourth Invention, Fourth Embodiment]
FIG. 20 is a block diagram showing a configuration of a communication support device A44 for an elderly deaf person according to a fourth embodiment of the present invention.
In the third embodiment A43, the amplification unit from the frequency analysis means 302 to the voice output means 306 in FIG. 16 is connected to the subsequent stage of the signal processing unit 403, whereas in the fourth embodiment A44, the signal processing unit A44 is connected. The amplification unit from the frequency analysis means 302 to the audio output means 306 in FIG. 17 is connected to the latter stage of the 403.
Also in the fourth embodiment A44, the same effect as the effect of the third embodiment A43 described above is exhibited.

[Fifth Embodiment of the fourth invention]
FIG. 21 is a block diagram showing a configuration of a communication support device A45 for an elderly deaf person according to a fifth embodiment of the present invention.
In the fifth embodiment A45, the adjusting unit 406 is added to the control means 402 in the third embodiment A43 of FIG.

The adjusting unit 406 is composed of a time resolution setting means 407 and a time expansion / compression adjusting means 408. The adjusting unit 406 adjusts the time for extending a part of the voice signal and the time for compressing the other part according to the time resolution of the user's hearing. For example, the adjusting unit 406 increases the time for extending the consonant section when the degree of decrease in the time resolution of the user's hearing is large as compared with the case where the degree of decrease in the time resolution of the user's hearing is small. Adjust to.

In order to adapt the time resolution setting means 407 to the user, an adjustment value for the time resolution is set as one of the fitting parameters by using a fitting program or the like before use. Using the set adjustment value, the time resolution value of the user is set in the time resolution setting means 407. The adjustment value is input and set from the outside, but is not limited to the configuration set in the time resolution setting means 407, and may be set by the adjustment unit 406 including the time expansion / compression adjustment means 408.

For example, the time resolution setting means 407 sets, as the time resolution value of the user's hearing, data measured by using the time resolution measurement method or a parameter of the degree of decrease in time resolution according to the measured value. Can be done.

The time decompression / compression adjusting means 408 is based on the time resolution value set by the time resolution setting means 407, and the time for the time decompression means 404 of the signal processing unit 403 to be decompressed (decompression time) and the time for the time compression means 405 to compress. Set the adjustment amount to adjust with (compression time).

The time expansion / compression adjustment means 408 performs the consonant expansion processing based on the set adjustment amount by referring to the expansion rate table prepared in advance. FIG. 22 shows an example of an elongation rate table. This extension rate table shows the relationship between the time resolution and the extension rate for each type (component) of each consonant, and the adjustment amount (magnification) to be extended according to the type of consonant.

Specifically, the time decompression / compression adjusting means 408 sets the decompression time and the compression time shorter based on the time resolution value set by the time resolution setting means 407, for example, when the degree of decrease in the time resolution is small. However, if the degree of decrease is large, the decompression time and compression time are set longer. In this way, it is possible to easily perceive a consonant having a short duration by extending the consonant until the user can perceive the consonant according to the degree of decrease in the time resolution of the user.

The control means 402 outputs the adjustment amount set by the time expansion / compression adjustment means 408 to the signal processing unit 403 together with the control signal according to the detection result by the voice analysis means 401. That is, the control means 402 determines the processing content (expansion, compression, etc.) of the sound based on the type of sound (vowel, consonant, other, etc.) analyzed by the voice analysis means 401. Then, the signal processing unit 403 is controlled by sending a control signal including information such as a sound section and processing contents to the signal processing unit 403 together with the adjustment amount set by the time expansion / compression adjusting means 408. Do.

The time extension means 404 extends the time of the consonant section based on the adjustment amount and the control signal input to the signal processing unit 403 by the control means 402. The time extension of the consonant section is performed in the same manner as the time extension means 404 of FIG. 18, but the time for extending the consonant section is also determined based on the input adjustment amount.

The time compression means 405 performs time compression of the vowel section and the like based on the adjustment amount and the control signal input to the signal processing unit 403 by the control means 402. This time compression is performed in the same manner as the time compression means 405 of FIG. 18, but the time for compressing the vowel section and the like is determined based on the input adjustment amount.

As described above, according to the fifth embodiment A45, the time resolution setting means 407 and the time decompression / compression adjusting means 408 adjust the voice decompression time and the compression time according to the time resolution of the user's hearing. can do. Thereby, it is possible to provide a support device capable of improving the hearing of consonants and improving the sound pressure level, which are more suitable for the individual user.

[Fourth Invention, Sixth Embodiment]
FIG. 23 is a block diagram showing the configuration of the communication support device A46 for the elderly deaf person according to the sixth embodiment of the fourth invention.

The sixth embodiment A46 is obtained by adding an adjustment unit 406 similar to the adjustment unit 406 in FIG. 21 to the control means 402 in the fourth embodiment A44 of FIG. 20.

In the sixth embodiment A46 as well, as in the fifth embodiment A45, the extension time and the compression time of the sound are adjusted according to the time resolution of the user's hearing, thereby further adapting to the individual user. It is possible to provide a support device that enables improvement of consonant hearing and improvement of sound pressure level at a lower cost.

A1, A2, A3 support device 10,100 glasses
Fm1, fm2 front microphone
Sm1, sm2 Side microphone 12a, 12b Temple 13 Control board 14a, 102 Sound source direction determination means 14b, 103 Sound amplification means 14c, 104 Noise elimination means 14d, 105 Control means 14e, 103a Sound modulation unit sp1, sp2 Speaker 15a Volume (touch) Sensor)
15b Battery 15c Power Switch 100 Glasses 111 Lens 112 Temple 113 Extension Member 200 Smartphone (Smartphone)
A41 support device (first embodiment)
A42 support device (second embodiment)
A43 support device (third embodiment)
A44 support device (fourth embodiment)
A45 support device (fifth embodiment)
A46 support device (sixth embodiment)

Claims (16)

The sound source direction is determined based on a plurality of front microphones provided on the front members of the glasses at lateral intervals, side microphones provided on the left and right side members of the glasses, and audio signals input from the respective microphones. The sound source direction determining means for determining, the sound amplifying means for amplifying the sound signal input from the microphone facing the sound source direction determined by the sound source direction determining means and giving it to the speaker, and the sound source direction determining means for determining. It is characterized by having a noise eliminating means for reducing or extinguishing an audio signal input from a microphone other than a microphone facing the sound source direction, and a speaker provided on the left and right side surface members of the glasses and producing an amplified sound. Communication support device for people with hearing information disabilities. The communication support device for an auditory processing disorder according to claim 1, wherein the speaker is an array speaker in which an even number of small speakers with acoustic tubes are arranged in close proximity to each other. It consists of glasses and a smartphone
The glasses
At least, a conversion means that collects the conversation in the front direction and converts it into a voice signal, a first transmitter that transmits the converted voice signal to the smartphone, and a first reception that receives an important point of the conversation transmitted from the smartphone. A first short-range wireless communication means including a unit, a first important point saving means for storing important points received from the smartphone, and an output means for outputting the saved important points to an output device provided on the glasses. The smartphone includes a control means for setting a timing for outputting an important point to an output device, a voice signal recording means for recording a voice signal received from the first communication means of the glasses, and the recorded voice signal. An important point extracting means for extracting important points of conversation from, a second important point saving means for storing the important points extracted by the important point extracting means, and a first communication means for receiving voice signals from the glasses. 2. Hearing characterized by comprising a second short-range wireless communication means including a receiving unit and a second transmitting unit that transmits important points stored in the second important point storage means to the first communication means of the glasses. Communication support device for people with information processing disabilities. The smartphone further includes a text conversion means for converting important points stored in the second important point storage means into text, and a third important point storage means for storing the important points converted into text by the text conversion means. ,
When the spectacles receive a textualized important point from the smartphone, the spectacles have a fourth important point saving means for storing the textualized important point and an output device provided with the saved important point text on the spectacles. The communication support device for an auditory processing disorder according to claim 3, further comprising a display means for displaying. The communication support device for an auditory processing disorder according to claim 4, wherein the output device is a speaker that outputs the important point text in exchange for an audio signal or an LCD that displays the important point text as an image. .. When the instruction means provided on the spectacles is operated, the display means of the spectacles displays on the display unit important points stored in the fourth important point storage means after a certain period of time from the time of the operation. The communication support device for an auditory information processing disorder according to claim 4. It consists of glasses and a smartphone
The glasses
A sound collecting means (high directional microphone) that collects the conversation of the other party, a first transmitter that wirelessly transmits the collected audio signal to the smartphone described later, and a first receiver that wirelessly receives a summary from the smartphone described later. It has a first short-range wireless communication means including the above, and a display means (liquid crystal monitor) provided on the lens of the glasses and displaying a summary received from a smartphone described later.
The smartphone has a second short distance including a second receiving unit that receives an audio signal transmitted from the first transmitting unit of the glasses and a second transmitting unit that transmits a summary sentence described later to the first receiving unit of the glasses. A wireless communication means, a recording means for storing the voice signal received by the second receiver, a voice character conversion means (text conversion means) for converting the recorded voice signal into text in word units, and a summary sentence from the text. A communication support device for persons with auditory information processing disorders, which comprises a means for creating a summary to be created. The auditory processing disorder according to claim 7, wherein instead of providing the liquid crystal monitor for displaying the summary on the glasses, a speaker for outputting the summary by voice to the glasses is provided so as to be located near the ear canal when the glasses are worn. Communication support device for. The auditory sense according to claim 7, further comprising a liquid crystal monitor for displaying the summary on the spectacles, and providing a speaker (built-in type, external earphone) for outputting the summary to the spectacles so as to be located near the ear canal when the spectacles are worn. Communication support device for people with information processing disabilities. The communication support device for an auditory processing disorder according to claim 9, further comprising a selection means for selecting one or both of the summary sentence display on the liquid crystal monitor and the summary voice output from the speaker. A voice input means for inputting a voice signal, a frequency analysis means for analyzing the frequency of the voice signal input to the voice input means, and the frequency analysis when the frequency band of the voice signal to be analyzed is 1000 Hz to 4000 Hz. It has an amplification means for amplifying an audio signal output by the means, an audio output means for outputting the audio amplified by the amplification means, and a selection means.
The amplification means includes a first amplification means for amplifying an audio signal output by the frequency analysis means to 25 to 35 dB, a second amplification means for amplifying to 30 to 40 dB, and a third amplification means for amplifying to 35 to 45 dB. The elderly hearing-impaired person is characterized in that the selection means selects which of the first amplification means, the second amplification means, and the third amplification means is operated by the operation of the user. Communication support device for. The audio input means into which the audio signal is input, the frequency analysis means for analyzing the frequency of the audio signal input to the audio input means, and the frequency analysis when the frequency band of the audio signal to be analyzed is 1000 Hz to 4000 Hz. It has an amplification means for amplifying an audio signal output by the means, an audio output means for outputting the audio amplified by the amplification means, a selection means, and a control means.
The selection means is operated by the user to select the amplification factor of the amplification means from a first amplification factor of 25 to 35 dB, a second amplification factor of 30 to 40 dB, and a third amplification factor of 35 to 45 dB. Is a thing
The control means is characterized in that it amplifies the amplification means at any one of the first amplification factor, the second amplification factor, and the third amplification factor based on the selection operation of the selection means. Communication support device for the hearing impaired. A voice that detects a voice input means into which a voice signal is input and a sounded section and a silent section of the voice signal input to the voice input means, and detects a vowel section and a consonant section within the detected sounded section. The analysis means, the audio signal processing means that temporally expands the consonant section detected by the audio analysis means, and temporally compresses the vowel section detected by the audio analysis means, and the audio signal processing means. A frequency analysis means that analyzes the frequency of the consonant sound and the frequency of the vowel compressed by the audio signal processing means and outputs the audio signal when the frequency band is 1000 Hz to 4000 Hz, and the frequency of the audio signal to be analyzed. It has an amplification means for amplifying an audio signal output by the frequency analysis means when the band is 1000 Hz to 4000 Hz, an audio output means for outputting the sound amplified by the amplification means, and a selection means.
The amplification means includes a first amplification means for amplifying an audio signal output by the frequency analysis means to 25 to 35 dB, a second amplification means for amplifying to 30 to 40 dB, and a third amplification means for amplifying to 35 to 45 dB. Including and
The selection means is a communication support device for elderly hearing-impaired people, characterized in that the user selects which of the first amplification means, the second amplification means, and the third amplification means is to be operated. A voice that detects a voice input means into which a voice signal is input and a sounded section and a silent section of the voice signal input to the voice input means, and detects a vowel section and a consonant section within the detected sounded section. The analysis means, the audio signal processing means that temporally expands the consonant section detected by the audio analysis means, and temporally compresses the vowel section detected by the audio analysis means, and the audio signal processing means. A frequency analysis means that analyzes the frequency of a consonant sound and the frequency of a vowel compressed by the audio signal processing means and outputs the audio signal when the frequency band is 1000 Hz to 4000 Hz, and the frequency of the audio signal to be analyzed. It has an amplification means for amplifying an audio signal output by the frequency analysis means when the band is 1000 Hz to 4000 Hz, an audio output means for outputting the sound amplified by the amplification means, a selection means, and a control means. And
The selection means is operated so that the user selects one of the first amplification factor, the second amplification factor, and the third amplification factor for the amplification factor of the amplification means.
The control means has an amplification factor of 25 to 35 dB, a second amplification factor of 30 to 40 dB, and a third amplification factor of 35 to 45 dB based on the selection operation of the selection means. A communication support device for the elderly with deafness, which is characterized by being amplified by. A voice that detects a voice input means into which a voice signal is input and a sounded section and a silent section of the voice signal input to the voice input means, and detects a vowel section and a consonant section within the detected sounded section. An analysis means, a voice signal processing means that temporally extends a consonant section detected by the voice analysis means, and temporally compresses a vowel section detected by the voice analysis means, and a time resolution of the user's hearing. The adjustment means for adjusting the time for extending the consonant section based on the time resolution information representing the above, the frequency of the consonant extended by the audio signal processing means, and the frequency of the vowel compressed by the audio signal processing means are analyzed. , The frequency analysis means that outputs the audio signal when the frequency band is 1000 Hz to 4000 Hz, and the audio signal output by the frequency analysis means when the frequency band of the audio signal to be analyzed is 1000 Hz to 4000 Hz is amplified. It has an amplification means, an audio output means for outputting the sound amplified by the amplification means, and a selection means.
The amplification means includes a first amplification means that amplifies the audio signal output by the frequency analysis means to 25 to 35 dB, a second amplification means that amplifies to 30 to 40 dB, and a third amplification means that amplifies the audio signal to 35 to 45 dB. Including
The selection means is a communication support device for elderly hearing-impaired people, characterized in that the user selects which of the first amplification means, the second amplification means, and the third amplification means is to be operated. A voice that detects a voice input means into which a voice signal is input and a sounded section and a silent section of the voice signal input to the voice input means, and detects a vowel section and a consonant section within the detected sounded section. The analysis means, the audio signal processing means for extending the consonant section detected by the voice analysis means in time and compressing the vowel section detected by the voice analysis means in time, and the time resolution of the user's hearing. The adjustment means for adjusting the time for extending the consonant section based on the time resolution information represented, the frequency of the consonant extended by the audio signal processing means, and the frequency of the vowel compressed by the audio signal processing means are analyzed. The frequency analysis means that outputs the audio signal when the frequency band is 1000 Hz to 4000 Hz, and the audio signal output by the frequency analysis means when the frequency band of the audio signal to be analyzed is 1000 Hz to 4000 Hz is amplified. It has an amplification means, an audio output means for outputting the sound amplified by the amplification means, and a selection means.
The selection means is operated by the user to select the amplification factor of the amplification means from a first amplification factor of 25 to 35 dB, a second amplification factor of 30 to 40 dB, and a third amplification factor of 35 to 45 dB. Is to be done
The control means is characterized in that, based on the selection operation of the selection means, the amplification means amplifies the amplification means at any one of the first amplification factor, the second amplification factor, and the third amplification factor. Communication support device for the elderly deaf.

Images