CN117826996A - Control method and device of head-mounted equipment, electronic equipment and head-mounted equipment - Google Patents
Control method and device of head-mounted equipment, electronic equipment and head-mounted equipment Download PDFInfo
- Publication number
- CN117826996A CN117826996A CN202311864217.2A CN202311864217A CN117826996A CN 117826996 A CN117826996 A CN 117826996A CN 202311864217 A CN202311864217 A CN 202311864217A CN 117826996 A CN117826996 A CN 117826996A
- Authority
- CN
- China
- Prior art keywords
- head
- audio signal
- frequency band
- preset frequency
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000005236 sound signal Effects 0.000 claims abstract description 83
- 230000001720 vestibular Effects 0.000 claims abstract description 43
- 238000012545 processing Methods 0.000 claims abstract description 34
- 210000001595 mastoid Anatomy 0.000 claims abstract description 32
- 230000035807 sensation Effects 0.000 claims abstract description 20
- 230000001133 acceleration Effects 0.000 claims description 34
- 230000033001 locomotion Effects 0.000 claims description 21
- 230000002123 temporal effect Effects 0.000 claims description 16
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 230000003321 amplification Effects 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 8
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 8
- 238000001914 filtration Methods 0.000 claims description 2
- 230000009286 beneficial effect Effects 0.000 abstract description 5
- 210000003128 head Anatomy 0.000 description 26
- 210000000988 bone and bone Anatomy 0.000 description 17
- 230000008569 process Effects 0.000 description 13
- 208000002173 dizziness Diseases 0.000 description 10
- 230000000007 visual effect Effects 0.000 description 10
- 230000001953 sensory effect Effects 0.000 description 9
- 210000003582 temporal bone Anatomy 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000008447 perception Effects 0.000 description 7
- 208000024891 symptom Diseases 0.000 description 7
- 230000001537 neural effect Effects 0.000 description 5
- 230000000638 stimulation Effects 0.000 description 5
- 206010019194 Head discomfort Diseases 0.000 description 4
- 230000009471 action Effects 0.000 description 4
- 210000004556 brain Anatomy 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000001965 increasing effect Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 210000003169 central nervous system Anatomy 0.000 description 2
- 210000003477 cochlea Anatomy 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000004424 eye movement Effects 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 210000004379 membrane Anatomy 0.000 description 2
- 239000012528 membrane Substances 0.000 description 2
- 210000000056 organ Anatomy 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 210000000721 basilar membrane Anatomy 0.000 description 1
- 210000000133 brain stem Anatomy 0.000 description 1
- 210000001638 cerebellum Anatomy 0.000 description 1
- 210000003710 cerebral cortex Anatomy 0.000 description 1
- 210000000860 cochlear nerve Anatomy 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 210000003027 ear inner Anatomy 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000001508 eye Anatomy 0.000 description 1
- 230000001976 improved effect Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 201000003152 motion sickness Diseases 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 230000001114 myogenic effect Effects 0.000 description 1
- 230000006461 physiological response Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000000272 proprioceptive effect Effects 0.000 description 1
- 230000003304 psychophysiological effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000003938 response to stress Effects 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 230000004936 stimulating effect Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H23/00—Percussion or vibration massage, e.g. using supersonic vibration; Suction-vibration massage; Massage with moving diaphragms
- A61H23/02—Percussion or vibration massage, e.g. using supersonic vibration; Suction-vibration massage; Massage with moving diaphragms with electric or magnetic drive
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/01—Constructive details
- A61H2201/0157—Constructive details portable
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5023—Interfaces to the user
- A61H2201/5048—Audio interfaces, e.g. voice or music controlled
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2205/00—Devices for specific parts of the body
- A61H2205/02—Head
- A61H2205/027—Ears
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Health & Medical Sciences (AREA)
- Physical Education & Sports Medicine (AREA)
- Pain & Pain Management (AREA)
- Epidemiology (AREA)
- Rehabilitation Therapy (AREA)
- Life Sciences & Earth Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Details Of Audible-Bandwidth Transducers (AREA)
Abstract
The invention discloses a control method of head-mounted equipment, which is applied to the technical field of the head-mounted equipment, wherein the head-mounted equipment is provided with a vibrating diaphragm corresponding to temporal bone mastoid behind auricles, and the control method comprises the following steps: processing the current audio signal to obtain an audio signal of a preset frequency band; wherein, the preset frequency band is matched with the sensing frequency band of vestibular sensation; the audio signal based on the preset frequency band drives the vibrating diaphragm to vibrate through the driving module, so that the generated vibration acts on the contact of the mastoid process to stimulate the vestibular sense, and the vestibular sense is stimulated through the contact to reduce the information conflict of vision-vestibular sense, so that the discomfort of the head of a user is effectively relieved, the cost of the head-mounted equipment is low, the head-mounted equipment is convenient to carry, and convenience can be provided for the user. The invention also provides a control device of the head-mounted equipment, the electronic equipment and the head-mounted equipment, and the control device and the electronic equipment have the same beneficial effects.
Description
Technical Field
The present invention relates to the field of a headset, and in particular, to a control method and apparatus for a headset, an electronic device, and a headset.
Background
The user can partially appear uncomfortable symptoms (namely, halation screen symptoms) such as dizziness when using wear equipment such as VR (Virtual Reality), AR (Augmented Reality ) and MR (Mixed Reality), and the like, so that the use experience of the user is affected by the discomfort of different degrees, the wish of continuing to use is reduced, and the popularization of the Virtual Reality technology is not facilitated.
The theory of sensory conflict is that symptoms such as dizziness are induced when visual stimulus in a virtual environment and expected information of vestibular sense are not matched, for example, when a first visual angle racing game is played, a user can perform racing operations such as sudden acceleration, sharp turning and the like, a large amount of information is visually input, but limbs do not have corresponding motions, the vestibular sense cannot sense the expected body acceleration information, and thus, the dizziness is caused by the information conflict of vision-vestibular sense. In order to solve dizziness caused by the limb perception conflict, a plurality of companies develop seat motion platforms, so that symptoms such as dizziness of users are relieved, experience effects of the users are obviously optimized, and user acceptance is improved. But the seat motion platform is huge in size and high in cost, and is not beneficial to the portable use of individual users.
In view of this, how to provide a portable head-mounted device capable of improving user comfort is a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The embodiment of the invention aims to provide a control method and device of head-mounted equipment, electronic equipment and head-mounted equipment, which can effectively relieve the halation of a user in the use process, and the head-mounted equipment is low in cost and convenient to carry, and can provide convenience for the user.
In order to solve the above technical problems, an embodiment of the present invention provides a control method of a head-mounted device, which is applied to the head-mounted device, wherein a vibrating diaphragm corresponding to temporal bone mastoid behind auricles is arranged on the head-mounted device, and the method includes:
processing the current audio signal to obtain an audio signal of a preset frequency band; wherein the preset frequency band is matched with the vestibular sensation sensing frequency band;
and driving the vibrating diaphragm to vibrate through the driving module based on the audio signal of the preset frequency band.
In one embodiment, the processing the current audio signal to obtain an audio signal of a preset frequency band includes:
receiving a current audio signal;
and filtering the current audio signal by adopting a high-low pass filter to obtain an audio signal with a preset frequency band.
In an embodiment, the driving, by a driving module, the vibrating diaphragm to vibrate based on the audio signal in the preset frequency band includes:
performing digital-to-analog conversion on the audio signal of the preset frequency band;
and carrying out power amplification processing on the audio signal after digital-to-analog conversion by adopting a power amplifier, and driving the vibrating diaphragm to vibrate based on the audio signal after power amplification processing.
In one embodiment, before the current audio signal is processed to obtain the audio signal of the preset frequency band, the method further includes:
acquiring a current gear of the head-mounted device;
acquiring a triggering condition corresponding to the current gear;
and acquiring corresponding motion parameters based on the triggering conditions, judging whether the current motion state of the head-mounted equipment meets the triggering conditions based on the motion parameters, and if so, entering the step of processing the current audio signal to obtain an audio signal of a preset frequency band.
In one embodiment, the obtaining the current gear of the headset includes:
and determining the current gear of the head-mounted equipment from preset gears based on a gear selection instruction of a user.
In one embodiment, the gears include a light gear, a medium gear, and a heavy gear.
In one embodiment, the trigger condition corresponding to the light gear includes: the angular acceleration of the head view camera is greater than a first preset value;
the triggering conditions corresponding to the intermediate gear include: the angular acceleration of the head view camera is greater than a first preset value; or the linear acceleration of the head vision camera is larger than a second preset value;
the triggering conditions corresponding to the serious gear comprise: the angular acceleration of the head view camera is greater than a first preset value; or the linear acceleration of the head vision camera is larger than a second preset value; or the overturning angular acceleration is greater than a third preset value.
The embodiment of the invention also provides a control device of the head-mounted equipment, which is applied to the head-mounted equipment, wherein the head-mounted equipment is provided with a vibrating diaphragm corresponding to temporal bone mastoid behind auricles, and the control device comprises:
the processing module is used for processing the current audio signal to obtain an audio signal of a preset frequency band; wherein the preset frequency band is matched with the vestibular sensation sensing frequency band;
and the driving module is used for driving the vibrating diaphragm to vibrate through the driving module based on the audio signal of the preset frequency band.
The embodiment of the invention also provides electronic equipment, which comprises:
a memory for storing a computer program;
and a processor for implementing the steps of the control method of the head-mounted device as described above when executing the computer program.
The embodiment of the invention also provides a head-mounted device, which comprises: the driving module and the vibrating diaphragm which is arranged at the rear of the auricle and corresponds to the temporal bone mastoid process are the electronic equipment.
The embodiment of the invention provides a control method of head-mounted equipment, which is applied to the head-mounted equipment, wherein the head-mounted equipment is provided with a vibrating diaphragm corresponding to temporal bone mastoid behind auricles, and the method comprises the following steps: processing the current audio signal to obtain an audio signal of a preset frequency band; wherein, the preset frequency band is matched with the sensing frequency band of vestibular sensation; and driving the vibrating diaphragm to vibrate through the driving module based on an audio signal of a preset frequency band.
Therefore, the vibration diaphragm is arranged at the position, corresponding to the temporal mastoid behind the auricle, of the head-mounted device, the audio signal of the preset frequency band matched with the sensing frequency band of the vestibular sense is obtained according to the current audio signal in the audio playing process, then the vibration diaphragm corresponding to the temporal mastoid behind the auricle is driven by the driving module according to the audio signal of the preset frequency band to generate vibration, the vibration acts on the contact point of the temporal mastoid behind the auricle, the vestibular sense is stimulated by the contact point, so that the information conflict of vision-vestibular sense is reduced, the head discomfort of a user is effectively relieved, the head-mounted device is low in cost and convenient to carry, and convenience is provided for the user.
The invention also provides a control device of the head-mounted equipment, the electronic equipment and the head-mounted equipment, and the control device and the electronic equipment have the same beneficial effects.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required in the prior art and the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a theoretical model of an induced motion sickness in the prior art;
fig. 2 is a flow chart of a control method of a headset according to an embodiment of the present invention;
fig. 3 is a schematic diagram of an architecture of a bone conduction headset according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a control circuit of a headset device of the headset device according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a control device of a headset according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a headset according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a control method and device of head-mounted equipment and the head-mounted equipment, which can effectively relieve the head discomfort of a user in the use process, has low cost and is convenient to carry, and can provide convenience for the user.
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The vestibular center is located in the brainstem, cerebellum, and cerebral cortex, and functions to integrate sensory information input of vestibular organs, visual system, and proprioceptive system, coordinate movements of the head and eyes, activate posture muscles that maintain balance, and provide correct directions for the head and body in space. The theory of sensory conflict is that symptoms such as dizziness are induced when visual stimulus in a virtual environment and expected information of vestibular sense are not matched, for example, when a first visual angle racing game is played, a user can perform racing operations such as sudden acceleration, sharp turning and the like, a large amount of information is visually input, but limbs do not have corresponding motions, the vestibular sense cannot sense the expected body acceleration information, and thus, the dizziness is caused by the information conflict of vision-vestibular sense.
Referring to fig. 1, fig. 1 is a schematic diagram for describing, understanding and predicting the occurrence of information conflict of vision-vestibular sensation, thereby inducing halasis. Expected limb state u d First, the preparation phase P is entered and directed to the neural command generating controller C, which generates a command m to drive the limb B to the desired position. Comprehensively consider external interference u e After the influence of (a), the limb state u actually represented is formed. This state is perceived by the visual system (vis), vestibular system (vest) and limb sensory system (som), and subsequently the Central Nervous System (CNS) processes and delays to produce a signal representing the actual limb perceived state (u) s ) Is the incoming signal of (a), u s Is a limb state signal obtained by sensory system perception post-processing. Written in the form of a transfer function:
u s ＝H(som,vis, post, …) u, where u s The model obtained by processing the neural signals of the body sensing system by the brain when the head equipment is not worn is represented, H (som, vis, vest, …) represents a proportional function of the identification of the physical state of the limb by the sensing neural system of each part of the body when the head equipment is not worn, and u represents the physical state of the limb actually expressed when the environment is handled when the head equipment is not worn.
It is assumed that the brain is expected to construct a feedback model against some similar sensory stimulus based on previous experience to quickly respond to self-initiated changes in physical state. The model uses u' S Representing the output of a so-called internal psychological expectation model, which is reproduced from previous experience of limb feedback, containing all the information of the visual system (vis '), the vestibular system (vest'), the limb sensory system (vest '), the low-pass filter (LP'), etc. Written in the form of a transfer function:
u' S =h '(som', vis ', vest', …) u ', where u' S The model obtained by processing the neural signals of the body sensing system by the brain when the head device is worn is represented, H ' (som ', vis ', vest ', …) represents a proportional function of the identification of the physical state of the limb by the sensing neural system of each part of the body when the head device is worn, and u ' represents the physical state of the limb actually represented when the head device is worn and corresponding to the environment.
The main input to this internal model is a copy of the drive instruction m' (output copy). And output u s In contrast, the output u' here should be the optimal estimate of the body state, it is this estimate that is in relation to the desired state u d The comparison is performed, thereby generating an error signal e: e=u d -u'; wherein u is d Representing historical empirical values of the brain for the same event treatment.
At the same time, this output drives our psycho-physiological responses such as Subjective Vertical (SV) and Motion Perception (MP), and Eye Movement (EM) physiological responses.
In an ideal case, the output signal u 'of the internal psychological expectation model' S Should be equal to the actual limb-perceived status signal u s At this time, no halation is caused. However, when there is an external disturbance, the signals will not be equal.This difference will generate an additional internal feedback signal (c=u S -u' S ) I.e. the current actual limb perception state conflicts with the limb state of the internal psychological expectation model, the halation can occur. The conflict signal is weighted by an internal feedback gain K, and the ratio of the visual system (vis '), vestibular system (vest'), limb sensory system (som ') in the function H' (som ', vis', vest ', …) is continuously and dynamically fed back and adjusted by an internal psychological model, so that u' S Approach u s Further, the conflict between the current actual limb feeling state and the expected state of the internal psychological model is reduced, namely, c tends to be zero, and the halation is relieved.
It should also be noted that the vestibular system may be stimulated by applying a noise stimulus using Bone Conduction Vibrations (BCV) at the temporal mastoid behind the auricle, which is an increase in sensory stimulus to the vestibular system, and does not require a precise adaptation of the intended vestibular signal and the actually applied vestibular signal, making the method easier to implement in practical products. Bone Conduction Vibration (BCV) decreases the perceived reliability of the vestibular system, i.e. the proportion of vest in function H (som, vis, vest, …) decreases, due to vest versus u' S And u is equal to s The difference of the (2) is larger, so that the ratio of the ves is reduced, which is equivalent to increasing the weight of the visual self-movement information obtained in the stimulation process, namely, the ratio of the ves in the function H (som, vis, vest, …) is increased, and the ratio of the vis is increased to enable the output signal u 'of the internal psychological expectation model to be generated due to smaller difference of the visual system perception' S =h ' (som ', vis ', vest ', …) u ' and the actual limb-perceived status signal u s =h (som, vis, vest, …) u tend to be equal, and vignetting is alleviated.
Referring to fig. 2, fig. 2 is a flowchart of a method for controlling a headset according to an embodiment of the present invention. The method is applied to a head-mounted device, and a vibrating diaphragm corresponding to temporal bone mastoid behind auricles is arranged on the head-mounted device, and the method comprises the following steps:
s110: processing the current audio signal to obtain an audio signal of a preset frequency band; wherein, the preset frequency band is matched with the sensing frequency band of vestibular sensation;
it should be noted that there are two ways in which the human ear produces hearing: the air sound stimulates the vibration of the basilar membrane of the inner ear to cause hearing and the temporal bone vibration is conducted to the cochlea to cause hearing, respectively. The bone conduction technology is to treat the picked external sound wave and then excite temporal bone in a vibration mode so as to stimulate cochlea; bone conduction headphones are a successful application of this technology in the hearing aid field. Bone vibration conduction sites are important factors affecting bone conduction sound perception, since temporal bone locations anterior superior to the auricle can lead to higher cochlear responses and lower bone pilot values than mastoid locations posterior to the auricle, i.e., bone conduction hearing sensitivity is higher at temporal bone locations anterior superior to the auricle. Accordingly, the contact point of the conventional consumer bone conduction earphone is typically the anterior superior temporal bone position of the auricle, as shown in fig. 3.
In the embodiment of the invention, the principle of action of bone conduction vibration is driven by the stimulation of a vestibular system in the theory of the induction of the halasis, and is not driven by the universal stress response caused by the sound felt in the application process of the bone conduction vibration. Bone conduction vibration has a definite frequency tuning range for stimulating the vestibular system, the frequency tuning range is determined based on the sensing frequency range of vestibular sensation, and in practical application, the sensing frequency range of vestibular sensation is 200-500 Hz, so that the vibration between 200-500 Hz generates the maximum myogenic potential. Although the sensitivity of bone conduction hearing at the mastoid location is slightly inferior, since the bone conduction vibration signal can effectively generate potential stimulation of vestibular organs at the mastoid location, the mastoid contact can be used as an EQ (Equalizer) low-frequency auxiliary compensation point of bone conduction and a vestibular system stimulation contact for alleviating halasis.
It will be appreciated that in the embodiment of the present invention, the vibration diaphragm is disposed on the head-mounted device at a position corresponding to the auricle posterior temporal mastoid, that is, the auricle posterior temporal mastoid vibration diaphragm as shown in fig. 3. In the process of playing the audio signal, the current audio signal is obtained and processed, and particularly, a high-low pass filter can be adopted to filter the current audio signal, so that the audio signal of the preset frequency band matched with the perceptual frequency band of vestibular sensation is obtained. The preset frequency range may be 200-500 Hz, and of course, the specific frequency range may be determined according to practical situations, which is not particularly limited in the embodiment of the present invention.
S120: and driving the vibrating diaphragm to vibrate through the driving module based on an audio signal of a preset frequency band.
Specifically, after the audio signal of the preset frequency band is obtained, digital-to-analog conversion can be performed on the audio signal of the preset frequency band, the digital audio signal of the preset frequency band is converted into an analog audio signal (particularly, digital-to-analog conversion can be realized through a sound card), then a power amplifier is used for performing power amplification processing on the audio signal after digital-to-analog conversion, so that a vibrating diaphragm is driven to vibrate according to the audio signal after power amplification processing, potential stimulation of vestibular sense organs is effectively generated at the mastoid position through driving vibration of the vibration diaphragm of temporal bone behind auricles, thereby generating interference on vestibular sense, reducing the weight of vestibular sense, and information conflict of vision-vestibular sense, and relieving dizziness and the like.
Specifically, referring to fig. 4, in practical application, two paths of audio output paths may be set, where the first path is used for playing back a spatial sound field, and the second path is used for compensating for low frequency sound and alleviating discomfort symptoms such as dizziness. Specifically, the audio signal of virtual reality drives the temporal bone vibration diaphragm acting on the front upper part of auricle through the sound card channel 1 and the power amplifier 1, and the temporal bone vibration is transmitted to the auditory nerve to cause sound perception, and the sound is replayed to construct a space immersion sound field. In the second path, the audio signal is filtered by a high-low pass filter to obtain an EQ curve with the frequency of 200-500 Hz, and then the EQ curve passes through a sound card channel 2 and a power amplifier 2 to drive a vibration diaphragm of the temporal mastoid process behind auricles.
In one embodiment, before the processing the current audio signal to obtain the audio signal of the preset frequency band, the method may further include:
acquiring a current gear of the head-mounted equipment;
acquiring a triggering condition corresponding to a current gear;
and acquiring corresponding motion parameters based on the trigger conditions, judging whether the current motion state of the head-mounted equipment meets the trigger conditions based on the motion parameters, and if so, entering a step of processing the current audio signal to obtain an audio signal of a preset frequency band.
In the embodiment of the invention, in order to further facilitate the use of the user and improve the use experience of the user, a plurality of gears can be preset, corresponding trigger conditions are set for each gear, the user can select the corresponding gear to set the gears of the head-mounted device by inputting the gear selection instruction according to the needs of the user, and the specific user can select the gears in a voice input mode or through the gear selection buttons. In practical application, the current gear of the head-mounted device can be obtained, the triggering condition corresponding to the current gear is obtained, the triggering condition relates to the corresponding motion parameter type, then the motion parameter of the head-mounted device corresponding to the motion parameter type is collected, whether the current motion state of the head-mounted device is the triggering condition is judged according to the motion parameter, then the current audio signal is processed under the condition that the current motion state meets the triggering condition, and the audio signal of a preset frequency band is obtained, so that the vibration diaphragm is driven to vibrate based on the audio signal, the generated vibration acts on the contact of the mastoid to stimulate vestibular sensation, and discomfort symptoms such as dizziness of a user are relieved better.
In one embodiment, the gears include a light gear, a medium gear, and a heavy gear.
It will be appreciated that the degree of head discomfort may be divided into mild, moderate and severe in practice, whereby different gears are set according to different degrees, respectively mild, moderate and severe.
In one embodiment, the trigger condition corresponding to the light gear includes: the head-view camera angular acceleration is greater than a first preset value (e.g., 3deg/s 2 )；
The trigger conditions corresponding to the intermediate gear include: the angular acceleration of the head view camera is greater than a first preset value; or the head view camera linear acceleration is greater than a second preset value (e.g., 4m/s 2 )；
The trigger conditions corresponding to the serious shift range include: the angular acceleration of the head view camera is greater than a first preset value; or the linear acceleration of the head vision camera is larger than a second preset value; or the angular acceleration of capsizing is greater than a third preset value (e.g. 3deg/s 2 )。
It should be noted that, referring to table 1, different gear positions correspond to the frequency of vibration of the diaphragm at the mastoid process of the temporal bone behind the auricle, that is, the number of times of regular triggering of the second path, and the triggering condition is controlled by signals such as angular acceleration of the head view camera, linear acceleration of the head view camera, and angular acceleration of overturning of the VR, MR, and AR devices.
TABLE 1 trigger conditions for different gears
It can be understood that in practical application, the more serious the discomfort degree of the head is, the higher the gear can be selected, the different gears correspond to different triggering conditions, the higher the gear corresponds to the more triggering conditions, so that the vibration of the vibration diaphragm of the temporal mastoid at the back of the auricle can be driven more frequently under the condition that the discomfort degree of the head is serious, namely, the vestibular sensation is stimulated more frequently, and the discomfort degree of the head is relieved better.
When a plurality of sensor signals intervene in the triggering condition, the second path can be triggered to complete the vibration of the diaphragm once by satisfying any sensor signal requirement, for example, for the severity, the data information of the angular acceleration sensor of the head view camera, the data information of the linear acceleration sensor of the head view camera and the overturning angular acceleration are detected, and the value of the angular acceleration sensor of the head view camera is calculated>3deg/s 2 Or head view camera linear acceleration sensor value>4m/s 2 Or capsizing angular acceleration>3deg/s 2 When three conditions meet one of the conditions, a second path can be triggered.
Specifically, in practical application, the duration of vibration of the diaphragm caused by single trigger is determined according to the duration that the sensor exceeds a set value, and the minimum duration can be set to be 1s; and in the case where the plurality of sensor signal magnitudes simultaneously satisfy or alternately satisfy exceeding the set value, the duration of the diaphragm vibration takes the intersection of the durations during which it exceeds the set value. The method provided by the embodiment of the invention combines signals such as the angular acceleration of the head view camera, the linear acceleration of the head view camera, the overturning angular acceleration and the like of VR, MR and AR equipment, and can determine whether to trigger the second path through judging corresponding triggering conditions, so that the vibration acts on mastoid contacts regularly to stimulate vestibular sensation, and the discomfort of the head of a user is effectively relieved. Meanwhile, the EQ curve can enhance the low-frequency performance of the bone conduction earphone and improve the sound immersion of a user.
As can be seen from the above, the present invention sets the vibrating diaphragm at the position corresponding to the temporal mastoid at the back of the auricle on the head-mounted device, obtains the audio signal of the preset frequency band matching the sensing frequency band of the vestibular sensation according to the current audio signal in the audio playing process, and then drives the vibrating diaphragm corresponding to the temporal mastoid at the back of the auricle to generate vibration according to the audio signal of the preset frequency band, the vibration acts on the contact of the temporal mastoid at the back of the auricle, and the vestibular sensation is stimulated by the contact to reduce the information conflict of the vision-vestibular sensation, thereby effectively relieving the head discomfort of the user.
On the basis of the above embodiment, the embodiment of the present invention further provides a control device for a head-mounted device, referring to fig. 5, which is applied to the head-mounted device, and the head-mounted device is provided with a vibrating diaphragm corresponding to temporal mastoid process behind auricles, including:
the processing module 11 is configured to process a current audio signal to obtain an audio signal of a preset frequency band; wherein, the preset frequency band is matched with the sensing frequency band of vestibular sensation;
the driving module 12 is configured to drive the vibration membrane to vibrate through the driving module based on an audio signal in a preset frequency band.
It should be noted that, the control device of the headset provided in the embodiment of the present invention has the same beneficial effects as the control method of the headset provided in the above embodiment, and for specific receiving of the control method of the headset related in the embodiment of the present invention, reference is made to the above embodiment, and the application is not repeated here.
On the basis of the foregoing embodiment, an embodiment of the present invention further provides an electronic device, with reference to fig. 6, including:
a memory 20 for storing a computer program;
a processor 21 for implementing the steps of the control method of the head-mounted device as described above when executing the computer program.
It should be noted that, the processor 21 in the embodiment of the present invention may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 21 may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 21 may also comprise a main processor, which is a processor for processing data in an awake state, also called CPU (Central Processing Unit ); a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 21 may integrate a GPU (Graphics Processing Unit, image processor) for rendering and drawing of content required to be displayed by the display screen. In some embodiments, the processor 21 may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.
Memory 20 may include one or more computer-readable storage media, which may be non-transitory. Memory 20 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 20 is at least used for storing a computer program, where the computer program, when loaded and executed by the processor 21, is capable of implementing the relevant steps of the control method of the headset disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may also include operation systems, data, etc., and the storage manner may be transient storage or permanent storage. The operating system may include Windows, unix, linux, among others. The data may include, but is not limited to, a set offset, etc.
On the basis of the above embodiment, the embodiment of the present invention further provides a headset, as shown in fig. 7, where the headset includes: a driving module 30, a vibrating diaphragm 31 disposed in correspondence with temporal mastoid process behind auricle, and the electronic device 32.
Specifically, the electronic device 32 in the embodiment of the present invention is configured to process a current audio signal to obtain an audio signal in a preset frequency band; wherein, the preset frequency band is matched with the sensing frequency band of vestibular sensation; the vibration membrane is driven to vibrate 31 by the driving module 30 based on the audio signal of the preset frequency band, so that the generated vibration acts on the mastoid contacts to stimulate vestibular sensation.
In one embodiment, the electronic device 32 further includes a high-low pass filter, and is configured to filter the current audio signal to obtain an audio signal with a preset frequency band through the high-low pass filter;
and/or the drive module 30 includes a sound card and a power amplifier; wherein:
the sound card is used for performing digital-to-analog conversion on the audio signal of the preset frequency band;
and the power amplifier is used for carrying out power amplification processing on the audio signal after digital-to-analog conversion by adopting the power amplifier and driving the vibrating diaphragm to vibrate based on the audio signal after power amplification processing.
It should be noted that, the headset provided in the embodiment of the present invention has the same beneficial effects as the control method of the headset provided in the above embodiment, and for specific receiving of the control method of the headset related in the embodiment of the present invention, reference is made to the above embodiment, and the detailed description of this application is omitted herein.
In the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, and identical and similar parts between the embodiments are all enough to refer to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section.
It should also be noted that in this specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A control method of a head-mounted device, which is applied to the head-mounted device, wherein a vibrating diaphragm corresponding to temporal mastoid behind auricle is arranged on the head-mounted device, and the control method comprises the following steps:
processing the current audio signal to obtain an audio signal of a preset frequency band; wherein the preset frequency band is matched with the vestibular sensation sensing frequency band;
and driving the vibrating diaphragm to vibrate through the driving module based on the audio signal of the preset frequency band.
2. The method for controlling a headset according to claim 1, wherein the processing the current audio signal to obtain an audio signal of a preset frequency band includes:
receiving a current audio signal;
and filtering the current audio signal by adopting a high-low pass filter to obtain an audio signal with a preset frequency band.
3. The method for controlling a headset according to claim 1, wherein the driving the vibration diaphragm to vibrate by the driving module based on the audio signal in the preset frequency band includes:
performing digital-to-analog conversion on the audio signal of the preset frequency band;
and carrying out power amplification processing on the audio signal after digital-to-analog conversion by adopting a power amplifier, and driving the vibrating diaphragm to vibrate based on the audio signal after power amplification processing.
4. The method for controlling a headset according to claim 1, further comprising, before the processing the current audio signal to obtain an audio signal in a preset frequency band:
acquiring a current gear of the head-mounted device;
acquiring a triggering condition corresponding to the current gear;
and acquiring corresponding motion parameters based on the triggering conditions, judging whether the current motion state of the head-mounted equipment meets the triggering conditions based on the motion parameters, and if so, entering the step of processing the current audio signal to obtain an audio signal of a preset frequency band.
5. The method for controlling a headset according to claim 4, wherein the obtaining the current gear of the headset includes:
and determining the current gear of the head-mounted equipment from preset gears based on a gear selection instruction of a user.
6. The control method of a headset according to claim 4, wherein the shift ranges include a light shift range, a medium shift range, and a heavy shift range.
7. The control method of the head-mounted device according to claim 6, wherein the trigger condition corresponding to the light shift position includes: the angular acceleration of the head view camera is greater than a first preset value;
the triggering conditions corresponding to the intermediate gear include: the angular acceleration of the head view camera is greater than a first preset value; or the linear acceleration of the head vision camera is larger than a second preset value;
the triggering conditions corresponding to the serious gear comprise: the angular acceleration of the head view camera is greater than a first preset value; or the linear acceleration of the head vision camera is larger than a second preset value; or the overturning angular acceleration is greater than a third preset value.
8. A control device of a head-mounted apparatus, which is applied to the head-mounted apparatus, wherein a vibrating diaphragm corresponding to temporal mastoid behind auricle is provided on the head-mounted apparatus, comprising:
the processing module is used for processing the current audio signal to obtain an audio signal of a preset frequency band; wherein the preset frequency band is matched with the vestibular sensation sensing frequency band;
and the driving module is used for driving the vibrating diaphragm to vibrate based on the audio signal of the preset frequency band.
9. An electronic device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the method of controlling a head-mounted device according to any one of claims 1 to 7 when executing said computer program.
10. A headset, comprising: the electronic device according to claim 9, wherein the driving module is disposed on the vibrating diaphragm corresponding to the temporal mastoid process behind the auricle.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311864217.2A CN117826996A (en) | 2023-12-29 | 2023-12-29 | Control method and device of head-mounted equipment, electronic equipment and head-mounted equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311864217.2A CN117826996A (en) | 2023-12-29 | 2023-12-29 | Control method and device of head-mounted equipment, electronic equipment and head-mounted equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117826996A true CN117826996A (en) | 2024-04-05 |
Family
ID=90505652
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311864217.2A Pending CN117826996A (en) | 2023-12-29 | 2023-12-29 | Control method and device of head-mounted equipment, electronic equipment and head-mounted equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117826996A (en) |
-
2023
- 2023-12-29 CN CN202311864217.2A patent/CN117826996A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3725354B1 (en) | Audio controller | |
| US9521976B2 (en) | Method and apparatus for encouraging physiological change through physiological control of wearable auditory and visual interruption device | |
| EP3537726B1 (en) | Controlling perceived ambient sounds based on focus level | |
| EP2403585B1 (en) | Galvanic vestibular stimulation system for simulation, directional cueing, and alleviating motion-related sickness | |
| US8068644B2 (en) | System for seeing using auditory feedback | |
| US11554244B2 (en) | Systems and methods for multi-modal and non-invasive stimulation of the nervous system | |
| EP2939706A1 (en) | Cognitive enhancement using feedback | |
| CN111566595B (en) | Information processing device, information processing method, and program | |
| CN106340221A (en) | Pure touch sense feedback and continuous force control task combined attention training system | |
| CN115501483A (en) | Method and device for intervening cognitive disorder through personalized transcranial electrical stimulation | |
| US20230053767A1 (en) | System, game console and method for adjusting a virtual environment | |
| WO2019244716A1 (en) | Information processing device, information processing method, and program | |
| US11853472B2 (en) | Modify audio based on physiological observations | |
| CA3112835A1 (en) | Methods and apparatus for inducing or modifying sleep | |
| CN117826996A (en) | Control method and device of head-mounted equipment, electronic equipment and head-mounted equipment | |
| CN116139403B (en) | Control method of transcranial electric stimulation device and transcranial electric stimulation device | |
| Bhowmik | Virtual and augmented reality: Human sensory‐perceptual requirements and trends for immersive spatial computing experiences | |
| WO2023286343A1 (en) | Information processing device, information processing method, and program | |
| US11501751B2 (en) | Mobile terminal with high frequency generator | |
| US11832065B2 (en) | Haptic tinnitus therapeutic system | |
| CN117991514B (en) | VR (virtual reality) head-mounted device, control method and controller | |
| US20240017166A1 (en) | Systems and methods for generating real-time directional haptic output | |
| CN106355969A (en) | Attention training system combining pure sound feedback and continuous force control tasks | |
| KR20230052799A (en) | Decoding model construction method for decoding eeg signal, touch control system and method for having the same | |
| KR20230092730A (en) | Apparatus for treatment of tinnitus and operating method for the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |