Nothing Special   »   [go: up one dir, main page]

CN109729457A - The bone wheat harvest sound processor of formula interactive voice earphone is worn for neck - Google Patents

The bone wheat harvest sound processor of formula interactive voice earphone is worn for neck Download PDF

Info

Publication number
CN109729457A
CN109729457A CN201711025968.XA CN201711025968A CN109729457A CN 109729457 A CN109729457 A CN 109729457A CN 201711025968 A CN201711025968 A CN 201711025968A CN 109729457 A CN109729457 A CN 109729457A
Authority
CN
China
Prior art keywords
microphone
bone
control device
signal
receiving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711025968.XA
Other languages
Chinese (zh)
Inventor
朱华明
武巍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jinruidelu Technology Co Ltd
Original Assignee
Beijing Jinruidelu Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jinruidelu Technology Co Ltd filed Critical Beijing Jinruidelu Technology Co Ltd
Priority to CN201711025968.XA priority Critical patent/CN109729457A/en
Publication of CN109729457A publication Critical patent/CN109729457A/en
Pending legal-status Critical Current

Links

Landscapes

  • Soundproofing, Sound Blocking, And Sound Damping (AREA)

Abstract

The present invention provides a kind of bone wheat harvest sound processor that formula interactive voice earphone is worn for neck, comprising: radio reception bone wheat, control device and executive device.The present invention is handled by the audio data to two-way or the even multichannel input of three tunnels, noise and noise can effectively be removed, it obtains effective clearly and by the audio data of reinforcement, it improves neck to wear the speech recognition accuracy of formula interactive voice earphone, further improve the accuracy and recording quality of service order, improves the satisfaction of user.

Description

Bone wheat sound receiving processing device for neck-wearing voice interaction earphone
Technical Field
The invention relates to the technical field of intelligent wearable equipment, in particular to a bone wheat receiving and processing device for a neck-worn voice interaction earphone.
Background
Along with the development of intelligent wearing equipment and the continuous improvement of people's standard of living, the use of various intelligent wearing equipment like intelligent wrist-watch is more and more popularized, and intelligent wearing equipment has become the indispensable communication instrument in people's life.
A person can hear sound because vibrations in the air transmit vibrations through the external ear canal to the eardrum, and the vibrations formed by the eardrum drive the auditory nerve of the person. When the middle and outer ear of a person is damaged or the ear canal is plugged by a hand, sound can transmit sound vibration through the skin and bones of the person to drive the auditory nerve of the person.
Bone conduction is a sound conduction mode, and sound waves are transmitted through skull, temporal bone, bone labyrinth, inner ear lymph fluid transmission, cochlea, auditory nerve and auditory center of a human, which is a bone conduction technology. Bone conduction is the vibration of the skull or temporal bone, which is transmitted directly into the inner ear without passing through the outer and middle ear. Compared with the traditional air conduction mode of generating sound waves through a loudspeaker diaphragm, the bone conduction mode omits a plurality of sound wave transmission steps, can realize clear sound restoration in noisy pipe diameters, and does not influence her people due to the fact that the sound waves are diffused in the air.
However, bone conduction techniques also have several disadvantages: (1) the amount of bone conduction sound is related to the location of contact with the bone and also to the characteristics of the human tissue. For example: the differences of the users such as age, gender and weight can cause different users to have different experiences when using the same bone conduction headset, and the different experiences are often performance deterioration. (2) When a user receives or sends a call by using a bone conduction technology, the bone conduction device is required to be tightly attached to a bone, a sinking wave is directly transmitted to an auditory nerve through the bone, the wearing mode determines that the bone conduction device is required to be highly pressed on the bone to be transmitted, the quality of audio transmission is affected if the bone conduction device is loosened, and the wearing mode of the highly pressed bone enables the comfort and the skin health of the user to be affected to different degrees in the using process. (3) Bone and human tissue produce frequency selective amplitude attenuation and delay for the shendong signal, and high fidelity or broadband audio signals are difficult to conduct to the auditory nerve through the bone, so most users based on the prior art complain about poor "tone quality" and "timbre" of bone conduction headphones. (4) Bone conduction sound leakage. Most of the existing bone conduction technologies cannot really solve the problem of bone conduction sound leakage because the existing technologies compensate the frequency-dependent real-world situation of human bone and tissue attenuation vibration signals by large volume and large vibration signals, which is equivalent to Yinzi 40489, and the user complains that the sound leakage is serious, or because more power is needed, the volume weight of the bone conduction sound is greatly increased, and the whole device is too heavy. (5) The bone conduction headset is an open binaural system, and when a user is in a noisy environment, the user cannot hear sound transmitted from the headset at all due to the openness of the bone conduction headset.
Patent application No. 102084668A discloses a method and system for processing signals, the system comprising: (a) a processor arranged to process a first input signal detected by the first microphone at a detection time, a second input signal detected by the second microphone at the detection time, and a third input signal detected by the first microphone at the detection time to produce a corrected signal responsive to the first, second and third input signals; and (b) a communication interface configured to provide the corrected signal to an external system. The method carries out noise reduction processing on the sound through a convolution function, and obtains a more accurate sound signal. However, since several sounds are mixed, some sounds are easily mistakenly determined as correct sounds and recorded in the track, and thus the output sound is not completely accurate and clear.
The patent application with the application number of 105721973a discloses a bone conduction headset and an audio processing method thereof, wherein the bone conduction headset comprises a human skeleton and tissue model modeling module, a mathematical pre-corrector, a delay estimation unit, a digital-to-analog converter, an analog-to-digital converter, a first low-pass filter, a second low-pass filter, an audio amplifier, an audio driving amplifier, at least one first microphone and at least one bone conduction oscillator; monitoring attenuation effect information of human bones and tissues of different users in real time, generating a compensation transfer function based on the attenuation effect information, and conducting the input audio signal in the bones and the human tissues after carrying out digital pre-correction on the input audio signal through the compensation transfer function. The method is mainly used for solving the problem of attenuation of audio signals, and correct audio data cannot be distinguished from noise.
Disclosure of Invention
In order to solve the above technical problem, the present invention proposes to process the signals of the first microphone and the second microphone to obtain an optimal audio signal for outputting; or by obtaining enhanced audio signals for the first microphone, the second microphone, and the third microphone and outputting the enhanced audio signals.
The invention provides a bone wheat receiving processing device for a neck-wearing voice interactive earphone, which comprises: the device comprises a radio bone microphone, a control device and an execution device;
the radio bone microphone is arranged on an earplug of the neck-wearing voice interaction earphone and/or a host;
the control device is arranged on the host;
the executing device is arranged on the earplug and/or the host;
the radio bone microphone is connected with the control device in a wired or wireless way;
the control device is connected with the execution device through a flexible cable;
the voice receiving bone microphone collects voice of a user, converts the voice into a digital signal and sends the digital signal to the control device;
the control device receives the digital signal, converts the digital signal into a control signal through operation and sends the control signal to the execution device;
the execution device receives the control signal sent by the control device and sends a wakeup prompt to a user or executes corresponding control;
the radio-reception bone microphone comprises a signal receiving part, an energy conversion part and a signal output part; the signal receiving part is arranged on the outer side of the sound-receiving bone microphone and forms a part of a shell of the sound-receiving bone microphone;
the energy conversion part is respectively connected with the signal receiving part and the signal output part.
Preferably, the sound-receiving microphone comprises a first microphone and a second microphone; the first microphone is arranged on one of the earplugs; the second microphone is arranged in the middle of the host; the first microphone and the second microphone are respectively contacted with the skin or the bones of the human body.
Any one of the above is preferable to further comprise a third microphone, and the third microphone is arranged on the other ear plug and is in contact with the skin or the bone of the human body.
Preferably, the sound-receiving bone microphone is one or more of an electric microphone, a condenser microphone, a piezoelectric microphone, an electromagnetic microphone, a carbon particle microphone, and a semiconductor microphone.
Preferably, any one of the above is integrated with the control device.
Preferably, in any of the above embodiments, the processing unit is MTK 6580.
Preferably, any one of the above, the actuator comprises a speaker and/or a screen.
Any one of the above is preferable that a filter device is further provided between the sound processing device and the control device.
Any one of the above is preferable that a signal conversion device is further provided between the control device and the execution device.
Any one of the above is preferable, further comprising at least one battery pack, and the battery pack is connected to the control device by a flexible cable.
Preferably, in any one of the above embodiments, the control device further integrates and operates a memory RAM.
Preferably, in any of the above embodiments, the control device further integrates a body memory space ROM or a body memory space ROM slot.
Any one of the above is preferable to further comprise a vibration sensor electrically connected to the control device through a flexible cable.
Any one of the above is preferred, wherein the digital signal of the sound receiving microphone comprises a first audio signal and a second audio signal.
Any one of the above is preferable that the first audio signal is voice information of a user collected by the first microphone.
Any one of the above embodiments preferably further includes a second microphone for capturing ambient sound within a time range of occurrence of the first audio signal.
Preferably, the control device further comprises the following sub-modules: the audio characteristic detection submodule is used for carrying out audio characteristic detection on the acquired audio signal; a main sound source judgment submodule for judging the main sound source; the master sound source compensation submodule is used for carrying out master sound source compensation; and the noise reduction submodule is used for eliminating noise.
The invention can effectively remove noise and noise by processing the two-way or three-way or even multi-way input audio data, obtain effective and clear and strengthened audio data, improve the voice recognition accuracy of the neck-wearing voice interaction earphone, further improve the accuracy and the recording quality of the service instruction and improve the satisfaction degree of users.
Drawings
FIG. 1 is a schematic structural view of example 1 according to the present invention;
description of the reference symbols in the drawings:
100 is used for the bone wheat of the interactive earphone of the neck-wearing pronunciation to receive the voice processing unit;
1, an earplug;
2, a host;
10, receiving the bone microphone;
20 a control device;
21 an execution device;
101 a first microphone; 102 a second microphone; 103 a third microphone;
210 a speaker; 211 screen;
22 battery pack.
Detailed Description
The invention is further illustrated with reference to the figures and the specific examples.
Example 1
As shown in fig. 1, a bone microphone receiving processing device 100 for a neck-worn voice interaction earphone includes: the bone microphone 10, the control device 20 and the execution device 21;
the radio bone microphone 10 is arranged on an earplug of the neck-wearing voice interaction earphone and/or a host;
the control device 20 is arranged on the host computer;
the actuating device 21 is arranged on the earplug and/or the host;
the radio bone microphone 10 is connected with the control device 20 through wires or wirelessly;
the control device 20 is connected with the execution device 21 through a flexible cable;
the radio bone microphone 10 collects the voice of a user, converts the voice into a digital signal and sends the digital signal to the control device 20;
the control device 20 receives the digital signal, converts the digital signal into a control signal through operation and sends the control signal to the execution device 21;
the executing device 21 receives the control signal sent by the control device 20, and sends a wake-up prompt to a user or executes corresponding control;
the radio-reception bone microphone 10 comprises a signal receiving part, an energy conversion part and a signal output part; the signal receiving part is arranged at the outer side of the sound-receiving bone microphone 10 and forms a part of the shell of the sound-receiving bone microphone 10;
the energy conversion part is respectively connected with the signal receiving part and the signal output part.
The sound receiving bone microphone 10 comprises a first microphone 101 and a second microphone 102; the first microphone 101 is arranged on one of the earplugs; the second microphone 102 is arranged in the middle of the host; the first microphone 101 and the second microphone 102 are in contact with the skin or the bones of the human body, respectively.
The earphone also comprises a third microphone 103, wherein the third microphone 103 is arranged on the other earplug and is in contact with the skin or the bone of the human body.
The sound-receiving microphone 10 is any one or more of an electrodynamic microphone, a condenser microphone, a piezoelectric microphone, an electromagnetic microphone, a carbon particle microphone, and a semiconductor microphone.
The control device 20 integrates a processing unit.
The processing unit is MTK 6580.
The execution means 21 comprise a speaker 210 and/or a screen 211.
A filter device is also arranged between the acoustic microphone processing device and the control device 20.
A signal conversion device is also arranged between the control device 20 and the execution device 21.
At least one battery pack 22 is also included, the battery pack 22 being connected to the control device 20 by a flexible cable.
The control device 20 also integrates an operating memory RAM.
The control device 20 is further integrated with a body memory space ROM or a body memory space ROM slot.
And the vibration sensor is electrically connected with the control device 20 through a flexible cable.
The digital signals of the sound receiving headset 10 include a first audio signal and a second audio signal.
The first audio signal is used for collecting voice information of a user by using the first microphone 101.
The second audio signal refers to the voice information of another position of the user within the time range of the first audio signal by using the second microphone 102.
A third audio signal is also included and speech information from a third location of the user is collected by a third microphone 103.
And the traditional microphone is also included, and the voice information of the user is collected through sound waves, wherein the voice information comprises environmental noise, the sound of the loudspeaker and the voice of the user.
The control device 20 further comprises the following sub-modules: the audio characteristic detection submodule is used for carrying out audio characteristic detection on the acquired audio signal; a main sound source judgment submodule for judging the main sound source; the master sound source compensation submodule is used for carrying out master sound source compensation; and the noise reduction submodule is used for eliminating noise.
The steps of audio characteristic detection are as follows: 1) extracting audio data with a frame length of 20ms, xi(n) and calculating the average energy EiZero crossing rate ZCRiShort time correlation RiAnd short-time cross-correlation Cij(k),
Wherein,2) according to said average energy EiThe zero crossing rate ZCRiThe short-time correlation RiAnd the short-time cross-correlation Cij(k) Calculating the non-silence probability of the current frameAnd probability of speech
Whereinis i channel max (E)i*ZCRi) Is determined by the empirical reference value of (a),is i channel max { max [ R ]i(k)]*max[Cij(k)]An empirical reference value. 3) The method for detecting the audio characteristics also comprises the step of detecting the non-silence probability of the current frame according to the i channelAnd the speech probabilityJudging the type of the current frame, namely whether the current frame is a noise frame, a voice frame or a noise-free environment voice frame,wherein,the method is an empirical value of relevant judgment, the Ambient sound frame without Noise is used as Ambient sound frame, Noise is used as Noise frame, and Speech is used as a voice frame. The dominant sound source determination submodule 232 determines the dominant sound source based on the current frameThe current frame extracted from that way is determined as the dominant sound source of the current position frame. The determination method comprises the following steps: 1) when one path is a Speech voice frame and the other path is an Ambient Noise-free environment voice frame or a Noise frame, determining the path as a main data path of the current position frame; 2) when one path is an Ambient Noise-free sound frame and the other path is a Noise frame, determining the path as a main data path of the current position frame; 3) when both paths are the same kind of frame, determiningThe channel with the largest value is used as the main data path of the current position frame. Main sound source compensation, after determining the main sound source of the current position frame, the compensation sub-module extracts effective data from another path to process the main sound sourceAnd (5) performing voice component compensation. The voice component compensation method comprises the following steps: 1) carrying out full-spectrum sub-band weighting superposition compensation in a frequency domain by utilizing effective audio data of different channels; 2) and carrying out spectrum copying operation by using the effective correlation characteristic of the low-frequency sub-band data to compensate the high-frequency sub-band data. And noise elimination, wherein the compensated audio data still contains a small amount of noise data, the noise reduction sub-module obtains noise spectrum characteristics according to noise frames related before and after the main data channel voice frame and effectively inhibits the noise spectrum components of the voice frame in a frequency domain, so that purer effective voice data is obtained. And outputting the signal, and pushing the finally generated effective voice data to the terminal equipment.
And importing main audio data, calling environment judgment data stored in a memory, comparing the main audio data with the environment judgment data, and determining the surrounding noise environment when the main audio is input. And calling the ambient noise data from the memory, and performing single-frame comparison with the main audio data. Audio data in a single frame of the main audio data that is identical to the ambient noise data is removed. Effective audio data without noise is generated.
For a better understanding of the present invention, the foregoing detailed description has been given in conjunction with specific embodiments thereof, but not with the intention of limiting the invention thereto. Any simple modifications of the above embodiments according to the technical essence of the present invention still fall within the scope of the technical solution of the present invention. In the present specification, each embodiment is described with emphasis on differences from other embodiments, and the same or similar parts between the respective embodiments may be referred to each other. For the system embodiment, since it basically corresponds to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The method and apparatus of the present invention may be implemented in a number of ways. For example, the methods and systems of the present invention may be implemented in software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order for the steps of the method is for illustrative purposes only, and the steps of the method of the present invention are not limited to the order specifically described above unless specifically indicated otherwise. Furthermore, in some embodiments, the present invention may also be embodied as a program recorded in a recording medium, the program including machine-readable instructions for implementing a method according to the present invention. Thus, the present invention also covers a recording medium storing a program for executing the method according to the present invention.
The description of the present invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to practitioners skilled in this art. The embodiment was chosen and described in order to best explain the principles of the invention and the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A bone microphone receiving processing device for a neck-worn voice interaction headset, comprising:
the device comprises a radio bone microphone, a control device and an execution device; it is characterized in that the preparation method is characterized in that,
the radio bone microphone is arranged on an earplug of the neck-wearing voice interaction earphone and/or a host;
the control device is arranged on the host;
the executing device is arranged on the earplug and/or the host;
the radio bone microphone is connected with the control device in a wired or wireless way;
the control device is connected with the execution device through a flexible cable;
the voice receiving bone microphone collects voice of a user, converts the voice into a digital signal and sends the digital signal to the control device;
the control device receives the digital signal, converts the digital signal into a control signal through operation and sends the control signal to the execution device;
the execution device receives the control signal sent by the control device and sends a wakeup prompt to a user or executes corresponding control;
the radio-reception bone microphone comprises a signal receiving part, an energy conversion part and a signal output part;
the signal receiving part is arranged on the outer side of the sound-receiving bone microphone and forms a part of a shell of the sound-receiving bone microphone;
the energy conversion part is respectively connected with the signal receiving part and the signal output part.
2. The bone microphone receiving processing device for a neck-worn voice interaction headset according to claim 1, wherein the bone microphone receiving comprises a first microphone and a second microphone; the first microphone is arranged on one of the earplugs; the second microphone is arranged in the middle of the host; the first microphone and the second microphone are respectively contacted with the skin or the bones of the human body.
3. The device as claimed in claim 2, further comprising a third microphone, the third microphone is disposed on another earplug, and the third microphone is in contact with human skin or bones.
4. The bone microphone sound processing device for a neck-worn voice interaction headset of claim 3, wherein the bone microphone for receiving sound is any one or more of an electrodynamic microphone, a capacitance microphone, a piezoelectric microphone, an electromagnetic microphone, a carbon particle microphone and a semiconductor microphone.
5. The device as claimed in claim 4, wherein the control device is integrated with the processing unit.
6. The device as claimed in claim 5, wherein the processing unit is MTK 6580.
7. The device as claimed in claim 6, wherein the execution device comprises a speaker and/or a screen.
8. The headset of claim 7, wherein a filter device is disposed between the headset and the control device.
9. The apparatus as claimed in claim 8, wherein a signal conversion device is provided between the control device and the actuator.
10. The bone microphone processing device for a neck-worn voice interaction headset according to claim 9, further comprising at least one battery pack, wherein the battery pack is connected with the control device through a flexible cable.
CN201711025968.XA 2017-10-27 2017-10-27 The bone wheat harvest sound processor of formula interactive voice earphone is worn for neck Pending CN109729457A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711025968.XA CN109729457A (en) 2017-10-27 2017-10-27 The bone wheat harvest sound processor of formula interactive voice earphone is worn for neck

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711025968.XA CN109729457A (en) 2017-10-27 2017-10-27 The bone wheat harvest sound processor of formula interactive voice earphone is worn for neck

Publications (1)

Publication Number Publication Date
CN109729457A true CN109729457A (en) 2019-05-07

Family

ID=66291025

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711025968.XA Pending CN109729457A (en) 2017-10-27 2017-10-27 The bone wheat harvest sound processor of formula interactive voice earphone is worn for neck

Country Status (1)

Country Link
CN (1) CN109729457A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102138337A (en) * 2008-08-13 2011-07-27 W·W·格雷林 Wearable headset with self-contained voice feedback and voice commands
CN102300140A (en) * 2011-08-10 2011-12-28 歌尔声学股份有限公司 Speech enhancing method and device of communication earphone and noise reduction communication earphone
CN105721973A (en) * 2016-01-26 2016-06-29 王泽玲 Bone conduction headset and audio processing method thereof
CN107071647A (en) * 2016-11-18 2017-08-18 北京金锐德路科技有限公司 A kind of sound collection method, system and device
CN207995324U (en) * 2017-10-27 2018-10-19 北京金锐德路科技有限公司 Neck wears formula interactive voice earphone

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102138337A (en) * 2008-08-13 2011-07-27 W·W·格雷林 Wearable headset with self-contained voice feedback and voice commands
CN102300140A (en) * 2011-08-10 2011-12-28 歌尔声学股份有限公司 Speech enhancing method and device of communication earphone and noise reduction communication earphone
CN105721973A (en) * 2016-01-26 2016-06-29 王泽玲 Bone conduction headset and audio processing method thereof
CN107071647A (en) * 2016-11-18 2017-08-18 北京金锐德路科技有限公司 A kind of sound collection method, system and device
CN207995324U (en) * 2017-10-27 2018-10-19 北京金锐德路科技有限公司 Neck wears formula interactive voice earphone

Similar Documents

Publication Publication Date Title
CN107071647B (en) A kind of sound collection method, system and device
EP3694229B1 (en) A hearing device comprising a noise reduction system
US9380374B2 (en) Hearing assistance systems configured to detect and provide protection to the user from harmful conditions
US9301057B2 (en) Hearing assistance system
CN103052012B (en) Automatic real-time hearing aid fitting based on auditory evoked potential
AU2010272769B2 (en) A hearing aid adapted for detecting brain waves and a method for adapting such a hearing aid
US20150319546A1 (en) Hearing Assistance System
US10176821B2 (en) Monaural intrusive speech intelligibility predictor unit, a hearing aid and a binaural hearing aid system
EP3934279A1 (en) Personalization of algorithm parameters of a hearing device
WO2016167877A1 (en) Hearing assistance systems configured to detect and provide protection to the user harmful conditions
US11589173B2 (en) Hearing aid comprising a record and replay function
EP3934278A1 (en) A hearing aid comprising binaural processing and a binaural hearing aid system
CN109729471A (en) The ANC denoising device of formula interactive voice earphone is worn for neck
US20240205615A1 (en) Hearing device comprising a speech intelligibility estimator
CN207995324U (en) Neck wears formula interactive voice earphone
CN207518800U (en) Neck wears formula interactive voice earphone
CN207518802U (en) Neck wears formula interactive voice earphone
CN109729454A (en) The sound wheat processing unit of formula interactive voice earphone is worn for neck
CN109729463A (en) The compound audio signal reception device of sound wheat bone wheat of formula interactive voice earphone is worn for neck
CN207518792U (en) Neck wears formula interactive voice earphone
CN109729457A (en) The bone wheat harvest sound processor of formula interactive voice earphone is worn for neck
CN207518791U (en) Neck wears formula interactive voice earphone
CN109729470A (en) The sound wheat harvest sound processor of formula interactive voice earphone is worn for neck
CN109729462A (en) The bone wheat processing unit of formula interactive voice earphone is worn for neck
CN109729472A (en) Neck wears exchange method, system and the device of formula interactive voice earphone

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190507