CN111105790A - Intelligent external device, intelligent sound box system and distributed reception method - Google Patents
Intelligent external device, intelligent sound box system and distributed reception method Download PDFInfo
- Publication number
- CN111105790A CN111105790A CN201811251368.XA CN201811251368A CN111105790A CN 111105790 A CN111105790 A CN 111105790A CN 201811251368 A CN201811251368 A CN 201811251368A CN 111105790 A CN111105790 A CN 111105790A
- Authority
- CN
- China
- Prior art keywords
- intelligent
- sound box
- voice
- information
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000005540 biological transmission Effects 0.000 claims abstract description 22
- 230000005236 sound signal Effects 0.000 claims description 44
- 230000002093 peripheral effect Effects 0.000 claims description 21
- 230000006698 induction Effects 0.000 claims description 10
- 238000010586 diagram Methods 0.000 description 12
- 230000003993 interaction Effects 0.000 description 12
- 238000005516 engineering process Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000002592 echocardiography Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000012535 impurity Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention provides an intelligent external device, an intelligent sound box system and a distributed reception method, wherein the intelligent external device comprises: the receiving module is configured to receive a voice instruction sent by a user; the transmission module is configured to send the voice instruction to the intelligent sound box, the intelligent sound box analyzes the voice instruction, executes the operation corresponding to the voice instruction and returns corresponding voice feedback information; and the playing module is configured to receive and play the voice feedback information. Based on the technical scheme provided by the invention, the problem that the user cannot communicate with the intelligent sound box due to the fact that the user is far away from the intelligent sound box in the prior art is solved, and the problem that the user cannot hear the voice feedback information of the intelligent sound box due to the fact that the user is far away from the intelligent sound box is further solved.
Description
Technical Field
The invention relates to the field of electronic equipment, in particular to intelligent external equipment, an intelligent sound box system and a distributed reception method.
Background
With the continuous improvement and development of modern science and technology, smart homes gradually occupy a place in the market and continuously increase the market share. For example, an intelligent sound box, an intelligent electric lamp, an intelligent refrigerator, an intelligent water heater, an intelligent television and the like all bring great convenience to the life of people. Among them, the smart speaker is gradually popular with users as a new product in recent years.
The distance that present intelligent audio amplifier mostly required and user can not exceed 6 meters, otherwise, the volume that the user was very difficult to normally speak awakens up intelligent audio amplifier, and the restraint of this kind of distance can't satisfy the demand that the user normally used intelligent audio amplifier under certain scene.
Disclosure of Invention
In view of the above problems, the present invention is proposed to provide an intelligent external device, an intelligent sound box system and a distributed sound receiving method, which overcome the above problems or at least partially solve the above problems, and can expand the voice interaction range of the intelligent sound box and the user.
According to an aspect of the present invention, there is provided an intelligent external device including:
the receiving module is configured to receive a voice instruction sent by a user;
the transmission module is configured to send the voice instruction to the intelligent sound box, the intelligent sound box analyzes the voice instruction, executes the operation corresponding to the voice instruction and returns corresponding voice feedback information;
and the playing module is configured to receive and play the voice feedback information.
Optionally, the receiving module is further configured to detect decibel information corresponding to the voice instruction;
the playing module is further configured to play the voice feedback information according to the decibel information.
Optionally, the intelligent external device further includes: and the human body induction module is configured to induce whether a human body exists in a specific range, and when the human body existence is detected, the human body induction module sends human body existence information to the intelligent sound box.
Optionally, the human body sensing module is further configured to sense a distance between a user who sends the voice command and the intelligent external device;
the playing module is further configured to determine decibel information for playing the voice feedback information according to the distance, and play the voice feedback information according to the decibel information.
Optionally, the intelligent external device further includes: and the heat source induction module is configured to induce heat source information in a specific range and send the heat source information to the intelligent sound box.
Optionally, the transmission module is further configured to directly send the voice instruction to the smart sound box in the form of an analog audio signal.
Optionally, the transmission module is further configured to convert the voice instruction from an analog audio signal to a digital audio signal, encrypt the digital audio signal, and send the encrypted digital audio signal to the smart sound box.
According to another aspect of the present invention, there is also provided a smart sound box system, comprising a smart sound box, a plurality of smart external devices according to any one of the above, the smart external devices being connected to the smart sound box, wherein,
the intelligent external equipment is configured to receive a voice instruction sent by a user and send the voice instruction to the intelligent sound box; receiving and playing voice feedback information returned by the intelligent sound box;
and the intelligent sound box is configured to analyze the voice command, execute the operation corresponding to the voice command and return the voice feedback information to the intelligent external equipment.
Optionally, the intelligent external device is further configured to sense whether a human body exists in a specific range, and send human body existence information to the intelligent sound box when the human body existence is detected; receiving and playing warning information returned by the intelligent sound box;
the intelligent sound box is further configured to return the warning information to the intelligent external device which sends the human body existence information when the human body existence information is received within a preset safety time period.
Optionally, the intelligent external device is further configured to detect decibel information of the voice instruction, and send the decibel information to the intelligent sound box;
the intelligent sound box is further configured to determine the maximum decibel information according to the received multiple decibel information, and return the voice feedback information to the intelligent external device which sends the maximum decibel information to play.
Optionally, the intelligent external device is further configured to sense heat source information within a specific range, and send the heat source information to the intelligent sound box;
the intelligent sound box is further configured to determine the maximum heat source information according to the received multiple pieces of heat source information, and return the voice feedback information to the intelligent external device which sends the maximum heat source information for playing.
Optionally, the smart speaker is further configured to parse the voice instruction, determine whether the voice instruction specifies a specific smart external device to play the voice feedback information, and return the voice feedback information to the specific smart external device to play if the voice instruction specifies the specific smart external device to play the voice feedback information.
Optionally, the intelligent external device is connected with the intelligent sound box through WiFi, bluetooth or infrared.
According to still another aspect of the present invention, there is provided a distributed sound receiving method applied to any one of the above intelligent peripheral devices, including:
receiving a voice instruction sent by a user;
sending the voice instruction to an intelligent sound box, analyzing the voice instruction by the intelligent sound box, executing the operation corresponding to the voice instruction, and returning corresponding voice feedback information;
and receiving and playing the voice feedback information.
Optionally, the distributed sound reception method further includes:
detecting decibel information corresponding to the voice instruction;
and playing the voice feedback information according to the decibel information.
Optionally, the distributed sound reception method further includes:
whether a human body exists in the specific range is sensed, and when the human body exists, human body existence information is sent to the intelligent sound box.
Optionally, the distributed sound reception method further includes:
sensing a distance to a user who issued the voice command;
and determining decibel information for playing the voice feedback information according to the distance, and playing the voice feedback information according to the decibel information.
Optionally, the distributed sound reception method further includes:
and sensing heat source information in a specific range, and sending the heat source information to the intelligent sound box.
Optionally, sending the voice command to a smart speaker, including:
and directly sending the voice instruction to the intelligent sound box in the form of an analog audio signal.
Optionally, sending the voice command to a smart speaker, including:
and converting the voice command from an analog audio signal into a digital audio signal, encrypting the digital audio signal, and sending the encrypted digital audio signal to the intelligent sound box.
The invention provides intelligent external equipment, an intelligent sound box system and a distributed sound receiving method. The technical scheme provided by the invention solves the problem that the user cannot communicate with the intelligent sound box due to the fact that the user is far away from the intelligent sound box in the prior art, and further solves the problem that the user cannot hear the voice feedback information of the intelligent sound box due to the fact that the user is far away from the intelligent sound box.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
The above and other objects, advantages and features of the present invention will become more apparent to those skilled in the art from the following detailed description of specific embodiments thereof, taken in conjunction with the accompanying drawings.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the alternative embodiments. The drawings are only for purposes of illustrating alternative embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
FIG. 1 is a functional block diagram of an intelligent peripheral according to one embodiment of the present invention;
FIG. 2 is a functional block diagram of an intelligent peripheral in accordance with a preferred embodiment of the present invention;
FIG. 3 is a functional block diagram of an intelligent peripheral according to another preferred embodiment of the present invention;
FIG. 4 is a schematic diagram of a framework of a smart sound box system according to one embodiment of the invention;
FIG. 5 is a schematic diagram of an interaction of an intelligent peripheral with a smart sound box according to one embodiment of the invention;
FIG. 6 is a flow chart illustrating a distributed reception method according to an embodiment of the present invention;
FIG. 7 is a flow chart diagram of a distributed sound reception method according to a preferred embodiment of the present invention;
fig. 8 is a flow chart of a distributed sound reception method according to another preferred embodiment of the invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It should be noted that the technical features of the embodiments and the preferred embodiments of the present invention can be combined with each other without conflict.
In order to solve the problems that a user cannot communicate with the intelligent sound box and cannot hear voice feedback information of the intelligent sound box due to the fact that the user is far away from the intelligent sound box in the prior art, the embodiment of the invention provides the intelligent external device which can transmit a voice instruction of the user to the intelligent sound box and play the voice feedback information of the voice instruction of the intelligent sound box to the user under the condition that the intelligent sound box is far away from the user.
Fig. 1 is a functional block diagram of an intelligent external device according to an embodiment of the present invention, and as shown in fig. 1, an intelligent external device 100 according to the present embodiment includes:
a receiving module 120 configured to receive a voice instruction sent by a user;
the transmission module 140 is coupled to the receiving module 120, and configured to send the voice instruction to the smart speaker, analyze the voice instruction by the smart speaker, execute an operation corresponding to the voice instruction, and return corresponding voice feedback information;
the playing module 160 is coupled to the transmission module 140 and configured to receive and play the voice feedback information.
The intelligent external device 100 provided by the embodiment of the invention is specially used for being arranged at a place far away from the intelligent sound box to receive sound for the intelligent sound box, the intelligent external device 100 sends the received voice instruction of the user to the intelligent sound box, the intelligent sound box analyzes the voice instruction, the operation corresponding to the voice instruction is executed, and meanwhile, corresponding voice feedback information is returned. The technical scheme provided by the embodiment of the invention solves the problem that the communication between the user and the intelligent sound box is not possible due to the long distance, and meanwhile, the voice feedback information is received and played by the intelligent external equipment 100, and the problem that the user cannot hear the voice feedback information of the intelligent sound box due to the long distance is further solved.
In a specific implementation, the receiving module 120 may be implemented based on a microphone or other device with similar functions, and the playing module 160 may be implemented based on a speaker or other device with similar functions.
It should be noted that the voice feedback information includes a wide range, including the voice feedback from the smart speaker itself, and the audio result from executing the voice command, such as the audio information of the played music, the played speech, etc., which can be played by the smart external device 100.
In a preferred embodiment of the present invention, the receiving module 120 may be further configured to detect decibel information corresponding to a voice instruction after receiving the voice instruction sent by a user. After the transmission module 140 sends the voice command to the smart speaker, the smart speaker analyzes the voice command, executes an operation corresponding to the voice command, and returns corresponding voice feedback information, and the playing module 120 may be further configured to play the voice feedback information according to the decibel information.
In the preferred embodiment, an optional intelligent function is provided, that is, the intelligent external device 100 is set to use the voice command provided by the user as a standard, and play the voice feedback information returned by the intelligent sound box with the same decibel information or volume, so that a very comfortable conversation environment can be provided for the user, and it is avoided that the user sets the volume of the intelligent sound box too large or too small before, which results in unexpected high volume or low volume, and brings a bad use experience to the user.
For example, the smart external device 100 is located in a living room where multiple people exist, the smart speaker is located in the main lying room, at this time, the user wants to start the smart speaker, the user sends a voice instruction of "xx (speaker name), hello" to the smart external device 100, the smart external device 100 sends the voice instruction to the smart speaker in the main lying room, and the smart speaker parses the voice instruction and generates corresponding voice feedback information, that is, "hello, i am". Under the circumstance, if the intelligent external device 100 does not detect the decibel information for sending the voice command, the intelligent external device cannot play the voice feedback information of the intelligent sound box to the voice command according to the decibel information, and the intelligent external device can take the decibel information replied last time as a reference, which may cause a problem that the sound of the intelligent external device 100 when playing the voice feedback information is very loud, and can disturb other people, or the sound is very loud, and can be heard by the user with the attention of the user. Based on the technical scheme provided by the preferred embodiment, the user can obtain the voice feedback information corresponding to the decibel information when the user sends the voice instruction, so that the user can send the voice instruction with certain decibel information according to the requirement of the user, the embarrassment condition possibly caused by the user is effectively avoided, and the user experience is improved.
Fig. 2 is a functional block diagram of an intelligent external device according to a preferred embodiment of the present invention, and as shown in fig. 2, the intelligent external device 100 may further include a human body sensing module 110, coupled to the transmission module 140, configured to sense whether a human body exists in a specific range, and send human body presence information to the intelligent speaker upon detecting the presence of the human body.
In this preferred embodiment, the human body sensing function can be realized by an ultrasonic sensing technology, the human body sensing module 110 can continuously emit ultrasonic waves, the ultrasonic waves can generate significant reflection when encountering impurities or interfaces to form reflected echoes, and when encountering a moving object, the ultrasonic waves can generate a doppler effect, and based on the above physical characteristics, the human body sensing module 110 can sense whether a human body exists in a specific range, and can also determine the distance between the human body and the human body according to the change of the ultrasonic waves. It should be noted that other human body sensing technologies capable of implementing the above functions can be used herein, and the present invention is not limited thereto.
In a preferred embodiment of the present invention, the human body sensing module 110 may be further configured to sense and send a distance between a user and the intelligent external device 100; the playing module 160 may be further configured to determine decibel information of the played voice feedback information according to the distance, and play the voice feedback information according to the decibel information.
In the preferred embodiment, another optional intelligent function is provided, that is, the intelligent external device 100 may determine decibel information for playing the voice feedback information according to a distance from a user who issues a voice instruction, and play the voice feedback information according to the decibel information. Here, the correspondence between the distance from the user who has issued the voice instruction and the decibel information of the played voice feedback information may be set in advance, and this correspondence is one-to-one, and the larger the distance value is, the larger the decibel value is. Therefore, the user requirements when the user is far away from the intelligent sound box can be adapted to, and the situations that the user cannot hear the corresponding voice feedback information due to the fact that the user is far away from the intelligent external device 100, the decibel information of the voice received by the intelligent external device 100 is small, the decibel information of the voice feedback information is small and the user cannot hear the corresponding voice feedback information are avoided.
For example, the distance between the intelligent external device 100 and the user is detected to be 8 meters, at this time, the user sends a voice command with decibel information of 60 decibels, the voice command with 30 decibels is received by the intelligent external device 100 due to the distance, if the intelligent external device 100 also plays the voice feedback information with 30 decibels, the user cannot hear or cannot hear the voice feedback information, and according to the technical scheme provided by this embodiment, the intelligent external device 100 can determine that the distance is corresponding to 8 meters by 60 decibels according to the preset corresponding relationship between the distance and the decibel information, and further determine to play the voice feedback information with 60 decibels, so that the remote user can hear the corresponding voice feedback information clearly, and user experience is greatly improved.
Fig. 3 is a functional block diagram of an intelligent external device according to another preferred embodiment, and as shown in fig. 3, the intelligent external device 100 may further include: and the heat source sensing module 130 is coupled with the transmission module 140, and is configured to sense heat source information within a specific range and send the heat source information to the smart sound box.
In the preferred embodiment, the heat source sensing function may be implemented by an infrared sensor, and in fact, a common human body may emit infrared rays with a specific wavelength of about 10um, and after the infrared rays of the human body irradiate the sensor, the intelligent external device 100 may sense the existence and position of the human body. It should be noted that other heat source induction technologies capable of achieving the above functions can be used herein, and the present invention is not limited thereto.
Optionally, the transmission module 140 may be configured to directly send the voice instruction to the smart sound box in the form of an analog audio signal, and the smart sound box automatically analyzes the analog audio signal; optionally, the transmission module 140 may also be configured to convert the voice instruction from the analog audio signal to a digital audio signal, encrypt the digital audio signal, and then send the encrypted digital audio signal to the smart sound box.
In a specific implementation, the transmission module 140 may be configured to directly send the voice instruction to the smart speaker in the form of an analog audio signal, so that the implementation is easier, and the wireless communication technology of the analog audio signal is mature nowadays, for example, the intercom technology, and can be conveniently applied to the technical scheme provided by the present invention. However, the mode of transmitting the analog audio signal has a certain risk in terms of information security, that is, the analog audio signal is easily intercepted. Therefore, if there is a high requirement on information security, the transmission module 140 may be configured to convert the voice command from the analog audio signal to the digital audio signal, encrypt the digital audio signal, and send the encrypted digital audio signal to the smart speaker, so that information security is guaranteed.
Based on the above-mentioned intelligent external device 100, the embodiment of the present invention further provides an intelligent sound box system. Fig. 4 is a schematic structural diagram of a smart sound box system according to an embodiment of the present invention. As shown in fig. 4, the smart speaker system in this embodiment includes: a plurality of the above-mentioned smart peripherals 100, smart speakers 200, and smart peripherals 100 connected (wired or wireless) to smart speakers 200, wherein
The intelligent external device 100 is configured to receive a voice instruction sent by a user and send the voice instruction to the intelligent sound box 200; receiving and playing voice feedback information returned by the intelligent sound box 200;
and the smart sound box 200 is configured to parse the voice instruction, execute an operation corresponding to the voice instruction, and return voice feedback information to the smart external device 100.
The embodiment provides an intelligent sound box system, wherein the intelligent external device 100 is specially used for being arranged at a place far away from the intelligent sound box 200 for receiving sound for the intelligent sound box 200, the intelligent external device 100 sends the received voice instruction of the user to the intelligent sound box 200, the intelligent sound box 200 analyzes the voice instruction, executes the operation corresponding to the voice instruction, and returns corresponding voice feedback information to the intelligent external device 100 for playing. This scheme of implementing provides has originally solved among the prior art because the user that the user leads to far away with intelligent audio amplifier can't communicate with intelligent audio amplifier, has further solved because the user that the user leads to far away with intelligent audio amplifier can't hear the problem of intelligent audio amplifier's voice feedback information.
In a preferred embodiment, the smart external device 100 may be further configured to sense whether a human body exists within a specific range, and transmit human body existence information to the smart sound box 200 when the human body existence is detected; receiving and playing the warning information returned by the intelligent sound box 200; smart sound box 200 may be further configured to return a warning message to smart external device 100 that transmitted the human presence information when the human presence information is received within a preset safety time period.
In the preferred embodiment, a home security scheme is provided based on the human detection function of the smart peripheral 100. The safe time period herein refers to a time period in which no person is in the room determined and set by the user. If the intelligent sound box 200 receives the human body existence information within the safety time period, the fact that the room enters a stranger is proved, at the moment, the intelligent sound box 200 returns warning information to the intelligent external device 100 which sends the information according to the received human body existence information, the warning information is played by the intelligent external device 100, the effect of frightening the stranger can be achieved, and therefore the personal safety and property safety of the user are guaranteed.
For example, before the user goes to work in the morning, a safe time period from nine am to five pm is set, ten am, the intelligent external device 100 located in the living room senses the existence of a human body, and then proves that a stranger comes from home, the intelligent external device 100 transmits the information to the intelligent sound box 200, the intelligent sound box 200 returns preset warning information to the intelligent external device 100 according to the information, and the warning information may be: the intruder, i have alarmed, or similar voice, can play a role of frightening the intruder by playing the warning information.
In a preferred embodiment, the intelligent external device 100 may be further configured to detect decibel information of the voice command, and send the decibel information to the intelligent sound box 200; the smart sound box 200 may be further configured to determine the maximum decibel information according to the received multiple decibel information, and return the voice feedback information to the smart external device 100 that sent the maximum decibel information for playing.
The technical solution provided in this preferred embodiment is mainly directed to a situation where multiple intelligent external devices 100 are configured for one intelligent sound box 200, and at this time, there may be a situation where a voice instruction sent by a user can be received by multiple intelligent external devices 100, and in order to avoid a situation where multiple intelligent external devices 100 all play voice feedback information, the intelligent sound box 200 may determine the highest decibel information therein, and only return the voice feedback information to the intelligent external device 100 that has sent the largest decibel information to play.
Fig. 5 is a schematic diagram of interaction between the smart external device and the smart speaker according to an embodiment of the present invention, as shown in fig. 5, an external rectangle is a home of a user, and a dotted circle represents an effective interaction range, where the smart speaker, the smart external device a, and the smart external device B all have their own effective interaction ranges, for example, the effective interaction range of the smart external device A, B is 5 meters. In the figure, the voice instruction sent by the user a can be directly received by the smart speaker within the effective interaction range of the smart speaker. User B, C is not in the effective interaction range of intelligent audio amplifier, can't directly communicate with intelligent audio amplifier, user B is in the voice interaction range of intelligent external equipment A, can receive user B's voice command by intelligent external equipment A, send user B's voice command to intelligent audio amplifier by intelligent external equipment A, intelligent audio amplifier can send voice feedback information to corresponding intelligent external equipment according to user B's voice command and play corresponding voice feedback information by intelligent external equipment, also can directly play voice feedback information. Similarly, the user C is in the voice interaction range of the intelligent external device B, the intelligent external device B can receive the voice instruction of the user C, the intelligent external device B can send the voice instruction of the user C to the intelligent sound box, and the intelligent sound box can send the voice feedback information to the corresponding intelligent external device according to the instruction of the user and play the corresponding voice feedback information by the intelligent external device, or directly play the voice feedback information.
According to the above embodiment, when the effective interaction ranges of the plurality of intelligent external devices 100 intersect with each other, and the user happens to be at the intersection and starts to send the voice command, because the plurality of intelligent external devices 100 can receive the voice command of the user at this time, if each intelligent external device 100 sends the command to the intelligent sound box 200, and the intelligent sound box 200 also sends the same voice feedback information to the plurality of intelligent external devices 100 according to each received voice command, the user may hear repeated voice feedback information within a certain period of time, and such a use experience is very bad.
For example, the smart speaker 200 is located in the main bedroom, the smart external device a and the smart external device B are placed in the living room, and at this time, the user sends a voice command in the living room, and the voice command can be received by the smart external device a or the smart external device B. Assuming that the voice information sent by the user in the living room is 50 decibels, the known voice instruction has a certain decibel loss in the transmission process, in this example, the intelligent external device a is closer to the user, the intelligent external device a loses 10 decibels in the transmission process, and the intelligent external device a finally receives the voice instruction of 40 decibels. The distance between the intelligent external equipment B and the user is far, 20 decibels are lost in the transmission process, and the intelligent external equipment B finally receives a 30 decibel voice command. In view of the above situation, when receiving the voice command and the decibel information of the intelligent external device A, B, the intelligent sound box 200 first determines the maximum decibel information from the decibel information of the voice commands, that is, determines that the decibel information of the voice command sent by the intelligent external device a is the maximum decibel information, and then sends the voice feedback information to the intelligent external device a for playing.
In a preferred embodiment, smart external device 100 may be further configured to sense heat source information within a specific range and transmit the heat source information to smart sound box 200; smart sound box 200 is further configured to determine the maximum heat source information according to the received multiple pieces of heat source information, and return the voice feedback information to smart external device 100 that sent the maximum heat source information for playing.
In the preferred embodiment, the smart sound box 200 may determine the maximum heat source information according to the received heat source information, and return the voice feedback information to the smart external device 100 that has sent the maximum heat source information for playing, so as to meet the user's needs in some specific scenarios.
For example, user a is located in a kitchen provided with intelligent external device a, intelligent sound box 200 is located in a living room, friends of user a are located in a main bed provided with intelligent external device B, where intelligent external device A, B sends sensed heat source information within a specific range to intelligent sound box 200, at this time, user a wants to play a piece of music for his friends, after receiving a voice command "please play a" jiangnan "for my friends" sent by user a, intelligent external device a sends the voice command to intelligent sound box 200, after receiving and analyzing the voice command, intelligent sound box 200 determines which received heat source information sent by intelligent external device a and intelligent external device B is large, and finally determines that the heat source information sent by intelligent external device B is large, that is, there are many people within the specific range of intelligent external device B, thus, the voice feedback information (audio of song "Jiangnan") is sent to the intelligent external device B, and the music is played by the intelligent external device B.
Preferably, the smart sound box 200 may be further configured to parse the received voice command, determine whether the voice command specifies a specific smart external device 100 to play the voice feedback information, and if the voice command specifies the specific smart external device 100 to play the voice feedback information, return the voice feedback information to the specific smart external device 100 to play.
The scheme provided by the preferred embodiment further provides an intelligent function, and in the case that a plurality of intelligent external devices 100 are configured for one intelligent sound box 200, different names can be set for each intelligent external device 100, so that a specific intelligent external device 100 can be specified to play voice feedback information. For example, a user a is in a main bed in which an intelligent external device a is placed, a user B is in a secondary bed in which an intelligent external device B is placed, the intelligent sound box 200 is located in a living room, at this time, the user a wants to play a song for the user B, the user a sends a voice instruction of "play" from the intelligent external device B to the intelligent external device a, the intelligent sound box 200, after receiving the voice instruction of the user a, analyzes the content included in the voice instruction, determines the play content and the play object, namely, plays "south of the river" from the intelligent external device B, and then returns corresponding voice feedback information (audio of the song "south of the river") to the intelligent external device B to play, so that the user B can hear the song played by the user a for him.
In the above embodiment, the smart external device 100 and the smart sound box 200 may be connected through WiFi, bluetooth, infrared, or wired connection, and the invention is not limited in particular.
The intelligent sound box system composed of the intelligent external device 100 and the intelligent sound box 200 provided by the embodiment can effectively expand the voice interaction range of the user and the intelligent sound box, and meanwhile, a plurality of intelligent settings are added based on the intelligent sound box system, so that the user experience is greatly improved. Based on the intelligent external device and the intelligent sound box system provided by the embodiments, based on the same inventive concept, the embodiment of the invention provides a distributed sound receiving method, which is applied to the intelligent external device.
Fig. 6 shows a distributed sound reception method according to an embodiment of the present invention, and as shown in fig. 6, the distributed sound reception method includes:
step S602: receiving a voice instruction sent by a user;
step S604: sending the voice instruction to the intelligent sound box, analyzing the voice instruction by the intelligent sound box, executing the operation corresponding to the voice instruction, and returning corresponding voice feedback information;
step S606: and receiving and playing the voice feedback information.
In the technical scheme provided by the embodiment of the invention, the intelligent external equipment is specially used for remote reception, after receiving the voice command of the user, the intelligent external equipment sends the voice command of the user to the intelligent sound box, the intelligent sound box analyzes the voice command, executes the operation corresponding to the voice command and returns corresponding voice feedback information. The technical scheme provided by the embodiment of the invention solves the problem that the communication between the user and the intelligent sound box is not possible due to the long distance, and in addition, the voice feedback information is received and played by the intelligent external equipment, so that the problem that the user cannot hear the voice feedback information of the intelligent sound box due to the long distance is further solved.
Fig. 7 is a flow chart diagram of a distributed sound reception method according to a preferred embodiment of the invention. As shown in fig. 7, the distributed sound reception method according to a preferred embodiment of the present invention includes:
step S702, receiving a voice instruction sent by a user;
step S704, detecting decibel information corresponding to the voice command;
step S706, sending the voice instruction to the intelligent sound box, analyzing the voice instruction by the intelligent sound box, executing the operation corresponding to the voice instruction, and returning corresponding voice feedback information;
step S708, receiving the voice feedback information, and playing the voice feedback information according to the decibel information.
In an optional embodiment, the method further comprises: whether a human body exists in the specific range is sensed, and when the human body exists, human body existence information is sent to the intelligent sound box.
Fig. 8 is a flow chart of a distributed sound reception method according to another preferred embodiment of the invention. As shown in fig. 8, a distributed sound reception method according to another preferred embodiment of the present invention includes:
step S802, receiving a voice command sent by a user;
step S804, sensing the distance between the user and the user who sends the voice command;
step S806, sending the voice instruction to the intelligent sound box, analyzing the voice instruction by the intelligent sound box, executing the operation corresponding to the voice instruction, and returning corresponding voice feedback information;
step S808, determining decibel information of the played voice feedback information according to the distance, and playing the voice feedback information according to the decibel information.
In an optional embodiment, the method further comprises: and sensing heat source information in a specific range, and sending the heat source information to the intelligent sound box.
Optionally, in step S806, the voice instruction may be directly sent to the smart speaker in the form of an analog audio signal, or the voice instruction may be first converted from the analog audio signal to a digital audio signal, and the digital audio signal is encrypted, and then the encrypted digital audio signal is sent to the smart speaker.
The embodiment of the invention provides intelligent external equipment, an intelligent sound box system and a distributed sound receiving method. According to the scheme, the problem that communication cannot be achieved due to the fact that the distance between the user and the intelligent sound box is long is solved, the voice feedback information is received and played by the intelligent external equipment, and the problem that the user cannot hear the voice feedback information of the intelligent sound box due to the fact that the distance is long is solved. Based on the intelligent sound box system, the embodiment of the invention also provides a plurality of intelligent settings, so that the intelligent external equipment can play the voice feedback information according to the volume of the voice instruction of the user or the distance from the user, the user can also specify the specific intelligent external equipment to play the voice feedback information through the voice instruction, and the intelligent external equipment can also realize the household safety guarantee and the identification and the response of specific life scenes. The intelligent settings fully consider the use habits and scenes of the user, and improve the user experience.
In the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.
Thus, it should be appreciated by those skilled in the art that while a number of exemplary embodiments of the invention have been illustrated and described in detail herein, many other variations or modifications consistent with the principles of the invention may be directly determined or derived from the disclosure of the present invention without departing from the spirit and scope of the invention. Accordingly, the scope of the invention should be understood and interpreted to cover all such other variations or modifications.
According to an aspect of an embodiment of the present invention, there is provided a1. an intelligent external device, including:
the receiving module is configured to receive a voice instruction sent by a user;
the transmission module is configured to send the voice instruction to the intelligent sound box, the intelligent sound box analyzes the voice instruction, executes the operation corresponding to the voice instruction and returns corresponding voice feedback information;
and the playing module is configured to receive and play the voice feedback information.
A2. The intelligent peripheral of a1, wherein,
the receiving module is also configured to detect decibel information corresponding to the voice instruction;
the playing module is further configured to play the voice feedback information according to the decibel information.
A3. The intelligent external device according to a1, further comprising:
and the human body induction module is configured to induce whether a human body exists in a specific range, and when the human body existence is detected, the human body induction module sends human body existence information to the intelligent sound box.
A4. The intelligent peripheral of the a3 module, wherein,
the human body sensing module is also configured to sense and send the distance between the user sending the voice command and the intelligent external equipment;
the playing module is further configured to determine decibel information for playing the voice feedback information according to the distance, and play the voice feedback information according to the decibel information.
A5. The intelligent external device of any of A1-A4, further comprising:
and the heat source induction module is configured to induce heat source information in a specific range and send the heat source information to the intelligent sound box.
A6. The intelligent peripheral of any of A1-A4, wherein,
the transmission module is also configured to directly send the voice instruction to the intelligent sound box in the form of an analog audio signal.
A7. The intelligent peripheral of any of A1-A4, wherein,
the transmission module is further configured to convert the voice instruction from an analog audio signal to a digital audio signal, encrypt the digital audio signal, and send the encrypted digital audio signal to the smart sound box.
According to another aspect of the embodiments of the present invention, there is also provided B8. a smart sound box system, including a smart sound box, a plurality of smart external devices according to any one of a1-a7, the smart external devices being connected to the smart sound box, wherein,
the intelligent external equipment is configured to receive a voice instruction sent by a user and send the voice instruction to the intelligent sound box; receiving and playing voice feedback information returned by the intelligent sound box;
and the intelligent sound box is configured to analyze the voice command, execute the operation corresponding to the voice command and return the voice feedback information to the intelligent external equipment.
B9. The smart sound box system of B8, wherein,
the intelligent external equipment is also configured to sense whether a human body exists in a specific range, and when the human body exists, the human body existence information is sent to the intelligent sound box; receiving and playing warning information returned by the intelligent sound box;
the intelligent sound box is further configured to return the warning information to the intelligent external device which sends the human body existence information when the human body existence information is received within a preset safety time period.
B10. The smart sound box system of B8, wherein,
the intelligent external equipment is also configured to detect decibel information of the voice instruction and send the decibel information to the intelligent sound box;
the intelligent sound box is further configured to determine the maximum decibel information according to the received multiple decibel information, and return the voice feedback information to the intelligent external device which sends the maximum decibel information to play.
B11. The smart sound box system of B8, wherein,
the intelligent external device is also configured to sense heat source information within a specific range and send the heat source information to the intelligent sound box;
the intelligent sound box is further configured to determine the maximum heat source information according to the received multiple pieces of heat source information, and return the voice feedback information to the intelligent external device which sends the maximum heat source information for playing.
B12. The smart sound box system of any one of B9-B11, wherein,
the intelligent sound box is further configured to analyze the voice instruction, determine whether the voice instruction specifies a specific intelligent external device to play the voice feedback information, and return the voice feedback information to the specific intelligent external device to play if the voice instruction specifies the specific intelligent external device to play the voice feedback information.
B13. The distributed sound reception system according to any one of B9-B11, wherein the smart external device and the smart speaker are connected through WiFi, Bluetooth or infrared.
According to still another aspect of the embodiments of the present invention, there is further provided a c14. a distributed sound receiving method applied to any one of the intelligent peripheral devices a1-a7, including:
receiving a voice instruction sent by a user;
sending the voice instruction to an intelligent sound box, analyzing the voice instruction by the intelligent sound box, executing the operation corresponding to the voice instruction, and returning corresponding voice feedback information;
and receiving and playing the voice feedback information.
C15. The distributed sound reception method according to C14, further comprising:
detecting decibel information corresponding to the voice instruction;
and playing the voice feedback information according to the decibel information.
C16. The distributed sound reception method according to C14, further comprising:
whether a human body exists in the specific range is sensed, and when the human body exists, human body existence information is sent to the intelligent sound box.
C17. The distributed sound reception method according to C14, further comprising:
sensing a distance to a user who issued the voice command;
and determining decibel information for playing the voice feedback information according to the distance, and playing the voice feedback information according to the decibel information.
C18. The distributed sound reception method according to C14, further comprising:
and sensing heat source information in a specific range, and sending the heat source information to the intelligent sound box.
C19 the distributed sound reception method according to any one of C14-C18, wherein the sending the voice command to a smart sound box comprises:
and directly sending the voice instruction to the intelligent sound box in the form of an analog audio signal.
C20. The distributed sound reception method according to any one of C14-C18, wherein sending the voice command to a smart speaker comprises:
and converting the voice command from an analog audio signal into a digital audio signal, encrypting the digital audio signal, and sending the encrypted digital audio signal to the intelligent sound box.
Claims (10)
1. An intelligent peripheral comprising:
the receiving module is configured to receive a voice instruction sent by a user;
the transmission module is configured to send the voice instruction to the intelligent sound box, the intelligent sound box analyzes the voice instruction, executes the operation corresponding to the voice instruction and returns corresponding voice feedback information;
and the playing module is configured to receive and play the voice feedback information.
2. The intelligent peripheral of claim 1,
the receiving module is also configured to detect decibel information corresponding to the voice instruction;
the playing module is further configured to play the voice feedback information according to the decibel information.
3. The intelligent peripheral of claim 1, further comprising:
and the human body induction module is configured to induce whether a human body exists in a specific range, and when the human body existence is detected, the human body induction module sends human body existence information to the intelligent sound box.
4. The intelligent peripheral of claim 3,
the human body sensing module is also configured to sense and send the distance between the user sending the voice command and the intelligent external equipment;
the playing module is further configured to determine decibel information for playing the voice feedback information according to the distance, and play the voice feedback information according to the decibel information.
5. The intelligent peripheral of any of claims 1-4, further comprising:
and the heat source induction module is configured to induce heat source information in a specific range and send the heat source information to the intelligent sound box.
6. The intelligent external device of any one of claims 1-4,
the transmission module is also configured to directly send the voice instruction to the intelligent sound box in the form of an analog audio signal.
7. The intelligent external device of any one of claims 1-4,
the transmission module is further configured to convert the voice instruction from an analog audio signal to a digital audio signal, encrypt the digital audio signal, and send the encrypted digital audio signal to the smart sound box.
8. A smart loudspeaker system comprising a smart loudspeaker, a plurality of smart peripherals according to any one of claims 1 to 7, said smart peripherals being connected to said smart loudspeaker, wherein,
the intelligent external equipment is configured to receive a voice instruction sent by a user and send the voice instruction to the intelligent sound box; receiving and playing voice feedback information returned by the intelligent sound box;
and the intelligent sound box is configured to analyze the voice command, execute the operation corresponding to the voice command and return the voice feedback information to the intelligent external equipment.
9. The smart sound box system of claim 8,
the intelligent external equipment is also configured to sense whether a human body exists in a specific range, and when the human body exists, the human body existence information is sent to the intelligent sound box; receiving and playing warning information returned by the intelligent sound box;
the intelligent sound box is further configured to return the warning information to the intelligent external device which sends the human body existence information when the human body existence information is received within a preset safety time period.
10. A distributed sound reception method applied to the intelligent peripheral of any one of claims 1 to 7, comprising:
receiving a voice instruction sent by a user;
sending the voice instruction to an intelligent sound box, analyzing the voice instruction by the intelligent sound box, executing the operation corresponding to the voice instruction, and returning corresponding voice feedback information;
and receiving and playing the voice feedback information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811251368.XA CN111105790B (en) | 2018-10-25 | 2018-10-25 | Intelligent external device, intelligent sound box system and distributed reception method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811251368.XA CN111105790B (en) | 2018-10-25 | 2018-10-25 | Intelligent external device, intelligent sound box system and distributed reception method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111105790A true CN111105790A (en) | 2020-05-05 |
| CN111105790B CN111105790B (en) | 2023-03-14 |
Family
ID=70417666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811251368.XA Active CN111105790B (en) | 2018-10-25 | 2018-10-25 | Intelligent external device, intelligent sound box system and distributed reception method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111105790B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111601193A (en) * | 2020-05-11 | 2020-08-28 | 长沙胖胖智能科技有限公司 | Whole-house control system based on intelligent sound and control method thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN206431768U (en) * | 2017-01-16 | 2017-08-22 | 上海智臻智能网络科技股份有限公司 | Intelligent household central control equipment and system with human body sensing |
| US20180060024A1 (en) * | 2016-08-26 | 2018-03-01 | Shenzhen Xinguodu Technology Co., Ltd | Intelligent switch and intelligent home system using the same |
| CN108012113A (en) * | 2017-11-07 | 2018-05-08 | 广州德为信息技术有限公司 | A kind of remotely intelligently monitoring method and system |
| CN108198550A (en) * | 2017-12-29 | 2018-06-22 | 江苏惠通集团有限责任公司 | A kind of voice collecting terminal and system |
| CN108398887A (en) * | 2018-02-24 | 2018-08-14 | 郑州森源新能源科技有限公司 | A kind of smart home distributed sound control method and system |
| CN108469966A (en) * | 2018-03-21 | 2018-08-31 | 北京金山安全软件有限公司 | Voice broadcast control method and device, intelligent device and medium |
-
2018
- 2018-10-25 CN CN201811251368.XA patent/CN111105790B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180060024A1 (en) * | 2016-08-26 | 2018-03-01 | Shenzhen Xinguodu Technology Co., Ltd | Intelligent switch and intelligent home system using the same |
| CN206431768U (en) * | 2017-01-16 | 2017-08-22 | 上海智臻智能网络科技股份有限公司 | Intelligent household central control equipment and system with human body sensing |
| CN108012113A (en) * | 2017-11-07 | 2018-05-08 | 广州德为信息技术有限公司 | A kind of remotely intelligently monitoring method and system |
| CN108198550A (en) * | 2017-12-29 | 2018-06-22 | 江苏惠通集团有限责任公司 | A kind of voice collecting terminal and system |
| CN108398887A (en) * | 2018-02-24 | 2018-08-14 | 郑州森源新能源科技有限公司 | A kind of smart home distributed sound control method and system |
| CN108469966A (en) * | 2018-03-21 | 2018-08-31 | 北京金山安全软件有限公司 | Voice broadcast control method and device, intelligent device and medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111601193A (en) * | 2020-05-11 | 2020-08-28 | 长沙胖胖智能科技有限公司 | Whole-house control system based on intelligent sound and control method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111105790B (en) | 2023-03-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP3935840B2 (en) | Automatic mute by baby monitoring device | |
| US8825020B2 (en) | Information access and device control using mobile phones and audio in the home environment | |
| CN108922537B (en) | Audio recognition method, device, terminal, earphone and readable storage medium | |
| US10932040B2 (en) | Lighting integrated sound processing | |
| US9824565B1 (en) | Smoke detector system with expanded capabilities | |
| EP2846328A1 (en) | Method and apparatus of detection of events | |
| KR20200034376A (en) | Apparatus and method for providing a notification by interworking a plurality of electronic devices | |
| US20210144495A1 (en) | Microphone Hole Blockage Detection Method, Microphone Hole Blockage Detection Device, and First Wireless Earphone | |
| KR101563361B1 (en) | System for wireless digital town broadcasting | |
| US10966023B2 (en) | Lighting system with remote microphone | |
| CN106896362A (en) | A kind of terminal that function is detected with ultrasonic distance | |
| JP2018508096A (en) | Method and apparatus for proximity detection for device control | |
| WO2018224189A1 (en) | An instruction forwarding system for a voice assistant | |
| CN111105790B (en) | Intelligent external device, intelligent sound box system and distributed reception method | |
| CN113674738A (en) | Whole-house distributed voice system and method | |
| EP3145211B1 (en) | Communication apparatus and wireless communication system including the same | |
| US20160337743A1 (en) | Apparatus and methods for attenuation of an audio signal | |
| RU147091U1 (en) | SOUND INFORMATION DEVICE | |
| CN106489264A (en) | Method for personalized ring-tone and electronic equipment | |
| US11270572B2 (en) | System and method for alerting a user to the presence of environmental sounds | |
| Bernstein et al. | Augmented warning sound detection for hearing protectors | |
| CN209313960U (en) | Wired home nurses alarm sound camera | |
| CN107358956B (en) | Voice control method and control module thereof | |
| CN214223426U (en) | A device and water heater for water heater voice broadcast | |
| JP2011151680A (en) | Intercom system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |