CN108490797A - The search result methods of exhibiting and device of smart machine - Google Patents
The search result methods of exhibiting and device of smart machine Download PDFInfo
- Publication number
- CN108490797A CN108490797A CN201810228840.1A CN201810228840A CN108490797A CN 108490797 A CN108490797 A CN 108490797A CN 201810228840 A CN201810228840 A CN 201810228840A CN 108490797 A CN108490797 A CN 108490797A
- Authority
- CN
- China
- Prior art keywords
- target
- distance
- working mode
- intelligent
- intelligent equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 230000001747 exhibiting effect Effects 0.000 title abstract 2
- 238000003384 imaging method Methods 0.000 claims description 29
- 238000004590 computer program Methods 0.000 claims description 11
- 230000007423 decrease Effects 0.000 claims description 2
- 235000021152 breakfast Nutrition 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000003993 interaction Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 5
- 230000005236 sound signal Effects 0.000 description 4
- 239000000284 extract Substances 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011022 operating instruction Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention proposes a kind of the search result methods of exhibiting and device of smart machine, wherein this method can be used for being used in smart home environment, including：Control smart machine is detected target, when detecting target, obtains the distance between target and smart machine, determines that the target operational mode of smart machine, control smart machine carry out screen setting under target operational mode according to distance.This method passes through according to the distance between people and smart machine, it determines the operating mode of smart machine, and carries out screen setting under target operational mode, realize according to the distance between people and smart machine, intelligence adjusts the display mode of screen, improves the display efficiency of smart machine.
Description
Technical Field
The invention relates to the technical field of terminal equipment, in particular to a search result display method and device of intelligent equipment.
Background
At present, in human-computer interaction, mainly touch and remote control modes are used. The touch control mode is mainly applied to the condition that the distance between the human-computer equipment and the mobile phone is relatively short, such as a mobile phone, an ipad and the like. The remote control mode is mainly used in the case that the equipment is far away, such as controlling a television through a remote controller.
However, in both touch and remote control modes, the display mode of the device is relatively single. For example, during the use of a mobile phone, the display format of the mobile phone, such as font size, is usually fixed. Although the fonts can be adjusted according to needs, the operation is complicated and not convenient enough. Therefore, the display mode of the existing equipment is fixed and single, and the adjustment is not convenient enough.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the related art.
The invention provides a search result display method of intelligent equipment, which is applied to an intelligent home environment, determines the working mode of the intelligent equipment according to the distance between a person and the intelligent equipment, and sets a screen in a target working mode, so that the display mode of the screen is intelligently adjusted according to the distance between the person and the intelligent equipment, and the display efficiency of the intelligent equipment is improved.
An embodiment of the invention provides a method for displaying search results of an intelligent device, which is used in an intelligent home environment and comprises the following steps:
controlling intelligent equipment to detect a target;
when the target is detected, acquiring the distance between the target and the intelligent equipment;
determining a target working mode of the intelligent equipment according to the distance;
and controlling the intelligent equipment to perform screen setting in the target working mode.
The method for displaying the search result of the intelligent device can be used in an intelligent home environment, the intelligent device is controlled to detect the target, when the target is detected, the distance between the target and the intelligent device is obtained, the target working mode of the intelligent device is determined according to the distance, and the intelligent device is controlled to carry out screen setting in the target working mode. In the embodiment, the working mode of the intelligent device is determined according to the distance between the person and the intelligent device, and the screen is set in the target working mode, so that the display mode of the screen is intelligently adjusted according to the distance between the person and the intelligent device, and the display efficiency of the intelligent device is improved.
Another embodiment of the present invention provides a search result display apparatus for an intelligent device, including:
the control module is used for controlling the intelligent equipment to detect the target;
the acquisition module is used for acquiring the distance between the target and the intelligent equipment when the target is detected;
the determining module is used for determining a target working mode of the intelligent equipment according to the distance;
and the setting module is used for controlling the intelligent equipment to carry out screen setting in the target working mode.
According to the search result display device of the intelligent device, the intelligent device is controlled to detect the target, when the target is detected, the distance between the target and the intelligent device is obtained, the target working mode of the intelligent device is determined according to the distance, and the intelligent device is controlled to carry out screen setting in the target working mode. In the embodiment, the working mode of the intelligent device is determined according to the distance between the person and the intelligent device, and the screen is set in the target working mode, so that the display mode of the screen is intelligently adjusted according to the distance between the person and the intelligent device, and the display efficiency of the intelligent device is improved.
Another embodiment of the present invention provides an intelligent device, including a processor and a memory; the processor reads the executable program code stored in the memory to run a program corresponding to the executable program code, so as to implement the search result presentation method of the smart device according to the embodiment.
Another embodiment of the present invention provides a computer program product, wherein when the instructions in the computer program product are executed by a processor, the method for displaying search results of an intelligent device according to the above embodiment is implemented.
Another embodiment of the present invention provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for presenting search results of an intelligent device according to the above embodiment.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic flowchart of a search result displaying method for a first intelligent device according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a search result displaying method for a second intelligent device according to an embodiment of the present invention;
fig. 3 is a diagram illustrating a display effect of a screen in a near field operating mode according to an embodiment of the present invention;
fig. 4 is a diagram illustrating a display effect of a screen in a far field operating mode according to an embodiment of the present invention;
fig. 5 is a schematic flowchart of a search result displaying method of a third intelligent device according to an embodiment of the present invention;
fig. 6 is a schematic flowchart of a search result displaying method for a fourth intelligent device according to an embodiment of the present invention;
fig. 7 is a schematic flowchart of a search result displaying method for a fifth intelligent device according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a boundary range provided by the present invention;
fig. 9 is a schematic flowchart of a search result displaying method for a sixth intelligent device according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of a search result display apparatus of an intelligent device according to an embodiment of the present invention;
FIG. 11 illustrates a block diagram of an exemplary smart device suitable for use in implementing embodiments of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
The following describes a search result presentation method and apparatus for an intelligent device according to an embodiment of the present invention with reference to the accompanying drawings.
At present, in the man-machine interaction field, such as the intelligent home field, the display mode of the equipment is single in the control mode of touch and remote control. For example, during the use of a mobile phone, the display format of the mobile phone, such as font size, is usually fixed. Although the fonts can be adjusted according to needs, the operation is complicated and not convenient enough. Therefore, the display mode of the existing equipment is fixed and single, and the adjustment is not convenient enough.
In order to solve the problem, the embodiment of the invention provides a method for displaying a search result of an intelligent device, which can be used in an intelligent home environment, and can be used for determining a working mode of the intelligent device according to a distance between a person and the intelligent device and setting a screen in a target working mode, so that a display mode of the screen can be intelligently adjusted according to the distance between the person and the intelligent device, and the display efficiency of the intelligent device is improved.
Fig. 1 is a schematic flowchart of a first method for displaying search results of an intelligent device according to an embodiment of the present invention.
As shown in fig. 1, the search result presentation method of the intelligent device includes:
step 101, controlling the intelligent device to detect the target.
In this embodiment, the smart device may detect the target device every preset time, for example, every 3 seconds. The intelligent device can be an intelligent refrigerator, an intelligent air conditioner, an intelligent television and the like in an intelligent home environment, and the target can be a person.
When detecting whether targets exist around the intelligent device, the detection can be performed by methods such as face recognition, voice acquisition, infrared signals and the like, and the specific process can be referred to the following embodiments and is not described herein again.
And 102, when the target is detected, acquiring the distance between the target and the intelligent equipment.
In the related art, in the control modes of touch and remote control, the display mode of the intelligent device is single. The touch mode is mainly applied to the condition that the distance between the human-computer devices is relatively short, such as using a mobile phone, an ipad and the like. Remote control is mainly used when the equipment is relatively far away, such as controlling a television or the like at home through a remote controller.
With the development of voice technology, the voice interaction greatly expands the interaction distance between a user and equipment from tens of centimeters to several meters and tens of meters. Meanwhile, due to the complexity of the intelligent home environment, such as the complexity of the illumination condition and other factors, the original display mode accompanied with the fixed interaction distance is single.
In this embodiment, after the existence of the target is determined, the distance between the target and the smart device is obtained, so as to determine the display mode of the screen on the smart device through the distance.
And 103, determining a target working mode of the intelligent equipment according to the distance.
In this embodiment, the target operating mode of the smart device may be determined according to the distance. Specifically, the correspondence between the distance and the operation mode may be established in advance. After the distance between the target and the intelligent device is obtained, the working mode corresponding to the distance between the target and the intelligent device can be determined by inquiring the corresponding relation between the distance and the working mode.
The different working modes may correspond to different screen display modes, such as font size, and spacing between elements in the screen.
And 104, controlling the intelligent equipment to perform screen setting in the target working mode.
After the working mode of the intelligent device is determined according to the distance between the target and the intelligent device, the intelligent device can be controlled to set the screen in the working mode, for example, the size of fonts in the screen, the brightness of the screen, the distance between elements in the screen and the like are set, so that the screen of the intelligent device is displayed according to the setting.
In order to more clearly illustrate the above embodiments, how to detect the target is described below in terms of face recognition, voice acquisition, and infrared signals, respectively, so as to explain the search result display method of the intelligent device provided by the embodiment of the present invention.
A method of detecting a target by face recognition and how to obtain a distance between the target and the smart device when it is determined that the target exists are described below. Fig. 2 is a schematic flowchart of a search result displaying method for a second intelligent device according to an embodiment of the present invention.
As shown in fig. 2, the search result presentation method of the intelligent device includes:
step 201, controlling a camera device on the intelligent device to acquire an image.
In this embodiment, be provided with camera device such as the camera on the smart machine, the accessible is controlled camera device and is gathered the image around the smart machine in real time.
Take intelligent refrigerator as an example, can place a camera on intelligent refrigerator top, the camera can rotate preset angle according to certain speed. After the camera rotates by a preset angle, the image is collected, and then the camera continues to rotate by the preset angle, so that the multi-directional image can be collected.
Step 202, performing face recognition on the acquired image, and determining that a target exists after the face is recognized.
The intelligent device can perform face recognition on the acquired image. Specifically, face contour data may be pre-stored, and the smart device extracts a contour from the image and compares the extracted contour with the pre-stored face contour. When the similarity exceeds a preset threshold, it can be considered that a human face is recognized from the image. When a human face is recognized, it can be determined that objects, i.e., people, are stored around the smart device.
And step 203, acquiring the imaging area of the target in the formed image when the target is determined to exist by the camera device.
In the present embodiment, when it is determined by the image pickup device that the target exists, the imaging area of the target in the formed image is acquired. Specifically, when it is determined that an object exists from an image captured by the imaging device, the imaging area of the object in the image, that is, the formed image, can be calculated from the face contour extracted from the image.
And step 204, acquiring the pre-acquired imaging area of the human body at the set distance.
In this embodiment, the camera device can collect the image of the human body in advance when the human is away from the intelligent device and the distance is set. Then, the intelligent device extracts the human body contour from the image, calculates the area of the human body contour as the imaging area of the human body, and stores the area so that the intelligent device can obtain the pre-collected imaging area of the human body at the set distance.
Step 205, calculating a distance adjustment coefficient according to the imaging area of the target and the imaging area of the human body.
In this embodiment, the ratio of the imaging area of the target to the imaging area of the human body may be used as a distance adjustment coefficient. Suppose that the imaging area of the subject is S and the imaging area of the human body is S0Then, thenA distance adjustment factor may be used. It can be understood that the ratio of the imaging area of the human body to the imaging area of the objectAnd may also be used as a distance adjustment factor.
And step 206, obtaining the distance between the target and the intelligent device according to the distance adjusting coefficient and the set distance.
In this embodiment, when the distance adjustment coefficient is equal to the ratio of the imaging area of the target to the imaging area of the human body, the ratio may be multiplied by the set distance, and the obtained result is the distance between the target and the smart device, as shown in formula (1).
Wherein L represents the distance between the target and the smart device, L0Indicating the set distance.
When the distance adjusting coefficient is the ratio of the imaging area of the human body to the imaging area of the target, the distance between the target and the intelligent device is equal to the ratio of the set distance divided by the imaging area of the human body to the imaging area of the target. As shown in equation (2).
Wherein λ is2Representing the ratio of the imaged area of the human body to the imaged area of the object.
And step 207, determining a target working mode of the intelligent equipment according to the distance.
In this embodiment, the operation modes of the smart device may include a near-field operation mode and a far-field operation mode. The intelligent device can automatically adjust the current screen brightness according to the current ambient light by taking the ambient light as a main influence element of the screen in a near-field working mode; in the remote working mode, the font, the content, the size of the font, the color of the font, the element spacing and the like are taken as main adjusting elements of the screen.
After the distance L between the target and the intelligent device is obtained, the distance L is compared with a preset distance threshold value K. When the distance is smaller than or equal to the preset distance threshold value, namely L is smaller than or equal to K, the interaction distance between the target and the intelligent device is considered to be short, and then the near field working mode is used as the target working mode of the intelligent device.
When the distance is greater than the distance threshold, that is, L > K, the interaction distance between the target and the smart device may be considered to be relatively long, and fonts, content amount, font size, and the like on the screen of the smart device need to be adjusted, and then the remote working mode is used as the target working mode of the smart device.
And step 208, controlling the intelligent device to perform screen setting in the target working mode.
In this embodiment, after the target operating mode of the intelligent device is determined, the intelligent device is controlled to perform screen setting in the target operating mode.
When the target working mode is the near-field working mode, the ambient brightness is the main influence factor of screen display, and the brightness of the current environment of the intelligent equipment can be acquired through a brightness sensor arranged on the intelligent equipment. Then, according to the collected ambient brightness, a mapping relation between the preset ambient brightness and the display brightness of the screen can be inquired, and the display brightness of the screen corresponding to the current ambient brightness is obtained. And then, setting the display brightness of the screen as the display brightness of the screen corresponding to the current environment brightness.
Since the closer the distance between the person and the smart device, the smaller the size of the font on the screen of the smart device required by the person, the format of the display elements on the screen can also be set according to the distance between the target and the smart device. Wherein, the display elements can be pictures, fonts and the like.
Specifically, the display format corresponding to the current distance may be obtained by querying a correspondence between a distance established in advance and a display format of a display element on the screen. Then, the display format of the on-screen display element is set to the display format corresponding to the distance. The display format includes the number, spacing, size, etc. of the display elements.
In this embodiment, the coverage area of the smart device may be divided into a plurality of areas in advance. For example, the coverage area of the smart device may be divided into 4 areas according to areas less than 1m, 1m to 2m, 2m to 3m, and more than 3m from the center point of the screen on the smart device. It should be noted that this dividing method is only an example, and in practical applications, the regions may be divided as needed.
After dividing the regions, a correspondence relationship between the regions and the display brightness of the screen and the display format of the display elements on the screen may be established.
When the target working mode of the intelligent device is a far-field working mode, the distance between the target and the intelligent device can be compared with the range corresponding to each area to determine the target area where the target is located. Then, the display brightness of the screen and the display format of the display elements on the screen corresponding to the target area are obtained by inquiring the corresponding relation between the display brightness of the area and the screen and the display format of the display elements on the screen. Then, the display brightness of the screen and the display format of the display elements on the screen are set to the display brightness of the screen and the display format of the display elements on the screen corresponding to the target area.
Taking screen brightness and font as an example, when a user is far away from the intelligent device, the screen brightness is set to be in a high brightness state so as to be suitable for clearly seeing the display content of the screen at a long distance, and when the user is close to the screen of the intelligent device, the screen brightness changes along with the ambient brightness.
The fonts on the screen can change along with the distance, when the distance between a person and the intelligent device is closer, the fonts are relatively smaller and are more suitable for the current distance, and when the distance is farther, the fonts on the screen can be obviously enlarged so as to be suitable for reading at a long distance.
As shown in fig. 3 and 4, the intelligent refrigerator has different display modes of the display elements on the screen according to the distance between a person and the intelligent refrigerator. When the distance between the person and the intelligent refrigerator is short, the target working mode of the intelligent refrigerator is a near-field working mode, as shown in fig. 3, breakfast recommended in morning recommendation is displayed in a small card form, 4 cards can be displayed on a display screen, and the font is small. When the distance between the person and the intelligent refrigerator is far, the target working mode of the intelligent refrigerator is a far-field working mode, as shown in fig. 4, breakfast recommended in morning recommendation is displayed in a large card form, only one card is displayed on the screen, and the font on the screen is relatively large when the font is close to the screen, so that the user at the far distance can clearly see the font and the picture content on the screen.
According to the search result display method of the intelligent equipment, the image is acquired through the camera device, the face of the image is recognized to determine whether the target exists, and when the target exists, the target working mode, the far-field working mode or the near-field working mode is determined according to the distance between the target and the intelligent equipment, so that intelligent display according to the distance is achieved, and the display efficiency is improved.
The following describes determining whether a target is present through a voice signal and how to calculate the distance between the target and the smart device. Fig. 5 is a flowchart illustrating a search result displaying method of a third intelligent device according to an embodiment of the present invention.
As shown in fig. 5, the search result presentation method of the intelligent device includes:
and 301, controlling a microphone array on the intelligent equipment to perform voice acquisition.
In this embodiment, a microphone array may be provided on the smart device, and voice acquisition may be performed in real time by controlling the microphone array. Wherein, the microphone array is composed of a plurality of microphones in the form of an array. The microphone array is used for collecting the voice signals, so that the accuracy of voice collection can be improved.
Step 302, when the collected voice signal is present, it is determined that a target is present.
In this embodiment, when the microphone array collects a voice signal, it can be determined that a target exists.
In order to avoid the interference of other sounds, such as the sound of animals, and the like, and improve the collection accuracy, the frequency of the collected sound signal can be detected to determine whether the frequency of the sound signal is in the frequency range of 300Hz to 3.4kHz of the voice signal. When the frequency range of the sound signal is within 300Hz to 3.4kHz, the sound signal can be determined to be a voice signal.
Step 303, when the existence of the target is determined by the microphone array, acquiring the time delay of the voice reaching each microphone in the microphone array.
In this embodiment, when the presence of the target is determined by the microphone array, the time delay of the speech reaching each microphone in the microphone array can be acquired. The time delay refers to the time when the voice signal reaches the microphone.
And step 304, determining the relative time delay between the adjacent microphones according to the time delay of each microphone.
After obtaining the time delay of the voice reaching each microphone, the time delays of two adjacent microphones can be differenced to obtain the relative time delay between the two adjacent microphones.
Step 305, determining position information between the target and the intelligent device according to the relative time delay and the interval between the adjacent microphones; the position information includes a distance and an angle between the target and the intelligent device.
In the present embodiment, it is assumed that microphones are arranged in parallel in a microphone array. Knowing the time delay of each microphone, the relative time delay τ between two microphones spaced one microphone apart (spaced one microphone apart) can be calculated, and multiplying the relative time delay by the speed of sound v yields the distance l ═ v ×.τ.
From this, it follows from the sine theoremWhere d is the spacing between two adjacent microphones and theta2The included angle between the voice signal and the plane where the microphone array is located. From this, the angle can be calculatedTherefore, the angle between the speech and the direction perpendicular to the microphone arrayI.e. determining the angle between the target and the smart device.
In this embodiment, for the time delay of each microphone, the distance between the target and each microphone is obtained by multiplying the time delay by the sound velocity. Then, the average of all the distances is found as the distance between the target and the smart device.
And step 306, determining the target working mode of the intelligent device according to the distance.
And 307, controlling the intelligent device to perform screen setting in the target working mode.
In this embodiment, the method for determining the working mode of the intelligent device according to the distance and controlling the intelligent device to perform the screen setting in the target working mode may refer to the related contents in the above embodiments, and details are not described herein.
According to the method for displaying the search results of the intelligent equipment, the voice is collected through the microphone array to determine whether the target exists, and when the target exists, the position information between the target and the intelligent equipment is further determined, so that intelligent display according to the distance is achieved, and the display efficiency is improved.
The following describes a method of determining whether a target is present by an infrared sensor and how to determine the distance between the target and the smart device. Fig. 6 is a flowchart illustrating a search result displaying method of a fourth intelligent device according to an embodiment of the present invention.
As shown in fig. 6, the search result presentation method of the intelligent device includes:
step 401, controlling an infrared sensor on the intelligent device to radiate an infrared signal outwards.
Since the infrared signal reflected by the human body has a corresponding temperature range, it can be used to determine whether a person is present around the smart device.
In this embodiment, the smart device may be provided with an infrared sensor. The intelligent device can control the infrared sensor to radiate infrared signals outwards in real time. When the infrared signal is blocked by an obstacle, the infrared signal can be reflected by the obstacle.
Step 402, when the returned infrared signal meeting the preset condition is received, determining that the target exists.
The preset condition may be a temperature obtained in advance according to an infrared signal returned by the human body.
In this embodiment, whether there is a reflected infrared signal may be detected in real time by the infrared detector. When the returned infrared signal is received, the temperature of the target surface can be collected. Then, the temperature of the target surface is compared with the temperature obtained in advance according to the infrared signal returned by the human body. When the difference between the two temperatures is less than a preset threshold, it may be considered that a person, i.e., a target, exists around the smart device.
And 403, when the infrared sensor determines that the target exists, acquiring the return time of the infrared signal, and determining the distance between the target and the intelligent device according to the return time.
The return time of the infrared signal refers to the time from the infrared sensor radiating the infrared signal to the infrared detector receiving the returned infrared signal.
When the presence of the target is determined by the infrared sensor, the return time period of the infrared signal can be acquired. Then, the return time length is multiplied by the propagation speed of the infrared signal, and the obtained result is divided by 2, so that the distance between the target and the intelligent device can be obtained.
And step 404, determining a target working mode of the intelligent device according to the distance.
And step 405, controlling the intelligent device to perform screen setting in the target working mode.
In this embodiment, a target operating mode of the intelligent device is determined according to the distance, and a method for controlling the intelligent device to perform screen setting in the target operating mode may refer to relevant contents of the above embodiments, which are not described herein again.
In the embodiment, the infrared sensor is controlled to radiate the infrared signal outwards, whether the target exists is determined according to whether the received returned infrared signal meets the preset condition, the distance between the target and the intelligent device is determined according to the returning time, the working mode of the intelligent device is determined according to the distance, the screen is set in the working mode, intelligent display according to the distance is achieved, and the display efficiency is improved.
Since the target operating mode of the smart device is related to the distance between the target and the smart device, and the position of the person is not fixed, in order to avoid that the target operating mode of the smart device is in a frequent switching state due to the fluctuation of the distance between the person and the smart device around the distance threshold. On the basis of the above embodiments, the embodiments of the present invention may set a boundary range to avoid frequent switching of the operation modes. Fig. 7 is a flowchart illustrating a fifth method for displaying a search result of an intelligent device according to an embodiment of the present invention.
On the basis of the embodiment shown in fig. 1, as shown in fig. 7, the method for displaying the search result of the intelligent device further includes:
and 105, continuously acquiring the distance between the target and the intelligent device.
In this embodiment, after the target operating mode of the smart device is determined according to the distance between the target and the smart device, the distance between the target and the smart device may be continuously obtained by using the method for obtaining the distance between the target and the smart device.
It should be noted that this step may also be executed after controlling the smart device to perform the screen setting in the target operation mode in step 104.
Step 106, if the distance is within a preset boundary range, maintaining the current target working mode; wherein the distance threshold is within a boundary range, and the boundary range comprises a lower limit value and an upper limit value.
In this embodiment, a boundary range may be preset, where the distance threshold is within the boundary range, and the boundary range includes a lower limit value and an upper limit value.
After the distance between the target and the smart device is obtained, the distance is compared with the upper limit value and the lower limit value of the boundary range to determine whether the distance is within the boundary range. And if the distance is within the preset boundary range, maintaining the current target working mode unchanged.
And step 107, if the distance gradually increases and exceeds the upper limit value, switching from the near-field working mode to the far-field working mode when the target working mode is the near-field working mode.
If the current target working mode of the intelligent equipment is a near-field working mode, when the distance between the target and the intelligent equipment is gradually increased and exceeds the upper limit value of the boundary range, switching the target working mode of the intelligent equipment from the near-field working mode to a far-field working mode; and when the distance between the target and the intelligent equipment is gradually reduced and is lower than the lower limit value of the boundary range, the intelligent equipment maintains the near-field working mode of the current target working mode.
And 108, switching from the far-field working mode to the near-field working mode if the distance gradually decreases and is lower than the lower limit value when the target working mode is the far-field working mode.
If the current target working mode of the intelligent equipment is a far-field working mode, when the distance between the target and the intelligent equipment is gradually reduced and is lower than the lower limit value of the boundary range, switching the target working mode of the intelligent equipment from the far-field working mode to a near-field working mode; and when the distance between the target and the intelligent device is gradually increased and exceeds the upper limit value of the boundary range, the intelligent device maintains the far-field working mode of the current target working mode.
Assuming that the distance threshold is 1.5m, the boundary range is [1.2m, 1.8m ], and the current target working mode of the intelligent device is a far-field working mode. As shown in fig. 8, when the distance between the person and the smart device is within the boundary range [1.2m, 1.8m ], the target operation mode of the smart device is always maintained in the far-field operation mode.
If the person gradually approaches the intelligent device, namely the distance between the person and the intelligent device gradually becomes smaller, when the distance is smaller than the lower limit value of 1.2m, the target working mode of the intelligent device is switched from the far-field working mode to the near-field working mode. If the person is gradually far away from the intelligent device, that is, the distance between the person and the intelligent device is gradually increased and exceeds the upper limit value of 1.8m, the target working mode of the intelligent device is still maintained in the far-field working mode.
In this embodiment, the boundary range is set as the buffer interval, so as to avoid the situation that the working mode is frequently switched when the distance between the target and the intelligent device fluctuates near the distance threshold, and make the intelligent device control more accurate.
On the basis of the above embodiment, after the smart device is controlled to perform the screen setting in the target operating mode, the smart device may further provide a service according to the received operating instruction. Fig. 9 is a flowchart illustrating a search result displaying method for a sixth intelligent device according to an embodiment of the present invention.
On the basis of the embodiment shown in fig. 1, as shown in fig. 9, the method for displaying the search result of the intelligent device may further include:
step 109, the operation instruction sent by the target is obtained.
In this embodiment, the target may issue an operation instruction to the smart device. For example, a voice instruction to provide breakfast recommendations may be issued to the smart refrigerator, and a voice instruction to search for favorite programs may be issued to the smart television. Of course, the triggering operation may also be performed on the smart device, and the smart device generates the operation instruction according to the triggering operation.
And step 110, providing services to the target according to the operation instruction in the target working mode.
In this embodiment, the intelligent device provides a service to the target according to the received operation instruction in the target operating mode.
For example, the intelligent refrigerator carries out breakfast recommendation according to an operation instruction of the breakfast recommendation; the intelligent air conditioner reduces the temperature of the air conditioner by 2 ℃ according to an operation instruction for reducing the temperature by 2 ℃.
When the operation instruction received by the smart device is a search instruction, providing a service to the target according to the operation instruction may include: the intelligent equipment extracts the search keywords from the search instruction, and then searches the search keywords through a search engine to obtain search results related to the search keywords.
For example, when the smart television receives a search instruction of "search for the western notes", the search keyword "western notes" is extracted from "search for the western notes", and the "western notes" are searched by a search engine to obtain search results related to the "western notes", such as the drama western notes, the western notes theme song, and the like.
And after the search result is obtained, the intelligent equipment displays the search result on the intelligent equipment according to the requirement of the current target working mode of the intelligent equipment. Specifically, the search result is displayed on the intelligent device according to the screen setting in the target working mode.
Taking the example of recommending breakfast by the intelligent refrigerator, when the target working mode of the intelligent refrigerator is the near-field working mode, after the search result is obtained, as shown in fig. 3, the intelligent refrigerator displays a plurality of small cards and has a small font on the screen according to the requirement of the near-field working mode on the breakfast recommending result. When the target operation mode of the intelligent refrigerator is the far-field operation mode, after the search result is obtained, as shown in fig. 4, the intelligent refrigerator displays a large card and a large font on the screen according to the breakfast recommendation result according to the requirement of the far-field operation mode, that is, each card is displayed in an enlarged manner compared with the near-field operation mode, so that the user can see the content on the screen clearly even in a long-distance situation.
In the embodiment, after the intelligent device is controlled to perform screen setting in the target working mode, the service can be provided for the target in the target working mode, and when the received instruction is a search instruction, the search result can be displayed according to the requirement of the working mode, so that the working mode can be switched according to the distance, and the search result can be displayed in the working mode, thereby realizing intelligent display and improving the display efficiency.
In order to implement the above embodiments, the embodiment of the present invention further provides a search result display apparatus for an intelligent device. Fig. 10 is a schematic structural diagram of a search result display apparatus of an intelligent device according to an embodiment of the present invention.
As shown in fig. 10, the search result presentation apparatus of the smart device includes: a control module 510, an acquisition module 520, a determination module 530, and a setup module 540.
The control module 510 is used for controlling the smart device to detect the target.
The obtaining module 520 is configured to obtain a distance between the target and the smart device when the target is detected.
The determining module 530 is configured to determine a target operating mode of the smart device according to the distance.
The setting module 540 is used for controlling the smart device to perform screen setting in the target operating mode.
In a possible implementation manner of this embodiment, the control module 510 is further configured to:
controlling a camera device on the intelligent equipment to acquire images;
carrying out face recognition on the collected image, and determining that a target exists after the face is recognized; or,
controlling a microphone array on the intelligent equipment to carry out voice acquisition;
determining that a target exists when the collected voice signal; or,
controlling an infrared sensor on the intelligent equipment to radiate an infrared signal outwards;
and when the returned infrared signal meeting the preset condition is received, determining that the target exists.
In one possible implementation manner of this embodiment, when the target is determined to exist by the image capturing device, the obtaining module 520 is further configured to:
acquiring the imaging area of a target in the image;
acquiring a pre-acquired imaging area of a human body at a set distance;
calculating a distance adjustment coefficient according to the imaging area of the target and the imaging area of the human body;
and obtaining the distance between the target and the intelligent equipment according to the distance adjusting coefficient and the set distance.
In one possible implementation manner of this embodiment, when the target is determined to exist by the microphone array, the obtaining module 520 is further configured to:
acquiring time delay of voice reaching each microphone in a microphone array;
determining the relative time delay between adjacent microphones according to the time delay of each microphone;
determining position information between the target and the intelligent device according to the relative time delay and the interval between the adjacent microphones; the position information includes a distance and an angle between the target and the intelligent device.
In a possible implementation manner of this embodiment, when the infrared sensor determines that the target exists, the obtaining module 520 is further configured to:
and acquiring the return time length of the infrared signal, and determining the distance between the target and the intelligent equipment according to the return time length.
In a possible implementation manner of this embodiment, the determining module 530 is further configured to:
when the distance is smaller than or equal to a preset distance threshold value, selecting a near-field working mode as a target working mode for the intelligent equipment;
and when the distance is greater than the distance threshold, selecting a far-field working mode as a target working mode for the intelligent equipment.
In a possible implementation manner of this embodiment, the setting module 540 is further configured to:
when the target working mode is the near-field working mode, acquiring the brightness of the current environment of the intelligent equipment;
setting the display brightness of the screen according to the brightness;
setting a display format of the display elements on the screen according to the distance, wherein the display format comprises the number, the spacing and/or the size of the display elements;
when the target working mode is a far-field working mode, determining a target area where the target is located according to the distance; the target area is an area obtained by pre-dividing the coverage area of the intelligent equipment;
setting the display brightness of a screen according to the target area;
and setting the display format of the display elements according to the target area, wherein the display format comprises the number, the spacing and/or the size of the display elements.
In a possible implementation manner of this embodiment, the apparatus may further include:
the obtaining module 520 is further configured to continuously obtain a distance between the target and the smart device;
the switching module is used for maintaining the current target working mode when the distance is within a preset boundary range; the distance threshold is in a boundary range, and the boundary range comprises a lower limit value and an upper limit value; when the target working mode is a near-field working mode, when the distance gradually increases and exceeds an upper limit value, switching from the near-field working mode to a far-field working mode; and when the target working mode is a far-field working mode, switching from the far-field working mode to a near-field working mode when the distance gradually becomes smaller and is lower than a lower limit value.
In a possible implementation manner of this embodiment, the apparatus may further include:
the acquisition instruction module is used for acquiring an operation instruction sent by a target after controlling the intelligent equipment to carry out screen setting in a target working mode;
and the providing module is used for providing services for the target according to the operation instruction in the target working mode.
In a possible implementation manner of this embodiment, when the operation instruction is a search instruction, the providing module is further configured to:
extracting a search keyword from a search instruction;
searching the search keyword through a search engine to obtain a search result;
and displaying the search result on the intelligent equipment according to the requirement of the target working mode.
It should be noted that the foregoing explanation on the embodiment of the method for displaying the search result of the intelligent device is also applicable to the apparatus for displaying the search result of the intelligent device in this embodiment, and is not repeated herein.
According to the search result display device of the intelligent device, the intelligent device is controlled to detect the target, when the target is detected, the distance between the target and the intelligent device is obtained, the target working mode of the intelligent device is determined according to the distance, and the intelligent device is controlled to carry out screen setting in the target working mode. In the embodiment, the working mode of the intelligent device is determined according to the distance between the person and the intelligent device, and the screen is set in the target working mode, so that the display mode of the screen is intelligently adjusted according to the distance between the person and the intelligent device, and the display efficiency of the intelligent device is improved.
In order to implement the foregoing embodiments, an embodiment of the present invention further provides an intelligent device, including a processor and a memory; the processor reads the executable program code stored in the memory to run the program corresponding to the executable program code, so as to implement the search result presentation method of the smart device according to the embodiment.
FIG. 11 illustrates a block diagram of an exemplary smart device suitable for use in implementing embodiments of the present invention. The smart device 12 shown in fig. 11 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
As shown in fig. 11, the smart device 12 is in the form of a general purpose computing device. The components of the smart device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. These architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus, to name a few.
The smart device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by smart device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
Memory 28 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 30 and/or cache Memory 32. The smart device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 11, and commonly referred to as a "hard drive"). Although not shown in FIG. 11, a disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk Read Only memory (CD-ROM), a Digital versatile disk Read Only memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the application.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally perform the functions and/or methodologies of the embodiments described herein.
The smart device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with the smart device 12, and/or with any devices (e.g., network card, modem, etc.) that enable the smart device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, the smart device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public Network such as the Internet) via the Network adapter 20. As shown, the network adapter 20 communicates with the other modules of the smart device 12 via the bus 18. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the smart device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 16 executes various functional applications and data processing, for example, implementing the methods mentioned in the foregoing embodiments, by executing programs stored in the system memory 28.
In order to implement the foregoing embodiment, an embodiment of the present invention further provides a computer program product, where instructions in the computer program product, when executed by a processor, implement the method for displaying search results of an intelligent device according to the foregoing embodiment.
In order to implement the foregoing embodiment, an embodiment of the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the search result presentation method of the smart device according to the foregoing embodiment.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (14)
1. A search result display method of intelligent equipment is used in an intelligent home environment, and comprises the following steps:
controlling intelligent equipment to detect a target;
when the target is detected, acquiring the distance between the target and the intelligent equipment;
determining a target working mode of the intelligent equipment according to the distance;
and controlling the intelligent equipment to perform screen setting in the target working mode.
2. The method of claim 1, wherein the controlling the smart device to detect the target comprises:
controlling a camera device on the intelligent equipment to acquire images;
carrying out face recognition on the collected image, and determining that the target exists after the face is recognized; or,
controlling a microphone array on the intelligent equipment to carry out voice acquisition;
when the collected voice signal exists, determining that the target exists; or,
controlling an infrared sensor on the intelligent device to radiate an infrared signal outwards;
and when the returned infrared signal meeting the preset condition is received, determining that the target exists.
3. The method according to claim 2, wherein when it is determined by the camera that an object exists, then the obtaining a distance between the object and the smart device comprises:
acquiring an imaging area of the target in the image;
acquiring the imaging area of the human body at a preset distance, which is acquired in advance;
calculating a distance adjustment coefficient according to the imaging area of the target and the imaging area of the human body;
and obtaining the distance between the target and the intelligent equipment according to the distance adjusting coefficient and the set distance.
4. The method of claim 2, wherein when a target is determined to be present by the microphone array, then the obtaining a distance between the target and the smart device comprises:
acquiring time delay of voice reaching each microphone in the microphone array;
determining relative time delay between adjacent microphones according to the time delay of each microphone;
determining position information between the target and the intelligent device according to the relative time delay and the interval between the adjacent microphones; wherein the position information includes a distance and an angle between the target and the smart device.
5. The method of claim 2, wherein when it is determined by the infrared sensor that an object is present, the obtaining a distance between the object and the smart device comprises:
and acquiring the return time length of the infrared signal, and determining the distance between the target and the intelligent equipment according to the return time length.
6. The method according to any one of claims 1-5, wherein the determining the target operating mode of the smart device according to the distance comprises:
when the distance is smaller than or equal to a preset distance threshold value, selecting a near-field working mode as the target working mode for the intelligent equipment;
and when the distance is greater than the distance threshold, selecting a far-field operating mode for the smart device as the target operating mode.
7. The method of claim 6, wherein the controlling the smart device to perform a screen setting in the target operating mode comprises:
when the target working mode is the near field working mode, acquiring the brightness of the current environment of the intelligent equipment;
setting the display brightness of the screen according to the brightness;
setting a display format of the display elements on the screen according to the distance, wherein the display format comprises the number, the spacing and/or the size of the display elements;
when the target working mode is the far-field working mode, determining a target area where the target is located according to the distance; the target area is an area obtained by pre-dividing the coverage area of the intelligent equipment;
setting the display brightness of the screen according to the target area;
and setting a display format of the display elements according to the target area, wherein the display format comprises the number, the spacing and/or the size of the display elements.
8. The method of claim 6, wherein after determining the target operating mode of the smart device according to the distance, further comprising:
continuously acquiring the distance between the target and the intelligent equipment;
if the distance is within a preset boundary range, maintaining the current target working mode; wherein the distance threshold is within the boundary range, the boundary range including a lower limit value and an upper limit value;
when the target working mode is the near-field working mode, if the distance gradually increases and exceeds the upper limit value, switching from the near-field working mode to the far-field working mode;
and when the target working mode is the far-field working mode, if the distance gradually decreases and is lower than the lower limit value, switching from the far-field working mode to the near-field working mode.
9. The method of claim 6, wherein after controlling the smart device to perform the screen setting in the target operating mode, further comprising:
acquiring an operation instruction sent by the target;
and under the target working mode, providing services for the target according to the operation instruction.
10. The method according to claim 9, wherein when the operation command is a search command, the providing a service to the target according to the operation command in the target operation mode comprises:
extracting a search keyword from the search instruction;
searching the search keyword through a search engine to obtain a search result;
and displaying the search result on the intelligent equipment according to the requirement of the target working mode.
11. The utility model provides a search result display device of smart machine which characterized in that includes:
the control module is used for controlling the intelligent equipment to detect the target;
the acquisition module is used for acquiring the distance between the target and the intelligent equipment when the target is detected;
the determining module is used for determining a target working mode of the intelligent equipment according to the distance;
and the setting module is used for controlling the intelligent equipment to carry out screen setting in the target working mode.
12. A smart device comprising a processor and a memory;
wherein the processor executes a program corresponding to the executable program code by reading the executable program code stored in the memory, so as to implement the search result presentation method of the smart device according to any one of claims 1 to 10.
13. A computer program product, characterized in that instructions in the computer program product, when executed by a processor, implement a search result presentation method for a smart device according to any of claims 1-10.
14. A non-transitory computer-readable storage medium having stored thereon a computer program, wherein the program, when executed by a processor, implements a search result presentation method for a smart device according to any one of claims 1-10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810228840.1A CN108490797A (en) | 2018-03-20 | 2018-03-20 | The search result methods of exhibiting and device of smart machine |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810228840.1A CN108490797A (en) | 2018-03-20 | 2018-03-20 | The search result methods of exhibiting and device of smart machine |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108490797A true CN108490797A (en) | 2018-09-04 |
Family
ID=63318555
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810228840.1A Pending CN108490797A (en) | 2018-03-20 | 2018-03-20 | The search result methods of exhibiting and device of smart machine |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108490797A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109885164A (en) * | 2019-02-22 | 2019-06-14 | 北京猎户星空科技有限公司 | Smart machine control method, device and storage medium |
| CN110085191A (en) * | 2019-05-15 | 2019-08-02 | 京东方科技集团股份有限公司 | Display device and processor, processing method, driving method, storage medium and equipment |
| CN110933501A (en) * | 2020-01-22 | 2020-03-27 | 恒信东方文化股份有限公司 | Child eye protection method for TV device, TV device with child eye protection function and system |
| CN111124109A (en) * | 2019-11-25 | 2020-05-08 | 北京明略软件系统有限公司 | Interactive mode selection method, intelligent terminal, equipment and storage medium |
| CN111599148A (en) * | 2020-03-06 | 2020-08-28 | 维沃移动通信有限公司 | Electronic equipment and connection method thereof |
| CN112034750A (en) * | 2020-08-13 | 2020-12-04 | 四川虹美智能科技有限公司 | Control method of intelligent household appliance, electronic remote controller and electronic equipment |
| CN112732091A (en) * | 2021-01-20 | 2021-04-30 | 宁波视睿迪光电有限公司 | Display mode switching method and device and display system |
| CN112740119A (en) * | 2018-09-25 | 2021-04-30 | 三星电子株式会社 | AI voice assistant of wall clock |
| CN112949327A (en) * | 2019-12-11 | 2021-06-11 | 苏涛 | Projection font automatic adjustment platform and method |
| CN113029152A (en) * | 2021-03-20 | 2021-06-25 | 深圳市天策规划设计有限公司 | Intelligent imaging type indexing method, device, system, equipment and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102646408A (en) * | 2012-03-27 | 2012-08-22 | 华为技术有限公司 | Method and terminal for adjusting the font size |
| CN103246654A (en) * | 2012-02-03 | 2013-08-14 | 腾讯科技（深圳）有限公司 | Display processing method and display processing apparatus of search results |
| CN103631502A (en) * | 2013-10-31 | 2014-03-12 | 小米科技有限责任公司 | Display content adjusting method and device and electronic equipment |
| CN104270513A (en) * | 2014-09-22 | 2015-01-07 | 广东欧珀移动通信有限公司 | Mobile terminal screen brightness adjusting method and device |
| CN104598021A (en) * | 2014-12-16 | 2015-05-06 | 天津三星电子有限公司 | Display equipment and display method |
| CN105117023A (en) * | 2015-09-25 | 2015-12-02 | 京东方科技集团股份有限公司 | Automatic adjustment display system and adjusting method and device thereof |
| CN106325705A (en) * | 2016-08-09 | 2017-01-11 | 北京云知声信息技术有限公司 | Method and device for adjusting display style |
| CN205912235U (en) * | 2016-06-29 | 2017-01-25 | 江西联创宏声电子股份有限公司 | Intelligent sound box |
| US9672589B2 (en) * | 2011-09-29 | 2017-06-06 | Oki Data Infotech Corporation | Terminal device and drawing display program for terminal device |
| CN107037957A (en) * | 2016-11-03 | 2017-08-11 | 阿里巴巴集团控股有限公司 | A kind of display methods and device |
| CN107562180A (en) * | 2016-06-30 | 2018-01-09 | 华为终端（东莞）有限公司 | A kind of method for information display and terminal |
-
2018
- 2018-03-20 CN CN201810228840.1A patent/CN108490797A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9672589B2 (en) * | 2011-09-29 | 2017-06-06 | Oki Data Infotech Corporation | Terminal device and drawing display program for terminal device |
| CN103246654A (en) * | 2012-02-03 | 2013-08-14 | 腾讯科技（深圳）有限公司 | Display processing method and display processing apparatus of search results |
| CN102646408A (en) * | 2012-03-27 | 2012-08-22 | 华为技术有限公司 | Method and terminal for adjusting the font size |
| CN103631502A (en) * | 2013-10-31 | 2014-03-12 | 小米科技有限责任公司 | Display content adjusting method and device and electronic equipment |
| CN104270513A (en) * | 2014-09-22 | 2015-01-07 | 广东欧珀移动通信有限公司 | Mobile terminal screen brightness adjusting method and device |
| CN104598021A (en) * | 2014-12-16 | 2015-05-06 | 天津三星电子有限公司 | Display equipment and display method |
| CN105117023A (en) * | 2015-09-25 | 2015-12-02 | 京东方科技集团股份有限公司 | Automatic adjustment display system and adjusting method and device thereof |
| CN205912235U (en) * | 2016-06-29 | 2017-01-25 | 江西联创宏声电子股份有限公司 | Intelligent sound box |
| CN107562180A (en) * | 2016-06-30 | 2018-01-09 | 华为终端（东莞）有限公司 | A kind of method for information display and terminal |
| CN106325705A (en) * | 2016-08-09 | 2017-01-11 | 北京云知声信息技术有限公司 | Method and device for adjusting display style |
| CN107037957A (en) * | 2016-11-03 | 2017-08-11 | 阿里巴巴集团控股有限公司 | A kind of display methods and device |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112740119A (en) * | 2018-09-25 | 2021-04-30 | 三星电子株式会社 | AI voice assistant of wall clock |
| US11782391B2 (en) | 2018-09-25 | 2023-10-10 | Samsung Electronics Co., Ltd. | Wall clock AI voice assistant |
| CN112740119B (en) * | 2018-09-25 | 2023-08-22 | 三星电子株式会社 | Wall Clock AI Voice Assistant |
| CN109885164A (en) * | 2019-02-22 | 2019-06-14 | 北京猎户星空科技有限公司 | Smart machine control method, device and storage medium |
| US11646001B2 (en) | 2019-05-15 | 2023-05-09 | Boe Technology Group Co., Ltd. | Display device, data processor, data processing method, driving method, storage medium, and electronic device |
| CN110085191A (en) * | 2019-05-15 | 2019-08-02 | 京东方科技集团股份有限公司 | Display device and processor, processing method, driving method, storage medium and equipment |
| CN111124109B (en) * | 2019-11-25 | 2023-05-05 | 北京明略软件系统有限公司 | Interactive mode selection method, intelligent terminal, equipment and storage medium |
| CN111124109A (en) * | 2019-11-25 | 2020-05-08 | 北京明略软件系统有限公司 | Interactive mode selection method, intelligent terminal, equipment and storage medium |
| CN112949327A (en) * | 2019-12-11 | 2021-06-11 | 苏涛 | Projection font automatic adjustment platform and method |
| CN110933501B (en) * | 2020-01-22 | 2020-05-22 | 恒信东方文化股份有限公司 | Child eye protection method for TV device, TV device with child eye protection function and system |
| CN110933501A (en) * | 2020-01-22 | 2020-03-27 | 恒信东方文化股份有限公司 | Child eye protection method for TV device, TV device with child eye protection function and system |
| CN111599148A (en) * | 2020-03-06 | 2020-08-28 | 维沃移动通信有限公司 | Electronic equipment and connection method thereof |
| CN112034750A (en) * | 2020-08-13 | 2020-12-04 | 四川虹美智能科技有限公司 | Control method of intelligent household appliance, electronic remote controller and electronic equipment |
| CN112732091A (en) * | 2021-01-20 | 2021-04-30 | 宁波视睿迪光电有限公司 | Display mode switching method and device and display system |
| CN113029152A (en) * | 2021-03-20 | 2021-06-25 | 深圳市天策规划设计有限公司 | Intelligent imaging type indexing method, device, system, equipment and storage medium |
| CN113029152B (en) * | 2021-03-20 | 2024-05-31 | 深圳市天策规划设计有限公司 | Intelligent imaging type indexing method, device, system, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108490797A (en) | The search result methods of exhibiting and device of smart machine | |
| CN110121118B (en) | Video clip positioning method and device, computer equipment and storage medium | |
| US10218899B2 (en) | Control method in image capture system, control apparatus and a non-transitory computer-readable storage medium | |
| KR101300400B1 (en) | Method, apparatus and computer-readble storage medium for providing adaptive gesture analysis | |
| CN110807361B (en) | Human body identification method, device, computer equipment and storage medium | |
| CN105229582B (en) | Gesture detection based on proximity sensor and image sensor | |
| CN110097576B (en) | Motion information determination method of image feature point, task execution method and equipment | |
| CN110570460B (en) | Target tracking method, device, computer equipment and computer readable storage medium | |
| US10721431B2 (en) | Method for estimating a timestamp in a video stream and method of augmenting a video stream with information | |
| CN108881544B (en) | Photographing method and mobile terminal | |
| EP3748533A1 (en) | Method, apparatus, and storage medium for obtaining object information | |
| WO2015003606A1 (en) | Method and apparatus for recognizing pornographic image | |
| CN109558000B (en) | Man-machine interaction method and electronic equipment | |
| CN112135034A (en) | Photographing method and device based on ultrasonic waves, electronic equipment and storage medium | |
| CN114267041B (en) | Method and device for identifying object in scene | |
| EP3438875A1 (en) | Image processing apparatus and control method therefor | |
| US20240361449A1 (en) | Techniques for generating motion information for videos | |
| CN113627413B (en) | Data labeling method, image comparison method and device | |
| EP2282224B1 (en) | Image processing apparatus, image processing method, and computer program | |
| US9558563B1 (en) | Determining time-of-fight measurement parameters | |
| CN111986229A (en) | Video target detection method, device and computer system | |
| CN104866163B (en) | Image display method, device and electronic equipment | |
| CN114647983A (en) | Display device and distance detection method based on portrait | |
| KR101886856B1 (en) | System and method for data combining based on result of non-rigid object tracking on multi-sensor seeker | |
| CN111221486A (en) | Information display system and information display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180904 |
|
| RJ01 | Rejection of invention patent application after publication |