CN109164917B - Electronic device control method, storage medium, and electronic device - Google Patents
Electronic device control method, storage medium, and electronic device Download PDFInfo
- Publication number
- CN109164917B CN109164917B CN201810998314.3A CN201810998314A CN109164917B CN 109164917 B CN109164917 B CN 109164917B CN 201810998314 A CN201810998314 A CN 201810998314A CN 109164917 B CN109164917 B CN 109164917B
- Authority
- CN
- China
- Prior art keywords
- pixel
- signal
- change
- brightness
- electronic device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The application discloses an electronic device control method, a storage medium and an electronic device. The method comprises the following steps: obtaining a pixel brightness signal of at least one photosensitive sub-pixel through the light sensor; determining, by the processor, from the pixel luminance signal, whether the obtained pixel luminance signals of the sensor sub-pixel at least two moments in time indicate that there is an ambient luminance change; determining, by the processor, a movement trajectory of an object according to the pixel brightness signal indicating that there is an ambient brightness change if there is the brightness change; and controlling the electronic equipment to execute corresponding operation response according to the movement track through the processor. The algorithm is simple, consumption of hardware resources in the algorithm operation process is reduced, and power consumption of the electronic equipment is further reduced.
Description
Technical Field
The present application relates to the field of data processing, and in particular, to an electronic device control method, a storage medium, and an electronic device.
Background
Electronic devices today have a variety of different functions that require a user to operate a trigger via a button or touch screen.
For the convenience of use of the user, the electronic device can acquire a gesture image of the user through the image sensor, and the image is recognized through an algorithm to determine an operation response corresponding to the gesture, so that the user only needs to swing the gesture in front of the image sensor of the electronic device to execute the corresponding operation response.
However, in order to recognize the gesture of the user, the electronic device needs to perform calculation through a complex algorithm, which consumes a large amount of hardware resources, and further increases the power consumption of the electronic device.
Disclosure of Invention
The embodiment of the application provides an electronic device control method, a storage medium and an electronic device, which can reduce the power consumption of the electronic device.
The embodiment of the application provides an electronic equipment control method, which is applied to electronic equipment, wherein the electronic equipment comprises a light sensor and a processor electrically connected with the light sensor, the light sensor comprises a pixel array consisting of a plurality of photosensitive sub-pixels, and the method comprises the following steps:
obtaining a pixel brightness signal of at least one photosensitive sub-pixel through the light sensor;
determining, by the processor, from the pixel luminance signal, whether the obtained pixel luminance signals of the sensor sub-pixel at least two moments in time indicate that there is an ambient luminance change;
determining, by the processor, a movement trajectory of an object according to the pixel brightness signal indicating that there is an ambient brightness change if there is the brightness change;
and controlling the electronic equipment to execute corresponding operation response according to the movement track through the processor.
An embodiment of the present application provides an electronic device, including:
the light sensor comprises a pixel array consisting of a plurality of photo-sensing sub-pixels and is used for obtaining a pixel brightness signal of at least one photo-sensing sub-pixel;
the signal comparison circuit is connected with the light sensor and used for determining whether the pixel brightness signals of the obtained photosensitive sub-pixel at least two moments indicate that environmental brightness change exists or not according to the pixel brightness signals; and
the processor is connected with the signal comparison circuit and used for determining the moving track of the object according to the pixel brightness signal indicating that the ambient brightness changes if the brightness changes; and controlling the electronic equipment to execute corresponding operation response according to the movement track.
The embodiment of the application provides a storage medium, wherein a computer program is stored on the storage medium, and when the computer program is executed on a computer, the computer is enabled to execute the steps in the electronic device control method provided by the embodiment of the application.
In the embodiment of the application, the moving track of the object is determined according to the pixel brightness signal indicating that the environmental brightness changes, and the electronic equipment is controlled to execute the corresponding operation response according to the moving track, so that the image recognition algorithm only needs to calculate by using part of the pixel brightness signal indicating that the environmental brightness changes so as to obtain the outline of the image, the algorithm is simple, the consumption of hardware resources in the algorithm running process is reduced, and the power consumption of the electronic equipment is further reduced.
Drawings
The technical solution and the advantages of the present invention will be apparent from the following detailed description of the embodiments of the present invention with reference to the accompanying drawings.
Fig. 1 is a flowchart of an implementation of an electronic device control method provided in an embodiment of the present application.
Fig. 2 is an application scenario diagram of an electronic device control method provided in an embodiment of the present application.
Fig. 3 is a schematic flowchart of determining a moving track of an object according to an embodiment of the present disclosure.
Fig. 4 is another schematic flow chart of determining a moving trajectory of an object according to an embodiment of the present application.
Fig. 5 is a schematic structural diagram for determining coordinates of a target pixel according to an embodiment of the present disclosure.
Fig. 6 is a functional structure block diagram of an electronic device according to an embodiment of the present application.
Fig. 7 is a block diagram of another functional structure of an electronic device according to an embodiment of the present application.
Fig. 8 is a schematic structural diagram of a signal comparison circuit according to an embodiment of the present application.
Fig. 9 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
Referring to the drawings, wherein like reference numbers refer to like elements, the principles of the present invention are illustrated as being implemented in a suitable computing environment. The following description is based on illustrated embodiments of the invention and should not be taken as limiting the invention with regard to other embodiments that are not detailed herein.
The embodiment of the application provides an electronic device control method, a storage medium and an electronic device. The details will be described below separately. The electronic device can be a smart phone, a tablet computer and the like.
The electronic device in this embodiment of the application may include a Smart Phone (Smart Phone), or a portable Computer with a wireless communication module, for example, a Tablet Computer (Tablet Computer), a notebook Computer (Laptop), or the like, and may also be a wearable and handheld Computer, such as a Smart wearable device (Smart weber), a Personal Digital Assistant (PDA), or the like, which is not limited herein.
When the method is applied to the electronic device, wherein the electronic device control method may be run in an operating system of the electronic device, and may include but is not limited to a Windows operating system, a Mac OS operating system, an Android operating system, an IOS operating system, a Linux operating system, an Ubuntu operating system, a Windows Phone operating system, and the like, which is not limited in the embodiment of the present application. The embodiment of the application provides an electronic device control method, a storage medium and an electronic device. The details will be described below separately.
The electronic device control method may be applied to an electronic device, which may be the electronic device mentioned in the above embodiments.
The electronic device comprises a light sensor and a processor electrically connected with the light sensor, wherein the light sensor comprises a pixel array consisting of a plurality of photosensitive sub-pixels.
The light sensor is a sensitive element with response or conversion function to external light signals or light radiation, and can detect intensity change of the light signals or the light radiation. In some embodiments, the light sensor may be a photo-electric tube, a photo-multiplier tube, a photo-resistor, a photo-transistor, an infrared sensor, an ultraviolet sensor, or a fiber optic photo-sensor. In other embodiments, the light sensor may also be a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor. Of course, the kind of the light sensor may not be limited thereto, and may be other light sensing devices not listed.
The light sensor comprises a pixel array consisting of a plurality of photosensitive sub-pixels. Specifically, each photosensitive sub-pixel can independently output different level signals according to different optical signal intensities, and parameter values of the level signals correspond to the sensed different optical signal intensities.
For example, the level signal corresponding to the first light intensity value is a first signal value, the level signal corresponding to the second light intensity value is a second signal value, and if the first light intensity value is greater than the second light intensity value, the first signal value is greater than/less than the second signal value.
It is understood that, besides the difference of the signal values, other signal characteristics may be used to correspond to different light intensity values, such as waveform/frequency characteristics, and the like, which are not limited herein. The number of the photosensitive sub-pixels is two or more, and the specific arrangement mode of the pixel array formed by the photosensitive sub-pixels can be set according to actual needs.
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating an electronic device control method according to an embodiment of the present disclosure. The electronic device control method may include:
101. and obtaining a pixel brightness signal of at least one photosensitive sub-pixel through the light sensor.
The light sensor can sense the intensity of light signals or light radiation of the external environment where the electronic device is located through the arranged light-sensitive subunit. When the photosensitive sub-pixel senses that the light signal or the light radiation exists in the environment, a pixel brightness signal corresponding to the intensity of the light signal or the light radiation is generated.
The pixel luminance signal may vary with different current, voltage, etc., depending on the intensity of the light signal or light radiation.
Each photosensitive sub-pixel may include a pixel brightness signal at one or more time instants, and each pixel brightness signal has a corresponding generation time instant.
For example, in the same sensor sub-pixel, the first time corresponds to a first pixel luminance signal obtained at the first time, and the second time corresponds to a second pixel luminance signal obtained at the second time, and the first pixel luminance signal and the second pixel luminance signal may be the same or different.
102. Determining, by the processor, from the pixel luminance signal, whether the obtained pixel luminance signals of the photosensitive sub-pixels at least two moments in time indicate the presence of an ambient luminance change.
Wherein the time refers to a certain time point, for example, 6 o' clock. The specific time position can be determined according to actual conditions.
The photosensitive sub-pixels generate pixel brightness signals at corresponding moments according to the ambient brightness at different moments.
In some embodiments, since the parameter value of the pixel luminance signal is related to the intensity value of the detected light signal or light radiation, it can be determined whether there is a change in the ambient luminance at least two moments by comparing the obtained pixel luminance signals of the photosensitive sub-pixel at least two moments and determining whether the parameter values of the pixel luminance signals at the at least two moments are different or whether the difference between the parameter values is smaller than or equal to a preset value.
Specifically, comparing the obtained pixel luminance signals of the photosensitive sub-pixels at least two moments, may be performed by comparing two or more pixel luminance signals according to a preset algorithm in a processor of the electronic device, so as to determine whether a difference exists or obtain a difference value.
For example, if the voltage value of the pixel luminance signal at the first time is 0.3V and the voltage value of the pixel luminance signal at the second time is 0.5V, the voltage values of the pixel luminance signals at the two times are compared by the processor, and it can be determined that the pixel luminance signals at the two times are different values, that is, it indicates that there is a change in the ambient luminance at the two times.
103. And determining the moving track of the object according to the pixel brightness signal indicating that the ambient brightness changes if the ambient brightness changes are indicated by the processor.
The object may be a hand of a human body, or other parts of the human body, or other objects except the human body. The specific definition can be determined according to actual conditions.
The moving track of the object may include a displacement direction, a path, and the like of the object during the moving process.
With reference to fig. 2, an application scenario of the electronic device control method provided in the embodiment of the present application is shown in the figure.
In the application scenario, an object state a1 of the actual environment at a time period of T1, an object state a2 at a time period of T2 are included; and an array pattern B1 of pixel luminance signals obtained during a period T1, and an array pattern B2 of pixel luminance signals obtained during a period T2 from the light sensor. Wherein the period T1 is earlier in time than the period T2.
In the array diagram of the pixel brightness signal obtained by the light sensor, the light sensor includes a plurality of photosensitive sub-pixels, and each grid in the diagram corresponds to a coordinate position of a photosensitive sub-pixel.
The object of the actual environment is a spherical object that changes from a first state (dotted line portion) at a first time to a second state (solid line portion) at a second time in a period T1.
In this process, the photosensitive sub-pixel can detect a change in luminance at the edge portion of the object due to the movement of the object.
For example, when an object is located between the light source and the photosensitive sub-pixel, the photosensitive sub-pixel may obtain a weaker light signal or light radiation intensity; when the edge of the object moves out of the position between the light source and the photosensitive sub-pixel, the photosensitive sub-pixel at the edge of the detected object obtains a stronger light signal (located between the light source and the photosensitive sub-pixel relative to the object) or the intensity of the light radiation because there is no blocking of the object, so that the parameter value of the pixel brightness signal obtained by the photosensitive sub-pixel at the corresponding position changes.
Alternatively, when the edge of the object moves from a position outside the light source and the photosensitive sub-pixel to a position between the light source and the photosensitive sub-pixel, the intensity of the light signal or the light radiation signal detected by the photosensitive sub-pixel changes from strong to weak, that is, the ambient brightness detected by the photosensitive sub-pixel changes.
In some embodiments, determining a movement trajectory of the object from the pixel luminance signal indicating the presence of the ambient luminance variation may include:
determining target pixel coordinates for each light-sensitive sub-pixel indicating the presence of ambient brightness variations over at least two time periods; and determining the moving track of the object according to the target pixel coordinates of at least two time periods.
If there is a pixel brightness signal indicating that there is an ambient brightness change in a certain period of time, the position of the pixel brightness signal corresponding to the sensor sub-pixel may be defined as a target pixel coordinate.
By comparing the target pixel coordinates of at least two time periods, information related to the change rule of the target pixel coordinates can be obtained, and then the moving track of the object in at least two time periods can be obtained through the information.
In some embodiments, as shown in fig. 2, after it is determined that a photosensitive sub-pixel in fig. 2 detects an ambient brightness change, the position of the photosensitive sub-pixel where the ambient brightness change is detected may be marked as a target pixel coordinate.
In the period T1, if the object in the position a1 changes from the first state to the second state, the edge position of the object changes due to the brightness, and the brightness signals of the pixels at two moments obtained by the photosensitive sub-pixels at the corresponding positions of the light sensor are also different. The photosensitive sub-pixels with the pixel brightness signal varying can be labeled at this time, thereby forming an array diagram as shown in B1.
Similarly, in the period T2, if the object at a2 changes from the first state to the second state, the photosensitive sub-pixels with the changed pixel brightness signals can be marked, so as to form the array diagram as shown in B2.
By comparing the change characteristics of the target pixel coordinates in the array diagrams of B1 and B2, only the change characteristics of the target pixel coordinates can be calculated through an algorithm, and the moving track of the object in the time period from T1 to T2, that is, the object moves to the lower edge in fig. 2, compared with the prior art that the moving track of the object is calculated by using a high-quality color image acquired by a camera, the method can greatly reduce the calculation amount of the algorithm, improve the processing efficiency, and reduce the power consumption of the electronic device in the process.
104. And controlling the electronic equipment to execute corresponding operation response according to the movement track through the processor.
The operation response may be a preset operation response defined by a human.
In some embodiments, the operational response may include one or more operational responses of the electronic device to turn on a screen, unlock the device, turn off the screen, launch a preset application, screen capture, or perform a system function.
For example, if the object is a hand of a human body, a mapping relationship is established between the operation of moving the hand of the human body to the left with respect to the electronic device and the operation of turning on the screen of the electronic device. At this time, if the electronic device detects that the moving track of the object is a left stroke relative to the electronic device, the screen of the electronic device is turned on.
Correspondingly, the detected different movement tracks can be associated with different operation responses of the electronic equipment, so that various different operations can be performed on the electronic equipment only through gestures, and the operation efficiency is improved.
Therefore, the moving track of the object is determined according to the pixel brightness signal indicating that the environmental brightness changes, and the electronic equipment is controlled to execute corresponding operation response according to the moving track, so that the image recognition algorithm only needs to calculate by using part of the pixel brightness signal indicating that the environmental brightness changes to obtain the outline of the image, the algorithm is simple, the consumption of hardware resources in the algorithm running process is reduced, and the power consumption of the electronic equipment is further reduced.
In some embodiments, please refer to fig. 3, which illustrates an implementation process of determining a moving track of an object according to an embodiment of the present application.
Determining the moving track of the object according to the target pixel positions of at least two time instants may include:
201. and obtaining the outline of the object according to the target pixel coordinates in the same time period.
If there is a pixel luminance signal indicating that there is an ambient luminance change at a certain time, the position of the sensor sub-pixel corresponding to the pixel luminance signal may be defined as a target pixel coordinate.
In some embodiments, the target pixel coordinates of the photosensitive sub-pixels that produce a luminance change in the same period may be arranged according to the pixel array position of the light sensor to obtain an array diagram of the target pixel coordinates as shown in fig. 2.
After the array map of the target pixel coordinates is obtained, the outline of the object can be formed according to the positional relationship of the target pixel coordinates. Specifically, since the edge position of the object is easily affected by the movement of the object and changes in brightness occur in a short time, the approximate contour of the object can be calculated by an algorithm by analyzing the position of the target pixel coordinate.
For example, as shown in fig. 2, by analyzing the position of the target pixel coordinates in the array diagram, the contour of the object can be roughly determined to be a circular object.
202. The change in position of the contour over at least two time periods is determined.
The position change condition may include parameters such as a displacement direction and a distance of the object.
Specifically, as shown in fig. 2, the position change of the object can be determined by the object contour formed by the target pixel coordinates between the T1 period to the T2 period, by the array map B1 in the T1 period and the array map B2 in the T2 period.
For example, as shown in fig. 2, when the contour of the object is determined to be a circle, the position of the center of the circle may be determined, and the position change of the contour between the T1 period and the T2 period may be obtained by comparing the positions of the centers of the contour of the T1 period and the T2 period.
203. And determining the moving track of the object according to the position change condition.
As shown in fig. 2, since the contour of the object formed by the target pixel coordinates has a corresponding relationship with the shape of the object, by analyzing the position change of the contour between the T1 period and the T2 period, the movement locus of the object can be determined at the same time.
Therefore, the contour of the object is obtained through the target pixel coordinates in the same time period, and the movement track of the object can be determined according to the position change condition of the contour determined in at least two time periods, so that the movement track of the object can be obtained by only calculating the change characteristic of the target pixel coordinates through the algorithm, the calculation amount of the algorithm is further reduced, the processing efficiency is improved, and the power consumption of the electronic equipment is reduced.
In some embodiments, please refer to fig. 4, which illustrates another implementation process for determining a moving track of an object according to an embodiment of the present application.
Determining the moving track of the object according to the target pixel positions of at least two time instants may include:
301. and obtaining the outline of the object according to the target pixel coordinates in the same time period.
If there is a pixel luminance signal indicating that there is an ambient luminance change at a certain time, the position of the sensor sub-pixel corresponding to the pixel luminance signal may be defined as a target pixel coordinate.
In some embodiments, the target pixel coordinates of the photosensitive sub-pixels that produce a luminance change in the same period may be arranged according to the pixel array position of the light sensor to obtain an array diagram of the target pixel coordinates as shown in fig. 2.
After the array map of the target pixel coordinates is obtained, the outline of the object can be formed according to the positional relationship of the target pixel coordinates. Specifically, since the edge position of the object is easily affected by the movement of the object and changes in brightness occur in a short time, the approximate contour of the object can be calculated by an algorithm by analyzing the position of the target pixel coordinate.
For example, as shown in fig. 2, by analyzing the position of the target pixel coordinates in the array diagram, the contour of the object can be roughly determined to be a circular object.
302. Object recognition is performed on the contour to determine object properties of the contour.
Wherein the object attribute may refer to a kind of an object, such as a soccer ball, a hand of a human body, and the like.
By analyzing the position of the target pixel coordinates in the array map, the contour can be subject to object recognition using an algorithm to determine the object attributes of the object.
For example, if a hand of a human body is stroked in front of the light sensor, the contour of the hand can be obtained by analyzing the array map corresponding to the target pixel coordinates in the same time period. And image recognition is carried out on the outline to obtain that the object is the hand of the human body.
303. Judging whether the object corresponding to the object attribute is a target object or not; if so, determining the movement track of the object according to the position change of the contour in at least two time periods; if not, the response is ended.
If the preset target object is the hand of the human body, the step of determining the movement track of the object according to the position change of the contour in at least two periods is executed only when the object attribute corresponding to the detected contour is the hand of the human body. If other objects are stroked across the light sensor, no response is made. Therefore, the interference of other objects can be avoided, and the number of times of false response is reduced, so that the power consumption of the electronic equipment is further reduced.
304. Determining the movement track of the object according to the position change of the contour in at least two periods.
As shown in fig. 2, since the contour of the object formed by the target pixel coordinates has a corresponding relationship with the shape of the object, by analyzing the position change of the contour between the T1 period and the T2 period, the movement locus of the object can be determined at the same time.
As can be seen from the above, compared with the scheme in fig. 3, the scheme further reduces the calculation amount of the algorithm, improves the processing efficiency, and reduces the power consumption of the electronic device, and can perform the object recognition on the contour, and only when the contour is recognized as the target object, the steps are performed. The mode can effectively avoid the interference of other objects and reduce the times of false response, thereby further reducing the power consumption of the electronic equipment.
In some embodiments, please refer to fig. 5, which illustrates steps for implementing a pixel luminance signal for determining the presence of ambient luminance variation according to embodiments of the present application.
Determining, from the pixel luminance signal, whether the obtained pixel luminance signals of the photosensitive sub-pixels at least two moments in time indicate the presence of an ambient luminance change may include:
401. and acquiring signal parameters of at least two pixel brightness signals of the photosensitive sub-pixel at least two moments, wherein the moments of acquiring the pixel brightness signals correspond to the signal parameters of the pixel brightness signals one to one.
For example, in the same sensor sub-pixel, the first time corresponds to a first pixel luminance signal obtained at the first time, and the second time corresponds to a second pixel luminance signal obtained at the second time, and the first pixel luminance signal and the second pixel luminance signal may be the same or different.
402. And judging whether the signal parameters meet preset conditions or not, wherein the preset conditions comprise that at least two signal parameters are different, or the difference value between at least two signal parameters is larger than a preset threshold value.
The pixel brightness signal can have different current, voltage and the like according to different intensities of the light signal or the light radiation. The signal parameter may be a voltage, a current, a waveform, a frequency, or the like of the pixel luminance signal, and the specific parameter type may be determined according to actual situations.
In some embodiments, a difference between two signal parameters may be calculated, and whether a preset condition is satisfied is determined by whether the difference is greater than a preset threshold.
For example, if the voltage value of the pixel luminance signal at the first time is 0.3V and the voltage value of the pixel luminance signal at the second time is 0.5V, the difference between the pixel luminance signals at the two times can be determined to be 0.2V by comparing the voltage values of the pixel luminance signals at the two times with the processor, and if the preset threshold is 0.1V, the difference between the signal parameters of the two pixel luminance signals can be determined to be greater than the preset threshold, so that the preset condition is satisfied.
And if the preset condition is met, defining that the pixel brightness signals acquired by the photosensitive sub-pixel at least two moments indicate that the ambient brightness changes.
403. And if the signal parameters meet preset conditions, generating a change signal corresponding to the photosensitive sub-pixel, otherwise, not generating.
The change signal is used for indicating that the pixel brightness signals acquired by the photosensitive sub-pixels at least two moments indicate that the ambient brightness changes. The variation signal may be of a certain algebraic number or of a certain signal parameter.
If the signal parameters do not meet the preset conditions, the change signal is not generated, and the phenomenon that excessive information parameters increase the calculation amount of the algorithm is avoided, so that the calculation efficiency is further improved.
If the brightness change exists, determining a moving track of the object according to the pixel brightness signal indicating that the ambient brightness change exists, which may include:
404. and determining the target pixel coordinates of the photosensitive sub-pixels corresponding to the change signals according to the change signals.
In some embodiments, in order to reduce the number of false responses of the electronic device, determining the target pixel coordinates of the photosensitive sub-pixel corresponding to the change signal according to the change signal includes:
judging whether the number of the photosensitive sub-pixels generating the change signal meets a preset trigger condition or not;
if yes, determining the target pixel coordinates of the photosensitive sub-pixels corresponding to the change signals;
if not, the generated change signal is not responded.
The preset triggering condition can trigger according to the number of the photosensitive sub-pixels.
For example, if the preset trigger condition is: there are more than 100 sensitive sub-pixels to which the variation signal corresponds. The target pixel coordinates of the photosensitive sub-pixel corresponding to the change signal are determined only when the moving amplitude of the object is large and the number of photosensitive sub-pixels corresponding to the change signal generated in the same time period is larger than 100.
Therefore, the number of times of false responses can be further avoided, and the power consumption of the electronic equipment is further reduced.
Therefore, the change signal is generated only when the signal parameters meet the preset conditions, and the target pixel coordinate is determined according to the change signal, so that the calculation efficiency can be effectively improved, and the power consumption of the electronic equipment can be reduced.
Referring to fig. 6, a functional structure block diagram of an electronic device according to an embodiment of the present application is shown.
In fig. 6, the electronic device includes a light sensor 510, a signal comparison circuit 520, and a processor 530, wherein:
the light sensor 510 includes a pixel array composed of a plurality of photo-sensing sub-pixels for obtaining a pixel luminance signal of at least one photo-sensing sub-pixel.
The light sensor can sense the intensity of light signals or light radiation of the external environment where the electronic device is located through the arranged light-sensitive subunit. When the photosensitive sub-pixel senses that the light signal or the light radiation exists in the environment, a pixel brightness signal corresponding to the intensity of the light signal or the light radiation is generated.
The pixel luminance signal may vary with different current, voltage, etc., depending on the intensity of the light signal or light radiation.
Each photosensitive sub-pixel may include a pixel brightness signal at one or more time instants, and each pixel brightness signal has a corresponding generation time instant.
And the signal comparison circuit is connected with the light sensor and used for determining whether the obtained pixel brightness signals of the photosensitive sub-pixels at least two moments indicate that the ambient brightness changes or not according to the pixel brightness signals.
Wherein the time refers to a certain time point, for example, 6 o' clock. The specific time position can be determined according to actual conditions.
The photosensitive sub-pixels generate pixel brightness signals at corresponding moments according to the ambient brightness at different moments.
In some embodiments, since the parameter value of the pixel luminance signal is related to the intensity value of the detected light signal or light radiation, it can be determined whether there is a change in the ambient luminance at least two moments by comparing the obtained pixel luminance signals of the photosensitive sub-pixel at least two moments and determining whether the parameter values of the pixel luminance signals at the at least two moments are different or whether the difference between the parameter values is smaller than or equal to a preset value.
Specifically, comparing the obtained pixel luminance signals of the photosensitive sub-pixels at least two moments, may be performed by comparing two or more pixel luminance signals according to a preset algorithm in a processor of the electronic device, so as to determine whether a difference exists or obtain a difference value.
The processor is connected with the signal comparison circuit and used for determining the moving track of the object according to the pixel brightness signal indicating that the ambient brightness changes if the brightness changes; and controlling the electronic equipment to execute corresponding operation response according to the movement track.
The object may be a hand of a human body, or other parts of the human body, or other objects except the human body. The specific definition can be determined according to actual conditions.
The moving track of the object may include a displacement direction, a path, and the like of the object during the moving process.
In some embodiments, determining a movement trajectory of the object from the pixel luminance signal indicating the presence of the ambient luminance variation may include:
determining target pixel coordinates for each light-sensitive sub-pixel indicating the presence of ambient brightness variations over at least two time periods; and determining the moving track of the object according to the target pixel coordinates of at least two time periods.
If there is a pixel brightness signal indicating that there is an ambient brightness change in a certain period of time, the position of the pixel brightness signal corresponding to the sensor sub-pixel may be defined as a target pixel coordinate.
By comparing the target pixel coordinates of at least two time periods, information related to the change rule of the target pixel coordinates can be obtained, and then the moving track of the object in at least two time periods can be obtained through the information.
The operation response may be a preset operation response defined by a human.
In some embodiments, the operational response may include one or more operational responses of the electronic device to turn on a screen, unlock the device, turn off the screen, launch a preset application, screen capture, or perform a system function.
Correspondingly, the detected different movement tracks can be associated with different operation responses of the electronic equipment, so that various different operations can be performed on the electronic equipment only through gestures, and the operation efficiency is improved.
Therefore, the pixel brightness signals are compared through the signal comparison circuit, whether the photosensitive sub-pixels with brightness changes exist can be determined through simpler hardware, and only when the ambient brightness changes are determined after comparison, the signals are processed through the processor, so that the moving track of an object is obtained, consumption of hardware resources in the algorithm running process can be reduced, and power consumption of electronic equipment is further reduced.
Referring to fig. 7, a block diagram of another functional structure of an electronic device according to an embodiment of the present application is shown.
The electronic device includes: the optical sensor 510, the delay circuit 521, the comparison circuit 522, the buffer 540 and the processor 530.
The signal comparison circuit includes a delay circuit 521 and a comparison circuit 522.
In some embodiments, the delay circuit is connected to the output end of the light sensor, and is configured to delay and output the pixel brightness signal at the current time;
and the comparison circuit is connected with the output end of the light sensor and the output end of the delay circuit and is used for acquiring the pixel brightness signal at the current moment and the pixel brightness signal at the previous moment after being delayed by the delay circuit, judging whether the pixel brightness signals at the two moments are different or not, and outputting a target level signal if the pixel brightness signals at the two moments are different.
The target level signal may be a pulse signal or a level signal of a specific level value. It will be appreciated that the specific form of the target level signal and the values of the specific level values exemplified may be determined according to the actual situation.
In some embodiments, please refer to fig. 8, which illustrates a specific circuit structure of a signal comparison circuit according to an embodiment of the present application.
The circuit structure comprises a photosensitive sub-pixel D1, wherein one end of the photosensitive sub-pixel D1 is connected with an inductor, and the other end of the photosensitive sub-pixel D1 is grounded. The light sensing sub-pixel D1 may be made of a light sensitive element.
The input end of the delay circuit is connected to the photosensitive subpixel D1, specifically, one end of an inductor L1 of the delay circuit is connected to the photosensitive subpixel D1, the other end of the inductor L1 is connected to the input end of the delay element a1, and the middle positions of the inductor L1 and the delay element a1 are grounded through a capacitor C1. The delay circuit is used for delaying the current pixel brightness signal of the photosensitive sub-pixel D1 and outputting the delayed current pixel brightness signal to the comparison circuit.
The comparison circuit comprises a comparator, wherein a first input end of the comparator is directly connected with the photosensitive sub-pixel D1, a second input end of the comparator is connected with an output end of the delay circuit, so that whether a difference exists between the pixel brightness signals at the current moment and the pixel brightness signal at the previous moment delayed by the delay circuit is judged, and a target level signal is output when the difference exists between the two pixel brightness signals.
It is understood that the circuit structure shown in fig. 8 is only an example, and other circuit implementations may be adopted according to actual situations.
In some embodiments, the processor 530 is further configured to:
obtaining the outline of the object according to the target pixel coordinates in the same time period;
determining a change in position of the profile over the at least two time periods;
and determining the moving track of the object according to the position change condition.
In some embodiments, the processor 530 is further configured to:
obtaining the outline of the object according to the target pixel coordinates in the same time period;
performing object recognition on the contour to determine object properties of the contour;
judging whether the object corresponding to the object attribute is a target object or not;
if yes, determining the moving track of the object according to the position change of the contour in the at least two time periods.
In some embodiments, the processor 530 is further configured to:
judging whether the quantity of the photon sensing pixels generating the target level signal meets a preset trigger condition or not;
if yes, determining the target pixel coordinates of the photosensitive sub-pixels corresponding to the change signals;
and if not, not responding to the generated change signal.
In some embodiments, the register 540 is connected between the comparing circuit 522 and the processor 530, and is used for storing at least one of the target level signals;
the at least one target level signal is divided according to time, the at least one target level signal may include at least one target level signal at a time, and the at least one target level signal at the same time period may include at least one target level signal.
The buffer 540 may facilitate the processor 530 to process the target level signal by buffering the target level signals, so as to obtain a more timely determination result of the movement trajectory of the object.
Therefore, by detecting the target level signal, the object contour can be obtained by using the position of the photosensitive sub-pixel corresponding to the target level signal, and the image can be obtained by using the contour calculation, so that the calculation amount of the processor is greatly reduced, the signals are calculated by using the algorithm only when the ambient brightness changes, and the power consumption of the electronic equipment can be greatly reduced.
Referring to fig. 9, in some embodiments, the electronic device 600 may further include: a display 603, a radio frequency circuit 604, an audio circuit 605, and a power supply 606. The display 603, the rf circuit 604, the audio circuit 605 and the power supply 606 are electrically connected to the processor 601, respectively.
The display 603 may be used to display information entered by or provided to the user as well as various graphical user interfaces, which may be made up of graphics, text, icons, video, and any combination thereof. The Display 603 may include a Display panel, and in some embodiments, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The rf circuit 604 may be used for transceiving rf signals to establish wireless communication with a network device or other electronic devices via wireless communication, and for transceiving signals with the network device or other electronic devices.
The audio circuit 605 may be used to provide an audio interface between the user and the electronic device through a speaker, microphone.
The power supply 606 may be used to power various components of the electronic device 600. In some embodiments, the power supply 606 may be logically connected to the processor 601 through a power management system, so as to implement functions of managing charging, discharging, and power consumption management through the power management system.
Although not shown in fig. 9, the electronic device 600 may further include a camera, a bluetooth module, and the like, which are not described in detail herein.
An embodiment of the present application further provides a storage medium, where the storage medium stores a computer program, and when the computer program runs on a computer, the computer is caused to execute the electronic device control method in any one of the above embodiments, for example:
obtaining a pixel brightness signal of at least one photosensitive sub-pixel through the light sensor; determining, by the processor, from the pixel luminance signal, whether the obtained pixel luminance signals of the sensor sub-pixel at least two moments in time indicate that there is an ambient luminance change; determining, by the processor, a movement trajectory of an object according to the pixel brightness signal indicating that there is an ambient brightness change if there is the brightness change; and controlling the electronic equipment to execute corresponding operation response according to the movement track through the processor.
In the embodiment of the present application, the storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
The electronic device provided in the embodiment of the present application and the electronic device control method in the above embodiments belong to the same concept, and any method provided in the electronic device control method embodiment may be run on the electronic device, and a specific implementation process thereof is described in the electronic device control method embodiment in detail, and is not described herein again.
The foregoing describes in detail an electronic device control method, a storage medium, and an electronic device provided in an embodiment of the present application, and a specific example is applied in the present application to explain the principle and the implementation of the present invention, and the description of the foregoing embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (9)
1. An electronic device control method, wherein the electronic device includes a light sensor and a processor electrically connected to the light sensor, the light sensor includes a pixel array composed of a plurality of photosensitive sub-pixels, the method comprising:
obtaining a pixel brightness signal of at least one photosensitive sub-pixel through the light sensor, wherein each photosensitive sub-pixel independently outputs different level signals according to different light signal intensities, the parameter values of the level signals correspond to the sensed different light signal intensities, each photosensitive sub-pixel comprises pixel brightness signals at a plurality of moments, and each pixel brightness signal has a corresponding generation moment;
determining, by the processor, from the pixel luminance signal, whether the obtained pixel luminance signals of the sensor sub-pixel at least two moments in time indicate that there is an ambient luminance change;
determining, by the processor, if there is a change in the ambient brightness, target pixel coordinates of each of the photosensitive sub-pixels indicating that there is a change in the ambient brightness for at least two time periods, wherein each of the time periods includes at least two of the time instants; obtaining the outline of an object according to the target pixel coordinates in the same time period, carrying out object identification on the outline to determine the object attribute of the outline, judging whether the object corresponding to the object attribute is a target object, if so, determining the movement track of the object according to the position change of the outline in the at least two time periods, so that the processor can determine the movement track of the object in the two time periods by only calculating the change characteristics of the target pixel coordinates;
and controlling the electronic equipment to execute corresponding operation response according to the movement track through the processor.
2. The electronic device control method of claim 1, wherein said determining from the pixel luminance signal whether the obtained pixel luminance signals of the photosensitive sub-pixel at least two time instants indicate the presence of an ambient luminance change comprises:
acquiring signal parameters of at least two pixel brightness signals of the photosensitive sub-pixel at least two moments, wherein the moments of acquiring the pixel brightness signals are in one-to-one correspondence with the signal parameters of the pixel brightness signals;
judging whether the signal parameters meet preset conditions or not, wherein the preset conditions comprise that at least two signal parameters are different;
and if the preset condition is met, defining that the pixel brightness signals acquired by the photosensitive sub-pixel at least two moments indicate that the ambient brightness changes.
3. The electronic device control method of claim 2, wherein after said determining from the pixel luminance signal whether the obtained pixel luminance signal of the photosensitive sub-pixel at least two time instants indicates that there is an ambient luminance change, further comprising:
if the signal parameters meet the preset conditions, generating a change signal corresponding to the photosensitive sub-pixel, otherwise, not generating the change signal;
the change signal is used for indicating that the pixel brightness signals acquired by the photosensitive sub-pixels at least two moments indicate that environmental brightness change exists;
and determining the target pixel coordinates of the photosensitive sub-pixels corresponding to the change signals according to the change signals.
4. The electronic device control method according to claim 3, wherein the determining the target pixel coordinates of the photosensitive sub-pixel corresponding to the change signal according to the change signal comprises:
judging whether the number of the photosensitive sub-pixels generating the change signal meets a preset trigger condition or not;
if yes, determining the target pixel coordinates of the photosensitive sub-pixels corresponding to the change signals;
and if not, not responding to the generated change signal.
5. The electronic device control method according to any one of claims 1 to 4, wherein the controlling the electronic device to execute the corresponding operation response according to the movement trajectory includes:
the operation response comprises one or more operation responses of screen lightening, unlocking, screen extinguishing, starting of a preset application program and screen capturing of the electronic equipment.
6. An electronic device, comprising:
the light sensor comprises a pixel array consisting of a plurality of light-sensitive sub-pixels and is used for obtaining a pixel brightness signal of at least one light-sensitive sub-pixel, each light-sensitive sub-pixel independently outputs different level signals according to different light signal intensities, the parameter values of the level signals correspond to the sensed different light signal intensities, each light-sensitive sub-pixel comprises pixel brightness signals at a plurality of moments, and each pixel brightness signal has a corresponding generation moment;
the signal comparison circuit is connected with the light sensor and used for determining whether the pixel brightness signals of the obtained photosensitive sub-pixel at least two moments indicate that environmental brightness change exists or not according to the pixel brightness signals; and
the processor is connected with the signal comparison circuit and used for determining the target pixel coordinate of each photosensitive sub-pixel indicating that the ambient brightness changes in at least two time periods according to a target level signal if the ambient brightness changes exist, wherein each time period comprises at least two moments; obtaining the outline of an object according to the target pixel coordinates in the same time period, carrying out object identification on the outline to determine the object attribute of the outline, judging whether the object corresponding to the object attribute is a target object, if so, determining the movement track of the object according to the position change of the outline in the at least two time periods, so that the processor can determine the movement track of the object in the two time periods by only calculating the change characteristics of the target pixel coordinates; and controlling the electronic equipment to execute corresponding operation response according to the movement track.
7. The electronic device of claim 6, wherein the signal comparison circuit comprises:
the delay circuit is connected with the output end of the light sensor and used for delaying and outputting the pixel brightness signal at the current moment;
and the comparison circuit is connected with the output end of the light sensor and the output end of the delay circuit and is used for acquiring the pixel brightness signal at the current moment, judging whether the pixel brightness signals at the two moments are different from each other or not through the pixel brightness signal at the previous moment delayed by the delay circuit, and outputting a target level signal if the pixel brightness signals at the two moments are different from each other.
8. The electronic device of claim 7, further comprising:
the buffer is connected between the comparison circuit and the processor and used for storing at least one target level signal;
the at least one target level signal is divided according to different time instants, the at least one target level signal comprises at least one target level signal at one time instant, and the at least one target level signal at the same time interval comprises at least one target level signal.
9. A storage medium having stored thereon a computer program, characterized in that the computer program, when executed on a computer, causes the computer to execute the method according to any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810998314.3A CN109164917B (en) | 2018-08-29 | 2018-08-29 | Electronic device control method, storage medium, and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810998314.3A CN109164917B (en) | 2018-08-29 | 2018-08-29 | Electronic device control method, storage medium, and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109164917A CN109164917A (en) | 2019-01-08 |
| CN109164917B true CN109164917B (en) | 2021-10-26 |
Family
ID=64893216
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810998314.3A Active CN109164917B (en) | 2018-08-29 | 2018-08-29 | Electronic device control method, storage medium, and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109164917B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112433529B (en) * | 2020-11-30 | 2024-02-27 | 东软睿驰汽车技术（沈阳）有限公司 | Moving object determining method, device and equipment |
| CN114020382A (en) * | 2021-10-29 | 2022-02-08 | 杭州逗酷软件科技有限公司 | Execution method, electronic equipment and computer storage medium |
| CN115242952B (en) * | 2022-07-28 | 2024-07-26 | 联想(北京)有限公司 | Image acquisition method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101576676A (en) * | 2009-06-02 | 2009-11-11 | 友达光电股份有限公司 | Touch-control panel and touch sensing method and application thereof |
| EP2687948A2 (en) * | 2012-07-18 | 2014-01-22 | Samsung Electronics Co., Ltd | Apparatus and method for controlling operation mode of device using gesture recognition |
| CN103576845A (en) * | 2012-08-06 | 2014-02-12 | 原相科技股份有限公司 | Environment light detection device and method and interactive device adopting environment light detection device |
| CN106155315A (en) * | 2016-06-28 | 2016-11-23 | 广东欧珀移动通信有限公司 | The adding method of augmented reality effect, device and mobile terminal in a kind of shooting |
| KR20180050473A (en) * | 2016-11-04 | 2018-05-15 | 삼성디스플레이 주식회사 | Display device |
-
2018
- 2018-08-29 CN CN201810998314.3A patent/CN109164917B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101576676A (en) * | 2009-06-02 | 2009-11-11 | 友达光电股份有限公司 | Touch-control panel and touch sensing method and application thereof |
| EP2687948A2 (en) * | 2012-07-18 | 2014-01-22 | Samsung Electronics Co., Ltd | Apparatus and method for controlling operation mode of device using gesture recognition |
| CN103576845A (en) * | 2012-08-06 | 2014-02-12 | 原相科技股份有限公司 | Environment light detection device and method and interactive device adopting environment light detection device |
| CN106155315A (en) * | 2016-06-28 | 2016-11-23 | 广东欧珀移动通信有限公司 | The adding method of augmented reality effect, device and mobile terminal in a kind of shooting |
| KR20180050473A (en) * | 2016-11-04 | 2018-05-15 | 삼성디스플레이 주식회사 | Display device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109164917A (en) | 2019-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102664705B1 (en) | Electronic device and method for modifying magnification of image using multiple cameras | |
| US11249554B2 (en) | Method and apparatus for selecting between multiple gesture recognition systems | |
| US8610670B2 (en) | Imaging and display apparatus, information input apparatus, object detection medium, and object detection method | |
| JP4835578B2 (en) | Display imaging apparatus, object detection program, and object detection method | |
| KR101184460B1 (en) | Device and method for controlling a mouse pointer | |
| US8638317B2 (en) | Display apparatus and method for controlling the same | |
| CN109164917B (en) | Electronic device control method, storage medium, and electronic device | |
| EP2965299B1 (en) | Modifying functionality based on distances between devices | |
| JP5093523B2 (en) | IMAGING DEVICE, DISPLAY IMAGING DEVICE, AND IMAGING PROCESSING DEVICE | |
| US20200116893A1 (en) | Use of thermopiles to detect human location | |
| WO2019024644A1 (en) | Proximity detection method and apparatus, storage medium, and electronic device | |
| US20230291827A1 (en) | Screen state control method and apparatus, and storage medium | |
| JP2006244446A (en) | Display device | |
| US20090213095A1 (en) | Display and imaging apparatus and object detecting method | |
| US20140139488A1 (en) | Gesture recognition apparatus and complex optical apparatus | |
| KR20180132496A (en) | Operating method of optical fingerprint sensor and operating method of electronic device and display device including thereof | |
| US20230176689A1 (en) | Electronic device and method for controlling touch function | |
| TW201800901A (en) | Method and pixel array for detecting gesture | |
| JP4270247B2 (en) | Display imaging apparatus, object detection program, and object detection method | |
| US20200342810A1 (en) | Electronic device and display for reducing leakage current | |
| CN107563259B (en) | Method for detecting action information, photosensitive array and image sensor | |
| US20140035807A1 (en) | Ambient light sensing device and method, and interactive device using same | |
| US11353992B2 (en) | Method and device for processing user input on basis of time during which user input is maintained | |
| JP4788755B2 (en) | Display imaging apparatus, object detection program, and object detection method | |
| JP7574609B2 (en) | Display input device, program, and display input method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |