WO2020216091A1

WO2020216091A1 - Image processing method and related apparatus

Info

Publication number: WO2020216091A1
Application number: PCT/CN2020/084506
Authority: WO
Inventors: 占文喜
Original assignee: Oppo广东移动通信有限公司
Priority date: 2019-04-22
Filing date: 2020-04-13
Publication date: 2020-10-29
Also published as: CN110084170A

Abstract

An image processing method and a related apparatus. Said method is applied to an electronic device, and a preset region (103) of the screen (102) of the electronic device (101) has a fingerprint recognition function. Said method comprises: in a current environment, acquiring at least one image when the screen (102) is in a screen-off state, and determining a first image according to the at least one image (S201); determining a second image according to the first image (S202); obtaining, according to the second image and the first image, a third image with background information eliminated (S203); determining fixed lines existing in the preset region according to the third image (S204); and blocking the fixed lines on the first image to obtain a target image (S205). The method can solve the problem of false recognition of fixed lines by extracting fixed lines, applying matching blocking on the coordinate region thereof, thereby avoiding false recognition, and improving the accuracy and intelligence of the electronic device (101) performing image processing.

Description

Image processing method and related device

Technical field

This application relates to the technical field of smart mobile terminals, and in particular to an image processing method and related devices.

Background technique

At present, the smart electronic devices on the market basically support the touch screen operation function. The fingerprint under the screen uses the OLED display as the original light source. The light is reflected on the finger and the glass contact surface due to the difference in the reflection of the light from the valley and ridge of the fingerprint. The photosensitive sensor absorbs the reflected light of different degrees and converts it into electrical signals with different sizes to form fingerprint images. Therefore, cracks in the display screen or foreign objects in the sensing area will affect the fixed pattern interference on the optical fingerprint under the screen, resulting in the inability to quickly unlock and other operations, which reduces the user experience.

Summary of the invention

The embodiments of the present application provide an image processing method and related devices to improve the accuracy and intelligence of image processing performed by electronic equipment.

In the first aspect, an embodiment of the present application provides an image processing method applied to an electronic device, a preset area of the screen of the electronic device has a fingerprint recognition function, and the method includes:

Under the current environment, collecting at least one image when the screen is in the off state, and determining the first image according to the at least one image;

Determining a second image according to the first image, the second image corresponding to an image collected by the electronic device in the current environment and the screen is free of foreign objects;

Obtaining a third image with background information eliminated according to the second image and the first image;

Determining, according to the third image, fixed lines existing in the preset area;

Shielding the fixed lines on the first image to obtain a target image.

In a second aspect, an embodiment of the present application provides an image processing device, which is applied to an electronic device. A preset area of the screen of the electronic device has a fingerprint recognition function. The image processing device includes an acquisition unit, a determination unit, an acquisition unit, and Shielding unit, where,

The collection unit is configured to collect at least one image when the screen is in the off state under the current environment, and determine the first image according to the at least one image;

The determining unit is configured to determine a second image according to the first image, the second image corresponding to an image collected by the electronic device in the current environment and the screen is free of foreign objects;

The obtaining unit is configured to obtain a third image with background information eliminated according to the second image and the first image;

The determining unit is further configured to determine the fixed lines existing in the preset area according to the third image;

The masking unit is used to mask the fixed lines on the first image to obtain a target image.

In a third aspect, embodiments of the present application provide an electronic device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be processed by the above The above-mentioned program includes instructions for executing the steps in any method of the first aspect of the embodiments of the present application.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the foregoing computer-readable storage medium stores a computer program for electronic data exchange, wherein the foregoing computer program enables a computer to execute In one aspect, some or all of the steps described in any method.

In a fifth aspect, embodiments of the present application provide a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute For example, some or all of the steps described in any method of the first aspect. The computer program product may be a software installation package.

It can be seen that in this embodiment of the application, in the current environment, the electronic device first collects at least one image when the screen is in the off state, and determines the first image based on the at least one image, and secondly, based on the The first image determines a second image, and the second image corresponds to an image collected by the electronic device in the current environment and the screen is free of foreign objects. Again, according to the second image and the first image Image to obtain a third image from which background information is eliminated, and then determine the fixed lines existing in the preset area according to the third image, and finally, mask the fixed lines on the first image to obtain a target image. It can be seen that the electronic device of the embodiment of the present application obtains the image under the preset area and eliminates the background through multiple image processing, and further extracts fixed lines, and matches and shields the coordinate areas, thereby obtaining error-free The image, thereby preventing the occurrence of false recognition, and improving the accuracy and intelligence of image processing by electronic devices.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 is a schematic diagram of fingerprint collection by an electronic device according to an embodiment of the present application;

2A is a schematic flowchart of an image processing method provided by an embodiment of the present application;

2B is a schematic diagram of an image without foreign matter provided by an embodiment of the present application;

2C is a schematic diagram of an image with foreign objects provided by an embodiment of the present application;

FIG. 3 is a schematic flowchart of another image processing method provided by an embodiment of the present application;

4 is a schematic flowchart of another image processing method provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

Fig. 6 is a block diagram of functional units of an image processing device provided by an embodiment of the present application.

Detailed ways

In order to enable those skilled in the art to better understand the solution of the application, the technical solutions in the embodiments of the application will be clearly and completely described below in conjunction with the drawings in the embodiments of the application. Obviously, the described embodiments are only It is a part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of this application.

The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific sequence. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes unlisted steps or units, or optionally also includes Other steps or units inherent to these processes, methods, products or equipment.

Reference to "embodiments" herein means that a specific feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art clearly and implicitly understand that the embodiments described herein can be combined with other embodiments.

The electronic equipment involved in the embodiments of the present application may be an electronic device with fingerprint recognition capabilities. The electronic equipment may include various handheld devices with fingerprint recognition functions, vehicle-mounted devices, wearable devices, computing devices, or those connected to a wireless modem. Other processing equipment, and various forms of user equipment (User Equipment, UE), mobile station (Mobile Station, MS), terminal equipment (terminal device), etc.

The following describes the embodiments of the present application in detail.

Fingerprint recognition technology associates a person with his fingerprints. By comparing his fingerprints with pre-saved fingerprints, and comparing the minutiae feature points of different fingerprints for identification, his true identity can be verified. The fingerprint image is the data of the fingerprint in the form of an image as a carrier. A fingerprint is a pattern formed by the bumpy skin on the pad of the end of a human finger. Fingerprints are lines formed by the bumpy skin on the fingertips of human fingers. Because human fingerprints are a function of genetics and environment, they are also closely related to human health, so fingerprints are common to everyone, but they are different. The repetition rate of fingerprints is extremely small, about 1/15 billion, so it is called "human identity card". It is precisely based on this characteristic of fingerprints that fingerprints are widely used as identity authentication information. Fingerprint lines often have interruptions, bifurcations or turning points. These breakpoints, bifurcation points and turning points are called "feature points". Each person's fingerprint pattern is unique in patterns, break points and intersections. Only by relying on this uniqueness and stability can we create fingerprint recognition technology. Each person's skin patterns, including fingerprints, are different in patterns, breakpoints, and intersections, which are unique and unchanged throughout their lives. Fingerprint recognition technology has the advantages of fast recognition speed, convenient collection and low price, and is widely used in many disciplines such as image processing, pattern recognition, and computer vision.

Generally, in fingerprint identification applications, users usually enter several sets of fingerprints into the database in advance, and each set of fingerprints is a fingerprint corresponding to one finger of the user. For example, one set of fingerprints is the fingerprint of the user's index finger, and the other set of fingerprints is the fingerprint of the user's thumb. For each group, the system will extract the feature points of the group of fingerprints and other information, and save it into a set of fingerprint corresponding feature point templates. When the user needs to input a fingerprint to perform an operation, the user places the fingerprint on the fingerprint recognition device so that the fingerprint recognition device recognizes the fingerprint input by the user, and then the terminal extracts the characteristic points of the fingerprint input by the user and compares it with the previous user Multiple sets of fingerprints pre-entered in the database are matched one by one. If the characteristic points of the fingerprint input by the user match the characteristic points of a set of fingerprints pre-entered in the terminal's database, the matching is successful and the terminal allows the corresponding operation to be performed. For example, for example, the user needs to unlock the screen of the terminal. At this time, when the fingerprint input by the user is matched successfully, the terminal unlocks the screen.

Obtaining a good fingerprint image is a very complicated problem. Because the fingerprint used for measurement is only a relatively small piece of skin, the fingerprint collection device should have a resolution good enough to obtain the details of the fingerprint. The fingerprint image acquisition equipment currently used is basically based on three technological foundations: optical technology, semiconductor silicon technology, and ultrasonic technology.

Using optical technology to collect fingerprints is the oldest and most widely used technology. Place your finger on the optical lens, and use a prism to project your finger on the charge-coupled device under the illumination of the built-in light source to form a ridge line (a pattern with a certain width and direction in the fingerprint image), which is black and valley lines (textures). The concave part between the lines) is a white digitized multi-gray fingerprint image that can be processed by the fingerprint device algorithm.

The light-sensitive screen fingerprint recognition technology is the under-screen fingerprint recognition technology, which is to place the recognition module under the mobile phone screen panel. During recognition, the RGB light emitted by the module penetrates the panel to form a fingerprint light film on the fingertips. The collected fingerprint information is fed back to the identification module, and the operation is completed through system comparison. Exemplarily, as shown in FIG. 1, the electronic device is 101, the display screen is 102, the preset area for collecting fingerprints is 103, and 104 is an enlarged fingerprint; a schematic diagram of an electronic device 101 collecting fingerprint 104, when the finger touches the screen The light emitted by the OLED screen penetrates the cover plate to illuminate the fingerprint texture, and the reflected light from the fingerprint penetrates the screen and returns to the sensor, and finally forms a fingerprint image for identification.

Before comparing fingerprints with stored data, the scanner processor must ensure that a clear image is obtained. It checks the average value of pixel darkness or the overall value of a small sample. If the overall image is too dark or too bright, the scan will be discarded. Then the scanner adjusts the exposure time to allow more or less light to enter, and scan again. If the darkness is appropriate, the scanner system will continue to check the sharpness of the image (the sharpness of the fingerprint scan). The processor will look at several straight lines that move in the vertical and horizontal directions on the image. If the line perpendicular to the crest is composed of very dark pixels and very bright pixels, it means that the fingerprint image has good clarity.

The fingerprint recognition system is a typical pattern recognition system, including fingerprint image acquisition, processing, feature extraction and comparison modules.

Among them, the touch screen includes a display screen and a touch panel (Touch Panel, TP), and the touch screen includes a fingerprint collection area. The fingerprint collection area is an area in the touch screen, that is, a large area that can be pressed by multiple fingers at the same time, rather than a small area that can be pressed by a single finger. The location of the fingerprint collection area may be the middle area of the touch screen, the upper part of the touch screen, the lower part of the touch screen, etc., which are not limited here.

Please refer to Figure 2A. Figure 2A is a schematic flowchart of an image processing method provided by an embodiment of the present application, which is applied to an electronic device, and a preset area of the screen of the electronic device has a fingerprint recognition function; as shown in the figure, this image Treatment methods include:

S201: In the current environment, the electronic device collects at least one image when the screen is in the off state, and determines a first image according to the at least one image.

Wherein, the current environment may be an unobstructed and horizontal indoor environment, which is not uniquely limited here.

S202: The electronic device determines a second image according to the first image, the second image corresponding to an image collected by the electronic device in the current environment and the screen is free of foreign objects.

S203: The electronic device obtains a third image from which background information is eliminated according to the second image and the first image.

Optionally, an image difference operation is performed between the second image and the first image to obtain a third image with background information eliminated.

S204: The electronic device determines, according to the third image, a fixed pattern existing in the preset area.

Wherein, the preset area may be a single point, an area, or a full screen, which is specifically determined according to the setting position of the fingerprint module under the screen.

S205: The electronic device shields the fixed lines on the first image to obtain a target image.

In a possible example, the determining the second image according to the first image includes: the electronic device performs an image difference operation between the first image and a prestored fourth image to obtain the current environment A first ambient light intensity value, the fourth image is an image collected by the electronic device in a preset state, and the preset state means that the screen is off and the ambient light brightness is a preset intensity value ; Determine the second image according to the first ambient light intensity value, the fourth image and the pre-stored noise floor image.

Among them, the pre-stored fourth image may be an image collected by a manufacturer at the factory or an image retrieved based on big data, and there is no unique limitation here.

Among them, image difference operation is also called image subtraction operation, which refers to the process of subtracting images of the same scene at different times or images of the same scene in different bands to obtain an output image.

Wherein, the preset intensity value may be 100 lux, which is not uniquely limited here.

It can be seen that, in this example, after the electronic device performs a differential operation between the collected image and the preset image to obtain the ambient light intensity, it obtains the image without foreign matter in the current environment screen state according to the formula, that is, the background is processed as the first step through image processing. The extraction of images improves the accuracy and intelligence of image acquisition by electronic equipment.

In a possible example, the determining the second image according to the first ambient light intensity value, the fourth image, and the pre-stored noise floor image includes: combining the first ambient light intensity value, the The second image and the pre-stored noise floor image are substituted into a preset formula to obtain a third image. The preset formula is E=L*(CD)/100+D, where E is the second image and L is the The first ambient light intensity, C is the fourth image and D is the pre-stored noise floor image.

Wherein, the pre-stored noise background image is the noise background image of the screen isolation environment.

It can be seen that, in this example, an image without foreign objects in the current environment and screen state is obtained according to the preset formula, which improves the accuracy and intelligence of image collection by the electronic device.

In a possible example, the at least one image includes a fifth image and a sixth image, and the determining the first image according to the at least one first image includes: the electronic device acquires the fifth image The image definition of the image and the sixth image; the first image is selected from the fifth image and the sixth image, and the image whose image definition is greater than the preset definition is selected.

Wherein, the preset definition can be set by the manufacturer at the factory or obtained from a large database, and there is no unique limitation here.

Optionally, if the image sharpness of the fifth image and the sixth image are both greater than the preset sharpness, the image with the most recent acquisition time is selected as the first image.

It can be seen that, in this example, the electronic device obtains a clearer first image by filtering the clarity of the captured image, which avoids subsequent misjudgment and mis-extraction due to the unclear captured image, which is beneficial to the electronic device The accuracy and intelligence of image acquisition.

In a possible example, the determining a fixed pattern existing in the preset area according to the third image includes: acquiring, by the electronic device, a pixel in the third image; if the pixel appears If it is abnormal, the abnormal pixel is determined as a fixed pattern pixel; the fixed pattern is obtained according to the fixed pattern pixel.

For example, as shown in FIG. 2B, FIG. 2B is an image with no abnormal pixels, that is, a completely black image without foreign objects in the preset area. If there are foreign objects in the preset area, as shown in FIG. 2C, 2C is an image with fixed lines, that is, white lines will appear in the image.

Wherein, the abnormality may be that the matching value of the current pixel point and the preset pixel point is lower than the preset matching value, which is an abnormality.

It can be seen that, in this example, the electronic device can obtain whether there are foreign objects in the collected image by analyzing the pixels, and extract the texture of the foreign objects, which is beneficial to the accuracy and intelligence of the electronic device in image collection.

In a possible example, after shielding the fixed pattern on the first image to obtain a target image, the method further includes: the electronic device collects a fingerprint image, and correcting the fingerprint image according to the fixed pattern To get the corrected fingerprint image.

It can be seen that in this example, the electronic device uses the obtained error-free image to revise the image of subsequent fingerprint collection, which can effectively prevent the occurrence of false recognition and improve the accuracy and intelligence of image processing by the electronic device.

In a possible example, the electronic device includes a light sensor, a proximity sensor, and an acceleration sensor; in the current environment, before at least one image is collected when the screen is in the off state, the method further It includes: the electronic device turns on the light sensor to collect the indoor light sensitivity value; detects whether the light sensitivity value is within a first preset threshold range; if so, turns on the proximity sensor to collect a reference image; if it is in the reference image If there is no foreign matter, the acceleration sensor is turned on to collect the target parameter; if the target parameter is within the second preset threshold range, at least one first image in the off-screen state is collected.

Wherein, the first preset threshold and the second preset threshold are factory settings at the factory.

Wherein, the target parameter may be acceleration, speed, etc., which are not uniquely limited here.

Optionally, before the light sensor is turned on to collect the light sensitivity value, a trigger instruction may also be obtained, and the light sensor is activated according to the trigger instruction.

Wherein, the trigger instruction includes a key instruction, a gesture instruction and a voice instruction.

It can be seen that, in this example, the electronic device further collects images by restricting the preset environment, which reduces the error and enables the collection process to be performed in a suitable environment, which is beneficial to the accuracy and intelligence of image collection.

Consistent with the embodiment shown in FIG. 2A, please refer to FIG. 3. FIG. 3 is a schematic flowchart of an image processing method provided by an embodiment of the present application, which is applied to the electronic device described in FIG. The preset area of the screen has fingerprint recognition function, as shown in the figure, this image processing method includes:

S301: Under the current environment, the electronic device collects at least one image when the screen is in the off state, and determines a first image according to the at least one image.

S302: The electronic device performs an image difference operation on the first image and a prestored fourth image to obtain a first ambient light intensity value in the current environment.

S303: The electronic device determines a second image according to the first ambient light intensity value, the fourth image, and a pre-stored noise floor image.

S304: The electronic device obtains a third image with background information eliminated according to the second image and the first image.

S305: The electronic device determines, according to the third image, a fixed pattern existing in the preset area.

S306: The electronic device shields the fixed lines on the first image to obtain a target image.

In addition, after the electronic device performs a differential operation between the collected image and the preset image to obtain the ambient light intensity, it obtains an image without foreign matter in the current environment screen state according to the formula, that is, performs the first step of extracting the background through image processing to improve The accuracy and intelligence of image acquisition by electronic equipment.

Consistent with the embodiment shown in FIG. 2A, please refer to FIG. 4. FIG. 4 is a schematic flowchart of an image processing method provided by an embodiment of the present application, which is applied to the electronic device described in FIG. The preset area of the display screen has a fingerprint recognition function. As shown in the figure, this image processing method includes:

S401: In the current environment, the electronic device collects at least one image when the screen is in the off state, and determines a first image according to the at least one image.

S402: The electronic device performs image difference calculation on the first image and a prestored fourth image to obtain a first ambient light intensity value in the current environment.

S403: The electronic device determines a second image according to the first ambient light intensity value, the fourth image, and a pre-stored noise floor image.

S404: The electronic device obtains a third image from which background information is eliminated according to the second image and the first image.

S405: The electronic device acquires pixels in the third image.

S406: If the pixel point is abnormal, the electronic device determines the abnormal pixel point as a fixed pattern pixel point.

S407: The electronic device obtains a fixed pattern according to the pixels of the fixed pattern.

S408: The electronic device collects a fingerprint image, and corrects the fingerprint image according to the fixed pattern to obtain a corrected fingerprint image.

In addition, the electronic device can obtain whether there is a foreign body in the collected image by analyzing the pixels, and extract the texture of the foreign body, which is beneficial to the accuracy and intelligence of the electronic device in image collection.

Consistent with the embodiments shown in FIGS. 2A, 3, and 4 above, please refer to FIG. 5. FIG. 5 is a schematic structural diagram of an electronic device 500 provided by an embodiment of the present application. As shown in the figure, the electronic device 500 includes an application processor 510, a memory 520, a communication interface 530, and one or more programs 521, where the one or more programs 521 are stored in the memory 520 and are configured to be executed by the application processor 510, The one or more programs 521 include instructions for performing the following steps;

Shielding the fixed lines on the first image to obtain a target image.

In a possible example, in the aspect of determining the second image based on the first image, the instructions in the program are specifically used to perform the following operations: perform image difference between the first image and the prestored fourth image Calculate to obtain the first ambient light intensity value in the current environment, the fourth image is an image collected by the electronic device in a preset state, and the preset state means that the screen is off And the ambient light brightness is a preset intensity value; the second image is determined according to the first ambient light intensity value, the fourth image and the pre-stored noise floor image.

In a possible example, in terms of determining the second image according to the first ambient light intensity value, the fourth image, and the pre-stored noise floor image, the instructions in the program are specifically used to perform the following operations : Substitute the first ambient light intensity value, the second image and the pre-stored noise floor image into a preset formula to obtain a third image, the preset formula is E=L*(CD)/100+D, Where E is the second image, L is the first ambient light intensity, C is the fourth image, and D is a pre-stored noise floor image.

In a possible example, the at least one image includes a fifth image and a sixth image, and in the aspect of determining the first image from the at least one first image, the instructions of the program are specifically used to execute The following operations: Obtain the image clarity of the fifth image and the sixth image; filter out the image with the image clarity greater than the preset definition from the fifth image and the sixth image as the first image.

In a possible example, in terms of determining the fixed lines existing in the preset area according to the third image, the instructions in the program are specifically used to perform the following operations: acquiring Pixel; if the pixel is abnormal, the abnormal pixel is determined to be a fixed pattern pixel; the fixed pattern is obtained according to the fixed pattern pixel.

In a possible example, after shielding the fixed lines on the first image to obtain a target image, the program further includes operations for performing the following operations: collecting a fingerprint image, and correcting the fingerprint according to the fixed lines Image to get the corrected fingerprint image.

In a possible example, the electronic device includes a light sensor, a proximity sensor, and an acceleration sensor; in the current environment, before at least one image is collected when the screen is off, the program The instructions are also specifically used to perform the following operations: turn on the light sensor to collect indoor light sensitivity values; detect whether the light sensitivity value is within the first preset threshold range; if so, turn on the proximity sensor to collect reference images; If there is no foreign matter in the reference image, the acceleration sensor is turned on to collect target parameters; if the target parameter is within the second preset threshold range, at least one first image in the screen-off state is collected.

In a possible example, before the light sensor is turned on to collect the indoor light sensor value, the instructions in the program are specifically used to perform the following operations: obtain a trigger instruction; and activate the light sensor according to the trigger instruction.

In a possible example, the third image from which background information is eliminated is obtained according to the second image and the first image, and the instructions in the program are specifically used to perform the following operations: Perform an image difference operation with the first image to obtain a third image with background information eliminated.

The foregoing mainly introduces the solution of the embodiment of the present application from the perspective of the execution process on the method side. It can be understood that, in order to implement the above-mentioned functions, the electronic device includes hardware structures and/or software modules corresponding to each function. Those skilled in the art should easily realize that in combination with the units and algorithm steps of the examples described in the embodiments provided herein, this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

The embodiment of the present application may divide the electronic device into functional units according to the foregoing method examples. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.

FIG. 6 is a block diagram of the functional units of the image processing device 600 involved in an embodiment of the present application. The image processing device 600 is applied to electronic equipment, and includes an acquisition unit 601, a determination unit 602, an acquisition unit 603, and a shielding unit 604, where:

The collecting unit 601 is configured to collect at least one image when the screen is in the off-screen state under the current environment, and determine the first image according to the at least one image;

The determining unit 602 is configured to determine a second image according to the first image, the second image corresponding to an image collected by the electronic device in the current environment and the screen is free of foreign objects;

The obtaining unit 603 is configured to obtain a third image with background information eliminated according to the second image and the first image;

The determining unit 602 is further configured to determine a fixed pattern existing in the preset area according to the third image;

The masking unit 604 is used to mask the fixed lines on the first image to obtain a target image.

Wherein, the image processing apparatus 600 may further include a storage unit 605 for storing program codes and data of the electronic device, and the storage unit 605 may be a memory.

It can be seen that in this embodiment of the application, in the current environment, the electronic device first collects at least one image when the screen is in the off state, and determines the first image based on the at least one image, and secondly, based on the The first image determines a second image, and the second image corresponds to an image collected by the electronic device in the current environment and the screen is free of foreign objects. Again, according to the second image and the first image Image to obtain a third image from which background information is eliminated, and then determine the fixed lines existing in the preset area according to the third image, and finally, mask the fixed lines on the first image to obtain a target image. It can be seen that the electronic device of the embodiment of the present application obtains the image under the preset area and eliminates the background through multiple image processing, and further extracts fixed lines, and matches and shields the coordinate areas, thereby obtaining error-free The image, thereby preventing the occurrence of false recognition, and improving the accuracy and intelligence of image processing by electronic equipment.

In a possible example, in the aspect of determining the second image based on the first image, the determining unit 602 is specifically configured to: perform an image difference operation on the first image and a prestored fourth image to obtain the The first ambient light intensity value in the current environment, the fourth image is an image collected by the electronic device in a preset state, and the preset state means that the screen is off and the ambient light brightness is The preset intensity value; the second image is determined according to the first ambient light intensity value, the fourth image and the pre-stored noise floor image.

In a possible example, in terms of determining the second image according to the first ambient light intensity value, the fourth image, and the pre-stored noise floor image, the determining unit 602 is specifically configured to: The first ambient light intensity value, the second image, and the pre-stored noise floor image are substituted into a preset formula to obtain a third image. The preset formula is E=L*(CD)/100+D, where E is all The second image, L is the first ambient light intensity, C is the fourth image, and D is a pre-stored noise floor image.

In a possible example, the at least one image includes a fifth image and a sixth image, and in determining the first image based on the at least one first image, the determining unit 602 is specifically configured to: The image definitions of the fifth image and the sixth image are acquired; among the fifth image and the sixth image, an image whose image definition is greater than a preset definition is selected as the first image.

In a possible example, in terms of determining the fixed lines existing in the preset area according to the third image, the determining unit 602 is specifically configured to: obtain pixels in the third image; if If the pixel point is abnormal, the abnormal pixel point is determined as a fixed pattern pixel point; the fixed pattern is obtained according to the fixed pattern pixel point.

In a possible example, after shielding the fixed pattern on the first image to obtain a target image, the acquisition unit 601 is specifically configured to: acquire a fingerprint image, and correct the fingerprint image according to the fixed pattern, Get the corrected fingerprint image.

In a possible example, the electronic device includes a light sensor, a proximity sensor, and an acceleration sensor; in the current environment, before at least one image is acquired when the screen is in the off state, the acquisition unit 601 is also specifically used to: turn on the light sensor to collect the indoor light sensitivity value; detect whether the light sensitivity value is within the first preset threshold range; if so, turn on the proximity sensor to collect the reference image; if it is in the reference image If there is no foreign matter, the acceleration sensor is turned on to collect the target parameter; if the target parameter is within the second preset threshold range, at least one first image in the off-screen state is collected.

In a possible example, before the light sensor is turned on to collect the indoor light sensor value, the collection unit 601 is further configured to: obtain a trigger instruction; and activate the light sensor according to the trigger instruction.

In a possible example, in terms of obtaining a third image from which background information is eliminated based on the second image and the first image, the obtaining unit 603 is configured to: the second image and the first image One image is subjected to image difference operation to obtain a third image with the background information removed. An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any method as recorded in the above method embodiment , The aforementioned computer includes electronic equipment.

The embodiments of the present application also provide a computer program product. The above-mentioned computer program product includes a non-transitory computer-readable storage medium storing a computer program. The above-mentioned computer program is operable to cause a computer to execute any of the above method embodiments. Part or all of the steps of the method. The computer program product may be a software installation package, and the above-mentioned computer includes electronic equipment.

It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that this application is not limited by the described sequence of actions. Because according to this application, some steps can be performed in other order or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

In the above-mentioned embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in an embodiment, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed device may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the above-mentioned units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or integrated. To another system, or some features can be ignored, or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical or other forms.

The units described above as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable memory. Based on this understanding, the technical solution of the present application essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, A number of instructions are included to enable a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the foregoing methods of the various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable memory, and the memory can include: flash disk , Read-only memory (English: Read-Only Memory, abbreviated as: ROM), random access device (English: Random Access Memory, abbreviated as: RAM), magnetic disk or CD, etc.

The embodiments of the application are described in detail above, and specific examples are used in this article to illustrate the principles and implementation of the application. The descriptions of the above examples are only used to help understand the methods and core ideas of the application; A person of ordinary skill in the art, based on the idea of the present application, will have changes in the specific implementation and the scope of application. In summary, the content of this specification should not be construed as a limitation of the present application.

Claims

An image processing method, characterized in that it is applied to an electronic device, and a preset area of the screen of the electronic device has a fingerprint recognition function, and the method includes:

Under the current environment, collecting at least one image when the screen is in the off state, and determining the first image according to the at least one image;

Determining a second image according to the first image, the second image corresponding to an image collected by the electronic device in the current environment and the screen is free of foreign objects;

Obtaining a third image with background information eliminated according to the second image and the first image;

Determining, according to the third image, fixed lines existing in the preset area;

Shielding the fixed lines on the first image to obtain a target image.
The method according to claim 1, wherein the determining the second image according to the first image comprises:

Performing an image difference operation on the first image and a prestored fourth image to obtain a first ambient light intensity value in the current environment, where the fourth image is an image collected by the electronic device in a preset state, The preset state means that the screen is in an off state and the ambient light brightness is a preset intensity value;

The second image is determined according to the first ambient light intensity value, the fourth image and the pre-stored noise floor image.
The method according to claim 2, wherein the determining the second image according to the first ambient light intensity value, the fourth image and a pre-stored noise floor image comprises:

Substitute the first ambient light intensity value, the second image, and the pre-stored noise floor image into a preset formula to obtain a third image. The preset formula is E=L*(CD)/100+D, where E is the second image, L is the first ambient light intensity, C is the fourth image, and D is a pre-stored noise floor image.
The method according to claim 1 or 2, wherein the at least one image includes a fifth image and a sixth image, and the determining the first image based on the at least one first image includes:

Acquiring the image clarity of the fifth image and the sixth image;

The first image is selected from the fifth image and the sixth image whose image definition is greater than the preset definition.
The method according to claim 1 or 2, wherein the determining a fixed pattern existing in the preset area according to the third image comprises:

Acquiring pixels in the third image;

If the pixel point is abnormal, the abnormal pixel point is determined as a fixed pattern pixel point;

A fixed pattern is obtained according to the pixel points of the fixed pattern.
The method according to claim 5, wherein after shielding the fixed lines on the first image to obtain the target image, the method further comprises:

A fingerprint image is collected, and the fingerprint image is corrected according to the fixed lines to obtain a corrected fingerprint image.
The method according to claim 1, wherein the electronic device includes a light sensor, a proximity sensor, and an acceleration sensor; in the current environment, at least one image is collected when the screen is in the off state Before, the method also includes:

Turn on the light sensor to collect indoor light sensor values;

Detecting whether the light sensitivity value is within a first preset threshold range;

If yes, turn on the proximity sensor to collect reference images;

If there is no foreign matter in the reference image, turn on the acceleration sensor to collect target parameters;

If the target parameter is within the second preset threshold range, at least one first image in the off-screen state is collected.
The method according to claim 7, characterized in that, before the turning on the light sensor to collect the indoor light perception value, the method further comprises:

Get trigger instruction;

The light sensor is activated according to the trigger instruction.
The method according to claim 1, wherein the obtaining a third image from which background information is eliminated based on the second image and the first image comprises:

Perform an image difference operation between the second image and the first image to obtain a third image with background information eliminated.
An image processing device, characterized in that it is applied to an electronic device, and a preset area of the screen of the electronic device has a fingerprint recognition function, and the image processing device includes an acquisition unit, a determination unit, an acquisition unit, and a shielding unit, wherein:

The collection unit is configured to collect at least one image when the screen is in the off state under the current environment, and determine the first image according to the at least one image;

The determining unit is configured to determine a second image according to the first image, the second image corresponding to an image collected by the electronic device in the current environment and the screen is free of foreign objects;

The obtaining unit is configured to obtain a third image with background information eliminated according to the second image and the first image;

The determining unit is further configured to determine the fixed lines existing in the preset area according to the third image;

The masking unit is used to mask the fixed lines on the first image to obtain a target image.
The device according to claim 10, wherein, in the aspect of determining the second image based on the first image, the determining unit is configured to: perform image difference between the first image and a prestored fourth image Calculation to obtain the first ambient light intensity value in the current environment, the fourth image is an image collected by the electronic device in a preset state, and the preset state means that the screen is off and The ambient light brightness is a preset intensity value; the second image is determined according to the first ambient light intensity value, the fourth image, and the pre-stored noise floor image.
The device according to claim 11, wherein, in the aspect of determining the second image according to the first ambient light intensity value, the fourth image, and a pre-stored noise floor image, the determining unit is configured to : Substitute the first ambient light intensity value, the second image and the pre-stored noise floor image into a preset formula to obtain a third image, the preset formula is E=L*(CD)/100+D, Where E is the second image, L is the first ambient light intensity, C is the fourth image, and D is a pre-stored noise floor image.
The device according to claim 10 or 11, wherein the at least one image includes a fifth image and a sixth image, and the first image aspect is determined according to the at least one first image, so The determining unit is configured to: obtain the image definition of the fifth image and the sixth image; filter out the image with the image definition greater than the preset definition from the fifth image and the sixth image For the first image.
The device according to claim 10 or 11, wherein in the aspect of determining the fixed pattern existing in the preset area according to the third image, the determining unit is configured to: obtain the third image If the pixel point is abnormal, the abnormal pixel point is determined as a fixed pattern pixel point; the fixed pattern is obtained according to the fixed pattern pixel point.
The device according to claim 14, wherein after the fixed pattern is masked on the first image to obtain the target image, the determining unit is further configured to: collect a fingerprint image and correct it according to the fixed pattern The fingerprint image is a corrected fingerprint image.
The apparatus according to claim 10, wherein the electronic device comprises a light sensor, a proximity sensor, and an acceleration sensor; in the current environment, at least one image is collected when the screen is off Previously, the collection unit was also used to: turn on the light sensor to collect indoor light perception values; detect whether the light perception value is within a first preset threshold range; if so, turn on the proximity sensor to collect reference images; If there is no foreign matter in the reference image, the acceleration sensor is turned on to collect target parameters; if the target parameter is within the second preset threshold range, at least one first image in the screen-off state is collected.
The device according to claim 16, characterized in that, before the light sensor is turned on to collect the indoor light sensor value, the collection unit is further configured to: obtain a trigger instruction; and activate the light sensor according to the trigger instruction.
10. The device according to claim 10, wherein, in terms of obtaining a third image from which background information is eliminated based on the second image and the first image, the obtaining unit is configured to: Image difference operation is performed between the image and the first image to obtain a third image with background information eliminated.
An electronic device, comprising a processor, a memory, a communication interface, and one or more programs, the one or more programs are stored in the memory and configured to be executed by the processor, The program includes instructions for executing the steps in the method according to any one of claims 1-9.
A computer-readable storage medium, characterized by storing a computer program for electronic data exchange, wherein the computer program enables a computer to execute the method according to any one of claims 1-9.