Nothing Special   »   [go: up one dir, main page]

WO2019076332A1 - Fingerprint information acquisition method and fingerprint recognition device - Google Patents

Fingerprint information acquisition method and fingerprint recognition device Download PDF

Info

Publication number
WO2019076332A1
WO2019076332A1 PCT/CN2018/110776 CN2018110776W WO2019076332A1 WO 2019076332 A1 WO2019076332 A1 WO 2019076332A1 CN 2018110776 W CN2018110776 W CN 2018110776W WO 2019076332 A1 WO2019076332 A1 WO 2019076332A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
fingerprint
vectors
vector
fingerprint identification
Prior art date
Application number
PCT/CN2018/110776
Other languages
French (fr)
Chinese (zh)
Inventor
曹华俊
袁亮
蒋洪睿
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201810654363.5A external-priority patent/CN109697402B/en
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP18868873.3A priority Critical patent/EP3686769B1/en
Publication of WO2019076332A1 publication Critical patent/WO2019076332A1/en
Priority to US16/852,573 priority patent/US10997394B2/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Definitions

  • the present application relates to the field of optical fingerprint recognition technologies, and in particular, to a method for acquiring fingerprint information for optical fingerprint recognition and a fingerprint identification device.
  • Fingerprint recognition technology involves many technical research fields and is widely used in work and life. At present, fingerprint recognition technology mainly includes capacitive fingerprint recognition technology, ultrasonic fingerprint recognition technology and optical fingerprint recognition technology. At present, most of the various terminal devices including smartphones, tablets and notebook computers adopt optical type. Fingerprint recognition technology.
  • a photo detector (PD) or the like is placed inside the display in the terminal display screen, or placed under the display screen.
  • the self-illumination of the pixel of the terminal display screen is used as a light source to illuminate the finger, and the PD receives the optical signal reflected by the surface of the finger, converts the optical signal into an electrical signal, and further processes the electrical signal to obtain fingerprint information.
  • the pixel points will interfere with each other, it is called afterglow interference, and the PD will also receive ambient light.
  • the strong ambient light also interferes with the optical fingerprint, which is called ambient light interference. Therefore, an interference signal is present in the optical signal received by the PD, and the accuracy of obtaining the obtained fingerprint information is low, which affects the fingerprint recognition performance.
  • the first aspect of the embodiments of the present application provides a method for acquiring fingerprint information, including: first, if a startup operation on a screen of a terminal is detected, acquiring a first vector set, where the first vector set includes A (A is greater than or equal to 2) mutually orthogonal or mutually quasi-orthogonal data vectors, each data vector comprising a plurality of data elements; secondly, the data elements in each data vector are sequentially used to control the minimum pixels in the fingerprint identification region
  • the unit emits light until the control illumination of all the smallest pixel units in the fingerprint identification area is completed, so as to obtain a corresponding second vector set in the fingerprint area, the second vector set carries the fingerprint information; finally, the first vector set solution is used. Adjusting the second vector set to obtain all the fingerprint information in the fingerprint identification area.
  • the vectors are orthogonal to each other to satisfy the following two conditions: (1) for two different vectors, the inner product between the two vectors is 0; (2) for any vector, the inner product of the vector itself is not Is 0, these two conditions can be expressed by the following formula:
  • W is the vector and the subscripts i and j are used to indicate the number of the vector.
  • the mutual quasi-orthogonality of the vectors means that the inner product of the two vectors in the condition (1) is a very small number (which may be a positive number or a negative number) close to 0, based on the satisfaction of the above condition (2), for example, A number such as 0.1, -0.05, those skilled in the art know that specific values can be designed according to the requirements of precision, and are not described here.
  • Vectors that are orthogonal or mutually quasi-orthogonal are constructed in the prior art. For example, some elements of a vector can be set to a certain number of zeros to achieve orthogonality. For example, if there are three vectors, one vector can be ⁇ 1 , 0,0,0 ⁇ , the other is ⁇ 0,1,0,0 ⁇ , and the third is ⁇ 0,0,0,1 ⁇ .
  • more complex and mutually orthogonal vectors can be constructed by other known or unknown algorithms, such as the simulated annealing algorithm proposed by Patric Ostergard.
  • the technical solution of the present application has the following advantages: the present application controls the minimum pixel illumination in the fingerprint identification area by using A sets of mutually orthogonal data vectors in the first vector set to obtain the fingerprint. A second vector set of fingerprint information in the area is identified. Finally, the second vector set is demodulated by using the first vector set to obtain all fingerprint information in the fingerprint identification area. It can be understood that, since each data vector is mutually orthogonal, in the process of controlling the minimum pixel unit illumination by the data vector, the interference between the illuminating rays of the minimum pixel unit can be reduced, and the fingerprint information obtained by demodulation can be obtained. More accurate, improved accuracy in obtaining fingerprint information, and improved fingerprint recognition performance.
  • the characteristics of the mutually quasi-orthogonal data vectors are similar to the mutually orthogonal data vectors, and therefore, similar effects can be produced, that is, the interference between the illuminating rays of the minimum pixel unit can be reduced, thereby improving the fingerprint recognition performance. .
  • the data element in each of the data vectors is sequentially used to control the fingerprint identification area.
  • the minimum pixel unit illumination comprises: (1) first controlling the minimum pixel unit illumination in a predetermined order using a data element of the same serial number in each of the data vectors; (2) reusing another sequence number in each of the data vectors The same data element controls the minimum pixel unit illumination in the predetermined order; (3) repeatedly performing the (1) and (2) processes until the fingerprint is controlled using the same data element of the last one of each of the data vectors Identifying the minimum pixel unit illumination within the region; (4) if the control illumination for all of the smallest pixel units within the fingerprint recognition region has not been completed, the processes of (1), (2), and (3) are repeated until completion.
  • the minimum pixel unit illumination is controlled by using the same sequence of data elements in a predetermined order, even if the minimum pixel unit is illuminated in a predetermined order, since the minimum pixel unit is illuminated, it will be illuminated for a period of time and then extinguished, Therefore, sequentially lighting the minimum pixel unit in a predetermined order may cause the residual light interference of the last illuminated minimum pixel unit to the next illuminated minimum pixel unit to be reduced or even eliminated, thereby causing the acquired fingerprint data. More accurate.
  • the first vector set is The three-dimensional matrix M[I, J, K] is constructed, and I, J, K are sequentially dimensions of the three-dimensional matrix M[I, J, K] in the X, Y, Z directions, wherein the three-dimensional matrix
  • the column vectors of M[I, J, K] having different coordinate positions on the X and Y planes are orthogonal to each other, the A being equal to the product of I and J, and one of the data vectors being the three-dimensional matrix M [ Any of the I, J, K] column vectors having the same coordinate position on the X and Y planes, and one of the data vectors includes K data elements.
  • the mutually orthogonal data vectors in the first vector set are obtained through the three-dimensional matrix structure.
  • the three-dimensional matrix can be constructed by using a simulated annealing algorithm or the like. Since the data vectors need to be orthogonal to each other, the more data vectors, the more difficult it is to construct, but by transforming into a three-dimensional matrix and constructing through three-dimensional matrix characteristics, the construction difficulty can be effectively reduced, and the complexity can also be realized by a computer.
  • the construction algorithm such as the above simulated annealing algorithm, therefore, constructing the first vector set through the three-dimensional matrix, the implementation method is simple and convenient, and the construction can be completed quickly and accurately.
  • one of the data vectors corresponds to one or more minimum pixel units And, one or more pixel points are included in one of the minimum pixel units.
  • the second vector set includes the A fingerprint vectors, where the fingerprint vector includes The fingerprint information collected during the minimum pixel unit illumination process; the demodulating the second vector set by using the first vector set to obtain all fingerprint information in the fingerprint identification area, including: using the same minimum The data vector corresponding to the pixel unit and the fingerprint vector perform a vector inner product operation until the vector inner product operation corresponding to all the minimum pixel units in the fingerprint recognition area is completed, to obtain all the fingerprint information in the fingerprint identification area.
  • the minimum inner pixel can be obtained only by using the data vector and the fingerprint vector corresponding to the same minimum pixel unit for the vector inner product operation.
  • the vector inner product operation method is used to obtain the fingerprint information in the fingerprint identification area, and the implementation method is simple and the accuracy is high.
  • the method further comprises: converting the data element in each of the data vectors into standardized display data, wherein the standardized display data is used To control the illumination of the smallest pixel unit.
  • the light of the minimum pixel unit and its illumination can be better controlled by converting the data elements into standardized display data.
  • the strength and the like thereby establishing a correspondence relationship between the data elements and the illuminance, thereby avoiding the adverse effects of the non-standard data elements in the illuminating modulation process, thereby ensuring the accuracy of the fingerprint information.
  • the gray scale data is a common standardized display data.
  • the illumination of the minimum image unit can be effectively controlled, thereby realizing the illumination modulation of the pixel unit.
  • the fingerprint identification area includes N fingerprint identification sub-regions, where N is an integer greater than 1.
  • the initiating operation is a touch operation; the method further includes: if the touch operation on the display screen of the terminal is detected, determining the fingerprint identification area according to an operation area corresponding to the touch operation, and The fingerprint identification area is divided into N pieces of the fingerprint identification sub-area, and the operation area is within the area of the fingerprint identification area.
  • the fingerprint identification area may be divided into multiple fingerprint identification sub-areas according to actual needs, and multiple fingerprint identification sub-areas may be scanned at the same time, thereby improving work efficiency.
  • the data vector is sequentially used in the foregoing After the data element in the control controls the minimum pixel unit illumination in the fingerprint identification area, the method further includes:
  • the emitted light reflected by the user's finger is sensed by the optical sensing device and converted into a fingerprint vector corresponding to the smallest pixel point.
  • the optical sensing device includes a PD array, and the reflected light is photoelectrically converted by the optical sensing device. Since the photosensitive characteristics of the PD array are good, the PD array can be converted to obtain accurate fingerprint data, thereby improving fingerprint recognition performance.
  • the data element in each of the data vectors is sequentially used to control the fingerprint Before the minimum pixel unit in the region is illuminated, the method further includes:
  • the minimum pixel unit and the PD array are collated to obtain a correspondence between the minimum pixel unit and the PD array.
  • the correspondence between the minimum pixel unit and the PD array is established by proofreading, so that the PD corresponding to the minimum pixel unit can be obtained according to the corresponding relationship in the orthogonal demodulation process, thereby Get accurate fingerprint data.
  • the minimum pixel unit includes a pixel.
  • the correspondence between the minimum pixel unit and the PD array may be: multiple pixels correspond to multiple PDs, or one pixel corresponds to multiple PDs, or one pixel corresponds to one PD.
  • a second aspect of the embodiments of the present application provides a fingerprint identification apparatus, including: an acquiring module, configured to acquire a first vector set, where the first vector set includes A mutual positives, if a startup operation on a screen of the terminal is detected a data vector, each of the data vectors includes a plurality of data elements, the A is an integer greater than 1; the illumination control module is configured to sequentially control the fingerprint identification area by using data elements in each of the data vectors The minimum pixel unit is illuminated until the control illumination of all the smallest pixel units in the fingerprint identification area is completed, to obtain a second vector set corresponding to the fingerprint identification area, and the second vector set carries fingerprint information; And a demodulation module, configured to demodulate the second set of vectors by using the first set of vectors to obtain all fingerprint information in the fingerprint identification area.
  • the illuminating control module is specifically configured to perform the following operations: (1) using each of the data vectors first a data element having the same serial number controls the minimum pixel unit illumination in a predetermined order; (2) using another data element having the same sequence number in each of the data vectors to control another minimum pixel unit illumination in the predetermined order; (3) repeating Performing (1) and (2) processes until the minimum pixel unit illumination within the fingerprint recognition area is controlled using the same data element of the last one of each of the data vectors; (4) if the The control illumination of all the smallest pixel units in the fingerprint recognition area is repeated (1), (2), and (3) until the completion.
  • the first vector set is a three-dimensional matrix
  • the structure of M[I, J, K], I, J, K are sequentially the dimensions of the three-dimensional matrix M[I, J, K] in the X, Y, Z directions, wherein the three-dimensional matrix M [ In I, J, K], column vectors having different coordinate positions on the X and Y planes are orthogonal to each other, the A is equal to the product of I and J, and one of the data vectors is the three-dimensional matrix M[I, Any one of J, K] has the same coordinate position on the X and Y planes, and one of the data vectors includes K data elements.
  • one of the data vectors corresponds to one or more minimum pixel units. And, one or more pixel points are included in one of the minimum pixel units.
  • the second vector set includes the A fingerprint vectors, where the fingerprint vector includes The fingerprint information collected during the minimum pixel unit illumination process; the demodulation module is specifically configured to perform vector inner product operation using the data vector and the fingerprint vector corresponding to the same minimum pixel unit until all the fingerprint identification regions are completed The vector inner product operation corresponding to the smallest pixel unit is used to obtain all the fingerprint information in the fingerprint identification area.
  • the fingerprint identification device further includes: a conversion module for converting data elements in each of the data vectors into standardized display data for controlling illumination of a minimum pixel unit.
  • the standardized display data includes gray data
  • the conversion The module is specifically used to:
  • the y is the gradation data
  • the n is the number of bits of the gradation data
  • the m[i, j, k] is Any one of the first data sets, i ⁇ [1, I]; j ⁇ [1, J], k ⁇ [1, K], the max is the largest element in the first data set a value, the min being the smallest element value in the first set of data.
  • the fingerprint identification area includes N fingerprint identification sub-regions, where N is an integer greater than 1.
  • the fingerprinting device further includes: a determining module, configured to: determine the fingerprint according to an operation area corresponding to the touch operation, if the touch operation on the display screen of the terminal is detected Identifying an area, and dividing the fingerprint identification area into N pieces of the fingerprint identification sub-area, the operation area being within an area of the fingerprint identification area.
  • a third aspect of the embodiments of the present application provides a fingerprint identification apparatus, including: a memory and a processor; the memory is configured to store an operation instruction; and the processor is configured to invoke the operation instruction to perform the first aspect.
  • the method for acquiring fingerprint information according to any one of the preceding claims.
  • a fourth aspect of the embodiments of the present application provides a computer storage medium, where the computer storage medium stores an operation instruction, when the operation instruction is run on a computer, so that the computer performs the first aspect as described above.
  • a fifth aspect of the embodiments of the present application provides a computer program product, when the computer program product is run on a computer, causing the computer to perform the method for acquiring fingerprint information according to any one of the above first aspects.
  • FIG. 1 is a schematic diagram of a frame of an optical fingerprint identification system according to an embodiment of the present application
  • FIG. 2 is a schematic diagram of an embodiment of a method for acquiring fingerprint information according to an embodiment of the present application
  • FIG. 3 is a schematic diagram of another embodiment of a method for acquiring fingerprint information according to an embodiment of the present disclosure
  • FIG. 4 is a schematic diagram of a fingerprint identification area segmentation according to an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a three-dimensional matrix M[8, 8, 8] according to an embodiment of the present application
  • FIG. 6 is a schematic diagram of a 4-bit gray level provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of an 8-bit gray level provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of scanning a fingerprint identification sub-area according to an embodiment of the present application.
  • FIG. 9 is a schematic diagram of an optical path of a PD array according to an embodiment of the present application.
  • FIG. 10 is a hardware structure diagram of a smart phone fingerprint identification system according to an embodiment of the present application.
  • FIG. 11 is a schematic diagram of another embodiment of a method for acquiring fingerprint information according to an embodiment of the present application.
  • FIG. 12 is a schematic diagram of a fingerprint identification area range according to an embodiment of the present application.
  • FIG. 13 is a schematic diagram of a three-dimensional fourth-order matrix according to an embodiment of the present application.
  • FIG. 14(a) is a schematic diagram of fingerprint scanning of a two-dimensional matrix according to an embodiment of the present application.
  • FIG. 14(b) is a schematic diagram of fingerprint scanning of another two-dimensional matrix according to an embodiment of the present application.
  • FIG. 14(c) is a schematic diagram of fingerprint scanning of another two-dimensional matrix according to an embodiment of the present application.
  • FIG. 14(d) is a schematic diagram of fingerprint scanning of another two-dimensional matrix according to an embodiment of the present application.
  • FIG. 15 is a schematic diagram of an embodiment of a fingerprint identification apparatus according to an embodiment of the present application.
  • FIG. 16 is a schematic diagram of another embodiment of a fingerprint identification apparatus according to an embodiment of the present application.
  • the present application provides a method for acquiring fingerprint information, which is used to improve the accuracy of acquiring fingerprint information and improve fingerprint recognition performance.
  • the technical solutions in the present application are clearly and completely described in the following with reference to the drawings in the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments.
  • the method for acquiring fingerprint information in the present application is applicable to terminal devices such as smart phones, tablet computers, notebook computers, and in-vehicle devices, and is not limited to the above terminal devices.
  • FIG. 1 is a schematic diagram of a system framework of an optical fingerprint identification system according to an embodiment of the present application.
  • the optical fingerprint identification system includes: a fingerprint scanning control circuit 101, a terminal display screen 102, an optical sensing device 103, a fingerprint information collecting front end processing circuit 104, a fingerprint information post processing circuit 105, and a fingerprint identification application circuit 106.
  • the terminal display screen 102 can be a liquid crystal display (LCD), an organic light emitting diode (OLED) display, or a quantum dot light emitting diode (quantum dot light emitting diode). Referred to as QLED) display, or micro light emitting diode (MLED) display.
  • LCD liquid crystal display
  • OLED organic light emitting diode
  • MLED micro light emitting diode
  • the fingerprint scanning control circuit 101 is configured to control fingerprint scanning and driving logic
  • the optical sensing device 103 is mainly used for sensing an optical signal and converting it into an electrical signal.
  • an array formed by the aforementioned PD may be used (hereinafter referred to as a PD array);
  • the fingerprint information collection front-end processing circuit 104 is configured to process the electrical signals collected by the optical sensing device 103, including but not limited to filtering, noise reduction, ADC conversion, protocol interface processing, and the like;
  • the fingerprint information post-processing circuit 105 is configured to perform calculation and analysis on the data processed by the fingerprint information collection front-end processing circuit 104 to obtain fingerprint information;
  • the fingerprint identification application circuit 106 is configured to perform operations such as user identity information verification based on the fingerprint information output by the fingerprint information post-processing circuit 105.
  • any one or more of the fingerprint scanning control circuit 101, the fingerprint information post-processing circuit 105, and the fingerprint identification application circuit 106 may be based on a universal A processor (such as a CPU) is implemented (that is, the CPU usually reads the instructions stored in the memory and later implements the functions of these circuits), wherein the CPU can be packaged on one chip together with other processing circuits.
  • a universal A processor such as a CPU
  • any one or more of the fingerprint scanning control circuit 101, the fingerprint information collection front-end processing circuit 104, and the fingerprint information post-processing circuit 105 may be implemented based on an integrated circuit, for example, based on an ASIC, an FPGA, or the like. To realize the functions of these circuits, at the same time, for better integration, these circuits can be packaged into one chip, and of course, it is not limited to package any one or more of the circuits into one chip separately.
  • the fingerprint identification application circuit 106 is implemented based on a CPU; the optical sensing device 103 is a PD array; the fingerprint scanning control circuit 101, the fingerprint information collection front end processing circuit 104, and the fingerprint information post-processing circuit 105 are each implemented by an integrated circuit. And packaged to the same chip.
  • a group A mutually orthogonal data vector in the first vector set is used to control all minimum pixel point illumination in the fingerprint identification area to obtain a second vector carrying fingerprint information in the fingerprint identification area.
  • the set finally, demodulates the second set of vectors by using the first set of vectors to obtain all fingerprint information in the fingerprint identification area.
  • FIG. 2 is a schematic diagram of an embodiment of a method for acquiring fingerprint information according to an embodiment of the present disclosure. As shown in FIG. 2, the method for obtaining fingerprint information includes:
  • a startup operation on the screen of the terminal is detected, acquiring a first vector set, where the first vector set includes a plurality of mutually orthogonal or mutually quasi-orthogonal data vectors.
  • the first vector set includes A mutually orthogonal data vectors, A is an integer greater than or equal to 2, and each data vector includes a plurality of data elements.
  • the startup operation refers to an operation of triggering the fingerprint identification device to start the method for acquiring the fingerprint information. For example, taking the mobile phone as an example, in the state of the mobile phone lock screen, the user's finger touches the fingerprint recognition area, or the user's finger is free to the mobile phone screen.
  • the touch operation of the area is not limited to the specific performance of the touch operation, and only a technical effect similar to the above touch operation can be achieved.
  • the fingerprint scanning control circuit 101 shown in FIG. 1 above may read all data elements in the first vector set from a physical storage space corresponding to the first vector set, such as a memory. Alternatively, it is also possible to read all of the above data from the corresponding memory by having an integrated circuit or chip similar to the above-described fingerprint scanning control circuit 101.
  • the first set of vectors and the corresponding data elements can be constructed by a three-dimensional matrix M[I, J, K], which in turn is a three-dimensional matrix M[I, J, K] at X , the dimension in the Y, Z direction, and I, J, K are integers greater than or equal to 1, each matrix element using m[i,j,k] (or mijk, as m011), where i ⁇ [1,I];j ⁇ [1,J],k ⁇ [1,K].
  • the three-dimensional matrix M[I, J, K] can be in the X direction (ie, in the Y and Z planes), in the Y direction (ie, in the X and Z planes), or in the Z direction (ie, X and Y).
  • the column vector having the same coordinate position as any one of the planes is used as a data vector, and one data vector correspondingly includes a plurality of data elements, for example, one, J or Z data elements.
  • each matrix element in the three-dimensional matrix satisfying the above orthogonal condition is taken as one data element, and a total of (I*J*K) data elements are used, and the (I*J*K) is according to the above-mentioned column vector Wi,j.
  • the data elements are divided into (I*J) data vectors, wherein each data vector includes K data elements.
  • the fingerprint identification device may further determine the fingerprint identification area according to the operation area corresponding to the startup operation.
  • the startup operation refer to the related description of the startup operation in the above step 201, and details are not described herein again.
  • the specific determination method of the fingerprint identification area refer to the related description in step 304 below, and details are not described herein again.
  • the fingerprint identification area may also be determined in a pre-specified manner, and specifically, a specific area on the screen of the terminal may be used as a fingerprint identification area.
  • a specific area on the screen of the terminal may be used as a fingerprint identification area.
  • the touched area is used as a fingerprint identification area, and the area of the designated fingerprint identification area is notified to the user to ensure that the user places a finger in the designated fingerprint area in the fingerprint application scenario, so that the mobile phone detects the specific area.
  • the touch operation eliminates the need to determine the fingerprint recognition area according to the operation area of the touch operation after the touch operation.
  • the mobile phone can issue a prompt message to prompt the user. Place your finger in the specified fingerprint recognition area, and do not limit the prompting method.
  • each data vector is sequentially used to control the illumination of the smallest pixel unit in the fingerprint identification area to obtain a second vector set corresponding to the fingerprint identification area.
  • the fingerprint identification device After acquiring the data elements in the first vector set and determining the fingerprint identification area, the fingerprint identification device sequentially controls the illumination of the smallest pixel unit in the fingerprint recognition area by using the data elements in each data vector until all the fingerprint recognition areas are completed.
  • the minimum pixel unit controls the illumination to obtain a second vector set corresponding to the fingerprint identification area, and the second vector set carries the fingerprint information.
  • the fingerprint recognition device sequentially uses the data elements in each data vector to control the illumination of the smallest pixel unit within the fingerprint recognition region.
  • the specific process can include the following steps:
  • "using one data element of the same serial number in each data vector” means using one data in one data vector. Then use the same sequence number data in another data vector, and so on. For example, first use the first data in the first data vector, then use the first data in the second data vector, then use the first data in the third data vector, and so on. The first data in the data vector. Next, you can use the second data in the first data vector, then the second data in the second data vector, and so on. It should be noted that the order of the data in each data vector used each time is not limited. For example, the second data in each data vector may be used first, and the second data is used in each data vector. The 5th data.
  • predetermined order refers to a predetermined order of lighting the minimum pixel unit, for example, for a rectangular area, from left to right, top to bottom; or from right to left, from top to bottom The order of the following; or other various sequences.
  • the scanning (1)(2)(3) process may be repeatedly performed, that is, the data may be repeatedly used again or The process of illuminating the smallest pixel unit of the scan area in multiple passes until the control illumination of all the smallest pixel units in the fingerprint recognition area is completed.
  • one data vector may correspond to one minimum pixel unit, or one data vector may correspond to two or more minimum pixel units, and in the above two correspondences, the minimum pixel unit may include One pixel, or two or more pixels.
  • controlling illumination described above may be implemented by the fingerprint scanning control circuit 101 described above in FIG. 1, or by an integrated circuit or chip having similar fingerprint scanning control circuit 101 as described above.
  • the optical sensing device 103 (including the PD array) described above in FIG. 1 senses the reflected light and converts it into an electrical signal and outputs it to the fingerprint information front end acquisition circuit 104, the front end of the fingerprint information.
  • the acquisition circuit filters and denoises the optical signal collected by the PD array to obtain corresponding fingerprint data, and saves the fingerprint vector, that is, the second vector set.
  • the acquiring method further comprises: the fingerprint identification device converting the data element in each data vector into a standardized display. Data, standardized display data is used to control the illumination of the smallest pixel unit.
  • the display data here refers to data for controlling the light of the display pixels to emit different intensities within a certain range.
  • each display screen (specifically driven by the display screen) controls the pixels of the display screen to emit different intensities according to a certain range of input data (ie, "display data"). Therefore, in order to adapt to the display screen "Display Data", in this application, data elements in a data vector can be converted (mapped) into display data.
  • display data data elements in a data vector can be converted (mapped) into display data.
  • This process can be called a standardized process.
  • the range of the display data is 1-10 and the range of the scan data is 1-100
  • 1-10 of the scanned data can be converted into 1 of the display data
  • 11-20 of the scanned data can be converted into 2 of the display data.
  • the 21-30 of the scanned data is converted into 3 of the displayed data... and so on.
  • the normalized data may be grayscale data
  • the fingerprint identification device converts the data elements in each data vector into grayscale data.
  • step 304 the specific description of the degree data conversion will not be described here.
  • the data elements in the data vector are converted into standardized display data, which may be implemented by the fingerprint scanning control circuit 101 as described in FIG. 1 above, or an integrated circuit having a conversion function similar to that of the fingerprint scanning control circuit 101 described above. Or chip and so on.
  • the second vector set includes A fingerprint vectors. It can be understood that the fingerprint vector is the same as the number of data vectors, and the fingerprint vector includes the fingerprint information collected during the minimum pixel unit illumination process.
  • the demodulating the second vector set by using the first vector set may be: performing a vector inner product operation using the data vector and the fingerprint vector corresponding to the same minimum pixel unit until all minimum pixel units in the fingerprint identification area are completed. The vector inner product operation finally obtains all the fingerprint information in the fingerprint identification area.
  • the fingerprint vector obtained by controlling the data element in each data vector Wi,j to control all the minimum pixel units in the fingerprint region is recorded as Vi, j
  • the data vector Wi, j and the fingerprint vector Vi, j are one-to-one correspondence
  • the fingerprint data in each fingerprint vector is arranged in the same manner as the data elements in the data vector corresponding to the fingerprint vector.
  • the demodulation process of the fingerprint information may be implemented by the fingerprint information post-processing circuit 105 described in FIG. 1 above, or by an integrated circuit or chip having the above demodulation function.
  • the specific demodulation process of the fingerprint information post-processing circuit 105 may be: the fingerprint information post-processing circuit 105 acquires the fingerprint data processed by the fingerprint information front-end acquisition circuit 104 and forms a corresponding fingerprint vector, and obtains a corresponding data vector from the memory, and finally The fingerprint information post-processing circuit 105 performs vector inner product operation based on the data vector and the fingerprint vector to obtain fingerprint information.
  • the minimum pixel unit on the terminal display screen is illuminating and modulating using mutually orthogonal data vectors, and the corresponding fingerprint data, that is, the fingerprint vector is obtained, and finally, the data vector and its corresponding fingerprint vector are demodulated to obtain an accurate image.
  • Fingerprint information to improve fingerprint recognition performance. It can be understood that, because the data vectors are mutually orthogonal, the mutual interference between the illuminating rays of the minimum pixel units in the illuminating modulation process can be reduced. Therefore, the method for acquiring the fingerprint information in the embodiment of the present application may be Improve the accuracy of obtaining fingerprint information and improve fingerprint recognition performance.
  • the minimum pixel unit may be one or more pixel points, and the method for acquiring the fingerprint information described in the embodiment of the present application will be described in detail below by taking the minimum pixel unit as one pixel.
  • the scanning described in the following is relative to the user, that is, a scanning of the user's finger.
  • the scanning process in the embodiment of the present application uses the scanning data to light the fingerprint. Recognizing the illuminating modulation process of the pixel points in the area, while the illuminating modulation is performed, the pixel illuminating ray also completes the scanning of the user's finger in the above illuminating modulation process. Therefore, the scanning mentioned below may be equivalent to the pair of pixels.
  • the illuminating modulation of the point, the scanning process is the pixel point illuminating modulation process. This will not be repeated below.
  • FIG. 3 is a schematic diagram of another embodiment of a method for acquiring fingerprint information according to an embodiment of the present disclosure. As shown in FIG. 3, another method for obtaining fingerprint information in the embodiment of the present application includes:
  • the calibration method may be: sending a calibration instruction by calling the fingerprint scanning control circuit 101 to drive a certain pixel to illuminate the user's finger, and recording the position of the pixel, and the PD array senses the light reflected by the user's finger and converts it into The electrical signal finally stores the data obtained after the signal processing into the data buffer. Traverse all the data of the PD array in the data buffer area, obtain the data with the largest value, and record the PD position corresponding to the data, so as to establish the correspondence between the two according to the recorded pixel position and the PD position, (pixel, PD) pairs and save.
  • each pixel of the terminal display screen is sequentially set to a corresponding (pixel, PD) pair and saved, and the calibration of the pixel is completed.
  • the correspondence between the pixel points and the PD may not be a one-to-one correspondence.
  • the following relationships may exist:
  • one data used for scanning is used to simultaneously illuminate a plurality of pixels, and when receiving, data of a plurality of PDs is acquired, and the data can be similarly added, averaged, etc. Get data that can reflect fingerprint information. In this process, it can be seen as binding multiple pixels into a "large” pixel, and binding multiple PDs into a "large” PD.
  • one data used for scanning is used to illuminate one pixel, and when receiving, data of a plurality of PDs is acquired, and the data can be similarly added, averaged, etc. Data that can reflect fingerprint information.
  • one data used for scanning is used to simultaneously illuminate a plurality of pixels, and when receiving, the value of the corresponding one PD is acquired.
  • the mobile terminal when the mobile terminal detects that the user's finger touches the display screen, the mobile terminal determines whether the touch operation of the finger is valid according to the actual scene, and if valid, starts the fingerprint positioning, otherwise the user does not respond to the touch. operating. If the fingerprint location is activated, the mobile terminal determines the coordinate position area where the user's finger is located as the operation area, and further, the mobile terminal determines the operation area as the fingerprint recognition area.
  • the mobile terminal can initiate fingerprint positioning and perform fingerprint recognition to unlock the screen after the fingerprint recognition succeeds.
  • the mobile terminal may not respond to the user's pressing operation.
  • the fingerprint identification area may be one piece or multiple pieces. For example, for a scene of multi-touch (ie, several fingers are simultaneously touched), one fingerprint identification sub-area may be divided for each touch point, and each There is no contact between the fingerprint recognition sub-areas.
  • FIG. 4 is a schematic diagram of a fingerprint identification area segmentation according to an embodiment of the present application.
  • a mobile phone screen is taken as an example.
  • touch points two finger fingerprints
  • the arrangement of the positions of the touched points is not limited, and for example, they may be arranged in a left-right relationship, an upper-lower relationship, or a mixed relationship.
  • two fingerprint recognition sub-areas of AEHD and FBCG can be generated accordingly. It can be understood that these two areas are larger than the touch points (requires coverage to be detected), but it does not need to be particularly large ( It is not necessary to introduce a large number of areas that are not related to fingerprints. It can usually be set to 1 to 3 times the area of the touch point, and some redundant areas are reserved around the touch points to prevent some fingerprint data from being missed. For subsequent processing convenience, the two regions can be matrices.
  • the scan data is a data element in the first vector set described in the embodiment corresponding to Fig. 2 above, wherein one data element is a scan data. Therefore, the scan data may be a matrix element in the above three-dimensional matrix M[I, J, K].
  • FIG. 5 is a schematic diagram of a three-dimensional matrix M[8, 8, 8] provided by an embodiment of the present application.
  • the three-dimensional matrix M[8,8,8] can be divided into eight two-dimensional matrices in the Z direction, and these two-dimensional matrices are respectively represented as: M1[I,J], M2[I,J], M3[ I, J], M4 [I, J], M5 [I, J], M6 [I, J], M7 [I, J], M8 [I, J].
  • a total of 64 column vectors of column vectors W1, 2, W1, 3, W1, 4, W1, 5, W2, 1, W2, 2, etc. can be obtained, wherein 64 column vectors satisfy: for the same
  • the three-dimensional matrix M[8, 8, 8] is sequentially constructed according to the above orthogonal conditions, and then the two-dimensional matrix of the three-dimensional matrix M[8, 8, 8] in the Z direction is used as a scanning pattern, and one matrix element is used as a matrix element. A scan of the data.
  • the correspondence between the scan data and the pixel is similar to the correspondence between the pixel and the PD, that is, one scan data corresponds to one pixel, or one scan data corresponds to multiple pixels. Or, a plurality of pixel data may be corresponding to a plurality of pixel points.
  • a detailed description refer to the related description of the correspondence between the pixel points and the PD in the foregoing step 301, and details are not described herein again.
  • scan data is converted into gray scale data.
  • scan data can be converted to gray scale data using Equation 1 or Equation 2 as described below.
  • y is the gradation data
  • n is the number of bits of the gradation data bit
  • m[i, j, k] is the three-dimensional matrix M[I, J, K] (i, j, k)
  • the matrix element of the coordinate position is any scan data
  • max is the maximum scan data value in the scan data group
  • min is the minimum scan data value in the scan data group.
  • the above formula 1 and formula 2 are only used as an exemplary description, and do not limit the conversion mode. Other conversion methods with the same technical effects can be used to convert the scan data into gray scale data.
  • the gray scale data is used to control the gray level (or gray scale) of the pixels of the display screen, and each pixel point includes three sub-pixels of RGB, and all three sub-pixels are set to the same gray scale data to be displayed.
  • the corresponding gray level is output.
  • the bit of the gray data is 4 or 8 bits.
  • FIG. 6 is a schematic diagram of a 4-bit gray level provided by the embodiment of the present application
  • FIG. 7 is a schematic diagram of an 8-bit gray level provided by the embodiment of the present application.
  • the gradation data has 4 bits, then there are 16 gray levels (from 0 to 15), when the gradation data is 0, the brightness is the lowest, and when the gradation data is 15, the brightness is the highest.
  • the grayscale data has 8 bits, then there are 256 gray levels (from 0 to 255), and the relationship between the gray level and the brightness is as shown in FIG.
  • each of the three-dimensional matrix M[8, 8, 8] in the Z direction The dimension matrix is used as a scan pattern, wherein the matrix elements are scan data, and each scan pattern includes 64 matrix elements (ie, data vectors) each having the same matrix element number, that is, a scan pattern includes 64 matrix elements.
  • This matrix element is a matrix element from the same sequence number in 64 column vectors, respectively.
  • the pixels in the fingerprint recognition area are respectively scanned by using eight scanning patterns, and each scan performs the following steps:
  • Step 1 Scan data is taken from each scan interval in a scan pattern, where s ⁇ I.
  • the scanning data extraction manner may be that all the scan data are taken out in a row-by-row manner, that is, one by one in a sequential order.
  • Step 2 Convert the scanned data into gray scale data to control the pixel spot illumination to scan the fingerprint recognition area.
  • Step 3 When all the data in the scan pattern is taken out and step 2 is performed, the scan pattern is moved in the fingerprint recognition area to continue scanning.
  • the scanning process is described by taking one pixel corresponding to one scan data as an example.
  • the total number of pixels in the fingerprint recognition area is 4 times the number of pixels corresponding to the scan pattern, scanning is performed using one scanning pattern, and only scanning is completed. 1/4 of the pixels in the fingerprint recognition area. Therefore, it is also necessary to use the scan pattern to scan the pixels in the other 3/4 fingerprint recognition areas to complete the scanning of the fingerprint recognition area. Therefore, the fingerprint can be used.
  • the pattern is scanned from the next pixel at the end of the last scan, thereby completing the scanning of the next 1/4 fingerprint recognition area. This process can be regarded as the movement of the scan pattern in the fingerprint recognition area. It should be understood that when fingerprint recognition When the number of total pixels in the area is equal to the number of pixels corresponding to the scan pattern, the scan pattern can scan the entire fingerprint recognition area once, without moving the scan pattern in the fingerprint recognition area.
  • Step 4 After the scan pattern traverses the entire fingerprint recognition area, the current scan is ended, and the next scan pattern is used for the next scan until the scan of the eight scan patterns is completed.
  • the acquiring method further includes: if the touch operation is effective, the fingerprint identification device may further correspond according to the startup operation, before the scanning of the fingerprint display area is controlled by using the scan data.
  • the operation area determines the fingerprint identification area, and divides the fingerprint identification area into N fingerprint recognition sub-areas, where N is an integer greater than or equal to 2.
  • FIG. 8 is a schematic diagram of scanning a fingerprint identification sub-area according to an embodiment of the present application. If the area of the fingerprint identification area is N times of the area of the pixel corresponding to one scan pattern (that is, the number of pixels included in the fingerprint recognition area is N times the number of pixels corresponding to one scan pattern), as shown on the right side of FIG. Dividing the fingerprint identification area into N fingerprint recognition sub-areas A1 to An, where n ⁇ [1, N], as shown on the left side of FIG. 8 , dividing any one of the fingerprint recognition sub-areas of A1 to An into Group G, each group includes s row scan data, s is greater than or equal to 2, and is less than or equal to the maximum row value in the scan pattern.
  • the fingerprint identification area is divided into two fingerprint recognition sub-areas of AEHD and FBCG.
  • the AEHD sub-area is scanned in groups, and the specific process is as follows:
  • Step 5 Divide the AEHD sub-region into at least two groups, denoted as G group, where G is an integer greater than or equal to 2;
  • Step 6 For each group region in the group G after grouping, the AEHD sub-region is scanned according to the scanning process described in the above steps 1 to 3 using the corresponding scanning pattern.
  • the scanning process in steps 1 to 3 above may be sequentially performed in the above-mentioned G group region, or the scanning process in steps 1 to 3 described above may be simultaneously performed on the G group region.
  • Step 7 Continue to scan the AEHD area for the next scan using another scan pattern until all scan patterns have been scanned.
  • the FBCG sub-area may be scanned in a similar manner, or the AEHD area may be scanned first, and then the FBCG area may be scanned, which is not limited in this application.
  • the scan data is taken out from the scan pattern in a row-by-row order to generate progressive gray scale data, and the pixel dots are illuminated line by line.
  • scanning may be performed from the scan pattern according to other predetermined rules, for example, by scanning a predetermined number of scan data or taking a scan in a predetermined random manner.
  • the random mode can reduce the afterglow interference between adjacent pixel points (that is, each pixel point is protected from being illuminated for a period of time after being lit, since the previous pixel point is lit When it is not extinguished, immediately illuminate an adjacent pixel, and the light of the previous pixel will interfere with the next pixel, which is called afterglow interference, further reducing the mutual interference between adjacent pixels.
  • FIG. 9 is a schematic diagram of an optical path of a PD array according to an embodiment of the present application.
  • the PD array in the optical fingerprint module 103 receives the reflected light signal reflected by the user's finger on the OLED screen.
  • a (pixel, PD) pair for characterizing the correspondence between pixel position and PD position has been established during the calibration process. According to the positional relationship recorded in the (pixel, PD) pair, when one of the pixels is lit, the PD receiving the reflected light signal can be determined.
  • the number of times the pixel is illuminated is the same as the number of reflected light signals received on the corresponding PD, that is, the pixel is illuminated several times, and the PD corresponding to the pixel is received.
  • the reflected light signal is reflected several times.
  • the PD array can be replaced with other image sensors having similar functions, and the present application does not impose any limitation.
  • the fingerprint information acquisition front end processing circuit 104 amplifies, filters, and the like the reflected light signal received by the PD to obtain fingerprint data.
  • the pixel points of the fingerprint recognition area are all scanned a plurality of times, there are a plurality of fingerprint data acquired by the corresponding PD, for example, 8 corresponding to the column vector W1, 1 in the above three-dimensional matrix M[8, 8, 8]
  • the eight fingerprint data obtained after scanning K times of the same pixel are: v111, v112, v113, v114, v115, v116, v117, v118.
  • the fingerprint data scanned by the scan data set is represented by a column vector Vi,j, wherein the V1,1 is a column vector corresponding to the fingerprint data after the fingerprint identification area is scanned using W1,1. It should be noted that the fingerprint data in the column vectors Vi, j is consistent with the order of the scan data in the column vectors Wi, j.
  • the column vector, Pi, j is the result of the orthogonal demodulation operation, that is, the fingerprint information.
  • Circuit 106 invokes operations such as fingerprint verification.
  • the scanning of the pixel in the display screen of the terminal is controlled by using the scanning data constructed by the three-dimensional matrix having orthogonal characteristics to perform fingerprint scanning.
  • the surface of the finger has a reflective characteristic, and the light of the pixel is reflected to form reflected light.
  • the signal wherein the reflected light signal carries fingerprint information, and further, converts the reflected light signal into fingerprint data, and performs orthogonal demodulation on the fingerprint data to obtain fingerprint information. Since the scan data has orthogonal characteristics, that is, the scanning process is orthogonally modulated, and the fingerprint information is obtained by orthogonally demodulating the fingerprint data obtained after scanning, and can be reduced by orthogonal modulation and quadrature demodulation. Even eliminate the ambient light and the interference between the light of each pixel to obtain more accurate fingerprint information and improve the performance of optical fingerprint recognition.
  • FIG. 10 is a hardware structure diagram of a fingerprint identification system of a smart phone.
  • the smart phone fingerprint recognition system includes: a light-emitting driving module 1001, a pixel array 1002, a scan driving module 1003, a multiplexing and demultiplexing module 1004, a display driving integrated circuit 1005, a touch electrode module 1006, a touch integrated circuit 1007, and a fingerprint module.
  • the display driving integrated circuit 1005 includes three parts: a modulus and digital-to-analog conversion module 10051, a control logic module 10052, and a power module 10053.
  • the illumination driving module 1001, the pixel array 1002, the scan driving module 1003, the multiplexing and demultiplexing module 1004, the display driving integrated circuit 1005, the touch electrode module 1006, and the touch integrated circuit 1007 are inherited in the OLED display of the smart phone.
  • the fingerprint module 1008 and the fingerprint module integrated circuit 1009 are integrated under the OLED display.
  • the application processor 1010 provides a control interface for the display driver integrated circuit 1005, the touch integrated circuit 1007, and the fingerprint module integrated circuit 1009, and executes a fingerprint recognition algorithm and a high-level fingerprint recognition application.
  • the illumination driving module 1001, the scan driving module 1003, and the control logic module 10052 can implement the fingerprint scanning function and the driving logic control function of the fingerprint scanning control circuit 101 described above in FIG.
  • the fingerprint module 1008 may specifically include the optical sensing device 103 (ie, PD array) and the fingerprint information collecting front-end processing circuit 104 described above in FIG. 1 to implement fingerprint data collection, filtering, and noise reduction processing.
  • the optical sensing device 103 ie, PD array
  • the fingerprint information collecting front-end processing circuit 104 described above in FIG. 1 to implement fingerprint data collection, filtering, and noise reduction processing.
  • the fingerprint module integrated circuit 1009 may specifically include the fingerprint information post-processing circuit 105 as described above in FIG. 1 to demodulate the fingerprint data to obtain corresponding fingerprint information.
  • the present application provides a specific method for acquiring fingerprint information, and a specific method flow is shown in FIG. 11.
  • a schematic diagram of an embodiment of a method for acquiring fingerprint information includes:
  • the calibration method is similar to the description in step 301 above, and details are not described herein again.
  • the specified area or all the areas on the OLED display are defined as the fingerprint identification area.
  • the touch operation is detected by the touch integrated circuit, and the touch integrated circuit reports the detection result to the AP 1010.
  • the AP 1010 starts the positioning and segmentation process of the fingerprint identification area, and determines the sub-area to be scanned.
  • the number of sub-regions is the same as the number of fingers in the fingerprint identification area.
  • the touch integrated circuit 1007 provides a finger touch area to the AP 1010, and determines a fingerprint identification area according to the finger touch area, where the fingerprint identification area is larger than and includes the finger touch area, and the fingerprint identification area is The non-coincident portion of the finger touch area has a certain pixel point.
  • the ABCD area in FIG. 12 is a fingerprint recognition area.
  • the length of the B segment is 10 mm (corresponding to 220 pixels on a 2K display), and the length of the AC segment is 12 mm (corresponding to 200 pixels on a 2K display).
  • the coordinates of points A, B, C, and D are finally determined, and the positioning process of the fingerprint identification area is completed.
  • the fingerprint identification area may be divided into multiple fingerprint identification sub-areas for scanning, which is a segmentation process of the fingerprint identification area, and the specific implementation is implemented. It can be realized by the above-mentioned segmentation program of the fingerprint area, and the implementation method of the segmentation program is many, and the present application does not impose any limitation.
  • the scan data is obtained from a specially constructed three-dimensional orthogonal matrix.
  • the scan data is stored in a memory of the smartphone, such as a non-volatile memory.
  • FIG. 13 is a schematic diagram of a three-dimensional fourth-order matrix provided by an embodiment of the present application.
  • the three-dimensional fourth-order matrix includes four two-dimensional matrices, which are sequentially M1[I, J], M2[I, J], M3[I, J], and M4[I, J], the elements of which are shown in FIG. It should be understood that the elements in the four two-dimensional matrix shown in FIG. 13 constitute the scanning pattern described in the above step 304.
  • each matrix vector includes four matrix elements. It should be understood that the above 16 column vectors satisfy the orthogonal conditions described above. It should be noted that m000, m001, m002 and m003 are the above M[1,1,1], M[1,1,2], M[1,1,3] and M[1,1,4]. The corresponding matrix element at the position. The matrix elements at other matrix positions are analogous, and are not described here.
  • S4 Generate gray scale data from the scan data.
  • S5 Control the pixel point illumination in the fingerprint recognition area by using the gray scale data, and scan the fingerprint identification area.
  • the fingerprint area on the 2K display may contain 220*200 pixels, and the two-dimensional matrix has only 4*4 pixels, so it needs to be multiple times. Scanning with the same two-dimensional matrix can completely cover this area.
  • the above-mentioned three-dimensional fourth-order orthogonal matrix M[i, j, k] is taken as an example to illustrate the specific process of scanning.
  • the specific scanning process is as follows:
  • the AP 1010 writes the element m000 of the first two-dimensional orthogonal matrix into the buffer area of the illumination driver module.
  • the illumination driving module 1001 generates a corresponding gray scale data from the matrix element m000.
  • the illumination driver module 1001 outputs the gray scale data to the control logic module 10052 of the display screen.
  • the control logic module 10052 simultaneously illuminates three sub-pixels of RGB corresponding to m000 in the upper left corner of the fingerprint area, so the pixel emits white light, and the white light intensity is determined by the gray scale data, thereby realizing the illumination modulation of the display pixel.
  • step 5 when scanning with m010 data, the above 1, 2, The m000 in 3, 4 needs to be replaced with m010; the other steps are similar, and will not be described here.
  • FIG. 14(a) is a schematic diagram showing scanning of the fingerprint identification area using the two-dimensional matrix M1[I, J] shown in FIG. 13;
  • FIG. 14(b) shows the use of the two shown in FIG. Scanning diagram of scanning the fingerprint identification area by the dimension matrix M2[I, J]; as shown in FIG. 14(c), scanning the fingerprint identification area by using the two-dimensional matrix M3[I, J] shown in FIG.
  • Schematic diagram; as shown in FIG. 14(d), is a scanning diagram for scanning a fingerprint identification area using the two-dimensional matrix M4[I, J] shown in FIG.
  • S7 It is judged whether scanning of all fingerprint identification areas is completed, and if not, jumping to S3 to continue scanning.
  • the AP1010 reads the data in the PD during the fingerprint scanning process and the demodulation method is as follows:
  • Step 8 After lighting a certain pixel, the AP 1010 sends a read command to the fingerprint module integrated circuit 1009 for reading data in the PD.
  • Step 9 After receiving the read command, the fingerprint module integrated circuit 1009 delays a period of time Tread, for example, 50 us, and the Tread time is used to wait for the PD to output stable photoelectrically converted data.
  • Tread a period of time
  • Step 10 After the Tread time elapses, the fingerprint module integrated circuit 1009 searches for a correspondence table (pixel, PD) between the pixel pixel and the PD, reads data from the PD corresponding to the pixel, and saves the data to the buffer area. Is the original fingerprint data.
  • a correspondence table pixel, PD
  • Step 11 Repeat steps 8 to 10 to complete the two-dimensional matrix M[I, j, 0], M[i, j, 1], M[i, j, 2], M[i, j, 3] respectively
  • the PD data is read and all saved to the buffer area.
  • the above data (mij0, mij1, mij2, mij3) (after conversion to grayscale data) four times of response to the same display pixel and four times of response on the corresponding PD, that is, four original fingerprint data, It contains useful signals and interference signals.
  • Step 14 Repeat steps 8 to 13 above to complete the correlation operation of all corresponding pixels in the region where the fingerprint is located, and the obtained set of all Pi, j is the final fingerprint reflection signal.
  • the above content details the method for obtaining the fingerprint information provided in the present application.
  • the following is a detailed description of the fingerprinting device that implements the above method for acquiring the fingerprint information.
  • FIG. 15 is a schematic diagram of an embodiment of a fingerprint identification apparatus according to an embodiment of the present application. Based on the foregoing embodiments, as shown in FIG. 15 , a fingerprint identification apparatus provided by an embodiment of the present application includes:
  • the obtaining module 1501 is configured to: if the startup operation on the screen of the terminal is detected, acquire a first vector set, where the first vector set includes A mutually orthogonal data vectors, and each of the data vectors includes multiple data. An element, the A being an integer greater than one;
  • the illumination control module 1502 is configured to sequentially control the minimum pixel unit illumination in the fingerprint recognition area by using the data elements in each of the data vectors until the control illumination of all the minimum pixel units in the fingerprint identification area is completed to obtain a second vector set corresponding to the fingerprint identification area, where the second vector set carries fingerprint information;
  • the demodulation module 1503 is configured to demodulate the second set of vectors by using the first set of vectors to obtain all fingerprint information in the fingerprint identification area.
  • the obtaining module 1501 can be implemented based on the fingerprint scanning control circuit 101 described in FIG. 1 above.
  • the illumination control module 1502 can be implemented based on the optical sensing device 103 and the fingerprint information collection front-end processing circuit 104 described above in FIG. 1 .
  • the specific functions refer to steps 202 and 203 in FIG. 2 and steps 304 and 305 in FIG. 3 .
  • the relevant description in the description will not be repeated here.
  • the demodulation module 1503 can be implemented based on the fingerprint information post-processing circuit 105 described in FIG. 1 above.
  • the specific function refer to the description in step 204 of FIG. 2 and step 306 in FIG. 3, and details are not described herein again. .
  • the first set of vectors is constructed from a three-dimensional matrix M[I, J, K], and I, J, and K are sequentially three-dimensional matrices M[I, J, K] in the X, Y, and Z directions.
  • the upper dimension, in which the column vectors of the three-dimensional matrix M[I, J, K] having different coordinate positions on the X and Y planes are orthogonal to each other, A is equal to the product of I and J
  • one data vector is a three-dimensional matrix. Any of M[I, J, K] has the same column position in the X and Y planes, and K data elements are included in one data vector.
  • one data vector may correspond to one minimum pixel unit, or may also correspond to multiple minimum pixel units, and in the above two correspondences, one minimum pixel unit may have only one pixel point, or It is composed of multiple pixels.
  • one minimum pixel unit may have only one pixel point, or It is composed of multiple pixels.
  • the second vector set includes A fingerprint vectors, and the fingerprint vector includes fingerprint information collected during the minimum pixel unit illumination process; for related description of the second vector set, refer to step 204 above.
  • the description of the demodulation section is not limited herein.
  • the fingerprint recognition apparatus further includes a conversion module 1504 for converting data elements in each data vector into standardized display data for normalizing display data for controlling illumination of the smallest pixel unit.
  • the fingerprint identification area includes N fingerprint identification sub-areas, N is an integer greater than 1, and the startup operation is a touch operation.
  • the fingerprint identification apparatus further includes: a determination module 1505, configured to detect the display screen of the terminal The touch operation determines the fingerprint identification area according to the operation area corresponding to the touch operation, and divides the fingerprint identification area into N fingerprint recognition sub-areas, and the operation area is within the area of the fingerprint identification area.
  • a determination module 1505 configured to detect the display screen of the terminal The touch operation determines the fingerprint identification area according to the operation area corresponding to the touch operation, and divides the fingerprint identification area into N fingerprint recognition sub-areas, and the operation area is within the area of the fingerprint identification area.
  • FIG. 16 is a schematic diagram of another embodiment of a fingerprint identification apparatus according to an embodiment of the present application.
  • another fingerprint identification device provided by the embodiment of the present application may be a variety of mobile terminals (such as a mobile phone or a tablet), or may be various other fingerprint recognition functions.
  • the electronic device includes: a PD array 1601, a readout integrated circuit 1602, and a processor 1603.
  • the processor 1603 may be a general-purpose processor (such as a CPU), and the general-purpose processor may be packaged together with other circuits on a chip to form a system on chip (SoC), also called an AP (application processor), or an AP chip.
  • SoC system on chip
  • AP application processor
  • the processor of the Huawei Kirin series, or the processor of the Qualcomm Snapdragon series may also be other integrated circuit chips, and the application does not limit this.
  • the readout integrated circuit 1602 may be specifically integrated with one or more of the fingerprint scanning control circuit 101, the fingerprint information collecting front end processing circuit 104, and the fingerprint information post processing circuit 105 in the corresponding embodiment of FIG. 1 described above. Circuit.
  • the readout integrated circuit 1602 can be implemented based on an ASIC, an FPGA, or the like.
  • the above three circuits may be packaged into one chip, or, without limiting, one or more of the circuits may be separately packaged into one chip.
  • the above-mentioned general-purpose processor (such as a CPU) can implement the fingerprint scanning control circuit 101, the fingerprint information collecting front-end processing circuit 104, and the fingerprint information in the corresponding embodiment of FIG. 1 by executing corresponding operation instructions.
  • the function of one or more of the circuits 105 is processed.
  • the fingerprint identification device may further include a storage device, which may be a built-in memory of the processor 1603, or an external storage connected to the processor 1603 (such as various ROMs, flashes, disks, and optical disks). Wait).
  • the storage device is configured to store the scan data obtained by constructing the three-dimensional matrix, the fingerprint data obtained after scanning the fingerprint area, and the operation instruction, so that the processor 1603 can invoke the operation instruction to perform the acquisition of the fingerprint information provided in the embodiment of the present application. method.
  • the fingerprint identification device in this embodiment may at least one of the fingerprint scanning control circuit 101, the fingerprint information post-processing circuit 105, and the fingerprint identification application circuit 106. It is integrated in the processor 1603 to cause the processor 1603 to execute the above-described method of acquiring fingerprint information.
  • the fingerprint device may further include the OLED display screen in the hardware system structure of the fingerprint recognition system on the smart phone in FIG. 10, wherein the application processor AP1010 functions as a processor to execute the method for acquiring the fingerprint information.
  • the present application also provides a computer storage medium suitable for use in an optical fingerprinting system, the computer storage medium including an operation instruction, when the operation instruction is run on a computer, the computer can be executed as The related operations in steps 201 to 204 in FIG. 2 and steps 301 to 306 in FIG. 3 described above.
  • the computer storage medium may specifically be a built-in memory in the processor 1603 described above or an external memory connected to the processor 1603.
  • the application also provides a computer program product that, when run on a computer, causes the computer to perform all of the operations described in Figure 2 or Figure 3 above.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the modules is only a logical function division.
  • there may be another division manner for example, multiple modules or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the functional modules in the various embodiments of the present application may be integrated into one processing unit, or each module may exist physically separately, or two or more modules may be integrated into one module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Image Input (AREA)
  • Collating Specific Patterns (AREA)

Abstract

Disclosed in the embodiments of the present application is a terminal display screen scanning method for optical fingerprint recognition, being used for improving the optical fingerprint recognition performance. Said method of the present application comprises: if a starting operation on a screen of a terminal is detected, acquiring a first vector set, the first vector set including A mutually orthogonal or mutually quasi-orthogonal data vectors, each of the data vectors including a plurality of data elements, A being an integer greater than 1; sequentially using the data elements in each of the data vectors for controlling a minimum pixel unit in a fingerprint recognition region to emit light, until all the minimum pixel units in the fingerprint recognition region are controlled to emit light, so as to acquire a second vector set corresponding to the fingerprint recognition region, the second vector set carrying fingerprint information; and using the first vector set for demodulating the second vector set, so as to obtain all the fingerprint information in the fingerprint recognition region.

Description

一种指纹信息的获取方法及指纹识别装置Fingerprint information acquisition method and fingerprint identification device
本申请要求于2017年10月20日提交中国专利局、申请号为201710996402.5的中国专利申请以及于2018年6月22日提交中国专利局、申请号为201810654363.5的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese Patent Application filed on October 20, 2017, the Chinese Patent Application No. 201710996402.5, and the Chinese Patent Application No. 201810654363.5 filed on June 22, 2018. The content is incorporated herein by reference.
技术领域Technical field
本申请涉及光学指纹识别技术领域,尤其涉及一种用于光学指纹识别的指纹信息的获取方法及指纹识别装置。The present application relates to the field of optical fingerprint recognition technologies, and in particular, to a method for acquiring fingerprint information for optical fingerprint recognition and a fingerprint identification device.
背景技术Background technique
指纹识别技术涉及众多技术研究领域,并且被广泛应用于工作和生活中。目前,指纹识别技术主要包括电容式指纹识别技术、超声波式指纹识别技术和光学式指纹识别技术,目前在包括智能手机、平板电脑和笔记本电脑在内的各类终端设备中,大多数采用光学式指纹识别技术。Fingerprint recognition technology involves many technical research fields and is widely used in work and life. At present, fingerprint recognition technology mainly includes capacitive fingerprint recognition technology, ultrasonic fingerprint recognition technology and optical fingerprint recognition technology. At present, most of the various terminal devices including smartphones, tablets and notebook computers adopt optical type. Fingerprint recognition technology.
光学式指纹识别技术中将在终端显示屏内集成光电检测器(photo detector,PD)等置于显示内部,或者,置于显示屏下方。将终端显示屏像素点的自发光作为光源对手指进行照射,PD接收手指表面反射的光信号,并将光信号转化为电信号,进一步对电信号进行处理,得到指纹信息。In the optical fingerprint recognition technology, a photo detector (PD) or the like is placed inside the display in the terminal display screen, or placed under the display screen. The self-illumination of the pixel of the terminal display screen is used as a light source to illuminate the finger, and the PD receives the optical signal reflected by the surface of the finger, converts the optical signal into an electrical signal, and further processes the electrical signal to obtain fingerprint information.
由于像素点光线之间会相互干扰,称之为余辉干扰,同时PD也会接收到环境光,强烈的环境光对光学指纹也构成干扰,称之为环境光干扰。因此,在PD接收到的光信号中会存在干扰信号,获取得到的指纹信息的准确性较低,影响指纹识别性能。Because the pixel points will interfere with each other, it is called afterglow interference, and the PD will also receive ambient light. The strong ambient light also interferes with the optical fingerprint, which is called ambient light interference. Therefore, an interference signal is present in the optical signal received by the PD, and the accuracy of obtaining the obtained fingerprint information is low, which affects the fingerprint recognition performance.
发明内容Summary of the invention
有鉴于此,本申请实施例第一方面提供了一种指纹信息的获取方法,包括:首先,若检测到终端屏幕上的启动操作,获取第一向量集合,该第一向量集合中包括A个(A大于或等于2)相互正交或者相互准正交的数据向量,每个数据向量中包括多个数据元素;其次,依次使用每个数据向量中的数据元素控制指纹识别区域内的最小像素单元发光,直到完成对指纹识别区域内所有的最小像素单元的控制发光,以获取指纹区域内对应的第二向量集合,该第二向量集合中携带有指纹信息;最终,利用第一向量集合解调第二向量集合,以得到该指纹识别区域内所有的指纹信息。In view of this, the first aspect of the embodiments of the present application provides a method for acquiring fingerprint information, including: first, if a startup operation on a screen of a terminal is detected, acquiring a first vector set, where the first vector set includes A (A is greater than or equal to 2) mutually orthogonal or mutually quasi-orthogonal data vectors, each data vector comprising a plurality of data elements; secondly, the data elements in each data vector are sequentially used to control the minimum pixels in the fingerprint identification region The unit emits light until the control illumination of all the smallest pixel units in the fingerprint identification area is completed, so as to obtain a corresponding second vector set in the fingerprint area, the second vector set carries the fingerprint information; finally, the first vector set solution is used. Adjusting the second vector set to obtain all the fingerprint information in the fingerprint identification area.
其中,向量相互正交是指满足如下两个条件:(1)对于两个不同的向量,两个向量之间的内积为0;(2)对于任意一个向量,该向量自身的内积不为0,这两个条件可用如下公式表示:Wherein, the vectors are orthogonal to each other to satisfy the following two conditions: (1) for two different vectors, the inner product between the two vectors is 0; (2) for any vector, the inner product of the vector itself is not Is 0, these two conditions can be expressed by the following formula:
(1)Wi*Wj=0.i≠j;(1) Wi*Wj=0.i≠j;
(2)Wi*Wj=A,i=j;(2) Wi*Wj=A, i=j;
其中,W表示向量,下标i、j用于指示向量的编号。Where W is the vector and the subscripts i and j are used to indicate the number of the vector.
向量相互准正交是指在上述条件(2)满足的基础上,条件(1)中的两个向量的内积为接近于0的一个非常小的数(可以是正数或者负数),例如,0.1,-0.05之类的数,本领域技术人员知道可以根据对精度的要求设计具体的值,这里并不赘述。The mutual quasi-orthogonality of the vectors means that the inner product of the two vectors in the condition (1) is a very small number (which may be a positive number or a negative number) close to 0, based on the satisfaction of the above condition (2), for example, A number such as 0.1, -0.05, those skilled in the art know that specific values can be designed according to the requirements of precision, and are not described here.
相互正交或者相互准正交的向量构造为现有技术,例如,简单的可以将向量的一些元素设置成一定数量的0来实现正交,例如,假设有三个向量,一个向量可以是{1,0,0,0},另一个是{0,1,0,0},第三个是{0,0,0,1}。此外,还可以通过其他已知或未知的各种算法来构造更复杂相互正交的向量,例如,Patric Ostergard提出的模拟退火算法。Vectors that are orthogonal or mutually quasi-orthogonal are constructed in the prior art. For example, some elements of a vector can be set to a certain number of zeros to achieve orthogonality. For example, if there are three vectors, one vector can be {1 , 0,0,0}, the other is {0,1,0,0}, and the third is {0,0,0,1}. In addition, more complex and mutually orthogonal vectors can be constructed by other known or unknown algorithms, such as the simulated annealing algorithm proposed by Patric Ostergard.
从以上技术方案可以看出,本申请技术方案具有以下优点:本申请利用第一向量集合中的A组相互正交的数据向量控制指纹识别区域内所有的最小像素点发光,以获取携带有指纹识别区域内指纹信息的第二向量集合,最终,通过使用第一向量集合对第二向量集合进行解调,以得到指纹识别区域内所有的指纹信息。可以理解的是,由于各个数据向量之间是相互正交的,在通过数据向量控制最小像素单元发光过程中,可以降低最小像素单元的发光光线之间相互干扰,从而通过解调得到的指纹信息更加准确,提高了获取指纹信息的准确性,以及提高了指纹识别性能。可以理解,相互准正交的数据向量的特性跟相互正交的数据向量差不多,因此,也能产生类似的效果,即也能降低最小像素单元的发光光线之间相互干扰,从而提高指纹识别性能。As can be seen from the foregoing technical solutions, the technical solution of the present application has the following advantages: the present application controls the minimum pixel illumination in the fingerprint identification area by using A sets of mutually orthogonal data vectors in the first vector set to obtain the fingerprint. A second vector set of fingerprint information in the area is identified. Finally, the second vector set is demodulated by using the first vector set to obtain all fingerprint information in the fingerprint identification area. It can be understood that, since each data vector is mutually orthogonal, in the process of controlling the minimum pixel unit illumination by the data vector, the interference between the illuminating rays of the minimum pixel unit can be reduced, and the fingerprint information obtained by demodulation can be obtained. More accurate, improved accuracy in obtaining fingerprint information, and improved fingerprint recognition performance. It can be understood that the characteristics of the mutually quasi-orthogonal data vectors are similar to the mutually orthogonal data vectors, and therefore, similar effects can be produced, that is, the interference between the illuminating rays of the minimum pixel unit can be reduced, thereby improving the fingerprint recognition performance. .
结合本申请实施例的第一方面,在本申请实施例的第一方面的第一种可能的实现方式中,所述依次使用每个所述数据向量中的数据元素控制所述指纹识别区域内的最小像素单元发光,包括:(1)先使用每个所述数据向量中一个序号相同的数据元素按预定顺序控制最小像素单元发光;(2)再使用每个所述数据向量中另一个序号相同的数据元素按所述预定顺序控制最小像素单元发光;(3)重复执行(1)和(2)过程,直至使用每个所述数据向量中的最后一个序号相同的数据元素控制所述指纹识别区域内的最小像素单元发光;(4)若还未完成对所述指纹识别区域内所有的最小像素单元的控制发光,重复执行(1)、(2)和(3)过程,直至完成。With reference to the first aspect of the embodiments of the present application, in a first possible implementation manner of the first aspect of the application, the data element in each of the data vectors is sequentially used to control the fingerprint identification area. The minimum pixel unit illumination comprises: (1) first controlling the minimum pixel unit illumination in a predetermined order using a data element of the same serial number in each of the data vectors; (2) reusing another sequence number in each of the data vectors The same data element controls the minimum pixel unit illumination in the predetermined order; (3) repeatedly performing the (1) and (2) processes until the fingerprint is controlled using the same data element of the last one of each of the data vectors Identifying the minimum pixel unit illumination within the region; (4) if the control illumination for all of the smallest pixel units within the fingerprint recognition region has not been completed, the processes of (1), (2), and (3) are repeated until completion.
在该种实现方法中,先后按照预定顺序分别使用序号相同的数据元素控制最小像素单元发光,即使最小像素单元按照预定顺序被点亮,由于最小像素单元被点亮之后会发光一段时间后熄灭,因此,按照预定顺序先后点亮最小像素单元可以使得在前一个被点亮最小像素单元对下一个被点亮的最小像素单元的余光干扰被降低,甚至被消除,进而使得获取到的指纹数据准确性更高。In this implementation method, the minimum pixel unit illumination is controlled by using the same sequence of data elements in a predetermined order, even if the minimum pixel unit is illuminated in a predetermined order, since the minimum pixel unit is illuminated, it will be illuminated for a period of time and then extinguished, Therefore, sequentially lighting the minimum pixel unit in a predetermined order may cause the residual light interference of the last illuminated minimum pixel unit to the next illuminated minimum pixel unit to be reduced or even eliminated, thereby causing the acquired fingerprint data. More accurate.
结合本申请实施例的第一方面,和第一方面的第一种可能的实现方式,在本申请实施例的第一方面的第二种可能的实现方式中,所述第一向量集合是由三维矩阵M[I,J,K]构造得到的,I,J,K依次为所述三维矩阵M[I,J,K]在X,Y,Z方向上的维度,其中,所述三维矩阵M[I,J,K]中在X和Y平面上坐标位置不相同的列向量之间相互正交,所述A等于I和J之积,一个所述数据向量为所述三维矩阵M[I,J,K]中任一个在X和Y平面上坐标位置相同的列向量,一个所述数据向量中包括K个数据元素。With reference to the first aspect of the embodiments of the present application, and the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect of the embodiments of the present application, the first vector set is The three-dimensional matrix M[I, J, K] is constructed, and I, J, K are sequentially dimensions of the three-dimensional matrix M[I, J, K] in the X, Y, Z directions, wherein the three-dimensional matrix The column vectors of M[I, J, K] having different coordinate positions on the X and Y planes are orthogonal to each other, the A being equal to the product of I and J, and one of the data vectors being the three-dimensional matrix M [ Any of the I, J, K] column vectors having the same coordinate position on the X and Y planes, and one of the data vectors includes K data elements.
在该种实现方式中,通过三维矩阵构造得到第一向量集合中相互正交的数据向量,具体实现中可以通过模拟退火算法等来构造得到三维矩阵。由于数据向量之间需要相互正交, 数据向量越多,其构造难度越大,但通过转换为三维矩阵并通过三维矩阵特性进行构造,可以有效地降低构造难度,并且,还可以通过计算机实现复杂的构造算法,如上述模拟退火算法,因此,通过三维矩阵构造第一向量集合,其实现方法较为简单方便,并且可以快速准确地完成构造。In this implementation, the mutually orthogonal data vectors in the first vector set are obtained through the three-dimensional matrix structure. In the specific implementation, the three-dimensional matrix can be constructed by using a simulated annealing algorithm or the like. Since the data vectors need to be orthogonal to each other, the more data vectors, the more difficult it is to construct, but by transforming into a three-dimensional matrix and constructing through three-dimensional matrix characteristics, the construction difficulty can be effectively reduced, and the complexity can also be realized by a computer. The construction algorithm, such as the above simulated annealing algorithm, therefore, constructing the first vector set through the three-dimensional matrix, the implementation method is simple and convenient, and the construction can be completed quickly and accurately.
结合本申请实施例的第一方面的第一种可能的实现方式,在本申请实施例的第一方面的第三种可能的实现方式中,一个所述数据向量对应一个或者多个最小像素单元,并且,一个所述最小像素单元中包括一个或者多个像素点。With reference to the first possible implementation manner of the first aspect of the embodiments of the present application, in a third possible implementation manner of the first aspect of the embodiments of the present application, one of the data vectors corresponds to one or more minimum pixel units And, one or more pixel points are included in one of the minimum pixel units.
在该种实现方式中,当一个数据向量对应多个像素点时,容易理解,使用一个数据向量便可以控制多个像素点的发光,可以缩短控制像素点发光所耗费的时长,更快地获取指纹信息,提升指纹识别性能。In this implementation manner, when a data vector corresponds to a plurality of pixel points, it is easy to understand that the use of one data vector can control the illumination of a plurality of pixel points, thereby shortening the time taken to control the illumination of the pixel points, and acquiring faster. Fingerprint information to improve fingerprint recognition performance.
结合本申请实施例的第一方面,在本申请实施例的第一方面的第四种可能的实现方式中,所述第二向量集合中包括所述A个指纹向量,所述指纹向量中包括在最小像素单元发光过程中采集到的指纹信息;所述利用所述第一向量集合解调所述第二向量集合,以得到所述指纹识别区域内所有的指纹信息,包括:使用同一个最小像素单元对应的数据向量和指纹向量进行向量内积运算,直至完成所述指纹识别区域内所有的最小像素单元对应的向量内积运算,以得到所述指纹识别区域内所有的指纹信息。With reference to the first aspect of the embodiments of the present application, in a fourth possible implementation manner of the first aspect of the application, the second vector set includes the A fingerprint vectors, where the fingerprint vector includes The fingerprint information collected during the minimum pixel unit illumination process; the demodulating the second vector set by using the first vector set to obtain all fingerprint information in the fingerprint identification area, including: using the same minimum The data vector corresponding to the pixel unit and the fingerprint vector perform a vector inner product operation until the vector inner product operation corresponding to all the minimum pixel units in the fingerprint recognition area is completed, to obtain all the fingerprint information in the fingerprint identification area.
该种实现方式中,由于指纹向量、最小像素单元和数据向量之间具有对应关系,毫无疑问,只有使用同一个最小像素单元对应的数据向量和指纹向量进行向量内积运算才能得到该最小像素单元对应的指纹信息。使用向量内积运算的方法得到指纹识别区域内的指纹信息,其实现方法简单,准确度较高。In this implementation manner, since there is a correspondence between the fingerprint vector, the minimum pixel unit, and the data vector, there is no doubt that the minimum inner pixel can be obtained only by using the data vector and the fingerprint vector corresponding to the same minimum pixel unit for the vector inner product operation. The fingerprint information corresponding to the unit. The vector inner product operation method is used to obtain the fingerprint information in the fingerprint identification area, and the implementation method is simple and the accuracy is high.
结合本申请实施例的第一方面,和第一方面的第四种可能的实现方式,在本申请实施例的第一方面的第五种可能的实现方式中,在所述依次使用每个所述数据向量中的数据元素控制所述指纹识别区域内的最小像素单元发光之前,所述方法还包括:将每个所述数据向量中的数据元素转化为标准化显示数据,所述标准化显示数据用于控制最小像素单元的发光。With reference to the first aspect of the embodiments of the present application, and the fourth possible implementation manner of the first aspect, in a fifth possible implementation manner of the first aspect of the embodiments of the present application, Before the data element in the data vector controls the minimum pixel unit illumination in the fingerprint identification area, the method further comprises: converting the data element in each of the data vectors into standardized display data, wherein the standardized display data is used To control the illumination of the smallest pixel unit.
该种实现方式中,由于数据向量之间是正交的,正交向量中的数据元素具有特定性,通过将数据元素转化为标准化显示数据之后可以更好地控制最小像素单元的发光及其发光强度等,进而使得数据元素与发光强度之间建立对应关系,从而避免不标准的数据元素在发光调制过程中的不利影响,进而使得指纹信息的准确度得以保证。In this implementation, since the data vectors are orthogonal and the data elements in the orthogonal vectors are specific, the light of the minimum pixel unit and its illumination can be better controlled by converting the data elements into standardized display data. The strength and the like, thereby establishing a correspondence relationship between the data elements and the illuminance, thereby avoiding the adverse effects of the non-standard data elements in the illuminating modulation process, thereby ensuring the accuracy of the fingerprint information.
结合本申请实施例的第一方面的第五种可能的实现方式,在本申请实施例的第一方面的第六种可能的实现方式中,所述标准化显示数据包括灰度数据,所述将每个所述数据向量中的数据元素转化为标准化显示数据,包括:按照如下公式一或者公式二将每个所述数据向量中的数据元素转化为所述灰度数据;所述公式一为:y=(2n-1)*((m[i,j,k])-min)/(max-min);所述公式二为:y=(2n-1)*sin{0.5*π*((m[i,j,k])-min)/(max-min)};在上述公式一和公式二中,所述y为所述灰度数据,所述n为所述灰度数据的bit位的位数,所述m[i,j,k]为所述第一数据集合中的任一个数据元素,i∈[1,I];j∈[1,J],k∈[1,K],所述max为所述第一数据集合中的最大元素值,所述min为所述第一数据集合中的 最小元素值。With reference to the fifth possible implementation manner of the first aspect of the embodiments of the present application, in a sixth possible implementation manner of the first aspect of the embodiments of the present application, the standardized display data includes grayscale data, where Converting the data elements in each of the data vectors into standardized display data, comprising: converting data elements in each of the data vectors into the gray scale data according to the following formula 1 or formula 2; y=(2n-1)*((m[i,j,k])-min)/(max-min); the formula 2 is: y=(2n-1)*sin{0.5*π*( (m[i,j,k])-min)/(max-min)}; in the above formula 1 and formula 2, the y is the gradation data, and the n is the gradation data The number of bits of the bit, the m[i,j,k] is any one of the data elements in the first data set, i∈[1,I];j∈[1,J],k∈[1 , K], the max is the largest element value in the first data set, and the min is the smallest element value in the first data set.
灰度数据是常见的标准化显示数据,通过将数据元素通过上述公式一或者公式二转化为灰度数据,可以有效地控制最小像单元的发光,从而实现对像素单元的发光调制。The gray scale data is a common standardized display data. By converting the data elements into gray scale data by the above formula 1 or formula 2, the illumination of the minimum image unit can be effectively controlled, thereby realizing the illumination modulation of the pixel unit.
结合本申请实施例的第一方面,在本申请实施例的第一方面的第七种可能的实现方式中,所述指纹识别区域包括N个指纹识别子区域,所述N为大于1的整数,所述启动操作为触摸操作;所述方法还包括:若检测到对所述终端显示屏的所述触摸操作,根据所述触摸操作对应的操作区域确定所述指纹识别区域,并将所述指纹识别区域划分为N个所述指纹识别子区域,所述操作区域在所述指纹识别区域的区域范围内。With reference to the first aspect of the embodiments of the present application, in a seventh possible implementation manner of the first aspect of the embodiments, the fingerprint identification area includes N fingerprint identification sub-regions, where N is an integer greater than 1. The initiating operation is a touch operation; the method further includes: if the touch operation on the display screen of the terminal is detected, determining the fingerprint identification area according to an operation area corresponding to the touch operation, and The fingerprint identification area is divided into N pieces of the fingerprint identification sub-area, and the operation area is within the area of the fingerprint identification area.
在该种实现方式中,可以将指纹识别区域根据实际需求划分为多个指纹识别子区域,并同时对多个指纹识别子区域进行扫描,从而提高工作效率。In this implementation manner, the fingerprint identification area may be divided into multiple fingerprint identification sub-areas according to actual needs, and multiple fingerprint identification sub-areas may be scanned at the same time, thereby improving work efficiency.
结合本申请实施例第一方面的第一方面的第四种可能的实现方式,在本申请实施例第一方面的第八种可能的实现方式中,在所述依次使用每个所述数据向量中的数据元素控制指纹识别区域内的最小像素单元发光之后,所述方法还包括:With reference to the fourth possible implementation manner of the first aspect of the first aspect of the present application, in the eighth possible implementation manner of the first aspect of the embodiments, the data vector is sequentially used in the foregoing After the data element in the control controls the minimum pixel unit illumination in the fingerprint identification area, the method further includes:
通过光学感应器件感应用户手指反射的发射光并转化得到最小像素点对应的指纹向量。The emitted light reflected by the user's finger is sensed by the optical sensing device and converted into a fingerprint vector corresponding to the smallest pixel point.
该种实现方式中,光学感应器件包括PD阵列,通过光学感应器件对反射光进行光电转换,由于PD阵列的感光特性好,因此PD阵列可以转换得到准确的指纹数据,进而提升指纹识别性能。In this implementation manner, the optical sensing device includes a PD array, and the reflected light is photoelectrically converted by the optical sensing device. Since the photosensitive characteristics of the PD array are good, the PD array can be converted to obtain accurate fingerprint data, thereby improving fingerprint recognition performance.
结合本申请实施例第一方面的第八种可能的实现方式,在本申请实施例第一方面的第九种可能的实现方式中,在依次使用每个所述数据向量中的数据元素控制指纹识别区域内的最小像素单元发光之前,所述方法还包括:With reference to the eighth possible implementation manner of the first aspect of the embodiments of the present application, in a ninth possible implementation manner of the first aspect of the embodiments of the present application, the data element in each of the data vectors is sequentially used to control the fingerprint Before the minimum pixel unit in the region is illuminated, the method further includes:
对最小像素单元和PD阵列进行校对,得到最小像素单元与PD阵列之间的对应关系。The minimum pixel unit and the PD array are collated to obtain a correspondence between the minimum pixel unit and the PD array.
在该种实现方式中,在发光调制之前,通过校对建立最小像素单元与PD阵列之间的对应关系,以使得在正交解调过程中可以根据此对应关系得到最小像素单元对应的PD,从而获取准确的指纹数据。最小像素单元包括像素点,最小像素单元与PD阵列之间的对应关系可以是:多个像素点对应多个PD,或者,一个像素点对应多个PD,或者,一个像素点对应一个PD。In this implementation manner, before the illuminating modulation, the correspondence between the minimum pixel unit and the PD array is established by proofreading, so that the PD corresponding to the minimum pixel unit can be obtained according to the corresponding relationship in the orthogonal demodulation process, thereby Get accurate fingerprint data. The minimum pixel unit includes a pixel. The correspondence between the minimum pixel unit and the PD array may be: multiple pixels correspond to multiple PDs, or one pixel corresponds to multiple PDs, or one pixel corresponds to one PD.
本申请实施例第二方面提供了一种指纹识别装置,包括:获取模块,用于若检测到终端屏幕上的启动操作,获取第一向量集合,所述第一向量集合中包括A个相互正交的数据向量,每个所述数据向量中包括多个数据元素,所述A为大于1的整数;发光控制模块,用于依次使用每个所述数据向量中的数据元素控制指纹识别区域内的最小像素单元发光,直至完成对所述指纹识别区域内所有的最小像素单元的控制发光,以获取所述指纹识别区域对应的第二向量集合,所述第二向量集合中携带有指纹信息;解调模块,用于利用所述第一向量集合解调所述第二向量集合,以得到所述指纹识别区域内所有的指纹信息。A second aspect of the embodiments of the present application provides a fingerprint identification apparatus, including: an acquiring module, configured to acquire a first vector set, where the first vector set includes A mutual positives, if a startup operation on a screen of the terminal is detected a data vector, each of the data vectors includes a plurality of data elements, the A is an integer greater than 1; the illumination control module is configured to sequentially control the fingerprint identification area by using data elements in each of the data vectors The minimum pixel unit is illuminated until the control illumination of all the smallest pixel units in the fingerprint identification area is completed, to obtain a second vector set corresponding to the fingerprint identification area, and the second vector set carries fingerprint information; And a demodulation module, configured to demodulate the second set of vectors by using the first set of vectors to obtain all fingerprint information in the fingerprint identification area.
结合本申请实施例第二方面,在本申请实施例第二方面的第一种可能的实现方式中,所述发光控制模块具体用于执行如下操作:(1)先使用每个所述数据向量中一个序号相同的数据元素按预定顺序控制最小像素单元发光;(2)再使用每个所述数据向量中序号相同 的数据元素按所述预定顺序控制另一个最小像素单元发光;(3)重复执行(1)和(2)过程,直至使用每个所述数据向量中的最后一个序号相同的数据元素控制所述指纹识别区域内的最小像素单元发光;(4)若还未完成对所述指纹识别区域内所有的最小像素单元的控制发光,重复执行(1)、(2)和(3)过程,直至完成。With reference to the second aspect of the embodiments of the present application, in a first possible implementation manner of the second aspect of the embodiments, the illuminating control module is specifically configured to perform the following operations: (1) using each of the data vectors first a data element having the same serial number controls the minimum pixel unit illumination in a predetermined order; (2) using another data element having the same sequence number in each of the data vectors to control another minimum pixel unit illumination in the predetermined order; (3) repeating Performing (1) and (2) processes until the minimum pixel unit illumination within the fingerprint recognition area is controlled using the same data element of the last one of each of the data vectors; (4) if the The control illumination of all the smallest pixel units in the fingerprint recognition area is repeated (1), (2), and (3) until the completion.
结合本申请实施例第二方面,和第二方面的第一种可能的实现方式,在本申请实施例第二方面的第二种可能的实现方式中,所述第一向量集合是由三维矩阵M[I,J,K]构造得到的,I,J,K依次为所述三维矩阵M[I,J,K]在X,Y,Z方向上的维度,其中,所述三维矩阵M[I,J,K]中在X和Y平面上坐标位置不相同的列向量之间相互正交,所述A等于I和J之积,一个所述数据向量为所述三维矩阵M[I,J,K]中任一个在X和Y平面上坐标位置相同的列向量,一个所述数据向量中包括K个数据元素。With reference to the second aspect of the embodiments of the present application, and the first possible implementation manner of the second aspect, in a second possible implementation manner of the second aspect of the embodiments, the first vector set is a three-dimensional matrix The structure of M[I, J, K], I, J, K are sequentially the dimensions of the three-dimensional matrix M[I, J, K] in the X, Y, Z directions, wherein the three-dimensional matrix M [ In I, J, K], column vectors having different coordinate positions on the X and Y planes are orthogonal to each other, the A is equal to the product of I and J, and one of the data vectors is the three-dimensional matrix M[I, Any one of J, K] has the same coordinate position on the X and Y planes, and one of the data vectors includes K data elements.
结合本申请实施例的第二方面的第一种可能的实现方式,在本申请实施例的第二方面的第三种可能的实现方式中,一个所述数据向量对应一个或者多个最小像素单元,并且,一个所述最小像素单元中包括一个或者多个像素点。In conjunction with the first possible implementation of the second aspect of the embodiments of the present application, in a third possible implementation manner of the second aspect of the embodiments of the present application, one of the data vectors corresponds to one or more minimum pixel units. And, one or more pixel points are included in one of the minimum pixel units.
结合本申请实施例的第二方面,在本申请实施例的第二方面的第四种可能的实现方式中,所述第二向量集合中包括所述A个指纹向量,所述指纹向量中包括在最小像素单元发光过程中采集到的指纹信息;所述解调模块具体用于:使用同一个最小像素单元对应的数据向量和指纹向量进行向量内积运算,直至完成所述指纹识别区域内所有的最小像素单元对应的向量内积运算,以得到所述指纹识别区域内所有的指纹信息。With reference to the second aspect of the embodiments of the present application, in a fourth possible implementation manner of the second aspect of the embodiments, the second vector set includes the A fingerprint vectors, where the fingerprint vector includes The fingerprint information collected during the minimum pixel unit illumination process; the demodulation module is specifically configured to perform vector inner product operation using the data vector and the fingerprint vector corresponding to the same minimum pixel unit until all the fingerprint identification regions are completed The vector inner product operation corresponding to the smallest pixel unit is used to obtain all the fingerprint information in the fingerprint identification area.
结合本申请实施例的第二方面,和第二方面的第四种可能的实现方式,在本申请实施例的第二方面的第五种可能的实现方式中,所述指纹识别装置还包括:转化模块,用于将每个所述数据向量中的数据元素转化为标准化显示数据,所述标准化显示数据用于控制最小像素单元的发光。With reference to the second aspect of the embodiments of the present application, and the fourth possible implementation manner of the second aspect, in the fifth possible implementation manner of the second aspect of the application, the fingerprint identification device further includes: a conversion module for converting data elements in each of the data vectors into standardized display data for controlling illumination of a minimum pixel unit.
结合本申请实施例的第二方面的第五种可能的实现方式,在本申请实施例的第二方面的第六种可能的实现方式中,所述标准化显示数据包括灰度数据,所述转化模块具体用于:With reference to the fifth possible implementation manner of the second aspect of the embodiments of the present application, in a sixth possible implementation manner of the second aspect of the embodiments of the present application, the standardized display data includes gray data, and the conversion The module is specifically used to:
按照如下公式一或者公式二将每个所述数据向量中的数据元素转化为所述灰度数据;所述公式一为:y=(2n-1)*((m[i,j,k])-min)/(max-min);所述公式二为:y=(2n-1)*sin{0.5*π*((m[i,j,k])-min)/(max-min)};在上述公式一和公式二中,所述y为所述灰度数据,所述n为所述灰度数据的bit位的位数,所述m[i,j,k]为所述第一数据集合中的任一个数据元素,i∈[1,I];j∈[1,J],k∈[1,K],所述max为所述第一数据集合中的最大元素值,所述min为所述第一数据集合中的最小元素值。The data elements in each of the data vectors are converted into the gray scale data according to the following formula 1 or formula 2; the formula one is: y=(2n-1)*((m[i,j,k] )-min)/(max-min); the formula 2 is: y=(2n-1)*sin{0.5*π*((m[i,j,k])-min)/(max-min In the above formulas 1 and 2, the y is the gradation data, the n is the number of bits of the gradation data, and the m[i, j, k] is Any one of the first data sets, i ∈ [1, I]; j ∈ [1, J], k ∈ [1, K], the max is the largest element in the first data set a value, the min being the smallest element value in the first set of data.
结合本申请实施例的第二方面,在本申请实施例的第二方面的第七种可能的实现方式中,所述指纹识别区域包括N个指纹识别子区域,所述N为大于1的整数,所述启动操作为触摸操作;所述指纹识别装置还包括:确定模块,用于若检测到对所述终端显示屏的所述触摸操作,根据所述触摸操作对应的操作区域确定所述指纹识别区域,并将所述指纹识别区域划分为N个所述指纹识别子区域,所述操作区域在所述指纹识别区域的区域范围内。With reference to the second aspect of the embodiments of the present application, in a seventh possible implementation manner of the second aspect of the embodiments, the fingerprint identification area includes N fingerprint identification sub-regions, where N is an integer greater than 1. The fingerprinting device further includes: a determining module, configured to: determine the fingerprint according to an operation area corresponding to the touch operation, if the touch operation on the display screen of the terminal is detected Identifying an area, and dividing the fingerprint identification area into N pieces of the fingerprint identification sub-area, the operation area being within an area of the fingerprint identification area.
上述第二方面的其他实现方式可参阅上述第一方面中的相关实现方式,此处不再赘述。另外第二方面及其各实现方式的有益效果与上述第一方面中的有益效果类似,可参阅上述 第一方面的相关描述,对此此处不再赘述。For other implementation manners of the foregoing second aspect, refer to related implementation manners in the foregoing first aspect, and details are not described herein again. In addition, the beneficial effects of the second aspect and its implementations are similar to those of the first aspect described above. For reference, the related description of the first aspect is not described herein.
本申请实施例第三方面提供了一种指纹识别装置,包括:存储器和处理器;所述存储器,用于存储操作指令;所述处理器,用于调用所述操作指令,执行上述第一方面中任一项所述的指纹信息的获取方法。A third aspect of the embodiments of the present application provides a fingerprint identification apparatus, including: a memory and a processor; the memory is configured to store an operation instruction; and the processor is configured to invoke the operation instruction to perform the first aspect. The method for acquiring fingerprint information according to any one of the preceding claims.
本申请实施例第四方面提供了一种计算机存储介质,所述计算机存储介质中存储有操作指令,当所述操作指令在计算机上运行时,以使得所述计算机执行如上述第一方面中任一项所述的指纹信息的获取方法。A fourth aspect of the embodiments of the present application provides a computer storage medium, where the computer storage medium stores an operation instruction, when the operation instruction is run on a computer, so that the computer performs the first aspect as described above. A method for obtaining fingerprint information as described.
本申请实施例第五方面提供了一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行上述第一方面中任一项所述的指纹信息的获取方法。A fifth aspect of the embodiments of the present application provides a computer program product, when the computer program product is run on a computer, causing the computer to perform the method for acquiring fingerprint information according to any one of the above first aspects.
上述第三方面至第五方面的有益效果,可参阅上述第一方面中的相关描述,对此此处不再赘述。For the beneficial effects of the third aspect to the fifth aspect, refer to the related description in the above first aspect, and details are not described herein again.
附图说明DRAWINGS
为了更清楚地说明本申请实施例的技术方案,下面将对实施例描述所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following description of the embodiments will be briefly described. It is obvious that the drawings in the following description are only some embodiments of the present application, Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.
图1为本申请实施例提供的一个光学式指纹识别系统框架示意图;FIG. 1 is a schematic diagram of a frame of an optical fingerprint identification system according to an embodiment of the present application; FIG.
图2为本申请实施例提供的一个指纹信息的获取方法的实施例示意图;2 is a schematic diagram of an embodiment of a method for acquiring fingerprint information according to an embodiment of the present application;
图3为本申请实施例提供的另一个指纹信息的获取方法的实施例示意图;FIG. 3 is a schematic diagram of another embodiment of a method for acquiring fingerprint information according to an embodiment of the present disclosure;
图4为本申请实施例提供的一个指纹识别区域分割示意图;FIG. 4 is a schematic diagram of a fingerprint identification area segmentation according to an embodiment of the present application;
图5为本申请实施例提供的一个三维矩阵M[8,8,8]示意图;FIG. 5 is a schematic diagram of a three-dimensional matrix M[8, 8, 8] according to an embodiment of the present application;
图6为本申请实施例提供的一个4bit灰度级示意图;FIG. 6 is a schematic diagram of a 4-bit gray level provided by an embodiment of the present application;
图7为本申请实施例提供的一个8bit灰度级示意图;FIG. 7 is a schematic diagram of an 8-bit gray level provided by an embodiment of the present application;
图8为本申请实施例提供的一个指纹识别子区域扫描示意图;FIG. 8 is a schematic diagram of scanning a fingerprint identification sub-area according to an embodiment of the present application;
图9为本申请实施例提供的一个PD阵列的光路示意图;FIG. 9 is a schematic diagram of an optical path of a PD array according to an embodiment of the present application;
图10为本申请实施例提供的一个智能手机指纹识别系统硬件结构图;10 is a hardware structure diagram of a smart phone fingerprint identification system according to an embodiment of the present application;
图11为本申请实施例提供的又一个指纹信息的获取方法的实施例示意图;FIG. 11 is a schematic diagram of another embodiment of a method for acquiring fingerprint information according to an embodiment of the present application;
图12为本申请实施例提供的一个指纹识别区域范围示意图;FIG. 12 is a schematic diagram of a fingerprint identification area range according to an embodiment of the present application;
图13为本申请实施例提供的一个三维四阶矩阵示意图;FIG. 13 is a schematic diagram of a three-dimensional fourth-order matrix according to an embodiment of the present application;
图14(a)为本申请实施例提供的一个二维矩阵的指纹扫描示意图;FIG. 14(a) is a schematic diagram of fingerprint scanning of a two-dimensional matrix according to an embodiment of the present application;
图14(b)为本申请实施例提供的另一个二维矩阵的指纹扫描示意图;FIG. 14(b) is a schematic diagram of fingerprint scanning of another two-dimensional matrix according to an embodiment of the present application;
图14(c)为本申请实施例提供的另一个二维矩阵的指纹扫描示意图;FIG. 14(c) is a schematic diagram of fingerprint scanning of another two-dimensional matrix according to an embodiment of the present application;
图14(d)为本申请实施例提供的另一个二维矩阵的指纹扫描示意图FIG. 14(d) is a schematic diagram of fingerprint scanning of another two-dimensional matrix according to an embodiment of the present application.
图15为本申请实施例提供的一个指纹识别装置实施例示意图;FIG. 15 is a schematic diagram of an embodiment of a fingerprint identification apparatus according to an embodiment of the present application;
图16为本申请实施例提供的另一个指纹识别装置实施例示意图。FIG. 16 is a schematic diagram of another embodiment of a fingerprint identification apparatus according to an embodiment of the present application.
具体实施方式Detailed ways
本申请提供了一种指纹信息的获取方法,用于提高获取指纹信息的准确性,提升指纹识别性能。The present application provides a method for acquiring fingerprint information, which is used to improve the accuracy of acquiring fingerprint information and improve fingerprint recognition performance.
下面将结合本申请中的附图,对本申请中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。本申请中的指纹信息的获取方法适用于智能手机,平板电脑,笔记本电脑,以及车载设备等终端设备中,也并非仅仅限制于上述终端设备。The technical solutions in the present application are clearly and completely described in the following with reference to the drawings in the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The method for acquiring fingerprint information in the present application is applicable to terminal devices such as smart phones, tablet computers, notebook computers, and in-vehicle devices, and is not limited to the above terminal devices.
图1为本申请实施例提供的一个光学是指纹识别系统的系统框架示意图。如图1所示,光学式指纹识别系统包括:指纹扫描控制电路101、终端显示屏102、光学感应器件103、指纹信息采集前端处理电路104、指纹信息后处理电路105和指纹识别应用电路106六个组成部分。其中,终端显示屏102可以是液晶显示器(liquid crystal display,简称LCD),也可以是有机发光二极管(organic light emitting diode,简称OLED)显示屏,或者,量子点发光二极管(quantum dot light emitting Diode,简称QLED)显示屏,或者,微型发光二极管(micro light emitting diodes,MLED)显示屏。FIG. 1 is a schematic diagram of a system framework of an optical fingerprint identification system according to an embodiment of the present application. As shown in FIG. 1, the optical fingerprint identification system includes: a fingerprint scanning control circuit 101, a terminal display screen 102, an optical sensing device 103, a fingerprint information collecting front end processing circuit 104, a fingerprint information post processing circuit 105, and a fingerprint identification application circuit 106. Components. The terminal display screen 102 can be a liquid crystal display (LCD), an organic light emitting diode (OLED) display, or a quantum dot light emitting diode (quantum dot light emitting diode). Referred to as QLED) display, or micro light emitting diode (MLED) display.
指纹扫描控制电路101用于对指纹扫描以及驱动逻辑进行控制;The fingerprint scanning control circuit 101 is configured to control fingerprint scanning and driving logic;
光学感应器件103主要用于感应光信号并转成电信号,例如,可以采用前述提到的PD形成的阵列(以下简称PD阵列);The optical sensing device 103 is mainly used for sensing an optical signal and converting it into an electrical signal. For example, an array formed by the aforementioned PD may be used (hereinafter referred to as a PD array);
指纹信息采集前端处理电路104用于对光学感应器件103采集到的电信号进行处理,包括但不限定滤波、降噪、ADC转化、协议接口处理等各种处理;The fingerprint information collection front-end processing circuit 104 is configured to process the electrical signals collected by the optical sensing device 103, including but not limited to filtering, noise reduction, ADC conversion, protocol interface processing, and the like;
指纹信息后处理电路105用于对指纹信息采集前端处理电路104处理后的数据进行计算分析得到指纹信息;The fingerprint information post-processing circuit 105 is configured to perform calculation and analysis on the data processed by the fingerprint information collection front-end processing circuit 104 to obtain fingerprint information;
指纹识别应用电路106用于通过根据指纹信息后处理电路105输出的指纹信进行用户身份信息验证等操作。The fingerprint identification application circuit 106 is configured to perform operations such as user identity information verification based on the fingerprint information output by the fingerprint information post-processing circuit 105.
上述各个电路可以基于不同的实现硬件实现,例如,在一种示例中,指纹扫描控制电路101、指纹信息后处理电路105和指纹识别应用电路106三者中的任意一个或多个都可以基于通用处理器(如CPU)实现(也即CPU通常读取存储在存储器中的指令后来实现这些电路的功能),其中,CPU可以和其他处理电路一起封装到一个芯片上。Each of the above circuits may be implemented based on different implementation hardware. For example, in one example, any one or more of the fingerprint scanning control circuit 101, the fingerprint information post-processing circuit 105, and the fingerprint identification application circuit 106 may be based on a universal A processor (such as a CPU) is implemented (that is, the CPU usually reads the instructions stored in the memory and later implements the functions of these circuits), wherein the CPU can be packaged on one chip together with other processing circuits.
在另一个示例中,指纹扫描控制电路101、指纹信息采集前端处理电路104以及指纹信息后处理电路105三者中的任一个或多个都可以基于集成电路实现,例如,基于ASIC、FPGA等方式来实现这些电路的功能,同时,为了更好地集成,可以将这几个电路封装成一个芯片,当然,也不限定将其中任何一个或多个电路单独封装成一个芯片。In another example, any one or more of the fingerprint scanning control circuit 101, the fingerprint information collection front-end processing circuit 104, and the fingerprint information post-processing circuit 105 may be implemented based on an integrated circuit, for example, based on an ASIC, an FPGA, or the like. To realize the functions of these circuits, at the same time, for better integration, these circuits can be packaged into one chip, and of course, it is not limited to package any one or more of the circuits into one chip separately.
在另一种示例中,指纹识别应用电路106基于CPU实现;光学感应器件103为PD阵列;指纹扫描控制电路101、指纹信息采集前端处理电路104和指纹信息后处理电路105各自都通过集成电路实现并封装到同一个芯片。In another example, the fingerprint identification application circuit 106 is implemented based on a CPU; the optical sensing device 103 is a PD array; the fingerprint scanning control circuit 101, the fingerprint information collection front end processing circuit 104, and the fingerprint information post-processing circuit 105 are each implemented by an integrated circuit. And packaged to the same chip.
本申请中指纹信息的获取方法,利用第一向量集合中的A组相互正交的数据向量控制指纹识别区域内所有的最小像素点发光,以获取携带有指纹识别区域内指纹信息的第二向量集合,最终,通过使用第一向量集合对第二向量集合进行解调,以得到指纹识别区域内 所有的指纹信息。可以理解的是,由于各个数据向量之间是相互正交的,在通过数据向量控制最小像素单元发光过程中,可以降低最小像素单元的发光光线之间相互干扰,从而通过解调得到得到的指纹信息更加准确,提高了获取指纹信息的准确性,以及提高了指纹识别性能。In the method for acquiring fingerprint information in the present application, a group A mutually orthogonal data vector in the first vector set is used to control all minimum pixel point illumination in the fingerprint identification area to obtain a second vector carrying fingerprint information in the fingerprint identification area. The set, finally, demodulates the second set of vectors by using the first set of vectors to obtain all fingerprint information in the fingerprint identification area. It can be understood that, since each data vector is mutually orthogonal, in the process of controlling the minimum pixel unit illumination by the data vector, the mutual interference between the illuminating rays of the minimum pixel unit can be reduced, thereby obtaining the obtained fingerprint by demodulation. The information is more accurate, improves the accuracy of obtaining fingerprint information, and improves fingerprint recognition performance.
为了便于理解本申请中指纹信息的获取方法,下面结合附图以及具体的实施例对本申请中指纹信息的获取方法进行详细说明。In order to facilitate the understanding of the method for obtaining the fingerprint information in the present application, the method for acquiring the fingerprint information in the present application will be described in detail below with reference to the accompanying drawings and specific embodiments.
图2为本申请实施例提供的一个指纹信息的获取方法的实施例示意图。如图2所示,指纹信息的获取方法包括:FIG. 2 is a schematic diagram of an embodiment of a method for acquiring fingerprint information according to an embodiment of the present disclosure. As shown in FIG. 2, the method for obtaining fingerprint information includes:
201、若检测到终端屏幕上的启动操作,获取第一向量集合,该第一向量集合中包括多个相互正交或者相互准正交的数据向量。201. If a startup operation on the screen of the terminal is detected, acquiring a first vector set, where the first vector set includes a plurality of mutually orthogonal or mutually quasi-orthogonal data vectors.
例如,第一向量集合中包括A个相互正交的数据向量,A为大于或者等于2的整数,每个数据向量中包括多个数据元素。启动操作是指触发指纹识别装置开始执行指纹信息的获取方法的操作,例如,以手机为例,在手机锁屏状态下,用户手指对指纹识别区域的触摸操作,或者,用户手指对手机屏幕任意区域的触摸操作,对于触摸操作的具体表现形态本申请不做任何限定,只需能达到与上述触摸操作类似的技术效果即可。For example, the first vector set includes A mutually orthogonal data vectors, A is an integer greater than or equal to 2, and each data vector includes a plurality of data elements. The startup operation refers to an operation of triggering the fingerprint identification device to start the method for acquiring the fingerprint information. For example, taking the mobile phone as an example, in the state of the mobile phone lock screen, the user's finger touches the fingerprint recognition area, or the user's finger is free to the mobile phone screen. The touch operation of the area is not limited to the specific performance of the touch operation, and only a technical effect similar to the above touch operation can be achieved.
在获取第一向量集合的具体实现方式中,可以是由上述图1中所示的指纹扫描控制电路101从第一向量集合对应的物理存储空间如存储器中将第一向量集合中全部数据元素读取出来,或者,也可以是通过具有与上述指纹扫描控制电路101类似的集成电路或者芯片将上述全部数据从相应的存储器中读取出来。In a specific implementation manner of acquiring the first vector set, the fingerprint scanning control circuit 101 shown in FIG. 1 above may read all data elements in the first vector set from a physical storage space corresponding to the first vector set, such as a memory. Alternatively, it is also possible to read all of the above data from the corresponding memory by having an integrated circuit or chip similar to the above-described fingerprint scanning control circuit 101.
在一种示例中,第一向量集合以及对应的数据元素可以通过三维矩阵M[I,J,K]来构造得到,I,J,K依次为三维矩阵M[I,J,K]在X,Y,Z方向上的维度,并且I,J,K均为大于或等于1的整数,每个矩阵元素使用m[i,j,k](或者mijk,如m011来表示),其中,i∈[1,I];j∈[1,J],k∈[1,K]。需要说明的是,在三维矩阵M[I,J,K]可以将X方向上(即Y和Z平面上)、Y方向上(即X和Z平面上)或者Z方向上(即X和Y平面上)任一项所述的坐标位置相同的列向量作为数据向量,一个数据向量中对应包括多个数据元素,例如I个、J个或者Z个数据元素。In one example, the first set of vectors and the corresponding data elements can be constructed by a three-dimensional matrix M[I, J, K], which in turn is a three-dimensional matrix M[I, J, K] at X , the dimension in the Y, Z direction, and I, J, K are integers greater than or equal to 1, each matrix element using m[i,j,k] (or mijk, as m011), where i ∈[1,I];j∈[1,J],k∈[1,K]. It should be noted that the three-dimensional matrix M[I, J, K] can be in the X direction (ie, in the Y and Z planes), in the Y direction (ie, in the X and Z planes), or in the Z direction (ie, X and Y). The column vector having the same coordinate position as any one of the planes is used as a data vector, and one data vector correspondingly includes a plurality of data elements, for example, one, J or Z data elements.
以上述Z方向上的列向量作为数据向量为例,将三维矩阵M[I,J,K]在Z方向上(即X、Y平面内)处于相同坐标位置的K个矩阵元素组成一个列向量即数据向量,记为:Wi,j,例如,坐标(1,1)对应的列向量W1,1={m111,m112,……,m11K},可以理解,如果将上述方法将Z方向上的元素构成一个列向量,上述三维矩阵M[I,J,K]中共有(I*J)个列向量,此时A=(I*J)。Taking the column vector in the Z direction as a data vector as an example, the K matrix elements of the three-dimensional matrix M[I, J, K] in the Z direction (ie, in the X and Y planes) at the same coordinate position form a column vector. That is, the data vector, which is written as: Wi, j, for example, the column vector W1 corresponding to the coordinates (1, 1), 1 = {m111, m112, ..., m11K}, it can be understood that if the above method is to be in the Z direction The elements constitute a column vector, and there are (I*J) column vectors in the above three-dimensional matrix M[I, J, K], in which case A=(I*J).
对于上述(I*J)个列向量满足如下正交条件:1、对于任意两个列向量,若该两个列向量对应的坐标位置不同,则该两个列向量的内积为0;2、对于任意一个列向量,该列向量自身的内积不为0。其中,构造满足上述要求的三维矩阵为现有技术,例如,可以通过Patric Ostergard提出的模拟退火算法来实现,当然,本申请也不限定使用其他各种能够实现的算法来构造上述三维矩阵。For the above (I*J) column vectors, the following orthogonal conditions are satisfied: 1. For any two column vectors, if the coordinate positions corresponding to the two column vectors are different, the inner product of the two column vectors is 0; For any column vector, the inner product of the column vector itself is not zero. The three-dimensional matrix that satisfies the above requirements is a prior art, for example, can be implemented by a simulated annealing algorithm proposed by Patric Ostergard. Of course, the present application does not limit the use of other various algorithms that can be implemented to construct the three-dimensional matrix.
如前文所述,上述三维矩阵M[I,J,K]中共有(I*J)个列向量。将满足上述正交条件 的三维矩阵中的每一个矩阵元素作为一个数据元素,则共(I*J*K)个数据元素,并按照上述列向量Wi,j将该(I*J*K)个数据元素划分为(I*J)个数据向量,其中,每一个数据向量中包括K个数据元素。As described above, there are (I*J) column vectors in the above three-dimensional matrix M[I, J, K]. Each matrix element in the three-dimensional matrix satisfying the above orthogonal condition is taken as one data element, and a total of (I*J*K) data elements are used, and the (I*J*K) is according to the above-mentioned column vector Wi,j. The data elements are divided into (I*J) data vectors, wherein each data vector includes K data elements.
202、若检测到上述启动操作,根据上述启动操作对应的操作区域确定指纹识别区域。202. If the startup operation is detected, determining a fingerprint identification area according to the operation area corresponding to the startup operation.
可选地,若检测到上述启动操作,指纹识别装置还可以根据上述启动操作对应的操作区域确定指纹识别区域。关于启动操作的其他描述详见上述步骤201中启动操作的相关描述,此处不再赘述。至于指纹识别区域的具体确定方法可参阅下文步骤304中的相关描述,此处不再赘述。Optionally, if the startup operation is detected, the fingerprint identification device may further determine the fingerprint identification area according to the operation area corresponding to the startup operation. For further descriptions of the startup operation, refer to the related description of the startup operation in the above step 201, and details are not described herein again. For the specific determination method of the fingerprint identification area, refer to the related description in step 304 below, and details are not described herein again.
需要说明的是,关于指纹识别区域还可以采用预先指定的方式进行确定,具体可以是将终端屏幕上的某个特定区域作为指纹识别区域,例如,以手机为例,将手机屏幕下方用户最方便触摸到的区域作为指纹识别区域,并且,告知用户指定的指纹识别区域的区域范围,以确保用户在需要指纹应用场景中将手指放置于指定的指纹区域内,从而使得手机在检测特定区域内的触摸操作,无需在触摸操作之后根据触摸操作的操作区域判断指纹识别区域。另一方面,为了更好地确保用户体验,在需要获取指纹信息的指纹应用场景中,但用户将手指放置于除指定指纹识别区域以外的手机屏幕区域上时,手机可以发出提示信息,提示用户将手指放置到指定指纹识别区域内,对于提示方式不做任何限定。It should be noted that the fingerprint identification area may also be determined in a pre-specified manner, and specifically, a specific area on the screen of the terminal may be used as a fingerprint identification area. For example, taking a mobile phone as an example, the user at the bottom of the mobile phone screen is most convenient. The touched area is used as a fingerprint identification area, and the area of the designated fingerprint identification area is notified to the user to ensure that the user places a finger in the designated fingerprint area in the fingerprint application scenario, so that the mobile phone detects the specific area. The touch operation eliminates the need to determine the fingerprint recognition area according to the operation area of the touch operation after the touch operation. On the other hand, in order to better ensure the user experience, in the fingerprint application scenario where fingerprint information needs to be obtained, but the user places a finger on the screen area of the mobile phone other than the designated fingerprint recognition area, the mobile phone can issue a prompt message to prompt the user. Place your finger in the specified fingerprint recognition area, and do not limit the prompting method.
203、依次使用每个数据向量中数据元素控制指纹识别区域内最小像素单元的发光,以获取指纹识别区域对应的第二向量集合。203. The data elements in each data vector are sequentially used to control the illumination of the smallest pixel unit in the fingerprint identification area to obtain a second vector set corresponding to the fingerprint identification area.
在获取第一向量集合中的数据元素,以及确定指纹识别区域之后,指纹识别装置依次使用每个数据向量中数据元素控制指纹识别区域内最小像素单元的发光,直至完成对指纹识别区域内所有的最小像素单元的控制发光,以获取指纹识别区域对应的第二向量集合,该第二向量集合中携带有指纹信息。After acquiring the data elements in the first vector set and determining the fingerprint identification area, the fingerprint identification device sequentially controls the illumination of the smallest pixel unit in the fingerprint recognition area by using the data elements in each data vector until all the fingerprint recognition areas are completed. The minimum pixel unit controls the illumination to obtain a second vector set corresponding to the fingerprint identification area, and the second vector set carries the fingerprint information.
在一种示例中,指纹识别装置依次使用每个数据向量中数据元素控制指纹识别区域内最小像素单元的发光具体过程可以包括以下步骤:In one example, the fingerprint recognition device sequentially uses the data elements in each data vector to control the illumination of the smallest pixel unit within the fingerprint recognition region. The specific process can include the following steps:
(1)先依次使用每个数据向量中一个序号相同的数据元素按预定顺序控制最小像素单元发光;(1) firstly using a data element of the same serial number in each data vector to control the minimum pixel unit illumination in a predetermined order;
(2)再依次使用每个数据向量中另一个序号相同的数据元素按预定顺序控制最小像素单元发光;(2) sequentially using the same data element in each data vector to control the minimum pixel unit illumination in a predetermined order;
(3)重复执行(1)和(2)过程,直至使用每个数据向量中的最后一个序号相同的数据元素控制指纹识别区域内的最小像素单元发光;(3) repeatedly performing the processes (1) and (2) until the minimum pixel unit illumination in the fingerprint recognition area is controlled using the same data element of the last sequence number in each data vector;
(4)若还未完成对指纹识别区域内所有的最小像素单元的控制发光,重复执行(1)、(2)和(3)过程,直至完成。(4) If the control illumination of all the smallest pixel units in the fingerprint recognition area has not been completed, the processes (1), (2), and (3) are repeatedly performed until completion.
在上述步骤(1)、(2)、(3)和(4)所示的示例中,“依次使用每个数据向量中一个序号相同的数据元素”是指使用一个数据向量中的一个数据,再使用另一个数据向量中的同一个序号的数据,依次类推。例如,先使用第一个数据向量中的第1个数据,再使用第二个数据向量中的第1个数据,再使用第三个数据向量中的第1个数据,依次类推,使用完所有的数据向量中的第1个数据。接下来可以使用第一个数据向量中的第2个数据,再使 用第二个数据向量中的第2个数据,依次类推。需要说明的是,每次使用的每个数据向量中的数据的顺序并不限定,例如,可以第一次先使用每个数据向量中的第2个数据,第二次使用每个数据向量中的第5个数据。In the examples shown in the above steps (1), (2), (3), and (4), "using one data element of the same serial number in each data vector" means using one data in one data vector. Then use the same sequence number data in another data vector, and so on. For example, first use the first data in the first data vector, then use the first data in the second data vector, then use the first data in the third data vector, and so on. The first data in the data vector. Next, you can use the second data in the first data vector, then the second data in the second data vector, and so on. It should be noted that the order of the data in each data vector used each time is not limited. For example, the second data in each data vector may be used first, and the second data is used in each data vector. The 5th data.
其中,上述“预定顺序”是指预定的点亮最小像素单元的顺序,例如,对于一个矩形区域,可以从左到右、从上到下的顺序;或者也可以从右到左、从上到下的顺序;或者也可以采用其他的各种顺序。另外,如果被指纹识别区域的面积较大,使用所有的数据向量中的数据无法一次完成扫描时,可以重复执行扫描(1)(2)(3)过程,即再利用这些数据重复执行一遍或者多遍点亮扫描区域的最小像素单元的过程,直至完成对指纹识别区域内所有的最小像素单元的控制发光。Wherein, the above-mentioned "predetermined order" refers to a predetermined order of lighting the minimum pixel unit, for example, for a rectangular area, from left to right, top to bottom; or from right to left, from top to bottom The order of the following; or other various sequences. In addition, if the area of the fingerprint identification area is large, and the data in all the data vectors cannot be used to complete the scanning at one time, the scanning (1)(2)(3) process may be repeatedly performed, that is, the data may be repeatedly used again or The process of illuminating the smallest pixel unit of the scan area in multiple passes until the control illumination of all the smallest pixel units in the fingerprint recognition area is completed.
在另一种实现方式中,一个数据向量可以对应一个最小像素单元,或者一个数据向量也可以对应两个及两个以上最小像素单元,并且,在上述两种对应中,最小像素单元均可以包括一个像素点,或者两个及两个以上像素点。In another implementation manner, one data vector may correspond to one minimum pixel unit, or one data vector may correspond to two or more minimum pixel units, and in the above two correspondences, the minimum pixel unit may include One pixel, or two or more pixels.
在上述控制发光的具体实现可以由上述图1中所述的指纹扫描控制电路101实现、也可以是通过具有与上述指纹扫描控制电路101类似的集成电路或者芯片实现。在控制指纹识别区域内的最小像素单元发光之后,通过上述图1中所述的光学感应器件103(包括PD阵列)感应反射光线并转化为电信号输出至指纹信息前端采集电路104,指纹信息前端采集电路对PD阵列采集到的光信号进行滤波和降噪处理后得到对应的指纹数据,以指纹向量即第二向量集合的方式保存下来。The specific implementation of controlling illumination described above may be implemented by the fingerprint scanning control circuit 101 described above in FIG. 1, or by an integrated circuit or chip having similar fingerprint scanning control circuit 101 as described above. After controlling the minimum pixel unit illumination in the fingerprint identification area, the optical sensing device 103 (including the PD array) described above in FIG. 1 senses the reflected light and converts it into an electrical signal and outputs it to the fingerprint information front end acquisition circuit 104, the front end of the fingerprint information. The acquisition circuit filters and denoises the optical signal collected by the PD array to obtain corresponding fingerprint data, and saves the fingerprint vector, that is, the second vector set.
可选地,在上述依次使用每个数据向量中数据元素控制指纹识别区域内最小像素单元的发光之前,所述获取方法还包括:指纹识别装置将每个数据向量中的数据元素转化为标准化显示数据,标准化显示数据用于控制最小像素单元的发光。Optionally, before the sequentially using the data element in each data vector to control the illumination of the minimum pixel unit in the fingerprint identification area, the acquiring method further comprises: the fingerprint identification device converting the data element in each data vector into a standardized display. Data, standardized display data is used to control the illumination of the smallest pixel unit.
这里的显示数据是指在一定范围内、用于控制显示屏像素发出不同强度的光的数据。具体的,每个显示屏(具体由显示屏的驱动完成)会根据在一定范围的输入数据(即“显示数据”)来控制显示屏像素发不同强度的光,因此,为了适配显示屏的“显示数据”,本申请中,可以将数据向量中的数据元素转换(映射)成显示数据。同时,可以理解,为了能够让数据向量中的数据元素能够对应不同的显示数据,需要将数据向量中的数据元素要按比例映射到显示数据的区间范围,这个过程即可称为标准化的过程。例如,假设显示数据的范围是1-10,扫描数据的范围是1-100,则可以将扫描数据的1-10转换成显示数据的1,扫描数据的11-20转换成显示数据的2,扫描数据的21-30转换成显示数据的3……依次类推。The display data here refers to data for controlling the light of the display pixels to emit different intensities within a certain range. Specifically, each display screen (specifically driven by the display screen) controls the pixels of the display screen to emit different intensities according to a certain range of input data (ie, "display data"). Therefore, in order to adapt to the display screen "Display Data", in this application, data elements in a data vector can be converted (mapped) into display data. At the same time, it can be understood that in order to enable the data elements in the data vector to correspond to different display data, it is necessary to map the data elements in the data vector to the range of the display data. This process can be called a standardized process. For example, assuming that the range of the display data is 1-10 and the range of the scan data is 1-100, 1-10 of the scanned data can be converted into 1 of the display data, and 11-20 of the scanned data can be converted into 2 of the display data. The 21-30 of the scanned data is converted into 3 of the displayed data... and so on.
在上述数据转化的一种示例中,该标准化数据可以是灰度数据,指纹识别装置将每个数据向量中的数据元素转化为灰度数据,其具体转化方式可参阅下文中步骤304中关于灰度数据转化的具体描述,此处不再赘述。In an example of the above data conversion, the normalized data may be grayscale data, and the fingerprint identification device converts the data elements in each data vector into grayscale data. For the specific conversion manner, refer to step 304 in the following. The specific description of the degree data conversion will not be described here.
在具体实现中,数据向量中的数据元素转化为标准化显示数据,可以由如上述图1中所述的指纹扫描控制电路101实现,或者,具有与上述指纹扫描控制电路101类似转化功能的集成电路或者芯片等实现。In a specific implementation, the data elements in the data vector are converted into standardized display data, which may be implemented by the fingerprint scanning control circuit 101 as described in FIG. 1 above, or an integrated circuit having a conversion function similar to that of the fingerprint scanning control circuit 101 described above. Or chip and so on.
204、利用第一向量集合对第二向量集合进行解调,以得到指纹识别区域内所有的指纹 信息。204. Demodulate the second vector set by using the first vector set to obtain all fingerprint information in the fingerprint identification area.
在一种示例中,第二向量集合中包括A个指纹向量,可以理解,指纹向量与数据向量的数目相同,该指纹向量中包括在最小像素单元发光过程中采集到的指纹信息,此种情况下,利用第一向量集合对第二向量集合进行解调可以是:使用同一个最小像素单元对应的数据向量和指纹向量进行向量内积运算,直到完成指纹识别区域内所有的最小像素单元对应的向量内积运算,最终,得到指纹识别区域内所有的指纹信息。In an example, the second vector set includes A fingerprint vectors. It can be understood that the fingerprint vector is the same as the number of data vectors, and the fingerprint vector includes the fingerprint information collected during the minimum pixel unit illumination process. The demodulating the second vector set by using the first vector set may be: performing a vector inner product operation using the data vector and the fingerprint vector corresponding to the same minimum pixel unit until all minimum pixel units in the fingerprint identification area are completed. The vector inner product operation finally obtains all the fingerprint information in the fingerprint identification area.
举例来说,基于上述步骤201中所述的数据向量Wi,j,在依次使用每个数据向量Wi,j中数据元素控制指纹区域内所有的最小像素单元发光后得到的指纹向量记为Vi,j,数据向量Wi,j和指纹向量Vi,j之间是一一对应的,并且每一个指纹向量中指纹数据的排列方式与该指纹向量对应的数据向量中数据元素的排列方式一样。For example, based on the data vector Wi,j described in the above step 201, the fingerprint vector obtained by controlling the data element in each data vector Wi,j to control all the minimum pixel units in the fingerprint region is recorded as Vi, j, the data vector Wi, j and the fingerprint vector Vi, j are one-to-one correspondence, and the fingerprint data in each fingerprint vector is arranged in the same manner as the data elements in the data vector corresponding to the fingerprint vector.
上述指纹信息的解调过程具体可以有上述图1中所述的指纹信息后处理电路105实现,或者,具有上述解调功能的集成电路或者芯片等实现。指纹信息后处理电路105的具体解调过程可以是:指纹信息后处理电路105获取指纹信息前端采集电路104处理后的指纹数据并组成相应的指纹向量,以及从存储器中获取对应的数据向量,最终,指纹信息后处理电路105基于数据向量和指纹向量进行向量内积运算得到指纹信息。The demodulation process of the fingerprint information may be implemented by the fingerprint information post-processing circuit 105 described in FIG. 1 above, or by an integrated circuit or chip having the above demodulation function. The specific demodulation process of the fingerprint information post-processing circuit 105 may be: the fingerprint information post-processing circuit 105 acquires the fingerprint data processed by the fingerprint information front-end acquisition circuit 104 and forms a corresponding fingerprint vector, and obtains a corresponding data vector from the memory, and finally The fingerprint information post-processing circuit 105 performs vector inner product operation based on the data vector and the fingerprint vector to obtain fingerprint information.
本实施例中,使用相互正交的数据向量对终端显示屏上的最小像素单元进行发光调制,得到对应的指纹数据即指纹向量,最后,利用数据向量以及其对应的指纹向量解调得到准确的指纹信息,提高指纹识别性能。可以理解的是,由于各个数据向量之间是相互正交的,可以降低发光调制过程中各最小像素单元发光光线之间的相互干扰,因此,通过本申请实施例中指纹信息的获取方法,可以提高获取指纹信息的准确性,以及提升指纹识别性能。In this embodiment, the minimum pixel unit on the terminal display screen is illuminating and modulating using mutually orthogonal data vectors, and the corresponding fingerprint data, that is, the fingerprint vector is obtained, and finally, the data vector and its corresponding fingerprint vector are demodulated to obtain an accurate image. Fingerprint information to improve fingerprint recognition performance. It can be understood that, because the data vectors are mutually orthogonal, the mutual interference between the illuminating rays of the minimum pixel units in the illuminating modulation process can be reduced. Therefore, the method for acquiring the fingerprint information in the embodiment of the present application may be Improve the accuracy of obtaining fingerprint information and improve fingerprint recognition performance.
如上述图2中的描述可知,最小像素单元可以是一个或者多个像素点,下面以最小像素单元为一个像素点为例对本申请实施例中所述的指纹信息的获取方法进行详细说明。As shown in the above description of FIG. 2, the minimum pixel unit may be one or more pixel points, and the method for acquiring the fingerprint information described in the embodiment of the present application will be described in detail below by taking the minimum pixel unit as one pixel.
需要说明的是,下文中所述的扫描是相对于用户而言的,即是一种对用户手指的扫描,于设备而言,本申请实施例中的扫描过程即是利用扫描数据点亮指纹识别区域内的像素点的发光调制过程,在发光调制的同时,像素点发光光线在上述发光调制过程中也完成了对用户手指的扫描,因此,下文中所提及的扫描可等同于对像素点的发光调制,扫描过程即像素点发光调制过程。下文中将不再赘述。It should be noted that the scanning described in the following is relative to the user, that is, a scanning of the user's finger. In the device, the scanning process in the embodiment of the present application uses the scanning data to light the fingerprint. Recognizing the illuminating modulation process of the pixel points in the area, while the illuminating modulation is performed, the pixel illuminating ray also completes the scanning of the user's finger in the above illuminating modulation process. Therefore, the scanning mentioned below may be equivalent to the pair of pixels. The illuminating modulation of the point, the scanning process is the pixel point illuminating modulation process. This will not be repeated below.
图3为本申请实施例提供的另一个指纹信息的获取方法的实施例示意图。如图3所示,本申请实施例中另一个指纹信息的获取方法,包括:FIG. 3 is a schematic diagram of another embodiment of a method for acquiring fingerprint information according to an embodiment of the present disclosure. As shown in FIG. 3, another method for obtaining fingerprint information in the embodiment of the present application includes:
301、校准终端显示屏像素点。301. Calibrate the terminal display pixel points.
在扫描终端显示屏之间,对终端显示屏像素点进行校准,以得到像素点位置与PD位置之间的对应关系。其校准方法可以为:通过调用指纹扫描控制电路101发送校准指令以驱动点亮某一个像素点对用户手指进行照射,并记录该像素点的位置,PD阵列感应用户手指反射回来的光线并转换为电信号,最终将信号处理后得到的数据存储到数据缓存区。遍历数据缓存区域中PD阵列的所有数据,获取其值最大的数据,并记录该数据对应的PD位置,从而,根据记录的像素点位置和PD位置,建立两者之间的对应关系,记为(pixel,PD)对并保存。Between the display screens of the scanning terminal, the pixel of the terminal display screen is calibrated to obtain a correspondence between the pixel position and the PD position. The calibration method may be: sending a calibration instruction by calling the fingerprint scanning control circuit 101 to drive a certain pixel to illuminate the user's finger, and recording the position of the pixel, and the PD array senses the light reflected by the user's finger and converts it into The electrical signal finally stores the data obtained after the signal processing into the data buffer. Traverse all the data of the PD array in the data buffer area, obtain the data with the largest value, and record the PD position corresponding to the data, so as to establish the correspondence between the two according to the recorded pixel position and the PD position, (pixel, PD) pairs and save.
同理,按照上面描述的校准方法,依次将每一个终端显示屏像素点均建立对应的(pixel,PD)对并保存,完成对像素点的校准。Similarly, according to the calibration method described above, each pixel of the terminal display screen is sequentially set to a corresponding (pixel, PD) pair and saved, and the calibration of the pixel is completed.
需要说明的是,在其他实施例中,像素点与PD的对应关系可以不是一一对应的关系,例如,可以存在以下几种关系:It should be noted that, in other embodiments, the correspondence between the pixel points and the PD may not be a one-to-one correspondence. For example, the following relationships may exist:
(1)多个像素点对应多个PD(1) Multiple pixels correspond to multiple PDs
在这种情况下,在进行扫描时,扫描时所用的一个数据用于同时点亮多个像素点,接收时,获取多个PD的数据,可以对这些数据可以进行类似相加、平均等处理得到成能够反应指纹信息的数据。在这过程中,可视为将多个像素点绑定成了一个“大”的像素点,将多个PD绑定成了一个“大”的PD。In this case, when scanning, one data used for scanning is used to simultaneously illuminate a plurality of pixels, and when receiving, data of a plurality of PDs is acquired, and the data can be similarly added, averaged, etc. Get data that can reflect fingerprint information. In this process, it can be seen as binding multiple pixels into a "large" pixel, and binding multiple PDs into a "large" PD.
(2)一个像素点对应于多个PD(2) One pixel corresponds to multiple PDs
在这种情况下,在进行扫描时,扫描时所用的一个数据用于点亮一个像素点,接收时,获取多个PD的数据,可以对这些数据可以进行类似相加、平均等处理得到成能够反应指纹信息的数据。In this case, when scanning, one data used for scanning is used to illuminate one pixel, and when receiving, data of a plurality of PDs is acquired, and the data can be similarly added, averaged, etc. Data that can reflect fingerprint information.
(3)多个像素点对应一个PD(3) Multiple pixels correspond to one PD
在这种情况下,在进行扫描时,扫描时所用的一个数据用于同时点亮多个像素,接收时,获取对应的一个PD的值。In this case, when scanning is performed, one data used for scanning is used to simultaneously illuminate a plurality of pixels, and when receiving, the value of the corresponding one PD is acquired.
302、当检测到触摸操作有效时,根据用户手指的操作区域确定指纹识别区域。302. When detecting that the touch operation is valid, determining the fingerprint identification area according to the operation area of the user's finger.
可选的,以移动终端为例,当移动终端检测到用户手指触摸显示屏时,移动终端会根据实际场景判断手指的触摸操作是否有效,若有效,则启动指纹定位,否则不响应用户的触摸操作。若指纹定位启动,则移动终端将用户手指所在的坐标位置区域确定为操作区域,进而,移动终端将该操作区域确定为指纹识别区域。Optionally, taking the mobile terminal as an example, when the mobile terminal detects that the user's finger touches the display screen, the mobile terminal determines whether the touch operation of the finger is valid according to the actual scene, and if valid, starts the fingerprint positioning, otherwise the user does not respond to the touch. operating. If the fingerprint location is activated, the mobile terminal determines the coordinate position area where the user's finger is located as the operation area, and further, the mobile terminal determines the operation area as the fingerprint recognition area.
举例来说,在屏幕指纹解锁的应用场景中,当用户在移动终端锁屏状态下用手指触摸显示屏时,移动终端可以启动指纹定位,进行指纹识别,以便在指纹识别成功之后解锁屏幕。当用户在移动终端亮屏状态下在某个应用场景(如游戏)中用手指按压屏幕时,移动终端可以不响应用户的按压操作。For example, in an application scenario in which the screen fingerprint is unlocked, when the user touches the display screen with the finger in the state of locking the screen of the mobile terminal, the mobile terminal can initiate fingerprint positioning and perform fingerprint recognition to unlock the screen after the fingerprint recognition succeeds. When the user presses the screen with a finger in an application scenario (such as a game) while the mobile terminal is in a bright screen state, the mobile terminal may not respond to the user's pressing operation.
进一步,可选的,指纹识别区域可以是一块,也可以是多块,例如,针对多点触摸(即几个手指同时触摸)的场景,可以针对每一个触摸点划分一个指纹识别子区域,各个指纹识别子区域之间并不接触。如图4所示,图4为本申请实施例提供的一个指纹识别区域分割示意图,图4中以手机屏幕为例,在手机屏幕上有两个触摸点(两个手指的指纹),两个触摸点的位置排列并不限定,例如,可以以左右关系、上下关系或者混合关系排列。针对这两个触摸点,可以相应地生成AEHD和FBCG两个指纹识别子区域,可以理解,这两个区域要比触摸点要大(需要覆盖需要检测到指纹),但也不需要特别大(过大会引入大量跟指纹无关的区域,没有必要),通常可以设置为触摸点面积的1到3倍,并在触摸点的周围都保留有一些冗余区域以防止漏检一些指纹数据,同时,为了后续处理方便,这两个区域可以是矩阵。Further, optionally, the fingerprint identification area may be one piece or multiple pieces. For example, for a scene of multi-touch (ie, several fingers are simultaneously touched), one fingerprint identification sub-area may be divided for each touch point, and each There is no contact between the fingerprint recognition sub-areas. As shown in FIG. 4, FIG. 4 is a schematic diagram of a fingerprint identification area segmentation according to an embodiment of the present application. In FIG. 4, a mobile phone screen is taken as an example. There are two touch points (two finger fingerprints) on the mobile phone screen, and two The arrangement of the positions of the touched points is not limited, and for example, they may be arranged in a left-right relationship, an upper-lower relationship, or a mixed relationship. For these two touch points, two fingerprint recognition sub-areas of AEHD and FBCG can be generated accordingly. It can be understood that these two areas are larger than the touch points (requires coverage to be detected), but it does not need to be particularly large ( It is not necessary to introduce a large number of areas that are not related to fingerprints. It can usually be set to 1 to 3 times the area of the touch point, and some redundant areas are reserved around the touch points to prevent some fingerprint data from being missed. For subsequent processing convenience, the two regions can be matrices.
303、当上述触摸操作有效时,获取扫描数据。303. Acquire scan data when the touch operation is valid.
该扫描数据为上述图2对应的实施例中所述的第一向量集合中的数据元素,其中,一 个数据元素便是一个扫描数据。因此,该扫描数据可以是上述三维矩阵M[I,J,K]中的矩阵元素。The scan data is a data element in the first vector set described in the embodiment corresponding to Fig. 2 above, wherein one data element is a scan data. Therefore, the scan data may be a matrix element in the above three-dimensional matrix M[I, J, K].
举例来说,图5为本申请实施例提供的一个三维矩阵M[8,8,8]示意图。图5中示出了一个8x8x8的三维矩阵(即I=8,J=8,K=8)。其中,三维矩阵M[8,8,8]中在Z方向上可以划分为8个二维矩阵,这些二维矩阵分别表示为:M1[I,J],M2[I,J],M3[I,J],M4[I,J],M5[I,J],M6[I,J],M7[I,J],M8[I,J]。将上述8个二维矩阵上位于相同坐标位置(i,j)的矩阵元素构成列向量Wi,j,例如,列向量W1,1={m[1,1,1],m[1,1,2],m[1,1,3],m[1,1,4],m[1,1,5],m[1,1,6],m[1,1,7],m[1,1,8]},或者,W1,1={m[1,1,8],m[1,1,7],m[1,1,6],m[1,1,5],m[1,1,4],m[1,1,3],m[1,1,2],m[1,1,1]},其中,m[1,1,1]至m[1,1,8]分别为二维矩阵M1[i,j]至M8[i,j]中(1,1)坐标上的矩阵元素。For example, FIG. 5 is a schematic diagram of a three-dimensional matrix M[8, 8, 8] provided by an embodiment of the present application. An 8x8x8 three-dimensional matrix is shown in Figure 5 (i.e., I = 8, J = 8, K = 8). Among them, the three-dimensional matrix M[8,8,8] can be divided into eight two-dimensional matrices in the Z direction, and these two-dimensional matrices are respectively represented as: M1[I,J], M2[I,J], M3[ I, J], M4 [I, J], M5 [I, J], M6 [I, J], M7 [I, J], M8 [I, J]. The matrix elements at the same coordinate position (i, j) on the above eight two-dimensional matrices constitute a column vector Wi, j, for example, a column vector W1, 1 = {m[1, 1, 1], m[1, 1 , 2], m[1,1,3],m[1,1,4],m[1,1,5],m[1,1,6],m[1,1,7],m [1,1,8]}, or, W1,1={m[1,1,8],m[1,1,7],m[1,1,6],m[1,1,5 ], m[1,1,4],m[1,1,3],m[1,1,2],m[1,1,1]}, where m[1,1,1] to m[1,1,8] are matrix elements on the (1,1) coordinate of the two-dimensional matrix M1[i,j] to M8[i,j], respectively.
同理,可以得到列向量W1,2,W1,3,W1,4,W1,5,W2,1,W2,2……等一共64个列向量,其中,64个列向量满足:对于同一个列向量,其自身的内积为0,例如,W1,1*W1,1=0,;对于任意两个不同的列向量,其两个列向量之间的内积不为0,例如,W1,1*W1,1=a,a≠0。根据上述正交条件依次构造得到三维矩阵M[8,8,8],进而将三维矩阵M[8,8,8]在Z方向上每一个的二维矩阵作为一个扫描图案,一个矩阵元素作为一个扫描数据。Similarly, a total of 64 column vectors of column vectors W1, 2, W1, 3, W1, 4, W1, 5, W2, 1, W2, 2, etc. can be obtained, wherein 64 column vectors satisfy: for the same The column vector has its own inner product of 0, for example, W1, 1*W1, 1 = 0. For any two different column vectors, the inner product between the two column vectors is not 0, for example, W1 , 1*W1, 1=a, a≠0. The three-dimensional matrix M[8, 8, 8] is sequentially constructed according to the above orthogonal conditions, and then the two-dimensional matrix of the three-dimensional matrix M[8, 8, 8] in the Z direction is used as a scanning pattern, and one matrix element is used as a matrix element. A scan of the data.
需要说明的是,扫描数据与像素点之间的对应关系与上述像素点与PD之间的对应关系类似,即可以是一个扫描数据对应一个像素点,也可以是一个扫描数据对应多个像素点,或者,还可以是多个扫描数据对应多个像素点,详细描述可参阅上述步骤301中像素点与PD之间的对应关系的相关描述,此处不再赘述。It should be noted that the correspondence between the scan data and the pixel is similar to the correspondence between the pixel and the PD, that is, one scan data corresponds to one pixel, or one scan data corresponds to multiple pixels. Or, a plurality of pixel data may be corresponding to a plurality of pixel points. For a detailed description, refer to the related description of the correspondence between the pixel points and the PD in the foregoing step 301, and details are not described herein again.
304、利用扫描数据控制终端显示屏像素点发光对指纹识别区域进行扫描。304. Scan the fingerprint identification area by using the scan data to control the pixel illumination of the display screen of the terminal.
在上述步骤302中获取到扫描数据之后,将该扫描数据转化为灰度数据。示例性的,可以采用如下所述的公式一或者公式二将扫描数据转化为灰度数据。After the scan data is acquired in the above step 302, the scan data is converted into gray scale data. Illustratively, scan data can be converted to gray scale data using Equation 1 or Equation 2 as described below.
公式一为:y=(2n-1)*((m[i,j,k])-min)/(max-min); Equation 1 is: y = (2n-1) * ((m[i, j, k]) - min) / (max-min);
公式二为:y=(2n-1)*sin{0.5*π*((m[i,j,k])-min)/(max-min)}; Equation 2 is: y=(2n-1)*sin{0.5*π*((m[i,j,k])-min)/(max-min)};
在上述公式一和公式二中,y为灰度数据,n为灰度数据的bit位的位数,m[i,j,k]为三维矩阵M[I,J,K]中(i,j,k)坐标位置的矩阵元素即任一个扫描数据,max为扫描数据组中的最大扫描数据值,min为扫描数据组中的最小扫描数据值。上述公式一和公式二只是作为一种示例性说明,并不对转换方式造成限定,还可以采用其他具有相同技术效果的转换方式将扫描数据转换成灰度数据。In the above formulas 1 and 2, y is the gradation data, n is the number of bits of the gradation data bit, and m[i, j, k] is the three-dimensional matrix M[I, J, K] (i, j, k) The matrix element of the coordinate position is any scan data, max is the maximum scan data value in the scan data group, and min is the minimum scan data value in the scan data group. The above formula 1 and formula 2 are only used as an exemplary description, and do not limit the conversion mode. Other conversion methods with the same technical effects can be used to convert the scan data into gray scale data.
举例来说,灰度数据用来控制显示屏像素点的灰度级(或称灰阶),每个像素点包括RGB三个子像素,将三个子像素均设置为相同的灰度数据就可以显示出对应的灰度级。通常灰度数据的bit为4为或者8位,图6为本申请实施例提供的一个4bit灰度级示意图,图7为本申请实施例提供的一个8bit灰度级示意图。如图6所示,灰度数据有4bit,那么有16个灰度级(从0到15),当灰度数据是0时亮度最低,灰度数据是15时亮度最高。如果灰度数据有8bit,那么有256个灰度级(从0到255),其灰度级与亮度之间的关系如图7所示。For example, the gray scale data is used to control the gray level (or gray scale) of the pixels of the display screen, and each pixel point includes three sub-pixels of RGB, and all three sub-pixels are set to the same gray scale data to be displayed. The corresponding gray level is output. Generally, the bit of the gray data is 4 or 8 bits. FIG. 6 is a schematic diagram of a 4-bit gray level provided by the embodiment of the present application, and FIG. 7 is a schematic diagram of an 8-bit gray level provided by the embodiment of the present application. As shown in Fig. 6, the gradation data has 4 bits, then there are 16 gray levels (from 0 to 15), when the gradation data is 0, the brightness is the lowest, and when the gradation data is 15, the brightness is the highest. If the grayscale data has 8 bits, then there are 256 gray levels (from 0 to 255), and the relationship between the gray level and the brightness is as shown in FIG.
在一种扫描方式示例中,如上述图5中所述的三维矩阵M[8,8,8],如上所述,将三维 矩阵M[8,8,8]中Z方向上的每一个二维矩阵作为一个扫描图案,其中的矩阵元素即为扫描数据,每一个扫描图案中各包括64个列向量(即数据向量)中一个序号相同的矩阵元素,即一个扫描图案中包括64个矩阵元素,这个矩阵元素分别是来自于64个列向量中的同一序号的矩阵元素。In a scanning mode example, the three-dimensional matrix M[8, 8, 8] as described above in FIG. 5, as described above, each of the three-dimensional matrix M[8, 8, 8] in the Z direction The dimension matrix is used as a scan pattern, wherein the matrix elements are scan data, and each scan pattern includes 64 matrix elements (ie, data vectors) each having the same matrix element number, that is, a scan pattern includes 64 matrix elements. This matrix element is a matrix element from the same sequence number in 64 column vectors, respectively.
依次利用8个扫描图案分别对指纹识别区域内的像素点进行扫描,每次扫描执行如下步骤:The pixels in the fingerprint recognition area are respectively scanned by using eight scanning patterns, and each scan performs the following steps:
步骤1:从一个扫描图案中每次间隔s行取出扫描数据,其中,s≤I。Step 1: Scan data is taken from each scan interval in a scan pattern, where s ≤ I.
上述扫描数据取出方式具体可以是按照逐行方式将扫描数据全部取出,即按照先后顺序一行一行地取出。Specifically, the scanning data extraction manner may be that all the scan data are taken out in a row-by-row manner, that is, one by one in a sequential order.
步骤2:将扫描数据转换为灰度数据控制像素点发光对指纹识别区域进行扫描。Step 2: Convert the scanned data into gray scale data to control the pixel spot illumination to scan the fingerprint recognition area.
步骤3:当扫描图案中所有数据均被取出并执行完步骤2时,在指纹识别区域内移动扫描图案继续进行扫描。Step 3: When all the data in the scan pattern is taken out and step 2 is performed, the scan pattern is moved in the fingerprint recognition area to continue scanning.
举例对上述扫描过程进行说明,以一个扫描数据对应一个像素点为例,当指纹识别区域内总像素点数目为扫描图案对应的像素点数目的4倍时,使用一次扫描图案扫描,只能扫描完指纹识别区域中1/4的像素点,因此,还需要使用该扫描图案对其他3/4指纹识别区域中的像素点进行扫描,才能完成本次对指纹识别区域的扫描,因此,可以使用指纹图案从上一次扫描结束时的下一个像素点开始进行扫描,从而完成下一个1/4指纹识别区域的扫描,这个过程可视为扫描图案在指纹识别区域中的移动,应理解,当指纹识别区域内总像素点数目与扫描图案对应的像素点数目想等时,扫描图案一次便可以扫描完整个指纹识别区域,无需在指纹识别区域内移动所述扫描图案。For example, the scanning process is described by taking one pixel corresponding to one scan data as an example. When the total number of pixels in the fingerprint recognition area is 4 times the number of pixels corresponding to the scan pattern, scanning is performed using one scanning pattern, and only scanning is completed. 1/4 of the pixels in the fingerprint recognition area. Therefore, it is also necessary to use the scan pattern to scan the pixels in the other 3/4 fingerprint recognition areas to complete the scanning of the fingerprint recognition area. Therefore, the fingerprint can be used. The pattern is scanned from the next pixel at the end of the last scan, thereby completing the scanning of the next 1/4 fingerprint recognition area. This process can be regarded as the movement of the scan pattern in the fingerprint recognition area. It should be understood that when fingerprint recognition When the number of total pixels in the area is equal to the number of pixels corresponding to the scan pattern, the scan pattern can scan the entire fingerprint recognition area once, without moving the scan pattern in the fingerprint recognition area.
步骤4:当扫描图案遍历扫描整个指纹识别区域之后,结束本次扫描,并使用下一个扫描图案进行下一次扫描,直至完成8个扫描图案的扫描。Step 4: After the scan pattern traverses the entire fingerprint recognition area, the current scan is ended, and the next scan pattern is used for the next scan until the scan of the eight scan patterns is completed.
在另一种示例中,在利用扫描数据控制终端显示屏像素点发光对指纹识别区域进行扫描之前,所述获取方法还包括:若上述触摸操作有效,指纹识别装置还可以根据上述启动操作对应的操作区域确定指纹识别区域,并且将指纹识别区域划分为N个指纹识别子区域,N为大于或者等于2的整数。In another example, the acquiring method further includes: if the touch operation is effective, the fingerprint identification device may further correspond according to the startup operation, before the scanning of the fingerprint display area is controlled by using the scan data. The operation area determines the fingerprint identification area, and divides the fingerprint identification area into N fingerprint recognition sub-areas, where N is an integer greater than or equal to 2.
举例来说,在指纹识别区域面积较大的情况下,为提高扫描速率,可以将指纹识别区域划分为N个指纹识别子区域,以对N个指纹识别子区域进行同时扫描,从而提高指纹识别效率。图8为本申请实施例提供的一个指纹识别子区域扫描示意图。若指纹识别区域的面积为一个扫描图案对应的像素点面积的N倍(即指纹识别区域中包括的像素点数目为一个扫描图案对应的像素点数目的N倍),如图8中右侧所示,将指纹识别区域划分为N个指纹识别子区域A1至An,其中,n∈[1,N],如图8的左侧所示,将A1至An中的任一个指纹识别子区域划分为G组,每组包括s行扫描数据,s大于或者等于2,并且小于或等于扫描图案中的最大行数值。For example, in the case that the area of the fingerprint identification area is large, in order to increase the scanning rate, the fingerprint identification area may be divided into N fingerprint identification sub-areas to simultaneously scan the N fingerprint identification sub-areas, thereby improving fingerprint recognition. effectiveness. FIG. 8 is a schematic diagram of scanning a fingerprint identification sub-area according to an embodiment of the present application. If the area of the fingerprint identification area is N times of the area of the pixel corresponding to one scan pattern (that is, the number of pixels included in the fingerprint recognition area is N times the number of pixels corresponding to one scan pattern), as shown on the right side of FIG. Dividing the fingerprint identification area into N fingerprint recognition sub-areas A1 to An, where n ∈ [1, N], as shown on the left side of FIG. 8 , dividing any one of the fingerprint recognition sub-areas of A1 to An into Group G, each group includes s row scan data, s is greater than or equal to 2, and is less than or equal to the maximum row value in the scan pattern.
如图4所示,即为N为2时的情况,将指纹识别区域划分为AEHD和FBCG两个指纹识别子区域。以扫描AEHD子区域为例,将AEHD子区域进行分组扫描,其具体过程如下:As shown in FIG. 4, when N is 2, the fingerprint identification area is divided into two fingerprint recognition sub-areas of AEHD and FBCG. Taking the scanning AEHD sub-area as an example, the AEHD sub-area is scanned in groups, and the specific process is as follows:
步骤5:将AEHD子区域划分为至少两组,记为G组,其中,G为大于或等于2的整数;Step 5: Divide the AEHD sub-region into at least two groups, denoted as G group, where G is an integer greater than or equal to 2;
步骤6:对于分组后G组中的每一个组区域,使用对应的扫描图案按照上述步骤1至步骤3中所述的扫描过程对AEHD子区域进行扫描。Step 6: For each group region in the group G after grouping, the AEHD sub-region is scanned according to the scanning process described in the above steps 1 to 3 using the corresponding scanning pattern.
其中,对上述G组区域可以按顺序依次执行如上述步骤1至步骤3中的扫描过程进行扫描,或者,对上述G组区域同时执行如上述步骤1至步骤3中的扫描过程进行扫描。The scanning process in steps 1 to 3 above may be sequentially performed in the above-mentioned G group region, or the scanning process in steps 1 to 3 described above may be simultaneously performed on the G group region.
步骤7:使用另一个扫描图案继续对AEHD区域进行下一次扫描,直至所有扫描图案扫描完毕。Step 7: Continue to scan the AEHD area for the next scan using another scan pattern until all scan patterns have been scanned.
需要说明的是,在对AEHD子区域进行扫描的同时,还可以采用类似方法扫描FBCG子区域,或者,先扫描AEHD区域,后扫描FBCG区域,对此本申请不做任何限定。It should be noted that, while scanning the AEHD sub-area, the FBCG sub-area may be scanned in a similar manner, or the AEHD area may be scanned first, and then the FBCG area may be scanned, which is not limited in this application.
还需要说明的是,上述扫描数据的是从扫描图案中按照逐行的顺序取出,生成逐行的灰度数据,逐行点亮像素点发光的。除上述逐行方式之外,还可以从扫描图案中按照其他预定的规则来进行扫描,例如,每次间隔预定数量的扫描数据或者采用预定的随机方式取出扫描数据并进行扫描。It should be noted that the scan data is taken out from the scan pattern in a row-by-row order to generate progressive gray scale data, and the pixel dots are illuminated line by line. In addition to the above-described progressive mode, scanning may be performed from the scan pattern according to other predetermined rules, for example, by scanning a predetermined number of scan data or taking a scan in a predetermined random manner.
本实施例中,与逐行方式相比,随机方式可以降低相邻像素点之间的余辉干扰(即每个像素点被点亮之后会保护发光状态一段时间,由于前一个像素点点亮后,尚未熄灭时,立即点亮后一个相邻的像素点,前一个像素点的光线会对后一个像素点产生干扰,称为余辉干扰),进一步降低相邻像素点之间的相互干扰。In this embodiment, compared with the progressive mode, the random mode can reduce the afterglow interference between adjacent pixel points (that is, each pixel point is protected from being illuminated for a period of time after being lit, since the previous pixel point is lit When it is not extinguished, immediately illuminate an adjacent pixel, and the light of the previous pixel will interfere with the next pixel, which is called afterglow interference, further reducing the mutual interference between adjacent pixels.
305、通过光学指纹模组接收用户手指表面反射的反射光信号。305. Receive an reflected light signal reflected by a surface of the user's finger through the optical fingerprint module.
具体实现中,可以通过如上述图1中所述的光学感应器件103接收用户表面反射的发射光信号。图9为本申请实施例提供的一个PD阵列的光路示意图。如图9所示,光学指纹模组103中的PD阵列接收OLED屏上用户手指反射的反射光信号。如上述步骤301中所述的校准过程的描述一致,在校准过程中已建立有用于表征像素点位置与PD位置之间对应关系的(pixel,PD)对。根据(pixel,PD)对中记录的位置关系,当点亮其中一个像素点时,便可以确定接收反射光信号的PD。In a specific implementation, the emitted light signal reflected by the surface of the user can be received by the optical sensing device 103 as described in FIG. 1 above. FIG. 9 is a schematic diagram of an optical path of a PD array according to an embodiment of the present application. As shown in FIG. 9, the PD array in the optical fingerprint module 103 receives the reflected light signal reflected by the user's finger on the OLED screen. As described in the description of the calibration process described in step 301 above, a (pixel, PD) pair for characterizing the correspondence between pixel position and PD position has been established during the calibration process. According to the positional relationship recorded in the (pixel, PD) pair, when one of the pixels is lit, the PD receiving the reflected light signal can be determined.
容易理解,对于同一个像素点而言,像素点被点亮的次数与对应PD上接收到的反射光信号的数量一致,即像素点被点亮几次,该像素点对应的PD上便接收到几次反射光信号。PD阵列可以使用其他具有类似功能的图像传感器代替,本申请不做任何限制。It is easy to understand that for the same pixel, the number of times the pixel is illuminated is the same as the number of reflected light signals received on the corresponding PD, that is, the pixel is illuminated several times, and the PD corresponding to the pixel is received. The reflected light signal is reflected several times. The PD array can be replaced with other image sensors having similar functions, and the present application does not impose any limitation.
306、将发射光信号转化为指纹数据,并对指纹数据进行解调,以得到指纹信息。306. Convert the transmitted optical signal into fingerprint data, and demodulate the fingerprint data to obtain fingerprint information.
如上述图1中的描述,通过指纹信息采集前端处理电路104对PD接收到的反射光信号进行放大、滤波处理等,以得到指纹数据。As described above in FIG. 1, the fingerprint information acquisition front end processing circuit 104 amplifies, filters, and the like the reflected light signal received by the PD to obtain fingerprint data.
由于指纹识别区域的像素点均被扫描了多次,对应PD获取到的指纹数据也会有多个,例如,使用上述三维矩阵M[8,8,8]中列向量W1,1对应的8个扫描数据对同一像素点K次扫描后得到的8个指纹数据依次为:v111,v112,v113,v114,v115,v116,v117,v118。Since the pixel points of the fingerprint recognition area are all scanned a plurality of times, there are a plurality of fingerprint data acquired by the corresponding PD, for example, 8 corresponding to the column vector W1, 1 in the above three-dimensional matrix M[8, 8, 8] The eight fingerprint data obtained after scanning K times of the same pixel are: v111, v112, v113, v114, v115, v116, v117, v118.
按照一定的排列顺序,将上述K个指纹数据进行排列得到列向量V1,1,例如V1,1=(v111,v112,v113,v114,v115,v116,v117,v118),或者,V1,1=(v118,v117,v116,v115,v114,v113,v112,v111)。According to a certain arrangement order, the K fingerprint data are arranged to obtain a column vector V1,1, for example, V1, 1=(v111, v112, v113, v114, v115, v116, v117, v118), or V1, 1= (v118, v117, v116, v115, v114, v113, v112, v111).
以列向量Wi,j类似,将扫描数据组扫描得到的指纹数据用列向量Vi,j表示,其中,上述V1,1为使用W1,1对指纹识别区域进行扫描后指纹数据对应的列向量。需要说明的是, 列向量Vi,j中指纹数据与列向量Wi,j中扫描数据的排列顺序一致。Similar to the column vector Wi,j, the fingerprint data scanned by the scan data set is represented by a column vector Vi,j, wherein the V1,1 is a column vector corresponding to the fingerprint data after the fingerprint identification area is scanned using W1,1. It should be noted that the fingerprint data in the column vectors Vi, j is consistent with the order of the scan data in the column vectors Wi, j.
对于同一个像素点,将该像素点的指纹数据对应的列向量Vi,j以及,该像素点的扫描数据对应的列向量Wi,j进行向量内积运算,即Wi,j*Vi,j=Pi,j;其中,*为向量内积运算符,Wi,j为(pixel,PD)表中某个像素点的扫描数据对应的列向量,Vi,j为同一个像素点对应的指纹数据构成的列向量,Pi,j为正交解调运算后的结果即指纹信息。For the same pixel, the column vector Vi,j corresponding to the fingerprint data of the pixel and the column vector Wi,j corresponding to the scan data of the pixel are subjected to a vector inner product operation, that is, Wi, j*Vi, j= Pi, j; where * is a vector inner product operator, Wi, j is the column vector corresponding to the scan data of a pixel in the (pixel, PD) table, and Vi, j is the fingerprint data corresponding to the same pixel point. The column vector, Pi, j is the result of the orthogonal demodulation operation, that is, the fingerprint information.
最终,将通过上述正交解调运算得到的所有指纹信息Pi,j,与像素点对应,建立(pixel,Pi,j)对的一张数据表,得到最终的指纹信息,以供指纹识别应用电路106调用进行指纹验证等操作。Finally, all the fingerprint information Pi,j obtained by the above orthogonal demodulation operation are corresponding to the pixel points, and a data table of (pixel, Pi, j) pairs is established, and the final fingerprint information is obtained for the fingerprint identification application. Circuit 106 invokes operations such as fingerprint verification.
本实施例中,使用通过具有正交特性的三维矩阵构造的扫描数据控制终端显示屏内的像素点发光进行指纹扫描,可以理解,手指表面具有反光特性,会将像素点的光线反射形成反射光信号,其中,反射光信号中携带有指纹信息,进一步,将反射光信号转换为指纹数据,并对指纹数据进行正交解调,得到指纹信息。由于扫描数据具有正交特性,即对扫描过程进行了正交调制,以及指纹信息是对扫描后得到的指纹数据进行正交解调后得到的,通过正交调制和正交解调,可以降低甚至消除环境光、以及各像素点光线之间的干扰,获取得到更加准确的指纹信息,提高光学式指纹识别的性能。In this embodiment, the scanning of the pixel in the display screen of the terminal is controlled by using the scanning data constructed by the three-dimensional matrix having orthogonal characteristics to perform fingerprint scanning. It can be understood that the surface of the finger has a reflective characteristic, and the light of the pixel is reflected to form reflected light. The signal, wherein the reflected light signal carries fingerprint information, and further, converts the reflected light signal into fingerprint data, and performs orthogonal demodulation on the fingerprint data to obtain fingerprint information. Since the scan data has orthogonal characteristics, that is, the scanning process is orthogonally modulated, and the fingerprint information is obtained by orthogonally demodulating the fingerprint data obtained after scanning, and can be reduced by orthogonal modulation and quadrature demodulation. Even eliminate the ambient light and the interference between the light of each pixel to obtain more accurate fingerprint information and improve the performance of optical fingerprint recognition.
基于上述各实施例,下面结合具体的应用场景对本申请中指纹信息的获取方法进行详细说明,如图10所示为智能手机指纹识别系统的硬件结构图。Based on the foregoing embodiments, the method for acquiring fingerprint information in the present application is described in detail below in conjunction with a specific application scenario. FIG. 10 is a hardware structure diagram of a fingerprint identification system of a smart phone.
智能手机指纹识别系统包括:发光驱动模块1001、像素阵列1002、扫描驱动模块1003、复用及解复用模块1004、显示驱动集成电路1005、触控电极模块1006、触控集成电路1007、指纹模组1008、指纹模组集成电路1009和应用处理器1010。The smart phone fingerprint recognition system includes: a light-emitting driving module 1001, a pixel array 1002, a scan driving module 1003, a multiplexing and demultiplexing module 1004, a display driving integrated circuit 1005, a touch electrode module 1006, a touch integrated circuit 1007, and a fingerprint module. Group 1008, fingerprint module integrated circuit 1009 and application processor 1010.
其中,上述显示驱动集成电路1005包括:模数及数模转换模块10051、控制逻辑模块10052和电源模块10053三个部分。发光驱动模块1001、像素阵列1002、扫描驱动模块1003、复用及解复用模块1004、显示驱动集成电路1005、触控电极模块1006和触控集成电路1007继承于智能手机的OLED显示屏中。指纹模组1008和指纹模组集成电路1009集成于该OLED显示屏的下方。The display driving integrated circuit 1005 includes three parts: a modulus and digital-to-analog conversion module 10051, a control logic module 10052, and a power module 10053. The illumination driving module 1001, the pixel array 1002, the scan driving module 1003, the multiplexing and demultiplexing module 1004, the display driving integrated circuit 1005, the touch electrode module 1006, and the touch integrated circuit 1007 are inherited in the OLED display of the smart phone. The fingerprint module 1008 and the fingerprint module integrated circuit 1009 are integrated under the OLED display.
应用处理器1010为显示驱动集成电路1005、触控集成电路1007和指纹模组集成电路1009提供控制接口,并执行指纹识别算法和高层指纹识别应用。The application processor 1010 provides a control interface for the display driver integrated circuit 1005, the touch integrated circuit 1007, and the fingerprint module integrated circuit 1009, and executes a fingerprint recognition algorithm and a high-level fingerprint recognition application.
发光驱动模块1001、扫描驱动模块1003以及控制逻辑模块10052可以实现上述图1中所述的指纹扫描控制电路101的指纹扫描功能以及驱动逻辑控制功能。The illumination driving module 1001, the scan driving module 1003, and the control logic module 10052 can implement the fingerprint scanning function and the driving logic control function of the fingerprint scanning control circuit 101 described above in FIG.
指纹模组1008具体可以包括上述图1中所述的光学感应器件103(即PD阵列)和指纹信息采集前端处理电路104等,以实现对指纹数据的采集、滤波和降噪处理等。The fingerprint module 1008 may specifically include the optical sensing device 103 (ie, PD array) and the fingerprint information collecting front-end processing circuit 104 described above in FIG. 1 to implement fingerprint data collection, filtering, and noise reduction processing.
指纹模组集成电路1009具体可以包括如上述图1中所述的指纹信息后处理电路105,以对指纹数据进行解调得到对应的指纹信息。The fingerprint module integrated circuit 1009 may specifically include the fingerprint information post-processing circuit 105 as described above in FIG. 1 to demodulate the fingerprint data to obtain corresponding fingerprint information.
基于上述各实施例,结合上述图10,本申请提供了一种具体的指纹信息获取方法,其具体方法流程如图11所示。Based on the foregoing embodiments, in conjunction with FIG. 10 above, the present application provides a specific method for acquiring fingerprint information, and a specific method flow is shown in FIG. 11.
如图11所示,本申请实施例提供的一个指纹信息的获取方法的实施例示意图,包括:As shown in FIG. 11, a schematic diagram of an embodiment of a method for acquiring fingerprint information provided by an embodiment of the present application includes:
S1:校准显示屏像素点。S1: Calibrate the display pixel points.
校准方法与上述步骤301中的描述类似,此处不再赘述。The calibration method is similar to the description in step 301 above, and details are not described herein again.
S2:指纹识别区域的定位与分割。S2: Positioning and segmentation of the fingerprint identification area.
将OLED显示屏上的指定区域或者全部区域定义为指纹识别区域,但用户手指触摸该指纹识别区域时,上述触摸操作被触控集成电路检测到,并且触控集成电路将检测结果上报给AP1010。AP1010启动指纹识别区域的定位与分割程序,确定待扫描的子区域。其中,子区域的个数与指纹识别区域内的手指个数相同。The specified area or all the areas on the OLED display are defined as the fingerprint identification area. When the user touches the fingerprint identification area, the touch operation is detected by the touch integrated circuit, and the touch integrated circuit reports the detection result to the AP 1010. The AP 1010 starts the positioning and segmentation process of the fingerprint identification area, and determines the sub-area to be scanned. The number of sub-regions is the same as the number of fingers in the fingerprint identification area.
具体的,如图12所示,触控集成电路1007向AP1010提供手指触摸区域,并根据该手指触摸区域确定指纹识别区域,该指纹识别区域大于并包括该手指触摸区域,该指纹识别区域与该手指触摸区域不重合部分留有一定的像素点,例如,图12中ABCD区域为指纹识别区域。例如,B线段的长度取值为10mm(在2K显示屏上对应于220个像素pixel),AC线段的长度取值为12mm(在2K显示屏上对应于200个像素pixel)。由此最终确定点A,B,C,D的坐标,完成指纹识别区域的定位过程。Specifically, as shown in FIG. 12, the touch integrated circuit 1007 provides a finger touch area to the AP 1010, and determines a fingerprint identification area according to the finger touch area, where the fingerprint identification area is larger than and includes the finger touch area, and the fingerprint identification area is The non-coincident portion of the finger touch area has a certain pixel point. For example, the ABCD area in FIG. 12 is a fingerprint recognition area. For example, the length of the B segment is 10 mm (corresponding to 220 pixels on a 2K display), and the length of the AC segment is 12 mm (corresponding to 200 pixels on a 2K display). Thus, the coordinates of points A, B, C, and D are finally determined, and the positioning process of the fingerprint identification area is completed.
进一步,如上所述,按照指纹识别区域的面积大小,以及扫描图案的面积大小,可以将指纹识别区域划分为多个指纹识别子区域进行扫描,此过程即为指纹识别区域的分割过程,具体实现可以通过上述指纹区域的分割程序实现,分割程序的实现方式较多,对此本申请不做任何限制。Further, as described above, according to the size of the fingerprint identification area and the size of the scan pattern, the fingerprint identification area may be divided into multiple fingerprint identification sub-areas for scanning, which is a segmentation process of the fingerprint identification area, and the specific implementation is implemented. It can be realized by the above-mentioned segmentation program of the fingerprint area, and the implementation method of the segmentation program is many, and the present application does not impose any limitation.
S3:读取扫描数据。S3: Read the scan data.
扫描数据由特别构造的三维正交矩阵得到。在智能手机出厂测试时,将该扫描数据存储到智能手机的存储器中,如非易失性存储器。The scan data is obtained from a specially constructed three-dimensional orthogonal matrix. When the smartphone is factory tested, the scan data is stored in a memory of the smartphone, such as a non-volatile memory.
图13为本申请实施例提供的一个三维四阶矩阵示意图。该三维四阶矩阵包括四个二维矩阵,依次为M1[I,J],M2[I,J],M3[I,J]和M4[I,J],其元素如图13所示。应理解,图13中所示的四个二维矩阵中的元素即构成上述步骤304中所述的扫描图案。FIG. 13 is a schematic diagram of a three-dimensional fourth-order matrix provided by an embodiment of the present application. The three-dimensional fourth-order matrix includes four two-dimensional matrices, which are sequentially M1[I, J], M2[I, J], M3[I, J], and M4[I, J], the elements of which are shown in FIG. It should be understood that the elements in the four two-dimensional matrix shown in FIG. 13 constitute the scanning pattern described in the above step 304.
将上述四个二维矩阵中位于相同位置上的矩阵元素取出构成列向量Vi,j,例如,将M1[I,J],M2[I,J],M3[I,J]和M4[I,J]中位于第一行第一列的元素(m000,m001,m002,m003)取出,排列得到列向量W1,1,如,W1,1={m000,m001,m002,m003},或者,V1,1={m003,m002,m001,m000}等。容易知道,二维矩阵中一共有16个位置,因此,可以得到16个列向量,并且每一个列向量中包括4个矩阵元素。应理解,上述16个列向量满足上文所述的正交条件。需要说明的是,m000,m001,m002和m003依次为上述M[1,1,1],M[1,1,2],M[1,1,3]和M[1,1,4]位置上对应的矩阵元素。其他矩阵位置上的矩阵元素依次类推,此处不再赘述。The matrix elements located at the same position in the above four two-dimensional matrices are taken out to form a column vector Vi,j, for example, M1[I, J], M2[I, J], M3[I, J], and M4[I , the elements in the first column of the first row (m000, m001, m002, m003) are taken out, and the column vector W1,1 is obtained, for example, W1, 1={m000, m001, m002, m003}, or, V1, 1 = {m003, m002, m001, m000}, and the like. It is easy to know that there are a total of 16 positions in the two-dimensional matrix, so that 16 column vectors can be obtained, and each matrix vector includes four matrix elements. It should be understood that the above 16 column vectors satisfy the orthogonal conditions described above. It should be noted that m000, m001, m002 and m003 are the above M[1,1,1], M[1,1,2], M[1,1,3] and M[1,1,4]. The corresponding matrix element at the position. The matrix elements at other matrix positions are analogous, and are not described here.
S4:将扫描数据生成灰度数据。S4: Generate gray scale data from the scan data.
S5:利用灰度数据控制指纹识别区域内的像素点发光,对该指纹识别区域进行扫描。S5: Control the pixel point illumination in the fingerprint recognition area by using the gray scale data, and scan the fingerprint identification area.
由于指纹所在区域对应的显示屏像素数量一般远大于二维矩阵的规模,例如2K显示屏上的指纹区域可能包含220*200个像素,而二维矩阵只有4*4个像素,因此需要多次使用同一个二维矩阵进行扫描才能完整覆盖这个区域。以上述三维四阶正交矩阵M[i,j,k]为例来说明扫描的具体过程。其具体扫描过程如下:Since the number of display screen pixels corresponding to the area where the fingerprint is located is generally much larger than the size of the two-dimensional matrix, for example, the fingerprint area on the 2K display may contain 220*200 pixels, and the two-dimensional matrix has only 4*4 pixels, so it needs to be multiple times. Scanning with the same two-dimensional matrix can completely cover this area. The above-mentioned three-dimensional fourth-order orthogonal matrix M[i, j, k] is taken as an example to illustrate the specific process of scanning. The specific scanning process is as follows:
1、AP1010将第一个二维正交矩阵的元素m000写入发光驱动模块的缓存区。1. The AP 1010 writes the element m000 of the first two-dimensional orthogonal matrix into the buffer area of the illumination driver module.
2、发光驱动模块1001将矩阵元素m000生成对应的灰度数据。2. The illumination driving module 1001 generates a corresponding gray scale data from the matrix element m000.
3、发光驱动模块1001将灰度数据输出到显示屏的控制逻辑模块10052。3. The illumination driver module 1001 outputs the gray scale data to the control logic module 10052 of the display screen.
4、控制逻辑模块10052同时点亮指纹区域左上角对应于m000的RGB三个子像素,因此像素发出白光,白光强度由灰度数据决定,按此实现显示屏像素的发光调制。4. The control logic module 10052 simultaneously illuminates three sub-pixels of RGB corresponding to m000 in the upper left corner of the fingerprint area, so the pixel emits white light, and the white light intensity is determined by the gray scale data, thereby realizing the illumination modulation of the display pixel.
5、重复上述1到4,直至完成m000,m010,m020,m030扫描数据的扫描。5. Repeat steps 1 through 4 above until the scan of m000, m010, m020, m030 scan data is completed.
6、重复上述5,也即再次用m000,m010,m020,m030数据进行重复扫描(可能需要重复多遍),直至完成指纹所在区域第一行的扫描(例如,针对本实施例中的场景中,由于AB线段长度是220个像素,220/4=55,需要重复54次才能覆盖AB线段)。6. Repeat the above 5, that is, repeat the scan with m000, m010, m020, m030 data again (may need to repeat multiple times) until the first line of the region where the fingerprint is located is scanned (for example, for the scene in this embodiment) Since the length of the AB line segment is 220 pixels, 220/4=55, it needs to be repeated 54 times to cover the AB line segment).
7、与上述6类似,用m100,m110,m120,m130完成指纹所在区域第二行的扫描,依此类推,完成全部行的扫描(对于AC线段,200/4=50,步骤7需要重复49次才能覆盖,因此整个指纹所在区域ABCD需要用55x50=2750个二维矩阵M1[i,j]才能覆盖)。7. Similar to the above 6, use m100, m110, m120, m130 to complete the scanning of the second line of the fingerprint area, and so on, to complete the scanning of all lines (for AC line segment, 200/4=50, step 7 needs to repeat 49) The time can be covered, so the area where the entire fingerprint is located ABCD needs to be covered by 55x50=2750 two-dimensional matrix M1[i,j].
8、重复上述1到7,完成其他三个矩阵M2[I,J],M3[I,J],M4[I,J]对同一个指纹所在区域ABCD的扫描。8. Repeat steps 1 through 7 above to complete the scanning of the other three matrices M2[I, J], M3[I, J], M4[I, J] for the area ABCD of the same fingerprint.
本领域技术人员可以理解,上述提到的“重复”并不是一模一样的,而是需要针对新的数据进行适应性调整,例如,步骤5中,当使用m010数据进行扫描时,上述1、2、3、4中的m000需要替换成m010;其他步骤也类似,这里不再赘述。Those skilled in the art can understand that the above mentioned "repetition" is not exactly the same, but needs to be adaptively adjusted for new data. For example, in step 5, when scanning with m010 data, the above 1, 2, The m000 in 3, 4 needs to be replaced with m010; the other steps are similar, and will not be described here.
如图14(a)所示为使用图13所示的二维矩阵M1[I,J]对指纹识别区域进行扫描的扫描示意图;如图14(b)所示为使用图13所示的二维矩阵M2[I,J]对指纹识别区域进行扫描的扫描示意图;如图14(c)所示为使用图13所示的二维矩阵M3[I,J]对指纹识别区域进行扫描的扫描示意图;如图14(d)所示为使用图13所示的二维矩阵M4[I,J]对指纹识别区域进行扫描的扫描示意图。FIG. 14(a) is a schematic diagram showing scanning of the fingerprint identification area using the two-dimensional matrix M1[I, J] shown in FIG. 13; FIG. 14(b) shows the use of the two shown in FIG. Scanning diagram of scanning the fingerprint identification area by the dimension matrix M2[I, J]; as shown in FIG. 14(c), scanning the fingerprint identification area by using the two-dimensional matrix M3[I, J] shown in FIG. Schematic diagram; as shown in FIG. 14(d), is a scanning diagram for scanning a fingerprint identification area using the two-dimensional matrix M4[I, J] shown in FIG.
S6:读取像素点对应的PD中的数据,该PD包含于指纹模组1008中。S6: Read data in the PD corresponding to the pixel, and the PD is included in the fingerprint module 1008.
S7:判断是否完成对所有指纹识别区域的扫描,若否,则跳转至S3继续进行扫描。S7: It is judged whether scanning of all fingerprint identification areas is completed, and if not, jumping to S3 to continue scanning.
S8:若是,则判断扫描次数是否等于K次,若否,则跳转至S3继续进行扫描。S8: If yes, determine whether the number of scans is equal to K times, and if not, jump to S3 to continue scanning.
S9:若等于K次,则根据扫描数据和PD中的数据解调出指纹信息。S9: If it is equal to K times, the fingerprint information is demodulated according to the scan data and the data in the PD.
AP1010在指纹扫描过程中读取PD中的数据以及解调方法如下:The AP1010 reads the data in the PD during the fingerprint scanning process and the demodulation method is as follows:
步骤8:AP1010在点亮某个像素点后,向指纹模组集成电路1009发送读取指令,用于读取PD中的数据。Step 8: After lighting a certain pixel, the AP 1010 sends a read command to the fingerprint module integrated circuit 1009 for reading data in the PD.
步骤9:指纹模组集成电路1009接收读取指令后,延时一段时间Tread,例如50us,该Tread时间用于等待PD输出稳定的光电转换后的数据。Step 9: After receiving the read command, the fingerprint module integrated circuit 1009 delays a period of time Tread, for example, 50 us, and the Tread time is used to wait for the PD to output stable photoelectrically converted data.
步骤10:Tread时间过后,指纹模组集成电路1009查找像素pixel和PD之间的对应表(pixel,PD),从上述像素点对应的PD上读出数据,将数据保存到缓存区,该数据为原始指纹数据。Step 10: After the Tread time elapses, the fingerprint module integrated circuit 1009 searches for a correspondence table (pixel, PD) between the pixel pixel and the PD, reads data from the PD corresponding to the pixel, and saves the data to the buffer area. Is the original fingerprint data.
步骤11:重复步骤8到10,完成二维矩阵M[I,j,0],M[i,j,1],M[i,j,2],M[i,j,3]各自对应的PD数据读取,全部保存到缓存区。Step 11: Repeat steps 8 to 10 to complete the two-dimensional matrix M[I, j, 0], M[i, j, 1], M[i, j, 2], M[i, j, 3] respectively The PD data is read and all saved to the buffer area.
步骤12:AP1010从缓存区读取原始指纹数据,构成向量Vi,j=(mij0,mij1,vij2, vij3),Vi,j的四个分量是用四个二维矩阵相同位置(i,j)上的数据(mij0,mij1,mij2,mij3)(转换为灰度数据后)对同一个显示屏像素进行四次发光调制后在对应PD上得到的四次响应,也就是四个原始指纹数据,其中包含了有用信号和干扰信号。Step 12: AP1010 reads the original fingerprint data from the buffer area to form a vector Vi, j=(mij0, mij1, vij2, vij3), and the four components of Vi, j are the same position (i, j) with four two-dimensional matrices. The above data (mij0, mij1, mij2, mij3) (after conversion to grayscale data) four times of response to the same display pixel and four times of response on the corresponding PD, that is, four original fingerprint data, It contains useful signals and interference signals.
步骤13:将原始指纹数据向量Vi,j与点亮对应像素所用的四维矩阵Z方向上的列向量Wi,j做相关运算(向量的内积运算),即Vi,j*Wi,j=Pi,j,Pi,j是对应像素在削弱了邻道干扰和环境光干扰之后得到的指纹反射信号,将Pi,j写入数据缓存区,后续供指纹识别模块调用。Step 13: Correlate the original fingerprint data vector Vi,j with the column vector Wi,j in the Z direction of the four-dimensional matrix used to illuminate the corresponding pixel (the inner product of the vector), ie Vi, j*Wi, j=Pi , j, Pi, j are fingerprint reflection signals obtained after the corresponding pixels weaken adjacent channel interference and ambient light interference, and write Pi, j into the data buffer area, which is then called by the fingerprint identification module.
步骤14:重复以上步骤8至步骤13,完成指纹所在区域全部对应像素的相关运算,得到的所有Pi,j的集合就是最终的指纹反射信号。Step 14: Repeat steps 8 to 13 above to complete the correlation operation of all corresponding pixels in the region where the fingerprint is located, and the obtained set of all Pi, j is the final fingerprint reflection signal.
需要说明的是,在读取了全部PD的数据并保存后,需要清除PD上的数据,否则PD上残留的数据会影响下一次的指纹成像。It should be noted that after all the PD data is read and saved, the data on the PD needs to be cleared, otherwise the data remaining on the PD will affect the next fingerprint imaging.
以上内容详细介绍了本申请中提供的指纹信息的获取方法,下面对实现上述指纹信息的获取方法的指纹势必装置进行详细说明。The above content details the method for obtaining the fingerprint information provided in the present application. The following is a detailed description of the fingerprinting device that implements the above method for acquiring the fingerprint information.
图15为本申请实施例提供的一个指纹识别装置实施例示意图。基于上述各实施例,如图15所示,本申请实施例提供的一种指纹识别装置,包括:FIG. 15 is a schematic diagram of an embodiment of a fingerprint identification apparatus according to an embodiment of the present application. Based on the foregoing embodiments, as shown in FIG. 15 , a fingerprint identification apparatus provided by an embodiment of the present application includes:
获取模块1501,用于若检测到终端屏幕上的启动操作,获取第一向量集合,所述第一向量集合中包括A个相互正交的数据向量,每个所述数据向量中包括多个数据元素,所述A为大于1的整数;The obtaining module 1501 is configured to: if the startup operation on the screen of the terminal is detected, acquire a first vector set, where the first vector set includes A mutually orthogonal data vectors, and each of the data vectors includes multiple data. An element, the A being an integer greater than one;
发光控制模块1502,用于依次使用每个所述数据向量中的数据元素控制指纹识别区域内的最小像素单元发光,直至完成对所述指纹识别区域内所有的最小像素单元的控制发光,以获取所述指纹识别区域对应的第二向量集合,所述第二向量集合中携带有指纹信息;The illumination control module 1502 is configured to sequentially control the minimum pixel unit illumination in the fingerprint recognition area by using the data elements in each of the data vectors until the control illumination of all the minimum pixel units in the fingerprint identification area is completed to obtain a second vector set corresponding to the fingerprint identification area, where the second vector set carries fingerprint information;
解调模块1503,用于利用所述第一向量集合解调所述第二向量集合,以得到所述指纹识别区域内所有的指纹信息。The demodulation module 1503 is configured to demodulate the second set of vectors by using the first set of vectors to obtain all fingerprint information in the fingerprint identification area.
需要说明的是,获取模块1501可以基于上述图1中所述的指纹扫描控制电路101实现,其具体功能可参见上述图2中步骤201、图3中步骤303中的相关描述,对此此处不再赘述。同样,发光控制模块1502可以基于上述图1中所述的光学感应器件103和指纹信息采集前端处理电路104实现,其具体功能可参见上述图2中步骤202和203、图3中步骤304和305中的相关描述,对此此处不再赘述。解调模块1503可以基于上述图1中所述的指纹信息后处理电路105实现,其具体功能可参见上述图2中步骤204、图3中步骤306中的相关描述,对此此处不再赘述。It should be noted that the obtaining module 1501 can be implemented based on the fingerprint scanning control circuit 101 described in FIG. 1 above. For the specific function, refer to the related description in step 201 in FIG. 2 and step 303 in FIG. No longer. Similarly, the illumination control module 1502 can be implemented based on the optical sensing device 103 and the fingerprint information collection front-end processing circuit 104 described above in FIG. 1 . For the specific functions, refer to steps 202 and 203 in FIG. 2 and steps 304 and 305 in FIG. 3 . The relevant description in the description will not be repeated here. The demodulation module 1503 can be implemented based on the fingerprint information post-processing circuit 105 described in FIG. 1 above. For the specific function, refer to the description in step 204 of FIG. 2 and step 306 in FIG. 3, and details are not described herein again. .
在一种示例中,第一向量集合是由三维矩阵M[I,J,K]构造得到的,I,J,K依次为三维矩阵M[I,J,K]在X,Y,Z方向上的维度,其中,三维矩阵M[I,J,K]中在X和Y平面上坐标位置不相同的列向量之间相互正交,A等于I和J之积,一个数据向量为三维矩阵M[I,J,K]中任一个在X和Y平面上坐标位置相同的列向量,一个数据向量中包括K个数据元素。关于采用三维矩阵构造第一向量集合的具体方法以及其他相关描述,可参阅上述步骤201中三维矩阵M[I,J,K]的相关描述,以及参阅上述步骤303中关于扫描数据的相关描述,此处 不再赘述。In one example, the first set of vectors is constructed from a three-dimensional matrix M[I, J, K], and I, J, and K are sequentially three-dimensional matrices M[I, J, K] in the X, Y, and Z directions. The upper dimension, in which the column vectors of the three-dimensional matrix M[I, J, K] having different coordinate positions on the X and Y planes are orthogonal to each other, A is equal to the product of I and J, and one data vector is a three-dimensional matrix. Any of M[I, J, K] has the same column position in the X and Y planes, and K data elements are included in one data vector. For a specific method for constructing the first vector set by using the three-dimensional matrix and other related descriptions, refer to the related description of the three-dimensional matrix M[I, J, K] in the above step 201, and refer to the related description about the scan data in the above step 303, I will not repeat them here.
在另一种示例中,一个数据向量可以对应一个最小像素单元,或者也可以对应多个最小像素单元,并且,在上述两种对应关系中,一个最小像素单元既可以只有一个像素点,也可以是由多个像素点构成。关于数据向量与最小元素之间对应关系的描述可参阅上述步骤203中的对控制发光过程的相关描述,以及上述步骤301中像素点与PD之间对应关系的类似描述,此处不再赘述。In another example, one data vector may correspond to one minimum pixel unit, or may also correspond to multiple minimum pixel units, and in the above two correspondences, one minimum pixel unit may have only one pixel point, or It is composed of multiple pixels. For a description of the correspondence between the data vector and the minimum element, refer to the related description of the control illuminating process in the above step 203, and a similar description of the correspondence between the pixel point and the PD in the above step 301, and details are not described herein again.
在另一种示例中,第二向量集合中包括A个指纹向量,指纹向量中包括在最小像素单元发光过程中采集到的指纹信息;关于对第二向量集合的相关描述可参阅上述步骤204中的解调部分的描述,此处不做限定。In another example, the second vector set includes A fingerprint vectors, and the fingerprint vector includes fingerprint information collected during the minimum pixel unit illumination process; for related description of the second vector set, refer to step 204 above. The description of the demodulation section is not limited herein.
在另一种示例中,指纹识别装置还包括转化模块1504,该转化模块1504用于每个数据向量中的数据元素转化为标准化显示数据,标准化显示数据用于控制最小像素单元的发光。具体地,当标准化显示数据包括灰度数据时,转化模块1504具体用于:按照如下公式一或者公式二将每个数据向量中的数据元素转化为灰度数据;公式一为:y=(2n-1)*((m[i,j,k])-min)/(max-min);公式二为:y=(2n-1)*sin{0.5*π*((m[i,j,k])-min)/(max-min)};在上述公式一和公式二中,y为灰度数据,n为灰度数据的bit位的位数,m[i,j,k]为第一数据集合中的任一个数据元素,i∈[1,I];j∈[1,J],k∈[1,K],max为第一数据集合中的最大元素值,min为第一数据集合中的最小元素值。关于上述灰度数据转化的其他相关描述可参阅上述图6和图7中的相关描述,此处不再赘述。In another example, the fingerprint recognition apparatus further includes a conversion module 1504 for converting data elements in each data vector into standardized display data for normalizing display data for controlling illumination of the smallest pixel unit. Specifically, when the normalized display data includes grayscale data, the conversion module 1504 is specifically configured to convert the data elements in each data vector into grayscale data according to the following formula 1 or formula 2; the formula one is: y=(2n -1)*((m[i,j,k])-min)/(max-min); Equation 2 is: y=(2n-1)*sin{0.5*π*((m[i,j) , k])-min)/(max-min)}; in the above formula 1 and formula 2, y is gray scale data, n is the number of bits of the gray bit data, m[i, j, k] Is any one of the data elements in the first data set, i ∈ [1, I]; j ∈ [1, J], k ∈ [1, K], max is the largest element value in the first data set, min is The smallest element value in the first data set. For other related descriptions of the above gray scale data conversion, refer to the related descriptions in FIG. 6 and FIG. 7 above, and details are not described herein again.
在另一种示例中,指纹识别区域包括N个指纹识别子区域,N为大于1的整数,启动操作为触摸操作;指纹识别装置还包括:确定模块1505,用于若检测到对终端显示屏的触摸操作,根据触摸操作对应的操作区域确定指纹识别区域,并将指纹识别区域划分为N个指纹识别子区域,操作区域在指纹识别区域的区域范围内。关于指纹识别区域分割为多个指纹识别子区域的其他相关描述,可参阅上述步骤304和图8的相关描述,此处不再赘述。In another example, the fingerprint identification area includes N fingerprint identification sub-areas, N is an integer greater than 1, and the startup operation is a touch operation. The fingerprint identification apparatus further includes: a determination module 1505, configured to detect the display screen of the terminal The touch operation determines the fingerprint identification area according to the operation area corresponding to the touch operation, and divides the fingerprint identification area into N fingerprint recognition sub-areas, and the operation area is within the area of the fingerprint identification area. For other related descriptions of the fingerprint identification area being divided into multiple fingerprint identification sub-areas, refer to the related descriptions of step 304 and FIG. 8 above, and details are not described herein again.
本实施例中,指纹识别装置的其他描述包括但不限于上述图2、图3、图10和图11中的描述,对此此处不再赘述。In this embodiment, other descriptions of the fingerprint identification device include, but are not limited to, the descriptions in FIG. 2, FIG. 3, FIG. 10, and FIG. 11, which are not described herein again.
图16为本申请实施例提供的另一个指纹识别装置实施例示意图。基于上述实施例,如图16所示,本申请实施例提供的另一种指纹识别装置,该装置可以是各种移动终端(例如手机、平板),也可以是各种其他具有指纹识别功能的电子设备,该装置包括:PD阵列1601、读出集成电路1602、处理器1603。FIG. 16 is a schematic diagram of another embodiment of a fingerprint identification apparatus according to an embodiment of the present application. Based on the foregoing embodiment, as shown in FIG. 16 , another fingerprint identification device provided by the embodiment of the present application may be a variety of mobile terminals (such as a mobile phone or a tablet), or may be various other fingerprint recognition functions. The electronic device includes: a PD array 1601, a readout integrated circuit 1602, and a processor 1603.
其中,处理器1603可以是通用处理器(如CPU),该通用处理器可以与其他电路一起封装在一个芯片组成一个片上系统(SoC),也称为AP(应用处理器),或者AP芯片,例如,华为Kirin系列的处理器,或者高通骁龙系列的处理器,也可以其他集成电路芯片,对此本申请不做限制。The processor 1603 may be a general-purpose processor (such as a CPU), and the general-purpose processor may be packaged together with other circuits on a chip to form a system on chip (SoC), also called an AP (application processor), or an AP chip. For example, the processor of the Huawei Kirin series, or the processor of the Qualcomm Snapdragon series, may also be other integrated circuit chips, and the application does not limit this.
在另一种示例中,读出集成电路1602具体可以集成:上述图1对应实施例中的指纹扫描控制电路101、指纹信息采集前端处理电路104以及指纹信息后处理电路105中的一个或多个电路。其中,读出集成电路1602可以基于ASIC、FPGA等方式来实现的集成电路。 可以将上述三种电路封装成一个芯片,或者,也不限定将其中的一个或多个电路单独封装成一个芯片。In another example, the readout integrated circuit 1602 may be specifically integrated with one or more of the fingerprint scanning control circuit 101, the fingerprint information collecting front end processing circuit 104, and the fingerprint information post processing circuit 105 in the corresponding embodiment of FIG. 1 described above. Circuit. The readout integrated circuit 1602 can be implemented based on an ASIC, an FPGA, or the like. The above three circuits may be packaged into one chip, or, without limiting, one or more of the circuits may be separately packaged into one chip.
在另一中示例中,上述通用处理器(如CPU)可以通过执行相应的操作指令,来实现上述图1对应实施例中的指纹扫描控制电路101、指纹信息采集前端处理电路104以及指纹信息后处理电路105中的一个或多个电路的功能。In another example, the above-mentioned general-purpose processor (such as a CPU) can implement the fingerprint scanning control circuit 101, the fingerprint information collecting front-end processing circuit 104, and the fingerprint information in the corresponding embodiment of FIG. 1 by executing corresponding operation instructions. The function of one or more of the circuits 105 is processed.
在一种示例中,该指纹识别装置还可以包括存储器件,该存储器件可以是处理器1603的内置存储器,也可以是与处理器1603相连的外接存储器(如各种ROM、flash、磁盘、光盘等)。该存储器件用于存储三维矩阵构造得到的扫描数据,对指纹区域扫描之后得到的指纹数据,以及操作指令,以使得处理器1603可以调用该操作指令执行本申请实施例中提供的指纹信息的获取方法。In an example, the fingerprint identification device may further include a storage device, which may be a built-in memory of the processor 1603, or an external storage connected to the processor 1603 (such as various ROMs, flashes, disks, and optical disks). Wait). The storage device is configured to store the scan data obtained by constructing the three-dimensional matrix, the fingerprint data obtained after scanning the fingerprint area, and the operation instruction, so that the processor 1603 can invoke the operation instruction to perform the acquisition of the fingerprint information provided in the embodiment of the present application. method.
与上述图1所述的光学式指纹识别系统相比,本实施例中的指纹识别装置可以将指纹扫描控制电路101、指纹信息后处理电路105和指纹识别应用电路106中的至少一种功能电路集成于处理器1603中,以使得处理器1603执行上述指纹信息的获取方法。Compared with the optical fingerprint identification system described in FIG. 1 above, the fingerprint identification device in this embodiment may at least one of the fingerprint scanning control circuit 101, the fingerprint information post-processing circuit 105, and the fingerprint identification application circuit 106. It is integrated in the processor 1603 to cause the processor 1603 to execute the above-described method of acquiring fingerprint information.
在另一种示例中,指纹装置还可以包括上述图10中智能手机上指纹识别系统的硬件系统结构中的OLED显示屏,其中,应用处理器AP1010作为处理器,执行上述指纹信息的获取方法。In another example, the fingerprint device may further include the OLED display screen in the hardware system structure of the fingerprint recognition system on the smart phone in FIG. 10, wherein the application processor AP1010 functions as a processor to execute the method for acquiring the fingerprint information.
本实施例中,指纹识别装置中的其他描述可参阅上述图1、图10、图2以及图3中的相关部分的描述,此处不再赘述。For other descriptions in the fingerprint identification device in this embodiment, refer to the descriptions of related parts in FIG. 1, FIG. 10, FIG. 2 and FIG. 3, and details are not described herein again.
本申请还提供了一种计算机存储介质,该计算机存储介质适用于光学式指纹识别系通中,该计算机存储介质中包括操作指令,当该操作指令在计算机上运行时,可以使得该计算机执行如上述图2中的步骤201至步骤204、以及图3中的步骤301至步骤306中的相关操作。该计算机存储介质具体可以是上述处理器1603中的内置存储器,或者与处理器1603连接的外接存储器。The present application also provides a computer storage medium suitable for use in an optical fingerprinting system, the computer storage medium including an operation instruction, when the operation instruction is run on a computer, the computer can be executed as The related operations in steps 201 to 204 in FIG. 2 and steps 301 to 306 in FIG. 3 described above. The computer storage medium may specifically be a built-in memory in the processor 1603 described above or an external memory connected to the processor 1603.
本申请还提供了一种计算机程序产品,当该计算机程序产品在计算机上运行时,以使得该计算机执行如上述图2或图3中描述的所有操作。The application also provides a computer program product that, when run on a computer, causes the computer to perform all of the operations described in Figure 2 or Figure 3 above.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。A person skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个模块或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be another division manner, for example, multiple modules or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
在本申请各个实施例中的各功能模块可以集成在一个处理单元中,也可以是各个模块单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。The functional modules in the various embodiments of the present application may be integrated into one processing unit, or each module may exist physically separately, or two or more modules may be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
以上所述,以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述 实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案范围。The above embodiments are only used to explain the technical solutions of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still The technical solutions described in the embodiments are modified, or some of the technical features are equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present application.

Claims (18)

  1. 一种指纹信息的获取方法,其特征在于,包括:A method for acquiring fingerprint information, comprising:
    若检测到终端屏幕上的启动操作,获取第一向量集合,所述第一向量集合中包括A个相互正交或者相互准正交的数据向量,每个所述数据向量中包括多个数据元素,所述A为大于1的整数;If the startup operation on the screen of the terminal is detected, acquiring a first vector set, where the first vector set includes A mutually orthogonal or mutually quasi-orthogonal data vectors, each of the data vectors including multiple data elements , the A is an integer greater than one;
    依次使用每个所述数据向量中的数据元素控制指纹识别区域内的最小像素单元发光,直至完成对所述指纹识别区域内所有的最小像素单元的控制发光,以获取所述指纹识别区域对应的第二向量集合,所述第二向量集合中携带有指纹信息;Controlling, by using the data elements in each of the data vectors, the minimum pixel unit illumination in the fingerprint recognition area, until the control illumination of all the smallest pixel units in the fingerprint identification area is completed, to obtain the corresponding fingerprint identification area. a second vector set, where the second vector set carries fingerprint information;
    利用所述第一向量集合解调所述第二向量集合,以得到所述指纹识别区域内所有的指纹信息。Decoding the second set of vectors with the first set of vectors to obtain all fingerprint information in the fingerprint identification area.
  2. 根据权利要求1所述的方法,其特征在于,The method of claim 1 wherein
    所述依次使用每个所述数据向量中的数据元素控制所述指纹识别区域内的最小像素单元发光,包括:The controlling, by using the data elements in each of the data vectors, the minimum pixel unit illumination in the fingerprint identification area, including:
    (1)先使用每个所述数据向量中一个序号相同的数据元素按预定顺序控制最小像素单元发光;(1) first controlling the minimum pixel unit illumination in a predetermined order using a data element having the same serial number in each of the data vectors;
    (2)再使用每个所述数据向量中另一个序号相同的数据元素按所述预定顺序控制最小像素单元发光;(2) using another data element of the same number in each of the data vectors to control the minimum pixel unit illumination in the predetermined order;
    (3)重复执行(1)和(2)过程,直至使用每个所述数据向量中的最后一个序号相同的数据元素控制所述指纹识别区域内的最小像素单元发光;(3) repeatedly performing the processes (1) and (2) until the minimum pixel unit illumination within the fingerprint recognition area is controlled using the same data element of the last one of each of the data vectors;
    (4)若还未完成对所述指纹识别区域内所有的最小像素单元的控制发光,重复执行(1)、(2)和(3)过程,直至完成。(4) If the control illumination of all the smallest pixel units in the fingerprint recognition area has not been completed, the processes (1), (2), and (3) are repeatedly performed until completion.
  3. 根据权利要求1或2所述的方法,其特征在于,Method according to claim 1 or 2, characterized in that
    所述第一向量集合是由三维矩阵M[I,J,K]构造得到的,I,J,K依次为所述三维矩阵M[I,J,K]在X,Y,Z方向上的维度,其中,所述三维矩阵M[I,J,K]中在X和Y平面上坐标位置不相同的列向量之间相互正交或者相互准正交,所述A等于I和J之积,一个所述数据向量为所述三维矩阵M[I,J,K]中任一个在X和Y平面上坐标位置相同的列向量,一个所述数据向量中包括K个数据元素。The first vector set is constructed by a three-dimensional matrix M[I, J, K], and I, J, K are sequentially the three-dimensional matrix M[I, J, K] in the X, Y, Z directions. a dimension in which column vectors of different coordinate positions on the X and Y planes in the three-dimensional matrix M[I, J, K] are orthogonal or mutually quasi-orthogonal, and the A is equal to the product of I and J And one of the data vectors is a column vector having the same coordinate position on the X and Y planes of any one of the three-dimensional matrices M[I, J, K], and one of the data vectors includes K data elements.
  4. 根据权利要求2所述的方法,其特征在于,The method of claim 2 wherein:
    一个所述数据向量对应一个或者多个最小像素单元,并且,一个所述最小像素单元中包括一个或者多个像素点。One of the data vectors corresponds to one or more minimum pixel units, and one or more of the minimum pixel units includes one or more pixel points.
  5. 根据权利要求1所述的方法,其特征在于,The method of claim 1 wherein
    所述第二向量集合中包括所述A个指纹向量,所述指纹向量中包括在最小像素单元发光过程中采集到的指纹信息;The second vector set includes the A fingerprint vectors, and the fingerprint vector includes fingerprint information collected during a minimum pixel unit illumination process;
    所述利用所述第一向量集合解调所述第二向量集合,以得到所述指纹识别区域内所有的指纹信息,包括:Demodulating the second set of vectors by using the first set of vectors to obtain all the fingerprint information in the fingerprint identification area, including:
    使用同一个最小像素单元对应的数据向量和指纹向量进行向量内积运算,直至完成所述指纹识别区域内所有的最小像素单元对应的向量内积运算,以得到所述指纹识别区域内 所有的指纹信息。Performing a vector inner product operation using the data vector and the fingerprint vector corresponding to the same minimum pixel unit until the vector inner product operation corresponding to all the minimum pixel units in the fingerprint identification area is completed, to obtain all the fingerprints in the fingerprint identification area. information.
  6. 根据权利要求1或5所述的方法,其特征在于,Method according to claim 1 or 5, characterized in that
    在所述依次使用每个所述数据向量中的数据元素控制所述指纹识别区域内的最小像素单元发光之前,所述方法还包括:Before the controlling, by the data element in each of the data vectors, the minimum pixel unit illumination in the fingerprint identification area, the method further includes:
    将每个所述数据向量中的数据元素转化为标准化显示数据,所述标准化显示数据用于控制最小像素单元的发光。The data elements in each of the data vectors are converted to standardized display data for controlling the illumination of the smallest pixel unit.
  7. 根据权利要求6所述的方法,其特征在于,The method of claim 6 wherein:
    所述标准化显示数据包括灰度数据,所述将每个所述数据向量中的数据元素转化为标准化显示数据,包括:The standardized display data includes grayscale data, and converting the data elements in each of the data vectors into standardized display data includes:
    按照如下公式一或者公式二将每个所述数据向量中的数据元素转化为所述灰度数据;Converting data elements in each of the data vectors into the gray scale data according to the following formula 1 or formula 2;
    所述公式一为:y=(2 n-1)*((m[i,j,k])-min)/(max-min); The formula one is: y=(2 n -1)*((m[i,j,k])-min)/(max-min);
    所述公式二为:y=(2 n-1)*sin{0.5*π*((m[i,j,k])-min)/(max-min)}; The formula 2 is: y=(2 n -1)*sin{0.5*π*((m[i,j,k])-min)/(max-min)};
    在上述公式一和公式二中,所述y为所述灰度数据,所述n为所述灰度数据的bit位的位数,所述m[i,j,k]为所述第一数据集合中的任一个数据元素,i∈[1,I];j∈[1,J],k∈[1,K],所述max为所述第一数据集合中的最大元素值,所述min为所述第一数据集合中的最小元素值。In the above formula 1 and formula 2, the y is the gradation data, the n is the number of bits of the bit position of the gradation data, and the m[i, j, k] is the first Any one of the data elements in the data set, i ∈ [1, I]; j ∈ [1, J], k ∈ [1, K], the max is the largest element value in the first data set, The min is the smallest element value in the first data set.
  8. 根据权利要求1所述的方法,其特征在于,The method of claim 1 wherein
    所述指纹识别区域包括N个指纹识别子区域,所述N为大于1的整数,所述启动操作为触摸操作;所述方法还包括:The fingerprint identification area includes N fingerprint identification sub-areas, the N is an integer greater than 1, and the startup operation is a touch operation; the method further includes:
    若检测到对所述终端显示屏的所述触摸操作,根据所述触摸操作对应的操作区域确定所述指纹识别区域,并将所述指纹识别区域划分为N个所述指纹识别子区域,所述操作区域在所述指纹识别区域的区域范围内。If the touch operation on the display screen of the terminal is detected, determining the fingerprint identification area according to an operation area corresponding to the touch operation, and dividing the fingerprint identification area into N pieces of the fingerprint identification sub-area, The operating area is within the area of the fingerprint identification area.
  9. 一种指纹识别装置,其特征在于,包括:A fingerprint identification device, comprising:
    获取模块,用于若检测到终端屏幕上的启动操作,获取第一向量集合,所述第一向量集合中包括A个相互正交或者相互准正交的数据向量,每个所述数据向量中包括多个数据元素,所述A为大于1的整数;An acquiring module, configured to acquire a first vector set, if the startup operation on the screen of the terminal is detected, where the first vector set includes A mutually orthogonal or mutually quasi-orthogonal data vectors, each of the data vectors Include a plurality of data elements, the A being an integer greater than one;
    发光控制模块,用于依次使用每个所述数据向量中的数据元素控制指纹识别区域内的最小像素单元发光,直至完成对所述指纹识别区域内所有的最小像素单元的控制发光,以获取所述指纹识别区域对应的第二向量集合,所述第二向量集合中携带有指纹信息;a lighting control module, configured to sequentially control, by using data elements in each of the data vectors, minimum pixel unit illumination in the fingerprint identification area until completion of control illumination of all minimum pixel units in the fingerprint identification area to obtain a second vector set corresponding to the fingerprint identification area, where the second vector set carries fingerprint information;
    解调模块,用于利用所述第一向量集合解调所述第二向量集合,以得到所述指纹识别区域内所有的指纹信息。And a demodulation module, configured to demodulate the second set of vectors by using the first set of vectors to obtain all fingerprint information in the fingerprint identification area.
  10. 根据权利要求9所述的装置,其特征在于,所述发光控制模块具体用于执行如下操作:The device according to claim 9, wherein the illumination control module is specifically configured to perform the following operations:
    (1)先使用每个所述数据向量中一个序号相同的数据元素按预定顺序控制最小像素单元发光;(1) first controlling the minimum pixel unit illumination in a predetermined order using a data element having the same serial number in each of the data vectors;
    (2)再使用每个所述数据向量中另一个序号相同的数据元素按所述预定顺序控制最小像素单元发光;(2) using another data element of the same number in each of the data vectors to control the minimum pixel unit illumination in the predetermined order;
    (3)重复执行(1)和(2)过程,直至使用每个所述数据向量中的最后一个序号相同的数据元素控制所述指纹识别区域内的最小像素单元发光;(3) repeatedly performing the processes (1) and (2) until the minimum pixel unit illumination within the fingerprint recognition area is controlled using the same data element of the last one of each of the data vectors;
    (4)若还未完成对所述指纹识别区域内所有的最小像素单元的控制发光,重复执行(1)、(2)和(3)过程,直至完成。(4) If the control illumination of all the smallest pixel units in the fingerprint recognition area has not been completed, the processes (1), (2), and (3) are repeatedly performed until completion.
  11. 根据权利要求9或10所述的装置,其特征在于,Device according to claim 9 or 10, characterized in that
    所述第一向量集合是由三维矩阵M[I,J,K]构造得到的,I,J,K依次为所述三维矩阵M[I,J,K]在X,Y,Z方向上的维度,其中,所述三维矩阵M[I,J,K]中在X和Y平面上坐标位置不相同的列向量之间相互正交或者相互准正交,所述A等于I和J之积,一个所述数据向量为所述三维矩阵M[I,J,K]中任一个在X和Y平面上坐标位置相同的列向量,一个所述数据向量中包括K个数据元素。The first vector set is constructed by a three-dimensional matrix M[I, J, K], and I, J, K are sequentially the three-dimensional matrix M[I, J, K] in the X, Y, Z directions. a dimension in which column vectors of different coordinate positions on the X and Y planes in the three-dimensional matrix M[I, J, K] are orthogonal or mutually quasi-orthogonal, and the A is equal to the product of I and J And one of the data vectors is a column vector having the same coordinate position on the X and Y planes of any one of the three-dimensional matrices M[I, J, K], and one of the data vectors includes K data elements.
  12. 根据权利要求10所述的装置,其特征在于,The device of claim 10 wherein:
    一个所述数据向量对应一个或者多个最小像素单元,并且,一个所述最小像素单元中包括一个或者多个像素点。One of the data vectors corresponds to one or more minimum pixel units, and one or more of the minimum pixel units includes one or more pixel points.
  13. 根据权利要求9所述的装置,其特征在于,The device of claim 9 wherein:
    所述第二向量集合中包括所述A个指纹向量,所述指纹向量中包括在最小像素单元发光过程中采集到的指纹信息;The second vector set includes the A fingerprint vectors, and the fingerprint vector includes fingerprint information collected during a minimum pixel unit illumination process;
    所述解调模块具体用于:使用同一个最小像素单元对应的数据向量和指纹向量进行向量内积运算,直至完成所述指纹识别区域内所有的最小像素单元对应的向量内积运算,以得到所述指纹识别区域内所有的指纹信息。The demodulation module is specifically configured to perform a vector inner product operation by using a data vector and a fingerprint vector corresponding to the same minimum pixel unit, until the vector inner product operation corresponding to all the minimum pixel units in the fingerprint identification area is completed, to obtain The fingerprint identifies all fingerprint information in the area.
  14. 根据权利要求9或13所述的装置,其特征在于,所述指纹识别装置还包括:The device according to claim 9 or 13, wherein the fingerprint identification device further comprises:
    转化模块,用于将每个所述数据向量中的数据元素转化为标准化显示数据,所述标准化显示数据用于控制最小像素单元的发光。a conversion module for converting data elements in each of the data vectors into standardized display data for controlling illumination of a minimum pixel unit.
  15. 根据权利要求14所述的装置,其特征在于,The device of claim 14 wherein:
    所述标准化显示数据包括灰度数据,所述转化模块具体用于:The standardized display data includes gray scale data, and the conversion module is specifically configured to:
    按照如下公式一或者公式二将每个所述数据向量中的数据元素转化为所述灰度数据;Converting data elements in each of the data vectors into the gray scale data according to the following formula 1 or formula 2;
    所述公式一为:y=(2 n-1)*((m[i,j,k])-min)/(max-min); The formula one is: y=(2 n -1)*((m[i,j,k])-min)/(max-min);
    所述公式二为:y=(2 n-1)*sin{0.5*π*((m[i,j,k])-min)/(max-min)}; The formula 2 is: y=(2 n -1)*sin{0.5*π*((m[i,j,k])-min)/(max-min)};
    在上述公式一和公式二中,所述y为所述灰度数据,所述n为所述灰度数据的bit位的位数,所述m[i,j,k]为所述第一数据集合中的任一个数据元素,i∈[1,I];j∈[1,J],k∈[1,K],所述max为所述第一数据集合中的最大元素值,所述min为所述第一数据集合中的最小元素值。In the above formula 1 and formula 2, the y is the gradation data, the n is the number of bits of the bit position of the gradation data, and the m[i, j, k] is the first Any one of the data elements in the data set, i ∈ [1, I]; j ∈ [1, J], k ∈ [1, K], the max is the largest element value in the first data set, The min is the smallest element value in the first data set.
  16. 根据权利要求9所述的装置,其特征在于,The device of claim 9 wherein:
    所述指纹识别区域包括N个指纹识别子区域,所述N为大于1的整数,所述启动操作为触摸操作;所述指纹识别装置还包括:The fingerprint identification area includes N fingerprint identification sub-areas, the N is an integer greater than 1, and the startup operation is a touch operation; the fingerprint identification apparatus further includes:
    确定模块,用于若检测到对所述终端显示屏的所述触摸操作,根据所述触摸操作对应的操作区域确定所述指纹识别区域,并将所述指纹识别区域划分为N个所述指纹识别子区域,所述操作区域在所述指纹识别区域的区域范围内。a determining module, configured to determine the fingerprint identification area according to an operation area corresponding to the touch operation, and divide the fingerprint identification area into N fingerprints, if the touch operation on the display screen of the terminal is detected A sub-area is identified, the operation area being within an area of the fingerprint identification area.
  17. 一种指纹识别装置,其特征在于,包括:A fingerprint identification device, comprising:
    存储器和处理器;Memory and processor;
    所述存储器,用于存储操作指令;The memory is configured to store an operation instruction;
    所述处理器,用于调用所述操作指令,执行上述权利要求1至8中任一项所述的指纹信息的获取方法。The processor is configured to invoke the operation instruction to perform the method for acquiring fingerprint information according to any one of claims 1 to 8.
  18. 一种计算机存储介质,其特征在于,包括:操作指令,当所述操作指令在计算机上运行时,以使得所述计算机执行如上述权利要求1至8中任一项所述的指纹信息的获取方法。A computer storage medium, comprising: an operation instruction, when the operation instruction is run on a computer, to cause the computer to perform acquisition of fingerprint information according to any one of claims 1 to 8 method.
PCT/CN2018/110776 2017-10-20 2018-10-18 Fingerprint information acquisition method and fingerprint recognition device WO2019076332A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP18868873.3A EP3686769B1 (en) 2017-10-20 2018-10-18 Fingerprint information acquisition method and fingerprint recognition device
US16/852,573 US10997394B2 (en) 2017-10-20 2020-04-20 Fingerprint information obtaining method and fingerprint recognition apparatus

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201710996402 2017-10-20
CN201710996402.5 2017-10-20
CN201810654363.5A CN109697402B (en) 2017-10-20 2018-06-22 Fingerprint information acquisition method and fingerprint identification device
CN201810654363.5 2018-06-22

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/852,573 Continuation US10997394B2 (en) 2017-10-20 2020-04-20 Fingerprint information obtaining method and fingerprint recognition apparatus

Publications (1)

Publication Number Publication Date
WO2019076332A1 true WO2019076332A1 (en) 2019-04-25

Family

ID=66173543

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/110776 WO2019076332A1 (en) 2017-10-20 2018-10-18 Fingerprint information acquisition method and fingerprint recognition device

Country Status (1)

Country Link
WO (1) WO2019076332A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111428603A (en) * 2020-03-18 2020-07-17 杭州指安科技股份有限公司 Electronic device and method for guaranteeing registered fingerprint quality in fingerprint identification system
CN112395925A (en) * 2019-08-19 2021-02-23 深圳富泰宏精密工业有限公司 Under-screen fingerprint registration method and electronic device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104933421A (en) * 2015-07-06 2015-09-23 上海箩箕技术有限公司 An optical type fingerprint imaging system
CN105678255A (en) * 2016-01-04 2016-06-15 京东方科技集团股份有限公司 Optical fingerprint identification display screen and display device
KR20160103598A (en) * 2015-02-24 2016-09-02 주식회사 유니온커뮤니티 Fingerprint Input Apparatus Using Mobile Terminal Equipped with Camera, and External-Optical Device thereof
CN106469303A (en) * 2016-09-18 2017-03-01 京东方科技集团股份有限公司 Fingerprint photoelectric current detector unit, Fingerprint Identification Unit, driving method and display device
US20170193269A1 (en) * 2015-02-11 2017-07-06 TRON Intelligence, Inc. Aperture sensing structure for lighting fingerprint
CN106991366A (en) * 2016-01-21 2017-07-28 上海箩箕技术有限公司 Optical fingerprint sensor
CN206431645U (en) * 2016-12-28 2017-08-22 南昌欧菲生物识别技术有限公司 Touching display screen and electronic installation

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170193269A1 (en) * 2015-02-11 2017-07-06 TRON Intelligence, Inc. Aperture sensing structure for lighting fingerprint
KR20160103598A (en) * 2015-02-24 2016-09-02 주식회사 유니온커뮤니티 Fingerprint Input Apparatus Using Mobile Terminal Equipped with Camera, and External-Optical Device thereof
CN104933421A (en) * 2015-07-06 2015-09-23 上海箩箕技术有限公司 An optical type fingerprint imaging system
CN105678255A (en) * 2016-01-04 2016-06-15 京东方科技集团股份有限公司 Optical fingerprint identification display screen and display device
CN106991366A (en) * 2016-01-21 2017-07-28 上海箩箕技术有限公司 Optical fingerprint sensor
CN106469303A (en) * 2016-09-18 2017-03-01 京东方科技集团股份有限公司 Fingerprint photoelectric current detector unit, Fingerprint Identification Unit, driving method and display device
CN206431645U (en) * 2016-12-28 2017-08-22 南昌欧菲生物识别技术有限公司 Touching display screen and electronic installation

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112395925A (en) * 2019-08-19 2021-02-23 深圳富泰宏精密工业有限公司 Under-screen fingerprint registration method and electronic device
CN112395925B (en) * 2019-08-19 2024-03-26 深圳富泰宏精密工业有限公司 Under-screen fingerprint registration method and electronic device
CN111428603A (en) * 2020-03-18 2020-07-17 杭州指安科技股份有限公司 Electronic device and method for guaranteeing registered fingerprint quality in fingerprint identification system
CN111428603B (en) * 2020-03-18 2023-05-09 杭州指安科技股份有限公司 Electronic device and method for guaranteeing registered fingerprint quality in fingerprint identification system

Similar Documents

Publication Publication Date Title
US10997394B2 (en) Fingerprint information obtaining method and fingerprint recognition apparatus
EP3690701B1 (en) Fingerprint recognition method, fingerprint recognition device and terminal equipment
US11516374B2 (en) Under-display image sensor
CN107220578A (en) A kind of two-dimensional code scanning recognition methods, device, mobile terminal and storage medium
US8275174B2 (en) Vein pattern management system, vein pattern registration apparatus, vein pattern authentication apparatus, vein pattern registration method, vein pattern authentication method, program, and vein data configuration
JP4790653B2 (en) Image processing apparatus, control program, computer-readable recording medium, electronic apparatus, and control method for image processing apparatus
US11176347B2 (en) Fingerprint-on-display recognition
KR20180102112A (en) Multi-level command sensing device
US20050237313A1 (en) Display device having optical input function
US20100226545A1 (en) Vein pattern management system, vein pattern registration apparatus, vein pattern authentication apparatus, vein pattern registration method, vein pattern authentication method, program, and vein data configuration
US20200160025A1 (en) Electronic Device
JP4727615B2 (en) Image processing apparatus, control program, computer-readable recording medium, electronic apparatus, and control method for image processing apparatus
US20220086378A1 (en) Electronic device and imaging method thereof
JP2008250950A5 (en)
JP2008250949A5 (en)
CN110941981B (en) Mobile fingerprint identification method and apparatus using display
JP2008250951A5 (en)
WO2019076332A1 (en) Fingerprint information acquisition method and fingerprint recognition device
CN110826479A (en) Electronic device and under-screen fingerprint sensing method thereof
US20190278970A1 (en) Detection device, information processing device, and information processing method
US8270681B2 (en) Vein pattern management system, vein pattern registration apparatus, vein pattern authentication apparatus, vein pattern registration method, vein pattern authentication method, program, and vein data configuration
CN109923555B (en) Fingerprint detection method, fingerprint detection device and electronic equipment
US9704030B2 (en) Flesh color detection condition determining apparatus, and flesh color detection condition determining method
US8320639B2 (en) Vein pattern management system, vein pattern registration apparatus, vein pattern authentication apparatus, vein pattern registration method, vein pattern authentication method, program, and vein data configuration
TWI725329B (en) Two-dimensional code and two-dimensional code reading device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18868873

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018868873

Country of ref document: EP

Effective date: 20200423