WO2018213947A1 - 图像识别系统及电子装置 - Google Patents
图像识别系统及电子装置 Download PDFInfo
- Publication number
- WO2018213947A1 WO2018213947A1 PCT/CN2017/085234 CN2017085234W WO2018213947A1 WO 2018213947 A1 WO2018213947 A1 WO 2018213947A1 CN 2017085234 W CN2017085234 W CN 2017085234W WO 2018213947 A1 WO2018213947 A1 WO 2018213947A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- feature
- image
- fingerprint
- feature information
- information
- Prior art date
Links
- 238000000605 extraction Methods 0.000 claims description 91
- 238000012545 processing Methods 0.000 claims description 46
- 238000003860 storage Methods 0.000 claims description 23
- 238000007781 pre-processing Methods 0.000 claims description 7
- 238000000034 method Methods 0.000 description 38
- 230000008569 process Effects 0.000 description 19
- 230000006870 function Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 238000009826 distribution Methods 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 101100272667 Xenopus laevis ripply2.2 gene Proteins 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 230000036548 skin texture Effects 0.000 description 2
- 230000001054 cortical effect Effects 0.000 description 1
- 230000005057 finger movement Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
Definitions
- the utility model relates to the field of biometric identification, in particular to an image recognition system and an electronic device thereof.
- Biometric technology especially fingerprint recognition, is widely used in smart terminals such as mobile phones. Since the setting position of the smart terminal is limited, when the biological image sensing is performed, the larger the sensing area is, the higher the cost is. Therefore, the image sensing area has a certain limit, and fingerprint identification is taken as an example, and the commonly used sensing area is currently used. It is 25% to 30% of the entire fingerprint area of the finger.
- the sensing area is small, if the recognition accuracy is to be ensured, it is necessary to collect the registration multiple times.
- the image information to be identified needs to be compared with all the registered templates to obtain the recognition result. In this way, image recognition takes a long time and is not conducive to user experience.
- the embodiments of the present invention aim to at least solve one of the technical problems existing in the prior art. To this end, the embodiments of the present invention need to provide an image recognition system and an electronic device.
- An image recognition system includes a storage unit, a feature extraction unit, and a feature comparison unit;
- the storage unit is configured to store a registered fingerprint template, where the fingerprint template includes first feature information and second feature information;
- the feature extraction unit is configured to perform feature extraction on an image to be recognized collected by a fingerprint collection unit, to obtain first feature information and second feature information;
- the feature comparison unit is configured to compare the first feature information with the first feature information in the fingerprint template stored by the storage unit to obtain a fingerprint template that is consistent in comparison; and compare the second feature information with the comparison.
- the second feature information in the fingerprint template is subjected to feature comparison to obtain a recognition result.
- the image recognition system further includes processing circuitry for controlling the feature extraction unit and the feature comparison unit to operate; the processing circuit includes an input interface and an output interface, the input interface And configured to receive an image to be identified, and the output interface is configured to output the recognition result.
- the feature extraction unit includes a first feature extraction unit and a second feature extraction unit, and the first feature extraction unit performs feature extraction on the image to be recognized by using a preset first feature extraction rule. a feature information; the second feature extraction unit performs feature extraction on the image to be recognized by using a preset second feature extraction rule to obtain second feature information.
- the image to be identified is a fingerprint image
- the first feature information includes a type of the fingerprint, a degree of curvature of the texture, and/or a width of the interval of the texture.
- the second feature information includes all feature point information for the ridge portion and/or valley portion of the fingerprint.
- the feature comparison unit includes a first feature comparison unit and a second feature comparison unit, the first feature comparison unit is used for feature comparison of the first feature information, and the second feature comparison The unit is used for feature comparison of the second feature information.
- the first feature information is coded feature information obtained by performing coded clustering processing on the image to be identified.
- the first feature extraction unit includes an image coding module and a feature classification statistics module; the image coding module is configured to perform image coding on the image to be recognized to obtain an initial coding feature; and the feature classification statistics module is configured to follow
- the preset coding feature class class categorizes the initial coding features, and counts the number of each class to form final coding feature information.
- the preset encoding feature core is preset and stored in the storage unit; or the preset encoding feature core is obtained by real-time updating in an online manner.
- the feature extraction unit is further configured to perform preprocessing on the image to be recognized before performing feature extraction, the preprocessing including noise processing and image enhancement processing.
- An electronic device includes the image recognition system of any of the above embodiments.
- the image recognition system has the following points when performing image recognition:
- the first feature information and the second feature information can be extracted in parallel, which further improves the fingerprint recognition speed.
- the comparison of the first feature information may be performed first, and after the second feature information is extracted, the feature of the second feature information is performed in parallel. Comparison, The fingerprint recognition speed is further improved.
- FIG. 1 is a schematic diagram of fingerprint registration using fingerprint recognition as an example in an image recognition system according to an embodiment of the present invention
- FIG. 2 is a schematic diagram of fingerprint recognition taking fingerprint recognition as an example in an image recognition system according to an embodiment of the present invention
- FIG. 3 is a functional block diagram of an image recognition system according to an embodiment of the present invention.
- FIG. 4 is a schematic diagram of comparison of feature information and fingerprint template in feature matching in an image recognition system according to an embodiment of the present invention
- FIG. 5 is a functional block diagram of a first feature extraction unit in an image recognition system according to an embodiment of the present invention.
- FIG. 6 is a schematic diagram of a plain fingerprint image and a coding feature distribution obtained by encoding the same according to the BSIF encoding in the image recognition system according to the embodiment of the present invention
- FIG. 7 is a schematic diagram of a fingerprint image of a crepe pattern in an image recognition system according to an embodiment of the present invention and a coded feature obtained by encoding the image according to the BSIF code;
- FIG. 8 is a schematic plan view showing an embodiment of an electronic device to which an image recognition system according to an embodiment of the present invention is applied;
- FIG. 9 is a functional block diagram of another embodiment of an electronic device to which an image recognition system according to an embodiment of the present invention is applied;
- FIG. 10 is a schematic flowchart of a registration process of an image recognition method according to an embodiment of the present invention.
- FIG. 11 is a schematic diagram of a fingerprint template stored in an image recognition method according to an embodiment of the present invention.
- FIG. 12 is a schematic flow chart of an embodiment of an identification process of an image recognition method according to an embodiment of the present invention.
- FIG. 13 is a schematic flow chart of another embodiment of an identification process of an image recognition method according to an embodiment of the present invention.
- FIG. 14 is a schematic flow chart of still another embodiment of an identification process of an image recognition method according to an embodiment of the present invention.
- first and second are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. .
- features defining “first” or “second” may include one or more of the described features either explicitly or implicitly.
- the meaning of "a plurality" is two or more unless specifically and specifically defined otherwise.
- connection is to be understood broadly, and may be, for example, a fixed connection or a Disassembling the connection, or connecting integrally; may be mechanical connection, electrical connection or communication with each other; may be directly connected, or may be indirectly connected through an intermediate medium, may be internal communication of two elements or mutual interaction of two elements Role relationship.
- installation is to be understood broadly, and may be, for example, a fixed connection or a Disassembling the connection, or connecting integrally; may be mechanical connection, electrical connection or communication with each other; may be directly connected, or may be indirectly connected through an intermediate medium, may be internal communication of two elements or mutual interaction of two elements Role relationship.
- the specific meanings of the above terms in the present invention can be understood on a case-by-case basis.
- the image recognition in the embodiment of the present invention refers to image acquisition of a target object placed at a specified position by using an image sensor, and the collected image will be transmitted to a processing system for image recognition through a flexible printed circuit board or other printed circuit. That is, it is identified whether the image has been registered or registered, or the identity of the user is recognized, and the like.
- the fingerprint image of the user must be registered before the fingerprint image is recognized.
- the user places the finger 200 that needs to be registered in the designated position.
- the fingerprint collecting unit 103 collects the fingerprint of the finger to obtain a fingerprint image.
- the feature extraction unit 101 performs fingerprint feature extraction on the fingerprint image obtained by the fingerprint collection unit 103, obtains fingerprint feature information, and forms a corresponding fingerprint template. It is stored to a predetermined location of the storage unit 102. This is repeated a number of times to form N corresponding fingerprint templates. It should be noted that, since the sensing area of the fingerprint collecting unit 103 is small, the same fingerprint is collected multiple times to form complete fingerprint information. Therefore, assuming that one finger is collected five times and five fingers are collected, a total of 25 fingerprint templates are generated.
- the finger 200 When the user needs to perform fingerprint recognition, the finger 200 is placed at the designated position, and the fingerprint collection unit 103 collects the fingerprint of the finger to obtain a fingerprint image.
- the feature extraction unit 101 performs fingerprint feature extraction on the fingerprint extraction unit 101 to obtain fingerprint feature information to be compared.
- the feature comparison unit 104 compares the fingerprint feature information to be compared with all the fingerprint templates in the storage unit 102, and outputs a comparison result, such as a successful recognition or a recognition failure.
- the fingerprint collection unit 103 herein may include any one or more of an optical fingerprint collection unit, a capacitive fingerprint collection unit, an ultrasonic fingerprint collection unit, a radio frequency fingerprint collection unit, and the like.
- the fingerprint feature information to be compared needs to be compared with all the fingerprint templates in the storage unit 102, the recognition result can be obtained. Therefore, the more the number of fingerprint templates, the longer the fingerprint recognition time is, so that the fingerprint recognition is performed. The speed is slow, which is not conducive to the user experience.
- the present invention proposes a new image recognition system.
- the image recognition system extracts features according to different feature extraction rules to obtain different feature information, such as first feature information, second feature information, etc.; when the feature information is compared, First comparing the first feature information with the first feature information in the image registration information, if the comparison is consistent, comparing the second feature information with the second feature information in the registration information, and finally outputting the comparison result .
- the comparison speed of the first feature information is faster than the second feature information, that is, The image recognition system improves the speed of image recognition.
- the image information may include fingerprint information, palm print information, ear pattern information, and skin texture information at other suitable locations on the living body. Since the skin texture and cortical structure of the organism have different characteristics, different organisms can be identified according to the characteristics.
- the living body is, for example, a human body, but may not be limited to a human body. In the following embodiments, fingerprint recognition will be described as an example.
- an image recognition system 100 includes a processing circuit 110 , a storage unit 120 , a feature extraction unit 130 , and a feature comparison unit 140 .
- Processing circuit 110 has, for example but not limited to, a microprocessor having an input interface 111 and an output interface 112.
- the input interface 111 is configured to receive image information collected by an image acquisition unit (not shown), such as fingerprint image information collected by the fingerprint collection unit.
- the fingerprint image information received by the input interface 111 may be an analog signal or a digital signal. If the fingerprint image information received by the input interface 111 is an analog signal, it is sent to the processing circuit 110. When it needs to be analog-to-digital converted, it is converted into a corresponding digital signal.
- the output interface 112 is configured to output a processing result, such as fingerprint identification success or fingerprint recognition failure, etc., and the processing result may be displayed by driving the display screen through the display driving circuit, or by displaying the indicator light, or performing voice prompting through the speaker.
- the processing circuit 110 outputs the corresponding fingerprint image information to the feature extraction unit 130, so that the feature extraction unit 130 performs feature extraction on the fingerprint image to obtain corresponding feature information.
- the feature information may include first feature information and second feature information, the first feature information and the second feature information are feature information that reflects fingerprint characteristics from different angles, and the feature information amount of the first feature information is smaller than the second feature. The amount of characteristic information of the information is small.
- the first feature information is used to describe the fingerprint feature of the user as a whole
- the second feature information is used to accurately describe the texture of the fingerprint, including all feature point information describing the texture of the ridge portion, due to the portion of the valley in the fingerprint and the position of the portion of the ridge.
- the position of the valley portion of the fingerprint can be determined by determining the position of the ridge portion of the fingerprint.
- the first feature information may also include all feature point information describing the texture of the valley portion, or all feature point information of the grain of the valley portion and the ridge portion.
- the first feature information and the second feature information may also be other suitable fingerprint information.
- the fingerprint template stored in the storage unit 120 corresponds to the first feature information and the second feature information including the registered fingerprint.
- the difference between the fingerprint templates generated when the same finger is registered is small, when storing, the same portion in each fingerprint template and a portion having a difference between the fingerprint templates may be stored. This will save storage space.
- all the fingerprint templates contain only feature information, and the corresponding fingerprint image cannot be obtained through the feature information, thereby ensuring the information security of the fingerprint template.
- the feature comparison unit 140 compares the first feature information extracted by the first feature extraction unit 131 with the first feature information of the registered N fingerprint templates to obtain a comparison.
- the fingerprint template for example, M fingerprint templates, M ⁇ N; the second feature information extracted by the second feature extraction unit 132 is compared with the second feature information in the fingerprint template that is aligned.
- the output comparison results such as recognition success or recognition failure. If the first feature information is compared with the first feature information in all the fingerprint templates that are registered, and no fingerprint template is obtained, the comparison result is directly output, that is, the second feature information is no longer compared.
- the unmatched fingerprint template can be quickly filtered, and the second feature information is avoided from being compared with all the fingerprint templates in the storage unit 120, thereby saving the comparison time of the second feature information. , improve the speed of fingerprint recognition.
- the comparison of the first feature information may be performed first. After the second feature information is extracted, the second feature information is compared, thereby further improving the fingerprint recognition speed.
- the feature extraction unit 130 may include a first feature extraction unit 131 and a second feature extraction unit 132.
- the first feature extraction unit 131 performs feature extraction on the fingerprint information by using a preset first feature extraction rule to obtain first feature information.
- the first feature information is used to describe the fingerprint feature of the user as a whole, and only contains a small amount of feature information describing the characteristics of the user's fingerprint.
- a human finger fingerprint may include three basic types: a concentric circle or a spiral line, which is called a bucket line; an opening on one side of the line, called a striated line; and a striate like a bow, called a bow line.
- the first feature extraction unit 131 may extract first feature information such as the type of the fingerprint, the degree of curvature of the texture, and the interval width of the texture.
- the second feature extraction unit 132 performs feature extraction on the fingerprint information by using a preset second feature extraction rule to obtain second feature information.
- the second feature information is used to accurately describe the uniqueness of the fingerprint. Therefore, the second feature information includes, but is not limited to, feature point information of each stripe path in the collected fingerprint image, for example, location information of each feature point and the feature. The eigenvalue of the point.
- the feature extraction unit 130 may further include a third feature extraction unit (not shown), and the third feature extraction unit performs feature on the fingerprint information by using a preset third feature extraction rule. Extracting, obtaining third feature information.
- the third feature information is used to describe several detailed feature points of the fingerprint, such as a bifurcation point, a termination point, a center point, and a triangle point, and the feature information amount of the third feature information is less than the feature information amount of the second feature information. However, there is more feature information than the first feature information. Therefore, after the comparison of the first feature information by the feature comparison unit 140, the first fingerprint template that is aligned is obtained, and the third feature information in the first fingerprint template that matches the third feature information and the comparison is performed.
- Performing an alignment obtaining a second fingerprint template consistent with the comparison, and comparing the second feature information with the second fingerprint template that is aligned, to obtain a comparison result, such as a successful recognition or a recognition failure.
- a comparison result such as a successful recognition or a recognition failure.
- the feature comparison unit 140 may include a first feature comparison unit and a second feature comparison unit.
- the first feature comparison unit is used for feature comparison of the first feature information
- the second feature comparison unit is used for feature comparison of the second feature information. Since the extraction speed of the first feature information is faster than the extraction speed of the second feature information, after the first feature information is extracted, the first feature comparison unit can perform feature comparison on the first feature information to obtain a comparison. Fingerprint template.
- the second feature comparison unit may perform feature matching on the fingerprint template in which the second feature information is consistent with the comparison, without waiting for the first feature information to end the feature comparison with all the fingerprint templates.
- the feature comparison of the feature comparison of the first feature information with the second feature information can also be processed in parallel, thereby speeding up the feature comparison, that is, improving the fingerprint recognition speed.
- the first feature information may be coded feature information obtained after performing coded clustering processing on the fingerprint image.
- the first feature information in the fingerprint template is coded feature information.
- the first feature extraction unit 131 may include an image coding module 1311 and a feature classification statistics module 1312 .
- the image encoding module 1311 is configured to perform image coding on the fingerprint image to obtain a coding feature.
- the feature classification statistics module 1312 is configured to perform feature classification on the coding features, and count the number of each class to form final coding feature information.
- the encoding method may include Local Binary Pattern (LBP), Local Phase Quantization (LPQ), and Binaryized Statistical Image Features (BSIF).
- LBP Local Binary Pattern
- LPQ Local Phase Quantization
- BSIF Binaryized Statistical Image Features
- the encoding may be performed by using one of the encoding methods, or may be encoded by using multiple encoding methods, as long as the encoding rule of the first feature information in the fingerprint template is consistent with the encoding rule of the first feature information in the fingerprint to be detected. can.
- Feature categorization methods may include k-means (k-means), hierarchical clustering, Self-Organizing Maps (SOM), Fuzzy C-means (FCM) clustering, etc., and the number of clusters may be For fixed values, of course, you can also flexibly set according to the actual situation.
- the coding feature obtained by the image coding module 1311 is compared with the preset coding feature core by using a distance metric or the like, and the coding feature is merged into the class with the smallest distance.
- the feature categorization statistics module 1312 then counts the number of each class, and finally obtains a statistical histogram, the final coding feature.
- the preset coding feature class core includes a cluster center value or a cluster mean value of the feature, a feature range value of the cluster, and the like.
- the preset coding feature core is pre-computed and saved to the image recognition system for reuse in feature classification.
- the preset coding feature class core can also be updated in real time through an online manner to improve the previously set coding feature class.
- the preset coding feature class core can also be obtained by processing the registered fingerprint template. For example, the fingerprint image in the registered fingerprint template is image-encoded to obtain a coding feature; then the feature features are clustered to obtain a coding feature core.
- the encoded feature core is obtained by using the registered fingerprint template processing
- the coding feature obtained by performing feature classification statistics according to the coding feature class is closer to the coding feature of the registered fingerprint template, so that when the feature comparison is performed, not only the acceleration is accelerated. Compare the speed and ensure the accuracy of the comparison.
- FIG. 6 is a fingerprint image of a parallel texture and a feature distribution after BSIF encoding the fingerprint image
- FIG. 7 is a fingerprint image of a curved texture, and BSIF encoding the fingerprint image.
- Characteristic distribution The fingerprint images shown in FIG. 6 and FIG. 7 only reflect the characteristics of the fingerprint as a whole, that is, the first feature information including only the fingerprint information. It can be seen from the feature distributions in FIG. 6 and FIG. 7 that the difference between the parallel lines and the curved lines is obvious, and thus the feature comparison is performed by the coding features, thereby further improving the comparison speed, that is, the fingerprint recognition speed.
- the fingerprint image may be subjected to certain preprocessing, for example, noise processing of the fingerprint image, enhancement processing of the fingerprint image, and the like. If there is noise in the fingerprint image, there will be burrs when extracting features, and there will be many false minutiae points, that is, pseudo-detail points.
- the noise processing of the image may include processing of the spatial domain and processing of the frequency domain, such as averaging or intermediate values of image pixels; frequency domain processing such as low pass filtering.
- the enhancement processing is mainly for highlighting the contrast between the ridge portion and the valley portion of the fingerprint image, for example, by adjusting the gray value of the image pixel, sharpening the fingerprint image, and increasing the outline of the fingerprint image and the sharpness of the line.
- adjusting the gray value of the image pixel sharpening the fingerprint image
- increasing the outline of the fingerprint image and the sharpness of the line there are other ways to deal with it, not to mention here.
- the image recognition system described above can be integrated as a processing chip, disposed separately from the image acquisition unit. In this way, the design of the image recognition system can be performed independently, thereby reducing the design cost.
- the image recognition system described above may also be integrated with the image acquisition unit as an image recognition chip, such as a fingerprint recognition sensor. In this way, the fingerprint recognition sensor collects fingerprints and performs fingerprint recognition internally. Even if the terminal main system applied by the fingerprint recognition sensor has a security threat, the biological information is still safe, thereby ensuring the security of the biological information.
- the image recognition system described above can be applied to implement corresponding functions on the smart terminal, for example, the image recognition system recognizes the user identity, and after the recognition succeeds, the user is unlocked, the application is started, the online payment is performed, and the like.
- the smart terminal can be a consumer electronic product or a home-based electronic product or a vehicle-mounted electronic product.
- consumer electronic products such as mobile phones, tablets, notebook computers, desktop monitors, computer integrated machines and other electronic products using biometric identification technology.
- Home-based electronic products such as smart door locks, televisions, refrigerators, wearable devices and other electronic products that use biometric technology.
- Vehicle-mounted electronic products such as car navigation systems, car DVDs, etc.
- the image recognition system can be integrated with the image acquisition unit as a chip, such as a fingerprint sensor chip, a collection fingerprint collection function and a fingerprint matching function; the image recognition system can also integrate a separate processing chip, that is, the image integration system is integrated in the chip. All or part of a component.
- an electronic device 500 is provided with an image capturing device 501 that collects image information and an image recognition system 100 according to any of the above embodiments.
- the electronic device may also set image collection.
- An image recognition chip that combines function and image matching functions.
- the image capturing device 501 can be a photoelectric sensing module, a capacitive sensing module, and of course, an imaging device.
- the image capture device 501 acquires image information of the target object, such as a fingerprint image, and transmits the acquired image information to the image recognition system 100.
- the image recognition system 100 processes the image information, it recognizes the image information and outputs a recognition result such as recognition success or recognition failure.
- the image recognition system 100 adopts a new recognition processing technology, at the time of feature extraction, feature extraction is performed on the image information according to different angles, and the first feature information and the second feature information are obtained, and the feature information amount of the first feature information is obtained.
- the first feature information is first compared with all the registered fingerprint templates to obtain a matching fingerprint template, and the fingerprints that are inconsistent are removed.
- the template is then compared with the fingerprint template that matches the alignment, thereby speeding up the feature comparison, that is, the image recognition speed.
- the electronic device 500 is a mobile phone, and the front surface of the mobile phone is provided with a display device 400 , and the image capturing device 501 or the image recognition chip is disposed under the front cover of the electronic device 500 .
- the image capture device 501 or the image recognition chip may also be disposed on the display device 400.
- the image capture device 501 can also be integrated as an image recognition chip, or the image capture device 501 can also be integrated with the image recognition system 100 as an image recognition chip, correspondingly disposed on the front, back, and sides of the electronic device 500. The position may be exposed to the outer surface of the electronic device 500 or may be disposed inside the electronic device 500 and adjacent to the outer casing.
- the electronic device 600 when the image recognition system is applied to the smart terminal, the existing structure of the smart terminal may be utilized, and some structures of the image recognition may be added.
- the electronic device 600 includes a processor 601, a memory 602, a display unit 603, a user input unit 604, a power source 605, and a communication unit 606.
- the memory 602 is used to store all data on the smart terminal 600 that needs to be stored, such as external data and internal processing data.
- the memory 602 can include an internal memory unit and an external memory unit.
- Display unit 603 includes, but is not limited to, an LCD, a TFT-LCD, an OLED, a flexible display, and the like.
- the user input unit 604 can generate input data according to a command input by the user to control various operations of the smart terminal 600.
- the user input unit 604 allows the user to input various types of information, and may include a button, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel, a shaker. Rod and so on.
- a touch panel when the touch panel is superimposed on the display unit 603 in a layer form, a touch screen may be formed.
- the keys in the user input unit 604 may include virtual keys disposed on the touch panel, or physical keys disposed in the non-display area, such as a Home button, a power button, and the like.
- the power source 605 is used to provide the working power required for the smart terminal to operate, and to provide the standby power required to maintain the standby state of the smart terminal.
- the communication unit 606 may include a communication interface such as USB, Type-C, etc.; of course, may also include a wireless communication interface such as GPRS, WCDMA, wifi, radio frequency, Bluetooth, infrared, and the like. It should be noted that FIG. 9 only exemplifies some components of the electronic device 600, and may further include other functional components, such as a camera, a microphone, a speaker, and the like, for implementing functions required by the user.
- the image capture device 601 and the image are further disposed on the electronic device 600.
- the structure of the image recognition system is similar to that of the image recognition system 100 of the above embodiment, except that the processing circuit 110 and the storage unit 120 in the image recognition system 100 are shared with the processor 601 and the memory 602 in the electronic device 600.
- other structures of the image recognition system 100 may be stored in the memory 602 or in a separate storage medium in the form of a software program, such as instruction code, for the processor 601 to invoke to implement the image recognition function.
- a software program such as instruction code
- the image capturing device 601 can be a photoelectric sensing module, a capacitive sensing module, and of course an imaging device.
- the configuration of the image acquisition device 601 in the electronic device 600 can be referred to the previous embodiment as an example, and details are not described herein again.
- the image capture device 601 collects image information of the target object, such as a fingerprint image, and transmits the acquired image information to the image recognition system 602.
- the image recognition system 602 processes the image information, it recognizes the image information and outputs a recognition result, such as recognition success or recognition failure.
- the image recognition system adopts a new recognition processing technology, feature extraction is performed on the image information according to different angles during feature extraction, and the first feature information and the second feature information are obtained, and the feature information ratio of the first feature information is obtained.
- the second feature information has a small amount of feature information. Therefore, when the feature comparison is performed, the first feature information is first compared with all the registered fingerprint templates to obtain a matching fingerprint template, and the fingerprint template that is inconsistent is removed. Then, the second feature information is compared with the fingerprint template that is aligned, thereby speeding up the feature comparison, that is, the image recognition speed.
- each unit in the above embodiment may be integrated into one processing unit, or two or more units may be integrated.
- the above integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.
- the units integrated in the above embodiments may also be stored in a computer readable storage medium if they are implemented in the form of software functional modules and sold or used as separate products. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in part contributing to the prior art.
- the computer software product is stored in a storage medium and includes instructions for causing a smart terminal (consumer electronics, home electronics, or vehicle-mounted electronic product) to perform all of the methods of the various embodiments of the present invention or section.
- An image recognition method of an embodiment of the present invention may include a registration process and an identification process.
- the registration process In the user, the user registers his own image information, such as fingerprint information, and the registered fingerprint information is stored in the form of a fingerprint template for use in the identification process.
- the identification process the collected fingerprint image to be detected is compared with the stored fingerprint template, and the recognition result is output, for example, the recognition success or the recognition failure.
- the registration process specifically includes:
- Step S101 acquiring a fingerprint image to be registered
- the fingerprint image to be registered is acquired by the image sensor.
- the fingerprint sensor Taking the fingerprint sensor as an example, when the user's finger is located on the fingerprint sensor, the fingerprint sensor will collect the fingerprint image of the finger and transmit the collected fingerprint image to the fingerprint recognition system.
- the input interface 111 of the fingerprint recognition system 100 can be electrically connected to the fingerprint sensor through a flexible printed circuit board or other circuit board.
- Step S102 performing feature extraction on the acquired fingerprint image, and acquiring first feature information and second feature information;
- the first feature information and the second feature information reflect the fingerprint feature from different angles, and the feature information amount of the first feature information is less than the feature information amount of the second feature information. Therefore, feature extraction is performed on the acquired fingerprint image according to different feature extraction rules, and the first feature information and the second feature information are obtained.
- the extraction of the first feature information and the extraction of the second feature information may be performed sequentially or in parallel. Moreover, the extraction of feature information in parallel can speed up feature extraction.
- the first feature information is used to describe the fingerprint feature of the user as a whole, and only contains a small amount of feature information describing the characteristics of the user's fingerprint.
- a human finger fingerprint may include three basic types: a concentric circle or a spiral line, which is called a bucket line; an opening on one side of the line, called a striated line; and a striate like a bow, called a bow line.
- different types of fingerprints also differ in the degree of curvature of the texture, the width of the interval of the texture, and the like. Therefore, when the first feature information is extracted, the type of the fingerprint, the degree of curvature of the texture, the interval width of the texture, and the like can be extracted.
- the second feature information is used to accurately describe the uniqueness of the fingerprint, and then includes all the feature information of the fingerprint information, such as the texture of the entire fingerprint. Therefore, when the second feature information extraction is performed, the texture information of the entire fingerprint is extracted.
- first feature information and the second feature information are not limited herein.
- the third feature information, the fourth feature information, and the like may also be extracted as needed.
- Step S103 Form a corresponding fingerprint template according to the first feature information and the second feature information; that is, each fingerprint template includes corresponding first feature information and second feature information.
- Step S104 determining whether the number of registration acquisitions reaches a preset threshold; if yes, executing step S105, otherwise returning to step S101;
- the acquisition is set at least 3 times, that is, the preset threshold is 3. It should be noted that each acquisition is an effective acquisition, that is, each acquisition.
- the fingerprint image should meet the requirements of sharpness, finger scanning position and so on. If the currently collected fingerprint image does not meet the requirements, for example, the finger movement causes the captured image to be blurred, the currently acquired image is discarded, and the user is prompted to re-collect the fingerprint image.
- step S105 all the fingerprint templates are stored.
- all fingerprint templates formed by the registration are stored.
- the difference between the fingerprint templates generated when the same finger is registered is small, when storing, the same portion in each fingerprint template and a portion having a difference between the fingerprint templates may be stored. This will save storage space.
- all the fingerprint templates contain only feature information, and the corresponding fingerprint image cannot be obtained through the feature information, thereby ensuring the information security of the fingerprint template.
- each registered finger has a corresponding fingerprint template library, that is, each fingerprint template has a corresponding finger identifier, and each corresponding fingerprint template library has multiple fingerprint templates.
- the fingerprint template corresponding to the finger A includes the template 1A, the template 2A, and the template 3A.
- the identifying process may specifically include:
- Step S201 acquiring a fingerprint image to be identified
- the fingerprint image to be identified is acquired by the image sensor.
- the fingerprint sensor when the user's finger is located on the fingerprint sensor, the fingerprint sensor will collect the fingerprint image of the finger and output the collected fingerprint image to the fingerprint recognition system.
- the input interface 111 of the fingerprint recognition system 100 can be electrically connected to the fingerprint sensor through a flexible printed circuit board or other circuit board.
- Step S202 performing feature extraction on the acquired fingerprint image to obtain first feature information and second feature information
- the first feature information and the second feature information reflect the fingerprint feature from different angles, and the feature information amount of the first feature information is less than the feature information amount of the second feature information. Therefore, feature extraction is performed on the acquired fingerprint image according to different feature extraction rules, and the first feature information and the second feature information are obtained.
- the extraction of the first feature information and the extraction of the second feature information may be performed sequentially or in parallel. Moreover, the extraction of feature information in parallel can speed up feature extraction.
- the first feature information is used to describe the fingerprint feature of the user as a whole, and only contains a small amount of feature information describing the characteristics of the user's fingerprint.
- a human finger fingerprint may include three basic types: a concentric circle or a spiral line, which is called a bucket line; an opening on one side of the line, called a striated line; and a striate like a bow, called a bow line.
- the type of fingerprint also differs in the degree of curvature of the texture, the width of the interval of the texture, and the like. Therefore, when the first feature information is extracted, the type of the fingerprint, the degree of curvature of the texture, the interval width of the texture, and the like can be extracted.
- the second feature information is used to accurately describe the uniqueness of the fingerprint, and then includes all the feature information of the fingerprint information, such as the texture of the entire fingerprint. Therefore, when the second feature information extraction is performed, the texture information of the entire fingerprint is extracted.
- Step S203 comparing the first feature information with the first feature information of all the registered fingerprint templates to obtain a fingerprint template that is consistent with the comparison;
- Step S204 comparing the second feature information with the second feature information in the fingerprint template that is aligned, to obtain a comparison result.
- step S204 is performed.
- step S204 is performed in parallel, and after the second feature information is successfully matched, the identification may be stopped, so that the comparison result may be obtained in advance, and the reference may be accelerated. Identify the speed.
- the first feature information may be coded feature information obtained after performing coded clustering processing on the fingerprint image.
- the first feature information in the fingerprint template is coded feature information.
- the identification process may specifically include:
- Step S301 acquiring a fingerprint image to be identified
- Step S302 performing feature extraction on the acquired fingerprint image to obtain coding feature information and second feature information
- Step S303 comparing the coded feature information with the coded feature information in all the registered fingerprint templates to obtain a fingerprint template that is consistent in comparison
- Step S304 comparing the second feature information with the second feature information in the fingerprint template that is aligned, to obtain a comparison result.
- the process of obtaining the encoded feature information may include: performing image coding on the fingerprint image to obtain an initial coding feature; classifying the initial coding feature, and counting the number of each class to form a final coding feature information.
- the encoding method may include Local Binary Pattern (LBP), Local Phase Quantization (LPQ), and Binaryized Statistical Image Features (BSIF).
- LBP Local Binary Pattern
- LPQ Local Phase Quantization
- BSIF Binaryized Statistical Image Features
- the encoding may be performed by using one of the encoding methods, or may be encoded by using multiple encoding methods, as long as the encoding rule of the first feature information in the fingerprint template is consistent with the encoding rule of the first feature information in the fingerprint to be detected. can.
- Feature categorization methods may include k-means (k-means), hierarchical clustering, Self-Organizing Maps (SOM), Fuzzy C-means (FCM) clustering, etc., and the number of clusters may be For fixed values, of course, you can also flexibly set according to the actual situation.
- the initial coding feature is compared with the preset coding feature class core by using a distance metric or the like, and the coding feature is merged to the class with the smallest distance. Then count the number of each class, and finally get a statistical histogram, the final coding feature.
- the preset coding feature class core includes a cluster center value or a cluster mean value of the feature, a feature range value of the cluster, and the like.
- the preset coding feature core is pre-computed and saved to the image recognition system for reuse in feature classification.
- the preset coding feature class core can also be updated in real time through an online manner to improve the previously set coding feature class.
- the preset coding feature class core can also be obtained by processing the registered fingerprint template. For example, the fingerprint image in the registered fingerprint template is image-encoded to obtain a coding feature; then the feature features are clustered to obtain a coding feature core.
- the encoded feature core is obtained by using the registered fingerprint template processing
- the coding feature obtained by performing feature classification statistics according to the coding feature class is closer to the coding feature of the registered fingerprint template, so that when the feature comparison is performed, not only the acceleration is accelerated. Compare the speed and ensure the accuracy of the comparison.
- the method may further include:
- Step S205 preprocessing the acquired fingerprint image.
- the fingerprint image may be subjected to certain preprocessing, for example, noise processing of the fingerprint image, enhancement processing of the fingerprint image, and the like. If there is noise in the fingerprint image, there will be burrs when extracting features, and there will be many false minutiae points, that is, pseudo-detail points.
- the noise processing of the image may include processing of the spatial domain and processing of the frequency domain, such as averaging or intermediate values of image pixels; frequency domain processing such as low pass filtering.
- the enhancement processing is mainly for highlighting the contrast between the ridge portion and the valley portion of the fingerprint image, for example, by adjusting the gray value of the image pixel, sharpening the fingerprint image, and increasing the outline of the fingerprint image and the sharpness of the line.
- adjusting the gray value of the image pixel sharpening the fingerprint image
- increasing the outline of the fingerprint image and the sharpness of the line there are other ways to deal with it, not to mention here.
- first and second are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated.
- features defining “first” or “second” may include at least one of the features, either explicitly or implicitly.
- the meaning of "a plurality” is at least two, such as two, three, etc., unless specifically defined otherwise.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Collating Specific Patterns (AREA)
Abstract
Description
Claims (11)
- 一种图像识别系统,其特征在于,包括存储单元、特征提取单元以及特征比对单元;其中,所述存储单元用于存储已注册的指纹模板,所述指纹模板包括第一特征信息和第二特征信息;所述特征提取单元用于对一指纹采集单元所采集的待识别图像进行特征提取,获得第一特征信息和第二特征信息;所述特征比对单元用于将第一特征信息与所述存储单元存储的指纹模板中的第一特征信息进行特征比对,获得比对一致的指纹模板;将第二特征信息与比对一致的指纹模板中的第二特征信息进行特征比对,获得识别结果。
- 如权利要求1所述的图像识别系统,其特征在于,所述图像识别系统还包括处理电路,用于控制所述特征提取单元和所述特征比对单元进行工作;所述处理电路包括输入接口和输出接口,所述输入接口用于接收待识别图像,所述输出接口用于输出所述识别结果。
- 如权利要求1所述的图像识别系统,其特征在于,所述特征提取单元包括第一特征提取单元、第二特征提取单元,所述第一特征提取单元采用预设的第一特征提取规则对待识别图像进行特征提取,获得第一特征信息;所述第二特征提取单元采用预设的第二特征提取规则对待识别图像进行特征提取,获得第二特征信息。
- 如权利要求3所述的图像识别系统,其特征在于,所述待识别图像为指纹图像,所述第一特征信息包括指纹的类型、纹路的弯曲程度、和/或纹路的间隔宽度。
- 如权利要求4所述的图像识别系统,其特征在于,所述第二特征信息包括指纹中脊部分和/或谷部分纹路的所有特征点信息。
- 如权利要求3所述的图像识别系统,其特征在于,所述特征比对单元包括第一特征比对单元和第二特征比对单元,第一特征比对单元用于第一特征信息的特征比对,第二特征比对单元用于第二特征信息的特征比对。
- 如权利要求1所述的图像识别系统,其特征在于,所述第一特征信息为对待识别图像进行编码聚类处理获得的编码特征信息。
- 如权利要求3所述的图像识别系统,其特征在于,所述第一特征提取单元包括图像编码模块、特征归类统计模块;图像编码模块用于对待识别图像进行图像编码,获 得初始编码特征;特征归类统计模块用于按照预设的编码特征类心对所述初始编码特征进行特征归类,并统计每个类的数目,形成最终的编码特征信息。
- 如权利要求8所述的图像识别系统,其特征在于,所述预设的编码特征类心为预先设置,并存储在所述存储单元中;或者所述预设的编码特征类心通过在线的方式实时更新获得。
- 如权利要求1所述的图像识别系统,其特征在于,所述特征提取单元还用于在进行特征提取之前,还对待识别图像进行预处理,所述预处理包括噪声处理、图像增强处理。
- 一种电子装置,其特征在于,包括权利要求1-10任一项所述的图像识别系统。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/085234 WO2018213947A1 (zh) | 2017-05-20 | 2017-05-20 | 图像识别系统及电子装置 |
CN201790000061.5U CN208689589U (zh) | 2017-05-20 | 2017-05-20 | 图像识别系统及电子装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/085234 WO2018213947A1 (zh) | 2017-05-20 | 2017-05-20 | 图像识别系统及电子装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018213947A1 true WO2018213947A1 (zh) | 2018-11-29 |
Family
ID=64395194
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/085234 WO2018213947A1 (zh) | 2017-05-20 | 2017-05-20 | 图像识别系统及电子装置 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN208689589U (zh) |
WO (1) | WO2018213947A1 (zh) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018213946A1 (zh) * | 2017-05-20 | 2018-11-29 | 深圳信炜科技有限公司 | 图像识别方法、图像识别装置、电子装置及计算机存储介质 |
CN109992945A (zh) * | 2019-04-11 | 2019-07-09 | 刘策 | 一种移动指纹解锁系统 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101931789A (zh) * | 2009-06-26 | 2010-12-29 | 上海宝康电子控制工程有限公司 | 关键区域中的高清晰人像自动记录及比对系统及其方法 |
CN106096361A (zh) * | 2016-05-31 | 2016-11-09 | 广东欧珀移动通信有限公司 | 一种指纹解锁方法及移动终端 |
CN106096360A (zh) * | 2016-05-31 | 2016-11-09 | 广东欧珀移动通信有限公司 | 一种解锁控制方法及终端设备 |
CN106202071A (zh) * | 2015-04-29 | 2016-12-07 | 腾讯科技(深圳)有限公司 | 账户信息获取的方法、终端、服务器和系统 |
US20160358010A1 (en) * | 2015-06-08 | 2016-12-08 | Crowd IP Box UG (haftungsbeschränkt) | Transformed Representation for Fingerprint Data with High Recognition Accuracy |
-
2017
- 2017-05-20 WO PCT/CN2017/085234 patent/WO2018213947A1/zh active Application Filing
- 2017-05-20 CN CN201790000061.5U patent/CN208689589U/zh active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101931789A (zh) * | 2009-06-26 | 2010-12-29 | 上海宝康电子控制工程有限公司 | 关键区域中的高清晰人像自动记录及比对系统及其方法 |
CN106202071A (zh) * | 2015-04-29 | 2016-12-07 | 腾讯科技(深圳)有限公司 | 账户信息获取的方法、终端、服务器和系统 |
US20160358010A1 (en) * | 2015-06-08 | 2016-12-08 | Crowd IP Box UG (haftungsbeschränkt) | Transformed Representation for Fingerprint Data with High Recognition Accuracy |
CN106096361A (zh) * | 2016-05-31 | 2016-11-09 | 广东欧珀移动通信有限公司 | 一种指纹解锁方法及移动终端 |
CN106096360A (zh) * | 2016-05-31 | 2016-11-09 | 广东欧珀移动通信有限公司 | 一种解锁控制方法及终端设备 |
Also Published As
Publication number | Publication date |
---|---|
CN208689589U (zh) | 2019-04-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018213946A1 (zh) | 图像识别方法、图像识别装置、电子装置及计算机存储介质 | |
US10970516B2 (en) | Systems and methods for biometric recognition | |
CN105260105B (zh) | 基于指纹传感器的显示屏唤醒方法、装置及移动终端 | |
CN107209855B (zh) | 通过指纹识别认证用户 | |
CN107358144A (zh) | 图像识别系统及电子装置 | |
CN105868613A (zh) | 一种生物特征识别方法、装置和移动终端 | |
KR101632912B1 (ko) | 지문 인식을 이용한 사용자 인증 방법 | |
WO2022127112A1 (zh) | 跨模态人脸识别方法、装置、设备及存储介质 | |
WO2022127111A1 (zh) | 跨模态人脸识别方法、装置、设备及存储介质 | |
US10552596B2 (en) | Biometric authentication | |
CN105303174B (zh) | 指纹录入方法及装置 | |
El_Rahman | Multimodal biometric systems based on different fusion levels of ECG and fingerprint using different classifiers | |
CN107077279B (zh) | 一种压力检测的方法及装置 | |
CN107358145A (zh) | 图像传感器及电子装置 | |
CN103870071A (zh) | 一种触摸源识别方法及系统 | |
WO2018213947A1 (zh) | 图像识别系统及电子装置 | |
CN107408208B (zh) | 用于对用户的生物测量进行分析的方法和指纹感测系统 | |
Nagwanshi et al. | Estimation of centroid, ensembles, anomaly and association for the uniqueness of human footprint features | |
CN112580472A (zh) | 一种快速轻量的人脸识别方法、装置、机器可读介质及设备 | |
CN106156774B (zh) | 影像处理方法及影像处理系统 | |
WO2018213945A1 (zh) | 图像传感器及电子装置 | |
Kankrale et al. | Template level concatenation of iris and fingerprint in multimodal biometric identification systems | |
CN111797075B (zh) | 数据回收方法、装置、存储介质及电子设备 | |
Yu et al. | Fingerprint image preprocessing based on whole-hand image captured by digital camera | |
Patel et al. | Fingerprint matching using two methods |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17910863 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17910863 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27/05/2020) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17910863 Country of ref document: EP Kind code of ref document: A1 |