JP6733790B2 - Mobile terminal, identity verification system and program - Google Patents

Description

The present invention relates to a mobile terminal, a personal identification system and a program used for personal identification processing.

Conventionally, for example, when a credit card is delivered from a credit company to a sending customer, it is necessary to strictly confirm the identity. As a system for that purpose, a system for efficiently performing identity verification and collection/delivery work is disclosed (for example, Patent Document 1). According to Japanese Patent Laid-Open No. 2004-242242, when a pickup/delivery product in which a credit card is enclosed is delivered to a recipient, the delivery/delivery product is delivered after confirming that the recipient is the recipient. Specifically, as a procedure for identity verification, first, the driver in charge of delivery and delivery is face-to-face with the recipient, and the identity of the items listed on the label of the delivery and the driver's license etc. presented by the recipient. Visually check the name and address of the document. Then, enter the recipient's date of birth, the document type data, and the symbol number data described in the personal identification document on the personal identification document into the terminal possessed by the driver in charge of delivery, and read the label. Match with the obtained data. If the verification result is a match, the package is delivered to the recipient.

JP, 2009-237823, A

For example, as a means of confirming the identity in opening a bank account, etc., conventionally, there is no need to forward the mail or the person is limited to the person who has applied for the account opening and performs face-to-face identity verification as described in Patent Document 1. The identity is confirmed by sending mail. Recently, financial institutions are studying methods of completing online identity verification. Under such circumstances, non-face-to-face personal identification is required as a method of personal identification. However, even if it is a non-face-to-face type, it is necessary to strictly verify the identity, as in the face-to-face type.

Therefore, an object of the present invention is to provide a mobile terminal, a personal identification system, and a program for strictly performing personal identification in online transactions.

The present invention solves the above problems by the following means. It should be noted that, for ease of understanding, reference numerals corresponding to the embodiments of the present invention will be given and described, but the present invention is not limited thereto. Further, the configurations described with reference numerals may be appropriately improved, or at least a part of them may be replaced with other components.

A first aspect of the present invention is a mobile terminal (1) having a photographing unit (33), and obtains data necessary for confirming the identity of a user at the time of starting a service, using only the mobile terminal possessed by the user. The guide screen output means (14) for outputting a guide screen designating the arrangement position of the object (9) to be photographed together with the personal identification document (3) on which the facial photograph is posted, and the guide screen output means. According to the outputted guidance screen, possession of the personal identification document (15) and a personal identification image acquisition means (15) for acquiring a personal identification image which is an image including the object and the personal identification document from the photographing unit. By the collation image acquisition unit (19) that acquires the collation image that is the image including the face of the holder from the photographing unit, the personal identification image acquired by the personal identification image acquisition unit, and the collation image acquisition unit. A mobile terminal, comprising: a collation image transmission unit (20) that transmits the acquired collation image to an identity verification server (4) that performs identity verification using the image.
A second invention is, in the portable terminal (1) of the first invention, a repetitive processing means for repeating the processing by the guide screen output means (14) and the processing by the personal identification image acquisition means (15) a plurality of times ( 13), the guide screen output means outputs the guide screen in which the arrangement position of the object (9) is different each time, and the personal identification image acquisition means, the personal identification document (3) of different observation angles. The mobile terminal is characterized in that a plurality of the personal identification images obtained by photographing are acquired from the photographing unit (33).
A third aspect of the present invention is the portable terminal (1) according to the second aspect, wherein the plurality of personal identification images acquired by the personal identification image acquisition means (15) capture the object (9) at the same observation angle. The mobile terminal is characterized by being
A fourth aspect of the present invention is the portable terminal (1) according to the second aspect of the present invention, wherein the plurality of personal identification images acquired by the personal identification image acquisition means (15) include the object (9) as the personal identification document ( The mobile terminal is characterized in that it is taken at the same observation angle as in 3).
A fifth aspect of the present invention is, on the portable terminal (1) of the first aspect, a repetitive processing means (the processing by the guide screen output means (14) and the processing by the personal identification image acquisition means (15) are repeated a plurality of times ( 13), the guide screen output means outputs the guide screen in which the arrangement position of the target object is different each time, and the personal identification image acquisition means includes a plurality of the personal identification document images captured from different image capturing directions. The personal identification image is acquired from the photographing unit (33), which is a mobile terminal.
A sixth aspect of the present invention is the portable terminal (1) according to any one of the second aspect to the fifth aspect, wherein at least one of the plurality of personal identification images acquired by the personal identification image acquisition means (15) is acquired. The personal identification image is a portable terminal characterized in that the thickness and face image of the personal identification document (3) can be confirmed.
A seventh invention is the portable terminal (1) according to any one of the first invention to the sixth invention, wherein the guide screen output means (14) is randomly determined from a plurality of predetermined positions. The mobile terminal is characterized in that the guide screen including the arranged position of the object (9) is output.
An eighth invention is the portable terminal (1) according to any one of the first invention to the sixth invention, wherein the guide screen output means (14) is random within a predetermined area of the guide screen. And outputting the guidance screen including the arrangement position of the object (9) determined in step 1.
A ninth invention is the portable terminal (1) according to any one of the first invention to the eighth invention, wherein the guide screen output means (14) uses the arrangement position of the object (9) as a frame line. The mobile terminal is characterized by outputting the guide screen shown.
A tenth aspect of the present invention is the portable terminal (1) according to any one of the first to ninth aspects, wherein the guide screen output means (14) indicates that the arrangement position of the object (9) is circular or The mobile terminal is characterized in that the guide screen shown as an elliptical shape is output, and the object includes a coin.
An eleventh invention is the portable terminal (1) according to any one of the first invention to the tenth invention, wherein the guide screen output means (14) confirms the identity together with the arrangement position of the object (9). The mobile terminal is characterized in that the guide screen designating the arrangement position of the document (3) is output.
A twelfth invention is the mobile terminal (1) according to the eleventh invention, wherein the guide screen output means (14) shows the arrangement position of the personal identification document (3) as a rectangular or trapezoidal frame line. A mobile terminal, characterized in that the guide screen is output.
A thirteenth invention is the mobile terminal (1) according to any one of the first to twelfth inventions, wherein the object is based on the identity verification image acquired by the identity verification image acquisition means (15). (9) and legitimacy confirmation means (16) for confirming the legitimacy of the personal identification document (3), and the collation image acquisition means (19) was able to confirm the legitimacy by the legitimacy confirmation means. In this case, the collation image is acquired, which is a portable terminal.
A fourteenth invention is a portable terminal (1) according to any one of the first invention to the thirteenth invention, in which blink detection is performed to detect a blink from an image of the face of the holder acquired from the imaging unit (33). A portable terminal comprising means (18), wherein the collation image acquisition means (19) acquires the collation image photographed by the photographing unit after the blink detection means detects a blink.
A fifteenth aspect of the present invention is an identity verification including a mobile terminal (1) having an image capturing unit (33) and an identity verification server (4) communicably connected to the mobile terminal and performing identity verification processing. In the system (100), the mobile terminal acquires data necessary for confirming the identity of the user at the time of service start, using only the mobile terminal owned by the user, and a face photograph is posted. According to the guide screen output means (14) for outputting a guide screen designating the arrangement position of the object (9) to be photographed together with the personal identification document (3), and the guide screen output by the guide screen output means. A personal identification image acquiring unit (15) for acquiring a personal identification image, which is an image including the object and the personal identification document, from the photographing unit, and an image including a face of a holder who has the personal identification document. A collation image acquisition unit (19) that acquires a collation image from the photographing unit, the personal identification image acquired by the personal identification image acquisition unit, and the collation image acquired by the collation image acquisition unit, A matching image transmitting unit (20) for transmitting to the personal identification server, wherein the personal identification server collates the collation image received from the mobile terminal with a facial photograph image included in the personal identification image. A matching means (43) and a result transmitting means (44) for transmitting the matching result information by the face matching means to the mobile terminal, the mobile terminal based on the received matching result information. A service start determination means (22) for determining whether to start service processing between a mobile terminal and a service providing server (7) communicably connected to the personal identification server and performing service processing. Is a personal identification system characterized by.
A sixteenth aspect of the invention is that the computer (1) possessed by the user, which has a photographing unit (33) and is used to acquire the data necessary for identifying the user at the time of starting the service, is the person who has the facial photograph. According to the guide screen output means for outputting a guide screen specifying the arrangement position of the object (9) to be photographed together with the confirmation document (3), and the guide screen output by the guide screen output means, the object and the object An identity verification image acquisition unit that acquires an identity verification image that is an image including an identity verification document from the imaging unit, and a matching image that is an image that includes the face of the holder who possesses the identity verification document, the imaging unit From the verification image acquisition unit, the verification image acquired by the verification image acquisition unit, and the verification image acquired by the verification image acquisition unit, a verification server that performs verification using an image ( 4) is a program (31b) for functioning as a collation image transmission means for transmission to 4).

According to the present invention, it is possible to provide a mobile terminal, a personal identification system, and a program for strictly performing personal identification in online transactions.

It is a figure showing the whole personal identification system composition concerning this embodiment. It is a functional block diagram of the portable terminal which concerns on this embodiment. It is a functional block diagram of an identity verification server concerning this embodiment. It is a flow chart which shows service start processing in a personal digital assistant concerning this embodiment. It is a flow chart which shows the identity verification processing in the personal digital assistant concerning this embodiment. It is a flow chart which shows personal identification image processing in a personal digital assistant concerning this embodiment. It is a figure which shows the example of a pattern of the guidance screen which concerns on this embodiment. It is a figure which shows the example of a display in the portable terminal which concerns on this embodiment. It is a flow chart which shows legitimacy confirmation processing in the personal digital assistant concerning this embodiment. It is a flow chart which shows the image analysis processing in the personal identification system concerning this embodiment. It is a figure which shows the example of a display in the portable terminal which concerns on this embodiment. It is a figure which shows the example of a display in the portable terminal which concerns on this embodiment. It is a flow chart which shows the collation image processing in the personal identification system concerning this embodiment. It is a figure which shows the example of a display in the portable terminal which concerns on this embodiment. It is a figure which shows the example of a pattern of the guidance screen which concerns on a modification. It is a figure which shows the example of a display mode of the guidance screen which concerns on a modification. It is a figure which shows the example of a display and the example of a pattern of a guidance screen in the portable terminal which concerns on a modification.

Hereinafter, modes for carrying out the present invention will be described with reference to the drawings. Note that this is merely an example, and the technical scope of the present invention is not limited to this.
(Embodiment)
FIG. 1 is a diagram showing an overall configuration of an identity verification system 100 according to the present embodiment.
FIG. 2 is a functional block diagram of the mobile terminal 1 according to the present embodiment.
FIG. 3 is a functional block diagram of the identity verification server 4 according to the present embodiment.
The personal identification system 100 shown in FIG. 1 is a system for performing personal identification required only when the first service of various services is started, using only the mobile terminal 1. Further, the personal identification system 100 is a system in which personal identification required at the start of the second and subsequent services is performed only by the mobile terminal 1.

Here, the various services are, for example, services related to opening an account in a bank, various banking services, car sharing services, renting of real estate, and the like, and are various services that require identification. Here, in the present embodiment, the case of starting a transaction with a financial institution such as opening an account will be described as an example, and the identity verification in the invention is a confirmation for enabling an online procedure using a mobile terminal or the like. Refers to processing. On the other hand, the personal authentication means a state in which the person has already been confirmed, and which prevents spoofing or the like at the time of starting the service for the second time or later.
In the following description, a case will be described as an example in which the mobile terminal 1 is used to start a service that requires identification and authentication.

The identity verification system 100 includes a mobile terminal 1 and an identity verification server 4. The mobile terminal 1 can be connected to the communication network N via a base station R for wireless communication, for example. The identity verification server 4 is communicably connected via the communication network N.
The personal identification system 100 is connected to the service providing server 7 via the communication network N. The service providing server 7 is a server for performing service processing with the mobile terminal 1.

The mobile terminal 1 is, for example, a terminal carried by a person who wants to receive the service provided by the service providing server 7. Hereinafter, a person who intends to receive the service is referred to as a user (owner). The mobile terminal 1 is, for example, a mobile device that also has the functions of a computer represented by a smartphone or a tablet.
As shown in FIG. 2, the mobile terminal 1 includes a control unit 10, a storage unit 30, a camera 33 (imaging unit), a touch panel display 35, and a communication interface unit 39.

The control unit 10 is a CPU (central processing unit) that controls the entire mobile terminal 1. The control unit 10 performs various functions in cooperation with the above-described hardware by appropriately reading and executing an operating system (OS) and various application programs stored in the storage unit 30.
The control unit 10 includes an application calling unit 11, an identity confirmation unit 12, an identity authentication unit 21, and a service start determination unit 22 (service start determination means).

When executing the transaction application 31a, the application calling unit 11 receives a request for identity verification or identity authentication from the service providing server 7 that performs processing corresponding to the transaction application 31a, and executes the identity verification application 31b (program). call.
The identity verification unit 12 is a control unit that performs identity verification processing. The identity verification unit 12 includes an identity verification image processing unit 13 (repetition processing means) and a collation image processing unit 17.

The personal identification image processing unit 13 includes a guide screen output unit 14 (guidance screen output unit), a personal identification image acquisition unit 15 (personal confirmation image acquisition unit), and a validity confirmation unit 16 (validity confirmation unit). ..
The identity verification image processing unit 13 acquires an image required for identity verification by repeating the processing by the guidance screen output unit 14, the identity verification image acquisition unit 15, and the validity verification unit 16 multiple times.

The guidance screen output unit 14 outputs, on the touch panel display 35, a guidance screen that specifies the document position that is the arrangement position of the identification document and the coin position that is the arrangement position of the coin (object) to be photographed together with the identification document. To do.
Here, the personal identification document is a publicly recognized identification card in which a facial photograph of the user is posted. A driver's license 3 is shown in FIG. 1 as an example of an identification document. In addition, the personal identification document may be a my number card or the like on which a face photograph of the user is posted.
Further, the type of coins is not limited.
Further, the guide screen is displayed together with the through image in the state where the through image by the camera 33 is displayed on the touch panel display 35. Here, the through image is an image in which the shooting range of the camera 33 is displayed on the touch panel display 35. Further, as will be described later, the coin positions when the guide screen is output multiple times are different positions.
The identity verification image acquisition unit 15 acquires the identity verification image, which is an image including the identity verification document and the coin, by the user operating the camera 33 to integrally photograph the identity verification document and the coin. ..

The legitimacy confirming unit 16 confirms the legitimacy of the personal identification image. For example, when nothing is reflected in at least one of the document position and the coin position, the validity checking unit 16 determines that the validity cannot be checked and gives an error. Even if the identity verification document is reflected in the document position, the validity checking unit 16 validates the identity verification document, that is, when the character cannot be recognized from the image of the identity verification document. It is an error because the sex cannot be confirmed. In addition, even if the validity confirmation unit 16 can recognize the identity verification document, if the validity period of the identity verification document has expired, the validity verification unit 16 determines that the validity cannot be verified and makes an error.

Then, the identity verification image processing unit 13 stores the acquired identity verification image in the acquired image storage unit 32 when the validity can be confirmed. Further, the personal identification image processing unit 13 extracts a facial photograph image, which is a portion of the facial photograph of the personal identification document, from the acquired personal identification image. Then, the personal identification image processing unit 13 stores the extracted face photograph image in the acquired image storage unit 32.

The collation image processing unit 17 acquires the face image of the user and collates it with the face photograph of the identity verification document. The collation image processing unit 17 includes a blink detection unit 18 (blink detection unit), a collation image acquisition unit 19 (collation image acquisition unit), and an image transmission unit 20 (collation image transmission unit).
First, in order to obtain a face image of the user, the user keeps the camera 33 in a position where the face of the user is captured and continues to take a picture of the face of the user. Then, the blink detection unit 18 detects the blink from the acquired captured image.
The collation image acquisition unit 19 acquires the face image of the user captured by the camera 33 as a collation image used for collation after the blink detection unit 18 detects the blink.
The image transmission unit 20 transmits the acquired collation image and the facial photograph image stored in the acquired image storage unit 32 to the personal identification server 4 for collation.

The personal authentication unit 21 is a control unit that performs personal authentication. The personal authentication unit 21 includes a collation image processing unit 17. That is, the person authenticating unit 21 acquires a collation image which is a user's face image after the blink detection by the camera 33, and acquires the collation image and the face photo image stored in the acquired image storage unit 32. It is sent to the identity verification server 4.
The service start determination unit 22 receives the matching result (matching result information) from the identity verification server 4 and determines whether the service can be started based on the received matching result.

The storage unit 30 is a storage area such as a semiconductor memory device for storing programs, data, and the like necessary for the control unit 10 to execute various processes.
The storage unit 30 includes a program storage unit 31 and an acquired image storage unit 32.
The program storage unit 31 is a storage area that stores various application programs (hereinafter, application programs are referred to as applications, applications, programs, or the like). The program storage unit 31 stores a transaction application 31a.

The transaction application 31a is installed in the mobile terminal 1 in advance, or downloaded to the mobile terminal 1 by communicating with an application distribution server (not shown) via the communication network N.
The transaction application 31a is a program for performing service processing with the service providing server 7. The transaction application 31a is, for example, an application for opening a bank account. The transaction application 31a includes a personal identification application 31b.
The identity verification application 31b is a program for performing various functions of identity verification and identity authentication executed by the control unit 10 of the mobile terminal 1.
Although the transaction application 31a is described as including the identity verification application 31b in the present embodiment, the transaction application 31a and the identity verification application 31b may be different applications.

The acquired image storage unit 32 is a storage area that stores the image acquired by the camera 33. The acquired image storage unit 32 stores the personal identification image. Further, the acquired image storage unit 32 stores the face photograph image extracted from the personal identification image.

The camera 33 is a photographing device. The camera 33 has an in-camera 33a and an out-camera 33b. The in-camera 33a is a camera provided on the side of the touch panel display 35 of the mobile terminal 1. The out-camera 33b is a camera provided on the back side of the mobile terminal 1.
The touch panel display 35 has a function as a display unit including a liquid crystal panel and the like, and a function as an input unit for inputting various operations by the user's finger.
The communication interface unit 39 is an interface for performing communication with various servers via the base station R and the communication network N, and functions as a transmission unit and a reception unit.

Returning to FIG. 1, the driver's license 3 is in the form of a card, and is a public identification card as described above. On the surface of the driver's license 3, personal information of the user including the user's address, name, date of birth, and user's face photograph is described. Further, on the surface of the driver's license 3, the expiration date, the license number, the date of grant, the color type (whether gold or not, etc.) are described. In the personal identification system 100, the user of the mobile terminal 1 takes a picture of his/her driver's license 3 or the like using the mobile terminal 1.

The identity verification server 4 is a server that performs identity verification by online procedure with the mobile terminal 1 and performs identity verification by face authentication. The identity verification server 4 is assumed to be owned by a company different from the company providing the service, but is not limited to this.
As shown in FIG. 3, the identity verification server 4 includes a control unit 40, a storage unit 50, and a communication interface unit 59.

The control unit 40 is a CPU that controls the entire identity verification server 4. The control unit 40 cooperates with the above-described hardware to execute various functions by appropriately reading and executing the OS and application programs stored in the storage unit 50.
The control unit 40 includes a personal identification image analysis unit 41, a face matching unit 43 (face matching unit), and a matching result transmitting unit 44 (result transmitting unit).

The personal identification image analysis unit 41 receives from the mobile terminal 1 a personal identification image including an image of the surface of the personal identification document. Then, the personal identification image analysis unit 41 converts the characters included in the personal identification document of the personal identification image into text by OCR (optical character recognition). After that, the personal identification image analysis unit 41 transmits the text-formed character string to the mobile terminal 1.
The face matching unit 43 receives the matching image transmitted by the mobile terminal 1 and the face photograph image. Then, the face collating unit 43 collates the received collation image with the face photograph image. Here, the face matching unit 43 may show the matching result between the matching image and the face photograph image by a score. For example, the face matching unit 43 performs image matching processing and calculates the degree of matching between the face photograph images as a score. Here, the score is represented by a numerical value from 0 to 100, for example, and the higher the degree of coincidence, the higher the numerical value.
The collation result transmission unit 44 transmits the collation result to the mobile terminal 1.

The storage unit 50 is a storage area such as a hard disk or a semiconductor memory device for storing programs, data, and the like necessary for the control unit 40 to execute various processes.
The storage unit 50 includes a program storage unit 51. The program storage unit 51 is a storage area that stores various programs. The program storage unit 51 stores a personal identification program 51a.
The identity verification program 51a is a program for performing various functions executed by the control unit 40 of the identity verification server 4.
The communication interface unit 59 is an interface for performing communication with various servers such as the service providing server 7 and the mobile terminal 1 via the communication network N.

Here, the computer refers to an information processing device including a control unit, a storage device, and the like, and the mobile terminal 1 and the identity verification server 4 are information processing devices including a control unit and a storage unit, respectively. Included in the concept.

The service providing server 7 shown in FIG. 1 is a server for performing service processing. In FIG. 1, the personal identification system 100 shows only one service providing server 7, but a plurality of servers may be provided for each service.
Although not shown, the service providing server 7 includes a control unit, a storage unit, a communication interface unit, and the like.

The base station R shown in FIG. 1 is a base station for wireless communication, and relays for the mobile terminal 1 to communicate with various servers. The base station R is, for example, a wireless LAN (Local Area Network) base station or a base station for a mobile terminal communication network of a communication carrier.
The communication network N is a network between various servers or between various servers and the base station R, and is an Internet line, a mobile terminal communication network, or the like.

Next, the processing of the personal identification system 100 will be described.
FIG. 4 is a flowchart showing a service start process in the mobile terminal 1 according to this embodiment.
First, a user who wants to start a service, for example, when the transaction application 31a is installed in the mobile terminal 1 in advance, has an icon (not shown) of the transaction application 31a displayed on the touch panel display 35 of his/her mobile terminal 1. Select operation such as tapping. Further, for example, when the transaction application 31a is downloaded to the mobile terminal 1 for the first time, the user performs a selection operation such as tapping the icon of the transaction application 31a provided on the touch panel display 35 of his/her mobile terminal 1 at the time of downloading. do. By doing so, the control unit 10 of the mobile terminal 1 executes the transaction application 31a.

When the transaction application 31a is executed, the main screen (not shown) of the transaction application 31a is displayed on the touch panel display 35 of the mobile terminal 1. Therefore, when the user performs an operation for starting a service (for example, an operation for selecting a menu) from the main screen, the mobile terminal 1 starts the service in step S10 (hereinafter, simply referred to as “S”) in FIG. An operation is accepted and, for example, processing for starting the service is executed. After that, the control unit 10 (application calling unit 11) calls the personal identification application 31b.

In S11, the control unit 10 determines whether or not the identity verification process has been completed. The case where the identity verification processing is completed means a case where the identity verification processing has already been performed because the service using the transaction application 31a has already been performed once. Therefore, the case where the personal identification processing has been completed corresponds to the case where the second or subsequent service start is accepted. Further, the case where the identity verification processing is not completed corresponds to the case where the service start using the transaction application 31a is accepted for the first time.
It should be noted that the control unit 10 may determine whether or not the identity confirmation processing has been completed, for example, by storing that the identity confirmation has been completed in the identity verification application 31b, and judge based on that. .. Further, when the identity verification processing is completed, the identity verification image and the facial photograph image are stored in the acquired image storage unit 32, and therefore the control unit 10 stores the facial photograph image in the acquired image storage unit 32. You may judge by whether or not it is done.
When the identity verification processing has been completed (S11: YES), the control unit 10 shifts the processing to S13. On the other hand, when the identity verification processing is not completed (S11: NO), the control unit 10 shifts the processing to S12.
In S12, the control unit 10 (identity confirmation unit 12) performs an identification process.

Here, the personal identification processing performed by the mobile terminal 1 will be described.
FIG. 5 is a flowchart showing the identity verification processing in the mobile terminal 1 according to the present embodiment.
FIG. 6 is a flowchart showing the personal identification image processing in the mobile terminal 1 according to this embodiment.
FIG. 7 is a diagram showing a pattern example of the guide screen according to the present embodiment.
FIG. 8 is a diagram showing a display example on the mobile terminal 1 according to the present embodiment.
FIG. 9 is a flowchart showing the validity confirmation process in the mobile terminal 1 according to the present embodiment.
FIG. 10 is a flowchart showing image analysis processing in the personal identification system 100 according to this embodiment.
11 and 12 are diagrams showing display examples on the mobile terminal 1 according to the present embodiment.
FIG. 13 is a flowchart showing the collation image processing in the personal identification system 100 according to this embodiment.
FIG. 14 is a diagram showing a display example on the mobile terminal 1 according to the present embodiment.

In S20 of FIG. 5, the control unit 10 (identity confirmation image processing unit 13) of the mobile terminal 1 performs identity verification image processing on the front side of the identity verification document.
Here, the personal identification image processing will be described with reference to FIG.
In S30 of FIG. 6, the control unit 10 (guidance screen output unit 14) performs coin position determination processing. The personal identification application 31b is prepared in advance with six patterns of guidance screens with different coin positions, for example, guidance screens 61 to 66 shown in FIG. The guide screen 61 has a coin position 61b provided on the upper right side of the document position 61a. The guide screen 62 is provided with a coin position 62b at the right center of the document position 62a. The guide screen 63 has a coin position 63b provided on the lower right side of the document position 63a. Similarly, in the guide screens 64 to 66, coin positions 64b to 66b are respectively provided on the left side of the document positions 64a to 66a in order from the upper side.
The control unit 10 randomly determines one guidance screen from the guidance screens 61 to 66, for example. Here, to determine at random means to display all the guide screens in random order. However, only some of the guide screens may be designated instead of all the guide screens.

In S31 of FIG. 6, the control unit 10 (guide screen output unit 14) outputs the guide screen determined by the coin position determination processing to the touch panel display 35. At that time, the control unit 10 causes the out-camera 33b to be executed and causes the touch panel display 35 to display the determined guide screen in a state where the through-image by the out-camera 33b is output.
As shown in FIG. 8A, the user looks at the displayed guidance screen 64 and puts the driving license 3 and the coins 9 into the frame of the guidance screen so that the driving license 3 and the coins 9 can be accommodated in the frame of the guidance screen. And the position of the mobile terminal 1 is adjusted.
In a state in which the driver's license 3 and the coin 9 are accommodated within the frame of the guide screen 64, the user operates the photographing button 64c displayed on the guide screen 64, and in S32, the control unit 10 causes Accept a shooting operation.

In S33, the control unit 10 (identity confirmation image acquisition unit 15) acquires the identity verification image 68a shown in FIG. 8(B). Then, the control unit 10 outputs the confirmation screen 68 including the personal identification image 68a as shown in FIG. 8B to the touch panel display 35. When the user wants to take a picture again, he/she can touch the button "retake picture" to return to the guide screen 64 shown in FIG. 8A and take the person confirmation image again.
For example, when the user touches the “next” button shown in FIG. 8B, the control unit 10 (validity confirmation unit 16) causes the validity confirmation shown in FIG. 9 in S34 of FIG. Perform processing.

In S40 of FIG. 9, the control unit 10 determines whether or not the object can be recognized at the coin position by performing a known image recognition process on the identity verification image. When the object can be recognized (S40: YES), the control unit 10 shifts the processing to S41. On the other hand, when the object cannot be recognized (S40: NO), the control unit 10 shifts the processing to S49.
In S41, the control unit 10 determines whether or not an object can be recognized at the document position. When the object can be recognized (S41: YES), the control unit 10 shifts the processing to S41. On the other hand, when the object cannot be recognized (S41: NO), the control unit 10 shifts the processing to S49.

In S42, the control unit 10 determines whether or not this process is a process relating to the surface. For example, the control unit 10 determines that the process is a process related to the surface when the process is the transition from S20 of FIG. 5, but the process is a process based on the transition from S23 or S24 of FIG. It is determined that the process is not related to. When the process is related to the surface (S42: YES), the control unit 10 shifts the process to S43. On the other hand, if the process is not for the surface (S42: NO), the controller 10 shifts the process to S45.
In S43, the control unit 10 performs the image analysis process shown in FIG.

In S50 of FIG. 10, the control unit 10 transmits the acquired identity verification image to the identity verification server 4.
In S51, the control unit 40 of the identity verification server 4 receives the identity verification image.
In S52, the control unit 40 (identity confirmation image analysis unit 41) acquires character information in which the identity verification document included in the received identity verification image is converted into text.
In S53, the control unit 40 transmits the acquired character information to the mobile terminal 1. It should be noted that the control unit 40, for example, when the character information cannot be obtained from the personal identification document because the image of the personal identification document is small or unclear, the control unit 40 indicates that the character information cannot be obtained. , May be transmitted to the mobile terminal 1. After that, the control unit 40 ends this processing.

In S54, the control unit 10 of the mobile terminal 1 receives the character information.
In S55, the control unit 10 confirms the validity based on the received character information. For example, when the control unit 10 receives from the identity verification server 4 that the character information has not been obtained, the control unit 10 cannot verify the validity. Further, the control unit 10 cannot confirm the validity when the expiration date of the personal identification document has expired. After that, the control unit 10 shifts the processing to S44 of FIG.

In S44 of FIG. 9, the control unit 10 (validity confirmation unit 16) determines whether or not the validity of the character information has been confirmed. When the validity can be confirmed (S44: YES), the control unit 10 shifts the processing to S45. On the other hand, when the validity cannot be confirmed (S44: NO), the control unit 10 moves the process to S49.
In S45, the control unit 10 (validity confirmation unit 16) moves the process to S35 in FIG. 6 assuming that the validity of the personal identification image can be confirmed.
On the other hand, in S49, the control unit 10 (validity confirmation unit 16) determines that the validity of the personal identification image could not be confirmed, and moves the process to S35 of FIG.

In S35 of FIG. 6, it is determined whether the legitimacy has been confirmed. When the validity can be confirmed (S35: YES), the control unit 10 moves the process to S36. On the other hand, when the validity cannot be confirmed (S35: NO), the control unit 10 shifts the processing to S39.
In S36, the control unit 10 stores the acquired identity verification image in the acquired image storage unit 32. After that, the control unit 10 shifts the processing to S21 of FIG.
On the other hand, in S39, the control unit 10 outputs the fact that the validity is an error, for example, to the touch panel display 35, and terminates this process without proceeding to the next.

In S21 of FIG. 5, the control unit 10 extracts a facial photograph image from the acquired personal identification image.
In S22, the control unit 10 stores the extracted face photograph image in the acquired image storage unit 32.
The processing of S23 and S24 is the same as the processing of FIG. 6 described above.

FIG. 11A shows a guide screen 81 for acquiring a personal identification image including the image on the back surface of the driver's license 3. FIG. 11B shows a confirmation screen 82.
FIG. 12A shows a guide screen 83 for obliquely obtaining a personal identification image including an image of the surface of the driver's license 3. In this state, the out-camera 33b of the mobile terminal 1 is placed at the same position as when the front surface or the back surface of the driver's license 3 is photographed, and the driver's license 3 is made to stand diagonally with the user's finger or the like. This is for obliquely photographing the surface of the driver's license 3. The guide screen 83 has a trapezoidal shape so that the frame indicating the document position 83a encourages photographing from an oblique direction. The coin position 83b is located at the lower right of the document position 83a. In this way, on the guide screen for obtaining the personal identification image including the image of the surface of the driver's license 3 from the diagonal direction, for example, the coin position is in the lower right, center lower, and lower left of the document position. An image may be prepared in advance, and the control unit 10 may randomly determine the guide screen of one pattern from the images. When photographing from an oblique direction, there is a space above and below the document position, so it is possible to arrange the coin position in such a front direction. FIG. 12B shows the confirmation screen 84.

In this way, the guide screens 81 and 83 are screens in which the words 81e and 83e are different depending on the object to be imaged, and the coin positions 81b and 83b are different.
As described above, when photographing the driver's license 3, the control unit 10 first photographs the front surface of the driver's license 3, then the rear surface of the driver's license 3, and finally the driver's license 3. The driver's license 3 is controlled so as to be photographed from an oblique direction with the surface visible.
By doing so, when the driver's license 3 is photographed a plurality of times, it is possible to output a guide screen in which coin positions are arranged at various positions.

In S25 of FIG. 5, the control unit 10 (matching image processing unit 17) performs the matching image processing shown in FIG.
In S60 of FIG. 13, the control unit 10 activates the in-camera 33a and outputs the face shooting screen 85 shown in FIG. 14 including the through image of the in-camera 33a to the touch panel display 35. The user adjusts the position of the mobile terminal 1 so that the face of the user can enter the face frame 85a of the face shooting screen 85.
In S61 of FIG. 13, the control unit 10 performs a known face recognition process on the captured image acquired from the in-camera 33a to detect the eyes.
In S62, the control unit 10 (blink detection unit 18) determines whether or not a blink has been detected. When the blink is detected (S62: YES), the control unit 10 shifts the processing to S63. On the other hand, when the blink is not detected (S62: NO), the control unit 10 stays in this process until the blink is detected.

In S63, the control unit 10 (matching image acquisition unit 19) sets the face image captured after the blink is detected as the matching image.
In S<b>64, the control unit 10 (image transmission unit 20) transmits the acquired collation image together with the facial photograph image stored in the acquired image storage unit 32 to the identity verification server 4. Here, the facial photograph image stored in the acquired image storage unit 32 is an image captured and stored by the mobile terminal 1 in the personal identification image processing.
In S65, the control unit 40 (face matching unit 43) of the identity verification server 4 receives the matching image and the face photograph image from the mobile terminal 1.

In S66, the control unit 40 (face matching unit 43) performs face matching processing for matching the matching image with the face photograph image. The control unit 40 performs the image matching process, and calculates, for example, the degree of matching between the matching image and the face photograph image as a score.
In S67, the control unit 40 (matching result sending unit 44) sends the matching result to the mobile terminal 1. After that, the control unit 40 ends this processing.
In S68, the control unit 10 (the matching image processing unit 17) of the mobile terminal 1 receives the matching result. After that, the control unit 10 shifts the processing to S14 of FIG.

In S13 of FIG. 4, the control unit 10 (personal authentication unit 21) performs the person authentication process. The control unit 10 performs the same processing as the collation image processing described in FIG. 13 as the personal authentication processing. The control unit 10 acquires the matching image used in the matching image processing, and sends it to the identity verification server 4 together with the facial photograph image already stored in the acquired image storage unit 32. In the identity verification server 4, the control unit 40 (the face matching unit 43, the matching result transmitting unit 44) matches the matching image with the face photograph image, and transmits the matching result to the mobile terminal 1.

In S14, the control unit 10 (service start determination unit 22) determines whether or not the authentication is successful based on the collation result. For example, when the score obtained as the collation result is equal to or more than the threshold value, the control unit 10 determines that the authentication is successful. When it is determined that the authentication is successful (S14: YES), the control unit 10 moves the process to S15. On the other hand, when it is not determined that the authentication is successful (S14: NO), the control unit 10 moves the process to S16.
In S15, the control unit 10 performs service processing with the service providing server 7 corresponding to the transaction application 31a. After that, the control unit 10 ends this processing.

On the other hand, in S16, the control unit 10 outputs a message of the authentication error to the touch panel display 35. After that, the control unit 10 ends this processing. In other words, if the result of the verification of the face image and the face photograph image of the personal identification document cannot be verified by the process of the personal identification or the personal authentication, the service process is not started. In the case of an authentication error, the control unit 10 preferably deletes the image stored in the acquired image storage unit 32.

As described above, according to the present embodiment, the personal identification system 100 has the following effects.
(1) When providing a service using the mobile terminal 1, if the mobile terminal 1 has the camera 33, it is convenient because the identity can be confirmed using only the mobile terminal 1. In other words, the user can provide the user with an environment for confirming the identity anytime, anywhere without the hassle of going to a window or the like. In addition, security is high because the identification is performed using biometric information. Further, it is not necessary to register biometric information in advance such as a fingerprint, which is highly convenient.
(2) Since the process of acquiring the personal identification image and the process of collating the facial photograph image acquired from the personal identification image with the own facial image taken by the user can be performed in a series of flows, It is convenient.

(3) Since the guidance screen designating the arrangement positions of the driving license 3 and the coins 9 is output, the user places the driving license 3 and the coins 9 at the designated positions according to the instructions on the guidance screen. .. Then, since the mobile terminal 1 acquires the personal identification image including the driver's license 3 and the coin 9 arranged by the user according to the instruction on the guidance screen, the user is instructed on the guidance screen each time the personal identification image is acquired. It can be something that complies. Therefore, randomness can be ensured by the arrangement position of the driver's license 3 and the coin 9 on the guide screen.

(4) As necessary for identity verification, the guidance screen is output multiple times to obtain identity verification images of the driver's license 3 and the coin 9 from different imaging directions. Since the guide screen changes the arrangement position of the coins 9 and arranges the coins at different positions each time, it is possible to require the user to perform an operation when the user takes an image. Therefore, it becomes a mechanism that the image taken in advance cannot be used, and it is possible to make it difficult to act fraudulently. Also, since the driver's license 3 is photographed from an oblique direction, it becomes possible to confirm the thickness of the driver's license 3 while checking the content of the driver's license 3 or the facial photograph of the driver's license 3, whether it is a fake or not. Can be confirmed.

(5) Since the guide screen is randomly determined from a plurality of predetermined coin positions, randomness can be ensured and processing can be simplified.
(6) Since the guide screen has the arrangement position indicated by the frame line and the effect position is indicated by the same circular shape as the coin, the guide screen can be easily understood by the user.

(7) The legitimacy of the personal identification image is confirmed, and when the legitimacy is confirmed, the collation image is acquired. Therefore, in the case of fraud, it is possible to stop the process at the previous stage without collating. it can.
(8) Since the user's face image is the image after detecting the user's blink, an image suitable for the collation image can be acquired.

Although the embodiment of the invention has been described above, the invention is not limited to the embodiment described above. In addition, the effects described in the embodiments are merely enumeration of the most suitable effects generated by the present invention, and the effects according to the present invention are not limited to those described in the embodiments. It should be noted that the above-described embodiment and the modification described later can be appropriately combined and used, but detailed description thereof will be omitted.

(Variation)
(1) In the present embodiment, the guide screen is prepared in advance with six patterns having different coin positions, and a guide screen randomly selected from them is output. Not limited. For example, the coin position may be set at an arbitrary position within a predetermined designated area.
FIG. 15 is a diagram showing a pattern example of a guide screen according to the modification.
The guide screen 291 illustrated in FIG. 15A includes a document position 291a and a coin area 291b. The guide screen 291 shows the coin position to the right, and the document position 291a is arranged to the left. In this case, the control unit of the mobile terminal 1 randomly determines the coin position in the range of the coin area 291b and outputs the coin position (not shown).

The guide screen 292 illustrated in FIG. 15B includes a document position 292a and a coin area 292b. The guide screen 292 shows the coin position on the left side and the document position 292a on the right side. In this case, the control unit of the mobile terminal 1 randomly determines the coin position in the range of the coin area 292b and outputs the coin position (not shown).
By doing so, the control unit of the mobile terminal 1 randomly determines the coin position in the coin area after determining whether the coin position is on the right side or the left side of the document position. Can be rich in.

(2) In the present embodiment, an example has been described in which the document position and the coin position output on the guide screen are indicated by frame lines, but the present invention is not limited to this. The guide screen may be displayed by another method as long as it shows the document position and the coin position in a manner easily understood by the user.
FIG. 16 is a diagram showing a display mode example of a guide screen according to the modification.
The guide screen 295 shown in FIG. 16(A) shows the document position 295a and the coin position 295b by broken lines.
The guide screen 296 shown in FIG. 16B shows the document position 296a in a hook shape.
Alternatively, the document position and the coin position may be displayed in a clear state so as to have transparency, and the range excluding the document position and the coin position may be displayed in a blurred state, for example. Further, a frame line or the like indicating the document position and the coin position may be displayed so as to be repeatedly displayed and hidden with the passage of time. Further, although the coin position is shown as a circular shape, it may be an elliptical shape or a polygonal shape.

(3) In the present embodiment, when photographing the personal identification document from an angle, the driver's license 3 is made to stand upright on a desk or the like by the user's finger or the like, and the driver's license 3 is displayed from above. The description has been made by taking an example of shooting, but the present invention is not limited to this. For example, even if an identity verification document such as a driver's license 3 is placed on a desk or the like with the front side facing upward and the identity verification document is photographed from an oblique direction, the identity confirmation documents at different observation angles can be photographed.

FIG. 17 is a diagram showing a display example and a guide screen pattern example on the mobile terminal 1 according to the modification.
FIG. 17(A) shows a guide screen 297 for capturing and acquiring the personal identification image including the image of the surface of the driver's license 3 from an oblique direction. This means that the out-camera 33b of the mobile terminal 1 is placed at an oblique position, not on the position facing the surface of the driver's license 3 while the surface of the driver's license 3 is placed on, for example, a desk. This is for taking a picture and obtaining an identity verification image. Specifically, the oblique position is, for example, a position where the photographing angle is about 45 to 60 degrees and the face photograph on the surface of the driver's license 3 can be recognized. The guide screen 297 has a trapezoidal shape in which the front (lower) side is long so that the frame indicating the document position 297a prompts photographing from an oblique direction. Here, the control unit 10 of the mobile terminal 1 may randomly determine the shooting angle and output a trapezoidal shape corresponding to the determined shooting angle. The coin position 297b is arranged in an elliptical shape at the lower left of the document position 297a.

On the guide screen for photographing and obtaining the personal identification image including the image of the surface of the driver's license 3 from an oblique direction, for example, the coin image has three patterns of the lower right, center lower, and lower left of the document position. May be prepared in advance.
FIG. 17B shows a guide screen 298 in which the coin position 298b is located below the center of the document position 298a. 17C shows a guide screen 299 in which the coin position 299b is located at the lower right of the document position 299a. In this way, in the guide screen for capturing and acquiring the personal identification image including the image of the surface of the driver's license 3 from an oblique direction, for example, the guide images of the above-mentioned three patterns are prepared in advance and carried. The control unit 10 of the terminal 1 may randomly determine one pattern of the guide screen from the guide screen.

In this way, by capturing the surface of the driver's license 3 placed on a table such as a desk from an oblique direction, an image showing the thickness of the driver's license 3 can be obtained more easily and stably. You can Further, since the driver's license 3 is placed and the mobile terminal 1 can be held in a stable state by holding the mobile terminal 1 with both hands, it is possible to reliably take the contents and face photograph described in the license.

(4) In the present embodiment, an example has been described in which the user operates the shooting button displayed on the guide screen at the time of shooting to acquire an image, but the present invention is not limited to this. For example, like the guide screen 297 shown in FIG. 17A, the entire driver's license 3 is reflected in the document position 297a, and the entire coin 9 is reflected in the coin position 297b. In this case, the control unit of the mobile terminal 1 may automatically acquire the image. The control unit of the mobile terminal 1 can determine the shooting timing and shoot by performing, for example, a known object recognition process.

In this way, the image is automatically acquired according to the object placed on the document position and the coin position so that the respective objects are reflected by the user, so that it is not bothersome to the user such as pressing the shooting button. Absent. In addition, since the obtained image is an image including both the driver's license 3 and the coin 9, it is possible to obtain an image satisfying the necessary requirements at the optimum shooting timing.
Note that automatic image acquisition may be performed in the same manner when photographing the front or back of the driver's license 3.

(5) In the present embodiment, as the validity confirmation, an object is reflected in the document position and the coin position, the personal identification document can be read, and the validity period of the personal identification document has not expired. The example of performing the confirmation processing has been described, but the present invention is not limited to this. Only a part of the above confirmations may be confirmed, or another confirmation may be performed. For example, the identity of the personal identification document captured on the surface of the personal identification document and the personal identification image in the diagonal direction may be confirmed.
(6) In the present embodiment, the personal identification image is described as a still image, but the present invention is not limited to this. Since it is necessary for the user to operate, a mechanism for showing the proof that the document is an identity verification document by photographing a driver's license with a moving image may be used.

(7) In the present embodiment, the case where the driver's license is used as the personal identification document has been described as an example, but the present invention is not limited to this. If it is a public identification card with a photograph of the person's face, it may be, for example, my number card. When the personal identification card is used as the personal identification document, the back side does not include information necessary for acquisition, and thus the front side and the oblique side may be photographed.
(8) In the present embodiment, an example in which a coin is used as an object to be imaged together with the personal identification document has been described, but the present invention is not limited to this. For example, a button or the like may be used as long as it has a circular shape. Further, when the user does not have a circular one, it may be replaced by placing a paper with a circle or the like on it according to the coin position.
Furthermore, the person is not limited to the circular shape, and other person that the user may have when performing the person confirmation may be used as an object to perform the person confirmation.

(9) In the present embodiment, the case where the personal identification server performs the image matching process and the character recognition process has been described as an example, but the present invention is not limited to this. For example, an image collation server communicatively connected to the personal identification server and an OCR server are provided, the face collation is performed using the image collation server, and character recognition processing is performed using the OCR server. It may be.
(10) In the present embodiment, the processing using the identity verification server and the mobile terminal has been described, but the content of processing between the identity verification server and the mobile terminal is not limited to this. The process other than the image acquisition performed by the mobile terminal may be performed by the identity verification server, or the process performed by the identity verification server may be performed by the mobile terminal.

(11) Various services are applicable as services for performing personal identification and personal authentication in the present embodiment. For example, in the case of banking business, it can be used for account opening and account linking processing, cash withdrawal processing using ATM, and the like.
As for using the ATM, personal identification is performed by the mobile terminal, and when authenticated, the QR code (registered trademark) is displayed on the mobile terminal, and the ATM is read, thereby replacing the mobile terminal with a cash card. Can be
For other ATMs, the QR code is output to the ATM, the mobile terminal reads the QR code, authenticates the identity after associating the account information, and replaces the mobile terminal with a cash card. Can be
Also, in the case of an agent acting on behalf of the person at the counter, the agent receives information proving that the person has been authenticated, without having to prepare a power of attorney in advance. I'm done.

1 mobile terminal 3 driver's license 4 identity verification server 7 service providing server 10, 40 control unit 12 identity verification unit 13 identity verification image processing unit 14 guidance screen output unit 15 identity verification image acquisition unit 16 validity verification unit 17 collation image processing Part 18 Blink detection part 19 Matching image acquisition part 20 Image transmission part 21 Personal authentication part 22 Service start determination part 30, 50 Storage part 31a Transaction application 31b Personal identification application 32 Acquired image storage part 33 Camera 35 Touch panel display 41 Personal identification image analysis Part 43 Face matching part 44 Matching result sending part 100 Identity verification system

Claims (16)

A mobile terminal having a photographing unit,
The data necessary for identifying the user at the time of starting the service is acquired using only the mobile terminal owned by the user,
A guide screen output means for outputting a guide screen specifying the arrangement position of the object to be photographed together with the personal identification document in which the face photograph is posted,
According to the guide screen output by the guide screen output unit, a personal identification image acquisition unit that acquires a personal identification image, which is an image including the object and the personal identification document, from the imaging unit,
A collation image acquisition unit that acquires a collation image, which is an image including the face of the holder who possesses the identity verification document, from the photographing unit,
A matching image transmitting unit that transmits the personal identification image acquired by the personal identification image acquisition unit and the collation image acquired by the collation image acquisition unit to a personal identification server that performs personal identification using an image,
Be equipped with,
A mobile terminal characterized by. The mobile terminal according to claim 1,
A repeating processing means for repeating the processing by the guide screen output means and the processing by the personal identification image acquisition means a plurality of times,
The guide screen output means outputs the guide screen in which the arrangement position of the object is different each time,
The personal identification image acquisition means acquires a plurality of the personal identification images obtained by photographing the personal identification documents of different observation angles from the photographing unit,
A mobile terminal characterized by. The mobile terminal according to claim 2,
The plurality of personal identification images acquired by the personal identification image acquisition means are images of the object at the same observation angle,
A mobile terminal characterized by. The mobile terminal according to claim 2,
The plurality of identity verification images acquired by the identity verification image acquisition means are images of the object at the same observation angle as the identity verification document,
A mobile terminal characterized by. The mobile terminal according to claim 1,
A repeating processing means for repeating the processing by the guide screen output means and the processing by the personal identification image acquisition means a plurality of times,
The guide screen output means outputs the guide screen in which the arrangement position of the object is different each time,
The personal identification image acquisition means acquires a plurality of the personal identification images obtained by photographing the personal identification document from different photographing directions from the photographing unit,
A mobile terminal characterized by. The mobile terminal according to any one of claims 2 to 5,
At least one of the personal identification images among the plurality of personal identification images acquired by the personal identification image acquisition means is capable of confirming the thickness and face image of the personal identification document.
A mobile terminal characterized by. The mobile terminal according to any one of claims 1 to 6,
The guide screen output means outputs the guide screen including the arrangement position of the object randomly determined from a plurality of predetermined positions,
A mobile terminal characterized by. The mobile terminal according to any one of claims 1 to 6,
The guide screen output means outputs the guide screen including a placement position of the object randomly determined within a predetermined area of the guide screen determined in advance,
A mobile terminal characterized by. The mobile terminal according to any one of claims 1 to 8,
The guide screen output means outputs the guide screen showing the arrangement position of the object as a frame line,
A mobile terminal characterized by. The mobile terminal according to any one of claims 1 to 9,
The guide screen output means outputs the guide screen showing the arrangement position of the object as a circular shape or an elliptical shape,
The object includes a coin,
A mobile terminal characterized by. The mobile terminal according to any one of claims 1 to 10,
The guide screen output means outputs the guide screen specifying the arrangement position of the personal identification document together with the arrangement position of the object,
A mobile terminal characterized by. The mobile terminal according to claim 11,
The guide screen output means outputs the guide screen showing the arrangement position of the personal identification document as a rectangular or trapezoidal frame line,
A mobile terminal characterized by. The mobile terminal according to any one of claims 1 to 12,
Based on the personal identification image acquired by the personal identification image acquisition means, a legitimacy confirmation means for confirming the legitimacy of the object and the personal identification document,
The collation image acquisition unit acquires the collation image when the legitimacy can be confirmed by the legitimacy confirmation unit.
A mobile terminal characterized by. The mobile terminal according to any one of claims 1 to 13,
A blink detecting means for detecting a blink from the image of the face of the holder acquired from the photographing unit,
The collation image acquisition unit acquires the collation image captured by the imaging unit after the blink detection unit detects a blink,
A mobile terminal characterized by. A mobile terminal having a photographing unit,
An identity verification server that is communicably connected to the mobile terminal and performs identity verification processing;
A personal identification system including
The mobile terminal is
The data necessary for identifying the user at the time of starting the service is acquired using only the mobile terminal owned by the user,
A guide screen output means for outputting a guide screen specifying the arrangement position of the object to be photographed together with the personal identification document in which the face photograph is posted,
According to the guide screen output by the guide screen output unit, a personal identification image acquisition unit that acquires a personal identification image, which is an image including the object and the personal identification document, from the imaging unit,
A collation image acquisition unit that acquires a collation image that is an image including the face of the holder who possesses the personal identification document from the photographing unit;
A matching image transmitting unit that transmits the personal identification image acquired by the personal identification image acquisition unit and the collation image acquired by the collation image acquisition unit to the personal identification server.
Equipped with
The identification server is
Face collating means for collating the collation image received from the mobile terminal with the face photograph image included in the personal identification image,
Collating result information by the face collating means, result transmitting means for transmitting to the mobile terminal,
Equipped with
Whether the mobile terminal starts service processing between the mobile terminal and a service providing server which is communicably connected to the personal identification server and performs service processing based on the received collation result information. A service start determination means for determining
A personal identification system characterized by. A computer possessed by the user, which has an image capturing unit and is used to acquire data necessary for confirming the identity of the user when the service starts,
A guide screen output means for outputting a guide screen specifying the arrangement position of the object to be photographed together with the personal identification document in which the face photograph is posted,
According to the guide screen output by the guide screen output unit, a personal identification image acquisition unit that acquires a personal identification image, which is an image including the object and the personal identification document, from the imaging unit,
A collation image acquisition unit that acquires a collation image, which is an image including the face of the holder who possesses the identity verification document, from the photographing unit,
A matching image transmitting unit that transmits the personal identification image acquired by the personal identification image acquisition unit and the collation image acquired by the collation image acquisition unit to a personal identification server that performs personal identification using an image,
A program to make it work.

Images