JP7570198B2 - CONTROL DEVICE, PORTABLE DEVICE, PROGRAM, APPROVAL SYSTEM, CONTROL METHOD, AND APPROVAL METHOD - Google Patents

Description

The present invention relates to a control device, a mobile device, a program, an approval system, a control method, and an approval method.

In recent years, authentication technologies using biometric information (sometimes referred to as biometric authentication technologies) have been developed. For example, Patent Literature 1 discloses a computer system equipped with a personal authentication function that uses the acoustic characteristics of the ear.
[Prior Art Literature]
[Patent Documents]
[Patent Document 1] JP 2005-032056 A

As the performance of mobile devices improves, biometric authentication functions are being installed on mobile devices. However, as the number of services that can be used via mobile devices increases, further improvements in security levels are expected.

In a first aspect of the present invention, a control device is provided. The control device controls, for example, a portable device. The control device includes, for example, a first authentication unit that authenticates a holder who holds or wears the portable device by a first biometric authentication method. The control device includes, for example, an instruction receiving unit that receives input of an instruction to the portable device. The control device includes, for example, a second authentication unit that authenticates an instructor who inputs an instruction by a second biometric authentication method that is different from the first biometric authentication method. The control device includes, for example, an instruction execution unit that executes processing according to an instruction received by the instruction reception unit when the first authentication unit authenticates the holder and the second authentication unit authenticates the instructor.

In the above control device, the first biometric authentication method may be at least one authentication method selected from the group consisting of an ear acoustic authentication method, a face authentication method, a vein authentication method, an iris authentication method, a fingerprint authentication method, and a voiceprint authentication method. In the above control device, the second biometric authentication method may be at least one authentication method selected from the group consisting of an ear acoustic authentication method, a face authentication method, a vein authentication method, an iris authentication method, a fingerprint authentication method, and a voiceprint authentication method.

In the above control device, the portable device may be a wearable terminal that can be worn on the head of the holder. In the above control device, the first biometric authentication method may be an ear acoustic authentication method. In the above control device, the second biometric authentication method may be a voiceprint authentication method.

The control device may include an instruction discrimination unit that discriminates the content of an instruction. In the control device, the instruction reception unit may receive voice input. The instruction discrimination unit may analyze the voice related to the instruction received by the instruction reception unit and discriminate the content of the instruction.

The control device may include a request receiving unit that receives a request signal from another information processing device to cause the mobile device to execute a process that requests an action or decision from the person giving the instruction. The control device may include a request executing unit that executes the process that requests an action or decision. In the control device, the instruction receiving unit may accept input of an instruction related to the action or decision when the request executing unit executes the process that requests an action or decision. In the control device, the process responsive to the instruction may be a process for requesting the person giving the instruction to approve payment for a product or service purchased by the person giving the instruction. In the control device, the process responsive to the instruction may be a process for requesting the person giving the instruction to decide whether or not to approve payment.

In a second aspect of the present invention, a portable device is provided. The portable device includes, for example, the control device according to the first aspect. The portable device includes, for example, a first biometric information acquisition unit that acquires first biometric information used in a first biometric authentication method. The portable device includes, for example, a second biometric information acquisition unit that acquires second biometric information used in a second biometric authentication method.

In a third aspect of the present invention, an approval system is provided. The approval system approves a payment using, for example, a portable device. The approval system has, for example, a first authentication unit that authenticates a holder who holds or wears the portable device by a first biometric authentication method. The approval system has, for example, a second authentication unit that authenticates an instructor who inputs instructions regarding the approval of the payment into the portable device by a second biometric authentication method that is different from the first biometric authentication method. The approval system has, for example, a determination unit that determines whether or not the payment has been approved based on the instructions input by the instructor into the portable device when the first authentication unit authenticates the holder and the second authentication unit authenticates the instructor.

In a fourth aspect of the present invention, a control method is provided. The control method is, for example, a method for controlling a portable device. The control method has, for example, a first authentication stage for authenticating a holder who holds or wears the portable device by a first biometric authentication method. The control method has, for example, an instruction reception stage for accepting input of an instruction to the portable device. The control method has, for example, a second authentication stage for authenticating an instructor who inputs an instruction by a second biometric authentication method different from the first biometric authentication method. The control method has, for example, an instruction execution stage for executing a process according to the instruction accepted in the instruction reception stage when the holder is authenticated in the first authentication stage and the instructor is authenticated in the second authentication stage.

In a fifth aspect of the present invention, an approval method is provided. The approval method is, for example, a method of approving a payment using a portable device. The approval method has, for example, a first authentication stage of authenticating a holder who holds or wears the portable device by a first biometric authentication method. The approval method has, for example, a second authentication stage of authenticating an instructor who inputs an instruction regarding the approval of the payment into the portable device by a second biometric authentication method of a different type from the first biometric authentication method. The approval method has, for example, a decision stage of determining whether or not the payment has been approved based on the instruction input by the instructor into the portable device when the holder is authenticated in the first authentication stage and the instructor is authenticated in the second authentication stage.

In a sixth aspect of the present invention, a program is provided. The program may be a program for causing a computer to function as the control device according to the first embodiment. The program may be a program for causing a computer to execute the control method according to the fourth embodiment. A computer-readable medium for storing the program may be provided. The computer-readable medium may be a non-transitory computer-readable medium. The computer-readable medium may be a computer-readable recording medium.

Note that the above summary of the invention does not list all of the necessary features of the present invention. Also, subcombinations of these features may also be inventions.

1 illustrates an example of a system configuration of a payment system 100. 1 shows an example of the internal configuration of a payment agency system management server 120. 1 shows a schematic diagram of an example of the internal configuration of a hearing aid 140. 2 illustrates an example of the internal configuration of the controller 320. 1 illustrates an example of information processing in a payment system 100. An example of the internal configuration of a hearing aid 602 and a mobile terminal 604 is shown generally. 13 illustrates another example of information processing in the payment system 100. 13 illustrates an example of a combination of authentication methods. An example of the system configuration of a computer 3000 is shown in schematic form.

The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention. In the drawings, the same reference numbers are used for the same or similar parts, and duplicate explanations may be omitted.

[Overview of payment system 100]
1 shows an example of a system configuration of a payment system 100. In this embodiment, the payment system 100 includes, for example, a sales management system 110, a payment agency system management server 120, and a credit payment system management server 130. In this embodiment, the sales management system 110 includes, for example, a reading unit 112, a payment processing unit 114, a communication unit 116, and a display unit 118. The payment system 100 may include one or more hearing aids 140.

In this embodiment, the sales management system 110, the payment agency system management server 120, and the credit payment system management server 130 transmit and receive information to and from each other via the communication network 10. In this embodiment, the sales management system 110 and the hearing aid 140 transmit and receive information to and from each other using a short-range wireless communication method. Examples of short-range wireless communication methods include wireless LAN, Bluetooth (registered trademark), Zigbee (registered trademark), and NFC.

In the embodiment related to FIG. 1, the details of the payment system 100 are described using as an example a case where a user 20 of the payment system 100 purchases a product 32 at a store 30. In this embodiment, the payment system 100 obtains approval from the user 20 regarding payment of the purchase price of the product 32 using a hearing aid 140 worn on the head of the user 20.

Specifically, for example, when user 20 offers to purchase product 32 to a sales clerk (not shown) at store 30, the sales clerk at store 30 uses store 30's sales management system 110 to start a process to settle the purchase price of product 32 (sometimes referred to as a settlement process). When the settlement process is started in the sales management system 110, an approval request is sent from the sales management system 110 to the hearing aid 140, requesting approval of the settlement.

When the hearing aid 140 receives the approval request, the hearing aid 140 outputs audio to inquire of the user 20 whether or not to approve the payment. The hearing aid 140 may output audio to present the details of the payment to the user 20. The hearing aid 140 may output audio to present the payment method to the user 20. The hearing aid 140 may output audio to inquire of the user 20 about the payment method. At this time, the hearing aid 140 may also confirm by an ear acoustic authentication method that the user 20 is a person who has legitimate authority to possess the hearing aid 140. Note that the timing of the above authentication is not limited to this embodiment.

If the user 20 approves the payment, the user 20 responds, for example, with "yes" to the inquiry from the hearing aid 140. On the other hand, if the user 20 does not approve the payment, the user 20 responds, for example, with "no" to the inquiry from the hearing aid 140. The hearing aid 140 analyzes the voice of the user's response using voice recognition technology to estimate or identify the content of the user's 20 response. At this time, the user 20 may indicate the payment method by voice, for example. The hearing aid 140 also analyzes the voice of the user 20 to identify the voiceprint of the user 20. In this way, the hearing aid 140 can confirm, by voiceprint authentication, that the user 20 is a person who has legitimate authority to approve the payment.

If it is confirmed that the user 20 has the proper authority to possess the hearing aid 140 and that the user 20 has the proper authority to approve the payment, the hearing aid 140 executes a process to send a response signal indicating the content of the user 20's answer to the payment system 100. For example, if the user 20 answers "yes", the hearing aid 140 sends a response signal indicating that the payment has been approved to the sales management system 110. This approves the above payment, and the payment process by the payment system 100 continues.

On the other hand, if the user 20 answers "No," the hearing aid 140 sends a response signal to the sales management system 110 indicating that the payment has not been approved. In this case, the payment system 100 stops or interrupts the payment process. In addition, for example, the sales management system 110 notifies a clerk at the store 30 of a message indicating that the payment has not been approved.

If it is not confirmed that the user 20 has the proper authority to possess the hearing aid 140 and/or that the user 20 has the proper authority to approve the payment, the payment system 100 may halt or interrupt the payment process. The response signal may also include information indicating the payment method specified by the user 20.

As described above, in this embodiment, the hearing aid 140 uses an ear acoustic authentication method to confirm that the user 20 has the proper authority to possess the hearing aid 140. The hearing aid 140 also uses a voiceprint authentication method to confirm that the user 20 has the proper authority to approve the payment. If it is confirmed that the user 20 has both the proper authority to possess the hearing aid 140 and the proper authority to approve the payment, the response of the user 20 regarding approval of the payment is accepted.

In this way, according to this embodiment, two-step authentication using two types of biometric authentication methods is realized in a series of payment processes. This realizes more advanced security management than when the answer of the user 20 regarding approval of the payment is accepted only on the condition that the ear acoustic authentication method has confirmed that the user 20 is a person with legitimate authority to possess the hearing aid 140.

Furthermore, according to this embodiment, the action of the user 20 for one of the two types of biometric authentication described above matches the action of the user 20 for instructing the hearing aid 140 to approve the payment. This allows even a user 20 who is not good at operating electronic devices to easily implement two-step authentication.

[Overview of each part related to the payment system 100]
In the present embodiment, the communication network 10 may be a transmission path for wired communication, a transmission path for wireless communication, or a combination of a transmission path for wireless communication and a transmission path for wired communication. The communication network 10 includes, for example, at least one of a wireless packet communication network, the Internet, a P2P network, a dedicated line, a VPN, a power line communication line, a vehicle-to-vehicle communication line, and a road-to-vehicle communication line.

The communication network 10 may include (i) a mobile communication network such as a mobile phone network, or (ii) a wireless communication network such as a wireless MAN (e.g., WiMAX (registered trademark)), a wireless LAN (e.g., WiFi (registered trademark)), Bluetooth (registered trademark), Zigbee (registered trademark), or NFC (Near Field Communication). As described above, wireless LAN, Bluetooth (registered trademark), Zigbee (registered trademark), and NFC may be examples of short-range wireless communication methods.

In this embodiment, the sales management system 110 manages various operations related to the sale of products or services at the store 30. Examples of the operations include order management, order management, arrival management, delivery management, inventory management, sales management, billing management, deposit management, and payment management.

In this embodiment, the reading unit 112 reads information (sometimes referred to as purchase information) about the product 32 that the user 20 wishes to purchase. The reading unit 112 outputs the information about the product 32 to the payment processing unit 114. Examples of the information about the product 32 include a product code and a price. Examples of the reading unit 112 include a barcode scanner, a QR code (registered trademark) scanner, and an RFID reader.

In this embodiment, the payment processing unit 114 executes at least a part of the payment processing for the purchase price of the product 32. The payment processing unit 114 may execute the above-mentioned payment processing in cooperation with the payment agency system management server 120 and the credit payment system management server 130.

For example, the payment processing unit 114 executes at least one of the following processes: (i) accepting input of purchase information; (ii) accepting input of a payment method desired by the user 20; (iii) if the payment method desired by the user 20 is a predetermined type of payment method, obtaining approval of the user 20 regarding the payment; (iv) if the payment method desired by the user 20 is a predetermined type of payment method, requesting payment from another information processing device and receiving a notification regarding the payment result; and (v) confirming the payment. After accepting input of the payment method desired by the user 20, the payment processing unit 114 may execute at least one of the following processes: (i) obtaining approval of the payment by the payment method from the user 20; (ii) requesting payment from another information processing device and receiving a notification regarding the payment result; and (iii) confirming the payment.

In this embodiment, the communication unit 116 transmits and receives information to and from the payment agency system management server 120 via the communication network 10. The communication unit 116 transmits and receives information to and from the hearing aid 140 using a short-range wireless communication method.

In this embodiment, the display unit 118 displays various information to at least one of the user 20 and the store clerk of the store 30. In one embodiment, the display unit 118 displays (i) information indicating the name and price of each of the one or more products 32 read by the reading unit 112, (ii) information indicating the total price of the one or more products 32 that the user 20 wishes to purchase, etc. In other embodiments, the display unit 118 displays (i) a message indicating that there is a high possibility that the hearing aid 140 is being used fraudulently, (ii) a message indicating that there is a high possibility that the user 20 is involved in fraudulent or criminal activity, etc.

In this embodiment, the payment agency system management server 120 mediates the transmission and reception of information between the sales management system 110 and the credit payment system management server 130. Details of the payment agency system management server 120 will be described later.

In this embodiment, the credit card payment system management server 130 provides a credit card payment service to the user 20 and the store 30. Specifically, the server pays the store 30 the amount of the product or service purchased by the user 20 at the store 30 minus a handling fee. The server also debits the above amount from the account of the user 20.

In this embodiment, the hearing aid 140 (i) collects external sound, (ii) amplifies and/or processes the collected sound, and (iii) outputs the amplified and/or processed sound to the user 20. In this embodiment, the hearing aid 140 is worn on or near the ear of the user 20. A wearable device that can be worn on or near the ear of the user 20 may be referred to as a hearable device. Other examples of hearable devices include earphones and headphones.

In addition to the functions of a normal hearing aid described above, the hearing aid 140 has the following functions: (i) a function to authenticate that the user 20 wearing the hearing aid 140 is the legitimate user of the hearing aid 140; (ii) a function to receive requests from an external device such as the sales management system 110; (iii) a function to accept input of instructions from the user 20; (iv) a function to authenticate that the user 20 who inputted instructions to the hearing aid 140 is the legitimate user of the hearing aid 140; and (v) a function to transmit instructions inputted by the user 20 to the hearing aid 140 to an external device such as the sales management system 110. Details of the hearing aid 140 will be described later.

[Specific configuration of each part of the payment system 100]
Each part of the payment system 100 may be realized by hardware, software, or hardware and software. Each part of the payment system 100 may be realized, at least in part, by a single server or by multiple servers. Each part of the payment system 100 may be realized, at least in part, on a virtual machine or a cloud system. Each part of the payment system 100 may be realized, at least in part, by a personal computer or a mobile terminal. Examples of the mobile terminal include a mobile phone, a smartphone, a PDA, a tablet, a notebook computer or laptop computer, and a wearable computer. Each part of the payment system 100 may store information using a distributed ledger technology such as a blockchain or a distributed network.

When at least some of the components constituting the payment system 100 are realized by software, the components realized by the software may be realized by starting software or a program that defines the operation of the components in an information processing device of a general configuration. The information processing device of the general configuration described above may include (i) a data processing device having a processor such as a CPU or GPU, a ROM, a RAM, a communication interface, etc., (ii) input devices such as a keyboard, a pointing device, a touch panel, a camera, a voice input device, a gesture input device, various sensors, a GPS receiver, etc., (iii) output devices such as a display device, a voice output device, a vibration device, etc., and (iv) storage devices such as memory, HDD, SSD, etc. (including external storage devices).

In the information processing device of the above general configuration, the above data processing device or storage device may store the above software or program. The above software or program, when executed by a processor, causes the above information processing device to perform the operations defined by the software or program. The above software or program may be stored in a non-transitory computer-readable recording medium. The above software or program may be a program for causing a computer to function as the payment system 100 or a part thereof. The above software or program may be a program for causing a computer to execute information processing in the payment system 100 or a part thereof.

In one embodiment, the information processing method in the payment system 100 or a part thereof may be a control method for controlling a mobile device. The above control method may be executed by the hearing aid 140, may be executed by the payment agency system management server 120, or may be executed by the hearing aid 140 and the payment agency system management server 120 in cooperation with each other.

The above control method has, for example, a first authentication stage in which a holder who holds or wears a portable device is authenticated by a first biometric authentication method. The above control method has, for example, an instruction reception stage in which input of an instruction to the portable device is accepted. The above control method has, for example, a second authentication stage in which an instructor who inputs an instruction is authenticated by a second biometric authentication method that is different in type from the first biometric authentication method. The above control method has, for example, an instruction execution stage in which, when the holder is authenticated in the first authentication stage and the instructor is authenticated in the second authentication stage, a process is executed according to the instruction accepted in the instruction reception stage.

In another embodiment, the information processing method in the payment system 100 or a part thereof may be a method for approving a payment using a mobile device. The above-mentioned approval method may be executed by the hearing aid 140, may be executed by the payment agency system management server 120, or may be executed by the hearing aid 140 and the payment agency system management server 120 in cooperation with each other.

The above approval method has, for example, a first authentication stage of authenticating a holder who holds or wears the portable device by a first biometric authentication method. The above approval method has, for example, a second authentication stage of authenticating an instructor who inputs instructions regarding the approval of the payment into the portable device by a second biometric authentication method that is different in type from the first biometric authentication method. The above approval method has, for example, a decision stage of determining whether or not the payment has been approved based on the instructions input by the instructor into the portable device when the holder is authenticated in the first authentication stage and the instructor is authenticated in the second authentication stage.

The user 20 may be an example of a holder or an instructor. The payment system 100 may be an example of an approval system. The hearing aid 140 may be an example of a control device or a portable device. The hearing aid 140 may be an example of a wearable terminal.

The ear or the vicinity of the ear of the user 20 may be an example of the body of the user 20. The ear acoustic authentication method may be an example of a first biometric authentication method. The voiceprint authentication method may be an example of a second biometric authentication method. An instruction input by the user 20 to the hearing aid 140 may be an example of an instruction for a mobile device. A process of transmitting an instruction input by the user 20 to the hearing aid 140 to an external device may be an example of a process according to an instruction. A process of obtaining approval from the user 20 regarding a payment may be an example of a process of requesting an action or decision from the person in charge. The approval request may be an example of a request signal.

[Another embodiment]
In this embodiment, the details of the payment system 100 or the hearing aid 140 are described using as an example a case in which the hearing aid 140 (i) receives an approval request from the sales management system 110 by a short-range wireless communication method, and (ii) transmits a response signal to the approval request to the sales management system 110 by a short-range wireless communication method. However, the method of transmitting and receiving the approval request or the response signal is not limited to this embodiment.

In another embodiment, at least one of the approval request and the response signal is transmitted between the sales management system 110 and the hearing aid 140 via the payment agency system management server 120. For example, the sales management system 110 transmits an approval request to the payment agency system management server 120. The payment agency system management server 120 transfers the approval request to the hearing aid 140. As a result, the approval request is transmitted from the sales management system 110 to the hearing aid 140 via the payment agency system management server 120. Similarly, the hearing aid 140 transmits a response signal to the payment agency system management server 120. The payment agency system management server 120 transfers the response signal to the sales management system 110. As a result, the response signal is transmitted from the hearing aid 140 to the sales management system 110 via the payment agency system management server 120.

In this embodiment, the details of the payment system 100 or the hearing aid 140 are described using an example in which the hearing aid 140 executes a process to obtain approval from the user 20 regarding a payment. However, the entity that executes the process to obtain approval from the user 20 regarding a payment is not limited to this embodiment.

In another embodiment, the payment agency system management server 120 may execute a process to obtain approval from the user 20 regarding the payment. In yet another embodiment, the payment agency system management server 120 and the hearing aid 140 may cooperate to execute a process to obtain approval from the user 20 regarding the payment.

In this embodiment, the details of the payment system 100 are described using an example in which the payment system 100 obtains approval from the user 20 regarding payment of the purchase price of the product 32 using the hearing aid 140. However, the payment system 100 is not limited to this embodiment. In other embodiments, the payment system 100 may obtain approval from the user 20 regarding payment of the purchase price of the product 32 using any type of portable device. Other examples of portable devices include mobile phones, smartphones, PDAs, tablets, notebook or laptop computers, wearable computers, etc.

In this embodiment, the details of the process in which the payment system 100 obtains the user 20's approval regarding a payment are described using an example in which the store 30 is a physical store, the sales management system 110 of the store 30 sends an approval request to the hearing aid 140, and the sales management system 110 of the store 30 receives a response signal from the hearing aid 140. However, the payment system 100 is not limited to this embodiment.

In another embodiment, the store 30 may be a virtual store built on an electronic commerce site. For example, the user 20 uses a communication terminal to access an operating system that operates the electronic commerce site. When the user 20 purchases a product or service at the virtual store, the operating system starts a payment process for the product or service. In the above embodiment, the operating system may include a payment processing unit 114. The communication terminal may include a communication unit 116. As a result, in the above payment process, the operating system can obtain approval from the user 20 regarding the payment of the purchase price of the product or service using the hearing aid 140 and the communication terminal of the user 20. The user 20 can input instructions by voice in at least one of the multiple processes included in the payment process.

[An example of the payment agent system management server 120]
2 shows an example of the internal configuration of the payment agency system management server 120. In this embodiment, the payment agency system management server 120 includes a user registration unit 212, a registered data storage unit 214, a payment processing unit 222, and an account balance management unit 224.

In this embodiment, the user registration unit 212 accepts registration of information about the user 20. When the user registration unit 212 accepts registration of the above information (sometimes referred to as registration information), the user registration unit 212 issues identification information (sometimes referred to as user ID) for the payment system 100 to identify the above user 20. The user registration unit 212 associates the user ID of the above user 20 with the registration information and stores them in the registration data storage unit 214. Examples of the registration information include name, address, contact information, place of employment, various biometric information, account information, and credit card information. Examples of the above biometric information include feature data for ear acoustic authentication (sometimes referred to as ear acoustic authentication data), feature data for voiceprint authentication (sometimes referred to as voiceprint authentication data), feature data for fingerprint authentication (sometimes referred to as fingerprint authentication data), feature data for face authentication (sometimes referred to as face authentication data), and feature data for iris authentication (sometimes referred to as iris authentication data).

In this embodiment, the registration data storage unit 214 stores a user ID and registration information for each of one or more users 20 in association with each other. The registration data storage unit 214 (i) extracts data that matches the conditions indicated by a request from each part of the payment system 100 or the hearing aid 140, and (ii) transmits the extracted data to the sender of the request as a response to the request.

In this embodiment, the payment processing unit 222 executes processing to perform payment on behalf of the sales management system 110 and the credit payment system management server 130. Specifically, the payment processing unit 222 executes credit processing, payment processing, and sales proceeds deposit processing.

For example, when the payment processing unit 222 receives a credit inquiry request for user 20 from the sales management system 110, it requests the credit payment system management server 130 to inquire about the credit information of user 20 (sometimes referred to as a credit inquiry). In addition, the payment processing unit 222 obtains information indicating the results of the credit inquiry from the credit payment system management server 130 and transmits the information to the sales management system 110.

For example, the payment processing unit 222 obtains information (sometimes referred to as sales information) indicating the sales of the store 30 resulting from the purchase by the user 20 from the sales management system 110. Based on the sales information, the payment processing unit 222 settles the price of the product 32 purchased by the user 20 at the store 30 (sometimes referred to as the purchase price of the user 20) with the credit payment system management server 130.

For example, the payment processing unit 222 acquires information indicating that an amount equivalent to the purchase price of the user 20 described above has been deposited from the credit payment system management server 130 to a specific account. The amount equivalent to the purchase price of the user 20 may be the same as the purchase price of the user 20, or may be the amount obtained by deducting the fee of the credit payment system management server 130 from the purchase price of the user 20. When the deposit from the credit payment system management server 130 is confirmed, the payment processing unit 222 deposits the amount equivalent to the purchase price of the user 20 into the account of the store 30. The amount equivalent to the purchase price of the user 20 may be the same as the amount deposited from the credit payment system management server 130, or may be the amount obtained by deducting the fee of the credit payment system management server 130 from the above-mentioned deposited amount.

In this embodiment, the account balance management unit 224 manages information regarding the account balance of each of one or more users 20. For example, in response to a request from the credit payment system management server 130, the account balance management unit 224 executes a process (sometimes referred to as an account debit process) to debit the purchase price of the user 20 from the account of the user 20.

[Another embodiment]
In this embodiment, the details of the payment system 100 have been described by taking as an example a case in which the payment processing unit 222 executes processing for acting as a proxy for payment between the sales management system 110 and the credit payment system management server 130. However, the payment system 100 is not limited to this embodiment. In other embodiments, the payment agency system management server 120 may execute at least a part of the functions of the credit payment system management server 130. For example, the payment processing unit 222 of the payment agency system management server 120 may execute a credit inquiry process. The payment processing unit 222 may also request the account balance management unit 224 to execute an account debit process.

In this embodiment, the details of the payment agency system management server 120 are described using an example in which the hearing aid 140 executes the payment approval process. However, the payment agency system management server 120 is not limited to this embodiment. In other embodiments, the payment agency system management server 120 may execute part of the payment approval process in the hearing aid 140. For example, the payment agency system management server 120 confirms that the user 20 has the legitimate authority to possess the hearing aid 140 using an ear acoustic authentication method. The payment agency system management server 120 may confirm that the user 20 has the legitimate authority to approve the payment using a voiceprint authentication method. Furthermore, when it is confirmed that the user 20 has the legitimate authority to possess the hearing aid 140 and that the user 20 has the legitimate authority to approve the payment, the payment agency system management server 120 may determine that the above-mentioned payment has been approved.

In this case, the payment agency system management server 120 may be an example of an approval system. The payment processing unit 222 may be an example of an approval system.

[An example of the hearing aid 140]
3 shows an example of the internal configuration of the hearing aid 140. In this embodiment, the hearing aid 140 includes, for example, a communication unit 312, a memory 314, a GPS receiver 316, and a wearing sensor 318. The hearing aid 140 includes, for example, a controller 320. The hearing aid 140 includes, for example, a sound collection microphone 332, a driver unit 334, and a reflected sound detection microphone 336. The driver unit 334 and the reflected sound detection microphone 336 form an ear acoustic data acquisition unit 340.

In this embodiment, the communication unit 312 transmits and receives information between the hearing aid 140 and a device external to the hearing aid 140. The communication unit 312 may be compatible with multiple types of communication methods. For example, in this embodiment, the communication unit 312 transmits and receives information with the sales management system 110 using a short-range wireless communication method. Note that in other embodiments, the communication unit 312 may transmit and receive information with the payment agency system management server 120 via the communication network 10 using a mobile communication method.

In this embodiment, memory 314 stores various information used for information processing in hearing aid 140. In one embodiment, memory 314 stores biometric information of user 20. According to this embodiment, memory 314 stores ear acoustic authentication data and voiceprint authentication data. The ear acoustic authentication data and voiceprint authentication data are acquired, for example, during initial setup of hearing aid 140 and stored in memory 314. The initial setup of hearing aid 140 may be performed by operation of user 20 before user 20 starts using hearing aid 140, or may be performed by operation of a salesperson at store 30 when user 20 purchases hearing aid 140.

In other embodiments, the memory 314 may store data used in the voice synthesis process, or may store data of a test sound used in the ear acoustic authentication process. The test sound may be an audible sound, an ultrasonic sound, an infrasound sound, or a combination thereof.

In this embodiment, the GPS receiver 316 receives a GPS signal. The GPS receiver 316 may generate location information indicating the location of the user 20 based on the received GPS signal. The GPS receiver 316 outputs the location information to the controller 320. The GPS receiver 316 may also associate information indicating the time with location information indicating the location of the user 20 at that time and store the information in the memory 314. The GPS receiver 316 may also associate information indicating the time with location information indicating the location of the user 20 at that time and transmit the information to the payment agency system management server 120.

In this embodiment, the wearing sensor 318 detects that the hearing aid 140 is worn at or near the ear of the user 20. The wearing sensor 318 may be a contact sensor or a non-contact sensor. The wearing sensor 318 outputs, for example, a signal indicating whether the hearing aid 140 is worn at or near the ear of the user 20 to the controller 320.

In this embodiment, the controller 320 controls the hearing aid 140. Details of the controller 320 will be described later.

In this embodiment, the sound collection microphone 332 collects external sounds (sometimes referred to as external sounds). The sound collection microphone 332 may collect the voice of the user 20. For example, the sound collection microphone 332 collects the voice of instructions given by the user 20 to the hearing aid 140. This allows the instructions of the user 20 to be input to the hearing aid 140. The sound collection microphone 332 may collect air conduction sound or bone conduction sound. The sound collection microphone 332 may convert the external sounds into digital signals and output them to the controller 320.

In this embodiment, the driver unit 334 outputs sound. The driver unit 334 outputs sound according to a control signal from the controller 320. In one embodiment, when the hearing aid 140 is used as a normal hearing aid, the driver unit 334 outputs an external sound collected by the sound collection microphone 332. As described above, the external sound collected by the sound collection microphone 332 may be amplified and/or processed by the controller 320 and then output from the driver unit 334. The external sound reproduced by the driver unit 334 may be referred to as a reproduced sound. In another embodiment, when the hearing aid 140 is used as an ear acoustic authentication device, the driver unit 334 outputs a test sound for ear acoustic authentication.

In this embodiment, the reflected sound detection microphone 336 collects the test sound output by the driver unit 334 that is reflected inside the ear canal of the user 20 (sometimes referred to as reflected sound). The reflected sound detection microphone 336 may collect air conduction sound or bone conduction sound. The reflected sound detection microphone 336 may convert the reflected sound into a digital signal and output it to the controller 320.

The controller 320 may be an example of a control device. The sound collection microphone 332 may be an example of an instruction receiving unit or a second bioinformation acquisition unit. The reflected sound detection microphone 336 may be an example of a first bioinformation acquisition unit. The ear acoustic data acquisition unit 340 may be an example of a first bioinformation acquisition unit.

Figure 4 shows an example of the internal configuration of the controller 320. In this embodiment, the controller 320 includes, for example, a communication control unit 410, a request receiving unit 422, an abnormality detection unit 424, a voice synthesis unit 426, and an authentication control unit 428. In this embodiment, the controller 320 includes, for example, a signal processing unit 430. In this embodiment, the controller 320 includes, for example, an ear acoustic authentication unit 440 and a voiceprint authentication unit 450. In this embodiment, the controller 320 includes, for example, a voice recognition unit 462, an instruction discrimination unit 464, and an instruction execution unit 466.

In this embodiment, the communication control unit 410 controls the communication between the hearing aid 140 and a device external to the hearing aid 140. The communication control unit 410 may control the operation of the communication unit 312 to control the above communication. For example, when the communication control unit 410 receives an approval request from the sales management system 110, the communication control unit 410 outputs the approval request to the request receiving unit 422. As a response to the above approval request, the communication control unit 410 transmits the response signal output by the instruction execution unit 466 to the sender of the above approval request.

In this embodiment, the request receiving unit 422 receives requests from external devices. For example, the request receiving unit 422 receives an approval request from the sales management system 110. The approval request may include information indicating the content of the payment (sometimes referred to as payment information). When the request receiving unit 422 receives the approval request, the request receiving unit 422 starts a process (sometimes referred to as a payment approval process) for obtaining approval from the user 20 regarding the payment of the purchase price of the product 32. This executes the payment approval process.

The payment approval process may be a process for requesting the user 20 or the person in charge to approve the payment for the product or service purchased by the user 20, or to determine whether or not to approve the payment. The payment approval process may include a process for determining the payment method. The payment approval process may include a process for the user 20 to select a specific payment method from among a plurality of available payment methods.

Specifically, the request reception unit 422 outputs the payment information included in the approval request to the anomaly detection unit 424. The request reception unit 422 outputs a signal indicating that the payment approval process has started to the voice synthesis unit 426 and the authentication control unit 428.

[Detection of payment anomalies]
In this embodiment, when the anomaly detection unit 424 obtains payment information from the request reception unit 422, the anomaly detection unit 424 analyzes the content of the payment indicated by the payment information to detect an anomaly related to the payment. The anomaly detection unit 424 detects that there is a high possibility that the hearing aid 140 or the credit information of the user 20 has been used fraudulently, that there is a high possibility that the user 20 has been involved in a crime such as fraud, and the like. For example, the anomaly detection unit 424 analyzes the content of the above payment and detects an anomaly when a purchasing pattern common to victims of fraudulent use or a purchasing pattern common to victims of crimes such as fraud is detected.

In another embodiment, the anomaly detection unit 424 obtains location information of the user 20 from the GPS receiver 316, and detects an anomaly regarding the above-mentioned payment based on the location information. The anomaly detection unit 424 detects an anomaly, for example, when a movement pattern common to victims of fraudulent use or a movement pattern common to victims of scams is detected. The anomaly detection unit 424 may detect an anomaly regarding the above-mentioned payment based on the location information of the user 20 and the content of the payment indicated by the payment information.

If an anomaly related to a payment is detected, the anomaly detection unit 424 outputs information indicating that an anomaly related to a payment has been detected to the voice synthesis unit 426. The anomaly detection unit 424 may also output information indicating the content or type of the detected anomaly to the voice synthesis unit 426. This improves security related to payments.

[Detection of abnormalities in external sounds]
In this embodiment, when the abnormality detection unit 424 acquires information indicating the recognition result of the voice included in the external sound from the voice recognition unit 462, the abnormality detection unit 424 analyzes the content of the above-mentioned voice and detects an abnormality related to the external sound. For example, the abnormality detection unit 424 detects that the user 20 is highly likely to be involved in a crime such as fraud. For example, the abnormality detection unit 424 analyzes the content of the voice of the conversation partner of the user 20, and detects an abnormality when a conversation pattern common to victims of crimes such as fraud is detected.

If an abnormality related to an external sound is detected, the abnormality detection unit 424 outputs information indicating that an abnormality related to an external sound has been detected to the voice synthesis unit 426. The abnormality detection unit 424 may also output information indicating the content or type of the detected abnormality to the voice synthesis unit 426. This improves security even when the hearing aid 140 is functioning as a normal hearing aid.

In this embodiment, the voice synthesis unit 426 generates synthetic voice. This allows the voice synthesis unit 426 to convert text data into voice data, for example. The voice synthesis unit 426 outputs the generated synthetic voice data to the signal processing unit 430.

According to one embodiment, when the voice synthesis unit 426 receives a signal from the request receiving unit 422 indicating that the payment approval process has started, the voice synthesis unit 426 synthesizes a voice of a message notifying the user 20 that the payment approval process has started. According to another embodiment, when the voice synthesis unit 426 receives a signal from the anomaly detection unit 424 indicating that an anomaly has been detected, the voice synthesis unit 426 synthesizes a voice of a message notifying the user 20 that an anomaly has been detected. The message may include information regarding the content or type of the detected anomaly.

In this embodiment, the authentication control unit 428 controls the ear acoustic authentication. For example, the authentication control unit 428 controls the timing at which a test sound for ear acoustic authentication is output. The authentication control unit 428 outputs a signal indicating the timing at which the test sound is output to the signal processing unit 430. The authentication control unit 428 may output data of the test sound to the signal processing unit 430.

In one embodiment, when the voice synthesis unit 426 receives a signal from the request receiving unit 422 indicating that the payment approval process has started, the authentication control unit 428 decides to output a test sound for ear acoustic authentication. After the payment approval process has started, the voice synthesis unit 426 may decide to periodically output the test sound while the wearing sensor 318 detects that the hearing aid 140 is being worn. In another embodiment, when the authentication control unit 428 receives a signal from the wearing sensor 318 indicating that the hearing aid 140 is being worn, the authentication control unit 428 may decide to output the test sound.

The ear acoustic authentication method can authenticate the user 20 as long as the user 20 is wearing the hearing aid 140, without the user 20 having to perform any special action for authentication. Therefore, the hearing aid 140 can execute the authentication process at any timing, or execute the authentication process continuously like a constant authentication. Here, the shorter the period between the time when the user 20 is authenticated by the ear acoustic authentication method and the time when the user 20 is authenticated by the voiceprint authentication method, the more fraudulent acts such as impersonation can be prevented. Therefore, the authentication control unit 428 may control the signal processing unit 430 so that the ear acoustic authentication process is executed multiple times during the period when the payment approval process is being executed.

In this embodiment, the signal processing unit 430 controls the driver unit 334 to output sound. The signal processing unit 430 amplifies and/or processes the external sound collected by the sound collection microphone 332. This realizes the function of a hearing aid.

In one embodiment, when the signal processing unit 430 receives an audio signal of a synthetic voice from the voice synthesis unit 426, the signal processing unit 430 controls the driver unit 334 so that the synthetic voice is output. In another embodiment, when the signal processing unit 430 receives a signal indicating the output timing of the test sound from the authentication control unit 428, the signal processing unit 430 controls the driver unit 334 so that the test sound is output in accordance with the timing.

In this embodiment, the ear acoustic authentication unit 440 authenticates the user 20 who owns or wears the hearing aid 140 using an ear acoustic authentication method. The ear acoustic authentication unit 440 outputs information indicating the authentication result using the ear acoustic authentication method to the instruction execution unit 466.

Specifically, the ear acoustic authentication unit 440 acquires reflected sound data from the reflected sound detection microphone 336. The ear acoustic authentication unit 440 analyzes the above data and extracts characteristic data of the reflected sound input to the reflected sound detection microphone 336. The ear acoustic authentication unit 440 compares the ear acoustic authentication data of the user 20 stored in the memory 314 with the characteristic data of the reflected sound input to the reflected sound detection microphone 336, and determines whether the two match.

If it is determined that the two match, the ear acoustic authentication unit 440 determines that the user 20 who currently owns or wears the hearing aid 140 is a person who has legitimate authority to own the hearing aid 140. If it is determined that the two do not match, the ear acoustic authentication unit 440 determines that the user 20 who currently owns or wears the hearing aid 140 is not a person who has legitimate authority to own the hearing aid 140.

In this embodiment, the voiceprint authentication unit 450 authenticates the user 20 who has input an instruction to the hearing aid 140 by voice using a voiceprint authentication method. The voiceprint authentication unit 450 outputs information indicating the authentication result by the voiceprint authentication method to the instruction execution unit 466. Note that for a single hearing aid 140, voiceprint authentication data of multiple users 20 may be registered as data indicating the voiceprint characteristics of a legitimate authorized person. This allows, for example, not only the legitimate owner or wearer of the hearing aid 140 but also the family, relatives, caregivers, etc. of the owner or wearer to input instructions to the hearing aid 140.

Specifically, the voiceprint authentication unit 450 acquires external sound data from the sound collection microphone 332. The voiceprint authentication unit 450 analyzes the above data and extracts feature data of the external sound input to the sound collection microphone 332. The voiceprint authentication unit 450 compares the voiceprint authentication data of the user 20 stored in the memory 314 with the feature data of the external sound input to the sound collection microphone 332, and determines whether the two match.

If it is determined that the two match, the voiceprint authentication unit 450 determines that the user 20 who currently inputs instructions to the hearing aid 140 into the hearing aid 140 has the legitimate authority to give instructions to the hearing aid 140. If it is determined that the two do not match, the voiceprint authentication unit 450 determines that the user 20 who currently inputs instructions to the hearing aid 140 into the hearing aid 140 does not have the legitimate authority to give instructions to the hearing aid 140. This makes it possible to determine, for example, whether or not the user 20 has the legitimate authority to approve a payment.

In one embodiment, the voiceprint authentication unit 450 starts the voiceprint authentication process when the voice recognition unit 462 recognizes the voice of the user 20. The voiceprint authentication unit 450 may execute the voiceprint authentication process using the data of the above-mentioned voice portion. According to this embodiment, the voiceprint authentication process is executed when the external sound contains the voice of the user 20, and the voiceprint authentication process is not executed when the external sound contains the voice of the user 20. This improves the information processing speed of the controller 320. In addition, the resource usage of the controller 320 is reduced.

In another embodiment, the voiceprint authentication unit 450 constantly or periodically monitors the external sounds collected by the sound collection microphone 332 and detects voice that matches the registered voiceprint authentication data. When voice that matches the registered voiceprint authentication data is detected, the voiceprint authentication unit 450 may output information indicating that voice that matches the registered voiceprint authentication data has been detected to the voice recognition unit 462. This improves the accuracy of voice recognition by the voice recognition unit 462.

In this embodiment, the voice recognition unit 462 recognizes the voice of the user 20. The voice recognition unit 462 may accept input of voice instructions. When the request acceptance unit 422 accepts an approval request and a payment approval request is initiated, a process for accepting voice instructions may be executed. In this case, the voice recognition unit 462 accepts, for example, input of an instruction regarding whether or not to approve the payment.

Specifically, the voice recognition unit 462 acquires external sound data from the sound collection microphone 332. The voice recognition unit 462 analyzes the above data and recognizes the voice of the user 20 input to the sound collection microphone 332. The voice recognition unit 462 generates information indicating the content of the recognized voice. For example, the voice recognition unit 462 generates text data indicating the content of the recognized voice. The voice recognition unit 462 may also recognize a specific keyword or key phrase. Examples of the above keyword or key phrase include "OK", "NG", "Yes", and "No". The voice recognition unit 462 may generate information indicating the recognized key phrase or the type of the key phrase as information indicating the content of the recognized voice.

This allows the voice recognition unit 462 to accept instructions input by the user 20 to the hearing aid 140. The voice recognition unit 462 outputs information indicating the content of the recognized voice to the abnormality detection unit 424 and the instruction discrimination unit 464.

In this embodiment, the instruction discrimination unit 464 discriminates the content of the instruction input to the hearing aid 140. For example, the instruction discrimination unit 464 acquires information indicating the content of the voice of the user 20 from the voice recognition unit 462. The instruction discrimination unit 464 analyzes the content of the voice of the user 20 and discriminates the content of the instruction input by the user 20 to the hearing aid 140. The instruction discrimination unit 464 outputs information indicating the content of the instruction input by the user 20 to the hearing aid 140 to the instruction execution unit 466.

Examples of the content of the instruction include whether or not to approve, the payment method, etc. For example, when the hearing aid 140 receives an approval request from the sales management system 110 and asks, "The payment is 3,500 yen. Do you approve the payment?", if the user 20 answers, for example, "OK" or "Yes", the instruction discrimination unit 464 determines that the instruction is an instruction indicating that the user 20 approves the payment. Similarly, when the user 20 answers, for example, "NG" or "No" to the above inquiry, the instruction discrimination unit 464 determines that the instruction is an instruction indicating that the user 20 does not approve the payment.

Also, as described above, for example, if user 20 can pay for the purchase price using multiple payment methods, the payment method may be specified by user 20's response to the inquiry. Examples of payment methods include credit card payment, debit card payment, QR code payment, electronic money payment, cryptocurrency payment, and point payment. Other examples of payment methods include types of credit card brands, types of debit card brands, types of electronic money, types of QR code payment services, types of cryptocurrency, and types of points. Points may be an example of electronic value.

For example, when the hearing aid 140, which has received an approval request from the sales management system 110, asks "The payment is 3,500 yen. Would you like to pay with the credit card of Company A, which is registered as the payment method?" and the user 20 answers, for example, "OK" or "Yes", the instruction discrimination unit 464 determines that the above instruction is (i) an instruction to specify credit card payment using Company A's credit card as the payment method, and (ii) an instruction indicating that the user 20 approves the payment. Similarly, when the user 20 answers, for example, "No. Please pay with Company B's credit card", the instruction discrimination unit 464 determines that the above instruction is (i) an instruction to specify credit card payment using Company B's credit card as the payment method, and (ii) an instruction indicating that the user 20 approves the payment.

In this embodiment, the instruction execution unit 466 obtains information indicating the content of the instruction input by the user 20 to the hearing aid 140 from the instruction discrimination unit 464. The instruction execution unit 466 obtains information indicating the authentication result by the ear acoustic authentication method from the ear acoustic authentication unit 440. The instruction execution unit 466 obtains information indicating the authentication result by the voiceprint authentication method from the voiceprint authentication unit 450.

The instruction execution unit 466 determines whether or not to execute processing according to the instruction input by the user 20 to the hearing aid 140 based on the authentication result by the ear acoustic authentication method and the authentication result by the voiceprint authentication method. Specifically, when the user 20 is authenticated by the ear acoustic authentication method and the voiceprint authentication method, the instruction execution unit 466 executes processing according to the instruction input by the user 20 to the hearing aid 140. For example, the instruction execution unit 466 executes processing to send a response signal including information indicating that the user 20 has approved the payment to the sales management system 110.

The instruction execution unit 466 may obtain information indicating whether or not the hearing aid 140 is worn by the user 20 (or a third party) from the wearing sensor 318. Based on whether or not the hearing aid 140 is worn by the user 20, it may determine whether or not to execute processing according to an instruction input by the user 20 to the hearing aid 140.

According to one embodiment, when the user 20 is authenticated by the ear acoustic authentication method, the user 20 is authenticated by the voiceprint authentication method, and the hearing aid 140 is worn by the user 20, the instruction execution unit 466 executes processing according to an instruction input by the user 20 to the hearing aid 140. According to another embodiment, when it is detected that the hearing aid 140 has been removed from the ear of the user 20, the instruction execution unit 466 resets, for example, the authentication result by the ear acoustic authentication method. According to these embodiments, security is further improved.

As described above, the ear acoustic authentication process may be executed multiple times while the payment approval process is being executed. For example, the ear acoustic authentication process may be executed periodically while the payment approval process is being executed, thereby realizing continuous authentication.

In this way, when multiple earacoustic authentication processes are performed during the execution of a single payment approval process, when the earacoustic authentication unit 440 fails to authenticate the user 20, the instruction execution unit 466 may suspend or stop the execution of the process according to the instruction input by the user 20 to the hearing aid 140. The instruction execution unit 466 may suspend or stop the execution of the process according to the instruction input by the user 20 to the hearing aid 140 until a predetermined condition is met. Examples of the predetermined condition include (i) a condition that the number of times that the earacoustic authentication unit 440 has succeeded in authenticating the user 20 after the earacoustic authentication unit 440 has failed to authenticate the user 20 is equal to or greater than a predetermined value, and (ii) a condition that a predetermined time has passed after the earacoustic authentication unit 440 has failed to authenticate the user 20.

The communication control unit 410 may be an example of a request receiving unit. The request acceptance unit 422 may be an example of a request receiving unit or a request executing unit. The ear acoustic authentication unit 440 may be an example of a first authentication unit. The voiceprint authentication unit 450 may be an example of a second authentication unit. The voice recognition unit 462 may be an example of an instruction accepting unit. The instruction discrimination unit 464 may be an example of an instruction discrimination unit. The instruction execution unit 466 may be an example of an instruction execution unit.

The external device may be an example of an external information processing device. The payment approval process may be an example of a process that requests an action or decision from an instructor. An instruction regarding whether to approve the payment may be an example of an instruction regarding an action or decision.

[Another embodiment]
In the present embodiment, the details of the abnormality detection unit 424 have been described by taking as an example a case in which, when the abnormality detection unit 424 detects an abnormality, the abnormality detection unit 424 outputs information indicating that the abnormality has been detected to the voice synthesis unit 426. However, the abnormality detection unit 424 is not limited to the present embodiment.

In another embodiment, when the abnormality detection unit 424 detects an abnormality, the abnormality detection unit 424 may transmit information indicating that an abnormality has been detected to the sales management system 110. The abnormality detection unit 424 may transmit information indicating the content or type of the detected abnormality to the sales management system 110. When the sales management system 110 acquires the above information from the abnormality detection unit 424, it causes the display unit 118 to display a message notifying that an abnormality has been detected and/or a message notifying the content or type of the abnormality. In this way, the payment system 100 can notify not only the user 20 of the hearing aid 140 but also the staff of the store 30 of the occurrence of the abnormality.

In this embodiment, the details of the controller 320 have been described using as an example a case where, when the request receiving unit 422 receives a request from an external device, the voice synthesis unit 426 synthesizes voice, and the signal processing unit 430 outputs a control signal for outputting the synthesized voice. However, the controller 320 is not limited to this embodiment. In addition to the above functions, the controller 320 has a function of, for example, when communication between the hearing aid 140 and an external device is started or established, (i) outputting a control signal for outputting a voice indicating that communication has been started or established with the external device, and (ii) outputting a control signal for outputting a voice indicating the identification information of the external device with which communication has been started or established.

More specifically, for example, the communication control unit 410 has a connection confirmation unit that confirms that communication has been started or established with an external device. The connection confirmation unit may acquire identification information of the external device from the external device. The identification information may be the name of the external device. The name of the device may be the name of the store 30, or may include the name of the store 30.

When the connection confirmation unit confirms that communication has been started or established with an external device, the communication control unit 410 outputs a signal indicating that communication has been started or established with the external device to the voice synthesis unit 426. At this time, the communication control unit 410 may output identification information of the above-mentioned external device to the voice synthesis unit 426. The voice synthesis unit 426 synthesizes a voice to notify the user 20 that communication has been started or established with the external device. The voice synthesis unit 426 may synthesize a voice to present to the user 20 the name of the external device with which communication has been started or established. Thereafter, the signal processing unit 430 outputs a control signal to output the voice synthesized by the voice synthesis unit 426.

For example, when communication is established between the hearing aid 140 and the sales management system 110 located in the store 30, the hearing aid 140 outputs a voice message such as "The hearing aid 140 has been connected to payment terminal No. 3 of the store 30." Also, when communication is established between the hearing aid 140 and the operating system that operates the electronic commerce site A via the communication terminal of the user 20, the hearing aid 140 outputs a voice message such as "The hearing aid 140 has been connected to the electronic commerce site A." This allows the user 20 to easily understand which system or store is executing the payment process. As a result, the safety of the payment process is improved.

Figure 5 shows an example of information processing in the payment system 100. According to this embodiment, ear acoustic authentication data and voiceprint authentication data are stored in the hearing aid 140, and an example of information processing in the payment system 100 is described using an example in which the hearing aid 140 executes a payment approval process.

According to this embodiment, before the user 20 purchases the product 32, user registration of the hearing aid 140 is performed in steps 512 and 514 (steps may be abbreviated as S). The user registration may be performed by the user 20 or by a salesperson at the store selling the hearing aid 140.

According to this embodiment, in S512, information about the user 20 is registered in the payment agency system management server 120. For example, a user ID, account information, and credit information are registered. In S514, information about the user 20 is registered in the hearing aid 140. For example, a user ID, ear acoustic authentication data, and voiceprint authentication data are registered.

Next, in S520, the user 20 offers to purchase a product or service. For example, the user 20 offers to purchase the product 32 to a salesperson at the store 30. The user 20 also informs the salesperson at the store 30 that they will be using a credit card as the payment method.

At S532, the clerk at the store 30 uses the reading unit 112 of the sales management system 110 to read the product information of the product 32. Once the reading of the product information is complete, the clerk at the store 30 executes an operation to cause the sales management system 110 to start the payment process by credit card payment. This starts the payment process. Once the payment process has started, the payment processing unit 114 of the sales management system 110 sends an approval request to the hearing aid 140.

In S534, when the request receiving unit 422 of the hearing aid 140 receives the approval request, the request receiving unit 422 starts the payment approval process. When the payment approval process starts, the abnormality detection unit 424 determines whether there is an abnormality in the payment, and the voice synthesis unit 426 generates a voice message requesting the user 20 to approve the payment, and controls the signal processing unit 430 to output the voice message. In addition, the authentication control unit 428 controls the signal processing unit 430 to output a test sound for ear acoustic authentication.

When the reflected sound detection microphone 336 detects a reflected sound corresponding to the test sound, the ear acoustic authentication unit 440 analyzes the reflected sound and executes ear acoustic authentication processing. When the sound collection microphone 332 detects a response voice from the user 20 to a voice message requesting the user 20 to approve the payment, the voiceprint authentication unit 450 executes voiceprint authentication processing, and the voice recognition unit 462 executes voice recognition processing to convert the response voice from the user 20 into text data. The instruction discrimination unit 464 discriminates the instruction from the user 20 based on the content of the response from the user 20.

Then, the instruction execution unit 466 determines whether or not to execute processing according to the instruction input by the user 20 to the hearing aid 140 based on the authentication results by the ear acoustic authentication method and the voiceprint authentication method. If the user 20 is authenticated by the ear acoustic authentication method and the voiceprint authentication method, the instruction execution unit 466 transmits a response signal including information indicating that the user 20 has approved the payment to the sales management system 110.

Next, in S536, when the payment processing unit 114 of the sales management system 110 receives the response signal, the payment processing unit 114 requests the payment agency system management server 120 to perform payment processing. For example, the payment processing unit 114 requests the payment agency system management server 120 to perform payment processing by sending payment request information including information indicating the content of the payment by the user 20 to the payment agency system management server 120.

Next, in S538, payment processing is executed between the payment agency system management server 120 and the credit payment system management server 130. When the payment processing is completed, a payment result notification indicating the payment result is sent from the payment agency system management server 120 to the payment processing unit 114 of the sales management system 110.

In S540, when the payment processing unit 114 receives a payment result notification indicating that the payment is complete, the payment processing unit 114 displays a message indicating that the payment is complete on the display unit 118. This allows the store clerk at the store 30 to understand that the payment is complete, and hands over the product 32 to the user 20. In addition, in S550, a deposit/withdrawal process is executed. This causes the purchase price to be debited from the account of the user 20, and the amount of the sales price minus the commission fee is deposited into the account of the store 30.

Figure 6 shows an example of the internal configuration of the hearing aid 602 and the mobile terminal 604. According to this embodiment, the hearing aid 602 and the mobile terminal 604 work together to perform the same processing as the hearing aid 140. In this embodiment, the hearing aid 602 includes, for example, a communication unit 312, a controller 610, a sound collection microphone 332, and an ear acoustic data acquisition unit 340. The mobile terminal 604 includes, for example, a communication unit 312, a memory 314, a GPS receiver 316, and a wearing sensor 318.

According to this embodiment, the functions of the controller 320 are divided between the controller 610 and the controller 620. The division of functions between the controller 610 and the controller 620 can be set arbitrarily, but for example, the controller 610 has a communication control unit 410 and a signal processing unit 430. Also, for example, the controller 620 has a communication control unit 410, a request reception unit 422, an abnormality detection unit 424, a voice synthesis unit 426, an authentication control unit 428, an ear acoustic authentication unit 440, a voiceprint authentication unit 450, a voice recognition unit 462, an instruction discrimination unit 464, and an instruction execution unit 466.

Figure 7 shows a schematic diagram of another example of information processing in the payment system 100. According to the embodiment described in relation to Figure 5, an example of information processing in the payment system 100 has been described using an example in which ear acoustic authentication data and voiceprint authentication data are stored in the hearing aid 140 and the hearing aid 140 executes the payment approval process. In contrast, in the present embodiment, an example of information processing in the payment system 100 has been described using an example in which ear acoustic authentication data and voiceprint authentication data are stored in the payment agency system management server 120 and the payment agency system management server 120 and the hearing aid 140 work together to execute the payment approval process.

This embodiment differs from the embodiment described in relation to FIG. 5 in that in S712, the user ID, account information, credit information, ear acoustic authentication data, and voiceprint authentication data are registered in the payment agency system management server 120. Note that in this embodiment, in S714, for example, the user ID is registered in the hearing aid 140.

Furthermore, according to this embodiment, the payment agency system management server 120 and the hearing aid 140 cooperate to execute the payment approval process in S734, which is different from the embodiment described in relation to FIG. 5. Specifically, when the request acceptance unit 422 of the hearing aid 140 accepts an approval request, the request acceptance unit 422 starts the payment approval process. In addition, the request acceptance unit 422 sends a signal indicating that the payment approval process has started to the payment agency system management server 120. In addition, the request acceptance unit 422 sends payment information indicating the content of the payment to the payment agency system management server 120.

When the payment approval process is started, for example, the payment agency system management server 120 has an anomaly detection unit 424 determine whether or not there is an anomaly in the payment. Also, for example, the voice synthesis unit 426 of the hearing aid 140 generates a voice message requesting the user 20 to approve the payment, and controls the signal processing unit 430 to output the voice message. Also, the authentication control unit 428 of the hearing aid 140 controls the signal processing unit 430 to output a test sound for ear acoustic authentication.

When the reflected sound detection microphone 336 of the hearing aid 140 detects a reflected sound corresponding to the test sound, data of the reflected sound is sent to the payment agency system management server 120. The payment agency system management server 120 analyzes the reflected sound and performs ear acoustic authentication processing. When the sound collection microphone 332 detects a response voice of the user 20 to a voice message requesting the user 20 to approve the payment, data of the response voice is sent to the payment agency system management server 120. The payment agency system management server 120 performs voiceprint authentication processing using the response voice. The payment agency system management server 120 also performs voice recognition processing of the response voice and converts the response voice of the user 20 into text data. The payment agency system management server 120 determines the instructions of the user 20 based on the content of the response of the user 20.

Then, the payment agency system management server 120 determines whether or not to execute processing according to the instructions input by the user 20 to the hearing aid 140 based on the authentication results by the ear acoustic authentication method and the voiceprint authentication method. If the user 20 is authenticated by the ear acoustic authentication method and the voiceprint authentication method, the payment agency system management server 120 decides to execute processing according to the instructions input by the user 20 to the hearing aid 140. The payment agency system management server 120 sends information indicating the decision result to the hearing aid 140. In addition, the hearing aid 140 sends a response signal including information indicating that the user 20 has approved the payment to the sales management system 110.

In steps other than the above differences, the same processing as in the embodiment described in relation to FIG. 5 may be performed. According to this embodiment, the voice recognition processing is performed by the payment agency system management server 120, improving the accuracy of the processing.

In this embodiment, an example of information processing in the payment system 100 has been described using as an example a case where the information processing of the anomaly detection unit 424, ear acoustic authentication unit 440, voiceprint authentication unit 450, voice recognition unit 462, instruction discrimination unit 464, and instruction execution unit 466 in the embodiment described in relation to FIG. 5 is realized in the payment agency system management server 120. However, the division of roles between the payment agency system management server 120 and the hearing aid 140 is not limited to this embodiment. For example, at least one of the ear acoustic authentication processing and the voiceprint authentication processing may be performed in the hearing aid 140.

Figure 8 shows an example of a combination of authentication methods. In the embodiment described with reference to Figures 1 to 7, an example of two-step authentication in the payment system 100 was described using an example in which the owner of the hearing aid 140 is authenticated by an ear acoustic authentication method, and the person pointing at the hearing aid 140 is authenticated by a voiceprint authentication method. However, the combination of authentication methods in two-step authentication is not limited to the above embodiment.

As shown in FIG. 8, the authentication method for the holder of the portable device in two-step authentication may be at least one authentication method selected from the group consisting of ear acoustic authentication, face authentication, vein authentication, iris authentication, fingerprint authentication, and voiceprint authentication. Similarly, the authentication method for the user of the portable device may be at least one authentication method selected from the group consisting of ear acoustic authentication, face authentication, vein authentication, iris authentication, fingerprint authentication, and voiceprint authentication, and may be a different type of authentication method from the holder's authentication method.

Figure 9 shows an example of a computer 3000 in which multiple aspects of the present invention may be embodied in whole or in part. For example, a part of the payment system 100 is realized by the computer 3000. For example, at least a part of the payment processing unit 114 of the sales management system 110 is realized by the computer 3000. For example, at least a part of the payment agency system management server 120 is realized by the computer 3000. For example, at least a part of the credit payment system management server 130 is realized by the computer 3000. For example, at least a part of the controller 320 is realized by the computer 3000. For example, at least a part of the controller 610 is realized by the computer 3000. For example, at least a part of the controller 620 is realized by the computer 3000.

A program installed on the computer 3000 may cause the computer 3000 to function as or perform operations associated with an apparatus according to an embodiment of the present invention or one or more "parts" of the apparatus, and/or to perform a process or steps of the process according to an embodiment of the present invention. Such a program may be executed by the CPU 3012 to cause the computer 3000 to perform certain operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

The computer 3000 according to this embodiment includes a CPU 3012, a RAM 3014, a GPU 3016, and a display device 3018, which are interconnected by a host controller 3010. The computer 3000 also includes input/output units such as a communication interface 3022, a hard disk drive 3024, a DVD-ROM drive 3026, and an IC card drive, which are connected to the host controller 3010 via an input/output controller 3020. The computer also includes legacy input/output units such as a ROM 3030 and a keyboard 3042, which are connected to the input/output controller 3020 via an input/output chip 3040.

The CPU 3012 operates according to the programs stored in the ROM 3030 and the RAM 3014, thereby controlling each unit. The GPU 3016 acquires image data generated by the CPU 3012 into a frame buffer or the like provided in the RAM 3014 or into itself, and causes the image data to be displayed on the display device 3018.

The communication interface 3022 communicates with other electronic devices via a network. The hard disk drive 3024 stores programs and data used by the CPU 3012 in the computer 3000. The DVD-ROM drive 3026 reads programs or data from the DVD-ROM 3001 and provides the programs or data to the hard disk drive 3024 via the RAM 3014. The IC card drive reads programs and data from an IC card and/or writes programs and data to an IC card.

The ROM 3030 stores therein a boot program or the like that is executed by the computer 3000 upon activation, and/or a program that depends on the hardware of the computer 3000. The input/output chip 3040 may also connect various input/output units to the input/output controller 3020 via a parallel port, a serial port, a keyboard port, a mouse port, etc.

The programs are provided by a computer-readable storage medium such as a DVD-ROM 3001 or an IC card. The programs are read from the computer-readable storage medium, installed in the hard disk drive 3024, RAM 3014, or ROM 3030, which are also examples of computer-readable storage media, and executed by the CPU 3012. The information processing described in these programs is read by the computer 3000, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be constructed by realizing the operation or processing of information in accordance with the use of the computer 3000.

For example, when communication is performed between computer 3000 and an external device, CPU 3012 may execute a communication program loaded into RAM 3014 and instruct communication interface 3022 to perform communication processing based on the processing described in the communication program. Under the control of CPU 3012, communication interface 3022 reads transmission data stored in a transmission buffer area provided in RAM 3014, hard disk drive 3024, DVD-ROM 3001, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes received data received from the network to a reception buffer area or the like provided on the recording medium.

The CPU 3012 may also cause all or a necessary portion of a file or database stored on an external recording medium such as the hard disk drive 3024, the DVD-ROM drive 3026 (DVD-ROM 3001), an IC card, etc. to be read into the RAM 3014, and perform various types of processing on the data on the RAM 3014. The CPU 3012 may then write back the processed data to the external recording medium.

Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and may undergo information processing. The CPU 3012 may execute various types of processing on the data read from the RAM 3014, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search/replacement, etc., as described throughout this disclosure and specified by the instruction sequence of the program, and write back the results to the RAM 3014. The CPU 3012 may also search for information in a file, database, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 3012 may search for an entry whose attribute value of the first attribute matches a specified condition from among the plurality of entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

The above-described program or software module may be stored in a computer-readable storage medium on the computer 3000 or in the vicinity of the computer 3000. In addition, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the above-described program to the computer 3000 via the network.

The blocks in the flowcharts and block diagrams in the above embodiments may represent stages of a process in which an operation is performed or "parts" of a device responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and/or a processor provided with computer-readable instructions stored on a computer-readable storage medium. Dedicated circuitry may include digital and/or analog hardware circuitry, and may include integrated circuits (ICs) and/or discrete circuits. Programmable circuitry may include reconfigurable hardware circuitry including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements, such as, for example, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like.

A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon comprises an article of manufacture that includes instructions that can be executed to create means for performing the operations specified in the flowchart or block diagram. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), Blu-ray disks, memory sticks, integrated circuit cards, and the like.

The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk, JAVA, C++, etc., and conventional procedural programming languages such as the "C" programming language or similar programming languages.

The computer-readable instructions may be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, or a programmable circuit, either locally or over a local area network (LAN), a wide area network (WAN), such as the Internet, so that the processor of the general-purpose computer, special-purpose computer, or other programmable data processing apparatus, or the programmable circuit, executes the computer-readable instructions to generate means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

Although the present invention has been described above using an embodiment, the technical scope of the present invention is not limited to the scope described in the above embodiment. It is clear to those skilled in the art that various modifications or improvements can be made to the above embodiment. Furthermore, the details described for a specific embodiment can be applied to other embodiments to the extent that they are not technically inconsistent. It is clear from the claims that such modifications or improvements can also be included in the technical scope of the present invention.

The order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before" or "prior to," and it should be noted that the processes may be performed in any order, unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is explained using "first," "next," etc. for convenience, it does not mean that it is necessary to perform the processes in this order.

10 Communication network, 20 User, 30 Store, 32 Product, 100 Payment system, 110 Sales management system, 112 Reading unit, 114 Payment processing unit, 116 Communication unit, 118 Display unit, 120 Payment agency system management server, 130 Credit payment system management server, 140 Hearing aid, 212 User registration unit, 214 Registration data storage unit, 222 Payment processing unit, 224 Account balance management unit, 312 Communication unit, 314 Memory, 316 GPS receiver, 318 Wearing sensor, 320 Controller, 332 Sound collection microphone, 334 Driver unit, 336 Reflected sound detection microphone, 340 Ear acoustic data acquisition unit, 410 Communication control unit, 422 Request reception unit, 424 Abnormality detection unit, 426 Voice synthesis unit, 428 Authentication control unit, 430 Signal processing unit, 440 Ear acoustic authentication unit, 450 Voiceprint authentication unit, 462 Voice recognition unit, 464 Instruction discrimination unit, 466 Instruction execution unit, 602 Hearing aid, 604 Mobile terminal, 610 Controller, 620 Controller, 3000 Computer, 3001 DVD-ROM, 3010 Host controller, 3012 CPU, 3014 RAM, 3016 GPU, 3018 Display device, 3020 Input/output controller, 3022 Communication interface, 3024 Hard disk drive, 3026 DVD-ROM drive, 3030 ROM, 3040 Input/output chip, 3042 Keyboard

Claims (12)

A control device for controlling a portable device,
a first authentication unit that authenticates a person who carries or wears the portable device by a first biometric authentication method;
an instruction receiving unit that receives an input of an instruction to the portable device;
a second authentication unit that authenticates an instructor who inputs the instruction by a second biometric authentication method different in type from the first biometric authentication method;
an instruction execution unit that executes a process according to the instruction received by the instruction reception unit when the first authentication unit authenticates the holder and the second authentication unit authenticates the instructor;
an anomaly detection unit that analyzes the content of the voice detected by the mobile device and detects an anomaly related to the voice detected by the mobile device;
a voice synthesis unit that synthesizes a voice of a message notifying the holder of the portable device that an abnormality has been detected in the voice detected by the portable device when the abnormality detection unit detects an abnormality in the voice detected by the portable device;
Equipped with
the portable device is a wearable terminal that can be worn on the head of the holder,
the first biometric authentication method is an ear acoustic authentication method,
the second biometric authentication method is a voiceprint authentication method,
The instructions are instructions regarding approval of a payment,
the process of the first authentication unit authenticating the holder, the process of the instruction receiving unit receiving the input of the instruction, and the process of the second authentication unit authenticating the instructor are executed as part of a payment approval process for obtaining approval for a payment,
the first authentication unit, when the payment approval process is started, continuously performs authentication process using the first biometric authentication method during a period in which the payment approval process is being executed;
When the first authentication unit fails to authenticate the instructor using the first biometric authentication method, the instruction execution unit interrupts or cancels execution of a process according to the instruction;
as part of the payment approval process, the portable device outputs a voice to present a payment means to the holder or to inquire about the payment means to the holder, the instructions including instructions regarding the payment means;
When it is detected that the portable device has been removed from the head of the holder, the instruction execution unit resets the authentication result based on the first biometric authentication method.
Control device. Further comprising an instruction discrimination unit that discriminates the content of the instruction.
The control device according to claim 1 . The instruction receiving unit receives the input by voice,
The instruction discrimination unit analyzes the voice related to the instruction accepted by the instruction acceptance unit and discriminates the content of the instruction.
The control device according to claim 2 . a request receiving unit that receives a request signal from another information processing device to cause the portable device to execute a process that requests the instructor to take an action or make a decision;
a request execution unit that executes the process that requests the action or the judgment;
Further equipped with
the instruction receiving unit receives an input of the instruction regarding the action or the judgment when the request executing unit executes the process requesting the action or the judgment.
The control device according to any one of claims 1 to 3 . The process in response to the instruction is (i) a process for requesting the person instructing to approve a payment for a product or service purchased by the person instructing, or (ii) a process for requesting the person instructing to determine whether or not to approve the payment.
The control device according to claim 4 . A control device for controlling a portable device,
a first authentication unit that authenticates a person who carries or wears the portable device by a first biometric authentication method;
an instruction receiving unit that receives an input of an instruction to the portable device;
a second authentication unit that authenticates an instructor who inputs the instruction by a second biometric authentication method different in type from the first biometric authentication method;
an instruction execution unit that executes a process according to the instruction received by the instruction reception unit when the first authentication unit authenticates the holder and the second authentication unit authenticates the instructor;
Equipped with
the portable device is a wearable terminal that can be worn on the head of the holder,
the first biometric authentication method is an ear acoustic authentication method,
the second biometric authentication method is a voiceprint authentication method;
The instructions are instructions regarding approval of a payment,
the process of the first authentication unit authenticating the holder, the process of the instruction receiving unit receiving the input of the instruction, and the process of the second authentication unit authenticating the instructor are executed as part of a payment approval process for obtaining approval for a payment,
the first authentication unit, when the payment approval process is started, continuously performs authentication process using the first biometric authentication method during a period in which the payment approval process is being executed;
When the first authentication unit fails to authenticate the instructor using the first biometric authentication method, the instruction execution unit interrupts or cancels execution of a process according to the instruction;
as part of the payment approval process, the portable device outputs a voice to present a payment means to the holder or to inquire about the payment means to the holder, the instructions including instructions regarding the payment means;
When it is detected that the portable device has been removed from the head of the holder, the instruction execution unit resets the authentication result by the first biometric authentication method;
the second authentication unit compares the voice feature data detected by the portable device with preregistered voiceprint authentication data and determines whether the two match, thereby authenticating the instructor;
The preregistered voiceprint authentication data includes voiceprint authentication data of a plurality of legitimate authorized persons.
Control device. A control device for controlling a portable device,
a first authentication unit that authenticates a person who carries or wears the portable device by a first biometric authentication method;
an instruction receiving unit that receives an input of an instruction to the portable device;
a second authentication unit that authenticates an instructor who inputs the instruction by a second biometric authentication method different in type from the first biometric authentication method;
an instruction execution unit that executes a process according to the instruction received by the instruction reception unit when the first authentication unit authenticates the holder and the second authentication unit authenticates the instructor;
Equipped with
the portable device is a wearable terminal that can be worn on the head of the holder,
the first biometric authentication method is an ear acoustic authentication method,
the second biometric authentication method is a voiceprint authentication method;
The instructions are instructions regarding approval of a payment,
the process of the first authentication unit authenticating the holder, the process of the instruction receiving unit receiving the input of the instruction, and the process of the second authentication unit authenticating the instructor are executed as part of a payment approval process for obtaining approval for a payment,
the first authentication unit, when the payment approval process is started, continuously performs authentication process using the first biometric authentication method during a period in which the payment approval process is being executed;
When the first authentication unit fails to authenticate the instructor using the first biometric authentication method, the instruction execution unit interrupts or cancels execution of a process according to the instruction;
as part of the payment approval process, the portable device outputs a voice to present a payment means to the holder or to inquire about the payment means to the holder, the instructions including instructions regarding the payment means;
When it is detected that the portable device has been removed from the head of the holder, the instruction execution unit resets the authentication result by the first biometric authentication method;
When the first authentication unit fails to authenticate the instructor using the first biometric authentication method, the instruction execution unit suspends or stops execution of a process according to the instruction until a predetermined condition is satisfied;
The predetermined condition includes at least one of: (i) a condition that the number of times that the first authentication unit has succeeded in authenticating the owner using the first biometric authentication method after the first authentication unit has failed to authenticate the owner using the first biometric authentication method is equal to or greater than a predetermined value; and (ii) a condition that a predetermined time has elapsed after the first authentication unit has failed to authenticate the instructor.
Control device. A control device according to any one of claims 1 to 7 ;
a first biometric information acquisition unit that acquires first biometric information used in the first biometric authentication method;
a second biometric information acquisition unit that acquires second biometric information used in the second biometric authentication method;
A mobile device comprising: A program for causing a computer to function as the control device according to any one of claims 1 to 7 . An approval system for approving a payment using a mobile device, comprising:
a first authentication unit that authenticates a person who carries or wears the portable device by a first biometric authentication method;
a second authentication unit that authenticates an instructor who inputs an instruction regarding approval of the payment into the portable device by a second biometric authentication method that is different in type from the first biometric authentication method;
a determination unit that, when the first authentication unit authenticates the holder and the second authentication unit authenticates the instructor, determines whether or not the payment has been approved based on the instruction input by the instructor into the portable device;
an anomaly detection unit that analyzes the content of the voice detected by the mobile device and detects an anomaly related to the voice detected by the mobile device;
a voice synthesis unit that synthesizes a voice of a message notifying the holder of the portable device that an abnormality has been detected in the voice detected by the portable device when the abnormality detection unit detects an abnormality in the voice detected by the portable device;
having
the portable device is a wearable terminal that can be worn on the head of the holder,
the first biometric authentication method is an ear acoustic authentication method,
the second biometric authentication method is a voiceprint authentication method;
the process of authenticating the holder by the first authentication unit, the process of authenticating the instructor by the second authentication unit, and the process of determining whether the payment has been approved by the decision unit are executed as part of a payment approval process for obtaining approval for the payment,
the first authentication unit, when the payment approval process is started, continuously performs authentication process using the first biometric authentication method during a period in which the payment approval process is being executed;
When the first authentication unit fails to authenticate the instructor using the first biometric authentication method, the determination unit interrupts or halts execution of a process for determining whether the payment is approved;
as part of the payment approval process, the portable device outputs a voice to present a payment means to the holder or to inquire about the payment means to the holder, the instructions including instructions regarding the payment means;
when it is detected that the portable device has been removed from the head of the holder, an authentication result based on the first biometric authentication method is reset;
Approval system. 1. A control method for controlling a portable device, comprising:
a first authentication step of authenticating a person who carries or wears the portable device by a first biometric authentication method;
an instruction receiving step of receiving an input of an instruction to the portable device;
a second authentication stage of authenticating an instructor who inputs the instruction by a second biometric authentication method different in type from the first biometric authentication method;
an instruction execution step of executing a process according to the instruction received in the instruction reception step when the holder is authenticated in the first authentication step and the instructor is authenticated in the second authentication step;
an anomaly detection step of detecting an anomaly related to the voice detected by the portable device by analyzing the content of the voice detected by the portable device;
a voice synthesis step of synthesizing a voice of a message notifying the user of the portable device that an abnormality has been detected in the voice detected by the portable device when the abnormality detection step detects an abnormality in the voice detected by the portable device;
having
the portable device is a wearable terminal that can be worn on the head of the holder,
the first biometric authentication method is an ear acoustic authentication method,
the second biometric authentication method is a voiceprint authentication method;
The instructions are instructions regarding approval of a payment,
the first authentication step, the instruction receiving step, and the second authentication step are performed as part of a payment authorization process for obtaining authorization for a payment;
When the payment approval process is started, the authentication process using the first biometric authentication method is continuously performed in the first authentication stage during the period in which the payment approval process is being performed;
If authentication of the instructor using the first biometric authentication method fails in the first authentication step, execution of a process according to the instruction in the instruction execution step is interrupted or stopped;
The control method includes:
as part of the payment approval process, the portable device outputs a voice to present a payment means to the bearer or to query the bearer for the payment means;
resetting an authentication result based on the first biometric authentication method when it is detected that the portable device has been removed from the head of the user;
and
The instructions include instructions regarding the payment instrument.
Control methods. A method for approving a payment using a mobile device, comprising:
a first authentication step of authenticating a person who carries or wears the portable device by a first biometric authentication method;
a second authentication step of authenticating an instructor who inputs an instruction regarding approval of the payment into the portable device by a second biometric authentication method different in type from the first biometric authentication method;
a determination step of determining whether the payment is approved based on the instruction inputted into the mobile device by the instruction person when the holder is authenticated in the first authentication step and the instruction person is authenticated in the second authentication step;
an anomaly detection step of detecting an anomaly related to the voice detected by the portable device by analyzing the content of the voice detected by the portable device;
a voice synthesis step of synthesizing a voice of a message notifying the user of the portable device that an abnormality has been detected in the voice detected by the portable device when the abnormality detection step detects an abnormality in the voice detected by the portable device;
having
the portable device is a wearable terminal that can be worn on the head of the holder,
the first biometric authentication method is an ear acoustic authentication method,
the second biometric authentication method is a voiceprint authentication method;
the first authentication step, the second authentication step, and the determination step are performed as part of a payment authorization process for obtaining authorization for the payment;
When the payment approval process is started, the authentication process using the first biometric authentication method is continuously performed in the first authentication stage during the period in which the payment approval process is being performed;
If the authentication of the instructor using the first biometric authentication method fails in the first authentication step, execution of a process for determining whether the payment is approved in the determination step is interrupted or stopped;
The approval method includes:
as part of the payment approval process, the portable device outputs a voice to present a payment means to the bearer or to query the bearer for the payment means;
resetting an authentication result based on the first biometric authentication method when it is detected that the portable device has been removed from the head of the user;
and
The instructions include instructions regarding the payment instrument.
Approval method.