KR20200010041A - Method and apparatus for performing user authentication - Google Patents

Abstract

According to one embodiment of the present disclosure, provided is a method for performing user authentication, which receives a user authentication request for access to at least one application running on an electronic device, determines a subject and a task constituting a live challenge for authentication based on a context parameter associated with at least one of the electronic device and a user, provides the live challenge generated based on the determination, and determines whether to access to at least one application based on whether the provided live challenge is performed.

Description

Method and device for performing user authentication {METHOD AND APPARATUS FOR PERFORMING USER AUTHENTICATION}

The present disclosure relates to user authentication techniques. More specifically, the present disclosure relates to a method and apparatus for performing user authentication by providing a live challenge generated based on a context parameter associated with a user of an electronic device.

As the digital communication technology is dramatically developed in various types of electronic devices, there is a growing concern about keeping data secure. In electronic devices, data security is required to protect the access, use, disclosure, modification and destruction of information for unauthorized individuals and organizations.

In general, in order to access a limited feature of an electronic device, such as a particular program, application, data, web site, etc., a message may be prompted to enter a password so that a user may be authorized to do so. In addition, there are various methods for identifying and / or authenticating a user of the electronic device. The authentication may include, for example, PIN based authentication, pattern-lock based authentication, CAPTCHA based authentication, biometric (fingerprint recognition, face recognition, iris recognition) based authentication, and the like. 1A is a diagram illustrating examples of authentication types according to the existing technology.

However, there is a problem that existing user authentication methods are not mutual and cumbersome. For example, if a user wants to access an application / website on an electronic device, the traditional method uses CAPTCHA, RE-CAPTCHA to identify the user from a web robot (ie BOT) and give the user permission to access it. Can be given. A user may access an application / website when solving a challenge (eg, captcha 10, pattern 20, question) as shown in FIG. 1A. According to the method shown in FIG. 1A, the BOT can be prevented from using an application / website. However, as the challenge task is already created and stored in the electronic device, a non-interactive authentication method is performed.

Thus, there is a need for more useful alternative techniques for mitigating the above or other disadvantages in authentication.

The disclosed embodiment may generate a live challenge based on a context parameter associated with a user of the electronic device, and perform user authentication based on the live challenge. In addition, the disclosed embodiment may perform user authentication by recognizing an object around the electronic device and providing a live challenge generated in the AR mode in the AR mode.

According to an embodiment, a method of performing user authentication may include receiving a user authentication request for access to at least one application executed in an electronic device; Determining a subject and a task constituting a live challenge for authentication based on a context parameter associated with at least one of the electronic device and the user; Providing a live challenge generated based on the determination; And determining whether to access at least one application based on whether the provided live challenge is performed.

According to an embodiment, a method of performing user authentication may further include identifying an object displayed in a field of view (FoV) of a camera included in an electronic device, and determining the subject and the task may include identifying the identified object. And a subject and a task based on the context parameter.

According to an embodiment, a method of performing user authentication may include: determining a subject and a task, including: determining a subject corresponding to the identified object; And determining a task that can be performed by the determined subject, and providing a live challenge may include displaying a question inducing the determined task.

In the method of performing user authentication according to an embodiment of the present disclosure, the providing of the live challenge may include identifying an AR image of a live challenge including a subject and a task as an augmented reality (AR) mode is set in the electronic device. It may include the step of overlapping the output.

The method of performing user authentication according to an embodiment may further include determining movement information of the electronic device or the user after object identification, and outputting an AR image may include determining the movement information. Based on the above, the method may include adjusting a position at which the AR image is output.

According to an embodiment, a method of performing user authentication may include identifying a location of an electronic device; And determining an object that exists around the electronic device based on the identified location of the electronic device, and determining the subject and the task may determine the subject and the task based on the determined object and the context parameter. have.

In a method of performing user authentication according to an embodiment, determining whether to access may deny access to at least one application because an operation of a user corresponding to a live challenge is not identified within a preset time. The user may allow access to at least one application as the user's operation corresponding to the deny and the live challenge is identified within a preset time.

In the method of performing user authentication according to an embodiment, the context parameter may include setting information of the electronic device, a time and location at which the user authentication request is received, activity performed by the user in the electronic device, and received by the electronic device. And at least one of a notification, social network service (SNS) information, surrounding environment information of the electronic device, a network to which the electronic device is connected, and information about another electronic device connected to the electronic device.

In the method of performing user authentication according to an embodiment, the determining of the subject and the task may determine the subject and the task using a preset learning network model based on a context parameter.

According to an embodiment, an electronic device for performing user authentication may include: an input / output unit; A memory for storing instructions; And at least one processor connected to the memory, wherein the at least one processor receives a user authentication request for access to at least one application executed in the electronic device through the input / output unit by executing an instruction, And determine a subject and a task constituting a live challenge for authentication based on a context parameter associated with at least one of the user, provide a live challenge generated based on the determination through the input / output unit, and based on whether the provided live challenge is performed. To determine whether to access at least one application.

According to an embodiment, a computer program product may include receiving a user authentication request for access to at least one application executed in an electronic device; Determining a subject and a task constituting a live challenge for authentication based on a context parameter associated with at least one of the electronic device and the user; Providing a live challenge generated based on the determination; And a recording medium storing a program for performing an operation of determining whether to access at least one application based on whether the provided live challenge is performed.

1A is a diagram illustrating examples of authentication types according to the existing technology.
1B is a diagram for describing a method of performing user authentication according to an embodiment of the present disclosure.
2 is a block diagram of an electronic device according to an embodiment of the present disclosure.
3 is a block diagram illustrating a live challenge engine of an electronic device according to an embodiment of the present disclosure.
4 is a diagram for describing a process of a live challenge engine for generating a live challenge according to one embodiment of the present disclosure.
5 is a diagram for describing a method of authenticating a user of an electronic device, according to an exemplary embodiment.
6 is a block diagram of an authentication engine of an electronic device for authenticating a user according to an embodiment of the present disclosure.
FIG. 7A is a diagram for describing a process of capturing and displaying an object around a user by an electronic device according to an embodiment of the present disclosure.
FIG. 7B is a diagram for describing a process of determining, by an electronic device, a story based on objects around a user, according to an embodiment of the present disclosure.
7C is a diagram for describing a process of determining, by an electronic device, a subject for a story, according to an embodiment of the present disclosure.
FIG. 7D is a diagram for describing a process in which an electronic device generates a live challenge based on a story, a subject, and a task, according to an embodiment of the present disclosure.
8A is a first portion of a flowchart for describing a method of authenticating a user of an electronic device according to an embodiment of the present disclosure.
8B is a second part of a flowchart for describing a method of authenticating a user of an electronic device, according to an embodiment of the present disclosure.
FIG. 9 is a diagram for describing a method of authenticating a user using a live challenge generated based on weather information, according to an embodiment of the present disclosure.
FIG. 10 is a diagram for describing a method of authenticating a user using a live challenge generated based on a recognized object according to one embodiment of the present disclosure.
FIG. 11 is a diagram for describing a method of authenticating a user by using a live challenge generated based on a recognized object according to one embodiment of the present disclosure.
FIG. 12 is a diagram for describing a method of authenticating a user using a live challenge generated based on a recognized object according to one embodiment of the present disclosure.
FIG. 13 is a diagram for describing a method of authenticating a user by using a live challenge generated based on a recognized object according to one embodiment of the present disclosure.
FIG. 14 is a diagram for describing a method of authenticating a user by using a live challenge generated based on a recognized object according to one embodiment of the present disclosure.
FIG. 15 illustrates a method of authenticating a user using a live challenge generated based on a context parameter according to an embodiment of the present disclosure.
FIG. 16 illustrates a method of authenticating a user using a live challenge generated based on a context parameter according to an embodiment of the present disclosure.
FIG. 17 illustrates a method for authenticating a user using a live challenge generated based on a context parameter according to an embodiment of the present disclosure.
FIG. 18 is a diagram for describing a method of authenticating a user using a live challenge generated based on a context parameter according to an embodiment of the present disclosure.
FIG. 19 illustrates a method for authenticating a user using a live challenge generated based on a context parameter according to an embodiment of the present disclosure.
20 is a diagram for describing a method of performing user authentication by an electronic device according to an exemplary embodiment.
21 is a block diagram of an electronic device that performs user authentication, according to an embodiment.

Terms used in the present disclosure will be briefly described, and a user authentication technique according to the present disclosure will be described in detail.

The terms used in the present disclosure selected general terms that are currently widely used as possible while considering functions in user authentication technology, but may vary according to the intention or precedent of a person skilled in the art, the emergence of a new technology, and the like. In addition, in certain cases, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present disclosure should be defined based on the meanings of the terms and the contents throughout the present disclosure, rather than simply the names of the terms.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are only used to distinguish one component from another. For example, without departing from the scope of the user authentication technique according to the present disclosure, the first component may be named a second component, and similarly, the second component may also be named the first component. The term and / or includes any one of a plurality of related items or a combination of a plurality of related items.

When any part of the specification is to "include" any component, this means that it may further include other components, except to exclude other components unless specifically stated otherwise. In addition, the term "part" as used herein refers to a hardware component such as software, a field programmable gate array (FPGA), or an application specific integrated circuit (ASIC), and the "part" performs certain roles. However, "part" is not meant to be limited to software or hardware. The “unit” may be configured to be in an addressable storage medium and may be configured to play one or more processors. Thus, as an example, a "part" refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, Subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within the components and "parts" may be combined into a smaller number of components and "parts" or further separated into additional components and "parts".

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present disclosure. However, the user authentication technique according to the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the user authentication technology according to the present disclosure, and like reference numerals designate like parts throughout the specification.

According to the existing user authentication technology, user authentication may be performed by prompting the user to provide a password / pattern, CAPTCHA, biometric, etc. on the electronic device. In addition, the electronic device may determine whether the user is authenticated based on whether the password input from the user matches data already stored. In addition, bioinformation may be used for user authentication in addition to the password. For example, a user can perform authentication by providing a fingerprint to a smartphone. As described above, the existing user authentication technology does not correspond to the interactive, and it may be difficult for the user to remember the information (password, pattern, etc.) required for each time, the user may feel uncomfortable.

Unlike conventional user authentication techniques, user authentication techniques in accordance with the present disclosure can perform user authentication in an interactive manner. An electronic device that performs a user authentication method according to an embodiment may generate a live AR challenge based on a plurality of context parameters. The generated live AR challenge may be displayed on the screen of the electronic device operating in the AR mode. The electronic device may induce the user to perform at least one task in real time by displaying the live AR challenge. If the user completes the task successfully, the user can access the electronic device. Therefore, the electronic device according to an embodiment may perform authentication by interacting with a user by checking whether a task according to a live AR challenge is performed in real time.

In addition, the user authentication technique according to the present disclosure may generate a live challenge based on user behavior. For example, an electronic device might ask, "Who is calling every day?" By providing a live challenge based on the question, the user of the BOT and the electronic device (that is, the real user) can be identified.

In addition, the user authentication technique according to the present disclosure can generate a real time live AR challenge without using external hardware components.

Hereinafter, an embodiment of the present disclosure will be described in more detail with reference to FIGS. 1B to 21.

1B is a diagram for describing a method of performing user authentication according to an embodiment of the present disclosure.

Referring to FIG. 1B, the electronic device 100 may receive a user authentication request for access to at least one application from a user. For example, the electronic device 100 may determine that a user authentication request has been received when a user input of touching an icon representing one of at least one application requiring permission to access is identified. However, this is merely an example, and the method of receiving the user authentication request by the electronic device 100 is not limited to the above-described example.

According to an embodiment, when the electronic device 100 receives a user authentication request, the electronic device 100 may automatically operate a camera function to capture the user's surroundings. The camera may capture an object in the vicinity of the user and display the object in the field of view of the camera, thereby identifying the object in the vicinity of the user. For example, the electronic device 100 may identify that there is a window behind the user through an image captured around the user.

Also, the electronic device 100 according to an embodiment may determine a plurality of context parameters associated with at least one of the user and the electronic device 100. The plurality of context parameters may include setting information of an electronic device, time and location at which the user authentication request is received, activity performed by a user in the electronic device, notification received by the electronic device, and social network service (SNS) information. And at least one of surrounding environment information of the electronic device, a network to which the electronic device is connected, and the number of other electronic devices connected to the electronic device. For example, the electronic device 100 may determine that it is currently raining.

The electronic device 100 may determine the real time story based on the recognized object such as a window and the plurality of context parameters.

In addition, the electronic device 100 may select at least one task to be applied to the real-time story. In addition, the electronic device 100 may determine that at least one task needs to be applied to at least one actor. The task may be "killing the spider." In addition, the electronic device 100 may generate a live challenge by combining a real-time story, at least one subject, and at least one task. For example, the live AR challenge illustrated in FIG. 1B may be generated by augmenting a spider, which is an AR image, in a window recognized by the electronic device 100. Live AR challenges may be generated using AR technology, virtual reality (VR) technology, and the like. The electronic device 100 may display a live challenge to the user in the AR mode, and induce the user to perform, for example, a task 110 such as killing a spider. In addition, the user can kill the spider by performing a touch action on the spider to complete the requested task. If the user performs the task successfully, the electronic device 100 may allow access of the user. If the user does not perform the task successfully, the electronic device 100 may deny access.

According to another example, when the time when the window is recognized by the electronic device 100 is a morning time, the live AR challenge may be “open window” for ventilation. According to another example, when the time when the window is recognized by the electronic device 100 is the evening time, the live AR challenge may be "Close window". Live AR challenges may be generated in real time based on context parameters representing user behavior, user environment, and the like. Accordingly, user authentication in an interactive manner can be performed.

2 is a block diagram of an electronic device according to an embodiment of the present disclosure.

Referring to FIG. 2, the electronic device 100 includes a camera 110, a live challenge engine 120, an AR engine 130, an authentication engine 140, a communication unit 150, a processor 160, and a memory 170. And a display 180. However, this is only an example, and the electronic device 100 may include fewer or more components than the aforementioned components. For example, the electronic device 100 may further include a sensor capable of identifying a position or a movement of the user or the electronic device 100 such as a gyroscope and an acceleration sensor. The above-described sensor is merely an example. The sensor included in 100 is not limited to the above-described example.

The live challenge engine 120 according to an embodiment may receive a user authentication request for authenticating that the electronic device 100 is a user. As the user authentication request is received, the live challenge engine 120 may generate a live challenge for the user of the electronic device 100. The live challenge represents a real time story and may include at least one task to be performed by a user.

In one embodiment, the live challenge engine 120 may generate a live challenge for the user by automatically initiating the camera 110 upon receiving the user authentication request. The camera 110 may be an imaging sensor or the like and may be used to capture an image of a user's surroundings. Also, the live challenge engine 120 may recognize objects around the user displayed in the field of view of the camera 110.

In addition, the live challenge engine 120 may determine a plurality of context parameters associated with at least one of the user and the electronic device 100. In an embodiment, the plurality of context parameters may include setting information of an electronic device, a time (eg, current date and time) and location at which the user authentication request is received, activity performed by a user in the electronic device, and the electronic device. At least one of a notification received by the device, social network service (SNS) information, environmental information (ex: weather, lighting) of the electronic device, a network to which the electronic device is connected, and the number of other electronic devices connected to the electronic device It may include.

In addition, the live challenge engine 120 may determine the real-time story based on the recognized object and the plurality of context parameters. The live challenge engine 120 may determine at least one subject based on the real time story. The live challenge engine 120 may determine at least one task to be applied to the at least one subject. In addition, the live challenge engine 120 may generate a live challenge by combining a real time story, at least one subject, and at least one task. At this time, the live challenge may include a live AR challenge. The live AR challenge may be generated by augmenting an AR image representing a subject and a task in a recognized object, which may be provided when the electronic device 100 operates in the AR mode.

According to one embodiment, authentication engine 140 may be coupled to memory 170 and processor 160. The authentication engine 140 can perform user authentication based on the live AR challenge. The AR engine 130 may display the live AR challenge in the AR mode on the screen of the electronic device 100. In addition, the AR engine 130 may derive at least one task to be performed by the user in the AR mode. Authentication engine 140 may determine whether at least one task is successfully performed by a user in AR mode. In addition, the authentication engine 140 may permit the user's access to at least one application of the electronic device 100 as at least one task is successfully performed by the user.

According to another embodiment, the electronic device 100 may identify an object in the vicinity of the user without using the camera 110. The electronic device 100 may determine whether the location of the user is indoors using a GPS (Global Positioning System) sensor, a gyroscope, or any other sensor, and recognize the object based on the location of the user. For example, if the electronic device 100 determines that an eye user is in his or her bedroom, the electronic device 100 withdraws data for that particular location (such as a bedroom), and based on the retrieved data, the live challenge is determined. It can recognize objects that exist at a specific location to create. The extracted data may be, for example, an image photographing a specific position. However, this is merely an example, and the data is not limited thereto.

According to another embodiment, the electronic device 100 may generate a live challenge without using a camera, AR, VR, or the like. The electronic device 100 may dynamically generate a live challenge based on a plurality of context parameters (such as a current user behavior). For example, the location of the user may be determined as an office based on the coordinates of the electronic device 100 acquired using the GPS. Accordingly, the electronic device 100 may determine an object existing in the office, and determine a subject and a task based on the object and generate a live challenge. For example, the electronic device 100 may request a user to select a color of a water bottle from a user desk.

The communicator 150 may be configured to allow hardware components in the electronic device 100 to communicate internally.

The processor 160 may be combined with the memory 170 to process various instructions stored in the memory 170 to authenticate a user of the electronic device 100.

The memory 170 may store instructions to be executed by the processor 160. Memory 170 may include nonvolatile storage elements. Examples of such nonvolatile storage elements may include magnetic hard disks, optical disks, floppy disks, flash memory, or electrically programmable memory (EPROM) or electrically erasable and programmable (EEPROM) memory. In addition, memory 170 may be considered a non-transitory storage medium in some examples. The term "non-transitory" indicates that the storage medium is not implemented with a carrier wave or a propagated signal. However, the term "non-transitory" should not be interpreted that the memory 170 is immovable. In some examples, memory 170 may be configured to store more information than the memory. In certain instances, non-transitory storage media may store data that may change over time (eg, in random access memory (RAM) or cache).

In an embodiment, the display 180 may be configured to display content on the electronic device 100. The display 180 may include, for example, a liquid crystal display (LCD), an active matrix organic light emitting diode (AM-OLED) display, a light emitting diode (LED) display, or the like.

 2 illustrates various hardware components of the electronic device 100, the configuration of the electronic device 100 according to the present disclosure is not limited thereto. In another embodiment, the electronic device 100 may include fewer or more components. In addition, the label or name of each component is used for illustrative purposes only, and does not limit the scope of the present disclosure. One or more components may be combined together to perform the same or substantially similar function of authenticating a user of the electronic device 100.

The electronic device 100 may be, for example, a smart phone, a mobile phone, a laptop, a tablet, a phablet, or the like, but is not limited thereto.

3 is a block diagram illustrating a live challenge engine of an electronic device according to an embodiment of the present disclosure.

Referring to FIG. 3, the live challenge engine 120 includes an object recognition engine 121, a context determination engine 122, a database identification engine 123, a convolution engine 124, a real-time story engine 125, and a subject determination. Engine 126, task determination engine 127, and response determination engine 128.

In one embodiment, the live challenge engine 120 may automatically start the camera 110 of the electronic device 100 upon receiving the user authentication request. In addition, the object recognition engine 121 may recognize objects around the user displayed in the field of view of the camera 110. According to another example, the object recognition engine 121 may determine an object that exists near a user based on a sensor capable of determining a position of a GPS or the like provided in the electronic device 100.

In addition, the context determination engine 122 may determine a plurality of context parameters associated with at least one of a user and an electronic device. In addition, the real-time story engine 125 may determine the real-time story based on the recognized object and the plurality of context parameters.

The subject determination engine 126 may determine at least one subject based on a real time story. Database identification engine 123 may be configured to identify and select user stories from a database. In addition, database identification engine 123 may be configured to identify / select a group of subjects for the user story from the database. The task determination engine 127 may determine at least one task to be applied to at least one subject.

Convolution engine 124 may combine a real-time story, at least one subject, and at least one task to generate a live challenge. The live challenge engine 120 can receive a live challenge from the convolution engine 124.

The task determination engine 127 may induce the user to perform at least one determined task in real time.

Response determination engine 128 may determine whether at least one task is successfully performed by the user.

The live challenge engine 120 according to another embodiment may generate a live challenge for the user without using the camera 110. This may correspond to that described above with reference to FIG. 2.

4 is a diagram for describing a process of a live challenge engine for generating a live challenge according to one embodiment of the present disclosure.

Referring to FIG. 4, the following process may be performed by the live challenge engine 120 of the electronic device 100 to generate a live challenge for the user of the electronic device 100.

In step 401a, the live challenge engine 120 may send the detected object to the database identifier engine 123. The object can be detected, for example, by Bixby vision.

In step 401b, the live challenge engine 120 may send a plurality of context parameters to the convolution engine 124. The plurality of context parameters include current date, current time, current location, difficulty of live challenge, weather information, lighting condition of the user's current environment, speed information at which the user / electronic device 100 moves, landscape, portrait. , Direction of the electronic device 100 (ex: reverse or forward direction), season information (ex: spring, summer, autumn, winter), number / type of accessories connected to the electronic device 100, setting information (ex: sound On / off, power saving on / off), and the like.

In step 402, the live challenge engine 120 may select one from a plurality of databases stored in the memory 170.

In step 403, the live challenge engine 120 may send the selected database and the number of entries to the convolution engine 124.

In steps 404a and 404b, the convolution engine 124 may mix all the context parameters and the number of entries received into the database and generate unique values every hour using some hashing technique, random number generation technique.

In steps 405a and 405b, the convolution engine 124 may transmit the generated value to a database stored in the memory 170. Meanwhile, the live challenge engine 120 may transmit the generated value to the subject determination engine 126.

In step 406, the live challenge engine 120 may select a user story from a database stored in the memory 170 upon receiving the generated value. In addition, the subject determination engine 126 may transmit the user story to the task determination engine 127.

In step 407, task determination engine 127 may determine a question / task that may be displayed to the user. The task determination engine 127 may store a list of tasks that can be performed for each type of subject and recognized object. In addition, task determination engine 127 may be trained using a learning network model based on some data sets of inputs and outputs. For example, subjects and objects can be used as inputs, and questions can be used as outputs. Thus, based on the subject and the object, the task decision engine 127 may identify a set of questions that may be presented for the current scenario. Task determination engine 127 may determine the question based on the current user environment, such as location, timer, and the like. For example, when the user is watching a movie, task determination engine 127 may determine a question to enter information about who the movie actor is.

In step 408, the task decision engine 127 may send the determined question / activity to the response decision engine 128 if the question / activity is determined.

In step 409, the response decision engine 128 may determine the correct response to the question and send it to the subject decision engine 126.

In step 410, the subject determination engine 126 may select a characteristic of the subject (eg, size, shape, color or user story) based on inputs such as user story, difficulty for the live challenge and context parameters. .

For example, suppose you have an example scenario that shows "Your window is displayed and the window has a curtain" as the user story. The context parameters for the current usage environment are as follows:

a. Your current location (e.g. different states, different countries),

b. Current weather conditions (e.g. sunny, rainy, etc.),

c. Current time (e.g. day, night afternoon, etc.),

d. Difficulty values (e.g. Difficult, Easy, Medium).

If the user is in India, the weather is sunny, day time, and easy, the subject determination engine 126 may display a window with open curtains visible (easy difficulty), and the user is well lit You may be asked to close the curtain.

For user authentication, a background service that captures the user's behavior and creates and stores a database of live challenges and solutions for live challenges can be continuously executed in the electronic device 100. To create a live challenge, you need to activate the following types of features:

a. Messages and mail

b. location

c. telephone

d. General activities [e.g. schedule, schedule, health record, etc.]

e. User Trends [Camera Usage, Call Usage, Frequent Calls, Home-Office Routines]

5 is a diagram for describing a method of authenticating a user of an electronic device, according to an exemplary embodiment.

In the following procedure, an embodiment in which the AR engine 130 of the electronic device 100 is involved in user authentication will be described.

1) The input module 101 of the electronic device 100 may receive a user authentication request.

2) The user authentication request may be sent to the AR engine 130.

3) In addition, the AR engine 130 may operate the camera 110 of the electronic device 100.

4) The camera 110 may transmit an image to the Bixby vision 110a of the electronic device. Bixby vision 110a can be built inside camera 110 so that a user can tap a visual icon in the viewfinder to interpret the sine or construct an AR image.

5) Bixby vision 110a may identify objects within the user's field of view and send the identified objects to input module 101.

6) The input module 101 can send the identified object to the live challenge engine 120.

7) The live challenge engine 120 may generate a live AR challenge by augmenting the user story and the subject. Live AR challenges may be generated based on the identified objects and other context parameters. In addition, the live challenge engine 120 may send a live AR challenge to the input module 101. The live challenge engine 120 can also send the results of the live AR challenge to the authentication engine 140.

8) The input module 101 can send the live AR challenge and context parameters to the AR engine 130.

9) AR engine 130 may indicate a live challenge in AR mode via camera 110. The AR animator 131 may be configured to display a live challenge at a specific position of the display 180 of the electronic device 100. Also, the AR engine 130 may operate the movement / motion detector 132 to obtain movement information of the user and the electronic device 100.

10) The movement / motion detector 132 may continuously transmit movement information to the AR engine 130.

11) The AR engine 130 may transmit movement information to the input module 101. The input module 101 can identify whether the live AR challenge was successfully completed.

12) Also, the input module 101 may transmit an authentication result to the authentication engine 140. The authentication engine 140 may determine a correlation between the result received from the live challenge engine 120 and the result received from the input module 101 to determine whether the live AR challenge was successfully completed.

a. If the results from the input module 101 and the results from the live challenge engine 120 are the same, the challenge can be completed successfully. Accordingly, the authentication engine 140 may allow a user to access the electronic device 100.

b. If the result from the input module 101 and the result from the live challenge engine 120 are not the same, the live challenge may not be completed successfully. Accordingly, the authentication engine 140 may deny access of the user to the electronic device 100.

6 is a block diagram of an authentication engine of an electronic device for authenticating a user according to an embodiment of the present disclosure.

The live challenge engine 120 may generate a live challenge and deliver relevant information to the AR engine 130 to provide a live challenge interactively with the camera 110. AR engine 130 may include an AR animator 131 and a movement detector 132. The AR engine 130 may perform an analysis of when, where, and how to show live challenges.

The AR animator 131 may analyze data of the live challenge and determine a location to display the live challenge in the electronic device 100. The AR animator 131 can calculate the exact location at which the live challenge is indicated based on the parameters provided by the live challenge. The AR animator 131 may display the live challenge in the AR mode of the display, at a location determined based on the calculation. In addition, the AR engine 130 may interact with the movement detector 132 to receive user input and transmit the user input to the authentication engine 140. The movement / movement detector 132 may detect a movement of the electronic device 100 using a sensor such as a gyroscope, an accelerometer, and identify whether the user is in a correct state / 3D space.

The following procedure may be performed in the AR engine 130 of the electronic device 100 to authenticate a user of the electronic device 100.

1) Activate the AR animator 131 and the camera 110.

2) Obtain basic coordinates and destination coordinates for the 3D plane.

3) observe the movement of the electronic device 100 and the user until the coordinates of the destination and the electronic device 100 do not match;

4) If the electronic device 100 does not perform the required operation within a limited time, the execution of the AR animator 131 and the camera 110 is disabled and the authentication is set to fail.

5) If the electronic device 100 is in the destination coordinates,

a. The live challenge engine 120 may select the type of questionnaire (such as one tap activity) or activity (such as user movement tracking).

b. The live challenge engine 120 may receive event details, such as the number of objects and details of the object, such as size, type, subtype, color, base coordinates, and the like. The live challenge engine 120 can also send the received event details to the AR engine 130.

c. The AR engine 130 may receive information about the user's action, compare the user action with the result data, and send the result data to the authentication engine 140.

Authentication engine 140 may determine whether the request is successful. Specifically, the authentication engine 140 may determine whether the request is successful based on the comparison of the original behavior sent by the live challenge engine 120 with the user behavior according to the data sent by the AR engine 130. .

7A to 7D are diagrams for describing an example scenario for authenticating a user of the electronic device 100 according to an embodiment of the present disclosure. In this embodiment, it is assumed that a user wants to access the electronic device 100.

The electronic device 100 may receive an access request from a user. As the access request is received, the electronic device 100 may automatically drive the camera 110 to capture an object in the vicinity of the user displayed in the field of view of the camera 110. FIG. 7A is a diagram for describing a process of capturing and displaying an object around a user by an electronic device according to an embodiment of the present disclosure. When the user is at home, as shown in FIG. 7A, the window 200 may be displayed on the electronic device.

In addition, the electronic device 100 may determine a user story based on the detected object and the user's situation. FIG. 7B is a diagram for describing a process of determining, by an electronic device, a story based on objects around a user, according to an embodiment of the present disclosure. The story may include a cobweb 210a selected from a database based on the detected object (such as window 200), as shown in FIG. 7B. Also, according to another exemplary embodiment, the electronic device 100 may determine a story based on the detected object and the user's situation.

In addition, the electronic device 100 may determine a subject for the selected user story based on the context of the user. 7C is a diagram for describing a process of determining, by an electronic device, a subject for a story, according to an embodiment of the present disclosure. The subject is a spider 210b selected from the database based on the detected object (such as window 200) and the story as shown in FIG. 7C.

In addition, the electronic device 100 may generate a live challenge for the user based on the selected story and the subject. In detail, the electronic device 100 may determine a task based on a story and a subject. FIG. 7D is a diagram for describing a process in which an electronic device generates a live challenge based on a story, a subject, and a task, according to an embodiment of the present disclosure. Referring to FIG. 7D, the electronic device 100 may display an AR image in which the spider 210b and the cobweb 210a are augmented on the window 200, and present the task of killing the spider 210b. The user may be asked to live challenge to kill spider 210b, as shown in FIG. 7D. If the user moves the user's hand 300 towards the spider 210b and performs tapping to kill the spider 210b, the live challenge may be completed. The electronic device 100 may continuously monitor the movement of the user to determine whether the live challenge is completed. Accordingly, the electronic device 100 may mutually identify and authenticate a user.

8A is a first portion of a flowchart for describing a method of authenticating a user of an electronic device according to an embodiment of the present disclosure. 8B is a second part of a flowchart illustrating a method of authenticating a user of an electronic device according to an embodiment of the present disclosure.

Hereinafter, a user authentication method according to an embodiment will be described in detail with reference to FIGS. 8A and 8B.

In operation 801, the electronic device 100 may receive a user authentication request. For example, the live challenge engine 120 included in the electronic device may receive a request for authenticating the user.

In operation 802, the electronic device 100 may determine whether to perform authentication using the AR. For example, the live challenge engine 120 can determine whether to perform authentication using the AR.

According to an embodiment, the electronic device 100 may display a message asking whether to perform authentication using the AR and determine whether to perform authentication using the AR based on a user response thereto. According to another embodiment, when the electronic device 100 operates in the AR mode, the electronic device 100 may determine to perform authentication using the AR without inquiring.

In operation 803, the electronic device 100 may automatically execute the camera 110. As determined to perform authentication using the AR, the electronic device 100 may execute the camera 100. In addition, the live challenge engine 120 included in the electronic device 100 may perform a corresponding operation.

In operation 804, the electronic device 100 may identify a user's surrounding object displayed on the camera's FoV. For example, the object recognition engine 121 provided in the electronic device 100 may identify an object around the user.

In operation 805, the electronic device 100 may determine a plurality of context parameters associated with at least one of the user and the electronic device 100. For example, the context determination engine 122 included in the electronic device 100 may determine a context parameter associated with at least one of the user and the electronic device 100.

In operation 806, the electronic device 100 may determine a real-time story based on the recognized object and the plurality of context parameters. For example, the real-time story engine 125 included in the electronic device 100 may determine the real-time story based on the recognized object and the plurality of context parameters.

Information about a story corresponding to an object and a context parameter may be stored in the database of the electronic device 100 in advance. When the object is recognized and a plurality of context parameters indicating the current situation are determined, the electronic device 100 may determine the real-time story by comparing the information with information previously stored in the database.

In operation 807, the electronic device 100 may determine at least one subject based on the real time story. For example, the subject determination engine 126 included in the electronic device 100 may determine at least one subject based on a real time story.

Information on at least one subject that can be set for each story may be stored in the database of the electronic device 100 in advance. When the story is determined, the electronic device 100 may determine the subject based on at least one of the determined story, the context parameter, and the recognized object.

In operation 808, the electronic device 100 may determine at least one task to be applied to at least one subject. For example, the task determination engine 127 included in the electronic device 100 may determine at least one task to be applied to at least one subject.

Information regarding at least one task that can be set for each story may be stored in the database of the electronic device 100 in advance. According to an embodiment, the electronic device 100 may determine a task based on at least one of a story, a subject, a context parameter, and a recognized object.

In operation 809, the electronic device 100 may generate a live AR challenge for the user of the electronic device 100 based on the recognized object and the plurality of context parameters. The electronic device 100 may generate a live AR challenge based on a story, a subject, and a task. Live AR Challenges can allow users to elicit the tasks they need to perform.

For example, the live challenge engine 120 included in the electronic device 100 may generate a live AR challenge for the user based on the recognized object and the plurality of context parameters.

In operation 810, the electronic device 100 may display a live AR challenge on a display in the AR mode.

In operation 811, the electronic device 100 may derive at least one task to be performed by the user in the AR mode. For example, task determination engine 127 may determine at least one task to be performed by the user in AR mode.

In operation 812, the electronic device 100 may determine whether at least one task is successfully performed by the user in the AR mode. For example, the response determination engine 128 included in the electronic device 100 may determine whether at least one task is successfully performed by the user in the AR mode.

In operation 813, the electronic device 100 may determine whether the live AR challenge is completed. For example, live challenge engine 120 can determine whether a live AR challenge has been completed.

In operation 814, the electronic device 100 may allow access to the electronic device of the user. When the user completes the live AR challenge, the electronic device 100 may grant access to the electronic device of the user.

In operation 815, the electronic device 100 may deny the user permission to access the electronic device. If the user does not complete the live AR challenge, the electronic device 100 may refuse to access the user's electronic device.

For example, the authentication engine 140 may deny a user access to the electronic device 100.

In operation 816, the electronic device 100 may determine a plurality of context parameters associated with at least one of the user and the electronic device. As the electronic device 100 determines not to perform authentication using the AR, the electronic device 100 may determine a plurality of context parameters associated with at least one of the user and the electronic device. For example, the context determination engine 122 may determine a plurality of context parameters associated with at least one of the user and the electronic device 100.

In operation 817, the electronic device 100 may determine a real-time story based on the plurality of context parameters. For example, the real time story engine 125 may determine the real time story based on the plurality of context parameters.

In operation 818, the electronic device 100 may determine at least one subject based on the real time story. For example, subject determination engine 126 may determine at least one subject based on a real-time story.

In operation 819, the electronic device 100 may determine at least one task to be applied to at least one subject. For example, task determination engine 127 may determine at least one task to be applied to at least one subject.

In operation 820, the electronic device 100 may generate a live challenge based on a real time story, at least one subject, and at least one task. For example, the live challenge engine 120 may generate a live challenge for a user of the electronic device 100 based on a real time story, at least one subject, and at least one task.

In operation 821, the electronic device 100 may display a live challenge on the display 180.

In operation 822, the electronic device 100 may derive at least one task to be performed by the user. For example, task determination engine 127 may derive at least one task to be performed by the user.

In operation 823, the electronic device 100 may determine whether at least one task is successfully performed by the user. For example, response determination engine 128 may determine whether at least one task was successfully performed by the user.

Various operations, operations, blocks, steps, etc. in the aforementioned flowchart 800 may be performed in a different order or simultaneously. In addition, in some embodiments, some of the operations, operations, blocks, steps, and the like may be omitted, added, or modified without departing from the scope of the present disclosure.

FIG. 9 is a diagram for describing a method of authenticating a user using a live challenge generated based on weather information, according to an embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user. In the present embodiment, it is assumed that user authentication of the electronic device 100 is performed in the AR mode.

Referring to FIG. 9, when the user authentication request is received, the electronic device 100 may automatically execute a camera. Accordingly, objects around the user can be captured in the field of view (FoV) of the camera. For example, the vehicle 910 may be captured in the field of view of the camera 110.

Meanwhile, the electronic device 100 may determine that the current weather is cloudy based on the context parameter. The electronic device 100 may determine to remove raindrops from the vehicle wiper 930 and the vehicle wiper 930 based on the captured object and context parameters. Accordingly, the electronic device 100 may superimpose the AR image of the wiper 930 and the raindrop 920 of the vehicle on the real world image of the vehicle 910 captured by the FoV of the camera. In addition, the electronic device 100 may provide a live AR challenge by outputting a question or a comment to induce the removal of the raindrop 920 by touching the wiper 930 together with the image in which the real world image and the AR image overlap. .

As the user completes the live challenge of removing the raindrops 920 by touching the wiper 930 with the hand 300, the user may be allowed to access the electronic device 100.

FIG. 10 is a diagram for describing a method of authenticating a user using a live challenge generated based on a recognized object according to one embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user. In the present embodiment, it is assumed that user authentication of the electronic device 100 is performed in the AR mode.

Referring to FIG. 10, when a user authentication request is received, the electronic device 100 may automatically execute a camera. Accordingly, objects around the user can be captured in the field of view (FoV) of the camera. For example, balloon 1010 may be captured in the field of view of the camera.

The electronic device 100 may generate a live challenge based on the captured object. For example, the electronic device 100 may select the compass 1020 as a subject constituting the live challenge. In addition, the electronic device 100 may determine to indicate the direction of the balloon 1010 using the compass 1020 for the task constituting the live challenge. The user may also be asked to complete a live AR challenge in which the compass 1020 rotates the compass 1020 so that the needle points to the balloon 1010. The user may access the electronic device 100 by rotating the needle of the compass 1020 in the direction of the balloon 1010 with the hand 300.

FIG. 11 is a diagram for describing a method of authenticating a user by using a live challenge generated based on a recognized object according to one embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user. In the present embodiment, it is assumed that user authentication of the electronic device 100 is performed in the AR mode.

Referring to FIG. 11, when the user authentication request is received, the electronic device 100 may automatically execute a camera. Accordingly, objects around the user can be captured in the field of view (FoV) of the camera. For example, hat 1120 may be captured in the field of view of the camera.

The electronic device 100 may generate a live challenge based on the captured object. For example, the electronic device 100 may select the cowboy 1110 as a subject constituting the live challenge. In addition, the electronic device 100 may determine to put a hat on the cowboy 1110 for the task constituting the live challenge. Accordingly, the electronic device 100 may generate a live challenge by superimposing the AR image of the cowboy 1110 on the real world image of the hat 1120 captured by the camera's FoV.

In addition, the electronic device 100 provides a live AR challenge by outputting a question or a comment to the user to move the hat 1120 to the head of the cowboy 1110 together with the image of the real world image and the AR image. can do. In addition, the user may be asked to drag the hat 1120 with the hand 300 to place it on the face of the cowboy 1110.

FIG. 12 is a diagram for describing a method of authenticating a user using a live challenge generated based on a recognized object according to one embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user. In the present embodiment, it is assumed that user authentication of the electronic device 100 is performed in the AR mode.

Referring to FIG. 12, when the user authentication request is received, the electronic device 100 may automatically execute a camera. Accordingly, objects around the user can be captured in the field of view (FoV) of the camera. For example, cowboy 1210 may be captured in the field of view of the camera.

The electronic device 100 may generate a live challenge based on the captured object. For example, the electronic device 100 may select a cowboy that is an object as a subject constituting a live challenge, and determine to attach a mustache 1220 to the cowboy 1210 as a task constituting the live challenge. Accordingly, the electronic device 100 may generate a live challenge by superimposing the AR image of the mustache 1220 on the real world image of the cowboy 1220 captured by the camera's FoV. In addition, the user may be asked to drag the mustache 1220 with the hand 300 to place it on the face of the cowboy 1210.

FIG. 13 is a diagram for describing a method of authenticating a user by using a live challenge generated based on a recognized object according to one embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user.

Referring to FIG. 13, when the user authentication request is received, the electronic device 100 may automatically execute a camera. Accordingly, objects around the user can be captured in the field of view (FoV) of the camera.

The electronic device 100 may generate a live challenge based on the captured object. For example, the electronic device 100 is a subject constituting the live challenge, and selects a balloon 1310 of different colors captured by the camera, and performs a task constituting a live challenge among the balloons 1310 of different colors. You may decide to choose an odd number of balloons of a certain color. Accordingly, the electronic device 100 may output a comment or question leading to selecting a balloon of a specific color that is odd among balloons 1310 of different colors captured in the field of view of the camera.

When the user completes the live challenge by selecting a balloon having an odd number of colors by hand 300, access to the electronic device 100 may be allowed.

FIG. 14 is a diagram for describing a method of authenticating a user by using a live challenge generated based on a recognized object according to one embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user. Referring to FIG. 14, when the user authentication request is received, the electronic device 100 may automatically execute a camera. Accordingly, objects around the user can be captured in the field of view (FoV) of the camera. For example, the cabin 1410 can be captured in the field of view of the camera.

As the cabin 1410 is captured, the electronic device 100 may determine that the live challenge is knocking on the door of the cabin 1410. The electronic device 100 may output a comment or question for inducing tapping on the door of the cabin 1410 captured in the field of view of the camera.

When the user completes the live challenge of knocking on the door of the cabin 1410 with the hand 300, access to the electronic device 100 may be allowed.

FIG. 15 illustrates a method of authenticating a user using a live challenge generated based on a context parameter according to an embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user. As the user authentication request is received, the electronic device 100 may provide a text input panel to input 2-3 letters of the password associated with the user. Here, the password associated with the user is determined based on the context parameter and may be a word indicating a situation of the user or the electronic device.

On the other hand, for each character, the first character is input in bold letters, the second character is input in italics, the third character may be displayed on the display so that the third character can be entered in lowercase. However, this is merely an example, and a character input panel may be provided in which a combination of characters is mixed to generate a more complicated live challenge. In addition, according to another example, the size, color, etc. of the character may be set differently.

The user may perform a live challenge by touching a specific letter in each letter input panel with the hand 300. When the live challenge is successfully performed, the user may access the electronic device 100.

FIG. 16 illustrates a method of authenticating a user using a live challenge generated based on a context parameter according to an embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user. As the user authentication request is received, the electronic device 100 may determine a subject and a task constituting the live challenge based on the context parameter. Referring to FIG. 16, the electronic device 100 may store context information indicating that the user recently reserved a flight ticket for a trip to New delhi through the electronic device 100. Based on this, the electronic device 100 may generate a live challenge for moving the plane so that the plane is located on the travel date in the calendar.

Accordingly, the electronic device 100 may display a plane image, a calendar image, and a question or comment that induces the plane to be positioned on the travel date on the calendar. The user may access the electronic device 100 by dragging the plane with his hand 300 and placing it on a date corresponding to the travel date.

FIG. 17 illustrates a method for authenticating a user using a live challenge generated based on a context parameter according to an embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user. As the user authentication request is received, the electronic device 100 may determine a subject and a task constituting the live challenge based on the context parameter. Referring to FIG. 17, a call record of a user may be stored in the electronic device 100. Based on this, the electronic device 100 may generate a live challenge in which the user selects who has the most calls yesterday.

Accordingly, the electronic device 100 may display a phone icon, a question or a comment that induces the user to select who is the person who made the most calls yesterday, information on the people who made the call yesterday. The user may access the electronic device 100 by dragging the phone icon with the hand 300 and placing the call on the image of the person who made the most calls yesterday.

FIG. 18 is a diagram for describing a method of authenticating a user using a live challenge generated based on a context parameter according to an embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user. As the user authentication request is received, the electronic device 100 may determine a subject and a task constituting the live challenge based on the context parameter. Referring to FIG. 18, the electronic device 100 may store a user's expenditure details. Based on this, the electronic device 100 may generate a live challenge for selecting how much the user paid most at the grocery store.

Accordingly, the electronic device 100 may display the money image and the wallet image on the display, and display a question or a comment that induces the user to select how much the user paid for the food purchase. The user may repeatedly perform the operation of dragging the money image to the wallet with the hand 300 until the user indicates the amount paid. When the user completes the live challenge, the user may access the electronic device 100.

FIG. 19 illustrates a method for authenticating a user using a live challenge generated based on a context parameter according to an embodiment of the present disclosure.

The electronic device 100 may receive a user authentication request from a user. As the user authentication request is received, the electronic device 100 may determine a subject and a task constituting the live challenge based on the context parameter. Referring to FIG. 19, the electronic device 100 may store a user's call log, messenger record, schedule information, and a photo. Based on this, the electronic device 100 may generate a live challenge for selecting where and where the user met on today's date last month.

Accordingly, the electronic device 100 may display a plurality of place images including an image of a place that the user actually went to today's date last month and an image of another place on the display. In addition, when the user inputs information about a person whom the user met on the date of the last month, the electronic device 100 may generate an image of the user and display a comment or question for inducing the user to move it to a specific place. . The user may complete the live challenge by dragging an image of a person who has met on today's date last month onto the image of a particular place with the hand 300. When the user completes the live challenge, the user may access the electronic device 100.

20 is a diagram for describing a method of performing user authentication by an electronic device according to an exemplary embodiment.

In operation S2010, the electronic device may receive a user authentication request for access to at least one application executed in the electronic device. For example, when the electronic device is in a locked state, as a touch input is received from the user, the electronic device may determine that a user authentication request for access to the home screen of the electronic device has been received. However, this is merely an example, and a manner of receiving a user authentication request is not limited to the above-described example.

In operation S2020, the electronic device may determine a subject and a task constituting a live challenge for authentication based on a context parameter associated with at least one of the electronic device and the user.

According to an embodiment, the electronic device may determine a situation of the electronic device or the user based on the context parameter. The electronic device may determine a subject and a task constituting the live challenge based on the determined situation for the mutual authentication of the user. Here, the subject may be a person, an object, an animal, or the like as a target that performs a specific task.

Meanwhile, according to another exemplary embodiment, the electronic device may identify an object detected on the FoV of the camera and determine a subject and a task constituting the live challenge based on the identified object. This may correspond to the method of generating the live challenge described with reference to FIGS. 9 to 14.

In operation S2030, the electronic device may provide a live challenge generated based on the determination.

According to an embodiment of the present disclosure, the electronic device may output an image or a question related to a subject and a task constituting the live challenge and a question or a question to induce a task to the device.

In operation S2040, the electronic device may determine whether to access at least one application based on whether the provided live challenge is performed.

According to an embodiment of the present disclosure, when an operation of a user corresponding to a live challenge is not identified within a preset time, the electronic device may deny access to at least one application. If the user's action corresponding to the live challenge is identified within a preset time, the electronic device may allow access to at least one application.

21 is a block diagram of an electronic device that performs user authentication, according to an embodiment.

As illustrated in FIG. 21, an electronic device 2100 according to an embodiment may include an input / output unit 2110, a processor 2120, and a memory 2130. However, not all illustrated components are essential components. The electronic device 2100 may be implemented by more components than the illustrated components, and the electronic device 2100 may be implemented by fewer components. For example, the electronic device 2100 may include a plurality of processors, and may include a camera and at least one sensor.

Hereinafter, the components will be described in turn.

The input / output unit 2110 is for receiving a user input or for outputting an audio signal or an image signal, and may include a display unit and a sound output unit. However, this is merely an example, and the components of the input / output unit 2110 are not limited to the above-described example.

The input / output unit 2110 according to an embodiment may receive a user authentication request. As the user authentication request is received, the input / output unit 2110 may output the live challenge generated based on the context parameter. In addition, as the live challenge is provided, the input / output unit 2110 may receive information input by the user for performing the live challenge.

The processor 2120 typically controls the overall operation of the electronic device 2100. For example, the processor 2120 may execute the above-described user authentication method by executing programs stored in the memory 2130.

The processor 2120 may control the input / output unit 2110 to receive a user authentication request for access to at least one application executed in the electronic device. In addition, the processor 2120 may determine a subject and a task constituting a live challenge for authentication based on a context parameter associated with at least one of the electronic device and the user. The processor 2120 may provide the live challenge generated based on the determination through the input / output unit 2110. In addition, the processor 2120 may determine whether to access at least one application based on whether the provided live challenge is performed.

The processor 2120 may identify an object displayed in a field of view (FOV) of a camera (not shown). The processor 2120 may determine a subject and a task based on the identified object and context parameters. In addition, the processor 2120 may display a question for inducing the determined task through the input / output unit.

As the augmented reality (AR) mode is set in the electronic device 2100, the processor 2120 may superimpose and output an AR image of a live challenge including a subject and a task on the identified object.

According to an embodiment, the processor 2120 may determine movement information of the electronic device or the user after object identification based on the movement of the electronic device or the user identified through the sensor (not shown). The processor 2120 may adjust a position at which the AR image is output based on the determined movement information.

The processor 2120 according to an embodiment may identify a location of the electronic device through a sensor (not shown). The processor 2120 may determine an object that exists in the vicinity of the own device based on the location of the electronic device identified through the sensor (not shown). The processor 2120 may determine a subject and a task based on the determined object and context parameters.

According to an embodiment of the present disclosure, the processor 2120 may deny access to at least one application as the operation of the user corresponding to the live challenge is not identified within a preset time. In addition, the processor 2120 may allow access to at least one application as the operation of the user corresponding to the live challenge is identified within a preset time.

The processor 2120 according to an embodiment may determine a subject and a task using a preset learning network model based on a context parameter.

The memory 2130 may store a program for processing and control in the processor 2120, and may store input / output data (eg, live challenge, context parameter).

The memory 2130 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM (RAM, Random Access Memory) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic Disk It may include at least one type of storage medium of the optical disk. In addition, the electronic device 2100 may operate a web storage or a cloud server that performs a storage function of the memory 2130 on the Internet.

Embodiments according to the present disclosure may be implemented through at least one software program executed on at least one hardware device. The components or embodiments illustrated in FIGS. 1 through 21 may include a block that may be at least one of a hardware device or a combination of hardware device and software module.

It is to be understood that the phraseology or terminology used herein is for the purpose of description and not of limitation. Therefore, although the embodiments of the present disclosure have been described in connection with the preferred embodiments, the embodiments of the present disclosure may be modified and implemented within the scope of the technical idea according to the present disclosure.

Method according to an embodiment of the present disclosure may be implemented in the form of program instructions that can be executed by various computer means may be recorded on a computer readable medium. Computer-readable media may include, alone or in combination with the program instructions, data files, data structures, and the like. The program instructions recorded on the media may be those specially designed and constructed for the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

According to an embodiment, a device may include a processor, a memory for storing and executing program data, a persistent storage such as a disk drive, a communication port for communicating with an external device, a touch panel, a key, a user interface such as a button, and the like. Device and the like. Methods implemented by software modules or algorithms may be stored on a computer readable recording medium as computer readable codes or program instructions executable on the processor. The computer-readable recording medium may be a magnetic storage medium (eg, read-only memory (ROM), random-access memory (RAM), floppy disk, hard disk, etc.) and an optical reading medium (eg, CD-ROM). ) And DVD (Digital Versatile Disc). The computer readable recording medium can be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. The medium is readable by the computer, stored in the memory, and can be executed by the processor.

In the present disclosure, the term "computer program product" or "computer-readable recording medium" is used to refer to media such as a memory, a hard disk installed in a hard disk live, and a signal. These "computer program products" or "computer-readable recording media" are means for providing a computer system with software consisting of instructions for performing a user authentication operation by providing a live challenge according to the present disclosure.

In the embodiments illustrated in the drawings, reference numerals have been used, and specific terms have been used to describe the embodiments, but the present invention is not limited to the specific terms, and the embodiments are all contemplated by those skilled in the art. It may contain elements.

An embodiment may be represented by functional block configurations and various processing steps. Such functional blocks may be implemented in various numbers of hardware or / and software configurations that perform particular functions. For example, an embodiment may comprise an integrated circuit configuration such as memory, processing, logic, look-up table, etc., capable of executing various functions by the control of one or more microprocessors or other control devices. You can employ them. In addition, an embodiment may employ the same or different types of cores, different types of CPUs. Similar to the components of the present invention that may be implemented in software programming or software elements, embodiments include C, C ++, including various algorithms implemented in combinations of data structures, processes, routines, or other programming constructs. It may be implemented in a programming or scripting language such as Java, assembler, or the like. Functional aspects may be implemented in algorithms running on one or more processors. In addition, the embodiment may employ the prior art for electronic configuration, signal processing, and / or data processing. Terms such as "mechanism", "element", "means", "configuration" can be used broadly and are not limited to mechanical and physical configurations. The term may include the meaning of a series of routines of software in conjunction with a processor or the like.

Specific implementations described in the embodiments are examples, and do not limit the scope of the embodiments in any way. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connection members of the lines between the components shown in the drawings are illustrative of the functional connection and / or physical or circuit connections as an example, in the actual device replaceable or additional various functional connections, physical It may be represented as a connection, or circuit connections. In addition, unless otherwise specified, such as "essential", "important" may not be a necessary component for the application of the present invention.

In the present disclosure (particularly in the claims), the use of the term “above” and similar indicating terminology may correspond to both the singular and the plural. In addition, when a range is described in an embodiment, the invention includes the invention to which the individual values belonging to the range are applied (unless stated to the contrary), and the description is the same as describing each individual value constituting the range. . Finally, if there is no explicit order or contradiction with respect to the steps constituting the method according to the embodiment, the steps may be performed in a suitable order. The embodiments are not necessarily limited according to the order of description of the above steps. The use of all examples or exemplary terms (eg, etc.) in the embodiments is merely for describing the embodiments in detail, and the scope of the embodiments is limited by the above examples or exemplary terms unless defined by the claims. It is not. Also, one of ordinary skill in the art appreciates that various modifications, combinations and changes can be made in accordance with design conditions and factors within the scope of the appended claims or their equivalents.

Claims (20)

Receiving a user authentication request for access to at least one application running on the electronic device;
Determining a subject and a task constituting a live challenge for authentication based on a context parameter associated with at least one of the electronic device and a user;
Providing a live challenge generated based on the determination; And
Determining whether to access the at least one application based on whether or not the provided live challenge has been performed. The method of claim 1,
Identifying an object displayed in a field of view (FoV) of a camera provided in the electronic device;
Determining the subject and the task,
And determining the subject and the task based on the identified object and the context parameter. The method of claim 2, wherein the determining of the subject and the task comprises:
Determining a subject corresponding to the identified object; And
Determining a task that the determined subject can perform;
Providing the live challenge,
Displaying a question leading to the determined task. The method of claim 2, wherein providing the live challenge comprises:
And displaying an AR image of a live challenge composed of the subject and the task by superimposing the identified object on the identified object as an augmented reality mode is set in the electronic device. The method of claim 4, wherein
Determining movement information of the electronic device or the user after object identification;
The outputting of the AR image may include:
And adjusting a position at which the AR image is output based on the determined movement information. The method of claim 1,
Identifying a location of the electronic device; And
Determining an object existing around the electronic device based on the identified location of the electronic device;
Determining the subject and the task,
And determining the subject and the task based on the determined object and the context parameter. The method of claim 1, wherein determining whether to access the,
As the user's action corresponding to the live challenge is not identified within a preset time, denying access to the at least one application,
And allowing access to the at least one application as the user's action corresponding to the live challenge is identified within the preset time. The method of claim 1, wherein the context parameter,
Setting information of the electronic device, time and location at which the user authentication request was received, activity performed by the user in the electronic device, notification received by the electronic device, social network service (SNS) information, and the electronic device And at least one of information about the surrounding environment, information about a network to which the electronic device is connected, and other electronic devices connected to the electronic device. The method of claim 1, wherein the determining of the subject and the task comprises:
And determining the subject and the task by using a preset learning network model based on the context parameter. Input and output unit;
A memory for storing instructions; And
At least one processor connected with the memory,
The at least one processor executes the instructions,
Receive a user authentication request for access to at least one application running on the electronic device through the input and output unit,
Determine a subject and a task constituting a live challenge for authentication based on a context parameter associated with at least one of the electronic device and a user,
Providing a live challenge generated based on the determination through the input / output unit,
And determine whether to access the at least one application based on whether the provided live challenge is performed. The method of claim 10,
Further includes a camera,
The at least one processor executes the instructions,
Identify an object displayed in a field of view (FoV) of the camera,
And determine the subject and the task based on the identified object and the context parameter. The method of claim 11,
Further includes a display,
The at least one processor executes the instructions,
Determine a subject corresponding to the identified object,
Determine the task that the determined subject can perform,
And display a question leading to the determined task on the display. The method of claim 11, wherein the at least one processor executes the instructions.
When an augmented reality (AR) mode is set in the electronic device, an AR image of a live challenge composed of the subject and the task is overlaid on the identified object and output. The method of claim 13,
Further comprising a sensor for identifying the movement of the electronic device or the user,
The at least one processor executes the instructions,
Determine, via the sensor, movement information of the electronic device or the user after object identification;
And an electronic device configured to adjust a position at which the AR image is output based on the determined movement information. The method of claim 10,
Further comprising a sensor for identifying the location of the electronic device,
The at least one processor executes the instructions,
Determine an object that exists around the electronic device based on the location of the electronic device identified through the sensor,
And determine the subject and the task based on the determined object and the context parameter. The method of claim 10, wherein the at least one processor executes the instructions.
As the user's action corresponding to the live challenge is not identified within a preset time, denying access to the at least one application,
And allow access to the at least one application as the operation of the user corresponding to the live challenge is identified within the preset time. The method of claim 10, wherein the context parameter,
Setting information of the electronic device, time and location at which the user authentication request was received, activity performed by the user in the electronic device, notification received by the electronic device, social network service (SNS) information, and the electronic device And at least one of information about the surrounding environment, information about a network to which the electronic device is connected, and other electronic devices connected to the electronic device. The processor of claim 10, wherein the at least one processor executes the instructions.
And determine the subject and the task by using a preset learning network model based on the context parameter. Receiving a user authentication request for access to at least one application running on the electronic device;
Determining a subject and a task constituting a live challenge for authentication based on a context parameter associated with at least one of the electronic device and a user;
Providing a live challenge generated based on the determination; And
And a program for determining whether to access the at least one application based on whether the provided live challenge is performed. The method of claim 19,
The method may further include identifying an object displayed in a field of view (FoV) of a camera provided in the electronic device.
The operation of determining the subject and the task,
And determine the subject and the task based on the identified object and the context parameter.

Images