KR101698107B1 - Mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a mobile terminal performing authentication using a camera and a control method thereof. According to the present invention, the mobile terminal comprises: a camera; a display unit configured to display a preview image of an image inputted from the camera; and a control unit displaying a first guide image guiding a placement location of a payment card and a second guide image guiding a placement location of an identification (ID) card together with the preview image on the display unit. In response to placement of a graphic object corresponding to the payment card in a display position of the first guide image and placement of a graphic object corresponding to the ID card in a display position of the second guide image, the control unit extracts the card information of the payment card and identification information of the ID card to perform registration of the payment card.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a mobile terminal for performing authentication using a camera and a control method thereof.

A terminal can be divided into a mobile terminal (mobile / portable terminal) and a stationary terminal according to whether the terminal can be moved. The mobile terminal can be divided into a handheld terminal and a vehicle mounted terminal according to whether the user can directly carry the mobile terminal.

The functions of mobile terminals are diversified. For example, there are data and voice communication, photographing and video shooting through a camera, voice recording, music file playback through a speaker system, and outputting an image or video on a display unit. Some terminals are equipped with an electronic game play function or a multimedia player function. In particular, modern mobile terminals can receive multicast signals that provide visual content such as broadcast and video or television programs.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

In recent years, as a part of improvement of a software part, a method of performing settlement using a mobile terminal has been developed. In the payment method using the mobile terminal, there was a method of taking a bar code using an application, a payment method using NFC, and a payment method using MST.

Meanwhile, in order to perform payment using the mobile terminal, information related to the payment means must be registered in the mobile terminal. The user has to inconveniently enter and authenticate the payment information through various steps in order to register the payment means. Therefore, a user who is unfamiliar with the operation of the mobile terminal has difficulty in inputting payment information.

In order to solve this inconvenience, the present invention proposes a method of registering the settlement means without complicated operations.

An object of the present invention is to provide a method of registering a payment means without complicated operations.

It is another object of the present invention to provide an intuitive user interface for registering payment means.

The present invention relates to a mobile terminal that performs authentication using a camera and a control method thereof, and more particularly, to a mobile terminal that performs authentication using a camera and includes a camera, a display unit configured to display a preview image of an image input from the camera, And a controller for displaying a first guide image for guiding the first guide image and a second guide image for guiding an arrangement position of the identification card on the display unit, In response to the graphic object corresponding to the identification card being located at the display position of the second guide image, the card information of the payment card and the identification information of the identification card are extracted to register the payment card .

In one embodiment, if the graphic object corresponding to the payment card is not located at the display position of the first guide image, or if the graphic object corresponding to the identification card is not displayed at the display position of the second guide image The registration of the payment card is not performed.

In one embodiment, when the registration of the payment card is not performed, the graphic object corresponding to the payment card and the graphic object corresponding to the identification card are again extracted from the preview image of the image input from the camera do.

In one embodiment, when the graphic object corresponding to the payment card is located at the display position of the first guide image and the graphic object corresponding to the identification card is not displayed at the display position of the second guide image, The payment information is extracted from the graphic object corresponding to the payment card, and then only the second guide image is displayed on the preview image.

In one embodiment, the control unit controls the camera such that the size of the graphic object corresponding to the payment card or the size of the graphic object corresponding to the identification card has a predetermined size in the preview image .

In one embodiment, the control unit outputs notification information for guiding control of the camera to the preview image for control of the camera.

In one embodiment, the apparatus further includes a position receiver for receiving position information, and when the position information received from the position receiver corresponds to a preset position, the controller displays, on the preview image, Only the first guide image for guiding the display position of the object is displayed.

In one embodiment, the control unit extracts card information from an image including a graphic object corresponding to the payment card, and performs registration of a payment card based on the extracted card information and location information do.

In one embodiment, when the extracted card information matches the pre-stored card information, the controller outputs notification information indicating that the card is a pre-registered card.

In one embodiment, when the graphic object corresponding to the payment card included in the preview image is a fake card, the controller does not register the payment card.

In one embodiment, when the graphic object corresponding to the payment card included in the preview image is a fake card, the controller transmits notification information indicating that the card is a fake card to a predetermined external terminal.

In one embodiment, the control unit performs registration of an additional card in addition to the payment card, based on the extracted card information and the identification information.

In one embodiment, when the preview image includes a plurality of graphic objects corresponding to a plurality of payment cards, the control unit may display a plurality of guide images guiding placement positions of the plurality of payment cards, respectively .

In one embodiment, in the preview image, when a plurality of graphic objects corresponding to a plurality of payment cards are located at positions where a plurality of guide images are displayed, the controller extracts, from the plurality of payment cards, The registration of at least a part of the payment card is performed based on the received card information and the identification information.

In one embodiment, the control unit may display a graphic object corresponding to the registered payment card and a graphic object corresponding to the non-registered payment card among the plurality of graphic objects corresponding to the plurality of payment cards, And displays them separately.

In one embodiment, when the payment card can not be registered based on the extracted card information and the identification information, the control unit extracts predetermined contact information from the extracted card information, And requests encryption information for registration of the payment card to the external terminal corresponding to the information.

In one embodiment, the control unit performs registration of the payment card based on the password information received from the external terminal.

In another embodiment of the present invention, in response to receiving a user's control command for registering a payment means, a step of displaying a preview image of a video input from a camera, a step of displaying a layout Displaying a first guide image guiding a position and a second guide image guiding an arrangement position of the identification card on the display unit; and displaying, in the preview image, a graphic corresponding to the graphic card and the identification card corresponding to the payment card Determining whether an object is located at a position of the first guide image and the second guide image, and if the graphic object corresponding to the payment card is located at a display position of the first guide image, When the graphic object corresponding to the identification card is located at the display position of the guide image, Extracting card information and the identification information of the identification card in the payment card group to include the step of performing the registration of the payment card.

In one embodiment, in performing the registration of the payment card, the graphic object corresponding to the payment card may not be located at the display position of the first guide image, or may be displayed at the display position of the second guide image And does not perform registration of the payment card when the corresponding graphic object is not located.

In one embodiment, in the step of registering the payment card, when authentication of the payment card is not performed, in the preview image of the image input from the camera, the graphic object corresponding to the payment card and the identification card And extracts the corresponding graphic object again.

The present invention can perform authentication of a payment card by simultaneously receiving images of a payment card and an identification card through a camera. Through this, the user can register the payment means in the mobile terminal without going through a complicated procedure.

In addition, the present invention provides a method for easily registering a payment means by a user who is not proficient in operation, by providing various notification information to a user when receiving card information and identification information through a camera.

Further, according to the present invention, by registering a plurality of payment cards at the same time, the payment means can be registered without going through several registration procedures.

1A is a block diagram illustrating a mobile terminal according to the present invention.
FIGS. 1B and 1C are conceptual diagrams illustrating an example of a mobile terminal according to the present invention in different directions.
2 is a flowchart illustrating a control method of registering a payment means using a camera in a mobile terminal according to the present invention. 3 and 4 are flow charts illustrating the control method of FIG.
5A to 7B are conceptual diagrams illustrating various user interfaces provided for registering a payment means when a payment means is registered using a camera.
8 is a conceptual diagram showing an example of registering a payment means when the state of the mobile terminal satisfies predetermined conditions.
FIGS. 9 to 10B are conceptual diagrams showing a control method when the card information recognized through the camera is a pre-registered card or a counterfeit card.
11 is a conceptual diagram showing a method of registering an additional card.
12 is a conceptual diagram showing a method of registering a payment means using previously stored identification information.
13A and 14B are conceptual diagrams showing a method of scanning a plurality of cards through a camera.
FIGS. 15A, 15B, and 15C are conceptual diagrams illustrating a method of individually registering each card when a graphic object corresponding to a plurality of cards exists in the image input from the camera.
16 is a conceptual diagram showing a method of simultaneously registering a plurality of cards.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

However, it will be appreciated by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, will be.

1A to 1C are block diagrams for explaining a mobile terminal according to the present invention, and FIGS. 1B and 1C are conceptual diagrams showing an example of a mobile terminal according to the present invention in different directions.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, ), And the like. The components shown in FIG. 1A are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.

The wireless communication unit 110 may be connected between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and the external server 100. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A microphone 226, a battery gauge, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation detection sensor, A thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs or applications running on the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions (e.g., telephone call receiving function, message receiving function, and calling function) of the mobile terminal 100. Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 1A in order to drive an application program stored in the memory 170. FIG. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [

Hereinafter, the various components of the mobile terminal 100 will be described in detail with reference to FIG. 1A.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) And an external terminal, or a server on a mobile communication network established according to a long term evolution (e. G., Long Term Evolution-Advanced).

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module 114 is connected to the mobile terminal 100 and the wireless communication system through the wireless area networks, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 ) And the other mobile terminal 100 (or the external server). The short-range wireless communication network may be a short-range wireless personal area network.

Here, the other mobile terminal 100 may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 100 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the short- 114 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, The virtual key or the visual key can be displayed on the touch screen with various forms. For example, the virtual key or the visual key can be displayed on the touch screen, ), An icon, a video, or a combination thereof.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor uses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, Detection.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object touching the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to the current state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs the storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal meets a set condition, the control unit 180 can execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

Hereinafter, embodiments related to a control method that can be implemented in a mobile terminal configured as above will be described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

In the following description of the drawings, the drawings drawn on the left side are referred to in the order of clockwise or top-down.

A mobile terminal according to the present invention provides a control method by which a payment means can be registered using a video input from a camera and a user interface accordingly. Hereinafter, the registration method of the settlement means will be described in more detail with reference to the drawings.

2 is a flowchart illustrating a control method of registering a payment means using a camera in a mobile terminal according to the present invention. 3 and 4 are flow charts illustrating the control method of FIG.

First, in order to register the payment means, the controller of the mobile terminal according to the present invention may display a preview image of the image input from the camera on the display unit (S210).

The control unit 180 can activate the camera 121 based on reception of a user's request for registration of the payment means. Here, the activation of the camera 121 may mean a state in which an image corresponding to the subject can be acquired through the image sensor of the camera.

The control unit 180 may display a preview image of the image input from the camera 121 on the display unit 151 when the camera 121 is activated.

The preview image may be a preview image, and may be a pre-image of the image input through the camera 121. [ More specifically, the preview image may be an image input from the camera 121 in real time before the image is captured.

The payment means may be, for example, a credit card, a debit card, a check card, a prepaid card, or the like as an object for performing settlement.

In addition, the controller of the mobile terminal according to the present invention may display the first guide image guided by the payment card together with the preview image and the second guide image guiding the placement position of the identification card on the display unit at step S220.

In order to register the payment means, the control unit 180 needs the card information of the payment card and the identification information of the user. Here, the card information is card-specific information, and may include a card number, a card company, an expiration date, a CVC number, and the like. The identification information is information capable of identifying the user, and may include ID information, a resident registration number, a passport number, biometric information of the user (fingerprint information, iris information, face recognition information, pulse information, etc.).

The controller 180 may display the first guide image and the second guide image together with the preview image on the display unit 151 when the camera 121 is activated to register the payment means.

The first guide image is an image for guiding the placement position of the payment card. The second guide image is an image for guiding an arrangement position of the identification card.

The first guide image and the second guide image may have predetermined sizes and shapes. The predetermined size and shape may be the same size and shape as the size of the graphic object corresponding to each of the payment card and the identification card.

The first guide image may be displayed at the placement position of the payment card in the preview image. Accordingly, the user can move the payment card so that the graphic object corresponding to the payment card is positioned on the first guide image in the preview image.

The second guide image may be displayed at a placement position of the identification card in the preview image. Accordingly, the user can move the identification card so that the graphic object corresponding to the identification card is positioned on the second guide image in the preview image.

3, the control unit 180 displays the first guide image 310 and the second guide image 320 together with the preview image 300 on the display unit 151, Can be displayed on the screen.

The display position of the first guide image and the second guide image may be set by a user. For example, the user can change the display position of the first guide image and the display position of the second guide image. In this case, the user moves the payment card so that the graphic object corresponding to the payment card is positioned at the position where the first guide image is displayed, and moves the payment card so that the graphic object corresponding to the identification card is positioned at the position where the second guide image is displayed Can be moved.

In addition, the controller of the mobile terminal according to the present invention may be configured such that the graphic object corresponding to the payment card is located at the display position of the first guide image, and in response to the graphic object corresponding to the identification card being located at the display position of the second guide image , Card information of the payment card, and identification information of the identification card to perform card authentication (S230).

If the position and size of the guide image coincide with the position and size of the graphic object corresponding to the payment card and the identification card in the preview image, the control unit 180 extracts the card information of the payment card and the identification information Can be extracted.

More specifically, the control unit 180 can determine whether a graphic object corresponding to the payment card is positioned at the display position of the first guide image on the preview image of the image input from the camera 121. [ In addition, the controller 180 may determine whether the graphic object corresponding to the identification card is positioned at the display position of the second guide image in the preview image.

Here, the graphic object is located in the guide image, which means that the display position and size of the graphic object coincide with the display position and size of the guide image.

3, the graphic object 330 corresponding to the payment card is positioned at the display position of the first guide image 310 in the preview image, and the graphic object 330 corresponding to the identification card The second guide image 340 may be positioned at the display position of the second guide image 320. In this case, the controller 180 can determine that the graphic object corresponding to the payment card is located at the display position of the first guide image, and the graphic object corresponding to the identification card is positioned at the display position of the second guide image.

If the graphic object corresponding to the payment card is located at the display position of the first guide image and the graphic object corresponding to the identification card is located at the display position of the second guide image, The card information of the card and the identification information of the identification card can be extracted. The card information and the identification information may be extracted by a conventional scanning technique or the like.

More specifically, the control unit 180 can photograph an image input through the camera 121 to extract card information and identification information. Thereafter, the photographed image is analyzed to extract card information and identification information.

As shown in the third diagram of FIG. 3, while the card information and the identification information are being extracted, the display unit 151 may display notification information indicating that card information and identification information are being extracted.

Alternatively, if at least one of the location and size of the guide image does not match at least one of the location and the size of the graphic object corresponding to the payment card and the identification card, The card information of the card and the identification information of the identification card may not be extracted.

More specifically, if the graphic object corresponding to the payment card is not located at the display position of the first guide image, or if the graphic object corresponding to the identification card is not displayed at the display position of the second guide image The card information of the payment card and the identification information of the identification card may not be extracted from each graphic object.

Here, the fact that the graphic object is not located in the guide image means that the display position and size of the graphic object do not coincide with the position and size of the guide image.

For example, if the graphic object corresponding to the payment card is not located at the display position of the first guide image in the preview image and the graphic object corresponding to the identification card is located at the display position of the second guide image The card information of the payment card and the identification information of the identification card may not be extracted from each graphic object.

As another example, in the preview image, when the graphic object corresponding to the payment card is located at the display position of the first guide image and the graphic object corresponding to the identification card is not displayed at the display position of the second guide image The card information of the payment card and the identification information of the identification card may not be extracted from each graphic object.

As another example, the control unit 180 determines that the graphic object corresponding to the payment card is not located at the display position of the first guide image and the graphic object corresponding to the identification card is located at the display position of the second guide image The card information of the payment card and the identification information of the identification card may not be extracted from each graphic object.

4, the controller 180 may determine that the size of the graphic object 330 corresponding to the payment card is larger than the size of the first guide image 310, The card information of the payment card and the identification information of the identification card may not be extracted from each graphic object.

As another example, if the size of the graphic object 330 corresponding to the payment card is smaller than the size of the first guide image 310, or the size of the second guide image 320 is larger than the size of the second guide image 320, The card information of the payment card and the identification information of the identification card may not be extracted from each graphic object.

Alternatively, the controller 180 may display only one of the graphic objects corresponding to the payment card at the display position of the first guide image and the graphic object corresponding to the identification card at the display position of the second guide image, If it is located at the display position of the image, card information or identification information can be extracted from only one of the graphic objects.

For example, as shown in the first and second figures of FIG. 5A, the control unit 180 determines that the graphic object corresponding to the payment card is located at the display position of the first guide image in the preview image, The card information of the payment card may be extracted from the graphic object corresponding to the payment card and the identification information may not be extracted from the graphic object corresponding to the identification card if the graphic object corresponding to the identification card is not located at the location.

As another example, the control unit 180 determines that the graphic object corresponding to the payment card is not located at the display position of the first guide image and the graphic object corresponding to the identification card is located at the display position of the second guide image The identification information can be extracted from the graphic object corresponding to the identification card without extracting the card information of the payment card from the graphic object corresponding to the payment card.

In this case, the control unit 180 may display the preview image of the image input from the camera 121 on the display unit, in order to extract the card information and the non-extracted information among the identification information. At this time, in the preview image, only one guide image for guiding the placement position of the graphic object corresponding to the information not extracted among the first guide image and the second guide image may be displayed. Therefore, the present invention can provide a method of continuously extracting information even when information is not extracted.

If the graphic object corresponding to the payment card is not located at the display position of the first guide image or the graphic object corresponding to the identification card is not displayed at the display position of the second guide image, The camera 121 may be controlled such that a graphic object corresponding to the payment card is located at the display position of the first guide image and a graphic object corresponding to the identification card is located at the display position of the second guide image. Therefore, the present invention can extract card information and identification information without direct manipulation of the user.

If the graphic object corresponding to the payment card is not located at the display position of the first guide image or the graphic object corresponding to the identification card is not displayed at the display position of the second guide image, An indicator (or indicator) is placed on the preview image so that the graphic object corresponding to the payment card is positioned at the display position of the first guide image and the graphic object corresponding to the identification card is positioned at the display position of the second guide image Can be displayed. Therefore, the user can be assisted with the operation for registering the payment means through the indicator.

When the card information and the identification information are extracted, the control unit 180 may transmit the card information and the identification information to the predetermined external server. The predetermined external server may be a server provided by the card supplier in order to register the payment means in the mobile terminal.

Meanwhile, the card information may include information on a predetermined external server. For example, the card information may include an IP address of an external server. Accordingly, the controller 180 may transmit the card information and the identification information to the predetermined external server based on the information about the predetermined external server included in the card information.

The card information and the identification information may be stored in advance in association with the predetermined external server. When the card information and the identification information are received from the mobile terminal, the predetermined external server can determine whether the card information matches the stored card information and the identification information.

The predetermined external server may transmit the authentication information so that the mobile terminal registers the payment means when the card information and the identification information received from the mobile terminal coincide with the stored card information and the identification information.

When receiving authentication information from a predetermined external server, the control unit 180 of the mobile terminal can perform card authentication based on the authentication information. Therefore, the control unit 180 can register the payment card as a payment means.

In this case, as shown in the fourth diagram of FIG. 3, the controller 180 may display a part of the card information of the registered card on the display unit 151. FIG.

Meanwhile, if the card information and the identification information received from the mobile terminal and the pre-stored card information and the identification information do not match, the predetermined external server may not transmit the authentication information so as to register the payment means in the mobile terminal .

The control unit 180 of the mobile terminal can determine that the registration of the payment means has failed if the authentication information is not received within a predetermined time after the transmission of the card information and the identification information. In this case, the control unit 180 may not be able to register the payment means based on the card information.

In this case, the control unit 180 may determine whether there is external terminal information set in advance in the card information. If there is preset external terminal information, the controller 180 may transmit a request signal for requesting authentication information for authentication of the payment card to the predetermined external terminal. Here, the preset external terminal information may be contact information.

When the controller 180 receives the encryption information from the predetermined external terminal after transmitting the request signal for requesting the encryption information, the controller 180 may register the payment card based on the encryption information. More specifically, the control unit 180 may transmit the encryption information to a predetermined external server, receive authentication information from a predetermined external server, and register the payment card. In this way, the user can register the card of the other person in his / her mobile terminal.

In the foregoing description, a method of extracting the card information and the identification information together for the registration of the payment means has been described. However, when the preset condition is satisfied, the control unit 180 can register the payment means only with the card information without extracting the identification information. Therefore, the user can more easily register the payment means.

Further, the control unit 180 can register a plurality of payment cards simultaneously or sequentially as payment means. More specifically, the control unit 180 can simultaneously receive card information of a plurality of payment cards through the camera 121. [ Thereafter, the control unit 180 can simultaneously register the card information and the identification information of the plurality of payment cards simultaneously or sequentially to the predetermined external server, thereby concurrently registering the card information and the single identification information as payment means. Therefore, the user can register the payment means at one time when registering the plurality of payment means.

In the foregoing, a method of registering the settlement means using the camera has been described. Through this, the user can conveniently register the payment means without going through various steps.

Hereinafter, various user interfaces provided for registering the payment means when the payment means is registered using the camera will be described. 5A to 7B are conceptual diagrams illustrating various user interfaces provided for registering a payment means when a payment means is registered using a camera.

The control unit 180 of the mobile terminal according to the present invention can register the payment means using the camera 121. [ In this case, the control unit 180 extracts the card information and the identification information from the graphic object corresponding to the payment card and the identification card corresponding to the payment card inputted through the camera 121, You can register your card.

5A, the controller 180 receives the graphic object corresponding to the payment card and the graphic object corresponding to the identification card through the camera 121, The first guide image 310 and the second guide image 320 can be displayed on the display unit 151 together with the preview image 300 of the image.

5A, the controller 180 determines that the graphic object 330 corresponding to the payment card is displayed at the display position of the first guide image 310 in the preview image 300 And may determine whether the graphic object 340 corresponding to the identification card is located at the display position of the second guide image 320. [

If either one of the graphic object 330 corresponding to the payment card or the graphic object 340 corresponding to the identification card is located at the display position of any one of the first guide image 310 or the second guide image 320, The control unit 180 may not extract the card information or the identification information from any one not located in the guide image. 5A, when the graphic object 340 corresponding to the identification card is not located at the display position of the second guide image, the control unit 180 may not extract the identification information .

In this case, in order to prevent the re-extraction of the card information, the controller 180 changes the visual appearance of the first guide image and extracts the identification information from the graphic object disposed at the position where the second guide image is displayed 2 Guide image can be displayed as it is. That is, the controller 180 can selectively extract only the graphic objects displayed in the second guide image.

For example, as shown in the third drawing of FIG. 5A, when the card information is extracted and the identification information is not extracted, the controller 180 determines the color of the first guide image Can be changed to gray, and the second guide image can be outputted as it is.

Alternatively, the controller 180 may cause the first guide image to disappear from the preview image to prevent re-extraction of the card information. For example, as shown in the first and second figures of FIG. 5B, the control unit 180 may cause the first guide image to disappear from the preview image 300 after the card information is extracted. In this case, the controller 180 may display only the second guide image 320, which guides the placement position of the graphic object corresponding to the identification card, together with the preview image 300.

On the other hand, when the size of the graphic object corresponding to the payment card and the size of the graphic object corresponding to the identification card are different from the size of the first guide image and the second guide image, the controller 180 zooms the camera 121 Zoom-in or zoom-out.

For example, as shown in the first drawing of FIG. 6A, when the size of the graphic object corresponding to the payment card and the identification card corresponding to the identification card is smaller than the size of the first guide image and the second guide image, If it is small, the camera 121 can be zoomed-in.

More specifically, the controller 180 determines whether the size of the graphic object corresponding to the payment card and the identification card corresponds to the size of the first guide image and the second guide image, The focal length of the lens 121 can be set. That is, the focal distance of the camera 121 can be calculated by the size of the graphic object corresponding to the payment card and the size of the first guide image and the second guide image corresponding to the identification card.

As a result of changing the focal length of the camera, as shown in the second drawing of FIG. 6A, in the preview image, the size of the graphic object corresponding to the payment card and the size of the graphic object corresponding to the identification card, The size of the image may match. In this case, the control unit 180 can extract the card information of the payment card and the identification information of the identification card and register the payment means.

As another example, as shown in the first drawing of FIG. 6B, when the size of the graphic object corresponding to the payment card and the identification card corresponding to the payment card is smaller than the size of the first guide image and the second guide image If it is large, the camera 121 can be zoomed-out. Here, the control method for zooming in is replaced with a control method for zooming in earlier.

Alternatively, when the size of the graphic object corresponding to the payment card and the size of the graphic object corresponding to the identification card are different from the size of the first guide image and the second guide image, the controller 180 may zoom in or zoom out the camera It is possible to output notification information so as to cause the camera 121 to perform zoom in or zoom out.

6C, if the size of the graphic object corresponding to the payment card and the size of the graphic object corresponding to the identification card is smaller than the size of the first guide image and the second guide image, for example, In order to induce the zoom in of the camera, it is possible to display notification information "enlarge the image by zooming in on the camera" together with the preview image.

Alternatively, when the display position of the graphic object corresponding to the payment card and the graphic card corresponding to the identification card is different from the display position of the first guide image and the second guide image, the control unit 180 determines that the graphic object corresponding to the payment card And notification information for guiding the movement of the display position of the graphic object corresponding to the identification card.

For example, as shown in the first and second drawings of FIG. 7A, when the graphic object corresponding to the payment card is located to the right of the display position of the first guide image, a notification saying "please move the card to the left" Information can be displayed in an area adjacent to the first guide image. In addition, when the graphic object corresponding to the identification card is positioned to the left of the display position of the second guide image, it is possible to display the notification information "Please move the card to the right" in the area adjacent to the second guide image.

As another example, when the graphic object corresponding to the payment card is located above the display position of the first guide image, as shown in the first and second drawings of Fig. 7B, a notification "Please move the card downward" Information can be displayed in an area adjacent to the first guide image. When the graphic object corresponding to the identification card is located below the display position of the second guide image, it is possible to display the notification information "Please move the card upward" in an area adjacent to the second guide image.

In the foregoing, a method of providing various user interfaces for registering the payment means when the payment means is registered using the camera has been described. Through this, the user can more intuitively register the payment means in various ways.

Hereinafter, a method of registering the settlement means when the state of the mobile terminal satisfies predetermined conditions will be described. 8 is a conceptual diagram showing an example of registering a payment means when the state of the mobile terminal satisfies predetermined conditions.

If the state of the mobile terminal satisfies the predetermined condition, the control unit 180 can immediately register the payment means without detecting the identification information.

The predetermined condition may be a condition that a state of the mobile terminal satisfies a security level for card registration. For example, the predetermined conditions include a condition that the mobile terminal is located at a specific position, a condition that the mobile terminal is log-in of a public certificate installed in the mobile terminal, Condition may be any one of the conditions.

Therefore, the control unit 180 can register the payment means without extracting the identification information, for the sake of security.

8, when the condition of the mobile terminal satisfies the predetermined condition, the controller 180 determines whether the preview image 300 is displayed in response to the user's request for registration of the payment means, And the first guide image 310 for guiding the placement position of the graphic object corresponding to the payment card can be displayed on the display unit 151 together. In addition, the controller 180 may not display the second guide image 320 on the display 151 to guide the placement position of the graphic object corresponding to the identification card.

In this case, when the graphic object 330 corresponding to the payment card is located at the display position of the first guide image 310, the controller 180 extracts the card information of the payment card, The payment card can be registered. When the payment card is registered, as shown in the second diagram of FIG. 8, the display unit 151 may display part of the card information of the payment card and notification information indicating that the registration is completed.

The above describes a method of registering the payment means when the state of the mobile terminal satisfies predetermined conditions. Accordingly, when the state of the mobile terminal satisfies the security required when registering the payment means, the user can conveniently register the payment means without inputting the identification information.

Hereinafter, a control method in the case where the card information recognized through the camera is a pre-registered card or a fake card will be described. FIGS. 9 to 10B are conceptual diagrams showing a control method when the card information recognized through the camera is a pre-registered card or a counterfeit card.

The control unit 180 extracts the card information and the identification information from the image input through the camera 121, and registers the payment means in the mobile terminal using the card information and the identification information.

On the other hand, when the extracted card information matches the card information previously stored on the memory 170 of the mobile terminal, the controller 180 may terminate the registration process of the extracted card information to the payment means. That is, when the extracted card information is a card already registered as a payment means, the control unit 180 does not perform re-registration.

If the registration procedure is terminated, the controller 180 may deactivate the camera 121 which has been activated for registration of the payment means. Also, as shown in the first and second drawings in Fig. 9, the display unit 151 may display notification information "This is a pre-registered card. Completion of the registration procedure ".

On the other hand, the control unit 180 may determine that the graphics object corresponding to the payment card in the image input through the camera 121 is a fake card. A counterfeit card is a counterfeit card, for example, a photo of a payment card, a card made of a material similar to a payment card, or an expired card. Various falsification detection algorithms that are used in the past can be used as an algorithm for determining whether a fake card exists.

If it is determined that the card is a counterfeit card, the control unit 180 may terminate the registration procedure of the payment means. And, as shown in the first and second drawings in Fig. 10, it is possible to display the notification information "It is a fake card.

If it is determined that the card is a counterfeit card, the control unit 180 may transmit notification information indicating that an attempt has been made to register the counterfeit card in the predetermined external terminal. The predetermined external terminal may be an external terminal corresponding to the preset telephone number in the mobile terminal. This can be a preset telephone number when the user issues the payment card.

For example, as shown in the first and second figures of FIG. 10B, when it is determined that the graphic object corresponding to the payment card is a fake card, the controller 180 transmits notification information to the predetermined external terminal, Information indicating that the notification information has been transmitted to the external terminal can be displayed on the display unit 151. [ Accordingly, the controller 180 notifies the preset external terminal of the registration attempt of the fake card, thereby enhancing the security.

The control method in the case where the card information recognized through the camera is a pre-registered card or a fake card has been described above. Thus, the user can prevent re-registration of a previously registered card and registration of a fake card.

Hereinafter, a method of performing registration of an additional card will be described. 11 is a conceptual diagram showing a method of registering an additional card.

The control unit 180 transmits the card information corresponding to the payment card and the corresponding identification information of the identification card to the predetermined external server for registration of the payment means, It is possible to receive a signal indicating the presence. Here, the additional card can be extracted on the basis of the identification information in the predetermined external server. For example, when a card supplier A issues an A1, A2, or A3 card based on the identification information of B, the predetermined external server generates A2 and A3 cards based on the card information of A1 and the identification information of B, Card information of the A3 card can be extracted.

In response to a signal indicating that the additional card exists, the control unit 180 may display notification information indicating the presence of the additional card on the display unit 151. [ For example, as shown in the first and second diagrams of FIG. 11, in response to receiving a signal indicating that an additional card related to the payment card exists from the preset external server, Quot; Are you sure you want to register an additional card? &Quot;.

The control unit 180 receives the card information of the additional card from the predetermined external server based on the reception of the user's request for registration of the additional card and registers the additional card together with the payment card . In this case, as shown in the third diagram of FIG. 11, notification information indicating that the payment card 1100 and the additional cards 1120 and 1130 are registered may be displayed on the display unit 151.

In the foregoing, a method of registering an additional card has been described. Through this, the user can register several cards at a time without issuing any additional procedure when a card issuer issues several cards.

Hereinafter, a method of registering a payment means using previously stored identification information will be described. 12 is a conceptual diagram showing a method of registering a payment means using previously stored identification information.

If the card information is input without receiving the card information and the identification information at the same time, the control unit 180 can perform the registration procedure of the payment means using the previously stored identification information.

The previously stored identification information may be the identification information of the user stored in the memory 170 of the mobile terminal or may be unique identification information of the mobile terminal. For example, the previously stored identification information may be resident registration information, passport information, authorized certificate information, international mobile equipement identity (IMEI), and the like.

When the graphic object corresponding to the payment card is extracted from the preview image, the control unit 180 can detect the identification information previously stored in the mobile terminal. Then, the control unit 180 may display the detected identification information on the preview image.

For example, as shown in the first and second diagrams of FIG. 12, the controller 180 displays a graphic object 330 corresponding to the payment card in the preview image 300 of the image input through the camera 121 The icon 1200 corresponding to the identification card can be displayed together with the preview image when the first guide image 310 is located at the display position of the first guide image 310. [

The controller 180 may transmit the card information and the identification information of the payment card to a predetermined external server in response to a user's control command for card registration.

For example, as shown in the second diagram of FIG. 12, the controller 180 moves the icon 1200 corresponding to the identification information to the graphic object 300 corresponding to the payment card, based on the drag input The card information and the identification information of the payment card can be transmitted to the predetermined external server.

Thereafter, the control unit 180 can register the payment card as a payment means. In this case, as shown in the third drawing of FIG. 12, notification information indicating that the registration is completed can be displayed on the display unit 151.

In the foregoing, a method of registering a payment card using previously stored identification information has been described. Accordingly, the user can immediately perform the registration process of the payment card without inputting the identification information on the preview image on which the payment card is recognized.

A method of registering a plurality of cards will be described below. 13A and 14B are conceptual diagrams showing a method of scanning a plurality of cards through a camera. FIGS. 15A, 15B, and 15C are conceptual diagrams illustrating a method of individually registering each card when a graphic object corresponding to a plurality of cards exists in the image input from the camera. 16 is a conceptual diagram showing a method of simultaneously registering a plurality of cards.

The controller 180 of the mobile terminal according to the present invention can simultaneously register a plurality of payment means. That is, the control unit 180 simultaneously detects graphic objects corresponding to a plurality of payment means in the image input through the camera 121, and registers the payment means using the detected graphic objects.

13A, in order to receive a plurality of pieces of card information, the control unit 180 displays a preview image 300 of a video input through the camera 121, a graphics corresponding to a plurality of payment cards A plurality of guide images 1310, 1320 and 1330 guiding the placement positions of the objects can be displayed on the display unit 151. [

In this case, the control unit 180 can determine whether or not the graphic object corresponding to the payment card is positioned at the display position of each guide image.

If a graphic object corresponding to a different payment card is located at the display position of each of the plurality of guide images 1310, 1320 and 1330, the control unit 180 can extract card information from different payment cards have. 13A, the control unit 180 displays notification information 1340 ("recognized completion") indicating that card information has been extracted from graphic objects corresponding to different payment cards together with the preview image can do.

On the other hand, if the graphic object corresponding to the payment card is not positioned at the display position of any one of the plurality of guide images in the preview image, the controller 180 re-enters the graphic object corresponding to the payment card Can receive.

For example, as shown in the first drawing of Fig. 13B, the control unit 180 may display the guidance image 1330 corresponding to the payment card at the display position of any one of the plurality of guide images 1310, 1320, and 1330 It is possible to display notification information 1350 ("re-recognition required") indicating that a re-entry is necessary on an area adjacent to any one of the guide images 1330. [

13B, the controller 180 displays any one guide image 1330 together with the preview image 300 in response to receiving a user's request for re-input (step < RTI ID = 0.0 > .

If the graphic object corresponding to the payment card is located at a position where one of the guide images 1330 is displayed in the preview image 300, the controller 180 may extract the card information from the graphic object corresponding to the payment card . In this case, as shown in the third diagram of FIG. 13B, the controller 180 may display notification information indicating that the card information is extracted from the graphic objects corresponding to the plurality of payment cards on the preview image 300. [

On the other hand, the control unit 180 performs a function of canceling the registration process of at least one payment card among a plurality of payment cards or a function of inputting new card information in a state in which the card information is extracted from the graphic objects corresponding to the plurality of payment cards can do.

More specifically, as shown in the first diagram of FIG. 14A, in a state where the card information is extracted from the graphic objects corresponding to the plurality of payment cards, the control unit 180 displays the graphic object corresponding to one of the payment cards It is possible to detect that the drag input in the first direction is applied. The first direction may be a predetermined direction, for example, a left-to-right direction with respect to a front surface of the display unit.

In this case, the controller 180 can cancel the registration process of the graphic object corresponding to one of the payment cards. The cancellation of the registration procedure may mean the operation of the mobile terminal, which terminates the registration of the payment card as a payment means.

On the other hand, as shown in the second diagram of FIG. 14A, in response to the drag input of the first direction, the controller 180 performs a function of canceling the registration procedure by dragging in the first direction The graphic object 1400 can be displayed together.

When the registration procedure ends, the graphic object corresponding to one of the payment cards disappears on the display unit 151 as shown in the third diagram of FIG. 14A. Therefore, the user can continue the registration process only for the graphic objects corresponding to the remaining payment cards.

14B, the controller 180 extracts the card information from the graphic objects corresponding to the plurality of payment cards and displays the graphic object corresponding to one of the payment cards in the area where the graphic object corresponding to one of the payment cards is displayed It is possible to detect that a two-directional drag input is applied. The second direction may be opposite to the first direction. For example, the second direction may be a direction from the right to the left with respect to the front surface of the display unit 151.

In this case, the control unit 180 can newly input the card information. More specifically, the control unit 180 deletes the currently extracted card information, and receives the graphic object corresponding to the new card information through the camera 121 again.

14B, the controller 180 may display a graphic object 1410 indicating that the card information input function is executed in response to the drag input in the second direction being applied. have.

14B, when the card information input function is executed, the control unit 180 inputs an input before executing the card information input function in order to receive new card information from the preview image 300 So that the graphic object corresponding to the payment card disappears. Therefore, the user can input new card information.

In addition, although not shown, the control unit 180 can determine whether or not the card information can be registered in a state in which the card information corresponding to the plurality of payment cards is extracted. In the case where the card information can be registered, it may be that the card information is not pre-registered or is not a counterfeit card. If the card information can not be registered, the card information may be pre-registered or may be a counterfeit card.

In this case, the control unit 180 can visually distinguish between the registerable card and the graphic object corresponding to the unregisterable card. Therefore, the user can intuitively recognize the registerable card.

In the above, a method of simultaneously receiving graphic objects corresponding to a plurality of cards has been described. In this way, the user can input multiple pieces of card information at the same time without separately inputting each piece of card information.

A method of registering a plurality of payment cards sequentially or simultaneously with the card information corresponding to a plurality of payment cards extracted will be described below. 15A, 15B, and 16 are conceptual diagrams showing a method of registering a plurality of payment cards sequentially or simultaneously in a state in which card information corresponding to a plurality of payment cards is extracted.

The control unit 180 may display graphic objects for registration of card information on the area where the graphic objects corresponding to the respective payment cards are displayed in a state in which the card information corresponding to the plurality of payment cards is extracted. For example, as shown in the first and second diagrams in Fig. 15A, in a state in which card information corresponding to a plurality of payment cards is extracted, registration of card information is performed on an area where graphic objects corresponding to the respective payment cards are displayed The graphical object 1500 can be displayed.

In this case, the controller 180 performs a registration process of any one payment card in response to the touch of the graphic object 1500 for registering the payment card displayed on the graphic object of one of the payment cards . For example, as shown in the third diagram of FIG. 15A, the controller 180 may display screen information related to performing a registration process of any one of the payment cards together with the preview image 300.

The registration procedure of any one of the above-mentioned payment cards may be provided with three methods, such as fingerprint authentication, secure number authentication and resident registration authentication.

When performing the registration procedure through the fingerprint authentication, the controller 180 may display the screen information for fingerprint recognition together with the preview image 300, as shown in the fourth diagram of FIG. 15A. Accordingly, the user can directly register a graphic object corresponding to one of the payment cards on the preview image.

As another example, as shown in the first drawing of FIG. 15B, the controller 180 displays screen information 1510 for fingerprint recognition on the area where the graphic object corresponding to each card is displayed together with the preview image 300 Can be superimposed and displayed.

In this case, the user can register the payment means by recognizing the fingerprint on the graphic object corresponding to the card to be registered as the payment means. For example, as shown in the second drawing of FIG. 15B, a user can recognize a fingerprint on a graphic object corresponding to one payment card.

In this case, as shown in the third drawing of Fig. 15B, the control unit 180 can register the payment card based on the fingerprint information and the card information corresponding to the recognized fingerprint.

As another example, as shown in FIG. 15C, the control unit 180 may select a plurality of payment method registration procedures 1520a, 1520b, and 1520c for each graphic object corresponding to each card on the preview image 300 A user interface can be provided. In this way, the user can proceed to register the desired card in a desired manner.

In addition, although not shown, when the registration process of any one of the card information corresponding to the plurality of payment cards is completed, the control unit 180 determines whether the card whose registration procedure is completed and the card whose registration procedure is not completed Can be visually distinguished and displayed. In this way, the user can intuitively distinguish between the registered card and the unregistered card when registering a plurality of cards in the preview image 300. [

On the other hand, the control unit 180 can simultaneously carry out the registration procedure for a plurality of cards in a state in which the card information corresponding to the plurality of payment cards is extracted.

16, when the card information corresponding to a plurality of payment cards is extracted, the control unit 180 determines whether or not the graphics object (s) associated with the function of simultaneously registering on the preview image 300 (1600) can be displayed.

16, in response to the touch of the graphic object 1600 associated with the function of simultaneously performing the registration procedure, the controller 180 displays a graphic for selecting the method of the registration procedure Objects 1610a, 1610b, and 1610c may be displayed on the preview image 300. FIG.

16, icons 1620a and 1620b indicating previously stored identification information are displayed on the preview image 300 when the method of using the stored identification information is selected in the manner of a registration procedure, as shown in the third drawing of FIG. .

In this case, as shown in the fourth diagram of FIG. 16, in response to the drag input being applied to the icon 1620a indicating the previously stored identification information, the control unit 180 displays the card information corresponding to the plurality of payment cards, And the registration of the settlement means can be proceeded using the previously stored identification information. Therefore, the user can register a plurality of payment means through one control command without inconvenience of having to proceed the registration procedure several times.

On the other hand, when the plurality of payment cards are simultaneously authenticated and registered, the authentication of at least one of the plurality of payment cards may fail. In this case, the control unit 180 can visually distinguish between the payment card for which authentication has been successfully performed and the payment card for which authentication has failed in the preview image.

Also, the control unit 180 may provide the user with notification information for re-authentication of the payment card for which authentication has failed. Also, the controller 180 may display the thumbnail image in one area of the preview image 300 in the case of the authentication card. Therefore, the user can recognize the currently registered card information while performing the re-authentication of the payment card in which authentication has failed.

 The present invention can perform authentication of a payment card by simultaneously receiving images of a payment card and an identification card through a camera. Through this, the user can register the payment means in the mobile terminal without going through a complicated procedure.

The present invention can perform authentication of a payment card by simultaneously receiving images of a payment card and an identification card through a camera. Through this, the user can register the payment means in the mobile terminal without going through a complicated procedure.

In addition, the present invention provides a method for easily registering a payment means by a user who is not proficient in operation, by providing various notification information to a user when receiving card information and identification information through a camera.

Further, according to the present invention, by registering a plurality of payment cards at the same time, the payment means can be registered without going through several registration procedures.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (20)

camera;
A display unit configured to display a preview image of an image input from the camera; And
And a control unit displaying a first guide image for guiding the placement position of the payment card and a second guide image for guiding the placement position of the identification card together with the preview image,
The control unit
In response to the graphic object corresponding to the payment card being located at the display position of the first guide image and the graphic object corresponding to the identification card being located at the display position of the second guide image,
The card information of the payment card and the identification information of the identification card are extracted and the registration of the payment card is performed. The method according to claim 1,
The control unit
If the graphic object corresponding to the payment card is not located at the display position of the first guide image or if the graphic object corresponding to the identification card is not located at the display position of the second guide image, And the mobile terminal does not. 3. The method of claim 2,
If the registration of the payment card is not performed, extracts a graphic object corresponding to the payment card and a graphic object corresponding to the identification card from the preview image of the image input from the camera. The method according to claim 1,
The control unit
If a graphic object corresponding to the payment card is located at the display position of the first guide image and a graphic object corresponding to the identification card is not located at the display position of the second guide image, After extracting the payment information,
And displays only the second guide image on the preview image. The method according to claim 1,
Wherein,
Wherein the control unit controls the camera such that a size of a graphic object corresponding to the payment card or a size of a graphic object corresponding to the identification card has a predetermined size in the preview image. 6. The method of claim 5,
Wherein,
Wherein the control unit outputs notification information for controlling the camera on the preview image to control the camera. The method according to claim 1,
Further comprising a position receiver for receiving position information,
Wherein,
And displays only the first guide image guiding the display position of the graphic object corresponding to the payment card on the preview image when the position information received from the position receiving unit corresponds to the predetermined position. 8. The method of claim 7,
The control unit
Extracts card information from an image including a graphic object corresponding to the payment card, and performs registration of a payment card based on the extracted card information and location information. The method according to claim 1,
The control unit
When the extracted card information matches the pre-stored card information, outputs notification information indicating that the card is a pre-registered card. delete delete The method according to claim 1,
Wherein,
Wherein the registration of the additional card is performed in addition to the payment card, based on the extracted card information and the identification information. The method according to claim 1,
The control unit
If a plurality of graphic objects corresponding to a plurality of payment cards are included in the preview image,
And displays a plurality of guide images guiding respective placement positions of the plurality of payment cards. 14. The method of claim 13,
The control unit
Wherein when a plurality of graphic objects corresponding to a plurality of payment cards are located at positions where a plurality of guide images are displayed in the preview image, the card information extracted from at least a part of the payment cards of the plurality of payment cards, And at least a part of the payment card is registered. 14. The method of claim 13,
The control unit
A graphic object corresponding to the registered payment card and a corresponding graphic object corresponding to the non-registered payment card are visually distinguished from the plurality of graphic objects corresponding to the plurality of payment cards, Mobile terminal. The method according to claim 1,
Wherein,
Extracting the preset contact information from the extracted card information when the payment card can not be registered based on the extracted card information and the identification information,
And requests encryption information for registration of a payment card to an external terminal corresponding to the preset contact information. 17. The method of claim 16,
Wherein,
And performs registration of the payment card based on the password information received from the external terminal. Displaying a preview image of an image input from a camera in response to receiving a control command of a user for registering a payment means;
Displaying a first guide image guiding the placement position of the payment card and a second guide image guiding the placement position of the identification card on the display unit together with the preview image;
Determining whether a graphic object corresponding to the payment card and a graphic object corresponding to the identification card are located at the positions of the first guide image and the second guide image in the preview image;
If it is determined that the graphic object corresponding to the payment card is located at the display position of the first guide image and the graphic object corresponding to the identification card is located at the display position of the second guide image, And registering the payment card by extracting identification information of the identification card. 19. The method of claim 18,
In the step of registering the payment card,
If the graphic object corresponding to the payment card is not located at the display position of the first guide image or if the graphic object corresponding to the identification card is not located at the display position of the second guide image, Wherein the mobile terminal is a mobile terminal. 20. The method of claim 19,
In the step of registering the payment card,
Wherein if the registration of the payment card is not performed, the graphic object corresponding to the payment card and the graphic object corresponding to the identification card are again extracted from the preview image of the image input from the camera .

Images