KR101370320B1 - Method for Providing Augmented Reality by User Selection Area, Server And Portable Terminal Therefor - Google Patents

Abstract

One embodiment of the present invention relates to a method for providing augmented reality by a user selected region, a server and a portable terminal therefor.

An embodiment of the present invention provides a server for providing augmented reality (Overlay) of information on the captured image, the server communication unit for interworking with a portable terminal; And receiving selection region information from the portable terminal, comparing the previously stored location-based related information with the received selection region information, and generating first region information data by extracting data matching the received selection region information. And a server controller for transmitting the generated first region information data to the portable terminal, wherein the server controller selects only the selected region information from a plurality of regions included in the location-based related information and includes the selected region information in the selected region. It provides an augmented reality providing server, characterized in that for generating the first area information data including all the plurality of menus.

According to an embodiment of the present invention, there is an effect of providing augmented reality for a region of interest frequently visited by a user by using previously downloaded region information data without delay of information access.

 Optional area, augmented reality, image recognition

Description

Method for Providing Augmented Reality by User Selection Area, Server And Portable Terminal Therefor}

One embodiment of the present invention relates to a method for providing augmented reality by a user selected region, a server and a portable terminal therefor. More specifically, by receiving user-selected area information from the portable terminal and providing local information data corresponding to the region, the terminal receives the data related to the region selected by the user regardless of the user's current location, and then the terminal receives the region information. The present invention relates to a method for providing augmented reality by a user-selected area that can directly provide augmented reality, and a server and a portable terminal therefor.

It is a technology to grasp the approximate position using the location and direction information, to compare the facility information such as the building information of the surrounding area and the real image information inputted according to the movement of the camera, Augmented Reality (AR) technology. More specifically, augmented reality is a field of virtual reality (VR), which is a computer graphics technique for synthesizing virtual objects in a real environment to make them appear as objects existing in the original environment. Unlike existing virtual reality, which is only for objects, it is a technology that can reinforce and provide additional information that is difficult to obtain only in the real world by synthesizing virtual objects on the basis of the real world. Currently augmented reality technology is used in broadcasting, advertising, exhibition, game, theme park, military, education and promotion but it has not spread to public.

Such augmented reality technology is becoming popular in the field of mobile AR technology used in communication terminals. At present, applications of mobile AR technology are appearing little by little, and marker-based mobile AR technology or sensor-based mobile AR technology is emerging as an initial stage technology. The mobile AR technology based on the markers is a technology for recognizing a specific building by capturing a specific symbol corresponding to a specific building together with a specific symbol when a specific building is photographed. The sensor-based mobile AR technology is a technology (Point of Interests) information corresponding to an image in an inferred direction by analogy with the current position and orientation of the terminal using a GPS and an electronic compass. All of these conventional technologies can not provide a technique of accurately recognizing an image input through a terminal, but merely inferring the current position and the direction in which the terminal is looking by using a GPS or an electronic compass provided in the terminal.

In order to solve the above-described problem, an embodiment of the present invention provides a user who can directly provide augmented reality when the terminal enters a corresponding region after receiving data related to a region selected by the user regardless of the current location of the user. The main purpose is to provide a method for providing augmented reality by the selected area, and to provide a server and a portable terminal therefor.

In order to achieve the above object, an embodiment of the present invention, a server for providing augmented reality (Augmented Reality) overlaying the information on the captured image, the server communication unit for interworking with a portable terminal; And receiving selection region information from the portable terminal, comparing the previously stored location-based related information with the received selection region information, and generating first region information data by extracting data matching the received selection region information. And a server controller for transmitting the generated first region information data to the portable terminal, wherein the server controller selects only the selected region information from a plurality of regions included in the location-based related information and includes the selected region information in the selected region. It provides an augmented reality providing server, characterized in that for generating the first area information data including all the plurality of menus.

According to another object of the present invention, there is provided a terminal for downloading augmented reality information in association with an augmented reality providing server, the terminal comprising: a display unit for displaying an execution screen of a running application; A terminal communication unit interlocked with the augmented reality providing server; A camera module for acquiring image information corresponding to a still image or a moving image; A key input unit for receiving a user command; And transmit selection area information by the input user command to the augmented reality providing server, download first area information data corresponding to the selection area information from the augmented reality providing server, and transmit the selected area information to the acquired image information. And a terminal controller for synthesizing the downloaded first region information data and outputting the synthesized first region information data through the display unit.

In addition, according to another object of the present invention, a method for providing augmented reality (Augmented Reality) information to the portable terminal to interwork, comprising the steps of: receiving selection area information from the portable terminal; Generating first region information data by comparing the stored location-based related information with the received selection region information and extracting data matching the received selection region information; Transmitting live image information of a region corresponding to the selected region information among the location-based related information to the portable terminal; And latitude and longitude coordinate value information, point of interest (POI) information, advertisement information, name information, telephone number information, and promotion corresponding to real-time image information of a region corresponding to the selected region information in the first region information data. And including at least one of at least one of information, internet link information, and tagging information, and transmitting the at least one information to the portable terminal.

As described above, according to an embodiment of the present invention, when the terminal enters the corresponding area after receiving data related to the area selected by the user regardless of the current location of the user, the augmented reality may be immediately provided. have. In addition, according to an embodiment of the present invention, it is possible to provide augmented reality for a region of interest frequently visited by a user by using previously downloaded region information data without delay of information access.

Hereinafter, some embodiments of the present invention will be described in detail with reference to exemplary drawings. It should be noted that, in adding reference numerals to the constituent elements of the drawings, the same constituent elements are denoted by the same reference symbols as possible even if they are shown in different drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In describing the components of the present invention, terms such as first, second, A, B, (a), and (b) may be used. These terms are intended to distinguish the constituent elements from other constituent elements, and the terms do not limit the nature, order or order of the constituent elements. When a component is described as being "connected", "coupled", or "connected" to another component, the component may be directly connected to or connected to the other component, It should be understood that an element may be "connected," "coupled," or "connected."

1 is a block diagram schematically illustrating a system for providing augmented reality by a user selection area according to an embodiment of the present invention.

The system for providing augmented reality by a user selection area according to an embodiment of the present invention includes a portable terminal 110, a wired / wireless communication network 120, and an augmented reality providing server 130.

The portable terminal 110 refers to a terminal that performs voice communication and data communication through wireless communication in cooperation with the wired / wireless communication network 120. For example, the portable terminal 110 may be a PDA (Personal Digital Assistant), a cellular phone, a PCS (Personal Communication Service) phone, a hand-held PC, a CDMA-2000 phone, a WCDMA phone, Player), a PlayStation Portable (PSP), and a Mobile Broadband System (MBS) phone.

The portable terminal 110 according to an embodiment of the present invention is a terminal having a camera module 370, and acquires image information corresponding to a still image or a moving image using the provided camera module 370. The portable terminal 110 may include a GPS module 340 and a function of generating location location information based on navigation data included in the radio wave signal using the GPS module 340 . It is not necessary for the portable terminal 110 to have the GPS module 340 in order to implement the present invention. However, if the GPS module 340 is provided, the GPS module 340 may be installed in the portable terminal 110 The current location information can be calculated and the current location information can be used to shorten the AR DB search time in case the augmented reality providing server 130 does not use the location information. In addition, the portable terminal 110 transmits the selected region information by the input user command to the augmented reality providing server 130, and downloads the first region information data corresponding to the selected region information from the augmented reality providing server 130. The first region information data downloaded to the obtained image information is synthesized and output through the display unit 320. In addition, the portable terminal 110 may include latitude and longitude coordinate value information, point of interest (POI) information, advertisement information, and name corresponding to live image information of the region corresponding to the selected region information included in the downloaded second region information data. A function of synthesizing at least one or more of information, phone number information, promotion information, internet link information, and tagging information with the obtained image information.

The portable terminal 110 transmits the location information generated by the augmented reality providing server 130, receives the current location information corresponding to the location information transmitted from the augmented reality providing server 130, and receives the received current location. A function of synthesizing the received second area information data with the image information acquired based on the information. In addition, the portable terminal 110 extracts an image feature point from the acquired image information, compares the extracted image feature point with the downloaded first region information data, and extracts second region information data extracted from data matching the extracted image feature point. And generates and synthesizes the generated second area information data with the acquired image information. In addition, the mobile terminal 110 may be configured according to color information, edge information, outline information, texture information, text information, and a specific angle of a specific object included in the acquired image information. A function of extracting an image feature point based on at least one piece of outline shape information is performed.

The wired / wireless communication network 120 refers to a network capable of transmitting and receiving data using an internet protocol using various wired and wireless communication technologies such as an internet network, an intranet network, a mobile communication network, and a satellite communication network. The wired / wireless communication network 120 may be a closed network such as a LAN (Local Area Network) or a WAN (Wide Area Network) as a network connecting the augmented reality providing server 130 and the portable terminals 110, (Internet). The Internet can be divided into several services, such as HyperText Transfer Protocol (HTTP), Telnet, File Transfer Protocol (FTP), Domain Name System (DNS), Simple Mail Transfer Protocol (SMTP) Simple Network Management Protocol (NFS), Network File Service (NFS), and Network Information Service (NIS). In addition, when the portable terminal 110 is a mobile communication terminal, the wired / wireless communication network 120 may include a mobile communication network. Here, the description of the wired / wireless communication network 120 is already known, and therefore, a detailed description thereof will be omitted.

The augmented reality providing server 130 according to an embodiment of the present invention interworks with the portable terminal 110, receives selection region information from the portable terminal 110, pre-stored location-based related information and received selection region information. Compare the to generate the first area information data extracted from the data matching the received selected area information, and transmits the generated first area information data to the portable terminal (110). Here, the augmented reality providing server 130 selects only the selected region information from the plurality of regions included in the pre-stored location-based related information, and then generates first region information data including a plurality of menus included in the selected region. It performs the function. In addition, the augmented reality providing server 130 performs a function of transmitting the live-action image information of the region corresponding to the selected region information from the location-based related information to the portable terminal 110. In addition, the augmented reality providing server 130 is latitude and longitude coordinate value information, POI (Point Of Interest) information, advertising information, name information, telephone number information, promotion ( The first region information data including at least one of promotion information, internet link information, and tagging information is transmitted to the portable terminal 110. In addition, the augmented reality providing server 130 calculates the current position information of the portable terminal 110 by using the location information received from the portable terminal 110, and transmits the calculated current position information to the portable terminal 110. It performs the function.

2 is a block diagram schematically illustrating an augmented reality providing server according to an embodiment of the present invention.

Augmented reality providing server 130 according to an embodiment of the present invention is configured to include a server communication unit 210, server control unit 220 and server storage unit 230.

In an embodiment of the present invention, the augmented reality providing server 130 is described as including only the server communication unit 210, the server control unit 220 and the server storage unit 230, which is an embodiment of the present invention It is merely an example of a technical idea, and a person of ordinary skill in the art to which an embodiment of the present invention belongs may include the augmented reality providing server 130 without departing from the essential characteristics of the embodiment of the present invention. Various modifications and variations to the components to be applied will be applicable.

The server communication unit 210 is a communication unit that performs a function of interlocking with the portable terminal 110 via the wired / wireless communication network 120, and performs a function of transmitting and receiving various data. Here, although the server communication unit 210 is described as a module included in the augmented reality providing server 130, the present invention is not limited thereto, and may be a separate server of a mobile communication company for communication.

Server control unit 220 according to an embodiment of the present invention as a control means for controlling the overall function of the server, by controlling the server communication unit 210 receives the selected area information from the portable terminal 110, based on the pre-stored location Comparing the related information with the received selection region information, generating first region information data extracted from data matching the received selection region information, and transmitting the generated first region information data to the mobile terminal 110; To perform. Here, the server controller 220 selects only selected region information among the plurality of regions included in the pre-stored location-based related information, and then generates the first region information data including all of a plurality of menus included in the selected region. To perform. In addition, the server controller 220 transmits the live-action image information of the region corresponding to the selected region information among the location-based related information to the portable terminal 110. The server controller 220 may include at least one of latitude and longitude coordinate value information, POI information, advertisement information, name information, phone number information, promotion information, internet link information, and tagging information corresponding to live image information of the region corresponding to the selected region information. The first region information data including one or more pieces of information is transmitted to the portable terminal 110. In addition, the server controller 220 calculates current location information of the mobile terminal 110 by using the location information received from the mobile terminal 110 and transmits the calculated current location information to the mobile terminal 110. Do this. The server control unit 220 includes a memory for storing a program for controlling the components of the augmented reality providing server 130 and a microprocessor for controlling each component of the augmented reality providing server 130 by executing the program As shown in FIG.

The server storage unit 230 is a storage means for storing various data necessary for the operation of the server, at least one of live-action image information, latitude-longitude coordinate value information corresponding to the live-action image information, point of interest (POI) information and advertisement information Store location-based information including the above information.

3 is a block diagram schematically illustrating a portable terminal according to an embodiment of the present invention.

The portable terminal 110 according to an embodiment of the present invention includes a memory unit 310, a display unit 320, a key input unit 320, a GPS module 340, a microphone 350, a speaker 360, 360, a camera module 370, and a terminal control unit 380.

In an embodiment of the present invention, the portable terminal 110 may include a memory unit 310, a display unit 320, a key input unit 320, a GPS module 340, a microphone 350, a speaker 360, and a terminal communication unit 360. ), But includes only the camera module 370 and the terminal control unit 380, which is merely illustrative of the technical idea of one embodiment of the present invention, and the technology to which one embodiment of the present invention belongs. Those skilled in the art will be applicable to various modifications and variations to the components included in the portable terminal 110 without departing from the essential characteristics of one embodiment of the present invention.

The memory unit 310 includes a plurality of software programs for executing various functions such as basic software for operating the portable terminal 110 and performing voice and data communication, a camera function, a protocol for processing a message transmitted and received to perform wireless communication, Software, and the like. The display unit 320 displays an operation state of the portable terminal 110 including a power supply state, a radio wave reception intensity, a date and time, and when the information is transmitted in the form of letters, numbers, and images. It is a screen display means for outputting. The key input unit 320 includes keys for inputting numbers, letters, symbols, and menus, and is a key input unit for inputting a key or command from a user using the portable terminal 110. The GPS module 340 generates a location information based on navigation data included in a radio signal. The microphone 350 is a voice input means for converting the voice input of the mobile communication subscriber into an electric signal for transmission. The speaker 360 is a sound output means for converting the transmitted voice signal into an audible sound and outputting it.

The terminal communication unit 360 encodes or decodes a voice signal, performs an equalizer function to remove multipath noise, and performs a digital signal processing function for performing an acoustic data processing function, and converts a signal to be transmitted and received into a baseband signal. Baseband conversion function that performs digital-to-analog conversion and analog-to-digital conversion processing, receives RF (Radio Frequency) signal, converts into IF (Intermediate Frequency) signal, converts IF signal into RF signal, and converts RF signal A radio communication processing means for performing radio demodulation and amplification, an RF signal processing function, an antenna function for transmitting and receiving a radio signal in the air, and the like to process radio communication. Meanwhile, the terminal communication unit 360 performs a function of interworking with the augmented reality providing server 130. The camera module 370 acquires image information corresponding to a still image or a moving image.

The terminal controller 380 according to an embodiment of the present invention transmits the selection area information by the user command input through the key input unit 330 to the augmented reality providing server, and corresponds to the selection area information from the augmented reality providing server. The first region information data is downloaded, and the first region information data downloaded to the obtained image information is synthesized and output through the display unit 320. In addition, the terminal controller 380 may include latitude and longitude coordinate value information, POI information, advertisement information, name information, and phone number information corresponding to live-action image information of a region corresponding to the selected region information included in the downloaded second region information data. And synthesizing the image information with at least one of the promotion information, the internet link information, and the tagging information. In addition, the terminal controller 380 transmits the location information generated by the augmented reality providing server 130, receives the current location information corresponding to the location information transmitted from the augmented reality providing server 130, A function of synthesizing the received second area information data with the image information obtained based on the current location information. In addition, the terminal controller 380 extracts the image feature point from the acquired image information, compares the extracted image feature point with the downloaded first region information data, and extracts data matching the extracted image feature point. And generate and synthesize the generated second area information data with the obtained image information. In addition, the terminal controller 380 may be configured according to color information, edge information, outline information, texture information, text information, and a specific angle of a specific object included in the acquired image information. A function of extracting an image feature point based on at least one piece of outline shape information is performed.

4 is a flowchart illustrating a method of providing augmented reality by a user selection area according to an embodiment of the present invention.

The portable terminal 110 drives an application for receiving augmented reality (S410), and when a user selects a specific region from the driven application by operating the portable terminal 110, the portable terminal 110 includes a key input unit ( The selected area information is received through the step 330 (S420). The portable terminal 110 transmits the selected region information by the user command to the augmented reality providing server 130 (S430).

The augmented reality providing server 130 receives the selection region information from the portable terminal 110, compares the pre-stored location-based related information and the received selection region information (S440), and the data matching the received selection region information The extracted first region information data is generated (S450), and the generated first region information data is transmitted to the portable terminal 110 (S460). Here, the augmented reality providing server 130 transmits the live image information of the region corresponding to the selected region information among the location-based related information to the portable terminal 110. In addition, the augmented reality providing server 130 is latitude and longitude coordinate value information, POI information, advertising information, name information, phone number information, promotion information, Internet link information and the like corresponding to the live-action image information of the region corresponding to the selected area information and The first area information data including at least one piece of tagging information is transmitted to the portable terminal 110. In addition, the augmented reality providing server 130 calculates the current position information of the portable terminal 110 by using the location information received from the portable terminal 110, and transmits the calculated current position information to the portable terminal 110. do.

The portable terminal 110 downloads the first region information data corresponding to the selected region information from the augmented reality providing server 130, synthesizes the downloaded first region information data to the obtained image information, and then displays it through the display unit 320. Output (S470). In addition, the portable terminal 110 may include latitude and longitude coordinate value information, point of interest (POI) information, advertisement information, and name corresponding to live image information of the region corresponding to the selected region information included in the downloaded second region information data. At least one or more of information, phone number information, promotion information, internet link information, and tagging information are acquired and synthesized with the obtained image information. In addition, the portable terminal 110 transmits the location information generated by the augmented reality providing server 130, receives the current location information corresponding to the location information transmitted from the augmented reality providing server 130, The received second area information data is synthesized with the image information acquired based on the current location information. In addition, the portable terminal 110 extracts an image feature point from the acquired image information, compares the extracted image feature point with the downloaded first region information data, and extracts the second region information data matched with the extracted image feature point. And generate and synthesize the generated second area information data with the obtained image information. In addition, the portable terminal 110 may display an image based on at least one of color information, edge information, outline information, texture information, text information, and outline shape information according to a specific angle included in the acquired image information. Function to extract feature points. In addition, the portable terminal 110 is a terminal having a camera module 370 and a GPS module 340, and acquires image information corresponding to a still image or a moving image using the provided camera module 370, The GPS module 340 generates location information based on the navigation data included in the radio signal.

In FIG. 4, although the portable terminal 110 and the augmented reality providing server 130 execute steps S410 to S470 sequentially, this is merely illustrative of the technical idea of an embodiment of the present invention. Those skilled in the art to which one embodiment of the present invention belongs should not be deviated from the essential characteristics of the embodiment of the portable terminal 110 and the augmented reality providing server 130 in the order described in FIG. Since it may be applied to various modifications and variations by executing in one or more steps of steps S410 to S470 in parallel, Figure 4 is not limited to the time series order.

As described above, the method for providing augmented reality by the user selection area according to the exemplary embodiment of FIG. 4 may be implemented in a software program and recorded in a computer-readable recording medium. A computer-readable recording medium for recording a program for implementing a method for providing augmented reality by a user selected region according to an embodiment of the present invention may be any type of data that can be read by a computer system. It includes a recording device. Examples of such computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and also implemented in the form of a carrier wave (e.g., transmission over the Internet) . The computer readable recording medium may also be distributed over a networked computer system so that computer readable code is stored and executed in a distributed manner. In addition, functional programs, code, and code segments for implementing an embodiment of the present invention may be easily inferred by programmers skilled in the art to which an embodiment of the present invention belongs.

5 is an exemplary diagram illustrating functions of a mobile terminal and an augmented reality providing server according to an embodiment of the present invention.

As illustrated in FIG. 5, a user may selectively receive only a specific area desired by the user by manipulating the portable terminal 110. That is, the user can download a separate application form (VM or separate software) in a state in which a download menu classified by region exists, and then receive augmented reality in real time without any delay in the region.

For example, if the user enters the mobile AR menu by operating the mobile terminal 110, there are regional menus divided into 'Myeongdong', 'Gangnam Station', 'Hongdae' and 'Daehakro', and select 'Myeongdong'. At least one of live image information of the region corresponding to the 'Myeongdong' region, latitude and longitude coordinate value information, POI information, advertisement information, name information, phone number information, promotion information, internet link information and tagging information corresponding to the live image information One or more pieces of information are downloaded to the user's portable terminal 110.

That is, the user may download the local information data for 'Myeong-dong' to the portable terminal 110 regardless of whether or not to enter 'Myeong-dong', and then the portable terminal 110 while the user enters the 'Myeong-dong' region. When driving the augmented reality application of the camera module 370 synthesizes the image information and pre-downloaded area information data is synthesized. Such an augmented reality providing method is a method of providing an augmented reality to a user without delay of information access delay, and the user can download and use only a region of interest that is frequently visited in advance as if the map of each region is downloaded. Could be.

6 is a view illustrating an augmented reality through a portable terminal according to an embodiment of the present invention.

6, it is assumed that the screen of the portable terminal 110 is a real image captured in a part of 'Myeongdong, Seoul' for convenience of explanation, and the local information data synthesized on the real image is stored in the server of the augmented reality providing server 130 It is assumed that the storage unit 230 is received from a pre-established database.

In the digital image processing technology of the mobile terminal 110, the digital image can extract the feature point, which is based on color information, edge information, outline information, texture information, text information, and a specific angle of a specific object included in the digital image. An image feature point may be expressed as a digital data set based on at least one or more pieces of edge shape information. Particularly, the obtained image information is mostly the case of the outdoor street photograph which is considered to have a great demand to apply the embodiment of the present invention. In the case of the outdoor street photograph, since the building including the straight line, the road, the signboard, the logo, the character and the specific pattern are included in many cases, the extraction of the image feature point can be performed more easily than the general non-rigid object.

Assuming that there are many signboards on the streets of 'Myeongdong, Seoul' as shown in FIG. 6, various signboard images such as 'coffee shop signboard', 'plastic surgery signboard', 'karaoke signboard' And the contents of the signboard, including the outline of a building, the outline of a building, and the like. In addition, when the distance of 'Seoul Myeongdong' is photographed at various angles, the size of the signboard can extract character information, etc. as image feature points. According to the extraction algorithm and the information included in the image, the data amount of the data representing the image feature point can be expressed from one tenth to one hundredth of the original image data size. For example, when the original image is 100 Kbytes, extracted minutia data can be represented by 1 to 10 Kbytes or less. At this time, it is possible to create a new DB combining the extracted minutiae and POI information, for example, a telephone number of 'coffee shop', information on promotions currently being promoted, a user's registered period of use, and a specific Internet link. And may be utilized as the server storage unit 230 of the augmented reality providing server 130. That is, when the user photographs the building at the 'Myeongdong crossroad' using the camera module 370 of the portable terminal 110, the portable terminal 110 is linked to the augmented reality providing server 130 of the shop displayed on the outer wall of the building. The name, phone number, promotion information, tourism information, and other tagging information are received and synthesized to the obtained image information as shown in FIG.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. That is, within the scope of the present invention, all of the components may be selectively coupled to one or more of them. In addition, although all of the components may be implemented as one independent hardware, some or all of the components may be selectively combined to perform a part or all of the functions in one or a plurality of hardware. As shown in FIG. The codes and code segments constituting the computer program may be easily deduced by those skilled in the art. Such a computer program can be stored in a computer-readable storage medium, readable and executed by a computer, thereby realizing an embodiment of the present invention. As the storage medium of the computer program, a magnetic recording medium, an optical recording medium, a carrier wave medium, or the like may be included.

It is also to be understood that the terms such as " comprises, "" comprising," or "having ", as used herein, mean that a component can be implanted unless specifically stated to the contrary. But should be construed as including other elements. All terms, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Commonly used terms, such as predefined terms, should be interpreted to be consistent with the contextual meanings of the related art, and are not to be construed as ideal or overly formal, unless expressly defined to the contrary.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

As described above, the present invention is applied to various fields that can directly provide augmented reality when the terminal enters a corresponding region after receiving data related to a region selected by the user regardless of the current location of the user. It is a useful invention that generates an effect of providing augmented reality to a region of interest that a user frequently visits by using pre-downloaded local information data without delay.

1 is a block diagram schematically illustrating a system for providing augmented reality by a user selection area according to an embodiment of the present invention;

2 is a block diagram schematically showing an augmented reality providing server according to an embodiment of the present invention;

3 is a block diagram schematically illustrating a portable terminal according to an embodiment of the present invention;

4 is a flowchart illustrating a method of providing augmented reality by a user selection area according to an embodiment of the present invention;

5 is a diagram illustrating functions of a mobile terminal and an augmented reality providing server according to an embodiment of the present invention.

6 is a view illustrating an augmented reality through a portable terminal according to an embodiment of the present invention.

Description of the Related Art

110: portable terminal 120: wired / wireless communication network

130: Augmented Reality provision server 210:

220: server control unit 230: server storage unit

340: GPS module 360:

370: camera module 380: terminal controller

Claims (10)

In the server for providing the augmented reality (Overlay) information overlaid on the captured image, A server communication unit operatively associated with the portable terminal; And Receiving selection region information from the portable terminal, comparing the stored location-based related information with the received selection region information, generating first region information data extracted from data matching the received selection region information, and And a server controller for transmitting the generated first region information data to the portable terminal, wherein the server controller is included in the selected region after selecting only the selected region information from a plurality of regions included in the location-based related information. The augmented reality providing server, characterized in that for generating the first area information data including all of a plurality of menus. The method of claim 1, The server control unit, Augmented reality providing server, characterized in that for transmitting the live-action image information of the area corresponding to the selected area information of the location-based related information to the portable terminal. The method of claim 2, The server control unit, Latitude and longitude coordinate value information, POI (Point Of Interest) information, advertisement information, name information, telephone number information, promotion information, internet link information and tagging corresponding to the live image information of the region corresponding to the selected region information Augmented reality providing server, characterized in that for transmitting the first area information data including at least one of the (Tagging) information to the portable terminal. The method of claim 1, The server control unit, The augmented reality providing server, characterized in that for calculating the current position information of the portable terminal using the position information received from the portable terminal, and transmits the calculated current position information to the portable terminal. In the terminal to download the augmented reality (Augmented Reality) information in conjunction with the augmented reality providing server, A display unit for displaying an execution screen of a running application; A terminal communication unit interlocked with the augmented reality providing server; A camera module for acquiring image information corresponding to a still image or a moving image; A key input unit for receiving a user command; And Transmits the selection area information by the input user command to the augmented reality providing server, downloads first area information data corresponding to the selection area information from the augmented reality providing server, and downloads the downloaded area information to the acquired image information. A terminal controller for synthesizing the first region information data and outputting the synthesized first region information data through the display unit; Including, The terminal control unit, Latitude and longitude coordinate value information, point of interest (POI) information, advertisement information, name information, telephone number information, corresponding to live-action image information of a region corresponding to the selected region information included in the downloaded second region information data, And at least one of promotion information, internet link information, and tagging information is synthesized with the obtained image information. delete 6. The method of claim 5, Further comprising a GPS module for generating position location information based on the navigation data included in the radio wave signal, The terminal controller transmits the generated location information to the augmented reality providing server, receives current location information corresponding to the transmitted location location information from the augmented reality providing server, and based on the received current location information. And combining the received second area information data with the obtained image information. 6. The method of claim 5, The terminal control unit, Extracting an image feature point from the acquired image information, generating second region information data by comparing the extracted image feature point with the downloaded first region information data, and extracting data matching the extracted image feature point; And synthesizing the generated second area information data with the obtained image information. 9. The method of claim 8, The terminal control unit, At least one or more of color information, edge information, outline information, texture information, text information, and outline shape information according to a specific angle included in the acquired image information And extracting the video feature point based on the information. In the method for providing augmented reality information to the portable terminal to work with, Receiving selection area information from the portable terminal; Generating first region information data by comparing the stored location-based related information with the received selection region information and extracting data matching the received selection region information; Transmitting live image information of a region corresponding to the selected region information among the location-based related information to the portable terminal; And Latitude and longitude coordinate value information, POI (Point Of Interest) information, advertisement information, name information, telephone number information, and promotion corresponding to the live image information of the region corresponding to the selected region information in the first region information data. Including at least one of information, internet link information, and tagging information and transmitting the information to the portable terminal; Method for providing augmented reality by the user selection area comprising a.

Images