KR101557663B1 - Method for Providing Location Based Services by Using Augmented Reality System Server And Portable Terminal Therefor - Google Patents

Abstract

One embodiment of the present invention relates to a location-based service providing method using an augmented reality, and a system, a server, and a portable terminal for the method.

According to an embodiment of the present invention, there is provided a portable terminal including: a server communication unit operable to interoperate with a portable terminal; An area determination unit for determining a size of a map area including a current location of the portable terminal based on the location location information received from the portable terminal; An environment information searching unit for searching for the main surrounding information included in the determined map area size; And a server controller for transmitting, to the portable terminal, location-based information in which some of the searched peripheral environment information is applied to map information corresponding to the determined map area size according to the determined area size. to provide.

According to an embodiment of the present invention, there is an effect that it is easy to grasp the surrounding position through the location-based service synthesized with the real-time image compared with the general map display method for the user.

Augmented reality, location based, portable terminal

Description

TECHNICAL FIELD [0001] The present invention relates to a location-based service providing method using augmented reality, a system, a server and a portable terminal for the same,

One embodiment of the present invention relates to a location-based service providing method using an augmented reality, and a system, a server, and a portable terminal for the method. More particularly, the present invention relates to a method and apparatus for synthesizing and displaying a real-time image acquired through a camera using a portable terminal having a camera and position-based information corresponding to a change in orientation of a real- Based service providing method using an augmented reality, and a system, a server, and a portable terminal for the same.

In general, a location-based service (LBS) measures the position of a corresponding terminal with a mobile phone, a PDA, or a PC, and provides route guidance related to the measured location, POI information, shopping information, Is a service that is provided with the information service of. Various methods using a base station of the communication network, a method using a GPS satellite signal, a wireless LAN, a Bluetooth, a WLAN, a WPAN, or an access point (AP) It is being used.

In the conventional techniques described above, the position of the terminal can be grasped, but when the terminal user is stopped, information on which direction the terminal is facing can not be known. That is, when providing a location-based service using only location information, a peripheral map is displayed on the display device of the terminal, the location of the terminal user is displayed on the map, and the relevant location-based service items are listed. . However, in this case, unless accurate map information such as three-dimensional map information is provided, the user must recognize the surroundings by comparing the actual environment through the eyes with the map through the terminal. In addition, even if the terminal provides three-dimensional map information, since the amount of data is large, it is difficult to store the information in the storage device, and downloading through the wireless communication network is also not easy.

According to an aspect of the present invention, there is provided a mobile terminal including a mobile terminal and a mobile terminal, the mobile terminal including: Based service providing method using augmented reality, and a system, a server, and a portable terminal for the same.

According to an aspect of the present invention, there is provided a portable terminal including: a server communication unit operatively associated with a portable terminal; An area determination unit for determining a size of a map area including a current location of the portable terminal based on the location location information received from the portable terminal; An environment information searching unit for searching for the main surrounding information included in the determined map area size; And a server controller for transmitting, to the portable terminal, location-based information in which some of the searched peripheral environment information is applied to map information corresponding to the determined map area size according to the determined area size. to provide.

According to another aspect of the present invention, there is provided an information processing apparatus including: a display unit displaying an execution screen of an application being driven; A terminal communication unit interlocked with the location based server; A position-based measurement unit for acquiring position-based related information; A location-based input unit for generating location-location information, real-time image information, and direction information using the obtained location-based related information; And receiving the location-based information corresponding to the location-based information from the location-based server, and transmitting the location-based information to the location-based server by combining the real-time image information, the directional information, And a terminal control unit for displaying the terminal through the display unit.

According to another aspect of the present invention, there is provided a method for searching a map, comprising: determining a size of a map area including a current position based on position location information; searching for major surrounding information included in the determined map area size; A location-based server for transmitting location-based information to which some of the searched peripheral environment information is applied; A portable terminal for transmitting the location location information to the location-based server, receiving the location-based information from the location-based server, synthesizing the direction information and the location-based information with the acquired real- And a wired / wireless communication network for relaying data transmitted and received between the portable terminal and the location-based service server.

According to another aspect of the present invention, there is provided a positioning method, comprising: determining a size of a map area including a current location of a terminal based on location location information received from a portable terminal; Searching the main environment information included in the determined map area size by the location-based server; The location-based server transmitting location-based information to the portable terminal, the location-based information including information on some of the searched peripheral environment information according to the determined area size; And receiving the location-based information from the portable terminal and synthesizing and displaying the acquired real-time image information and direction information on the received location-based information. .

As described above, according to the embodiment of the present invention, the location-based information corresponding to the change of the orientation of the real-time image obtained through the camera of the portable terminal is synthesized and displayed, It is effective to continuously receive location-based information.

In addition, according to an embodiment of the present invention, there is an effect that it is easier to grasp the surrounding position through the location-based service synthesized with the real-time image compared with the general map display method from the user's perspective. In addition, according to an embodiment of the present invention, there is an effect that a location-based service using an augmented reality can be provided using a portable terminal possessed by a user, without a separate device using an augmented reality.

Hereinafter, some embodiments of the present invention will be described in detail with reference to exemplary drawings. It should be noted that, in adding reference numerals to the constituent elements of the drawings, the same constituent elements are denoted by the same reference numerals even though they are shown in different drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In describing the components of the present invention, terms such as first, second, A, B, (a), and (b) may be used. These terms are intended to distinguish the constituent elements from other constituent elements, and the terms do not limit the nature, order or order of the constituent elements. When a component is described as being "connected", "coupled", or "connected" to another component, the component may be directly connected or connected to the other component, It should be understood that an element may be "connected," "coupled," or "connected."

1 is a block diagram schematically illustrating a location-based service system using an augmented reality according to an embodiment of the present invention.

It is a technology to grasp the approximate position using the location and direction information, to compare the facility information such as the building information of the surrounding area and the real image information inputted according to the movement of the camera, Augmented Reality (AR) technology. More specifically, augmented reality is a field of virtual reality (VR), which is a computer graphics technique for synthesizing virtual objects in a real environment to make them appear as objects existing in the original environment. Unlike existing virtual reality, which is only for objects, it is a technology that can reinforce and provide additional information that is difficult to obtain only in the real world by synthesizing virtual objects on the basis of the real world.

The location based service system using the augmented reality according to an exemplary embodiment of the present invention includes a portable terminal 110, a wired / wireless communication network 120, a location based server 130, and a DB server 140.

The portable terminal 110 refers to a terminal that performs voice communication and data communication through wireless communication in cooperation with the wired / wireless communication network 120. For example, the portable terminal 110 may be a PDA (Personal Digital Assistant), a cellular phone, a PCS (Personal Communication Service) phone, a hand-held PC, a CDMA-2000 phone, a WCDMA phone, Player), a PlayStation Portable (PSP), and a Mobile Broadband System (MBS) phone.

The portable terminal 110 interlocks with the location-based server 130 and obtains the location location information, the real-time image information, and the direction information through the location-based measurement unit 210, and transmits the obtained location location information to the location- Receives the location-based information corresponding to the location-location information from the location-based server 130, and synthesizes and displays the obtained real-time image information, direction information, and received location-based information. Here, the portable terminal 110 includes a camera module 212 for acquiring real-time image information, a gyro sensor 214 for sensing movement, an acceleration sensor 216 for sensing acceleration, And a GPS module 218 for acquiring data (Navigation Data). The portable terminal 110 includes an image input unit 222 for receiving and transmitting the acquired real time image information, a direction measurement unit 224 for generating direction information based on the detected motion and the detected acceleration, And a position measurement unit 226 for generating positional positional information including the latitude and longitude coordinate values.

The portable terminal 110 processes the received real-time image information and the received location-based information in accordance with the direction information, and transmits the real-time image information received through the pattern matching of the received real- It recognizes the objects of the location based information and extracts and delivers the position values of the objects when synthesizing the location based information to the real time image information. In addition, the portable terminal 110 controls the terminal communication unit 260 to receive the location-based information, and performs a function of controlling only the user's predetermined information among the main circumstance information included in the location-based information . Meanwhile, the portable terminal 110 performs a function of displaying the real-time image and the direction information after synthesizing the real-time image and the direction information according to the position value of the object.

The wired / wireless communication network 120 is a network capable of transmitting and receiving data using an Internet protocol using various wired / wireless communication technologies such as an Internet network, an intranet network, a mobile communication network, and a satellite communication network. The wired / wireless communication network 120 may be a closed network such as a LAN (Local Area Network) or a WAN (Wide Area Network) as a network connecting the location-based server 130 and the portable terminals 110, Internet). The Internet can be divided into several services, such as HyperText Transfer Protocol (HTTP), Telnet, File Transfer Protocol (FTP), Domain Name System (DNS), Simple Mail Transfer Protocol (SMTP) Simple Network Management Protocol (NFS), Network File Service (NFS), and Network Information Service (NIS). In addition, when the portable terminal 110 is a mobile communication terminal, the wired / wireless communication network 120 may include a mobile communication network. Here, the description of the wired / wireless communication network 120 is already known, and therefore, a detailed description thereof will be omitted.

The location-based server 130 is a server for providing location-based services. The location-based server 130 receives location location information from the portable terminal 110, extracts the current location using the location location information, Point Of Interest) information, shopping information, advertisement information, and the like. That is, when the location-based server 130 receives the location-based service request from the portable terminal 110 via the wired / wireless communication network 120, the location-based server 130 receives the location location information from the portable terminal 110, Information about the peripheral position of the portable terminal 110 such as shopping information and advertisement information to the DB server 140 and transmits the information to the portable terminal 110 via the wired / wireless communication network 120 do.

The location-based server 130 interlocks with the portable terminal 110, determines the size of the map area including the current location of the portable terminal 110 based on the location location information received from the portable terminal 110, Searches for the main peripheral information included in the area size, and transmits the location-based information to the portable terminal 110 to which some information of the main peripheral information retrieved according to the determined area size is applied. Here, the location-based server 130 performs a function of applying some of the peripheral environment information to the location-based information based on the importance information according to the detected main environment information. For example, in the case of importance information, importance attached to each surrounding building information included in the searched main surrounding information is given to a high degree of importance such as a public institution, a hospital, a gas station, an intersection name and an entry name , The name of a restaurant, etc., may be given a relatively low importance.

In addition, the location-based server 130 extracts current location information of the portable terminal 110 based on the radar coordinate values included in the location location information, and extracts altitude information of the current location information, And type information, based on at least one piece of information. In addition, the location-based server 130 performs a function of interlocking with the DB server 140 and determining the size of the map area using the map information received from the DB server 140. For example, the location-based server 130 may use the altitude information of the current location information of the portable terminal 110 to vary the size of the area for transmitting information according to the location of the portable terminal 110. That is, when it is determined that the position of the portable terminal 110 is located at a fairly high position using the altitude information of the current position information, the area (or the user) displayed through the camera module 212 of the portable terminal 110 (Or an area located at a long distance), it is determined that the area is a large area where the size of the map area is accumulated, and the location-based information including only a part of the information having a high degree of importance is generated It is. Meanwhile, the location-based server 130 may use the area type information corresponding to the current location information of the portable terminal 110 in order to vary the size of the area for transmitting the information according to the location of the portable terminal 110. [ That is, when the area type information corresponding to the current location information is 'Gangnam area commercial area', it can be assumed that the location of the portable terminal 110 is surrounded by a large building. At this time, (Or an image required by a user) is displayed in a narrow region (or an area limited to a close range). Therefore, the size of the map area is determined to be a narrow area, and a detailed location based Information can be generated.

The location-based server 130 performs a function of searching for the main surrounding information from at least one of the tourist information, the shopping information, the advertisement information, the place name information, and the address information. Meanwhile, the location-based server 130 interlocks with the DB server 140 and performs a function of searching for the main peripheral information based on the data received from the DB server 140.

The DB server 140 is a kind of database for storing information related to a map, and may include a map DB, a name and address DB, a route DB, a tourist information DB, a shopping DB, an advertisement DB, and other DBs. 1, the DB server 140 is shown as a server separately implemented from the location-based server 130, but the present invention is not limited thereto and may be implemented as being included in the location-based server 130 .

2 is a block diagram schematically illustrating a portable terminal according to an embodiment of the present invention.

The portable terminal 110 according to an exemplary embodiment of the present invention includes a location based measurement unit 210, a location based input unit 220, a terminal control unit 230, a display unit 250, and a terminal communication unit 260 .

The portable terminal 110 includes only the location-based measurement unit 210, the location-based input unit 220, the terminal control unit 230, the display unit 250, and the terminal communication unit 260 It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention as defined by the appended claims. A key input unit, a microphone, a speaker, and the like may be added to the components included in the portable terminal 110 within a range of the present invention.

The position-based measurement unit 210 includes a camera module 212 for acquiring real-time image information, a gyro sensor 214 for sensing movement, an acceleration sensor 216 for sensing acceleration, A GPS module 218, and the like. Here, the gyro sensor 214 senses the angular velocity of the terminal movement of the yaw axis and the pitch axis. The gyro sensor 214 may be configured to detect angular velocities of movements of the yaw axis and the pitch axis in order to recognize rotation, inclination, or movement of the terminal in up / down / left / right directions. That is, the direction measuring unit 224 extracts only a desired band by removing a noise component of a high frequency from the motion signal of the terminal captured by the gyro sensor 214, It is possible to recognize rotation, inclination or motion of the robot. Here, the real-time image information, the sensed motion information, the sensed acceleration information, and the navigation data acquired by the position-based measurement unit 210 may be grouped into location-based related information for convenience of explanation.

The location-based input unit 220 receives the location location information, the real-time image information, and the direction information through the location-based measurement unit 210. Meanwhile, the location-based input unit 220 can transmit location location information, real-time image information, and direction information to the terminal control unit 230 using the location-based related information obtained through the location-based measurement unit 210. The position-based input unit 220 includes an image input unit 222 for receiving and transmitting the acquired real-time image information, a direction measurement unit 224 for generating direction information based on the detected motion and the sensed acceleration, And a position measurement unit 226 that generates positional positional information including the latitude and longitude coordinate values based on the data. That is, the image input unit 222 receives image information input in real time through the camera module 212, and transmits the received image information to the image output control unit 232 and the image processing unit 236. The direction measuring unit 224 can calculate direction information using at least one sensor among the gyro sensor 214 and the acceleration sensor 216 as a module for finding direction information that the camera module 212 actually . The position measuring unit 226 is a module for grasping the current position of the portable terminal 110, and can calculate the positional positioning information using the GPS module 218. [ However, since the position measurement unit 226 may not be able to measure the position information when the portable terminal 110 is located in a transliteration area of the GPS such as an indoor (in building) or a tall building, ID) or triangulation of WLAN or WPAN.

The terminal control unit 230 transmits the received location location information to the location-based server 130, receives the location-based information corresponding to the location location information from the location-based server 130, To the image processing unit 236. [0050] The terminal control unit 230 includes a video output control unit 232, a position information control unit 234, and an image processing unit 236.

The image output controller 232 processes the received real-time image information and the received location-based information according to the direction information, and receives the real-time image information on the received real-time image information through pattern matching of the received real- Based information and extracts and transmits the position value of the object when synthesizing the location-based information to the real-time image information. That is, the role of the image output control unit 232 is to direct the real-time image information received through the image input unit 222 and the feature information on the building in the direction of the direction of the portable terminal 110 received through the position information control unit 234 Based on the real-time image information, the location information is compared with the real-time image information by pattern matching of the location-based information. And transmits the value to the image processing unit 236. [

In addition, the location information control unit 234 controls the terminal communication unit 260 to receive the location-based information and to control the user to display only predetermined information of the main environment information included in the location-based information . That is, the location information control unit 234 transfers the location information of the portable terminal 110 received from the location measurement unit 226 to the location-based server 130 through the terminal communication unit 260, Based on the positional information and direction information received from the position measurement unit 226 and the direction measurement unit 224 and the positional information received from the position based server 130, It is possible to extract only the information determined as the information desired by the user from the main peripheral information of the information and transmit the extracted information to the video output controller 232.

The image processing unit 236 synthesizes the received real-time image information, the received direction information, and the received location-based information, and displays the synthesized image on the display unit 250. Also, the image processor 236 synthesizes the real-time image and the direction information according to the position value of the object, and displays the synthesized image. That is, the image processing unit 236 synthesizes the real-time image information received from the image input unit 222 and the additional information received from the image output control unit 232 according to the position value of the object received from the image output control unit 232, (250). ≪ / RTI > 2, the image processing unit 236 is implemented separately from the terminal control unit 230. However, the present invention is not limited thereto, and the image processing unit 236 may be included in the terminal control unit 230 ≪ / RTI >

The display unit 250 displays the terminal operation state including at least one or more information among power state information, radio wave reception intensity information, date information, and time information. When information is transmitted in the form of letters, numbers, images, Screen display means for outputting information. That is, the display unit 250 displays an execution screen of the application being driven.

The terminal communication unit 260 is a wireless communication processing unit that performs voice or data communication through a wired / wireless communication network 120 or an AP (Access Point). The wireless communication processing unit 260 performs coding or decoding of a voice signal and performs an equalizer function for multipath noise cancellation A baseband conversion function for performing digital-to-analog conversion and analog-to-digital conversion processing on a signal to be transmitted and received, and a baseband conversion function for converting an RF (Radio Frequency ) Signal to an IF (intermediate frequency) signal, converts the IF signal to an RF signal, performs an RF signal processing function for demodulating and amplifying the RF signal, and an antenna function for transmitting and receiving a radio signal into the air. The terminal communication unit 260 may be implemented to process data packets using a wireless communication technology such as a LAN, a Wi-Fi, a WiMAX, and a WiBro, But the present invention is not limited thereto. Meanwhile, the terminal communication unit 260 performs a function of interlocking with the location-based server 130.

3 is a block diagram schematically showing a location-based server according to an embodiment of the present invention.

The location-based server 130 according to an exemplary embodiment of the present invention includes a server communication unit 310, an area determination unit 320, a server control unit 330, and an environment information searching unit 340.

The location-based server 130 includes only the server communication unit 310, the area determination unit 320, the server control unit 330, and the environment information searching unit 340. However, It will be appreciated by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention as defined by the appended claims, The server 130 may be modified and modified in various ways.

The server communication unit 310 is a communication unit that performs a function of interlocking with the portable terminal 110 via the wired / wireless communication network 120, and performs a function of transmitting and receiving various data. The server communication unit 310 performs a function of interlocking with the DB server 140. For example, the server communication unit 310 may include a data receiving unit and a data transmitting unit. The data receiving unit receives the location location information of the portable terminal 110 through the wired / wireless communication network 120 and transmits the location information to the area determining unit 320 To-date. The data transmission unit of the server communication unit 310 transmits the information received from the server control unit 330 to the portable terminal 110 via the wired / wireless communication network 120.

The area determining unit 320 determines the size of the map area including the current location of the portable terminal 110 based on the location location information received from the portable terminal 110. The area determination unit 320 extracts the current location information of the portable terminal 110 based on the radar coordinate values included in the location location information, and stores the altitude information of the current location information, the area corresponding to the current location information And the size of the map area based on at least the information of the type information. The area determining unit 320 also determines the size of the map area using the map information received from the DB server 140. For example, the area determining unit 320 determines the size of an area required to provide information by using the map DB information, identifies the shape of the area corresponding to the current position of the portable terminal 110, Lt; / RTI >

Here, the DB server 140 classifies and stores information on a map DB, a place name and address DB, a route search DB, a tourist information DB, a shopping DB, an advertisement DB, and other DBs in a database, Based server 130 may be implemented within or outside the location-based server 130. In an embodiment of the present invention, the DB server 140 is illustrated as being implemented outside the location-based server 130, but the present invention is not limited thereto. In addition, such a database refers to a general data structure implemented in a storage space (hard disk or memory) of a computer system using a database management program (DBMS), and includes a database for searching (extracting), deleting, (RDBMS) such as Oracle, Informix, Sybase, and DB2, as well as Gemston, Orion, An object-oriented database management system (OODBMS) such as Orion, O2 and the like and an XML Native Database such as Excelon, Tamino, Sekaiju and the like, It can be implemented for the purpose and has the appropriate fields or elements to achieve its function. On the other hand, the DB server 140 transmits map information included in the map DB, the name and address DB, the destination DB, the tourist information DB, the shopping DB, the advertisement DB, and other DBs held by the DB server 140 to the area determining unit 320 So that the area determining unit 320 can determine the map area size.

The server control unit 330 is a control means for controlling the overall function of the server. The server control unit 330 is a control means for controlling the overall function of the server, Based information applied to the map information corresponding to the area size and transmits the generated location-based information to the portable terminal 110. The server control unit 330 may include a memory for storing a program for controlling the components of the server, and a microprocessor for controlling the components of the server by executing the program. For example, the server control unit 330 requests the environment information searching unit 340 for the main surrounding information included in the determined size of the map area received from the area determining unit 320, and transmits the request to the environment information searching unit 340 Extracts the received various information and the importance of the information in consideration of the size of the information providing area, and transmits the extracted information to the data transmitting unit of the server communication unit 310.

The environment information searching unit 340 searches for the main surrounding information included in the determined map area size. In addition, the environment information searching unit 340 transmits importance information according to the searched peripheral environment information to the server control unit 330, and causes the server control unit 330 to transmit the location- Apply some of the information.

The environment information searching unit 340 searches for the main peripheral information from at least one of the tourist information, the shopping information, the advertisement information, the place name information, and the address information. In addition, the environment information searching unit 340 performs a function of searching for the main peripheral information based on the data received from the DB server 140. For example, the environment information searching unit 340 searches the DB server 140 for the corresponding information requested by the server control unit 330, and stores the importance of information and information stored in the DB server 140 in the server To the control unit 330. Here, the DB server 140 supplies map information included in the map database, the location name and address DB, the route search DB, the tourist information DB, the shopping DB, the advertisement DB, And the environment information searching unit 340 can search for the main surrounding information included in the determined map area size.

4 is a flowchart for explaining a location-based service method using an augmented reality according to an embodiment of the present invention.

The portable terminal 110 confirms whether there is a request for a location-based service by a user's operation or command (S410). That is, the user may operate a location-based application installed in the portable terminal 110 or select a location-based menu to use the location-based service.

If it is determined in step S410 that there is a request for the location-based service, the portable terminal 110 obtains the navigation data included in the radio wave signal through the GPS module 218 and the position measurement unit 226, Based on the data, a position including the latitude and longitude coordinates is positioned (S421).

The portable terminal 110 transmits location location information to the location-based server 130 via the wired / wireless communication network 120 in order to utilize the location-based service (S422). Upon receiving the location location information from the portable terminal 110, the location-based server 130 transmits a map topographical information request signal to the DB server 140 (S423) and transmits a map topographical information response signal from the DB server 140 (S424).

The location-based server 130 extracts the current location information of the portable terminal 110 based on the radar coordinate values included in the location information, and stores the altitude information of the current location information, the area type information , And the map area size is determined based on at least one of the map topographical information response signals from the DB server 140 (S425).

The location-based server 130 transmits a peripheral environment information request signal for searching for the main environment information included in the determined map area size to the DB server 140 (S426) And receives an information response signal (S427).

Based on the determined area size, the location-based server 130 generates location-based information using some of the detected main peripheral information (S428). At this time, the location-based server 130 may apply some information of the main environment information to the location-based information based on the importance information according to the detected main environment information, Only the set information can be displayed. The location-based server 130 transmits the location-based information to the portable terminal 110 via the wired / wireless communication network 120 (S429).

Based information in step S421 to step S429 is generated and transmitted to the portable terminal 110. The step S421 to step S429 is a step of receiving the location-based information from the portable terminal 110 in step S420 .

The portable terminal 110 receives the location-based information from the location-based server 130 and acquires real-time image information through the camera module 212 and transmits direction information through the gyro sensor 214 and the acceleration sensor 216 (S432).

The portable terminal 110 synthesizes and displays the received location-based information, real-time image information, and direction information (S434). That is, the portable terminal 110 processes the received real-time image information and received location-based information according to the direction information, and outputs the received real-time image information and the received location- Based on the location information, extracts the location value of the object when the location-based information is synthesized with the real-time image information, synthesizes the real-time image and the direction information according to the location value for the object, can do.

Since steps S432 to S434 are a process of synthesizing and displaying the location-based information, direction information, and real-time image information in the portable terminal 110, the step S432 of providing the location-based service on the portable terminal 110 side, Can be seen as.

Based information received from the location-based server 130 on the basis of the result of the check (S440), the portable terminal 110 confirms whether or not the area of the location-based information received from the location- If the area is deviated, S420 is performed (S450). If it is determined in step S440 that the area based on the location-based information received from the location-based server 130 is not deviated, step S430 is performed (step S460).

4, it is described that the location-based server 130 and the portable terminal 110 sequentially execute steps S410 to S460. However, this is merely illustrative of the technical idea of the embodiment of the present invention, It will be understood by those skilled in the art that the location-based server 130 and the portable terminal 110 may change the order described in FIG. 4 without departing from the essential characteristics of an embodiment of the present invention Or steps S410 to S460 may be applied in various modifications and variations as long as they are executed in parallel. Therefore, FIG. 4 is not limited to the time-series order.

As described above, the location based service method using the augmented reality according to an embodiment of the present invention described in Fig. 4 can be implemented by a program and recorded in a computer readable recording medium. A program for implementing a location-based service method using an augmented reality according to an embodiment of the present invention is recorded, and a computer-readable recording medium includes all kinds of recording devices for storing data that can be read by a computer system do.

Examples of such computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and also implemented in the form of a carrier wave (e.g., transmission over the Internet) . The computer readable recording medium may also be distributed over a networked computer system so that computer readable code is stored and executed in a distributed manner. In addition, functional programs, code, and code segments for implementing an embodiment of the present invention may be easily inferred by programmers skilled in the art to which an embodiment of the present invention belongs.

5 is an exemplary diagram illustrating a location-based service using an augmented reality according to an embodiment of the present invention.

5, the portable terminal 110 transmits direction information acquired through the gyro sensor 214 or the acceleration sensor 216 to the real-time image information acquired through the camera module 212, Based on the location-based information received from the mobile terminal 130 and display it on the display unit 250. 5, when it is assumed that the portable terminal 110 is fixed to a vehicle and is provided with a location-based service, a camera module 212 is mounted on the display unit 250 of the portable terminal 110 The real-time image information acquired through the real-time image information is displayed, overlapped with the real-time image information, the speed information of the vehicle is displayed, and the main surrounding building information such as the gas station is overlapped.

That is, the location-based service according to an exemplary embodiment of the present invention not only uses the current location information of the portable terminal 110 but also grasps the current location information using the direction information as well as the direction of the portable terminal 110, The user of the terminal 110 can define the area in a desired direction. That is, the portable terminal 110 can recognize the direction information through the gyro sensor 214 or the acceleration sensor 216 and can display a map of the direction that the portable terminal 110 is aiming at, And the peripheral recognition rate can be increased through comparison with the map. In addition, it is possible to receive a desired service without displaying map information displayed on the display unit 250 of the portable terminal 110. For example, in the case of a route search service, a service can be provided by displaying only a simple icon such as an arrow in a direction in which the user should go.

In addition, since the high-performance central processing unit and the high-resolution camera module 212 are mounted according to the development of the technology of the portable terminal 110 separately from the position information and the orientation information, By combining video information with location and direction information, more accurate and intuitive location based services can be provided. In other words, conventionally, the map information of the surrounding area is displayed using the location and direction information, and the desired service is used. In contrast to this, the approximate position that is determined by using the location and direction information is grasped, The user can grasp the desired service through comparison between the real image information inputted according to the motion of the user and provide related information.

Also, as shown in FIG. 5, the location-based service according to an embodiment of the present invention needs to have a different size of area for transmitting information according to the location of the portable terminal 110. [ If the position of the portable terminal is located at a fairly high position such as a mountain top, a region (or a region desired by the user) displayed through the camera module 212 of the portable terminal 110 is displayed in a wide area ). If the location of the portable terminal 110 is surrounded by a large building, the area (or area required by the user) displayed through the camera module 212 of the portable terminal 110 is displayed in a narrow area Limited area).

Based on the location information received from the portable terminal 110, the location-based server 130 identifies the location environment of the portable terminal 110 from the map DB, determines the size of the map area of the area to be transmitted, From the various DBs, and transmits the information to the portable terminal 110. At this time, since the image input through the camera module 212 is displayed through the portable terminal 110 having a limited size, it can be limited to the amount of information that can be displayed on the real time image. However, considering that the amount of objects that can be accurately grasped through the camera module 212 is limited, the location-based server 130 can directly transmit the information received from the DB server 140 to the portable terminal 110, The information to be transmitted is determined according to the importance of the information. Accordingly, the DB server 140 (or the environment information searching unit 340 of the location-based server 130) must inform the location-based service server of the importance of the information together with the information, unlike the conventional location-based service.

While the present invention has been described in connection with what is presently considered to be the preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. That is, within the scope of the present invention, all of the components may be selectively coupled to one or more of them. In addition, although all of the components may be implemented as one independent hardware, some or all of the components may be selectively combined to perform a part or all of the functions in one or a plurality of hardware. As shown in FIG. The codes and code segments constituting the computer program may be easily deduced by those skilled in the art. Such a computer program can be stored in a computer-readable storage medium, readable and executed by a computer, thereby realizing an embodiment of the present invention. As the storage medium of the computer program, a magnetic recording medium, an optical recording medium, a carrier wave medium, or the like may be included.

It is also to be understood that the terms such as " comprises, "" comprising," or "having ", as used herein, mean that a component can be implanted unless specifically stated to the contrary. But should be construed as including other elements. All terms, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Commonly used terms, such as predefined terms, should be interpreted to be consistent with the contextual meanings of the related art, and are not to be construed as ideal or overly formal, unless expressly defined to the contrary.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

As described above, the present invention provides a method for providing a location-based service using an augmented reality, which can continuously receive location-based information according to a real-time image changed according to movement of a user, and a system, a server, and a portable terminal for the same It is a very useful invention that generates an effect to easily grasp the surrounding location through the location based service synthesized with the real time image compared with the general map display method from the user's viewpoint.

1 is a block diagram schematically showing a location-based service system using an augmented reality according to an embodiment of the present invention;

2 is a block diagram schematically illustrating a portable terminal according to an embodiment of the present invention.

3 is a block diagram schematically illustrating a location-based server according to an embodiment of the present invention.

4 is a flowchart for explaining a location-based service method using an augmented reality according to an embodiment of the present invention;

5 is an exemplary diagram illustrating a location-based service using an augmented reality according to an embodiment of the present invention.

Description of the Related Art

110: portable terminal 120: wired / wireless communication network

130: Location-based server 140: DB server

210: Position-based measurement unit 220: Position-based input unit

230: terminal control unit 250:

260: Terminal communication unit 310: Server communication unit

320: area determination unit 330: server control unit

340: environment information retrieval unit

Claims (12)

A server communication unit operatively associated with the portable terminal; An area determination unit for determining a size of a map area that needs to provide information including a current location of the portable terminal based on the location location information received from the portable terminal; An environment information searching unit for searching for the main surrounding information included in the determined map area size; And Based on the map information, the map information, which is obtained by applying some of the searched peripheral environment information to the map information corresponding to the determined map area size according to the determined area size, Lt; / RTI > The method according to claim 1, The environmental information retrieving unit, Wherein the server control unit transmits importance information according to the searched peripheral environment information to the server control unit, and the server control unit applies some information of the main environment information to the location-based information based on the received importance information. server. The method according to claim 1, Wherein the area determining unit Extracting the current position information of the portable terminal based on the radar coordinate value included in the positional information, and extracting at least one or more of the altitude information of the current position information and the area type information corresponding to the current position information And determines the size of the map area that needs to be provided based on the information. The method according to claim 1, The environmental information retrieving unit, And searches the main peripheral environment information from at least one or more pieces of information including at least one of tourism information, shopping information, advertisement information, place name information, and address information. The method according to claim 1, The server communication unit is interlocked with the DB server, Wherein the area determining unit determines the map area size to provide the information using the map information received from the DB server. The method according to claim 1, The server communication unit is interlocked with the DB server, Wherein the environment information searching unit searches the main peripheral information based on data received from the DB server. A display unit for displaying an execution screen of a running application; A terminal communication unit interlocked with the location based server; A position-based measurement unit for acquiring position-based related information; A location-based input unit for generating location location information, real-time image information, and direction information of the terminal using the obtained location-based related information; And Based server, receiving the location-based information corresponding to the location-location information from the location-based server, transmitting the real-time image information, the direction information of the terminal, and the received location- And a display unit Wherein the portable terminal comprises: 8. The method of claim 7, Wherein the position- A camera module for acquiring the real-time image information; A gyro sensor for sensing movement; An acceleration sensor for detecting an acceleration; And A GPS module for acquiring navigation data included in the radio wave signal The portable terminal comprising: 9. The method of claim 8, The location- An image input unit receiving and transmitting the obtained real time image information; A direction measuring unit for generating direction information of the terminal based on the sensed movement and the sensed acceleration; And And a position measurement unit for generating the positional position information including the latitude and longitude coordinate values based on the obtained navigation data, Wherein the portable terminal comprises: 8. The method of claim 7, The terminal control unit, Based on the real-time image information and the received location-based information, pattern-matching the received real-time image information and the received location-based information with the directional information of the terminal, An image output control unit for recognizing an object and extracting and transmitting a position value of the object when the position based information is synthesized with the real time image information; A location information control unit for controlling the terminal communication unit to receive the location-based information, and to control the user to display only predetermined information of the main environment information included in the location-based information; And Based on the position information of the object, and displays the synthesized image on the display unit, Wherein the portable terminal comprises: Determining a size of a map area that needs to be provided with information that includes a current location based on the location location information, searching for the main surrounding information included in the determined map area size, A location based server for transmitting location based information to which some of the information is applied; A portable terminal for transmitting the location location information to the location-based server, receiving the location-based information from the location-based server, and synthesizing the location information and direction information of the terminal with the acquired real- And Based service server for relaying data transmitted and received between the portable terminal and the location- Based on the location information of the augmented reality. Based on the location information received from the portable terminal, the location-based server determining the size of the map area requiring the information including the current location of the terminal; Searching the main environment information included in the determined map area size by the location-based server; The location-based server transmitting location-based information to the portable terminal, the location-based information including information on some of the searched peripheral environment information according to the determined area size; And Wherein the portable terminal receives the location-based information, synthesizes and displays the obtained real-time image information and direction information of the terminal on the received location-based information And generating a location-based service using the augmented reality.

Images