KR20130082755A - Service server and method by object recognition - Google Patents

Abstract

PURPOSE: A message service server through object recognition and a method thereof are provided to generate and register a new message based on the data obtained through object recognition and to perform data communication among individuals or groups, thereby exchanging messages about recognized objects among users using data terminals. CONSTITUTION: A service server (120) includes a data input interface, a controller (121), and a processor (122). The data input interface is assigned with an exposure group from a data terminal (110) and receives text data about a target object from an arbitrary terminal. The controller receives an image of the target object from the data terminal and searches in a database for memo data related to the image. The processor processes the image to display the memo data with the image and provides the processed image to a terminal which belongs to the exposure group. [Reference numerals] (110) Data terminal; (111) Camera; (120) Service server; (121) Controller; (122) Processor

Description

SERVICE SERVER AND METHOD BY OBJECT RECOGNITION}

Embodiments of the present invention relate to a service server and a method through object recognition for performing information communication between designated individuals or groups using augmented reality through object recognition.

Augmented Reality is a fusion of physical space and electronic space. It is augmenting the real world by adding virtual information to the perception of the user by mixing virtual images such as computer graphics on real world or real world images. .

A tangible object is a metaphor that means how a user interacts in a virtual environment. The tangible object provides a user with an intuitive interface to control digital information in the virtual environment for easy interaction between the user and the virtual content. to provide.

Augmented Reality is generally a term derived from a virtual environment and a virtual reality, and means a mixture of a real world image and a virtual image by inserting a computer graphic image into the real environment. Real-world information may contain information that the user does not need, and sometimes the user may lack information. However, using computer-generated virtual environments, you can simplify or hide information you don't need. In other words, the augmented reality system combines the real world and the virtual world to allow interaction with the user in real time.

In addition to such an augmented reality system, a service for exchanging information about a target object is needed.

An embodiment of the present invention provides a service server and a method through object recognition for generating and registering a new message based on information obtained through object recognition and performing information communication between designated individuals or groups.

In order to achieve the above-described embodiment, the service server through object recognition includes a data input interface configured to receive an exposure group from an information terminal; A controller for retrieving memo information associated with the image from a database when an image of a target object is received from the information terminal; And a processor for processing the image and providing the memo information to the terminal belonging to the exposure group so that the memo information is displayed together with the image.

In addition, as a technical method for achieving the above embodiment, the service method through the object recognition, comprising: specifying an exposure group from the information terminal; Retrieving memo information associated with the image from a database as an image of a target object is received from the information terminal; And processing the image so that the memo information is displayed together with the image and providing the memo information to a terminal belonging to the exposure group.

According to an embodiment of the present invention, a message is generated and registered based on information obtained through object recognition, and information communication is performed between designated individuals or groups, thereby exchanging a message about a recognized object between users by using an information terminal. can do.

1 is a diagram illustrating a configuration of a service server through object recognition according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of an information generating terminal through object recognition according to an embodiment of the present invention.
3 is a diagram illustrating a configuration of an information inquiry terminal through object recognition according to an embodiment of the present invention.
4 is a flowchart illustrating a method of generating information through object recognition according to an embodiment of the present invention.
5 is a flowchart illustrating an information inquiry method through object recognition according to an embodiment of the present invention.
6 is an exemplary view showing an information inquiry screen through photo recognition according to an embodiment of the present invention.
7 is an exemplary view showing an information inquiry screen through landscape recognition according to an embodiment of the present invention.
8 is an exemplary view showing an information inquiry screen through barcode recognition according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to or limited by the embodiments. Like reference symbols in the drawings denote like elements.

1 is a diagram illustrating a configuration of a service server through object recognition according to an embodiment of the present invention.

Referring to FIG. 1, the service server 120 may include a data input interface (not shown) that receives an exposure group from the information terminal 110; As the image of the object is received from the information terminal 110, the controller 121 for retrieving the memo information associated with the image from the database; And a processor 122 for processing the image so that the memo information is displayed together with the image and providing the memo information to the terminal belonging to the exposure group.

Where to create memo information

The controller 121 may receive the memo information generated through the text input interface based on the recognized screen by recognizing the shape of a photograph or a specific object captured by the camera 111 in the information terminal 110. .

After recognizing address information through a barcode by the scanner of the information terminal 110, the controller 121 may receive memo information generated based on the corresponding barcode from the information terminal 110. The controller 121 may recognize the barcode attached to the product in the information terminal 110 and receive memo information linked to the barcode through the text input interface.

The controller 121 may receive the memo information designated by the address identified by the barcode from the information terminal 110, store the memo information in the database, and then retrieve the memo information identified by the address from the database.

The controller 121 combines location information with recognition of information such as a recognition screen and a bar code, and enables generation of memo information. The controller 121 may receive memo information generated by linking the location information acquired by the GPS system to the image information recognized by the information terminal 110.

Generation of memo information

The controller 121 may receive information, such as a memo, from the information terminal 110 with respect to specific information (a figure of a thing, a barcode, a trademark, a sign, etc.). The controller 121 receives memo information, which is multimedia information generated by linking text information with image information recognized by the camera 111, from the information terminal 110.

The controller 121 receives the text information and the multimedia data about the target object from the information terminal through the data input interface, generates the memo information by attaching the multimedia data to the text information, and displays the image of the target object and the generated memo information. It can be linked and stored in the database.

The controller 121 acquires time information of receiving the image, includes the memo information, stores the memo information, and stores the memo information in the database. You can select and search from.

The processor 122 may limit the exposure condition of the memo information generated by providing the exposure setting interface to the information terminal 110 for the date, time, location, and object in addition to the above information. The processor 122 may register the spatiotemporal and thing information as the exposure condition of the memo information input through the exposure setting interface.

The processor 122 may provide an exposure setting interface to the information terminal 110 to designate a range (distance, etc.) to be exposed based on the location of the memo information. The processor 122 may set the exposure area by designating a distance around a reference position to which the memo information input through the exposure setting interface is exposed.

The processor 122 may limit the information exposure method to be possible only through recognition of the corresponding point through the exposure setting interface provided to the information terminal 110, or may provide the information to be accessed from a distance. The processor 122 may select one of the information access paths, either short or long distance, as a method of exposing the memo information through the exposure setting interface.

The processor 122 may also set whether to reuse, edit, and transmit the original information, whether to generate additional information, and the like. The processor 122 may be designed to select and combine any one or more of using, editing, transferring, and adding memo information which is text information linked to the image information.

Impression target

The processor 122 may set the exposure target based on a specific person or group through the exposure setting interface provided to the information terminal 110. The processor 122 sets an individual or a group to expose the memo information so that only a specific object can access the memo information.

The processor 122 enables authentication processing by interworking information on an individual or a group with a system having memo information dynamically. The processor 122 may perform an authentication procedure in association with a system that stores memo information that links information about an exposure target.

The processor 122 may designate a specific device as an exposure target through the exposure setting interface provided to the information terminal 110. The processor 122 may designate and set a specific device having an operation attribute of an information terminal other than the specific target as the exposure target of the memo information.

Share memo information

When all of the specified exposure conditions are met, the processor 122 may alert the information terminal about the corresponding information to the target user when the target user is within a predetermined range with the generated memo information.

The processor 122 provides an information providing environment so that the information terminal 110 can directly look up the memo information from a long distance according to the set exposure condition, and provides an editing interface for generating additional information in the memo information. You may. In this case, the processor 122 may provide the exposure setting interface and the editing interface to the information terminal so that the original memo information may be directly transmitted to another person or edited according to the setting information.

The processor 122 may need to track the movement of the information terminal 110 directly to the location of the corresponding information according to a setting condition which is an exposure condition. In this case, the processor 122 may provide the information terminal 110 with the location or path of the memo information according to the setting of the information generator. When the information terminal 110 moves to a corresponding position, the processor 122 may provide memo information only when the information terminal 110 recognizes a specific object / object from the information terminal 110 to a device such as a camera according to a setting condition.

The processor 122 does not specify a location, etc., and if a target is designated as a barcode of the product, the memo accompanying the information terminal 110 recognizes only the barcode of the product through the scanner (when conditions such as the target are met). Information may be provided to the information terminal 110.

The processor 122 generates memo information for various exposure groups for the same product, and when the information terminal 110 belongs to several exposure groups together, Depending on the setting, it is possible to search memo information by group or memo information without group.

2 is a diagram illustrating a configuration of an information generating terminal through object recognition according to an embodiment of the present invention.

Referring to FIG. 2, the information generating terminal 210 transmits information recognizing an image of a target object to the service server 220 to receive text information about the target object from the service server 220. The processor 212 generates memo information by attaching the multimedia data to the text information and stores the memo information in the service server 220.

The controller 211 transmits the target object information recognized from the image obtained by photographing the target object using the camera 213 to the service server 220. The service server 220 searches the database 221 to search for text information linked to the target thing and transmits the search result to the controller 211.

The controller 211 displays the text information received from the service server 220 and provides an editing interface to provide an editing environment in which memo information can be generated by attaching multimedia data to the text information. The controller 211 transmits and stores memo information to which the multimedia data is attached to the service server 220.

When the controller 211 receives information about an exposure group of memo information from the service server 220, the processor 212 selects an exposure group according to a user input transmitted through the exposure selection interface, and selects the memo information and the selected exposure. The group is linked and stored in the service server 220.

3 is a diagram illustrating a configuration of an information inquiry terminal through object recognition according to an embodiment of the present invention.

Referring to FIG. 3, the information inquiry terminal 310 transmits the searched location information to the service server 320 to service memo information according to a user input and a controller 311 indicating the presence of memo information corresponding to an exposure group. It includes a processor 312 to download and display from the server (320).

The controller 311 transmits the searched location information to the service server 320 using the GPS system 313. The service server 320 retrieves the exposure group and the memo information linked to the searched location information from the database 321 to detect the presence of the memo information linked to the exposure group to which the information inquiry terminal 310 as a search result belongs. The controller 311 is notified.

The controller 311 notifies the user of the existence of memo information linked to the searched location information, and downloads and displays the selected memo information from the service server 320 according to the user input.

When the controller 311 receives the image captured by the camera 314 to the service server 320 to receive the location information on the captured image from the service server 320, the processor 312 may be configured according to the captured image. The path of the changed location information is tracked to transmit the tracked path to the service server 320, and memo information corresponding to the tracked path is downloaded from the service server 320 and displayed.

The processor 312 requests and receives the editing authority for the memo information from the service server 320 and stores the edited memo information with the editing authority in the service server 320. The processor 312 may download and display the edited memo information corresponding to the searched location and the exposure group from the service server 320.

4 is a flowchart illustrating a method of generating information through object recognition according to an embodiment of the present invention.

The information generating method through object recognition according to an embodiment of the present invention may be implemented by the information generating terminal shown in FIG. 2. In the following description of FIG. 4, the present invention will be described with reference to FIG. 2 as described above.

In step 401, the information generating terminal photographs and recognizes a target object using a camera and transmits the recognized information to the service server (step 402). In step 403, the service server searches for memo information on the recognized object and transmits a search result to the information generating terminal (step 404).

In operation 405, the information generating terminal displays memo information on the target object and executes a memo writing interface. In step 406, the information generating terminal inputs memo information added from the user through the memo writing interface.

In operation 407, the information generating terminal attaches a memo information and attaches a multimedia file including at least one of an image, music, and video to create memo information. In step 408, the information generating terminal lists the exposure group or the user list received from the service server to select the exposure target after completing the creation of the memo information (step 409).

In step 410, the information generating terminal transmits the exposure target information selected from the list to the service server. In operation 411, the service server requests a group information inquiry corresponding to the exposure target information from the community site. In step 412, the community site inquires the group information of the exposure target and transmits a search result to the service server (step 413).

In operation 414, the service server transmits a search result of group information corresponding to the exposure target information to the information generating terminal.

In step 415, the information generating terminal links and stores the exposure group which is a search result in the memo information, and transmits the information to the service server (step 416). In step 417, the service server stores the memo information and the exposure group and transmits the storage result to the information generating terminal (step 418).

5 is a flowchart illustrating an information inquiry method through object recognition according to an embodiment of the present invention.

The information inquiry method through object recognition according to an embodiment of the present invention may be implemented by the information inquiry terminal illustrated in FIG. 3. In the following description of FIG. 5, FIG. 5 will be described with reference to FIG. 3 described above in order to understand the invention.

In step 501, the information inquiry terminal searches for a location using the GPS system and transmits the location search information to the service server (step 502).

In operation 503, the service server searches for exposure information of one or more of a location, a date, a time, and an object by referring to the location search information, and requests the community site to display the exposure information (step 504). In step 505, the community site inquires the exposure information based on the information stored in the database and transmits the inquiry result to the service server.

In step 506, the service server notifies the information inquiry terminal of the presence of the exposure information by referring to the inquiry result of the exposure information. In step 507, the information inquiry terminal informs the user of the presence of the exposure information and displays memo information corresponding to the location search information.

In step 508, the information inquiry terminal requests the service server to search for a location and a route. In step 509, the service server searches for the location information and transmits the location information to the information inquiry terminal (step 510).

In step 511, the information inquiry terminal tracks the location path based on the location information. In step 512, the information inquiry terminal requests an inquiry of exposure information corresponding to a location path from the service server. In operation 513, the service server refers to the information stored in the database, and inquires the exposure information, and transmits the exposure information, which is a result of the inquiry, to the information inquiry terminal (step 514).

In step 515, the information inquiry terminal inquires and displays memo information corresponding to the exposure information. In step 516, the information inquiry terminal displays an editing interface to receive addition or editing of memo information, and requests the service server to add or edit memo information (step 517).

In step 518, the service server adds or edits the memo information according to the editing authority and transmits the edit result to the information inquiry terminal (step 519). The information inquiry terminal may display the edited memo information.

6 is an exemplary view showing an information inquiry screen through photo recognition according to an embodiment of the present invention.

The information terminal recognizes the picture and displays memo information corresponding to the exposure group corresponding thereto. The information terminal displays memo information registered in the corresponding exposure group for the recognized picture.

7 is an exemplary view showing an information inquiry screen through landscape recognition according to an embodiment of the present invention.

The information terminal recognizes the landscape image and displays memo information on the landscape corresponding to the exposure group corresponding thereto. The information terminal associates and displays memo information registered in the corresponding exposure group for the recognized landscape according to the exposure position of the landscape, and enlarges and displays the selected memo information.

8 is an exemplary view showing an information inquiry screen through barcode recognition according to an embodiment of the present invention.

The information terminal recognizes the barcode printed on the object through the scanner and displays memo information on the barcode information corresponding to the exposure group corresponding thereto. The information terminal displays memo information related to product information registered in the corresponding exposure group for the recognized barcode information on the screen.

Further, embodiments of the present invention include a computer readable medium having program instructions for performing various computer implemented operations. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

As described above, the present invention has been described by specific embodiments such as specific components and the like. For those skilled in the art, various modifications and variations are possible from these descriptions. It is therefore to be understood that within the scope of the appended claims, the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. .

110: information terminal
111: camera
120: service server
121: Controller
122: processor

Claims (16)

A data input interface for receiving an exposure group from the information terminal;
A controller for retrieving memo information associated with the image from a database when an image of a target object is received from the information terminal; And
A processor for processing the image and providing the memo information with the image to a terminal belonging to the exposure group
Service server through the object recognition comprising a. The method of claim 1,
The data input interface,
Receiving text information about the target object from any terminal including the information terminal,
The controller,
And attaching the multimedia data input through the data input interface to the text information to generate memo information, and store the memo information in the database in correspondence with the image of the target object. The method of claim 1,
The memo information includes location information,
The controller,
Searching for location information on the information terminal or the target thing, and searching and selecting memo information having the searched location information from the database. The method of claim 1,
The memo information includes time information,
The controller,
Searching for time information at which the image is received, and selecting and searching memo information having the searched time information in the database. The method of claim 1,
The controller,
Searching for location information on the information terminal or the terminal belonging to the exposure group, and determining whether memo information having the searched location information is stored in the database,
The processor comprising:
If it is determined to be stored, the presence of the memo information to the information terminal or the terminal belonging to the exposure group, and provides the corresponding memo information in conjunction with the user input of each terminal, the service server through the object recognition. The method of claim 1,
The controller,
Generating route information about the information terminal tracked by the GPS system, and retrieves memo information corresponding to the generated route information from the database to be provided to the terminal belonging to the exposure group through the processor Service server with awareness. The method of claim 1,
The controller,
Providing the editing authority with respect to the memo information to the information terminal to receive memo information edited with the editing authority from the information terminal through the data input interface. The method of claim 1,
A scanner that scans the barcode to obtain an address when the barcode is received as the image
Further comprising:
The controller,
And recognizing the memo information in a field in the database identified by the address. Receiving an exposure group from an information terminal;
Retrieving memo information associated with the image from a database as an image of a target object is received from the information terminal; And
Processing the image so that the memo information is displayed together with the image and providing the memo information to a terminal belonging to the exposure group
Service method through object recognition comprising a. 10. The method of claim 9,
Receiving text information and multimedia data on the target object from any terminal including the information terminal;
Generating memo information by attaching the multimedia data to the text information; And
Storing the generated memo information in the database in correspondence with the image of the target object;
Further comprising, the service method through the object recognition. 10. The method of claim 9,
The memo information includes location information,
Wherein the searching comprises:
Searching for location information on the information terminal or the target object and selecting and searching memo information having the searched location information in the database;
Including, service method through object recognition. 10. The method of claim 9,
The memo information includes time information,
Wherein the searching comprises:
Searching for time information at which the image is received, and selecting and searching memo information having the searched time information in the database;
Including, service method through object recognition. 10. The method of claim 9,
Searching for location information on the information terminal or the terminal belonging to the exposure group, and determining whether memo information having the searched location information is stored in the database; And
Notifying the existence of the memo information to the information terminal or a terminal belonging to the exposure group if it is determined to be stored.
Further comprising, the service method through the object recognition. 10. The method of claim 9,
Generating route information about the information terminal tracked by the GPS system
Further comprising:
Wherein the searching comprises:
Retrieving memo information corresponding to the generated route information from the database
Including, service method through object recognition. 10. The method of claim 9,
Providing editing rights to the memo information to the information terminal; And
Receiving memo information edited with the corresponding editing authority from the information terminal through a data input interface;
Further comprising, the service method through the object recognition. 10. The method of claim 9,
When the barcode is received as the image, scanning the barcode to obtain an address
Further comprising:
Wherein the searching comprises:
Retrieving the memo information in the field in the database identified by the address
Including, service method through object recognition.

Images