KR101729938B1 - Integrative image searching system and service method of the same - Google Patents

Abstract

The present invention relates to an image retrieval system and method for retrieving using an image of an object, and more particularly, to an image retrieval system and method for retrieving an object such as a barcode, a QR code, a real object including a face or an object through a PC- When an image is input, the inputted image is analyzed through image recognition based on a minutia point to identify the type of the object, and the decoder can be automatically driven according to the type of the object, It is possible to provide a convenient search function.

Description

[0001] INTEGRATIVE IMAGE SEARCHING SYSTEM AND SERVICE METHOD OF THE SAME [0002]

The present invention relates to an integrated image search system and a service method thereof, and more particularly, to an integrated image search system and a service method thereof. More particularly, The integrated image retrieval system and the service method that can recognize all objects regardless of the type of object by reading the object by automatically detecting the type of the object by analyzing with the recognition technology and automatically driving the corresponding decoder according to the object type .

In general, when a user watches a movie or an advertisement program on a television or the like, finds an object (e.g., a person or an object) that he / she likes during shopping, or finds any object that he / In recent years, it is desired to capture and memorize using a camera of a mobile terminal.

However, in the case of the former, it is difficult to manage the memo by habit, always have a memo sheet, and there is a risk of losing a memo note of the detailed information of the commodity.

In the latter case, it is easy to carry and manage the mobile terminal because it uses the mobile terminal always possessed by the user. However, in order to retrieve the desired object through the captured image, there is a disadvantage that the information exposed in the image must be manually input. For example, you must enter the name of the exposed item in the image, product number, shape, color, and so on.

At this time, although the search is clearly made for the information that is clearly exposed such as the name of the product or the product number, there is a difficult problem in the search operation when the feature such as the shape or the image is characteristic or the image is not reported accurately .

Therefore, in recent years, technologies including a decoder (recognition engine) capable of recognizing the object using the image of the object have been applied to the terminal.

That is, a technique is disclosed in which a bar code decoder is mounted on a terminal, a bar code is recognized from a bar code image and then the bar code is recognized or a QR code decoder is mounted on the terminal to recognize the QR code from the image of the QR code.

However, since the decoders for barcode, QR code, face recognition, and image recognition are individually mounted on each terminal, the recognition is limited according to the orientation of the object. In order to recognize the object, There is a disadvantage to perform the request.

SUMMARY OF THE INVENTION Accordingly, the present invention has been made in an effort to solve the above problems, and it is an object of the present invention to provide a method and apparatus for recognizing a type of an object from an image, The object of the present invention is to provide a system and method capable of automatically recognizing all objects regardless of the type of an object by automatic reading by reading the object by automatically calling the decoder.

According to a first aspect of the present invention, there is provided a terminal for integrated image search according to the present invention, which is connected to a server through a communication network, requests a search for a desired object, and receives the search result, An image capturing unit for capturing an object and generating an image of the object; an image recognizing unit for analyzing the image of the object generated through the photographing unit based on image recognition to grasp the type of the object in advance; And an integrated recognition engine for automatically driving a readable decoder according to the type of the identified object to recognize the image of the object.

According to a second aspect of the present invention, there is provided an image search server according to the present invention, which is connected to a client terminal through a communication network and receives a search request for a desired object from the terminal, An interface module for performing communication with the terminal through the communication network; and an image recognition module for analyzing the image of the object based on the image recognition based on the input of the image of the object through the interface module, And an integrated recognition engine for automatically driving a readable decoder according to a type of the object recognized by the image recognition module and recognizing the image of the object.

According to a third aspect of the present invention, there is provided a search service method of a terminal for accessing a server through a communication network, requesting a search for a desired object, and receiving the search result, Analyzing characteristics of an image based on image recognition when a video for the object is input to a terminal, and determining a type of the object; The terminal automatically requests a decoder that can be read according to the type of the object, The terminal recognizing an object by reading an image of the object by a decoder requested to be driven; And the terminal is provided with a search service by transmitting the recognized object to the server.

According to a fourth aspect of the present invention, there is provided a search service method in a server according to the present invention, comprising the steps of connecting to a terminal of a client through a communication network and receiving a search request for a desired object from the terminal, Wherein the server analyzes the characteristics of the image based on image recognition and grasps the type of the object when the image of the object is input from the terminal to the server, The server automatically requesting a decoder capable of reading according to the type of the identified object and requesting the decoder to drive the decoder; The server recognizing an object by reading an image of the object by a decoder requested to be driven; Searching for an object recognized by the server, and transmitting the search result to the terminal.

According to the present invention, even when various types of objects such as a barcode, a face image, a QR code, an NFC tag, and an RFID tag are input, the type is automatically recognized through image recognition of the object, There is an effect that automatic processing can be performed without having to directly select and operate a search method for each type. In addition, since a single terminal or server can recognize a variety of objects, it is possible to provide a convenient search service.

In addition, since a server-based integrated recognition engine can be applied to a device not equipped with an integrated decoder for searching, a search service can be provided regardless of a device. Further, when the type of the object is newly added, the corresponding decoder can be easily expanded, so that the decoder can be applied quickly.

Further, when the present invention is associated with a shopping provision service using an online shopping mall, synergies and new services can be created.

1 is a diagram illustrating a network configuration of an integrated image search system according to an embodiment of the present invention.
2 is a block diagram illustrating a detailed configuration of a terminal according to an embodiment of the present invention;
3 is a block diagram showing the detailed configuration of the integrated recognition engine shown in Fig.
4 is a block diagram illustrating a detailed configuration of an image search server according to an embodiment of the present invention;
5 is a flowchart illustrating a search process of a terminal when the integrated recognition engine according to the embodiment of the present invention is installed in the terminal.
FIG. 6 is a flowchart illustrating a search process of a server and a terminal when the integrated recognition engine is loaded in the server according to the embodiment of the present invention. FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The configuration of the present invention and the operation and effect thereof will be clearly understood through the following detailed description. Before describing the present invention in detail, the same components are denoted by the same reference symbols as possible even if they are displayed on different drawings. In the case where it is judged that the gist of the present invention may be blurred to a known configuration, do.

The objects referred to hereinbelow are objects or objects that are exposed through programs such as goods, water itself, water, or television programs that the user would like to purchase during shopping or normally accidentally found, Site and the like. The identification code may be a product number including a character / number, a bar code, a QR code, an NFC (Near Field Communication) tag, an RFID (Radio Frequency Identification) tag, an OCR (Optical Character Recognition) All objects have characteristic points in terms of character, shape, purpose, function, and two or more characteristic points can coexist. For example, if an identification code is attached to the glasses, the object becomes an eyeglass, and the image of the object includes not only image information about the eyeglasses but also identification code information.

1 is a diagram illustrating a network configuration of an integrated image search system according to an embodiment of the present invention.

The integrated image search system according to an embodiment of the present invention includes a terminal 100 capable of acquiring an image of an object desired to be searched, a recognition unit 120 for recognizing and searching an image of an object received through the communication network 200 from the terminal 100 And may include an image search server 300.

In addition, the image search server 300 may further include an additional information server 400 for providing additional information on each object to the image search server 300. The additional information may include detailed information about the object, shopping purchase information (price information, selling place information, etc.) when the object is an object, and detailed information related to the person (clothes, accessory information, Album information, etc.). In the former case, the terminal 100 can be provided with a shopping service which can directly link to the additional information server 400 through the communication network 200 to purchase a desired commodity.

The terminal 100 according to the embodiment of the present invention can be applied to any type of terminal regardless of the terminal if it is a terminal capable of transmitting and receiving data through the communication network 200 and acquiring an image of the object. For example, a PC, a PDA, a digital camera, a web cam, a mobile terminal, and the like can be applied.

In particular, the terminal 100 according to the embodiment of the present invention creates and stores an image of an object by photographing an object that is found by chance during shopping or usually, and when the user wants to manage detailed information about the object and the object And transmits the image of the object to the image search server 300 through the communication network 200 at the request of the user. To this end, the terminal 100 may include photographing means 120 for photographing an object and generating an image of the object.

In addition, the terminal 100 according to the embodiment of the present invention recognizes the type of the object by recognizing the image of the object acquired from the photographing means 120 through the image recognition basis, and selects and applies a decoder according to the determined type Thereby enabling integrated recognition of various objects. For this, the terminal 100 may include an integrated recognition engine that performs the above functions. The detailed configuration thereof will be described in detail below.

In addition, the terminal 100 according to the embodiment of the present invention may store location information of a location where the object was photographed, time information of the time when the interested goods were photographed, that is, date and time information, And at least one of other information including additional information can be input and included in the image of the object.

In addition, the terminal 100 according to the embodiment of the present invention does not receive location information of an object photographed by a user, and when the object is photographed, the terminal 100 has a global positioning system (GPS) It is possible to grasp the position and add the position information to the image of the object.

The terminal 100 according to the embodiment of the present invention accesses the supplementary information server 400 by using the data communication service or the Internet service provided by the communication network 200, Service can be provided.

The communication network 200 according to the embodiment of the present invention is a network that provides services by communicating with the terminal 100 by wire / wireless. That is, the communication network 200 may be a wired Internet network, and may be a wireless data network (Internet network, IMS, etc.) connected through a mobile communication network (CDMA, W- . Specifically, the CDMA network may be connected to the data network through a PDSN (Packet Data Serving Node), and the W-CDMA network may be connected to the data network through a GGSN (Gateway GPRS Support Node). In addition, in areas such as hot-spot, it can be connected to the Internet network through short-range communication such as Wi-Fi.

The communication network 200 according to an embodiment of the present invention receives a request for transmission of an image of an object from the terminal 100 and receives the image from the terminal 100 and transmits the image to the image search server 300. On the contrary, when the communication network 200 is requested to transmit search result information from the image search server 300, the search result information is received from the image search server 300 and transmitted to the corresponding terminal 100.

The image search server 300 is a server that provides a search function using an image of an object. The image search server 300 receives additional information of each object from the additional information server 400, stores and updates the additional information in the database, The mobile terminal 100 searches for the additional information of the corresponding object and transmits the search result to the terminal 100.

In the case of a system that performs integrated recognition on the basis of a terminal, the image search server 300 searches for additional information of an object recognized by the terminal 100, and transmits the search result to the terminal 100 .

In the case of a system that performs integrated recognition based on a server, the image search server 300 recognizes the image of the object received from the terminal 100 in the image search server 300, and determines the type of the object, The decoder can be applied to analyze the object. Thereafter, the additional information of the object is searched and the search result is transmitted to the terminal 100. The detailed configuration thereof will be described in detail in FIG. 4 below.

The additional information server 400 stores and manages additional information related to various objects and provides supplementary information of the object to the image search server 300 at regular intervals.

In addition, the additional information server 400 according to the embodiment of the present invention can operate an online shopping mall site for selling objects. In this case, the additional information server 400 sells and delivers the purchased product in response to the purchase request of the terminal 100. [

2 is a block diagram illustrating a detailed configuration of a terminal according to an embodiment of the present invention.

The terminal 100 shown in FIG. 2 has a structure in which an integrated recognition engine for automatically recognizing and reading an image of an object is implemented therein to perform terminal-based integrated recognition.

The terminal 100 may include an interface unit 110, a photographing unit 120, a control unit 130, an image recognition unit 140, a memory 150, and an integrated recognition engine 160.

The interface unit 110 connects to the image search server 300 (FIG. 1) or the additional information server (400 in FIG. 1) through a communication network 200 (FIG.

The photographing means 120 photographs an object and generates an image thereof. Specifically, the photographing means 120 may include a camera, a web cam, and the like provided in the terminal 100.

The memory 150 stores an image photographed through the photographing unit 120 and stores the recognized information through the image recognizing unit 140 and the integrated recognition engine 160. [

The image recognition unit 140 analyzes the image of the object generated through the photographing unit 120 using the image recognition method based on the feature point extraction to determine the type of the object. For example, if the object is a bar code, each object has unique feature point information that can identify the type of the bar code. If the object is a QR code, unique feature point information . As described above, when a feature point is extracted from an image of an object through image recognition, it is possible to determine the shape of each object according to the feature point information.

The type identification using the minutia information of the object is possible by utilizing the database implemented in the integrated recognition engine 160.

The integrated recognition engine 160 includes feature point information and a decoder necessary for recognizing the object. The feature point information and the decoder are classified according to the type of the object, the feature point information is provided to the image recognition unit 140 to determine the type of the object, and the decoder is selectively driven according to the type of the object, .

In particular, the integrated recognition engine 160 according to the embodiment of the present invention is characterized in that all the decoders according to the type of each object are constructed, so that any object can be integrated and recognized in one terminal.

In addition, the integrated recognition engine 160 according to the embodiment of the present invention is characterized in that even if two or more pieces of information are contained in one object, i.e., both image information and barcode information are included, integrated recognition can be performed. In this case, the image information and the barcode information can be simultaneously recognized. However, for the reliability of retrieval, the decoder having the highest recognition rate may be called first and sequentially recognized.

FIG. 3 shows a detailed configuration of an integrated recognition engine according to an embodiment of the present invention.

As shown, the integrated recognition engine 160 includes a classification DB (classifier DB) 162 including unique minutia information that can identify a type of each object, a decoder 164 for reading each object by type, and the like .

The classification DB 162 includes a bar code classification DB 1621 including unique minutia information about a bar code, a QR code classification DB 1622 including minutia information of the QR code, a face (eye, nose, mouth, etc.) An NFC classification DB 1624 including minutia information for the NFC tag, an RFID classification DB 1625 including minutia information about the RFID tag, a unique identification code for the OCR code, An OCR classification DB 1626 including minutia information, and other classification DB 1627 including minutia information about other codes. The feature point information unique to the bar code can be a shape composed of a black bar and a white bar of the bar code, and the feature point information of the QR code can use the position identification code located at three corners. In addition, NFC tags, RFID tags, and OCR codes can also be utilized in their own forms.

The decoder 164 corresponds to the configuration of the classification DB 162 and includes a barcode decoder 1641, a QR code decoder 1642, a face recognition decoder 1643, an NFC tag decoder 1644, an RFID tag decoder 1645, An OCR code decoder 1646, a guitar decoder 1647, and the like.

Here, when the type of the object is newly added, the integrated recognition engine 160 constructs the newly added minutia information and the decoder in a scalable manner in the existing configuration.

Referring again to FIG. 2, the controller 130 according to the embodiment of the present invention controls the operation of each unit as a whole, and controls transmission and reception of data through the interface unit 110. Then, control is performed so that the image photographed through the photographing means 120 is stored in the memory 150. In addition, when performing the image recognition through the image recognition unit 140, the classification DB 162 constructed in the integrated recognition engine 160 may be provided to the image recognition unit 140.

Accordingly, the terminal 100 according to the embodiment of the present invention provides a convenient search service using the terminal by automatically recognizing the image of the object according to the type in the device itself.

Here, the terminal 100 according to the embodiment of the present invention preferably generates and uses an image of an object using the photographing means 120. However, the present invention is not limited thereto, and the image of the object may be displayed on a predetermined web page or a separate device Can be obtained.

4 is a block diagram illustrating a detailed configuration of an image search server according to an embodiment of the present invention.

The image search server 300 shown in FIG. 4 is a structure in which the integrated recognition engine 160 (FIG. 2) described in the terminal configuration of FIG. 2 is constructed in a server other than the terminal 100 (FIG. 2). In this case, the image search server 300 can provide the integrated recognition service using the integrated recognition engine 350 to the terminal through the communication network including the WiFi wireless network.

The image search server 300 may include an interface module 310, an image recognition module 320, a control module 330, an additional information management module 340, and an integrated recognition engine 350.

The interface module 310 interfaces communication between the terminal connected through the communication network and the additional information server in the same manner as the interface unit 110 of FIG.

When the image of the object is received from the terminal, the image recognition module 320 recognizes the type of the object by performing the image recognition based on the feature point extraction based on the image of the object from the terminal, as in the image recognition unit 140 of FIG.

The integrated recognition engine 350 includes minutia information and decoders necessary to recognize various objects. The minutiae point information is supplied to the image recognition module 320 to be applied to grasping the type of the object, and the optimal decoder 354 suitable for the object identified through the image recognition module 320 is driven to read the object.

At this time, the image search server 300 arranges the decoders 354 and the classification DBs 352 constructed in the integrated recognition engine 350 in order of highest recognition rate, sorting the search results in the order of arrangement, .

The control module 330 controls these operations, and the additional information management module 340 receives and updates the additional information of each object stored in the additional information server 400 (FIG. 1) at regular intervals.

The configuration and functions not described in detail above are the same as those of the control unit (130 in FIG. 2), the image recognition unit (140 in FIG. 2), the integrated recognition engine ), The duplicated description will be omitted.

Accordingly, as described above, in the embodiment of the present invention, the integrated recognition engine for recognizing the image of the object and recognizing the type of the object and driving the corresponding decoder according to the obtained type, And may be a structure for calling necessary information to the server or may be a structure for loading and analyzing images of an object mounted on the image search server 300 in real time. Regardless of the structure, the search results obtained through the image search can be sequentially arranged by ranking in a form having the highest recognition rate for reliability.

Hereinafter, a process of using the integrated image retrieval system based on the above configuration will be described with reference to FIGS. 5 and 6. FIG.

5 is a flowchart illustrating a search process of a terminal when the integrated recognition engine according to the embodiment of the present invention is installed in the terminal. For reference, the description will be made in connection with the constituent elements of Fig.

The terminal 100 inputs an image of an object photographed through the photographing means 120 or an image of a web page or an object obtained through a separate device (S10).

Then, the terminal 100 analyzes the image of the input object based on the classification DB of the integrated recognition engine 160 (S20).

The analysis method applies feature recognition technology based on feature extraction to extract feature points from images. For example, an image of a barcode can recognize that the object is in the form of a barcode by image recognition based on a feature point.

The terminal 100 classifies the types of objects through the analysis process (S30).

Then, the terminal 100 calls the corresponding decoder to read the classified object and requests its operation (S40). That is, when a barcode is detected through image recognition based on a feature point from an image of an object, a barcode decoder for reading a barcode is called and driven. When a feature point information about a face is detected, a face recognition decoder can do.

Then, the terminal 100 analyzes the image of the object by the decoder requested to be driven and identifies the object (S50).

The terminal 100 transmits the identified object information to the image search server to request the search, and in response to receiving the additional information about the object from the image search server, the terminal 100 displays and displays it (S60).

FIG. 6 is a flowchart illustrating a search procedure of a server and a terminal when the integrated recognition engine according to the embodiment of the present invention is installed in a server. 6 will be described in connection with the components of FIG.

The terminal 100 transmits the image of the object photographed through the photographing means or the image of the object obtained through the web page or the separate device to the image search server 300 (S110 , S120).

The image search server 300 analyzes the image of the object received from the terminal 100 through image recognition based on the feature point (S130). This analysis process can be distinguished by using the classification DB 352 and the image recognition module 320 built in the integrated recognition engine 350.

After the analysis, the image search server 300 classifies the type of the object according to the characteristic, calls the corresponding decoder to read the classified object, and automatically drives it (S140, S150). Then, the image search server 300 analyzes the image of the object by the driven decoder and identifies the object (S160).

In addition, the image search server 300 searches for additional information about the identified object and transmits the search result to the corresponding terminal 100 (S170, S180).

The terminal 100 displays the search result transmitted from the image search server 300, that is, the additional information of the object (S190).

Through this searching process, the present invention can be utilized in a price comparison service in an Internet shopping mall. In this case, a user can use not only a product but also a shopping purchase service through price comparison of goods.

Further, the present invention can be applied to vision and graphics technology related to pattern recognition, network technology, DB construction technology, and the like.

The foregoing description is merely illustrative of the present invention, and various modifications may be made by those skilled in the art without departing from the spirit of the present invention. Therefore, it can be applied to a wide range of technical fields such as pattern recognition related vision, graphic technology, network technology, and DB construction technology. Therefore, the embodiments disclosed in the specification of the present invention do not limit the present invention. The scope of the present invention should be construed according to the following claims, and all the techniques within the scope of equivalents should be construed as being included in the scope of the present invention.

Conventionally, a search service using an image has a disadvantage that a recognition engine for barcode, QR code, face recognition, image recognition, etc. is individually mounted on each terminal, and there is a limitation that the user has to request a request for recognition directly However, according to the present invention, when an image of an object is input, the type of the object is recognized through the image recognition, and a decoder is selectively applied according to the type of the object. Thus, integrated recognition of various objects is possible by reading the object, Thus, there is an effect that the user can automatically recognize and search without having to directly ask for the recognition request. Accordingly, if the technology included in the present invention is linked to a price comparison service and a shopping purchase service in an online shopping mall, the current video search service business can be more activated.

100: terminal 200: communication network
300: image search server 400: additional information server
110: interface unit 120: photographing means
130: control unit 140: image recognition unit
150: memory 160: integrated recognition engine
162: Classification DB 164: Decoder
310: Interface module 320: Image recognition module
330: control module 340: additional information management module
350: Integrated recognition engine

Claims (25)

A terminal connected to a server through a communication network to request a search for a desired object and receive the search result,
A photographing means for photographing the object to generate an image for the object;
An image recognition unit for extracting predefined feature points for each type in relation to the object from the image of the object generated through the imaging unit and recognizing the type of the imaged object based on the extracted feature points;
An integrated recognition engine for recognizing the image of the object by driving a readable decoder according to the type of the object recognized through the image recognition unit;
And a terminal for searching for an integrated image. delete delete The method according to claim 1,
Wherein the integrated recognition engine includes all readable decoders according to the type of the object. Claim 5 has been abandoned due to the setting registration fee. The method according to claim 1 or 4,
Wherein the decoder includes a barcode decoder, a QR code decoder, a Near Field Communication (NFC) decoder, a Radio Frequency Identification (RFID) decoder, an Optical Character Recognition (OCR) decoder, a face recognition decoder, A terminal for image search. The method according to claim 1,
Wherein the type of the object includes at least one of a product number, a barcode, a QR code, an NFC tag, an RFID tag, and an OCR code, including a thing or a person, a specific body part, terminal. A server connected to a client terminal through a communication network and receiving a search request for a desired object from the terminal, the server transmitting the search result to the terminal,
An interface module for performing communication with the terminal through the communication network;
An image recognition module for extracting predefined feature points for each type from the image of the object when the image of the object is input through the interface module and recognizing the type of the object based on the extracted feature points; ,
An integrated recognition engine for recognizing the image of the object by driving a readable decoder according to the type of the object recognized by the image recognition module;
Wherein the image search server comprises: delete delete Claim 10 has been abandoned due to the setting registration fee. 8. The method of claim 7,
Wherein the integrated recognition engine includes all readable decoders according to the type of the object. Claim 11 has been abandoned due to the set registration fee. 11. The method according to claim 7 or 10,
Wherein the decoder includes a barcode decoder, a QR code decoder, a near field communication (NFC) decoder, a radio frequency identification (RFID) decoder, an optical character recognition (OCR) decoder, a face recognition decoder, Search server. Claim 12 is abandoned in setting registration fee. 8. The method of claim 7,
Wherein the type of the object includes at least one of a product number, a barcode, a QR code, an NFC tag, an RFID tag, and an OCR code including a thing or a person, a specific body part, a character / delete delete delete A search service method of a terminal for accessing a server through a communication network to request a search for a desired object and receiving the search result,
The terminal extracting predefined feature points for each type in relation to the object from the image of the object and determining the type of the object based on the extracted feature points;
The terminal calls a decoder that can be read according to the type of the object and requests a drive;
The terminal recognizing an object by reading an image of the object by a decoder requested to be driven;
The terminal transmits the recognized object to the server and receives a search service
Wherein the integrated video search service method comprises: Claim 17 has been abandoned due to the setting registration fee. 17. The method of claim 16,
The image for the object is
Wherein the image is obtained by photographing and creating the object through the photographing unit provided in the terminal, or a web page obtained through a communication network or a separate device. delete Claim 19 is abandoned in setting registration fee. 17. The method of claim 16,
Wherein the plurality of decoders are provided according to the type of the object. Claim 20 has been abandoned due to the setting registration fee. 17. The method of claim 16,
Wherein the decoder includes a barcode decoder, a QR code decoder, a Near Field Communication (NFC) decoder, a Radio Frequency Identification (RFID) decoder, an Optical Character Recognition (OCR) decoder, a face recognition decoder, Search service method. There is provided a search service method of a server for accessing a terminal of a client through a communication network and receiving a search request for a desired object from the terminal,
Wherein the server extracts predefined feature points for each type from the image of the object when the image of the object is input from the terminal and grasps the type of the object based on the extracted feature points;
The server calls a readable decoder according to the type of the identified object and requests a drive;
The server recognizing an object by reading an image of the object by a decoder requested to be driven;
And searching for an object recognized by the server and transmitting the search result to the terminal. Claim 22 is abandoned in setting registration fee. 22. The method of claim 21,
The image for the object is
Wherein the image is obtained by photographing and creating the object through the photographing unit provided in the terminal, or a web page obtained through a communication network or a separate device. delete Claim 24 is abandoned in setting registration fee. 22. The method of claim 21,
Wherein the plurality of decoders are provided according to the type of the object. Claim 25 is abandoned in setting registration fee. 22. The method of claim 21,
Wherein the decoder includes a barcode decoder, a QR code decoder, a Near Field Communication (NFC) decoder, a Radio Frequency Identification (RFID) decoder, an Optical Character Recognition (OCR) decoder, a face recognition decoder, Search service method.

Images