WO2018112930A1 - Method and device for identifying commodities - Google Patents

Abstract

A method and a device for identifying commodities, which relate to the field of commodity identification technology. The present invention is used for assisting the blind in acquiring commodity information. The method comprises: collecting images of a commodity from at least one viewing angle to acquire image information of the commodity (S11); acquiring, according to the image information of the commodity, text information of the commodity (S12); and converting the text information of the commodity into voice information, and outputting the voice information (S13). The method is used for assisting the blind in identifying commodities.

Description

Product identification method and device Technical field

The present invention relates to the field of commodity identification technology, and in particular, to a commodity identification method and apparatus.

Background technique

Blindness is one of the serious social and public health problems in the world. More than 70% of human information is obtained through vision, and vision problems largely limit access to information for blind people.

Due to vision problems, there are many inconveniences in the lives of blind people. Especially when shopping in shopping malls, in the face of a wide variety of goods in the mall, blind people cannot independently obtain information on the types, models, prices, etc., so for blind people, It is very difficult to select the products that you need from a large space and a large number of products, and complete the shopping independently. In a case, the blind person obtains the product information through the shopping guide when shopping, but this not only brings great inconvenience to the blind shopping, but also greatly increases the workload of the shopping guide, and consumes a lot of manpower and time. cost. Therefore, how to assist blind people to obtain product information is an urgent problem to be solved.

Summary of the invention

Embodiments of the present invention provide a product identification method and apparatus for assisting a blind person to obtain product information.

In order to achieve the above object, embodiments of the present invention adopt the following technical solutions:

In a first aspect, a method for identifying a product for assisting a blind person to obtain product information is provided, the method comprising:

Performing image collection on the commodity from at least one perspective to obtain image information of the commodity;

Obtaining text information of the commodity according to image information of the commodity;

The text information of the commodity is converted into voice information, and the voice information is output.

In a second aspect, a merchandise identification device is provided for assisting a blind person to obtain merchandise information, and the apparatus includes:

An image acquisition module, configured to perform image collection on the commodity from at least one viewing angle, and acquire image information of the commodity;

An image recognition module, configured to acquire text information of the commodity according to image information of the commodity;

a voice output module, configured to convert text information of the commodity into voice information, and output the voice information.

In a third aspect, a merchandise identification apparatus is provided, the apparatus comprising: a processor and a memory, the memory for storing computer execution code, the computer execution code for controlling the processor to perform the first aspect Product identification method.

According to a fourth aspect, there is provided a computer storage medium for storing computer software instructions for use in the article identification device of the third aspect, comprising program code designed to perform the article identification method of the first aspect.

In a fifth aspect, a computer program product is provided that can be directly loaded into an internal memory of a computer and contains software code, and the computer program can be implemented by the computer and can implement the product identification method described in the first aspect.

The product identification method provided by the embodiment of the present invention firstly collects images from at least one perspective, acquires image information of the commodity, and then acquires text information of the commodity according to the image information of the commodity, and finally converts the text information of the commodity into voice information. And outputting the voice information, because the product identification device provided by the embodiment of the present invention can acquire the image information of the product and obtain the text information of the product according to the image information of the product, and finally convert the text information of the product into the voice information output, so In the embodiment of the invention, the blind person can obtain the commodity information by means of voice.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a flow chart of steps of a product identification method according to an embodiment of the present invention;

2 is a second flowchart of steps of a product identification method according to an embodiment of the present invention;

3 is a third flowchart of steps of a product identification method according to an embodiment of the present invention;

4 is a fourth flowchart of steps of a product identification method according to an embodiment of the present invention;

FIG. 5 is a fifth flowchart of steps of a product identification method according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic structural diagram of a product identification device according to an embodiment of the present invention; FIG.

Figure 7 is a second schematic structural diagram of a product identification device according to an embodiment of the present invention;

FIG. 8 is a third schematic structural diagram of a product identification device according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. It should be noted that the following provides Some or all of the technical features of any of the various technical solutions may be combined to form a new technical solution without conflict. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

In the embodiment of the present invention, the term “and/or” is merely an association relationship describing an association object, indicating that there may be three relationships, for example, A and/or B, which may indicate that A exists separately, and A and B, there are three cases of B alone. In addition, the character "/" in this article generally indicates that the contextual object is an "or" relationship. Unless otherwise stated, "multiple" in this document refers to two or more.

In the embodiments of the present invention, the words "exemplary" or "such as" are used to mean an example, illustration, or illustration. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the invention should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of the words "exemplary" or "such as" is intended to present the concepts in a particular manner.

It should be noted that, in the embodiments of the present invention, the meaning of "a plurality" means two or more unless otherwise stated.

It should be noted that, in the embodiment of the present invention, "(English: of)", "corresponding (relevant)" and "corresponding" may sometimes be mixed, and it should be noted that When the difference is not emphasized, the meaning to be expressed is the same.

The basic principle of the technical solution provided by the embodiment of the present invention is: the problem that the blind person cannot obtain the product information due to the vision problem, and the blind person cannot purchase the product independently. The technical solution provided by the embodiment of the present invention obtains the image of the product. The information then obtains the text information of the product according to the image information of the product, and finally converts the text information of the product into the voice information output, thereby enabling the blind person to obtain the information of the product by receiving the voice information, thereby solving the problem that the blind person cannot obtain the product information.

Based on the above content, an embodiment of the present invention provides a product identification method for assisting a blind person to obtain product information.

Exemplarily, the executive body of the product identification method provided by the embodiment of the present invention may A terminal device for identifying a product line by using the product identification method provided by the embodiment of the present invention. The terminal device may be a head-mounted blind guide device, a guide blind glasses, a mobile phone, a portable computer, a pocket computer, a handheld computer, a digital photo frame, a palmtop computer, a navigator, etc., or the terminal device may be installed and implemented by the present invention. The product identification method provided by the example is a software client for identifying a product line or a personal computer for a software system or software application (English name: personal computer, PC for short), a server, etc., and the specific hardware implementation environment may be a general computer form, or The specially designed integrated circuit (English name: Application Specific Integrated Circuit, ASIC for short) can also be (English full name: Field Programmable Gate Array, referred to as: FPGA), or some programmable expansion platform such as embedded ( English name: Tensilica) configurable processor platform, etc.

Referring to FIG. 1 , a product identification method provided by an embodiment of the present invention includes:

S11. Perform image collection on the commodity from at least one perspective to obtain image information of the commodity.

Exemplarily, the image acquisition in the above step S11 can be implemented by one or more of an image sensor such as a monocular camera, a binocular camera, or the like.

Optionally, in the foregoing S11, the image collection of the product from at least one perspective may be an image collection of the product from one perspective, or an image collection of the product from multiple perspectives. Exemplarily, in the embodiment of the present invention, the image collection of the commodity from multiple perspectives can be specifically implemented by the following method:

1. The user places the product within the collection range of the image capture device, and then rotates and/or moves the product, and the image capture device images the product from multiple perspectives during the user's rotation and/or movement of the product. collection.

Second, the image acquisition device includes a plurality of images and is respectively disposed at different positions. When performing image acquisition, a plurality of image collection devices disposed at different positions respectively perform image collection on the products from one perspective, thereby realizing the goods from multiple perspectives. Perform image acquisition.

It should also be noted that when images are collected from multiple perspectives, The image information of the product is obtained by image capturing the product from a plurality of viewing angles, and thus the image information of the product includes an image of a plurality of viewing angle products. By collecting images from a plurality of perspectives, the image information of the products can be more comprehensively obtained, thereby facilitating the subsequent recognition of the image information of the products.

S12. Acquire text information of the product according to image information of the product.

The process of acquiring the text information of the product according to the image information of the commodity in the above embodiment may be completed inside the image recognition device or may be assisted by the remote service device.

When the process of acquiring the text information of the product according to the image information of the product is completed inside the image recognition device, step S12 can be specifically implemented by the following steps: a. Identifying the image information of the product. b. Obtain text information of the product according to the recognition result. Illustratively, the above steps can be performed by an image processing device equipped with image recognition software.

When the process of acquiring the text information of the product according to the image information of the product is completed by the remote service device, step S12 can be specifically implemented by: c. transmitting the product image information to the remote service device, so that the remote service device can be used for the product. The image information is identified, and the text information of the product is obtained according to the recognition result. d. Receive text information of the goods sent by the remote service device. Exemplarily, the remote service device can be a cloud server or the like.

In addition, the image information of the product can be identified, and the image image information can be processed, analyzed, and understood using any image recognition algorithm. In the embodiment of the present invention, the image recognition algorithm used in the process of identifying the image information of the commodity is not limited.

S13. Convert the text information of the commodity into voice information, and output the voice information.

Specifically, the text information of the commodity can be converted into voice information by using a voice synthesis technology, and then the synthesized voice information is output through an audio output device such as a speaker, a power amplifier, a speaker, or a headphone.

It should be noted that the text information of the commodity is converted into the voice information, and the voice information is outputted, which may be: directly converting the text information of the commodity into the voice information output through the voice synthesis technology, or performing the text information of the commodity. Keyword extraction, for example, comparing the text information of the product with the keywords of the product stored in the database, and then outputting the keyword comparison result by voice.

The product identification method provided by the embodiment of the present invention firstly collects images from at least one perspective, acquires image information of the commodity, and then acquires text information of the commodity according to the image information of the commodity, and finally converts the text information of the commodity into voice information. And outputting the voice information, because the product identification device provided by the embodiment of the present invention can acquire the image information of the product and obtain the text information of the product according to the image information of the product, and finally convert the text information of the product into the voice information output, so In the embodiment of the invention, the blind person can obtain the product information by means of voice, thereby enabling the blind person to independently purchase the product.

Further, the embodiment of the present invention provides the following specific implementation manners to implement the product identification method shown in FIG. 1:

One,

Referring to FIG. 2, the above product identification method specifically includes the following steps:

S21: Perform image collection on the commodity from at least one perspective to obtain image information of the commodity.

S22. Perform bar code recognition on the image information of the product, and obtain a barcode of the product.

Specifically, the commodity barcode in the above embodiment may be a one-dimensional barcode and/or a two-dimensional barcode. The one-dimensional barcode of the commodity is composed of a set of regularly arranged bars, spaces and corresponding codes. The two-dimensional bar code of the product is a black and white graphic that is distributed in a two-dimensional direction by a certain geometric pattern. The bar code symbols that form the bar code of the merchandise may include code and bar code identification of the retail merchandise, the storage and packaging package merchandise, the logistics unit, the location of the party, and the like. Usually the bar code of the merchandise is printed on the merchandise package or attached to the merchandise as a bar code label. Therefore, by performing bar code recognition on the image information of the product, the product can be obtained. Bar code.

The identification of the one-dimensional barcode of the commodity may be: firstly performing one-dimensional barcode detection and positioning, determining a region of the one-dimensional barcode in the image, and then performing one-dimensional barcode recognition on the image of the region, and reading one-dimensional The information such as the product number in the barcode is finally obtained by querying the information in the one-dimensional barcode. Similarly, the identification of the two-dimensional barcode of the product may be: first performing two-dimensional barcode detection and positioning, and then performing two-dimensional barcode recognition on the image of the area, and reading the information in the two-dimensional barcode. The difference from the one-dimensional barcode is that the two-dimensional barcode can include more information, so the text information of the commodity can be directly obtained through the content of the two-dimensional barcode or the obtained information can be further processed to obtain the text of the commodity.

S23. Obtain text information of the product according to the barcode of the product.

By querying and processing the bar code of the product, the product information of the product manufacturer, name, price, color, etc. can be immediately recognized, and the product information is displayed in the form of text, so the product can be obtained according to the bar code of the product. Text information.

In addition, the barcode of the product also follows the principle of uniqueness, that is, a commodity item can only have one code, or one code can only identify one commodity item. Barcodes of different products will be used for different specifications, different packaging, different varieties, different prices, and different colors. Therefore, the text information of the commodity obtained by the barcode of the commodity is relatively accurate, and the error of the commodity information provided to the user can be avoided.

S24. Convert the text information of the commodity into voice information, and output the voice information.

two,

Referring to FIG. 3, the above product identification method specifically includes the following steps:

S31. Perform image collection on the commodity from at least one perspective to obtain image information of the commodity.

S32. Perform optical character recognition on image information of the product (English name: Optical Character Recognition, English abbreviation: OCR), obtain the characters in the image information of the product.

Specifically, optical character recognition refers to an optical character recognition device (such as a scanner, a digital camera, a printer, etc.) inspecting paper documents and characters on an image, determining the shape by detecting a dark and bright mode, and then using a character recognition method. The process of translating shapes into computer text.

Optionally, as described above, the image information of the product in the embodiment of the present invention includes at least two images, and each of the images may be optically recognized in the process of performing optical character recognition on the image information of the product. Then, the recognized characters are sorted to obtain the text information of the product, and at least two images included in the image information of the product may be first spliced and fused, and then the optical character recognition is performed to obtain the text information of the product.

S33. Acquire text information of the product according to characters in the product image information.

Usually, the outer packaging of the product is accompanied by a packaging label, and the packaging label will indicate the name and address of the manufacturer or seller of the product, the product name, the trademark, the composition, the quality characteristics, the number of products in the package, and the method of use. The amount, number, storage note, quality inspection number, production date and expiration date, etc., so the text information of the product can be obtained according to the characters in the product image information.

S34. Convert the text information of the commodity into voice information, and output the voice information.

three,

Referring to FIG. 4, the above product identification method specifically includes the following steps:

S41. Perform image collection on the commodity from at least one perspective to obtain image information of the commodity.

S42: Feature extraction of image information of the product, and acquiring features of the product.

Optionally, the feature of the commodity in the above embodiment may be a manually designed image. Features acquired by the feature extractor may also be automatically learned by a machine learning method, such as by deep learning methods.

S43. Sort the products according to the characteristics of the products, and obtain the classification of the products.

Illustratively, classifying the products according to the characteristics of the products and obtaining the classification of the products may be to classify the features of the products into a classifier to obtain the classification of the products. The classifier may be a traditional support vector machine classifier (English name: Support Vector Machine, SVM for short) or a traditional iterative (English name: adaboost) classifier, or a classifier based on a deep learning network.

S44. Obtain text information of the product according to the classification of the product.

After the classification of the merchandise is obtained in the above step S43, the text information of the merchandise of the merchandise can be obtained according to the classification of the merchandise.

S45. Convert the text information of the commodity into voice information, and output the voice information.

four,

Referring to FIG. 5, the above product identification method specifically includes the following steps:

S51. Perform image collection on the commodity from at least two perspectives to obtain image information of the commodity.

S52. Perform barcode identification on image information of the product.

When the barcode identification of the image information of the product is successful in step S52, steps S53 and S57 are performed. When the barcode identification of the image information of the product fails in step S52, step S54 is performed.

S53. Obtain a barcode of the product, and obtain text information of the commodity according to the barcode of the commodity.

S54. Perform optical character recognition on image information of the product.

When the optical character recognition of the image information of the product is successful in step S54, steps S55, S57 are performed, and the optical character of the image information of the product is performed in step S52. When the recognition fails, steps S56 and S57 are performed.

S55. Acquire characters in the image information of the product, and obtain text information of the product according to the characters in the product image information.

S56: Feature extraction of image information of the product, classifying the product according to the characteristics of the product, acquiring the classification of the product, and acquiring the text information of the product according to the classification of the product.

S57. Convert the text information of the commodity into voice information, and output the voice information.

It should be noted that the step of acquiring the text information of the product in the product identification method provided in the above embodiment may also be applied to the remote server, for example, when the remote service device receives the image information of the product, the product may also be The image information is barcoded, the barcode of the commodity is obtained, and the text information of the commodity is obtained according to the barcode of the commodity, and then the text information of the commodity is sent; for example, when the remote service device receives the image information of the commodity, it may also The image information of the product is optically recognized, the characters in the image information of the product are obtained; the text information of the product is obtained according to the characters in the product image information, and then the text information of the product is re-issued; that is, the remote server may also adopt any of the above The text information acquisition method of the commodity in the implementation manner obtains the text information of the commodity.

The device embodiments corresponding to the method embodiments provided above are provided in the following description of the embodiments of the present invention. It should be noted that the explanation of the related content in the following device embodiments can refer to the foregoing method embodiments.

In the case where the respective functional modules are divided by the corresponding functions, FIG. 6 is a schematic diagram showing a possible structure of the product identification device for assisting the blind person to acquire the product information in the above embodiment. The item identification device 600 includes:

The image acquisition module 61 is configured to perform image collection on the commodity from at least one viewing angle to acquire image information of the commodity.

The image recognition module 62 is configured to acquire text information of the product according to the image information of the product.

The voice output module 63 is configured to convert text information of the commodity into voice information, and output the voice information.

The product identification device provided by the embodiment of the present invention includes: an image acquisition module, an image recognition module, and a voice output module, wherein the image acquisition module is configured to perform image collection on the commodity from at least one perspective, and acquire image information of the commodity, and the image recognition module The image information of the product is identified, and the text information of the product is obtained according to the recognition result. The voice output module is configured to convert the text information of the product into voice information, and output the voice information, because the product provided by the embodiment of the present invention The identification device can acquire the image information of the product and obtain the product text information according to the image information of the product, and finally convert the text information of the product into the voice information output. Therefore, the blind person can obtain the product information by means of the voice according to the embodiment of the present invention.

Optionally, referring to FIG. 7, the image recognition module 62 includes: a sending unit 621 and a receiving unit 622;

The sending unit 621 is configured to send the product image information to the remote service device, so that the remote service device identifies the image information of the product, and acquires the text information of the product according to the recognition result;

The receiving unit 622 is configured to receive text information of an item sent by the remote service device.

Optionally, the image recognition module 62 is specifically configured to perform barcode identification on the product image information, obtain a barcode of the commodity, and obtain text information of the commodity according to the barcode of the commodity.

Optionally, the image recognition module 62 is specifically configured to perform optical character recognition on the image information of the product, acquire characters in the image information of the product, and obtain text information of the product according to the characters in the image information of the product.

Optionally, the image recognition module 62 is specifically configured to perform feature extraction on the image information of the product, acquire the feature of the product, classify the product according to the feature of the product, obtain a classification of the product, and obtain text information of the product according to the classification of the product.

That is, the image acquisition module 61 is configured to implement step S11 shown in FIG. 1, step S21 shown in FIG. 2, step S31 shown in FIG. 3, step S41 shown in FIG. Step S51 shown in FIG. 5; image recognition module 62 is used to implement step S12 shown in FIG. 1, steps S22 and S23 shown in FIG. 2, steps S32 and S33 shown in FIG. 3, and step S42 shown in FIG. S43, S44 and steps S52, S53, S54, S55, S56 shown in FIG. 5; the voice output module 63 is used to implement step S13 shown in FIG. 1, step S24 shown in FIG. 2, and step S34 shown in FIG. Step S45 shown in FIG. 4 and step S57 shown in FIG.

It should be noted that all the related content of the steps involved in the foregoing method embodiments may be referred to the functional description of the corresponding functional modules, and details are not described herein again.

In hardware implementation, the image capturing module 61 may be one or more of an image sensor such as a monocular camera or a binocular camera. The image recognition module 62 may be a processor; the voice output module 63 may be an audio output device such as a speaker, a power amplifier, a speaker, a headphone, or the like. The programs corresponding to the operations performed by the product identification device described above may be stored in the memory of the article identification device in software, so that the processor invokes the operations corresponding to the above respective modules.

In the case of employing an integrated unit, FIG. 8 shows a possible structural diagram of the article identification device involved in the above embodiment. The product identification device 800 includes a processor 81, a memory 82, a system bus 83, a communication interface 84, an image acquisition device 85, and a voice output device 86.

The processor 81 may be a processor or a collective name of a plurality of processing elements. For example, the processor 81 can be a central processing unit (CPU). The processor 81 can also be another general purpose processor, a digital signal processing (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or Other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, and the like, can implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the present disclosure. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The processor 81 may also be a dedicated processor, which may include at least one of a baseband processing chip, a radio frequency processing chip, and the like. The processor can also be a combination of computing functions, such as one or more microprocessor combinations, DSP and A combination of microprocessors and so on. Further, the dedicated processor may also include a chip having other specialized processing functions of the device.

The memory 82 is used to store computer execution code, and the processor 81 is connected to the memory 82 through the system bus 83. When the mobile terminal is running, the processor 81 is configured to execute the computer execution code stored in the memory 82 to execute any of the embodiments provided by the embodiments of the present invention. A product identification method, for example, the processor 81 is configured to support the mobile terminal to perform step S12 shown in FIG. 1 , steps S22 and S23 shown in FIG. 2 , steps S32 and S33 shown in FIG. 3 , and FIG. Steps S42, S43, S44 and steps S52, S53, S54, S55, S56 shown in Fig. 5, and/or other processes for the techniques described herein, the specific article identification method can be referred to above and in the drawings The related description is not repeated here.

The system bus 83 can include a data bus, a power bus, a control bus, and a signal status bus. For the sake of clarity in the present embodiment, various buses are illustrated as the system bus 83 in FIG.

Communication interface 84 may specifically be a transceiver on the device. The transceiver can be a wireless transceiver. For example, the wireless transceiver can be an antenna or the like of the device. The processor 81 communicates with other devices via the communication interface 84, for example, if the device is a module or component of the terminal device, the device is for data interaction with other modules in the terminal device.

The steps of the method described in connection with the present disclosure may be implemented in a hardware manner, or may be implemented by a processor executing software instructions. The embodiment of the present invention further provides a storage medium for storing computer software instructions used by the mobile terminal shown in FIG. 8 , which is designed to execute the product identification method shown in FIG. 1 , 2 , 3 , 4 , and 5 . code. The software instructions may be composed of corresponding software modules, and the software modules may be stored in a random access memory (English: random access memory, abbreviation: RAM), flash memory, read only memory (English: read only memory, abbreviation: ROM) , erasable programmable read-only memory (English: erasable programmable ROM, abbreviation: EPROM), electrically erasable programmable read-only memory (English: electrical EPROM, abbreviation: EEPROM), registers, hard disk, mobile hard disk, CD-ROM (CD-ROM) or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor to enable the processor to read information from the storage medium and Write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an ASIC. Additionally, the ASIC can be located in a core network interface device. Of course, the processor and the storage medium may also exist as discrete components in the core network interface device.

The embodiment of the invention further provides a computer program product, which can be directly loaded into the internal memory of the computer and contains software code, and the computer program can be loaded and executed by the computer to implement the figures 1, 2, 3, and 4. The product identification method shown in 5.

Those skilled in the art will appreciate that in one or more examples described above, the functions described herein can be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored in a computer readable medium or transmitted as one or more instructions or code on a computer readable medium. Computer readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one location to another. A storage medium may be any available media that can be accessed by a general purpose or special purpose computer.

The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. All should be covered by the scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims (13)

1. A commodity identification method for assisting a blind person to obtain commodity information, wherein the method comprises:

   Performing image collection on the commodity from at least one perspective to obtain image information of the commodity;

   Obtaining text information of the commodity according to image information of the commodity;

   The text information of the commodity is converted into voice information, and the voice information is output.
2. The method according to claim 1, wherein the obtaining the text information of the product according to the image information of the product comprises:

   Sending image information of the commodity to a remote service device, so that the remote service device acquires text information of the commodity according to image information of the commodity;

   Receiving text information of the commodity sent by the remote service device.
3. The method according to claim 1, wherein the obtaining the text information of the commodity according to the image information of the commodity comprises:

   Performing barcode identification on the image information of the commodity to obtain a barcode of the commodity;

   Obtaining text information of the commodity according to the barcode of the commodity.
4. The method according to claim 1, wherein the obtaining the text information of the commodity according to the image information of the commodity comprises:

   Performing optical character recognition on the image information of the commodity, and acquiring characters in the image information of the commodity;

   The text information of the item is acquired based on the characters in the product image information.
5. The method according to claim 1, wherein the obtaining the text information of the commodity according to the image information of the commodity comprises:

   Feature extraction of image information of the commodity to acquire features of the commodity;

   Sorting the goods according to the characteristics of the goods, and obtaining the classification of the goods;

   The text information of the item is obtained according to the classification of the item.
6. A commodity identification device for assisting a blind person to obtain commodity information, characterized in that the device comprises:

   An image acquisition module, configured to perform image collection on the commodity from at least one viewing angle, and acquire image information of the commodity;

   An image recognition module, configured to acquire text information of the commodity according to image information of the commodity;

   a voice output module, configured to convert text information of the commodity into voice information, and output the voice information.
7. The apparatus according to claim 6, wherein the image recognition module comprises: a transmitting unit and a receiving unit;

   The sending unit is configured to send the commodity image information to a remote service device, so that the remote service device identifies image information of the commodity, and acquires text information of the commodity according to the recognition result;

   The receiving unit is configured to receive text information of an item sent by the remote service device.
8. The device of claim 6 wherein:

   The image recognition module is specifically configured to perform barcode identification on the product image information, acquire a barcode of the commodity, and acquire text information of the commodity according to the barcode of the commodity.
9. The device of claim 6 wherein:

   The image recognition module is specifically configured to perform optical character recognition on the image information of the product, acquire characters in the image information of the product, and according to the image of the product The characters in the message get the text information of the item.
10. The device of claim 6 wherein:

    The image recognition module is specifically configured to perform feature extraction on the image information of the product, acquire characteristics of the product, classify the product according to the feature of the product, obtain a classification of the product, and acquire the classification according to the classification of the product. The textual information of the product.
11. A commodity identification device, comprising: a processor and a memory, the memory for storing computer execution code, the computer execution code for controlling the processor to perform any of claims 1-5 The item identification method described in the item.
12. A computer storage medium for storing the computer software instructions for use in the article identification device according to claim 11, comprising a program designed to execute the article identification method according to any one of claims 1 to 5. Code.
13. A computer program product, which can be directly loaded into an internal memory of a computer and containing software code, which can be loaded and executed by a computer to implement the product of any one of claims 1-5 recognition methods.

Images