JP7038880B2 - Matching the display of the product provided by the user to the seller of the product - Google Patents

Description

This application is a continuation of US Patent Application No. 14 / 726,929 entitled "Matching User Provided Repressions Of Items With Cells Of Together Items" filed on June 1, 2015, 12/2015. The "Matching User Provided Repressions Of" filed on May 12, 2015, claiming the interests of US Application No. 14 / 964,307, entitled "Item Selling On Multiple Websites" filed on May 9, 2015. It claims the interests of US Provisional Application No. 62 / 160,456 entitled "Items With Cells Of Together Items", which is incorporated herein by reference in its entirety.

People are increasingly interacting with computers and other electronic devices in new and interesting ways. Electronic devices have become widespread and used in many daily activities as processing power, connectivity and location tracking have increased. For example, to find products, watch videos, listen to music, research, buy both digital and physical products (“e-commerce”) and receive news, to name just a few. Often use electronic devices. Other uses include social community, communication with friends and family, photography and much more.

E-commerce market sellers typically build a website that contains product information about the products they sell, and users visit that website to browse various web pages within the website. obtain. A user may typically obtain product details, product reviews posted by other users, and / or purchase a product from the seller of the product. At the time of purchase of the product, the seller packs the product and delivers the product to the delivery destination specified by the user.

A detailed description will be given with reference to the accompanying drawings. In a drawing, the leftmost digit (s) of the reference number identifies the drawing in which the reference number first appears. The use of the same reference number in different drawings indicates similar or same items.

FIG. 3 is a diagram of an exemplary environment including a server system and client devices communicatively connected over a network. It is a block diagram of the implementation example in which the seller's products are posted on a plurality of websites by one implementation. It is a block diagram of the implementation example which matches the seller of the product with the display of the product provided by the user by one implementation. It is a block diagram of the implementation example which matches the seller of the product with the display of the product provided by the user by one implementation. It is a block diagram of the Example which supports the purchase of the display product by a user by one implementation. It is a block diagram of the Example which supports the purchase of the display product by a user by one implementation. It is a block diagram of the purchase process by one implementation. Another block diagram of the purchasing process with one implementation. Display of segmented images by one implementation. One implementation is the display of a segmented image with a purchase control associated with a display product that can be purchased from one or more sellers. Display of goods and product variants available to the seller of goods by one implementation. It is a display of purchase confirmation of the product by one implementation. An example of the process of matching the display of the product provided by the seller with the display of the product provided by the user by one implementation is illustrated. An example of a process in which an image provided by a user is processed by one implementation to match a product displayed in the image with a seller of the product is illustrated. An example of the purchase request process by one implementation is illustrated. An example of the purchase execution process by one implementation is illustrated. FIG. 3 is an exemplary implementation diagram of a server system that can be used in various implementations.

Implementations are described herein by way of example, but one of ordinary skill in the art recognizes that the implementations are not limited to the examples or drawings described. The drawings and their detailed description are not intended to limit implementation to the particular form disclosed, and conversely, all modifications, equivalents and alternatives that fall within the spirit and scope defined in the appended claims. Please understand that there is an intention to include. The headings used herein are used only for the purposes that make up the specification and are not intended to be used to limit the scope of the specification or claims. The word "may" used throughout this application is not an obligatory meaning (ie, meaning "should"), but an acceptable meaning (ie, "may"). Meaning). Similarly, the words "include", "include", and "includes" mean "include", but are not limited in scope.

This disclosure is a system and method that allows a seller to sell merchandise directly and also sell these merchandise as a trader through a management service without having to retain individual inventory and / or purchase processing information in the management service. To explain.

Currently, many e-commerce sellers promote and sell their products through their websites or applications, which are either hosted by the seller or the e-commerce "shopping cart" platform. It can be performed (eg, MAGENTO, SHOPIFY, BIGCOMMERECE). To allow users to purchase goods, the seller owns a shopping cart and a payment processor that actually processes the payment of the goods so that the user sends funds to the seller (eg, AUTOIZE.NET, PAYPAL, STRIPE, BALANCED) works together.

With the rapid growth of e-commerce, sellers often believe that they need to increase awareness from potential customers, for example, participating as a vendor on third-party websites or applications held by management services. , Sell products for sale through management services. Merchants typically need to pay management services the ongoing costs of owning a share or commission for each sale and / or the right to sell the goods for sale through the management service. Similarly, the trader must maintain a trader account for the management service, in which the management service manually updates the inventory of goods, posts goods for sale, adjusts prices, manages delivery, processes orders, and so on. While such an independent vendor account provides an opportunity to learn about management services, it requires more effort for sellers, which, to name a few, causes problems with warehouse management and order processing.

For example, if there are 5 units of product A that the seller wants to sell, the seller allocates a separate inventory quantity to each different sales channel (for example, 3 units are sold directly from the seller himself, and 2 units are a management service. You must either (sell at) or update the quantity in stock each time an item is ordered. For example, if a seller posts 5 units of inventory on his website and 5 units of inventory through a management service, the seller will access the vendor account each time the unit is sold directly through the seller. , Will need to update the quantity of inventory through management services. Similarly, each time a unit is sold through a management service, the seller will have to visit his website and update the inventory quantity.

Similarly, because the management service and seller are independent, the host requires that order processing, payment and order management be done directly in the management service. As a result, the seller may need to cooperate with the first payment authentication entity for the seller and the second payment authentication entity for the vendor account in the management service. These double efforts add additional work to the seller, which can lead to an unpleasant customer experience with no units in the hands of the seller when the user places an order.

As further described below, in the implementation described below, the seller as a vendor through the management service without having to maintain individual inventory, manually update information to the management service and / or manage orders from the management service. You can sell the products for sale directly. Each transaction made in the management service is sent to the seller for processing and completion as if the user were purchasing the goods directly from the seller.

For example, the seller may create a vendor account in the management service so that the exchange of information between the management service and the seller is authenticated. The seller sends a product catalog to a management service, which identifies the products that the seller sells and that the user can purchase from the seller. For each product, the product catalog includes source location identifiers such as uniform resource locators (“URL”) on web pages where products, products can be viewed and / or products can be purchased from sellers, product images, and products. Information, image information, etc. can be specified.

The management service can be a service that allows a user to post an image, view an image, share an image, interact with another user, purchase a product, and the like. The management service may use the information from the product catalog provided by the seller to determine if any of the images accessible by the user of the management service includes a display of the seller's product for sale. For example, in some examples, a user of a management service may post an image taken from another web page, such as a web page of a seller's website, to the management service. In such an example, the posted image may include image information, also known as metadata, which may include the URL from which the image was acquired. If the URL of the user-provided image matches the URL contained in the product catalog, the image provided by the user to the management service includes the display of the product that can be sold by the seller, and the user-provided image is the product and / or the sale of the product. Can be determined to be associated with a person.

In another example, if the user-provided image does not contain a URL, or if the URL contained in the image information does not match the URL from the product catalog, the image is processed using one or more image processing algorithms and the image is imaged. The product displayed in can be detected. The processed image can then be compared with the image and / or image information contained in the product catalog provided by the seller to determine if the seller's product is displayed in the image. If it is determined that the seller's product is displayed in the user-provided image, the user-provided image is associated with the product and / or the seller of the product.

When a user or another user of the management service requests viewing of a user-provided image determined to be included in the seller's display of the product for sale, the user-provided image is presented with a purchase control. Additionally, seller information identifying the seller and / or goods may be presented in the presentation of the user-provided image as well. The user can browse the image and select a purchase control to obtain variant information about the product displayed in the image and / or purchase the product displayed in the image from the seller. The item "variant information", as used herein, is additional information about the goods and / or the sale of the goods. For example, the merchandise variant information may include the quantity of merchandise available for sale by the seller, the price of the merchandise, the size of the merchandise, the color of the merchandise, the shipping charges for delivering the merchandise, the delivery time and / or other information.

When the user requests that the product displayed in the user-provided image be purchased from the seller who is determined to sell the displayed product, the management service assists the purchase between the user and the seller. do. For example, a management service may send a merchandise reservation request to a seller to reserve one or more units of merchandise for purchase by a user browsing the merchandise. If the user chooses to purchase the item, the management service provides the seller with the purchase information without requiring the vendor to hold the payment verification service in the vendor account. In some implementations, encrypted credit card information may be sent to the seller as part of the product information. In other implementations, the credit card associated with the user may appear as a unique token managed by the storage service. The storage service is credit card information in a secure form. The storage provider replaces the token with a credit card and provides the seller with purchase information for authentication. When the seller authenticates the purchase, the authentication confirmation is sent to the management service, and the management service notifies the user that the purchase of the product from the seller is completed.

By providing purchase information to the seller and allowing the seller to work with its payment processor for purchase authentication, the seller only needs to maintain a single relationship with the payment processor. You can manage all your inventory in one place and you don't have to renew different vendor accounts separately.

In another example, depending on the purchase request, the management service may provide a product identifier, product information (eg, selected variant), user identifier, and the like. In some implementations, management services may likewise assist users in paying for goods, for example through a third-party payment processor. Alternatively, payment information may be provided to the seller for payment processing of the goods. Finally, the purchase of the goods is completed and the seller can deliver the goods to the user.

A "goods" can be anything that can be displayed and sold. For example, goods can be physical goods (clothes, hardware, paintings, etc.), digital goods (eg, audio, video, images), services (eg, landscaping, banking, home painting).

FIG. 1 shows users 101 such as users 101 (1), 101 (2) to 101 (N), and one or more server computers 100 (1), 100 (2), which are communicably connected via a network 108. ) To 100 (N), one or more client devices 104 such as client devices 104 (1), 104 (2), 104 (3) to 104 (N), seller A106 (1), FIG. 3 is an exemplary environment diagram comprising one or more sellers 106, such as seller B106 (2) to seller C106 (N). As will be appreciated, any number and / or type of server system 100, client device 104 and / or seller 106 may be included in the environment, and the illustration in FIG. 1 is merely exemplary. Similarly, any number of users 101 may be included in the environment. For the purposes of discussion, the term "user" interacts with Management Service 110 (discussed below) to post or otherwise provide images, view images, share images, and others. As used herein, it refers to an individual who interacts with a user, purchases a product displayed in a browsed image, and the like.

The network 108 may include a local area network, a wide area network such as a public exchange telephone network (PSTN), a cable television network, a satellite network, a collection of networks, a public internet protocol network, a private internet protocol network, or a combination thereof. Further, the network 108 can be wired, wireless or a combination thereof. The server system 100 may further include a mapping data store 111, an image data store 113, a product catalog data store 115 and / or a user profile data store 117. Further described below, the data store may include lists, arrays, databases and other data structures used for storing and retrieving data. Similarly, the present disclosure describes multiple data stores, but in some implementations the data stores may be configured as a single data store or multiple data stores.

The mapping data store 111, the image data store 113, the product catalog data store 115 and the user profile data store 117 may be integrated into the server system 100 or otherwise communicably linked to the server system 100. For example, one or more of the mapping data store 111, the image data store 113, the product catalog data store 115, and / or the user profile data store 117 is located in a remote computing resource (not shown) and can communicate with the server system 100. Can be linked to. In some implementations, the mapping data store 111, image data store 113, product catalog data store 115 and / or user profile data store 117 may be one or more CD-RW / DVD-RW drives, hard disk drives, tape drives or It may include digital content and other storage devices used to store information. The server system 100, individually or together with the mapping data store 111, the image data store 113, the product catalog data store 115 and / or the user profile data store 117, allows the user 101 to post images, view images, share images, and so on. It is possible to provide a management service 110 that supports communication with other users, viewing of product variant information of products displayed in images, and the like. Similarly, the management service 110 may assist the user in purchasing the goods displayed in the image from the seller of the determined goods.

The server system 100 may be further configured to exchange information with one or more sellers 106. Seller 106 may include any kind of entity and / or individual (s) that sell the entity for sale. For example, the seller 106 may include an e-commerce website that sells and delivers goods, the provision of services, traditional retail stores or wholesale stores, and the like.

In some implementations, seller 106 may interact with management service 110 to provide and / or update a product catalog listing the seller's products for sale. The product catalog may contain product information about each product sold by the seller. For example, the product information includes the product name, the price of the product, the URL of the seller's web page where the product can be viewed and / or purchased from the seller, the geographical location of the seller, to promote the product, and / or the user-provided image. May include advertising costs, etc. that the seller is willing to pay to associate the item with the item. For example, a seller may sell thousands of merchandise through his e-commerce website, each of which is associated with one or more web pages on the seller's website or one or more. It may be displayed on a web page. The seller 106 may provide the management service 110 with a product catalog containing one product, some products, or all products sold by the seller. As further described below, the management service 110 stores the product catalog provided by the seller in the product catalog data store 115, and any of the user-provided images held in the image data store 113 is provided by the seller. It can be determined whether or not the display of the product listed in the product catalog is included. The images held in the image data store 113 include the display of the goods that the seller identifies in the goods catalog, and these images are associated with the goods and / or the seller. The association is kept in the mapping data store 111.

Advertising costs can refer to the amount the seller is willing to pay to promote the product, to associate the product with a user-provided image that includes a display of the product, and so on. In some implementations, advertising costs may be based on the number of views or impressions the product receives from users of the management service. In another implementation, the advertising costs can be a specified period, etc. In an implementation, when two or more sellers sell the same or similar merchandise, advertising costs may be used as a factor in determining which seller (s) are associated with the user-provided image including the display of the merchandise.

The seller 106 further identifies and removes the merchandise from the merchandise catalog by identifying extra merchandise for sale by the seller, provides updated variant information for the merchandise identified in the merchandise catalog, and / or. By changing the cost of advertising a product, the offered product catalog can be updated on a regular basis. These up-to-date information is reflected in the product catalog data store 115 and may be used by the management service 110 when presenting the image to the user.

Returning to FIG. 1, the client device 104 is a wireless computer such as a personal computer, a tablet computer, an electronic book reader device, a laptop computer, a desktop computer, a netbook, a personal digital assistant (PDA), a portable game machine, a smartphone, or a mobile phone. It may include communication devices, set-top boxes, game consoles, cameras, audio recorders / players or any combination thereof. As described with respect to the implementations shown herein, the server system 100 is configured to exchange data and information, including users, images, sellers, products, product variants and other similar information, with the client device 104. .. For example, the management service 110 interacts via the server system 100 to present an image to the user 101, presents product variant information to the user 101, and purchases a product between the user and the seller of the product. Can do things like support.

Similarly, the user 101 interacts with the management service 110 via the client device 104 to provide images, view images, share images, interact with other users, and initiate product purchases from product sellers. And so on. As described herein, the user who provides the image containing the display of the goods may be a different person or entity than the seller of the goods displayed in the image.

The mapping data store 111 stores information about the association between the goods displayed in the user-provided image and the goods sold by the seller. For example, a product is displayed in a user-provided image and can be determined to be available for sale by three different sellers (listed in the product catalog). In such an example, the mapping data store 111 will retain the association between the user-provided image held in the image data store 113 and the matching product listed in the product catalog provided by each seller.

The user profile data store 117 stores information about the user 101 of the management service 110. All kinds of information can be stored in the user profile data store 117. For example, user profile information such as attributes, name, address, gender, browsing history, purchase history, billing information, delivery information, purchase information, social networks and / or friends with which user 101 interacts can be stored in the user profile data store 117. Can be remembered. User profile information is between the user and the seller when interacting with the management service 110 (eg, clickstream data when the user explores the management service 110), when posting, viewing and / or sharing an image. Can be provided directly from user 101 of the client device 104 and / or collected from user 101, such as when assisting in the purchase of. In some implementations, users of Management Service 110 limit the amount of information contained in their user profile, limit access to their user profile information, and / or share from their user profile information. You may choose to limit the information (if any). The user profile information held in the user profile data store 117 can be used by the management service 110 to assist the user in purchasing goods from the seller.

In addition to retaining mappings, product catalogs, images and information about the user, the management service 110 may return usage information to the user 101 and / or the seller 106. For example, the management service 110 may return use and / or purchase information (eg, purchase history) to the user 101 through communication between the server system 100 and the client device 104. Such information may include identification of images recently viewed, provided or shared, identification of others who have viewed images posted by the user, purchase of goods by the user, and the like. Similarly, the management service 110 may provide information to the seller 106 through communication between the server system 100 and the seller 106. Such information may include an analysis of the seller's products sold, such as the number of user-provided images including the display of each product, the purchase history of the product, and the like.

FIG. 2 is a block diagram of an implementation example in which the seller's products are posted through a plurality of channels by one implementation. The implementation example starts when the seller 206 creates a product for sale by the seller, and the user can purchase the product that can be sold directly from the seller. For example, sellers may create their own e-commerce websites and may create websites hosted by e-commerce platform providers such as SHOPIFY, Magento, BIGCOMMERCE, VOLUSION, BIGCARTEL, 3DCART and the like. In order to enable the purchase of goods, the seller processes and authenticates the purchase request from the user. Associated with payment processors such as NET, STRIPE, PAYPAL, BALANCED.

In addition to establishing the seller's direct sale, seller 206 creates an account in management service 210, referred to herein as a vendor account. The vendor account allows the management service 210 and the seller 206 to share information. In one example, seller 206 creates a vendor account and presents a dialog requesting management service 210 to authenticate information sharing with the seller. Upon receiving the authentication, the management service 210 sends a token to the seller over the network 208 and sells from the seller so that the seller and the management service 210 can establish a communication link and exchange information on the network 208. Request personal information. The token may identify the information used by the seller 206 and transmitted by the management service 210 as being associated with the seller 206. In response, the seller sends the seller information to the management service 210, which uses the seller information to identify the information received from the seller as associated with the seller 206. And certify that the seller 206 sells the goods through the management service. For example, the seller information required to authenticate the seller 206 may include, but is not limited to, transaction history information, payment refusal rate, seller's merchandise sales period, seller's contact information, and the like.

Once the seller 206 is approved by the management service 210, a link is established between the seller and the management service, which allows the seller to send information to the management service 210, which the management service 210 sells. Information can be sent to a person. Additionally, the seller 206 creates a product catalog. The product catalog identifies each product that seller 206 wants to sell through a host site maintained by management service 210. The product catalog is a source location such as a uniform resource locator (“URL”) on the web page of the seller's website where the product, the product can be viewed and / or the product can be purchased from the seller for each product. It is possible to specify an identifier, a product image, product information, image information, sellable quantity, price, delivery information, product description, product category information, product size, product shape, product color, and the like.

As described below, the product catalog and / or parts thereof may be updated regularly by the seller, whereby the management service retains current information about the products that the seller sells through the management service. For example, if a unit of a product is sold directly by the seller, the product catalog may be updated automatically, which makes the units available for sale through the management service accurate. This can be done without the intervention of the seller.

Here, referring to FIG. 3, the seller 306 provides the product catalog to the management service 310. The product catalog is sent to the management service 310 on the network 308, and the management service 310 stores the product catalog in the product catalog data store 315. When the management service 310 receives the product catalog from the seller 306, the management service 310 processes a user-provided image stored in the image data store 313, which is called a stored image, and one of the stored images is the product catalog sold by the seller. Determine if it contains the display of the product specified in.

The processing of the stored image can be performed step by step. For example, in the initial processing, the source location identifier such as the URL of the product listed in the product catalog is compared with the source location identifier included in the image information of the stored image, and whether any of the source location identifiers is the same or similar. It may include determining whether or not. For example, when the source location identifier is a URL, if the source location identifier of the existing image and the source location identifier listed in the product catalog are the same, they can be determined to be the same. Similarly, if two URLs, the source location identifier of the stored image and the source location identifier listed in the product catalog, have the same domain address (from the same website or domain), they are determined to be similar. obtain.

If the source location identifiers are the same, the stored image may be determined to include a display of the seller's goods for sale. When the stored image contains a source location identifier similar to the source location identifier contained in the product catalog, the stored image is further processed using one or more image processing algorithms and the stored image is included in the product catalog. It can be determined whether it is similar to an image or image information corresponding to a similar source location identifier. For example, a hash value may be determined for the stored image and compared with the hash value included in the product catalog. Alternatively, one or more image processing algorithms such as an edge detection algorithm, an object detection algorithm, and the like may be used to determine the features of the stored image that can be represented as feature vectors. The image provided in the product catalog can also be processed to generate the feature vector (or the feature vector can be provided in the product catalog). The feature vector of the stored image may then be compared to the feature vector of the product (s) identified as having a similar source location identifier in the product catalog, and if the feature vectors are similar, the stored image is sold. It may be determined that the display of the product sold by the person is included. In some implementations, additional image processing may be performed on images with the same source location identifier as well.

The source location identifier can be either a physical or virtual location and is associated with the goods and / or any other identifier that can be used to identify the goods. For example, as described above, the source location identifier can be the URL of a web page from which information about the product can be obtained. In another implementation, the source location identifier may include the physical coordinates of one or more physical locations (eg, the seller's physical store) where the goods can be viewed and / or purchased. In such an implementation, the user-provided image may include location information such as Global Positioning System (GPS) coordinates, which are compared to the coordinates contained in the product catalog. In yet another implementation, the source location identifier may include a Universal Product Code (UPC), barcode, baud code, etc. associated with the product.

In some implementations, stored images that do not match the products in the product catalog may be further processed as part of the initial processing. For example, the feature vector of the processed stored image may be used to determine if the product is displayed in the image, and if so, the category of the product may be determined. For example, the management service may maintain a list of product categories and corresponding feature vectors, which are representative of the products associated with the product category. A product category can be a classification or categorization of any type of product. For example, product categories may include shoes, shirts, bags, sporting goods, clothing, hats, cars and the like. For each product category, the product feature vector, color, shape and / or other features associated with that category are retained and can be used to compare with the feature vector and / or other information in the stored image. .. If there is a similarity between the feature vector and / or other information associated with the product category and the feature vector and / or other information of the stored image, the stored image may be associated with that product category.

Similarly, the goods identified in the goods catalog as the seller and / or the goods sold by the seller may be further associated with the goods category. The seller's association of a product identified as a category association with a category can be done in a manner similar to that described above with respect to the association of stored images with a category. Alternatively or additionally, the seller may identify the product category, for example, by specifying the product category of each product listed in the product catalog.

The stored image may include the display of the product listed in the provided product catalog based on the category determined for the stored image, the seller 306 and / or the category associated with the seller's sold product. Determine if there is. For example, if the product category determined for the stored image matches the product category associated with the seller and / or the product catalog provided by the seller, the stored image may include a display of the seller's product for sale. It can be determined that there is sex. If the stored image contains a display of a product that may be listed in the product catalog, additional processing may be performed to determine which product is displayed in the image. Additional processing may include additional analysis of the stored image and / or comparison of the feature vector and / or other image information between the stored image and the product in the product category associated with the same product category. In another example, a person may manually review a stored image and compare it to a product listed in a product catalog that has the same product category, and the product displayed in the image is listed in the product catalog. It may be determined whether or not it matches the product. The person may be an employee of management service 310, an independent evaluator, a user (or user group) of management service 310, a representative or employee of seller 306, and the like.

If it is determined that the stored image contains the display of the product listed in the product catalog provided by the seller 306, the management service establishes an association between the product listed in the product catalog and the stored image. And store the association in the mapping data store 311. Similarly, the management service may establish an association between the stored image and the seller 306 and retain that association in the mapping data store 311. As further described below, when the user requests viewing of the stored image, the management service 310 determines the association between the stored image and the seller's product for sale, and the seller information and / or purchase control is the image of the product. Present to the presentation.

Focusing on FIG. 4 here, the user 401 may further provide an image that may match the seller's product for sale. In this example, user 401 uses client device 404 to provide images to management service 410 over network 408. When the management service receives the image, it stores the image in the image data store 413, processes the provided image, compares the processed image with the product identified in the product catalog data store 415, and the user-provided image Determine if the seller includes a display of the product for sale. The processing of the user-supplied image may be performed in a stepwise manner similar to that described above with respect to FIG. For example, the source location identifier of the user-provided image may be compared to the source location identifier held in the product catalog data store 415, with the feature vector of the product identified in the product catalog data store 415 by processing the user-provided image. The feature vector may be generated, and the image information associated with the user-provided image may be compared with the image information from the product catalog data store 415.

If the user-provided image is determined to include a display of the product listed in the product catalog data store 415, the user-provided image is associated with the product and / or the seller selling the product, and the association is associated with the mapping data store 411. Is remembered in.

5 to 6 are block diagrams of an embodiment that assists the user in purchasing a display product by one implementation. Focusing first on FIG. 5, an implementation example is initiated by requesting the user 501 to view an image through the client device 504, which image is provided by the user (user 501 or any other user) to the management service 510. However, it is stored in the image data store 513. The request is transmitted from the client device 504 to the management service 510 through the network 508. Upon receiving the user's request, the management service 510 queries the mapping data store 511 to determine if there is any association between the requested image and the seller's product for sale. If there is an association between the image requested by the user and the product sold by the seller identified in the product catalog data store 515, the management service 510 provides the requested image and the purchase control presented to the user. .. As further described below, the purchase control is user selectable to obtain additional details about the item displayed in the requested image and / or initiate an item purchase from the seller selling the item. Is for. In some implementations, the management service 510 may further provide seller information that identifies the seller of the goods displayed in the image.

In addition to providing images and purchase controls for presentation to user 501, management service 510 may further send to seller 506 a request for a product variant for a product displayed in the image and available for purchase from seller 506. .. The seller 506 may provide the current merchandise variant for the merchandise displayed in the image and available for purchase from the seller 506 in response to receiving the merchandise variant request. In another implementation, instead of the management service 510 sending a request to seller 506, or in addition to the management service 510 sending a request to seller 506, the seller manages product variant updates. It may be sent to service 510 on a regular basis. For example, the seller 506 may specify an update interval (eg, hourly, daily, weekly) and send the latest information on the product catalog and / or product variant to the management service, the latest on the product catalog and / or product variant. Information is retained and used by management service 510. In some implementations, the seller 506 may be configured to send the latest information on the product variant to the management service 510 when the product variant changes (eg, price change, inventory quantity change). In such an implementation, the management service 510 does not send a request for product variant information to the seller 506, but the management service 510 pre-provides and stores the product variant for the product displayed in the request image. Information is available.

Focusing here on FIG. 6, when the user 601 selects or otherwise activates the purchase control provided for the image, a request is sent to the management service 610. For example, the requested image and the corresponding purchase control may be transmitted by management service 610 to client device 604 over network 608 and presented to user 601 on the display of client device 604. When the user selects the purchase control, the client device 604 sends a request to the management service 610 over the network 608.

In response to receiving the request, the management service 610 sends the product variant information corresponding to the product associated with the selected purchase control to the client device 604, which is displayed in the image. In some implementations, product variant information may be transmitted with another image of the product (s), the seller and / or additional details regarding the sale of the product. In addition, the management service 610 sends a reservation request for the seller 606 to temporarily reserve the goods to the seller 606 via the network so that there is a quantity of goods that can be sold to the user 601. Can be.

When the seller chooses to purchase the goods, a purchase request is sent from the client device 604 to the management service 610, the management service 610 of the goods between the seller of the goods 606 and the user 601 as illustrated in FIG. Support the purchase. In some implementations, the user 601 may complete the purchase of the goods without being redirected to the seller 606. For example, the management service 601 may acquire or own the information necessary to complete the purchase and transmit that information to the seller 606. For example, as part of a purchase, a user may use product details (eg, size, color), quantity, delivery details (eg, delivery speed, destination), payment credentials (eg, credit card number, bank account number) and / Or may provide purchase information such as other information. As further described below with respect to FIG. 7, the management service may provide purchase information to the seller, who may complete the purchase of the goods for the user. In such an implementation, all aspects of the purchase may be made by the seller 606, including communicating with the payment processor for purchase authorization, updating inventory for sale, etc., or on behalf of the seller 606. May be done in. If the purchase is authenticated, the purchase confirmation is returned from the seller 606 to the management service 610.

In another example, the management service may provide a payment confirmation to the seller by assisting the user in paying the goods (eg, via a third party payment processor) on behalf of the seller. In addition to payment confirmation, the management service 610 may provide the seller with a product variant selected by the user (eg, size, color, delivery options), a delivery address specified by the user, and the like.

Seller 606 initiates delivery of goods to the user upon completion of purchase and / or receipt of purchase confirmation. For example, if the goods are physical goods, the seller 606 may deliver the goods to a delivery location designated by the user. Similarly, if the goods are digital goods, the goods may be transmitted from the seller to the user 601 via a network 608, for example. The management service 610 may provide the user 601 with a confirmation message that the purchase of the goods from the seller 606 has been completed.

As described, the implementation can determine the products displayed in the user-provided image and match these products with the seller who sells the products. In the examples described herein, it was mentioned that a single seller sells the goods, but in another implementation, the goods displayed in the user-provided image may be sold by multiple sellers. For example, if the item displayed in the image is a sports shoe, this item may be available from a number of different sports shoe sellers. In such an implementation, the user-provided image of the product may be associated with each seller and the management service keeps the mapping in the mapping data store. In some implementations, a single seller may be associated with a purchase control when the user-provided image and the corresponding purchase control are sent to the requesting user. A single seller may be randomly selected, may be selected based on price, and may be selected based on the user's past purchase history, user and seller location and / or other factors. Alternatively, the list of sellers may be provided to the user when the purchase control is activated.

FIG. 7 is a block diagram of the purchasing process with one implementation. As mentioned above, the management service 710 may support the purchase of goods between the user 701 and the seller 706. In the implementation described herein, a user of a management service may purchase goods from a seller other than the management service without ever leaving the management service website. At the same time, the seller may promote and sell his or her goods through the management service, even if the image provided by the seller and / or the user of the management service independent of the management service is used.

When the user 701 selects the desired product variant and initiates the purchase of the product, the management service 710 receives the purchase request and the selected product variant. The management service may further retain the user's purchase information (eg, credit card, billing information and delivery information) in the user profile data store, and / or the user may provide such information as part of the purchase request. good.

In the example illustrated in FIG. 7, the management service 710 acquires all the information necessary for the seller 706 to be able to complete the purchase of the goods. Purchase information may include username or identifier, address, billing address, merchandise information, selected merchandise variants, shipping information, prices, payment credentials, and the like. In some implementations, some of the purchase information may be retained in the management service data store. For example, when a user establishes a user account in a management service, the user's profile may include a user name or identifier, address, shipping information, billing address and / or payment credentials. In some implementations, payment credentials such as credit cards may be stored in payment credential vault 703, where the vault is AUTHORIZE. It may be held by a third party such as NET, STRIPE, BRAINTREE, etc. Once the user's payment credentials are stored in the payment credential vault 703, the token may be associated with the payment credentials provided to the management system and held in the user profile.

If the user is providing a new payment credential, the provided payment credential may be sent by the management service 710 to the payment credential vault 703, which returns a token representing the payment credential to the management service. You can do it.

When the purchase information is sent by the management service, the token provided by the payment credential vault is included in the purchase information without including the actual payment credential. In some implementations, purchase information, including tokens rather than actual payment credentials, may be sent directly from management service 710 to seller 706. For example, if the payment processor 702 used by the seller 706 to process the payment is the same entity as the payment credential vault 703, the purchase information with the token may be sent directly to the seller 706, the seller then. , Tokens may be sent to the payment processor 702 for payment processing and authentication. Since the payment processor 702 has information on both the token and the payment credential associated with the token, it can process and authenticate the payment based on the associated payment credential.

In another implementation, the seller 706 may transfer the received token to the payment credential vault 703, where the payment credential vault sends the payment credential to the seller and / or the payment processor associated with the seller. This makes it possible to process and authenticate payments for purchased items. In such an implementation, the payment credential vault may determine that the recipient of the payment credential complies with one or more criteria, such as the Payment Card Industry (PCI) Compliance Standard. Additionally, the transmission of payment credentials may be sent using a secure connection. In such an implementation, a purchase identifier identifying the purchase and / or a seller identifier identifying the seller of the goods may be included in the token and transmitted to the payment credential vault 703. Similarly, the purchase information may be transmitted to the seller 706 along with the purchase identifier. The purchase identifier is then used by the seller 706 and the payment credential vault 703 to adjust and confirm the payment for the purchase.

Alternatively, the purchase information with the token may be sent from the management service to the payment credential vault 703, along with a seller identifier indicating the seller to whom the payment information is transferred. Upon receipt of the purchase information, the payment credential vault replaces the token with the payment credential and sends the purchase information and the actual payment credential to the seller 706. In such an implementation, the payment credential vault may determine that the recipient of the payment credential complies with one or more criteria, such as PCI compliance criteria. In addition, payment credentials can be sent using a secure connection. Upon receipt of the payment credential, the seller provides the payment credential to the associated payment processor 702 for processing and authentication.

The payment processor 702 processes, confirms that the payment has been authenticated, and returns the payment transaction identifier and instructions that the payment has been authenticated to the seller 706. In response to this, the seller may return a purchase confirmation to the management service 710 confirming that the purchase has been completed. In some implementations, the purchase confirmation sent from seller 706 to management service 710 is sent directly from seller 706 to management service 710. Alternatively, the purchase confirmation may be sent from the seller 706 to the management service 710 via the payment credential vault 703. Upon receiving the purchase confirmation, the management service 710 may send a notification to the user confirming that the seller has confirmed the purchase of the goods. When the seller begins delivering the goods, the funds may be collected from the payment processor and the transaction may be completed.

If the payment processor cannot authenticate the payment, the payment processor returns a notification to the seller that the payment will not be authenticated. If the payment is not authenticated, one or more reasons (eg, the payment information is invalid) may be provided in the notification that the payment is not authenticated. The seller 706 may then send the reason for the failure to the management service 710, which may obtain the information required from the user to complete the payment.

In the implementation described with respect to FIG. 7, the user can purchase goods directly from the seller 706 through the management service 710, at which time the management service does not need to send payment credentials to the seller. Similarly, the purchase is processed by the seller and the associated payment processor 702 as if a direct purchase with the seller had occurred. In such a configuration, the inventory available to both the seller and the management service is automatically updated, and the details of all orders are integrated and maintained by the seller and the like.

FIG. 8 is a block diagram of another purchasing process with one implementation. As mentioned above, the management service 810 may support the purchase of goods between the user 801 and the seller 806. In the implementation described herein, a user of a management service may purchase goods from a seller other than the management service without ever leaving the management service website. At the same time, the seller may promote and sell his or her goods through the management service, even if the image provided by the seller and / or the user of the management service independent of the management service is used.

When the user 801 selects the desired product variant and initiates the purchase of the product, the management service 810 receives the purchase request and the selected product variant. The management service may further retain the user's purchase information (eg, credit card, billing information and delivery information) in the user profile data store, and / or the user may provide such information as part of the purchase request. good.

Payment of goods may be completed separately, based on the relationship between the management service and the seller of the goods. In one implementation, the seller of goods may hold a payment account on the third-party payment processor 802, which approves payments for purchases backed by management service 810. In such a configuration, the details of the user's purchase are not provided to the seller 806, and the seller remains the seller on record. Once the purchase is made, the payment is processed by the third party payment processor 802 and the payment is made to the seller's account held by the third party payment processor 802. In another configuration, the seller can be his own payment processor. In such a configuration, the details of the user's purchase may be provided from the management service 810 to the seller 806, who may process the payment for the goods.

In either configuration, when the management service 810 receives a purchase request from user 801 the total cost of the purchase (eg, price, tax, delivery), the payment token identifying the purchase transaction and the seller's identifier are the payment processor 802 (eg). Sent to either a third-party payment processor or the seller's payment processor). The payment processor 802 processes, confirms that the payment has been authenticated, and returns the payment transaction identifier and instructions that the payment has been authenticated to the management service 810.

Upon receiving the payment transaction identifier, the management service sends a payment transaction identifier to the seller 806 confirming that the purchase has been authenticated. In response, the seller may return a purchase confirmation to management service 810 confirming that the purchase has been completed. Similarly, the management service may send a notification to the user confirming that the seller has confirmed the purchase of the item. When the seller begins delivering the goods, the funds may be collected from the payment processor and the transaction may be completed.

In yet another implementation, the management service 810 provides the goods to purchase, the goods variant information (eg, quantity, color, size), the delivery information, and the user information required by the seller to complete the sale of the goods to the user (eg, the quantity, color, size). , User information, payment information), etc., all set orders can be prepared. All set orders can then be sent directly to seller 806. Upon receiving an all-configured order from management service 810, seller 806 processes the order and indicates that the purchase was not completed due to purchase confirmation or one or more reasons (eg, invalid payment information). Send any of the errors back to management service 810. The management service 810 may send a notification to the user 801 confirming that the seller has confirmed the purchase of the goods or that there was an error in the purchase request. When an error occurs, the management service 810 can acquire the information necessary for resolving the error from the user and provide the information to the seller 806, so that the product purchase from the seller can be completed.

In addition to the management service determining multiple sellers for the products displayed in the image, in some implementations multiple products may be displayed in a single user-provided image. In such an example, the image may be segmented based on the various positions of the displayed merchandise, the seller may be determined for different merchandise, and different purchase controls are presented for each of these merchandise. You can do it.

For example, reference to FIG. 9 illustrates the display of segmented user-provided images, including a plurality of products sold by various sellers, in one implementation. Images such as image 900 can be segmented using image segmentation techniques. For example, the background of the image may be determined (eg, based on out-of-focus areas and / or similar colors) and excluded from processing. Similarly, six objects were identified and the image was segmented into six different regions. Specifically, it is a body object 902, a head object 904, a shirt object 906, a trouser object 908, a bag object 910, and a shoe object 912. As part of the segmentation, the root object, which is the body object 902 in this example, was determined and the positions of the other objects 904-912 were considered when identifying these other objects. Image segmentation is described in more detail in US Patent Application No. 14 / 279,871, entitled "Image Based Search," which is incorporated herein by reference in its entirety.

In other implementations, other segmentation and identification techniques may be used to segment the image. For example, crowdsourcing techniques may be used to segment the image. For example, when the user browses an image, the image area containing the object may be selected and the image may be segmented based on the position of the object in the image. The more users identify objects in an image, the more reliable the identification of these objects. Based on the segmentation and specification provided by the user, the object in the image can be identified and a determination is made as to whether the object is a product for sale by the seller.

For example, each segment may be processed to generate feature vectors for the products displayed within the segment, and these feature vectors are compared to the feature vectors associated with the product identified in the product catalog data store. May be done. Alternatively or additionally, the image segments may be processed to classify the goods into one or more categories. For example, the shirt object 906 of image 900 may be processed to detect an object (shirt) displayed within a segment containing the shirt object 906, and the segment is associated with a category representing a shirt (or another related category). May be done. As mentioned above, the display of an object (shirt) may be compared to the seller's product associated with the shirt category and / or to the seller's product associated with the shirt category. It is determined whether the object displayed in the segment matches the seller's product for sale. This process is performed on each object and / or segment of the image and may determine the goods sold by one or more sellers displayed in the image.

FIG. 10 is a display of segmented images 1000 presented on the display of client device 1004 by one implementation, purchased into an image object determined to be a product for sale by one or more sellers. The control is associated. For each item determined to be available for purchase by one or more sellers in the segmented image, a purchase control may be presented near the item determined to be user selectable. In this example, the shirt 1006 is determined within the first segment 1005 of image 1000, and the purchase control 1026 is presented near the shirt presentation. Similarly, the bag 1010 is determined within the second segment 1009 of the image, and the purchase control 1020 is presented near the bag presentation. The trousers 1008 are determined within the third segment 1007 of image 1000 and the purchase control 1028 is presented near the presentation of the trousers 1008. Finally, the shoe 1012 is determined within the fourth segment 1011 of image 1000 and the purchase control 1022 is presented near the presentation of the shoe 1012.

The majority of the segments of the image 1000 are determined to include the display of the seller's products, while the segment 1003 containing the object of the person's head is determined not to include the seller's products. Since it is determined that the object (person's head) displayed in the segment 1003 is not a product sold by the seller, no purchase control is presented near the presentation of the object.

The user may view the image 1000 on the client device 1004 and selectively interact with one or more purchase controls to obtain additional details about the goods associated with the purchase controls. For example, FIG. 11 is a display of a product and a product variant of a shirt product according to one implementation. The information 1100 presented on the display of the client device 1104 is generated in response to the user selecting the purchase control 1026 (FIG. 10) associated with the shirt product. In this example, when the purchase control 1026 is selected, an additional view 1110 of the shirt product is presented to the user with the name of the seller of the goods 1106, in this example the seller A, and the goods may be purchased from the seller A. The information 1100 presented may further include the trade name "Women's Summer Casual Shirt" 1108. The management service may further acquire and provide product variant information 1112 such as size, fit, color, delivery method and / or shirt quantity, as described above. The user may change or select the product variant information, for example, by interacting with the presentation of the product variant information. Additionally, purchase and / or delivery information 1114 may be further presented to the user, which is currently associated with the user of client device 1104 and is "buy now" by the user. When control 1116 is selected, management services are used to assist in the purchase of goods. The user may modify the purchase and / or delivery information 1114 by selecting the "Edit" control 1118 to provide or select other information. The type or form of payment method may be used in the implementations described herein. For example, a user profile associated with a user, maintained by a management service, may include credit card information, as illustrated, and may be used to assist in a purchase between the user and the seller of the goods. .. In another implementation, other payment forms such as bank transfers, e-commerce payment processors, etc. may be used as well.

In some implementations, discount code 1119 or other advertisements may be associated with the goods displayed in additional view 1110. For example, if the seller A1106 is promoting the received goods and the discount code 1119 is offered as part of the clearing process, the discount code 1119 is automatically identified and displayed on the display of the client device 1104. It may be included in the presented information 1100. In some implementations, the discount code 1119 is offered by the seller as a product variant of the product. In another implementation, the user may modify, update, or provide discount code 1119 by selecting discount code 1119 and providing such information.

Product addition view 1110 is a digital still image, video file, animation. It can be in the form of a gif file or the like. For example, the additional view 1110 is an animation that the user can manipulate to change the presented view of the product. It may include the presentation of a gif file. For example, if the client device 1104 includes a touch-based display, the user can move his or her finger on the touch-based display. You can manipulate or control the presentation of the gif file to get another view of the presented goods. In one implementation, the user may control the presentation of the image and rotate the image to obtain front, back, sides and / or other views of the image, which effectively provides a 360 degree view of the image. offer.

In some implementations, the user may view and / or provide comments, reviews, ratings and / or other information about the goods displayed within the additional view 1110. In some implementations, the user may be further presented with the identification of related products that are often viewed or purchased with the products displayed in the additional view 1110. The related product is a product that is often purchased together with the product or a product that the user often browses when browsing the product displayed in the additional view 1110. For example, if another user of the management service often purchases the product "Ladies Summer Casual Shirt" from seller A and more shorts that look good, the information 1100 is the product displayed in the additional view 1110. Shorts that look good can be further identified to the user as a product that is often purchased with. The user may obtain additional information about the matching shorts by selecting the identified matching shorts.

When the user selects the "Buy Now" control 1116, the management service assists the purchase of goods between the user and the seller. The product purchase support is described above with respect to FIGS. 7 and 8. In addition to assisting the purchase, the management service may further send a confirmation message to the user, as illustrated in FIG. In this example, the management service sends a confirmation message 1202 to the client device 1204, where the confirmation message 1202 sends a confirmation email to the user that the seller of the goods has received an order for the goods from the user and that the seller has sent a confirmation email to the user. It confirms that it will be done.

FIG. 13 illustrates a process example 1300 for matching a seller with a product by one implementation. Each of Process Example 1300 and the other processes described herein is exemplified as a set of blocks in a logical flow diagram. Some of the blocks represent possible actions in hardware, software or combinations thereof. With respect to software, a block represents a computer executable instruction stored on one or more computer-readable media and performing operations detailed when executed by one or more processors. In general, computer executable instructions include routines, programs, objects, components, data structures, etc. that perform a particular function or perform a particular abstract data type.

Computer-readable media include hard drives, floppy disks, optical disks, CD-ROMs, DVDs, read-only memory (ROM), random access memory (RAM), EPROM, EEPROM, flash memory, magnetic or optical cards, solid state memory devices. , Or other types of storage media suitable for storing electronic instructions, may include non-temporary computer-readable storage media. Additionally, in some implementations, the computer-readable medium may include a temporary computer-readable signal (compressed or uncompressed). Examples of computer-readable signals are configured to be accessible to computer systems that host or run computer programs, including signals that are downloaded or uploaded over the Internet or other networks, whether modulated using carrier waves or not. Signals, but are not limited to. Ultimately, the order in which the actions are described is not intended to be construed as a limitation, and any number of descriptive actions may be combined in any order and / or in parallel to carry out the process. It is possible. Similarly, more or less behavior than these descriptions may be utilized for the various implementations described herein.

The process example 1300 is started by determining in 1302 whether or not there is a source location identifier such as a URL, GPS coordinates, a barcode, etc. included in the image information of the user-provided image. As described above, the user-provided image may already be stored in the image data store of the management service or may be provided to the management service by the user. A user-provided image can be any image or display of an object that the user provides to the management service. For example, the user-provided image may be an image acquired by an image capture device of the user's client device, an image copied from another website, an image from an electronic message, or the like.

The image may include a source location identifier, such as a URL, if the image is taken from another location on the network, such as the Internet (eg, a website). In another example, the source location identifier may identify the physical location of the image captured by the image capture device (camera). For example, when the camera acquires an image, the image information may include GPS coordinates (latitude and longitude) that specify the position of the image capture device when the image was acquired.

If it is determined that the user-provided image does not include the source location identifier, process example 1300 proceeds to process example 1400, which will be described later in FIG. However, if it is determined that the user-provided image contains a source location identifier, the source location identifier of the user-supplied image is compared at 1304 with the source location identifier held in the product catalog data store. As mentioned above, the product catalog data store maintains a list of products sold by one or more sellers. When the source location identifiers are compared, at 1306 a determination is made as to whether the source location identifier of the user-provided image matches the source location identifier of the product identified in the product catalog.

If it is determined that the source location identifier of the user-provided image does not match any of the source location identifiers of the products in the product catalog data store, process example 1300 proceeds to process example 1400 described below with respect to FIG. If the source location identifier of the user-provided image matches the source location identifier of the product in the product catalog data store, at 1308, the user-provided image is the matching product from the product catalog data store and / or the sale selling the product. Associated with a person. The management service maintains this association in the mapping data store.

A user-provided image is presented to the user, such as the user requesting viewing of the user-provided image, based on the association between the user-provided image and the product and / or the seller of the product identified in the product catalog data store. Each time, at 1310, the presentation of the image will include purchase control and / or seller information. The purchase control may be selectable by the user to obtain additional information about the product displayed in the user-provided image and / or to initiate the purchase of the product, as described above. The seller information identifies the seller of the goods displayed in the image. When multiple sellers are associated with the item displayed in the image, the seller information is one of the sellers, one seller determined based on the advertising costs provided for the item, multiple. You may specify the seller of the product, provide an instruction that two or more sellers are selling the product displayed in the user-provided image, and the like. The user who requests the viewing of the user-provided image may be the user who provided the image, or may be any other user of the management service.

In the example illustrated in FIG. 13, the matching of the user-provided image to the seller when the source location identifier of the user-provided image matches the source location identifier of the product listed in the product catalog data store has been described. In some implementations, additional analysis may be performed before determining that the user-provided image contains a display of the seller's goods for sale. For example, a user-provided image may be processed to determine if the image is similar or matches the image or image information contained in the product identified as having a matching source location identifier in the product catalog. In another implementation, additional image information such as creation date, file size, hash value, color histogram, etc. may be compared to obtain additional confirmation that the user-supplied image contains a display of the seller's product for sale. .. In some implementations, all or part of FIG. 14 may be done in parallel with Process Example 1300.

FIG. 14 illustrates a process example 1400 of one implementation that processes a user-provided image to match a product displayed in the image with the seller of the product. Process example 1400 starts at 1402 by receiving an image from the user. The received image is then processed in 1404 using one or more image processing algorithms such as edge detection, object detection, grayscale analysis, etc. to determine the object to be displayed in the image. In some implementations, additional feature vectors may be generated to represent the image and / or the objects in the image.

In addition to processing the image, at 1406, the source location identifier, the comment added by the user who provided the image, the comment added by the user who viewed and / or shared the image, the time, date and / or position associated with the image. Image information such as, etc. can be further examined. Based on the processed image and the image information, in 1408, a determination is made as to whether or not the product category for the object displayed in the image can be determined. In some implementations, the management service may maintain a list of product categories for products sold by various sellers. Each product category may include one or more product features such as a description, a typical image of the product associated with the product category, a typical shape, size and / or color of the product that may be associated with the product category. Similarly, a seller may be associated with a product category based on the type of product sold by the seller. Similarly, based on the type of product, the product for sale may be associated with one or more product categories.

When determining whether an object displayed in a user-provided image can be associated with a product category, the processed image and / or image information is compared with the characteristics of each product category and the object displayed in the image. Determines if is similar to a product category. For example, the size, shape and / or color of the determined object is compared between the size (s), shape (s) and color (s) characteristics of the product category between the object and the product category. You may judge the similarity of.

If the object displayed in the user-supplied image cannot be associated with a product category, at 1410 the image is sent for manual review and categorization. Manual review and categorization may include reviewing a user-supplied image by one or more people to determine the category of objects displayed within the image. The person (s) can be an employee of the management service, a user of the management service, a seller, and the like.

When it is determined that an object displayed in an image can be associated with a category, or when manually categorized, in 1412, the object displayed in the user-supplied image is associated with the determined category. The similarity with the image in the product catalog is determined. For example, the information in the image processed from the user-provided image (eg, feature vector, histogram) is compared with the image information about the image that matches the product identified in the product catalog to determine the similarity between these images. You may judge.

At 1414, based on the similarity between the user-provided image and the stored image, the probability of the stored image having the highest similarity to the user-provided image is determined, which means that the stored image matches the user-provided image. It shows the possibility of doing so. Probability may be based on the difference between the determined similarity scores. For example, when the highest similarity score is 95% and the next highest similarity score is 45% and 34%, the probability that the stored image having the highest similarity score and the user-provided image match can be high. By comparison, when the highest similarity score is 95% and the next highest similarity score is 94% and 93%, the images are similar, but one of these images is displayed in the user-supplied image. Since the product may actually be included, the probability that the stored image with the highest similarity score and the user-provided image will match is low.

At 1416, a determination is made as to whether the probability exceeds the reliability threshold, based on the probability score of the stored image with the highest similarity. The reliability threshold can be any number, score or other indicator that the probability score must reach above the threshold. The reliability threshold can vary with different images, different users, different times, and so on.

If the probability score does not exceed the threshold, at 1418 the image is transmitted for one or more people to manually make the association. In some implementations, images, image data, stored images and / or stored images with the highest similarity score associated with products in the product catalog corresponding to the same category are manually associated by one or more people. Can be sent to do. One or more users may be employees of the management service, employees of potential sellers of goods, users of the management service, and the like.

At 1420, the user-provided image is associated with the seller of the goods specified in the goods catalog and / or the goods specified in the goods catalog when the probability score is determined to exceed the threshold or when the association is manual. The management service keeps the association in the mapping data store.

A user-provided image is presented to the user, such as the user requesting viewing of the user-provided image, based on the association between the user-provided image and the product and / or the seller of the product identified in the product catalog data store. Each time, at 1422, the presentation of the image will include purchase control and / or seller information. The purchase control may be selectable by the user to obtain additional information about the product displayed in the user-provided image and / or to initiate the purchase of the product, as described above. The seller information identifies the seller of the goods displayed in the image. When multiple sellers are associated with the item displayed in the image, the seller information refers to one of the sellers, one seller based on the advertising costs provided for the item, and multiple sellers. It may be specified, such as providing an instruction that two or more sellers are selling the product displayed in the user-provided image. The user who requests the viewing of the user-provided image may be the user who provided the image, or may be any other user of the management service.

FIG. 15 illustrates an example of a purchase request process 1500 with one implementation. Process example 1500 starts at 1502 when the user selects a purchase control. As described above, the purchase control is presented to the user-provided image when it is determined that the user-provided image contains a display of the seller's product for sale.

Upon receiving the purchase control selection, at 1504, the seller is queried for the current product variant information corresponding to the product displayed in the image. As mentioned above, in some implementations, in response to a purchase control selection, the seller may be queried for product variant information, and the seller may periodically send product variant information to the management service. And / or the seller may provide the latest information on the product variant information when the product variant is changed.

In 1506, process example 1500 further transmits product details and current product variant information to the user's client device for presentation to the user. As illustrated and described above with respect to FIG. 11, the presentation to the user may include additional views of the product, current product variant information, purchase details, and the like. Similarly, as described above, the user may modify and / or select a particular product variant for the product, which may be used to complete the purchase of the product. For example, the user may select a particular size, color and / or other information of the goods, which may be used at the time of purchase and / or delivery of the goods.

Then, at 1508, a determination is made as to whether or not the purchase request has been received. For example, the user may choose to purchase goods when selecting the desired variant and when providing purchase details (eg, delivery address, credit card information, delivery time). If no purchase request is received, the process example completes at 1509. However, if it is determined that the purchase request has been received, at 1510 the selected merchandise variant, delivery information and user information for the user to initiate the purchase is sent to the seller of the merchandise.

In response to sending selected product variants, delivery information and user information to the seller, process example 1500 identifies purchase transactions and purchase details (eg, shipping, identification tags, delivery times) in 1512. Receive a purchase identifier from the seller.

Based on the information provided by the user and the purchase information provided by the seller, process example 1500 assists the purchase of goods between the user and the seller in 1514. Additional details for assisting the purchase of goods between the user and the seller of the goods are described above with respect to FIGS. 7 and 8. Finally, upon completion of the purchase, a purchase confirmation is sent to the user at 1516. The purchase confirmation may be sent in the form of a presentation on the user's client device, an electronic message (“email”), a text message, or the like.

FIG. 16 illustrates an example purchase execution process 1600 with one implementation. Process example 1600 provides additional details corresponding to box 1514 (FIG. 15). Process example 1600 begins at 1604 by acquiring purchase information and payment tokens. As mentioned above, the purchase information may include product identification, desired quantity, delivery details (eg, delivery address, delivery speed), selected product variants (eg, size, color, etc.). The payment token is a unique identifier provided by the payment credential vault, associated with the payment credential selected by the user purchasing the goods, and used to authenticate the purchase. If the payment token is not yet remembered, the payment credential is obtained from the user and provided to the purchase credential vault, where the payment token can be obtained.

Upon acquisition of the purchase information and payment token, at 1606, the purchase information and payment token without payment credentials are transmitted to the seller who sells the goods purchased by the user. As mentioned above, purchase information and payment tokens may be sent from the management service to the seller via the payment credential vault. Upon receiving the purchase information and payment tokens, the payment credential vault can provide the seller with the payment credentials displayed by the purchase information and tokens, thereby processing the purchase of the goods.

As mentioned above, the seller uses his or her payment processor or associated payment processor to process the payment as if the purchase was made directly by the seller. The payment processor can be the same or different entity as the payment credential vault. In the example of an entity with the same payment processor and payment credential vault, the payment credential vault may process payments for goods based on tokens received from the management service rather than providing the payment credential to the seller.

When the seller confirms the purchase on the payment processor, the seller returns the purchase confirmation to the management service. The purchase confirmation may be sent directly to the management service by the seller and / or to the management service via the payment credential vault. If the purchase cannot be confirmed, the seller will return the failure and / or request for additional information to the management service.

Returning to process example 1600, in 1608, after sending the purchase information and the payment token, a determination is made as to whether or not the purchase confirmation has been received. If it is determined that the purchase confirmation has been received, at 1610 the user is provided with a notification confirming to the user that the purchase of goods from the seller has been successful and completed. The purchase confirmation may be sent in the form of a presentation on the user's client device, an electronic message (“email”), a text message, or the like.

If it is determined that the purchase confirmation has not been received, at 1612, missing information or necessary additional information is obtained from the user. For example, if the billing address or payment credentials have expired, the user may be required to update such information. Upon obtaining the information from the user, at 1614, the updated purchase information is sent to the seller, and the process example returns to the determination block 1608 and continues.

FIG. 17 is an exemplary implementation of a server system, such as the server system 1700, that may be used in the implementations described herein. The server system 1700 may include a processor 1701, such as one or more redundant processors, a video display adapter 1702, a disk drive 1704, an input / output interface 1706, a network interface 1708 and a memory 1712. The processor 1701, the video display adapter 1702, the disk drive 1704, the input / output interface 1706, the network interface 1708 and the memory 1712 may be communicably connected to each other by the communication bus 1711.

The video display adapter 1702 provides a display signal to a local display (not shown in FIG. 17) to allow an operator of the server system 1700 to monitor and configure the operation of the server system 1700. The input / output interface 1706 also communicates with external input / output devices not shown in FIG. 17, such as a mouse, keyboard, scanner or other input / output device that can be operated by the operator of the server system 1700. The network interface 1708 includes hardware, software or any combination thereof for communicating with other computing devices. For example, the network interface 1708 may be configured to provide communication over the network 108 between the server system 1700 and other computing devices such as the client device 104, as shown in FIG.

Memory 1712 typically includes random access memory (RAM), read-only memory (ROM), flash memory and / or other volatile or persistent memory. The memory 1712 is indicated to store an operating system 1714 for controlling the operation of the server system 1700. The binary input / output system (BIOS) 1716 for controlling the low level operation of the server system 1700 is also stored in the memory 1712.

Memory 1712 further stores program code and data for providing network services that allow client devices and sellers to exchange information and data files with server system 1700 and / or management service 1710. The data store manager application 1720 shows the mapping data store 1711, the image data store 1713, the product catalog data store 1715 and / or the user profile data store 1717, and client devices such as the client device 104 shown in FIG. 1 and / or FIG. Supports data exchange and mapping with sellers such as seller 106.

As used herein, the term "data store" refers to any device or combination of devices capable of storing, accessing and retrieving data, in any standard decentralized or clustered environment. , Any combination and number of data servers, databases, data storage devices and data storage media. The server system 1700 may optionally integrate with data stores 1711, 1713, 1715, 1717 that execute one or more application aspects for client devices, sellers and / or management services 1710. Appropriate hardware and software may be included. The server system 1700 works with data stores 1711, 1713, 1715, 1717 to provide access control services such as text, graphics, audio, video and / or images transferred to client devices and / or sellers. Content can be generated.

Data stores 1711, 1713, 1715, 1717 may include several individual data tables, databases or other data storage mechanisms and media for storing data relating to a particular embodiment. For example, the exemplary data stores 1711, 1713, 1715, 1717 include mechanisms for storing images, user information, mappings and product catalogs from sellers of goods, which can be used to provide content (eg, users). (Provided images and purchase controls) can be generated and sent to client devices and / or sellers to control the actions taken.

It should be understood that there can be many other aspects such as access right information, preferred sellers, etc. that can be stored in data stores 1711, 1713, 1715, 1717. These can be stored in any of the above mechanisms as needed, or in any additional mechanism of the data stores 1711, 1713, 1715, 1717. Data stores 1711, 1713, 1715, 1717 can operate to receive instructions from the server system 1700 and acquire, update, or otherwise process data in response to the instructions through the logic associated therewith. ..

The memory 1712 may further include the management service 1710 described above. Management service 1710 may be run by processor 1701 to perform one or more of the functions of server system 1700. In one implementation, the management service 1710 may represent an instruction embodied in one or more software programs stored in memory 1712. In another implementation, management service 1710 may represent hardware, software instructions or a combination thereof.

The server system 1700 is a distributed environment that utilizes several computer systems and components interconnected via one or more computer networks or communication links using direct connections in one implementation. However, it will be appreciated by those skilled in the art that such systems will work similarly well with systems with fewer or more components as illustrated in FIG. Therefore, the depiction of FIG. 17 is considered to be exemplary in nature and should not be considered to limit the scope of the present disclosure.

The subject matter is described in terms specific to structural features and / or methodical acts, but the subject matter set forth in the appended claims is not necessarily limited to the particular feature or act described. It should be understood that there is no such thing. Rather, certain functions and acts are disclosed as exemplary forms that implement the claims.

The implementation of this disclosure may be described with the following provisions in mind:
1. 1. Receiving images, including product displays, from users of the management service,
Processing the image and determining product information about the product.
Associating the image with a product category, at least in part, based on the product information.
Determining multiple potential sellers of the goods displayed in the image,
Requesting confirmation from each of the potential sellers as to whether or not the product will be sold,
Receiving confirmation from the plurality of potential sellers confirming that the seller sells the goods, and
To associate the image with the seller
A computer mounting method comprising presenting to the second user the image and a purchase control that allows the second user to purchase the goods displayed in the image from the seller.

2. 2. The product variant information further comprises receiving product variant information from the seller, wherein the product variant information specifies at least one of the price of the product, the size of the product, or the color of the product, as described in Clause 1. Computer implementation method.

3. 3. The computer implementation method according to clause 1, wherein presenting the image and the purchase control further comprises presenting seller information identifying the seller of the goods.

4. To store the image in an image data store held by the management service,
By associating the image with the product information held in the product catalog held by the management service,
The computer implementation method described in Clause 1, further comprising.

5. When executed by the processor
Receiving the first image including the display of the first product from the first user of the management service,
Determining the first product displayed in the first image and
To determine a seller who sells the first product, which is different from the first user.
By associating the first image with the seller,
To present to the second user the first image and the seller information that identifies the seller of the first product displayed in the first image.
A temporary computer-readable storage medium that stores instructions that cause the processor to at least perform.

6. The instruction further causes the processor to present a purchase control selectable by the second user in order to initiate the purchase of the first product from the seller when executed by the processor. Temporary computer-readable storage medium as described in Clause 5.

7. When the instruction is executed by the processor,
Receiving the purchase control selection from the second user and
The second user is provided with product variant information including at least one of a delivery charge for the product, a delivery time for the product, a delivery method for the product, a size for the product, a color for the product, or a quantity for the product. To present and
The temporary computer-readable storage medium according to Clause 6, which further causes the processor to perform at least.

8. The temporary computer-readable storage medium according to clause 7, wherein the product variant information is obtained from the seller in response to receipt of the selection of the purchase control.

9. The temporary computer-readable storage medium according to Clause 7, wherein the product variant information is periodically received from the seller and is retained by the management service.

10. When the instruction is executed by the processor,
Receiving from the seller a product catalog containing product information for each of the plurality of products sold by the seller.
For each of the plurality of merchandise, the merchandise information sells the merchandise catalog comprising at least one of a second image representing the merchandise, a source location identifier associated with the merchandise, or merchandise variant information. To receive from a person and
The temporary computer-readable storage medium according to Clause 5, which further causes the processor to store the product catalog in a product catalog data store held by the management service.

11. The instruction causes the processor to determine the first product when executed by the processor, and further
Comparing the first source location identifier associated with the first image with the product information held in the product catalog data store.
Determining the first product based on the match between the first source location identifier and the stored source location identifier held in the product catalog data store.
A temporary computer-readable storage medium according to clause 10, comprising an instruction to cause the processor to perform at least.

12. The instruction causes the processor to determine the first product when executed by the processor.
The first image is processed by an image processing algorithm to determine the first feature vector representing the product displayed in the image.
Comparing the first feature vector with the product information stored in the product catalog data store,
Determining the first product based on the similarity between the first feature vector and the stored feature vector held in the product catalog data store.
A temporary computer-readable storage medium according to clause 10, further comprising an instruction to cause the processor to perform at least.

13. When the instruction is executed by the processor,
Processing a plurality of images stored in the image data store of the management service by an image processing algorithm, and
For each of the plurality of images
Determining the feature vector representing the product displayed in the image,
Comparing the feature vector with the stored feature vector held in the product catalog data store,
Determining the goods and the seller of the goods, at least in part, based on the comparison.
The temporary computer-readable storage medium according to clause 10, further causing the processor to at least associate the image with the goods and the seller of the goods.

14. The first image includes the display of the second product.
When the instruction is executed by the processor,
Determining the second product displayed in the first image and
To determine the second seller to sell the second product,
To present the first image and the second seller information for identifying the second seller of the second product displayed in the image to the second user.
The temporary computer-readable storage medium according to Clause 5, which further causes the processor to perform at least.

15. When the instruction is executed by the processor,
To present a first purchase control selectable by the second user in order to initiate a first purchase of the first product from the seller.
To present a second purchase control selectable by the second user in order to initiate a second purchase of the second product from the second seller.
The temporary computer-readable storage medium according to clause 14, which further causes the processor to perform at least.

16. With one or more processors
When concatenated to the one or more processors and executed by the one or more processors,
Receiving product information about the products sold by the first seller from the first seller, and
The product information for the product is stored in the product catalog data store held by the management service, and
Receiving a first image including a display of the first product from a first user different from the seller.
Comparing the first image with the product information for the product,
Determining whether the first product displayed in the first image matches the product sold by the first seller, at least partially based on the comparison.
By associating the first image with the product,
The first user is provided with the first image, the identifier of the first seller, and a sales control that the first user can select to initiate the purchase of the product from the first seller. To present and
A computing system comprising a memory for storing a program instruction that causes the one or more processors to perform a method of providing the above.

17. The method is
Judging that the product can be purchased from the second seller,
To present the user with an option to select to purchase the product from the first seller or the second seller.
16. The computing system according to clause 16.

18. The method is
Requesting that the first seller confirm that the first image includes the display of the product, and
Further provided with receiving confirmation that the first image includes the display of the product.
Determining that the first product displayed in the first image matches the product is further at least partially based on the confirmation.
The computing system described in Clause 16.

19. The comparison of the first image is
16. The computing system according to clause 16, wherein the first image information including the source location identifier corresponding to the source of the first image is compared with the product information.

20. The method is
Receiving the purchase control selection and
To support the purchase of the product, the purchase is made between the first user and the first seller, and the first seller delivers the product to the first user. The computing system according to clause 16, further comprising assisting in the purchase of.

Claims (20)

A computer implementation method of a management service for purchasing the goods of one or more sellers independent of the management service.
It receives a request from a user who operates a client device via a network, displays a user-provided image stored in an image data store managed by the management service, and displays a user-provided image.
Using the processor of the management service,
The user-provided image is segmented to identify multiple image segments of the user-provided image.
Each of the plurality of image segments is processed to identify the plurality of products displayed in the requested user-supplied image.
Matching at least one of the plurality of products represented in the user-provided image with the corresponding product of the plurality of products offered for sale by the seller of the one or more sellers. death,
In order to display the request for the user to purchase the corresponding product, the presentation of the user-provided image including the purchase control of at least one product among the plurality of products displayed in the user-provided image is presented via the network. To the client device operated by the user.
A request is received from a user operating the client device via a network in order to purchase at least one of the plurality of products from the seller.
Sending purchase information to the seller over the network to complete the purchase of at least one item to the user, as if the request was received directly from the user by the seller.
Receive a purchase confirmation from the seller and
A computer-implemented method of providing a notification from the seller indicating that the purchase of at least one product has been completed to the user operating the client device via the network. Product variant information is received from the seller via the network, and the product variant information includes at least one of the price of at least one product, the size of at least one product, or the color of at least one product. The computer mounting method according to claim 1, further comprising specifying. The presentation of the requested image includes a purchase control of at least one of the plurality of products displayed in the requested image, the purchase control identifying at least one corresponding seller. The computer implementation method according to claim 1, further comprising displaying personal information. The request from the user to purchase at least one merchandise includes instructions for payment credentials used to process payment for at least one merchandise.
The purchase information is transmitted to the seller over the network through the payment credential vault that manages the payment credentials.
The computer implementation method of claim 1, wherein the purchase information comprises a unique payment token provided by the payment credential vault as an indication of the payment credential. The request from the user to purchase at least one merchandise comprises displaying the said payment credential used to process the payment for at least one merchandise.
The method further
Determine the payment token provided by the payment credential vault that manages the payment credential and display the payment credential.
Including said payment token of said purchase information
The computer implementation method according to claim 1, wherein the purchase information including the transmission of the payment token to the seller is transmitted. When the payment token is sent to the seller, it is determined that the seller is associated with the payment credential vault so that the seller can use it to process payments for at least one item. The computer mounting method according to claim 5. A non-temporary computer-readable storage medium that stores instructions, when executed by a processor implemented in a management service, the instructions are sent to the processor.
Manage image data stores that store images provided by multiple users
A user who operates a client device receives a request to display an image of the plurality of user-provided images stored in the image data store via a network.
The requested user-supplied image is segmented to identify multiple image segments within the requested image.
Each of the plurality of image segments is processed to identify the plurality of products displayed in the user-provided image.
At least one of the plurality of products displayed in the user-provided image is matched with a corresponding product provided for sale by one seller of the plurality of independent sellers.
Sellers of multiple independent sellers who are associated with at least one of the products displayed in the user-provided image requested by the user's client device over the network and who sell at least one product. Provide an image presentation containing seller information to identify
In order to purchase at least one product from the seller of at least one product, the request is received from a client device operated by a user via a network.
The purchase of the user required for the management service to complete the purchase of at least one product with the seller on behalf of the user, as if the request was received directly by the seller independent of the management service. Get information ,
Receive a purchase confirmation from the seller via the network confirming that the purchase of at least one individual item has been completed.
A computer-readable storage medium that causes the client device of the user to send a notification that the purchase of at least one product from the seller has been completed. The instructions also give at least to the processor.
The seller receives a product catalog displaying a plurality of products that can be sold by the seller via a network, and the seller also sells each of the plurality of products directly and independently of the management service. , The non-temporary computer-readable storage medium according to claim 7. The instructions also give at least to the processor.
The non-temporary computer-readable storage medium according to claim 8, wherein periodic updates of the product catalog are received from the seller via a network so that each stock quantity of the plurality of products is up-to-date. The instructions also give at least to the processor.
A reservation request is made to the seller over the network to respond to the receipt of the request from the user and reserve a unit of at least one product for use in executing the purchase of at least one product of the user. The non-temporary computer-readable storage medium according to claim 7, which is to be transmitted. The instructions also give at least to the processor.
The non-temporary computer-readable storage according to claim 7, wherein the product variant information corresponding to at least one product is acquired via a network in response to receiving a request to purchase at least one product from the user. Medium. The non-transitory computer-readable storage medium of claim 11, wherein the product variant information is periodically received from the seller via a network and managed by a management service. The instructions also give at least to the processor.
A product catalog containing product information of each of a plurality of products provided by the seller for sale to the user is received from the seller via the network through the management service.
For each of the plurality of products, the product is provided for direct sale by the seller independently of the management service, and the product information includes a display image of the product and a source associated with the product. Contains at least one location identifier, or product variant information,
The non-temporary computer-readable storage medium according to claim 7, wherein the product catalog is stored in the product catalog data store managed by the management service. The instructions also give at least to the processor.
Using one or more image processing algorithms, the image data store managed by the management service is made to process the plurality of user-provided images managed.
For each of the multiple images mentioned above,
The feature vector display of the product displayed in the image is determined, and the display is determined.
The feature vector is compared with the stored feature vector managed in the product catalog data store.
The product and the seller of the product are determined based on at least some comparisons.
The non-temporary computer-readable storage medium according to claim 7, wherein the image is associated with the seller of the product and the war memorial product. The instructions also give at least to the processor.
In presenting the image requested to the user, the purchase control of at least one of the plurality of products displayed in the requested image is included, and the purchase control is selectable by the user and is said to be sold. The non-temporary computer-readable storage medium of claim 7, which initiates a request from a person to purchase at least one product. A computing system that implements management services at run time
With one or more processors
It is connected to the one or more processors and has a memory for storing program instructions.
When the one or more processors are executed, the one or more processors
Holds an image data store that stores multiple images provided by the user,
Product information for a plurality of products provided for sale by a seller through the management service, sold directly by the seller, and independent of the management service, from one or more sellers via a network. Receive,
The product information of the plurality of products is stored in the product catalog data store managed by the management service.
A plurality of users including a display of a plurality of products stored in the image data store via a network from a first user operating a client device and provided for sale by one or more sellers. A request to display the provided image is received, and the requested user-provided image is provided to the image data store by a second user.
The requested user-provided image is segmented, and the requested user-provided image is specified in a plurality of image segments.
Each of the plurality of image segments is processed to match the goods in the image segments with the goods offered by the sale of one or more sellers.
The presentation of the user-provided image requested to the client device of the first user via the network, and the presentation including the product information corresponding to each of the products displayed in the requested user-provided image. To provide,
In order to purchase the product displayed in the requested user-provided image, the request is received from the client device of the first user via the network.
Acquire purchase information corresponding to the first user and the product,
Having the seller send the purchase information over the network so that the seller can complete the purchase of the first user's goods as if the seller had received the request directly.
The first user is made to receive a purchase confirmation from the seller via the network to confirm that the purchase of the product is completed.
A computing system that causes a client device of a first user to send a notification that the purchase of a product from the seller is completed via a network. 16. The computing system of claim 16, wherein the one or more processors further retains merchandise information for a plurality of merchandise provided for sale by the plurality of sellers independent of the management service. 16. The one or more processors further receive product variant information from the seller over a network that identifies at least one of the price of the product, the size of the product, or the color of the product. The computing system described in. The purchase request for the goods includes the display of payment credentials used to process the payment for the goods.
The purchase information is sent to the seller over the network via the payment credential vault that manages the payment credentials.
16. The computing system of claim 16, wherein the purchase information comprises a unique payment token provided by the payment credential vault as an indication of the payment credential. The purchase request for the goods includes the display of payment credentials used to process the payment for the goods.
The one or more processors
Determine the payment token to display the payment credential and
Including the payment token in the purchase information
16. The computing system of claim 16, wherein the transmission of the purchase information transmits a payment token to the seller over a network.

Images