JP2011123741A - Sample providing device and promotion development system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a sample providing device and a promotion development system, for improving the efficiency of work when displaying a composite image on a display unit. <P>SOLUTION: A marker displayed on a sample article stored in the sample providing device is used to associate sample image data representing a virtual object comprising a three-dimensional model like a package of the sample article, with a marker ID indicating the stored sample article, thereby the virtual object of the package of the sample article is displayed over an image of a box of the sample article, on which the marker ID is displayed, by recognizing the box in a captured image. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a sample providing apparatus and a promotional deployment system that provide sample products and provide the sample products.

There is a display device that uses a technology called augmented reality in order to synthesize and display a virtual space image that has been created in advance with an image in real space that is captured by an imaging device such as a camera ( For example, see Patent Document 1).
The display device obtains identification information predetermined for the index object based on a specific index object imaged from the real space, and synthesizes a composite image corresponding to the identification information with an image in the real space. indicate.

  When such display is performed, a necessary composite image is created in advance by a computer or the like, and the composite image is transmitted from the computer to the display device and stored in a storage unit in the display device. When a synthesized image is synthesized with an image to be synthesized, the synthesized image corresponding to the identification information is read from the storage unit in the display device, synthesized, and displayed.

JP 2003-256876 A

  However, when the types of index objects increase, it is necessary to prepare a number of composite images corresponding to the index objects. In this case, since a composite image corresponding to the type of the newly added index object is stored manually in the storage unit of the display device, there is a problem that the operation becomes complicated.

  The present invention has been made in consideration of such circumstances, and has been made to solve the above-described problem. The object of the present invention is to provide a sample providing apparatus for improving work efficiency when displaying a composite image on a display unit. And providing a promotional deployment system.

  In order to solve the above-described problem, a sample providing apparatus according to the present invention captures a sample product box on which a marker is displayed and an optical image by an optical system and generates captured image data. A display unit for displaying an image based on the captured image data, image processing on the captured image data, and pre-assigned to the marker from captured image data generated based on an optical image including the marker An image processing unit that obtains first identification information, and obtains marker form information representing at least one of a position, a size, and a posture of the marker in the screen of the imaging screen data, and the first identification A storage unit that stores information associating information with second identification information representing composite image data to be combined with the captured image data; and the image When the first identification information is obtained by the physical unit, based on the first identification information, referring to the storage unit, the composite image data indicated by the associated second information is obtained, A control unit that causes the display unit to display an image synthesized by superimposing the combined image data corresponding to the marker form information on the captured image data for an image region representing the marker in the captured image data; It is characterized by providing.

  The sample providing apparatus according to the present invention further includes a communication unit that communicates with a management server connected via a network, and the control unit obtains the first identification information by the image processing unit. A message requesting transmission of the composite image data corresponding to the first identification information is transmitted to the management server via the communication unit, and the image data is added to the composite image data received via the communication unit. The first identification information corresponding to is stored in a storage unit in association with each other.

  In addition, the sample providing apparatus according to the present invention further includes a time measuring unit that measures the current date and time, and the storage unit is a time in which the first identification information is effective for the first identification information. Date and time information representing a band is stored in association with each other, and the control unit refers to the storage unit based on the current date and time counted by the time unit, and the date and time information stored in the storage unit is , It is determined whether or not the date and time measured by the timing unit is past, and if the date and time information stored in the storage unit is in the past, it is associated with the date and time information The information is deleted from the storage unit.

  Further, in the sample providing device according to the present invention, the storage unit stores the first identification information in association with store information representing a store where the sample providing device is installed, and the control unit includes: When the information is received from the management server, it is determined whether or not the received information includes a store number different from the store number stored in the storage unit, and the store stored in the storage unit When the store number different from the number is included in the information received from the management server, the received information is not stored in the storage unit.

In order to solve the above problem, a promotion distribution system according to the present invention is a promotion deployment system including a sample providing device and a management server connected to the sample providing device via a network, and the management server Stores information for associating the second identification information representing the composite image data with the first identification information assigned in advance to the marker displayed on the sample product provided by the sample providing device. 1 storage unit and a first communication unit that communicates with the sample providing apparatus via the network, the sample providing apparatus including a container for storing a sample product box on which the marker is displayed; A second communication unit that communicates with the management server via the network;
An imaging unit that captures an optical image by an optical system and generates captured image data; a display unit that displays an image based on the captured image data; and image processing the captured image data to obtain an optical image including the marker First identification information assigned in advance to the marker is obtained from the captured image data generated based on the image, and at least one of the position, size, and orientation of the marker in the screen of the imaging screen data is obtained. An image processing unit that obtains marker form information to be represented; a storage unit that stores information that associates the first identification information with second identification information representing composite image data that is combined with the captured image data; When the first identification information is obtained by the image processing unit, the first identification information is associated with the first identification information by referring to the storage unit. An image obtained by superimposing the composite image data corresponding to the marker form information on the captured image data with respect to the image region representing the marker in the captured image data. The control unit of the sample providing apparatus, when the first identification information is obtained by the image processing unit, the synthesis corresponding to the first identification information A message requesting transmission of image data is transmitted to the management server via the communication unit, and the composite image data received via the communication unit is associated with the first identification information corresponding to the image data. And storing it in a storage unit.

  ADVANTAGE OF THE INVENTION According to this invention, the sample provision apparatus and promotion expansion | deployment system for improving the working efficiency at the time of displaying a synthesized image on a display part can be provided.

It is the schematic for demonstrating an example of the promotion expansion | deployment system which concerns on this Embodiment. It is a block diagram for demonstrating an example of a structure of the control system of the promotion expansion system which concerns on this Embodiment. It is a reference figure for demonstrating an example of the box of the sample goods accommodated in the sample provision apparatus which concerns on this Embodiment, and the marker code displayed on this. It is the schematic for demonstrating an example of the sample determination information memorize | stored in the memory | storage part which concerns on this Embodiment. It is the schematic for demonstrating an example of the user registration information memorize | stored in the memory | storage part which concerns on this Embodiment. It is the schematic for demonstrating an example of the reading history information memorize | stored in the memory | storage part which concerns on this Embodiment. It is the schematic for demonstrating an example of the sample registration information memorize | stored in the memory | storage part which concerns on this Embodiment. It is a reference figure for demonstrating an example of the display screen displayed on the sample provision apparatus which concerns on this Embodiment. It is a reference figure for demonstrating an example of the flow of member registration for allocating member ID utilized with the promotion expansion | deployment system which concerns on this Embodiment. It is a reference figure for demonstrating an example of the utilization flow of the promotion expansion | deployment system which concerns on this Embodiment. It is a reference figure for demonstrating an example of the display screen displayed on the operation part of the sample provision apparatus which concerns on this Embodiment. It is a reference figure for demonstrating the other example of the display screen displayed on the operation part of the sample provision apparatus which concerns on this Embodiment. It is a flowchart for demonstrating an example of the processing flow of the sample goods provision process in the sample provision apparatus which concerns on this Embodiment. It is a flowchart for demonstrating an example of the processing flow of the sample registration information creation process in the sample provision apparatus which concerns on this Embodiment. It is a flowchart for demonstrating an example of the processing flow of the display control process in the sample provision apparatus which concerns on this Embodiment.

[First Embodiment]
FIG. 1 is an overview diagram illustrating a promotion development system 100 according to the present embodiment.
As shown in FIG. 1, the promotion development system 100 includes a sample providing device 1, a storefront display device 2, and a management server 3.

  The sample providing device 1 is communicably connected to the storefront display device 2 and is communicably connected to the management server 3 via the network 4. The sample providing device 1 and the storefront display device 2 are arranged, for example, in a store, and a product shelf 5 is installed in the vicinity thereof.

  Specifically, the sample providing apparatus 1 includes a sample providing apparatus display 101, a reading unit 102, an operation unit 103, a sample display unit 104, and a sample outlet 105.

  The sample providing device display 101 is disposed in an upper part of the sample providing device 1 and is, for example, a digital signage (Digital Signage) used as an advertising medium for displaying video, audio, information, and the like. Output audio.

The reading unit 102 reads a unique ID from a medium holding information on a unique unique ID (Identity Document).
This unique ID is unique identification information different from each other. For example, a unique ID assigned to a user who has been registered in advance is referred to as a member ID. A unique ID arbitrarily assigned to an unspecified user is referred to as a trial ID.

  Examples of the medium that holds this unique ID include a medium on which a two-dimensional code including information representing an encrypted unique ID is printed, and a mobile phone that displays the two-dimensional code on a display unit. Further, it is possible to use an IC tag including an IC chip in which a unique ID is stored, a non-contact type IC card having a built-in IC chip, a mobile phone, or the like.

  The reading unit 102 includes, for example, a two-dimensional code reading unit 102a that reads a unique ID included in a two-dimensional code by photographing a two-dimensional code printed on a medium, and a non-contact IC card And a wireless reading unit 102b that reads a unique ID stored in the IC chip by wirelessly communicating with the IC tag.

  The operation unit 103 has a display screen that receives an operation from the user and outputs operation information corresponding to the operation and displays an operation screen. The operation unit 103 can use, for example, a touch panel, displays an operation screen showing operation buttons, messages, and the like as a video and receives an operation instruction from the operation screen.

  The sample display unit 104 is arranged so that sample commodities accommodated in the sample providing device 1 or models similar to the sample commodities can be seen from the outside. In the sample display unit 104, a transparent protective plate or the like is attached to the arranged products and the like so that the arranged sample products and the like are not soiled or taken out from the outside. In the present embodiment, the product A is arranged side by side on the left side, the product B is in the center, and the product C is on the right side.

  The sample take-out port 105 is a discharge port for sample products provided from the sample providing device 1, and is a portion from which, for example, sample products selected by the user via the operation unit 103 are discharged and sample products are taken out by the user. .

  The storefront display device 2 is digital signage that is used as an advertising medium that outputs video, audio, information, and the like, for example. For example, the storefront display device 2 is communicably connected to the sample providing device 1 and outputs video, audio, and the like output from the sample providing device 1.

  The management server 3 is connected to the sample providing apparatus 1 via the network 4 and communicates with the sample providing apparatus 1.

The merchandise shelf 5 is a shelf for displaying merchandise, and for example, the display portion is divided into four parts: an uppermost stage, an upper stage, a lower stage, and a lowermost stage. In the present embodiment, a product A is displayed on the top and top of the product shelf 5, a product B is displayed on the bottom, and a product C is displayed on the bottom. Further, in the present embodiment, different products are placed on each stage of the product shelf 5, but a plurality of types of products may be displayed in the same stage, or even only one type of product. May be displayed.
The product shelf 5 and the storefront display device 2 may be integrally formed, and the storefront display is displayed on a storage portion provided in the product shelf 5 formed in a size that covers the storefront display device 2. The device 2 may be fitted and accommodated.

Next, the configuration of the control system of the promotion development system 100 will be described in more detail with reference to FIG. FIG. 2 is a block diagram illustrating an example of the configuration of the control system of the promotion development system 100.
As shown in FIG. 2, in addition to the above-described configuration, the sample providing apparatus 1 includes an imaging unit 106, an image processing unit 107, a storage unit 108, a control unit 109, a communication unit 110, a lottery unit 111, A sample discharge driving unit 112, a sample storage unit 113, and a time measuring unit 114 are further provided.

  The imaging unit 106 captures an optical image incident through the lens, generates captured image data, and outputs the captured image data to the image processing unit 107. The imaging unit 106 is, for example, a small camera or the like, and images a user or the like near the position where the operation unit 103 can be operated in front of the sample providing apparatus 1. For example, the imaging unit 106 captures a moving image including a plurality of continuous images, and the captured image data includes a moving image including a plurality of continuous images.

  The image processing unit 107 performs image processing on the captured image data input from the imaging unit 106 and determines whether or not a marker code is included in the optical image captured by the imaging unit 106.

  As shown in FIG. 3, this marker code is a marker printed on the surface of a sample product box provided by the sample providing device 1 (in other words, the position, orientation, and position of the sample product in the captured image data). An object teaching index indicating a size), and a predetermined unique marker ID is assigned to this marker. That is, the marker code includes information representing the encrypted marker ID. For example, the marker code is obtained from the image data obtained by photographing the marker code by a device having a function of analyzing the marker code, such as the image processing device 107. ID is extracted. Since this sample product includes products of various shapes and sizes, the sample product can be automatically provided to the user via the sample providing device 1 by being enclosed in a certain box. .

In the present embodiment, as shown in FIG. 3, the marker code includes a marker position portion indicating the position of the marker code, a marker direction portion indicating the direction of the marker code, and a marker ID portion indicating the marker ID.
This marker position portion is, for example, a square frame having a uniform width.
For example, the marker direction portion is located inside the frame of the marker position portion and in the vicinity of one corner of the square.
For example, the marker ID portion is located inside the frame of the marker position portion and near the center of the square.

Further, the image processing unit 107 performs image processing on the captured image data to obtain information (hereinafter referred to as marker form information) representing the position, size, posture (orientation), etc. of the marker code.
Specifically, the image processing unit 107 obtains information representing the posture (orientation) of the box of the sample product on which the marker code is displayed based on the distortion of the square of the marker position portion, and the marker position portion. Based on the size of the square, information representing the size of the sample product box, that is, the relative distance between the sample product box on which the marker code is displayed and the sample providing device 1 is obtained. Further, the image processing unit 107 obtains information representing the vertical and horizontal directions determined in advance for the sample product box based on the marker direction part. Furthermore, the image processing unit 107 obtains a marker ID of the marker code based on the marker ID unit.

  Returning to FIG. 2, the storage unit 108 includes sample determination information 181, user registration information 182, reading history information 183, sample registration information 184, content data 185, sample image data 186, and attached image data 187. And remember.

As shown in FIG. 4, the sample determination information 181 is determined according to the unique ID, the determination condition indicating the condition for permitting the provision of the sample product, and the provision of the sample product is permitted based on the determination condition. This is information for associating sample product information indicating sample products provided in the case with content numbers representing content data. This content number is identification information for identifying each of the plurality of content data included in the content data 185.
The sample determination information 181 includes different tables depending on the type of unique ID (for example, member ID or trial ID).

When the type of the unique ID is a trial ID, as shown in FIG. 4A, a determination condition according to a lottery result or a distribution period and sample product information are associated with the unique ID. The unique ID here is, for example, a unique ID (trial ID) read by the two-dimensional code reading unit 102a, and is given a number such as QR-1xxx.
For example, the unique ID “QR-11xxx” (ie, “QR-11000” to “QR-11999”) is associated with the determination condition “winning by lottery” as a condition for providing sample products. As the sample product information, “selected sample product” is associated.

On the other hand, when the type of the unique ID is a member ID, as shown in FIG. 4B, the sample product information is associated with the determination condition corresponding to the user information represented by the unique ID read by the reading unit 102. .
This user information is information associated with a unique ID in user registration information 182 (described later in FIG. 5). For example, information indicating the user's “gender” or “age”, and information on each user. “History information” indicating the past reading situation of the assigned unique ID is included.
The sample determination information 181 in the case of the member ID is referred to by the control unit 109 together with user registration information 182 to be described later, and based on the unique ID read by the reading unit 102, the corresponding determination information and sample product information It is determined whether or not there is.

  As shown in FIG. 5, the user registration information 182 includes a user ID assigned to a member registered as a member of the unique ID, and includes the gender, age, history information, etc. of the user to whom the member ID is assigned. It is information that associates information. These pieces of user information are information registered by the user when the user who is given the member ID performs member registration, for example. A detailed description of member registration will be described later with reference to FIG.

As illustrated in FIG. 6, the reading history information 183 is information that associates history information with a lottery result with a unique ID.
The history information is the same information as the history information included in the user registration information 182.

  In the sample registration information 184, as shown in FIG. 7, the marker ID includes a sample image number indicating sample image data, an attached image number indicating attached image data, a product number indicating a sample product, and the use of the marker ID. This is information that associates date and time information representing a valid time zone with a store number representing a store where the marker ID is used.

This sample image number is a number assigned to each of the plurality of sample image data included in the sample image data 186 to identify each sample image data.
The attached image number is a number assigned to each of the plurality of attached image data included in the attached image data 187 for identifying each of them.
The content number is a number assigned to each of the plurality of content data included in the content data 185 to identify each of the content data.
The date and time information is, for example, a promotion implementation period in which sample products are provided using the sample providing device 1.
The store number is identification information assigned to identify each of a plurality of stores, and the store number assigned to the store where the sample providing apparatus 1 is installed is stored in the storage unit 108.

Returning to FIG. 2, the control unit 109 comprehensively controls the sample providing apparatus 1. For example, a sample product providing process, a sample registration information creating process, and a display control process as will be described later with reference to FIGS. 13 to 15. I do.
For example, the control unit 109 performs sample registration information creation processing in a setting mode that is activated when a sample product is stored in the sample storage unit 113 by an attendant. In this setting mode, for example, when the control unit 109 detects that the door covering the sample storage unit 113 or the like has been opened by using a sensor or the like, or the setting mode is designated by the staff via the operation unit 103. It starts when it is done.

  In addition, when the setting mode ends, the control unit 109 shifts to the sample providing mode, and performs sample product providing processing and display control processing. The end of this setting mode is, for example, when the control unit 109 detects that the door covering the sample storage unit 113 or the like has been closed, or through the operation unit 103. Is terminated if is specified by the attendant.

(Sample product provision processing)
The control unit 109 determines whether the unique ID read by the reading unit 102 satisfies the determination condition based on the sample determination information 181 stored in the storage unit 106. When the unique ID satisfies the determination condition, the control unit 109 sends the sample product indicated in the sample product information associated with the unique ID or the sample product selected by the user to the sample outlet 105. The sample discharge driving unit 110 is driven to discharge.

  In the determination condition corresponding to the unique ID read by the reading unit 102, the control unit 109 determines that “winning” in the lottery result is set as a condition for providing the sample product, To run a lottery. When the lottery result is input from the lottery unit 111, the control unit 109 stores the lottery result in the reading history information 183 of the storage unit 108 in association with the unique ID.

  In addition, the control unit 109 determines the determination result in the sample providing process (for example, the product number or name of the provided sample product or the marker ID read by the reading unit 102), the time when the unique ID was read, and user information Are stored in the reading history information 183 stored in the storage unit 106 in association with the unique ID.

(Sample registration information creation process)
When the marker code is detected from the captured image data by the image processing unit 107 in the setting mode, the control unit 109 obtains the marker ID included in the marker code from the image processing unit 107. Based on the obtained marker ID, the control unit 109 transmits a message requesting transmission of sample image data of the sample product represented by the marker ID to the management server 3 via the communication unit 110. For example, the control unit 109 transmits a message requesting transmission of sample image data in association with a marker ID.

When receiving the sample image data from the management server 3, the control unit 109 stores the sample image number indicating the sample image data in the sample registration information 184 of the storage unit 108 in association with the marker ID.
When the control unit 109 receives, from the management server 3, attached image data, product number, date / time information, and store information associated with the marker ID, the attached image number and product number indicating the attached image data. The date information and the store information are stored in the sample registration information 184 of the storage unit 108 in association with the marker ID.

  The control unit 109 receives information associated with a store number different from the store number stored in the storage unit 108 of the information received from the management server 3 (for example, sample image data, attached image data, product number, Such as date / time information), the information is deleted without being stored in the sample registration information 184.

In addition, the control unit 109 refers to the sample registration information 184 based on the current date and time measured by the time measuring unit 114, and the date and time information in the sample registration information 184 is recorded on the date and time It is determined whether or not it is past the time. When the date / time information in the sample registration information 184 is in the past, the control unit 109 deletes the information associated with the date / time information from the sample registration information 184.
When the operation information for deleting the information corresponding to the designated marker ID is input from the sample registration information 184 from the operation unit 103, the control unit 109 deletes all the information associated with the marker ID. delete.

(Display control processing)
In the sample providing mode, when the marker ID is obtained by the image processing unit 107 based on the captured image data in the sample providing mode, the control unit 109 refers to the sample registration information 184 and the sample image data 186 based on the marker ID. The sample image data corresponding to is obtained.
The control unit 109 controls the display form of the obtained sample image data based on the marker form information obtained by the image processing unit 107, and displays the sample image data on the captured image data generated by the imaging unit 106. Are superimposed on each other and displayed on the sample providing apparatus display 101.

More specifically, the control unit 109 creates a composite image corresponding to the movement of the marker code displayed in the captured image data using a technique called augmented reality, and the sample providing apparatus display 101. To display.
For example, based on the marker form information obtained by the image processing unit 107, the control unit 109 follows the movement of the sample product box being moved in the real space, and the sample image data displayed in the virtual space moves. Composite image data obtained by combining an image with captured image data is created and output to the sample providing apparatus display 101. This augmented reality technology is realized, for example, by storing software that implements this technology in the storage unit 108 and causing the control unit 109 to execute this software.

More specifically, with reference to FIG. 8, in the sample provision mode, when a user with a sample product box is imaged by the imaging unit 106, the user and the sample product box are displayed as illustrated. The marker code is included in the captured image data.
The image processing unit 107 performs image processing on the captured image data to obtain a marker ID included in the marker code, and obtains marker form information indicating the position, size, and orientation of the marker code. And the marker form information are output to the control unit 109.

Based on the input marker ID and marker form information, the control unit 109 controls the sample image data so as to rotate, move, change the magnification, and the like so as to rotate, move, and change the magnification of the virtual object made of the sample product box. In the image data screen, the sample image data indicating the virtual object of the sample product box corresponding to the position, size, and orientation of the marker code is superimposed and synthesized on the portion where the marker code is displayed. When the synthesized image data is displayed on the sample providing device display 101, for example, as illustrated, the sample image data is displayed in the marker code portion of the sample product held by the user.
Here, an example in which sample image data representing a package of sample products is displayed is shown.

Further, in the sample registration information 184, when the attached image data is associated with the marker ID obtained by the image processing of the image processing unit 107, the control unit 109 synthesizes the attached image data on the captured image data. Then, it is displayed on the sample providing apparatus display 101. Thus, as shown in the figure, around the sample product, for example, the product name of the sample product (for example, OO curry), a appeal message (for example, product component, calorie off, banana recommended for hidden taste, etc.), product Price (xxx circle) and an image (for example, cooking image, character, animation, etc.) are displayed.
In addition, the attached image data may be, for example, an animation movie that is given a movement such as a scroll popping out of a bag, the scroll being opened, and texts and pictures written on the scroll appear. The size of the displayed character may change, or an image such as a character may move.

  Returning to FIG. 2, the communication unit 110 is communicably connected to the management server 3 via the network 4 and is communicably connected to the communication unit 201 of the storefront display device 2 to transmit information.

  The sample discharge driving unit 111 is driven based on the determination result in the sample providing process by the control unit 109, and the sample product determined by the control unit 109 from the sample storage unit 113 that stores each sample product for each sample product. Is discharged to the sample outlet 105.

The sample storage unit 113 is configured to be stored in a storage space by being inserted from a storage port by a staff member, for example. For example, each storage space stores a box of sample products containing the same type of sample product, and the sample discharge drive unit 111 opens the outlet of the sample storage unit 113 to store the sample product. Are discharged to the sample outlet 105 one by one.
For example, the sample product box is formed in a shape to be accommodated in the sample accommodating portion 113, and even when sample products having different sizes and shapes are accommodated, the size accommodated in the sample accommodating portion 113. It is preferable to be put in a box formed in the same shape. Accordingly, sample products having different sizes and shapes can be stored in the sample storage unit 113, and the marker position portion of the marker code displayed on the sample product box can be made to have a certain shape and size.

  The clock unit 114 counts the current date and time, and outputs the clocked information to the control unit 109.

The storefront display device 2 includes a communication unit 201, a control unit 202, and a product shelf display 203.
The communication unit 201 is communicably connected to the sample providing apparatus 1.
The control unit 202 receives a control signal and content data from the sample providing apparatus 1 via the communication unit 201. The control unit 202 causes the product shelf display 203 to output video and audio based on the content data received based on the control signal from the sample providing device 1.
The merchandise shelf display 203 is, for example, a liquid crystal display or the like, and is controlled by the control unit 202 to output video and audio based on content data.

The management server 3 includes a communication unit 301, a storage unit 302, and an operation unit 303.
The storage unit 302 uses a marker ID as a sample image number indicating sample image data, an attached image number indicating attached image data, a product number indicating a sample product, and a date and time indicating a time zone in which the marker ID is valid. Information that associates information with a store number representing a store where the marker ID is used is stored.
When the communication unit 301 receives a message requesting information stored in the storage unit 302 such as sample image data from the sample providing apparatus 1, the communication unit 301 stores information associated with the marker ID associated with the message. The information is read from the unit 302, and the marker ID is associated with the read information and returned to the sample providing apparatus 1.
The operation unit 303 accepts an operation input from an administrator or the like who manages the management server, accepts an operation input such as rewriting, changing, adding, or overwriting information stored in the storage unit 302 and is stored in the storage unit 302. Change or create information.

Next, an example of a process for displaying a two-dimensional code including a member ID as a unique ID on the display unit of the mobile phone of the registered user will be described with reference to FIG.
As shown in FIG. 9, the user's mobile phone reads a two-dimensional code including a mail address of a transmission destination to which a mail requesting member registration is transmitted by using a function built in the user.
For example, the mobile phone transmits, to the site server specified by the mail address, an empty mail that includes the mail address as a destination and does not include any information in the body of the message.

Based on the received mail, the site server returns a temporary registration mail in which a URL (uniform resource locator) specifying a site for performing member registration is described to the mobile phone.
This mobile phone accesses the URL described in the received temporary registration mail, and information necessary for membership registration (for example, user name, age, gender, residential area, mobile phone number and mail address, etc.) ) To the site server.
When the site server performs processing for authenticating the member registration based on the received information and determines that the information valid for the member registration is received, the site server assigns a unique member ID to the user and assigns the member ID to the member ID. The received information is associated and stored in the storage unit provided in the site server.
This completes member registration.

  Here, for example, when an email requesting the provision of a sample product by the sample providing device 1 is transmitted from the mobile phone to the site server, the two-dimensional code including the member ID associated with the email address of the mobile phone Is created by the site server and sent to the mobile phone. Thereby, the two-dimensional code including the member ID is displayed on the mobile phone.

  However, the present invention is not limited to this, and a configuration may be adopted in which a two-dimensional code including a unique member ID is distributed from the site server to the member's mobile phone in accordance with the start time of the campaign. .

Next, an example of promotion development using the sample providing device 1 will be described with reference to FIG.
In this promotion, the sample providing device 1 is used to notify the provision of the sample product, and the sample providing device 1 is used to provide the sample product to the user having the two-dimensional code including the unique ID and the IC tag. Is.
In addition, by attaching a marker code to the sample product to be provided, a composite image using augmented reality technology is displayed on the sample providing device display 101 according to each sample product, and functional information and related information regarding each sample product are displayed. Etc. to appeal to the user.

First, in accordance with the promotion period, on the flyer of the store where the sample providing device 1 is set, the web page of the store, etc., the two-dimensional code posted on the flyer or web page, or membership registration We will announce that you can receive sample products by bringing the two-dimensional code and IC tag obtained by
As a result, in addition to customers who go to the store on a regular basis, it is expected that customers who intend to provide sample products will be attracted to the store.

On the other hand, during the promotion period, the sample providing apparatus 1 is installed at the storefront, and for example, a poster that indicates a two-dimensional code (see the description with reference to FIG. 8) for announcement of the promotion and member registration. Etc. are posted on the storefront.
This allows a user who has not yet registered as a member to read the two-dimensional code written on the poster and prompt the user to register as a member.

Moreover, the user who brought the leaflet can cause the sample providing apparatus 1 to execute the sample product providing process by causing the two-dimensional code reading unit 102a to read the two-dimensional code printed on the leaflet.
On the other hand, a user who has registered a member in advance or a user who has registered as a member also allows the two-dimensional reading unit 102a to read a two-dimensional code including the member ID, or an IC tag that stores the member ID Can be read by the wireless reading unit 102b to allow the sample providing apparatus 1 to execute the sample product providing process.

  However, the present invention is not limited to this, a two-dimensional code including a trial ID is temporarily displayed on a member card possessed by a registered user, or a two-dimensional code including a trial ID is displayed on a mobile phone. An e-mail magazine may be transmitted to display the two-dimensional code on the display unit of the mobile phone. The user can cause the sample providing apparatus 1 to execute a sample product providing process using these two-dimensional codes.

  In addition, when the member ID of the user who received the sample product is transmitted from the sample providing device 1 to the site server, the site server sends the email address of the mobile phone associated with the member ID to the site server. You may send the mail for inputting the answer to a questionnaire and making it return to a server. Thereby, it is possible to carry out the impression and actual condition survey of the user who received the sample product by the sample providing device 1, and associate the member ID with the questionnaire result and store it in the storage unit of the site server.

  Next, with reference to FIG. 11, an example of a user operation method for receiving a sample product from the sample providing device 1 will be described. FIG. 11 illustrates an example in the case where a unique ID associated with a determination condition that is determined in advance to provide a sample product according to the lottery result is read in the sample determination information 181. FIG.

As shown in FIG. 11, on the display screen of the operation unit 103 of the sample providing apparatus 1, a message indicating that sample products are being provided, as shown in the screen SC1, and the display of the operation unit 103 to the user A message prompting you to touch the screen is displayed.
Here, when the user touches the display screen of the operation unit 103, a message prompting the reading of the unique ID by the two-dimensional code or the IC tag is displayed as shown on the screen SC2.

When the user holds the two-dimensional code or IC tag over the two-dimensional code reading unit 102a or the wireless reading unit 102b, the two-dimensional code reading unit 102a or the wireless reading unit 102b reads the unique ID and outputs it to the control unit 109. Based on the input unique ID, the control unit 109 refers to the sample determination information 181 to determine whether or not it is a unique ID for providing a sample product, and performs a lottery in providing the sample product. It is determined whether or not.
When it is determined that the ID is a unique ID for lottery, a lottery screen showing a plurality of options (for example, A to D) in the lottery is displayed on the display screen of the operation unit 103 as shown on the screen SC4. Is done. When any one of the options is selected (touched) by the user via the operation unit 103, the lottery unit 111 performs lottery based on the touched option and outputs the lottery result to the control unit 109. To do.

When the lottery result is “winning”, a message for notifying the winning as shown in the screen SC5 is displayed on the display screen of the operation unit 103, and then the sample providing apparatus 1 as shown in the screen SC6 is displayed. A selection screen for selecting one of the stored sample products A to C is displayed.
When one of the sample products A to C displayed on the selection screen is selected (touched) by the user via the operation unit 103, the control unit 109 drives the sample discharge driving unit 112 to be touched. The sample product is discharged to the sample outlet 105.

  Then, as shown in the screen SC7, the operation unit 103 displays on the display screen a message indicating that the sample product has been discharged from the sample outlet 105 and a message prompting the user to take out the sample product from the sample outlet 105. To do.

  On the other hand, when the lottery result is “missing”, the display screen of the operation unit 103 displays a message for notification of losing as shown on the screen SC8, and subsequently, for example, an advertisement or the like as shown on the screen SC9. A screen displaying is displayed.

  Next, with reference to FIG. 12, another example of a user operation method for receiving provision of sample merchandise from the sample providing device 1 will be described. FIG. 12 illustrates an example in which a unique ID associated with a determination condition that is determined to provide a sample product is read regardless of the lottery result in the sample determination information 181. FIG. In addition, the same code | symbol is attached | subjected to the screen similar to the screen demonstrated using FIG. 11, and detailed description is abbreviate | omitted.

  As shown in FIG. 12, a screen as shown on the screen SC1 is displayed on the display screen of the operation unit 103 of the sample providing apparatus 1, and then a unique ID by a two-dimensional code or an IC tag as shown on the screen SC2. A message prompting you to read is displayed.

Here, when the unique ID is read by the two-dimensional code reading unit 102a or the wireless reading unit 102b, the control unit 109 refers to the sample determination information 181 and provides sample products based on the read unique ID. It is determined whether or not it is a unique ID to be performed.
Here, when it is determined that the read unique ID is a unique ID for providing a sample, the sample accommodated in the sample providing apparatus 1 as shown in the screen SC6 is displayed on the display screen of the operation unit 103. A selection screen for selecting one of the products A to C is displayed.
When one of the sample products A to C displayed on the selection screen is selected (touched) by the user via the operation unit 103, the control unit 109 drives the sample discharge driving unit 112 and is touched. The sample product is discharged to the sample outlet 105, and the operation unit 103 displays a screen as shown in the screen SC7.

Next, with reference to FIG. 13, the processing flow of the sample product provision processing will be described. FIG. 13 is a flowchart illustrating an example of a processing flow of sample product providing processing.
As shown in FIG. 13, when the control unit 109 is in the sample provision mode, when the unique ID is read by the two-dimensional code reading unit 102a or the wireless reading unit 102b (step ST1), the control unit 109 is read. Based on the unique ID, the sample determination information 181 is referred to and it is determined whether or not the unique ID is used for lottery in the provision of the sample product (step ST2).

  For example, when the unique ID “QR-21001” is read by the two-dimensional code reading unit 102a, the control unit 109 refers to the sample determination information 181 and is associated with the unique ID “QR-21001”. Get judgment conditions. As the determination condition, as shown in FIG. 4A, the first unique ID read in the distribution period is a condition for permitting the provision of the sample product.

  Therefore, the control unit 109 determines that the unique ID “QR-21001” is not a unique ID for lottery in the provision of the sample product (step ST2-NO), and based on the read unique ID “QR-21001” With reference to the determination information 181, it is determined whether or not the ID is a unique ID for providing a sample product (step ST 3).

  Specifically, the control unit 109 refers to the reading history information 183 and confirms that the reading history information associated with the unique ID “QR-21001” has been provided as a sample product within the distribution period. It is determined whether or not the information is information to be represented. In the reading history information 183, when the unique ID “QR-21001” is not stored, or the reading history information associated with the unique ID “QR-21001” is provided within the distribution period. When it is determined that the information does not represent that, the control unit 109 determines that the unique ID “QR-21001” is the unique ID that provides the sample product (step ST3-YES).

  The control unit 109 refers to the sample determination information 181 stored in the storage unit 106 and is indicated in the sample product information associated with the unique ID “QR-21001” read by the reading unit 102. The sample discharge driving unit 110 is driven to discharge the sample product A being discharged to the sample outlet 105 (step ST4). As a result, the sample product A is discharged to the sample outlet 105.

Next, the control unit 109 obtains time information representing the date and time when the sample product A was provided or the date and time when the unique ID “QR-21001” was read by the two-dimensional code reading 102 a from the time measuring unit 114.
The control unit 109 associates the unique ID “QR-21001” with the information indicating the provided sample product A and the history information indicating the time information obtained by the time measuring unit 114, and reads the read history information of the storage unit 108. It is stored in 183 (step ST5).
Here, when the unique ID is a member ID, the control unit 109 also stores information in which the history information is associated with the unique ID in the user registration information 182.

  On the other hand, when it is determined in step ST3 that the history information associated with the unique ID “QR-21001” in the reading history information 183 is information indicating that the sample product has been provided within the distribution period. The control unit 109 determines that the unique ID “QR-21001” is not a unique ID that provides sample products (step ST3-NO), and proceeds to step ST6.

Then, the control unit 109 refers to the sample determination information 181 to determine whether there is a content number associated with the unique ID “QR-21001” (step ST6). When there is an associated content number, the control unit 109 reads the content data indicated by the content number from the content data 185 in the storage unit 108 and sends it to the communication unit 201 of the storefront display apparatus 2 via the communication unit 110. Output (step ST7).
Thereby, the storefront display device 2 outputs the input content data to the control unit 202 and causes the display unit 203 to output the content data.

  Returning to step ST2, when the control unit 109 determines that the ID is a unique ID for lottery in providing sample products (step ST2-YES), the control unit 109 causes the lottery unit 111 to perform lottery.

  For example, when the unique ID “QR-12001” is read by the two-dimensional code reading unit 102a, the control unit 109 refers to the sample determination information 181 and is associated with the unique ID “QR-12001”. Get judgment conditions. As the determination condition, as shown in FIG. 4A, the case where winning is made by lottery is a condition for permitting the provision of sample products.

Therefore, the control unit 109 determines that the unique ID “QR-12001” is a unique ID for performing lottery in the provision of sample products, and causes the lottery unit 111 to perform lottery. The lottery result executed by the lottery unit 111 is output to the control unit 109.
When the lottery result is “win” (step ST9—YES), the control unit 109 displays a selection screen for selecting a sample product on the display screen of the operation unit 103, and allows the user to select one sample product. (Step ST11).
When one sample product is selected via the operation unit 103, the control unit 109 drives the sample discharge drive unit 110 to discharge the selected sample product to the sample outlet 105 (step ST10).

Next, the control unit 109 obtains time information representing the date and time when the sample product was provided or the date and time when the unique ID “QR-12001” was read by the two-dimensional code reading 102 a from the time measuring unit 114.
The control unit 109 adds, to the unique ID “QR-12001”, information indicating the provided sample product, history information indicating the time information obtained by the timing unit 114, and a lottery result (whether or not. Is stored in the reading history information 183 of the storage unit 108 (step ST12).
Here, when the unique ID is a member ID, the control unit 109 also stores information in which the history information is associated with the unique ID in the user registration information 182.

  Next, a processing flow of the sample registration information creation process will be described with reference to FIG. FIG. 14 is a flowchart illustrating an example of a processing flow of sample registration information creation processing.

  As shown in FIG. 14, when the control unit 109 is in the setting mode, the image processing unit 107 detects this marker code based on the captured image data generated by the imaging unit 106 (step ST21). The image area including the code is subjected to image processing (analysis) to obtain a marker ID included in the marker code (step ST22). Then, the image processing unit 107 outputs the obtained marker ID to the control unit 109.

  The control unit 109 associates the marker ID with a message requesting to send sample image data corresponding to the marker ID input from the image processing unit 107, and transmits the message to the management server 3 via the communication unit 110 (step S110). ST23).

When receiving this message, the management server 3 refers to the storage unit 302 to determine whether there is sample image data associated with the marker ID associated with the message. When sample image data associated with the marker ID is obtained, the management server 3 associates the marker image with the sample image data and transmits the sample image data to the sample providing apparatus 1 via the communication unit 301.
In the storage unit 302, when the attached image data, the product number, the date / time information, the store number, or the like is associated with the marker ID, the management server 3 transmits the sample image data and the sample providing apparatus 1 together with the sample image data. To do.

Then, the sample providing apparatus 1 receives sample image data, attached image data, product number, date / time information, and store number associated with the marker ID from the management server 3 via the communication unit 110 (step ST24).
Next, based on the information received from the management server 3, the control unit 109 adds a sample image number indicating sample image data, an attached image number indicating attached image data, a product number, date / time information, and a store to the associated marker ID. The numbers are associated and stored in the sample registration information 184 of the storage unit 108 (step ST25).

And the control part 109 repeats the process of step ST22-24, when the other marker ID is obtained by the image process part 107 (step ST26-YES).
Thereby, sample registration information 184 as shown in FIG. 7 is created.

  Next, a processing flow of the display control process will be described with reference to FIG. FIG. 15 is a flowchart illustrating an example of a processing flow of display control processing.

  As illustrated in FIG. 15, in the sample providing mode, when the image processing unit 107 detects a marker code based on the captured image data generated by the imaging unit 106, image processing (analysis) is performed on an image region including the marker code. Then, the marker ID included in the marker code is obtained (step ST41). Then, the image processing unit 107 outputs the obtained marker ID to the control unit 109.

  The control unit 109 refers to the sample registration information 184 based on the marker ID input from the image processing unit 107, obtains the sample image number associated with the marker ID, and refers to the sample image data 185. Then, sample image data associated with the sample image number is obtained (step ST42).

  Also, the image processing unit 107 performs image processing (analysis) on the captured image data generated by the imaging unit 106 to obtain marker form information indicating the position, size, and orientation of the marker code. Output.

  The control unit 109 controls the display form of the sample image data based on the input marker ID and marker form information, and the position of the marker code in the portion where the marker code is displayed in the screen of the captured image data. Then, sample image data corresponding to the size and orientation is synthesized (step ST43).

  Next, the control unit 109 refers to the sample registration information 184 based on the marker ID input from the image processing unit 107 and determines whether there is an attached image number associated with the marker ID. When there is an attached image number associated with the marker Id, the attached image data associated with the attached image number is obtained based on the attached image number with reference to the sample image data 185 (step ST45). ).

The control unit 109 combines the obtained attached image data with the captured image data (step ST46).
When it is determined in advance that the attached image data is displayed in a display form according to the position, size, orientation, etc. of the marker ID, the control unit 109 displays the input marker ID and the marker form information. Based on this, the display mode of the attached image data is controlled, and the attached image data corresponding to the marker code displayed in the captured image data is synthesized within the screen of the captured image data.

  Then, the control unit 109 displays the synthesized image data on the sample providing apparatus display 101 (step ST47).

As described above, the sample providing device 1 according to the present embodiment uses the marker displayed on the sample product to be stored, and sets the sample image number representing the sample image data to the marker ID representing the sample product to be stored. I made it correspond.
Thereby, the stored sample product and the sample image data corresponding to the sample product can be associated one-to-one, and the work efficiency when creating the sample registration information 184 for storing the associated information Can be improved.

If not according to the present invention, the staff member inputs the product number of the sample product via the operation unit 103 and requests the management server 3 for sample image data or the like associated with the product number. The product number may be associated with the received sample image data or the marker ID displayed on the sample product.
However, the sample providing apparatus 1 according to the present embodiment has a function of displaying a composite image using augmented reality technology, and includes an imaging unit 106 and an image processing unit used when realizing the function. By using 107 to read the marker ID, it is possible to reduce operations such as inputting a product number for identifying the sample product. In addition, since the configuration and function originally provided are used, a newly added configuration and function can be suppressed, which is economical.

Further, when the marker ID is obtained from the captured image data captured by the imaging unit 106 in the setting mode, the control unit 109 associates the marker ID with a message requesting sample image data or the like, and 3 was sent.
Thereby, the storage unit 302 of the management server 3 receives sample image data or the like associated with the marker ID, and the control unit 109 stores the received information in the sample registration information 184 in association with each other. Can do. Therefore, it is possible to reduce the work of the staff instructing transmission of sample image data or the like by manual work, the work of storing the received information in association with each other, and the like.

  Further, the control unit 109 receives the date / time information associated with the marker ID from the management server 3, and stores the date / time information associated with the marker ID in the sample registration information 184. The control unit 109 refers to the sample registration information 184 based on the current date and time measured by the time measuring unit 114, and the date and time when the date information in the sample registration information 184 is timed by the time measuring unit 114. In the past, the information associated with the date / time information is deleted from the sample registration information 184.

  As a result, when the promotion period in which the sample product is accommodated in the sample providing device 1 has elapsed, the information related to the sample product stored in the sample registration information 184 can be automatically deleted. This eliminates the need for the staff to delete from the sample registration information 184 information related to the sample product for which the promotion measure has been completed. In addition, it is possible to avoid the situation where the information related to the sample product for which the promotion period has ended is left in the sample registration information 184 in an indefinite period, and to effectively use the memory capacity of the storage unit 108. Can be avoided.

The control unit 109 receives the store number associated with the marker ID from the management server 3 and stores the store number in the sample registration information 184 in association with the store number. When the control unit 109 receives information from the management server 3, the received information includes a store number different from the store number representing the store where the sample providing device 1 stored in the storage unit 109 is installed. If the store number different from the store number stored in the storage unit 109 is included in the information received from the management server 3, the received information is not stored in the sample registration information 184. I did it.
Thereby, even if it is a case where the information for delivery other than the store in which the sample provision apparatus 1 is set is received, the situation which receives this information in the sample registration information 184 accidentally can be avoided.

Note that the sample providing apparatus 1 according to the present embodiment is not limited to the above configuration, and provides content in a state where, for example, the sample product providing process, the sample registration information creating process, and the display control process are not performed. May be.
For example, when the control unit 109 determines that each processing such as sample product processing is not being performed, the content data stored in the content data 185 is read and displayed on the sample providing apparatus display 101.

  As this content data, for example, a conversational message that speaks to a user passing in front of the sample providing device 1, seasonal information according to the season or event, advertisement, advertisement, weather forecast, fortune telling, cooking Includes information such as video and cooking tips. In addition, this information is introduced in a tone spoken by the store manager and store clerk on the store side, and a message for communication with the introduced information is displayed with comments from customers using supermarkets such as housewives and OLs. It is preferable.

Further, the present invention is not limited to this, and may have the following configuration.
For example, the marker has been described as a code configured with a geometric figure design as shown in FIG. 3, but the present invention is not limited to this, and the image processing unit 107 serves as a specific index. When a figure or an image is recognized, it may be a figure or an image serving as the index.

In addition, the sample registration information creation process by the control unit 109 is performed by, for example, a marker by an imaging device provided on the path from the storage port to the sample storage unit 113 or in the vicinity of the storage port when stored in the sample storage unit 113. The marker ID included in the code may be read. This simplifies the work of causing the imaging unit 106 to read the marker of each sample product, and improves the work of sample registration information creation processing by an attendant.
Furthermore, the sample registration information creation processing by the control unit 109 is not limited to reading the marker code, and for example, the image processing unit 107 reads information included in the barcode based on the image data captured by the imaging unit 106. Alternatively, the information corresponding to the marker ID may be detected by analyzing the image data and recognizing numbers and characters captured.

In addition, the sample registration information creation processing by the control unit 109 is not limited to the marker ID included in the marker code. For example, a barcode or a two-dimensional code including a product number or an encrypted product number is displayed on the sample product box. In this case, the product number may be read by the imaging unit 108 imaging this display. In this case, the control unit 109 transmits a message including the product number to the management server 3 and requests sample image data and the like.
Note that the communication unit 201 of the storefront display device 2 may be configured to be communicably connected to the communication unit 301 of the management server 3 via the network 4. At this time, the storefront display device 2 can receive and display image data to be displayed on the display unit 203 from the management server 3.

In addition, the operation process of the sample providing device 1 or the storefront display device 2 can be used as a program to be executed by a computer or a computer-readable recording medium as the program, and read and executed by a computer system. Thus, the above processing is performed. The “computer system” here includes a CPU, various memories, an OS, and hardware such as peripheral devices.
Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” means a flexible disk, a magneto-optical disk, a ROM, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, a hard disk built in a computer system, etc. This is a storage device.

Further, the “computer-readable recording medium” means a volatile memory (for example, DRAM (Dynamic DRAM) in a computer system that becomes a server or a client when a program is transmitted through a network such as the Internet or a communication line such as a telephone line. Random Access Memory)), etc., which hold programs for a certain period of time.
The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

  DESCRIPTION OF SYMBOLS 1 ... Sample provision apparatus, 2 ... Store front display apparatus, 3 ... Management server, 4 ... Network, 101 ... Sample provision apparatus display, 102 ... Reading part, 103 ... Operation 106, imaging unit, 107 ... image processing unit, 108 ... storage unit, 109 ... control unit, 110 ... communication unit, 114 ... timing unit

Claims (5)

A housing for housing a sample product box on which markers are displayed;
An imaging unit that captures an optical image by the optical system and generates captured image data;
A display unit for displaying an image based on the captured image data;
The captured image data is subjected to image processing to obtain first identification information pre-assigned to the marker from the captured image data generated based on the optical image including the marker, and the screen of the captured screen data An image processing unit for obtaining marker form information representing at least one of a position, a size, and a posture of the marker,
A storage unit for storing information associating the first identification information with the second identification information representing the composite image data to be combined with the captured image data;
When the first identification information is obtained by the image processing unit, based on the first identification information, referring to the storage unit, the composite image data indicated by the associated second information is obtained. And a control unit that causes the display unit to display an image synthesized by superimposing the composite image data corresponding to the marker form information on the captured image data with respect to an image region representing the marker in the captured image data. When,
A sample providing apparatus comprising: A communication unit that communicates with a management server connected via a network;
The controller is
When the first identification information is obtained by the image processing unit, a message requesting transmission of composite image data corresponding to the first identification information is transmitted to the management server via the communication unit,
The sample providing apparatus according to claim 1, wherein the composite image data received via the communication unit is associated with the first identification information corresponding to the image data and stored in the storage unit. It further includes a timekeeping part that keeps track of the current date and time,
The storage unit
The first identification information is stored in association with date / time information representing a time zone in which the first identification information is effective,
The controller is
Whether the date and time information stored in the storage unit is earlier than the date and time measured by the time measuring unit with reference to the storage unit based on the current date and time timed by the time unit. The information associated with the date information is deleted from the storage unit when the date information stored in the storage unit is in the past. 2. The sample providing apparatus according to 2. The storage unit
Stores the first identification information in association with store information representing a store where the sample providing device is installed,
The controller is
When the information is received from the management server, it is determined whether or not the received information includes a store number different from the store number stored in the storage unit, and the store stored in the storage unit The sample providing apparatus according to claim 2 or 3, wherein when the store number different from the number is included in the information received from the management server, the received information is not stored in the storage unit. A promotion deployment system comprising a sample providing device and a management server connected to the sample providing device via a network,
The management server
First information for storing information associating second identification information representing composite image data with first identification information assigned in advance to a marker displayed on a sample product provided by the sample providing device. A storage unit;
A first communication unit that communicates with the sample providing device via the network;
The sample providing device comprises:
An accommodating portion for accommodating a box of sample products on which the marker is displayed;
A second communication unit that communicates with the management server via the network;
An imaging unit that captures an optical image by the optical system and generates captured image data;
A display unit for displaying an image based on the captured image data;
The captured image data is subjected to image processing to obtain first identification information pre-assigned to the marker from captured image data generated based on the optical image including the marker, and the screen of the captured screen data An image processing unit for obtaining marker form information representing at least one of the position, size, and orientation of the marker
A storage unit for storing information associating the first identification information with the second identification information representing the composite image data to be combined with the captured image data;
When the first identification information is obtained by the image processing unit, based on the first identification information, the storage unit is referred to obtain composite image data indicated by the associated second information And a control unit that causes the display unit to display an image synthesized by superimposing the composite image data corresponding to the marker form information on the captured image data with respect to an image region representing the marker in the captured image data. And comprising
The control unit of the sample providing device includes:
When the first identification information is obtained by the image processing unit, a message requesting transmission of composite image data corresponding to the first identification information is transmitted to the management server via the communication unit, and A promotion development system, wherein the composite image data received via the communication unit is associated with the first identification information corresponding to the image data and stored in a storage unit.

Images