JP2019079153A - Information processing apparatus, control method for information processing apparatus, and control program for information processing apparatus, and article providing system - Google Patents

Abstract

To provide an information processing apparatus, etc., capable of reducing a steep rise in cost and the load of processing of the information processing apparatus.SOLUTION: An information processing apparatus comprises: an acquisition unit which acquires identification information related to a user having entered a predetermined space; a detection unit which detects user's walking tracks in the predetermined space; an article determination unit which determines whether predetermined change is made in a display place where articles are displayed in the predetermined space; a user determination unit which determines, based upon the display place where the article determination unit determines that the predetermined change is made and walking tracks, identification information to be made to correspond to payment information on a payment of an article in the display space where it is determined that the predetermined change is made; a payment storage unit which stores, for each piece of identification information determined by the user determination unit, at least one piece of payment information made to correspond to the identification information; and a payment unit which performs payment processing based upon the payment information stored in the payment storage unit.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus capable of executing processing relating to the handling of articles, a control method of information processing control program, and an article providing system.

  In recent years, in places where goods are handled, such as stores and warehouses, such as unmanned stores where goods are sold unmanned, for example, it is necessary to track people removed from the stock place. Not a system is emerging. For example, Patent Document 1 describes a computing system in which tracking of removal or placement of articles at an inventory location having a material handling facility is performed by a processor.

Japanese Patent Application Publication No. 2016-532932

  In the system described in Patent Document 1, an image capturing device (for example, a camera) is used to track an article removed by the user from the stock location, and a series of such hands before and after the user's hand enters the stock location. Images are taken. Then, based on the comparison of the images, it is determined whether the user has excluded the object from the inventory location or placed the object in the inventory location. However, in the system described in Patent Document 1 in which images are used for tracking goods in the stock location, the load for comparison processing of a series of plural images before and after the user's hand enters the stock location, and installation of a camera There was a problem that the cost concerned became high.

  Therefore, in view of the problems as described above, the present invention is an information processing apparatus capable of reducing costs and reducing the processing load on the information processing apparatus, a control method for the information processing apparatus, a control program for the information processing apparatus, and an article providing system Intended to provide.

  An information processing apparatus according to an embodiment of the present invention includes an acquisition unit that acquires identification information associated with a user who has entered a predetermined space, a detection unit that detects at least a walking trajectory of the user in the predetermined space, An article determination unit that determines whether or not a predetermined change has occurred in the display place where an article in the space is displayed; a display place determined that a predetermined change has occurred by the article determination unit; Based on the user determination unit determining the identification information to be associated with the settlement information related to the settlement of the item displayed in the display place determined to have a predetermined change, and for each identification information determined by the user determination unit, A payment storage unit for storing at least one payment information associated with the identification information, and a payment unit for executing a payment based on the payment information stored in the payment storage unit .

  Furthermore, in the information processing apparatus according to the embodiment of the present invention, the article determination unit determines a predetermined change when the weight after the change becomes smaller than that before the change in the display place where the item is displayed. May be determined to have occurred.

  Furthermore, in the information processing apparatus according to the embodiment of the present invention, the article determination unit determines that the shape of the group of articles displayed after the change is smaller than that before the change in the display place where the article is displayed In this case, it may be determined that a predetermined change has occurred.

  Furthermore, in the information processing apparatus according to the embodiment of the present invention, the user determination unit is configured to determine, from the display location where it is determined that the predetermined change has occurred, the position when the predetermined change occurs in the walking locus. The identification information associated with the user within the range may be determined as identification information to be associated with the settlement information on the settlement of the item displayed in the display place where it is determined that the predetermined change has occurred.

  Furthermore, the information processing apparatus according to the embodiment of the present invention further includes a restriction unit that controls restriction means for restricting entry and exit to a predetermined space, and the restriction function is identification information for which settlement is performed by the settlement unit. The restriction on the exit of the user associated with the user from the predetermined space may be released.

  Furthermore, the information processing apparatus according to an embodiment of the present invention further includes a user storage unit that stores identification information associated with a user in association with identification information that identifies the user, and the acquisition unit has a predetermined space The identification information associated with the specific information transmitted from the terminal device of the user who has entered may be acquired from the identification information stored in the user storage unit.

  Furthermore, the information processing apparatus according to an embodiment of the present invention further includes a setting unit configured to set temporary identification information to a user entering a predetermined space, and the acquiring unit is configured to temporarily set the identification unit. Unique identification information may be obtained.

  Furthermore, the information processing apparatus according to an embodiment of the present invention is display information for displaying payment information associated with identification information on a display unit of a terminal apparatus corresponding to the identification information associated with the payment information. May further include a display output unit that outputs the

  In a control method of an information processing apparatus according to an embodiment of the present invention, an acquisition step of acquiring identification information associated with a user who has entered a predetermined space in an information processing apparatus, and at least walking of the user in the predetermined space When a predetermined change occurs in an article determination step of determining whether or not a predetermined change has occurred in a detection step of detecting a trajectory, a display place where an article in a predetermined space is displayed, and an article determination step A user determination step of determining identification information to be associated with settlement information on settlement of an item displayed at a display place determined to have a predetermined change, based on the determined display place and the walking locus; A settlement storage step of storing at least one piece of settlement information associated with the identification information for each of the identification information determined in the step; To execute the payment based on the stored payment information in the storage step is executed and settlement steps.

  A control program of an information processing apparatus according to an embodiment of the present invention includes an information processing apparatus, an acquisition function of acquiring identification information associated with a user who has entered a predetermined space, and at least walking of the user in the predetermined space. It is determined that a predetermined change has occurred by a detection function that detects a trajectory, an article determination function that determines whether a predetermined change has occurred, and an article determination function in a display place where an article in a predetermined space is displayed User determination function that determines identification information to be associated with settlement information related to settlement of an item displayed at a display place determined to have a predetermined change based on the displayed place and the walking track, and a user determination function And a payment storage function for storing at least one payment information associated with the identification information for each identification information determined by the It was to achieve a settlement function to execute a settlement based on the settlement information.

  An article providing system according to an embodiment of the present invention acquires a reading unit that reads identification information associated with a user who has entered a predetermined space, and data of at least a walking trajectory of the user in the predetermined space. 1 detection unit, a second detection unit for acquiring data relating to a predetermined change occurring in a display place where goods in the predetermined space are displayed, data relating to the walking trajectory and data relating to the predetermined change The information processing apparatus may include a transmission unit that transmits information to the information processing apparatus, a restriction unit that restricts the user leaving the predetermined space, and a reception unit that receives information instructing cancellation of the restriction of the restriction unit.

  According to the present invention, an information processing apparatus capable of reducing the cost of installing a camera and reducing loads of a plurality of image processing in the information processing apparatus, a control method of the information processing apparatus, a control program of the information processing apparatus and an article providing system Can be provided.

1 is a schematic view of an article providing system configuration according to an embodiment of the present invention. It is an example of the block diagram of the server (information processing apparatus) by one Embodiment of this invention. It is an example of the block diagram of the terminal device by one embodiment of the present invention. It is a schematic diagram explaining an example of composition in a store by one embodiment of the present invention. It is the schematic explaining the determination of the user who acquired goods from a display place by one Embodiment of this invention. Both (a) and (b) are schematic diagrams explaining determination of the user who acquired goods from a display place by one Embodiment of this invention. (A) is an explanatory view when a user enters a store, (b) is a screen example of a terminal device of the user, and (c) is an example of identification information stored in a storage unit. When a user acquires goods from a display place, (a) is explanatory drawing, (b) is an example of a screen of a user's terminal device, (c) is an example of payment information memorized by storage part. When the user executes payment, (a) is an explanatory diagram, (b) is a screen example of the terminal device of the user, and (c) is an example of payment history stored in the storage unit. Both (a) and (b) are examples of payment information stored in the storage unit according to an embodiment of the present invention. It is an example of the flowchart of the control method of the information processing apparatus according to one embodiment of the present invention.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic view of an article providing system according to an embodiment of the present invention. The article providing system 500 is a system of services that allows the user 400 to obtain and purchase an article even if a caretaker providing the article is not present. Hereinafter, as an example, an embodiment will be described in which provision of an article is an unmanned store where a salesperson or a salesclerk who sells a product does not exist, as shown in FIG. The article provision system 500 includes at least a server (information processing apparatus) 100, a store 200, a terminal device 300, and a network NET, as shown in FIG. The server 100 is connected to the store 200 and the terminal device 300 via the network NET. Although two servers 100 are shown in FIG. 1, they may be realized as a plurality of groups of servers or may be realized alone. In the store 200, a plurality of products (articles) are displayed on a product shelf (display place). Although details will be described later, the settlement of the product purchased by the user 400 at the store 200 is performed by the server 100 or a predetermined settlement service via the network NET.

  Although the terminal device 300 is associated with the user 400 and is shown in FIG. 1 as a smartphone, it may be a terminal device that can be connected to a network, such as a tablet or wearable terminal (glasses type, watch type, headset type, etc.). Anything may be used. Further, although only one terminal device 300 is shown in FIG. 1 for the sake of simplicity, it goes without saying that more than one terminal device may be present. That is, there may be a plurality of users who enter the store 200. Although application software (hereinafter also referred to as “application”) provided by the service side for using the store 200 may be downloaded to the terminal device 300, the store 200 may be used without using the application. Can be done (details will be described later). In addition, between the terminal device 300 and a predetermined communication device provided in the store 200, a beacon signal using Bluetooth (registered trademark), BLE (Bluetooth Low Energy), RFID (Radio Frequency Identifier) standard Near field communication such as ultrasonic waves and infrared communication may be performed.

  FIG. 2 is a block diagram of a server (information processing apparatus) 100 according to an embodiment of the present invention. As shown in FIG. 2, the server 100 includes a control unit 110, a communication unit 120, and a storage unit 130. Although the details will be described later, the functions of these units will be briefly described.

  The control unit 110 is a processor having a function of controlling each unit of the server 100. The control unit 110 includes an acquisition unit 111, a detection unit 112, an article determination unit 113, a user determination unit 114, a settlement unit 115, a restriction unit 116, a setting unit 117, and a display output unit 118. The acquisition unit 111 acquires identification information associated with the user who has entered the predetermined space. The acquisition unit 111 may acquire identification information associated with the user who has entered the predetermined space from the identification information stored in the storage unit 130. Alternatively, temporary identification information may be set for the user entering the predetermined space by the setting unit 117, and the acquisition unit 111 may acquire the temporary identification information.

  The detection unit 112 detects at least a walking trajectory of the user who has entered the predetermined space in the predetermined space. The item determination unit 113 determines whether or not a predetermined change has occurred in the display place where the product in the predetermined space is displayed. The article determination unit 113 determines that the predetermined change has occurred when the weight after the change is smaller than that before the change in the display place where the product is displayed. Alternatively, the article determination unit 113 determines that the predetermined change has occurred when the shape after the change of the displayed group of goods becomes smaller than that before the change in the display place where the goods are displayed. . The user determination unit 114 determines that the product displayed in the display place determined to have the predetermined change is generated based on the display place determined to have the predetermined change generated by the item determination unit and the walking locus. The identification information to be associated with the settlement information on Note that the user determination unit 114 is identification information associated with a user whose position when a predetermined change has occurred is within a predetermined range from the display place where it is determined that the predetermined change has occurred, of the walking trajectory. Is determined as identification information to be associated with settlement information on settlement of a product displayed at a display place where it is determined that a predetermined change has occurred. The settlement unit 115 executes settlement based on the settlement information associated with the identification information.

  The limiting unit 116 controls limiting means for limiting entry / exit to a predetermined space. In addition, the restriction unit 116 controls the restriction unit so as to release the restriction on the leaving of the user from the predetermined space, which is associated with the identification information for which the settlement unit 115 has performed the settlement. The display output unit 118 outputs display information for causing the payment information associated with the identification information to be displayed on the display unit of the terminal device corresponding to the identification information associated with the payment information.

  Communication unit 120 includes reception unit 121 and transmission unit 122, and has a function of executing communication (transmission and reception of various data) with store 200 or terminal device 300 via network NET in accordance with an instruction from control unit 110. . For example, in response to an instruction from the acquisition unit 111, the reception unit 121 receives identification information of the user who has entered the predetermined space. Further, in response to an instruction from the detection unit 112, the reception unit 121 receives data on the walking trajectory transmitted from the detection unit installed in the store 200. In addition, the receiving unit 121 and the transmitting unit 122 exchange payment information with a predetermined payment service server that executes payment in accordance with an instruction from the payment unit 115. The transmitting unit 122 transmits, to the terminal device 300, the display information for causing the display unit of the terminal device corresponding to the identification information to be displayed, which is output by the display output unit 118 and associated with the identification information. Do. These communications may be performed by wire or wireless, and any communication protocol may be used as long as they can communicate with each other.

  The storage unit 130 is typically realized by various recording media such as a hard disc drive (HDD), a solid state drive (SSD), a flash memory, and the various programs and data required for the server 100 to operate. It has the function to memorize. The storage unit 130 stores (stores) at least one piece of payment information associated with the identification information for each of the identification information determined by the user determination unit 114. In addition, the storage unit 130 may store in advance identification information associated with the user, or may store, for each of the identification information, a payment method and information indicating a payment service used for payment. The storage unit 130 also stores information indicating which product is displayed at which position on the product shelf.

  Next, the terminal device 300 will be described. As shown in FIG. 3, the terminal device 300 includes a control unit 310, a communication unit 320, a storage unit 330, an input receiving unit 340, a display unit 350, an audio interface (I / F) 360, and a speaker 370.

  The communication unit 320 includes a reception unit 321 and a transmission unit 322, and has a function of executing communication with the server 100 or communication means installed in the store 200 via the network NET. The communication may be performed by wire or wireless, and any communication protocol may be used as long as communication with each other can be performed. The communication unit 320 may also be used to exchange data with the authentication device 95 installed in the store 200.

  The storage unit 330 has a function of storing various programs and various data required for the terminal device 300 to operate. For example, the storage unit 330 includes information such as a program of an application necessary to receive the service according to the present embodiment. The storage unit 330 is typically realized by various recording media such as an HDD, an SSD, and a flash memory.

  The input receiving unit 340 receives an input from the user 400, and transmits information related to the input to the control unit 310. In the terminal device 300, the input receiving unit 340 is realized by a touch panel or the like, detects a touch by a pointing tool such as a user's finger or a stylus and the touch position, and transmits coordinates of the touch position to the information processing unit 311. In the present embodiment, the input receiving unit 340 receives a request for selection of a purchased product by the user or a payment.

  The control unit 310 is a processor having a function of controlling each unit of the terminal device 300. The control unit 310 includes an information processing unit 311, a display processing unit 312, and a determination unit 313. The information processing unit 311 has a function of controlling to transmit information from the communication unit 320 to the server 100 in accordance with the information input from the input reception unit 340. The information processing unit 311 also has a function of transmitting the information received from the server 100 by the communication unit 320 to the display processing unit 312. The display processing unit 312 has a function of converting the display data transmitted from the information processing unit 311 into pixel information and writing the pixel information in the frame buffer of the display unit 350.

  The display unit 350 is a monitor having a function of displaying an image according to the display data written in the frame buffer by the display processing unit 312, and is typically realized by a liquid crystal display. The display unit 350 displays payment information received from the server 100 via the network NET. The audio I / F 360 is an interface of the speaker 370 and an earphone not shown. Note that the payment information may be output as voice via the voice I / F 360, or a predetermined warning sound may be output. In addition, a settlement request from the user may be instructed (inputted) by voice.

  Next, the store 200 will be described using FIGS. 4 and 5. FIG. 4 is a schematic diagram illustrating an example of the configuration in the store 200 according to an embodiment of the present invention. In addition, after that, when it is not necessary to distinguish in particular, alphabets A, B, and the like of reference numerals indicating that a plurality exist in the drawing may be omitted. As shown in FIG. 4, in the store 200, a product shelf 80 as a display place for the product 50 is installed. A floor sensor 60 capable of detecting the walking path of the user 400 is provided on the floor of the store 200. The floor sensor 60 may be realized by, for example, a capacitive sheet-like sensor, or may be realized by a plurality of sensor modules embedded and used below or on the floor. Here, the floor sensor 60 functions as an input unit to which data regarding the walking trajectory of the user 400 who has entered the store 200 is input. The data on the walking locus input to the floor sensor 60 is transmitted from the communication means 220 provided in the store 200 to the server 100 via the network NET. The detection unit 112 of the server 100 can analyze the data obtained from the floor sensor 60 to detect the walking trajectory of the user 400.

  Further, on each step of the product shelf 80, a shelf pressure sensor 10 functioning as a weight sensor for detecting a change in weight is provided, and a change in weight of the product displayed on the product shelf 80 is detected. Similarly to the floor sensor 60, the shelf pressure sensor 10 may be in the form of a sheet or may be realized by a plurality of sensor modules. The shelf pressure sensor 10 sequentially measures the weight of the goods loaded on the shelf pressure sensor 10 itself, and the measured data is transmitted to the server 100 via the network NET. The article determination unit 113 of the server 100 compares the received data (that is, the weight applied to the shelf pressure sensor 10) in time series order, and determines whether there is a change in the continued data. Then, when the weight after the change is smaller than before the change, it is determined that the predetermined change has occurred. Here, the predetermined change means that the goods loaded on the shelf pressure sensor 10 are removed. Further, the item determination unit 113 can also determine that the item is loaded on the shelf pressure sensor 10 (that is, the item is returned to the item shelf 80). For example, when it is determined by the item determination unit 113 that the weight after change is larger than that before change according to the change in data received from the shelf pressure sensor 10, the product is returned to the shelf 80 It means that.

  Further, a plurality of TOF (Time of Flight) sensors 20 may be provided on the product shelf 80 to measure the depth direction of the product shelf. The TOF sensor 20 can detect a change in the shape of the product group. That is, the TOF sensor 20 measures the distance of the product group arranged in the depth direction of the product shelf, and the measured data is transmitted to the article determination unit 113. The article determination unit 113 compares the distance measurement data from the TOF sensor 20 in chronological order, and determines whether there is a change in the continuous distance measurement data (that is, the shape of the product group). And when the shape of the goods group before change becomes small compared with the shape of the goods group after change, it determines with predetermined change having occurred. In addition, the predetermined change here means that the goods displayed on the goods shelf were removed. Furthermore, as a predetermined change, as described above, it can also be determined that the product has been returned to the product shelf.

  According to one embodiment of the present invention, it is determined using a combination of these sensors which products the user who has entered the store 200 has acquired from the product shelf 80 and has. This determination will be described with reference to FIG. FIG. 5 is a schematic plan view of the inside of the store 200 as viewed from above. The detection unit 112 detects the walking trajectory R1 in the store 200 of the user 400 using the data acquired by the floor sensor 60. Further, the article determination unit 113 determines the point C1 at which the predetermined change occurs in the product shelf 80A using the data acquired by the shelf pressure sensor 10 or the TOF sensor 20. The data acquired by the shelf pressure sensor 10 detects, as a predetermined change, a case where the weight after the change is smaller than that before the change in the display place where the product is displayed. Also, based on the data acquired by the TOF sensor 20, it is detected that the shape after the change of the displayed commodity group becomes smaller than that before the change as the predetermined change in the display place where the commodity is displayed. Be done. That is, in response to the increase in the distance detected by the TOF sensor 20, it is detected that the shape of the commodity group in the display place is reduced. When a predetermined change occurs at the point C1, the user determination unit 114 determines that the product displayed at the point C1 is acquired by the user whose walking position P1 is within the predetermined range from the point C1. The predetermined range may be stored in the storage unit 130 as a fixed value (for example, a radius of 30 cm or less centering on the point C1), or may be stored in the storage unit 130 as a table according to the walking locus R1. It may be done. Here, the table refers to the distance required to acquire a product according to the gender of the user estimated based on the stride of the walking locus R1, the size of the foot, and the size (weight) of the pressure. It is something to remember.

  In addition, in order to improve the accuracy of the determination by the user determination unit 114, the product shelf 80 may be provided with the sight sensor 30 and the human sensor 40. The gaze sensor 30 acquires data on the gaze of the user 400 located in front of the product shelf 80. Furthermore, a shelf floor sensor 70 is provided between the product shelf 80 and the floor of the store 200, and acquires data on the change in weight of the entire product shelf 80. The data acquired by each of these sensors may also be transmitted to the detection unit 112 of the server 100 via the network NET, and may be used auxiliary to the above determination. For example, when a product is removed from the product shelf 80 based on the line-of-sight data of the user obtained from the line-of-sight sensor 30, the user who focused on the product may be extracted and determined together with the walking locus . Further, it may be determined whether the user's hand has entered the inside of the product shelf 80 using data obtained from the human sensor 40. Further, as shown in FIGS. 6A and 6B, the position (x, y, z) of the shelf where the user extends the hand 400H is determined by the TOF sensor 20 which measures the distance from the top of the product shelf 80 Then, it may be determined which goods have been removed or goods have been returned to the shelf.

  Next, purchase processing of a product in the store 200 will be described using FIGS. First, an aspect in which an application for using the shop 200 is installed in the terminal device 300 after the user 400 performs service usage registration will be described. In this case, the identification information of the user who has registered for use of the service is stored in, for example, the user information table 133 illustrated in FIG. 7C in the storage unit 130 of the server 100 or an external memory provided separately from the server 100. It is stored in advance as In the user information table 133, a name, a settlement method, and the like are associated and stored for each identification information (customer ID). Here, the payment method is a method used for payment designated in advance by the user, and is, for example, electronic money, credit card, internet banking, mobile carrier payment, and the like.

  As shown to Fig.7 (a), the authentication apparatus 95 is provided in the entrance ENT of the shop 200, and in this embodiment, only the user who succeeded in user authentication can enter the shop 200. FIG. First, the user 400 launches an application on the terminal device 300 in order to perform entrance processing to the store 200. FIG. 7B is an example of the terminal device 300 on which is displayed a key (QR code in the example shown) DIS1 which is specific information for causing the authentication device 95 to read. When the user 400 causes the authentication device 95 to read the key DIS 1, the communication means 220 provided in the store 200 transmits information on the key DIS 1 to the server 100. The control unit 110 of the server 100 determines whether or not the identification information corresponding to the key DIS1 is stored in the user information table 133. Here, the key DIS1 may be the identification information (customer ID) of the user itself, or may be other information associated with the identification information. In the latter case, text data, images, sounds, fingerprint information, retina information or the like may be used as the specific information and read by the authentication device 95.

  When the identification information is stored in the user information table 133, the restriction unit 116 cancels the entrance restriction by the restriction means (for example, a door key, an alarm device, and the like) provided in the store 200. That is, the restriction unit 116 transmits, to the shop 200, an instruction to cancel the entrance restriction provided in the shop 200. The restriction means is not limited to physically restricting entrance, and entrance to the store 200 is possible, but use of an application may not be permitted.

  As shown in FIG. 8A, when the user 400 enters the store 200, as described with reference to FIG. Are sent to the detection unit 112. A floor sensor is provided in the vicinity of the entrance ENT or in the vicinity of the authentication device 95, and the identification information of the user and the footprint of the user are stored in the storage unit 130 in advance in association with entry into the store 200. Be done. Further, as described above, the article determination unit 113 uses the data acquired from the shelf pressure sensor 10, the TOF sensor 20, the sight sensor 30, and the human sensor 40 provided on the product shelf 80 to Determine if the item has been removed. Furthermore, the item determination unit 113 specifies the removed item based on the information on the correspondence between the item shelf and the item stored in the storage unit 130. The user determination unit 114 determines, based on the data acquired from each sensor, a user (a user who has the removed product) to be associated with payment information on the payment of the removed product. Then, as shown in FIG. 8C, the payment information storage unit 131T has a payment information table 131T in which the acquired product, the amount of money, and the total amount of money are associated with the identification information (customer ID) as payment information. It is stored in 131. Further, as shown in FIG. 8B, on the display unit 350 of the terminal device 300, payment information of the product acquired by the user is displayed.

  The determination by the item determination unit 113 or the user determination unit 114 may be performed each time the user removes or returns the product from the product shelf, and stores the output data from each sensor in association with the time. In addition, each past data may be performed on the basis of time. However, as shown in FIG. 8 (b), the former reflects the settlement information each time and is displayed on the terminal device 300, which is desirable for the convenience of the user.

  Further, it is considered that the correspondence between the identification information of the user and the footprint of the user is less accurate if the footprints are similar among the users. In this case, a camera may be provided in the store 200, and the identification information and the face image of the user may be associated and stored in advance at the entrance ENT. Then, the vicinity of the product shelf in which a predetermined change has occurred may be imaged by a camera, and the obtained image may be analyzed to determine the user who has acquired the product.

  Next, the settlement process of the product will be described. As shown in FIG. 9 (a), when the user 400 enters the settlement area 90 of the store 200, as shown in FIG. 9 (b), a screen DIS3 for selecting execution of settlement of goods is displayed on the terminal device 300. Displayed on the display unit. This is realized, for example, by the display output unit 118 outputting display information for causing the terminal device 300 to display the payment information based on the payment information stored in the payment storage unit 131. After that, when the button (purchase button) DIS4 for executing payment is selected by the user 400, the payment unit 115 controls to execute payment. For example, when the payment method is a credit card, the payment unit 115 controls the transmission unit 122 to transmit a request for payment to a server of a credit company (not shown). When the settlement is completed (the settlement completion response is received), the restriction unit 116 transmits an instruction to cancel the restriction of the restriction means (for example, the door key) for restricting the exit of the store 200, and the exit OUT of the store 200 Is unlocked. Further, the storage unit 130 stores a payment history table 134 that stores the payment history of the user.

  As described above, according to the embodiment of the present invention, the user who has acquired the product is determined based on the walking locus of the user who has entered the store 200 and the predetermined change in the display place of the product. Since this predetermined change is detected by the sensor, it is possible to provide the store 200 with the cost rising and the processing load on the server reduced as compared with the case where a plurality of cameras are provided.

  Further, as described above, in the display place where the product is displayed, the weight sensor determines that the product is acquired by the user when the weight after the change is smaller than that before the change, and the product is The change in weight that occurs when being returned to the product shelf does not associate the payment information of the product. Similarly, in the display place where the product is displayed, when the shape after the change of the displayed product group becomes smaller than before the change, it is determined that the product is acquired by the user, and the product is on the product shelf Due to the change in shape that occurs when it is returned to, the product settlement information is not associated. When the product is returned to the product shelf, the settlement information is updated, and the association of the returned product with the identification information is released.

  Further, it is determined that the product is acquired by the user within a predetermined range from the display place where it is determined that the predetermined change has occurred, when the predetermined change has occurred in the display place. Therefore, the determination accuracy of the user who acquired the product can be improved.

  Furthermore, according to one embodiment of the present invention, only the usage registered user for the service, that is, only the user whose identification information is stored in advance, can enter the store 200, and only the user who has completed the settlement Exiting from the store 200 is possible. Since the service side of the registered use user for the service has registered the user's information, it is possible to enhance the security of the store 200 which is an unmanned store on the crime prevention.

  In addition, in the use of the store 200, the usage registration to the service may not be performed (the application may not be installed). In this case, for example, when the user 400 enters the store 200, the setting unit 117 sets temporary identification information. For example, as shown in a table 132E of FIG. 10A, a camera is installed at an entrance ENT of a store and is associated with an image of a face of the user 400 who has entered the store 200 (face authentication is performed). The temporary identification number (one-time customer ID) is stored in a predetermined storage unit. A floor sensor may be provided at the entrance ENT, and a temporary identification number may be associated with the footprint instead of the face image or together with the face image. Since acquisition of goods in store 200 by a user is the same as that of a mode mentioned above after that, explanation is omitted. That is, in the storage unit of the server 100, for example, as in the payment information table 131E of FIG. 10B, the payment information of the product is stored in association with the temporary identification number. The settlement is performed, for example, via a settlement device installed in the settlement area 90 of the store 200. The settlement device includes, for example, at least a display and a camera, and the display displays a list of products acquired by the user who makes the settlement. This can be realized, for example, by the display output unit 118 outputting display information based on the payment information of the product associated with the user according to the determination by the user determination unit 114 of the server 100 to the payment apparatus. Then, a request for the user to make a payment via the payment device is output to the server of the credit card company, or the total amount is withdrawn from the electronic money. In response to the completion of the settlement, the outlet OUT of the store 200 is unlocked, and the user can leave the store 200.

  As described above, according to another embodiment of the present invention, even a user who has not registered for use of the service can use the store 200, which is highly convenient. However, the use by a large number of unspecified users remains uneasy on the crime prevention for unmanned stores. For this reason, the usage history of the store 200 in the past is stored in association with the image of the face obtained by face authentication, and a user who has unpaid goods, a user who repeatedly changes the display place of the goods, etc. It is also possible for the restriction unit 116 not to release the restriction means for restricting the entrance to the store 200 to a user who is found to have an undesirable behavior for the use of 200. The user information associated with the temporary identification information is not limited to the image of the face, and may be part of the clothes of the user, belongings, or the like. However, as described above, it is preferable to use a face image from the viewpoint of the crime prevention of the store.

  Next, the control method according to the above-described embodiment of the present invention will be described with reference to the drawings. FIG. 11 is a flowchart of the control described above. First, the acquisition unit 111 acquires identification information associated with the user who has entered the predetermined space (step S11). The identification information may be stored in the storage unit 130 or the external memory when the use registration of the service is performed in advance, or may be acquired from the setting unit 117 when the temporary identification information is set. May be Then, based on the data obtained from the floor sensor 60, the detection unit 112 detects a walking locus in a predetermined space (step S12). The article determination unit 113 determines whether or not a predetermined change has occurred in the display place where the article in the predetermined space is displayed (step S13). If a predetermined change does not occur, the process returns to step S12, and detection of the walking trajectory is continued. If it is determined in step S13 that a predetermined change has occurred, settlement information on settlement of goods based on the display place determined by the user determination unit 114 that the predetermined change has occurred and the walking locus. Identification information to be associated with is determined (step S14). Then, at least one piece of payment information associated with the identification information is stored in the storage unit 130 for each identification information (step S15). Then, the settlement unit 115 executes settlement based on the settlement information (step S16).

  As described above, according to one embodiment of the present invention, since various sensors are used in combination, it is possible to suppress an increase in cost and to reduce labor costs without requiring a salesperson of goods. It can be realized. It should be noted that, using the information on the purchased product, it is possible to judge the product to be newly replenished to the store and the product to update the display place without the manager directly visiting the store 200. Therefore, the goods provision system according to the present invention is effective in a sparsely populated area where the goods to be replenished from the storage place of goods are more difficult than the urban area.

  Although the present invention has been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various changes and modifications based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. For example, each means, functions included in each step, etc. can be rearranged so as not to be logically contradictory, and it is possible to combine or divide a plurality of means, steps, etc. into one. . Further, the structures described in the above embodiments may be combined as appropriate. For example, the processing described as the function of the server 100 may be performed by a server provided in the store 200. Further, each component described as being included in the server 100 may be distributed and realized by a plurality of servers.

  Specifically, the processing performed by the control unit 110 may be performed by a server provided in the store 200, and for example, functions such as the article determination unit 113 and the restriction unit 116 are provided in the store 200. The server may be provided.

  Although one embodiment of the invention related to the present invention has been described, it goes without saying that the present invention is not limited to this. For example, although the above describes the aspect in which payment information, user information, and the like are stored in the storage unit 130 of the server 100, the various information may be stored as a database in a memory separate from the server 100.

  Moreover, in the above, the example of the shop was demonstrated as a predetermined | prescribed space. However, as the predetermined space, the present invention is also applicable to a warehouse for storing articles, a rental service such as a library or a rental video shop, and the like. The predetermined space is not a closed space as shown in FIG. 1 but may be an open space as long as it is a space provided with a floor sheet. For example, an unmanned sales space may be provided in a vacant space of a building or an apartment, at a corner of an office, or the like.

  In addition, the change of a user's positional information may be used instead of the walk locus | trajectory using a floor sensor. This can be realized, for example, by installing a beacon transmitter in a predetermined space and using information on the position of the own terminal estimated on the terminal device side using near field communication.

  Moreover, in the case of the embodiment in which the user uses and registers for service, it is possible to realize the following configuration. For example, the user's payment history can be stored in the storage unit in association with the user (identification information). At this time, environmental information such as the purchase date of the product, the weather on the purchase date, and an event in the area around the store may be stored in the storage unit together with the payment history. Based on these pieces of information, it is possible to provide, for each user, information that recommends the purchase of a product. For example, if the product purchased in the past is a consumable item, the consumption date of the product is estimated based on the purchase date, and a message is offered near the consumption date indicating that the product purchased in the past or a related product is recommended to be purchased. May be In addition, when the user enters the store, the message may be transmitted to the terminal device 300 or may be output by voice. For example, the control unit 110 of the server determines a recommended product based on the history stored in the storage unit 130, and the display output unit 118 outputs the information output from the terminal device 300, or the store 200 This can be realized by outputting the information output in

  In addition, according to changes in the environment around the store (for example, changes in the weather such as rainfall, changes in traffic conditions such as train delays), it is possible for users in the store to sell items such as umbrellas, books, food, and beverages. A message may be sent suggesting a purchase.

  Furthermore, a predetermined reward may be set for the user according to the user's purchase history. For example, a fee may be discounted when purchasing a predetermined item. This can be realized, for example, by storing information on remuneration for each user in the storage unit 130 and resetting the settlement information by the settlement unit 115 when executing the settlement.

  Moreover, moving means, such as a wheel, may be provided in the shop 200 mentioned above, and the shop 200 may be movable by automatic driving | operation. Then, the store 200 may move to the storage warehouse of the product by automatic operation, and the product may be replenished. As a result, it is possible to realize an article providing system with further reduced cost, and to actively expand the store 200 in a sparsely populated area.

  In the article providing system according to the present invention, the reading unit is the authentication device 95, the first detection unit is the floor sensor 60, the second detection unit is the shelf pressure sensor 10, and the communication unit is provided with the transmission unit and the reception unit. This can be realized by the store 200 realized by the door provided with the restriction portion at the outlet OUT.

  Each functional unit of the server 100 may be realized by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or the like, or a CPU (Central CPU) It may be realized by software using Processing Unit). Also, each functional unit may be realized by one or more integrated circuits, and the functions of the plurality of functional units may be realized by one integrated circuit.

  When each functional unit of the server 100 is realized by software, the server 100 or the terminal device 300 reads a program instruction that is software that realizes each function, the above program and various data by a computer (or CPU) A ROM (Read Only Memory) or storage device (these are referred to as a "recording medium") recorded in a possible manner, a RAM (Random Access Memory) for developing the program, and the like are provided. The object of the present invention is achieved by the computer (or CPU) reading the program from the recording medium and executing the program. That is, the information processing apparatus 100 according to the present invention causes the acquisition unit 111, the detection unit 112, the article determination unit 113, the user determination unit 114, the settlement unit 115, and the restriction to be executed by the CPU executing the program loaded on the RAM. It functions as the unit 116, the setting unit 117, and the display output unit 118. As the recording medium, a “non-transitory tangible medium”, for example, a semiconductor memory, a programmable logic circuit or the like can be used. The program may be supplied to the computer via any transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

  The above program is, for example, a script language such as ActionScript, JavaScript (registered trademark), Python, Ruby, an object-oriented programming language such as C language, C ++, C #, Objective-C, Swift, Java (registered trademark), etc. It can be implemented using a markup language such as HTML5.

500 article provision system 400 user 100 server (information processing apparatus)
200 store 220 communication means 300 terminal device 110 control unit 111 acquisition unit 112 detection unit 113 article determination unit 114 user determination unit 115 settlement unit 116 restriction unit 117 setting unit 118 display output unit 120 communication unit 121 reception unit 122 transmission unit 130 storage unit 310 control unit 311 information processing unit 312 display processing unit 313 determination unit 320 communication unit 330 storage unit 340 input reception unit 350 display unit 370 speaker 321 reception unit 322 transmission unit 95 authentication device 50 product 80 product shelf 60 floor sensor 10 shelf pressure sensor 20 TOF sensor R1 walking locus 80A product shelf C1 point P1 walking position 30 line of sight sensor 40 human sensor 70 shelf floor sensor 400H hand 133 user information table 131 T settlement information table 131 settlement storage unit 90 settlement area 1 4 settlement history table 132E table 131E settlement information table

Claims (11)

An acquisition unit that acquires identification information associated with a user who has entered a predetermined space;
A detection unit for detecting at least a walking trajectory of the user in the predetermined space;
An item determination unit that determines whether or not a predetermined change has occurred in a display place where an item in the predetermined space is displayed;
Settlement information on settlement of goods displayed in the display place determined to have the predetermined change based on the display place determined to have the predetermined change generated by the item determination unit and the walking locus A user determination unit that determines identification information to be associated with
A payment storage unit that stores, for each identification information determined by the user determination unit, at least one piece of settlement information associated with the identification information;
A settlement unit that executes settlement based on the settlement information stored in the settlement storage unit;
An information processing apparatus comprising: The article determination unit determines that a predetermined change has occurred when the weight after change in the display place where the product is displayed becomes smaller than before change.
An information processing apparatus according to claim 1, characterized in that. The article determination unit determines that a predetermined change has occurred in the display place where the goods are displayed, when the shape of the displayed group of goods after change is smaller than that before the change.
The information processing apparatus according to claim 1 or 2, characterized in that: The user determination unit identifies the position at which the predetermined change has occurred in the walking trajectory is associated with the user within a predetermined range from the display place determined to cause the predetermined change. The information is determined as identification information to be associated with settlement information on settlement of a product displayed at a display place where it is determined that the predetermined change has occurred.
The information processing apparatus according to any one of claims 1 to 3, characterized in that: And a limiting unit configured to control limiting means for limiting the exit of the user to the predetermined space,
The restriction unit cancels the restriction on the leaving of the user from the predetermined space associated with the identification information for which the settlement unit has performed the settlement.
The information processing apparatus according to any one of claims 1 to 4, characterized in that: It further comprises a user storage unit that stores identification information associated with the user in association with identification information that identifies the user,
The acquisition unit acquires identification information associated with the specific information transmitted from the terminal device of the user who has entered the predetermined space from the identification information stored in the user storage unit.
The information processing apparatus according to any one of claims 1 to 5, characterized in that: The user further comprises a setting unit configured to set temporary identification information for the user entering the predetermined space,
The acquisition unit acquires temporary identification information set by the setting unit.
The information processing apparatus according to any one of claims 1 to 5, characterized in that: The display output unit is further configured to output display information for causing the display unit of the terminal device corresponding to the identification information associated with the payment information to display the payment information associated with the identification information.
The information processing apparatus according to any one of claims 1 to 7, characterized in that: In the information processing apparatus,
An acquisition step of acquiring identification information associated with a user who has entered a predetermined space;
Detecting at least a walking locus of the user in the predetermined space;
A product determination step of determining whether or not a predetermined change has occurred in a display place where the product in the predetermined space is displayed;
Settlement related to the settlement of the product displayed in the display place determined to have the predetermined change based on the display place determined to have the predetermined change in the product determination step and the walk locus A user determination step of determining identification information to be associated with the information;
A settlement storage step of storing at least one piece of settlement information associated with the identification information for each of the identification information determined in the user determination step;
A settlement step for executing settlement based on the settlement information stored in the settlement storage step;
Control method of the information processing apparatus. In the information processing apparatus,
An acquisition function of acquiring identification information associated with a user who has entered a predetermined space;
A detection function for detecting at least a walking trajectory of the user in the predetermined space;
A product determination function that determines whether or not a predetermined change has occurred in a display place where the product in the predetermined space is displayed;
Settlement information on settlement of goods displayed at the display place determined to have the predetermined change based on the display place determined to have the predetermined change generated by the product determination function and the walking locus A user determination function that determines identification information to be associated with
A payment storage function that stores at least one piece of payment information associated with the identification information for each identification information determined by the user determination function;
A settlement function for executing settlement based on the settlement information stored in the settlement storage function;
Control program for an information processing apparatus that realizes A reading unit that reads identification information associated with a user who has entered a predetermined space;
A first detection unit for acquiring data of at least a walking trajectory of the user in the predetermined space;
A second detection unit that acquires data regarding a predetermined change that has occurred in a display place where the product in the predetermined space is displayed;
A transmitter configured to transmit data on the walking trajectory and data on the predetermined change to a predetermined information processing apparatus;
A restriction unit for restricting the exit of the user from the predetermined space;
A receiving unit that receives information instructing cancellation of the restriction of the restriction unit;
An article providing system comprising:

Images