JP2014211908A - Electronic shopping system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system that utilizes actual images of a virtual store on the Internet so that customers can browse the store and select goods and that is then transferred from the selected goods to an existing electronic shopping purchase system.SOLUTION: A client computer is provided with, current position specifying means 101 for specifying a current position in a virtual store, in-store image display means 102 for displaying images from the current position in the virtual store on a screen or display or in-store image display means 107 for displaying based on moving images, and character information recognizing means 106 for selecting goods from the images, so that the selected goods data is transferred to an existing electronic shopping system (a server 2).

Description

The present invention relates to an electronic shopping system in which a client computer is connected to a server and a virtual in-store video is provided to the client computer.

Conventionally, in Internet shopping, a server is accessed from a client computer via the Internet, and a desired product is selected on a home page provided from the server. In selecting this item, the user must first enter product information in the search item, and the purchase product cannot be reached unless the product to be purchased is specified to some extent.
In addition, the number of products that are extracted and selected from the server after the search is started and the related products are limited in the number of displays in the screen display, and products can always be selected only within a narrow range of types. If there is no desired product on the displayed screen, the next candidate is displayed again on the next screen from the search again, and the operation of narrowing down the product is repeated or new product information is entered into the search item. There wasn't. And these systems were completely different from the actual situation in the store, and it was not possible to go around the store or make impulse purchases.
Therefore, Patent Document 1 describes means for solving such a problem. In the technology described in Patent Document 1, a client computer is connected to a server including data in a virtual store and data in which product information is stored, and a client user operates the client computer to operate the server. The virtual store video read from the database is displayed on the screen of the client computer in response to the user's movement and added to the purchase file, so that the client can enjoy the atmosphere of actually going around the store, and is an important factor in shopping This is an electronic shopping system that can be used for impulse buying.

JP 2007-122248 A

However, the purchase system in this case does not need to set the product selection area category when selecting the product in the virtual store image read from the server database on the client computer and associate the category with the product information. However, when changing the product display, there is a problem that the shelf classification must be reset and associated with the product for registration. In addition, since there is a limit to the category setting for the displayed product, there is a problem that the associated product information is also limited. For example, even when there is product information data of an existing electronic shopping system, the purchase system cannot directly match the selected product data with the existing product information data. There is a problem that it must be re-searched by transplanting to the search item of the product information database.
In addition, an effective method has not been developed for forward / backward movement and side image movement in the virtual store.

An object of the present invention is to solve such problems, and a client computer and a server having in-store video storage means for storing in-store video information are connected via a network, and the above-described client computer is provided. In the electronic shopping system for selecting and purchasing a desired product from the video in the virtual store displayed on the screen, the client computer includes a current location designating unit for designating a current location in the virtual store and a virtual screen on the screen of the client computer. In-store video display means for displaying in-store video, product zoom means for zooming and displaying the product group on the screen in order for the client to select a product from the virtual store video, and the client wishing from the zoomed product group Specified by the product specification means for specifying the product to be Character information recognition means for reading the title of the product as character information, and character information transmission means for transmitting the character information read by the character information recognition means to the server, the server storing the video in the virtual store In-store video storage means, video transmission means for transmitting the virtual in-store video called from the in-store video storage means to the client computer, a database in which titles as product information are stored as character information, and sent from the client computer Search means for receiving the title of the character information and retrieving information on the product having the same title as the title from the database, and product information transmission means for sending the product information extracted by the search means to the client computer; The virtual in-store video of the client computer Based on the video transmitted from the video means of the server, displayed on the client computer, the client computer further displays product information sent from the server on the screen and purchase means for determining purchase The product purchase transmission means for transmitting the determination by the purchase means to the server is provided. The client computer has a hardware configuration of a normal computer such as a CPU, a storage device, and an output device. The server also has a normal computer hardware configuration such as a CPU, a storage device, and an output device.

In the present invention, a client computer and a server having in-store video storage means for storing virtual store video information are connected via a network, and a desired product is selected from the virtual store video displayed on the client computer. In the electronic shopping system to be purchased, the client computer includes a current position designating unit for designating a current position in the virtual store, an in-store video display unit for displaying the video in the virtual store on the screen of the client computer, and the client virtually Product zoom means for zooming the product group and displaying it on the screen in order to select a product from the in-store video, product designation means for designating a product desired by the client from the zoomed product group, and the product designation means described above Video transmission means for transmitting an image of the product designated by The server stores in-store video storage means for storing the virtual in-store video, video transmission means for transmitting the virtual in-store video called from the in-store video storage means to the client computer, and the product title from the product image. Character information recognition means to be read as information, a database in which character information read by the character information recognition means is stored as character information, and a search for extracting information on products having the same title as the title from the database And product information transmitting means for transmitting the product information extracted by the search means to the client computer, and the video in the virtual store of the client computer is also included in the video transmitted from the video means of the server. And displayed on the client computer and the client The computer may further include a purchase unit that displays the product information sent from the server on the screen, determines purchase, and a product purchase transmission unit that transmits the determination by the purchase unit to the server. .

If the title of the product selected from the image of the virtual store shelf displayed by the in-store video display means cannot be read using the character information recognition means, an error display is displayed in the item for displaying the title read by the character recognition means Preferably, an error is displayed by the means, and when the error is displayed, the character information of the product title input by the client by the input means is transmitted by the transmitting means.

Product title display and barcode reading means that can be read by the character information means on the product display plate on which the product information installed on the product display shelf is selected after the product is selected from the image on the in-store video display screen by the in-store video display means The client may be configured to be able to select whether the product title is read by the character information recognition means or by the barcode reading means. When the client desires display by the character information recognition means, the method is the same as before. However, when the barcode reading means is desired, the barcode reading means reads the barcode data of the client computer. The data transmitting means transmits the received bar code data from the product database managed by the bar code information to the client computer, and the server transmits the product data to the client computer by the data transmitting means. Display on the video display screen.

The database in which the product information of the server is stored can be an existing shopping database whose search item is the title as character information. The passage of the virtual store video of the server is divided into a plurality of blocks in the front-rear direction, and the store video storage means of the server stores the virtual store video in association with each block. Can be configured. The in-store video storage means of the server may store four images of front, rear, left and right for each of the blocks. The in-store video display means of the client is configured to refine and display the in-store video based on four images of the block received from the server when the client is located in a specific block. it can. The in-store video storage means of the server can store images expressed by perspective as front and back images, and can store direct view images as left and right images. The forward image stored in the in-store video storage means by the server is a forward perspective image viewed from the rear end of the block, and the rear image is a rear perspective image viewed from the front end of the block. When the client moves in the block, the image is enlarged or reduced according to the moving distance, and the side surface is a side image from the front end to the rear end of the block, and moves in the block. When the block is located in the center of the moving direction, the side screen of the block will be displayed as it is, and if it moves beyond that, the display range will move according to the amount moved. The side image of the adjacent block correspondingly is fetched by the client computer from the in-store video storage means of the previous term server, and is displayed by the in-store video display means. The in-store video display means the client enlarges the front image from the rear end of the block and moves forward, and when the image overlaps the front image at the rear end of the next block, or from the block at the current position When straddling the next block in the direction of travel, this movement information is transmitted to the server side, and when the server receives this movement information, it is moved from the in-store video storage means of the server to the next block beyond the distance the client has moved. There is a video transmission means for calling up and transmitting the associated four image data to the client computer. The client computer stores the image data of this block in the memory, and thereafter based on the three blocks, based on these. Since it is configured by refining the image, (However, the image of the side can also be a single shelf for one row ) The memory load on the client computer will be lighter, and it will be possible to move forward and tour without stress as if walking in the actual store, and it will allow shopping while moving as well as the situation in the store from front to back and left and right I can do things.

Alternatively, rails in which the camera moves from the rear end to the front end of each passage are provided in an actual store passage, and the store image storage means of the server stores the virtual store image in association with each rail. Can be configured. The in-store video storage means of the server may store four moving images of front, rear, left, and right for each of the rails.
The in-store video display means of the client can be configured to refine and display the in-store video based on the four videos of the rail received from the server when the client is located on a specific rail. . The in-store video storage means of the server can store moving images taken from the rear end to the front end of the passage as front, rear, left and right images.
The moving image stored in the in-store video storage means by the server is, for example, a moving image taken while moving four moving images of front, rear, left and right from the rear end to the front end of the passage when the camera takes a passage. When the client moves forward in the passage, the front moving image of the camera is used, and when the client changes the direction backward, the moving image behind is reversed. Then, when moving forward in the lateral direction, play a video of the camera facing left or right, and when moving backward in the horizontal direction, turn sideways. It consists of using the video of the camera that was used for reverse rotation.

The rail of the camera moving in the store of the store video means can be a guideline such as a magnetic tape provided on the lower side of the camera.

The in-store video display means that when the client “plays” the video on the screen in front of the rail and moves forward and collides with the crossing rail, the client can select either the current rail or the crossed rail, and the new crossing When the selected rail is selected, the rail change information is transmitted to the server, and when the server receives the rail change information, the server transmits the image data to the client computer by calling the crossed rail data from the in-store video storage means. Since the client computer is configured by storing new data in the memory and refining the moving image based on these, the client computer can move on the screen to use the moving image. The movement is also smooth, and a shoppin that is closer to excursions in an actual store (real store) It can allow the shape of.

In addition, the passage rail is a classification of video and video, and even if you do not ride on that rail, if you are equipped with four cameras on the front, back, left and right, and if it is a self-propelled imaging device, the line corresponding to the rail is classified into data It can also be taken as.

The rail of the camera moving in the store of the store video means can be a guideline such as a magnetic tape provided on the lower side of the camera.

In the present invention, by recognizing the title of the product in the virtual store image by the character information recognition means, it is possible to carry out with the product quantity and display situation closest to the actual actual store shape, and character information recognition By simplifying the system using the means, the existing system can be used as it is, making it easier to use than before, making it cheaper, and making it possible to configure electronic shopping that matches the user's thoughts. .
In addition, the virtual store video can be shopped while moving around the actual store by moving forward and backward on the screen of the client computer and moving the side shelf image and zooming in and out.

It is a block diagram in embodiment of the electronic shopping system of this invention. It is a flowchart figure of the goods purchase procedure in this invention. It is a (monitor) display screen of the client computer in this invention. It is a (monitor) display screen of the client computer in this invention. It is a front screen of a client screen at the time of employ | adopting the block in this invention. It is a top view regarding the screen movement of the front of a client at the time of employ | adopting the block in this invention, and a side. 1 is a block diagram of an electronic shopping system according to an embodiment of the present invention. (The character information system is on the client computer side) It is explanatory drawing of a coordinate axis at the time of employ | adopting the block in this invention. It is a structure display figure of the shop image display means at the time of employ | adopting the block in this invention. It is the initial image of each block at the time of employ | adopting the block in this invention. The block replacement figure by the movement of the client at the time of employ | adopting the block in this invention. It is a figure explaining operation | movement at the time of employ | adopting the block in this invention. It is an expanded view of a front screen and a side screen when moving forward through a block when the block according to the present invention is employed. It is explanatory drawing of the zoom means in this invention. It is explanatory drawing of the goods designation | designated means (focus) in this invention. It is explanatory drawing of the goods data transmission means in this invention. 1 is a block diagram of an electronic shopping system according to an embodiment of the present invention. (The character information system is on the server side) It is a passage rail at the time of employ | adopting the moving image in this invention, and a coordinate diagram. It is a figure explaining the operation | movement at the time of employ | adopting the moving image in this invention. It is a keyboard reading means figure by the character information recognition means error in this invention. It is a selection figure of the character recognition means and barcode reading means in this invention. It is a guideline of a camera in the present invention and a PC mounting diagram. It is a goods plate figure in the present invention.

The network configuration (floorbook view) of the present invention will be described with reference to FIG.
A server 3 is connected to a network 1 such as the Internet, and a server 2 is connected to the server 3.
The server 2 is an existing shopping system having a database in which product information is stored, and a product sales system is provided by the server 3.
The client computer 4 is connected via the network 1 and can access the server 3 via the network 1.

Next, the case of purchasing a product using the client computer 4 will be described with reference to the product purchase procedure flowchart of FIG. 2 and the computer display screens of FIGS.

When a client accesses the server 2 from the client computer 4, acquires a homepage from the server 2, and opens the homepage on the screen (step 1 in FIG. 2), a bookstore such as 000 bookstore as shown in FIG. 3 (1) The name is displayed, and the selection switch of the floor book view of the present invention described below is displayed on the right side of the bookstore name. When the cursor is moved to the switch of the floor book view and clicked, the server is clicked. 3 is accessed, and the display of each floor and the guidance for each floor are displayed (FIG. 3 (2)). For example, each floor display from the 1st floor to the 7th floor and the product genre contents of each floor floor are displayed. Move the cursor to the desired floor from there, and click to select the floor to move to Select (step 2 in FIG. 2).

When a floor is selected, an image of the designated floor selected by the screen operation appears (FIG. 3 (3)), which is a floor MAP corresponding to an actually existing store.
Initially, a pointer is displayed at a position (S) near the entrance of the floor MAP (step 3 in FIG. 2). The pointer indicates its own position in the virtual store, and the position of itself in the virtual store can be changed by moving the pointer. To move the pointer, move the cursor to the desired position while dragging the cursor to the pointer and drop it. The pointer is provided with a direction indicator, so that a desired direction can be selected from the position P of the pointer itself, and an image in that direction can be displayed. The direction indicator is composed of front F, back B, left L, and right R, and by clicking on any of them, the screen in that direction can be displayed.

For example, by clicking the part F, an image corresponding to the front direction is displayed in the actual store, and by clicking the part L, an image directed to the left is displayed in the actual store, and By clicking on the part R, an image facing right is displayed in the actual store, and by clicking on the part B, images when looking back in the actual store are respectively displayed ( Step 4 in FIG.

For example, dragging the pointer P from the S position with the cursor to the T position (see the virtual line in FIG. 3 (3)), dropping it, pointing and selecting F, and clicking, as shown in FIG. 3 (4) The in-store image when looking forward from the point T is displayed (step 4 in FIG. 2). The reduced version of the same floor MAP as above is displayed in the upper right of the screen in Fig. 3 (4). The current position of the client is indicated by an arrow. Return to the screen (FIG. 3 (3)).

A screen moving device H is installed at the lower center of the screen in FIG. 3 (4), and the screen moving device H here specifies the moving direction of the front F, back B, left L, and right R screens. With an indicator, for example F
Clicking on the part will display the image heading forward in the actual store, and clicking on the L part will display the video pointing to the left in the actual shop, and the R part By clicking, an image facing right is displayed in the actual store, and by clicking the portion B, images when looking back in the actual store are displayed.

Next, the front / rear / left / right movement in the store will be described with reference to FIGS.
The in-store MAP is divided into a plurality of blocks, and the block has four images, front, rear, left, and right. The front, rear, left, and right images viewed from the position in the block are the left and right images of the block when viewed from here. It is refined from the left and right images of a block that is present or adjacent to that block. The client simply stores in the client memory the block in which the client is located and its image data, and the blocks on both sides of the block in which the client is located and the image data on both sides thereof. When the client moves forward or laterally within the block from an arbitrary position, the image is displayed over a range of three blocks centered on the client.
When the client comes to a preset position in the range of 3 blocks, the client computer takes in the next block data from the in-store video storage means of the server, replaces one block, and proceeds to the next image with a 3 block configuration. .

For example, the front screen viewed from an arbitrary position by the client is represented in perspective, and the front screen viewed from the arbitrary position is an image by perspective viewed from the rear end of the block to which the client belongs (FIG. 5 (1)). In other words, the perspective image from the rear end is enlarged by the distance the client has moved from the rear end (FIG. 5 (2)) and displayed so as to fit on the screen of the client computer. (FIG. 5 (V)).
And when the screen of the magnification of the screen (FIG. 5 (W)) of the client computer of the image further enlarged in front (FIG. 5 (3)) coincides with the front image (FIG. 5 (4)) of the next block, Alternatively, the screen is switched when the client crosses the next block.
By repeating the above, the image is displayed as if it is moving forward in the passage.

Next, when viewed from the position of the rear end of the block X of FIG. 6, the side surface displays the range of FIGS. 6 (a) and (7). An image shifted forward is displayed. For example, the side surface when located in the middle of the front direction of the block X becomes the portion of FIGS. 6B and 8, and when located at the tip of the block X becomes the portion of FIGS. 6C and 9. .

The front screen and the side screen memorize the moving distance of the client, and based on that, the front is enlarged by the moving distance, and the side is moved in the horizontal direction within the range of the client's screen by the moving distance. And display.

If the amount of image data for one column on both sides of the shelf block can be stored in the display memory or a memory equivalent thereto in the client computer, the side shelf images are end-to-end in the three block image memories of the client computer. It is also possible to use a system in which only one block width is displayed around the display position.

Next, returning to FIG. 3, in FIG. 3 (4), when the turn indicator H is used and the L or R switch is pressed to turn to the side, the screen shown in FIG. 3 (5) is displayed. In the center of H, the switch to display the front F of the direction indicator so far is changed to the upper U, the rear B is changed to the lower D, and the zoom switch Z, the focus switch Fo, and the switch C for canceling the focus. If E is attached and the switch E is clicked with a cursor, it will move to the screen of FIG. 3 (6) which displays said switches. And the direction indicator H is installed in the center lower part also in FIG.
Specifies the direction of movement of the upper U, lower D, left L, and right R screens. Further, the shelf can be moved in the horizontal direction by using the left L and right R switches of the direction indicator H.

The screen moving device H in FIG. 3 (6) displays, for example, an image corresponding to moving up in the actual store shelf by clicking on the U portion, and clicking on the L portion. The image moved to the left in the actual store is displayed, and by clicking on the R part, the image moved to the right in the actual store is displayed, and clicking on the D part actually Images are displayed when they move down on the store shelves.
In FIG. 3 (6), an adjuster Z for zooming by the zoom means is shown in FIG.
It is displayed at the lower right of the screen, and it has a scale between zoom + and zoom-in with respect to the center of the screen. There is a knob on the scale. When dropped, the enlargement / reduction can be adjusted, and the target product can be selected by expanding the shelf of the target genre (step (5, 6 in FIG. 2)).

Further, there are a focus switch Fo and a cancel switch C in the lower right of FIGS. 3 (6), 4 (7) (8) (9), and the focus switch Fo displays the title of the product selected above as character information. This is a switch for displaying the focus area M on the screen, which is a guideline for the size until it is recognized by the recognition system. The size of the product title is adjusted with the zoom switch Z according to the focus area M. The height is adjusted (FIG. 4 (8), FIG. 2 step (7, 8)).
When the focus switch Fo is double-clicked, the character information recognition system starts.

For example, when the client finds a desired product from FIG. 3 (6), the product is adjusted with the screen moving device H so that the product is in the center of the screen, and the product is adjusted with the zoom adjuster at the lower right of FIG. 3 (6). The product can be enlarged and selected (step (6) in FIG. 2, FIG. 4 (7)). Also in FIG. 4 (7), there are a focus switch Fo and a cancel switch C at the lower right of the screen. The focus switch Fo uses a character information recognition system to display a focus area M for recognition. And adjust with the zoom switch Z according to the area M.

When the character information cannot be read, the error display means may be configured in the server so that an error display appears in the item G of FIG. In this case, the flow chart shown in FIG. When a product is selected from the image of the in-store video display means, the title of the product is zoomed and read by the character information recognition means (step 1 in FIG. 20), and the character data of the product title is read by the character information recognition means (see FIG. 20 step 2), the character information is displayed in the reading item G (step 3 in FIG. 20), and after confirming the actual video, the confirmation button is pressed (step 4 in FIG. 20). When the character information recognition means cannot read the character data of the product title (step 5 in FIG. 20), the error display means displays an error in the read display item G (step 20 in FIG. 20). 6) Therefore, the characters corresponding to the actual product title are input with the keyboard of the client computer and the confirm button is pressed (FIG. 2). Step 7) and to transfer the commodity title data to the search item of the existing shopping system.

The store shelf image selected from the store image display means (FIG. 23 (1) and FIG. 21 (1)) is displayed, the product display shelf selected from among them is designated (FIG. 23 (2) and FIG. 21 (2)), The title of the product (for example, the name of a food product) installed on the product display shelf will be zoomed and read by the character information recognition system. Instead of selecting the title as it is, a product display plate is installed and the product is displayed. On the display plate, a product title and barcode product information installed on the product display shelf are described. When the character information reading means is selected in the client selection, the title of the product can be zoomed and read in the focus area (FIG. 21 (4)), and the character information product data can be transmitted to the server (FIG. 21 ( C) The server receives the character information product data transmitted from the client computer, compares it with the product data memory, and transmits the product data to the client computer (FIG. 21D). Confirm the product title item on the recognition screen while viewing the actual product image, and then press the confirm button to move to the existing shopping system.If you select the barcode reading method in the client selection, zoom the barcode display. Read in the focus area (Fig. 23 (3), Fig. 21 (6)
The barcode product data can be transmitted to the server (FIG. 21A), and the server receives the barcode product data transmitted from the client computer, compares it with the product data memory, and stores the product data in the client computer. (FIG. 21 (B)) The client confirms the product title item on the barcode recognition screen with the store shelf image while viewing the image of the actual product, and shifts to the existing shopping system with the confirm button (FIG. 23 ( 4) FIG. 21 (7)).

When the product is enlarged and confirmed whether it is the target product or not, when the Fo switch at the lower right of FIG. 4 (7) is clicked with the mouse, a focus area M is displayed as shown in FIG. With the direction indicator of Z and the screen moving device H, adjustment is made so that the product image enters the focus area M (step (8) in FIG. 2). When the title of the product is within the focus area M for character information recognition, double-click the focus switch in the lower right of Fig. 4 (9) to recognize the image data of the product by the character information recognition system. The product title is displayed on the right center G of the live-action video on the display screen (10) in FIG.

The product title G recognized by the character information displayed on the display screen of FIG. 4 (10) is compared with the product title of the live-action video, and if the character information recognition is correct, the confirmation key is clicked (step (9 in FIG. 2) )). Then, the product title data of FIG. 4 (10) G is transmitted from the client computer to the search items in the home page in the existing electronic shopping system in the server 2 by the product transmission means (FIG. 16) via the network, and the data 4 (step 10 in FIG. 2), the search is started by the search means of the existing electronic shopping system, and the product information obtained by sending the extracted product information to the client computer by the transmission means is shown in FIG. The screen display means displays the search result (step (10) in FIG. 2).

Finally, in step (11) in FIG. 2, when the client decides to purchase by looking at the screen, he / she decides to purchase the merchandise by putting the merchandise in the cart according to the existing electronic shopping system.

When the character information cannot be read, the error display means may be configured in the server so that an error display appears in the item G of FIG. In this case, the flow chart shown in FIG. When a product is selected from the image of the in-store video display means, the title of the product is zoomed and read by the character information recognition means (step 1 in FIG. 20), and the character data of the product title is read by the character information recognition means (see FIG. 20 step 2), the character information is displayed in the reading item G (step 3 in FIG. 20), and after confirming the actual video, the confirmation button is pressed (step 4 in FIG. 20). When the character information recognition means cannot read the character data of the product title (step 5 in FIG. 20), the error display means displays an error in the read display item G (step 20 in FIG. 20). 6) Therefore, the characters corresponding to the actual product title are input with the keyboard of the client computer and the confirm button is pressed (FIG. 2). Step 7) and to transfer the commodity title data to the search item of the existing shopping system.

After that, the in-store shelf image selected from the in-store image display means (FIG. 23 (1) and FIG. 21 (1)) is displayed, and the selected product display shelf is designated (FIG. 23 (2) and FIG. 21 (2). ), The title of the product installed on the product display shelf (for example, the product name of food) will be zoomed and read by the character information recognition system, but instead of selecting the title as it is, a product display plate is installed, On the product display plate, a product title and barcode product information installed on the product display shelf are described. When the character information reading means is selected in the client selection, the title of the product can be zoomed and read in the focus area (FIG. 21 (4)), and the character information product data can be transmitted to the server (FIG. 21 ( C) The server receives the character information product data transmitted from the client computer, compares it with the product data memory, and transmits the product data to the client computer (FIG. 21D). Confirm the product title item on the recognition screen while viewing the actual product image, and then press the confirm button to move to the existing shopping system.If you select the barcode reading method in the client selection, zoom the barcode display. Read in the focus area (Fig. 23 (3), Fig. 21 (6)
The barcode product data can be transmitted to the server (FIG. 21A), and the server receives the barcode product data transmitted from the client computer, compares it with the product data memory, and stores the product data in the client computer. (FIG. 21 (B)) The client confirms the product title item on the barcode recognition screen with the store shelf image while viewing the image of the actual product, and shifts to the existing shopping system with the confirm button (FIG. 23 ( 4) FIG. 21 (7)).

Next, a more detailed processing procedure between the client computer and the server of the system of the present invention will be described with reference to FIG.
FIG. 7 is a block diagram of an electronic shopping system according to an embodiment of the present invention. On the client computer side, the current position specifying means 101 in the virtual store, the in-store video display means 102 for displaying the in-store video viewed from the specified current position, and the zoom for selecting the product by zooming the video Means 103, display means 104 for displaying it on the client computer, product designation means 5 for focusing the product on the displayed screen and designating the title of the product, and character information for reading the designated title as character information It has a recognition means 106, a display means 107 for displaying the recognized character data on the client computer, and a title transmission means 108 for confirming the displayed title and transmitting it to the server 2. Share data with each other or send it directly from the client computer to the server 3 The product information transmission means 111 for starting the search and transmitting the search result to the client computer by the character data transmitted by the subject title transmission means 108 is further provided on the client computer side, from the received search result data. A purchase unit 112 for determining purchase of a product and a purchase transmission unit 113 for transmitting purchase data are included. Here, the character information recognizing means is configured in the client computer, but may be configured in the server 3.

In the store video display means 102, when the target floor is designated from the input device of the client computer, the floor is transmitted to the server 3. The server 3 calls the store block MAP on the designated floor from the databases 1 and 2, and the client computer. Send to. Then, the client displays the in-store MAP on the designated floor transmitted from the server 3 on the client computer,
The coordinate position of the starting point of the MAP from the input device on the client computer (
8), the block for the current position designated by the selection is designated, and the position information is transmitted to the server 3. The server 3 calls the image corresponding to the block designated from the in-store video storage means 114 of the databases 1 and 2 and transmits it to the client computer. indicate. (See Figure 9)

Here, the block is a unit having an image, and the server sets all the blocks along the passage of the in-store layout map and stores them in the in-store video storage means. In addition, a block is a space that represents a certain position, and there is always a video, and when there is a specified position in the block, that block or its adjacent block is specified as a reference. The image viewed from the determined position is determined. When moving forward, for each block, the perspective video data taken by the camera from the rear end, which is the block start position, is input to the block memory and set in the block MAP of the server (see FIG. 10 block initial images X, Y, and Z), within the specified block, enlarge the perspective image viewed from the rear end of the block that is the initial image, and cross over the next block, some video Even if there is a deviation, the next initial image moves to the perspective image seen from the rear end of the block.

Next, each block image will be described with reference to the block diagram 11. The block X at the current position is based on the passage and is front H and shelf B, E, rear G The four images are set as one block, and the block is set for all the in-store layout MAP (Fig. 1).
1 (1)). When the client moves in the store, the current position where the client is located is set by the coordinate position (FIG. 8), and the client is at that position, centering on the image of the block to which the client at that position belongs. The visible image is determined. Then, in the memory of the client computer, if the block belonging to the position designated by the coordinate position is the current position of the in-store MAP, the image of 3 blocks (Y · X · M) including the designated block is included. Stored in the screen display memory of the client computer. From among the three blocks, the front image H of the aisle and the rear image G on the opposite side, the images of the right shelves A, B, C and the left shelf images D, E, F are blocked in front of the aisle Hereinafter, image zoom, shelf movement, and switching to the next image used as an image are processed in the client computer (see FIG. 12).

In FIG. 11, when the client moves forward in the block X, the screen is changed by enlarging the front screen H. (The front screen H is a perspective image viewed from the rear end of the block). For example, when the client is located at the forefront (rear end) of the block X, the front perspective image H is displayed as it is on the screen of the client computer, and the client is at the block X and there As the camera advances forward, the front perspective image H is enlarged according to the degree of advancement, and only the amount that enters the client screen is displayed. When the position of the client advances and straddles the next block, or when the front screen H of the current position block X is enlarged and zoomed forward, the enlarged image of the front screen H becomes the front screen I of the next block Y. And the front screen H is replaced with the front screen I of the next block (again, the front screen I is a perspective image viewed from the rear end of the block). Then, the block M disappears from the stored memory, and the data of the block Z is newly acquired from the in-store video storage means in the server and stored in the display memory of the client computer. (Fig. 11 (5)) In this way, when the client advances the block and straddles the next block on the screen of the client computer, the front screen of the current position block is enlarged and overlapped with the front screen of the next block. At this time, one block data is always acquired from the server, and the subsequent block M is deleted simultaneously (virtual line in FIG. 11 (5)). When the client is positioned at the center of the block X in (FIG. 11 (3)) and the side shelf image B (FIG. 11 (3)) is specified on the computer screen, It is a part of a set of three block shelves (A / B / C) used in computer memory. (
FIG. 11 (2, 3, 4) Here again, the side block image data follows the block replacement by the advance of the client. Then, the client can freely move within the image using the screen moving device and zoom in the screen of the computer, and can select the target product by scaling up and down (see FIG. 12).

As described above, since the next block data is already stored in the memory of the client computer by the block replacement of the system due to the movement of the client, it is not necessary to transfer from the server each time, and the same image of the next block is stored. It appears smoothly (see FIG. 12).

Next, if the client moves forward on the screen, the perspective initial image (the perspective front image viewed from the rear end of the block where the client is currently located) is zoomed by the distance moved. The side view is displayed by shifting the direct view image to the side by the distance the client has advanced on the screen. These are linked to the moving distance of the client, and are set in the client computer. By repeating the movement in the block and the movement for each block, it is possible to feel as if the store is moving forward (see FIG. 12).

For example, when advancing the passage in the display screen FIG. 3 (4), if the portion of the direction indicator F of the screen moving device H is continuously dragged, as shown in FIG. 6 and FIG. Initially, a front initial screen (FIG. 6, FIG. 5 (1)) from the rear end of the block X is displayed. If the screen is enlarged by the amount moved by the client, an image (FIG. 5 (2)) is obtained, and the screen size of the client computer does not change, so the computer screen (FIG. 6 (b) in the enlarged image FIG. 5 (2). ) V. FIG. 5 (V)) is displayed. When the vehicle advances in this way, the initial image is enlarged by the amount of advance, and an image in a predetermined range (with a size that fits in the display of the client computer) is displayed on the display centering on the center of the enlarged image. If this process is repeated continuously, the image on the display will gradually increase as you move forward, so you can feel the progress.
Each block has an initial screen, and the enlarged image when proceeding to the next block matches the initial image of the next block. Then, the computer screen (FIGS. 6C, 5W, and 5W) in the screen (FIG. 5 (3)) obtained by zooming in on the front screen of block X is the front screen of FIG. c) When overlapped with 4 and FIG. 5 (4), or when the client moves forward and straddles the next block, the front screen of block Y (FIG. 6 (c) 4 and FIG. 5 (
The above server is configured to shift to 4)). (See Figure 13)

Next, the relationship between the side screen and the forward image will be described with reference to FIG. 6 (a). On the screen (1) of the client computer, when the turn indicator on the screen is used to turn to the side shelf screen, the still image of the side shelf is displayed. Is displayed based on the data from the side shelf images A ′ to B in FIG. 6A. The screen is centered on the position where the client turns in the screen. FIGS. 6A and 7 are displayed within a predetermined range that fits on the screen. In this case, the “predetermined range that fits on the screen” refers to the side view, the basic image shows from the top of the shelf to the flat display product under the shelf, and the side is based on the average shelf width in the store. To do. And this time, when the client turns the screen to the side shelf screen with the direction indicator on the screen when the client moves forward (FIGS. 6B and 6V), the screen is displayed from the shelf screen of FIGS. An image in which the client has moved to the shelf screens 6 (b) and (8) is displayed (see FIG. 13). And FIG.
The screen (FIG. 6 (c) / FIG. 5 (W)) obtained by further enlarging the front screen of the block X in FIG. When the client turns to the side shelf screen with the direction indicator on the screen (FIG. 6 (c) / FIG. 5 (4)), the shelf screen is changed from FIG. 6 (b) (8) to FIG. (C) Move to (9).

Then, for example, in FIGS. 6A, 6B, and 6C, when the front screen (1) of the block X is enlarged by (1 · V · W) by the distance the client has moved, The shelf image is shifted to the side by the moving distance of the client again like the image of (7,8,9) shelf, and the front image is enlarged by the amount that the client has moved forward, and the next block When the position advances to the start position, the next block screen (FIG. 6 (c) (4)) is displayed at a position where the image overlaps the screen of the next block (FIG. 6 (c) (W)) or a position across the next block. At this point, the data of block Z is automatically downloaded and stored in the memory of the client computer from the server.

Further, the image data of the block X is obtained by linking the enlargement magnification of the front initial screen and the movement distance of the side screen by perspective from the rear end with respect to the moving distance of the client, and the initial image is set to the next set in advance. When the block overlaps the initial image from the rear end of the block or when the client crosses the next block, the block is set so that the image data is fetched from the server database to the image display memory of the client computer. Even if it moves to the next screen, there is no need to transfer from the server each time, and the operation is performed smoothly. By repeating the above, on the aisle screen of the display screen FIG. 3 (4)), images when proceeding forward in order are displayed, so the client advances the aisle while checking his / her position and walks through the store. You can travel around as you go (see Figures 12 and 13).

If the amount of image data for one column on both sides of the shelf block can be stored in the display memory or a memory equivalent to it in the client computer, the shelf image is used as one image from end to end, and each section It is also possible to combine the system in which only the previous and next images are zoomed on the initial screen of the block as described above and changed to the initial image of the next block at the last position in the block (see FIGS. 12 and 13). .

Next, since the zoom means in FIG. 14 (1) is set so that the center of the client computer screen becomes the standard center for zooming the screen, for example, the product can be obtained from the target shelf, the image of FIG. 3 (6). When the selection is made, the target product is adjusted so as to be at the center of the screen by the screen moving device, and enlarged by the zoom switch, FIG. 4 (7) is displayed. The store block video stored in the database 2 is composed of high-quality photographic video, and the server 3 places the target product at the center of the image and stretches the video around that video. It can be processed and displayed on the client computer. The enlargement can also be performed on the client computer side.

FIG. 15 (1) The product designation means (focus) uses the in-store shelf zoom screen of FIG. 4 (8) displayed on the client computer described above and uses the character information recognition means in the client computer for the title of the target product. Then, the area setting M for reliably reading the characters as data is set, and the zoom switch Z is used to adjust the area (FIG. 4 (8, 9)).

The character information recognition means in FIG. 15 (2) is the product designation means displayed on the client computer in FIG. 15 (1), and the title of the designated product is the title of the product in the character information recognition engine in the client computer. The character information is extracted and the data is displayed on the client computer by using a display means. The character information recognition engine stores the shape of the target character as data, and the data is stored in the target computer. It is equipped with an engine that applies to the shape of characters, and uses them to extract the character information and product data of the target from various forms.

When the client confirms the character information data displayed on the client computer shown in FIG. 15 (2), the character information data shown in FIG. 4 (10) is transmitted to the search item of the existing shopping system of the server 2 this time. The existing shopping system 2 searches the received character information data from the database by the search engine and transmits the search result to the client computer (FIG. 4 (11) (FIG. 16). The client computer sends the data to the existing electronic shopping system. And purchase the product by the purchasing means in the above system.

Next, a detailed processing procedure between the client computer and the server of the system of the present invention when the character information recognition means is on the server side will be described with reference to FIG.
FIG. 17 is a block diagram of an electronic shopping system according to an embodiment of the present invention. On the client computer side, the current position designation means 1 in the virtual store, the in-store video display means 2 for displaying the in-store video viewed from the designated current position, and the zoom for selecting the product by zooming the video Means 3, display means 4 for displaying it on the client computer, product designation means 5 for focusing the product on the displayed screen and designating the title of the product, and product for transmitting the designated title to the server 3 The server 3 transmits the recognized character data to the client computer by the character information recognition unit 7 that reads the title of the product sent from the client computer as character information. This time, the server 2 has a display means 8 for displaying the character data sent from the server 3 to the client computer and a product title transmitting means 6 for confirming the displayed title and transmitting it to the server 2. In the search item, data is shared with the server 3 or transmitted directly from the client computer to the server 3, and the search means 10 starts the search with the character data transmitted by the title transmission means 8 of the client computer, and the search result is displayed. A product information transmitting unit 11 for transmitting to the client computer is provided, and the client computer side is further configured by a purchasing unit 12 for determining the purchase of the product from the received search result data and a purchase transmitting unit 13 for transmitting the purchase data.

Next, another system for in-store video will be described.
The in-store MAP is divided by passage rails along which each camera moves.
That is, in actual stores, passage rails are provided along which the camera moves along each passage. The camera moves along the aisle rail and shoots four videos, front, back, left, and right. The display screen of the client computer is configured to display four moving images, front, back, left, and right taken by the camera in accordance with the movement of the client.

Here, the rail of the camera moving in the store in the store video means is a guideline such as a magnetic tape provided on the floor of the passage displaying the shooting section. The camera shoots according to the guideline (FIG. 22A). The self-propelled camera is equipped with a PC (FIG. 22B), and the course can be designated in advance (FIG. 22C). In addition, the self-propelled camera transmits the captured video data to a floor main PC that is installed in advance by a wireless run (FIG. 22D), and the floor main PC transmits the data to the server using a line (FIG. 22). (E)). Also, in places where it is difficult to shoot with the camera in the store or where changes are frequently required due to product display, STAFF shoots from a predetermined angle with a digital camera (FIG. 22 (F)) and the data Can be input to the floor block data designated by the main PC using an SD card or the like (FIG. 22G).

For example, when the client moves forward in a certain passage, when the forward image is displayed, a forward moving image of the camera that has moved here is displayed, and when the client moves in reverse, the moving image behind the camera is displayed. Displayed by turning in reverse.
The current position of the client is a roller where the vertical and horizontal coordinate axes overlap, and either or both of them overlap the passage rail in the traveling direction and coincide with the moving image playback position of the client computer on that rail. When the client moves forward or backward in the passage rail from the current position or moves laterally in the lateral direction, the moving image is displayed over the range of the passage rail. When the client selects another aisle rail that comes and intersects the aisle position of the aisle rail (where the vertical and horizontal coordinate axes overlap the vertical and horizontal sides of the aisle rail), the client computer uses the in-store video storage means of the server. The data of the specified aisle rail is taken in, refined and displayed.

Referring to FIG. 18, the current position P of the client on the passage rail B is a position where the vertical coordinate axis 1 and the horizontal coordinate axis 2 overlapping the passage rail B intersect with each other toward the passage rail E (see FIG. 3 ( 4)) When the F of the screen moving device H is kept pressed, the moving image of the client computer moving toward the passage rail E “plays”, and when released, it “stops”. Then, if you press B, the front screen changes to the back screen, and if you continue to press F again, the screen that goes forward toward the aisle rail G will be "reproduced" in the reverse direction. Will be displayed.
Next, when the left L or right R switch is pressed, the screen changes to a shelf on the side, and the moving image captured while the image of the shelf moves from the rear end to the front end of the passage is the left L, right of the screen moving device. When R is held down, “play” and “return” are displayed, and when the switch is released, a “still” screen is displayed. By repeating the above, the image is displayed as if it is moving forward in the passage.

The operation within the page of the client computer will be described with reference to FIG.
The client computer accesses the in-store video storage means (8) of the database of the server, calls the designated passage rail from the passage rail data in which the in-store MAP is divided into passage rails, and associates the live-action image, and designates the designated passage rail. Accumulate in the video memory (6). The load frame (3) on the display screen of the client computer is the designated passage rail moving image memory (6) designated by the client in the moving image load frame memory in front (1) after (5) left (2) right (4) of the client computer. Is stored in the frame load frame memory in the front, rear, left and right, and displayed in the display frame load frame (3) of the client computer.

The product on the shelf may actually display the title of the product as in the above embodiment, but if not, the product information may be displayed with a price tag or the like in accordance with the present invention. Is possible.

1 network 2 server (existing shopping system)
3 servers (system of the present invention)
4 Client computer 101 current location designation means (store video in store)
102 In-store video designation means 103 viewed from the current position 103 Zoom means 104 Display means (zoomed product)
105 focus (product designation means)
106 character information recognition means 107 display means (characters recognized by the character information recognition means)
108 title transmission means (product information transmission means)
109 Search item received 110 Search means for searching received data 111 Sending means for transmitting search results to client computer 112 Purchase means for determining purchase of goods from received data 113 Purchasing means for transmitting purchase data 114 In-store video Storage means

Claims (20)

An electronic shopping system in which a client computer and a server having in-store video storage means for storing in-store video information are connected via a network, and a desired product is selected from the in-store video displayed on the client computer and purchased. In
The video information in the virtual store held by the server is taken from the actual store, and the client can travel around the virtual store provided by the server in the same way as in the actual store and select products. A featured electronic shopping system. The in-store passage of the actual in-store video is divided into a plurality of blocks in the front-rear direction, and the in-store video storage means of the server stores the virtual in-store video in association with each block. The electronic shopping system according to claim 1. 3. The electronic shopping system according to claim 2, wherein the in-store video storage means of the server stores four images of front, rear, left, and right for each of the blocks. 4. The electronic shopping system according to claim 3, wherein the in-store video storage means of the server stores images expressed by perspective as front and back images, and stores direct-view images as left and right images. The in-store video display means of the client refines and displays the in-store video based on four images before, after, and from the block received from the server when the client is located in a specific block. 5. The shopping system according to claim 3, wherein the current position in the virtual store of the client is designated by designating a block or a passage rail by the client. The front image stored in the in-store video storage means by the server is a front perspective image viewed from the rear end of the block, and the rear image is a rear perspective image viewed from the front end of the block. When the client moves within the block, this image is enlarged or reduced according to the moving distance, and the side surface is a side image from the leading edge to the trailing edge of the block, and within the block. When moving, when the block is located in the center of the moving direction, the side screen of that block will be displayed as it is, and if it moves beyond that, the display range corresponding to the moved amount The side image of the adjacent block corresponding to the amount of movement is fetched by the client computer from the in-store video storage means of the server and displayed on the in-store video display means. 5 shopping system described. The in-store video display means the client enlarges the front image from the rear end of the block and moves forward, and when the image overlaps the front image at the rear end of the next block, or from the block at the current position When straddling the next block in the direction of travel, this movement information is transmitted to the server side, and when the server receives this movement information, it is moved from the in-store video storage means of the server to the next block beyond the distance the client has moved. There is a video transmission means for calling up and transmitting the associated four image data to the client computer. The client computer stores the image data of this block in the memory, and thereafter based on the three blocks, based on these. 7. The electronic shopping system according to claim 3, 4, 5, or 6, wherein the image is purified. The actual in-store aisle is divided into rails on which the camera moves from the rear end to the front end of each aisle, and the in-store video storage means of the server associates the virtual in-store video with each rail. 8. The electronic shopping system according to claim 1, wherein the electronic shopping system is stored. 9. The electronic shopping system according to claim 8, wherein the in-store video storage means of the server stores four moving images of front, rear, left, and right for each of the rails. The in-store video display means of the client refines and displays the in-store video based on the front, back, left and right videos of the blocks in the rail received from the server when the client is located on a specific rail. 10. The electronic shopping system according to claim 8 or 9, wherein: 2. The electronic shopping system according to claim 1, wherein the in-store video storage means of the server stores a moving image taken from the rear end to the front end of the passage as front, rear, left and right images. The moving image in the front-rear direction stored in the in-store video storage means by the server is a moving image taken before and after moving from the rear end to the front end of the rail. When the client moves on the rail, the moving image is “ The images displayed by performing “Playback” and “Return” and the side images are taken from the rear end to the front end of the rail. 9. The electronic shopping system according to claim 8, wherein a side moving image viewed from a certain position is displayed by performing “playback” and “return” when moving in the left-right direction. The in-store video display means that when the client “plays” the video in front of the rail and moves forward and collides with the crossing rail, the client can select either the current rail or the crossed rail, and the newly crossed rail When this is selected, the rail change information is transmitted to the server side. When the server receives the rail change information, the server transmits image data for the crossed rails to the client computer from the in-store video storage means of the server. 10. The electronic shopping system according to claim 9, wherein the client computer stores new data in a memory and refines the moving image based on the new data. 14. The electronic shopping according to claim 8, 9, 10, 11, 12 or 13, wherein the rail of the camera moving in the store of the in-store video means is a guideline such as a magnetic tape provided under the camera. system. 2. The electronic shopping system according to claim 1, wherein the transmission means transmits the character information of the product title selected by zooming the image of the virtual store shelf displayed by the in-store video display means. A client computer and a server having in-store video storage means for storing video information in the virtual store are connected via a network, and the above video system includes a current position specifying means for specifying the current position in the virtual store by the client computer, In-store video display means for displaying the video in the virtual store on the screen of the client computer, and product zoom means for zooming the product group and displaying on the screen in order for the client to select the product from the virtual store video,
The server
In-store video storage means for storing the virtual in-store video, video transmission means for transmitting the virtual in-store video called from the in-store video storage means to the client computer, and the virtual in-store video of the client computer are images of the server 2. The electronic shopping system according to claim 1, wherein the electronic shopping system is displayed on the client computer based on the video transmitted from the means, and can travel around the store and select a product. An electronic shopping system in which a client computer and a server having in-store video storage means for storing in-store video information are connected via a network, and a desired product is selected from the in-store video displayed on the client computer and purchased. In
The client computer is
Current position designating means for designating the current position in the virtual store; in-store video display means for displaying the video in the virtual store on the screen of the client computer;
Product zoom means for zooming the product group and displaying it on the screen for the client to select a product from the virtual store image, Product designation means for specifying the product desired by the client from the zoomed product group, A transmission means for transmitting the title of the product designated by the product designation means to the server as character information;
The server
In-store video storage means for storing the virtual in-store video, video transmission means for transmitting the virtual in-store video called from the in-store video storage means to the client computer, the title of the designated product sent from the client computer, The retrieval means for retrieving the information of the product having the same title from the database in the database in which the character information of the title of the read product and the title as the product information in the server are stored as character information, and the retrieval means Product information transmitting means for transmitting the extracted product information to the client computer, and the video in the virtual store of the client computer is based on the video transmitted from the video means of the server, and the client computer Displayed on
The client computer further displays on the screen the product information sent from the server, and shifts to purchase means for determining purchase, and product purchase transmission means for transmitting the determination by the purchase means to the server. And electronic shopping system. 18. The electronic shopping system according to claim 16, wherein the database in which the product information of the server is stored is a database of an existing shopping system that uses a title as character information as a search item. 18. The character information of a product title selected by zooming a virtual store shelf image displayed by the in-store video display means is transmitted to a server of an existing shopping system by the transmitting means. Electronic shopping system. After selecting the product from the image on the in-store video display screen by the in-store video display means, the title display and the barcode notation that can be read by the barcode reading means are performed on the product display plate on which the product information installed on the product display shelf is described. The shopping system according to claim 16 or 17, wherein the client is configured to read the product title by a barcode.