JP7219997B1 - How to output blueprints of block objects - Google Patents

Abstract

An object of the present invention is to provide a method that enables a user to easily assemble a block object using block parts. A method for outputting a blueprint of an assembleable block object composed of a plurality of types of block parts, which is executed by a processing unit of a server terminal connected to a plurality of user terminals via a network. The processing unit of the server terminal obtains information about the block object from the user terminal, displays the image of the block object in an augmented reality space displayed on the user terminal, and receives the block object from the user terminal. Information about the part is received, and an image of the block part is displayed in the augmented reality space so as to be identifiable with respect to the block object. [Selection drawing] Fig. 6

Description

The present invention relates to a method for outputting a blueprint of a block object.

Toys in which a user builds block object models such as animals, buildings, vehicles, etc. using block parts such as Lego bricks are popular.

For example, Patent Literature 1 discloses a method for streamlining the design of block parts forming a block object.

Patent No. 5665872

However, although the technique disclosed in Patent Literature 1 can realize efficiency in designing and visualization of block parts, it realizes a method of visualizing an image of assembling block objects from the user's point of view. No method is disclosed.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a method that makes it easier for a user to assemble a block object using block parts.

In one aspect of the present invention, a method for outputting a blueprint of an assembleable block object composed of a plurality of types of block parts, which is executed by a processing unit of a server terminal connected to a user terminal via a network. The processing unit of the server terminal acquires information about block parts from the user terminal, determines block objects that can be assembled based on the information about the block parts, and blueprint information of the block objects and Information about the block parts is displayed, blueprint information of the block object is updated, information about the block parts is updated based on the updated blueprint information, and information about the updated block parts is displayed. In one aspect of the present invention, a method for outputting a blueprint of an assembleable block object composed of a plurality of types of block parts, which is executed by a processing unit of a server terminal connected to a user terminal via a network. A processing unit of the server terminal acquires information about a block object from the user terminal, displays an image of the block object in an augmented reality space displayed on the user terminal, and from the user terminal, Information about the block parts is received, and an image of the block parts is displayed in the augmented reality space so as to be identifiable with respect to the block object.

According to the present invention, it is possible to provide a method that makes it easier for a user to assemble a block object using block parts.

1 is a block diagram illustrating a system for providing a method for recommending block objects according to a first embodiment of the present invention; FIG. 2 is a functional block configuration diagram showing a server terminal 100 of FIG. 1; FIG. 2 is a functional block configuration diagram showing a user terminal 200 of FIG. 1; FIG. 4 is a diagram showing an example of object model information stored in the server 100; FIG. 4 is a diagram showing an example of block parts information stored in the server 100; FIG. FIG. 4 is an example of a flowchart showing details of a method for outputting a design drawing of a block object according to the first embodiment of the present invention; FIG. FIG. 11 is another example of a flowchart showing details of a method for outputting a blueprint of a block object according to the first embodiment of the present invention; FIG. It is an example of a block object displayed on the user terminal according to the first embodiment of the present invention. It is a figure explaining an example of basic block parts concerning a first embodiment of the present invention. It is an example of identifying and displaying a block part for a block object displayed on the user terminal according to the first embodiment of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. It should be noted that the embodiments described below do not unduly limit the scope of the invention described in the claims. Moreover, not all the constituent elements shown in the embodiments are essential constituent elements of the present invention.

<Configuration>
FIG. 1 is a block diagram illustrating a system for providing a method for recommending block objects according to a first embodiment of the present invention. This system 1 includes a server terminal 100 that generates block object design drawing information based on coordinate information of block parts acquired from a user terminal 200 or a sensor device 300, and a user It is composed of terminals 200A and 200B. Hereinafter, for convenience of explanation, the user terminals 200A and 200B will be collectively referred to as the user terminal 200. FIG.

Here, as an example of a block object composed of a plurality of block parts, an animal object will be described as an example in this embodiment. Not limited.

The server terminal 100 and the user terminal 200 are each connected via a network NW. The network NW includes the Internet, an intranet, a wireless LAN (Local Area Network), a WAN (Wide Area Network), and the like.

The server terminal 100 may be, for example, a general-purpose computer such as a workstation or personal computer, or may be logically realized by cloud computing. In the present embodiment, one server terminal is exemplified for convenience of explanation, but the present invention is not limited to this, and a plurality of server terminals may be used.

The user terminal 200 is, for example, an information processing device such as a personal computer or a tablet terminal, but may be configured by a smart phone, a mobile phone, a PDA, or the like.

In this embodiment, the system 1 has a server terminal 100 and a user terminal 200, and a user uses the user terminal 200 to operate the server terminal 100. The server terminal itself may be provided with a function for direct operation by each user.

FIG. 2 is a functional block configuration diagram of the server terminal 100 of FIG. The server terminal 100 includes a communication section 110 , a storage section 120 and a control section 130 .

The communication unit 110 is a communication interface for communicating with the user terminal 200 via the network NW, and communication is performed according to a communication protocol such as TCP/IP (Transmission Control Protocol/Internet Protocol).

The storage unit 120 stores programs, input data, and the like for executing various control processes and functions in the control unit 130, and is composed of a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. be. The storage unit 120 also has an object model information storage unit 121 that stores information related to the object model, and a block parts information storage unit 122 that stores block parts information generated based on the object model. . A database (not shown) storing various data may be constructed outside the storage unit 120 or the server terminal 100 .

The control unit 130 controls the overall operation of the server terminal 100 by executing a program stored in the storage unit 120, and is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and the like. be done. The functions of the control unit 130 include an information reception unit 131 that receives information such as instructions from the user terminal 200, an object model information processing unit 132 that refers to and processes various types of information related to object models, and various types of information related to block parts. It has a block parts information processing unit 133 that refers to and processes information, and an output processing unit 134 that performs processing for transmitting design drawing information related to block objects to the user terminal so as to be output. The information receiving unit 131, the object model information processing unit 132, the block parts information processing unit 133, and the output processing unit 134 are activated by a program stored in the storage unit 120 and are executed by the server terminal 100, which is a computer (electronic calculator). Executed by

The information reception unit 131 is provided by the server terminal 100, and the user (enters text, presses an icon When a predetermined request is made, information is received from the user terminal 200 , or coordinate information of block parts generated by the sensor device 300 is received via the user terminal 200 and the communication unit 110 .

The object model processing unit 132 stores information related to the object model in the object model information storage unit 121 and performs processing for referring to the stored object model information.

The block parts information processing unit 133 stores information related to block parts in the block parts information storage unit 122 and performs processing for referring to the stored block parts information.

The output processing unit 134 performs a process of transmitting necessary information to the user terminal 200 so that the user terminal 200 displays design drawing information and the like related to the block object. At this time, the output processing unit 134 uses the image and text data stored in the storage unit 120 as materials and arranges various images and text in a predetermined area of the user interface based on a predetermined layout rule, so that the user can Screen information required to be displayed on the interface of the terminal 200 can be generated. This screen information generation process can also be executed by a GPU (Graphics Processing Unit).

FIG. 3 is a functional block configuration diagram showing the user terminal 200 of FIG. The user terminal 200 includes a communication section 210 , a display operation section 220 , a storage section 230 and a control section 240 .

The communication unit 210 is a communication interface for communicating with the server terminal 100 via the network NW, and communication is performed according to a communication protocol such as TCP/IP. The communication unit 210 can also include a communication interface for communicating with the sensor device 300 via short-range wireless communication or the like.

The display operation unit 220 is a user interface used by the user to input instructions and display text, images, etc. according to input data from the control unit 240, and the user terminal 200 is configured by a personal computer. When the user terminal 200 is a smart phone or a tablet terminal, it is composed of a touch panel or the like. The display operation unit 220 is activated by a control program stored in the storage unit 230 and executed by the user terminal 200, which is a computer (electronic calculator).

The storage unit 230 stores programs, input data, and the like for executing various control processes and functions in the control unit 240, and is composed of RAM, ROM, and the like. Further, the storage unit 230 temporarily stores communication contents with the server terminal 100 .

The control unit 240 controls the overall operation of the user terminal 200 by executing programs stored in the storage unit 230, and is composed of a CPU, a GPU, and the like.

Note that the server terminal 100 may be configured to have the function of the display operation unit, and in this case, the configuration may be configured without the user terminal 200 . In addition, the user terminal 200 may be provided with a camera (not shown). In this case, the camera captures an image of an AR marker provided on the block parts, thereby determining the shape, color, etc. of the block parts. type, etc., and determine coordinates in Augmented Reality (AR) space.

FIG. 4 is a diagram showing an example of object model information stored in the server 100. As shown in FIG.

The object model information 1000 shown in FIG. 4 stores information related to an object model generated by a service operator related to the server terminal 100 or a user related to the user terminal 200, and the like. FIG. 4 shows an example of one object model (user identified by object ID "10001") for convenience of explanation, but information of a plurality of object models can be stored. Various data related to the object model, such as 3D model data of the object model, cross-section data of the object model, data related to one or more types of block parts and their number required to assemble the object model, cross-section layers Information such as blueprint information related to block parts arranged for each (layer) can be included. Here, the 3D model data can also be stored as 2D model data converted into a 3D model by predetermined processing.

FIG. 5 is a diagram showing an example of block parts information stored in the server 100. As shown in FIG.

The block parts information 2000 shown in FIG. 5 stores information related to the shape, size, color and weight of block parts. FIG. 5 shows an example of one block part (a block part identified by ID "20001") for convenience of explanation, but information related to a plurality of block parts can be stored. Various data related to block parts can include, for example, data related to block parts corresponding to parts for assembling a block object (consisting of the shape, size, color, number of each block part, etc.). . Here, each of the plurality of types of block parts can be associated with a unique color, but is not limited to this.

FIG. 6 is an example of a flowchart showing a method for outputting a design drawing of a block object according to the first embodiment of the present invention.

As a preliminary process, the user accesses the server terminal 100 using the web browser of the user terminal 200 or (when installing an application) an application or the like. A predetermined screen is displayed on a user interface via a website, an application, or the like. The user has basic block parts, which will be described later, at hand in advance, and information about the basic block parts is stored in the block parts information storage section 122 of the storage section 120 of the server terminal 100 .

Then, as the process of step S101, the information reception unit 131 of the control unit 130 of the server terminal 100 receives information about the block object that the user wants to assemble from the user terminal 200 via the network and the communication unit 110. receive. Here, the user can select a desired block object from a plurality of block objects on the user interface screen displayed on the user terminal 200 . In this example, the user wants to assemble a frog block object as shown in FIG. When the input operation is performed, the server terminal 100 receives information regarding the block object corresponding to the frog.

Subsequently, as the process of step S102, the object model information processing unit 132 of the control unit 130 of the server terminal 100 refers to the object model information storage unit 121 of the storage unit 120 based on the received information regarding the block object model. , to display the block object on the user terminal 200 based on the 3D data of the block object selected by the user. Here, the AR space is displayed on the user interface screen of the user terminal 200, and the image of the block object generated based on the 3D data is displayed in the real space captured by the camera provided in the user terminal 200. be done. Here, the user can enlarge, reduce, rotate, etc., the image of the block object displayed in the AR space by pinching, zooming, or other operations on a predetermined controller or touch panel.

Subsequently, as the process of step S103, the information reception unit 131 of the control unit 130 of the server terminal 100 receives information about one block part owned by the user from the user terminal 200 via the network and the communication unit 110. . Here, when the user takes a picture of the block parts owned by the user with the camera provided in the user terminal 200, the AR marker attached to the block parts is identified, and the identified information is transmitted to the server terminal 100. . Based on the information identified through the AR mark, the block parts information processing unit 133 of the server terminal 100 identifies the type of block parts (the type defined by any one or a combination of shape, color and size). do. The block parts information processing unit 133 can also identify the coordinates of the block parts in the AR space.

Subsequently, as the process of step S104, the object model information processing unit 132 of the control unit 130 of the server terminal 100 refers to the design drawing information of the object model stored in the object model information storage unit 121 of the storage unit 120, Based on the information about the block parts identified from the received information about the block parts, it is determined whether or not the block parts are block parts necessary for assembling the block object, and the block parts necessary for assembling the block object are determined. , the output processing unit 134 of the control unit 130 of the server terminal 100 displays the block parts portion by color in the block object arranged in the AR space displayed via the user interface screen of the user terminal 200. The identification display of the block parts is performed by, for example, blinking the display.

For example, FIG. 8(b) is an example of part of the blueprint data of the frog object model. The blueprint data indicates, in each layer, the placement area of the block parts required to configure the object model, along with coordinate information, by color. Along with this design drawing data, the block parts information processing unit 133 refers to the block parts information stored in the block parts information storage unit 122 of the storage unit 120, and selects the predetermined block parts as shown in FIG. , which block part is used in which area in the placement area of the block parts included in the blueprint information, and whether the received block part matches the determined block part confirm. Here, when it is confirmed that the block parts match each other, that is, when it is confirmed that the block parts owned by the user are used to assemble the block object, the output processing unit 134 outputs the AR The image of the block parts is displayed in different colors or blinked so that the user object displayed in the space can be identified where the block parts are used.

FIG. 7 is another example of a flowchart showing a method for outputting a design drawing of a block object according to the first embodiment of the present invention.

In this example, in the process of step S104, when the block parts are displayed in an identifiable manner in the AR space, when the block parts held by the user are displayed in the AR space, , Similarly, readjusting the size of the block object displayed in the AR space and displaying it overlaid with the block parts, etc., so that the user can easily assemble the block object using the block parts on hand. is.

First, in the process of step S201, the object model information processing unit 132 of the control unit 130 of the server terminal 100 refers to the 3D model information of the object model stored in the object model information storage unit 121 of the storage unit 120, The size of the block parts is determined based on the received coordinate information in the AR space of the block parts via the AR markers provided on the block parts held by the user, and the size of the object model to be displayed in the AR space is determined. The size is readjusted (resized) so that the size of the block parts that make up the object model matches the size of the actual block parts owned by the user.

Subsequently, in the processing of step S202, the output processing unit 134 of the control unit 130 of the server terminal 100 causes the image of the block object whose size has been readjusted as described above to be displayed on the user interface screen of the user terminal 200. In the AR space where the block parts are displayed, they are superimposed on the image of the block parts. Here, the output processing unit 134 can display the block object and the block parts separately by translucently displaying the block object, so that the user can more easily assemble the block object. .

As described above, according to the present embodiment, when the user assembles a block object, the user can identify and display the block parts he/she has along with the block object in the AR space by identifying where they are used. , can easily assemble block objects.

Although the embodiments according to the invention have been described above, they can be implemented in various other forms, and can be implemented with various omissions, substitutions, and modifications. These embodiments, modifications, omissions, substitutions and modifications are included within the technical scope of the claims and their equivalents.

1 system 100 server terminal, 110 communication unit, 120 storage unit, 130 control unit, 200 user terminal, NW network

Claims (5)

A method for outputting a blueprint of an assembleable block object composed of a plurality of types of block parts, which is executed by a processing unit of a server terminal connected to a user terminal via a network, comprising:
The processing unit of the server terminal,
obtaining information about block objects from the user terminal;
displaying an image of the block object in an augmented reality space displayed on the user terminal;
receiving information about block parts from the user terminal;
determining whether or not the block parts are block parts necessary for assembling a block object; A method of displaying the block object so as to be identifiable. 2. The method according to claim 1, wherein an image of said block parts is displayed at a location necessary for assembling said block object. The method according to claim 1, wherein the user terminal images the block parts and receives information about the block parts via AR markers provided on the block parts. 2. The method according to claim 1, wherein the image of the object model is resized according to the size of the image of the block part. 2. The method of claim 1, wherein the image of the block object is made translucent.

Images