JP7011363B1 - Storyboard production equipment, storyboard production method and storyboard production program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To create a storyboard suitable for a person who has little knowledge or experience because there is no means for creating a cut image itself, although there is a storyboard production device provided with a means for writing a text or inputting an existing cut image. There was a problem that it was difficult. SOLUTION: In order to solve the above problem, an object determination unit for determining an object, a camera work determination unit for determining a camera work for an object in an image of a cut constituting a storyboard, and the determined camera work are used. An image generation unit that generates a reflected image, a related information acquisition unit that acquires related information that is information related to the cut of the generated image, and the generated image and the related information of the cut of the image. Provided is a storyboard production apparatus having a cut number assigning unit for assigning a cut number to a included cut. [Selection diagram] Fig. 1

Description

The present invention relates to a storyboard production device that easily produces a storyboard, which is an important tool in animation production.

Storyboards express the flow of video works such as animations and movies using pictures and letters. More specifically, the image of the cut, the serial number of the cut, the explanation of the cut (movement of the picture, dialogue, sound, situation explanation, intention, etc.), the length of the cut (time), etc. are displayed in chronological order. be. In the production of video works, storyboards function as blueprints shared among creators.

However, in order to create a storyboard that is easy to share images among creators and is easy to understand, considerable knowledge and experience are required, and it is not easy for those who lack these to create storyboards. There is.

As an attempt to solve this problem, there is a technique of digitizing the production of storyboards, which was conventionally handwritten (Patent Document 1).

Japanese Unexamined Patent Publication No. 2010-060850

The storyboard production device disclosed in Patent Document 1 is provided with a means for inputting a description of a cut such as handwriting and a means for inputting an existing cut image, but does not create the cut image itself. , Handwritten cut images are digitized and used.

Therefore, in order to produce a cut image sufficient to exert the function of the storyboard, considerable knowledge and experience are still required, and the above-mentioned problems have not been solved.

Therefore, in order to solve the above problems, the following storyboard production apparatus and the like are provided in the present invention. That is, an object determination unit that determines an object, a camerawork determination unit that determines camerawork for an object in a cut image constituting a storyboard, and an image generation unit that generates an image reflected by the determined camerawork. A cut that assigns a cut number to a cut including a related information acquisition unit that acquires related information that is information related to the cut of the generated image, the generated image, and the related information of the cut of the image. A storyboard production device having a numbering unit and a numbering unit is provided.

Further, an object determination step for determining an object, a camerawork determination step for determining camerawork for an object in an image of a cut constituting a storyboard, and an image generation step for generating an image reflected by the determined camerawork. A cut in which a cut number is assigned to a cut including the related information acquisition step for acquiring related information which is information related to the cut of the generated image, the generated image, and the related information of the cut of the image. Provided is a storyboard production method having a numbering step and.

With the storyboard production device according to the present invention, even a person with little knowledge or experience can produce a storyboard.

A block diagram showing an example of the functional configuration of the storyboard production device of the first embodiment. Conceptual diagram showing an example of a UI screen for the user to determine camera work for an object The UI screen shown in FIG. 2 is a diagram showing an example of displaying a 3D space in which an object is located in the lower layer. A diagram showing an example of a UI screen for acquiring related information by user input. Conceptual diagram showing an example output in the form of a storyboard Conceptual diagram showing a configuration example of hardware that realizes the storyboard production device of Example 1. A flow chart showing an example of the flow of information processing of the storyboard production device of the first embodiment. A block diagram showing an example of the functional configuration of the storyboard production device of the third embodiment. Conceptual diagram showing an example of UI screen when saving a file

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. The present invention should not be limited to these embodiments, and may be implemented in various embodiments without departing from the gist thereof.

<Example 1>
<Overview>
The storyboard production device of this embodiment determines the position and setting of the camera with respect to an object such as a character, generates an image reflected by the camera as a cut image, and arranges the image together with the information about the cut on the sheet.

In the following, the functions and processing flow of the storyboard production device and the contents of the hardware will be described. The functional blocks of the present apparatus described below can be realized as a combination of hardware and software. Specifically, if a computer is used, the CPU (central processing unit), main memory, bus, or secondary storage device (hardware drive, non-volatile memory, storage media such as CD and DVD, and those media) Controls hardware components such as read drives), input devices used for information input, printing devices and display devices, and other external peripheral devices, as well as interfaces for the external peripheral devices, communication interfaces, and their hardware. Driver programs for this, other application programs, user interface applications, etc. can be mentioned. Then, by the arithmetic processing of the CPU according to the program expanded on the main memory, the data input from the input device or other interface and held on the memory or hard disk is processed and stored, or the above hardware or the above-mentioned hardware or the like. Instructions to control the software are generated. Alternatively, the functional block of this system may be realized by dedicated hardware.

Further, the present invention can be realized not only as a system but also as a method. Further, a part of such an invention can be configured as software. Further, the program used to make the computer execute such software, and the recording medium in which the program is fixed are naturally included in the technical scope of the present invention (as well as throughout the present specification).

<Functional configuration>
FIG. 1 is a block diagram showing an example of a functional configuration of the storyboard production device of the first embodiment. As shown in FIG. 1, the storyboard production device 100 includes an object determination unit 101, a camera work determination unit 102, an image generation unit 103, a related information acquisition unit 104, and a cut numbering unit 105.

The object determination unit 101 has a function of determining an object. The object is an object drawn (projected) in the image of the cut, and is mainly a person or an animal appearing in the work, but may be another object. The object can be determined by the user selecting from a plurality of preset objects. As the set objects, for example, "boy", "girl", "adult man", "adult woman", "elderly man", "elderly woman", etc. should be set separately according to gender and age. Can be done. Further, the object is not limited to one person (one), and a plurality of objects such as two people (two) may be set. It can also be configured to select and determine the background of the object, the position and number of light sources, and the like.

Then, each background (back surface, left surface, right surface, bottom surface, front surface, top surface) of the stage on which the object is located is determined. Determining the stage means determining each background of the stage (various actual scenery or background expressed by patterns, coloring, etc.) constituting the 3D space. For example, the lower surface has a blue and white checkered pattern, the back surface has a brown and white checkered pattern, and the front surface has a dark color. Similar to the object determination, the stage determination can be configured so that the user selects from various candidates.

The camera work determination unit 102 has a function of determining camera work for an object in the image of the cut constituting the storyboard. A cut is a break in a video work until the picture is switched, and is sometimes called a shot. Further, the image of the cut is a picture representing the composition of each cut. Then, one cut is composed of the image of the cut and the information about the content of the cut (related information described later).

Camera work is the position, orientation, zoom, etc. of the camera with respect to the object, and how the object is projected. The camera work may be determined so that the user determines the position or the like, or AI (artificial intelligence) proposes to the user based on the object or the stage (background) as described later. You may.

The image generation unit 103 has a function of generating an image to be reflected by the determined camera work. Hereinafter, the determination of the camera work and the generation of the image reflected by the camera work will be described with reference to FIGS. 2 and 3.

FIG. 2 is a conceptual diagram showing an example of a UI (user interface) for a user to determine camera work for an object. In the UI screen 200 shown in FIG. 2, the area 201 shows an object and a plurality of camera positions that can be arranged with respect to the object. In the figure, two objects are indicated by circles (white circles), and the camera positions that can be placed are numbered in the area on one side (front side) divided by the imaginary nine that connects the two objects. Is shown with. It is also possible to set the camera position that can be placed on the other side (rear side) divided by the imaginary line. Further, the camera may be configured so that the camera can be arranged at a position beyond the imaginary line.

Then, in the area 202 of the UI screen, an image showing an object (a form of a doll) from each camera position is displayed together with a number assigned to the camera position. In this figure, images from the first to fifth camera positions from the top of the area 202 are shown, but by scrolling, images from the sixth and subsequent camera positions can also be displayed.

Here, the background of the image projected from the front (1 camera position 203) and the background of the image projected from the left side (2 camera positions) are configured to be different in their patterns and coloring. By making each background (back, left, right, bottom, front, top) of the stage on which the object is located different by pattern or coloring, it becomes easy to grasp the object in the 3D space.

Further, the UI screen of FIG. 2 may be displayed as a layer as in the UI screen 300 of FIG. FIG. 3 displays the 3D space 301 in which the object is located on the lower screen, and displays the UI screen 302 shown in FIG. 2 on the upper layer. With this configuration, the entire space in which the object exists can be intuitively grasped by the display in the 3D space, and the image from each camera position can be confirmed.

The related information acquisition unit 104 has a function of acquiring related information which is information related to the cut of the generated image. The related information is information about the content of the cut such as the movement of the picture, dialogue, sound, explanation of the situation, and intention, and may include information on the time of the cut.

FIG. 4 is a diagram showing an example of a UI for acquiring related information by input of a user. In the UI screen 400 shown in FIG. 4, the image of the generated cut is displayed in the area 401, and below that, the content explanation such as the writing which is the related information of the cut and the dialogue are input. The input field for is displayed. Then, in the area 402 on the right side, a plurality of images projected by camera work different from the images displayed in the area 401 are displayed, and the positional relationship between the stage and the object can be understood. With this configuration, it is possible to input information related to the cut while viewing the image of the cut.

The cut numbering unit 105 has a function of assigning a cut number to a cut including the generated image and the related information of the cut of the image. In the UI screen 400 shown in FIG. 4, the area 403 is configured so that a plurality of generated images are arranged side by side, and one image selected from the plurality of images is placed in the area 401. It is displayed and you can enter related information.

Here, the plurality of images arranged in the area 403 are given a time-series order according to the arrangement. For example, in the case of a time series in which the image proceeds from left to right, the cut number is assigned from the image arranged on the left side. In addition, the images arranged in this area are configured so that the order can be changed by an operation such as drag and drop. The cut number is updated as the order is changed.

It can also be configured so that the length of the cut (length of the image) can be set. The cut scale may be set in seconds, frames, or seconds and frames may be used together. For example, since animation is often produced at a frame rate of 24 FPS, 24 frames may be set to 1 second, for example, "1 (second) + 12 (frame)".

Further, the storyboard production apparatus of this embodiment can be configured to have an image editing unit for editing the generated image. For example, in the UI screen 400 shown in FIG. 4, the image selected from the images arranged in the area 403 can be configured so that the image displayed in the area 401 can be edited. For example, changing the pose (posture, orientation, etc.) of an object, or changing the number and strength of light sources for an object. Further, like paint software, the object may be configured so that the user can make corrections by using a pointing device (mouse, pen tablet, touch panel, etc.). The above-mentioned acquisition of related information, assignment of cut numbers, and editing can be performed in any order and can be repeatedly executed.

Further, the storyboard production apparatus of the present embodiment can be configured to have an output unit that outputs the cuts to which the cut numbers are assigned according to the cut numbers. FIG. 5 is a conceptual diagram showing an example of output in the form of a storyboard by the output unit. As shown in FIG. 5, the cut number 502, the image 502, the content 503, the dialogue / SE504, and the cut scale 505 for each cut are displayed in chronological order. Further, printing or the like can be performed as needed. As shown in FIG. 5, after displaying in the form of a storyboard, it is also possible to make corrections to the image and related information.

<Hardware configuration>
FIG. 6 is a conceptual diagram showing a configuration example of hardware that realizes a storyboard production device. As shown in the figure, the picture content production device 600 includes a CPU 601 that performs various arithmetic processes, a RAM 602 that is a volatile recording medium, a storage 603 such as a flash memory or an HDD that is a non-volatile storage medium, and a communication interface 604. , And an input / output interface 605. The RAM 602 reads a program for performing various arithmetic processes to be executed by the CPU 601 and provides a work area (work area) of the program. Further, a plurality of addresses are assigned to the RAM 602, and the program executed by the CPU 601 can exchange data with each other and perform processing by specifying and accessing the addresses. (The same applies throughout the specification).

Here, the functions of the object determination unit 101, the camera work determination unit 102, the image generation unit 103, the related information acquisition unit 104, and the cut numbering unit 105 of the storyboard production apparatus 100 shown in FIG. 1 are mainly shown in FIG. It is realized by the CPU 601 and the RAM 602 and the input / output interface 605. Further, the functions of the image editing unit and the output unit of the storyboard production apparatus not shown in FIG. 1 are mainly realized by the CPU 601 and the RAM 602 and the input / output interface 605 of FIG.

<Processing flow>
FIG. 7 is a flow chart showing an example of the flow of information processing of the storyboard production apparatus. As shown in the figure, the object is determined (S701: object determination step). Then, the camera work for the object in the image of the cut constituting the storyboard is determined (S702: camera work determination step). Then, an image to be reflected by the determined camera work is generated (S703: image generation step). Then, the related information which is the information related to the cut of the generated image is acquired (S704: related information acquisition step). Then, a cut number is assigned to the cut including the generated image and the related information of the cut of the image (S705: cut number assigning step).

<Effect>
According to the storyboard production device of this embodiment, even a person with little knowledge or experience can produce a storyboard.

<Example 2>
<Overview>
This embodiment relates to a storyboard production device that presents camera work using a trained model based on the first embodiment.

<Functional configuration>
The storyboard production apparatus of the second embodiment is characterized in that the camera work determination unit presents the camera work using the trained model based on the determined object and / or the stage. As for the functional configuration other than the camera work determination unit, the same description as the configuration having the same name in the first embodiment will be omitted.

The trained model used to present the camera work, for example, accumulates a large amount of camera work data for a set stage or object and inputs this into an algorithm to generate a trained model. By inputting an object or stage into the generated trained model, camera work suitable for the object or stage is obtained as an output, and the obtained camera work is presented to the user. The user can adopt the presented camera work and can be configured to request re-presentation.

Since the camera work is presented based on the determined object or stage using the trained model in this way, it becomes easy for a user with little knowledge or experience to make a difficult camera work decision.

<Hardware configuration>
The storyboard production device of the second embodiment can be realized by the hardware configuration shown in FIG. 6 according to the first embodiment.

<Processing flow>
The processing flow of the storyboard producing apparatus of the second embodiment is basically the same as the processing flow of the storyboard producing apparatus of the first embodiment. The storyboard production device of the second embodiment is characterized in that the camera work is presented using the trained model based on the determined object and / and the stage in the camera work determination step.

<Effect>
According to the storyboard production apparatus of the second embodiment, it becomes easy for a user with little knowledge and experience to determine difficult camera work.

<Example 3>
<Overview>
Example 3 is based on Example 1 or Example 2, and is characterized in that a file related to the production of a storyboard is saved in a predetermined storage destination according to the type attached to the file. Regarding the device.

<Functional configuration>
FIG. 8 is a block diagram showing an example of the functional configuration of the storyboard production device of the third embodiment. As shown in FIG. 8, the storyboard production device 800 includes an object determination unit 801, a camera work determination unit 802, an image generation unit 803, a related information acquisition unit 804, a cut numbering unit 805, and an image editing unit. It has an 806, an output unit 807, and a file storage unit 808. Since each configuration other than the file storage unit 808 has the same function as the configuration having the same name in the first or second embodiment, the description thereof will be omitted.

The file storage destination installation unit 808 has a function of installing a predetermined storage destination according to the type attached to the file related to the production of the storyboard. The file related to the production of the storyboard is a file generated by the above-mentioned functions of each configuration, a file generated by a device such as a PC (personal computer) including the main storyboard production device, and the like.

FIG. 9 is a conceptual diagram showing an example of a UI screen when saving a file. First, as an example of the type attached to the file, there are "planning", "PV", "OP", "END", "OVA" and the like. Here, when trying to save a file with the type of "PV", as shown in FIG. 9A, the preset save destinations "_0_plan", "_1_PV", and "_2_OP" are used. , "_3_END", "_4_OVA", "_5_series", "_6_MOVIE", "_1_PV" is automatically specified and displayed in a state of waiting for selection (dotted line frame in the figure).

Then, by the user determining the folder of "_1_PV" in the selection waiting state, as shown in FIG. 9B, the "00_scenario", which is set in advance as a storage destination under "_1_PV", "01_Visual", "02_Storyboard", "03_LO", "04_Original", "05_Dynamic", "06_CG", "07_Shooting", "08_Editing", "09_Production", "10_Package" Each save destination is displayed (dotted line frame in the figure). In this way, the hierarchical structure of folders and folder names for storing and managing files are also preset in a manner suitable for animation production.

<Hardware configuration>
The storyboard production device of the third embodiment can be realized by the hardware configuration shown in FIG. 6 according to the first embodiment or the second embodiment.

<Processing flow>
The processing flow of the storyboard producing apparatus of Example 3 is basically the same as the processing flow of the storyboard producing apparatus of Example 1 or Example 2. Then, the storyboard production device of the third embodiment has a step of setting a predetermined storage destination according to the type attached to the file related to the production of the storyboard.

<Effect>
According to the storyboard production device of the third embodiment, since the save destination is set according to the type of the generated file, there is no need for complicated work such as setting the save destination and the hierarchical structure of the save folder, which is beneficial for the user. Is.

100: Storyboard production device 101: Object determination unit 102: Camera work determination unit 103: Image generation unit 104: Related information acquisition unit 105: Cut number assignment unit 601: CPU
602: RAM
603: Storage 604: Communication interface 605: Input / output interface

Claims (6)

The object determination unit that determines the object and the object determination unit
The camerawork determination unit that determines the camerawork for the object in the image of the cut that constitutes the storyboard,
An image generation unit that generates an image reflected by the determined camera work,
A related information acquisition unit that acquires related information that is information related to the cut of the generated image, and a related information acquisition unit.
It has a cut number assigning unit that assigns a cut number to a cut including the generated image, the related information of the cut of the image, and the cut .
The camera work determination unit determines the camera work by the user with an image showing the object, a plurality of camera positions that can be arranged with respect to the object, and an image showing the object from the plurality of camera positions. Displayed as a UI screen for,
Storyboard production equipment. An output unit that outputs the cut to which the cut number is assigned according to the cut number,
The storyboard production device according to claim 1, further comprising. The storyboard production apparatus according to claim 1 or 2, further comprising an image editing unit for editing the generated image. The storyboard production apparatus according to any one of claims 1 to 3 , further comprising a file storage destination installation unit for installing a predetermined storage destination according to the type attached to the file related to the production of the storyboard. The object determination step that determines the object and the object determination step
The camerawork determination step that determines the camerawork for the object in the image of the cut that makes up the storyboard,
An image generation step of generating an image reflected by the determined camera work, and
A related information acquisition step for acquiring related information, which is information related to the cut of the generated image, and
It has a cut numbering step of assigning a cut number to a cut including the generated image, the relevant information of the cut of the image, and the cut.
In the camera work determination step, the user determines the camera work of the object, an image illustrating a plurality of camera positions that can be arranged with respect to the object, and an image showing the object from the plurality of camera positions. Displayed as a UI screen for,
Storyboard production method. The object determination step that determines the object and the object determination step
The camerawork determination step that determines the camerawork for the object in the image of the cut that makes up the storyboard,
An image generation step of generating an image reflected by the determined camera work, and
A related information acquisition step for acquiring related information, which is information related to the cut of the generated image, and
A storyboard production program for causing a computer to execute a cut numbering step of assigning a cut number to a cut including the generated image and the related information of the cut of the image .
In the camera work determination step, the user determines the camera work with an image illustrating the object and a plurality of camera positions that can be arranged with respect to the object, and an image showing the object from the plurality of camera positions. Displayed as a UI screen for
Storyboard production program.

Images