JP7182372B2 - Video editing system, server, terminal and video editing method - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Law From November 22nd to 24th, 2017, we distributed advertising materials for the video editing system at the “27th Annual Meeting of the Japanese Otological Society/Academic Lecture”. .

The present invention relates to a moving image editing system, server, terminal, and moving image editing method, and can be suitably used for, for example, a moving image editing system, server, terminal, and moving image editing method for extracting a desired portion from a moving image shot as digital data. .

There is a demand for editing work that efficiently extracts important scenes from moving images that are long and lack overall changes.

For example, among videos recorded by a fixed-point camera of several hours of a surgical operation, an important scene that is desired to be shown as a teaching material to medical students may be a very short portion of the video. In such a case, it is desirable from the viewpoint of learning efficiency to select and extract only important scenes from the captured moving images, edit them, and use the edited moving images as teaching materials.

Such editing requires a thorough knowledge of which aspects of the surgical procedure are important. One of the reasons for this is that there is little so-called camerawork in moving images recorded at a fixed point, and there is little change in the entire screen. However, human resources with such knowledge are often busy with medical activities including surgery itself, and it is difficult to devote a long time to video editing. Therefore, it is desirable to be able to efficiently edit moving images in a shorter time.

In relation to the above, Patent Document 1 (Japanese Patent Application Laid-Open No. 2014-042654) discloses a server device, a client device, a medical image processing system, a medical image processing method, and a program. The server device of Patent Literature 1 processes medical image information. This server device includes a storage unit, a server-side transmission unit, a server-side reception unit, and an edit processing unit. Here, the storage unit stores first moving image data, which is moving image data of medical images, and second moving image data generated by reducing the data amount of the first moving image data. The server-side transmission unit transmits the second moving image data to the client device in response to a request from the client device. The server-side reception unit receives edit processing information that is transmitted from the client device and indicates details of edit processing for the second moving image data. The edit processing section edits the first moving image data based on the received edit processing information.

In Patent Document 1, when first moving image data to be edited is transmitted from a server device to a client device, second moving image data whose data amount is reduced is transmitted by a streaming method instead of the first moving image data. (Paragraph 0032 of the specification). The image quality of the second moving image data is inevitably lower than that of the first moving image data due to the reduced data amount (paragraph 0033 of the specification). Also, as long as the video is reproduced, only one frame can be viewed on the screen of the client device at a time.

JP 2014-042654 A

To provide a moving picture editing system and a moving picture editing method for efficiently editing a moving picture for a long time. Other problems and novel features will become apparent from the description of the specification and the accompanying drawings.

The means for solving the problems will be described below using the numbers used in (Mode for Carrying Out the Invention). These numbers are added to clarify the correspondence relationship between the description of the claims and the description of the invention. However, these numbers should not be used to interpret the technical scope of the invention described in (claims).

A moving picture editing system (1) according to one embodiment comprises a server (3) and a terminal (5). Here, the server (3) generates an intermediate still image group (8) from the pre-editing moving image (7). The terminal (5) partially reads out the intermediate still image group (8) from the server (3), and transfers the desired selection range (84) included in the pre-editing moving image (7) to the intermediate still image group (8). set based on The server (3) comprises an intermediate still image group generator (331) and a partial still image group generator (332). Here, the intermediate still image group generation unit (331) arranges the plurality of still images included in the pre-editing moving image (7) and arranged in time series in the first direction in the first period, and Generating a first intermediate still image (81) out of the group of intermediate still images (8) arranged in a second direction orthogonal to the first direction with a second period different from the period, and the first intermediate still image (81) is reduced to generate a second intermediate still image (82) of the intermediate still image group (8). The partial still image group generation unit (332) selects the first intermediate still image (81) included in the predetermined first display range (811) according to the display control signal received from the terminal (5). A partial still image (812) and a second partial still image (822) included in a second display range (821) including the first display range (811) of the second intermediate still image (82) are generated. . The terminal (5) comprises a display device (522), an input device (523) and an arithmetic device (53). Here, the display device (522) displays the first partial still image (812) and the second partial still image (22) such that the first display range (811) and the second display range (821) are linked. do. The input device (523) inputs a display control operation for setting a first display range (811) of the first intermediate still image (81) to be displayed at once, and Input an edit control operation to set one of the still images included in the partial still image (812) as one end of the selection range (84). A computing device (53) generates a display control signal for transmitting the content of the display control operation to the server (3), and generates an edit control signal for transmitting the content of the edit control operation to the server (3). The server (3) further comprises an edited moving image generator (333). Here, the post-editing video generation unit (333) extracts the part included in the selection range (84) from the pre-editing video (7) according to the edit control signal received from the terminal (5), Generate animation (9).

A moving image editing method according to one embodiment includes generating an intermediate still image group (8) from a pre-editing moving image (7) (S1), and producing a pre-editing moving image (7) based on the intermediate still image group (8). Setting a desired selection range (84) to be included (S2), and extracting a portion included in the selection range (84) from the pre-editing video (7) to generate an edited video (9) ( S3). Generating an intermediate still image group (8) (S1) includes arranging a plurality of still images included in the pre-editing moving image (7) and arranged in time series in a first direction in a first cycle, and Generating a first intermediate still image (81) arranged in a second direction orthogonal to the first direction in a second cycle different from the first cycle (S133), and reducing the first intermediate still image (81) Generating (S134) a second intermediate still image (82). Setting the selection range (84) (S2) includes inputting a display control operation (S221, S223), and displaying at once one of the first intermediate still images (81) according to the display control operation. setting a first display range (811) (S211); Among the still images (82), the second partial still image (822) included in the second display range (821) including the first display range (811) is divided into the first display range (811) and the second display range. (821) are displayed in conjunction with each other (S218), inputting an edit control operation (S221, S222), and according to the edit control operation, the first partial still image ( 812) as one end of the selection range (84) (S222).

According to the embodiment, it is possible to edit a moving image over a long period of time more efficiently.

FIG. 1A is a block circuit diagram showing an overall configuration example of a video editing system according to one embodiment. FIG. 1B is a block circuit diagram illustrating one configuration example of a server according to one embodiment. FIG. 1C is a block circuit diagram showing one configuration example of a terminal according to one embodiment. FIG. 2 is a flow chart showing an overall configuration example of a moving image editing method according to an embodiment. FIG. 3 is a diagram showing one configuration example of an intermediate still image group according to one embodiment. FIG. 4A is the first half of a sequence diagram showing in more detail one configuration example of part of the video editing method according to one embodiment. FIG. 4B is the second half of the sequence diagram of which the first half is shown in FIG. 4A. FIG. 5A is a diagram illustrating a configuration example of display on a terminal according to an embodiment; FIG. 5B is a diagram illustrating another configuration example of display on the terminal according to one embodiment. (Framework for AI evaluation) FIG. 6A is a diagram illustrating an example of a method of displaying an intermediate still image group according to one embodiment. FIG. 6B is a diagram illustrating another example of a method of displaying intermediate still images according to one embodiment. FIG. 6C is a diagram illustrating yet another example of a method of displaying intermediate still images according to one embodiment.

Embodiments for implementing a moving picture editing system 1 and a moving picture editing method according to the present invention will be described below with reference to the accompanying drawings.

(embodiment)
The configuration of a video editing system 1 according to this embodiment will be described with reference to FIGS. 1A to 1C. FIG. 1A is a block circuit diagram showing an overall configuration example of a video editing system 1 according to one embodiment. FIG. 1B is a block circuit diagram showing one configuration example of the server 3 according to one embodiment. FIG. 1C is a block circuit diagram showing one configuration example of the terminal 5 according to one embodiment.

(Component)
Components of a video editing system 1 according to the present embodiment will be described with reference to FIG. 1A. A moving image editing system 1 of FIG. 1A includes a server 3 , a database 4 and a terminal 5 . The moving image editing system 1 of FIG. 1A may further include one or both of the imaging device 2 and the display device 6 . Database 4 may be configured as part of server 3 .

The server 3 is a computer that implements various functions by executing programs to input, calculate, and output data. The server 3 may be configured as a physical server, or may be configured as a virtual server that operates on another physical server.

The server 3 of FIG. 1B includes a bus 31 , an input/output interface 32 , a communication section 321 , a calculation section 33 , a storage section 34 and an external storage device 35 . The server 3 may further include a recording medium 351 . The calculation unit 33 includes an intermediate still image group generation unit 331 , a partial still image group generation unit 332 , an edited moving image generation unit 333 , and an evaluation unit 334 . The storage unit 34 may contain the database 4 .

The calculation unit 33 implements various functions by executing programs stored in the storage unit 34 . The intermediate still image group generation unit 331, the partial still image group generation unit 332, the edited moving image generation unit 333, and the evaluation unit 334 each perform functions realized by the operation unit 33 executing a predetermined program as functional blocks. It is expressed as

The intermediate still image group generation unit 331 is a functional block realized by the operation unit 33 executing an intermediate still image group generation program (not shown), and has a function of generating the intermediate still image group 8 from the pre-editing video 7. . The intermediate still image group 8 according to the present embodiment is obtained by cutting out a plurality of frames included in the pre-editing moving image 7 as independent still images, and combining the plurality of cut out still images to form one huge first intermediate image. Although it has functions such as generating a still image 81 and generating a second intermediate still image 82 by reducing the first intermediate still image 81, it may also have other functions.

The partial still image group generation unit 332 is a functional block realized by the operation unit 33 executing a partial still image group generation program (not shown), and has a function of generating a partial still image group from the intermediate still image group 8. . The partial still image group generation unit 332 according to the present embodiment generates a first partial still image 812 and a second partial still image 812 obtained by clipping a portion of the first intermediate still image 81 and the second intermediate still image 82 that can be displayed at once on the terminal 5 . Although it has the function of generating a still image 822, it may also have other functions.

The edited moving image generation unit 333 is a functional block realized by the calculation unit 33 executing an edited moving image generation program (not shown), and has a function of generating the edited moving image 9 from the unedited moving image 7 . The post-editing moving image generation unit 333 according to the present embodiment particularly has a function of cutting out a desired portion from the pre-editing moving image 7 to produce the edited moving image 9, but may further have other functions.

The evaluation unit 334 is a functional block realized by the calculation unit 33 executing an evaluation program (not shown), and is a function of evaluating each region obtained by further dividing each frame of the pre-editing moving image 7 according to a predetermined standard. have The evaluation unit 334 according to the present embodiment may have a function of evaluating the probability that cancer cells are included in each area when the subject is, for example, the biological tissue of a patient undergoing surgery. However, this is just an example and does not limit the present embodiment. It should be noted that the exemplified “function of evaluating the probability that a living tissue contains cancer cells” is a publicly known technique realized by applying so-called artificial intelligence, so further detailed description thereof will be omitted.

The database 4 is a storage device that stores data in a readable and writable manner from the outside. As described above, the database 4 may be included in the storage unit 34 of the server 3 or, conversely, may exist independently of the server 3 .

The terminal 5 is a computer that implements various functions by executing programs and reading and writing data. The terminal 5 may be, for example, a tablet terminal or a smart phone, but these examples do not limit the present embodiment.

The terminal 5 of FIG. 1C includes a bus 51, an input/output interface 52, a communication device 521, a display device 522, an input device 523, an arithmetic device 53, a storage device 54, and an external storage device 55. there is The computing device 53 includes a display control signal generator 531 and an edit control signal generator 532 . Here, the display control signal generation section 531 and the edit control signal generation section 532 represent functions realized by the arithmetic device 53 executing a predetermined program stored in the storage device 54 as functional blocks. be. The terminal 5 may further include a recording medium 551 .

The photographing device 2 is a device that generates a pre-editing moving image 7 to be edited by the moving image editing system 1 according to this embodiment, and is, for example, a video camera. The imaging device 2 preferably has a function of outputting a moving image obtained by optically imaging a subject as digital data that can be processed by the server 3 .

The display device 6 is a device for displaying the edited moving image 9 generated by the moving image editing system 1 according to this embodiment, and is, for example, a television, monitor, display, or the like.

(connection relationship)
With reference to FIG. 1A, the connection relationship of the components of the video editing system 1 according to this embodiment will be described.

The server 3 is preferably connected to each of the photographing device 2, the database 4, the terminal 5 and the display device 6 by wired or wireless communication. However, the server 3 does not have to be connected to all of the photographing device 2, the terminal 5 and the display device 6 at the same time. For example, the server 3 and the photographing device 2 need to be communicably connected only when the server 3 receives the pre-editing moving image 7 transmitted from the photographing device 2. It may be connected or may not be connected. Similarly, the server 3 and the terminal 5 need to be communicatively connected only when the terminal 5 is used for video editing, and the two may be connected before or after that. It doesn't have to be. Further, the server 3 and the display device 6 need to be communicably connected only when the edited moving image 9 is reproduced on the display device 6, and the two may be connected thereafter. , does not have to be connected. However, with respect to the server 3 and the database 4, it is preferable that a communicable connection be established between them at all times.

With reference to FIG. 1B, the connection relationship of the components of the server 3 according to this embodiment will be described.

The bus 31 is electrically communicably connected to each of the input/output interface 32 , the computing unit 33 , the storage unit 34 and the external storage device 35 . In other words, the input/output interface 32 , the computing section 33 , the storage section 34 and the external storage device 35 can electrically communicate with each other via the bus 31 .

The input/output interface 32 is connected to the communication section 321 . The communication unit 321 is connected to each of the photographing device 2, the database 4, the terminal 5, and the display device 6, which are not shown in FIG. 1B, so as to perform either one or both of wired communication and wireless communication.

In addition, the external storage device 35 is connected to the recording medium 351 when writing data to or reading data from the recording medium 351 . Note that the external storage device 35 and the recording medium 351 do not necessarily have to be connected when data is not written or read.

With reference to FIG. 1C, the connection relationship of the components of the terminal 5 according to this embodiment will be described.

The bus 51 is electrically communicably connected to the input/output interface 52, the communication device 521, the display device 522, the input device 523, the arithmetic device 53, the storage device 54, and the external storage device 55, respectively. In other words, the input/output interface 52 , the communication device 521 , the display device 522 , the input device 523 , the arithmetic device 53 , the storage device 54 and the external storage device 55 can electrically communicate via the bus 51 .

The input/output interface 52 is connected to each of the communication device 521 , the display device 522 and the input device 523 .

The communication device 521 is connected to the server 3 (not shown in FIG. 1C) so that either one or both of wired communication and wireless communication can be performed.

In addition, the external storage device 55 is connected to the recording medium 551 when data is written to or read from the recording medium 551 . Note that the external storage device 55 and the recording medium 551 do not necessarily have to be connected when data is not written or read.

(motion)
The operation of the video editing system 1 according to the present embodiment, that is, the configuration of the video editing method according to the present embodiment will be described with reference to FIG. FIG. 2 is a flow chart showing an overall configuration example of a moving image editing method according to an embodiment.

The flowchart of FIG. 2 includes a total of three major steps, ie, a first major step S1 to a third major step S3. The first major process S1 includes a total of three intermediate processes, a first intermediate process S11 to a third intermediate process S13. The third intermediate step S13 includes a total of four sub-steps of first sub-step S131 to fourth sub-step S134. The second major step S2 includes a total of three intermediate steps from the first intermediate step S21 to the third intermediate step S23.

The flow chart of FIG. 2 will be briefly described. The flowchart of FIG. 2 starts from the first major step S1. In the first major step S1, the server 3 generates an intermediate still image group 8 from the pre-editing moving image 7. FIG. After that, in the second major step S2, the terminal 5 sets a selection range for video editing. After that, in the third major step S3, the server 3 generates the edited moving image 9. FIG.

The first major step S1 in FIG. 2 will be described in more detail. The first major process S1 starts from the first intermediate process S11.

In the first intermediate step S11, the photographing device 2 shoots the pre-editing moving image 7. FIG. The captured pre-editing moving image 7 is preferably digital data in a format receivable by the server 3, but the format of the digital data may be appropriately converted as necessary. After the first intermediate step S11, a second intermediate step S12 is performed.

In the second intermediate step S<b>12 , the database 4 stores the pre-editing moving image 7 via the server 3 . In other words, the server 3 receives the pre-editing moving image 7 from the imaging device 2 and stores it in the database 4 . However, when the shooting of the pre-editing moving image 7 by the shooting device 2 is performed in a state where the shooting device 2 and the server 3 are connected, the first intermediate step S11 and the second intermediate step S12 are performed in parallel. Also good. In other words, in such a case, the pre-editing moving image 7 may be gradually stored in the database 4 via the server 3 from the captured portion. After the second intermediate step S12, a third intermediate step S13 is performed.

In a third intermediate step S13, the server 3 generates an intermediate still image group 8. FIG. The third intermediate step S13 will be described in more detail with reference to FIG. FIG. 3 is a diagram showing one configuration example of the intermediate still image group 8 according to one embodiment. The third intermediate step S13 starts from the first minor step S131.

In the first sub-step S131, the intermediate still image group generation unit 331 of the calculation unit 33 of the server 3 converts each frame of the pre-editing moving image 7 into a still image. The number may be written in a predetermined place on each of the converted still images. This number may be an integer representing the order of the frame from which each still image is derived in the pre-editing moving image 7 with a consecutive number, or may be the date and time when the frame was shot. , or the elapsed time from the start of shooting. In this embodiment, the case where the elapsed time as a number is represented by a 2-digit integer representing minutes, a 2-digit integer representing seconds, and a 2-digit integer representing a frame number will be considered. Also, the place where this number is written may be the upper right corner of the still image or another place, but it is preferable that the number be uniform for all the frames. A plurality of still images obtained by this conversion are preferably stored in the database 4 .

Here, as an example of the pre-editing moving image 7, a moving image having the following parameters is considered. That is, the length of the moving image is 60 minutes, the resolution on the time axis is 60 frames per second, and therefore the total number of frames included in this moving image is 216,000. In this case, the number of the first still image is "00:00.00" representing "00 minutes 00 seconds 00th frame", and the number of the last still image is "59" representing "59 minutes 59 seconds 59th frame". : 59.59". The number of pixels in each frame is 1,920 pixels in the horizontal direction and 1,080 pixels in the vertical direction. Note that these parameters are merely examples and do not limit the present embodiment.

Note that the first minor step S131 may be performed in parallel with the second middle step S12. That is, even before the entire pre-editing moving image 7 is completely stored in the database 4, when a part of the pre-editing moving image 7 starts to reach the server 3, the frame of the portion that has reached the server 3 is changed to a still image. You can start conversion. Similarly, the first minor step S131 may be performed in parallel with the second intermediate step S12 and the first intermediate step S11. After the first sub-process S131, a second sub-process S132 is executed.

In the second sub-step S132, the evaluation section 334 of the calculation section 33 of the server 3 evaluates each still image. The results of this evaluation are preferably stored in database 4 .

Here, as an example of evaluation criteria, as described above, the case of using the probability that cancer cells are included in each region is considered. First, each still image is divided into a plurality of evaluation regions. For example, each still image may be divided horizontally into four and vertically into three, for a total of 12 evaluation areas. Next, each area of each still image is evaluated based on the evaluation criteria. For example, when using the probability that cancer cells are included as an evaluation criterion, the evaluation result can be represented by a numerical value of 0 to 100%.

The second sub-process S132 may be performed in parallel with the first sub-process S131. That is, the evaluation unit 334 may sequentially evaluate still images generated by converting from the pre-editing moving image 7 . Similarly, the second minor step S132 may be performed in parallel with the first minor step S131 and the second intermediate step S12, or may be performed in parallel with the first minor step S131, the second intermediate step S12 and the first intermediate step S11. may be performed. After the second sub-process S132, a third sub-process S133 is executed.

In the third sub-step S<b>133 , the intermediate still image group generation unit 331 of the calculation unit 33 of the server 3 generates the first intermediate still image 81 included in the intermediate still image group 8 . The first intermediate still image 81 is one huge still image formed by regularly arranging and combining some or all of the plurality of still images generated in the first sub-step S131.

A configuration example of the first intermediate still image 81 will be described with reference to FIG.

The intermediate still image group 8 in FIG. 3 includes a first intermediate still image 81 , a second intermediate still image 82 and a third intermediate still image 83 . In the example of FIG. 3, the number of images included in the intermediate still image group 8 is 3, but this number is just an example and any integer of 2 or more can be set. As will be described later, a second intermediate still image 82 is obtained by reducing the first intermediate still image 81 at a predetermined ratio, and a third intermediate still image 82 is obtained by further reducing the second intermediate still image 82 at a predetermined ratio. An intermediate still image 83 is obtained. Therefore, the configuration of the first intermediate still image 81 will be described here.

First, focusing on the horizontal arrangement of the first intermediate still images 81, it is preferable that the plurality of still images are arranged in a predetermined cycle. In the example of FIG. 3, the period in the horizontal direction is 1/60 second, and 60 still images are arranged in each horizontal row in chronological order from left to right. . In this case, all still images are included in the first intermediate still image 81 .

Next, focusing on the arrangement of the first intermediate still images 81 in the vertical direction, it is preferable that the plurality of still images are arranged in a cycle different from that in the horizontal direction. In the example of Fig. 3, the vertical cycle is 1 second, which is longer than the horizontal cycle, and 3,600 still images are arranged in a vertical row in chronological order from top to bottom. They are arranged side by side.

In other words, the intermediate still image group generator 331 may generate the first intermediate still image 81 in the following procedure, for example. First, the number of vertical and horizontal pixels of the first intermediate still image 81 is calculated based on the total number of still images corresponding to each frame of the pre-editing moving image 7 and the vertical and horizontal cycles, and an image of this size is calculated. A memory area required for processing is secured in the storage unit 34 . Next, the image for which the memory area is secured is divided horizontally into 60 and vertically into 3,600, and a total of 216,000 cells are defined. Finally, one of the 216,000 still images is placed in each of the defined squares. Here, the order of arranging still images in each square is determined, for example, as follows. Start with the first cell on the first row from the top, first column from the left, that is, the first cell in the upper left corner, then proceed one square at a time to the right, until you reach the first column from the right on the first row from the top. , that is, it advances rightward by one square to the 60th square in the upper right corner. After that, proceed from the 61st square in the 1st row from the left on the 2nd row from the top to the right, and so on. We reach square 216,000. It should be noted that this order determination method is merely an example, and does not limit the present embodiment.

In the above example, the dimensions of the first intermediate still image 81 are 115,200 pixels in the horizontal direction and 3,888,000 pixels in the vertical direction. Depending on the performance of the server 3, it may be difficult to handle still images this large. In such a case, the first intermediate still image 81 may be divided into an appropriate number in each of the vertical and horizontal directions and managed as a plurality of files inside the server 3 .

Also, a plurality of first intermediate still images 81 may be generated. As another example from FIG. 3, the horizontal cycle may be set to 1 second and the vertical cycle may be set to 1 minute. In this case, only 1/60 of all still images is included in the first intermediate still image 81 .

Furthermore, a plurality of first intermediate still images 81 having different combinations of cycles in the vertical and horizontal directions may be generated. In this case, it is preferable that the first still image to be displayed can be switched by the user's operation in a step to be described later.

The generated first intermediate still image 81 is stored in the database 4 . After the third sub-process S133, a fourth sub-process S134 is executed.

In the fourth sub-step S<b>134 , the intermediate still image group generation unit 331 of the calculation unit 33 of the server 3 generates the second intermediate still image 82 included in the intermediate still image group 8 . The second intermediate still image 82 is generated by reducing the first intermediate still image 81 at a predetermined ratio, as described above. This ratio may be, for example, 1:2 in both the longitudinal and transverse directions. However, this is just an example and does not limit the present embodiment.

The intermediate still image group generating section 331 may further generate a third intermediate still image 83 in the fourth sub-step S134. The third intermediate still image 83 is generated by further reducing the second intermediate still image 82 at a predetermined ratio, as described above. Also, if the intermediate still image group 8 includes the fourth and subsequent still images, they may be similarly reduced and generated. As a result, a plurality of intermediate still images included in the intermediate still image group 8 have a pyramidal relationship of reduction or enlargement as shown in FIG. 1A.

The generated second intermediate still image 82 and third intermediate still image 83 are stored in the database 4 . After the fourth minor step S134, the second major step S2 is executed.

The second major step S2 includes a total of three intermediate steps, the first intermediate step S21 to the third intermediate step S23, as described above. Details of the first intermediate step S21 to the third intermediate step S23 will be described with reference to FIGS. 4A and 4B. FIG. 4A is the first half of a sequence diagram showing in more detail one configuration example of part of the video editing method according to one embodiment. FIG. 4B is the second half of the sequence diagram of which the first half is shown in FIG. 4A.

The sequence diagrams of FIGS. 4A and 4B show the steps performed by the server 3 and the terminal 5 and their order. In the first half of the sequence diagram shown in FIG. 4A, the first intermediate step S21 includes a total of eight steps from the first sub-step S211 to the eighth sub-step S218. In the second half of the sequence diagram shown in FIG. 4B, the second intermediate step S22 includes a total of four steps of the first sub-step S221 to the fourth sub-step S224, and the third intermediate step S23 is the first sub-step S231. to the third sub-step S233.

In the second major step S2, the server 3 and the terminal 5 work together to set the selection range for video editing. The second major process S2 starts from the first intermediate process S21. In the first intermediate step S21, the server 3 and the terminal 5 cooperate to display the intermediate still image group 8. FIG. The first intermediate step S21 starts from the first minor step S211.

In the first sub-step S211, the terminal 5 determines the display range of the intermediate still image group 8 to be displayed on the display device 522. FIG. The display range of the display device 522 according to this embodiment will be described with reference to FIG. 5A. FIG. 5A is a diagram showing a configuration example of display on the terminal 5 according to one embodiment.

In the example of FIG. 5A, the display device 522 of the terminal 5 is divided into a total of three display areas, ie, a first display area 5221 to a third display area 5223 . A first partial still image 812 is displayed in the first display area 5221 . A second partial still image 822 is displayed in the second display area 5222 . A third intermediate still image 83 is displayed in the third display area 5223 . In other words, on the display device 522 of the terminal 5, the first intermediate still image 81 to the third intermediate still image 83 with different scales are displayed simultaneously, albeit partially.

Note that the total number of display areas may be changeable according to the user's operation. Also, the positional relationship and area ratio of each display area with respect to the display device 522 may be changed according to the operation by the user.

The first partial still image 812 is the portion of the first intermediate still image 81 displayed in the first display area 5221 . As described above, the first intermediate still image 81 is very large, and it is difficult to display the entire image on the display device 522 of the terminal 5 at once. Therefore, it is necessary to extract and display a portion of the first intermediate still image 81, reduce and display the whole or a portion of the first intermediate still image 81, or display a combination of both. A first display range 811 shown in FIG. 3 schematically shows a portion of the first intermediate still image 81 displayed in the first display area 5221 shown in FIG. 5A.

Similarly, the second partial still image 822 is the portion of the second intermediate still image 82 displayed in the second display area 5222, and this portion corresponds to the second display range 821 shown schematically in FIG. corresponds to

In the examples of FIGS. 3 and 5A, the third intermediate still image 83 is sufficiently reduced with respect to the third display area 5223 and displayed in its entirety in the third display area 5223 . However, this is only an example, and when the third intermediate still image 83 is large with respect to the third display area 5223, the third intermediate still image 83 is displayed in the same manner as the first partial still image 812 and the second partial still image 822. A part of the intermediate still image 83 is preferably extracted and displayed in the third display area 5223 .

As will be described later, the position and width of the first display range 811 with respect to the first intermediate still image 81 and the position and width of the second display range 821 with respect to the second intermediate still image 82 are changed according to the user's operation. preferably. However, only when displaying for the first time, it is preferable to determine each display range according to predetermined initial settings without waiting for an operation by the user. The initial setting of the display range may be set, for example, so that the portion corresponding to the first frame of each intermediate still image is displayed in the center of each display area.

Here, it should be noted that only the first display range 811 and the second display range 821 are determined at the stage of the first sub-step S211, and the determination is not reflected on the display device 522. FIG. After the first sub-process S211, a second sub-process S212 is executed.

In the second sub-step S212, the display control signal generator 531 of the terminal 5 generates a display control signal representing the display range determined in the first sub-step S211. However, the display range actually represented by the display control signal may be a wider area by adding a certain margin to the periphery of the display range determined in the first sub-step S211. After the second sub-process S212, a third sub-process S213 is executed.

In the third sub-step S213, the communication device 521 of the terminal 5 transmits a display control signal to the server 3. After the third sub-process S213, a fourth sub-process S214 is executed.

In the fourth sub-step S214, the communication unit 321 of the server 3 receives the display control signal. The received display control signal may be stored in the storage unit 34 . After the fourth sub-process S214, the fifth sub-process S215 is executed.

In the fifth sub-step S215, the partial still image group generation unit 332 of the server 3 generates a partial still image group according to the display control signal. In the example of FIG. 5A, the partial still image group includes a first partial still image 812, a second partial still image 822 and a third intermediate still image 83. In the example of FIG.

As described above, the first partial still image 812 is generated by extracting the portion corresponding to the first display range 811 represented by the display control signal from the first intermediate still image 81 . Similarly, the second partial still image 822 is generated by extracting the portion corresponding to the second display range 821 represented by the display control signal from the second intermediate still image 82 .

After the fifth sub-process S215, a sixth sub-process S216 is executed.

In the sixth sub-step S<b>216 , the communication unit 321 of the server 3 transmits the partial still image group to the terminal 5 . After the sixth sub-process S216, a seventh sub-process S217 is executed.

In the seventh sub-step S217, the communication device 521 of the terminal 5 receives the partial still image group. After the seventh sub-process S217, an eighth sub-process S218 is executed.

In the eighth sub-step S218, the terminal 5 displays the partial still image group on the display device 522. FIG. At this time, the terminal 5 appropriately cuts out and reduces the size of the first partial still image 812 included in the partial still image group according to the size of the first display area 5221 before displaying it. Similarly, the terminal 5 cuts out the second partial still image 822 and the third intermediate still image 83 included in the partial still image group appropriately according to the size of the second display area 5222 and the third display area 5223. and zoom out before displaying.

(Linked display of selection range)
Here, the display of the first display area 5221 to the third display area 5223 in conjunction with each other will be described. In the second display area 5222, a frame representing the first display range 811 corresponding to the first partial still image 812 displayed in the first display area 5221 is superimposed on the second partial still image 822. It is preferable to display in conjunction with the partial still image 822 . By doing so, the user can more easily grasp the correspondence relationship between the first partial still image 812 and the second partial still image 822 . Similarly, in the third display area 5223, a frame representing the second display range 821 corresponding to the second partial still image 822 displayed in the second display area 5222 is superimposed on the third intermediate still image 83. , is preferably displayed in conjunction with the third intermediate still image 83 .

In addition, the selection range 84 is displayed in each of the first display area 5221 to the third display area 5223 in conjunction with the first partial still image 812, the second partial still image 822, and the third intermediate still image 83. preferably. The selection range 84 may be displayed as a frame surrounding it, or the selection range 84 and other portions may be displayed by distinguishing them using different brightness or saturation.

Furthermore, when an operation is performed to scroll one of the first partial still image 812 and the second partial still image 822 on the display device 522, the other partial still image is also automatically scrolled in conjunction. Details of this operation will be described later.

(Overlapping display of evaluation results)
On the first partial still image 812 displayed on the display device 522, the result of the evaluation performed in the second minor step S132 of the third intermediate step S13 of the first major step S1 may be superimposed and displayed. A method of displaying evaluation results will be described with reference to FIG. 5B. FIG. 5B is a diagram showing another configuration example of display on the terminal 5 according to one embodiment.

In FIG. 5B, for the sake of explanation, a total of 9 still images are extracted from the first partial still image 812, with 3 columns in the horizontal direction and 3 columns in the vertical direction. As described above, each of these nine still images is horizontally divided into four and vertically divided into three, for a total of 12 evaluation areas. In FIG. 5B, the still images are delimited by solid lines and the evaluation panes 89 are delimited by dashed lines.

Almost all of the respective evaluation areas are surrounded by non-selection frames 87 at the four corners. Among them, only one evaluation area on which the cursor 86 overlaps is surrounded at four corners by a selection frame 88 having a shape different from that of the non-selection frame 87 . Here, the cursor 86 can be moved by the user's operation, and each time the cursor 86 moves over the evaluation frame 89, the non-selection frame 87 of the evaluation region to be moved changes to the selection frame 88, and vice versa. , the selection frame 88 of the evaluation area of the movement source returns to the non-selection frame 87 . In order to make it easier for the user to distinguish between the non-selection frame 87 and the selection frame 88, the shape of both, the positional relationship with the corresponding table frame, etc. may be changed. In the example of FIG. 5B, the non-selection frame 87 is arranged inside the evaluation frame 89 , while the selection frame 88 protrudes from the evaluation frame 89 . Also, the selection frame 88 has a wider width than the non-selection frame 87 .

Each of the non-selection frame 87 and the selection frame 88 preferably represents the evaluation result of the corresponding evaluation area so that the user can easily distinguish between them. For example, the non-selection frame 87 and the selection frame 88 may be displayed with different colors corresponding to the evaluation results, or may be displayed with different shapes corresponding to the evaluation results. As a display method using different colors, for example, a color-coding method in which numerical values of evaluation results are converted into hues may be adopted. As an example of hue conversion, the higher the value, the closer to warm colors such as red and yellow, and the lower the value, the closer to cold colors such as blue and purple. Also, as a display method based on the difference in shape, for example, the higher the numerical value of the evaluation result, the longer the width and length, and conversely, the lower the numerical value, the smaller the width and length. good.

By displaying the evaluation result corresponding to each evaluation area of the first partial still image 812, it is expected that the user can easily select the desired range.

After the eighth minor step S218, the second intermediate step S22 is executed.

In the second intermediate step S22, the terminal 5 performs an input operation by the user. The second intermediate step S22 starts from the first minor step S221.

In the first sub-step S221, the input device 523 of the terminal 5 inputs an operation by the user. For example, when the terminal 5 is a tablet, a smartphone, or the like, this operation may be performed via a touch panel integrated with the display device 522 . Also, if the terminal 5 is a personal computer or the like, it may be performed via a mouse or a keyboard. After the first sub-process S221, the second sub-process S222 to the fourth sub-process S224 are executed.

In the second sub-process S222, the third sub-process S223, and the fourth sub-process S224, the terminal 5 roughly classifies the operations input in the first sub-process S221 into four types. That is, an operation of selecting the selection range 84, an operation of changing the display range, an operation of completing editing work of the moving image, or other operations. The second sub-process S222, the third sub-process S223, and the fourth sub-process S224 may be executed simultaneously, but for the sake of convenience, FIG. 4B shows a configuration example in which they are executed sequentially.

In the second sub-step S222, the arithmetic device 53 determines whether the operation input in the first sub-step S221 was the operation to set the selection range 84. Here, the operation for setting the selection range 84 may be an operation for the user to select the first or last frame included in the selection range 84 . If the input operation is an operation for setting the selection range 84 (YES), the contents of the operation are stored in the storage device 54 . After that, the eighth minor step S218 of the first intermediate step S21 of the second major step S2 is executed again. This is because the display range of the partial still image group displayed in each display area does not change, but the display of the selection range 84 needs to be changed. Conversely, if the input operation is not the operation of setting the selection range 84 (NO), then the third sub-step S223 is executed.

In the third sub-step S223, the arithmetic device 53 determines whether the operation input in the first sub-step S221 is an operation to change the display range. Here, as an operation for changing the display range, for example, a so-called scrolling operation that horizontally moves the display range continuously in a predetermined direction, and a currently displayed still image are changed to the currently displayed area. A so-called jump operation is conceivable, which is a discontinuous horizontal movement to another still image outside. If the input operation is an operation to change the display range (YES), the display range of the group of partial still images displayed in each display area will be changed. The first sub-step S211 of step S21 is executed again.

With reference to FIGS. 6A and 6B, it will be described that pseudo moving image reproduction using still images is possible by performing a so-called scrolling operation in units of still images. FIG. 6A is a diagram showing an example of a method of displaying the intermediate still image group 8 according to one embodiment. FIG. 6B is a diagram showing another example of how to display the intermediate still image group 8 according to one embodiment.

FIG. 6A shows a table of the first display area 5221 at the first time t ₁₁ to the fourth time t ₁₄ when the user performs an operation to scroll the display contents of the display device 522 from right to left. An example is shown. A first partial still image 812 that is a part of the first intermediate still image 81 is displayed in the first display area 5221 at each time, but the display range differs for each time. Also, in FIG. 6A, each of the still images included in the first partial still image 812 at each time is indicated by a corresponding number. As described above, this number represents the elapsed time from the start of shooting of the pre-editing moving image 7 to the shooting of that frame in the format of "minutes:seconds.frames".

Note that in FIG. 6A , the still images whose times are displayed in parentheses as numbers correspond to virtual frames that can be arranged outside the first intermediate still image 81 . For example, of the first partial still image 812 corresponding to time t13, the still image _in the second row from the top and the first row from the right is displayed as "(00:01.00)". If this still image were to be arranged further to the right of the still image "00:00.59" arranged at the right end of the first intermediate still image 81, it would be the still image "00:01.00". indicates that it should Such a virtual frame may be displayed as a blackened still image, for example. In particular, a still image with a number "(--:--.--)" corresponds to the time before or after the shooting of the pre-editing moving image 7 was started or after the frame corresponding to the still image. It indicates that it is a virtual frame.

Focusing on the number of the still image arranged in the center of the first partial still image 812 at each time, it is "00: _01.57 " at the first time t11. Similarly, the second time t12 is "00: _01.58 ", the third time _t13 is "00: _01.59 ", and the fourth time t14 is "00:02.00". Note that the first partial still image 812 scrolls by the size of the still image. As a result, when the user fixes the viewpoint at the center of the first display area 5221 and performs a scroll operation to move the first display range 811 in the horizontal direction, the still image positioned at that location is displayed in the first display area 5221 . Switching from "00: _01.57 " at time t11 to "00: _01.58 " at second time t12, and further "00: _01.59 " at third time t13 and "00: _01.59 " at fourth time t14 00:02.00". By performing such switching display, it appears to the user's eyes as if the pre-editing moving image 7 is being reproduced.

As described above, in the present embodiment, in communication between the server 3 and the terminal 5, still images with a relatively low bit rate are continuously reproduced without streaming playback of the pre-editing video 7 with a relatively high bit rate. By switching the display to , it is possible to perform pseudo video playback.

Similar pseudo moving image reproduction can also be performed by a vertical scrolling operation, as shown in FIG. 6B. Since the vertical scrolling operation is just a change in the direction of the horizontal scrolling operation described with reference to FIG. 6A, further detailed description is omitted. However, it should be noted that the periods of the frames corresponding to the plurality of still images arranged in the first intermediate still image 81 are different in the horizontal direction and the vertical direction. That is, in the case of the present embodiment, frame-by-frame display can be realized in pseudo moving image reproduction by horizontal scrolling, but fast forward display can be realized in pseudo moving image reproduction by vertical scrolling. In other words, in this embodiment, it is possible to very easily switch between pseudo moving image playback at different speeds by selecting the direction of scrolling on the display device 522 . It should also be noted that frame-by-frame reverse playback and rewind display can be easily realized simply by reversing the direction of scrolling.

With reference to FIG. 6C, it will be described that when performing a so-called jump operation, the user can intuitively and easily grasp the destination by performing reduced display and enlarged display in the first display area 5221 . FIG. 6C is a diagram showing still another example of a method of displaying the intermediate still image group 8 according to one embodiment.

A jump operation according to the present embodiment is preferably performed in the second display area 5222 or the third display area 5223 . Specifically, the user selects one of the still images displayed in the second partial still image 822 or the third intermediate still image 83 as the jump destination still image 85B. At this time, in the first display area 5221, display in conjunction with the second display area 5222 and the third display area 5223 is performed.

FIG. 6C shows an example of how the display of the first display area 5221 changes at each of the first time t ₃₁ to the third time t ₃₃ when the user performs the jump operation. The first time t31 is immediately before the jump operation, and the first partial still image 812 is displayed in the first display area _5221. FIG. The still image arranged in the center of the first partial still image 812 at the first time _t31 is called the jump source still image 85A for convenience. The third time _t33 is immediately after the jump operation, and the first partial still image 812 is displayed in the first display area 5221. FIG. The jump destination still image 85B is displayed in the center of the first partial still image 812 at the third time _t33 . The second time _t32 is a time between the first time t31 and the third time _t33 , and the jump source first display range _811A and A portion including both the jump destination first display range 811B is reduced and displayed. Here, the jump source first display range _811A is the display range corresponding to the first partial still image 812 at the first time t31, and the jump destination first display range 811B is the first display range _811B at the third time t33. This is the display range corresponding to the partial still image 812 .

It is preferable that the portion of the first intermediate still image 81 displayed in the first display area 5221 is gradually enlarged from the first time _t31 to the second time _t32 . In other words, the display content of the first display area 5221 is gradually reduced from the first time _t31 to the second time _t32 . On the contrary, it is preferable that the portion of the first intermediate still image 81 displayed in the first display area 5221 is gradually reduced from the second time _t32 to the third time _t33 . In other words, the display content of the first display area 5221 is gradually enlarged from the second time _t32 to the third time _t33 .

Note that when the jump destination still image 85B is included in the first display range 811, the first display area 5221 is not reduced or enlarged, and the jump destination still image is displayed in the first display range 811. You may perform scrolling to move to the center of . This is because there is a low possibility that the user will lose sight of the jump source still image 85A if the jump is this distance.

By directing the first display area 5221 in this way, it is possible to visually and easily understand for the user which jump source still image 85A is heading to which jump destination still image 85B by the jump operation. becomes.

If the operation input in the first sub-step S221 is not the operation of selecting the selection range 84 (NO), then the fourth sub-step S224 is executed.

In the fourth sub-step S224, the arithmetic device 53 determines whether or not the operation input in the first sub-step S221 was the operation for completing the editing work of the moving image. Here, the operation of completing the moving image editing operation is the operation of confirming these selections after the user selects the first or last frame included in the selection range 84 in the second minor step S222. If the input operation is an operation to complete the editing work of the moving image (YES), then the first minor step S231 of the third intermediate step S23 of the second major step S2 is executed. If the input operation is not an operation to complete the editing work of the moving image (NO), and even if the operation is to complete the editing work of the moving image, the selection of the first or last frame included in the selection range 84 is completed. If not, or if it is invalid, then the first sub-process S211 of the first medium process S21 of the second major process S2 is executed again. If there is no need to update the display, the first sub-step S221 of inputting the operation may be executed again.

In the third intermediate step S23 of the second major step S2, the terminal 5 generates an edit control signal. The third intermediate step S23 starts from the first minor step S231.

In the first sub-step S231, the edit control signal generator 532 of the terminal 5 generates an edit control signal. The edit control signal includes information indicating the first or last frame that defines the selection range 84 to be extracted from the unedited moving image 7 . The edit control signal generator 532 generates edit control signals based on information stored in the storage device 54 . After the first sub-process S231, a second sub-process S232 is executed.

In the second sub-step S232, the communication device 521 of the terminal 5 transmits an edit control signal to the server 3. After the second sub-process S232, a third sub-process S233 is executed.

In the third sub-step S233, the communication section 321 of the server 3 receives the edit control signal and stores it in the storage section . After the third minor step S233, the third major step S3 is executed.

In the third major step S3, the edited moving image generator 333 of the server 3 generates the edited moving image 9 based on the edit control signal. More specifically, a selection range 84 included between two frames indicated by the edit control signal is extracted from the pre-edited moving image 7 and stored in the database 4 as the edited moving image 9 . In actual operation, a plurality of selection ranges 84 may be extracted from the same pre-editing image 7 and combined, or an edited moving image 9 may be generated by combining the plurality of selection ranges 84 in an order different from that at the time of shooting. You can Further, a plurality of selection ranges 84 may be extracted from a plurality of pre-editing images 7, or an edited moving image 9 may be generated by combining a plurality of selection ranges 84 extracted from a plurality of pre-editing images 7 in a desired order. Also good. When the third major step S3 is completed, the operation of the moving image editing system 1 according to this embodiment, that is, the moving image editing method according to this embodiment is also completed.

As described above, according to the present embodiment, all or part of the frames included in the pre-editing moving image 7 are arranged vertically and horizontally and displayed as a list, so that two frames that serve as reference points for the selection range 84 can be easily identified. can be found and specified. Furthermore, by easily performing pseudo moving image reproduction at two different speeds depending on the direction of scrolling, it is possible to facilitate searching for a frame that serves as a reference point. Also, displaying the evaluation result for each evaluation area obtained by dividing each frame makes it possible to easily search for the frame serving as the reference point. By transmitting/receiving still image data instead of moving image data between the server 3 and the terminal 5, more agile operation can be expected.

Although the invention made by the inventor has been specifically described above based on the embodiment, it should be understood that the invention is not limited to the above-described embodiment, and that various changes can be made without departing from the gist of the invention. Needless to say. Further, the features described in the above embodiments can be freely combined within a technically consistent range.

1 moving image editing system 2 photographing device 3 server 31 bus 32 input/output interface 321 communication unit 33 calculation unit 331 intermediate still image group generation unit 332 partial still image group generation unit 333 post-editing moving image generation unit 334 evaluation unit 34 storage unit 35 external storage Device 351 Recording medium 4 Database 5 Terminal 51 Bus 52 Input/output interface 521 Communication device 522 Display device 5221 First display area 5222 Second display area 5223 Third display area 523 Input device 53 Arithmetic device 531 Display control signal generator 532 Edit control Signal generator 54 Storage device 55 External storage device 551 Recording medium 6 Display device 7 Pre-editing moving image 8 Intermediate still image group 81 First intermediate still image 811 First display range 811A Jump source first display range 811B Jump destination first display range 812 First partial still image 82 Second intermediate still image 821 Second display range 822 Second partial still image 83 Third intermediate still image 84 Selection range 85A Jump source still image 85B Jump destination still image 86 Cursor 87 Non-selection frame 88 Selection Frame 89 Evaluation frame 9 Edited video

Claims (12)

a server that generates an intermediate still image group from the unedited video;
a terminal that partially reads the intermediate still image group from the server and sets a desired selection range included in the pre-editing moving image based on the intermediate still image group;
The server is
A plurality of still images included in the pre-editing moving image and arranged in chronological order are arranged in a first direction in a first period and are orthogonal to the first direction in a second period different from the first period. generating a first intermediate still image out of the group of intermediate still images arranged in a second direction, and reducing the first intermediate still image to produce a second intermediate still image out of the group of intermediate still images; an intermediate still image group generating unit to generate;
a first partial still image included in a predetermined first display range of the first intermediate still image and the first display of the second intermediate still image according to a display control signal received from the terminal; a partial still image group generating unit for generating a second partial still image included in a second display range including the range,
The terminal is
a display device that displays the first partial still image and the second partial still image such that the first display range and the second display range are interlocked;
inputting a display control operation for setting the first display range of the first intermediate still image to be displayed at one time, and selecting any one of the plurality of still images included in the first partial still image; an input device for inputting an edit control operation for setting a still image as one end of a selection range;
an arithmetic device that generates the display control signal for transmitting the contents of the display control operation to the server and generates an editing control signal for transmitting the contents of the editing control operation to the server;
The server is
A moving image editing system, further comprising: an edited moving image generation unit that extracts a portion included in the selected range from the unedited moving image to generate an edited moving image according to the edit control signal received from the terminal. In the video editing system according to claim 1,
When changing the first display range, the display device of the terminal continuously scrolls the first partial still image in units of still images in the first direction, thereby displaying a pseudo display in the first period. moving image reproduction, and continuously scrolling still image units in the second direction to perform pseudo moving image reproduction in the second cycle. In the movie editing system according to claim 1 or 2,
The intermediate still image group generating unit of the server further generates a third intermediate still image by further reducing the second intermediate still image,
The display device of the terminal,
further displaying the entirety of the third intermediate still image simultaneously with the first partial still image and the second partial still image;
A moving image editing system further displaying frames corresponding to the first display range and the second display range in the third intermediate still image so as to overlap the third intermediate still image. In the video editing system according to any one of claims 1 to 3,
The server is
further comprising an evaluation unit that divides each of the plurality of still images into a plurality of evaluation regions having predetermined dimensions, and evaluates each of the plurality of evaluation regions according to a predetermined standard;
The display device of the terminal,
A moving image editing system, wherein, when displaying the first partial still image, each of the plurality of evaluation regions is displayed while being distinguished from each other by the result of the evaluation. An input/output interface for inputting unedited video from the outside,
a database that stores the pre-editing video;
A plurality of still images included in the pre-editing moving image and arranged in chronological order are arranged in a first direction in a first period and are orthogonal to the first direction in a second period different from the first period. Generating a first intermediate still image out of the group of intermediate still images arranged in a second direction, and reducing the first intermediate still image to generate a second intermediate still image out of the group of intermediate still images. an intermediate still image group generation unit for
a first partial still image included in a predetermined first display range of the first intermediate still image and the first display range of the second intermediate still image according to a display control signal received from the outside; a partial still image group generating unit for generating a second partial still image included in a second display range including
A server, comprising: an edited moving image generation unit for generating an edited moving image by extracting a portion included in a desired selection range from the unedited moving image according to an edit control signal received from the outside. A first partial still image included in a predetermined first display range of the first intermediate still image, and a second intermediate still image including the first display range of the second intermediate still image reduced from the first intermediate still image. an input/output interface for externally inputting the second partial still image included in the display range;
a display device that displays the first partial still image and the second partial still image such that the first display range and the second display range are interlocked;
The first intermediate still images are a plurality of still images arranged in a first direction with a first period and arranged in a second direction orthogonal to the first direction with a second period different from the first period. and inputting a display control operation for setting the first display range to be displayed at one time among the first intermediate still images, and being included in the first partial still image among the plurality of still images an input device for inputting an edit control operation for setting one of the still images as one end of the selection range;
a computing device that generates a display control signal for transmitting the contents of the display control operation to the outside and an editing control signal for transmitting the contents of the editing control operation to the outside. generating an intermediate still image group from the pre-editing video;
setting a desired selection range to be included in the pre-editing moving image based on the intermediate still image group;
Extracting a portion included in the selection range from the pre-editing video to generate an edited video,
Generating the intermediate still image group includes:
A plurality of still images included in the pre-editing moving image and arranged in chronological order are arranged in a first direction in a first period and are orthogonal to the first direction in a second period different from the first period. generating a first intermediate still image aligned in a second direction;
generating a second intermediate still image by reducing the first intermediate still image;
Setting the selection range includes:
inputting a display control operation;
setting a first display range of the first intermediate still image to be displayed at one time according to the display control operation;
A first partial still image included in the first display range of the first intermediate still image, and a second portion included in a second display range including the first display range of the second intermediate still image. displaying a still image such that the first display range and the second display range are interlocked;
entering an edit control operation;
A moving image editing method, comprising setting one of the still images included in the first partial still image among the plurality of still images as one end of the selection range in accordance with the editing control operation. In the video editing method according to claim 7,
The displaying includes:
Continuously scrolling the first partial still image in units of still images in the first direction to perform pseudo moving image reproduction in the first period;
A moving image editing method, comprising: continuously scrolling the first partial still image in units of still images in the second direction to perform pseudo moving image reproduction in the second period. In the video editing method according to claim 7 or 8,
Generating the intermediate still image group includes:
further comprising reducing the second intermediate still image to generate a third intermediate still image;
The displaying includes:
displaying the entire third intermediate still image simultaneously with the first partial still image and the second partial still image;
A moving image editing method, comprising displaying frames corresponding to the first display range and the second display range in the third intermediate still image so as to overlap the third intermediate still image. In the video editing method according to any one of claims 7 to 9,
Generating the intermediate still image group includes:
Further comprising dividing each of the plurality of still images into a plurality of evaluation regions having a predetermined size, and evaluating each of the plurality of evaluation regions according to a predetermined standard;
The displaying includes:
A moving image editing method, comprising: displaying each of the plurality of evaluation areas while distinguishing them according to the result of the evaluation when displaying the first partial still image. inputting pre-edited video from outside;
storing the pre-edited video;
A plurality of still images included in the pre-editing moving image and arranged in chronological order are arranged in a first direction in a first period and are orthogonal to the first direction in a second period different from the first period. Generating a first intermediate still image of the group of intermediate still images arranged in a second direction;
reducing the first intermediate still image to generate a second intermediate still image of the group of intermediate still images;
receiving a display control signal from the outside;
According to the display control signal, a first partial still image included in a predetermined first display range of the first intermediate still image, and a partial still image included in a predetermined first display range of the second intermediate still image, and a second partial still image including the first display range of the second intermediate still image generating a second partial still image included in the two display ranges;
receiving edit control signals from the outside;
A moving image editing method, comprising extracting a portion included in a selection range from the unedited moving image to generate an edited moving image according to the editing control signal. A first partial still image included in a predetermined first display range of the first intermediate still image, and a second intermediate still image including the first display range of the second intermediate still image reduced from the first intermediate still image. externally inputting a second partial still image included in the display range;
displaying the first partial still image and the second partial still image such that the first display range and the second display range are interlocked;
The first intermediate still images are a plurality of still images arranged in a first direction with a first period and arranged in a second direction orthogonal to the first direction with a second period different from the first period. and inputting a display control operation for setting the first display range of the first intermediate still image to be displayed at one time;
inputting an edit control operation for setting one of the plurality of still images included in the first partial still image as one end of a selection range;
generating a display control signal for externally transmitting the content of the display control operation;
A moving picture editing method, comprising: generating an edit control signal for externally transmitting the content of the edit control operation.

Images