JP2000100128A - Editing system and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily grasp a unit step, and to improve the working efficiency of editing by outputting a processed clip as a result clip, and by displaying each button corresponding to the unit step of each clip processing layer. SOLUTION: One sequence of video moving image data is defined as a clip, one clip is treated as one layer, and an image is processed on the layer. In the area of a time line 46 in an editor window, a plurality of desired layers are displayed in the time sequence array of a reduced thumbnail picture, and a desired frame is dragged to an object area 47 for editing the clip. A scale selection area 43 has a button for setting a scale of a time direction in the time line 46. For example, when '1' being used as the unit time of 'Frame' is specified, the thumbnail picture is displayed in 1 frame unit at each fifth frame. In the time scale area 45, the figures of time at each fifth frame is displayed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an editing system and an editing method for synthesizing an image and performing an editing process by applying a special effect to the image.

[0002]

2. Description of the Related Art In recent years, in the field of post-production for editing video data obtained from a video camera, there is a non-linear editing system using a disk as a recording medium for recording material data. Various types of editing processing are performed as editing processing performed in the non-linear editing system. For example, video editing processing to create a desired video program by connecting multiple materials, combining processing to combine multiple materials using key signals, and special effect processing to apply special effect processing to materials Etc. exist. Generally, the video editing process is performed by an editing device, the synthesizing process is performed by a video switcher, and the special effect process is performed by a special effect device.

[0003] Today, with the improvement of random accessibility of disk-shaped recording media, it is possible to simultaneously access video data of a plurality of channels.
An editing system for processing video data of a plurality of channels in real time has been demanded. For example, in the editing industry for creating commercials for television broadcasting, the editing industry for creating movie programs, etc., editing processing is performed using tens to hundreds of materials, and different types of editing processing are used in combination. It is desired. Further, it has been required to generate sophisticated and complicated editing result data by repeatedly performing these plural kinds of editing processes many times.

In order to realize such editing processing, there has been proposed an editing system using a timeline showing the contents of the editing processing in a multilayered layer structure.

In such an editing system, the contents of the editing process are displayed on a monitor so as to be easily understood by the user, and the editing process is easily performed by using a pointing device such as a mouse. So that you can do it.

[0006]

However, in the conventional editing system, since the editing is performed in the order from the lower layer to the upper layer or in the order from the upper layer to the lower layer, the content of the processing is limited by the layer configuration. Therefore, an editing system that can freely perform editing processing regardless of whether the layer is an upper layer or a lower layer has been considered.

[0007] However, in such an editing system, switching of each layer per unit step cannot be performed easily, and when performing the switching, the switching operation is very complicated and takes a very long time. there were. For example, when a slider for switching unit steps is slid using a pointing device such as a mouse or the like, it takes a lot of time and effort to perform a desired unit step.

The present invention has been proposed in view of such circumstances, and provides an editing system and an editing method capable of easily and easily switching unit steps when performing an editing process. Aim.

[0009]

In order to solve the above-mentioned problems, an editing system according to the present invention edits a plurality of clips serving as editing units to generate an edited processed result clip. A clip processing unit having a plurality of clip processing layers for performing predetermined processing on a clip while managing time, and a plurality of objects corresponding to the respective clip processing layers, each of which is connected to each other to form one hierarchical structure And a display means for displaying the processing contents of the clip processing means as a timeline, and displaying the hierarchical structure of the clip processing layers by connecting the hierarchical structure between the objects. The clip processing means manages the time of each clip processing layer and includes one clip processing layer. The clip that has been subjected to the predetermined processing is subjected to predetermined processing by a clip processing layer in a higher layer than the one clip layer, and the predetermined processed clip output from the clip processing layer in the highest layer is set as a result clip. The output means displays the respective buttons corresponding to the unit steps of each clip processing layer.

According to the editing method of the present invention, in the editing method of editing a plurality of clips serving as an editing unit and generating a result-processed clip, a plurality of clip processing layers perform predetermined processing on the clips while managing time. And a plurality of objects respectively corresponding to the respective clip processing layers. Each of the objects is connected to each other to form one hierarchical structure, so that the hierarchy of each clip processing layer is determined. The contents are displayed as a timeline, the formed hierarchical structure is displayed by connecting the objects, and time management of each clip processing layer is performed. The clip processing layer on the upper layer than the clip layer of Outputs a predetermined processed clip output from the layer results as a clip, and displaying the respective buttons corresponding to the unit step of the clipping layer.

[0011]

Embodiments of the present invention will be described below with reference to the drawings.

1. Overall Configuration of Editing System The present invention is applied to, for example, an editing system 1 having a configuration shown in FIG. The editing system 1 includes a workstation 2 that controls the entire system. The workstation 2 includes a main body 2A including a CPU (central processing unit) and various processing circuits, a floppy disk drive, a hard disk drive, and the like.
A has a display 2B, a keyboard 2C, a mouse 2D, and a pen / tablet 2E connected to A. In such a workstation 2, application software for editing is installed in a hard disk drive in advance, and the workstation 2 is activated as an editing computer by operating the application software based on an operating system.

When this application software is operated, a graphic display for a GUI (graphical user interface) is displayed on the display 2B, and the above-described pen tablet 2E and mouse 2D are connected to the display 2B. When the user selects a desired graphic display to be displayed on the display 2B, a desired editing command can be input to the workstation 2. In addition, various numerical data related to editing and the like can be input to the workstation 2 via the keyboard 2C.

When an editing command or various numerical data is input by a user operation, the workstation 2 outputs control data corresponding to the editing command or various numerical data to a device controller 3 described later. Thus, each device constituting the editing system 1 can be controlled via the device controller 3. However, regarding the video disc recorder 5,
Some functions can be directly controlled without using the device controller 3.

Video data is input to the workstation 2 via the device controller 3, and an image of an editing material, an image after editing, and the like are displayed on the display 2.
B.

The device controller 3 is a control device that receives control data from the workstation 2 and actually controls each device. A dedicated controller 4 having a dial operator, a slide operator, and the like is connected to the device controller 3, so that in the editing system 1, the keyboard 2 C, the mouse 2 D, or the pen / tablet 2 E of the workstation 2 is provided. Then, gradually changing control data that cannot be input can be input.

The device controller 3 receives control data from the workstation 2 and the dedicated controller 4, and controls a device corresponding to the control data. For example, for the video disk recorder 5, the device controller 3 instructs reproduction of the material and recording of the edited material. Upon receiving the instruction, the video disk recorder 5 reproduces and outputs video data or audio data of a desired material recorded on the internal disk-shaped recording medium, or edits the edited video data. And audio data are recorded on the disk-shaped recording medium.

Similarly, a video tape recorder (VTR)
6, the device controller 3 instructs reproduction of the material. Video tape recorder 6 receiving this instruction
Reproduces and outputs video data and audio data of a desired material recorded on an internal video tape in response to the instruction. In the case of the editing system 1, the video data recorded on the video tape recorder 6 is temporarily downloaded to the video disc recorder 5, and then treated as video data of the material.

The device controller 3 includes a switcher 7
Is instructed to select video data output from the video disk recorder 5, the video tape recorder 6, or the video camera 8. Switcher 7 receiving this instruction
According to the instruction, video data of a desired material to be input is selected and output to the digital multi-effector 9, output to the workstation 2 via the device controller 3, or The video data is sequentially selected and connected, the edited video data is output to the monitor 10 for display, and the edited video data is returned to the video disk recorder 5 for recording.

The device controller 3 instructs the digital multi-effector 9 to perform various effect processes. In response to the instruction, the digital multi-effector 9 applies special effect processing such as mosaic processing and three-dimensional image conversion processing to the input desired video data, and effects such as transition effects. Processing or image synthesizing processing is performed, and the video data obtained as a result is returned to the switcher 7 again and output to the workstation 2, the monitor 10, the video disk recorder 5, and the like.

The device controller 3 instructs the audio mixer 11 to edit audio data output from the video disk recorder 5 or the video tape recorder 6. The audio mixer 11 synthesizes (mixes) a desired audio material in accordance with the instruction, and returns the synthesized audio data to the video disk recorder 5 for recording.

Thus, in the editing system 1 having such a configuration, by inputting a desired editing command via the work station 2, various kinds of plural plural data recorded on the video disk recorder 5 and the video tape recorder 6 are obtained. Using the video data of the material, it is possible to easily create sophisticated and complicated desired video data. Thus, various edits can be performed only by operating the workstation 2 without the user directly operating each device constituting the editing system as in the related art.

2. Configuration of Workstation In this section, the configuration of the workstation 2, which is the main entity of the editing system 1, will be described. As shown in FIG. 2, the workstation 2 includes a system bus 20 for transmitting command data and video data, a CPU 21 for controlling the entire workstation 2, and video data S 1 supplied from the device controller 3. A video processor 22 for performing processing and the like, a display controller 23 for managing video data displayed on the display 2B and a graphic display for a GUI, an HDD interface 24 for controlling a local hard disk drive (local HDD) 24A, a floppy disk drive (FDD) F for controlling 25A
DD interface 25, keyboard 2C, mouse 2
D and pen. It has a pointing device interface 26 for generating a control command based on a command from a pointing device such as the tablet 2E, and an external interface 27 provided with a software driver for sending control data S2 to the device controller 3.

The system bus 20 is a bus for transmitting video data, command data, address data, and the like inside the workstation 2, and includes an image data bus 20A for transmitting video data, a command data and an address. A command data bus 20B for transmitting data.

The image data bus 20A has a CPU 21,
Video processor 22, display controller 23, HDD
Interface 24 and FDD interface 25
Are connected respectively. The CPU 21, the video processor 22, the display controller 23, the HDD interface 24, and the FDD interface 25 transmit video data via the image data bus 20A.

On the other hand, the command data bus 20B has C
PU 21, video processor 22, display controller 2
3. HDD interface 24, FDD interface 25, pointing device interface 2
6 and the external interface 27 (ie, all blocks inside the workstation 2 are connected), and the command data bus 20
Command data and address data are transmitted via B.

The CPU 21 is a block for controlling the entire work station 2, and a ROM 21 storing an operating system of the work station 2.
A and a RAM 21B for storing uploaded application software, a database, and the like. When starting workstation 2,
The CPU 21 is activated by operating based on the operating system stored in the ROM 21A. If you launch the application software under this running operating system,
The CPU 21 first reads out the application software recorded on the hard disk of the hard disk drive 24A, uploads it to the RAM 21B, and then executes and starts up the application software.

The application software is divided into modules for each function and is modularized. As will be described later, the application software is roughly divided into an editing module for connecting materials and the like, and a synthesizing process for overlapping materials and the like. A special effect module for performing special effect processing such as three-dimensional image conversion of materials, and a control module for managing activation of these modules and transfer of data between modules, etc. Have been. That is, in this system, when the application software is started, the control module starts first, and when an editing instruction is input by the user, the corresponding module (editing module, synthesizing module, Or a special effect module) as appropriate, and performs editing instructed by the user.

The video processor 22 receives an SDI (Serial Digital Interface) input to the workstation 2.
e) A block for receiving the standard video data S1, performing data conversion on the video data S1, and temporarily buffering the converted video data. Specifically, the video processor 22
Is a processor controller 22A that controls the entire video processor 22, and the received video data S
A data converter 22 for extracting a composite video signal from the payload section 1 and converting the composite video signal into digital component video data.
B and a frame memory 22 for temporarily storing video data of several frames transmitted from the data conversion unit 22B.
C.

The processor controller 22A controls the data conversion operation of the data conversion unit 22B by sending a control signal to the data conversion unit 22B, and extracts the time code from the video data S1 to the data conversion unit 22B. Let it. The processor controller 22A sends a control signal to the frame memory 22C to read / read the frame memory 22C.
Controls write timing and read / write address. Regarding the read timing, the processor controller 22A controls the read timing of the frame memory 22C so that the time code transmitted to the display controller 23 corresponds to the video data (frame data).

The data converter 22B converts a composite video signal into digital component video data based on a control signal from the processor controller 22A. The time code is extracted in this conversion process. The video data obtained by this conversion is sent to the frame memory 22C as described above, and the extracted time code is sent to the processor controller 22A.
Sent to

The frame memory 22C stores the data conversion unit 2
The video data supplied from 2B is temporarily stored.
The read / write timing of the frame memory 22C is controlled by the processor controller 22A as described above. The frame memory 22C includes at least two frame memories, and can store video data of at least two frames.

The video data stored in the frame memory 22C is read based on read control of the processor controller 22A. At this time, the image size is made smaller than the original image by reading out all pixels of the video data stored in the frame memory 22C instead of reading them out at predetermined intervals. The video data whose image size has been converted in this way is displayed in a predetermined display area of the display 2B for checking the material or the editing result, and is thus sent to the display controller 23 via the image data bus 20A.

The display controller 23 is connected to the display 2
6 is a control block for controlling data displayed on B. The display controller 23 is a memory controller 23
A and VRAM (Video Random Access Memory)
23B. The memory controller 23A operates according to the internal synchronization of the
Read / write timing is controlled. This VRAM
23B includes a frame memory 2 of the video processor 22.
2C and the image data generated by the CPU 21 are stored in the memory controller 2
It is stored based on the timing control signal from 3A.
The video data and image data stored in the VRAM 23B are read out based on a timing control signal from the memory controller 23A based on the internal synchronization of the workstation 2, and displayed on the display 2B.

In this case, the graphic display based on the image data is a graphic display for the GUI. The image data sent from the CPU 21 to the VRAM 23B is, for example, image data such as a window, a cursor, a scroll bar, or an icon indicating a device.

Thus, the workstation 2 displays the image data and the video data on the display 2B so that the display 2
B displays a GUI or material for user operation or an image of an edited result. The HDD interface 24 is an interface block for communicating with a local hard disk drive 24A provided inside the workstation 2. The HDD interface 24 and the hard disk drive 24A are connected to an SCSl (Small Com
Communication is performed based on the transmission format of the puter system interface).

In the hard disk drive 24A, application software to be started on the workstation 2 is installed. When the application software is executed, the application software is read from the hard disk drive 24A and uploaded to the RAM 21B of the CPU 21. Is done. When terminating the application software, the RAM 21
Various information (for example, information of a database relating to the editing material) generated by the editing operation stored in B is downloaded to the hard disk via the hard disk drive 24A.

The FDD interface 25 is an interface block for communicating with a floppy disk drive 25A provided inside the workstation 2. The FDD interface 25 and the floppy disk drive 25A perform communication based on the SCSI transmission format.

The pointing device interface 26 is an interface block for receiving information from the keyboard 2C, the mouse 2D, and the pen / tablet 2E connected to the workstation 2. The pointing device interface 26 is a keyboard 2C
The input information received from the button provided in the CPU 21 is decoded, and the received input information is decoded and transmitted to the CPU 21. Similarly, the pointing device interface 26
Receives, from the mouse 2D, detection information of a two-dimensional rotary encoder provided on the mouse 2D, and click information of left and right buttons provided on the mouse 2D (that is, selection designation information by pressing a button) from the mouse 2D. The information is decoded and transmitted to the CIPU 21. Similarly, the pointing device interface 26
CPU receives two-dimensional position data from pen / tablet 2E, decodes the received position data,
21. Based on such information from the pointing device interface 26, the CPU 21
Can recognize which command button of the GUI displayed on the display 2B has been instructed, can recognize various data input from the keyboard 2C, and can perform control corresponding thereto.

The external interface 27 is connected to the device controller 3 connected to the outside of the workstation 2.
It is a block for communicating with. The external interface 27 has a driver for converting various control commands such as a reproduction command and a recording command generated by the CPU 21 into data of a predetermined communication protocol, and transmits control command data S2 to the device controller 3 via the driver. Send out.

3. Principle of Editing in Editing System In this section, the principle of editing in editing system 1 will be described step by step.

(3-1) Basic Configuration of Application Software for Editing First, in this section, a basic configuration of application software for editing prepared in the workstation 2 will be described. As shown in FIG. 3, in the editing system 1, editing application software modularized for each function is prepared in a workstation 2. The modularized application software is roughly divided into an editing module EM for performing editing processing such as material joining processing, a combining module CM for performing combining processing such as material overlapping processing, and a special effect for the material. Special effect module SM for processing, editing module EM and compositing module C modularized for each of these functions
M and a control module CNTM that manages activation of the special effect module SM and the like. When the application software having such a configuration is uploaded from the hard disk drive 24A to the RAM 21B, the control module CNTM first starts up,
Under the control of the control module CNTM, each of the modules EM, CM, and SM is appropriately activated according to an instruction from the user.

The clip database CDB comprises the video disk recorder 5 and the RAM 21B.
It stores video data of materials and various data related to editing. Each of the modules EM, CM, and SM reads a material specified by the user from the clip database CDB, and uses hardware such as the above-described switcher 7 and digital multi-effector 9 to respond to the user's instruction for the material. And edits the resulting edited material into the clip database CDB.
Register with. Each module EM, CM and SM are
Data relating to editing such as various parameters used for editing is also registered in the clip database CDB. As the clip database CDB, mainly video data of the material is stored in the video disk recorder 5, and various data related to editing is stored in the RAM 21B.

(3-2) Definition of Clip In the editing system 1 according to the present invention, each material is handled in a unit called a clip. This section defines this clip. In the editing system 1 according to the present invention, one sequence of video moving image data is defined as clip video data, and data for managing how the clip video data is generated is defined as clip management data. Data consisting of clip video data and clip management data is defined as a clip. In the editing system 1 according to the present invention, a material generated by simply cutting out the source video data is referred to as a material clip (MC), and a material generated by editing the material clip is referred to as a result clip (FC). : Fat Clip).

In the editing system 1 according to the present invention, a plurality of clips including the material clips MC and the result clips FC are managed in a hierarchical structure based on the relationship between the clips. This will be described below with reference to the example shown in FIG.

In the example shown in FIG. 4, the result clip FC-0
08 is material clip MC-001, material clip MC
-002 and material clip MC-003 are generated by combining the three material clips. That is, the relationship between the result clip FC-008, the material clip MC-001, the material clip MC-002, and the material clip MC-003 is a vertical relationship. In such a vertical relationship, the material clip MC
−001, the material clip MC-002, and the material clip MC-003 are respectively called lower clips because they are subordinate to the result clip FC-008. Conversely, the result clip FC-008 is generated by integrating these lower clips. It is called an upper clip because it is a video clip.

Similarly, the result clip FC-009 is a clip generated by applying a special effect to the material clip MC-004. Therefore, the material clip MC-004 is a lower clip of the result clip FC-009, and conversely, the result clip FC-009 is a higher clip of the material clip MC-004.

The result clip FC-010 is a result clip generated by editing the result clip FC-008 and the result clip FC-009 (in this case, joining them by, for example, a wipe). For this reason, the result clip FC-008 and the result clip FC-
009 is a lower clip of the result clip FC-010, and the result clip FC-010 is a higher clip of the result clip FC-008 and the result clip FC-009.

As described above, each clip has a vertical relationship. In this editing system 1, the clip database C
The DB manages the clips in a hierarchical structure based on the hierarchical relationship between the clips. Note that material clips that are not used for any editing processing are not related to other clips, but such material clips are managed as having no link destination. Further, the example shown here is merely an example, and there are naturally other combinations as the vertical relationship between clips.

(3-3) Concept of Combining Process Next, in this section, the concept of the combining process performed by the combining module CM will be described. Result clip F shown in FIG.
The video image of C-008 is a material clip MC-0.
01, material clip MC-002 and material clip MC
-003 is generated by synthesizing the video image (that is, composite processing). FIGS. 5 and 6 show the concept of the combining process. FIG. 5 shows how video images of three material clips MC-001, MC-002, and MC-003 are synthesized, and FIG.
Result clip FC-008 generated by synthesis processing
Represents a video image.

In the editing system 1 according to the present invention,
When combining a plurality of clips, each clip is regarded as one layer (layer), and the combining process is performed by overlapping the layers. In the example shown in FIG. 5, the first layer L1
And the material clip MC-002 as the second layer L2.
The material clip MC-001 is designated as the layer L3 of the. When synthesizing the material clips assigned to the layers L1, L2, and L3, the layers L1 and L3 are sequentially stacked on the layer L1 as the lowest layer. That is, the second layer L is placed on the video image (for example, an image representing the background) of the material clip MC-003 designated as the first layer L1.
The video image of the material clip MC-002 designated as No. 2 (for example, an image representing a person) is superimposed and synthesized, and a third image is placed on the synthesized video image.
Material clip MC-00 specified as the layer L3 of the
One video image (for example, an image representing a character) is superimposed and synthesized. By such a combining process, it is possible to generate a result clip FC-008 of a video image in which three materials overlap as shown in FIG.

In the example shown in FIG. 5, the material clips M assigned to the three layers L1 to L3, respectively.
Although an example in which C-003, MC-002, and MC-001 are combined has been described, in the editing system 1 according to the present invention, the number of layers is not particularly limited.

4. GUI Display A GUI screen displayed on the display 2B of the workstation 2 when each module is activated will be described.

(4-1) Configuration of Main Window As shown in FIG. 7, a main window 30 is displayed on the display 2B. The main window 30
Is a menu (Me
nu) A window 31 and a toolbar (Tool Bar) window 32 displaying only menus of frequently used functions
And a Bin Tree window 33. Further, if necessary, preview images of a Bin window 34, a Run Control window 35, a material clip MC, and the like before editing to check them. And an editor window 40 for creating a result clip FC.

The menu window 31 has a menu of all functions necessary for the image editing process. For example, a new menu for creating a new result clip FC, and a name for the created result clip FC. It has a Save menu for attaching and saving, an Interim Make menu for generating intermediate results, and the like.

The bin tree window 33 shows, by a tree structure, the locations of the material clips MC, the result clips FC, and the like in the bin window 34.

The bin window 34 includes material clips MC of various images used for cut editing and the like, clips FC that have already been edited to some extent, and objects for processing the images.

The run control window 35 is for moving the position of a current bar, which will be described later, indicating the current time, which is the current reproduction time. This detailed description will be described later.

The preview window 36 is an area for displaying an image of video data of the material clip MC or the result clip FC when a preview button, a view button, an all preview button, or an all view button (not shown) is operated. By providing such a display area, the material clip M
C or the video image of the result clip FC generated as a result of editing can be confirmed.

(4-2) Configuration of the Editor Window The editor window 40 handles the result clip FC, in other words, generates the result clip.
As shown in FIG. 8, the editor window 40 includes a current time (Current Time) area 41 for displaying the current time and the like, and an in-out time (In Out Time) area 42 for displaying the times of the editing start point and the editing end point. , Scale Select area 43, Co Timeline 44, Time Scal
e) an area 45, a time line 46 for displaying and editing the temporal position of each object, and an object (Objec) displaying an object indicating a data flow.
t) an area 47 is provided.

In the current time area 41, the current time (for example, “00: 00: 01: 02”: 0)
(Time 0 minutes 1 second 2 frames) is displayed. The current time is the time at which the current time bar 51 is located on the time line 46. Current time bar 5
The position of 1 is the run control window 35 described above.
Can be changed using.

The run control window 35 is shown in FIG.
As shown in FIG. 7, the button is composed of ten GUI-displayed buttons. Each button has a function of moving the position of the current bar by clicking each button as follows.

A Top button 201 moves the current time bar 51 to the top result clip FC. A previous key frame (Previous KF) button 202 moves the current time bar 51 to a key frame KF immediately before the time indicated by the current current time bar 51. Previous Frame
The button 203 moves the current time bar 51 to the frame immediately before the time indicated by the current current time bar 51. The stop button 204 immediately stops the movement of the current time bar 51. Run button 2
05 moves the current time bar 51 at 1x speed. A next frame (Next Frame) button 206 moves the current time bar 51 to a frame immediately after the time indicated by the current current time bar 51. A next key frame (Next KF) button 207 moves the current time bar 51 to a key frame immediately after the time indicated by the current current time bar 51. The Goto button 208 is used to activate the key frame KF of the designated key frame number or the current time bar 51 at the designated time.
To move. An End button 209 moves the current time bar 51 to the end of the last result clip FC. Create Keyframe (Create
The KF) button 210 displays the current current time bar 51
A new key frame KF is created at the position (time) indicated by. As a result, control of the clip and control relating to the key frame KF can be performed.

The in-out time area 42 includes an in-point time (eg, “00: 00: 01: 02”) as an editing start point and an out-point time (eg, “00: 00: 01: 2”) as an editing end point.
2) is displayed. The in point and the out point indicate the selected state, that is, the start and end points of the material clip MC or the result clip FC that is the target of the editing process. In each layer L on the timeline 46, the range from the in point to the out point is called a "cell".

The scale select area 43 is for setting the size (scale) of the time line 46 in the time direction. As shown in FIG.
There are “Frame” for setting the size of the frame, “Second” for setting the size for one second, and “Min” for setting the size for one minute. “Frame” has four check boxes, and means 1 frame, 2 frames, 5 frames, and 10 frames in unit time from the left. "Second"
Has five check boxes and means unit time 1 second, 2 seconds, 5 seconds, 10 seconds, and 20 seconds in order from the left.
“Min” has four check boxes, and means unit times of 1 minute, 2 minutes, 5 minutes, and 10 minutes in order from the left.

Here, the display steps per unit time will be described using the time scale table shown in FIG. For example, as shown in FIG. 8, when the check box of one frame of unit time of “Frame” is checked, a thumbnail picture (Thumbn
ail Picture) is displayed for each frame, and the displayed unit step (Show Time Step) is 5 frames.
A thumbnail picture is a simple image displayed on a layer L when a material clip MC of the image is set on a certain layer L. For example, the layer L shown in FIG.
The image displayed in 3 corresponds to this. Note that the width-to-length ratio of the thumbnail picture is 4: 3. For example, when the width of each layer on the timeline 46 is 30 pixels, the thumbnail picture is a reduced image of 40 × 30 pixels. At this time, in the time scale area 45, “00: 0
Since "00: 00: 01: 05" is displayed after "0:01:00", it is displayed in units of five frames. Similarly, FIG.
According to this, for example, when the check box of the unit time of 2 seconds of “Second” is checked, the layer L of the video data is
Displays thumbnail pictures every 60 frames,
The displayed unit step is 10 seconds.

The co-timeline 44 corresponds to the timeline 4
6 shows the edited content specified. In this case, in the timeline 46, due to screen restrictions,
Since all the edited contents cannot be displayed at once, by displaying a graphic image of the edited contents on the co-timeline 44,
As a whole, it is possible to easily understand what editing content is specified. For example, in the case where editing contents such as combining several material clips MC are specified in the timeline 46, a bar-shaped graphic image indicating a clip specified in each layer is overlapped with the editing contents. The graphic image is displayed on the co-timeline.

Thus, the user can see the display to grasp the whole picture of the specified editing contents and easily grasp that the contents are the synthesis processing of several clips.

The time scale area 45 has a preview area 45a and an in-out area 45b, and the time per unit step is displayed. When a preview button (not shown) is operated, a blue bar indicating the range of video data of the preview target image is displayed in the preview area 45a. A yellow bar indicating the range from the editing start point to the editing end point is displayed in the in-out area 45b.

The time line 46 is an area for designating a clip to be edited to be subjected to the composition processing for each layer. In this editing system 1, each one
Finally, it is possible to specify a clip to be a material for the composition processing. The display range of the timeline 46 is limited, and it is not possible to display all the layers L at one time. However, by operating the scroll buttons displayed at the right end of the timeline 46, the timeline 46 can be scrolled up and down, so that a desired layer can be displayed. . This timeline 4
In 6, each of the layers corresponds to a clip serving as a material of the composition processing.

In the object area 47, an object 52 indicating the connection state of each layer constituting the timeline 46 is displayed. Each object 52 exists one by one corresponding to each layer.

The object 52 is pasted from the bin window 34 to the object area 47 by drag and drop. Object 52 is
In the vertical direction, it can be located in units of rows (each layer) of the timeline 46, and can be located freely in the horizontal direction.

5. Operation method (5-1) Starting the editor window The bin window 34 shown in FIG.
A plurality of material clips MC and result clips FC are included. When the user double-clicks on the result clip FC, an editor window 40 for editing the result clip FC is displayed. Also, the timeline 46
Double-clicking on any cell (clip) on each layer of the above also displays an editor window 40 for editing the clip.

When a new result clip FC is to be generated, it is necessary to create an empty result clip FC in the bin window 34 in advance. In the following description, using the empty result clip FC editor window 40,
A case where the entity of the result clip FC is created will be described.

(5-2) Creation of Timeline When the above-mentioned editor window 40 is activated, an empty timeline 46 and an object area 47 are displayed as shown in FIG.

The user selects a desired material clip MC by clicking on a desired material clip MC (or a result clip FC or an object or the like) from the bin window 34. By performing such processing, the cell of the material clip MC is displayed. Then, when this is placed at a desired position by drag and drop, a layer is formed at that position, and a material clip MC is set for the layer. The material clips MC are set in layers in the vertical direction and in frames in the horizontal direction.

After setting a cell on the time line 46, the cell can be dragged and moved only in the horizontal direction. Further, the setting position can be changed by dragging and dropping the in point and the out point of the cell.

The length of a cell indicating a clip is a length corresponding to the duration of the clip (the time from the start to the end of the clip). In each cell, a character indicating a clip name or a key processing name is displayed, so that the user can know at a glance which clip or key processing is set.

(5-3) Creation of Object The user clicks a desired object in the bin window 34 to select the object. Then, by placing the object at a desired position in the object area 47 by drag and drop, an object is set. At this time, the object is
In the vertical direction, it is set for each layer. That is, the object is set on the horizontal line of each layer.

The object can be moved by dragging even after it has been set in the object area 47. Thus, a plurality of objects can be set in the object area 47.

When a plurality of objects are set in the object area 47, it is necessary to connect the objects next.

Here, as shown in FIG. 11, the object 52 is
4 (54a, 54b), view switch 55 (55a,
55b), an output connector 56 is provided, an input connector 54 is connected to input lines 57 (57a, 57b) for inputting video data or parameters, and an output connector 56 is connected to an output line 58. . Note that the object 52 handles a main one of the input connectors 54 as a main input connector as described later in detail.

When the output connector 56 is clicked, a transition is made to the wiring mode starting from the output connector 56. Then, the input connector 5 of another object 52
4 Click to connect between these connectors,
The wiring mode ends. Here, the case where the connection is made with the output connector 56 as a starting point has been described,
When the input connector 54 is used as a starting point, the connection can be made in the same manner.

The object 5 thus connected
2, video data, parameters, and the like are input from below the object body 53. Then, the object 52 outputs the video data, parameters, and the like from the right side of the object body 53. The colors of the input line 57 and the output line 58 differ depending on the type of signal. For example, video data input / output lines are blue, key input / output lines are red, video data and key input / output lines are magenta, and parameter input / output lines are green.

When the view switch 55b is clicked, for example, as shown in FIG.
b and the input line 57b connected thereto disappear. However, simply the input line 57b is not displayed, but this does not mean that the relationship with other objects connected via the input line 57b is not lost. Thus, when there are many objects 52, the object configuration can be easily displayed by clicking the view switch 55.

FIG. 13 is a diagram showing the object 52 when many input lines 57 and output lines 58 are connected to the object body 53. The object 52 is connected to other objects (not shown) via input lines 57a to 57c and 57e. Since the view switch 55d is clicked, there is an input line connected to the input connector 54d, but the input line is not displayed. Further, the object 52 has four output connectors 56a, 56b, 56c, 56d, each of which has an output line 58a, 58b,
58c and 58d are connected.

(5-4) Signal Properties When the input connector 54 is double-clicked,
An input line 57 connected to the input connector 54
Is displayed. For example, FIG.
In the object 52 shown in FIG.
When 4a is double-clicked, as shown in FIG.
A dialog box 60 for a signal input to the input connector 54a is displayed.

The dialog box 60 includes a video (Video) check box 61 indicating that a signal input to the input connector 54a is video data, and a key (Key) box 62 indicating that the signal is a key.
And a video and key (Video and Key) check box 63 indicating that the key is a video signal and a key. The dialog box 60 specifies the type of signal input to the input connector 54a by checking one of the three check boxes, and in the case of FIG. The signal indicates video data.

However, when the dialog box 60 is open, another check box, for example, a key check box may be clicked to add a check mark. As a result, the signal on the input line 57 is changed to a key signal.

When the signal input to the input connector 54a is a parameter, the dialog box 60 may indicate the content of the parameter. For example, as shown in FIG. 15, the three-dimensional parameter "3D Transform""
May be displayed.

When the object body 53 of the object 52 is double-clicked, an object dialog box 70 showing the properties of the object 52 is displayed as shown in FIG.

Object dialog box 70
Is the name of the object 52, the input connector 54
And a list of output connectors 56, and display and setting of parameters not included in the key frame.
Specifically, as shown in FIG. 16, the object dialog box 70 displays “Layer1”, “BackGround”, “3D”,
The switch box of "Parameter" is shown, and "Layered" and "Par" are output as signals output from the output connector 56.
ameter "switch box. When the switch box is clicked to take a check mark, no signal is input to the input connector 54 corresponding to the switch box. When the switch box is clicked again to place a check mark, a signal is input to the input connector 54.

The object dialog box 70 has a bypass switch box 71. The bypass switch box 71 switches whether to output (bypass) a signal input from the main input connector 54 of the object 51 as it is. That is, the object 52
When the bypass switch box 71 is checked, the signal input to the main input connector 54 is output to the outside as it is.

6. Generation of Result Clip FC (6-1) Visualization of Character Next, a case where a result clip FC for visualizing a character is generated using the timeline 46 and the object having a simple configuration shown in FIG. 17 will be described. The time line 46 includes a layer L1 and a layer L2. The layer L1 is a layer that generates an image of the character from the character data. The layer L2 is a layer that outputs predetermined character data at a predetermined time, and has three key frames KF here. Here, the key frame KF1 is character data of “Today”, the key frame KF2 is character data of “weather”, and the key frame KF3 is character data of “good”.

Further, an object is provided for each of the layers L1 and L2. First object 71
Corresponds to the layer L2, and corresponds to the key frames KF1 to KF3.
When the predetermined time is reached, the character data of "today", "weather" and "good" are supplied to the second object 72 via the output connectors. The second object 72 corresponds to the layer L1, and sequentially generates and outputs an image of the character based on the character data. As a result, an image (telop) of “the weather is fine today” is generated.

As described above, by using the timeline and the object corresponding to each layer of the timeline, the time management of the image can be performed in accordance with the timeline, and the connection relation of each layer is determined by the connection relation of the object. Can be easily recognized, and the user can easily perform the editing operation.

(6-2) Generation of Intermediate Result The above-described editor window 40 performs an editing process using a timeline or an object, and outputs an editing result output from a final object as a result clip FC. When the timeline 46 has a multi-layer structure of layers, and the number of objects becomes extremely large with this, it is necessary to confirm what kind of image is being generated in the middle of the object. Therefore, even in the case of an intermediate object, an intermediate result can be generated and the image can be confirmed.

Here, a case where a time line 46 and an object are configured as shown in FIG. 18 will be described as an example. In the timeline 46, the layer L5
Is a layer of a cut image named “Take12”. The layer L4 is a layer that generates three-dimensional parameters from the motion of the image. Here, the generation of the intermediate result of the object 82 will be described, and the description of the other layers will be omitted. On the other hand, object 81
Corresponds to the layer L5, and supplies the image of “Take12” to the object 82. Object 82
Indicates the motion of the supplied image based on the supplied image.
Generate and output dimensional parameters.

Here, when an object 82 is clicked to generate an intermediate result and an interlim make menu is selected from the menu window 31 shown in FIG. 7, the object 82 is iconified.
When the object 82 is iconified, the clips of the layers L4 and L5 become black as shown in FIG.
The object 82 cannot be edited. If the intermediate result is an image, the output contents of the object 82 can be confirmed by previewing the contents of the iconized object 82 or the like.

Further, with the object 82 selected (clicked), "Save" is selected from the menu window 31.
When "As (save as name)" is selected, the contents of the object 82 are saved, and a clip FC is generated as a result of the output contents of the object 82.

When the intermediate result is discarded and the editing operation is performed again, the object 82 is selected, and the unmake (UnMak) is selected from the menu window.
e) Select a menu. At this time, the intermediate result is discarded, and editing processing of objects subsequent to the object 82 becomes possible.

(6-3) Generation of User-Defined Result Clip FC Instead of simply generating an intermediate result, an output of an intermediate object can be generated as a result clip FC.

Here, a case where a time line 46 and an object are configured as shown in FIG. 20 will be described as an example. In the timeline 46, the layer L6
Is a layer of a cut image named “Take12”. Layer L5 includes key frames KF1, KF2, and KF.
This is a layer that changes the color of the image at the timing 3. Note that description of other layers is omitted. On the other hand, the object 83 corresponds to the layer L6, and supplies the image of “Take12” to the object 84. The object 84 changes the color of the supplied image in accordance with the timing of each key frame KF and outputs the image.

Then, the object 84 or the layer L5
When "Save As" is selected from the menu window 31 in a state where the clip is selected, the resulting clip FC can be generated as an effect having a timeline. The resulting clip FC generated in this manner
Appear in the bin window 34 and can be reused to generate other resulting clips FC.

(6-4) Other Examples Hereinafter, an example of the configuration of the objects arranged in the time line 46 and the object area 47 will be shown, and the contents thereof will be described.

FIG. 21 is a block diagram showing an example of an object arranged in the time line 46 and the object area 47 when a title image is placed on the main image. The time line 46 includes four layers from a layer L1 to a layer L4. Layer L
Reference numeral 4 denotes a layer of video data of the image “XXX”.
The layer L3 is a layer that indicates character data of the title image “ZZZ” displayed on the image “XXX”. The layer L2 is a layer for performing a combining process.
The title image “ZZZ” is combined with the image “XXX”.
The layer L1 is a layer indicating an output.

In the object area 47, objects 101 to 104 corresponding to each layer are provided. The object 101 is provided right beside the layer L4, and corresponds to the layer L4. Object 10
2 is provided right beside the layer L3 and corresponds to the layer L3. The object 103 is provided on the horizontal line of the layer L2, corresponds to the layer L2, and is connected to the lines from the objects 101 and 102. The object 104 is provided on the horizontal line of the layer L4, corresponds to the layer L4, and is connected to a line from the object 103.

Then, the object 101 sets the time "0
[0:01:00], video data of the image “XXX” is output. The object 102 outputs the character data of the title image “ZZZ” at the time “00:01:10”. The object 103 outputs the video data from the object 101 and outputs the key frame KF1.
(Time "00:01:40"), KF2 (time "00:02:50"),
“ZZZ” at the timing of KF3 (time “00:03:15”)
And outputs the character data. Object 104
Outputs the video data from the object 103 to the outside.

As described above, the time line 46 manages the time of each layer L, and each object forms the connection relationship of each layer L, so that data processing can be flexibly performed regardless of the order of the layers L. It can be carried out.

FIG. 22 shows a timeline 46 and a main part configuration diagram of each object when a title image is placed on a main image and the title image is moved by motion capture.

The time line 46 is composed of six layers L from layer L1 to layer L6. The layer L6 detects a motion of an object and outputs a parameter of the motion.
Layer. The layer L3 is a layer of a 3D transform (3D Transform) for moving an input image based on an input three-dimensional parameter. The layers L1 and L2 correspond to the layers L1 and L2 shown in FIG.
Same as 2. Layers L4 and L5 are respectively shown in FIG.
Are the same as the layers L3 and L4 shown in FIG.

In the object area 47, each layer L
Objects 105 to 11 corresponding to 6 to L1, respectively
0 is provided. The object 105 captures a movement of a certain image and outputs a three-dimensional parameter indicating the movement. The object 106 outputs video data of the main image “XXX”. The object 107 outputs the character data of the title image “ZZZ”. The object 108 is connected to the output lines of the object 105 and the object 107. The object 109 is connected to the output lines of the object 106 and the object 108. The object 110 is connected to an output line of the object 109, and outputs an image from this line to the outside.

The object 108 moves the title image “ZZZ” from the object 107 based on the three-dimensional parameters from the object 105, and
To supply. The object 109 is the object 10
At the timing of the key frames KF1, KF2, and KF3, a title image from the object 108 is synthesized and supplied to the object 110. Object 110
Outputs the image from the object 109 to the outside.

As described above, not only a simple title image is synthesized with a main image, but also a moving title image can be easily synthesized.

In FIG. 23, a title image is placed on the main image, and the title image is subjected to motion capture and 3D.
FIG. 3 shows a configuration diagram of a main part of the timeline 46 and each object when moving with.

The time line 46 is composed of seven layers L from layer L1 to layer L7. The layer L7 is a layer indicating that an arbitrary object is moving. The layers L1 to L6 are the layers L shown in FIG.
Same as 1 to L6.

In the object area 47, each layer L
Objects 111 to 11 respectively corresponding to 7 to L1
7 are provided. The object 111 outputs three-dimensional parameters. The object 112 is connected to the output line of the object 111. The object 113 outputs video data of the main image “XXX”. The object 114 has the title image “ZZ”.
The character data of Z ″ is output.
The output lines of the object 112 and the object 114 are connected. The object 116 is connected to the output lines of the object 112 and the object 115. The object 117 is the object 11
6 is connected to an output line, and an image from this line is output to the outside.

The object 112 outputs three-dimensional parameters based on the movement of an arbitrary object from the object 111. The object 115 moves the title image “ZZZ” from the object 114 based on the three-dimensional parameters from the object 112, and
To supply. The object 116 is the object 11
At the timing of the key frames KF1, KF2, KF3, the title image from the object 115 is synthesized and supplied to the object 117. Object 117
Outputs the image from the object 116 to the outside.

As described above, the title image synthesized with the main image can be moved together with the movement of an arbitrary object.

FIG. 24 shows a time line 46 having the same functions as in FIG. 23 and a main part configuration diagram of each object. Specifically, in FIG. 23, the object 114 and the layer L4 are deleted by clicking the view switch 115a of the object 115, and the object 113 and the layer L5 are deleted by clicking the view switch 116a of the object 116. I have.

Therefore, the time line 46 is composed of five layers L, that is, layers L1 to L5.

As described above, when a predetermined view switch is clicked, the object below the line to be input and the layer L are erased on the input connector corresponding to the view switch, and a simple display is performed. .

FIG. 25 shows a configuration diagram of a main part of the time line 46 and each object when a hexahedron is displayed.

The time line 46 includes layers L1 to L18.
Up to 18 layers L. The layer L18 is a layer of globe move (Global Move) indicating the entire movement of the cube. Layers L15 to L
Reference numeral 17 denotes a cube (Cu) indicating parameters of each face of the cube.
be) layer. The layer L14 is a layer of video data indicating an image "Video Side-1" which is one side of the cube. The layer L13 is a layer of a 3D transform (3D Transform) for moving an image based on three-dimensional parameters. Layers L12 and L11, layer L
10, layer L9, layers L8, L7, layers L6, L
5, layers L4 and L3 are the layers L14 and L1 described above.
Same as 3. The layer L2 is a combine (Combine) layer indicating synthesis of images. The layer L1 is an output layer for performing output processing.

In the object area 47, as shown in FIG. 25, objects 118 to 133 corresponding to the respective layers L18 to L1 are provided. Note that the objects 119 correspond to the layers L115 to L17.

The object 118, corresponding to the layer L18, outputs a parameter indicating the motion of the arrears. The object 119 corresponds to the layers L15, L16, and L17, and based on parameters from the object 118,
Output the parameters for each of the six faces of the cube. The object 120 corresponds to the layer L14,
Outputs video data of one face of the facepiece. Object 1
21 is based on the video data from object 120 and the two parameters from object 119,
The video data is output by moving one surface of the hexahedron. Also, objects 122 and 123, objects 124 and 125, objects 126 and 127, objects 128 and 129, and objects 130 and 131
Performs the same processing as the objects 120 and 121 described above, respectively. The object 132 corresponds to the layer L2, and the objects 121, 123, 125, and 12
The video data of each hexahedron from 7, 129, 131 is synthesized and output. The object 133 corresponds to the layer L1 and outputs an image of a moving cube from the object 132 to the outside.

As described above, not only the title image but also each image can be given a motion and synthesized and output.

FIG. 26 is a diagram showing the configuration of the main part of the time line 46 and each object in the case where a paint function for coloring all or a part of the screen with a predetermined color is provided.

[0129] The time line 46 is composed of four layers L from layers L1 to L4. Layer L
Reference numeral 4 denotes the above-described motion capture layer. The layer L3 is a background video (Background Video) layer that is a background image. Layer L2
Is a paint layer for giving a predetermined color to an image. The layer L1 is an output layer.

In the object area 47, the layer L4
Objects 134 to 137 corresponding to L1
Is provided. The object 134 is a layer L4
And outputs a parameter indicating the motion of the object. The object 135 corresponds to the layer L3 and outputs video data of a background image. Object 136
Corresponds to the layer L2, and performs processing for changing the color of the background image from the object 135 based on the parameter from the object 134. The object 137 corresponds to the layer L1 and outputs a background image from the object 136 that changes color to the outside.

As described above, not only an object but also a color change or the like can be given.

FIG. 27 shows a configuration diagram of the main part of the time line 46 and each object when three-dimensional data is generated.

The time line 46 is composed of three layers L1 to L3. Layer L
3 is a source video indicating the video data of the moving object, which is the source of the three-dimensional parameter to be generated (Source Video)
Layer. The layer L2 is a layer of a motion capture parameter for generating a three-dimensional parameter from video data of a moving object. The layer L1 is an output layer.

In the object area 47, the layer L3
Objects 138 to 140 corresponding to L1
Is provided. The object 138 outputs video data of the moving object. The object 139 generates and outputs three-dimensional parameters of the moving object based on the video data from the object 138. The object 140 outputs the three-dimensional parameters from the object 139 to the outside.

As described above, three-dimensional parameters can be generated by the configuration of the timeline 46 and the objects 138 to 140.

As described in detail above, the editing system 1 to which the present invention is applied performs time management of data and parameters by using a timeline, and shows the connection relationship of each layer constituting the timeline by using an object. Complicated and troublesome editing work can be easily performed.

At this time, an intermediate result output by an intermediate object can be generated, or a result clip FC defined by the user can be generated, and editing can be performed more easily than in the past.

Further, by erasing a part of the objects, the contents of the editing process can be easily grasped visually, and the properties of the objects are displayed so that the signals input / output to / from the objects are displayed. Can be easily set.

It should be noted that the present invention is not limited to the above-described embodiment, and that changes in design and the like can be made within the scope described in the claims. The configuration of 40 is shown in FIG.
Of course, it is not limited to the configuration of FIG.

[0140]

According to the editing system and the editing method of the present invention, the time of each clip processing layer is managed, and a clip which has been subjected to a predetermined processing by one clip processing layer is placed higher than the one clip layer. A predetermined processing is performed on the clip processing layer in the hierarchy, a predetermined processed clip output from the clip processing layer in the highest hierarchy is output as a result clip, and each button corresponding to a unit step of each clip processing layer is output. Is displayed, the unit step can be easily grasped.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an editing system to which the present invention has been applied.

FIG. 2 is a block diagram showing an internal configuration of a workstation which is a main configuration of the editing system.

FIG. 3 is a configuration diagram of each module and a clip database included in the editing system.

FIG. 4 is a diagram for explaining hierarchical management of clips.

FIG. 5 is a diagram for explaining the contents of a combining process.

FIG. 6 is a diagram for explaining a video image generated by the combining process.

FIG. 7 is a diagram illustrating a menu window displayed on a display of the workstation.

FIG. 8 is a diagram for explaining an editor window in the menu window.

FIG. 9 is a diagram illustrating a run control window having a function of adjusting a current time bar displayed in an editor window.

FIG. 10 is a time scale diagram for explaining a display step per unit time.

FIG. 11 is a diagram for explaining a configuration of an object provided in an object area in an editor window.

FIG. 12 is a diagram for explaining a configuration of the object.

FIG. 13 is a diagram for explaining the configuration of the object.

FIG. 14 is a diagram illustrating a dialog box of a signal input to the input connector.

FIG. 15 is a diagram for explaining a dialog box when a signal input to the input connector is a parameter;

FIG. 16 is a diagram for explaining an object dialog box showing properties of an object.

FIG. 17 is a diagram illustrating an example of a configuration of a timeline and an object.

FIG. 18 is a diagram illustrating a configuration of a timeline and an object used for explaining generation of an intermediate result of the object.

FIG. 19 is a diagram illustrating a configuration of a timeline and an object used for explaining generation of an intermediate result of the object.

FIG. 20 is a diagram illustrating a configuration of a timeline and an object used for explaining generation of a result clip defined by a user.

FIG. 21 is a diagram illustrating a configuration of a timeline and an object when a title is added to a video.

FIG. 22 is a configuration diagram of main parts of a timeline and each object when a title image is placed on a main image and the title image is moved by motion capture.

FIG. 23 is a configuration diagram of a main part of a timeline and each object when a title image is put on a main image and the title image is moved by motion capture and 3D.

FIG. 24 is a configuration diagram of main parts of a timeline and each object when a title image is placed on a main image and the title image is moved in 3D with motion capture.

FIG. 25 is a main part configuration diagram of a timeline and each object when a hexahedron is displayed.

FIG. 26 is a configuration diagram of a main part of a timeline and each object in a case where a paint function is provided for giving a predetermined color to all or part of a screen.

FIG. 27 is a configuration diagram of a main part of a timeline and each object when three-dimensional data is generated.

[Explanation of symbols]

1 editing system, 2 workstations, 30 menu windows, 40 editor windows, 46
Timeline, 47 object area

Claims (4)

[Claims] 1. An editing system for editing a plurality of clips serving as an editing unit to generate a result-processed clip, comprising a plurality of clip processing layers for performing predetermined processing on the clips while managing time. A layer determining means having a plurality of objects respectively corresponding to the respective clip processing layers, and determining the layer of the respective clip processing layers by connecting the respective objects to form a single hierarchical structure; Display means for displaying the processing content of the clip processing means as a timeline, and displaying the hierarchical structure of the hierarchy determining means by connecting the objects between the objects, wherein the clip processing means manages the time of each clip processing layer. At the same time, the clip processed by the one clip processing layer Causing the clip processing layer in a higher layer than the layer to perform predetermined processing, outputting a predetermined processed clip output from the clip processing layer in the uppermost layer as a result clip, An editing system, wherein each button corresponding to a unit step of a processing layer is displayed. 2. An apparatus according to claim 1, further comprising instruction means for instructing display contents to be displayed on said display means, wherein said display means is instructed by said instruction means among buttons corresponding to unit steps of said clip processing layers. And displaying the unit steps of each of the clip processing layers so as to correspond to the unit steps corresponding to the buttons, and displaying the processing contents of the clip processing means as a timeline so as to correspond to the unit steps. The editing system according to claim 1. 3. An editing method for editing a plurality of clips serving as an editing unit to generate a result-processed clip, wherein a plurality of clip processing layers perform predetermined processing on the clip while managing time, and A plurality of objects respectively corresponding to the processing layers are provided, and the respective objects are connected to each other to form one hierarchical structure, so that the hierarchy of each of the clip processing layers is determined. In addition to displaying as a timeline, the formed hierarchical structure is displayed by connecting the objects, and time management of each clip processing layer is performed. A predetermined process is performed by a clip processing layer in a layer higher than the clip layer, and the clip processing in the highest layer is performed. Editing method and displaying the respective button outputs a predetermined processed clip output from the layer as a result the clip, corresponding to the unit step of the respective clipping layers. 4. A unit step of each of the clip processing layers is displayed so as to be a unit step corresponding to a button instructed by an instruction unit among buttons corresponding to the unit steps of each of the clip processing layers. 4. The editing method according to claim 3, wherein the contents of processing by said clip processing means are displayed as a timeline so as to correspond to said unit steps.