WO2019105438A1

WO2019105438A1 - Video special effect adding method and apparatus, and smart mobile terminal

Info

Publication number: WO2019105438A1
Application number: PCT/CN2018/118370
Authority: WO
Inventors: 周宇涛
Original assignee: 广州市百果园信息技术有限公司
Priority date: 2017-11-30
Filing date: 2018-11-30
Publication date: 2019-06-06
Also published as: CN108022279A; CN108022279B

Abstract

Disclosed in embodiments of the present invention are a video special effect adding method and apparatus, and a smart mobile terminal. The method comprises the following steps: obtaining a user's click instruction or slide instruction in a video editing state; obtaining position coordinates specified by a user in an editing frame according to the click instruction or the slide instruction, and using the position coordinates as fall point coordinates of one key frame in a special effect animation; and synthesizing an edition video and the special effect animation such that the key frame covers the position coordinates specified by the user in the editing frame. During dual-video editing synthesis, one key frame is provided in preset special effect animation coordinates, the fall point position of the frame decides the position where the whole special effect animation is superimposed at the edition video during the video synthesis, and the user freely sets, by setting fall point coordinates, the frame position where the special effect animation is located in the edition video.

Description

Video special effect adding method, device and intelligent mobile terminal

Technical field

The embodiment of the invention relates to the field of live broadcast, in particular to a video special effect adding method and device, and an intelligent mobile terminal.

Background technique

Video editing refers to the process of recording the desired image with a camera and then using the video editing software on the computer to make the image into a disc. However, as the processing power of smart mobile terminals becomes better and better, real-time video editing has become a demand for development, and editing short video shots by smart mobile terminals has become a new demand.

In the prior art, the editing of the video by the smart mobile terminal still stays in a relatively simple application, such as cutting and splicing the video, or changing the color of the video by the color brightness of the video and the mask with a color added to the video.

The inventor of the present invention found in the research that the video editing method of the smart mobile terminal in the prior art can only realize the simple splicing and color grading function of the video, and the video splicing only places the plurality of videos in a sequential relationship. Play on the same timeline. Therefore, when the user uses the editing function, the operation space is limited, and the editing operation with high degree of freedom cannot be performed according to the editing needs of the user. The editing function of the intelligent mobile terminal has a poor customer experience, and it is difficult to promote the application.

Summary of the invention

Embodiments of the present invention provide a high-degree-of-freedom video editing method, apparatus, and intelligent mobile terminal capable of determining a key frame picture landing point coordinate in a special effect animation according to a user instruction.

In order to solve the above technical problem, a technical solution adopted by the embodiment of the present invention is to provide a video special effect adding method, which includes the following steps:

Obtaining a user's click command or a slide instruction in a video editing state;

Acquiring, according to the click instruction or the sliding instruction, a position coordinate specified by the user in the edit frame picture, and using the position coordinate as a drop point coordinate of a key frame picture in the special effect animation;

The edit video and the special effects animation are combined such that the key frame picture is overlaid at a user-specified position coordinate in the edit frame picture.

Optionally, an anchor point for calibrating the coordinates of the drop point is generated in the edit frame picture in the video editing state;

The step of acquiring the click command or the slide command of the user in the video editing state further includes the following steps:

Obtaining a first click instruction of the user, and calculating coordinates of the first click instruction;

Aligning whether coordinates of the first click instruction are within a coordinate area of the anchor point;

When the coordinates of the first click instruction are within the coordinate area of the anchor point, the anchor point is updated with the user's sliding instruction to update the drop point coordinate.

Optionally, the editing area in the video editing state includes: a first editing area and a frame progress bar; and the first editing area displays a frame picture image that is represented by the editing video at the stop time of the frame progress bar;

Obtaining a click or slide instruction by the user within the range of the frame progress bar;

Determining a stop time of the frame progress bar according to a click or slide instruction in a range of the frame progress bar;

A frame picture image characterized by the stop of the frame progress bar is retrieved as the edit frame picture.

Optionally, the frame progress bar is provided with a sliding bar marked with the duration of the special effect animation, and the sliding bar is provided with a command bar for indicating the location of the key frame picture;

Obtaining a sliding instruction that a user acts within the range of the slider to cause the slider to slide along the frame progress bar along with the sliding instruction;

Determining, according to a sliding instruction of the user in the range of the sliding bar, a frame progress bar stopping time pointed by the instruction bar;

The first editing area displays a frame picture image characterized by a stop of the frame progress bar pointed by the instruction bar.

Optionally, the step of acquiring a position coordinate specified by the user in the edit frame screen according to the click instruction or the slide instruction, and using the position coordinate as a drop point coordinate of a key frame picture in the special effect animation, further includes Steps:

And placing the edited video and the special effect animation on two parallel time tracks;

When the editing video is played to the start time of the special effect animation, the special effects animation is played synchronously and the special effects animation is displayed on the upper layer of the edited video.

Optionally, when the playing video is played to the start time of the special effect animation, the special effect animation is played synchronously and the special effect animation is located after the step of displaying the upper layer of the editing video, and further includes the following steps :

Obtain the user's revocation instruction;

The temporary effect animation is deleted on the stack.

Obtaining positional relationship information between each frame of the preset effect animation and the key frame picture;

Calculating, according to the falling point coordinates and the positional relationship information, a coverage coordinate of each frame of the special effect animation;

Determining a coverage position of each frame of the effect animation according to the coverage coordinates.

In order to solve the above technical problem, an embodiment of the present invention further provides a video special effect adding apparatus, including:

The obtaining module is configured to obtain a click command or a slide instruction of the user in a video editing state;

a processing module, configured to acquire, according to the click instruction or the sliding instruction, a position coordinate specified by the user in the edit frame screen, and use the position coordinate as a drop point coordinate of a key frame picture in the special effect animation;

And a synthesizing module, configured to synthesize the edit video and the special effect animation, so that the key frame picture is overlaid at a user-specified position coordinate in the edit frame picture.

The video special effect adding device further includes:

a first obtaining submodule, configured to acquire a first click instruction of the user, and calculate coordinates of the first click instruction;

a first comparison submodule configured to compare whether coordinates of the first click instruction are within a coordinate area of the anchor point;

a first update submodule, configured to: when the coordinates of the first click instruction are within a coordinate area of the anchor point, the anchor point is updated with a sliding instruction of the user to update the drop point coordinate.

The video special effect adding device further includes:

a second obtaining submodule, configured to obtain a click or slide instruction of the user within a range of a frame progress bar;

a first calculation submodule, configured to determine a stop time of the frame progress bar according to a click or slide instruction in a range of the frame progress bar;

The first calling submodule is configured to retrieve a frame picture image represented by the stop time of the frame progress bar as the edit frame picture.

The video special effect adding device further includes:

a third obtaining sub-module, configured to acquire a sliding instruction that the user acts within the range of the sliding bar, so that the sliding bar slides along the frame progress bar according to the sliding instruction;

a second calculating submodule, configured to determine, according to a sliding instruction that the user acts within the range of the sliding bar, a frame progress bar stopping time pointed by the instruction bar;

And a first display submodule, configured to display, by the first editing area, a frame picture image represented by a stop time of a frame progress bar pointed by the instruction bar.

Optionally, the video special effect adding device further includes:

a first setting submodule, configured to separately place the edited video and the special effect animation on two parallel time tracks;

The first preview sub-module, when playing the edit video to the start time of the special effect animation, synchronously playing the special effect animation and the special effect animation is displayed on an upper layer of the edit video.

Optionally, the video special effect adding device further includes:

a fourth obtaining submodule, configured to acquire a revocation instruction of the user;

The first undo sub-module is configured to delete the temporarily-supplied the effect animation in a stack manner.

Optionally, the video special effect adding device further includes:

a fifth obtaining sub-module, configured to acquire preset positional relationship information of each frame of the special effect animation and the key frame picture;

a third calculation sub-module, configured to calculate, according to the falling point coordinates and the position relationship information, a coverage coordinate of each frame of the special effect animation;

And a first determining submodule, configured to determine, according to the coverage coordinate, a coverage position of each frame of the special effect animation.

In order to solve the above technical problem, an embodiment of the present invention further provides an intelligent mobile terminal, which includes:

One or more processors;

Memory

One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the The video effect adding method.

The beneficial effects of the embodiment of the present invention are: in the double video editing and synthesis, a preset key animation picture is set in the preset special effect animation coordinate, and the falling position of the picture determines the entire special effect animation to edit the video overlay during the video synthesis. The position of the user is free to set the position of the screen where the special effects animation is located in the edit video according to the way of setting the coordinates of the landing point. In this way, the user is free to control the view position of the special effect animation in the synthesized video, thereby improving the user's freedom in the video editing process, improving the entertainment of the video editing, and having a better customer experience and market prospect.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings can also be obtained from those skilled in the art based on these drawings without paying any creative effort.

1 is a schematic flowchart of a method for adding a video special effect according to an embodiment of the present invention;

2 is a schematic flowchart of determining a position of another frame picture in a special effect animation according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a display manner for generating an anchor point in an edit frame picture according to an embodiment of the present invention; FIG.

4 is a schematic flow chart of determining anchor coordinates of an anchor point according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a first editing area and a frame progress bar display area according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic flowchart of an embodiment of selecting an edit frame picture according to an embodiment of the present invention; FIG.

7 is a schematic view showing a display area provided with a slide bar and a command bar according to an embodiment of the present invention;

FIG. 8 is a schematic flowchart diagram of another implementation manner of selecting an edit frame screen according to an embodiment of the present invention; FIG.

FIG. 9 is a schematic flowchart of a method for previewing a video result according to an embodiment of the present invention;

FIG. 10 is a schematic diagram of an editing effect cancellation process according to an embodiment of the present invention; FIG.

11 is a schematic structural diagram of a video special effect adding apparatus according to an embodiment of the present invention;

FIG. 12 is a block diagram showing the basic structure of an intelligent mobile terminal according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention.

In the flow of the description of the invention and the claims and the above-described figures, a plurality of operations in a particular order are included, but it should be clearly understood that these operations may not follow the order in which they appear in this document. Execution or parallel execution, the serial number of the operation such as 101, 102, etc., is only used to distinguish different operations, and the serial number itself does not represent any execution order. Additionally, these processes may include more or fewer operations, and these operations may be performed sequentially or in parallel. It should be noted that the descriptions of “first” and “second” in this document are used to distinguish different messages, devices, modules, etc., and do not represent the order, nor the “first” and “second”. It is a different type.

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Example

Please refer to FIG. 1. FIG. 1 is a schematic diagram of a basic flow of a video special effect adding method according to an embodiment of the present invention.

As shown in FIG. 1, a video special effect adding method includes the following steps:

S1100: acquiring a user's click command or a slide instruction in a video editing state;

The user uses the smart mobile terminal to edit the captured or locally stored video, and after entering the editing state, accepts the click or slide command sent by the user through the finger or the stylus.

S1200. Acquire a position coordinate specified by the user in the edit frame screen according to the click instruction or the slide instruction, and use the position coordinate as a drop point coordinate of a key frame picture in the special effect animation;

Obtaining a position coordinate of a click command or a slide instruction of the user, wherein when the user issues a click command, the coordinate position of the display area of the smart mobile terminal is obtained by the user, and the coordinate position is used as the position coordinate specified by the user. When the command issued by the user is a slide command, the coordinate position at the last point of the user's sliding track is obtained, and the coordinate position is taken as the position coordinate specified by the user.

In the editing state, the display area of the intelligent mobile terminal displays one frame in the edited video selected by the user as the edit frame screen, and the editing operation occurs when the user performs video editing on the edit frame screen, and the edit frame screen is partially edited after editing. The operation can be copied on other frame pictures of the video. The user specifies the coordinate position specified in the display area of the smart mobile terminal, that is, the coordinate position on the edit frame screen is specified.

After obtaining the coordinates of the position specified by the user, the position coordinate is used as the coordinates of the falling point of the key frame of the special effect animation. It should be pointed out that the area of the key frame picture is smaller than the area of the edit frame picture, and the editing frame picture needs to be specified during editing. A coordinate is used as a drop point in the edit frame picture of the key frame picture, and the drop point is a coordinate position designated by the user.

In the embodiment, the video editing is to edit the special effect animation on the video. In the embodiment, the special effect animation refers to a video short film with a certain action scene (such as a meteorite falling or a shell explosion, etc.), or an animation subtitle having a certain motion change. However, the present invention is not limited to this, and the special effects animation in this embodiment can be any video material having a video format.

In this embodiment, a key frame picture is set in the special effect animation, and the key frame picture is pre-selected, and the frame picture in which the most tension or the plot transition occurs in the special effect animation is usually selected (for example, when the special effect animation is a shelling, when the projectile is grounded and exploded) The frame picture; the special effect animation is the frame picture of the meteorite impact moment when the meteorite impacts; or the special effect animation is the frame picture when the subtitles are arranged in a straight line when the multi-word flight subtitles are arranged). However, the key frame picture is not limited to this. According to the application scenario, the key frame picture can be any frame specified in the special effect animation.

1300. Synthesize the edit video and the special effect animation so that the key frame picture is overlaid at a position coordinate specified by the user in the edit frame picture.

After determining the coordinates of the drop point of the key frame picture in the edit frame picture, the key frame picture is overlaid on the position coordinate specified by the user in the edit frame picture, thereby completing the synthesis of the edit video and the special effect animation.

In the above embodiment, in the dual video editing and synthesis, a preset key animation picture is set in the preset special effect animation coordinate, and the position of the falling point of the key frame picture determines the position where the entire special effect animation is superimposed in the editing video during video synthesis, the user According to the way of setting the coordinates of the coordinates, you can freely set the position of the screen where the special effects animation is located in the editing video. In this way, the user is free to control the view position of the special effect animation in the synthesized video, thereby improving the user's freedom in the video editing process, improving the entertainment of the video editing, and having a better customer experience and market prospect.

The coordinates of the drop point are reproducible, and the effect animation consists of multiple frame pictures. The position of the key frame picture can determine the coverage position of other frame pictures in the effect animation in the edited video. For details, please refer to FIG. 2. FIG. 2 is a schematic flowchart of determining the position of other frame pictures in the special effect animation of the embodiment.

As shown in FIG. 2, after step S1200, the following steps are further included:

S1211: Obtain positional relationship information between each frame of the preset effect animation and the key frame picture;

The effect animation is composed of multi-frame pictures. The center point of the selected key frame picture is taken as the coordinate origin. When constructing the special effect animation, the positional relationship of other frame pictures in the special effect animation with respect to the coordinate origin is calculated, and other frame pictures are calculated. The relationship of the coordinates relative to the origin coordinates. For example, if the coordinates of the frame picture adjacent to the key frame picture are [2, 2], the key frame picture moves two units to the left, and after moving two units upward, it is the position of the frame picture.

After the coordinates of the drop point of the key frame picture are determined, the pre-stored positional relationship information can be acquired by accessing the location information storage location in the effect animation.

S1212: Calculate, according to the coordinates of the falling point and the positional relationship information, a coverage coordinate of each frame of the special effect animation;

Since the size of each frame in the edited video is the same, the coordinates of other frame pictures calculated according to the coordinates of the coordinates can be directly applied to other frame pictures of the edited video.

Therefore, the coverage coordinates of each frame of the effect animation are calculated according to the coordinates of the landing point and the positional relationship information. For example, the coordinates of the frame picture adjacent to the key frame picture are [2, 2]. In the original setting, the coordinate of the key frame picture is [0, 0], and the coordinates of the determined key frame picture are [100, 200]. Then, the corresponding overlay coordinate of the frame picture is [102, 202].

S1213. Determine, according to the coverage coordinate, a coverage position of each frame of the special effect animation.

In video editing, at the special effect animation coverage position, each frame of the special effects animation has a frame corresponding to it in the edited video, and the area of each frame in the edited video is the same. Therefore, the calculated overlay coordinates can be directly used in The effect animation is in the edit video frame picture corresponding to one frame. The coverage position of each frame of the effect animation is determined according to the overlay coordinates and the area of the screen.

In the embodiment, the coverage position of each frame of the entire special effect animation is calculated by the coordinates of the falling points of the key frame picture, thereby achieving the purpose of controlling the coverage position of the entire special effect animation by the coordinates of the falling points of the key frame picture, and reducing the position of the frame. The complexity of editing is user-friendly.

In some embodiments, in order to enable the user to more intuitively determine the coordinates of the landing point, an anchor point for calibrating the coordinates of the landing point is generated in the edit frame image in the video editing state, as shown in FIG. 3 and FIG. 4 . FIG. 3 is a schematic diagram of a display manner for generating an anchor point in an edit frame picture according to the embodiment; FIG. 4 is a schematic flowchart of determining anchor coordinates of an anchor point according to the embodiment.

As shown in FIG. 4, the following steps are further included between step S1100:

S1011: Acquire a first click instruction of the user, and calculate coordinates of the first click instruction;

As shown in FIG. 3, in the video editing state, an anchor point for calibrating the coordinates of the drop point is generated in the edit frame picture, and the anchor point is specifically designed as a slamming anchor point, that is, an outer ring representing the range of the anchor point is provided and the design is completely The origin of the center. However, the shape of the anchor point is not limited. According to different application scenarios, the anchor point can be designed into (not limited to) different patterns such as a circle, a ring, a triangle, or other polygons, and can also use a cartoon pattern according to different application scenarios or Other silhouette patterns are replaced.

In the anchor generation state, the smart mobile terminal acquires the user's first click command and calculates the coordinates specified by the user's click command.

S1012. Align whether coordinates of the first click instruction are within a coordinate area of the anchor point;

The coordinates of the shape of the anchor point are a collection of all the coordinates located within the outer circle of the anchor point. After obtaining the coordinates of the user's click instruction, it is determined by comparison whether the coordinates specified by the user are within the coordinate set of the anchor point. If not, it means that the user has not issued an instruction to change the coordinates of the landing point, and if it indicates that the user has issued an instruction to adjust the coordinates of the landing point, the process proceeds to step S1023.

S1023. When the coordinates of the first click command are in the area of the anchor point coordinate, the anchor point is updated with a sliding instruction of the user to update the drop point coordinate.

When the coordinates of the first click instruction are within the coordinate area of the anchor point, it is determined that the user instruction adjusts the coordinates of the landing point. At this time, the anchor point moves with the sliding track of the user, and the anchor point is acquired after the user sliding instruction ends. The coordinate position of the anchor point center of the new position, and the coordinate position of the anchor point center is the updated drop point coordinate.

According to the above implementation method, the user can adjust the anchor point more intuitively, and at the same time, the user instruction confirmation program is set, which can prevent the user from performing other editing activities when setting the coordinates of the landing point, since only the click is The coordinate of the anchor point can be adjusted in the coordinate area of the anchor point, so when the anchor point is not clicked, the user can perform other operations on the video to facilitate the user's editing.

In some embodiments, the user needs to determine one of the frames in the edited video as an edit frame. Referring to FIG. 5 and FIG. 6 , FIG. 5 is a schematic diagram of a first editing area and a frame progress bar display area according to the embodiment. FIG. 6 is a schematic flowchart of an embodiment of selecting an edit frame picture according to an embodiment.

As shown in FIG. 5, the editing area in the video editing state includes: a first editing area and a frame progress bar; and the first editing area displays a frame picture image represented by the editing video at the stop time of the frame progress bar.

Specifically, the first editing area is located above the frame progress bar, and the first editing area is a scaling frame for the display area. The frame progress bar is the timeline for editing the video, which is composed of a number of frame picture thumbnails arranged by timeline. The first edit area displays a frame picture image in which the edited video is characterized at the stop of the frame progress bar. If the frame progress bar stops at the position of 03:35 seconds, the first editing area displays the frame picture of the edited video at that time as the edit frame picture.

The following steps are also included before step S1100 shown in FIG. 6:

S1021: Acquire a click or slide instruction of a user within a range of a frame progress bar;

In the anchor display state, the smart mobile terminal acquires a user's click or slide instruction.

S1022: Determine a stop time of the frame progress bar according to a click or slide instruction in a range of the frame progress bar;

The coordinates of the range of the frame progress bar are a collection of all the coordinates located within the frame progress bar area. After obtaining the coordinates of the user's click command or the slide instruction, it is determined by comparison whether the coordinates specified by the user are within the set of frame progress bar coordinates. If not, the user has not issued an instruction to change the edit frame screen, and if so, the user has issued an instruction to adjust the edit frame screen.

After receiving the click or slide instruction of the user on the frame progress bar, the user stops determining the stop time on the progress bar according to the instruction, and the frame picture of the edited video represented by the time is the edit frame picture selected by the user.

S1023: Acknowledge a frame picture image represented by the stop timing of the frame progress bar as the edit frame picture.

Confirming the stop time of the user instruction on the frame progress bar, picking up the frame picture characterized by the stop time, and displaying the frame picture in the first edit area.

As shown in FIG. 5, in some alternative implementations, an anchor point can be displayed in the first editing area while the frame progress bar is being set.

In some embodiments, after adding the effect animation, a slider that represents the duration of the effect animation is added to the frame progress bar, and a bar that represents the position of the key frame is set on the slider. For details, please refer to FIG. 7 and FIG. 8. FIG. 7 is a schematic diagram of a display area provided with a slide bar and a command bar according to the embodiment. FIG. 8 is a schematic flow chart of another embodiment of selecting an edit frame picture according to the embodiment.

As shown in FIG. 7, the frame progress bar is provided with a slider bar marked with the duration of the special effect animation, and the slider bar is provided with a command bar for indicating the position of the key frame picture.

The slider bar is the frame that represents the duration of the effect animation. The length of the slider is the proportion of the effect animation on the edit video frame progress bar. For example, the duration of the special effects animation is 5s, and the duration of editing the video is 20s. The length of the slider on the frame progress bar is one quarter of the total length of the frame progress bar; the duration of the special effect animation is 5s, and the duration of editing the video is 45s. Then the length of the slider on the frame progress bar is one-ninth of the total length of the frame progress bar.

The command bar is disposed on the slide bar for indicating the position of the key frame picture in the special effect animation, and the instruction bar is designed to have an indication such as an arrow indicating the representation, such as (not limited to) a sniper anchor point or a triangular arrow.

As shown in FIG. 8, before step S1100, the following steps are further included:

S1013: Acquire a sliding instruction that the user acts in the range of the sliding bar, so that the sliding bar slides along the frame progress bar according to the sliding instruction;

A sliding instruction that the user acts within the range of the slider is obtained to enable the slider to slide following the user's sliding command.

S1032, determining, according to a sliding instruction that is performed by the user in the range of the sliding bar, a frame progress bar stopping time pointed by the instruction bar;

After receiving the click or slide instruction applied by the user on the frame progress bar, the user stops determining the stop time on the frame progress bar according to the instruction, and the frame picture of the edited video represented by the time is the edit frame picture selected by the user.

S1033. The first editing area displays a frame picture image represented by a stop time of a frame progress bar pointed by the instruction bar.

After the slide bar is stopped, the slide bar calls the frame picture represented by the time of the frame progress bar pointed by the instruction bar at this time as the edit frame picture, that is, the first edit area always displays the image represented by the frame progress bar of the command bar alignment time.

By adopting the above method, the user can intuitively adjust the position of the entire special effect animation on the frame progress bar, and can also visually see the play position of the key frame picture on the frame progress bar, thereby improving the intuitive operation.

In some embodiments, the editing effect needs to be previewed after the editing is completed. For details, please refer to FIG. 9. FIG. 9 is a schematic flowchart of a method for previewing a video result according to an embodiment.

As shown in FIG. 9, after step S1200, the following steps are further included:

S1221. The edit video and the special effect animation are respectively placed on two parallel time tracks;

The edit video and the effect animation are placed on two parallel time tracks during preview. And the time track where the effect animation is located is always above the edit video time track. So that the effects animation is always on the top of the edit video.

S1222: When the editing video is played to the start time of the special effect animation, the special effect animation is played synchronously and the special effect animation is displayed on an upper layer of the edited video.

During playback, when editing video effects animations need to be played, the frame images of the editing video and the special effects animation are simultaneously read, and the two frame images are simultaneously rendered, and then placed in the video memory of the smart mobile terminal. When the display is called, the frame picture after the superimposed rendering is called for display, thereby completing the presentation of the two video overlays.

By playing the preview to the start time of the special effect animation and simultaneously calling the frame images of the two video at the same time for superimposed rendering, the user can preview the editing effect, which is convenient for the user to review, and helps to enhance the editing effect of the video. .

In some embodiments, the editing effect can be quickly deleted in the preview state. For details, please refer to FIG. 10 , which is a schematic diagram of an editing effect revocation process according to the embodiment.

As shown in FIG. 10, after step S1222, the following steps are further included:

S1231: Obtain a user's revocation instruction;

In the preview state described above, the user's revocation instruction is acquired, and the user issues a revocation instruction by clicking on a specific location (undo button) area of the display area of the smart mobile terminal.

S1232: The temporary effect animation is deleted in a stack manner.

When the smart mobile terminal stores the special effect animation added to the edited video, it is saved in a stack manner, and is characterized by advanced post-out. Since a plurality of special effect animations can be set on the same editing video, the method of stack entry is used for storage during storage, and when the undoing is performed, the temporary effect animation is also deleted by stacking, that is, deleting and finally entering the temporary storage. The effect animation in the space, and finally delete the first effect animation into the temporary space.

In order to solve the above technical problem, an embodiment of the present invention further provides a video special effect adding apparatus. For details, please refer to FIG. 11. FIG. 11 is a block diagram showing the basic structure of a video special effect adding apparatus according to this embodiment.

As shown in FIG. 11 , a video special effect adding apparatus includes: an obtaining module 2100, a processing module 2200, and a synthesizing module 2300. The obtaining module 2100 is configured to acquire a click instruction or a slide instruction of the user in a video editing state; the processing module 2200 is configured to acquire a position coordinate specified by the user in the edit frame screen according to the click instruction or the slide instruction, and use the position coordinate as a special effect animation. The coordinates of the drop point of one of the key frame pictures; the synthesizing module 2300 is configured to synthesize the edit video and the special effect animation so that the key frame picture is overlaid at the position coordinates specified by the user in the edit frame picture.

In the video special effect adding device, the preset special effect animation coordinates are provided with a key frame picture, and the position of the falling point of the picture determines the position where the entire special effect animation is superimposed in the editing video during the video synthesis, and the user Set the coordinates of the coordinates to freely set the position of the screen where the effect animation is located in the edit video. In this way, the user is free to control the view position of the special effect animation in the synthesized video, thereby improving the user's freedom in the video editing process, improving the entertainment of the video editing, and having a better customer experience and market prospect.

In some embodiments, an anchor point for calibrating the coordinates of the drop point is generated in the edit frame picture in the video editing state. The video special effect adding device further includes: a first acquiring submodule, a first comparing submodule, and a first updating submodule. The first obtaining sub-module is configured to acquire a first click instruction of the user, and calculate coordinates of the first click instruction; the first comparison sub-module is configured to compare whether the coordinates of the first click instruction are in a coordinate area of the anchor point. The first update submodule is configured to: when the coordinates of the first click instruction are within the coordinate area of the anchor point, the anchor point is updated with the sliding instruction of the user to update the coordinates of the drop point.

In some embodiments, the editing region in the video editing state includes: a first editing region and a frame progress bar; and the first editing region displays a frame image that is characterized by the editing video at the stop of the frame progress bar. The video special effect adding device further includes: a second obtaining submodule, a first calculating submodule, and a first calling submodule. The second obtaining sub-module is configured to obtain a click or slide instruction of the user in a range of a frame progress bar; the first calculating sub-module is configured to determine a stop time of the frame progress bar according to a click or a sliding instruction in a range of the frame progress bar; A calling sub-module is used to retrieve a frame picture image characterized by a stop of the frame progress bar as an edit frame picture.

In some embodiments, the frame progress bar is provided with a slider bar marked with the duration of the effect animation, and the slider bar is provided with a command bar for indicating the position of the key frame picture. The video special effect adding device further includes: a third obtaining submodule, a second calculating submodule, and a first display submodule. The third obtaining sub-module is configured to obtain a sliding instruction that the user acts in the range of the sliding bar, so that the sliding bar slides along the frame progress bar with the sliding instruction; and the second computing sub-module is configured to act within the sliding bar range according to the user. The sliding instruction determines a frame progress bar stop time pointed to by the instruction bar; the first display sub-module is configured to display a frame picture image represented by the stop of the frame progress bar pointed by the instruction bar in the first edit area.

In some embodiments, the video special effect adding device further includes: a first setting submodule and a first preview submodule. The first setting sub-module is used to place the editing video and the special effect animation on two parallel time tracks respectively; when the first preview sub-module is used to play the editing video to the start time of the special effect animation, the special effect animation and the special effect are synchronously played. The animation is located on the top of the edit video.

In some embodiments, the video special effect adding apparatus further includes: a fourth obtaining submodule and a first revocation submodule. The fourth obtaining sub-module is configured to acquire a revocation instruction of the user; and the first revocation sub-module is configured to delete the temporarily-applied special effect animation in a stack manner.

In some embodiments, the video special effect adding apparatus further includes: a fifth obtaining submodule, a third calculating submodule, and a first determining submodule. The fifth obtaining sub-module is configured to obtain position relationship information of each frame picture and key frame picture in the preset special effect animation; the third calculating sub-module is configured to calculate each special effect animation according to the falling point coordinate and the position relationship information. The overlay coordinate of the frame picture; the first determining sub-module is configured to determine a coverage position of each frame of the special effect animation according to the overlay coordinate.

This embodiment also provides an intelligent mobile terminal. For details, refer to FIG. 12. FIG. 12 is a schematic diagram of a basic structure of an intelligent mobile terminal according to an embodiment of the present invention.

It should be noted that in the present embodiment, all the programs in the video special effect adding method in the embodiment are stored in the memory 1520 of the smart mobile terminal, and the processor 1580 can call the program in the memory 1520 to perform the above video special effect adding. All the features listed in the method. The video effect adding method in this embodiment is described in detail in the function implemented by the smart mobile terminal, and details are not described herein again.

In the dual video editing and synthesis of the intelligent mobile terminal, a key frame picture is set in the preset special effect animation coordinates, and the position of the falling point of the picture determines the position where the entire special effect animation is superimposed in the editing video during the video synthesis, and the user sets according to the setting. Set the coordinates of the drop point, and freely set the position of the screen where the special effects animation is located in the edit video. In this way, the user is free to control the view position of the special effect animation in the synthesized video, thereby improving the user's freedom in the video editing process, improving the entertainment of the video editing, and having a better customer experience and market prospect.

The embodiment of the present invention further provides an intelligent mobile terminal. As shown in FIG. 12, for the convenience of description, only the parts related to the embodiment of the present invention are shown. If the specific technical details are not disclosed, please refer to the method part of the embodiment of the present invention. The terminal may be any terminal device including a smart mobile terminal, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), an in-vehicle computer, and the terminal is an intelligent mobile terminal as an example:

FIG. 12 is a block diagram showing a partial structure of an intelligent mobile terminal related to a terminal provided by an embodiment of the present invention. Referring to FIG. 12, the smart mobile terminal includes: a radio frequency (RF) circuit 1510, a memory 1520, an input unit 1530, a display unit 1540, a sensor 1550, an audio circuit 1560, and a wireless fidelity (Wi-Fi) module 1570. , processor 1580, and power supply 1590 and other components. It will be understood by those skilled in the art that the smart mobile terminal structure shown in FIG. 12 does not constitute a limitation on the smart mobile terminal, and may include more or less components than those illustrated, or combine some components or different components. Arrangement.

The following describes the components of the smart mobile terminal in detail with reference to FIG. 12:

The RF circuit 1510 can be used for receiving and transmitting signals during the transmission or reception of information or during a call. Specifically, after receiving the downlink information of the base station, the processing is processed by the processor 1580. In addition, the data designed for the uplink is sent to the base station. Typically, RF circuitry 1510 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, RF circuitry 1510 can also communicate with the network and other devices via wireless communication. The above wireless communication may use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division). Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), and the like.

The memory 1520 can be used to store software programs and modules, and the processor 1580 executes various functional applications and data processing of the smart mobile terminal by running software programs and modules stored in the memory 1520. The memory 1520 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a voiceprint playing function, an image playing function, etc.), and the like; the storage data area may be stored. Data created according to the use of the smart mobile terminal (such as audio data, phone book, etc.). Moreover, memory 1520 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 1530 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the smart mobile terminal. Specifically, the input unit 1530 may include a touch panel 1531 and other input devices 1532. The touch panel 1531, also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 1531 or near the touch panel 1531. Operation), and drive the corresponding connecting device according to a preset program. Optionally, the touch panel 1531 may include two parts: a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 1580 is provided and can receive commands from the processor 1580 and execute them. In addition, the touch panel 1531 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1531, the input unit 1530 may also include other input devices 1532. Specifically, other input devices 1532 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.

The display unit 1540 can be used to display information input by the user or information provided to the user as well as various menus of the smart mobile terminal. The display unit 1540 can include a display panel 1541. Alternatively, the display panel 1541 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. Further, the touch panel 1531 may cover the display panel 1541. After the touch panel 1531 detects a touch operation on or near the touch panel 1531, the touch panel 1531 transmits to the processor 1580 to determine the type of the touch event, and then the processor 1580 according to the touch event. The type provides a corresponding visual output on display panel 1541. Although in FIG. 12, the touch panel 1531 and the display panel 1541 are two independent components to implement the input and input functions of the smart mobile terminal, in some embodiments, the touch panel 1531 and the display panel 1541 may be Integrate to realize the input and output functions of intelligent mobile terminals.

The smart mobile terminal may also include at least one type of sensor 1550, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1541 according to the brightness of the ambient light, and the proximity sensor may close the display panel 1541 when the smart mobile terminal moves to the ear. And / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the posture of smart mobile terminals (such as horizontal and vertical screen switching). , related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as well as other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that smart mobile terminals can also configure, I will not repeat them here.

An audio circuit 1560, a speaker 1561, and a microphone 1562 can provide an audio interface between the user and the smart mobile terminal. The audio circuit 1560 can transmit the converted electrical data of the received audio data to the speaker 1561, and convert it into a voiceprint signal output by the speaker 1561. On the other hand, the microphone 1562 converts the collected voiceprint signal into an electrical signal by the audio. Circuit 1560 is converted to audio data upon receipt, processed by audio data output processor 1580, transmitted via RF circuitry 1510 to, for example, another smart mobile terminal, or output audio data to memory 1520 for further processing.

Wi-Fi is a short-range wireless transmission technology. The smart mobile terminal can help users to send and receive emails, browse web pages and access streaming media through the Wi-Fi module 1570. It provides users with wireless broadband Internet access. Although FIG. 12 shows the Wi-Fi module 1570, it can be understood that it does not belong to the essential configuration of the smart mobile terminal, and can be omitted as needed within the scope of not changing the essence of the invention.

The processor 1580 is a control center of the smart mobile terminal that connects various portions of the entire smart mobile terminal using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 1520, and by calling them stored in the memory 1520. The data, performing various functions and processing data of the intelligent mobile terminal, thereby performing overall monitoring of the smart mobile terminal. Optionally, the processor 1580 may include one or more processing units; preferably, the processor 1580 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like. The modem processor primarily handles wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 1580.

The smart mobile terminal also includes a power source 1590 (such as a battery) for supplying power to various components. Preferably, the power source can be logically connected to the processor 1580 through a power management system to manage functions such as charging, discharging, and power management through the power management system. .

Although not shown, the smart mobile terminal may further include a camera, a Bluetooth module, and the like, and details are not described herein again.

It is to be noted that the preferred embodiments of the present invention are described in the specification of the present invention, and the present invention may be embodied in many different forms and not limited to the embodiments described herein. These examples are not intended to be limiting as to the scope of the present invention, which is intended to provide a more thorough understanding of the present disclosure. Further, the above various technical features are further combined with each other to form various embodiments not enumerated above, and are considered as the scope of the description of the present invention; further, those skilled in the art can improve or change according to the above description. All such improvements and modifications are intended to be included within the scope of the appended claims.

Claims

A video special effect adding method, comprising the steps of:

Obtaining a user's click command or a slide instruction in a video editing state;

Acquiring, according to the click instruction or the sliding instruction, a position coordinate specified by the user in the edit frame picture, and using the position coordinate as a drop point coordinate of a key frame picture in the special effect animation;

The edit video and the special effects animation are combined such that the key frame picture is overlaid at a user-specified position coordinate in the edit frame picture.
The video special effect adding method according to claim 1, wherein an anchor point for calibrating the coordinates of the drop point is generated in the edit frame picture in the video editing state;

The step of acquiring the click command or the slide command of the user in the video editing state further includes the following steps:

Obtaining a first click instruction of the user, and calculating coordinates of the first click instruction;

Aligning whether coordinates of the first click instruction are within a coordinate area of the anchor point;

When the coordinates of the first click instruction are within the coordinate area of the anchor point, the anchor point is updated with the user's sliding instruction to update the drop point coordinate.
The video special effect adding method according to claim 1, wherein the editing area in the video editing state comprises: a first editing area and a frame progress bar; and the first editing area displays the editing video in the a frame picture image characterized by a stop of the frame progress bar;

The step of acquiring the click command or the slide command of the user in the video editing state further includes the following steps:

Obtaining a click or slide instruction by the user within the range of the frame progress bar;

Determining a stop time of the frame progress bar according to a click or slide instruction in a range of the frame progress bar;

A frame picture image characterized by the stop of the frame progress bar is retrieved as the edit frame picture.
The video special effect adding method according to claim 3, wherein the frame progress bar is provided with a sliding bar marked with the duration of the special effect animation, and the sliding bar is provided with a position indicating the key frame picture. Instruction bar;

The step of acquiring the click command or the slide command of the user in the video editing state further includes the following steps:

Obtaining a sliding instruction that a user acts within the range of the slider to cause the slider to slide along the frame progress bar along with the sliding instruction;

Determining, according to a sliding instruction of the user within the range of the slider bar, a frame progress bar stop time pointed by the instruction bar;

The first editing area displays a frame picture image characterized by a stop of the frame progress bar pointed by the instruction bar.
The video special effect adding method according to claim 1, wherein the acquiring a position coordinate specified by a user in an edit frame picture according to the click instruction or a slide instruction, and using the position coordinate as a key frame in the special effect animation After the step of dropping coordinates of the screen, the following steps are also included:

And placing the edited video and the special effect animation on two parallel time tracks;

When the editing video is played to the start time of the special effect animation, the special effects animation is played synchronously and the special effects animation is displayed on the upper layer of the edited video.
The video special effect adding method according to claim 5, wherein, when the editing video is played to a start time of the special effect animation, the special effects animation is synchronously played and the special effect animation is located in the editing video. After the steps shown in the upper layer, the following steps are also included:

Obtain the user's revocation instruction;

The temporary effect animation is deleted on the stack.
The video special effect adding method according to claim 1, wherein the acquiring a position coordinate specified by a user in an edit frame picture according to the click instruction or a slide instruction, and using the position coordinate as a key frame in the special effect animation After the step of dropping coordinates of the screen, the following steps are also included:

Obtaining positional relationship information between each frame of the preset effect animation and the key frame picture;

Calculating, according to the falling point coordinates and the positional relationship information, a coverage coordinate of each frame of the special effect animation;

Determining a coverage position of each frame of the effect animation according to the coverage coordinates.
A video special effect adding device, comprising:

The obtaining module is configured to obtain a click command or a slide instruction of the user in a video editing state;

a processing module, configured to acquire, according to the click instruction or the sliding instruction, a position coordinate specified by the user in the edit frame screen, and use the position coordinate as a drop point coordinate of a key frame picture in the special effect animation;

And a synthesizing module, configured to synthesize the edit video and the special effect animation, so that the key frame picture is overlaid at a user-specified position coordinate in the edit frame picture.
The video special effect adding apparatus according to claim 8, wherein an anchor point for calibrating the coordinates of the drop point is generated in the edit frame picture in the video editing state;

The video special effect adding device further includes:

a first obtaining submodule, configured to acquire a first click instruction of the user, and calculate coordinates of the first click instruction;

a first comparison submodule configured to compare whether coordinates of the first click instruction are within a coordinate area of the anchor point;

a first update submodule, configured to: when the coordinates of the first click instruction are within a coordinate area of the anchor point, the anchor point is updated with a sliding instruction of the user to update the drop point coordinate.
An intelligent mobile terminal, comprising:

One or more processors;

Memory

One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to execute rights The method for adding a video effect according to any one of claims 1-7.