Nothing Special   »   [go: up one dir, main page]
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SVD doesn't support prompt for motion control #75

Open
duongnv0499 opened this issue Aug 13, 2024 · 3 comments
Open

SVD doesn't support prompt for motion control #75

duongnv0499 opened this issue Aug 13, 2024 · 3 comments

Comments

@duongnv0499
Copy link

Hi team, thank you for a great project, while finetuning svd, I noticed that there is no prompt supported for motion control with svd. is there anyway i can control the motion by prompt when using SVD (same as use with SD) ?. Thank you all
@sculmh
Copy link
Collaborator
sculmh commented Aug 13, 2024

SVD supports motion control through the motion_bucket_id in the configuration file.
# The motion bucket ID. Used as conditioning for the generation. The higher the number the more motion will be in the video. motion_bucket_id: 127

@duongnv0499
Copy link
Author

SVD supports motion control through the motion_bucket_id in the configuration file. # The motion bucket ID. Used as conditioning for the generation. The higher the number the more motion will be in the video. motion_bucket_id: 127

thank you for a quick response, as i understand, motion_bucket_id is like the range of motion, that why the higher the number the more motion. Am I misunderstanding something ? How can I create a motion with prompt "a girl is fighting" ?

@sculmh
Copy link
Collaborator
sculmh commented Aug 13, 2024

As far as I know, the SVD model for image2video generation does not support prompt control as you mentioned.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sculmh @duongnv0499