Google's Lumiere Brings AI Video Closer To Real Than Unreal
Google's Lumiere Brings AI Video Closer To Real Than Unreal
Google's Lumiere Brings AI Video Closer To Real Than Unreal
Lumiere
Lumiere starts with creating a base frame from the prompt. Then, it
uses the STUNet framework to begin approximating where objects
within that frame will move to create more frames that flow into each
other, creating the appearance of seamless motion. Lumiere also
generates 80 frames compared to 25 frames from Stable Video
Diffusion.
Google was kind enough to put clips and prompts on the Lumiere site,
which let me put the same prompts through Runway for comparison.
Here are the results:
:
Google Lumiere-generated video
Runway-generated video
READ MORE
Other models stitch videos together from generated key frames where
the movement already happened (think of drawings in a flip book),
while STUNet lets Lumiere focus on the movement itself based on
where the generated content should be at a given time in the video.
Google has not been a big player in the text-to-video category, but it has
slowly released more advanced AI models and leaned into a more
multimodal focus. Its Gemini large language model will eventually
bring image generation to Bard. Lumiere is not yet available for testing,
but it shows Google’s capability to develop an AI video platform that is
comparable to — and arguably a bit better than — generally available AI
video generators like Runway and Pika. And just a reminder, this was
where Google was with AI video two years ago.
:
Google Imagen clip from 2022 Image: Google
Google’s Lumiere paper, though, noted that “there is a risk of misuse for
creating fake or harmful content with our technology, and we believe
that it is crucial to develop and apply tools for detecting biases and
malicious use cases to ensure a safe and fair use.” The paper’s authors
didn’t explain how this can be achieved.
F E AT U R E D V I D E O S F R O M T H E V E R G E
With Apple's recent release of the new 14-inch MacBook Pro, 16-inch
MacBook Pro, and Mac Mini, there are now four different MacBooks and a
desktop that you can buy with M2 chips inside. That's great for Apple fans,
but can also be... intimidating. Becca Farsace, Monica Chin, and Chris
Welch break down each of these M2 devices, what it's good at, and who it's
for. Help us help you.
:
More from this stream From ChatGPT to Google Bard: how AI is
rewriting the internet
RECOMMENDED
North Korea [Pics] Most These Steve Jobs Solar roof tiles Canada:
tears down Hilarious Liposuction Left His are the future Stairlift Deals
'reunification' Failures In Patches are Daughter and (Take A Look)
arch, sending Product the Ultimate Billions surprisingly Sponsored | Stairlift
message to Design Ever Solution for Making Her affordable. | Search Ads
Seoul Sponsored | Stubborn Fat The Richest Sponsored | Solar
Sponsored | Nikkei Investing Magazine Sponsored | Heiress Roof Shingles I
Asia Wonder Patch Sponsored | Search Ads.
Investing Magazine
AD
:
T E RM S OF U S E / PRIVACY NOTICE / CO OKIE POL ICY / D O NOT S EL L OR S H ARE MY PERSON AL I NFO / L ICEN S ING FAQ
/ AC CE SS IBI L I TY / PL AT FORM STATU S / HOW WE RATE AND REVI EW PRODUCT S
© 2 02 4 VOX M E D I A , L L C . A L L R I G H T S R E S E RV E D
: