. I hope you found this article informative and exciting about the latest AI tool from Google, Lumiere. Lumiere is a text to video AI model that allows users to type in text and have it translated into video. But Lumiere goes beyond just text to video, it also allows users to animate existing images, create video in the style of paintings, create specific animation sections within images, and much more.
The science behind Lumiere is fascinating, with Google’s research paper unveiling a Spacetime diffusion model for realistic video generation. This model generates the entire temporal duration of the video at once, creating a more consistent and coherent video experience. The results of their research show that Lumiere outperforms other state-of-the-art models in both text to video and image to video generation, providing realistic and diverse motion in the videos produced.
In comparison to other AI models like Pika and Gen 2, Lumiere excels in terms of video quality, text alignment, and overall user preference. The ability of Lumiere to create lifelike scenes and near-realistic videos is a game-changer for aspiring AI cinematographers and filmmakers. The rapid progression of AI technology in this field is astounding, with the potential for individuals to create high-quality, professional-looking videos from the comfort of their own home.
As we look to the future, the development of General World models like those proposed by Runway ml opens up new possibilities for creating immersive and dynamic virtual worlds where AI assists in building narratives, characters, and visual elements. The combination of AI tools like Lumiere with simulation technology allows creators to bring their stories to life in ways that were previously unimaginable.
Overall, the emergence of AI tools like Lumiere is revolutionizing the world of video production and filmmaking. The ability to generate realistic, diverse, and coherent videos with just a few clicks opens up new avenues for creativity and storytelling. Whether you’re a seasoned filmmaker or an aspiring creator, now is the time to explore the possibilities that AI technology like Lumiere has to offer. With the continued advancements in AI technology, the future of video production is looking brighter than ever.
Have it broadcast a Wyt Family… ;P
Welcome to the age of recycled garbage for you to consume. Enjoy.
um, not new, this was out like i don't know almost ten years? anyone have any idea on the timeline?
Image to text will help the blind know what is up ahead and how much they earn 😞
Temporal consistence is actually trivial. All you have to do is to generate a 3d model with model parameters and then teach the AI to correctly animate the model parameters. This is exactly what CGI animators are doing. They are usually not drawing frame by frame themselves. That's why CGI animation looks more consistent than classical frame animation using large teams of human animators. I have no idea why everybody is making such a big deal out of this.
absolutely diabolical art theft. I will never willingly pay for content created by or utilising ai theft. Get your greedy little eyes off the magic art machine. You couldnt make art before, whatever you use this monster for will be crap and if you can do it, millions will. There are fools already trying to sell this ai art as prints…. damn they think theyre talented because of text inputs….. like children with photoshop filters.
Deep fakes are about to start causing a lot of problems for the naive…
Can Lumiere also do old style nightmarish AI animations?
Its simply finding and reversing the program that pixilated the image of the car.
If everyone is STUNNED, it follows that they have been SHOCKED
This channel and Sam Altman is complete BEEELSCHEIT. Hsquared. Pure HYPE AND HYPERBOLE!! There is no imminent AGI FOLKS!!
isn't it basically utilizing spa Cecial awareness brute force statics crunching combined with full knowledge of all our knowledge including mathematics & logic. What do I know?
I was kind of amazed that the source image of the girl in the field had a lose dress on, but the tight gold dress she had on the generated image had the exact shape of her butt beneath the dress. The image used didn’t show any of the shape of each gluteus maximus muscles (butt cheeks) in the source image but somehow recreated that form underneath perfectly and that wouldn’t seem possible, even knowing there would be a void between the cheeks.
As an artist, I could do that even with the absence of the form in the source image, but that’s would just me pulling from a vast experience from years of painting and drawing female images to know what shape is underneath even a tight dress. I can’t believe that the AI is pulling such an accurate form similar to the memory as an artist does.
This aged pretty poorly
*cough*SORA*cough*. Nowadays this looks horrible, lol.
I can't wait until I can afford to use some of the AI stuff that's out now and in the future. Sucks when ubiquitous technology is out of your price range. 🙁
This and OpenAIs Sora, it's moving so god damn fast. It's legit scary. Who the fuck knows where it's gonna be in even 5 years let alone 10
So in a few years we can no longer count on what we see in news features, interviews, informative videos etc. Not so cool!
3 weeks later we have SORA now which makes this look terrible lol
god damn it
And then Sora comes out of nowhere and blows this out of the water. LoL
Insanely… still can't believe what it is done! Ohh…
While talking about cinema, a friend of mine who thought he was making just another joke did, in fact, I think make a profound observation, "we need our illusions to be perfect." Think about it,"we need our illusions to be perfect." What a strange deluded animal we are.
Well all that is greast but i feel google is talking about its Ai video generative tool for the past 2 years and we cant still access it or use it… so in theory its not better than runway because ic annot use it yet lol
IT HAS ME ABSOLUTELY STUNNED!!!
i like the worse better
16:41 I would definitely raise an argument here that the prompt is bad. That being said, 90% of prompt writing uses the camera/viewer's perspective as the assumption. In this case I'd have to say that "ours" is wrong. The Sheep is not on the right side of the image compared to the wine glass. You would have a much better argument if the prompt was, "There's a wine glass on the right side of a Sheep", because you could pretty easily interpret that as "the sheep's right side". However this is a prompt, you are describing a scene. It's assumed without context that directions are based on what the camera is looking at, not the subjects.
It was invented by (most) jewish Ocupiers in Israel. Google Founders are zionist Jews. So, this is a jewish Zionist-Product!
It has been clear to me that yes these models understand far more than we give them credit for. It's easy to prove this by contradiction: Suppose these models do not have knowledge about depth, how can they not only replicate the effect across "photos" and "drawings" that they generate, but ALSO in completely unseen human-made images, understanding the surroundings and being able to add elements in an existing scene? It would be impossible to achieve without some sort of internal representation. Now that internal representation might be different from ours, but certainly the end results show that it's understood. From my experiments, it seems extremely adept at doing things with color, not just lines and perspective. Perhaps it even uses color, rather than anything else to establish landmarks in images.
WOW THIS IS THE NEW SIGNIFICANT QUALITY STEP
No limitations in cinema…
As a Terry Gilliam fan, I'm not sure it's a good idea ^^'
In fact the software is nowhere near as accomplished and realistic as depicted here. It's yet more crappy AI that churns out simplistic garbage for the most part.
How soon before Wes Roth videos are AI generated? 😀
Hollywood is done. 😆
Really hoping it’s close to being as amazing once we can use
9:59
The math that makes up the model is just getting closer to the answer it's looking for through statistics, & will never be anymore understanding of itself because "it" is just a processing of math itself. Given enough time can mathematics math itself into an understanding of the universe into which it maths, or would that be an illusion as well?
The sheep WAS to the right of the wine glass, from the viewer's perspective…. Where did it say it had to be from the perspective of the wineglass?!
And people say there is not chance of a non zero chance that we are in a simulation. haha. great vid tho man
Great, thanks!
Propaganda anyone?