Well it’s been another really busy week in the world of AI
I’m here to break it down for you starting with probably the biggest news of the week which was the introduction of Gemini, Google’s answer to chat GPT. I’m not going to break this one down too much in this video because I made an entire Deep dive video about everything we know so far about Gemini right here.
However, the quick TLDR is that they’re releasing it in three models: Gemini Nano which is mostly for mobile devices, Gemini Pro which we’re currently getting access to in Bard right now but so far it hasn’t been that impressive, and Gemini Ultra which is the really cool model that they showed off in all of their demo videos but that nobody actually has access to yet. They also released a series of Benchmark comparisons showing how it compares to GPT-4. However, a lot of people have pointed out that it’s comparing it to the older model of GPT-4 and not the newer GPT-4 Turbo model. But based on their comparisons, it essentially beats GPT-4 of the previous generation in almost every single Benchmark. But again, this is Gemini Ultra, the one that they say is coming next year.
However, what I found out today was that Google wasn’t entirely honest with their promotion of this new Gemini. I came across this Tech Crunch article today called Google’s best Gemini demo was fake. In my previous video, I showed off this demo where this person was putting visuals in front of a camera and then Gemini was responding in real time to everything it was seeing. However, if we go to the very front of this video, there is this disclaimer saying “sequences shortened throughout.” Turns out it actually turned out most of the video was sort of faked to make Gemini look a lot better than it really is. A spokesperson actually said, “We created the demo by capturing footage in order to test Gemini’s capabilities on a wide range of challenges then we prompted Gemini using still image frames from the footage and prompting via text.”
To be fair, Google did put out a blog post on their developer blog called “How It’s Made: interacting with Gemini through multimodal prompting” where it actually shows how it was done. But based on this Tech Crunch article, pretty much every single example they showed in the video where they made it look like it was watching a camera video footage and Gemini was responding in real time, pretty much none of that was true. They gave it image plus text prompts and got the response and then in the video, we all saw they actually went back later and narrated over the whole thing. So none of the talking that you were hearing from the actual narrator was created in real time. That was done in postproduction to make it look like it was happening in real time.
Later on in the video, they drew a picture of a guitar and it was hooked up to an amplifier and it appeared that Gemini generated that electric guitar sound. But in reality, it just did a search for whatever type of music it was asking to generate. So when they drew this guitar plus amp plus drums plus Palm Tree, it gave a description and then just did a search for music for a tropical vacation. It didn’t actually generate the music according to this Tech crunch article.
Google actually reached out to them and asked them to change the word “fake” but this Tech crunch article writer argues that it was actually faked. To some degree, I agree with them. I made a whole video breaking down this video and the whole time I was watching it, I honestly thought they were recording a video and Gemini was responding in real time. So personally, even I feel a little duped by it. So I think it’s okay to say that a lot of what we saw here is fake. It’s not based in reality. It’s not what we will actually likely see from Gemini when we get access to it.
Elon Musk Announced that Grock will be rolling out
Today, the day I’m recording this, which is December 7th, 2023, Elon Musk announced that grock will be rolling out to X Premium Plus subscribers with the latest app release. As of this recording on the 7th, I haven’t got access to it yet. But as of this recording, I haven’t got access to it yet.
I actually got Early Access to Pika 1.0. I’m not going to dive too deep into it in this video. I talked about it in the last week’s news video and I’m making a deeper dive video on it next week. In my opinion, so far it lives up to the hype.