Discover how Ilya Sutskever utilizes AI mental models for hearing AI voices, visualizing neural nets, and creating GNOME mats

By
Leah Sirama
-
44
443



Cool <a href='https://ainewsera.com/how-to-use-new-google-gemini/artificial-intelligence-news/' title='Discover the Ultimate Guide for Mastering Google Gemini AI in 2024' >AI</a> Videos

In this video, there’s just a few really cool videos that kind of keep piling up

AI Vision in Real Time

Here’s a gentleman running around doing laps around his office and the AI Vision in real time is picking up what he’s doing and describing what he’s doing. The AI vision is the next big Frontier with GPT 4 Vision. Once it’s fast and accurate, it can do pretty much anything, like play a video game, navigate browsers, and more.

Large Language Model Visualization

Visualizing what happens inside a large language model can be fascinating. There are cool visualizations available that provide a good understanding of the architecture of these models. You can zoom in and see each layer, weight, bias, attention matrix, and more.

Nano GPT Model

Looking at the Nano GPT model, which has 85,000 parameters, gives insight into how these models work at a smaller scale. By sorting letters or words in alphabetic order, you can see how the model processes the data through tokenization and embedding.

Neural Nets and World Model

Neural networks build a world model based on the data they are trained on. They learn to predict the next word by creating a representation of the world, including human conditions, interactions, and more. The more accurate they are at predicting, the more detailed their world model becomes.

AI Voice Coach

An AI-enhanced voice system can act as a coach to help people be more positive, focused, or achieve their goals. While this technology can be beneficial, there are concerns about privacy and potential manipulation if controlled by a giant corporation.

Augmented Reality

Augmented reality technology can create realistic visuals that blend seamlessly with the real world. It’s getting harder to distinguish between what’s real and what’s augmented, showcasing the potential of this technology.

Autonomous Robot for Materials Synthesis

An autonomous robot is working on synthesizing new materials based on predictions made by AI models. This process could lead to advancements in semiconductors, batteries, microchips, building materials, and medicines, done autonomously with high accuracy.

Thankful Milestone Speech

A wise man once said not to use a platform for making political speeches. Instead, thank your audience and supporters for being part of your journey. AI and technology continue to push boundaries and create exciting possibilities for the future.

Thank you for watching!


RELATED ARTICLESMORE FROM AUTHOR

44 COMMENTS

  2. Ilya's insightful observation that as LLMs are better trained at word the statistics better describe the world context from which they came. Reminded me of a passage, "For since the creation of the world God's invisible qualities—his eternal power and divine nature—have been clearly seen, being understood from what has been made, so that people are without excuse."

  4. °∆ I believe we are meant to be like Jesus in our hearts and not in our flesh. But be careful of AI, for it is just our flesh and that is it. It knows only things of the flesh (our fleshly desires) and cannot comprehend things of the spirit such as peace of heart (which comes from obeying God's Word). Whereas we are a spirit and we have a soul but live in the body (in the flesh). When you go to bed it is your flesh that sleeps but your spirit never sleeps (otherwise you have died physically) that is why you have dreams. More so, true love that endures and last is a thing of the heart (when I say 'heart', I mean 'spirit'). But fake love, pretentious love, love with expectations, love for classic reasons, love for material reasons and love for selfish reasons that is a thing of our flesh. In the beginning God said let us make man in our own image, according to our likeness. Take note, God is Spirit and God is Love. As Love He is the source of it. We also know that God is Omnipotent, for He creates out of nothing and He has no beginning and has no end. That means, our love is but a shadow of God's Love. True love looks around to see who is in need of your help, your smile, your possessions, your money, your strength, your quality time. Love forgives and forgets. Love wants for others what it wants for itself. Take note, true love works in conjunction with other spiritual forces such as patience and faith (in the finished work of our Lord and Savior, Jesus Christ, rather than in what man has done such as science, technology and organizations which won't last forever). To avoid sin and error which leads to the death of our body and also our spirit in hell fire, we should let the Word of God be the standard of our lives not AI. If not, God will let us face AI on our own and it will cast the truth down to the ground, it will be the cause of so much destruction like never seen before, it will deceive many and take many captive in order to enslave them into worshipping it and abiding in lawlessness. We can only destroy ourselves but with God all things are possible. God knows us better because He is our Creater and He knows our beginning and our end. Our prove text is taken from the book of John 5:31-44, 2 Thessalonians 2:1-12, Daniel 2, Daniel 7-9, Revelation 13-15, Matthew 24-25 and Luke 21. Let us watch and pray… God bless you as you share this message to others.

  14. AI vision is already being used on the battlefield to identify armored targets for kamikaze drones. Soon AI robot terminators capable of killing humans will be developed and deployed, why? Because that is what ALL hi tech development has eventually been used for: creating new weapons and increasing corporate profits (with the latter often tied to the former). The apartheid state of Israel is already using AI to target Palestinians, creating a database of the physical characteristics of EVERY Palestinian they are effectively kidnapping.

  19. It's not intelligence. It's a sophisticated mimic. Always will be. The thing is these brainiac fools are running us down the road towards a cliff and they don't even understand how the tech really does what it does. It's like a huge Rube Goldberg machine that actually does something useful but soon will start building and improving itself and we don't know how or why.

  20. Coincidentally, I've watched a few videos in the past few day about people with aphantasia (no internal imagery) and also those with no inner voice. Voice in my head might be interesting for those people to try. They'd find it even weirder that the rest of us I suspect!

  30. 🎯 Key Takeaways for quick navigation:

    00:14 🤖 AI Vision can analyze real-time actions and describe them, showcasing the potential of AI in understanding and interpreting human activities.
    01:11 🧠 Visualizations of neural networks, like Nano GPT, provide insights into the inner workings of AI models and how they process information.
    04:13 🌐 AI language models learn more than just predicting words; they build a mental model of the world, including human interactions and conditions.
    06:57 🎥 AI can generate images and videos rapidly, offering potential for future video production, personal coaches, and more.
    10:14 🤖 AI-driven robots are autonomously synthesizing new materials, which could have applications in semiconductors, batteries, microchips, and more.
    11:47 🏆 A light-hearted ending acknowledging milestones and thanking the audience for their support.

    Made with HARPA AI

  31. I believe that personal AI coaches will be a real breakthrough. The state-of-the-art models are so adept at language and psychology that personal coaches based on these models will be a valuable resource for many people. They will be highly intelligent and empathetic and available 24/7 for very little money. Health insurance companies will welcome them very much. My wife is a psychotherapist, and I think this will probably hurt the business.

  35. Wes, you just killed me with the Ricky G stuff. I don't follow people, I have no TTk nor FB account. I don't post comments…. But you are such a great guy, with lots of things that are on such a short supply these days: curiosity, attention to facts, caution, imagination, enthusiasm, nuance… My DS shared your channel once and you are now part of my daily routine. Congratulations for this well deserved milestone. Keep on the great work. Am so thankful.

  39. The "Predicting the next word" with Ilya Sutskever placed two concepts together to see how predicting the next word must work, in humans and AI apparatus.

    If you do not know the context it is impossible to predict the next _______. Do I mean word? Do I mean automobile brand I will see? Do I mean term in the equation? This is simpler if you know the situation, the setting in which the statement is made. You know of you are an architect talking business from the setting. The AI needs a prompt, "You are a world renowned architect." Bob's your uncle. With background information the problem is soluble. With AI, AGI, anything less than an all knowing God, or blind luck the "prompt" is required and the better the prompt the better the results. This is true for humans and AIs, especially AIs with very limited working memory that it has not learned how to manage properly, yet.

    We will have reached an important step when we can leave Cathy, our personal AI assistant, for a day or two, come back, and resume a conversation without knowing if "Cathy" is a human or a computer. (This includes missing the guess on WHICH conversation we are resuming from time to time.)

    Another thing I am wondering about here is "how does an AI forget something it learned and has since found to be false?" That is another valuable HI ability.

    {^_^}

  43. Nice milestone and very appropriate and appreciated clip from Ricky. I sure wish I could send that to the stupid leader singer of the Celtic band I went to see on the weekend who decided to lecture everyone on our shameful colonial history…. f me. 😣. At a Christmas concert. People are so incredibly stupid in chynada. Zero knowledge of history apparently. Anyway. Thank you!! 🙏 🎉. Your jokes crack me up. Good luck with Jerry…. crazy times.