Meta’s Massive Stockpile of NVIDIA GPUs Showcases Commitment to AGI Vision

45
405

and reading this article about the importance of AI technology disseminating in all corners of society and the economy. The potential benefits of AI technology are vast, from making people smarter and more creative to automating tasks and jobs that can lead to greater efficiency and productivity.

The comparison to the invention of the printing press, which made people more literate and informed, is apt when considering the impact that AI technology can have on society. Just as the printing press revolutionized communication and knowledge sharing, AI technology has the potential to enhance human intelligence and capabilities in ways we cannot yet imagine.

The push for open-source AI models, as advocated by leaders like Mark Zuckerberg and Yan Loon, is crucial for ensuring that AI technology remains accessible and transparent. By allowing developers and researchers to collaborate and build upon existing models, we can accelerate progress and innovation in the field of AI.

The debate over the regulation of AI research and development is ongoing, with concerns about monopolies and control over powerful AI systems. However, the emphasis on open-source models and democratizing access to AI technology can help mitigate these risks and ensure that AI benefits everyone, not just a select few.

As we continue to explore the potential of AI technology and its impact on society, it is important to consider the role of openness, collaboration, and transparency in shaping the future of AI. With the right approach, AI technology has the power to transform our world for the better and unlock new possibilities for human creativity and innovation.

45 COMMENTS

  1. At about 7:30 "It turns out that coding is actually really important structurally for having the LLMs be able to understand the rigor and hierarchical structure of knowledge, and just more generally have an intuitive sense of logic." in this quote you can also swap out LLMs with Humans, and it will be broadly very correct based on what I anecdotally have seen and heard and experienced myself as a now quite senior computer engineer. Learning to code was a step function in my cognitive toolbox, and gave me a much deeper intuitive understanding of mathematics.
    Other courses I took along the way and also their application in production has given a much better intuition for both inductive and deductive logic as well as systems thinking and a deeper appreciation of scale. Being able to think about code from single instructions executing on the order of nanoseconds to cache hits or misses in tens of nanoseconds, memory access around 100 nanoseconds, blocks of code running in microseconds, HDD/SSD IO in milliseconds, network calls from single to tens or hundreds of milliseconds, and then data processing running various O(N) scaling laws on 1 to thousands to millions to billions of pieces of data need to be structured and done very differently and at each level of scale or abstraction you have different concerns and implications.
    This has also helped me appreciate and get a bit into geopolitics and macroeconomics, where the sheer scale of things like demographics over time and the size of supply chains in the economies in various industries can be mindboggling if you don't understand scale. Like to complete the green revolution by 2050 will either require AGI/ASI take-off with robotics covered fairly soon (looks potentially plausible), as without that there's not enough capital available and getting produced to pull off the build-out of energy and manufacturing infrastructure as well as skilled labour to man that building and manufacturing in time to meet the challenge.

  2. With AGI being predominantely developed via being open source, that means AGI will be the first technology achieved via humanity coming together. The normal everyday person can contribute from anywhere in the world. That's awesome.

  3. A rule I learned a long time ago, is, no matter how stupid, controversial, or even plain wrong idea you present, there will always be the 3% who are for it. Always.

    Any proposition that gets less than 3% naysayers, has to actually be super valid.

  4. 1:35 Glad to hear Meta guy arguing for decentralized power of AI, but can’t help being skeptical given Zuckerberg’s czar-like rule over social media and the attention economy for 4 Billion users .. an unelected life-long reign, even though we can see he’s not good at this powerful job

  5. Why are we selling advanced chips to China? Have we forgotten they're a Communist dictatorship? Have we learned nothing from our mistake of enriching China *because greed* so they could modernize and become an existential threat to the whole world? 🤦🤷

  6. On "everyone will have their own AI enhancing their intelligence", it comes to mind that repeatedly throughout history people have tried to liberate themselves by concentrating power. Whether it's through the government, or AI, these often do not end well. Something big and powerful enough to provide for all your desired needs, is also a monster that can swallow you whole.

    Someone will control the AI you rely on, someone with their own agendas and priorities.

  7. 11:58 WERE IS THIS POLL?? I was literally talking about exactly that topic to everyone with an ear today.

    That guy, went to number 1 spot regarding AI personalities.

    I still do not know enough about the guy to trust him, but the Zuckerberg turns out to be a voice in favour of privacy as the giant truly empowers the open source space. LLama 3, going open source… if it is multimodal with an appreciative performance in text mode…… you have two braincells.

  8. I would have never expected someone high up in a major corporation to be for Open Source, since they're priorities are usually:
    1 – Projecting the company's personal morals, and sacrificing a percentage of paying customers to do so. (censorship)
    2 – Money. (keeping everything closed source to stay ahead of other companies)
    3 – Technological Advancement.

    Them saying they plan on open sourcing AGI leads me to believe the number one priority this time is technological advancement, which is definitely a curveball! With Meta's resources, I believe they can advance really fast by leveraging how Open Source works!

  9. after trying to get ChatGPT to generate an image that it deemed "inappropriate" (the MIDDLE FINGER OOOHHH HOW OFFENSIVE), I am now of the opinion that open source is mandatory so we aren't constrained by the moral puritans of some corporation.

  10. I really like all your content and what you offer. The thing that really bothers me though is your editing with the closed caption yellow follow the words part. You only used to do it a tiny bit in your earlier videos for emphasis. Now it's just way too much and it's like having your CAPS ON FOR EVERYTHING!!! Please stop!

  11. Open source AI is a deceptive term. In the traditional sense is when the source code of some software is accessible to the general public. Neural networks have an additional element to their structure that contribute to the production of the software, the training data. With AI we can open source the weights, and the network's architecture code while still having a proprietary element with the data used to produce the model. With Llama, as well as other models, claim to be open source in the traditional sense but is not truly open source because the data used to produce the weights are hidden. I really think that one of the most important things to do for regulator purposes, and safety is to have an open source architecture, weights, and data set. I really feel that it is really misleading to call Llama, Mixtral, and other models open source when the production of the software contains an integral element that is not open and accessible to the general public.