The AI Daily Brief: Artificial Intelligence News and Analysis - AI Starting to Self-Improve Says Zuckerberg

Episode Date: July 31, 2025

Mark Zuckerberg just published a major essay on Meta’s vision for “Personal Superintelligence,” claiming their AI is beginning to show signs of self-improvement. This follows Meta’s aggressive... talent push, with billion-dollar offers to AI researchers from OpenAI and Anthropic—many of which are being declined. Zuckerberg contrasts competitors by promoting superintelligence as a tool for personal empowerment, not just labor automation and UBI. Reactions are mixed: some praise the individual focus, while others question whether Meta’s ad-driven model can deliver—or if it’s quietly retreating from open source commitments.Ask GPT about our Agent Readiness Audits - ⁠https://bit.ly/supersuperagent⁠Brought to you by:KPMG – Go to ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://kpmg.com/ai⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ to learn more about how KPMG can help you drive value with our AI solutions.Blitzy.com - Go to ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://blitzy.com/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ to build enterprise software in days, not months AGNTCY - The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠agntcy.org ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠  ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Vanta - Simplify compliance - ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://vanta.com/nlw⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Plumb - The automation platform for AI experts and consultants ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://useplumb.com/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠The Agent Readiness Audit from Superintelligent - Go to ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://besuper.ai/ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠to request your company's agent readiness score.The AI Daily Brief helps you understand the most important news and discussions in AI. Subscribe to the podcast version of The AI Daily Brief wherever you listen: https://pod.link/1680633614Subscribe to the newsletter: https://aidailybrief.beehiiv.com/Join our Discord: https://bit.ly/aibreakdownInterested in sponsoring the show? nlw@breakdown.network

Transcript
Discussion (0)
Starting point is 00:00:00 This podcast is supported by Google. Hi folks, Paige Bailey here from the Google DeepMind Devrel team. For our developers out there, we know there's a constant tradeoff between model intelligence, speed, and cost. Gemini 2.5 Flash aims right at that challenge. It's got the speed you expect from Flash, but with upgraded reasoning power. And crucially, we've added controls, like setting thinking budgets, so you can decide how much reasoning to apply, optimizing for latency and costs. So try out Gemini 2.5 Flash at AIS Studio.gov.com and let us know what you build. Today on the AI Daily Brief, Meta's Mark Zuckerberg drops a new vision for personal superintelligence
Starting point is 00:00:36 and says they've seen glimpses of AI system self-improving. Before that in the headlines, Microsoft apparently is feeling the AGI. The AI Daily Brief is a daily podcast and video about the most important news and discussions in AI. Hello, friends, quick announcements before we dive in. First of all, thank you to today's sponsors, Google Gemini, Blitzy, Vanta, and Superintelligent. And of course, as always, to get an ad-free version of the show, just go to patreon.com slash AI Daily Brief. You can get ad-free for just $3. And today we got a full one, so let's dive right on in to the headlines.
Starting point is 00:01:13 Welcome back to the AI Daily Brief Headlines edition, all the daily AI news you need in around five minutes. Today is one of those days when almost every story in the headlines could actually be the centerpiece of a full episode. So we will rip through these, but I would not be surprised if we come back to some of these themes later in the week or next week. week as well. We kick off today with progress in the negotiation between OpenAI and Microsoft, where it appears that continued access to OpenAI's technology has been the key topic. Now, the two firms for background have been locked in a lengthy negotiation around OpenAI's plans to convert to a for-profit company. Last month, it seemed like we were getting near daily updates on how the talks were going, and it sounded like they were not going well. Open AI were leaking
Starting point is 00:01:56 that they were considering making an antitrust complaint, while Microsoft's positions seemed to be that they held all the cards and were content to just run out the clock until the end of the year. That could force OpenAI to lose out on about 20 billion in funding that was contingent on the conversion. Now, however, it appears that cooler heads have prevailed and a deal is getting close. Bloomberg reports that the companies are in advanced talks to land a deal that would see Microsoft retain access to OpenAI's technology even if AGI is achieved. This is one of the weirdest parts of this deal, and everyone has commented on it so we don't have to dwell on it too long.
Starting point is 00:02:29 But basically, under the current deal they had, Microsoft was cut off from OpenAI's models once they reached some ill-defined state of AGI. What's crazier than that is that Open AIs board had sole discretion to determine what counts as AGI. Now, Microsoft maybe thought that A, A, this was way far in the future, and B, they had partners at Open AIs board who they could deal with rationally, meaning they weren't all that concerned about it when those deals were signed. But then, of course, the absolute utter fricacy around sales. Altman's firing, then rehiring happened, and ever since then, Microsoft has, I believe,
Starting point is 00:03:05 basically felt a responsibility to distance themselves from the potential for quackery happening based on that particular term. It should be noted that without an AGI declaration, the deal is said to expire in 2030, but in any case, it appears that that has become less of a stumbling block. Sources say that CEO Satchie Nadella and Sam Altman discussed the restructuring personally at the Sun Valley Conference in Idaho earlier this month, describing the tone of the talks as positive, but with the caution that they could still hit a roadblock. The current reporting suggests that the companies are converging on an agreement to get rid of the subjective definition of AGI and substitute a revenue-based metric instead.
Starting point is 00:03:39 Under these updated terms, it would be something like AGI being defined as a technology that can deliver $100 billion in total profits from Microsoft and other investors, effectively paying them out for profit-sharing agreements. Sources noted that another term prevents Microsoft from pursuing AGI themselves, and while it's not clear that Microsoft is looking to spin up a superintelligence team, the reporting does suggest that this has been a topic of discussion during the negotiations as well. Obviously, markets are rooting for this deal to get done. Goldman Sachs analyst Cash Rangan said,
Starting point is 00:04:07 if a deal were to be signed, it would take away a hurdle, at least from the investor's perspective. Both parties have so much to gain from this. Moving over to funding news, Anthropics' rumor valuation just keeps moving up as their latest round gets ready to close. Over the past month, we heard rumors that Anthropic were fielding investment offers at $100 billion, which increased to $150 billion last week, And now Bloomberg reports the number is $170 billion, and the company is, in their words, nearing a deal. Iconic capital is reportedly leading the round,
Starting point is 00:04:36 which is expected to raise between $3 and $5 billion. The source said that Anthropic has also been in discussions with the Qatar Investment Authority and Singapore's sovereign wealth fund, which add to the rumors that Abu Dhabi's MGX is looking to invest as well. Now, holding aside who this money is coming from, they're basically at a place where sovereign wealth funds are kind of the only game in town with that sort of capital. What's more interesting is that the valuation definitely suggests
Starting point is 00:04:56 that Anthropic is closing the gap with rivals. OpenAI's latest round, for example, put them at a $300 billion valuation, and Elon Musk was reportedly looking for a $200 billion valuation for XAI. But what's more impressive than the jump in valuation is the fact that it actually has a very specific reasoning that isn't just AI hype markets excited. Anthropics started the year at around 1 billion ARR. It took them a few months to get up to 3 billion ARR, and then it took them one month to get to 4 billion ARR and another month to get to 5 billion ARR. In other months, to get to 5 billion ARR. In other words, revenue is absolutely surging right now. In fact, reports suggest that Anthropic is seeing revenue getting all the way up to $9 billion
Starting point is 00:05:34 by year's end, which is just a phenomenally fast rate of growth. Sabine analysis as AJ Karabi writes, Anthro's API revenue has overtaken Open AIs. And once I internalize that and its implications, I joined their ranks in believing code is the only thing that matters. Meanwhile, over in OpenAI land, the company continues to experiment not just with new models, although everyone is just frantically sitting here tapping our fingers waiting for GBT5 at this point, but also new dedicated versions of their tools and specific agents focused on particular use cases. For example, the company has just released study mode for chat GBT.
Starting point is 00:06:09 In an announcement blog, they describe the feature as a learning experience that helps you work through problems step by step instead of just getting an answer. Essentially, the model will give students hints and nudges to reason out their own solution to a problem rather than just giving the answer. Anthropic released a similar study mode for Claude in April, but for everyday high schoolers, obviously ChatsyBTBT is by far their most used product. Study after study reports that ChatsyPT usage in schools is somewhere north of 80%, which, to use a joke I've used before here, and apologies, I am a dad after all,
Starting point is 00:06:38 means that about 20% of people are lying. Now, OpenAI said that their study mode feature was developed with education experts to reflect behaviors that promote deeper learning. That includes, in their words, encouraging active participation, managing cognitive load, proactively developing metacognition and self-reflection, fostering curiosity and providing actionable and supportive feedback. Now, I think that there is a lot here that's interesting. There is a societal question, an education question.
Starting point is 00:07:03 Also a competitive question. A lot of AI for education companies are now wondering what their future holds. But like I said, basically every news item in today's headlines could be its own episode, and we've still got a couple more to cover. For example, we have an update from Notebook LM. The latest new feature is called video overviews. And this is super interesting. Also in the context of that,
Starting point is 00:07:24 educational use case, although that, of course, is not the only use case. Google writes, you can think of these as a visual alternative to audio overviews. The AI host creates new visuals to help illustrate points while also pulling in images, diagrams, quotes, and numbers from your documents. This makes it uniquely effective for explaining data, demonstrating processes, and making abstract concepts more tangible. Similar to audio overviews, you can tune the video output to match a particular knowledge level or target audience.
Starting point is 00:07:50 That means you can use the same source material to generate a slideshow suitable for children or grad students. I'm actually thinking about a way to potentially use this to explain the idea of the bitter lesson and maybe what it means for enterprises in an LRS episode coming up at some point in the future. Alongside the video featured notebook LM also has a number of quality of life improvements. Users can now generate more than one overview, mind map or study guide per per se, and they can also explore more than one output at once. For example, listening to an audio overview while also perusing the mind map. Lastly, today we'll close on a meta story for that sweet, sweet synergy with our main episode, the company is now planning to allow AI during the
Starting point is 00:08:27 interview process to better reflect the real world. Wired view to memo from earlier this month in which Meta called for mock candidates to test a new style of interview. The memo said, Meta is developing a new type of coding interview in which candidates have access to an AI assistant. This is more representative of the developer environment that our future employees will work in and also makes LLM-based cheating less effective. Now, there's been a ton of reporting on this topic recently, suggesting that some of even the leading AI firms can't figure out how to deal with AI use in job interviews. Earlier this month, Anthropic released somewhat mixed guidance that they were looking for candidates who excel at collaborating with AI, while also advising
Starting point is 00:09:01 candidates that they shouldn't actually collaborate with AI during the coding assessments. I met a spokesperson said, we're obviously focused on using AI to help engineers with their day-to-day work, so it should be no surprise that we're testing how to provide these tools to applicants during interviews. Now, honestly, there are probably a lot of ways to do this poorly, but some version of this was completely inevitable. I've talked before on this show about how we've had employees of Superintelligent in the past developers, who we had to let go because they just would not adapt
Starting point is 00:09:28 to the new world of agented coding assistance, which is not to say, of course, that those things are a cure-all or perfect or should be used for every different use case when it comes to coding, but it is so clearly a relevant skill set to be able to know how to navigate and get the most from that set of tools
Starting point is 00:09:42 that they have to be incorporated in the application process in some way. One person doing a victory lap around this was of course Clare's CLEE CEO Roy Lee, whose entire company has premised on the idea that in a few years things we consider cheating now will be just totally de rigueur. He posted the scoop of the announcement and said simply, You're welcome, everyone. With that, though, let's move over to our main episode, which is still in the meta world, but a very different thing.
Starting point is 00:10:07 Zuckerberg has laid out a vision for personal superintelligence and suggested that they're already seeing AI self-improvement. This episode is brought to you by Blitsey, the Enterprise Autonomous Software Development Platform with infinite code context. Blitzy uses thousands of specialized AI agents that think for hours to understand enterprise-scale code bases with millions of lines of code. Enterprise engineering leaders start every development sprint with the Blitzy platform, bringing in their development requirements. The Blitzy platform provides a plan, then generates and pre-compiles code for each task. Blitzy delivers 80% plus of the development work autonomously while providing a guide for the final 20% of human development work required to complete the sprint.
Starting point is 00:10:46 Public companies are achieving a 5x engineering velocity increase when incorporating Blitsey as their pre-IDE development tool, pairing it with their coding co-pilot of choice to bring an AI-native STLC into their org. Blitzy is providing a limited time, 30-day free proof-of-concept for qualifying enterprises. The team will provide a 5x velocity increase on a real development project in your org. Visit blitzy.com and press book demo to learn how Blitzie transforms your STLC from AI-assisted to AI Native. That's B-L-I-T-ZY.com.
Starting point is 00:11:17 As a founder, you're moving fast towards product market fit, your next round, or your first big enterprise deal. But with AI accelerating how quickly startups build and ship, security expectations are higher earlier than ever. Getting security and compliance right can unlock growth or stall it if you wait too long. With deep integrations and automated workflows built for fast-moving teams, Vanta gets you audit-ready fast and keeps you secure with continuous monitoring as your models, infra, and customers evolve. Fast-growing customers like Langchain, writer and cursor, trusted Vanta to build
Starting point is 00:11:49 a scalable foundation from the start. And look, as someone who lives in the world of enterprise procurement, I love how Vanta makes it easy to get compliance right. The last thing you need when you're trying to win that big deal is to have it scuttled by something that Vanta has solved for over 10,000 companies. Go to vanta.com slash NLW to save $1,000 today through the Vanta for Startups program and join over 10,000 ambitious companies already scaling with Vanta. That's VAN, T-A, com slash NLW to save $1,000 for a limited time. If you are a regular listener, you will have heard about Super Intelligence Agent Readiness Audits at this point.
Starting point is 00:12:25 But I wanted to tell you today about the full suite of Agent Readiness products that go beyond just the initial readiness report. Over the last six months, Super Intelligence has built out an entire agent planning suite. We help you move from discovery to planning to implementation. In addition to the Agent Readiness Audit, after you've completed your agent readiness audits, we help you double-click on your most important use cases with what we call our use case planning reports. These reports are going to help you understand what sort of technical preparation you need to do to be ready for a use case, what challenges you
Starting point is 00:12:58 might face in implementation, and whether you should be thinking about building, buying, partnering, or some combination. After that, you can even get a spec document in what we call our technical blueprint that gives either your developers or the developers of the partner you work with what they need to build exactly the agent that you're looking for. If you want to learn more about super intelligence agent planning suite, we've built a custom GPT to answer your questions. Just go to bit. That's bit.ly slash super agent, all one word. And if you have any questions, the agent can even help you book an appointment with our team. Welcome back to the AI Daily Brief. Today, as we sit and wait for GPT5, we are talking about a different company's vision for the future of
Starting point is 00:13:42 AI, Meta's Mark Zuckerberg has just published a short essay on what he calls personal superintelligence. It's significant enough to have its own URL, meta.com slash superintelligence, and lays out a particular vision for what the point of advanced AI should be. Now, Zuckerberg is not the only AI leader who's done one of these What the Near Future holds types of posts. Last fall, Anthropics to Ariel Amade wrote his essay Machines of Loving Grace, which he basically said he needed to do because for as much as people were paying attention to him about the risks of AI, he also wanted to paint a picture of what the best version of an AI future could be.
Starting point is 00:14:17 More recently, we got from Sam Altman, his post on the gentle singularity. And something that Altman and Zuckerberg have in common that we'll discuss further is this idea that we've crossed some fundamental threshold. Sam Altman's piece begins, we are past the event horizon. The takeoff has started. Humanity is close to building digital superintelligence. As we'll see, Zuckerberg makes a similar argument. But before we get into the details, let's actually. talk about the context into which this essay comes. Obviously, one of the big stories of the last
Starting point is 00:14:44 couple of months have been these incredibly large offers that Zuckerberg and Meta have been throwing around to try to win talent from the rest of the AI research labs. Their success has at least been moderate. Altman and OpenAI continue to claim that in general, Zuckerberg has had to go kind of far down the org chart to find people who are willing to part, but he has clearly had at least some success. Recently, Meta announced a new chief scientist for the AI lab, and in general, their talent card is a lot more stacked than it was just a couple of months ago. That said, all of the reporting this week is around how Zuckerberg and Meta have recently turned their attention to former OpenAI CTO Mira Muradi's new startup thinking machines lab and how that effort hasn't been all that
Starting point is 00:15:23 successful. The big headline this week, in fact, was that at least one person on the TML team got a billion dollar offer and rejected it. In fact, the reporting has it that no one from TML actually left. Now, to some, this suggests that the story is that even with this much money, people are still turning Zuckerberg down. Wired reported that in addition to the billion dollar deal, most of the rest of the offers were still between 200 million and 500 million over a four-year period, and in the first year alone, some were guaranteed to make between 50 and 100 million. Will DePoo from OpenAI writes, the bigger story is not that Zuck is giving out $400 million offers. It's that people are turning them down. What might that mean? Now, one kind of obvious
Starting point is 00:16:05 answer is that a lot of these folks were fairly early at OpenAI or Anthropic or wherever they got their start before joining TML. And so weren't exactly in a position where that money fundamentally got them to a different stratosphere. Or maybe at least to put it more simply, they had a bunch of millions of dollars already. And yet still, there is a sense among many that there is at least a bit of a mission thing here, that it's probably not just money, but that many of these researchers are more keyed into the goal of building advanced AGI or ASI or whatever designation we want to call it these days, than they were at just getting a few more commas in their net worth. And I think that this essay, and the accompanying video that Meta dropped of Zuckerberg
Starting point is 00:16:43 talking straight to camera about it, certainly strike me as having the goal of maybe trying to fill in some of that mission orientation. It's significant enough and short enough that I'm just going to read the whole thing. Zuckerberg writes, over the last few months, we've begun to see glimpses of our AI systems improving themselves. The improvement is slow for now, but undeniable. Developing superintelligence is now in sight. It seems clear that in the coming years, AI will improve all our existing systems and enable the creation and discovery of new things that aren't imaginable today. But it is an open question what we will direct superintelligence towards. In some ways, this will be a new era for humanity. But in others, it's just a continuation of historical
Starting point is 00:17:22 trends. As recently as 200 years ago, 90% of people were farmers growing food to survive. advances in technology have steadily freed much of humanity to focus less on subsistence and more on the pursuits we choose. At each step, people have used our newfound productivity to achieve more than was previously possible, pushing the frontiers of science and health, as well as spending more time on creativity, culture, relationships, and enjoying life. I am extremely optimistic that superintelligence will help humanity accelerate our pace of progress. But perhaps even more important is that superintelligence has the potential to begin a new era of personal empowerment, where people have greater agency to improve the world in the direction they choose. As profound as the abundance produced by AI may one day be,
Starting point is 00:18:01 an even more meaningful impact on our lives will likely come from everyone having a personal superintelligence that helps you achieve your goals, create what you want to see in the world, experience any adventurer, be a better friend to those who care about, and grow to become the person you aspire to be. Meta's vision is to bring personal superintelligence to everyone. We believe in putting this power in people's hands to direct it towards whatever they value in their own lives. This is distinct from others in the industry who believe superintelligence should be directed centrally towards automating all valuable work, and then humanity will live on a dole of its output.
Starting point is 00:18:32 At Meta, we believe that people pursuing their individual aspirations is how we have always made progress expanding prosperity, science, health, and culture. This will be increasingly important in the future as well. The intersection of technology and how people live is Meta's focus, and this will only become more important in the future. If trends continue, then you'd expect people to spend less time in productivity software, and more time creating and connecting. Personal superintelligence that knows us deeply, understands our goals, and can help us achieve
Starting point is 00:18:59 them will be by far the most useful. Personal devices like glasses that understand our context because they can see what we see, hear what we hear, and interact with us throughout the day will become our primary computing devices. We believe the benefits of superintelligence should be shared with the world as broadly as possible. That said, superintelligence will raise novel safety concerns. We'll need to be rigorous about mitigating these risks and careful about what we choose to open source. Still, we believe that building a free society requires that we aim to empower people as much as possible. The rest of this decade seems likely to be the decisive period for determining the path this technology will take,
Starting point is 00:19:32 and whether superintelligence will be a tool for personal empowerment or a force focused on replacing large swaths of society. Meta believes strongly in building personal superintelligence that empowers everyone. We have the resources and the expertise to build the massive infrastructure required, and the capability and will to deliver new technology to billions of people across our products. I'm excited to focus Meta's efforts towards building this future. So how has the response been to this? So far, and it's not been very long, it's only been a few hours since they dropped this, the takes are kind of what you might expect. Some of them are extremely petty, with people complaining that the visual impact of the note is basically
Starting point is 00:20:06 the same approach that Ilya and Safe Superintelligence took in their announcement webpage, which maybe seems like extra rubbins given them that met a poach, the CEO of SSI, who was Daniel Gross. Mostly, I think that they're trying to make a point that it's the ideas that matter here not the presentation. Another category of response is to be inherently mistrustful of Zuckerberg's vision of the future, given how all in on the metaverse he was a few years ago, which many people perceive as being an abandoned bed at this point. Lou Thomas writes, there are a lot of images floating around of the weird blocky character style metaverse images that were shared by Meta and Zuck just a few years ago. Another big theme was that seemingly not-so throwaway line about open source.
Starting point is 00:20:46 The line is, we believe the benefits of superintelligence should be shared with the world as broadly as possible. That said, superintelligence will raise novel safety concerns. We'll need to be rigorous about mitigating these risks and careful about what we choose to open source. Many are pointing out that this is quite different than the vision laid out in a note from just a year ago, called open source AI as the path forward. It's also worth taking a moment here to note that this is not Meta's first attempt at laying out their vision of how they're different when it comes to AI. Of course, so far, the main differentiator has been this open source. source approach. Many people have recently expressed skepticism, however, that that's going to be long
Starting point is 00:21:21 sustainable, given that A, China has seemed to race ahead in that department, and B, that it's very clear that Zuckerberg is not content just competing to be the best open source model. He wants to build the best models, period. Now, it might be inevitable, but I do think that there is significant brand risk should meta back away from its commitment to open source. However, for now, that's firmly in the realm of speculation, and so it's probably not worth dwelling on all that much. Some are complaining that the vision isn't grandiose enough. Transformer editor Shaquil Hashim writes, I think the most interesting thing about Zuck's vision here is how boring it is. He suggests the future with superintelligence will be one with glasses, not nanobots, not brain computer interfaces,
Starting point is 00:21:57 but glasses, just entirely devoid of ambition and imagination. I'll come back to that critique in just a minute. Still, overall, probably the most common skepticism, and one that's frankly, I think, reasonable, is basically a concern that META's business model will in some ways run at odds with the vision of the future that they're trying to suggest for. writes Mall, sounds impressive and META can talk all they want about personal superintelligence. But as long as their core remains an ad-driven dopamine machine, they're the last company I'd trust with something like this. Matt Middlestod writes, despite reporting that superintelligence labs would be startup-esque and
Starting point is 00:22:31 walled from meta's business as usual, these goals seem deeply tied down by meta's social media legacy and existing product line. It's hard to imagine big transformations if we don't aim at big problems. So I want to talk about a few parts of this. First of all, let's acknowledge that this starts with a very profound argument, that meta is starting to see self-improving AI. Now, maybe it would be too easy to overstate how far they're trying to say that is, considering he's using words like glimpses of our AI systems improving themselves, but he says the improvement is undeniable. So you have here another head of one of the major labs arguing that we've passed some fundamental event horizon. Second, this piece is absolutely trying to draw a sharp
Starting point is 00:23:11 line between a vision for superintelligence that's all about how you get your work done and a vision for superintelligence that's all about your life. Zuckerberg throws an elbow or two, basically arguing that his competitors just want to automate away your job, while he and Meta want you to do more of whatever it is that you do that makes you feel most fulfilled. Now, it will be, as we've already seen, very hard for some people to separate the message from the messenger here. Too many people just simply will not trust Zuckerberg and Meta with this sort of ambition. Others will understandably see fingerprints of connecting this particular vision of superintelligence conveniently to the existing product lines that Meta already has. I'm sympathetic to Zuck and Meta because the reason that they
Starting point is 00:23:51 have those product lines is the reason that they would be interested in how those things are impacted by AI. But nevertheless, some people aren't going to be able to get beyond their skepticism of the financial motivation for having this particular vision. But here's something that I do think is important about this. Right now, most of our discussion about AI is a lot of about the transition and the transformation and the change. It's about how much more productive you could be doing the things you do currently. What it's going to look like to do your job in the near future with this different set of tools. Our field of vision for AI is largely this transitional period, the next few years.
Starting point is 00:24:27 What these essays in general try to get at, and what I think Zuckerberg is trying to plant a flag in, is a vision for the world after the transformation. And while I don't think that this is a fully baked theory or articulation, you can see Mark here trying to tell a story about how the future should feel. And arguing in some fundamental way that it should be less about you doing more and better work and more about you living a better and more fulfilling life, whatever that happens to mean to you. Whether you believe in this particular vision for the world after AI transformation, whether you're skeptical, like I said, of this particular messenger.
Starting point is 00:25:01 I do think it's a good conversation to be having to zoom out to what we're going to. we want that world to look like. It's going to be hard to design systems that serve people if we don't have a vision for what's serving people in a world of plentiful, abundant, and nearly free intelligence actually looks like. Super interested to see what you guys all think about this. Use the comments on YouTube or at Spotify. Come join the Patreon, whatever. Find a way to share your thoughts. I'm sure there's going to be a wide diversity of opinions on this one. For now, that is going to do it for today's AID Daily Brief. I appreciate you listening or watching as always. And until next time,
Starting point is 00:25:35 Peace.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.