Big Technology Podcast - OpenAI Teases GPT-5, Musk's Plan For xAI, Loneliness in Remote Work Era

Episode Date: May 31, 2024

Brian McCullough, host the Techmeme Ride Home podcast, joins us our weekly discussion of the latest tech news. We cover 1) OpenAI teasing GPT-5 2) Or wait, was it GPT-6? 3) Satya Nadella speaks with S...am Altman about OpenAI's Apple partnership 4) How long will OpenAI and Microsoft be best buds? 5) Does OpenAI benefit by diversifying partnerships? 6) Is Apple going to go all-in on AI at WWDC? 7) What the new Siri might look like? 8) OpenAI's ex-board members speak up about Altman firing episode 9) Statement from OpenAI on alignment work 10) Elon Musk gets $6 billion to build 'gigafactory of compute' at xAI 11) Could Ilya join Elon again? 12) How remote work is increasing loneliness 13) The meetings will continue until morale improves --- Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice. For weekly updates on the show, sign up for the pod newsletter on LinkedIn: https://www.linkedin.com/newsletters/6901970121829801984/ Sign up for Big Technology on Substack: Here’s 40% off for the first year: https://tinyurl.com/bigtechnology Questions? Feedback? Write to: bigtechnologypodcast@gmail.com

Transcript
Discussion (0)
Starting point is 00:00:00 OpenAI says it started training its next frontier model. Saty and Adela calls Sam Altman to talk about his Apple partnership. Apple's big announcements, meanwhile, look clearer ahead of WWDC. Elon Musk raised $6 billion for XAI, and the remote work era is spiking loneliness. All that and more is coming up right after this. Welcome to Big Technology Podcast, Friday edition, when we break down the news in our traditional cool-headed and nuanced format. We have Brian McCullough with us here in the house talking about everything.
Starting point is 00:00:30 thing from GPT5 potentially coming in to the Musk fundraising and of course what's going on with Apple and open AI and how Microsoft feels all about it. Brian is the host of the tech meme ride home show. It's a great show. You can find it in your podcast app of choice. He's also a partner at the ride home fund. Brian, welcome back to the show. Great to see you. Great to see you again. I think, you know, this is what the fourth or fifth time we've done this. But since Alex has been telling you about tech meme recently, I believe, you know, FYI, if you don't want to go to TechMeme every 30 seconds like most of us do to read the articles. You can just have me regurgitate the articles to you every day for about 15 minutes, a really quick podcast. It goes
Starting point is 00:01:10 well, as we always say, with big technology. That's right. Definitely go to TechMeme right home to check out your daily tech news. Come to us for, you know, on the weekends or on Wednesdays as we dive deep into the headlines. And let's just do that right now. So Open AI had a very interesting release this week, Brian. And by release, I mean press release, really. They talked about how they were starting to invest in safety in a different way and made a big safety announcement. They have a new safety and security council. Second paragraph. Let me say, OpenAI has recently begun training its next frontier model.
Starting point is 00:01:44 And we anticipate the resulting system to bring us to the next level of capabilities on our path to AGI. I mean, talk about bearing the lead there. Like, why wouldn't an open AI just come out with a press release and say, hey, we're starting GPD5? But I think maybe they've just taken such a hit publicity-wise with the leaving of Elias Sitskever and the leaving of all this, like many of the folks in the super alignment team that they wanted to show that they were committed and sort of wrap the GPT-5 news and like a hot dog bun of safety. I don't know. It's your perspective on what happened with this announcement. And what do you think about the fact that GPT-5 has started to train? So this could be a head fake by them, which we can talk about in a second.
Starting point is 00:02:27 But as you mentioned, I am a GP in two different early stage funds, one of which is AI focused. And one of the things that's been kind of unique about the spring so far is that people in the AI community and investors in AI have sort of been waiting on tender hooks for is when is GPT5 going to come out? When GPT40 came out, you saw a lot of, you know, there's tons of stuff. startups that are doing like, what if there's a chat bot for customer service? What if there's a chat bot for you go through the Wendy's Drythrough or whatever? And that conversational, like, step forward that GPT4 had, um, obviated a lot of startups. So in the spring, a lot of folks have been sort of waiting to see if GPT5 was going to come out. A lot of people thought it could be out by now. I would say, this is arguable, but I'd say maybe the majority of people thought it was
Starting point is 00:03:24 coming this summer. So it's a bit of a surprise. that essentially people were thinking that based on the cadence of when the previous models came out by saying that we've just started training what they're essentially saying is that at a minimum GPT5 is is eight months out right can I give you a crazy counter here and maybe maybe this is completely wrong but do you think that that might be GPT 6 that they're training and they've got GPT 5 ready to release if that was the expectation people people were so waiting for this that when GPT, remember there was that weird thing
Starting point is 00:04:00 that was floating around and people are like, this seems like a bot. It was GPT2 chat or something like that. And then it became GPT4. It turned out it was GPT 40. People were thinking is this, are they testing GPT5 in the wild? So that's what I said is it could be a head fake in the sense that because the industry is sort of waiting,
Starting point is 00:04:20 because Open AI as far as most people feel, although Anthropic and others would argue with this, is still the state of the art and people expect that whatever their next flagship model is going to be, is going to leapfrog the existing stuff. So if they're head faking us, what they could do is like we expected by the end of the summer, release GPT5, because then everyone's like, oh, it's going to be a year out. Because the idea is it takes eight months to train, and then you need months to, like, test and do the refinement on the various weights and things like that. So what they're signaling to the industry is maybe it's a year out. Maybe it's a 20, 25 release, as I said.
Starting point is 00:05:01 So then you could have Open AI competitors try to rush things and beat them to market. Because why else, I mean, it is mysterious that you're basically revealing your timeline, right? So yes, they could be head faking in that way. They could be saying, well, GPD5 is a, or signaling that it's a year away. and then release it earlier than people are anticipating. Or you're right, they've made a leapfrog and it's a second generation beyond. But functionally, it doesn't matter because people in the AI space, there is concern out there that there is a ceiling to this technology,
Starting point is 00:05:41 that the transformer technology that most of the current generation of AI is based on might have its limits. And those limits are around things like the data to train on and things like that. and energy, energy, accessibility to compute and things like that. So for so many reasons, people are watching Open AI to see where the state of the art is. Like I've said on my show, like if, if GPT4-0 had been GPT-5, the narrative right now would be, oh, we've reached our ceiling. There's a gating function to what this technology can do right now.
Starting point is 00:06:20 And that would have reverberations towards everything, towards the investments that people are making to, from Microsoft to VCs to whatever. And just what you mean when you dropped in our doc this sentence that you said, the degree, the basically waiting for GPT5 is freezing the market. Is it basically because people are like saying we have these certain capabilities? Now we can do things with those capabilities, cool things with those capabilities. But we don't know how much further to go in until we see that step change improvement. that is GPD5. Exactly. Well, I mean that in a very basic level, which is there are a lot of startups out there
Starting point is 00:06:56 that are essentially glorified wrappers around OpenAI APIs. And so when they release the new model, if all the work that you've done for your image creating bot, your chap, whatever, suddenly looks, if GPD5 is a 10x or 100x in terms of capabilities, then all the work that you've been doing around the previous APIs might be obviously. But it's also freezing the market because if open AI continues to be the gold standard, people are waiting to see will this, remember the step change that we saw from GPT2 to GP3 and then especially three to four. And so people are are trying to get a sense of will that happen again? Will when GPT5 comes out, will it basically be like take the chessboard and throw it up in the air and start fresh? So I said it's freezing the market for investment, but also for people thinking about it strategically, because if open AI is still, as most people believe, state of the art, cutting edge, the best practitioner of this with the best tech and the most money behind it, people are waiting to see what the leader can do. Now, conversely, let's go in the opposite direction. If this is right and they're a year out, then this is the window for an anthropic or somebody else to do.
Starting point is 00:08:19 essentially release their version of GPT5 or what GPT5 could be. So while I'm saying that this is freezing the market, it also could be opening up a window of opportunity for OpenAI competitors. Yeah, all the breadcrumbs that we get also suggest that whatever's coming down the road for them, their next generation model, Open AI, they believe that it's going to be big. And this is from the information. Altman and his colleagues also believe that the newest large language model OpenAI is training will far surpass, far surpass the best LLM it sells today, putting to rest the growing
Starting point is 00:08:54 questions in the industry about whether the technology has hit a plateau. What do you think when you hear that? I hear that as a good competitive stance, keeping everybody sort of on their toes, sort of uneven. Because on the one hand, you know, Sam Altman will say to startup founders, like, don't do anything that is just a rapper because our technology is going to get so good. that it's it's going to blow anything like that away now that is contradicted by the fact that a part of their business is selling their APIs to people to do things to it so if if you are a founder in the AI space if you're an investor in the AI space imagine the fact that on one hand you know open AI and Sam outman have said from day one we're going after a GI we're going after
Starting point is 00:09:40 a computer that can meet and exceed anything a human mind can do in that case we don't know what the business case is because like does that mean that the computer takes over the world and tells us how to run it better? Or do you sell that for people that, you see what I'm saying? So they are right now sort of straddling the fence of, hey, we're allowing you to do all these things. Let a thousand flowers bloom, create your startup around our APIs and things like that. But also, meanwhile, stick with us because when the next version comes out,
Starting point is 00:10:10 it's going to blow everyone else out of the water and maybe all these startups are meaningless. So bottom line, your prediction on GPD-5, you think most likely, sometime in 2025. I'll give you 50-50 that it would happen before the end of this year and then 50-50 that it would happen in Q1 of next year. I mean, come on, Brian, you can't go 50-50 that it's going to happen this year or next year. I'm giving you those are solid tangible, those are tangible numbers. There's it may, it's like basically your probability on that on that line is that okay. I'll go 40, 43.
Starting point is 00:10:48 by the end of this year and then yeah that will accept okay okay so most likely sometime next year i think it'll be next year yeah yeah in the meantime there are already some near-term concerns that opening i is going to have to deal with and maybe near-term breakthroughs and big partnerships that we're going to see before we ever get to gpt5 and the first one of those is going to be this big partnership with Apple that we're bound to see in WWDC, which is in, I guess, a week from Monday. So this is really coming close. And we're going to talk a little bit about what we know already about WWDC. But first, the very fact that OpenAI took $13 billion from Microsoft and is now doing
Starting point is 00:11:34 this partnership with Apple is already, I don't know if you want to say, raising alarm bells within Redmond and the Microsoft headquarters. but it certainly seems like Microsoft is curious about it, and I think they'd be within their rights to sort of want to know what's going on. And there's this information story. The headline is OpenAI CEO cements control as he secures the Apple deal,
Starting point is 00:11:57 which is about Sam Altman, but there's a little detail buried kind of deep in the story that actually seems to be the most interesting news nugget of it all. Here it is. The Apple deal could complicate Altman's relationship with OpenAI's most important business partner, Microsoft. Altman recently met with Microsoft CEO, Satya and Adela, to discuss Microsoft's concerns about how the Apple deal might affect the cloud software giant's own product ambitions,
Starting point is 00:12:23 and the two executives discussed the servers Microsoft would need to handle Apple's use of open AI services. I mean, that is a very extraordinary type of meeting where Satya is, I mean, obviously Microsoft and Apple are they're much more sympathetic than they've been in the past, like the jobs and the Gates era where they were at each other's necks. But it sounds fascinating that Sadia is like, how many of my servers do I need to give to make Apple a more valuable company? And aren't you supposed to be our more aligned product team? So that's, that's sort of the original sin of this partnership. Is that the right analogy? Like the original, the original sin of like Open AI itself, the weirdness of Microsoft investing in Open AI was that it was sort of a nonprofit
Starting point is 00:13:10 that has moved to for-profit, and as we're hearing whispers, it's going to move 100% to for-profit. But from Microsoft's perspective, the original sin here is that they can't acquire open AI, right? So if in a different regulatory environment, or if this were 10 years ago, look at what Microsoft has done. They have essentially gone all in on AI. They are putting AI into all of their most important products from Excel to Teams to Windows 11 itself to, you name it. And so they're basically making it a core component of all of their most important product, most important product lines. There was a day-long Microsoft outage recently where you couldn't use things like Teams and the AI within Word, the co-pilots and things like that, because the Microsoft APIs are down.
Starting point is 00:14:09 So think of how core these things have suddenly become to most of their most important product lines. Microsoft naturally would want to own that technology. If it is going to become, Microsoft is the most valuable company in the world now because essentially investors have given them credit for being AI first and maybe the most ahead of the Big Seven or whatever in terms of AI. And also because they're the most natural company. to apply this technology and sort of this business sense. What I'm saying, though, is like, you know, meta's trying to apply AI inside their family of apps, right?
Starting point is 00:14:48 But they own their own AI technology. Google, obviously, is trying to integrate into everything, but they also own their own stuff. So the original sin is that Microsoft, if this is core technology to them, they want to own it. Now, we've seen them signaling that they have not put all of their. eggs in the Sam Altman basket, right? They've invested in other Open AI competitors. They're, you know, in their earnings reports, they're talking about their CAPEX spending going up because, you know, we're theorizing that they're training their own. They're even, they are training. They are training their own. Like, they have them training huge models. Great. So my
Starting point is 00:15:28 question to you is now, and by the way, before we even get to that, don't forget the weird chaos around Open A.I. Where they got blind. What weird chaos, Brian? That's in the past. They got blindsided by Sam Altman's ouster. I don't imagine that they're thrilled with some of the weirdness like around Scarlett Johansson and like the, you know, you went down the list of weird things that happened over the last two weeks. So it's clear that Microsoft is hedging their bets, right? But what I'm also saying is what would you, okay, you give me the odds on how tight this
Starting point is 00:16:02 relationship between Microsoft and Open AI would be five years from now. I don't think Microsoft would ever divest themselves of their investment, but five years from now, will they not need Open AI? And Sam's not, he wasn't born yesterday, he knows that. In a way, the partnership between Microsoft and Open AI is sort of like what Apple's doing right now with Open AI, which is our own technology is not good enough. We know we need to launch AI chatbot something that is sophisticated enough now. And then three years from now, five years from now, when our tech is good enough, we don't need them. Right. So that's essentially what Microsoft has done from day one. So what you give me the odds of Microsoft and Open AI five years from now being as tightly
Starting point is 00:16:48 partnered as they are right now. Well, Brian, I'll have you know I'm rewatching the wire. And what the guy's name, the detective Lester tells you to follow the money and not the drugs. And so I'll just follow the money here. And we know. that Microsoft gave open AI $13 billion. We think that a lot of that was either, you know, server credits or potentially just plowed right back into Azure to train and deploy models. And we know that OpenAI is reported to be on schedule to make about $2 billion this year in revenue. Okay. So that's the money picture for Open AI. In comes Apple. Apple says OpenAI, basically we want to plug you into our operating system. And how much is that deal going to be
Starting point is 00:17:31 worth to Open AI. It could be worth, this is from the information, it could be worth billions of dollars to the startup if it goes well. Not a billion, billions. Billions, yeah. That's their entire revenue. I mean, let's say it's even two billions. That's their entire revenue this year. And that's right now. What what Sam and Open AI want is they essentially want to maybe not replace the Google search deal that Apple has had for 20 years, where Apple makes $20 billion. I Obviously, they don't want to pay Apple $20 billion. It's the opposite. They're going to get paid by Apple to do this.
Starting point is 00:18:06 Exactly. So in a way, if they could replace Google by being searched, Open AI is imagining five years from now. They're making $5, $10 billion a year from Apple because they are fulfilling all of these functions that include the sort of autonomous agents, the assistant, the searching and summarizing the web, and all that stuff.
Starting point is 00:18:29 Exactly. So I think that like it's good for, honestly, look, it's good for both Open AI and for Microsoft to diversify here. It's good for Open AI to have multiple partners because it's more sustainable that way and it's sort of really able to chart its own future in a way that it wants if it's not reliant on just one company. And frankly, it's good for Microsoft because it allows it to, you know, both rely on a partnership with Open AI, but also if it's developing and building internally, we know that they have Mustafa Soleim on there working on consumers. products now, right? Like it gives Microsoft greater control over how this technology integrates with its products and greater insulation from whatever, you know, potential chaos might ensue at a partner, although you would imagine that open AI is a lot more stable now than it was previously. And one last thing. One last thing here. We also know that the priorities of Open AI and
Starting point is 00:19:23 Microsoft might be different, right? Right. Opening I think at its heart, still a research house, right? And I was on air on CNBC this week. I was talking about how chat GPT is still only at 100 million users. That's the number that it hit two months after launch. But ultimately, like, I don't think that that is like the live or die for them. It's about the technology. Whereas Microsoft was pushing open AI after the Sam Altman, this is a report we have in the financial times,
Starting point is 00:19:51 that Microsoft was pushing open AI after the Sam Altman blow up to be more focused on commercial products. So if that's what Microsoft wants, by building these capabilities in-house, Microsoft is able to get that. And then also, let's say, you know, Open AI comes up with, like, some massive research breakthrough. And let's say they actually are training GPT6 now. It's just like freaking human-level intelligence. Like Microsoft will be able to benefit from that. So that's my perspective on this.
Starting point is 00:20:19 Yeah, except that I think that Open AI is incentivized right now. Again, these are two extremely cany operators who, this is not their first. Rodeo. Open AI is incentivized now because they know they can see the strategic angles here. Microsoft wants to have control over this core technology. They can't buy open AI, so they're going to try to build it in-house so no one can stop them from doing it. So open AI is incentivized now to go product. You said, well, they're still more focused on the research. I don't think that's necessarily true. I think that the path for open AI to stay strong and independent is to productize themselves, which would run contrary to Microsoft running to productize themselves as well.
Starting point is 00:21:05 This is extremely reductive. But in a sense, you can think of this as I've always said that AI is trying to make the Star Trek computer a product, which is you don't have to know anything. It's like the shift from the command line to the GUI. Computing is not having to know, I got to go to this app, I got to go to this website, I got to type in these forms. The AI just does it for you. The first person to productize that, whether it be in Excel, whether it be inside of Instagram, whether it be inside Google search or your Google Docs or whatever, that they imagine that that is
Starting point is 00:21:43 people will pay, you know, tens and maybe hundreds of dollars a month for that, you know, per seat and enterprise per person and consumer. So open AI in that. In that, if you look at it through that lens is actually weak because they have to build their own brand you know there was there was a story this week that i think that they just signed up price waterhouse cooper's or pwc as you're supposed to call them now uh to the tune of of thousands and thousands of seats well so they have to do that from a standing start like if you take that reductive lens of who's going to be the first one to productize um essentially having a butler that a computer butler that does everything for you um They would have to do that without a platform of their own and, you know, sign up for a chat GBT
Starting point is 00:22:30 account and pay us per month and that sort of thing. Yes, but that's why these partnerships are so important to them. And that's why they really do win with these multiple partnerships because they can create that for Microsoft and they're going to create it for Apple at WWDC. I'm saying for the long term, that doesn't work for anyone. Long term, five years out, Apple does not want to be using open AI. They want to be using their own stuff. I'd suggest. that's also true for Microsoft, and I'm suggesting that's true for Open AI. They know that, and so they need to plow their own sort of path here to be competitive five years out. When Microsoft hired Suleiman. And that's why they might be a research house, because they ultimately will have
Starting point is 00:23:12 to keep advancing the status quo in order to be able to maintain these deals. Because if they just had stuff on, it was easy to replicate on par with everybody, then they would be out already. when when Microsoft Aqua hired even though technically they didn't to get around again the competitive landscape or the regulatory landscape
Starting point is 00:23:30 hiring Suleyman was the biggest signal that hey by the way Sam we don't need you forever but Suleiman is just consumer products and he was also building a failing company so true but they hired somebody that can be the vision like I'm not
Starting point is 00:23:48 one of these people that denigrates or says that Sam Haltman hasn't achieved a lot of stuff, but he's not a product guy necessarily. He's not an engineer. He's also not a researcher. I don't know, Brian. I mean, whatever you want to call him,
Starting point is 00:24:04 he's the guy whose company who is running underneath him took this technology that was built within Google and everybody had access to and actually built the product. Not only that, and has the state of the art research underneath him that nobody else can equal. has, as we saw with the attempted coup,
Starting point is 00:24:23 the backing of some of the most talented people in the AI field. So again, I'm not denigrating Sam Elman at all. He's clearly the caniest operator in the space as it exists right now. And he brought the space to the forefront. So he deserves all the credit for that in the world. Yeah, but OK, so let's talk about a little bit
Starting point is 00:24:39 about why opening eye is going to be in sort of why they're going to win in the near term for sure. Even though I agree with you, there's vulnerability. I've been talking about on the show for a while. But I also think this Apple partnership might really change the game for Open AI in a way that I'm just starting to appreciate because it seems like Apple is going all the way in. And there was always a question of like, what was Apple going to do? So previous reports, this is from Mark German in Bloomberg. So previous reports had Apple preparing a bunch of different features like voice memo transcriptions and summaries and recaps of websites and notifications and automated message replies and advanced photo editing.
Starting point is 00:25:20 and AI generated emojis. Okay, all that to me, total snooze. But the report this week really brings into focus about how big Apple is going to go in on this, right? So this is from German again. Apple plans AI-based Siri overhaul to control individual app functions. Now, the second part of that headline is really important. It's not about information retrieval like your traditional chat GPT.
Starting point is 00:25:46 It's actually giving control of the app over to Siri. and here over yeah well basically allowing you to control the app with Siri not letting the a i control it for you but here's the story from german apple inc is planning to overhaul Siri and move that will let users control individual app functions with their voice the new system will allow Siri to take command of all the features within apps for the first time that change okay it required a revamp of series underlying software we know this okay here is an example at the start Siri will handle one command at a time but apple has plans to allow users to chain commands together.
Starting point is 00:26:21 For example, I'm 100% certain this is gonna be the hero demo at WWDC, and by my certainty is probably, you know, just me being overconfident reading this, but it sounds likely, okay? He says, for example, you can ask Siri to summarize a recorded meeting and then text it to a colleague and run request. Or an iPhone could theoretically be asked to crop a picture
Starting point is 00:26:43 and then email it to a friend. Right, so you don't have to say, and then open it in, in a photo, photos and then crop it you just you just like like Picard says in Star Trek it's like you know computer enhance and it just does it right it is also what the Rabbit R1 suggested was it was trying to do although whether it was successful doing that is obviously hugely debatable but imagine that you want to book a flight and you don't have like once you give it access to your Expedia account and your your Gmail and your whatever you just say book a flight for next
Starting point is 00:27:17 Wednesday to Seattle. And that's it. It just does it and maybe you give it the price parameter, but you don't have to tell it. Open this app, do that. The access to the system level is what's key here. And that's what people and some of the papers that have been released by Apple research suggest that they're going in this direction. The idea is that at the OS level, the AI will have the ability to do stuff for you, to execute commands. multi-level commands with things that would take different steps. That's why I say it's similar to the moving from the command line to the GUI, where as opposed to having to know how to, in a command way,
Starting point is 00:28:02 tell the computer what to do, you clicked icons and you did drop-down menus. If you need to plan a vacation now or do a doctor's appointment, you know that you as the human have to go into this account, go to that website, use this app, check. this account, you know, all that stuff is obviated by, if the AI has the ability to execute at the OS level on your behalf, then it is Picard saying computer enhance without having to say, go to Adobe and then enhance 30%. You just say enhance more, enhance more. That's what we're, that's what Apple is suggesting. Okay. So let's just, as we end this segment, just kind of do like
Starting point is 00:28:45 a little scorecard here. So we think Open AI is going to come out of this this next year stronger i i'm going to i'm going to put a i'm going to 50 percent stronger 50 percent weaker brian i still think that there is there's the there's a possibility that people are underwhelmed by w wdc what happens then if if the demos are not wow gee whiz enough um not only is apple's stock price in trouble but um like opening i could should still come out of this looking good. But more than, I was saying to someone just this past weekend, more than any other WWDC that I can remember for a decade, I don't know where this is going to land. So yeah, there's your 50-50 again. I don't know what the odds are that they're
Starting point is 00:29:32 going to have an iPhone moment where it's like, I didn't even know that was possible versus, oh, a slightly smarter Siri. I do think that WWDC is going to be very impressive, mostly because it has to be for both of these companies for open AI to yeah to be able to continue to push forward I mean opening I will be fine if it releases GPT5 and it's like a godlike AI or not even that but just like another step forward and what we were seeing and I mean app but Apple does need this I think they really do and I'm not rooting for this because I love to be wowed I live for iPhone moments where the the possibilities and the vistas are pushed forward but if people come If two weeks from now, people are underwhelmed and that's what you're talking about on the show.
Starting point is 00:30:16 Remember, I said that there's a real possibility here that they don't hit the mark. Well, I mean, they were able to make the Vision Pro look cool in an era where, like, mixed reality. That has missed the mark. Yes. I mean, it looked cool, and people talked about it for three weeks. Exactly. So, I mean, these are two companies that really can do excellent marketing. And they often have products to back it up.
Starting point is 00:30:38 But not all of them hit in the long run. Okay, I want to talk about Microsoft real quick, you know, in terms of, terms of like wrapping up where things are going. What's your sense as to like the uptake on the co-pilots? Because that's some of the feedback I've been getting is that like, okay, Microsoft, because you mentioned, okay, Microsoft, the most valuable company in the world. Yes, by it, by a good deal, actually. It's predicated on their ability to be first in AI and a lot of their ability to
Starting point is 00:31:05 productize this stuff and put it into office and Excel and all these things. Are you getting a sense that people are actually using these co-pilots? Is this enthusiasm for Microsoft sustainable in terms of being able to be traced back to actual usage? For Microsoft specifically, I can't speak to, but I'll use, I'll broaden it out to tell you what I, you know, in the end, the promise of AI and AGI is that the computers are smarter than us, so they make smarter decisions and we leave the decision making to them. where the state of the art is right now is essentially getting rid of the busy work of the you know instead of taking 90 minutes to create a a slideshow presentation just do it in five and you know tweak it um i'm seeing that uptake in a lot of places where there's busy work to be done uh law uh the the the uptake that i have seen anecdotally just from companies that i'm aware of
Starting point is 00:32:09 startups and things like that as an example going through you know case files depositions things like that things that you hire people to spend hours weeks months years to do like that so i would extrapolate onto that that first of all i hear all the time from developers that yeah i'll never develop without a co-pilot again it is creeping into things like law like health care like education, if you're a teacher and you can use it to do lesson planning, do IEPs and things like that. And you've got, you know, troves of paperwork and things like that. So I, I'm answering your question by saying, I bet Microsoft is seeing uptake in it. We know this because they continue to double down on every product they're putting into. I'm saying anecdotally, I believe it too,
Starting point is 00:32:59 because anything that is wrote mind numbing work can be replaced or, or not replaced with a co-pilot, but made less terrible by a co-pilot. So yes, I think that Microsoft is perfectly positioned for that. Before we go to break, we should talk a little bit about the fact that Helen Toner and Tasha Kali, just who were the two OpenAI board members who sort of sparked the firing of Sam Altman. They actually said why they fired him this week. And again, they basically said little. So I didn't want to dedicate too much time here because it's been like the same sort of like he was not consistently candid like come on like actually like this it sort of seems like it was just a power struggle the more they talk um but this is just from the ft that toner
Starting point is 00:33:50 uh it's summarizing what she said on the ted ai show uh she said that he missed that sam misled the board of multiple occasions about its safety process for years she says sam had made it really difficult for the board to actually do its job by withholding information misrepresenting things that were happening at the company and in some cases outright lying to the board. I mean, one example that she gave was that the board didn't know chat GPT was coming until they found out about it on Twitter. How do you read this? Is this more concerning than I'm starting to think it is?
Starting point is 00:34:23 Yeah, I think so, but this comes back to my disagreement with you that they are still research-based. I think that the fundamental disagreement within OpenAI is there were a ton of people when it was founded in, you know, 2015, 2016. I can't remember what year it was exactly. They basically got the best and the brightest of the entire academic space, right? And they essentially said, the whole premise was we're going to do this independently because this is too important for any big tech behemoth to own, for any one company to own.
Starting point is 00:35:01 So you have, I don't know what the percentage would be of the company at one point, maybe not now because a lot of those people have left, as we know, who believed in that as an academic and research mission. The Helen Toners of the world probably can't give us like more tangible examples of when specifically Sam Altman was talking out of both sides of his mouth to people. That seems to be what they're suggesting for various, you know, legal reasons. They probably can't give you tangible examples. My read is the fundamental problem here is that a certain percentage of the company bought into it being a research company and not a product company and that either Sam falls on the it's going to become a product company side or
Starting point is 00:35:49 he's trying to play both sides as long as he can because it would in it would help open AI to go down parallel tracks as long as it can before it has to make a decision and and so that suggests what essentially if you read between the lines the board has always said is you're telling me one thing, and then I heard you told somebody else the exact opposite. Right. All right. My point here is that it has no choice but to be both research and product, but, and I guess for us, it's like what leads? You're saying product leads. I'm saying research leads. And then there are people that want to get off that train if it's not the train that they wanted to be on. That's true. Yeah. We also got an email from OpenAI last week talking about their. alignment work so they actually i don't think they have a super alignment team but they
Starting point is 00:36:40 do have a team is dead but they they do have an alignment team spinning up a new one or something like john shulman who's their co-founder is taking on an expanded profile a portfolio as the head of alignment science and they say it's a priority for open a i and the company expects this investment to increase over time so that's what they tell me we'll see yeah okay i'm sorry before we go to break one more thing which just is just an amazing detail with this Apple situation. This is from the information's report. In wooing Apple, Altman had to overcome skeptics
Starting point is 00:37:13 within the iPhone maker. Some Apple executives have long had an aversion to chatbots, especially its head of machine learning, John Gendra, who, by the way, came over from Google. In early 2023, after ChatGPT exploded in popularity, he told staff in an internal all-hand meeting. And this is after, I assume, presumably he's tried Chat-GPT, chat chipped he said the last thing people needed was another chatbot I mean come on well that
Starting point is 00:37:39 maybe explains why Siri has been this stuck in in the mud for Lord Almighty I mean what it was going on there all right there's somebody who thinks the world does need one more chatbot and that's Elon Musk we'll talk about his six billion dollar fundraise and what he plans to do with xAI on the other side of this break again we're here with Brian McCullough he's the host of the tech meme ride home podcast which you can listen to every weekday where Brian will give you a great recap of what's going on in the world of tech recommended one of our favorite shows and also before we go to break this is going to be another one of our episodes where we're collaborating with Techmeme you'll be able to see it on
Starting point is 00:38:17 the home page of TechMeme and I wanted to thank TechMeme for showcasing the podcast on its homepage it's my go-to site for finding out what's happening in the tech world as it's happening found a lot of stories for this week's show on TechMeme and then went in and read and I think you're going to find great value from it too so that's TechMeme all right elon musk's six billion dollar fundraising coming up right after the break hey everyone let me tell you about the hustle daily show a podcast filled with business tech news and original stories to keep you in the loop on what's trending more than two million professionals read the hustle's daily email for its irreverent and informative takes on business and tech news now they have a daily podcast called
Starting point is 00:38:56 the hustle daily show where their team of writers break down the biggest business headlines in 15 minutes or lists and explain why you should care about them. So search for the Hustled Daily Show and your favorite podcast app like the one you're using right now. And we're back here on big technology podcast with Brian McCullough. He's the host of the TechMeme Ride Home podcast and the partner of the TechMeme of the Ride Home Fund and another fund that's AI focused. What's the name of that fund, Brian? The Ride Home AI Fund. And specifically I need to specify the funds are not related to TechMeme. The Ride Home Fund is a separate brand. color production it's a brian mccullough production yes are you going to invest or let's say this so
Starting point is 00:39:37 elon you know what i'm going to ask already elin yes i do invested six billion i sorry raised six billion uh from sequoia and dreason horwitz and others okay would you have invested in that musk xa i okay i have some real inside baseball for you which i have mentioned this on my show um i was offered that daily so you you often When you're an investor, people learn you're an investor and you get offered things often secondaries from a company that's raising it's B round or it's C round. And so somebody got a hold of an early employee that's trying to unload a million shares. And what they do is they spin up a special purpose vehicle and they offer it to people that have funds like me. And they say,
Starting point is 00:40:28 do you want X number of shares of this company that's going to do a C round or whatever? Very rarely has, I mean, it's not like this is the late stage round of XAI, but I was offered this by a lot of people I've worked with in the past and people that I had never heard of. This was all over the place. And I'm not casting aspersions here. I don't necessarily know what that means. but Alex I could have gotten you an allocation in this if you wanted like this was shopped around a lot at the at the right home funds we passed on it because we're an early stage fund
Starting point is 00:41:10 and so you know we investing above a 10 billion dollar valuation is not necessarily the waters that we fish in just for the how okay works out on our thing let's say you weren't would you have put the money in I mean did it look like a good and investable opportunity for you I think I still would have passed why because I think that the the value proposition here is Elon Musk and then that that he has Twitter you know everybody is concerned about where am I going to get high quality data this week Vox and and the Atlantic signed deals I think the Dow Jones signed a big and these are big deals and maybe we'll talk about about that again in a second. But why did they go to the Atlantic? Because the Atlantic has been published since like 1843 or something like that, right? So you have high quality stuff going back forever. Is Twitter high quality? Now, Open AI has paid Reddit. Is Reddit high quality? I don't know. What I'm saying is, is if the value proposition is Elon Musk, that's interesting to me,
Starting point is 00:42:23 except for the fact that he seems to be distracted by so many things. I mean, the guy did also co-found Open AI. Did, yes. So also that makes me a little nervous. Is this a revenge job or whatever? But I would have passed on it because I don't know that just training it on Twitter is enough. And then I would make the argument that people are behind. they are starting behind now they have raised more money than croesus to obviously catch up
Starting point is 00:42:54 they're going to buy as much as nVIDIA will give them in terms of the compute that they need to do this um but i just would have passed for that reason now forget about me um what do you think that the larger move here is because obviously you know andri san and Saudi Arabia and like big blue chip names clearly believe in this as a play, do you think that if Microsoft is going to do it? Open AI's here. Google's doing it. Met is doing it. Anthropic, this one, that one, is there room for another one? Like, I've, I've discussed before, is there a commoditization in the sense that there were 20 different search engines before Google came in and killed them all? Yeah, I mean, why not, right? Like,
Starting point is 00:43:41 if there's room for two, there's room for, you know, seven, I guess. Maybe not, but Maybe not, but you're right. Look, I think that, that here's my perspective on it. So first of all, we do have some information about how they're gonna play it. So first of all, they're gonna spend a lot of this money on compute. And Musk has said he's, and this is from the information,
Starting point is 00:44:01 he wants to build a gigafactory of compute. And that XAI is gonna need 100,000 specialized semiconductors to train and run the next version of AI GROC. He is saying that, okay, in the May presentation to investors, Musk said he wants to get the supercomputer running by the fall of 2025 and will hold himself personally responsible for delivering it on time when completed the connected groups of chips, Nvidia's H100 units, will be at least four times the size of the biggest GPU clusters that exist today. So I think the question is like, if improvement is going to come from brute forcing these models with more compute and more data, Elon Musk can get that compute, he can get the data, right, from Twitter or wherever he figures it out and common crawl, whatever, might be. So, so it seems like he's, he might, he will probably be able to catch up if his computer is going to be four X size. Then the question comes down to will, will you end up with technique that
Starting point is 00:45:03 helps you get better beyond size? And everybody's going to make a bet on technique. And I think that like venture capitalists, you know, they could put money in and lose. And that's okay, right? But they, they bet on the chance that this can win and is there a chance that they can have like the right technique that helps push this forward i think it's it's at least a probability a possibility i don't know if it's likely but it's possible and also like the one wildcard is and i know that it's probably not going to happen but elin musk was able to recruit ilias at skever to open ai once can he recruit him again can he recruit somebody with his level of talent to come do it and become like the the chief scientist at XAI, I think it's possible.
Starting point is 00:45:49 And if that happens, all bets are off. I had Nat Friedman, the AI investing extraordinaire. There's nobody that is a more prominent personal investor in AI right now than Net Freeman, ex-CEO of GitHub. And he very strongly believes, because we asked him, like, can the biggest model, will the biggest model always win, which is a little, there's fudging around the edges. But essentially the question is, the most compute, the most data, will that always win?
Starting point is 00:46:23 And he was like, so far, I haven't seen anything that suggests otherwise. The more compute you throw at it, the more high quality data you throw at it, the better it can be. So yes, there is a, there's a philosophical debate right now versus what you call technique, what we call terroir, which is like, yeah, but do you just, want gpt six to be reading x-ray scans or do you want a specialized model that is trained on medical stuff and x-ray scans because maybe that would be better possibly Elon agrees with nat and is like look just go big because until we see proof otherwise big is continuing to win here it would be interesting you know speaking of the compute like you know um Sam Altman you know
Starting point is 00:47:14 The story was he wants to raise $8 trillion or whatever it was to create... Seven trillion, man. Yeah. I mean, come on. Well, listen, I dream bigger than even... I know. No, he joked, why not eight, I think. Right, right.
Starting point is 00:47:27 So, like, let's say that the pitch that I got for XAI was that, which maybe it is, then that's more interesting to me because if they're right and then building these superclusters is what's going to matter. then that's more interesting. But I would have passed because I don't know where it's going to go. Other people smarter than me are fine with, listen, it's Elon, so we don't, we're in, and we'll see. Yeah, well, Larry Ellison is certainly happy because he's going to be, yeah, he's going to be making
Starting point is 00:48:07 some money licensing his Oracle servers out to make this happen. we got an interesting comment actually here so general foundational models will be commoditized and the value will be captured in vertical specific models trained on private data and my uh michel or michael whatever um that is the debate because on the one hand that is part of the thesis that i'm investing in which is um verticals and what i'm calling terroir in in the wine sense where what you train it on and how you do the the knobs and levers of the of the of the way and things like that will make things better. But again, like Nat Friedman, 100% believes that that's not true
Starting point is 00:48:49 and that the bigger, beefier model has until proven otherwise, continues to beat even the most specialized models. Yeah, and maybe he's making a bet on both with this giga, what did he call it, a giga computer, gigas, anyway. Gig a gigafactory of compute. It's actually excellent branding. He's nothing if not consistent. He held on to the X.com domain name for 25 years before he could finally.
Starting point is 00:49:17 And everything is giga. Yes. Yeah. All right. Before we leave, I want to talk quickly about this. Oh, so first of all, I should tease. We talked a little bit about these deals that Vox and the Atlantic have made with Open AI and whether the news industry can survive AI and whether these are advised or not.
Starting point is 00:49:34 Big story this week, obviously, like in the media sense, on Wednesday, Ben's Smith and Naima Raza, who I just started this new podcast called Mix Signals. They're coming on with Joe Marquesi, who's a venture capitalist, and we're going to talk all about whether these deals are advisable or not. And it's going to be fun because Ben and I were both at BuzzFeed. And obviously, BuzzFeed made some deals with Facebook and Twitter and thinking it would be good to, you know, distribute the content. And that didn't work out exactly as planned.
Starting point is 00:50:02 So that's coming Wednesday on the podcast. But let's, before we end, talk just briefly about this loneliness article. because it was very interesting. So the Wall Street Journal had this story talking about how in the age of remote work, American workers, really workers around the world, I think, are getting way more lonely. And they had some wild stats.
Starting point is 00:50:23 So they said, I couldn't believe this, Brian. More than 40% of fully remote workers pulled in a 2023 survey of working parents said they go days without leaving the house. Those who work in office spend nearly a quarter of their time in virtual meetings and face-to-face meetings account for only 8% of their time. Also, this is crazy.
Starting point is 00:50:45 Americans in particular have tripled the time spent in meetings since 2020. And let's see, 68% said they knew their coworkers on a personal level down from 79% five years ago. Are we under appreciating the impact that this era of remote work is going to have on people in terms of just making them lonelier than ever before. And, you know, we're both, like, I think we're both remote entrepreneurs. Like, do you feel this at all in your life? I'm curious what you think about this. I have never worked in an office.
Starting point is 00:51:18 Like, I have an office, but it's a we work-like situation, so it's just me. I've never, you have, you worked in newsrooms and things like that. I've never had that. But my first company, I found it in 1999, was all the workers were remote distributed. So what I would say about this is it's not for everyone, but that's the point maybe that this data is revealing is that if you were someone who went to college to get a certain degree to do a certain type of work and I'm not saying that people pursued careers to work in offices and cubicles that, you know, people have have bemoan that for as long as cubicles. and things like that have been around. And then like look at the movie, the apartment from the,
Starting point is 00:52:08 is it the late 50s or early 60s? Like the office has always kind of seemed a little dehumanizing to certain people. But if you're not prepared for the fact that like, you can hear my dog flapping his ears over there, you, if you work from home and you're not used to that as being your sort of, yeah, that's why I right by a window that's why like it's a different skill set so let's say that you were someone
Starting point is 00:52:39 that worked in an office for 10 years and especially in silicon valley where you're used to the perks and the the the free lunch and the the gym membership and all that stuff like i can see that this is you would be like this is not what i signed up for i think what i'm saying is um it's it's not for everyone there are a lot of people that i know that that prefer it you mean i don't have to give up two hours of my day for a commute awesome Yeah. But yeah, I can see how people would feel a little rug pulled by being like, this is not what I signed up for. And what's with all the meetings, Brian? Can we end this podcast getting together and finding a place of agreement that the meetings are becoming too much? Like I said, the meetings, let's see. Okay, here it is. Paradoxically, meetings can make people feel lonelier. And even so if the meetings are virtual, a 2023 survey by employees.
Starting point is 00:53:34 by employee experience and at least company perceptics found that people who described themselves as very lonely very lonely tend to have heavier meeting loads than they're less lonely staffers so more than 40% of these people spend more than half their work hours in meetings and right this is the stat again that Americans have tripled the time they spent in meetings can't this meeting just be an email I mean you're right maybe AI can solve it for us by having our like co-pilot show up in meetings, but it's absolutely astounding to me how meetings have multiplied the way that they have since 2020. The hotness of the moment in the AI space is autonomous agents, the amount of startups that I've seen that are like, have our AI agent attend the meeting for you.
Starting point is 00:54:23 It can answer questions on your behalf because it's been trained on your email so it knows what your action items are. You can also prompt it ahead of time. And then, so you So you don't have to attend and it will give you a readout afterwards so that it'll be like sort of like getting the inbox zero at the end of the day. All of those eight meetings that you had today, you didn't actually have to attend. We can also get to a place where you train an avatar on yourself. So maybe people don't know that Brian didn't attend. So maybe AI is going to solve that for us. I think that people hated meetings and the joke was before COVID times.
Starting point is 00:55:00 like couldn't this have been an email but like scheduling an in-person meeting was always harder than being like just click on Zoom so I can see that COVID times and remote work has just made maybe calendarly a little bit has yeah yes yes as well calendar links maybe they're causing more meetings well Brian it taken away the friction of doing meetings is only made meetings multiply like cockroaches I know but I do like calendar Anyway, I'm with you. Less meetings, more time in person. If you're working remotely and you've been in the house for multiple days on end, please walk out of the house now. Please take these headphones off and walk out of the house and go feel the sun on your face. And I was going to argue the opposite. I was going to argue the opposite. This is what keeps podcasters and business is the fact that since we're all by ourselves all the time that we have these asynchronous friends that are our. our podcasting buddies that we feel like we know even though we've never let me try that again brian if you are at home and you haven't gone out of the house in multiple days keep your headphones
Starting point is 00:56:10 in walk outside of the back catalog of feel the sound on your face big technology to every one of these podcasts listen to all the tech me right home podcasts go to a local coffee shop and say hey keep your ear but believe i haven't told you about this podcast that i love and then you will feel happy yeah and that is our message so kumbaya less meetings more an interaction. Lots of fun AI news coming up in the next few weeks. We'll be here to cover it. Brian is going to be there to cover it. You can listen to his show TechMeme Ride a Home podcast on your podcast app of choice. You can listen to our show, Big Technology podcast on your podcast app of choice, indoors, outdoors. It's your decision. On Wednesday, we'll be back with Ben
Starting point is 00:56:50 Smith, Naima Raza, and Joe Marquesi talking about the implications of all of these AI companies and news organizations doing deals with each other. Until then, I hope you have a great couple of days and we'll see you next time on big technology podcast

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.