TBPN - Grok Deep Dive, 200,000 GPU's in Memphis, There's No Moat?, Time is Money, Tell Me a Joke

Episode Date: February 18, 2025

TBPN.com is made possible by:Ramp - https://ramp.comEight Sleep - https://eightsleep.com/tbpnWander - https://wander.com/tbpnPublic - https://public.comAdQuick - https://adquick.comBezel - ht...tps://getbezel.comPolymarket - https://polymarket.comFollow TBPN: https://TBPN.comhttps://x.com/tbpnhttps://podcasts.apple.com/us/podcast/technology-brothers/id1772360235https://youtube.com/@technologybrotherspod?si=lpk53xTE9WBEcIjV

Transcript
Discussion (0)
Starting point is 00:00:00 Welcome to Technology Brothers, the number one live show in tech. Jordi lock in because we are live from the Temple of Technology, the Fortress of Finance, the Capital of Capital. That's right. Today is Tuesday, February 18th, 2025, and this show starts now. We got a great show for you guys. We got a GROC 3 deep dive. We're breaking it down.
Starting point is 00:00:21 I got early access. I ran the same deep research prompt through Open AI deep research and through GROC. We're going to break down each analysis. and the prompt I used is about AI and how these LLMs are progressing and some benchmarking stuff. So it'll be a good educational experience for you, and you'll also get to make your own call on which one you think is better. But you've got to play with these to understand them. We've got a ton of other stuff.
Starting point is 00:00:47 There's a deep dive in the Wall Street Journal about how Elon Musk and Sam Altman, kind of their relationship soured. We'll be putting that in the truth zone if there's any untruths in there. And it's also a massive launch day because our boy, Alexander Carp, his book is officially live. Let's go. The Doctor. The Technological Republic, hard power, soft power, and the future of the West. It's available now.
Starting point is 00:01:12 If you pre-ordered it, it should be on your doorstep soon. It's available on Audible. And we highly recommend it. We're big fans of Carp over here at TBPN. And so let's kick it off with Groch 3. I got access, I think, on Sunday. I had it do the first prompt, which was tell me a joke. Make sure it's actually funny, original, and insightful.
Starting point is 00:01:36 My favorite comedians are Shane Gillis, Norm MacDonald, etc. Structure the joke like an actual stand-up set, not like a knock-knock joke or a basic question-answer type joke. And so here's what Grock said. You couldn't have been more clear. Couldn't have been more clear. And let's see if AI is taking my job as a comedian news podcaster, tech analyst, venture capitalist. Word sell.
Starting point is 00:01:56 Word's up. Grock says, you ever notice how AI is supposed to take over the world, but it's still out here struggling to understand my mom's accent when she yells at Siri? Like, we're all worried about SkyNet, but meanwhile, Siri's over here going, I'm sorry, I didn't catch that. Did you say turn on the lights or burn down the house? And it's not just Siri, right? All these tech bros are like, AI is going to replace your job, man. But I'm like, bro, AI can't even replace my family. fantasy football lineup without benching Patrick Mahomes for a kicker. Meanwhile, I'm getting texts for my buddy who's a product manager and his Apple Watch is like meeting starting and he's sprinting across the office like he's running the Dakar rally. AI's not taken over the world. It's too busy trying to figure out if we're asking for a weather report or confessing to a crime. By the time it gets there, we'll all be living on the moon anyway, probably because some founder convinced us it's the next big VC flex. It's so,
Starting point is 00:02:59 so this is so jarring to listen to because it sounds like, like it's structured in a way that it should be funny. Yeah. But it's just completely not. Yeah. And so your, your brain is sort of like yearning for a singer. Yep.
Starting point is 00:03:12 And it just never comes. Yep. You're perpetually in the state of, of like, hoping you're going to hear that sweet note. Yeah. Exactly. And it just doesn't come.
Starting point is 00:03:23 But I do think the, You know, obviously the benchmarks for GROC 3 are incredible. We'll go into all that. There's a lot of good stuff in here. I think what's interesting about this is that GROC 3, clearly this is trained on my feed because in my last 10 tweets, I posted, DeCarr Raleigh, Patrick Mahomes. I also posted something about in here, I said, product manager and the Apple Watch. Remember that post?
Starting point is 00:03:53 Yep. You actually fed that one to me. And so it clearly took that text in and said, okay, this user, this person who's prompting me likes Apple Watches and product managers and we'll get those jokes maybe. But it didn't really integrate it properly in an interesting way. And I was texting with one of the XAI guys and was like, this is really interesting. Like I don't know if I like this, but I think this could be really cool for certain prompts. And it could make it so that, sure, sometimes I want a vanilla like.
Starting point is 00:04:25 clean LLM installation where I come to it. It doesn't know anything about me. And I give it a really robust prompt and it doesn't assume anything. And then other times I'm going to want it to really know, oh, this guy's like super in-group in this particular niche. He's down the rabbit hole on this. So all of a sudden, if I'm explaining, you know, like VC fun dynamics, I can be super jargony and super and super in-group and super detailed.
Starting point is 00:04:49 But then if I'm explaining like oiling gas to this guy, He doesn't know anything about oil exploration. So I got to keep that high level. That's actually a benefit to me. And that would be really cool. So I think fine-tuning the models on the individual person's timeline, whatever you can get information about them, that could be very cool. But in this case, it was very, very silly.
Starting point is 00:05:10 It's so funny to have this many things that are aligned to the stuff that you post about and botch it this hard. I'm getting text from my buddy who's a product manager and his Apple Watch is like meeting starting. Because you posted about the, you posted the White Lotus reference of the product manager. And he's sprinting across the office like he's running the Dakar rally. Like it just doesn't combine it all. How does that, yeah, how does that go with AI supposed to take over the world? Like, yeah, I don't, I don't get it.
Starting point is 00:05:39 Anyway, GROC 3, I don't think there is a good comedy evel. No, it's that right now. So we're not even benchmarking. We talked about this before we came online. The evels are hyper-fixated on these sort of ultra-complexed. problems and they clearly massively struggle on like a comedy eval, right? Like that would like somebody should make the comedy eval. 100% that basically says I asked, you know, all these foundation models to make various
Starting point is 00:06:06 types of jokes. This is the funniest joke. I tested it against real humans to see if they laugh. Exactly. And so that's a totally valid way to test a model because being able to produce jokes is a, you know, there's sort of comedic intelligence. Totally. Totally. Totally. And so it's not just about solving these sort of esoteric problems that nobody thinks about all day long. I think that GROC could potentially get the most extreme product market fit. And what this, like, specific response tells me they're going towards is they want to have, like, the current thing happen. And then somebody be able to generate a post that's hyper-relevant to what they talk about for that specific moment in time.
Starting point is 00:06:49 And in many ways, when the timeline is just model on model, on model, that will be like some form of, you know, comedic general intelligence. Yeah, we were joking about X potentially setting up the at chat handle. I just saw Mike Solana posted chat. What's going on with these airplanes? And just saying like, hey, chat, like, is this real? Chat is this real? Is like a common online internet phrase these days? And so I could definitely see. GROC be instantiated as a as a player character or an NPC on X in a way that it could interact with a lot of posts or or be someone that's integrated. It's also interesting looking at the XAI launch stream looking at what Elon was pushing the engineers on. So he's like, okay, we have we have this breakthrough. We have the cutting edge LLM. When are we going to solve Riemann? He's talking about the Riemann hypothesis, which is the kind of like the hardest mathematical problem that we haven't, the humanity hasn't solved yet. And the, and the XAI engineer is kind of
Starting point is 00:07:54 joking, well, as long as we have a random string generator, like something that just randomly generates words, and then a validator and enough compute time, you should just be able to brute force it. And they're kind of joking around. But it's very clear that they are focused on fundamental math, fundamental physics, breakthroughs in science and technology. And that's just a completely different vector of optimization against comedy. Anyway, let's move on to Ben Thompson, who already posted an update breaking down grok three let's talk about the the actual launch of grok three because i'm just sitting there hammering through some emails last night and i'm actually watching pmf or pmf or die and i hear patty in the cage be like yo the grok three announcements going up and and they just kind of haphazardly
Starting point is 00:08:38 throw up this live stream yeah and then just like sit there with one camera yeah and it was it was it's kind of cool and that it's authentic they're not overly fixated on production value or anything like that There's been a number of sort of model releases that were structured. You know, open, open AI is continuously drilling into people's heads. We are the Apple of AI. Yeah, more product focused. Product focused, but also just like the production value of like their presentations are at a different level. And so anyways, I thought it was fascinating that they just had one camera, showed up,
Starting point is 00:09:09 streamed it, you know, basically bounced. It was no bells and whistles. And so cool approach. Similar to safe super intelligence, which is basically saying like, We're not even going to release products until we have AGI, which we'll get to. Yeah, yeah. Yeah, I mean, the whole AI landscape is fascinating. The model layer is commoditizing, but there are so many different product strategies on top of the, on top of the models.
Starting point is 00:09:35 And it's very cool to see that XAI is just, you know, forking, delivering straight into X. Yeah, I love that. So, Ben Thompson and Stretcary, highly recommend that you subscribe. He kicks off of the quote from Bloomberg. he says XAI showed off the updated GROC 3 model. They call it the smartest AI on Earth across math, science and coding benchmarks, GROC 3 beats, Google Gemini, Deepseek V3, Anthropic Claw, and GPT's 40. They said they announced this during a live stream Monday. GROC 3 has more than 10 times the compute power of its predecessor and completed pre-training in early January.
Starting point is 00:10:12 Musk said the presentation alongside three XAI engineers were continually improving the models every day. It's literally within 24 hours. You'll see improvements. And that's true. They are, they're really rolling out stuff very, very, very quickly. They also introduced a smart search engine, which I tested. And interestingly, you don't need to click a button to trigger it. It's just, it's just like if it thinks that you want, you know, some deep research, it just goes and does it. It's called deep search. It's a reasoning chatbot that expresses its process and of understanding a query and how it plans its response. And we'll take you through one of the results from GROC 3's deep search product.
Starting point is 00:10:51 And then they also intend to release a voice-based chat bot as soon as possible. So Ben Thompson writes, GROC 3 appears to be one of, if not the best performing base model in the world. It is topping the usual benchmarks, but not if you include 03, which is interesting. That was not in the bar charts, which we'll get to. And tops all categories, the highest score in LM Arena. Obviously, we're XAI fans, X fans here, GROC fans. but the sort of selective positioning of new models against models, like definitely needs to be called out
Starting point is 00:11:25 because people just sort of decide, all right, who are we going to sort of compare ourselves to in this very moment? Yeah. Because everybody just wants to show, you know. Yeah. I mean, honestly, like there's so many different vectors because 03 can be very compute intensive. Then there's O3 mini. Then there's O3 mini. Then there's O3 mini high.
Starting point is 00:11:44 And so, you know, there's this big like value tradeoff. between yeah if you let the if you let the LLM reason for hours and you spend $2,000 per query you can get remarkable results but then yeah is that really a fair benchmark against something that costs a dollar in France 10 cents and so all of a sudden you need to plot these on like an x and y graph and then eventually you need to plot them on some sort of like yeah unintelligible tensor graph or something anyway let's go to andre carpathy the absolute dog who is not a fair observer because he's worked with Elon but he's also worked at open AI so maybe he's a little bit more, a little bit more fair than most people think. I really enjoy his analysis.
Starting point is 00:12:24 He says, the impression overall I got here, I got here is that this is somewhere around O1 Pro capability and ahead of DeepSeek R1, though, of course, we need actual real evaluations to look at. The impression I get of Deep Search is that it's approximately around perplexity's deep research offering, which is great, but not at the level of Open AIs recently released Deep Research, which still feels more thorough and reliable. And I found that deep research is just a lot of better at spitting out 5,000 words. Most of the other products spit out a thousand words. And so you just get more out of deep research.
Starting point is 00:12:54 Which is what you want from deep research. Usually. You're not looking for, you know, perfectly summarized, you know, handful of paragraphs. Exactly. The entire point is to let you kind of figure out what's important. So Carpathie goes on. He says, as far as a quick vibe check over two hours this morning,
Starting point is 00:13:12 GROC 3 plus thinking feels somewhere around the state of the art territory of Open AI's strongest models, 01 Pro for $200 a month, and slightly better than Deepseek R1 and Gemini 2.0 Flash thinking, which is quite incredible considering that the team started from scratch one year ago. This time scale to state-of-the-art territory is unprecedented, and that is undeniable. This gets at the first GROC3 takeaway. It's simultaneously surprising and not surprising. Start with the latter. XAI famously built a 100,000 GPU cluster in Memphis and now has 200,000 GPUs and used 20,000 of them to train GROC3. And so they're still built. thing, the larger cluster. So even though you'll see a lot of people posting on the timeline,
Starting point is 00:13:51 oh, you know, GROC 3, 100,000 GPUs, that's not accurate. They, they only use 20,000 for this, but it's still impressive. Yeah. And just to highlight again, this is the largest cluster ever, the 20,000, 20,000 GPUs. That's not true. The 100,000 is the largest ever. I believe. So he's saying the largest ever for XAI or the largest ever for any foundation model? I don't know. I asked I asked both chat GPT and grok to pull this. Groc uh, groc says GPT4 use 25K GPUs, while GROC3 used 20,000 GPUs. Now chat GPT says that, uh, that GPT4 was just thousands 20K GPUs A100s. So it seems like around 20, 20, 25K has been the top to date. It's honestly unclear from these.
Starting point is 00:14:43 But clearly Elon knows that he's just he's just willing to sprint towards these big, big numbers as fast as humanly possible. 100%. And so, and sure, it resulted in a top tier model. That's not surprising given it is what scaling laws predicted. But it is comforting as there was a question as to scaling, as to whether scaling laws had hit a wall. And people were saying this during the deep seek kind of fiasco. What is surprising is that XAI is only 19 months old. The company has gone from incorporation to the largest GPU cluster in the world to arguably the best model in less time than it has taken OpenAI to go from GPT4 to GPD5, albeit with substantial updates along the way, including the big 40 update just this past weekend.
Starting point is 00:15:34 It's both the testament to Elon Musk and his team, Jess Gas, Jensen, CEO of Nvidia, Jensen Wong. So to me, to me this tells that our read on the Elon bid, which was only last week, it feels like a month ago at this point. Yeah. But Elon bidding $100 billion to buy some, you know, not entirely known amount of Open AI means that he believes he either was purely doing that as out of spite to toss like a wrench into that process or he believes that the product layer is what actually matters because he's able to achieve incredible performance purely at the model layer. but even as Carpathie's saying, the product layer is not there yet. And certainly GROC has nowhere near the real consumer usage that Open AI does. Yeah. It's interesting.
Starting point is 00:16:26 So he goes into competitive implications. He says, I did get access to GROC 3, but not the thinking and search models. I actually don't know if I have access to the thinking and search models. It's unclear to me from a product perspective. And he has to say that he finds himself using GROC 2 quite a bit, almost entirely. via its integration into the X app. It turns out being plugged into a pre-existing distribution channel is very useful.
Starting point is 00:16:49 And this is a crazy bullcase for Elon buying X. But the challenge is that X is a very specific type of audience that is not necessarily reflective of certainly not the LinkedIn audience. Sure. Like you could argue that OpenAI should go do a deal with LinkedIn and say like make us your default LLM and just distribute us to like the normy masses. because long term it's going to be more important to be there.
Starting point is 00:17:16 Yeah, yeah. He also says, I also never use it anywhere else. For me, product matters, and chat GPT remains my product of choice. I feel the exact same way. I'm also curious to what extent chat GPT deep researches advantage over other competitors like Google, perplexity and now XAI, are due simply to 03, still being the best model versus OpenAI spending more time crafting a better tool. Regardless, the impetus for OpenAI to focus on being a consumer tech company is as
Starting point is 00:17:42 strong as ever. Open AI is the only AI lab to have organically built its own distribution channel and they really, really need to get an advertising product out the door to ensure they are serving free customers the best possible models, which makes perfect sense. This also explains why. That has to be pending this quarter potential. I'm sure they're building it right now. Yeah. And there's just a question of do they use Microsoft as the partner there? I believe Netflix was considering that as well because Microsoft has a really big ad network from LinkedIn and from and from from Bing, even though you don't think of them as a big advertising company.
Starting point is 00:18:16 They built all the algorithms and all the structure and all the inventory and so. Certainly not gonna be meta. Yeah. And so this also explains why OpenAI is tying up with Oracle and SoftBank and trying to become a for-profit. XAI raised $6 billion last November and actually owns its GPUs.
Starting point is 00:18:33 Musk also said on the live stream that XAI is building out a one million GPU cluster. Let's go. Size gone for the one million cluster. Boom. Let's get that in the hand of your spot. We got to get this more down. Actually, we need a button to hit on the set.
Starting point is 00:18:50 We have that. To the size guy. No, no, it raises the gone. It's hilarious. And then, of course, he ties it to Ilius Sutskever in Bloomberg. Is raising more than $1 billion for his startup at a valuation of over $30 billion. We'll talk about this later in the show. Volting the nascent venture into the ranks of the world's most valuable private technology
Starting point is 00:19:12 companies. Green Oaks is in. They're putting in 500 mil. So the person who asked not to be identified. Green Oaks is also an investor in AI company's scale and data bricks. The round marks a significant valuation from the $5 billion that Scriber's company was worth before. First off, a disclaimer, Daniel Gross, a frequent stratakery interview guest is the CEO of SSI. I never realized. I didn't know that. Is that breaking? Are we scooping? Are we scooping Ben's scoop right now? We got it cool with the scoos. It's too much. People get. get confused. No, I think this was like, I think this was actually publicized like very early on.
Starting point is 00:19:47 Interesting. That's, that Ilya wanted to be the technical lead more than anything else. That's cool. But that's very cool. Because DG, you know he's going, you know, he, you know, he seems like for everything I've seen just extremely, extremely motivated to win and be in the most important places constantly. Yeah. It's funny. He also had an accelerator.
Starting point is 00:20:08 Yeah. Sam had an accelerator, small accelerator called Y Combinator. So the accelerator to foundation model pipeline is very real. You know the other path, the counterfactual, the path not traveled here. Daniel Gross, sold the company Apple in AI, got acquired, should have, should have, you know, taken over the CEO role. Yeah, yeah, yeah. This is something we advocate here on the show.
Starting point is 00:20:31 If you get your company aquired, start asking the CEO, hey, what's the succession plan? Yeah. How can I get in the, how can I get in the board? Hang out outside of the board meetings. Yeah. Try to flag people down. It'll only take four quarters. to get a little time with like the key players and then from there you know just start you know it's
Starting point is 00:20:47 it's such an underrated strategy right now I think I think like there there's massive value in being a founder and actually going in and turning for the top job going for the top job it sounds too ambitious to be true but I think someone will eventually do it and we'll all be like yeah it's amazing yeah a lot of a lot of founders end up getting aqua hired and then are not super happy with the leadership at the company yeah and then they're just become the leadership instead of and it sounds like a lot of like a joke, but it's not. It's actually a better path than just like resting, investing. And then you're like, oh, what do I want to do next? I'll have to do the same company or like become a V-C and you're kind of lost. Instead of like, wait, I just got acquired by a company that does the same
Starting point is 00:21:24 thing that I was doing, but they have a thousand times more resources. Yeah. The only problem here is that I'm not in charge. What if I was in charge? Yeah. Solve that problem. Yeah. Anyway, that's my little stump speech. And so they have pledged, this is wild about SSI. So they have pledged not to release a product until it has achieved a safe super intelligence. So you're going to raise so much money. Well, XAI explains why. It is absolutely viable to have started late, provided you have the funds, catch up quickly. And of course, SSI's talent speaks for itself. SSI is also, I would imagine a big Nvidia customer. Again, I don't know that to be true, but what else might the money be going towards? Which brings this conversation back to chips. On one hand,
Starting point is 00:22:03 chips remain the gating factor to the easiest route to a frontier model. On the other hand, this is why deep seek matters. They're not the only route to something that is at least competitive. The debate on the value of an attempted export ban remains an open one. Anyway, fantastic article. Absolutely. I totally respect SSI saying we're not going to ship until we have, we've achieved our goal, which is like the kind of approach you can only really take if you're Ilya and like Daniel Gross, where you're basically saying, yes, we're going to need to raise billions of dollars. you're going to just have to trust us that we're going to and just like bet on us that we're going to deliver that one of the things that every foundation like the war the foundation model wars right now which will be studied eventually because it's creating this sort of foundational technology that presumably our entire society will be dependent on at some point it is so distracting for these companies and the teams and the investors when there's new models releasing every week and you can imagine everybody everybody at end. Anthropic last night was watching the GROC demo live not working.
Starting point is 00:23:10 Everybody at OpenAI was doing the same thing, right? So it's just wildly distracting to constantly be forced to ship and ship and ship. Yep. When you can tell that they're able to make incredible progress internally without even getting user feedback, right? Yeah, yeah. Elon's basically saying, hey, I just need another $20 billion and I'm going to make a much better model. Yeah. Yeah, sure.
Starting point is 00:23:33 will make it available through the XAI X integration. But Elon wants to solve the Riemann hypothesis. He is the customer and he has his e-val. And once it solves the Riemann hypothesis, he'll be happy. And that's kind of it, which is fascinating. I think another hot take that we were discussing earlier was there's this big push around like the model layer is commoditizing. And people say that as like a bare case.
Starting point is 00:23:57 Yeah. But I was wondering if you flip it around like people make tons of money in commodities all the time, right? Like oil, big oil. Like, oil is a commodity. Still worth producing oil. It's hugely valuable. There were massive companies built on it. There were small companies that just did little exploration and just had a little plot of land, but a little track. You know, actual infrastructure technology providers. And so I wonder if there's a world where, you know, intelligence is is so valuable and LLMs and AI is so valuable that, you know, yeah, even if you're like the sixth best model, you can still sell the intelligence if it's at the frontier level to the market at
Starting point is 00:24:35 a market clearing price that still generates profit above what the NVIDIA GPUs cost. And you still reap the reward and the $30 billion valuation is completely justified in the same sense that, you know, hey, yeah, if you, you know, you're like, hey, I got a plot of land in Texas that I'm going to pull some oil out of. Yeah, you don't have a monopoly on all of oil. Yeah. But you still made money. Yeah. And so I wonder if that's how old plan. The, you know, If LLMs, you know, replace a lot of work broadly, knowledge work specifically, it's easy to say, hey, these are trillion-dollar markets that we're playing in. Yeah.
Starting point is 00:25:09 It makes total sense that there's five to 10 companies that are going to raise billions of dollars to go after that, right? Because the prize is so great. Yep. Potential prize is so great that, you know, Elia raising at 30, you know, and Daniel Gross raising at 30 billion posts is actually, you know, it's, it's, it's, it's, maybe it's it's it's it's it's it's just ends up looking like a great investment of like how do you potentially get a you know 50x on on on a multi-billion dollar check like maybe that's how you
Starting point is 00:25:42 it is so crazy when you think about it that way like when you think about like crypto it's like a big new technology it a lot of people are into it it's just like a cool thing and yeah the market cap of all the crypto combined is around a trillion dollars social networking also like very valuable cool new technology market cap round a trillion dollars phones cool new technology market cap around a trillion dollars electric cars cool new technology market cap around a trillion dollars you know operating systems uh Microsoft round a trillion dollars cloud computing there's a round a trillion dollars of value and so it's like how in what world does AI and LLMs not wind up being around a trillion dollars of value I get that like it could go any direction and like how you slice that up it could be very
Starting point is 00:26:27 equal. It could be one winner take all and you know, hey, people are going to have their bull case for X or bull case for their open AI, anthropic, whoever. But, you know, it just feels like the stakes are definitely one trillion, right? Yeah. If we look out in the future, even if we're, even if we're not being like super, super intelligence pilled and we're just thinking about like, yeah, like this is a new technology and it will be a consumer market or an enterprise market or any of them. Like, will there be an opportunity to make a bunch of money? Probably. Yeah. So, Anyway, let's move on to Yaxine. He is working for Elon over at X, a good friend of the show.
Starting point is 00:27:05 He has been, he's become a bit of an open AI hater. But let's hear him out and see. We got some poster on poster violence here because this is clearly a ruin caricature or the same exact character and, you know, dancing around the data center. And so he's arguing that there's no moat with this. he says moats are silicon valley head cannon wishful thinking they need to exist they need it to exist they make you believe that you're doing the thing that would be impossible for others all to justify the fundraise when they say moat what they're saying is proprietary monopoly i'm here to tell you that
Starting point is 00:27:44 the monopoly is a myth the proprietary monopoly simply does not exist open i could open source all their models and it wouldn't really harm their business existence you would only harm their ability to fundraise. Everyone should take Peter Thiel more seriously, just be different. I mean, what a poster. I mean, he's layering on a bunch of things that people could potentially disagree with in the first few paragraphs, which positions him well to then extrapolate on all those ideas now that people are kind of riled up a little bit. Totally. So he says, is Capital a moat? In previous times, capital was a moat. But as technology progresses, everything becomes cheaper. Skill, labor are now being automated. Levels I.O.10M valued companies, order magnitude $10 million
Starting point is 00:28:28 valued companies, spawning them every three months for fun. He doesn't need to raise. I like that. We got to put levels in the cage, by the way. He would just, he would crush it. He'd be out in a day. Yeah. Especially with the latest code gen slop spitting out PHP server code. It's free. It's free. The software I produce for myself on a daily basis would have taken a team of engineers. Now, it's one hour in between work and dinner. It's post-scarcity. It's unprecedented. Yep. We are at the point where the idea that capital as a moat is not being sold by the people who need the funds. Instead, the idea is being pushed by the people with the sad, sad
Starting point is 00:29:05 capital that has nowhere to go. What is the point of money when legions of engineers who actually just slow you down? When you really only need 8x, H-100, and two frogs to create outsized impact. Your real competitor is the end user writing their own software. I used to work at Oth Otho. We shipped login as a service. It sold itself. Many Seattle homes were paid off by sales commissions of Otho contracts.
Starting point is 00:29:33 It wasn't OCTA. It wasn't Ping 1. Our biggest competitor was our customer themselves writing their own login page. We had to sell them on it not being a good way to spend their time. So he breaks down the serious AGI players. this is personal opinion open AI nah remember Yahoo
Starting point is 00:29:49 okay yeah Xene we know we know who you're who you're pushing for here the serious players vertical robotics manufacturers and mujuko shops I don't know what that means midi JCP Unitri Tesla Anderral Deepseek Jane Street Palantier social media platforms meta
Starting point is 00:30:07 vertical AI companies XAI deep seek Google are your ML researchers wearing knee pads and a sweaty tank top plugging in Ethernet. If yes, you're going to make it. Eath Zurich, I will not elaborate. Distributed, decentralized AI. Bootstrap companies with a lot of freedom, people building novel devices.
Starting point is 00:30:27 Interesting. What can't be easily replicated? Software used to cost money and AI is just software. There is a limit on individual model intelligence that yields diminishing returns. And it is my belief that we will rapidly exhaust any room available. It is my belief that AGI will run on consumer hardware, and any proprietary models will only be run as convenience. What can't be easily replaced is knees on the ground, soldering irons, and the Majoko-R-L sauce, and God-like product managers yearning invest accordingly.
Starting point is 00:30:59 This is financial advice for billionaires. This feels like it feels like basically 40 posts combined into one article. Yeah, yeah, yeah, yeah. But one thing that's interesting, so when we were talking earlier about intelligence being commodified, and some people saying, oh, it's not investable. It's a commodity, if it's a commodity, especially at these prices, you're saying, hey, commodities actually are very valuable. There's a ridiculous amount of demand for them.
Starting point is 00:31:25 The hard part, what he's outlining here is that, you know, everybody knows that there's a big market for oil. Like, you can see what the price is. If you can get a barrel of oil out of the ground, you can sell it at this sort of market clearing price for that grade of oil, right? There's like, you know, oil that turns into jet fuel and whatever. whatever, but there's like, it's a commodity, it's sort of priced in the open market. There's fully a world where intelligence gets to that point, too.
Starting point is 00:31:50 And then the challenge is what Yassine is saying, which is here with AI, it's like, what can't be easily replicated is knees on the ground, soldering irons, et cetera, et and so the same thing with oil. It's like the challenge with getting oil out of the ground is you got to get oil out of the ground, right? You need dudes with trucks to go drill for oil and then make sure the drill is. running properly make sure you have water make sure you have power you know the the the the drill is breaking all the time and and so uh it doesn't seem like data centers will maybe be
Starting point is 00:32:22 that at as much of a challenge to keep operational but it's certainly uh it's certainly not easy to operate these things highly efficiently right yeah interesting i don't know yeah if it's a commodity where where is the most valuable part of the commodity um is it is the producer and this like the supplier producer. Yeah, but is that energy? Is that Nvidia or is that the LLM deliverer? Right. It's an open
Starting point is 00:32:51 question. Anyway, let's move on to some reactions on the timeline and then we'll give you a breakdown of GROC 3 versus Open AI deep research. So creatine cycle, who's been on the show before says, sorry, autizmos, it's time to grow some arms and social skills. And Jordy chimes in says
Starting point is 00:33:07 getting diced continues to be underpriced. And he says, printing this out and hanging it on my wall in Pack Heights. And he just shows the GROC 3 reasoning data. It beat 03 mini high. Beta reasoning beta. Some people were upset about this. Rex, two slides later says they omitted 03 from the chart and the live stream for some
Starting point is 00:33:30 reason. So I added the numbers for you. And then, but this was reasonable because 03 isn't public and those benchmarks can't be verified yet. So I think it's understandable that they did. didn't include it. But then again, GROC 3 with reasoning isn't publicly available. So people can't validate that e-vail. So there's a lot of like questions over like what counts for an eval that goes on a chart. I think they both have, you know, fair arguments there. Yeah. They're like,
Starting point is 00:33:57 we can validate what our model does. Yeah, yeah, yeah. We can't validate what you're doing because it's not available. So we know. Yep, yep, yep, yep. We cooked. Yeah. And so, uh, uh, uh, Sheel Monot gives a little context on the Grot Colossus. 200,000 GPUs in Memphis, Tennessee, built in 214 days. I think semi-analysis and Dylan Patel have done a deeper dive here that we'll have to dig into. There's some really fascinating things going on here. Shield says, why Memphis? They found an old Electrolux factory, added trailers to add cooling, one quarter of the cooling capacity of the U.S.
Starting point is 00:34:34 And trailers for power generation, they use Tesla megapacks to smooth out power fluctuations. The next training cluster will go from a quarter gigawatt to 1.2 gigawatts using Gb-200s from Nvidia. There's a fascinating thing that leaked because of Lama. When meta open-source Lama 3 or some piece of that, they had a line or like a function, a piece of code in the training data that basically said like, what was it? It was like power plant not blow up. And so basically what it does is, is when you're training, you're doing all this complex math that's using a lot of electricity.
Starting point is 00:35:17 Yeah. And then all of a sudden, there'll be like moments where you're maybe just like, okay, we're done doing the math. We're going to like save the model for a second. And so all of a sudden your power will just drop to zero. Yeah. And if the power like substation or the power plant is sending tons of electricity and then all of a sudden it doesn't get anything. It can blow up or something like that or it can be bad. And so they built them like a special piece of code that basically just has it does random math.
Starting point is 00:35:47 Can you imagine the reason that that got implemented? Yeah. Oh, yeah. These engineers are just like, you know, just tapping away, you know, vibe coding. And then they just get a call. Hey. It's like, hey, like, what are you guys doing? Yeah.
Starting point is 00:36:03 Yeah. I mean, it would be crazy if there was like a major power. Yeah. Yeah, and so just going back to the Colossus, the cluster in Memphis, this was always in many ways. I think we talked about this last year. The bull case for Elon building a foundation model company was that he has the boots on the ground experience to spin up heavy infrastructure manufacturing facilities, you know, figuring out how to manufacture batteries at scale for Tesla in the United States. And so having the playbook and being able to pull talent from, you know, a company like Tesla or specifically. SpaceX and say, hey, we need to build this data center in 214 days.
Starting point is 00:36:41 Like, unbelievable. Yeah. Like many people would say, you know, even, you know, linking this back to L.A., people are not going to have their homes rebuilt for four years. That's crazy. They did this. They built it. They built the biggest, you know, cluster ever in 214 days.
Starting point is 00:36:56 That's a great point. Where they just found an old factory and said, we're just doing this right now. Yeah. And so that's really Elon's like edge here for sure. Yeah. No. And it, and it is so part of the culture at Tesla. the I mean they're making millions of starlings so the CTO at deterrence yeah
Starting point is 00:37:13 was at Tesla specifically working on their battery cell engineering and so he's just bringing that just crazy ethos around his name's Henry around speed yeah and it's just amazing to witness that's awesome so yeah let's move on to word grammar word grammar says I'm feeling very similar to how I felt six months ago opening I did something groundbreaking now two other labs have replicated it soon the rest will follow making it a pretty undifferentiated market. Yeah, we've we've talked about this a little bit. I mean, it's it's unclear like if open AI had not launched deep research and like the reasoning model would deep seek have been able to come up with it? Like is the idea valuable or is it just a
Starting point is 00:37:54 or or is everyone kind of on the same path? What do you think? It's interesting. Everything because everybody's competing against many of the same benchmarks to show that they're competitive. They're all focusing on getting better at many of the same things when what we really want, and which is why SSI is interesting, is they're basically saying we're not going to release anything publicly until it's what we want it to be. So we're not going to build based around these benchmarks. And so I actually think the competition is good and bad. It's like a double-edged sword, right?
Starting point is 00:38:30 It's good in that it's sort of pushing the pace and everybody's motivated to, to rapidly improve these models. But at the same time, it's not so great because we're getting models that consistently just look more and more and more like each other. Yep. And consumers are not even going to be able to notice the difference. So they're just going to probably default to what they already use and love. Or maybe you're using grok in the X, but not elsewhere.
Starting point is 00:38:54 Well, here's an interesting twist on that. So Paul Calcraft says, Elon posted an early Groch three screenshot saying he, asked what Grog 3 thought of the information and it said it's garbage. And then Paul Colcraft asked the same question, what's your opinion on the information? And it told him it's a solid outlet. And you know what's going on here. It's fine tuning on the person who queries it their timeline. And so Grock 3, when Elon prompts it, it knows Elon doesn't like the information. let's give him an answer that confirms what he believes. And it's the same thing for Paul Calcraft.
Starting point is 00:39:35 And so this is going to raise a very interesting question where people will kind of be in like LLM echo chambers almost, where they're like, oh yeah, I asked the LLM and it told me that, you know, microplastics aren't a big deal because I've been posting about that. Or microplastics are the worst thing ever because I've been posting about that. Yeah, and this is exactly what already happens on X broadly. Exactly. echo chamber is so real, where you just sort of, you know,
Starting point is 00:40:02 for me, I'll see somebody, I'll see very like offhand, you know, randomly somebody will have like a blue sky in their profile. Yeah. And I'm like, oh,
Starting point is 00:40:11 I haven't seen that in a while. Yeah, yeah. But someone else is seeing that constantly. Oh yeah. And they're probably using blue sky. They're like, oh yeah,
Starting point is 00:40:19 everybody I love uses blue sky. Yeah. Right. Yeah. It's very interesting. And you know what's going to happen here is that, the mainstream media is going to do these tests where they go. You know what they did on like, you know,
Starting point is 00:40:33 TikTok and Instagram where they'd be like, I followed a bunch of Nazi content and then it gave me more Nazi content. And so it's like a Nazi algorithm. They'll probably do the same thing where they'll go into these LLMs, talk to it for a really long time, essentially fine tune it on the idea that like they're crazy. And then it'll be like, it gave me crazy responses. And it's like, yeah, I get it.
Starting point is 00:40:53 It probably shouldn't do that. But at the same time, like you really like, twisted its arm and it's not doing that for most people. So I don't really have that much of a problem with it as long as there's like some guidelines here and like it's directionally like it doesn't automatically steer you towards some negative echo chamber. Anyway, word grammar has another banger post here. On a roll. Richard Sutton's bitter lesson died January 22 with Deepseek and it was born again on February 17 less than a month. So this is of course about scaling laws and Rich Sutton's bitter lesson, which we'll get into, of course, the idea that algorithms,
Starting point is 00:41:31 while important, are not as important as scaling and compute power. So scale is all you need. Let's go to another post from Liron Shapira. He says, people in 2022, Elon can't actually keep these servers online. Elon now, the bonus tab in the app makes you, takes you to the highest benchmark frontier model. And so, yeah, real narrative violation for everyone that said, Elon, wasn't going to be able to keep ax or twitter like online he's like not only doing that the reason the reason that you know it wasn't an issue is i don't have a memory of wanting to use twitter and or x
Starting point is 00:42:08 and not being able to and i think i would really i would remember that for my whole life yeah such a such a daily habit if you're going on there and just nothing was was loading um it's uh yeah he he really mogged everybody that that was calling him out on that yeah Yeah, well, Andre Carpathie shared more evals because he got access to GROC 3. He says, on thinking, GROC clearly has an around state-of-the-art thinking model, the think button, and did great out-of-the-box on my Settlers of Caton question, which is create a board game web page showing a hex grid, just like in the game Settlers of Caton. Each hex grid is numbered one to N, where N is the total number of hex tiles.
Starting point is 00:42:52 Make it generic so one can change the number of rings using a slide. For example, Catan, the radius is three hexes. Single HTML page, please. Pretty good. Few models get this reliably right. The top open AI thinking models, O1 Pro, get it two, but all of Deepseek R1, Gemini 2.0 flash thinking, and Claude do not.
Starting point is 00:43:12 It did not solve his emoji mystery question, where he gave it a smiling face with an attached message hidden inside Unicode variation selectors, even when I gave it a strong hint on how to decode it, in the form of rust code. This is like such a, I don't know if I could solve that, Andre. I'm sorry. That is a very complicated e-val, but it makes sense, I guess, and probably valuable.
Starting point is 00:43:37 It should break that eventually. The most progress I've seen from this is Deepseek R1, which once partially decoded the message. It solved a few tick-tac toe boards. He gave it with nice, clean chain of thought. I uploaded the GP2 paper. I asked it a bunch of simple look-up questions. All worked great. And so he has a whole bunch of evals that he can kind of rip through.
Starting point is 00:43:55 that's a really cool way to do it. It's like, you know, do some web programming, build a website, like to solve Tic-Tac-T-O, you know, decode this mystery, do this riddle. And then he also asks, about an hour, I'm assuming. What? Yeah, exactly. He said he played with it for like two hours. And so he did the same thing with deep search. He asked, what's with the upcoming Apple launch? Any rumors? And he liked the answer there. Why is Palantir stock surging recently? He gave it a check. White Lotus season three, where was it filmed? And is it the same team as seasons one and two? What toothpaste does Brian Johnson use? It didn't get Singles Inferno, season four cast, and where are they now?
Starting point is 00:44:30 Which I don't even know what Inferno is, but Singles Inferno? I guess that's a show he watches, which I love. And then what Speeds to Text program has Simon Wilson mentioned he's using? So he says, I did find some sharp edges here. The model doesn't seem to like to reference X as a source by default. Interesting. Though you can explicitly ask it to. A few times I caught it hallucinating URLs that don't exist.
Starting point is 00:44:52 A few times it said factual. things that I think are incorrect and it didn't provide a citation. It told me Kim Jong-Su is still dating Kim Min-Soole of Singles Inferno season four, which surely is totally off, right? This is hilarious. Andre, are you into Singles Inferno? I need to get up on this. This is good stuff. The impression I get of deep search is that it's approximately around where perplexity deep research offering, which is great, but not yet at the level of deep research. Random LLM gotchas. Sadly, the model's sense of humor does not seem to be obviously improved. This is a common LLM issue with humor capability and general mode collapse.
Starting point is 00:45:31 Famously, 90% of the 1,000 outputs asking chat GPT for a joke were repetitions of the same 25 jokes. Crazy. Got them dead to rights. GPT5, you're on notice. You better be funny. Even when prompted in more detail away from simple pun territory example, give me a stand-up. I'm not sure that it is state of the art humor example generated joke Why did the chicken join a band because it had the drumsticks and wanted to be a cluck star
Starting point is 00:46:05 That's a that's a real knee-slapper They're they're honestly the jokes that are so bad that sometimes they're very funny because it's just like wow It will be it will be amazing to when they do get to the point because I think everybody can see that we will you know, the general belief is that we'll get there. Yeah. But like think about having a comedian in your pocket that knows what you think is funny. And it's basically somebody will make a rapper app that's just a big button that you, the laugh button that you press.
Starting point is 00:46:38 Yeah. It just generates a new joke. It just gets better and better. And it even hears your response to it. So it starts to learn on. Yeah. That would be really good training to it actually. Yeah.
Starting point is 00:46:48 Yeah. They could do that. Okay. So let's move on to GROC 3 and Open AI Deep Research. I got your analysis there. So I went to both GROC 3 and Open AI Deep Research, and I asked it this really, really long prompt. I said, I'd like you to build me a definitive table of LLM models and break down their
Starting point is 00:47:07 evolution, specifically their relative sizes. So I want to know, you know, GROC3 came out. It uses 20K GPUs. I'm not exactly sure how many flops that is, but I would like to put all of these in the same terms like they're all an equivalent number of flops. I want to know the progression of GPT 1 to 2 to 3 to 4 for the pre-training runs. And then I want to know the same thing that happened at I said Anthropic. It was transcribed incorrectly to antropic, which is wrong. And I want dates of when these were released. Then give me some uniform benchmark like chatbot arena or
Starting point is 00:47:36 MMLU. I really need you to go pull all this together. I'm like, come on, do this for me, bro. And then I'd like you to investigate how the bitter lesson in Moore's law are interacting now. Essentially, the bitter lesson states that you always just want to throw more scale, but it's unclear to me what the benefits of scale are proportional to the capabilities of these models. So my basic thesis is that, you know, we're potentially hitting diminishing marginal returns. We're going to see less gains from increased scale. And so the real question is, GROC 3 is a 20K GPU run. They're planning to do 100K GPU run. And the question is, does the 5x or 10x increasing compute power? Does that increase the model's final capability usefulness by 1%
Starting point is 00:48:17 10%? Does it double it? Does it 10x it? And that's what I'm trying to predict. And I want to see these based on trend lines. What kind of results should I expect? And specifically, I want, I want you to not just qualitative results, not just quantitative results, but qualitative results. Like, what do we expect a 1 million GPU cluster trained model to be able to do? Is it just high IQ? Is that the best measure? Like, what should we, how should we be measuring these things? And is there an evolution that like, you know, we have no top, no max? Do we just continue to push on? The final question is like, does this continue to get better as we get to a billion GPUs, a trillion GPUs, a Google GPUs? What are we getting for that?
Starting point is 00:48:56 I guess the question is, is intelligence unlimited? Even if we assume that we're on the right algorithmic path, that's the main question. And so basically, I just wanted to, like, you know, dump out a ton of research and give me a bunch of information. The only thing that could handle that kind of prompt is your secretary, right? It's a lot of stuff. I mean, you just basically dumped a... Yeah. But you certainly gave plenty to work with.
Starting point is 00:49:23 What's interesting is if you look at page two and then page six or something, you can actually see both GROC and OpenAI dumped out tables of how these models evolved. So GPT1, it claims was trained on 10 GPUs, then GPT2, 100 GPUs. GPT3, 10,000 GPUs, and then GPT for 25,000 GPUs. Which is what tracks to the other. And yeah, and on the other one it says 1,000 and then 20K. And so the big question here is on flops. This is the real, like, standard metric is number of flops.
Starting point is 00:50:07 And the jargon term for this is just using the order of magnitude for number of flops. So you can think of GPT3. you call that an E23 model because it had 3.14 times 10 to the 23rd flops. And so you call that an E23 model. GPT4 was an E25 model because it's not just more GPUs, but it's also more training time and more powerful GPUs. And so you can't just say, oh, they used 5X GPUs because they might have run them longer, more power, all these different things.
Starting point is 00:50:42 So you really just want to do flops because that's the most standard. And so deep mind chinchilla is an e23 model. Lama 70B is an E24 model. And Grok 3 is an E26 model. I don't know how I missed chinchilla. Oh, chinchilla's a big one because that was the paper that defined the scaling laws. So when people talk about the pre-training scaling law, they call it chinchilla scaling laws because it came from the chinchilla paper. Got it.
Starting point is 00:51:11 And so in here. Now, this is where we get weird because ChagibbT claims that GROC 3 is an E26 model, but GROC 3 claims that GROC 3 is an E25 model. And so I don't know who's hallucinating here. I don't know who's more accurate. They could they could both be hallucinating, to be clear. They could. No one is necessarily right.
Starting point is 00:51:35 And so GROC 3 claims that GROC 3 is less flop intensive than GPT4. but GPT4 claims that GROC 3 is more powerful than GVT4. And so they're both gassing each other up, I guess, in a weird way. I think OpenAI is more accurate here, but it's very funny. I don't know. It's all very odd. And like I don't have time to fact check all of this. So I'm kind of just like vibe interpreting this.
Starting point is 00:52:08 But let's read some of the analysis here from the bitter lesson. The bitter lesson argues that AI progress relies, and this is from GROC 3, and then we'll read the chat GPT version. The bitter lesson argues that AI relies on scaling compute and data over bespoke algorithms. LLMs embody this. GPT3's success came from brute force scale, not architectural breakthroughs. It was a very simple algorithm. They just gave it the entire web, and they trained it a lot with a lot of GPUs. It's the first, like, big training run, basically.
Starting point is 00:52:39 However, your thesis about diminishing returns challenges this. Does more compute always yield proportional gains. Moore's law has slowed. That's the law that says that doubling transistor density every two years. With GPU, with GPU performance now scaling via parallelism. And so we are scaling compute, but we're doing it by just getting more and more GPUs. LLM training outpaces hardware gains relying on cluster size rather than per chip efficiency. So we're not just doubling the training run every year.
Starting point is 00:53:07 We're like 10xing it because we're just building these monster data centers. So scaling laws. Kaplan and Hoffman show performance scales predictably with compute, parameters, and data. This implies a 10x compute increase yields 25 to 60% loss reduction, not 10x. MMLU gains reflect this. GPT3 to GPT4 is a 160x compute jump for a 50% score increase. I still don't really know how to interpret all this. We're going to have some guests on to break it down.
Starting point is 00:53:42 Yeah. And so, I don't know. It's interesting. The main thing is that like, I think when most people play with this, they're like, it's great. It's good. But it's not like a complete step change from what else I'm seeing online. No, the big headline takeaway from last night is that XAI is catching up on raw model capabilities in a very short period of time. in terms of product usefulness,
Starting point is 00:54:13 it doesn't seem to be there yet, right? Because even you're seeing, okay, well, you trained on all of my posts, but I actually don't even necessarily like that that much. And so they seem to be on a collision course with Open AI from a capability standpoint, especially as they get into these next runs. But again, this is going back to my earlier point.
Starting point is 00:54:38 I look at all this, you know, Elon, know, hitting these e-vals, but then simultaneously still wanting to spend $100 billion on OpenAI, when he could just, you know, spend that money on XAI. And he's, you know, again, we don't know if he's doing it to throw a wrench in the process. But it seems like he would love to be chairman of Open AI is like my read of the situation. This is interesting. The chat GPT deep research is, I think, much more. readable as a, it just has a research paper.
Starting point is 00:55:14 So, and again, that's them innovating at the product level. Yeah. And what Ben Thompson said is he's not sure if they just have a better model that's just producing better outputs or they just are refining the actual product layer more. Yeah, yeah. So they say increasing model size and compute generally improves performance, but with diminishing returns. And so that's the real question here of like, like, you know, if we 100x,
Starting point is 00:55:40 the models like we're planning to is if it just gets a little bit better it might not actually be able to do real work still because it might still break down and hallucinate a little bit like yeah we're we're we're all hoping for the model that just like never hallucinates ever and and do a ton of stuff and hold everything in memory and which may not ever come maybe i think we we will get there it's just the question of like you know what if it's what if it's a thousand order of magnitudes. Like, you know, like that would be, yes, the scaling law would hold. Like the scaling law would be correct.
Starting point is 00:56:14 But like it would take a long time to build like a Dyson sphere for that, basically. Early work by OpenAI showed that large language model loss follows a power law. Performance improves predictably as model parameters and data scale up. And this was that picture of like GPD3 to GPD4, more parameters, more data. And so everyone was going bigger, bigger, bigger. For example, going from GPD3, 175 billion to models like Gopher to 288. and Megatron Turing 530 improved benchmarks, but not proportionally to the huge jumping compute required.
Starting point is 00:56:47 DeepMind's 280B gopher outperformed GPT3 on knowledge tasks, reading comprehension and fact-checking, yet it saw little gain in logical thinking or common sense tasks despite 60% more compute. This suggests some capabilities plateau and less new approaches are used, and that's the reasoning model, right? And so diminishing returns are evident on many benchmarks,
Starting point is 00:57:09 As models grow, metrics like MMLU, a broad knowledge test, improve, but approach an asymptote near human performance. And that's frustrating because I would want linear progress that just blows through human performance, but it's really like we're kind of, maybe we need new evals. I don't know. GP23 achieved only around 50% on MMLU while below the 90% expert human level. So that's the human level benchmark. Gofer did 60%.
Starting point is 00:57:38 Chinchilla did 67%. GPT4 jumped to 86% nearing human experts. However, GPT4's training used roughly two orders of magnitude more compute than GPT3 for that last 30 to 40 point gain. So it's still very important, but it's just like
Starting point is 00:57:54 diminishing. Each additional few points towards 90% is increasingly expensive in compute. Similarly, coding and math benchmarks saw massive leaps from GPT3 to GPT4. but further gains beyond GPD 4 are smaller. In XAIs GROC 3, pushing to an unprecedented 200K GPU cluster
Starting point is 00:58:13 only yielded moderate improvements over the prior state of the art. Hallucination! They didn't use all 200K GPUs. And here it's saying that they did. Well, yeah, if you look in the... Yeah, they... OpenAI specifically says in their research that they say up to 200,000 Nvidia GPUs, 100 to 200K GPUs over four months,
Starting point is 00:58:36 we know that's not true. Yeah. And so it's a mess. I don't know. We're close to something. It's cool. I like it. Well, we've compared. We've got to step these up. But I mean, they're both. Should we talk about their dynamic? Yeah, absolutely. Let's move on to the Wall Street Journal. The inside story of how Altman and Musk went from friends to bitter enemies. Kick us off. On the first full day of the second Trump presidency, Elon Musk was in the White House complex when he got word that his nemesis was about to hold a press conference.
Starting point is 00:59:06 with the president. Amazing. Amazing first sentence here. I don't know who's writing this. He turned on the television and watched his Open AI's chief executive, Sam Altman, and a beaming Donald Trump touted a $500 billion investment
Starting point is 00:59:22 in AI infrastructure called Stargate. And this is a hilarious dynamic if it's actually true, where he's turning on the TV. He's got X open on his phone. He's just shaking his head. Like, one, Sam is an absolute dog for even making this happen. You've got to be pretty brave to just go into the, into the White House, the lion's dad.
Starting point is 00:59:43 Elon's got like six of his kids running around. They know you're a target. That's great. So props to even making that happen. Mossa, I'm sure, was, you know, pulling, making, making some magic happen too. So despite having rarely left the president's side over the preceding few months, Musk was blindsided by the announcement, according to people familiar with the matter. Musk fumed to aides and allies about the announcement claiming Stargate's backers didn't have the money they needed.
Starting point is 01:00:09 The deepest, which is true, right? It sort of came out that they didn't have it. It was more of like a road show, you know, SPAC announcement type thing. So the deepest cut was Altman's success navigating Trump world via a carefully coordinated series of recent meetings in Palm Beach and phone calls with the White House while keeping the plan secret from the president's first buddy. First buddy. Oh, yeah, buddy cop. They're going buddy cop mode. But Trump's got a lot of buddies.
Starting point is 01:00:37 Altman and Musk co-founded Open AI in 2015, but their relationship soured when Musk left in 2018 following a power struggle. It worsened when Musk responded to the launch of Chat-GTPT by launching his own rival startup XAI. This week, the feud went nuclear when Musk followed the Stargate unveiling with his own bombshell, a hostile $97.4 billion bid for the assets of the nonprofit that controls OpenAI. A decade after joining forces, they are now fighting for control of the very thing that brought them together in one of the highest stakes and most personal fights in
Starting point is 01:01:07 recent business history. The outcome could determine everything from the future of a world-changing technology to who will help set the nation's technology agenda with the new president. Interesting. This article is based on the conversations with more than a dozen people familiar with Altman and Musk's relationship over the years as well as Open AI and Musk's business and political decisions. We got to go back and watch the Sam Altman, Elon Musk podcast. Have you seen this? They had their own show together? It wasn't, it was why Combinator had a, a series of interviews on their YouTube channel. And Sam went and conducted a number of interviews, and one of them was with Elon.
Starting point is 01:01:43 And so they're sitting in the Tesla factory, just chopping it up about like entrepreneurship and wisdom. And it's just like, it's crazy to see. I'll continue. So in many ways, Sam Altman 39 and Elon Musk 53 couldn't be more different. Well, Musk was beaten up and verbally abused as a child. Altman was a teacher's pet whose parents routinely told him he could be whatever he wanted to be. Where Musk's, where Musk was often abrasive, Altman tended to tell people what they wanted to hear. And while Musk was an engineer, steeping himself in the details of rocket and battery design,
Starting point is 01:02:18 Altman is a technology-obsessed intellectual, reading widely across philosophy, science, and literature, and penning essays on how society should organize itself. But both have strikingly similar taste for power. Let's go. Taste for power. That should be one of our hiring metrics. Yes. John, what do you think this guy's taste for power is?
Starting point is 01:02:39 You think he's real hungry? Yeah. I mean, if you're in an interview... You can tell Ben's got a real taste for power. Absolutely. Yeah, if you're in an interview and somebody asks you, where do you want to be in 10 years? And you just say supremely powerful.
Starting point is 01:02:54 I think you get the job. I think you get the job. Oh, yeah. Yeah, that's the video. Look at this. Very poorly. It doesn't even feel that long ago. It wasn't that long ago.
Starting point is 01:03:05 The cinematography was not incredible, but I think it's probably 2016 or something. The Andrew Tate, you know, early. 2015, wow. That is wild seeing them hang out. Just bros, just guys being dudes doing a pod together. You'd love to see it. It's too bad. I mean, they keep coming back to the fact that mom and dad are fighting.
Starting point is 01:03:28 You know, these are two, you know, everyone picks aside, but ultimately these are Americans. They're building technology. I love technology. I love America. Yeah. I wish they could just be on the same team and and build something awesome together. I hope that they can have a reconciliation. That's my biggest hope.
Starting point is 01:03:46 Well, and so for years, the millennial Altman looked up to the Genesque Musk's as a hero, a real life's Tony Stark who provided a counter example to the country's technological stagnation that Altman railed against when he was president of the startup accelerator, Y, Combinator. Altman met Musk years earlier when Y Combinator partner Jeff Ralston introduced them.
Starting point is 01:04:08 Oh, I know Ralston pretty well. Oh, they misspelled his name here. And helped arrange for Altman to tour Musk's SpaceX Rocket Factory. Interesting. Altman's time leading Y Combinator from 2014 to 2019 put him at the epicenter of power in Silicon Valley. He became known as a fixer with an unrivaled Rolodex who could call in favors for the startups he invested in or punish investors who crossed them. This is 100% true. He was great at what he did during this time. He was fantastic. This his special talent was raising money, which he would do by arriving in his signature uniform of jeans and sneakers, curl his small frame up cross-legged in a conference room chair and unspool a vision so grandiose, compelling and earnest that it often seemed like investors
Starting point is 01:04:53 were powerless to keep from funding his projects. It's great. I mean, great storyteller, great fundraiser. And what's interesting is that like, yeah, he raised some money. He raised a lot of money for his projects, but he was also, like, an angel investor who got tons of deals done for other people. He set other people up with funds. Like, he was, he was, marshaling capital all over the place. I had heard that he invested in, he was able to invest in Stripe, but it's $700,000 evaluation. I don't know, but I know. It was like 10 on 700K or something. I mean, I think he's a billionaire just from Stripe. Yeah. Basically. Somehow. I don't know. Yeah. But, I mean, yeah, phenomenal investor. And then,
Starting point is 01:05:31 For anyone listening, if you want to be a billionaire, just put 10K into the next stripe. Yeah, yeah, that's a good advert. People tend to make it really complicated. Yeah, why are you over complicating it? Yeah. Think, oh, it takes years and all this stuff, all this hard work now.
Starting point is 01:05:43 Just take 10 grand and just put it into the next stripe. Yeah. And I mean, he's even doing it more recently with Oaklo, that nuclear startup, which is public. And it's a spec, and it's a successful spack. The stock's way up. What a narrative evaluation. Like, if you see people talking about it, you know,
Starting point is 01:06:01 on X, the company, they call it Sam Altman's nuclear startup. Yeah, yeah, yeah. So, like, that is probably, like, the dominant narrative causing it to pump. Yeah. I actually have to check. I own a little, I own a little bit of it. You know, you own, oh, no. Okay, not financial advice here.
Starting point is 01:06:16 I am down. I am down. Yeah, I am down four percent today. So, oh, it's not, it's pulling back. It had to. Well, it had to. Make up your own mind. Go on public. Check it out.
Starting point is 01:06:31 and see if it's for you. Yeah. Maybe. Anyway. Not that we certainly do not recommend. No, we don't recommend individual stocks, but we do recommend becoming a multi-strategy, multi-stage large asset management firm. Yeah.
Starting point is 01:06:44 And running your business through public. Yeah. Become a long short equity hedge fund. There you go. And it all starts with public. In early 2015, Musk and Altman began having regular dinners each Wednesday in the Bay Area. their conversations tended toward the apocalyptic, how the world might end, how they might prepare for it, to where they might have to flee. A likely cause they agreed would be artificial intelligence that grows smarter than humans and impossible control. That may, Altman suggested they create a Manhattan project to develop artificial general intelligence or AGI that is as smart as humans at most tasks. They wanted to ensure Google, which had a huge lead in developing the technology, didn't end up deciding what it would mean for the human race. fascinating solution, you know, like, like, there is another world where you're like, we're just,
Starting point is 01:07:35 like, we're just going to try and like, you know, use military might to just actually, like, ban this development of this technology. Yeah. Like, you could do that. I wouldn't advocate for that at all. And I think AGI's, like, I think the whole, the whole history of this stuff is going very well. I'm very satisfied with how it's going.
Starting point is 01:07:51 But, you know, there is another world where you're like, hey, yeah, like, there's this technology and, like, we need to, you know, steer people away from development. of this and like ban this and control this and then have international coalitions and and you know mill and Harry might to build it up like there are things you can't build uh you know dark web drug marketplaces are a good example it's worth noting that Sam Altman and Musk had these meetings and then Altman decided that he was going to get really into building bunkers yeah sort of doomsday you know uh set up fly on the wall uh so i would love to have been a part of those conversations and so they joined forces They raise up to a billion dollars.
Starting point is 01:08:32 Musk pledged to supply the lion's share of the money, and they would lead it as co-chairman. Ooh. The co-CEOOO-CEO thing is always wrong. Co-chairman is hilarious. Yeah, they should have figured that out early on. It's very clear that they didn't play out like, okay, like what if this is actually like a trillion dollar opportunity?
Starting point is 01:08:49 Like who will want to run this? And they were both like, well, obviously it'll be me. It's not, there's no question. Of course. Their relationship began to disintegrate in 2017. pretty quickly. I mean, this is 2015.
Starting point is 01:09:02 They're having dinners. 2017, they start disintegrating after open AI researchers realized they would need far more money than a nonprofit could raise to develop
Starting point is 01:09:10 advanced AGI. We talked about this. If you want to summon the AI god in a box, you've got to be a capitalist. It's not happening in a nonprofit. You're not just writing
Starting point is 01:09:20 some clever algorithm with some altruistic research. We are interested in taking P to private. Exactly. There's a lot of stuff. private. No, it's the for-profit conversion. For-profit conversion. Then it'll be private,
Starting point is 01:09:34 and then we'll take it public. And then we'll probably take it private again. As the private Bravo, we'll take it public, take it private. Yep, yep, yep. You know the post of document. Yeah. That's great. According to one of their emails, Elon demanded majority control and to be CEO. Altman's successful move to block his mentor would mark the beginning of their rupture. He convinced another co-founder, Greg Bachman, to back him over must. Brockman reeled in OpenAI chief scientist, Ilya, Sutskiver to also back Altman. Brockman and Sutskiver wrote in an email to Musk
Starting point is 01:10:05 that since Open AI was founded to avoid an AI dictatorship, it seemed like a bad idea to create a structure where you would become a dictator if you choose to, if you chose to. Within hours, Musk wrote back that this is the final straw. By early 2018, he had left the company and Altman took over leadership. This was like very under-discussed at the time
Starting point is 01:10:25 because Open AI was such just a research lab and they were doing like little things here and there. Like this was definitely not in the news in the same way. Like 2018, people were talking about SpaceX and Tesla, mostly. Yeah. So over the next few years,
Starting point is 01:10:38 they focused on research in 2020. They released ChatGPT. This became huge. Turned out to be one of the most successful and transformative consumer technology products of the century in the company of the iPhone, Facebook, and TikTok. As it's as shocked as the rest the world that AI had gone mainstream and upset that he wasn't a part of it.
Starting point is 01:11:01 Musk began publicly criticizing Open AI for moving too fast and not taking safety seriously. He signed an open letter calling for a six-month pause on AI development. Within a few months, launched... It's funny. A lot of people called for similar, you know, signed similar letters calling for a pause on new podcast formation. Oh, yeah? And of course, that didn't get through.
Starting point is 01:11:19 Nope. You can't stop it. The era of progress moves but one way. Yeah. In 2024, he attacked Altman and a new. new venue court after suing OpenAI and its CEO that February. He withdrew the suit in June, refiled it in August and amended in November. They've been going back in the fort in the back, back and forth in the courts for a long time.
Starting point is 01:11:39 Musk's lawyers declared the perfidity and deceit are of Shakespearean proportions. You know it's a good lawyer. You got to pay top dollar that can hit your lines like that. That's not less than a thousand dollars an hour. That's a $5,000 in our lawyer. That's 10K potentially. Allman and Musk were bitter. L. L.M. could never. Yeah, and so Altman said Musk was bitter that he left before the company succeeded.
Starting point is 01:12:04 As Musk's legal attacks escalated, Altman watched with growing alarm as Musk grew closer and closer to Donald Trump, campaigning by his side and spending hundreds of millions of dollars to support him. You want to continue? Yeah, and I mean, there's lines from Altman interviews where he's like, you know, I would hope that, you know, the president wouldn't sort of pick favorites when we're here, you know, all. trying to develop this transformative technology. And to Trump's credit, he seemingly hasn't picked favorites specifically with an AI. He obviously has a good relationship with Elon, but he's not, we haven't seen him go out
Starting point is 01:12:40 and do any sort of press conference for XAI or the Memphis data center. It's such a narrative violation. Yeah. Like everyone thinks Trump is going to be super corrupt with this stuff. And he's just like, you know what? He's making, he's having his cash bonanza over here. Our listeners know that like, yeah, he's. Deal guy.
Starting point is 01:12:59 Deal guy. Anyway, Altman first mentioned Stargate to Open AI's board in 2023 as a way to vastly increase the computing power. His company could tap to develop and operate AI. He originally brought the idea of Microsoft asking it to invest upward of $100 billion. But in the wake of an episode in 2023, when Altman was ousted from the CEO Perch for five days, the tech giant balked. Just get it together, guys. We're not putting up $100 billion for a guy who can. can't hold him to his job.
Starting point is 01:13:28 He gets upset. It's so funny. There's so much drama here. Altman soon found partners, one with SoftBank. Altman had known him since his white combinator days. Second was Larry Ellison, a longtime friend of Musk, who was hung out to dry when XAI pulled out of a Texas Data Center project that Ellison's company Oracle was working on. Altman agreed OpenAI would take it over.
Starting point is 01:13:50 The project grew into the foundation for Stargate. I didn't know that. Interesting. That it had originally been an XAI project. But then I guess Musk wanted to. do the data center like himself and like own the whole stack. And isn't, isn't Allison heavily invested in X?
Starting point is 01:14:05 I don't know. Yeah, I think so. I mean, they're all super conflicted and like, you know, it's all just like sneaking his tail over here. Yeah,
Starting point is 01:14:14 so he, I think he put in at least a billion. Okay, look that up and I'm going to keep reading. In December's Masayoshi Sown played golf with the president-elect at Mar-Lago and announced his intention to invest $100 billion in U.S. infrastructure projects alongside Trump and Lutnik. Their press conference effectively previewed Stargate without making any of the details public,
Starting point is 01:14:34 which ensured Musk still didn't know about opening eyes involvement. Here's a great AI overview, a Gemini overview. Okay. Quoting, you know, using the Washington Post as a source, Larry Ellison, co-founder of Oracle, invested $1 billion in X. However, as of September 20204, he lost 720 million of his investment. according to the Washington Post, which clearly he didn't lose his investment. He had a paper loss.
Starting point is 01:15:03 He had a paper. And then it was marked down. But now it's back up. Yeah. So I'm going to have to put the Washington Post in the true zone. And so Altman goes to the inauguration festivities. He doesn't sit with the other tech CEOs alongside Musk. There was like the high like, you know, the real like killers were up there with like Zoc and Bezos and Musk.
Starting point is 01:15:23 were up in like kind of a balcony area and then Altman was down with Theo Vaughn and Alex Alex Wang. It was a bunch of cool like little microcrues. I think Jake Paul was over there for some reason. The next day Altman and his partners arrived at the White House where they were more fully explained their plans for Stargate to Trump. Trump told the group he wanted to go ahead with the announcement. The new president loved that they were aiming to invest a 500 billion during his term a number sure to make headlines. It makes sense. He wants a lot of jobs, wants a lot of economic growth, spend the money in America. And so Musk gets upset. He's fuming to AIDS about how the partners didn't really have the funding lined up for the project. He called it fake on X. Musk was already
Starting point is 01:16:09 plotting a counter move and had been considering making a bid for the nonprofit. Musk said he was inspired to make the bid because Open AI was in the midst of becoming a for-profit company and he believed Altman planned to undervalue the asset of the nonprofit, which would become an independent charity with a stake in the for-profit. But Musk's more primal message was for investors. Let's go to war with Sam Altman. Altman was at the Paris AI summit when news of the bid broke. And so he got like TMZed a little bit with, you know, the reporter saying,
Starting point is 01:16:39 what do you think about this? And he's like, oh, my God, I can't do with this. He basically was saying, like, I just wanted to stop really bad. That was the immediate take. And so he said, open AI is not for a. sale and the board has unanimously rejected Mr. Musk's latest attempt to disrupt his competition, said Brett Taylor, chairman of Open AI's board. I thought Brett Taylor's building an AI company separately. I guess he is. I think he's probably doing both. Any potential reorganization of Open AI
Starting point is 01:17:07 will strengthen our nonprofit and its mission to ensure AGI benefits all of humanity. Open AI's rejection comes as no surprise, says Musk's lawyer, Mark Toberoff. Musk had said he wanted to save the company from the dangerous direction in which his co-founder had taken it. It's time for open AI to return to the open source safety focused force for good it once was, he pronounced. We will make sure that happens. Altman responded in his signature, nice brand of nice guy savagery. Probably his whole life is from a position of insecurity. He said on Bloomberg TV, I feel for the guy. I don't think he's a happy person. I do feel for him. Wow. It's wild because I think if Elon, Elon would tell you I don't want to be happy.
Starting point is 01:17:48 Yeah, he also said that on the... Don't use that metric to evaluate, like, to try to judge me, right? Yeah. His motivation is to put a data center on Mars. Yeah, that's true. Anyway. Absolutely wild. Well, we got some breaking news.
Starting point is 01:18:05 Thank you to Ben for surfacing it. From Perplexity. Okay. He's also... They've been in the timeline recently because... They're fighting it out. Everyone's in the trenches. Perplexity CEO likes to use Sam Altman's reply.
Starting point is 01:18:18 his marketing engine for perplexity. It's seemingly his strategy now. So perplexity says today we're open sourcing R1 1776. Cool name. Got to give him credit for that. A version of the deep seek R1 model that's been post-trained to provide uncensored, unbiased and factual information. To keep our model uncensored on sensitive topics, we created a diverse multilingual evaluation set of 1,000 examples using human annotators and specially designed LLM judges. We compared frequency of censorship in the original R1 and state-of-the-art LLMs to R11776. You can see a chart, Ben, maybe you can pull it up or we can do it in post. We also ensured the models, math, and reasoning abilities remained intact after the uncensoring
Starting point is 01:19:02 process. Benchmark evaluations showed it performed on par with the base R1 model, indicating that uncensoring had no impact on core reasoning capabilities. That's cool. So, I mean, hot take, like, I don't really care about. censorship and LLMs all that much because like I how many times are you doing you know research on the Tiananmen Square Massacre? Like you know it's like yeah most of the time I'm like make this recipe list or like you know pull some GPU data together or you know something that's like it wouldn't even be censored either way but uh it's cool that they did it and in 1776 obviously very American branded very uh you know American dynamism coded and uh probably like a fun stunt. marketing stunt and it's good because there was a lot of like is deep see secretly bad and like
Starting point is 01:19:52 poisoning it so I like that they like did the work to like go get it up I think that's cool so I think perplexity can be very useful yep I don't use it a ton yeah I use it from time to time I find it I find it can be fantastic it's just more so the friction of opening perplexity and searching ends up being high for a lot of this sort of faster you know I just just opened Google search and I got the information I wanted even though it was like, you know, I asked how much did Larry Allison invest in X? And Gem and I like botched it and like gave this highly politicized answer, but I still got the data that I wanted. So I think perplexity would have done a much better job of that. I should probably just like start, you know, using it more.
Starting point is 01:20:37 But overall like their product strategy right now feels very reactionary. It seems like the CEO is sort of like watching what other people are doing figuring out how to make it about them right hey here we have our like we we basically made r1 into a better consumer product for americans look at us and he's launching their their sort of deep research competitor which again even carpathy was saying you know not not quite on par in terms of how people are using deep research broadly today so yeah um yeah overall you know just focusing your messaging on on your your top competitor, your former boss's reply section. I'm not super bullish on that strategy. What's interesting is perplexity does have another feature, like tab, that I actually think is really
Starting point is 01:21:27 cool and I was super bullish on, but then I didn't wind up using all that much. It's an algorithmic feed of news stories that are AI generated. So like the top story for me is GROC 3, which obviously I'm interested in talking about. And then you click on it and it shows you a bunch of sources. and key features, and it's very nicely organized, and it's not super ad riddled and stuff. And I thought this was really cool, but at the same time, I would rather experience the Groch III launch on X
Starting point is 01:21:58 in the messy timeline. And so I haven't been using that as much as I thought. And we were talking about this yesterday, like, is there room for a new hacker news or a new tech meme? And perplexity kind of built it. I think they did a great job on product execution in that tab.
Starting point is 01:22:15 I think it's quite good. But I think that in 2025, people want a feed that is more chaotic, more combative, more comedic, entertaining. Entertainment, exactly.
Starting point is 01:22:31 So I want to see the actual live stream that I can just go watch the definitive source. I want to see the community notes. I want to see Carpathie. And then I want to see growing Daniel Mimit and I want to see Rune respond. And I want to see Yaxine respond.
Starting point is 01:22:43 and I like getting my news that way, honestly, more than, hey, there's this sanitized AI summary. That's helpful, but it's not as fun. Yeah, it's interesting. So I'm looking at the like free productivity charts right now, which a lot of these AI apps are under productivity. So perplexity is at 26, GROX at 1, chat GPT is at, or sorry, GROX at 2, Chad GPT is at 1. So this is just a snapshot. In the app store? No way.
Starting point is 01:23:10 This is a snapshot of moment in time. Where's deep seek? I thought they were going to destroy everything. Deep Seek is number three. Okay. And then perplexity is down at number 26. Okay. Behind things like HP Smart, their printer.
Starting point is 01:23:24 No, no, no. The ringtones maker, the ring app. You know, random VPNs. Speechify is actually ranking. Cliff White's, my boy. Have you met Cliff? And then so here's, here's. Yeah, you had mentioned that.
Starting point is 01:23:39 Beast. Beast on the Benchrist. So perplexity is 26. they have 127 rankings chat on AI, which is basically an open AI alternative, has 194,000 rankings and is only at 28. This is like a seemingly like no name, you know, sort of the most blatant rapper that you can think of. So I don't know.
Starting point is 01:24:03 I think that I don't see this model getting them to be in the top. five. So to me, if they're, if they're, you know, launching R1, 1776, do consumers in the app store actually care about that? Because if you're competing with Google, you need to not be worried about how cool X is going to think your product releases and more so how you go from 26 on the charts to top three, right? If you actually want to be competitive, clearly wants to compete with Sam. Every single day he's responding to Sam. So I think, I think this launch is super cool. I definitely want to play around with it, but, you know, at the end of the day. Yeah, I've honestly seen the same thing on, on, oddly in the nicotine pouch world where I've seen
Starting point is 01:24:51 like people be like, oh, I'm launching a new nicotine pouch with like an American flag on it. And like, okay, it'll get like, you know, a thousand likes on X. And then it's like, okay, like, do you have $10 million to spend with the 7-11 Walmart and, you know, quick trip to actually get your product in store? It's like the thing that actually drives like the adoption loop is like completely separate from like popularity. Totally. And it's just yeah, yeah, it's interesting. I wonder like perplexity I think is cool because like they're not just doing the vanilla like we're just doing another chat bot.
Starting point is 01:25:28 There's already 17 of those that have like billions of dollars. At least they're trying a different product instantiation. I think that is cool. But but yeah, I do wonder how they can get. how they can get just more, how can I fit it into my life and how it can really get to, you know, solid traction. And, yeah, I mean, maybe speed. You mentioned speed.
Starting point is 01:25:51 Like, if it was faster than Google and it was something that I could make my default search in Safari on iOS somehow. The challenge might be down for that. Is if you're sitting in Google Chrome working, it's always going to be faster to hit command and immediately start searching. Now, no, no, no. if if arvin the CEO of perplexity made a compelling case on x that i should go into my chrome tab and reroute the default chrome search to perplexity and showed me how to do that i might do that
Starting point is 01:26:24 and try it see how it goes but it has to be a faster product and google and google can continue to make that super hard or they could just say you're not allowed to build competitive and again it might not be like an actual consumer like yeah viral growth strategy like it might not be my not yeah anyway should we wrap up grok i think we did a full deep dive yeah that was great now you know where where are we on time we're at 1220 an hour and a half okay well let's go through some timeline we got a bunch of good stuff by the way yeah i'm loving the new layout yeah it's great yeah thank you for the the comments on it we're trying to make the show better every single day in different ways uh sometimes we wake up and with a bad sleep score but we're still actually had actually how's those
Starting point is 01:27:08 sleep. I had a rough night. I went to bed a little late. So I'm sure I'm getting docked. Let's see. I have to give I have to give a little anecdote. Ooh, 82. I got destroyed. I got 83. 642. Can you imagine if can you imagine if they were just like in the background listening like adjusting them to try to make us like super competitive? Wait, what did you get? I got 83. 83. You beat me. I beat you by one. No, but so last, so I made a mistake this morning. I got up at five. Yeah. My eight sleep warmed my bed. Yep. like five, you know, whatever, to, so that I was sort of like waking up naturally. Yeah.
Starting point is 01:27:43 And then at five, it starts doing the vibrating alarm, which is really nice. The issue is that I snooze the alarm. I didn't turn it off. And then I just got out of bed and I left. Oh, and then, I was in the car. And she's texting me being like, please turn off your alarm. Yeah. Which is funny because normally people are like, turn off your alarm because you're still sleeping.
Starting point is 01:28:06 Yeah. But turning off your alarm because you're already. Already in the car. It's great. But it's, you know, connected via Wi-Fi, so I was able to just, like, turn it off. I mean, for what it's worth, I think I still, like, the eight sleep got me to a place where even though I didn't have the best night's sleep, it went a little bit further. The six and three-quarters hours of sleep I got were fantastic.
Starting point is 01:28:28 Fantastic. But I'm ready to lock in tonight. I started that point by saying our, we actually are genuinely focused on how do we improve the format of the show every single day. There's the format. There's the camera, lighting, overlay. So thank you to everybody that gives us feedback. We see it in the chat.
Starting point is 01:28:46 We see it in the DMs, comments, et cetera. Trying to make it better every single day, forever. And yeah, it's a fun journey. Keep grinding. Let's get into the timeline. Let's go to Paul Graham. Andreas Klinger says, this picture will be framed by dads everywhere.
Starting point is 01:29:03 Paul Graham says, every time we come back to Silicon Valley, my 16-year-old son gets a massive dose of cognitive dissonance when he notices that apparently smart and reasonable people seem eager to obtain something he's convinced is utterly worthless. Yeah. And someone says, interesting. What's that?
Starting point is 01:29:21 And he says, my advice. It's like he set this up to go viral. Like, it's like he almost framed the first tweet to be like, yeah, somebody's going to ask and then I'll drop the bomb on them. Yeah. Because he could have just said like, you know, my, he could have revealed that it was his advice, but it wouldn't have been as good and it would have been like maybe cockier or something. I don't know.
Starting point is 01:29:42 It was a great post. It was very funny. Great poster. Yeah. And I don't know. Yeah, I don't have a 16 year old yet, but it'll be interesting to see if he enjoys my advice at that point. Well, what we'll do is, is all give advice to your son. Yeah.
Starting point is 01:29:57 You give advice to my kids. Yeah. And they'll respect it because they're like, oh, this is like my dad's business partner. Yeah. I respect what he says. So even if they go through that awkward, you know, teenage period where they're sort of rebelling will still be able to you know deliver the also i mean i'm planning to go full reverse psychology and have all my advice be like move to brooklyn become a
Starting point is 01:30:19 do drugs yeah exactly like yeah just look you're 16 i want you to be doing drugs i want you to be doing when i was your age i was doing yeah and then he's like i'm dad i'm going to the military and i'm starting i'm getting a job at goldman exactly working 18 hours of a day. Exactly. Exactly. I don't know. It's fun. It's funny to see PG. He is, he's been posting about his kids for 16 years. Yeah. Posting through it. He's been, he's been posting the dad. It's good to see him come back. He had that post that many people were commenting on the feng shui. Oh yeah. In his room, but, you know, he's posting through it. Posting through it. That's great. Let's go to David Holes, founder of Mid-Journey. He says, the biggest frustration of a hardcore
Starting point is 01:31:07 technologist in San Francisco is how many big companies, both tiny and gargantuan, are kind of fake. Investors often can't tell the difference between story and substance and armed with a billion dollars. It may take a decade for it to fail. As an observer, when those companies finally fall, you expect to feel some sense of satisfaction, but actually you only feel sadness and a sense of waste. Dude, I know exactly who he's posting about. Perhaps this is just the price we pay to live in a place that is so supportive of wild ideas and risky ventures. A lot of dumb stuff is going to happen and we just have to be okay with it.
Starting point is 01:31:45 It's just emotionally hard. It's like it's such a funny take on like, oh, I. No. No, there's some, there's some fraud or whatever. And he's like, you know, most people would be like, oh, this is like, you know, bad for the economy or wasting money or, oh, like, I should be getting the money to be. build something real. And he's just like, this is just emotionally draining.
Starting point is 01:32:08 Yeah. I love how Zen he is. Yeah. It's so good. Anyway, yeah, I think the real crazy thing is that, is that like him,
Starting point is 01:32:16 lots of people in Silicon Valley have identified the new crop of frauds. Yeah. Mainstream media silent. They're not doing investigative journalism anymore. Yeah. Kind of like a weird like, hey, maybe mainstream media. Like we need that.
Starting point is 01:32:28 Hey, maybe we need some investigative journalism. Like where is the, I don't know, the John Kerry Rue of this generation. Yeah. I don't know if John Carrier is like retired or still working, but got to start figuring these things out mainstream media because there's some bombshells out there right now. But yeah, I mean, when you think about the high profile hard tech companies right now that are
Starting point is 01:32:52 building that have a lot of hype that have raised a lot of money, the challenge is, you know, what he's saying is like, yeah, if you are a well-versed observer or you have a, any type of, like, you know, insight into the company, you can kind of point out, like, what he's saying of great, great story, not a lot of substance, right? Which is what he's pointing out. And that by itself is not fraud, right? Like, you can, there are plenty of companies that have great stories and just not a lot of substance, right? Maybe they're building something and they're building just not a very good version of it, but they still, you know, continue to raise money. Yeah, I mean, in the, like, post.com world, there was a guy
Starting point is 01:33:29 named Barney Pell who started a company called Moon Express who was trying to deliver like basically build a moon colony. Great story. Raised a bunch of money. Didn't get anywhere. It failed. And it wasn't a fraud. It was just like, all the investors were like obviously bummed, but they were like, yeah, like I wanted you to try to build. I don't know. It might have been a legal thing. But I, but I'm pretty sure what happened. I need to actually deep dive the company. But I'm pretty sure it's like, yeah, if you're as an investor, there's a lot of times when you put money in a company and you're like, hey, I wanted you to try this, and I know that it's a 10% chance that it works out. And if it fails, yeah, no hard feelings.
Starting point is 01:34:05 Nikiel in the chat says, Hindenberg meets, Hindenberg research meets the information. Oh, yeah, that would be good. Somebody does that. It would get a, you slap that behind a paywall and you'll be, you know, have some nice revenue in no time. Yeah. Yeah, it's great. Everyone, Nabil says, well articulated, it's not ideal, but the alternatives feel worse.
Starting point is 01:34:27 There does have to be a way to. improve. Anyway, let's move on to Mateo over at 8 Sleep. He says, it's so exciting to see 8 Sleep on TV during the final of the premier Paddell in Riyadh, supporting the number one team in the world of Coelho and Tapia. I don't know about Padilla. I think it's on the ground. No, Paddle,
Starting point is 01:34:47 is the cool version of pickleball. Not to throw too much shade at... Palantir? Palantir's pickleball paddle. I think it's great if you're, you know, doing paddle. Esk sports. But yeah, it's just a faster, higher pace, more athletic, more intense version. Boom.
Starting point is 01:35:06 Boom. Got your Aidsleep hat on. There you go. Thankfully, I caught that. That would have been deeply embarrassing. Yeah. I never would have recovered. But yeah, I mean, it's cool that AteSleep is, I mean, it's such a fun brand.
Starting point is 01:35:16 Because, like, yeah, it's a consumer tech company, hardware company. But they get to go and play an F1 and pro sports teams. And it's a lot of fun. Anyway, getting Ate Sleep. It's a no-brainer. We love eight sleep here. Speaking of other sponsors, we love, let's move on to Ramp. Aaron says, this is why I love Ramp.
Starting point is 01:35:38 And he's quote posting, Ramp's official account. It says last Friday, our team attended the Eagles Parade in Philadelphia for some on-the-ground journalism, what we found might shock you. And they have all these, they do this funny video of like, you know, people with ramp signs at the Philadelphia celebration. It's great. They're really, they're getting so much out of the Super Bowl. It is crazy.
Starting point is 01:36:00 I guarantee this thing is ROI positive, which is more than you can say for a lot of superwit. And it shows like taking that scrappy approach of saying, hey, we've made this big investment, but let's make the most of it. Exactly. I guarantee you Doritos ran their ad and they were like, cool. Like Pat on the back. Nice. We're done.
Starting point is 01:36:14 Okay. I'm going to see you next year. Yeah. And Packy, Packy's a big Eagles fan. I think he grew up outside of Philadelphia. Okay. He'll correct me if I miss that. But yeah, love to see Philly fans.
Starting point is 01:36:28 you know, get a win. Having fun. Yeah, that's great. Well, let's move on to a bezel deep dive. We got just add on ad on ad. Now, these ads are brought to you by AdQuick. I can mix in some reviews that have ads in them. Okay. Yeah, yeah, let's do that. Let's go to some reviews with that. So we're going to. The ads in the reviews are presented by AdQuick, by the way. To be clear, the best way to buy out of home ads for your startup. So I got the first one. I honestly, every time I read these ads. It just makes my heart saying it gets better every time. So I haven't seen Zero to one but unhinged by somebody named John. The Technology Brothers podcast isn't just a show.
Starting point is 01:37:04 It's a founder's dojo, a 10x brain gym, and a capital allocator's confessional all wrapped into one. Every episode is a masterclass in thinking from first principles, moving fast, and breaking every norm except the ones that print cash. Amazing. John and Jordy don't just talk tech. They talk trajectory. Listen long enough and you'll either build something great or realize you never have the stomach for it in the first place. But let's talk execution. You know what else requires ruthless efficiency, managing your finances when the system
Starting point is 01:37:33 wasn't built for you. That's when Purple comes in. So this is a really cool startup. Purple is the first banking and benefits platform built for the disability community because FinTech forgot millions of Americans who actually need financial tools built for real life. Checking accounts, EBT integrations, ABLE, ABLE, Savings all in one place. Purple built the mercury for people with disabilities because dealing with Social Security makes raising a series A look easy.
Starting point is 01:37:58 Check it out at Withpurple.com. That's cool. That makes so much sense. Yeah, yeah, yeah. It's kind of like true. All of tech wanted to focus on how do I reinvent the Amex, you know, like platinum card? How do I make this cool credit card that has like restaurant reservations? Meanwhile, like massive opportunities sitting here with Purple to just build tools for this, you know,
Starting point is 01:38:19 narrow, you know, subset of people who will switch from their primary bank. You imagine that most of the people that are feeling that frustration are not immediately like, oh, I got to go build a startup. Whereas, you know, a lot of, like, obviously, like, Ramp isn't a highly competitive. Like, they need, like, IMO gold medalists and, like, the best venture capitalists in the world and, like, tons of money and team members because everyone who's built a company has thought, you know, I need better CFO software, right? And, like, expense management and corporate cart.
Starting point is 01:38:51 So that's going to be a very hot market. This is, like, a place where you could actually probably go in, break in, make a statement, and then grow your business off of that. So I just think that's fascinating. Love it. And that's just something that like it would never come up on a market map. It would never come up in like a brainstorming session. You're not going to hear some thread guy say like,
Starting point is 01:39:07 once he sells for a billion, somebody, some VC will be like, we need the market map for disability tech and tech. So awesome. Thank you, John for the review. I got another one. Okay. And then we'll jump into some other ones. Relentless Alpha by username, I'm having fun, five stars.
Starting point is 01:39:22 The technology brothers are at it five days a week, consistent. delivering fresh alpha right out of the oven on the most relevant news in tech. Let's go. It's like taking a peek into the elite group chats you've never been a part of. With two to three hours of top tier daily content from the Brotherhood, I no longer have time to catch the latest flop guest rotation of the week on all in. That's brutal, brutal. But there have been some flops lately.
Starting point is 01:39:47 Even though Naval went on, I thought that was cool. Oh, yeah. I got to watch that one. This review is sponsored by Psychedelic Science, the premier psychedelic conference globally hosted in Denver this June. Don't miss 300 speakers covering the latest breakthroughs in psychedelic research alongside 12,000 attendees Mark and Dresen can yap about ayahuasca one-shotting founders all he wants. But just because it's no longer contrarian to be into psychedelics doesn't mean they deserve newfound hate from Silicon Valley. I think that's correct.
Starting point is 01:40:13 They're not without risks and they're not for everyone, but there's no debating their immense potential for healing creativity and let's be honest. Fun. Register today to learn about the latest psychedelic research policy and culture this summer. Great, great. He's sort of predicted any pushback from our audience and just nailed it. It was good. Sounds very cool. I imagine like this seems like something Tim Ferriss would, attend or speak at. I wonder if he has already. But very cool. Thank you to I'm having fun. Great username for a business like that. Yeah, yeah, very interesting. Any others? We got more. I'll just rip through them again. This one's also sponsored by ad, correct?
Starting point is 01:40:50 Okay, let's go. This review is. And then there's also another ad in there. separate business. Cool. No wonder, this is from Cody Ames. No wonder everyone I know told me to watch this. If they said X is ahead of the world, John and Jordy, or head of X, they take the largest feats and most interesting developments from startups and VC to broader technology and business, then extract it into an engaging and easy to listen to format. Couldn't recommend this podcast enough to anyone who needs a quick and easy way to digest the biggest news you won't find anywhere else. I also heard they're the most profitable podcast, which is no shocker. This is the,
Starting point is 01:41:20 the obvious spot to advertise your company or any news you have. So actually, Cody didn't put an ad in here. That's my only critique of this review. He was talking to us about OpenX, his company, which is very cool. And I believe Cody is also a car guy who,
Starting point is 01:41:37 he's maybe rebuild it. I don't want to get it wrong because it'd be very offensive. But AMG Hammer. He's a hammer guy. He's a hammer. Yeah. And so this is like the most legendary Mercedes. Kind of like Mercedes muscle car essentially.
Starting point is 01:41:52 Like I mean, a fantastic driver's vehicle. And I think he's restoring, rebuilding, modifying, recreating one. But he's invested a ton of time and obviously deserves the respect to the tech community for his incredible automotive innovations. Yeah. And I got the last review, which is short, but perfect from username, dude, what's mine say? On Friday, he says, F.P. Jorn of Tech Podcasts. stars. Nothing more needs to be said. Fantastic review. Do another review putting that in it. I feel like we need to give back for that. Well, speaking of watches, we got a promoted post from
Starting point is 01:42:36 Bezell. Let's talk about the Rolex day date, the president in 18-carat yellow gold with a factory diamond set bezel and green lacquer dial just landed on Bezle. This isn't just a watch. It's a status symbol, a power move on the wrist. Let's break it down. The watch of the elite launched in 1956. 1965, the day date was the first watch to display the day and the date in full. And so if you don't know about watch complications, you can kind of think about it in, there's a hierarchy here. You add each complication up. You start with the time only, just got the time on your wrist. Then you add a date complication. Date just tells you the date, just the number. Then day date is going to tell you it's Friday the 26. It's Tuesday,
Starting point is 01:43:18 the 18th, then you can get into more perpetual calendars, which keep the time out for years and years and years, annual calendars, which are right for 364 days of the year, and then you have to reset. And then you get, there's even an eternal calendar there now that goes out like a thousand years or something. And then there's moon phase complications, all sorts of complications. And so, but the day date is great because you just look down, you immediately know, hey, it's Tuesday the 18th. And this is the watch of the elite.
Starting point is 01:43:49 It's been the go-to for presidents, CEOs, and anyone who needs their watch to say, I make decisions that matter. I love it. Why is it called the president? The first U.S. president to rock the day date, Lyndon B. Johnson, by the late 60s, it had earned the nickname the president's watch.
Starting point is 01:44:05 That's pretty good marketing. Yeah, it's so sick. He's worn by world leaders, moguls, power players, this watch run things. Rolex doesn't make the day date and steal. Only precious men. metals. That's the rule. This one, 18K yellow gold forged in Rolex's in-house foundry because even their gold has to be better than everyone else's. It is a factory diamond set bezel.
Starting point is 01:44:25 Pure opulence. You know, we love opulence here. There's a difference between aftermarket diamonds and Rolex diamonds. Rolex hand-selects and sets every stone under strict standards, meaning this bezel isn't just flashy, it's flawless. Green lacquer dial. This is Rolex's power color. Rolex green equals money, prestige, and legacy. The deep lacquer finish on this dial gives Is it a richness that pops against the gold? And so, like, a lot of people see these watching, oh, Rolex, it's just like so expensive and it's just such a flashy thing. Like, I enjoy this stuff because I'm a nerd for this.
Starting point is 01:44:55 And I think it's really cool that like even the most minor little details have a story and and there's some sort of it's, it's as engineering minded as anything else. And so that's why I'm excited about this stuff. I think you need a day date soon because the first time we met, I distinctly remember asking you at some point. I was like, wait, so do you want to be like the president someday? I was just like, I was just trying to figure out, like, what you wanted to do. Turns out it was be a podcaster.
Starting point is 01:45:21 But, you know, that's a well-trodden path. The reality TV to the White House is well-established at this point. But, yeah, also, if you've seen Glenn Gary, Glenn Ross, the watch that Alec Baldwin wears is a gold Rolex day-date presidential. And he pulls it out. There's this iconic scene where he says, look at this watch. This watch costs more than your car. He says coffee is for closers, always be closing. That's where that comes from.
Starting point is 01:45:46 And that was another movie, I think, in the 80s or maybe 90s that popularized the presidential day date even more. And the presidential bracelet is particularly special here. It's the ultimate flex. It's the three link president bracelet was designed specifically for the day date. It's smooth, seamless, and also hides the class because true luxury is effortless. It's one of the most comfortable bracelets Rolex makes. So would you wear it? Let us know in the comments.
Starting point is 01:46:12 Think you can pull it off. Head to the Bezell app. Download it. And it's just, yeah, there you go. Oh, look at that. I mean, it's just so iconic. Do you, Jordy, do you know about how you should tell if you should wear silver or gold? Are you familiar with this?
Starting point is 01:46:29 The veins thing? No, I'm actually not. So there's this thing where a lot of women know about this with makeup. There's this idea of like if you have warm undertones or cool. undertones and then and then for a woman you should match your foundation to that and so there's this there's this critique that's going on on like instagram right now that I randomly saw which is like uh republican woman makeup is like they're i guess the left is like critiquing republican women for doing their makeup wrong and a lot of the things that they get wrong is that they have cool undertones but they're using
Starting point is 01:47:01 warm foundation and for men oftentimes it's it's if you have cool undertones you're better off with silver and if you have warm undertones, you're better off with gold. And so the way you figure this out is you look at your veins, and if your veins look blue, you have cool undertones. And if they look more green,
Starting point is 01:47:18 you have warm undertones. And so the classic example is just like, you know, I'm obviously like Swedish and very like northern. And so I have blue undertones, blue blood. Yeah. And more like Italian guy
Starting point is 01:47:30 is going to have greener undertones. And that Italian guy is going to look good in gold, right? Yeah. And so when you think about the, you know, The mafia guy, the Italian guy, the Tony Soprano. He's going to have more green undertones.
Starting point is 01:47:44 And that's going to lend itself to being able to rock a gold watch. Now, I recently bought not even a real gold watch, just a watch that happens to be gold. I think it's maybe gold plated. But just to try it on and see if I can pull it off because I want to dip my toe in before I really try and go full gold. But for now, I've been sticking with silver and I've been very happy. And I think it matches my tones and my colors. in my style. Same here. I'm glad that I'd never even heard of that rule.
Starting point is 01:48:11 Yeah. But fortunately, I'm blue. I mean, it makes sense. Like, look at you. And we're both rock and silver. Exactly. Nice. Well, let's move on to the next promoted post. You got to you got to stage his out. Well, I mean, this is like, yeah,
Starting point is 01:48:27 it's an ad for public, but it's really a blog post that we would talk about in the show anyway. It's from their founder and co-CEO, Leaf Abraham. He says, we ship a lot in all areas of business. By the way, he has a very unique Cassio, which we'll have to have him on the show sometime to show it off. But anyways, he should have to use the Cassio in the picture here. Oh, yeah, totally. Yeah. We'll have to get him on Bezell and see what he picks out.
Starting point is 01:48:54 And so he says, we ship a lot in all areas of the business. It's obviously cultural and one of the philosophies we embrace is what we call pace management. I thought there's an interesting little management tip for founders because Leaf is obviously. running like a very high performance organization and he probably has some interesting stuff to share. And so he says, time is the most precious resource we have and we must ensure that we manage it well. A new method we will be talking about frequently that you all should embrace his pace management. And this was actually just an email that he sent out to the team. And so it's kind of cool that he published this after the fact. This is a good example of going direct. Just like he didn't, he's not like
Starting point is 01:49:29 becoming an influencer. He's just taking content that he's already writing. Exactly. And then just publishing it. Yeah. So he says, as a manager, you will. are responsible, not just for the quality of the work, but also for the speed at which it gets delivered. Time savings compound dramatically over time. Letting time slip away costs everyone money, not just the company, but everyone of your coworkers. Here's how to manage pace. You got to take ownership of the pace, drive the pace of the project despite knowing that the urgency you instill might make some people uncomfortable at times. You got to break this project into small manageable pieces. You need frequent deadlines with quick check-ins. Let's regroup next week is the enemy. Check
Starting point is 01:50:07 in with the group progress at least every 48 hours. I like this. This is the, this is the Chris Saka thing. Like people ask, oh, when do you want this? Q2, Q tomorrow.
Starting point is 01:50:16 Isn't that what he said? Q Friday. How about Q Friday? I like that. And this is very similar. Yeah, check in more frequently. Don't throw things.
Starting point is 01:50:24 Yeah, yeah, next week. Keep teams small. Make sure every person knows exactly what they are responsible for. And that everyone else on the team does too. And then project specific channels. Sometimes it helps to create project-specific channels.
Starting point is 01:50:38 Dedicated space allows for focus discussions even on the smallest details. So some good advice from Leaf over at public. And if you're looking for a portfolio, if you're building a company and you're wondering if you're going fast enough, well, we're doing, we went from one day a week to two days a week to three days a week, five days, week. Eventually we'll be doing eight, nine, ten days a week. Ten days a week. Let's go.
Starting point is 01:51:09 Let's move over to Sam Altman. He's thinking about open source and stuff. He asked X for our next open source project. Would it be more useful to do an 03 mini level model that is pretty small but still needs to be run on GPUs? I thought you were saying he asked rock. I thought Sam was asking Rock for product advice or the best phone sized model we can do. And this was sitting right at 50-50. And then Dylan Patel chimes in from semi-analysis.
Starting point is 01:51:39 He says, I can't believe X users are so stupid. Not voting for O3 Mini is insane. You can literally already distill 40-Claude 3.5 deep-seek V3 into sizes that will run on phones. And it's just funny that like, yeah, obviously like that, the hackathon kiss just kind of generally wants. And continues to be a dominant poster. Phenomenal. Phenomenal. And should we report a murder?
Starting point is 01:52:03 Yeah. This one needs to be reported. You do it. That's too good. All right. So this is on BC Brags. He says, I'd like to report a murder. Delian says, I've ended up leading more rounds in the last four months than the prior three
Starting point is 01:52:14 years combined. Not sure what it means, but I guess we are so back, question mark. Chamath says means you've decided for whatever reason that time diversity doesn't matter in portfolio construction. Spoiler alert, it does. Delian says, ha, thankfully not too many 2021 SPAC shares in my portfolio construction. either quick 10x ratio, quick work. This one, this one, I'm surprised that, you know,
Starting point is 01:52:42 maybe Chamoth was down to get ratioed and just felt like, you know, becoming a supporting character in the timeline for the day. But coming for this one is the most dangerous thing. You're playing with a cobra on the timeline. Yeah, cobra. And then also, and then also trying to critique somebody for time-based portfolio construct. where Chamath, you know, basically spearheaded the largest investment into this, like, novel, you know, sort of financial product into highly speculative companies. Yeah.
Starting point is 01:53:15 in a very condensed time period. So it's just like kind of set yourself up for that. Also is Jamatha a seed investor? Like has he done seed stage investing? I don't think of him as like seeding big. Is in the other grok the GROQ? As at seed? I think so.
Starting point is 01:53:32 Okay. He incubated didn't he? I purely think of him as like growth stage and like a SPAC guy now. But maybe he does. But like yeah, Delian like, you know, I don't think like if you're doing seed deals like the time-based portfolio construction matter. Yeah, so he put 10 million into GROQ, GROQ, which was a Google team that spun out.
Starting point is 01:53:54 I saw a funny thing about GROC with the Q. Everyone's talking about GROC 3, which has a K. And Harry Stebbings is like, here's my interview with GROQ, and it's the GROQ. So he like knew that he should drop that to like, you know, farm off of the energy or something that people would pull over.
Starting point is 01:54:14 I love that was funny. Anyway, let's move on to the new president of Syria. I thought this was funny. This guy had quite the path. Bucco Capital bloke says, intern, al-Qaeda, then associate, al-Qaeda, then senior associate, al-Qaeda, then insurgent at various, and then presidents of Syria. And this is from an interview that the new president of Syria, Ahmed al-Shara, did with leading some small YouTube channel, I guess.
Starting point is 01:54:47 And he says, I joined al-Qaeda because I was a 19-year-old, and there wasn't any other venue to take part in politics. Also, because I want skills and experience. I already built all government institutions in Idlib before the offensive. This ensures we can immediately take over and prevent anarchy. And yeah, I mean, obviously, like, you know, the American propaganda during the war on terror was very much like, oh, it's like a bunch of like terrorists and caves.
Starting point is 01:55:15 They're just like completely running around. But it's like, no, they have time sheets. They have time cards and they have to do lists and tracking and inventory management. Their own payroll software. Yeah. Yeah. And like, uh, what's the big one? Like, what's the net suite?
Starting point is 01:55:30 Oh, uh, I, uh, ERP basically. Um, and yeah, I mean, uh, the, these like large terrorist organizations are like, there are, I mean, he's obviously joking with like the internet. intern associate, senior associate, but there are like career paths and like tracks that you can like move up in. Yeah, it's it's worth noting that if you look at terrorist organizations or drug cartels, you don't become these sort of nation state level players or, you know, multi, multi, billion dollar enterprises without being highly organized and having real leadership hierarchies and stuff like that. That's why I've joked before about Pablo Escobar being the greatest CPG founder of all time.
Starting point is 01:56:13 because even if you told somebody you can break every law under the sun, they would not be able to bootstrap a company to $22 billion of annualized revenue in a decade. We got to put deep research on this or the fans. Jordy and I were on a call with David Senra last night from the founders podcast, and we were debating how big was just the cocaine industry, I guess? How would you benchmark that against big oil? big tobacco. What's the tam? What's the market size? I was arguing that it was probably over a trillion dollars in like market cap if you applied some sort of price to earnings multiple on
Starting point is 01:56:52 however much money is going on. What was the total revenue? How big of a player was this guy? And should you put, I don't know why I'm blanking out of his name. Who's the greatest CPG founder again? Pablo. Pablo. Pablo Escobar. Should you hang his jersey in the rafters of, I mean, certainly greatest criminals of all time, but, you know, how big was his enterprise? And I wonder, I wonder how many employees he had working for him if he really, like, mapped out the entire org. Yeah. Is it like thousands or tens of thousands? But imagine if he could get the same revenue on that 22 billion as figure, he would have a hundred and potentially whatever comes after a trillion. Quadrillion. Quadrillion. Yeah. Anyways, I got another post here from Arfer Rock. If you're not following,
Starting point is 01:57:40 Arfra Rock. Great poster. He's come out the gates sharing sort of behind the scenes on rounds that are getting done. He'll typically talk about a round two to the three months before it gets announced. So his point of view is that he does it to help make rounds more competitive because you can imagine if you're a big capital allocator and you see Arfer Rock posts such and such round getting done and you hit up your associate and you're like, why haven't we seen this yet? You're like get on the phone with them. And so definitely I'm sure it helps create some sponsored posts with them. momentum no i think we should have him on the show for a segment where he speaks through like an anonymous like voice you know trin you know some some make him sound uh like steve jobs or something
Starting point is 01:58:20 like that and just talk about um you know all this stuff he's seeing but he's got an update here this was underreported uh usv came out with a new core fund in 2024 they have historically taken you know uh the approach of staying small focusing on returns focusing on the real craft of venting venture and that they're not sort of a high volume investor. They're making a handful of new bets, typically doing them very early. And so he outlines like their total fund performance, which their first fund in 2004 was about $100 million fund. It ended up grossing $1.5 billion, so almost close to a 15x there. And then you just go down the list pretty much every single fund except their 2019 opportunity fund, which for those that don't know, an opportunity fund is more,
Starting point is 01:59:16 hey, we have a bunch of early stage companies that have done well. And so the 2019 opportunity fund is the only fund on this list that isn't like top decile basically. And it's sitting at 1.3% IRA. And you have to imagine they sort of deployed that fund at the absolute top into their companies that they knew already that were good companies that just were kind of a little bit frothy. So, anyways could still turn around who knows but uh you know one of the goats certainly the the the new york city goat uh almost deserving of a place in the holy trinity but hasn't quite scaled and had the impact yeah haven't hasn't scaled yet um cool to see though you got to leave it as a trilogy you can't can't make it quadrilogy it never works um well let's move on to promoted post from
Starting point is 02:00:06 wander. We got a great spot up in Big Sur. Jordy, have you been in Big Sur? I have. I've driven through it. Some of my fondest memories as a kid are from Big Sur. I went up there with my family, went inner tubing down the river. I remember that really fondly. Founders Fund just had a big event out there for all the defense tech folks. It's really, it's really California at its best, right? It's coastal, it's rugged. You've got the mountains meeting the sea. Yeah. It's It's fantastic. Fantastic. So there's a beautiful photo here.
Starting point is 02:00:40 What's cool about the wander is that you know there's going to be fast Wi-Fi. So I feel like we can go stay there. We can still hit stream and not worried about reliability. It's actually we're not in a wander for PMF or die, unfortunately. And that's been like the number one issue is that we're trying to stream HD video. And so showing up to an Airbnb and not having, you know, quality Wi-Fi is a terrible experience. experience, Wander fixes that among a bunch of other stuff. And so Zachary Slayton, MBA says, what a great weekend spent in Big Sur.
Starting point is 02:01:13 Not only were the views and drive incredible, but our Wander House made the experience just that much better. Great experience, great service, amazing amenities. Highly recommended, take a look, share some beautiful videos and pictures. And this is so funny because, you know, 18 likes, pretty small post. We love it. It's a great post. But now you're going to get a video reply from this podcast. Zachary, welcome to technology brothers.
Starting point is 02:01:39 Just, you know, basically going forward now that we're partner with Wander, it's like anyone who posts about Wander is going to get random clips from us. But we love the post and thanks for sharing because this is a place where I might stay. And I'm glad to see it on the timeline. Amazing. I actually have some more breaking news. We got a company called High Touch raises 80 million at a $1.2 billion valuation. They came out of YC.
Starting point is 02:02:03 Okay. We'll have to ask Gary about them. Wow. This one came out of nowhere. I don't know what their last round was done at, but I'm looking on their site right now. And they're already working with Spotify, Oritsia, Warner Music Group, PetSmart, TripAdvisor, Whoop, Cars.com, Plaid, Ramp. So they work with Ramp, so they must be great. Callenly, GitLab, DocuSign, greenhouse.
Starting point is 02:02:25 And they do like marketing personalization tools with AI. Anyways, absolutely massive one. It's always a number of times recently. maybe it's a sign of a little bit of frothiness or just these companies are growing really quickly. You hear about a company for the first time when they're raising at north of a billion. And for somebody that's like highly tuned into
Starting point is 02:02:45 the sort of flow of new companies that doesn't happen that much. Yeah. Yeah. I mean, yeah, you go back to like, yeah, like hearing about Anderol 2016, like, yeah, their first round, I think they raised $10 million. And that was a lot. But it's like they raised it.
Starting point is 02:03:02 Everyone in tech heard about it. And it was, I don't know. I don't remember the first evaluation. It was probably like 10 on 100 or 10 on 80 or something. And now it's like you're learning about companies when they're already unicorns. But also, you know, B2B, you know, kind of like under the radar founders. That's kind of the nature of these things. But good luck to them.
Starting point is 02:03:19 And I'm sure there are some powerful metrics underneath that raise. Yeah. I guarantee it. Because this stuff's hot and there's a lot of marketing automation to do. So we'll have to do a deep dive on them. That'll be cool. Maybe have them on the show. Let's go to Blake Robbins.
Starting point is 02:03:33 he says careers are shaped by people not logos and he posts he's been changing up his format i like this some screenshot essays more or less uh bringing stuff to the timeline uh he says at 21 i joined ludlow ventures with no experience in venture capital instead of giving me a strict set of rules jonathan brett did something that shaped my entire career they trusted me to chase my curiosity they gave me agency when they had no every reason not to trust a new grad that trust rewired how i think about ownership risk and possibility. I got lucky. The conventional wisdom in tech is clear. Join a high growth startup to accelerate your career. The logic makes sense. Rapid growth creates opportunities. Responsibilities expand faster than org charts and you learn by doing rather than watching.
Starting point is 02:04:17 But this advice misses something fundamental. Who you work with for matters more than where you work. I completely agree with this. It's like if you have a good person that you're working with, it's way more valuable than just the logo. Yeah. Yeah. And they define your mental model for excellence. Tech loves to worship pedigrees. When you're when you're working, when you're coming out of, let's say you go to college, you come out of school. It's so hard to evaluate if people are truly world class. Like for me, I came out of school. I was working on a bunch of YouTube stuff, working with Sean and Connor at the Ridge. I love them as people. They were clearly very talented, but it actually took me five years and like to work with a bunch of other people to realize how
Starting point is 02:05:03 good they were. Yeah. It's good point. Yeah. And yeah, it's been it's been awesome to see. But again, it's so hard to figure out like just. Yeah. Obviously there are there are normal distributions and bell curves like all over even high performing organizations like the worst Harvard grad. Like the dumbest Harvard grad is going to be like way dumber than the smartest like, you know, I don't know, community college grad right? Like because there's going to be overlap in these in these, in these normal distributions. And that happens within companies too. He says tech loves to worship company pedigrees.
Starting point is 02:05:38 X stripe, ex ramp, Xanderol. These labels imply excellence, but they mask the real story. What matters is who mentored these people. Great companies don't create great talent by default. It's the leaders within them who nurture ambition,
Starting point is 02:05:49 challenge thinking, and build environments where people threat. Yeah, there's a lot of people that are like, oh, I was early at this company. And then you see some of the early photos. And you're like,
Starting point is 02:05:57 why aren't you in that photo? I've gotten absolutely cooked hiring for logo pedigree. Totally. Like not every time, but like almost 50% of the time. And the challenge is somebody joining as the, somebody joining as the, you know, thousandth employee at an iconic company.
Starting point is 02:06:17 They could be great. They could be great, but not even have an impact, right? Like they could just be great and sort of exist within the structure. And so, yeah, you just got to really, really press people and not let them sort of slide into roles based on having worked at Yeah. I mean, you think about the path of like Locky Groom who was not just like at Stripe. I don't even know if he was that early at Stripe, but he went into Stripe and then it very quickly became like the money guy for Patrick. Yeah. Right. And it's like he was running like their
Starting point is 02:06:46 ventures team more or less or like doing something with investing. And then Sam Altman set him up with a fund and like it was very quickly. He was on like a massive like, you know, high growth thing and got a ton of AUM. And that's very different from like, oh yeah, I went in and like I was kind of on a team that wasn't like super high performing and I just kind of like you know work nine to five yeah and like yeah what is what is what is uh Jeremy Giffon talk about like you want to be like off the he he talks about off the org chart yeah yeah yeah you know running the ventures program at like like exactly where the founders care about yeah yeah yeah yeah yeah no meetings no no no bosses but employed by the company that's like an ideal scenario if possible uh yeah it's fascinating um big news
Starting point is 02:07:31 massive promoted post from Sotheby's. A lot of people want to check this out. Banksie's crude oil from the collection of Blink 182's Mark Hoppest will headline the modern and contemporary evening auction at Sotheby's London on March 4th. So if you're headed over to this auction house,
Starting point is 02:07:49 check out the collection of Mark Hoppice from Blinkwinnity 2. I thought this is fun to share. I know a lot of you guys in the in the community are art collectors and often at Sotheby, so you want the heads up, and now you know. Let's move over to... By the way, Bo just texted me and said,
Starting point is 02:08:10 it cracks me up how little John knows about UFC because he saw that whatever we talked about it yesterday. So we're going on record right now. John, you've got to learn about the number one sport in America and we got to go to go to a card soon. I was playing it up a little bit, but it was very funny. that's great being like
Starting point is 02:08:33 who's this schmuck calling out my friend Beau I don't know who this is of course it's like a UFC guy anyway great anyway we love him
Starting point is 02:08:46 let's go back to wander Kyle Tivitz this is a big promotion episode lots of ads sometimes you do a lot of bucket pulls sometimes we did a lot of deep dive sometimes where they do a lot of bangers that's the whole point of the show
Starting point is 02:08:56 after this let's slam through a couple posts and get out of here Okay. So Kyle says one of the best designed app launch at launch I've ever seen. Stoke to be an investor. Great job at the Protector team. So Nikita Beer has been advising a company called Protector, which allows you to book armed agents. They're debuting in Los Angeles in New York City and number three on the app store. And so this is kind of the latest Nikita project. He pumps out a lot of stuff. What do you? Well, I don't. I think this is a company he's advising. He's advising. Yeah. You know, potentially through intro. So I thought this was interesting because back in 2014, Uber was really hot and there was an Uber for everything. And there was a company that went through YC with this, basically this exact idea. It was called like Bouncer or something.
Starting point is 02:09:43 I forget what it was called. There's like Uber for Bouncers. I sent it into the chat at some point. But, you know, maybe that idea wasn't, it wasn't the right time for that. But maybe this is the one. What's interesting is that disintermediation is all. always a risk with these platforms. That was the problem with the dog walker apps is that is that once you find a good dog walker
Starting point is 02:10:05 on a dog walker app, you just say, hey, let's not use the app. Just come every week at this time. And so that's always been a risk. Whereas with Uber, like even if I have a guy who's reliable to take me to the airport or like, you have a guy or like, oh yeah, I know a guy who gave me his card and like if I'm going out with friends for a long time and I want to rent the limo for the whole weekend or something like I'll call him. But, you know, I'm not just going to have a guy follow me around all the time.
Starting point is 02:10:31 Yeah. Yeah. But with this, it really comes down to trust how much, you know, with. So I'm sure there's an opportunity for protector, right? Just the pure novelty of, oh, I just called this like armed security guard to where I am. Jeremy talks about this, right? Like there's lots of opportunities of take things that the ultra wealthy love and then make them accessible to the masses through these sort of on demand platform. So I'm sure there's a market opportunity for this.
Starting point is 02:10:57 I'd say overall, again, you call an Uber, you don't care who picks you up as long as the car is generally clean and they're fast, whereas things like this, security is ultra-high trust, right? So you would much rather have somebody that you know well and that you know has like great training and that you have a good relationship with because if they're needed in any way, you know, you want to know that you can rely on that. I think that maybe the app can actually do a good job there because if they're onboarding agents and they have a very rigorous process, it's totally possible to have an app.
Starting point is 02:11:30 At the same time, if the customers don't demand that, you know that the apps will and the platforms will coalesce towards something that's a little bit sloppier. But that's fine because if you're on a marketplace app and you're just like, look, I just want to be in Tulsa and I want it to be the cheapest thing ever and I don't care if the furniture's from TEMU, like, yeah, there's an app for that.
Starting point is 02:11:52 But, you know, this, it's kind of, you know, up to them how they curate the marketplace. It will be interesting. I have no idea how he got this to number three in the app store so fast. He's a master. Because there can't be that many people. You're telling me there's more people booking armed agents than booking VRBOs. There's ways.
Starting point is 02:12:13 So here's a potential way. So if you use these sort of algorithmic feeds to generate views on your content, let's say you're producing a bunch of organic content and running ads, there's ways to do these sort of like pre-downloads or almost like pre-ordering the apps where you can like get somebody to say like I want to I want to download this and then when you release it you can drive let's say a hundred thousand one day and then you'll rank even though even though you know maybe the next day you won't because I mean I love the idea of armed agents being on demand I think that it's probably like a very good thing and will increase safety and reduce crime which I think is good
Starting point is 02:12:49 but I would hate to live in a country where an app for both booking armed agents is more is more popular than nice vacation rentals you know that's like a very like our society is truly degrading if it's like oh yeah people are like like the like the gun app is more popular than like the gun store is more popular than the luxury good store anyway good luck to the team awesome launch love to see that Nikita's working with it very interesting to follow along and see where that goes anyway we got a promoted post from Konigsegg there's a 2021 Konigieg rigera out obviously you're going to have to bid against Sam for this one. Yeah, you think they posted this knowing that Sam would see it, not people to help himself?
Starting point is 02:13:29 For sure. For sure. You know, they go on X. For those that don't know, Sam Altman loves Kona Seggs. He loves all sports cars. He's a McLean Affle. Absolute. Fiend.
Starting point is 02:13:39 He loves them, you know, as he said, he's doing Open AI because he loves it. And he's also, you know, buying cars because he just loves cars. He's a simple guy. I'm very pro Sam Altman, the car guy. That's one of the main reasons I'm really. He was saying that he was using deep research to find this sort of obscure accurate. Yeah. Yeah.
Starting point is 02:13:58 I guess he was successful. Obscure. It's an NSX, bro. He could have said, I need to find one with this sort of. Sure. Sure. Yeah.
Starting point is 02:14:05 That's true. That's true. Yeah. Anyway, zero to 60 in less than three seconds, top speed of 250 miles an hour. If you're looking for a new daily driver, maybe you work in AI. Maybe you just raised a billion. Did some secondary. Pick up a Konexeg.
Starting point is 02:14:20 Yeah. Maybe you work at PETA. and you see the money coming from the for-profit conversion, and you're like, yeah, I'm going to be rich. Pick this up, let everyone know that you're serious about the for-profit conversion. When you pull up to the investor meetings, you're like, really, Pita?
Starting point is 02:14:36 And they're like, well, he's already got the Konigsegregara. So, yeah, he must be the real deal. He must have a really good plan for how he's going to monetize this going forward. So we love to see it. Anyway, we quote tweeted this on the PMFER die feed. But we thought we'd cover it here just to throw a reply towards Starter Story. If you're not familiar with Starter Story, YouTube channel that profiles does video interviews
Starting point is 02:15:03 and profiles on independent builders, hackers, entrepreneurs, and they did one on Blake, our boy in the cage. And so Starter Story says he taught himself how to code with ChatGBT. He built three iPhone apps, made $10 million in revenue. We called him up and asked him to break it all down. They talked for hours, but cut out all the fluff to give you all the alpha. I love it. And so there's 20 minute video.
Starting point is 02:15:28 Blake is an absolute beast. He breaks down a bunch of different business ideas. And if you want to know more about Player 1 in the cage, you can watch this 20 minute video to get an idea of who Blake is. An absolute dog. An absolute dog. It is 107. How are we doing on time? We're good.
Starting point is 02:15:45 Cool. I think we should wrap. Yeah, let's wrap pretty soon. Let's go to. Uh, do a lingo. Oh, this is good. Trace Stevens is doing an event on March 6th. If you're in San Francisco, go check it out.
Starting point is 02:16:03 Lee Marie Braswell over at Kleiner Perkins. Another holy Trinity venture capital firm. She says, join me on March 6th at an event with Trace Stevens where he, he's discussing one of my favorite posts ever. Choose good quests. Link in comments. Hat tip to his co-author, Markey Wagner. an absolute dog as well. Tray is one of the most mission driven people I've ever met, as well as an inspiration for practicing Christians in tech when Trey talks about both building great
Starting point is 02:16:32 companies while also finding purpose. I listen. If you haven't read Choose Good Quest, it's fantastic. I highly recommend it. I think he should turn it into a book. I hope he does. But you can go hear him talk about it at this event. And so go find the Luma and go to this event. If you're in on March 6th. Anyway, I think that's a good place to close out. Oh, we got to talk about your bags. You've been, you've been killing it with Nvidia. And somebody had the same idea as you.
Starting point is 02:17:06 McKay Wrigley says, can we talk about how unbelievably stupid the market reaction to Deepseek was? Compute got more useful and everyone sold. Literally today for GROC3, Elon goes, oh yeah, we bought another 100K of H-100s and mentioned a new 1.2 gigawatt data center. Nobody is going to buy less GPUs. And this shows that the price of Nvidia is exactly what it was a month ago, right, before the deep seek drop. And I think you bought the bottom.
Starting point is 02:17:33 I actually, yeah, when, when deep seek launches Sunday, they have their fake run up in the app store. Everybody is sort of talking broadly about Jevin's paradox and all this stuff. It just seems like it was to, for a company to go down 15% like that, it just, seem way oversold. And I have no idea what Nvidia stock does over the long term. But yeah, just bought right as everybody was panicking and just, you know, back up, you know, up 15% since then. But making it look easy, Jordy. Making it look easy. But we are in the news business. We're in the casting business. Not the financial advice business. So good luck out there. Stay safe. Avoid doing anything that your mother would not approve of. Well said. Have some good etiquette.
Starting point is 02:18:21 Focus on your manners. Have you coined that probably? I'm working on it. What would your mother say? Yeah. Too many. That's my current philosophy for how you should behave yourself, especially on the internet.
Starting point is 02:18:34 What would your mother say? Make your mom proud. What would your mother say about you launching that meme coin and rugging it immediately? What would your mother say about you getting in a petty fight with another technology leader publicly on X? What would your mother say about you asking your date to split the check? embarrassing. Don't do that.
Starting point is 02:18:52 You got to dive into that one next time. Yeah, we'll cover it eventually. We're going to be doing a big etiquette deep dive, big manners update, giving you the, you know, how to use each fork, how to tie a tie. We're going to be working on that, how to drive stick. These things are important. How to make your bed. Anyway, leave us a five-star review on Apple Podcasts on Spotify and keep watching us and expect
Starting point is 02:19:15 a lot of new updates. We're cooking. We are cooking. Thanks for watching. we will see you tomorrow. See you tomorrow. Bye.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.