TBPN - TML Inkling, California Forever?, TSMC Capex | David Baszucki, Everett Randle, Eric Glyman, Jordan Black

Episode Date: July 16, 2026

(01:38) - TML Inkling (11:31) - 𝕏 Timeline Reactions (15:15) - California Forever? (17:27) - TSMC Capex (18:32) - Everett Randle is a general partner at Benchmark, where he invests in ...AI, enterprise software, and frontier technology companies. Before joining Benchmark, he was a partner at Kleiner Perkins and previously invested at Founders Fund, BOND, and Vista Equity Partners, backing companies including Anthropic, Rippling, Flock Safety, SpaceX, and Chainguard. (48:32) - Eric Glyman is the co-founder and Co-CEO of Ramp, the AI-powered finance automation platform helping businesses manage spending, accounting, procurement, and corporate cards. Previously, he co-founded Paribus, which was acquired by Capital One, and is known for building software that helps companies save both time and money through automation. (01:07:19) - 𝕏 Timeline Reactions (01:16:36) - Jordan Black is the co-founder and CEO of Senra Systems, a company applying AI and advanced software to modernize precision manufacturing for aerospace and defense. He focuses on building automated, software-defined factories that dramatically accelerate the production of complex, high-performance components for the next generation of industrial and defense technologies. (01:28:29) - David Baszucki is the co-founder and CEO of Roblox, the online platform where users create, share, and play millions of interactive 3D experiences. An engineer and longtime software entrepreneur, he previously co-founded Knowledge Revolution and has led Roblox’s growth into one of the world’s largest gaming and creator platforms. TBPN is made possible by:Ramp - https://ramp.comPublic - https://public.comCisco - https://www.cisco.comConsole - https://www.console.comCrowdStrike - https://www.crowdstrike.comFigma - https://www.figma.comMongoDB - https://www.mongodb.comNYSE - https://www.nyse.comRailway - https://railway.comShopify - https://www.shopify.comCodex - http://openAI.com/codexFollow TBPN: https://TBPN.comhttps://x.com/tbpnhttps://open.spotify.com/show/2L6WMqY3GUPCGBD0dX6p00?si=674252d53acf4231https://podcasts.apple.com/us/podcast/tbpn/id1772360235https://www.youtube.com/@TBPNLive

Transcript
Discussion (0)
Starting point is 00:00:00 You're watching TVPN. Today is Thursday, July 16th, and we are live for the TVPN Ultramm, the Temple of Technology, the Fortress of Finance, the Capital of Capital. Let me tell you about Ramp.com. Time is money. Say both. Easy-use corporate cards, bill pay, accounting, and a whole lot more, all in one place. We have a very special show for you today because we have Tyler Cosgrove guest hosting.
Starting point is 00:00:21 He's here in chair. And I know I'm going to make mistakes today because I always throw it over to Jordie. I got to remember this. Tyler, it reminds me of this video from Warren Buffett. We got to play it to show what I'm going through emotionally today without Jordy in the TVPN Ultradome. Let's pull up this video of Warren Buffett throughout the years at the Berkshire Hathaway shareholder meetings. Charlie, how do you feel about that? Charlie, me, are you?
Starting point is 00:00:50 Charlie? Charlie, I'm so used to. Oh, you got to play it from the beginning. Years and years, Warren Buffett. always goes to Charlie after he gives his comment. He gives his speech and then he kicks it over to Charlie. Charlie, through the years. Charlie?
Starting point is 00:01:10 Charlie. Tearjerker. Yeah. Makes me want to cry. It's emotional. Charlie me. Charlie. That's Greg Abel.
Starting point is 00:01:21 So if that happens today, I apologize. But there is a ton of news we're going to be going through today. We have a packed lineup as well. We have Ev Randall, Eric Klein, and Jordan Black, Dave Zuki from Roblox coming on. We have a great show, and there's a lot of news. The first big story is, of course, Thinking Machines' new model has released.
Starting point is 00:01:41 Miramaradi's AI startup release its first model in bid to loosen AI Giants' grip. We're going to be talking about open source, closed source, where the frontier is, national geopolitical model moves. And some people had an idea. This was going to happen. Some inkling.
Starting point is 00:01:56 Oh, they have an inkling. Yeah, that they're going to release them. Did they? I didn't have an inkling that they were going to jump into the open source rate. I think it's actually, I think it makes a lot of sense given the Tinker API, right? The whole business is, you know, you're doing fine tuning on open source models. Yeah. It makes a lot of sense that they're going to have their own. Yeah. That, you know, you can easily it's sort of like they are set up as a business to launch an open source model without it degrading any other piece of their business because the Tinker API, that fine tuning that they do, that integration
Starting point is 00:02:26 with the customers that they have actually benefits from open source. Yeah. And then they can go to their clients and say, look, you know, it's the red hat model at any time you can leave because we are giving you the weights of the model, open source. You can do whatever you want with them. But keep working with us because we're helping you a bunch and we're making money in the process. So thinking machines lab, the first model is an open weights model designed to chip away at the lead of open AI Anthropics, says the Wall Street Journal. Former Open AI technology chief Miramirati is betting on more customizable artificial intelligence models to chip away at the lead to the frontier labs, such as her former employing.
Starting point is 00:03:00 player hold over the technology. TML, a company led by Maradi, released its first AI model Wednesday and did it with open weights, meaning that others can modify it with their data. Called Inkling, the model has 975 billion total parameters, making it far smaller than estimates of the most advanced closed source models. Yeah, but it was true of experts. So only, I think the number is 41 billion of those are actually active. At any moment.
Starting point is 00:03:27 Yeah. So this is definitely on the bigger side of open source models. But like that number, it's not, these aren't like dense models like what you traditionally think of. Sure. Of the models like, you know, four years ago. Yeah, yeah. Muradi told the journal, we trained it to be a broad, balanced foundational, foundation model,
Starting point is 00:03:45 strong across many domains, flexible enough to adapt. Inkling is not the strongest overall model available today, open or closed, which is a different frame of reference for many of these model launches. Everyone's been jockeying for the frontier, even if they're not world class at everything. Usually when they launch, they say, oh, well, we're best at something or we're best at this, but a different tone, different communication strategy. And I think it's being well received. I think people are having fun with it.
Starting point is 00:04:15 Yeah, I mean, I think the main pitch here is that this model is, like, uniquely set up for the Tinker API. It's built to be fine-tuned. Sure, sure. That's the whole point. Got it. D.D. Das says, thingy machines just dropped the best open-weight AI model. outside of China. And obviously that is a big topic of conversation as business leaders in the United States have some policies and some reticence about using Chinese open source models,
Starting point is 00:04:39 even if they're not worried about the dystopian, you know, Manchurian candidate hidden inside the weights. Maybe they just want to be aligned with a U.S.-based company for a variety of reasons. Inkling beats Nemotron 3 Ultra and benchmarks put it between Kimmy K2.5 and 2.7. Of course, there's also news today that Kimi K3 will be launching and is another jump forward, but there's back and forth between some AI researchers around what's going on there, how long that strategy will continue. So, D.D. says, many were contending to this throne, but think he has come out on top. Really solid release and will pair well with Tinker. So there are some benchmarks that you can go and dig into if that's your thing. There's another very bullish take from Jack Morris of Engram Labs. He says, people are underestimating what a big deal this is. This is the only open weight model that's trained without distilling from OpenAI or Anthropic.
Starting point is 00:05:44 Kimmy distills, GLM distills, Qen distills, Nemotron distills, Kimi and Deepseek, which counts. Basically, a fully different tech stack. The first pure open frontier coding model, very exciting. And there's a community note on this. Can you break down exactly like where are they standing on the shoulders of giants? Where are they not? Yeah. So, yeah.
Starting point is 00:06:04 So I think this tweet is not exactly true. In the blog post, they say to bootstrap post training, we ran an initial supervised fine-tuning on synthetic data generated by open weight models, including Kimi K2.5. Okay. So I think that's, like, generally how people think of, like, distillation, that they mean something related to this. Sure. So I think that actually is not that different than what people like. at Nvidia with Nemetron did. Sure.
Starting point is 00:06:29 So this is not like very new, I think. But it's sort of like the lightest touch of distillation that could happen because it's just one piece of the pipeline, one small amount of data. It's not one of these scenarios where we're like, why is it identifying as Claude? Or why is it just saying that it's chat GPT? But it is funny because you can kind of say like, oh, well, if this is like kind of distilled on Kimi and Kimi's kind of distilled on closed source. Yep.
Starting point is 00:06:54 Well, then maybe you get some kind of two-layer displacement. this sort of round trip loop. But at the same time, there's probably something to be said for the more layers of abstraction, the more ingredients you pour in, like, the distillation becomes weaker and weak. Yeah, and I think there's also an important question of like, well, okay, they're doing some level of distillation. Like, why? Because you can either be like, well, they're just doing it to save time, whatever. Like, obviously they have these capabilities, but there's no point in, you know, doing everything over again.
Starting point is 00:07:22 You might as well just use what's out there already. or is it because actually like these capabilities that they get from this, this, you know, distillation light, whatever it is, are those actually super imperative to the model like being good? There was a reaction from Engram, the company founded by Jack Morris. First, let me tell you about console. Console builds AI agents that automate 70% of IT, HR, and finance support giving employees instant resolution for access, requests, and password reset. So Engram says our founder, Jack Morris, recently issued some unfounded claims that got community noted. we deeply apologize for the confusion caused by his original post, the follow-up post, and the follow-up to the follow-up post. Nevertheless, we stand by his conviction in his own takes and in strong
Starting point is 00:08:03 open-source models like inkling. And there is a question of like distillation is a vague term where it's not a binary thing. And if it's not in the pre-training data, does it count? I think it's also very much this mean people love to talk about on X. They like to kind of, you know, scapegoat, oh, you know, it's all distillation. That's the only reason Chinese models are good. Yep. Is that actually true probably? I mean, Anthropics head of national security policy, Taran Chabra, accused Zipu, Z.AI, of distilling both Claude and OpenAI models for GLM 5.2 at the Aspen Security Forum earlier this week. This is from Vincent Chow, senior AI reporter at SCMP. He said it's the first time that they've named Zipu specifically after previously calling out Deepseek, Alibaba, Moonshot, and Minimax join the club at this point. They also accused Deepseek of continuing its adversarial campaign of distillation.
Starting point is 00:08:57 Anthropic is now shutting down distillation accounts on the order of millions accounts per week. That is crazy scale. I mean, you always think about it as like, oh, there's like shut down that one company or shut down that one block of IP addresses. But when there's a really, really distributed attack, we've even heard about whole companies that just like resell clawed tokens. or GPT's 5.6 tokens. And that looks like a reasonable business because it's just a rapper company, of course. You want to work with them. But then you don't realize that on the other side, who are their customers?
Starting point is 00:09:34 Why do they, why do they get to 100 million run rate so quickly? Well, maybe it's a lab that's trying to distill through this pass-through entity. And of course, it's hard to like watermark the tokens once they go out the API and they get passed through some other system. And they can go through other countries, all sorts of things. So millions per week, that's, That is crazy. That's got to be really difficult to, it's a game of whack-a-mole.
Starting point is 00:09:57 They say, GLM is, quote, probably the most advanced Chinese model on the market now, which poses significant cyber security challenges. They hinted that Anthropic will expand access to mythos to ensure fair fight for cyber defenders. And they said that distillation challenge is real in shrinking U.S. lead in AI, suggesting that the U.S. government could do more to clamp down on Chinese model adoption globally by working with allies similar to trusted telecom efforts like Huawei and ZTE. So obviously a hot topic and people will be debating how exactly how heavy of a hand the government should be.
Starting point is 00:10:33 Yeah, I think this release is also makes a lot of sense. I think it was a week ago there was that article about like Beijing, Islingat Kerbing overseas access to Chinese top AI models. Yeah. Right. So if you're not going to be able to access the Chinese open source, right, it makes a lot of sense to start doing American open source, Western open source. Yeah, it really does feel like there's a pretty wide.
Starting point is 00:10:53 It feels very well-timed. Yeah, it seems like there's a pretty wide gap between at least what's reported preferences from Beijing, from the actual government and the companies. The companies are like, send us all the Nvidia chips. Let's distill everything. And then let's open source these models and compete internationally. And Beijing's like, hey, maybe we need like, you know, an indigenous supply chain here. Maybe we need to, you know, lock down these models, keep our lead over here, go work internally. I don't know. But if you're worried about security, head over to CrowdStrike. Your business is AI,
Starting point is 00:11:25 their business is securing it. CrowdStrike secures AI and stops breaches. This was an interesting post from Grace Lee. She asked the question, how did Open AI Sol finally learn design taste? She projected a thousand websites by GPD 5.6 Sol into a design manifold and discovered big holes. These holes were where GPD 5.5 previously generated outputs with, quote, bad AI smell. So there were, you know, there's these tells in any AI model, but it's not this, it's that, the M-Dash. Once people start identifying those as, ah, we don't like that, it's too AI, it's too generic. One way it appears to actually sort of beat that out of the model is to actively avoid those specific things. And then she calls out three particular.
Starting point is 00:12:15 areas that have been avoided as anti-patterns. One, the bento box layout in dashboards. Two, large typefaces and hero images. I did realize that sometimes you would ask for a website and you would just get a massive block of huge text. And that's just not the way when you land on a beautiful website. It's usually there's more wordsmithing. There's more terse language. Well, you know, you make your first website with five, six old or whatever and it looks really good. Yeah. And then you make 10 and they're like, oh, okay, there's actually, a lot of patterns I'm seeing. Totally.
Starting point is 00:12:47 And you can start clocking them, like, everywhere you see. You see a lot of like clodisms, whatever on general design. You see them everywhere. Yeah, especially if you don't come with any opinion. It's like the, you know, high border radius on the edges. There's a little color on the side. Yeah, yeah. Especially if you don't come with like an opinion.
Starting point is 00:13:03 If you come, like we made a whole vibe coded website in Codex for just the latest episode of Nick Bostrum on Joe Rogan. and I wanted it to look like a UFC fight card and a fight promotional website. And it doesn't look like any normal AI slop. I mean, there's still like AI generated images. It looks like AI, but it doesn't look like, oh, yes, that's the bento box layout, or that's the offset layout,
Starting point is 00:13:30 or that's purple, or it's stealing from linear. It's a completely different style. So if you at least inject, like, one reference point, you'll usually land somewhere. Yeah. I mean, it's interesting, though, this makes it seem like, you know, the new model is not necessarily, it doesn't have like higher variance with outputs it gives, but we basically just found like, oh, there's certain examples that people really don't like,
Starting point is 00:13:51 let's just remove those. But you're not necessarily like making the model more creative by removing these like patterns that always comes to. Yeah. Well, you're giving like the flavor of creativity and maybe that's. Yeah, but you can imagine if we kind of keep the same model for six months, we'll just notice new patterns. Totally. And you'll have this kind of thing problem.
Starting point is 00:14:11 But at the same time, like mid-jurial. journey had like a very distinct look and people like that look at least some people. And so if you can if you can quickly personalize and customize and land in a place where someone whose job is designing dashboards is happy every time with the layout. Like there is somewhat of a platonic ideal for some of these design patterns. And at the same time, if you're, yeah, working on certain, like there's certain designs that are just like solved. to make the call to action green, blue, not red, right? And so some of those do need to be consistent. And then also I imagine that many folks who are using these tools in enterprises are doing, even if it's not a fine tune, they're uploading a reference for everything that they're designing. So it's consistent with the brand that they've designed. Anyway, let me tell you about the New York Stock Exchange.
Starting point is 00:15:07 Want to change the world? Raise capital at the New York Stock Exchange. Just do it. Just do it. Stop making excuses. California Forever lost a $3.2 billion shipyard project from Defense Startup Seronic after the company chose the port of Brownsville, Texas over Solano County. Oh, no. You're not supposed to clap for that.
Starting point is 00:15:31 We got a Texan in the studio who's happy about that. This is bad news for California. We want California to have a whole bunch of amazing stuff. Brandon Corral who wrote the newsletter, TPPN.com today. was very disappointed about this. The automated shipyard, known as Port Alpha, Port Alpha, is expected to create roughly 10,000 permanent jobs along with thousands of union construction jobs. Supporters say California's lengthy approval process ultimately cost the state.
Starting point is 00:15:58 One of the first marquee tenants that California Forever had pointed to as evidence, its planned city could anchor a new era of American shipbuilding. Joshua, executive director for the California Alliance for Jobs, said California failed to move with the urgency the product required, quote, while Texas moved quickly and aggressively, thank you, Jackson. California could not provide clear expedited approval process needed. He said, calling the decision an enormous loss
Starting point is 00:16:25 for Solano County, California workers, and our state's manufacturing economy earlier this year, California Forever signed a 40-year construction labor agreement covering 70,000 acres, and labor groups later backed legislation to fast-track environmental review and permitting for the proposed shipyard, the legislation has yet to advance.
Starting point is 00:16:41 Instead, Texas, This has approved a $211 million tax abatement package in June to secure Seronics investment at Brownsville, roughly 20 miles from Starbase. Labor leaders said they warned that without expedited approvals, the project would leave the state, then that is exactly what happened. A project insider told the San Francisco Chronicle that California forever itself remains on track, but acknowledged that losing a major defense contractor sends a powerful signal about the state's ability to compete for large industrial investments. But I like Yan, I like the California Affair Project, and I'm excited for where he takes it next. I'm sure he's on the hunt for the next major tenant.
Starting point is 00:17:21 But we have our next guest soon in the waiting room. We'll bring in Everett Randall from Benchmark in just a minute. Got to talk about TSMC. Yes, TSMC. Where is this in the stack? TSM both beat earnings and raised their CAPEX guy. They're spending a lot more money. And...
Starting point is 00:17:42 Fledged to invest an additional $100 billion in the U.S. plans to spend a record amount, cementing its position atop the global semiconductor supply chain. Yes. And yeah, they're investing another $100 billion in Arizona Fabs, but people are worried about
Starting point is 00:17:59 overspending. The news is that NASDAQ dropped 1% on TSM's spending plans offset by strong results. Very, very, very odd story that in a time when even TSM, which was not a particularly AGI-pilled company for a long time since they've been through the smartphone boom, so many booms and busts, so many cyclical build-out cycles, that when they are finally like, yes, now is the time, people are, I don't know. They're skeptical.
Starting point is 00:18:29 But we have Ev Randall in the waiting room. Let's bring him in to the TBPN Ultradown. Ev, how are you doing? Hey, gentlemen. How are we doing? Welcome to the show. George's traveling. We have Tyler Cosgrove.
Starting point is 00:18:41 We have Tyler Cosgrove. On our team, a guest host today. Very excited to have you. How are you doing? How is the year going? I'm interested in just like your general state of the markets. You recently said, you said, it's an incredibly disorienting time to be investing. What's disorienting?
Starting point is 00:18:59 You just put money in every company and they all go up. That's certainly what it feels like for the last 18 months, which is scary. in and of its own. Yeah, I did, I was on, you know, my partner, Jack Altman's podcast, I'm capped with, with Tray and Delian over at Founders Fund. And I was saying that one of the scariest things of today, and then we can go to the disorienting part. But one is the scariest parts is this feeling of inevitability.
Starting point is 00:19:27 Like, it kind of feels like sometimes, oftentimes it does feel like as in venture investors, we are monkeys throwing darts at a dartboard. And, you know, you never really know when, like, like what number you're going to hit. But imagine you're that monkey and you just keep hitting like the triple 20, like every time you throw it. And you're like, this is weird. And, you know, your response to that usually is just like throwing a lot more darts.
Starting point is 00:19:54 So the last 18 months, the last 24 months, everyone I think is feeling, feeling, you know, very, very confident in the market or just like how all their companies are going. And all these companies are growing extremely fast. And so everyone is investing a ton of money. It's all getting marked up very, very quickly. We obviously had the SpaceX IPO, which was huge for several firms. We're probably going to have the open AI inthropic IPOs that are going to be huge for a bunch of firms.
Starting point is 00:20:19 There's just this sense that, like, we all know that AI is going to change the world in so many ways. We all know that, you know, space is big, defense is big, nuclear energy is big. All these things are big and therefore, you know, more and more money into these things and they just keep getting marked up. And the last time I felt like investors had this much of a sense, up inevitability. Like, yes, it's expensive, but like it's going to get marked up in six months. So therefore, we should do it, was the summer and fall of 2021. And we all kind of know how that ended up.
Starting point is 00:20:51 Yeah, I want to talk about what's similar to 2021. What's different. But first, there was something, I don't remember exactly who said it on that podcast that you did with Jack, Dellen, and Trey. But there was this concept of when a firm has one of these huge power law wins, like a SpaceX and an Anderol and anthropic and open AI. Then the liquidity is coming and they're, the phrase that was used on the podcast was playing with house money.
Starting point is 00:21:18 Does that mean like literally recycling or just your LPs are more excited to back you, write bigger checks, like the purse strings are looser? Like what does playing with house money mean? How does it feel? What are the risks? Yeah, a useful analogy here is maybe like in sports. So like let's say, you are up to bat in baseball in the World Series,
Starting point is 00:21:43 and you hit a grand slam. And then the next at bat, you hit like another grand slam. And so you're like, okay, I've hit two grand slams in a row. Basically whatever else I do for this game, like I did my job. Like I'm good. Like I'm great. And counterintuitively, honestly, that might make you better because you're just swinging free. You're swinging away.
Starting point is 00:22:06 You're taking a lot of risk. You're like, screw it. I've already done my job. I've already, you know, contributed to my team and scored a bunch of runs from my team. So, like, I'm just going to swing away. I think that very much is the case around the industry where if you have a lot of exposure, especially in Anthropic, but also an opening eye and a few other companies, a lot of these firms have sprinkled their exposure across several different funds. So it's not like you invested in Anthropic in one fund.
Starting point is 00:22:36 fund. I know funds that have Anthropic in like eight of their funds because they're like this is like this is the this is the golden goose. The Masa golden goose. You know, they're going to put it in every fund. And so then now they're like, look, all of our funds look great. They're going to look even better when anthropic IPOs. So like, let's take some risk. Let's like, you know, let's swing away. And honestly, it might, it might do them well.
Starting point is 00:23:00 But that's the whole concept of playing with house money is like anthropic's going to boy so many fund returns across their portfolio of fund. that you might, you're like, look, look, we don't need to play super conservatively from here on out. And that feels like something that is uniquely different than 2021. 2021 felt like much more of a broad-based bubble in the sense that there were power law winners at the time, but you didn't have the same effect of if you've spread this one company across all of your, maybe I'm just not remembering, but I don't remember it that way. I remember it much more like there are so many SaaS companies. companies that are going to go from 100 million ARR to 2 billion, 1 billion, that we can underwrite them all, even though they are competing.
Starting point is 00:23:45 And then there's this AI wave that's coming. But what do you remember about 2020, 2021 that was similar or different? It feels like it was a little bit more driven by spreadsheets and actual growth math as opposed to a major technological shift. But what was that era like for you? It's funny. Yeah, you still had like, obviously, you didn't have the extent of IPA. IPOs of like a SpaceX and opening high or Anthropic. But you know, you had like DoorDash.
Starting point is 00:24:11 You had, you know, Airbnb. You had Palantir. So you had like, you did have some liquidity, you know, New Bank, a few others. So you had like, there was a lot of money that was made. But it wasn't, you're right that it wasn't to the extent of Anthropic where you're like, oh, we had new bank. So therefore like we can like go to the beach and just like take a bunch of risk. And Palantir in particular was, I mean, what, 10 billion IPO and not.
Starting point is 00:24:36 really sprinkled across many funds, very concentrated, and sort of a black sheep of venture for a long time. I don't know if that's the right term, but, yeah, you're totally right. Like the actual IPO, like, you know, one, it didn't do well. Yeah. I think the share price was, like, stuck at, like, $8 for, for, like, a year or two. Crazy. Or three years.
Starting point is 00:24:57 It took a while for it to take off. Yeah, yeah. See, you didn't, you didn't have nearly as much money. It's funny. I actually went back. I remember in, I think, in, like, $204.20. Yeah, 24. So a couple of years ago, I was like, I want to go back and like read.
Starting point is 00:25:10 Like, what were we doing? Like, were we all high? Like, what, like, what was going on? Like, were we, like, were we just drunk? Yeah, there was this guy who wrote this whole piece about like aggressive crossover funds coming in. That was a crazy moment. That was a crazy moment. But I was like, okay, like, this is like what, like, what was.
Starting point is 00:25:27 Like, if I was to go back and read investment memos, sure. Like, and put myself in my mind then. And not me, but just like the industry's mind. Like, was this all rational? And I think that the really tough part about 2020 and 2021 was that from like the last two decades before then, all of these trends that we were investing behind were very secular. So if you like look up the e-commerce penetration rate as a percentage of total commerce in the U.S., it's like the most straight linear line you've ever seen. But then 2020 happens, we all get locked up. And there's like this insane acceleration.
Starting point is 00:26:01 And so tech investors were always, you know, taught and trained on the fact that like growth, kind of goes one way. Like there's, it's not cyclical. It's not like up and down. And so you look back at a lot of these investment memos and a lot of what people were thinking. And the companies were doing unbelievably well. Like all of these SaaS companies were growing like, you know, 200, 300%, they had really good fundamentals. The cohorts looked good. Like customers were expanding. They were staying. Like the, all the fundamentals were really, really good. And then of course, you had an overlay on top of that, which was like the public markets for pricing SaaS. companies at like 40 to 50 times sales.
Starting point is 00:26:39 That's the craziest thing to me. It's like you look back at like, you know, the Snowflake IPO. And you're like, I was reading the S1 and I was like the thing was that like less than 500 of revenue. We went out of like $80 billion. Yeah. And I was like, okay, there's some crazy stuff that's happening right now. But we're like, we have not seen anything, anything like the tops of the SaaS 2021 bubble when like Snowflake was going out at like 120 times revenue on the public. markets.
Starting point is 00:27:07 How much of multiple compression that's happened is venture capitalists actually learning their lesson, the market learning their lesson, or just purely interest rate effects? I think it's actually just the compression of multiples that we see now is people are just more scared of the business models. Like obviously, you know, everyone's saying like, oh, SaaS is basically dead, like terminal value concerns, all those things. But when you think about all the most popular business models and the most popular businesses that are getting funded right now, like,
Starting point is 00:27:36 There's no, there's no precedence on public markets of like an AI app company. Like we don't know what like an AI app company will trade at. Yeah. We don't know if it'll trade much better than SaaS, moderately better than SaaS or the same as SaaS. Yeah. We, we don't really know how like a space company besides, you know, with the exception of SpaceX, which is like an exception, not the rule.
Starting point is 00:27:56 We don't know how like a space company we will trade. We don't know how, um, you know, like, with that one, what about like ASTS, Rocket Lab? Like there's a couple public comps and like the pure play space area. No? That's true. And less on launch, I more mean like, you know, satellite companies. Sure, sure.
Starting point is 00:28:12 Or like, and yes, you could say the same thing about like, yeah, with Anderol, there's obviously a lot of, a lot of primes. Like, God, I hope it doesn't trade like that. Yeah, yeah, yeah. Yeah, much more like palis. That's the thing where it's like a lot of the things that people have been investing in either don't have precedence. Sure.
Starting point is 00:28:28 They have something about them like lower gross margins or capital intensity that's scary. Or the incumbents trade really poorly. And so you're like, well, like, you know, this is. kind of like when a firm went out. I think in 2020, no one knew if it would trade like a bank or like a payments company. Yeah. And it like sort of traded as a hybrid of the two. But no one really knew how to like how to how to think about the company for a few quarters until it's public.
Starting point is 00:28:52 So I think lower multiples mostly because people are just discounting because they don't really know how these things are going to trade. Sure. I want to talk about close source, open source, just totally. token maxing and the economics of AI right now. But I want to go back to your January 31st, 2024 post. You said, making a real effort to not take for granted the, quote, $3 Uber across town era of AI, and I hope you are too. That feels remarkably prescient, extremely true.
Starting point is 00:29:30 I didn't realize, I think the last time we talked about it was around just the models getting expensive around reasoning. and the gross margin changing, but now it feels like this is, like, directly targeted at CFOs of, like, large companies who are showing up with, I mean, we have Eric Lyman coming out on the show.
Starting point is 00:29:47 They had one, their AI spend, spent hit $1.5 million in a single week. And so we are out of that era. But as you reflect on that, it was that what you were predicting? How are you seeing opportunities across new companies in the era of, like, cost control and ROI maxing, how are you processing that idea of like the end of the Uber
Starting point is 00:30:11 era? Because in many ways, there's still a knockout, drag out fight between Codex and Claudecote and they're resetting limits every 12 hours, six hours. They're fighting it out. Like, we're still sort of in the capital fight, but at the same time, we're also in the, some enterprises are really controlling costs now. Yeah, there's, oh, God, there's so much to this topic. And there's so many different things we could talk about, so I'll try to hit the best portions of it. Yeah, the tweet, I think there's like a consumer part of the tweet and then an enterprise part of the tweet. And like the consumer part of the tweet was like, there's no ads. You know, the LLMs don't want anything of us. They're
Starting point is 00:30:47 still super raw. It's just this like silly little service that like clearly is going to need to mature into an adult, you know, cash flowing product one day, but right now it's not. You could also compare it to like the old days of Instagram. Like when Instagram didn't want anything from you. It was amazing. It was like the best app ever. And now it wants money from you in the form of like you, you know, being an ad unit. And so all you see is short form video.
Starting point is 00:31:14 And it's like, you know, rot, you know, and like brain rot. And TVPN videos. So those are those are the ones that say. And then on the enterprise side, there was all this, you know, that there was reports that sometimes where it was like, man, cursors, it's really hard to compete against something like cloud code because they would compare the basically amount of cloud usage you could get through. a subscription plan with with with anthropic versus API via cursor and you'd get like 20x the usage with
Starting point is 00:31:40 anthropic like this insane subsidization yeah on anthropic and I think both just the incremental adoption of AI by enterprises and that starting to like move down a bit it's still thinking there's like a fair amount of subsidization but it's like starting to go away a little by little as these as just like the token hungrieness of the models gets much higher like now that we've done like you know We've moved from, like, again, just chat EBT to long-running agents that are like way token hungrier because they're reasoning models and like you, that you sub-agents and all these things. You know, the cost of just like absolutely ballooned. And so like on one hand, it's like very clear that we've like exited the $3 Uber stage.
Starting point is 00:32:23 On the other hand, you know, there's folks like Dylan Patel at semi-analysis and there's some of these like really forward-leaning companies that are like not. only are token costs reaching our human labor costs, but like we hope they go over. Yeah. You know, and like we hope all of our competitors use open source models. And like we hope all of our competitors use, you know, like dumb models because our employees will be using the frontier intelligence models and like that's our competitive advantage. And so I don't think there's like there's a lack of clarity around all of this that I think
Starting point is 00:32:58 is, again, part of the disorienting thing about even investing in AI. I will say we're seeing an immense amount of app companies. I think if an app company, like app companies are either already at 80% plus open source usage for like their own apps that they're that they're serving to their customers or like 90% of them are trying to get to that ratio plus. So across our portfolio and beyond, a lot of people are working with folks like fireworks to, you know, custom train and fine tune. these increasingly good open source models. And like Jesse at DeCagun actually had a really good post on this where he talked about just the fact that like for mature use cases that can be that are well known and can be fine tuned on. You just don't need frontier intelligence anymore. And oftentimes it's best for these app companies to fine tune open source models around those specific use cases.
Starting point is 00:33:51 Yeah. Are you finding with the application layer companies internally they're adopting the semi-analysis approach, they're using the frontier to build. their tools, but then if they're vending out tokens, they want those to be very efficient because that scales with their user base, not with their employee count? Yes, I think that that is probably completely correct. I think it's like an extremely good take. Yeah. Where it's like, yeah, like for, but the only reason I think of that is because what are they
Starting point is 00:34:21 using it internally for? You know, like, they're using it for coding. And like they're using it for and like these are, these are high velocity startups where like the number one thing that matters is high quality shipping velocity of software. And so if they can get a competitive different, if they can be differentiated competitively by shipping faster by using Fable and just like spamming, you know, Fable the whole time. They're going to do that. But then the thing that they're selling their customers is a very different use case.
Starting point is 00:34:47 Yeah. So if it's like a support, you know, agent, you can use open source for that. But like the frontier intelligence on coding is still, you're seeing a lot of incremental gains for that. Yeah, yeah. The frontier labs are the spikiest on coding. Like that thinking machines example from Bridgewater felt like a unique spike in research and news analysis that might not show up at a frontier lab because it's maybe a smaller market. But thinking machines, they'd like bring that to bear, fine-tune something that outperforms everything at a lower cost. What else are you sort of retreating to in the age of the application layer?
Starting point is 00:35:24 Are you more likely to look at two-sided marketplaces, network effects, something with like the other sources of power from zero to one? If just like big pile of code is not defensible in the long term like it was maybe a decade ago? Yeah. Yeah. What are you actually looking for? And then are you actually seeing entrepreneurs acknowledge that and then go and build that? Yeah. Yeah.
Starting point is 00:35:52 Yeah, I mean, I will say, like, seeing a nice ad-scale marketplace with clear network effects, it's like a, it's like a drink of water in the desert. You're just like, oh, my God, you know, like, I don't have to worry about AI labs or, you know, business model quality or any of these things. And so it is a breath of fresh air because I feel like, you know, those are always in style, you know, these like super seven powers moody businesses that somehow avoid AI exposure because maybe they're, their consumer marketplaces or something. So I absolutely think that's the case. I'm also, I, I've always been relatively less or like not really in the bearish camp around lab risk for a lot of these app companies. You know, one, like, one, one like silly example could be like, you know, some people like,
Starting point is 00:36:42 oh, like, you know, Claude for Legal is coming out. Like Anthropics going to legal, like, uh-oh, legal AI space. And my response has always been like, look, like, Anthropics. in like three months of 2026 probably added the amount of like near like even medium or long term tam that exists in AI legal which is still like a ton of revenue like it's still an immense amount of revenue but like you're telling me that they're going to put like their eight like their SWAT team yeah to like grind out what is a top down sale market yeah over like seven years to maybe add some portion of the ARR that they added like in Q1 yeah like it just doesn't like
Starting point is 00:37:22 It just doesn't make any sense at all in terms of like the highest and best use of like the labs time. Yeah. And so I think all of these markets, like again, like people need to think about like, well, what are the theoretical competitive risks and what are like the practical competitive risks? And like throughout SaaS, I'm sure like if, you know, Microsoft at one point was like, we're going to win this extremely niche market for X at any given point. And it became like the number one project for the business. then they could go do that, but they didn't do that because they had like Microsoft Office, you know, doing tens of billions of ARR and like their security business doing tens of billions of ARR. And so it's all these things around prioritization that I think are that I think people don't think about. And so I'm not that bearish on the app player stuff.
Starting point is 00:38:09 And then the last thing I'll say is that the other really interesting thing that I'm seeing is that there are all these like short term things that I totally get why companies are doing them. and I think they kind of have to do them that in the long term we're going to look back and be like, this clearly made no sense to do long term. The biggest one that I see is like every app, or not every app company, but like a lot of these app companies now
Starting point is 00:38:31 feel like they need to have like a labs team where it's like every single app company. You know, they'll hire like, you know, a few researchers for meta or something. And then all of a sudden it's like, well, you know, we can defend ourselves from the labs because like we also have a research team. And like we're doing like,
Starting point is 00:38:47 we're doing like AI research. And it's something that I think we'll look back at in like in some cases it will have been valuable. But in many cases, I think it's just like a way for founders to be like, oh, no, look, like we also have researchers. Like, we don't have risks from the labs. Like, we're doing our own research. And I just think that like there's not, there's not that many opportunities for like an in-house research team to be doing that much groundbreaking work, you know, relative to like what the actual best researchers are doing within all the places that have the most GPUs, which is the frontier labs. Yeah. It's interesting.
Starting point is 00:39:18 because labs can mean a few things. It could mean AI research or it could mean experiments. And if you're an eBay... This isn't Ramp Labs, by the way, because Ramp Labs is doing like... Yeah, very different case. But there's a world where you're eBay and you realize that, like, the labs aren't really going to steamroll you because you have this, like, liquidity and this market and this network effect.
Starting point is 00:39:44 But, you know, just figuring out the right. way to integrate AI and maybe it's not just stuffing a chatbot in the corner. Maybe it's something a little bit more polished and having a team that can go out and look at the full product surface area without needing to be like the top down AI mandate of like every feature needs to be AI enabled is probably the wrong pattern but letting a team go around and say well yeah actually we don't need to add AI to the checkout flow because we want addresses to be deterministically verified but in terms of description If somebody's asking about this product, throwing an AI summary there might make sense.
Starting point is 00:40:24 And we're going to use an open source model for that because it's going to run on millions and millions of product descriptions or something like that. Tyler, I want to give you a chance to ask a question if you have anything. Yeah, yeah. I was curious, how word are you about the massive dependence that open source has on China? There was this article, I think, a week ago, and it was something to the extent of like Beijing is looking at curbing overseas access to China. Chinese top AI models, almost all of the Western open source models seem to be quite reliant on the Chinese models, which in some sense seem to be reliant on American and close source.
Starting point is 00:41:01 Maybe it's just a circle, but it seems like that's like if a lot of these app layers are just training their own models, they're doing fine tunings on open source models. From China. If those go away. Or they stop accelerating. What happens there? China says no. Yeah.
Starting point is 00:41:16 Yeah. Yeah. It's funny. I, on a, on a podcast recently, I just for some reason can't prevent myself from saying spicy takes that get people mad at me. And we were talking about open source models. I think it was on Harry Steving's Pod. And I was like, where, like, where are the good Western models? Like, why?
Starting point is 00:41:39 Like, all, like, in some, and, you know, I'm like, we don't have any good open source models. Then everyone was like, we have so many good open source models. Jensen is dunking on you. And this company and this company is like good. And then I didn't, because I restrained myself, but I just wanted to tweet back the OpenRouter token rankings. Yeah. Then where are they?
Starting point is 00:41:58 If they're so good, why don't people use them? Yeah. Why do you, like look at the top 10 on Open Router. Like all of them are Chinese, all of them. And so I think that, I think that the, like a good pushback to what I said on that podcast was like, well, they're coming. And I've always been like, well, where are they? But now we actually are starting to see some American teams like actually really go hardcore at the opportunity.
Starting point is 00:42:21 And so like one, Nvidia obviously cares deeply about there being a strong open source ecosystem. They've done more than any single company across the entire stack to fund and support and like bring into existence an awesome open source ecosystem. And so I think we all owe Nvidia and Jensen a debt of gratitude for pushing so hard for a healthy open source ecosystem. So they have Nemotron now. Nemotron, by all appearances, is like a great start. And I know a lot of people in our portfolio, they're actually quite bullish on the future of Nemotron. Thinking Machines Labs just came out with inkling, which again, a lot of people are very excited about. They don't claim that it's at the frontier even of Chinese open source yet.
Starting point is 00:43:05 But again, it's extremely customizable, which people love, enterprises and app companies love. And again, it's a, you know, seemingly a bit of a commitment. to continue to develop open source models. Reflection AI has always been, you know, they now have, their strategy is, I don't think they've released one yet, but their strategy is clearly to,
Starting point is 00:43:24 you know, have the American open source model. And so I think relative to even three or four months ago, there's more that you can point to around like, okay, like the West is actually trying to do these things. In terms of like the nested contingencies of like, who's distilling who and like,
Starting point is 00:43:39 where are all the model capabilities coming from? I think like, I think the whole distilling thing is like, I think it's oversimplified. Like, I think it's, like, a little too simplistic. I think it's also, like, a little, like, maybe there's some, like, xenophobia in there where it's, like, in the public where it's like, well, the only way that the Chinese models are good, is if they're just, like, distilling. Sure. And they're doing some stuff up.
Starting point is 00:44:00 Like, they clearly are doing some really good creative things. And, like, the deep-seek paper was, like, truly groundbreaking. Yeah. Like, it was awesome. And you can see it because, like, open-source architectures get ported back into foundation models and close-source labs all the time. And also you just see that there's a ton of successful AI researchers who come from China and stuff. But yeah, I think that's all a good point. Yeah.
Starting point is 00:44:21 I have another question related to the application layer. I'm interesting. Like, Venture's been through these like sort of experiments, whether it was like biotech for a little bit. D to C e-commerce was sort of enabled by Facebook. And then eventually D to C didn't die. It just sort of returned to. the better fit was like CPG private equity firms know how to do it. They still do it.
Starting point is 00:44:52 There's still some amazing outcomes, usually in like the 500 million to one billion category. You're not seeing trillion dollar CPG companies anytime soon. But are there any areas in the application layer that you're seeing, oh, this category is now potentially investable as a venture opportunity because of AI. I'm thinking like game studios or something else. Or is there a pocket of previously venture backable companies that maybe should be moved more over into, hey, just bootstrap that, get it to scale, do some private equity, secondary, rent a cash flow positive, more of like a lifestyle business. Yeah.
Starting point is 00:45:30 I think there's a lot of both. I mean, even like, if you think about it, even in some of the more obvious verticals where we've seen early AI winners, like even in legal, right? Like legal before AI was not seen as like a venture category. There was like no, Etrium and Clear Spire. Two like really solid runs at that. The tech enabled law firm and, you know, rough goes on both accounts. And now it's like, oh, the money's flowing. The business looks like a normal tech company.
Starting point is 00:45:58 Yeah, there's still like margins and whatnot. They got to pay for tokens. But like in general, it looked a lot more like a tech company than a law firm. For sure. And even the SaaS companies that sold into law, it was always just like, Oh, super constrained, Tam, it's a slag. You can't get law firms to pay a lot. And now, you know, Logaro and Harvey have just, like, absolutely eye-watering numbers that, like, you know, for the last three years now.
Starting point is 00:46:19 And clearly are among, like, the very, very best day at- And Harvey just acquired benchmark, right? That was a jump scare. I was like, we did what? We did what? Yeah, that was quite the strategic move, but also just a hilarious troll on the timeline. Very much. But then on the PE, like on the on the on the other side, there's like obviously we're in Recore and they become this like huge awesome platform for the task economy and kind of like, you know, finding the data that actually now moves these models forward.
Starting point is 00:46:54 Yeah. There's so many. If you think about like at the limit, if the limit to like getting AI agents to be able to do everything is to like find all the data in the world and like feed it to them in a really high quality way. There's so many people I know that are finding, like, going out in the world and finding, like, extremely niche or just, like, data that no one would think of. And then, like, you know, making it, you know, like, high quality serviceable to labs or anyone that wants to buy that data. So, like, there's one, for example, that's, like, basically instrumenting a medical clinic. So, like, every conversation is recorded. Every, you know, the thing that they're doing is video recorded.
Starting point is 00:47:33 They're, like, you know, almost doing, like, a, yeah, like, like, like, like, like, like, like, like, putting telemetry throughout every portion of a medical clinic and then making that a data set. And so I feel like, again, like, is that venture scalable trillion dollar? Probably not doing it if you're like just like the medical clinic data company. But I think there's going to be a lot of like entrepreneurial people that make a lot of money just bootstrapping these things and building them to, you know, 50 to $100 million revenue businesses for like eight to 10 years. Yeah. And like that's sort of all you need to do. Yeah.
Starting point is 00:48:03 It's exciting for like entrepreneurship broadly. It's just an exciting time to be building. Well, thank you so much for taking the time to come chat with us. Have a great rest of your day. Have a great weekend, and we'll talk to you soon. Thanks, guys. Goodbye. Let me tell you about public.com.
Starting point is 00:48:16 Investing for those that take it seriously. They got stocks, options, bonds, crypto, treasuries, and more with great customer service. Our next guest is TBPN royalty. We got Eric Lyman from Ramp. He's the co-founder. And now the co-CEO. He's in the waiting room and we'll bring him in to the TVPN Ultram. first time we've talked to him since he's become co-CEo.
Starting point is 00:48:38 How is it? How does it feel? I feel so good to be back. I missed you guys. I missed you, too. First time chatting with Tyler directly. I think he's popped in a few times. You've chatted with us in every different permutation, the yellow suits in person, in the New York Stock Exchange all over the place.
Starting point is 00:48:57 But how are you settling in into the new title, co-CEO? It feels good. It's what's been so fine. Kareem and I worked basically this way together for 15. Yeah, yeah. I was about to say everyone's like trying to do like hot takes around it. I'm like,
Starting point is 00:49:12 have you actually met these guys? They've been co-CEO the entire journey, even going back before ramp. It's been fun. Like I, like for me, like part of what makes this fun is like, we've known for years like Kareem is the secret weapon of the company.
Starting point is 00:49:31 Yeah. He's driving so much of what. what's going on. Now it's like more obvious to people of like we got at least two of us. There's actually way more interesting people at the company. But no, we're, it's moving fast, growing faster this year. And it's just fun. You know, now it's, you can swap and take some some events off my hands too, which is great. Yeah, I love it. Well, businesses on ramp are moving tokens fast through their systems. It's showing up in their books. You built a website token dashspend. dot FM. I love the dot FM. I think that's a very fun
Starting point is 00:50:05 TLD. But what inspired this? I imagine it was from like direct conversations with your customers. Did this come internal? What were the findings? What were the goals of the project? You nailed it like over the last year. The last full months alone, ramp customer spent on tokens has grown by 21 times. Wow. 21X. Is that a gong or is that
Starting point is 00:50:31 up we're a little bit of both. It's some of every, it depends who's making the money or spending the money. And look, by the way, like the crazy part is it's not like people are like turn it off. It's like, no, I actually want to spend more on the right things. And so like, you know, so we saw this from our customers. We saw this from ourselves. You know, a few years ago I spent was a routing error like error to. I think it may it hit almost 10% of our payroll spend, the equivalent with.
Starting point is 00:51:01 on tokens on a payroll. And look, there's great things you can say about it. We're launching products faster than ever. We're more efficient than ever. We're growing faster. And yet, you know, I hate to say, there are people at the company who, like, use Fable to, like, look up the weather. Wait that happened yet, too?
Starting point is 00:51:22 We heard about that other companies. I can't believe. I'm teasing. I'm teasing. But there's this whole thing where people know and get in the abstract. of models even from a year ago were amazing are great at doing tasks and we can be more efficient
Starting point is 00:51:39 to accounting teams need to be able to monitor this like it's you know I think of our CFO who would get a bill for hundreds of thousands of dollars and then the work began of like you need to allocate some to engineering some to sales in marketing some to you name it and so there's just so many products that weren't built
Starting point is 00:51:59 by the labs and so to Today's launch around token spend management is a place where any company, whether or not you've tried RAMP can link up your API keys and then you're good to go. And we're helping people really within minutes start cutting their spend by several percentage points. And so it's been a very fun launch. Yeah. What was the first sort of generative AI application at Ramp? Was that the GPT API for understanding receipt data? So this was actually, so that was our first ML model for sure.
Starting point is 00:52:38 But the generative use case, I think it was six months before chat GPT came out. We hopped on GPT3. And we started using this for Go team. Yeah, classifying different receipts, putting things in the right expense category. things that could be done deterministically fuzzy logic could apply, but LLMs were uniquely suited. But at the time, that was a rounding air. Then you go forward to May and you get a bill for $1.5 million in a single week. What's the actual process for untangling what's happening?
Starting point is 00:53:18 Are you looking at prompts? Are you just going to Slack and saying, hey, you know, you were one of the top 10 drivers of token spend? Can you flesh out a little bit of what you got done? this week, that type of thing? What is the correct way for an organization to interrogate their spend maybe qualitatively after they're done with the quantitative side? Great. Most organizations that are even at a place to be thinking about this, they're using lots of tools, right? They're spending on open AI models. They're spending on Anthropic. They're using Gemini. They might be dabbling in open source. They're using cursor. And so the first step is
Starting point is 00:53:57 actually just seeing it. It's being able to link up your keys so you can understand and start to break up basic questions of like what's happening today, not in a month when you go get your bills, connecting and tagging that. And that's something you can do out of the box through the product. We come back within minutes to help you understand it. And so you can start to go and see, okay, not just this person normally spends $1,000 a month, but they've already ran through $800 in an hour. And so you can set up notifications. We show you unusual spikes. And so, again, think back to the early days of ramp and corporate cards.
Starting point is 00:54:34 A lot of this was alerting and visibility. It's these types of insights. And you also see things like, you know, we know how the most efficient companies are running. And so if you aren't cashing, you are overspending. Some people will leave fast mode on, which can be multiple times more expensive. And so we'll just highlight that for you. Sure. And then finally at the end, you get to controlling it, you know, acting on it.
Starting point is 00:54:59 And, you know, I think for today there's so much to do on the analytics itself. But I do think there's more sophisticated opportunities to be had, whether that's in small model training, in routing, in much more. And we're excited at the whole space. I think there's so much to do to help companies save. Okay. Sure. Yeah. So I see the average company, 59% of their token spend.
Starting point is 00:55:25 is on frontier models. How do you, how should companies be thinking about allocating between frontier models and open source? Is it almost a thing where like you're in a explore phase, you're using the frontier models, you're doing these kind of net new coding tasks, whatever, and then once you find this repetitive thing, you're running the same process every day, every week. Is that when you, when you allocate it towards open source, maybe you're even doing a fine-toe? And how should people be thinking about that kind of stuff? It's a perfect question. And I think for companies out there, if you're listening to this and like haven't used these models. I would say using frontier models just to get a feel is good.
Starting point is 00:56:00 It is surprising the capabilities that models have. And if you don't have a multi-thousand-dollar a month built, like to start there, I think is reasonable. But then you start getting into optimization. And there's a few sets of interesting questions. One, there are cases when using frontier models can, in fact, be cheaper. Like, for example, in our own benchmarks, on our software engineering benchmark. People think of Sonnet as an older model in, let's say, the anthropic world. And it is cheaper per call, but it needs to think a lot harder and call more agents working in collaboration. And actually the smarter models, like, it's kind of if you've met someone smart, like, they don't need to go and do like long division. They can just like do division in
Starting point is 00:56:45 their head. There are cases where using Scott Ware, for example, Scott Woo, calling Scott Woo is much faster. His hourly rate is much higher, but there might be certain things. You know, Scott Wu per second might be cheaper than, you know, hiring a team of third graders. Certainly the bad ventricabler's made. I'm like, I won one Scott Wu instead of a thousand. This is right. So, so that's part one. But then the really interesting part is when you get down into benchmarking of what is the nature of work that you're doing, you know, you can use these trillion parameter models to answer really tough questions. But when you start seeing very high production use cases,
Starting point is 00:57:29 you'll see, if you know all of the input tokens you're getting are around customer service, you'll see companies like Sierra having their own small models around what makes great efficient. And so they've lobotomied just the part of the brain that is really useful for those types of services. to, if you can dynamically start to route based on the complexity of the task, you can say a small model just for accounting. It maybe is all we need.
Starting point is 00:58:00 We don't need to go ask, you know, a model that can allow us to cure cancer and do quantum physics and that kind of a thing. And so in some sense, it's on both. And you can start to get really interesting answers. The more that you can benchmark your own business and the more that you have high fidelity about the nature of the inputs you're getting, the outputs you're seeing, and then the efficacy per cent on getting to that. And there's so much to build around this area. Talk a little bit about the shape of AI product development, the AI work you're doing, Ramp Labs, sort of the surface area, the spikes there, because there's, there's, you know, just using AI to improve the product
Starting point is 00:58:46 that is deterministic, right? Better software. Then there's, there's, you know, just using AI to improve the product that is deterministic, right? Better software. Then there's also AI integrations. Like, I mean, it's such an anodyne feature, but I love the fact that you can open up the ramp app and just ask a model, like, how much do we spend on camera equipment last month? And it'll just tell me. And that's amazing. And I'm sure I could, like, wire it up to some other system, but like, I love just having it there. And then there's also, like, AI research and harness development and all sorts of work that's happening there.
Starting point is 00:59:12 And that's can be expensive, but how are you thinking about all the different tradeoffs and all the different work within, the AI slash labs umbrella. So on using this, I mean, this is just an incredible technology, as you know. Like, I think about like part of what, like, let's just talk about like B2B SaaS for a second, you know, if we must. Yes, please. You know, you know, come on. I was waiting. I was waiting to.
Starting point is 00:59:40 Yeah. We're finally doing it. You know, boys. Here we go. All right. So the problem why most B2B SaaS is awful is companies are complicated and people want different things. And so the accounts payables clerk wants a view. Your accountant wants a view.
Starting point is 00:59:55 The CFO wants a different view. One person wants a button. You want to make it simpler for these people, more advanced for another. And how do you deal with this? Well, it turns out generative interfaces where based off of who you are, how using your product, it can show you the interfaces you need with the views, the graphs that you like to do your work, can be intuitive. And so it's very interesting in making products that all. are very powerful, but feel simple and relevant for the products.
Starting point is 01:00:25 And so on one side of it, like, forget RAMP, I just think organizations in spending time around dynamic and generative interfaces, there's, I think you can just make better computers. You can make better tools for people. Why do we care as a provider of services? what is so different structurally about spend on models and on tokens and on software is you could just hammer Salesforce all day. You're not going to get like a bigger bill from Salesforce. Sorry, going on. I'll call him back.
Starting point is 01:01:05 Conference man. Yeah. You're on. No, I'll save them for a minute. But to go a bit deeper on it, if you start going and using, as folks know in the token maxing era, lots of tokens, like your bill can go from $1,000 to $10,000, $100,000 to $1 million very quickly if you start going. And it's not like payroll spend that companies are able to manage in some way. It's not like normal vendor spend. In some sense, it's like an untapped corporate card.
Starting point is 01:01:40 you can spend as you go, and by the way, the meter's not running. And you don't see it. And this starts to feel a lot like what we've obsessed over for years of can you help people manage every incremental dollar far better? And so it's pulled us deep into answering the question of if you want to know return on investment. We should be thinking about like what is return? What did you buy? Can you understand just the semantics of it? So what was the output to the efficiency as there's more types?
Starting point is 01:02:09 So it is, we're obsessing over this from every floor of the building. One of the, one of the interesting things about Ramp is, you know, everyone who has a Ramp card in an organization has, you know, they can open up and see all their transactions. They can see their budgets, their limits, the policy that applies to them. And they, you know, they can implicitly understand that, you know, if they spent $10,000 on their card or $1,000, like, did they deliver that much value to the organization? And I'm wondering if you see either Ramp or just generally businesses need to push more of that data to the end user, the token consumer. And how will that instantiate? I'll give you an example from like the just card world. And we're seeing this already in AI spin management.
Starting point is 01:02:59 So in the card world, there's this concept of just like out of policy spending. Like let's say that you. let's say you never got a notice and you spend on Uber Eats because you forgot to switch over the card on the weekend. Sure. You might keep running it up and never really realize it. And it turns out if you just tell people once, hey, that was out of policy, you see spend and out of policy spend just drop. You tell people like you weren't supposed to do that. They don't do that.
Starting point is 01:03:27 You know, people actually want to be good and do the right thing. And this is the checking the weather with Fable 5. Yeah. It's like, I didn't realize. spent $100 to check the weather. Yeah. And, you know, sometimes some subtle UI like this and feedback goes a long way. And so in the product we've already seen, actually just exposing people, here's your AI
Starting point is 01:03:48 spend. Like John Tyler, I don't know if you guys know what you spent on token spends yesterday, but on ramp, you can know. And it turns out when you see it, you start getting more efficient. And so even just the act of exposing it to you is driving down these savings for people. So you nailed it. There's so much there. Yeah.
Starting point is 01:04:13 We probably spent a lot on tokens yesterday. We were vibe-coded a bunch of really, really jokey sites that provided a lot of a lot of laughs and a belly laugh. We had Saga and Jetty on the show who does not like prediction markets and we built him an entire prediction market for his entire life. And the belly laugh that he got from that was priceless. It was all play money. But I think it was worth it, but I actually haven't seen the token mill. So I don't know. It might have been rough.
Starting point is 01:04:42 I want to talk. Do you have another couple minutes? Of course. Okay. I guess the last question for me. The ramp econ lab. That is a separate lab. I'm very interested in the knock-on benefits of Aura Khorazian's excellent work,
Starting point is 01:04:56 studying the economic impacts all over. I mean, the research has gone to the front page of the Financial Times, the Wall Street Journal, so many other places. What has that unlocked for you as CEO in conversations with customers? What have been like the knock on effects of that project? At first, it's just, you can kind of understand the world better.
Starting point is 01:05:21 It's very obvious in now because it's been this, I guess, to paraphrase Elon, like a supersonic tsunami. where it's gone from didn't really exist years ago to perhaps 1% of the United States is GDP in the next 12 months. Like it looks quite likely at this point. And this data is going so fast, like you look at most economic indicators and you get things a quarter later. It's not measured precisely.
Starting point is 01:05:46 Whereas ramp data, you know, we're tracking about 1% of all corporate span to the United States. And you can just see it and you can understand it. And you can adjust your strategies faster. it actually helps people better run their business and not get left behind. So I just find it useful for finance teams and technology, people building businesses. Beyond it, it's just grown awareness.
Starting point is 01:06:10 You know, we're competing against some of the best-known brands ever created. And, you know, if we're going and trying to win you over and say, you know, try our tools. You should trust us to move money, store. money help you get more from every dollar an hour and you've never heard of us it's just a much harder sell to oh yeah i saw ramp in in the journal on tbPN um you know on the founders podcast or um you know more and more it starts unlocking it and when it shows up in a way where um it's actually already providing value to you before we have a conversation it it's uh you can get deeper um much faster and um you know i think over the long run that that leads to more growth
Starting point is 01:06:56 That makes a lot of sense. Well, thank you for taking the time to come chat with us. Congrats on the launch, the website. Thanks, Sean. Token-Spend.fm. Go check it out. Optimize your token spend today with Ramp's latest project. Have a great rest of your Thursday.
Starting point is 01:07:11 Have a great weekend. We'll talk to you soon. Goodbye. Let me tell you about Figma. Agents meet the Canvas. Your AI agents can now create and modify your Figma files with design system context. We have a couple interesting op-eds I want to take. to cruise through in the Wall Street Journal, the bear case for Malibu.
Starting point is 01:07:31 This is interesting. For decades, this 21-mile stretch of coastline served as one of America's most durable expressions of wealth offering residents, ocean views, private beach access, and the opportunity to spend large portions of the day on Pacific Coast Highway. That proposition is beginning to face scrutiny, rising insurance costs, wildfire exposure, limited restaurant options, and the difficulty of commercial. completing basic errands have weakened the case for full-time residents. According to property advisors who are familiar with the West Side, quote,
Starting point is 01:08:06 you are paying $18 million to live somewhere that makes buying toothpaste feel like regional travel, said Graham Pelt, a partner to Royal Property Research. Several homeowners have recently shifted their primary residences to Brentwood, Montecito, and Pasadena, retaining Malibu properties for occasional use. The beach remains attractive, but the emerging bear case is that visiting it may be, be sufficient. Interesting. Interesting. This is the wrong, I feel like this is the wrong day for Jordy to step away from the show because this is a, this is not good news. I feel like he would, if he were here, he would be defending Malibu, but fortunately he's not. I have another, I guess we
Starting point is 01:08:42 just can't really, we'll never know. I think I mostly agree with what I'm reading here. Yeah, yeah, it makes some good points. There's another, there's another, there's another interesting op-ed. This one's in the Financial Times. They're calling it the end of Botega Veneta. Botega Veneta's position is the preferred label of consumers seeking to display wealth without displaying a logo showing signs of strain. The Italian fashion houses woven leather bags, oversized footwear, and muted branding helped define the quiet luxury era, but their growing visibility has made the products less useful as signals of discretion. Quotega, quote, the customer bought Botega because only certain people recognize it's at Isabel March End, an analyst at Mode Capital.
Starting point is 01:09:18 The problem is that now everybody recognizes it. That's not good. Stylists say some younger shoppers are moving towards vintage, accessories, smaller Japanese labels, and tap-out T-shirts, familiar with those, whose providence cannot be immediately identified from across a restaurant. Botega remains a significant luxury business, but its cultural difficulty is that the absence of a logo has effectively become one. Interesting.
Starting point is 01:09:41 I feel like Jordi would push back on that, too, but there's one more we should go through. Apparently, the G-Wagon is losing its grip. The Mercedes-Benz G-class, long the default vehicle of musicians, a professional athlete, and men who describe routine commercial activity as motion is losing ground among a small influential group of tastemakers. In recent polling, future, Jacob Allorty and Gunna each identified the 2014 Jeep Grand Cherokee as the emerging vehicle of choice. Yeah, I've been hearing this.
Starting point is 01:10:12 Yeah, yeah, it is on the come-up, citing its restrained, styling, limited social media exposure and availability with a factory-installed CD player. That's a nice feature. Quote, the G-Wagon communicates the owner has money, said one person. and briefed on the survey, the Grand Cherokee communicates that the owner has somewhere to be. That's a good point. Dealers have reported increased interest in low mileage examples with dark paint, tinted windows, and minimal modifications. Mercedes remains dominant on conventional luxury buyers, but among Chads with motion, according to the study,
Starting point is 01:10:44 the status hierarchy is shifting. Authenticity now requires cloth seats, a loose headliner, and at least one dashboard warning light. Yeah, and I think we found this graph of different takes. Jason cars, how they moved? Can we pull this up? How overall taste in cars has shifted from 20, 25 to 2026? Looks a little bit like polling numbers, and we'll see the Mercedes G-Wagon has dropped from 95% approval to just 45%.
Starting point is 01:11:13 Meanwhile, the 2014 Jeep Jeep Jeep Grand Cherokee here has jumped from 33% to 97%. Yeah, I mean, certainly among my friends, I think the 2014 Jeep Braint Cherokee has almost become kind of like the aspirational car. This is like you really know you've kind of made it once you're running in one of these. Yes, yes. Other big movers, the Nissan Morano Kraus Cabrero-A, of course, went from 65% to 83%. The Dodge Challenger Hellcat Scat Pack is moved from 45% to 74%, eclipsing the G-Wagon as the must-have vehicle. And the 2016 Honda Accord, a strong showing going from 22% to 54%.
Starting point is 01:11:50 Yeah, I mean, over the course of a single year, that's a pretty big jump. Yeah, it seems like if you got a G-WRourd, wagon, you could get a 2014 Jeep Grand Cherokee and a Honda Accord from 2016, potentially. That might be the move. Well, we'll keep following the story and we'll see what Jordy has to say about all of this in the future when he's back in the TVPin Ultradale. We had to take a shot at him. We had to have fun.
Starting point is 01:12:13 No, of course, we're joking around with Jordy. Let's go back to the timeline because there are some... You're going to talk about the DoorDash CLI. Yes, DoorDash launched a CLI, which... People have been asking for this. Have they? Have they been? DoorDash, I mean, there's that funny meme of like, robot, push the order food button.
Starting point is 01:12:35 This makes it, like, one step easier. Are they imagining that people are locked in terminals, vibe coding, and that they will want the DoorDash CLI to order them food? Or are they expecting developers to build whole applications on top of DoorDash? So, I mean, I think the idea is mostly that you'll have coding agents use the CLI to then order. So presumably you're super locked in. You know, you've had your Codex goal running for six hours. It's going to ping something. Is this bad news for MCP?
Starting point is 01:13:06 Because they have an API. They have just a web front end that a computer use agent can go and use. I wonder why the move to CLI, maybe it's faster, maybe more token efficient. People are trying to be efficient. A CLI means you can drop DoorDash into whatever you already run. wired into your internal tools and office catering orders itself. I could imagine office catering if you're starting to build or vibe code sort of like an ERP for your office organizing. You could potentially do that.
Starting point is 01:13:38 But I mean, DoorDash shared orders in an office is pretty seamless. Usually someone who's like quarterbacking the order would just drop a link in Slack. Everyone picks what they want in the DoorDash app. It's all linked together and paid. I mean, I think it's just one of those like last mile problems. where you've automated so much, but you still have to manually do the DoorDash order. Might as well just plug it in. People are having fun with it.
Starting point is 01:14:01 Lawrence Jank says, my biggest fantasy is becoming a reality. Jarvis. Order $57 worth of Shake Shack on DoorDash. No tip. That's a lot of, that's a lot of Shake Shack. That's potentially too much. Shake Shack is actually pretty expensive. Yeah.
Starting point is 01:14:16 $57? That's got to be like two huge burgers and a shake. Something like that's true. Well, Mod Retro's CEO, Torin, was interviewed by Take Kim, and Dylan Abrasado on our team shared his favorite moment from the interview. Tay's take says, I'm extremely bullish on Mod Retro. They have Steve Jobs-like product taste that will serve them well beyond retro video game consoles. That's interesting. What would they do outside of retro video game consoles?
Starting point is 01:14:47 Something new. Something could compete with the Xbox. Jobs' original DNA was combining beautifully designed. High quality products with a simplified, friendly customer experience after using the chromatic, I believe, Mod Retro, can deliver that type of premium user experience with less frustration and fewer data privacy issues. I wouldn't be surprised to see them expand into televisions, headphones, and other high volume consumer electronics. Maybe a dumb TV, which Palmer was talking about when he came on the show. He's sick of smart TVs and their advertisements and signups and all QR codes and all that. Yeah, I'm odd like device, music.
Starting point is 01:15:23 I'm very interested in, do you think the M64 will be somewhat hackable in the sense that you could get sort of a dummy cartridge and then you could potentially vibe code a ROM that loads onto the mod retro gives you the full experience of the controllers? Because we've been building a lot of web-based games and webGL. And those are fun, but it just doesn't feel the same when you're on a MacBook keyboard. that's not really, you know, mechanical keyboard. You don't have a mouse. You don't have a controller. I bet, I mean, I imagine with, it's also pretty easy to wire up an Xbox controller as an input to a web-based thing. Yeah, yeah.
Starting point is 01:16:02 I mean, you can just connect with Bluetooth. It's like fairly. Yeah. But there's something, there's something magical about the original sticks of the N64. Yeah. And actually seeing it, like the constraints actually breathe the innovation. You can create some mashup between Mario Kart and Golden Eye or whatever you want pretty easily with vibe coding. It'll be interesting to see where the hackers take it, how modible the mod
Starting point is 01:16:25 retro is. Anyway, we have our next guest in the waiting room. Let me tell you about Cisco. First, critical infrastructure for the AI era, unlock seamless real-time experiences and new value with Cisco. And we have Jordan Black from Senra Systems, who's the co-founder and CEO, with a huge funding announcement. How are you doing? Welcome to the show. Doing great. Thanks for having me. Long overdue. I mean, I heard about this company. you've been working with Founders Fund for a while, right? But take me through a little bit of the history, introduce yourself in the company. Absolutely.
Starting point is 01:16:58 Jordan Black, CEO, co-founder, started this company over three years ago, right on my apartment, building wire harnesses on my carpet floor. Founders Fund's been a great investor in us since the pre-seed all the way to Series B, which you just did. How much was the Series B? Tyler's going to hit the gong. Let's go. How much did you raise?
Starting point is 01:17:19 $65 million. Okay, so explain like I'm five, the product, the customer base, what's fueled the growth, what's in the supply chain? What do you, what's your key value at? Perfect. I brought some props on the show, but. Fantastic. Senra is solving the wire harness problem in the U.S. for Air.
Starting point is 01:17:50 space of defense. And you're probably one to run a wire harnesses or anyone watching this. And this is what it is. It's just like a bundle of wires, connectors, cables. Think of it like your iPhone charger, but a lot more complex. And this whole thing I'm holding in my hands is designed in Excel spreadsheets and PowerPoint slides. And it's all done by hand today as well, by really scaled workforce putting this together. And think of it like a cheesecake factory, but trying to scale it. It's really complex. And there's no calling. linear schools that exist and no recipes and you're just got to figure it out and make it happen to. How on earth are people designing these in PowerPoint? That seems like a crime. Like, is it,
Starting point is 01:18:33 they're drawing out little diagrams on, on PowerPoint slides with like the draw line tool? They use that. They use Microsoft Paint Vizio is a big one. People design things on. This is anything from the large aerospace defense companies to startups too. But it's, it's, it's, it's, It's the input into wire harnessing is not standardized. The output of who builds this, how you build it. What's the right way to build? It's not standardized. And like Senra is solving this $165 billion market by being the ones that says like
Starting point is 01:19:05 the bullshit's over. And we're just going to take over and standardize the entire thing. So why not a pure software solution? Like just wire harnessing SaaS. There are big companies that have been grappling with vertical integration. the Anderil, SpaceX. I imagine that you could sell this as a SaaS product, but why work on the actual production?
Starting point is 01:19:29 That's where the problem is. We started the company, even with the design tool, and we got some traction with that too. But in the day, every company just wants the wire harness and they want to come faster than normally is. They want to plug in and work. And it's the quality, it's a speed, it's the cost, but they care about the physical product.
Starting point is 01:19:46 And I think if you want to make a generational company where it's like, where were we before Google Maps came out? It's like, how are we building harnesses in the U.S. today? It's like we're with Senra 10 years ago. And that's kind of what the goal we want to have. But it's the problem. We have to vertically integrate the entire thing. And what's driving the customers to Senra? Is it speed because you're local?
Starting point is 01:20:09 Is it forward deployed engineers that you've sent into organizations to sort of co-design wire harnesses? before you make them. Is it the made in America or price or speed? Like what are the key factors that jump out? Yeah, I think just being better is not how we're going to win and how we're going to win every time. But it's like quality is a number one thing. Like it's really hard to get a high quality harness because it's all done by hand. So you don't know it works until you plug it in, turn it on the rocket and the wires fit in the right spot or the wires aren't crossed and the whole thing blows it up.
Starting point is 01:20:43 Like they just recall like a million cheap vehicles because like the wire harnessing is bad. This is a really big problem just in any industry. So qualities are number one thing. And we're over 99% first-past yield with all our customers. And like you just will never go out of style. And this is why you keep coming back to us. The second is going to be speed. It usually takes months to quote something,
Starting point is 01:21:04 takes, you know, even over six months to even get a wire harness from a customer to a company today or it's going to be faster for the customers we're growing with. And the last one is like that forward deployed engineering portion of it. So we do everything prototype to production. So we will partner with the Neo Primes, the Primes, just any of these companies say, let's be your engineering partner. Let's be your expert and tell you how you should design this thing, how you should be thinking about it. And let's go build you the prototypes and let's go scale into production sense of it.
Starting point is 01:21:32 We're not just your contract manufacturer. Like here's the PowerPoint slide, go build it. It's like here's the PowerPoint slide. Let's go design this perfectly, build the prototypes perfectly and then make this at least your problems in the long term. to. What subcategories of electronics or products are actually growing their wire harness footprint? I'm thinking of like the smart fridge boom where there was a move to put a screen and a Wi-Fi router in every device in your kitchen. And it feels like that's sort of peaked and maybe that's declining. What are you seeing outside of the obvious automotive space, defense, categories that are
Starting point is 01:22:13 sort of like sneakily interesting markets or maybe on a growth trajectory that you might not have expected unless you were on the ground in the industry. Yeah, there's a great question. I think it's maybe obvious, but like the data center. Oh, sure. But what's really interesting, it's not just the wiring that goes in the data centers, but the surrounding infrastructure around it. It's like, we need more generators.
Starting point is 01:22:37 We need more churners. We need more HVAC equipment. So you're seeing a really big, uh, inflex, collection point in that sector too. Aerospace on just the actual commercial airspace, like more satellites. You have obviously fence with everything growing in too. But anything that requires electricity. So now you're seeing all these new energy companies.
Starting point is 01:22:56 So I think the one that's going to start taking off is going to be like microreactors or nuclear reactors. Like those are really difficult wire harnesses to build. And there's not a lot of people who know how to build that stuff as well. So as people, the new incumbents and the Westinghouse of the world start like, scaling up, it's like we're ready to be kind of part of that journey as well too. What does your path to automation look like? How did you make the first wire harness? How are you making one today?
Starting point is 01:23:28 What does it look like in a decade? It's scaled from me building it in my apartment three years ago and just going to investors saying, look, I have revenue like to build wire harnesses. So you literally like ordered the parts on Amazon and like put it together basically? And just put together, carpet floor. I got, you know, this, this PO. Let's, uh, revenue generating, uh, within the first few weeks. Um, I think the first year was, uh, got a really great team of like, because of my background
Starting point is 01:24:00 is from SpaceX. And like really skilled technicians to be doing this for 10, 20 years and they were building viruses. Now, probably over 90% of our workforce is people who we've trained to go build a harness in four weeks versus the number of years it takes to go build that. So I think that's like the inflection point now of like how do you scale the unscalable? It's like build a training program, build an operating system for them to go build these harnesses on and then build as much, integrate as much semi-automation to the factory too. And then what's going to happen in the next like
Starting point is 01:24:28 one to five year range is like we have a dedicated team working on AI and robotics of like talking to all the new companies, talking to the existing incumbents of like we are ready to go bring in as much robotics and much automation into this factory. We're tracking all the data from the design input into telling technicians exactly have to do with work instructions to the physical automation data points of like how are they doing things with their hands. And the really goal, I think everyone from the technicians building it to the executive level suite is how do we automate this as much as possible. And I think that's the really exciting part. But we have a really good foundation of like, we're building this, we're collecting the data, we're working with their
Starting point is 01:25:07 customers, we're seeing what their cost points are and trying to grow as much as possible. A couple of years ago, Daniel Gross wrote a blog post called AGI Betts, and I think the very first one was, is copper underpriced, which I think was a very funny one. He was 100% right. Copper has risen in cost a lot. Do you think about raw material input costs as an important lever on your business? Do you hedge? Is this material? Or are you able to pass the three? to customers and not have it affect the core business? I think it's a little bit of both, but overall, like, we're buying this and we're not making the copper wire.
Starting point is 01:25:48 We're not making the connectors. We assemble it. Sure. That's kind of our point of value add. But they think the difference is because we're this engineering partner, we want to be a cost-effective supplier for these customers, too. So we can go, we have actually your own software that we built out in an AI tool that ends up like looking at the bomb or the bill of material cost and says, this is how much it should be.
Starting point is 01:26:11 And then suggesting to the customer, you should go with X, Y, Z other component because it's cheaper, readily available. It will work for your application. But nobody is telling them this is how you should do it. And that's why I say it's so much like a cheesecake factory of like, why are we using this really exquisite beef when we can go maybe this over here, which like has the same flavor or you can't even taste it once you put a thousand calories of cheese on it or something like that too. So that's really, I think, the value add too.
Starting point is 01:26:35 is like if the price of copper is going up, nothing we can necessarily change in our control to do that besides having better suppliers and distributors we work with and working with our end customers of choosing the right products from the two. Where are you based and who are you hiring? We have two factories, one in Redondo Beach and then one in Cyprus, California. And that's eight, we just opened that up. It's 82,000 square feet in manufacturing space. And we're hiring all across the board. We're hiring in operations. so technicians, engineers, industrial engineers as well too, manufacturing people just be on the ground floor, building the factory from the ground up.
Starting point is 01:27:14 And it's really exciting. It's like there's not a lot of greenfield factories that you say, this is how things should be built, this is how they should be done. This is we're building the ship as we're driving it too. We're hiring people on the engineering side from the software perspective and automation of like how do we go at have a lever of making this more efficient and more. automated in the future. And then we're also hiring us like business development and sales of like partnering with these customers and the program management side of like you get to go to fly these customers, see what the wire harness needs are, see what your product goes into and like really get
Starting point is 01:27:49 integrated with their end goals too. Very cool. Well, congratulations on the new round. Thank you for everything you're doing. And thank you for coming on the show. Have a great Thursday. Thank you. Let me tell you about Railway.
Starting point is 01:28:01 Let me tell you about Railway. Railway is the all-in-one intelligent cloud provider. Use your favorite agent to deploy web app, service databases, and more. Well, Railway automatically takes care of scaling, monitoring, and security. I'm very glad that the dog bark or the other bark made it through. Let me also tell you about Shopify. Shopify is the commerce platform that grows with your business and lets you sell in seconds online, in store, on mobile, on social, on marketplaces, and now with AI agents. And without further ado, we have David Bazuki from Roblox. He's the founder and CEO.
Starting point is 01:28:34 He's been on the show before. Welcome back, David. How are you doing? Hey, it is great to be here. Thank you. Thank you so much for taking the time to come chat with us. I'm very excited about build. I'm very excited about a lot of other things going on in the Roblox world.
Starting point is 01:28:48 But take us through the announcement today. It makes so much sense. I think a lot of people could have predicted this happening, but I'm very interested in the shape of the project. and how you actually see it changing what Roblox is. Yeah, the shape is ambitious, and at the same time, it goes all the way back to our roots. You know, 20 years ago when we launched, we had this mission and vision of removing limits of gaming and having everyone be a creator.
Starting point is 01:29:18 The notion of a UGC platform was new. It's interesting that 20 years ago, our first slogan was, you make the game. And so, you know, time has an interesting way of going full circle. Fast forward to where we are right now. Roblox Studio has a bunch of models working to accelerate creation. We have the studio assistant. People are using it with MCP. And so we're gathering all of those models and bringing the studio assistant right to a tab in our mobile app,
Starting point is 01:29:51 both for one shot game creation and iterative gaming creation. It's really an elegant unification of what has traditionally been Roblox Studio all the way to the mobile app tab as well. So right now, I've seen tons of models that are capable of designing incredible games when prompted appropriately in a variety of systems. But they're all sort of expensive right now. Some of them are subsidized on plans. But I think everyone's optimistic about the cost coming down by orders of me. magnitude very quickly. But how are you thinking about doing that dance right now of giving creators the most powerful AI and not putting too many limits on it, but setting yourself up for a really
Starting point is 01:30:39 solid financial footprint over time as the product gets more popular? The hope is, you know, our well over 130 million DAUs, more and more of them can be creators. And I'll highlight that the economics aren't changing. You know, we expect more. and more money to flow to our creator ecosystem as even part of this announcement. There's a neat thing underneath what people see on the user-facing side of Roblox, that we're a huge infrastructure company. We have data centers all around the world. We have bandwidth.
Starting point is 01:31:13 We have CPU. We have inference. And we started this, fortunately, well over 10 years ago, to keep costs down and performance high. A lot of the inference we run today, we run all on our own data center. We optimize that in a way. The philosophy and the optimism of costs coming down goes straight to build in that just as Roblox Studio was the way people made games 20 years ago, that's still going to be live. But we think as games get more complex, as they get multiplayer, as they have interesting economies, as we want to save the infrastructure, all of that running behind it, that promise comes back with people being able to prompt and create games.
Starting point is 01:31:53 our vision is that everyone will have access to this for a certain amount. We will initially have the ability to buy more token usage if you want. But the beautiful thing is this is eventually consistent. And as inference gets cheaper and cheaper and cheaper, just as some other things were expensive 20 years ago, we think more and more people are going to be able to use this more and more. As you reflect on the decision to build your own infrastructure, how bad would it be be if you hadn't done that right now. Would you, do you, would you be feeling like a memory crunch? Would you be, are you feeling any of that? Like, what about what's going on in public cloud or the
Starting point is 01:32:37 AI buildout is well positioning you or maybe even affecting you? Yeah, I think we've said publicly before the cost benefits of our infrastructure may be roughly 3x. Now, I don't know, I don't want to quote that on inference and other things. but there's an enormous advantage to that and an enormous advantage of taking all that money, pushing it to creators rather than cloud providers. We are great partners with some of the cloud providers, especially in burst mode. There's a mathematical optimization where if we can run on our own in from most of the time and burst to cloud when we need to, that's kind of like the optimal cost structure.
Starting point is 01:33:18 But I do think the vision is we want all 130 million of those creates. creators and users to participate in making games. Take me through some of the other AI initiatives that are rolling out across Roblox right now. I was fascinated by the AI upreszing technology. I'd been very optimistic about that all over gaming. We've seen it early signs of it with DLSS, but clearly this is next generation technology. What's the feedback been? What's the process like?
Starting point is 01:33:52 I think there's a little bit of a fun, boiled toad thing going on here. We're all used to what a game looks like. We've been all playing games for 10 or 20 years. We know what they look like. And we have an expectation of what we look like. I don't think any of us have the expectation that a game should be photorealistic at 4K 60 hertz like a movie. Like that is something that's the problem.
Starting point is 01:34:22 province of movies right now, offline video models that create super high-res. And in our minds, we haven't disconnected like, what could that be like? Our vision and our dream and our hope is multiplayer gaming at photo realism, 4K60 hertz. And we believe the best strategy for this is not pure 3D traditional gaming, not pure video, world model, you know, action systems and all of that. but a hybrid system that is both optimizing the coordination of the thousand people in the multiplayer world with local super upreszing for each user. And so that's, you know, that's what we publish a blog post on.
Starting point is 01:35:05 It's why we're working on this super upreshing video model that we're going to incorporate. We showed some early demos, more demos to come, but we do believe it's almost going to be like going from black and white movies to color movies. No one has, we just aren't used to a purely photorealistic feeling game. So if the successful, like the keys to success as a UGC game creator, sometimes it can be asset driven, they can create something really high fidelity, sometimes it can be they are able to actually instantiate the game quickly, all of that's becoming easier with the two products you mentioned.
Starting point is 01:35:46 what remains the secret sauce to a breakout UGC creator on Roblox? Yeah, I think it's, there's a couple of interesting factors here. The overarching thing, if we take a step back, that gaming provides us in society is really our belief. Like, we think the world needs to be playing a little bit more, like, hanging out together, using their imagination. It's how we've evolved as humans and play is just a good thing. We think that as far as the creation of these experiences, we're going to see more and more interesting ways for people to play together. I feel it's a little bit like we've moved from oil painting to Photoshop.
Starting point is 01:36:32 We're all going to get better at making digital assets and things like that. But there's going to be enormous room for creativity around what type environments we play in. We're all going to feel more powerful creating those environments. We're going to have the same opportunities, I think, for many of the large teams on Roblox that are big studios now. But we will also have opportunities for first-time creators, just as sometimes first-time video producers get a breakout hit. I do think we're going to make that possible as well. Yeah, I'm curious how you're thinking about using AI not just to build the games, but also within the games. So, like, you know, I think everyone who's used these models has had this idea of like, oh, this would be an incredible NPC, right, in a game.
Starting point is 01:37:20 You can talk to it. It has this incredible, you know, ability to respond to what you're doing. I'm curious how Roblox is this thing about, you know, using models. I would say yes, yes, yes, yes, both NPC creation as well as dynamic world creation as well. You know, one can imagine a gaming world where, like, in the movie Inception, there is a dream master. who can modify the whole world for other people in real time. That's a very complicated computational challenge, you know, folding the road over in that dream sequence and inception.
Starting point is 01:37:55 But dynamic world generation, I think we're going to see in real time. Also, NPCs, you know, both not just doppelgangers and digital twins and every single sci-fi movie we've ever seen. There's another really interesting aspect for NPCs and that it's very. very hard. I think it's much harder in the gaming industry to figure out, is that thing going to work or is it going to be interesting? We've seen so much success in code acceleration, because we can define it, we can write a test plan, we can do iterative loops, we can let it go all night and get better and better. A game is a lot more difficult to define what is good.
Starting point is 01:38:35 I think we're going to see more and more NPCs used as testing agents. And the interesting thing about NPCs is rather than trying to write a test plan, let's put 100 random NPCs in a game, give them the same mission as a human, and see how they perform. The fun thing about really extrapolating to the future with a lot of compute and a lot of inference is those NPCs could conceivably run 100 times faster than humans.
Starting point is 01:39:01 So it's feasible to imagine a 100 player test for 100 hours with NPCs being compressed down to an hour. that starts to introduce the notion of Wiggins loop programming for game creators initially with NPCs. You mentioned Inception. The whole team's nodding because they all just saw it in 70mm in theaters because it was re-released. They love that. What about Roblox, the movie, or IP that is developed in Roblox going to the big screen? We saw Backrooms, a blender project.
Starting point is 01:39:37 very successful summer blockbuster. What's the future of that pipeline? We are looking into it. We've been really conservative because what we've always imagined Roblox as a IP factory, where new IPs that are not coming from the movie angle are coming from the, you know,
Starting point is 01:39:56 dress to impress and grow a garden angle. I just went and bought some dress to impress physical toys. So I think we're looking at how maybe in the future we would accelerate less of Roblox and more of those creators. It's fun to imagine a future where the brands of those creators supports properties. So I would say a lot of opportunity there. How is advertising developing in Roblox? It feels like AI unlocks.
Starting point is 01:40:26 It just lowers the cost of actually doing a branded integration. Someone who's a non-technical marketer can potentially come to you and say, I want a physical instantiation of my store. I want to do some sort of stunt. And you can say, yeah, like, this will just be a couple tokens. It's going to be a couple hundred bucks to get done. I think you're exactly right. What we're experimenting as well, even the descriptions of experiences, the thumbnails that creators make.
Starting point is 01:40:53 All of that is starting to become AI and dynamically generated. I would also say as our discovery tool moments, more and more starts to become front and center in the product, that's a much more. advertising format, a lot of young people are used to. Also, our on-platform advertising business, which is creators, in addition to using our recommendation algorithm, boosting by buying advertising on our homepage is going very well. And then, as you mentioned, we're seeing continued growth in both brand integration, as well as video advertising as well. Sorry. I did. I did it. Sorry.
Starting point is 01:41:39 It's very funny. How are you thinking about new platforms, new consoles, just the general strategy of the Roblox footprint. Are we past peak new platform, or is there, are there more surfaces that you want to expand on to? I know three surfaces right now. We're doing early experiments with Android TV, which is exactly the same Roblox client. Many experiences on Roblox that are not super high Twitch related are super interesting there. I think there's a huge opportunity to be on all TV platforms. Of course, we really respect Nintendo and Switch, continuing to talk with it.
Starting point is 01:42:30 them. We do think Roblox should be on that device. And then as we start to see all this collection of AR glasses and VR headsets starting to pop out, you know, we're going to see more and more maturation of what is kind of the standardized AR form factor, which is heads-up display, overlayed on glasses, ultimately projection. That's a real interesting platform for 3D communication as well. So we're tracking that. And of course, we're big fans of MetaQuest and Roblox is live there. And a lot of people play in VR right now. Yeah. In general, the glasses for me, I mean, there's been some exciting launches, Snap Spectacles and the meta rayband displays. But it feels like we're in a little bit of like a AR, VR, VR, winter in the sense of like it's just wait for the next major iteration. We're just sort of in between cycles. Is that what you feel? I think there's a huge AR glasses opportunity once we get speaker, microphone, camera, projection, lightweight, all working together. Everyone's dancing around the edge of it.
Starting point is 01:43:43 Arguably, the Google Glass from 10 years ago, I feel was on the right track. What's the lightest wearable everyday option? So I feel we may be in an AR winter. I'm not sure, but I'm very optimistic about that. form factor. Yeah. Yeah. It's interesting.
Starting point is 01:44:03 I'm such a VR bowl, but at the same time when I see just rumors about, oh, this next great display was canceled or something like that, I'm, I mean, VR and AR are super different. I, I had the privilege of trying on a VPL data glove literally when Jaron Lanier ran the first, you know, VR system on SGIs. So I saw it super early. So I'm super optimistic about AR. What about screenless experiences? I mean, there's a lot of like smart speakers and the meta raybans that don't have the displays, have an AI that you can talk to.
Starting point is 01:44:45 And I'm wondering, like, is there is there any opportunity for a Roblox creator to create a game that I mean, there are games on Amazon Alexa? And I'm wondering if there's any Roblox creator that could potentially create a game that doesn't require a screen, at least for part of the experience. I think the more Roblox is not thought of just as a game or a platform, but incredibly high performance, low-cost infrastructure that's available to everyone. That infrastructure is both single player and multiplayer. It's 2D and it's 3D. It can be on low-end devices and high-end. And is that infrastructure more and more incorporates NPCs and audio and those types of things. You can imagine crossover type games that involve NPC interaction jumping from those with a visual display to pure NPC interaction.
Starting point is 01:45:42 So I would say we're very focused on providing high quality, low cost infrastructure throughout the platform. And I think also focused on where it makes sense from performance and privacy. whether it's our voice safety models, our text filter models, our super upsampler model that we've announced, NPC model, game creation coding models, scene gen model, single part creation model. There's many of these where we feel we have the data to build world class and kind of put it all together in our build harness. What is your overarching philosophy on where certain pieces of the, the safety and KYC infrastructure should live. Because, I mean, I have kids.
Starting point is 01:46:30 They're not playing games yet, but I imagine they will at some point. I'm probably going to have an opinion about the amount of screen time. I'm probably going to do some research on what the right amount is. Some of that can live at the device level. Some of it can live at the application level.
Starting point is 01:46:44 Some of it can live just at the parenting, paying attention level. How do you think about the different pieces of the puzzle where identification lives, where screen time lives, where different filters live. Is this an important tradeoff? This is a top big discussion in D.C., right? Sure.
Starting point is 01:47:02 What responsibility do device manufacturers have? Do they have to tag the age of every device? I would roll back all the way to Roblox values. One of the four is we are responsible. And that value has led us to, in a way, shutting off a phone call. on my Apple Macintosh. Sorry about that. I hope you don't hear that.
Starting point is 01:47:27 So that has led me to, sorry about that. Problem of having integrated phone on your PC. That has led us to taking responsibility and doing a few big moves. No sharing image or video, age checking now everyone on the platform. So both AI and biometri. signals and really being unique in leading that charge, we ultimately will take every age signal we can get, whether DC mandates it from a device, whether we collect it, and we just get higher and higher resolution. But we're not waiting for a law or for device manufacturers to do that.
Starting point is 01:48:14 Like we're already done. Like we're already age checking everyone and using that to ban communication and, and monitor content. The other thing I would highlight is there's no silver bullet there in that even with device age check, so many parents are so busy that so many devices get handed around the household, just go take my phone, go take my tablet, that we will have young people, we will have nine-year-olds on devices that are age-checked for 18, that there is some reliable reliability and constantly doing continuous age checking like we do. Yeah.
Starting point is 01:48:55 I mean, the funniest example I can remember is there's this old Twitter exchange where presumably a young woman got banned from using Twitter by her parents. And so she logged into her Samsung smart fridge and sent a tweet. It was like, I'm back online. And it just shows you like kids are so ingenious. Like they will get around things. So you have to have layers of protections at every level, and there's no one-size-fits-all approach,
Starting point is 01:49:23 which I think is your- That's exactly right. Yeah, I'm curious how you're thinking about safety, especially in regards to AI. I mean, every time a new frontier model comes out, you'll see someone within like an hour who's jailbroken in. They have this crazy prompt, and you can get the model to say all these crazy stuff. So I'm wondering how you're thinking about that,
Starting point is 01:49:38 especially in terms of these large language models. Oh, like red teaming, sort of? Yeah, yeah. Yeah, I would say we're going further than that in that now, For everyone on our platform under 16 right now, they have a huge corpus of content. It's called Kids in Select Content. It's well over 20,000 games. But these are going through a fairly excruciating both user funnel as well as moderation funnel.
Starting point is 01:50:04 And in a way, it's working really wonderfully. That's an enormous amount of content. At the same time, it's not the full UGC catalog of millions and millions of things. And because we have age check, we can push it there. the vision with build is we have the ability in build that we don't fully have in studio where everything's being created by a prompt where we can see a history of all the prompts that have been used to create a game as well as ultimately the images that have been uploaded, the models, all of those kind of things to really make a similar determination
Starting point is 01:50:40 on the quality of that content. Whereas when you use a wide open IDE, whether it's Roblox studio or VS code or whatever, you probably can make anything. And so we are optimistic. We will keep the same safety gauntlet for experiences created by build. We're also really optimistic that because our discovery system is so unique to gaming, it's very much based on estimated long-term retention, based on direct measurement, that our discovery team's pretty optimistic, even if there's 20 times more games being created, one could have the fear, oh my gosh, we're going to get a lot of AI slop.
Starting point is 01:51:24 But, you know, we already have millions of people making games. Some of them are amazing. They're not all amazing. They need to make it through a high retention gauntlet before they start really being surfaced. So the beauty of this is we think our current discovery systems are already perfectly poised for the expansion of creation from build. Yeah, this is the aggregator thesis.
Starting point is 01:51:48 You're already filtering everything and you're set up for it. How are you thinking about intellectual property on Roblox in this, where it gets even easier to make games and experiences? There have been some artists and IP owners that have been more lean forward on, yeah, remix my songs or use my likeness. Sora had this weird cameo feature that I thought was pretty elegantly implemented where someone could go in and say, anyone, like Jake Paul was like, anyone can remix my image.
Starting point is 01:52:19 I want to be all over the internet. Other people said, don't put me in any videos that you generate. And I'm wondering if there's, like, what the long-term relationship with different pieces of IP. Some filmmakers might want a bunch of free UGC games that promote their movie. And some might not want any of their IP to leak into Roblox. How are you treating that? Yeah. So we, you know, that relationship between IP holders and current creators and game developers is really complicated.
Starting point is 01:52:50 There's multiple countries. There's Hollywood contracts. Like, imagining a small one or two person shop going and getting a license to some big IP is somewhat unfathomable. We do believe the future of this is just like Roblox solving it in a systems oriented way. We have a platform right now that is somewhat new called IP Manager, where we want, and we are running the gamut all the way from some pieces of IP, which, hey, we're open for licensing. We want multiple creators to come and use our IP. The IP from the movie Saw is in our IP manager. And so a creator who's interested in using that IP can directly contact, you know,
Starting point is 01:53:40 do an online contract and start producing something from that. But that IP manager can also act as an IP controller as well. And IP can go up there more. And the more that AI gets good at auto scanning and auto detecting can also be some companies that just say no one anywhere should be using our IP. So I think we're viewing this as a system's opportunity. and just like the democratization of gaming, we want more creators making interesting games,
Starting point is 01:54:14 democratization of the licensing process. Yeah, I mean, I've been really optimistic about AI solving this because I've watched firsthand how YouTube has dealt with it where you put a song in, immediately the royalties just go over there, you don't make money, but that artist does, and most artists are fine with that,
Starting point is 01:54:33 and then they always have the option to click that button and say, actually, I don't want that at all. And it's not perfect. Everyone has approvals at the right time, but it's like this stable equilibrium where I think everyone gets what's economically viable. I'm very optimistic,
Starting point is 01:54:46 but this will ultimately be a solved problem. Yeah, it's exciting. Well, congratulations on Build. Congratulations of all the progress. Thank you so much for taking the time to come chat with us. July 28th, Billed goes into Alpha. July 28th, thank you.
Starting point is 01:55:01 Thank you so much for coming on the show. Have a great Thursday. Have a great rest of your week. We'll talk to you soon. Good to see it. Let me tell you about MongoDB. What's the only thing faster than the AI market? Your business on MongoDB.
Starting point is 01:55:13 Don't just build AI. Own the data platform. That powers it. In Creator World, there is some news from Colin Samir. Lexus is now the official car of Colin and Samir. What does that actually mean? They made four ads for them that roll out across YouTube. They're sponsoring four videos on their channel.
Starting point is 01:55:35 It's the first of its kind of. deal that represents broader shift taking place in media, the aperture of what it means for a brand to work with the creator is changing quickly. It's very cool to see because obviously they've been on YouTube for a long time. They've done a lot of like host red ads, mid-roll ads, but this is a much deeper integration and something that I think will be hopefully replicated all over YouTube and be a new source of revenue for for creators of all kinds. So I was excited to see this. In other entertainment news, Jake from EconC-M-Pick, Econpick, says this is almost hard to believe. Disney spent $129 billion acquiring Marvel, Star Wars, Pixar, ESPN, and Fox, which is $182 billion in today's dollars. Throw in all of their legacy assets in the entire company's market cap today is $169 billion. Wow.
Starting point is 01:56:35 do you know what this picture is missing? Which, what do you mean? So, so they're saying they acquired all these assets and the company is only worth $169 billion. What's missing from this analysis? The cash that's been returned to shareholders. Disney across dividends and buybacks has returned like 70 billion, maybe more to shareholders, which is, I don't know, I just thought this. And it is, it is an interesting.
Starting point is 01:57:05 angle because they have spent a lot acquiring and the company is not worth more than what they acquired. So there's this question of like were those acquisitions accruitive or destructive or dilutive. But there is a whole separate picture, which is that a lot of cash has been returned to shareholders throughout this journey. Yeah. Also, I mean, that's the mechanism with which those acquisitions were funded also should Yeah, matters a lot. I don't know.
Starting point is 01:57:29 It was sort of interesting. Sean Frank has a pitch. He says you should move to New York City. bro, you got to move to NYC. The weather, horrible. 100 degrees, easy. AC, F that. Taxes, so high.
Starting point is 01:57:43 Rent, highest in the country. Air quality, some of the worst in America. Tech, bro, we banned. Do they really ban Waymo in New York? I believe so, yeah, there's no Waymo's. Wow, that's very wild. Yeah, if you can make it here, you can make it anywhere. So, I don't know.
Starting point is 01:57:57 Do you ever have aspirations to move to New York City? At some point, it seems... You've been to New York City. Yeah, yeah. It's a nice city. That's the thing is that all of this is true, and it's still a great city to hang out. It's so fun, so dense. You can see so many people walk around.
Starting point is 01:58:11 It's beautiful. It's just like, I don't know, it's unlike anything else. Still great, but yeah. You never lived in New York City. I've never lived in New York City, but I've spent, like, a lot of time there. So I've had a good time. Anyway, let me tell you about Codex. Codex is a powerful workspace for getting work done with AI agents, whether writing code, analyzing data,
Starting point is 01:58:28 creating content, or automating business workflows. Codex helps you move projects forward from start to finish. And there's some other news in the timeline, but we can go over it more next week. Eli Lilly is buying psychedelics firm Atai Beckley for an initial $2.8 billion. A tie was founded by Christian Angermeyer. I've actually interviewed him years ago. Fascinating deal working on psychedelics and a bunch of other things. Therapeutics for mental health conditions.
Starting point is 01:58:57 A huge deal going on there. And there's a few other stories, but we can get to them tomorrow. We're off tomorrow. there's some travel going on, but we'll be back Monday at 11 a.m. Pacific Sharp. Thank you to everyone who tuned in in the chat. Thank you for positive reviews of Tyler. Let us know anything to Tyler. Leave us a review on Apple Podcasts and Spotify.
Starting point is 01:59:19 Write us an email. Tell us how he did. I think he did fantastic. Have the best Thursday of your life. Yes. There you go. That's a good impression. That's a good impression.
Starting point is 01:59:29 But thank you. Sign up for a newsletter at TBPN.com. And we will see you on. Monday. See you. Goodbye. Going flashbang. Oh, we got the flashbang. There we go.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.