Moody's Talks - Inside Economics - The AI Series: Adoption Ramps Up

Episode Date: September 8, 2026

In this episode of our AI series, Ara Kharazian, lead economist at fintech company Ramp, joins the Inside Economics team to discuss the state of AI adoption. Drawing on Ramp’s real-time business spe...nding data, Ara offers a unique view into which firms and industries are moving fastest, which are lagging, which LLMs are gaining traction, how token pricing is evolving, and what data center constraints and government regulation could mean for the AI boom.Guest: Ara Kharazian, Lead Economist, RampView our latest articles and research on AI- https://www.economy.com/ai-insight-hub Questions or Comments, please email us at InsideEconomics@moodys.com. We would love to hear from you. To stay informed and follow the insights of Moody's Analytics economists, visit Economic View. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Transcript
Discussion (0)
Starting point is 00:00:15 Welcome to Inside Economics. I'm Mark Zandi, the chief economist of Moody's Analytics, and I'm joined by my two trusty co-host, Chris DeRides and Marissa Dina Talley. Hi, guys. Hey, Mark. Good afternoon. Yeah, good afternoon. I understand you're off to France here in an hour or two. Yeah, that's right. That's exciting. My last podcast for a couple weeks, I'll miss you guys. Oh, really?
Starting point is 00:00:37 You're going to muddle through without me. Chris, do you notice how much, she's like traveling the world all the time. And I, what's, what's that all about? What's wrong with us? It's what you're asking. Is that what it is? What's wrong with you? Yeah.
Starting point is 00:00:50 Yes. Yes. Well, you go off to Italy for a month or so, don't you? In the summertime? A little less than that. A little less than a month. Yeah. All right.
Starting point is 00:00:59 But I do bring my microphone with me, so. Oh, you do? Yes, you do. Yeah. Dedicated. It's a little different situation, Chris. How so? Because he's going to his mother-in-law's house and sitting in his mother-in-law's house and
Starting point is 00:01:13 Working. All right. I'm going to traveling all over the French countryside. I can't tow the pod mic with me. I'm sorry. So all of the places you're going in France, where are you most excited to go? I'm most excited about Paris just because I've never been. But I'm really looking forward to the countryside and the chateaus and the wineries
Starting point is 00:01:35 and I'll be in Bordeaux. And I'm excited about all of it. But I mean, Paris obviously is, I think, just very. iconic and I've never been. And you were saying the weather is now more reasonable. It looks more reasonable. Yes. Yeah. Good. Good. Well, we'll miss you.
Starting point is 00:01:54 Thank you. Yeah, we'll miss you. We've gotten to know each other quite well in the last week or so because I don't know how many podcasts we've recorded, but. Quite a few, yeah. Quite a few. But we've got a great guest, Ara Karazian from Ramp. Ara, did I, how badly did I bet your name? Did I really get it? Oh, wow. That's great.
Starting point is 00:02:14 Well, fantastic. So good to have you on board. Thanks for coming on. Thank you. Thank you for having me. I'm excited. Yeah. And we're, you know, I don't know if anyone told you, but we're having a series of podcasts around artificial intelligence AI. We had, our first one was with David Autor. Do you know, David? He's the MIT economist. Yeah, a really good guy. And it was quite fascinating. And then we're releasing a podcast this afternoon with Daryl Spence from Capital Group. And we had Michael Gugas from Construction Connect talking about data centers.
Starting point is 00:02:50 And now you. So it's great to have you on. Would you mind, I don't know you very well, and I don't know Ramp at all. And I know you're doing a lot of great work. I'm starting to follow your AI index very carefully. And you're in the, deeply in the conversation around AI. Could you just give us a brief sense of you? in Ramp?
Starting point is 00:03:13 I have this great privilege of working with a great data set, mostly because of Ramp's product. But I know my name is Rara Krasian. I am the lead economist at Ramp, and I run our economics lab, sort of our equivalent of a think tank. But we produce original research using business spend data from Ramp about new technology frontiers, AI spend especially most recently, and how businesses are investing in it, where they're pulling back, and where they're double-term. down. Now, this work works because if you're trying to understand how AI is developing in the market,
Starting point is 00:03:49 there's not really a lot to go off. The companies that are developing it are all privately held. So you can't really get a great sense of the size of the market. And then if you want to understand how businesses themselves are using it, there's not much in the way of productivity statistics, at least in the international statistics. So you kind of want to start with, well, who's using AI in the first place. For a long time, all we had to work with was surveys, but those surveys are often detached from the reality at most businesses. You come up to the cusp of trying to draw lines about, what does AI adoption really mean? Can we measure the intensity of AI adoption with a survey? And so the privilege of my data set is that it's actual business spend data. So Ramp is a finance
Starting point is 00:04:32 platform for businesses. So you can think about a transaction data set of corporate cards and invoicing and bill pay and token spend management. We pull all those sources together to look at the universe of business spend and understand not only how are firms buying AI and who they're buying it from, but how that's changing over time. And then what's different between firms that are using AI and those that aren't? And then from there, you can start to understand, how are they hiring differently? How are they opting for open source models or not? So it's a really great data. set that allows you to track this fast-changing market in a way that public data sets so far have not been able to do. Are RAMP's clients, I guess, is that the right word, are customers?
Starting point is 00:05:21 Yeah. They're enterprises, their businesses. Are they in a certain set of industries? What are the demographics? What are the characteristics of the Ramp customers? Yeah. 70,000 businesses, $200 billion of annual spend, primarily in the United States is where my research focuses, but that'll change over time. It has a pretty good distribution, I would say, actually, in terms of sector. You know, we have everything from tech to manufacturing to construction, and most of our work is able to therefore break down our estimates of adoption by the sector or size of the company. I do, however, think that we skew toward, regardless of the sector that you're
Starting point is 00:06:01 looking at, relatively tech-forward businesses. Ramp itself is already a sort of AI finance platform, form itself. It's opted for by tech forward businesses versus like a chaser and amax. And that is actually a strength of our data set. If you want to understand, I think, where the market's going to go, you want to look at these early adopters of new technologies. For that reason, our data set was the first two track that Anthropic was starting to overtake Open AI in business adoption. It's also a highly granular data set so we can report these sort of differences between businesses as they come in. So when you talk about adoption,
Starting point is 00:06:39 would it be fair of AI by enterprises, by businesses, would it be fair to say that the, and we're going to get into your data and get a sense of what the data is saying, but would it be fair to say that it kind of overstates the case for the broader economy, or do you make a correction for that? So that's a harder question than you would think,
Starting point is 00:07:03 because there are, The U.S. government estimate lands in like the low 20s, as far as the share of firms that use AI. Our estimate is about 53%, just crossed 50% a couple months ago. But there are other estimates that use survey data of U.S. businesses that land somewhere around 70 to 80%. In many ways, I think our data set is actually likely to understate adoption because we're limited to looking at paid adoption on a business's sort of invoicing and or corporate card platform. So we're not capturing free adoption. You know, Gemini usage happening through Google Workspace. We're not capturing the adoption that is definitely happening on employees' personal accounts.
Starting point is 00:07:45 And that's really the difficulty of doing this research and some of the questions that we've had to deal with, both at Ramp and then other economists externally, is where do you draw the line of adoption? For a long time, that's all that mattered is our business is using it. And the metrics kind of coalesced around that. Turns out answering that question itself is very difficult. because you have to define what it means to use a new nation technology, and we're still trying to figure out how it's applied in enterprise. Increasingly, I think the research is shifting over to a better question, which is how are they using it and to what intensity,
Starting point is 00:08:21 and then you can break down the actual product lines that are adopted. Got it, got it. So just as a fictitious example, if Moody's or a ramp client, and I don't know if they are or we are or not. and we spend, you know, making it up, half a million dollars on our LLM, or we're using Claude,
Starting point is 00:08:44 that would show up in your data. That would be the kind of thing that would show up in your data. Yes. And you would know it's anthropic, it's not open AI, you would know all those things, right? Because you're paying the bill.
Starting point is 00:08:56 You're paying to build anthropic. Well, think about anything that shows up on the receipt because we see that too. To be IRS compliant, businesses have to upload those itemized. receipts. So that's what allows us to see, are they just buying Claude or are they making agent calls through Claude code? Is it a subscription? Is it tokens? Increasingly, we're able to see whether or not, you know, the other software that you're buying outside of those main model
Starting point is 00:09:24 companies is also inclusive of AI features that are charged for as line items. So it's a market that's developing very quickly. And you see that in the story of bills. Literally receipts and invoices are evolving the same way our work is involving. Got it, got it. Hey, Marissa, before we move on to the meat of the matter, the results, the OpenA, the, excuse me, the AI index. And I should say, Arra, Marissa comes from the BLS, so she's, you know, very persnickety when it comes to data sources. Marissa, any thing you want to ask Aura about the data before we move on? What about AI that's built into existing software platforms?
Starting point is 00:10:09 Like if people are using copilot but it's in their, you know, Microsoft, do you have any insight into that or does it have to be a specific AI product they're purchasing separately? That specific example is the type of adoption that I think we underestimate. I see. Okay. Because you buy, and that's a sort of Gemini example, right? That Gemini is free through Google Workspace copilot as well through Microsoft's equivalent. Now, the most advanced businesses that are using AI are typically not primarily relying on Copilot and Gemini.
Starting point is 00:10:44 So for our research, we're able to focus on the segment of businesses that's spending on more advanced tools. But that's a great example of why it's hard to track these trends over time. Is that for many people who are using AI today, they're using versions of AI that are very different than the frontier that, you know, We're increasingly getting used to at companies that are paying for it. Hey, Chris, anything for ARA? What about open source or open weight models? I hear there's an expansion into that area. So in theory, that's free.
Starting point is 00:11:18 That's not charged for, correct? Or maybe do you have any insight into that usage? That's a good point. So open source models or open weight models, theoretically businesses should be able to create their own infrastructure on site that allows them to call this internally hosted model such that no payments are going in and out of the company. It's all hosted on a company's own computers. The market has not adopted that path very popularly, mostly because there are fairly cheap alternatives to using open source
Starting point is 00:11:54 models that are hosted by another company. So this is like using a router product. It's just a cheaper way to access not just one open source model, but a lot of open source models. And you still get most of the price savings, but you're making tool calls and small payments to another vendor. So you can proxy, and this is what we do, you can essentially track open source adoption by tracking payments to those kinds of companies, those routers. We do that too. Just one last question before we get on to the data, because we've worked with third-party
Starting point is 00:12:29 data sources as well over the years. And one of the problems and tried to tease out, you know, information from that data. And one of the issues that would come up is the growth rate of the company itself, right? I mean, if you're growing fast, then some of what you're observing is simply that you're getting a larger share of the marketplace. Or conversely, if your business isn't performing well, just the opposite. Is that an issue here at all or something to be wary of when looking at the data? Yeah. Well, I think my frustration with private data source is exactly what you're describing is that, you know, this is a call to my counterparts of their companies, is that there is oftentimes pressure to use these private sector data sets in ways that they're just not well suited to do.
Starting point is 00:13:20 I mean, I think that's the best life advice is the same as the best economics data set advice is that, you know, don't try to be something that you're not. And so for all of our research, we do a combination of things. One, it's picking a metric that accounts for exactly what you're describing. So if we're comparing two different groups of businesses, we compare like for like businesses to try to track those changes. I see. Right. If we are unable to do that and sometimes we are able to that, it's actually just helpful to show that there are large differences between the fast growing businesses and the slower growing businesses, we want to highlight that change. And we'll be transparent about our methodology,
Starting point is 00:14:00 and we'll show here's what's different about these firms versus others. And then we publish all of our data online so that researchers can download them segment by segment. And if they want to make their own weights, you know, to make tech a little heavier, tech a little bit lighter in this sample, let's make it more construction manufacturing focused. You can do that too.
Starting point is 00:14:20 So we've seen actually a couple of researchers, you know, produce similar results. Got it, got it. Well, let's move on to the AI index. And I know you do a lot of different things, but this feels like kind of your flagship set of data. You want to describe the index and what broadly it's saying at this point about adoption and intensity of use?
Starting point is 00:14:46 AI index does a couple of things, but it starts with our spend data, and it tracks first the share of businesses that are using AI at all, and then the respective share of businesses that are using OpenEye versus Anthropic versus the other model providers. I'll start with that metric because it's the broadest image of the market, which is where
Starting point is 00:15:03 you see, you know, pretty mediocre adoption rates of AI from most of 23 to 2024 and then this rapid rise in adoption in 2025 into the beginning of 26, especially driven by adoption of the more advanced tools like coding agents. That's where you saw the share of firms using AI cross about 50% in our sample. It's actually simultaneously around the same. time that you start to see this intense competition between Open Eye versus Anthropic. So remember for most of the last five years, well, I mean less than five years, right? This is much younger market than I even realized. Open AI was kind of this default. You know, it was it was the AI that most of us were familiar with as far as a vendor that you could buy from. And despite AI being this thing
Starting point is 00:15:51 that businesses could buy, it was also something that consumers were learning about for the first time. And so if you're a business buying AI for the first time, you're probably going to buy Open AI because that's what you're familiar with as a consumer. That started to change at the end of 2025 and the beginning of 26, where Anthropics start to see this really meteoric rise, ultimately crossing Open AI in business adoption. And today, having about 53 percent, not 53, about 43 percent of businesses are using Anthropic today. So you start to see in this metric, like a story of a market that is becoming increasingly complex and expanding and starting to behave differently from how we'd expect software to behave. Because remember, if you're typically buying software, you are buying one vendor. I mean, there's some try before you buy period where you experiment, but software purchasing companies typically follows this cycle where as you become more advanced, you stick to one vendor and you sign one long-term contract at a lower price. AI is nothing like that.
Starting point is 00:16:54 And that we saw as firms became more advanced, they actually start to consider more than one vendor and sign on for more than one vendor. And then the contracts they start to sign with those vendors start to get bigger and bigger and bigger. That's Open AI versus Anthropics story. But then you start to see that in the rest of the metrics that we track. Per employee per month's spend
Starting point is 00:17:14 tells a similar story where if you want to see, well, how far is this market going to go? where should it land? Because no one really knows how much to spend on AI at all. You see every single segment of business,
Starting point is 00:17:29 no matter how you break it up versus tech, manufacturing, or retail, every segment is growing their AI spend. And in virtually every segment, if you divide it by the top 1%, the top 10%, and the median, you observe these power law effects where the vast majority of spend,
Starting point is 00:17:48 90% of the spend is, driven by less than 10% of the customers. Overall today, the top 1% spends about $7.4,000 per employee per month on AI. Top 10% is about $6.50 and the top, and the median is about $12 per employee per month. And so there you start to see these distributional effective AI. And you start to see how the adoption metric itself is lacking to simply track whether or not businesses use AI, fails to track the fact that some businesses are using it much more than others. Some businesses aren't really using very complex versions of it at all.
Starting point is 00:18:30 You know, $12 per month maps to like a simple chat GPT subscription for everyone. And that starts to explain the macro statistics that we're all familiar with. Why doesn't AI show up in productivity metrics in the U.S.? It's because the vast majority of firms that are using AI are not getting ROI from it. They just aren't. They're using extremely simple models. They're not even using multiple models on average. You're not seeing that yet.
Starting point is 00:19:02 The median firm, and by the way, this is our very tech forward data set that we just talked about. Yeah, yeah. Is spending a chat GPT subscription, which, like, if you've used chat GPT, even the paid versions, you know that it's like nice to have, but it's not particularly productivity enhancing. So the gains from AI end up being concentrated amongst a very small set of, by the way,
Starting point is 00:19:30 fast-growing firms. And yet the metrics that the market is tracking are typically reported at the aggregate level. You know, the average spend or the total, amount of open eye and anthropic revenues. This is a really fast-changing market. It's a very dynamic market and it's a very heterogeneous market. And it's so I think that's the place where Ramp Bay Eye Index has been so helpful to analysts is showing how complex its development has been. It's not tracking the same way as software has historically because as firms become more advanced,
Starting point is 00:20:10 their behavior becomes more complex and difficult to track and spread between multiple vendors. I don't think we've figured out yet. I don't think most firms have even figured out where it's going to land in terms of how much they expect to spend on AI. So there's a lot to unpack there. So the lead statistic, the stat you led with, was 53% of the enterprises that you have business with
Starting point is 00:20:40 our customers use AI in some way or spending some money on artificial intelligence. And of course, that's, excuse the pun, ramped up quite a bit since 2020 when chat GPT was put on the planet was close to zero and now it's 53 percent and it's still rising. Do you know, just quickly kind of a sidebar, you know, what the total spend is? Do you have an estimate of the total spend by enterprises on AI? Do you have any sense of that? Like, is it $300 billion? Is it a trillion?
Starting point is 00:21:16 It's not a trillion dollars. Is it $100 billion? From the public metrics, it's in like the low hundreds of billions. I think the late assessments are somewhere between $200 to $300 billion. Okay, $2,300 billion, which in the grand scheme and things is pretty small. And you're saying that's got to be one reason why it's not showing up in the macroeconomic data, at least not yet. But that's the other thing you're saying.
Starting point is 00:21:39 You're saying that the intensity of use is very concentrated among a few firms. So you've got these big, big power users that are using it very aggressively, spending a lot of money on it. But most of the other enterprises captured by that 53%, they're not. They're casual users.
Starting point is 00:22:00 Who knows what they're doing with it? As you say, the ROI is probably not there. Is that, do I have that right? Exactly. Yeah. Got it. Got it. And that's another reason why we're not seeing it in your view in the macroeconomic data in the productivity day because, first of all, it's only a couple 300 billion dollars.
Starting point is 00:22:19 Second of all, it's very concentrated in a few businesses. It's not broad-based in terms of intensive use. I mean, even in our data set, that's one of the adjustments that we have to make for our research is that realization that to do research on all AI adopters doesn't really. get at the quantifiable impact that AI adoption is going to have on a firm. Because all AI adopters is including this group of firms that is high intensity, highly invested in it, doubling down on it every month. And it's also including these businesses that look fairly casual in their adoption by comparison.
Starting point is 00:23:00 But it requires you to come up with a definition of what does it mean to be a good adopter of AI? Right. And this is, of course, what businesses are trying to address and why they're hiring, you know, the model companies, open ionanthropic. No one's really come up with a definition, at least no one's shared publicly the playbook. Yeah. You know, the sort of practices and habits that use AI to drive productivity gains throughout a large complex organization. We have some ideas of it, but it's not known to the public. Now, there's two different ways of kind of thinking about what you're saying, or at least my interpretation of what you're. you're saying. One is a more optimistic perspective, and that is, well, we got a lot of room to run here. I mean, it's early days. Adoption is still pretty low, only 53%. You can envision, it should be at 100% at
Starting point is 00:23:51 some point. And more importantly, intensity should broaden out to more firms. So there's a lot of opportunity for growth here and for the impact to become meaningful from a macroeconomic perspective. other way of looking at it is just the opposite, that it's not working. You know, it's not working for the median company in the United States. They're floundering in trying to figure out how to use it. Maybe it's premature to conclude that this is not going to work, but maybe it's not going to work. So, Chris, you were shaking your head, yes. Is that, you're thinking the same lines? Yeah, I was thinking very, yeah, it's kind of this bimodal distribution. Right. Right. Either we haven't discovered how to really use it. This new hammer and takes time just to figure out how to use it. Or it's not really useful for most people. It's really a surgical instrument and you have to be a highly specialized firm to really take advantage of it.
Starting point is 00:24:50 Are, is that a good frame? And if it's a good frame, where do you land, oh? I think it's, I think it's a good frame insofar that it shows how difficult it is for AI to proliferate through a market point. place through traditional mechanisms. You know, we found, for example, that firms that small businesses, for example, are less likely to use AI in the first place. But when they do, they tend to be more intense adopters. Intensity defined as far as their spend per employee is higher. They're more likely to use multiple models than even in enterprise, at least, you know, when they're high intensity.
Starting point is 00:25:31 they're more likely to sort of reinvest in it year over year. That is an economically suboptimal outcome because what it means is that AI adoption proliferates through, oftentimes through what we found in our research is the labor pool you can hire from and the other businesses that you're around. Tech companies in California
Starting point is 00:25:56 are more likely to adopt AI and use it more intensely than tech companies, in New York. There is no economic reason for that, other than these are the companies that observe AI be used in a certain way, and then they learned from it, and they applied it in their own organizations. Now, I'm not going to go on a show and say, like, oh, we need to help out, like, the New York-based tech companies be more productive.
Starting point is 00:26:22 I'm in New York, and I work at a New York-based tech company, actually, right? But, like, that's not the policy concern I have. So much as the policy concern I have is that there are companies that are upon AI adoption through these uneven mechanisms, then enjoying the growth that is bequeathed by intense AI adoption. And then you can walk through the economic stories that are likely to occur, right? I think if you want to go into historic technological transformation and theory and how this tends to go, it's that even if a technology doesn't make a firm that much more productive, a doctor's office is not going to become that much more productive when it uses AI, the doctor's offices that use computers are likely to put out of business the doctor's offices that don't.
Starting point is 00:27:21 you know, because they, you can imagine, they're more likely to get a Google Maps listing. They're more likely to advertise and then drive more patients over to them. Even though the computer itself and the internet didn't do that much for, you know, my day-to-day experience going to a doctor. Yeah, it might be something similar there, where through these methods of proliferate, through these sort of uneven proliferation mechanics, you will have some firms be winners and losers simply by the fact that they were part of these networks rather than they were the ones that were best positioned to succeed. Yeah, so, okay, it's complex, but in my kind of simplistic way of thinking about this, you know, I'm an economist. So like all economists, I look at history and I say, this is how technology diffuses to the economy and how it diffuses and it takes a long time.
Starting point is 00:28:17 There's a lot of frictions, and you're saying the same thing. And the productivity gains are hard to come by, certainly early on. It takes a long time. In fact, it's not until new companies form and optimize around the technology that you start to see the real lift, because those companies can organize themselves, get the right people, don't have the same frictions, and, you know, we see the technology develop more fully. That's, that, am I reading too much in your data when that makes sense? It makes sense. That's what your data is kind of sort of saying, at least so far. We wrote a paper. A good example
Starting point is 00:28:55 is that we wrote a paper a couple months ago about AI's impact on jobs. Everyone wants to write that paper, but we had a very good data set for it in that, you know, previous work so far has worked, has focused on surveys to try to estimate AI adoption or it's
Starting point is 00:29:10 try to estimate jobs impact through AI exposure scores. Like, is this job exposed to AI? Is it not? Yeah. And, you know, economists disagree on the ability of those scores and even the surveys to get at the answer. You know, what you really want is a data set that shows, hey, these firms adopted AI,
Starting point is 00:29:28 these firms didn't. What happened to jobs over time pre and post adoption? And so we used our data set and we joined it with a workforce data set from Ravello Labs. Yeah, great. We've had their chief, who's our chief economist again? Lisa Simon. Yeah, she's great. Yeah.
Starting point is 00:29:46 Lisa Simon was on the paper with, co-authored the paper with us. And we found, you know, essentially that kind of story where firms that adopt AI tend to grow faster following adoption, but it's essentially exclusively concentrated amongst the firms that adopt AI intensely. So if you divide AI adoption to two different groups, firms that adopt AI intensely versus firms that adopt it sort of very lightly. So using agents, multiple models versus maybe having a simple. chat subscription for everybody. Firms that adopt AI intensely grow their headcount 10% over the two years following adoption. Firms that adopt AI lightly see no change from the control group. And by the way, this is comparing like for like firms.
Starting point is 00:30:36 So firms that were growing at otherwise similar rates pre-adoption, there are obviously firms that adopt AI were fast-growing firms as is. Tends to be the case with new technologies. their headcount growth accelerated upon adoption. Interesting. And so, and today the results were concentrated amongst the sort of high-intensity groups of businesses. But you saw some interesting growth, too, in unexpected places. You saw outsized hiring growth for entry-level hires.
Starting point is 00:31:09 That surprised us when we were first reading it, but such that it was about 12% overall growth over two years. such that the final firm had a 1% higher share of entry-level workers two years following adoption. And that was statistically significant. But, you know, it's surprising to many of us on the outside, but if you talk to many of these firms and these sort of high-intensity group, they'll say that they are hiring differently today. And the main difference is that they want to hire people who know how to use the AI models and know how to use them well. Right. And what better place to look than young people and recent college grads? So it sounds like you're kind of landing where most economists have landed.
Starting point is 00:31:54 That is adoption, but slower adoption. It's going to take a while for it to really come on and change the macroeconomic picture. And that the impact on jobs, of course, a lot of churn, a lot of job disruption over here, but job creation over here, the net of all that is, it feels like the job market's going to be okay, just fine. That's kind of what you're saying. I think that I've landed somewhere.
Starting point is 00:32:25 Sometimes it feels like I'm too econ for the tech people and two tech for the econ people. I know how that feels. And really that's because of the data set that I work with, in that I am not a, I mean, if you talk about what tech people think, is going to happen to the job market. You know, you get very disparate views on each side, right?
Starting point is 00:32:49 You get either massive job boom or you see massive job loss and none of us have anything to do after. And also, we all die, is apparently one of the mainstream opinions. So I'm not in that school of thought. And then you see a lot of the econ people who, I think, underestimate the effects of AI adoption, and the productivity gains that are already happening at firms that use it intensely. I agree that you don't really see them
Starting point is 00:33:18 in national productivity statistics. I mean, you know, you can see like the impact of the data center boom, but you don't actually see the, clearly see the impact of AI as far as it's applied to white-collar work. But if you have a data set, again, it's not otherwise available
Starting point is 00:33:33 to work so granularly to people in the public that we do want to make that available. And you can track specifically what's happening, at the specific segment of companies that are applying it intensely, which is still a very small group, you do see productivity gains. You see hiring growth and you see ROI in the form of the revealed preferences of those businesses. It's not bubble-like behavior when a firm expands their AI vendor list to experiment with new ones
Starting point is 00:34:07 and to double down on the old ones as well and to increase contract sizes. retention rates for AI-enabled software has risen each year since we started tracking it. As in I'm not just talking about like the model companies open-ionanthropic, but I'm talking about the fact that in every area of software, you're seeing AI-native entrance, CRM, right? This like Salesforce and HubSpot dominate the market, right? But there are also new entrants that are AI-native and challenging those large incumbents. that are growing their business adoption rates,
Starting point is 00:34:46 like whole percentage points month over month, growing very quickly. Salesforce and Upspot are still so large and not losing a massive amount of market share. But you can start to see how there is increasingly a better matching happening between software vendor and business buyer and that the companies that are buying AI,
Starting point is 00:35:07 whether it's through open-inanthropic or it's through some vertical-specific software category, are finding such use for it that they can both expand the vendor list and double down on the ones that they've bought previously. That doesn't happen in bubbles where there's just spend without question. You know, you are seeing some actual conscious decision-making about who you want to go with and who you want to buy from. Got it, got it.
Starting point is 00:35:34 So there's really two really big concerns about it. There's lots of concerns about AI. I mean, there's a lot of worries. But from a macro perspective in the near term, there's two. We talked about one, and that's job loss. And the other is around what's going on in the equity market and the credit markets more broadly. Stock prices have risen very significantly corporate credit spreads or paper thin. There's a lot of euphoria around, investor euphoria, around the success of AI.
Starting point is 00:36:10 these companies that are in that ecosystem and that they're going to be able to generate the kind of profits that are necessary to support those higher valuations. How do you have a view on that? How do you think about that in the context of what you're observing? Well, so far, across these segments that we track,
Starting point is 00:36:36 you see every group buy more and more from the model companies. every month. You know, the median top 10%, top 1%, even the threats that we have talked about, open source models and Chinese models, cheaper Chinese models that may eat away at the revenues of open-anthropic. Adoption of those tools is relatively marginal. Only about 6% of businesses that buy AI are buying open-source models, are using open-source models. Typically through a router platform. That's how we can track it. amongst those businesses, they continue to increase their spend on open-Aanthropic.
Starting point is 00:37:18 So I imagine, you know, it's had some marginal effect on how much they would have spent and some counterfactual on open-anthropic, but not enough that it's led to a net decrease amongst the companies that, again, specifically the companies that are already using open-source models. So that's some reprieve for investors that are banking on open-ionanthropics growth, is that companies, regardless of their cost-conscious posture or their exploration of cheaper models, continue to spend more and more on American model companies and at the frontier.
Starting point is 00:37:55 However, there are cracks in that AI thesis. So one of them being what's revenue, it's price times quantity. So quantity is addressed. Quantity will be fine. companies will buy more and more AI that continues to happen at the top 1% within it, the median, everyone's buying more AI.
Starting point is 00:38:16 Maybe if you asked me a month ago, I would say there's no problem really on price either because companies keep going for the frontier as well. But that's starting to appear not the case. There's two main signs of that. So Fable came out over a month ago now. Fable is
Starting point is 00:38:34 Fable 5 is anthropopic. I'm a big fan. Big fan of Fable. I know. I'm in the minority. But yeah, you're exactly. That's what I was. So, and remember Fable was so good, highly performed that the government briefly banned it.
Starting point is 00:38:49 Right. We all know that it's a good model. It's also Anthropics' most expensive models. Essentially the most expensive frontier model to date for sort of normal business usage. And Fables only cracked about 5 to 10% of business adoption slash model spend in today's market across open-9 Anthropic. So lagging pretty significantly behind GPD 5.6 Seoul, that's Open AI's frontier model,
Starting point is 00:39:21 lagging behind even Opus's latest model, which is Anthropics are their best model. And, you know, there's a couple of reasons going around about it that, well, Fable 5 because of its sort of everything that happened with the government, they have to do safety checks on every prompt that's going through the model. It's one of the things the government imposed on Anthropa to get it approved. And therefore,
Starting point is 00:39:46 Anthropic has to keep your data for 30 days to do these safety checks. That is a non-starter for many businesses. So they're not willing to use Fable for that reason. But the second reason is price. It is the most expensive model. And there are other highly performant models
Starting point is 00:40:01 that are pretty much just as good. and they're half the price. Like 5.6 sole was half the price. Actually, if you asked me two weeks ago, it was half the price. But this week, Open I just cut the price of 5.6 sold by 20%. Did they? I didn't know that.
Starting point is 00:40:20 Forget threats from Chinese model companies. These are two companies that are competing with each other. Yeah. And Anthropic has yet to respond, actually, with its own price cuts. But Open up is very... I kind of sort of did. Do you remember after the... the government allowed it to go forward.
Starting point is 00:40:36 Then they gave you a week. You have this for free for a week. And you'll see it's not just price cuts, right? They are also increasingly starting to introduce cheaper models and highly performant cheap models. Right. To compete both of each other and the Chinese model companies are doing price cuts on those two.
Starting point is 00:40:51 So if you look at a chart of these sort of effective price per million tokens to the frontier model, to open an anthropic, it's fallen like in a month, like 30, 40 percent. Where do you get that data, Aura? RAMP, my data set. You have that data? Yeah, because we have itemized receipts. We see the price per token.
Starting point is 00:41:12 Do you publish that data? I just haven't noticed it. I hope by the time that this one goes, this podcast goes up, we'll have prices posted on our website. Oh, okay, okay, great. I thought I might have missed it. Yeah.
Starting point is 00:41:23 Ramp.com slash data has our dashboard of metrics that I track. Because I've been looking for that data. I just haven't seen it. Yeah, and I'm increasingly adding more to it as we, Thank you. Like I want listeners to know that this is a scrappy team. That website is vibe coded by me. Like, I see.
Starting point is 00:41:41 It looks pretty good. There's data that we have that we use to inform sort of our outlook that isn't on the website because I haven't made the charts yet. And so. You could, I could, you need a little lesson on chart making. I'm just saying. I need fable five. You could do better.
Starting point is 00:41:56 I'm just saying. You have some cool charts like that first chart where you show market kind of the adoption rate by LLM is a pretty cool chart. I made that before the vibe coding era. I wrote that by name. Oh, is that why? Okay, that makes sense. I'm not joking.
Starting point is 00:42:10 Like, that was probably the last piece of code that I truly wrote myself. I see. The job of an economist has changed a lot over the last year and a half as well. So. But the picture of your painting, okay, you say, okay,
Starting point is 00:42:24 we're going to get the quantity, we're going to get demand, it's going to happen, but it's only going to happen at the cost, the price is going to be, is falling, the effective price is falling. So what does that mean for overall revenue? Well, the whole other lever that the model companies had to push their profits up is now
Starting point is 00:42:41 totally gone. There's no price lever anymore, clearly. No price lever. So it's all going to be a volume play. And they're going to have to, they're going to have to increase volume faster than the price can fall. And so far, that's actually been happening just fine. but is going to become increasingly challenging.
Starting point is 00:43:03 I am not an investor, so I don't actually know where the valuation should end up. But I can say as these levers start to deteriorate, especially the price lever, I would re-evaluate my price. I mean, part of the challenge here, too, is even tracking the volumes, there's a chart going around that use open-anthropics public disclosures to try to estimate. their total revenue for the year. And then it had like a revenue figure for Open AI for like and Anthropic for like, this is a couple weeks ago, like July and August of this year.
Starting point is 00:43:42 And I was like, how did they already get that? Like, I don't think that was announced. And you look at the chart notes and said like, oh, we can, we just continued the previous trend. I saw that. Yeah, I saw that. That's on like, that's fine. Almost always in every market.
Starting point is 00:43:56 Because most markets just don't change that much. much. They're also not that fast growing. The methods are fine. It's really the best the market can do. But I saw that and I was like, oh, I can make that chart with the ramp data. Because we only get a subset of the market, but we correlate surprisingly closely. And so I published my own chart. And I think the shock that came to many analysts and watchers is that it was the first chart to show and confirm what open AIS CFO sort of said in remarks to the company, which is, that they saw an inflection point in July,
Starting point is 00:44:30 and they're now growing faster. And that's exactly what our chart showed. Is the first chart to show that actually, after several months of anthropic beating Open AI in growth, open eye was now growing faster. And that's entirely something, as entirely a result of the fact that previous methods of financial analysis
Starting point is 00:44:48 that we're all used to, which is just, yeah, sure, impute the next month. It's fine. It's one month. How much can change in the market? That doesn't work for AI model companies, in part because these models aren't very sticky. You know, we saw the reasoning behind OpenEye's recent growth is that they came out with a better model than Anthropic. Yeah. That doesn't go well for these valuations either, right? I mean, it's a contestable
Starting point is 00:45:15 market. I mean, yeah, right? I mean, very contestable. People switch, you know, I switch very, quickly. I mean, I switch rapidly. Yeah. The model companies, but it's not like they can give much forward guidance about it and say, oh, we're going to have the better model in December of 27. They can't do that because they don't know what's going to come out of their models until it does and until it's digested by users. Forget the market, like literally engineers who use it and talk about which one works for them. And in this most recent cycle, it was open AI one. Open Eye beat Fable, beat Anthropics Fable. Interesting. And so you have all of these models sort of all of the sort of financial models fall apart.
Starting point is 00:46:00 I know, we're going to lose you pretty soon. So let me hand the baton back over to Chris and Marissa. Hey, Chris, there's so much to unpack here. We go on forever. Where do you want to take the conversation? Well, I'm feeling, I came into this hoping to have a little bit better. I actually am feeling a little bit worse about the outlook here. So maybe you can either confirm.
Starting point is 00:46:22 In what way, Chris, in what way are you feeling worse? Very consistent with our job. Well, I'm hearing. what I'm hearing is there's a race to the bottom. The prices are heavily subsidized and there's highly competition. Things are going down. The prices are coming down. Token costs are coming down, which, okay, great for consumers for the time being.
Starting point is 00:46:40 But then if I go back to my previous, there were our previous podcast, right, on the data centers, the costs are going up. Yeah. Right. Regulations, cost of electricity, so on and so forth. So it seems like something's going to crack here, right? The two can't continue indefinitely. Or am I missing something? Is there some innovation on the horizon here that makes all the math work out here?
Starting point is 00:47:05 It depends on who you are in the market. I mean, if you are a business or a consumer of these models, it's great. Price comes down. For now, right? Just like ride sharing, right? Uber was highly subsidized until it wasn't, right? Until the market sorted itself out.
Starting point is 00:47:22 Now it's like a taxi, right? Well, but the increased competition, I think, still Uber and Lyft is a story like there's only so many companies that can enter
Starting point is 00:47:31 that market and so many sort of fixed resources for that I think AI is a little bit difference at the end of the
Starting point is 00:47:37 day I mean there are sort fixed resources as far as power and compute but you know the malls do get
Starting point is 00:47:44 more efficient over time as well and so you can imagine there's going to be more volume to support demand anyway
Starting point is 00:47:50 for that at least for the users it sounds like you're saying well the demand is going to
Starting point is 00:47:55 material either perhaps it's still a nascent technology. Going back to your earlier point, just a few firms really are leveraging it, but that's destined to grow. So the demand is going to be sufficient to grow into the supply, even if the prices come in here,
Starting point is 00:48:12 there's still so much demand, so much future opportunity that... Not to worry, Chris. He's not saying that. He's actually... I don't know if the demand is defined by profits. I don't know about. Yeah, yeah.
Starting point is 00:48:27 Demand as far as like, is there enough demand for tokens in general that business would be able to employ into productivity enhancing workflows? Yes. Will that be sufficient given the realities of an ever-declining price war to support high valuations? I'm not an investor and then I'll pause on that point. I was going to ask. I was going to ask, okay, not an investor. Here you. Okay.
Starting point is 00:48:56 Okay, very interesting. Yeah, very interesting. Marissa, anything you want to ask Aro about? I'm a little more interested in the demographics of these firms that you're looking at that are these. You said that it looks like they're small businesses, right, and they're very intense adopters. Can you tell are these like startups with one or two people? It sounds like you have employee accounts there. So what more can you glean about what kinds of? of firms these are.
Starting point is 00:49:28 It varies. I think the high-intensity adopt, I think the stat you're referring to is that small businesses are less likely to adopt AI in the first place, but when they do, they're more likely to be intense. Yeah. Yeah. So if you're an intense adopter, yes, you do skew toward the smaller side,
Starting point is 00:49:44 but it's, on average, it's still in like the sort of tens to low hundreds in terms of employee count. You do see some very intense adopters in enterprise with, you know, a thousand, two thousand employees and certainly very, you know, some examples in pure tech and software development with more than that. But I think it's hard to give you an image of the profile of the segments because there is so much heterogeneity amongst the users.
Starting point is 00:50:17 You'll find examples in any group. But I do think that the, um, today the productivity gains have been concentrated amongst tech, not only because of the sort of proliferation mechanics of how AIs spread amongst firms, but because the most advanced productivity enhancing version of AI is made by tech for tech, it's coding agents. Now, open question whether or not that technology will, you know, proliferate through other types of firms, if they'll be able to make this sort of equivalent coding agent, but for manufacturing. There's a lot of really interesting work happening in robotics with AI. I'm bullish on that work happening, and I'm bullish on the gains that will come from it.
Starting point is 00:51:05 But today, it's not nearly as developed as what's developed for tech. Yeah. Hey, Ara, what do you vibe code in? What LLM do you use? I, at Ramp, Ramp is one of the very tech forward companies, and internally sometimes it feels like we're babies in terms of using AI because we have a pretty good setup for employees. We have our own harness. You can use codex, you can use Claude, but there's an internal version called Ramp Glass that connects to all of the frontier models and it connects to our internal company tools. So it just, it makes it
Starting point is 00:51:46 easy for me to connect between things and make direct edits to our website. I don't have to log into a million accounts. That's one of the challenges to using these coding agents is that you can have to make your own setup. And so we have a pretty good system here at Ramp. Got it. Does it optimize across the models?
Starting point is 00:52:06 Yeah. Right? So, in terms of the cost, right? That's an emerging area, right? Because you can add-hoc select the model and you can set an auto model that follows the firm defaults, the company-level
Starting point is 00:52:22 defaults to sort of keep you from spinning up an agent that blows thousands of dollars on a task that really doesn't need it. I mean, I think that's where the market's going to go. Firms that are trying to figure out how much to spend on AI, you know, you can't leave it in the ends of your employees who have to track in their head what model is good for what and how much it's going to cost. This market is changing way too quickly. So I think increasingly firms are going to figure out how to have their own sort of implementations of this. You're going to see products come to the market, but you're going to have companies set defaults and sort of monitor and track spend that way instead of free-for-all we're in right now at most
Starting point is 00:53:01 firms. You know, this is one other thing that struck me was, again, going back to that first chart, is anthropic and open AI dominate to a significant degree. I didn't realize. I thought Gemini perhaps or some of the others would have a higher adoption. Right, but they don't. It's really those two companies that are kind of dominating things here. I think there's probably a lot of free adoption of Gemini because of its integration.
Starting point is 00:53:28 Free adoption, yeah. But no, it's not a major player in enterprise spend. Yeah. So to end, what didn't we ask you? Because, you know, you look at this data, you live this data, you know, it's your baby. What is it that you see in there that we should have? asked you about that we didn't ask you about. Anything? There's a couple things I'm thinking about today. I mean, I'm thinking about,
Starting point is 00:53:57 uh, government is trying to figure out what to do about AI. I think there's a lot of discourse about data centers. I understand why it's there. But the real question is, how do you get more firms to use AI in a productivity enhancing way? That's ultimately going to be what vaults us into a, right? You know, next boom of productivity. And today, I'm not sure that we have those systems set up. We found that there are uneven mechanisms that distribute AI through the economy. That's going to lead to some economically suboptimal outcomes. Is there a role for government there to get businesses outside of tech using AI more effectively? Probably, I don't think it's going to be in the form of subsidies. I hope not. I hope not. I don't want to do that.
Starting point is 00:54:45 It's hard for the government to get any of this stuff through because there's this not unreasonably that AI is going to disproportionately impact white-collar work. I actually think our evidence is that it's probably the opposite. It's more likely going to impact blue-collar work once we get the sort of manufacturing automation wave going. And that it's going to work like every other technological development and paradigm of the last century. And yet today the focus is on data centers and making sure software engineers keep their
Starting point is 00:55:17 jobs, even though software engineers are doing pretty well, you know, if you really look at it. So I do think that the discourse, which tends to be informed by a lot of punditry and vibes and people who, you know, think they have a viewpoint because they are on Twitter a lot, would be better informed by observed behaviors of businesses. And so my goal is to publish that kind of work so that people can make these more informed decisions and ideally better policy decisions with it. Well, that's great. I mean, thank you. Good luck with all that. That's a heavy burden. And on the government, I'd say, I'd just settle for bright yellow lines around the use of these models. I mean, that would be kind of nice as opposed to kind of an ad hoc quasi licensing regime,
Starting point is 00:56:10 which you have no idea how it's being implemented or will be implemented. Who's under the auspices of the government's oversight who's not. I mean, let's just nail that down. I think that would go a long way to getting adoption and use in a place where we want it. But thank you for, you know, spending time with us. And really, thank you for providing this information to the marketplace. You know, we are going to be, we are using it and we're going to use it a lot more intensely going for it. And I can't wait to see that price data. That'll be really cool when you release that. Thank you, guys. Thank you for having me. This is really fun. Take care now. And with that, dear listener,
Starting point is 00:56:46 We're going to call this a podcast. Hope you enjoyed it. Take care now.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.