Big Technology Podcast - Claude Code Head Boris Cherny: Insane Growth, Tokenmaxxing, AI Agents' Next Frontier

Episode Date: May 20, 2026

Boris Cherney is the head of Claude Code at Anthropic. Cherney joins Big Technology to discuss Claude Code’s explosive growth and whether the rise of AI agents is sustainable. Tune in to hear how Claude Code is changing software development, why Anthropic believes agents will spread far beyond coding, and what happens when people start running hundreds or thousands of AI agents in parallel. We also cover token maxing, rate limits, Codex competition, SaaS disruption, self-improving AI, and whether today’s models really understand the consequences of their actions. Hit play for a sharp look at the agent boom from one of the people building it. Join the Big Technology AI Summit: https://summit.bigtechnology.com --- Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice. Want a discount for Big Technology on Substack + Discord? Here’s 25% off for the first year: https://www.bigtechnology.com/subscribe?coupon=0843016b Learn more about your ad choices. Visit megaphone.fm/adchoices

Let's talk with ClaudeCodehead Boris Churny about the product's explosive growth, what's next on the roadmap, and whether all this is sustainable. That's coming up right after this. I'm just back from ServiceNow's Knowledge 2026 in Las Vegas, and the conversations I had there are ones you're going to want to hear. I sat down with their president and CPO Amit Zaveri on the platform strategy powering enterprise AI, chief people and AI enablement officer Jackie Kani, and Chief Digital Information Officer Kelly Romack,

on what AI really means for the workforce. The technical leaders behind ServiceNow's Nvidia partnership on shipping AI at scale and Alta Beauty on deploying ServiceNow's technology across 1,300 stores. If you want to know where Enterprise AI is actually headed, not the hype, but the real story, you can find these videos on my YouTube channel,

search Alex Cantrellwitz on YouTube. Depending on who you ask, between 80 and 95% of Enterprise AI projects fail. To get AI to work for you, you don't need more tokens. You need better people. A board pairs powerful proprietary tools with senior engineers who've seen it all. That combination means your project doesn't stall, doesn't drift, and doesn't fall.

It ships. Whether you're a startup that needs to get to market or an enterprise with complex legacy challenges, a board delivers exactly what your business needs fast. Aboard is your partner for AI transformation. Visit abord.com and let's build something together. Welcome to Big Technology Podcast, a show for cool-headed and nuanced conversation of the tech world and beyond. We have a great show for you today. ClaudeCode head Boris Churny is here with us in studio.

We're going to talk all about the product, the way it's taken off, what's next on the roadmap, and of course, whether it's sustainable. We're going to go into things like token maxing, token inefficiency, and then, of course, the future of knowledge work. So no lack of topics to cover. Boris, it's so great to see you. Welcome to the show. Yeah, thanks for having me.

So let's talk a little bit to begin with about the growth of ClaudeCode. It's been massive, right? I think at a recent event, Darya Amadeh, the CEO of Anthropic, talked about how demand for Anthropics products has been up like 80 times year over year. I remember speaking with him last year around this time and he was thrilled that Anthropic was at $4 billion. A.R. That seems quaint right now. The numbers right now say maybe it's $45 billion. Right. So a 10x there, 80x demand. And the question is how fast the company can serve the demand here. But talk about the portion of demand that Claude Code makes up and what you've seen in terms of demand growth and the amount of people using this thing. For an increasing number of people in the world, I think the way that you use agents and the way that you use AI, it's not just Anthropic products, but it's Quad Code in particular.

And, you know, of course, for Anthropic, there's a lot of different products. There's, you know, there's Quad Code, there's Quad-A-I chat, there's Quad Design, there's co-work, there's like API products. There's a lot of ways to experience Anthropic. but for a lot of people, quadcode is their first introduction. And yeah, the growth has just been insane. It's, you know, when we first released it internally, it just skyrocketed immediately. And so before we even released quad code to anyone outside of Anthropic, we felt that it's pretty likely that this is going to be a hit.

And around the time that we released Opus 4 and Sonnet 4, this was in May of last year, the growth just went exponential. And I've just never seen growth as steep. And then it just kept going more and more exponential. With Opus 4.5, that was November, and then 4.6, that was February of this year, and then 4.7, you just keeps inflecting over and over. And, you know, there's a lot of people on our team that have worked in tech for a long time. And, you know, we worked on all sorts of hypergrowth products. Like, this is something you talk about in tech all the time.

These, like, you know quorants in hypergrowth. But even on the team, we've never seen growth like this. And so we're just trying to figure out how do we make it so everyone can continue to experience this. How do we make it so we can continue growing at the space and the pace that we expect in the future, which might be even steeper than it is today? And we're running a lot about how to do this and how to keep scaling the services. So a year ago, it was clear that the bulk of usage of Anthropics AI models was happening through the API. That would be like a company like a consulting group, for instance, putting it into action at a bank and the bank using it to summarize some calculations. I'm just throwing an example out there.

That compared to the Claude Chatbot, it was far and away. The API was the lion's share of usage, revenue, all these things. Does that still the case today, or is Claudecotecoteing that? We have a mix. So, you know, like products play a much bigger role for Anthropic than they did a year ago. That's definitely the case. Product growth is accelerating. It's growing very quickly.

API is also accelerating and growing very quickly. And for us, we are investing in both. We have to be a product company because there's kind of a lot of reasons for lab to build products. And, you know, this actually wasn't clear early on. Like very early on in Anthropics history, this is before I joined, this was actually like an active debate. Should we even build products? Like, is this actually like a useful thing to do?

And it turns out it's very useful, you know, for mindshare, but then also for safety. fundamentally we exist to study AI safety. This gives us better tools to do that. We're also a small number of people. And so most things in the world, we will not build. And so this is why we also have to provide a platform. And we have managed agents and API and SDK, all of these products. So people can build on top.

And thousands and thousands of businesses choose to do that. Yeah, it's interesting to hear you even answer the question, saying that it's a mix. So I take it you're not going to share which is bigger right. now. Maybe not right now. Okay. But the fact that like it's not a clear cut, the API is bigger. Maybe it is. But the fact that you even say it's a mix just shows the fact that Anthropics owned and operated products are just growing massively. And now so, you know, we've set the stage here that this is something that's growing exponentially. We've obviously, we obviously have seen the anthropic revenue grow exponentially kind of alongside this product.

This is a product that you conceived of and built and run today. I think that there's probably some people watching who are like, well, what is ClaudeCode? Most of our viewers obviously know what it is. And I was like, how do I write this like in a simple one-sentence definition? And I wrote that it's a way to build websites and software in plain English. And then on the way over here, I was like, well, that kind of sells it short a little bit. I mean, what would you describe it as? I think that's actually a pretty good description.

All right, we'll take it. I think when a lot of people think about AI, they think about chatbots. And for engineers, that's what AI was, you know, maybe like a year and a half ago before we started quad code. That's what AI was for most people. And we realized at some point that the model was actually getting really good at coding, and it's getting really good at using tools. And these are things that we've kind of always tried. the model to do. And, you know, this has kind of been the research direction for a while. It started to become commercially useful about a year and a half ago. And so for Cloud Code, we took

this bet. And we deviated from the way that everyone wrote code at the time. Because the way that everyone in the world wrote code was using essentially a fancy text editor. And we just thought maybe we can do much better than this. And we could do something really, really different than what's been done before. It was very much a bet. And so we interested. We interested in you know, quad code. And the thing that made quad code different from chatbots at the time was quad code can use tools. And this is it. Like this is just the difference. It's with a chat bot,

you're going back and forth and you're talking, but an agent, and quad code is an agent, it can use your tools. Right. And can we just quickly define the tools? So tools could be anything, and you tell me if I'm wrong, from using a browser to like logging into Cloudflare and then setting up some agent that way, right? So it becomes less of what does this product do itself, and more of like, what can this product log into and then sort of do with a multiplicity of products that you use online?

That's right. It can connect all your different tools. It can use your browser. It can use your computer. Even something as simple as like editing a file on your computer. You know, like a year and a half ago, there was no AI product that could actually do that. But this is the first thing that quad code was able to do. It could edit a file on your desktop.

If you have a bunch of files on your desktop, it can organize them. And so like quad code and co-work have this access if you choose to give it. If you're granted. Yeah. And, you know, it can do this. And this is magical. It's this tiny difference completely changes the way that people can use this product. And it totally changes what this product can do for you.

Yeah. I mean, the fundamental thing, I think, just to drill down here is that it seems like AI has shifted from sort of like as great at auto-complete, right? Because at the fundamental layer, AI is just predicting what comes next. If you're using machine learning and applying it on a large data set, predicting whether you might default on your mortgage and whether a bank should grant a mortgage. When it comes to a sentence, predicting the next word with code, predicting the next bit of code in a sequence, right? So I think that was Gen 1. But what you're talking about now is the machine is actually just able to go.

and after you give it this natural language prompt, code itself, hook into tools, and then do things for you. And so, correct me if I'm wrong, but the use cases here have gone from developers hooking into it and writing code with cloud code, and we've seen this explosion, I guess, largely driven by them, but then by a secondary force, by non-technical folks, people like me,

who can build software by directing the AI agent, which is cloud code to build a piece of workflow software for them or a website or to take control of your computer via something like Claude Co-Work, which is sort of the, maybe I would call it the easier sister product and saying, well, you have access to my browser now. You know what type of flights I like to book. I need to be in India in a couple of weeks. Book the flight. Yeah, yeah, exactly. I actually just use Co-Work to book a bunch of flights. I'm going to be flying a bunch this month for, you know, we have like Code with Claude coming up in London and Tokyo and there's some other stops along the way. And I went back and forth with co-work and I was like, okay, I need to be in these places at this time.

And it was five stops. It was like a lot of cities. And here's roughly the schedule. Look through my email, look through my calendar, and just double check it, make sure I'm not missing anything. It found actually two stops that I was missing. And also a couple of dates that I told it wrong. And it just found this by looking at my email. email after, you know, I asked it to do that. And then I told it to book the flights. And I went and,

you know, was coding on something. And I was just doing work. And I came back an hour later and it booked eight flights and five hotels. And one of the hotels was kind of incorrect. It was in the wrong area. I asked it to rebook it and change it. And it was done. I actually, this is something that I try every time with co-work and with quad code. I have these sort of like test cases. So these sort of like a common thing that I would do, and I just retry it with different models and, you know, as the model improves. This is the best result I've ever gotten.

And there's something about co-work combined with Opus 4.7 where it's able to do this. And I think one of the hardest things for me has been as the model improves, you constantly have to readjust your expectations of what it can do.

And if you talk to people, especially engineers that used the model a year ago, they might, And they didn't use it since. They might say something like, oh, well, you know, it's not very good at coding. And, you know, I don't trust it to write more than a few lines at the time, at a time, because that's what the model was a year ago. It wasn't very good yet.

And if you fast forward to today and you sit down these people and, you know, they try the new model. And as, like, a lot of people have been doing an increasing number of engineers, it's just a completely different experience. The capability is completely different. And I think this is the first technology I've ever. used like this where every month there's a step change in what it can do. And as a user of this technology, it's just quite hard because you have to kind of keep retraining, you have to keep retrying.

You always need this like beginner mindset to retry the technology and use it for a thing it was not good at before because the next model might just do it perfectly. Right. And so I think this is the vision. The way that you're outlining it is effectively previously when you would use technology, you would be subject to the interface. You would have a software company that built for scale, but you would get a lot of features that may be more applicable to you.

You would have to go through all these bells and whistles whenever you were trying to book something, even though you knew what you wanted and you wouldn't have a website that would know your preferences. Now it sort of shifts the paradigm where you have, again, it's an agent, it's something that goes out and does things for you and can potentially shape your experience. online the way that you want it. And that's that is I think what people are seizing upon.

And that's why we're seeing where you're seeing really the explosive growth. But now I want to pressure test the thesis a little bit and bring up some things that make me curious how much of this is real and how much of this is just unbridled enthusiasm at the potential, but maybe stuff we should have a reality check on. And the first thing is that there's such great demand. But the question is how much of that demand is pure demand versus demand that's gamified. And there is a practice that's going on within Silicon Valley and outside of it. That's called token maxing. I'm sure you've heard of it.

It's where companies have a mandate where people are supposed to use lots of AI tokens by running their AI agents as much as they can. and then those who use the most tokens are like rewarded on a leader or on a leader board or meet a goal of AI actions that they have to take as opposed to physical actions. So I want to hear your perspective on token maxing and whether you think that makes up a large portion of the usage of the products that you're building. Yeah, I don't think token maxing is a large percent. The way that I would think about it is, you know, before Anthropic, actually, I used to work at a big tech company. You're on Facebook. I was a Facebook. Which is one of the companies that's token maxing.

That's right. That's right. Yeah. And one of my responsibilities was the health of all of the code across, you know, across Metazapp. So this is like Facebook, Instagram, you know, WhatsApp. And one of the reasons that we care about the health of the code, and this is essentially things like code quality, is. is if the code is really high quality, engineers are more productive. And there's like a big team of people that worked on productivity.

And before models, before Claude, you would work for a really long time and you would see maybe like a one to three percent improvement in productivity per engineer over the course of a year, like something like that. And that was like a pretty big improvement. And it was like very hard one. You essentially had to try a lot of ideas. and eventually you find something that improves productivity like this. And what happened with Claude is now many companies, including Anthropic, and all of our biggest customers, are reporting gains on the order of hundreds of percentage points.

And I think the last number that we reported is the amount of code written per engineer at Anthropic has grown something like 250% since we introduced Claude Code. And this is while keeping code quality and reliability and all these things, kind of stable. So without those things regressing, the volume of code has grown a lot. And so this kind of productivity impact, I think, is just like very new. And I think people are trying to figure out how do we get this? There's a lot of companies asking, like, how do we, how do we get these kind of benefits? Because a lot of companies are seeing it, and then some are still figuring it out. And I think my advice is almost always the same. The first thing is just give

everyone tokens, let people experiment. I wouldn't necessarily recommend token. I wouldn't necessarily recommend token maxing, but I would recommend let people experiment so they don't have to ask for approval for every token. The second thing is give people psychological safety because a lot of times when people are innovating and they're building tools that make them more productive, they're changing their own workflows to make them more productive. They try a bunch of ideas. Some of them might not work.

And then some of them work. So you want to give people this kind of psychological safety so they feel okay experimenting with it and finding these new processes. And then the thing that a lot of companies see is the productivity improvements and the innovations do not come from the people you expect. Back in the old days, you know, everyone could point out, like, these are my most productive engineers. But I think nowadays, a lot of the improvements are coming from people you just never would expect. It could be like an accountant somewhere in the corner of your org that just automates, like, accounting in a way that no engineer would have thought of. It could be some marketer automating like marketing in a way that you know.

never would have thought of. It could have been like a new grad software engineer that just build something amazing. And this is something that just like didn't happen before. The challenge is you can't identify these engineers and these people ahead of time. You don't know who they are. And it's almost always going to surprise you. And so the thing you want to do is let people experiment, give them safety. And then once there's some kind of use case that scales up, that's when you think about optimizing it. But you don't want to optimize ahead of time. So I don't know if doing it in a competitive way works for some companies with their culture, then I think that's great. If for other companies, the way they want to do it is just kind of create safety and create space for engineers to experiment,

which is what we do at Anthropic, then I think that's great too. It really depends on the company. Yeah, and I'll say, look, I use a lot of tokens. I'm in the tools all the time. I think Cloud Code and Cloud Co-work have both been pretty great for my business. I'm a solo operator, although that kind of sells it short because I have a team of people behind me that help me, mostly in a part-time basis. But that's for a different show. But I do wonder, you know, when I read these stories, the large corporations are largely making up big percentages of these budgets. And the incentives, you know, and again, like I started the show saying, how sustainable is this? The incentives are bad in some of these places.

This is from the Financial Times recently. Amazon staff use AI tool for unnecessary tasks to inflate usage scores. Some employees said colleagues were using the software to automate additional unnecessary AI activity to increase their consumption of tokens. They said the moved reflected pressure to adopt the technology after Amazon introduced targets for more than 80% of developers to use AI each week. I got checked this with an Amazon employee. They're like, yep, this is what's how. happening. They told me I triggered an automation that runs for hours and then gets deleted every day in order to meet these targets. So you said you don't think that this token maxing stuff is a big part of

demand. Is there anything that you can see on your end to indicate that it's not that this is an outlier and not the rule in most places? Yeah, this is, I don't know how many companies are doing this token maxing thing. I've heard of it as a trend, you know, a little bit. If you look at QuadCodes customers, We have just many, many, many customers. So it's not like, you know, there's like one company driving the usage. It's not like that. I do want to kind of step back a little bit and just think about like how does this kind of change happen? Because I think the goal of what these companies are trying to do, I don't want to speak for them.

And I would recommend just talking to them. Yeah. But the goal of what they're trying to do, I think, is probably like organizational change and business process change. How do you make it to your company benefits from AI? And this is often unclear. it's very dependent on the company because every company has a different business, a different culture, a different org,

a different way of doing things. There was this old Harvard Business Review article from the 90s, which I just love. And I forget the title, but it was something like computers are here. Why is no one seeing the productivity impact? And this was a big question, right? It's like, to us, it's obvious.

Computers make us more productive. This is just incredibly obvious today. But in the 90s, this was not obvious. And what was happening is, is personal computers were being adopted. They were replacing mainframes. And now they're affordable. So the average company, the average startup can buy one.

You don't have to spend millions of dollars on a mainframe anymore. But there was this challenge and there was this paradox. Companies were adopting it, but they were not seeing productivity improvement. What's going on? And so this Harvard Business Review article, it made the case that in order to get a benefit from computers, you have to restructure your whole business process. around computers, they have to be at the center of the way that you do things. And if you still have like paper, you know, filing cabinets and you have a bunch of drawers full of

stuff and it's still a paper and pen kind of physical process. And there's a computer somewhere on the periphery. You're really not going to benefit. But if you throw away your filing cabinets, you throw away your, you know, desk drawers full of, you know, papers, and you put a computer at the center of it. And that's the way that you do all your business process, then you benefit. And there was this split between companies. Some were doing this, and they were doing this very painful change, and they benefited from it.

And then others didn't. And I think it's kind of the same thing now. A lot of companies are trying to figure out how to benefit from the productivity impacts of AI. And there's just a lot of experimentation. And everyone is trying different approaches to figure out how to benefit from it. I don't think there's one right approach. Okay. And look, I think that when we see something,

and grow as fast as Cloud Code has grown and as fast as anthropic has grown. It's good to just kind of talk this stuff through and it's good to hear your perspective. So, okay, that's token maxing. Now, tokens, of course, are the output of the model, like the words or portions of words that the model outputs and the words and portions of words that go into it, right? And that is how these companies charge and the more you have, the more data centers you need, et cetera, et cetera. You know, as these models get better, they haven't.

Well, let me put it to you this way. Sometimes I wonder whether they're as efficient as they can be. These big models can sometimes do a lot of work, use a lot of tokens, even if the output is great, people wonder, well, is this sort of just driving up token demand where it could have been a really easy process? And the models are expending many, many tokens and not getting there as, as efficiently as they could. Let me give you an example. I've been using Claude Co-work to make PowerPoint presentations. It's really good at it. And I've been using the Opus 4.7 model.

And a couple of times I've said, all right, you know, you're working on this, this, ship it as a PDF. And it just starts to lose its mind. It cycles and it uses as many tools as it possibly can. And, you know, it just seems unable to ship the PDF. And eventually, I kept telling it, no, you're making this PowerPoint. You know where it is. Ship it. And it goes, I owe you an apology. I went down a rabbit hole worrying about a constraint that wasn't actually blocking us the files there.

And then it shipped it. I mean, talk a little bit about the efficiency of these models. And whether that is a legitimate worry that, you know, as we've seen the growth part of it, is these like loops that a model like Opus 4.7 might find itself in to do basic tasks. Yeah. Generally, when we think about models, there's a few different aspects of it. One is just how intelligent is it. Another one is how fast it is. And another one is how efficient it is. And we generally try to move all these together. Between these, I think we should probably optimize for intelligence. That's the most important thing. So even if it's like a little bit less

efficient, but it's more intelligent and it lets you do more things, that's really useful. because the efficiency optimization comes after. After we make it more intelligent, then we can make it more efficient. So it's sort of kind of we do one, then we do the other. We've been experimenting a lot with how exactly we give people control over this, because we don't always know the right default. Sometimes when you're using it, you know better, you know better. And so one mechanism that we had for this is picking a model.

So you can pick opus or sonnet or haiku. another mechanism that we've been experimenting with is effort. I don't know this is like the biggest sonnet middle, high, that's right, that's right, and this is just like the size of the model. Right.

And then there's effort. And effort is essentially how, you know, I think the word is actually really descriptive. It's how much effort do you want to put into it? And you can set this. We have a recommended effort. So, you know,

for example, to maximize intelligence for Opus 4.7, you want to use extra high or maximum effort. But if you want it to do, two-less tokens you can pick like medium or low effort. And this is a control that you have. Yeah, I talked about this on the show recently. And we had a commenter that came in. And I was of the opinion that these, you know, bigger models will find a way to become more efficient on like the export, the PDF thing. We had a commenter come in that wrote,

Alex, they can't fix things like that PDF problem. It's inherent to LM technology. And it's the biggest barrier to useful widespread dissemination and usage of agentic AI. I think I'm going to try to translate that. What they were trying to say is, we talked about predictions earlier, that this is all probabilistic. It's sort of predicting the next word. You don't get the same answer from an AI agent twice. And so therefore, this type of thing is a feature of the way that they work and not fixable. What do you think?

No, I don't think that's right. When you think about, like, okay, let's zoom out a little bit. So engineers are the first adopters, right? Like, engineers started using cloud code like a year and a half ago. And, you know, this is before non-engineers were using agents in a meaningful way. This is, you know, before co-work and so on. If I think back to what cloud code was a year and a half ago, it wasn't very good. I could use it to write a little bit of code, but if I really trust it to build an entire feature or entire product, it wouldn't turn out well.

It did the same thing. Like, it would go in spirals and the quality wasn't good or, you know, it built it and either the code was bad. or it didn't work. And at some point, it just started to get better. And as the model improved and as quad code improved, the result just got better and better and better. And so you fast forward to today, quad code is 100% written by quad code.

Co-work is 100% written by quad code. An increasing number of features are fully written by quad code across Anthropic and products. And this is something that we hear from customers also. I did a talk at Wycombinator, you know, the startup incubator yesterday. And I asked people to raise their hands, you know, everyone, everyone's using quad code. And I asked them, you know, raise your hand if 100% of your code is written using quad code today.

About half the hands went up. And then, you know, I asked people, raise your hand if 0% of your code is, you know, written with AI. There's like one hand now. And this is a room of like a few hundred people. Power to that person. That's right. And, you know, there's still room for this, obviously. And then everyone else was somewhere in the middle.

You know, it's like most of their code is written with quad code, but not all of it. But that's kind of the place where the model was at today. It was not there a year ago. A year ago, it was not good enough for this. And so this is exactly what you're saying play out with co-work right now. It's still early. You know, we released it, well, like a few months ago. It's going to keep improving.

It's going to keep getting better as the product gets better, as the model gets better. But this is early days. I think still everyone using cowork today is an early adopter. Everyone even using AI today is an early adopter. There are so many people in the world, and most people have not tried AI in a meaningful sense. So there's just like there's a lot more room to improve this. Yeah, we're hosting an event here in San Francisco on June 18th, and a lot of the marketing material I've turned out with co-work. Now, I go back and forth.

I don't let it one-shot it, so I'm looking at the copy. But I do things like, you know, upload, you know, our, you know, download statistics to sort of show the growth of the podcast. And I give it the names of the speakers. and it like is amazing at saying building a prospectus. Here's what the event's going to be. Here's who's going to be in the audience. Here's who's speaking. Here's what you should be there.

Here's how to get in touch. Insane. It's so good. What was your feeling like the first time that you used it and the first time that you saw like the agents use your tools? Well, I mean, obviously I've sort of enabled everything. So I think this is kind of an experience that many people have had where there's a browser extension for Claude.

And you realize that you can only get the benefit of this, or you'll get most benefit by letting Claude take over your browser and do things for you. And the experience is almost the same as I had with the Waymo, where those first couple turns, I was like white knuckling and like watching and like, should I approve reading everything? And then you start to trust it a little bit and you just hit approve, approve, approve, right? And the Waymo, the same thing. You're like, okay, this looks like it's not going to kill me. And then five minutes later, you're on your phone as the AI does the work. And that was my experience with code and co-work. Is that sort of track?

I mean, this is like my experience, too. I think it's like any technology. I was watching someone that's like a friend that's been learning to use co-work over time. And, you know, she's not an engineer. And there's this use case the other day. Like her, there was like a language input on the computer where you can kind of choose between languages on the laptop. And there was some issue with it. And she couldn't figure out how to fix it.

And so before which she was. would have done is go to Google and ask like, hey, how do I fix this, you know, this issue that I'm having my computer? And this time she just, like, ask cowork. And a coworker was like, cool, let me take a look. Can I, can I use your computer? And she said yes, and it took over the computer. And I guess this kind of like orange glow. And you get to watch as co-work open settings and it sees what's going on with a language picker. And it diagnoses it and it fixes it. And, you know, you're still in the driver's seat. So you can see this happening. You can monitor it. it's not happening in the background or anything.

But it's just, it's magical. And I actually did, like, my instinct was dope in Google. And so it's funny that, like, for her, she went to using co-work for this. And this is actually something I feel all the time. I think for people that have kind of grown up with these products and they've seen previous versions, they might not be as ambitious as they could. But for people that are new to the products, I often see them using quad code and for things that I wouldn't have even thought of.

And it's just, like, amazing. It's so creative. And I work a lot every time I see it. Yeah. Now, the biggest drawback right now, I would say, and I've seen you reply to people on X about this, is the rate limits. Like, when I see people say, I've given Cloud Code a shot, but I'm kind of done with it. It's typically because they've hit their token allotment, and it only works for like an hour for them. And then they have to wait four to use it again.

And they look for alternatives. What do you think the rate limits have done to the ability for your product to grow? And what is the plan, if there is one, to make people be able to use this without those rate limits? This is something we're actively working on. The reality is a very small percent of people actually hit their rate limits, which is surprising. For pro users, it's a little bit higher. For Max, it's actually quite low. And I think the thing that you're saying when people talk about it is there's a couple of things happening.

One is that we actually reduce the peak rate limits. And that's now rolled back. And we've actually doubled rate limits. So we're giving people more rate limits. But there was a brief period where we reduced them. And so people were running into that. The second thing that's happening is cloud code is actually quite extensible. And so people can use plugins.

They can use all sorts of integrations. and some of these use tokens in a pretty inefficient way. And so the thing that we've been working on is surfacing this to you, so users can decide, do you want to use this plugin or do you not? So you can see kind of what percentage of your tokens goes to it. And then I think the third thing is there's a lot of people that have just increasingly become power users. Like first, when we release quad code, you know, you ran one quad at a time. Nowadays, I'm running, you know, like on my computer, I run maybe five at a time.

And then every night I run like, you know, not every night. But most nights, I run like hundreds of quads at a time, all in parallel. Yeah, hundreds, sometimes thousands. And this is something that I just wouldn't have imagined a year ago. And obviously, this uses a lot of tokens. And there's a lot of people that are figuring out these new workflows that are using a lot more tokens. And this is sort of like at the edge of what you can do with the max plan. And, you know, this is why you can just like pay using API also.

So if you just want to have as many tokens as you need, you can do this too. And this is what a lot of enterprises do. Right. Now, it wasn't long ago where I'm pretty sure Dario Anthropics CEO was referring to OpenAI and talking about the spending on the buildout. And he, and he's talked about this afterwards, he said, I'm trying to be disciplined in the way I spend, which is still spending many billions of dollars on data centers to enable this stuff like you're talking about. And others, which we think is Open AI, are yoloing, right? But now OpenAI is doing this too with Codex. And you could call it Yolowing, but they have a lot of data center capacity that they've built.

How do you think about that? Because, you know, when people do hit these rate limits, they may just go over to Codex. It's a pretty intense competition. So how do you think about that? How does Anthropic think about that internally? That, you know, at least from the outside perception, is that, this added discipline on data center buildouts might end up losing users in the most important product battle that your two companies are engaged in. Yeah. So, you know, first of all, our growth has never been faster than it is today.

So, you know, for Quad Code, the growth is accelerating. And I think because most people don't actually hit rate limits very often, it's actually not a huge issue. For the people that are, we are laser focused on improving the experience. And so we double the favor rate limits. We are announcing today that we're increasing the weekly rate limits. And of course, we announced the new colossus capacity, which, you know, we brought online to serve all these new users. Via Elon Musk. Via Elon. Yeah, because this, I mean, this growth is just no one, no one would have predicted this.

This was just beyond our wildest forecasts. And so, you know, I think for us, what matters the most is we, we, we, we. We need to serve our users. We want to make sure our users are really happy. And we're doing everything we can to make that happen. Are you surprised by Codex? How do you view them as a competitor? I think there's always, you know, there's always copycats.

There's always competitors. For me, it's flattering. And I think it just forces everyone to do better. So, you know, for me, the thing that I care about the most is just doing the best job that we can to serve our users. and we encourage everyone on the team to, you know, talk to users every day. And, you know, just keep making the product a little bit better every day. So this is what I care about the most. Okay.

I want to take a break, but we have so much more to cover. I want to talk about how this extends beyond code, the future of the chat bot, and then maybe talk a little bit about, I mean, I could go through our agenda. We really need two hours. So why don't we take a break and come back and get to as much as we can right after this? Most leaders know how work is supposed to happen, but when it comes to how it actually gets done day-to-day across tools, teams, and handoffs, they're mostly guessing. That's exactly the problem Scribe Optimize was built to solve. Trusted by over 80,000 enterprises, including nearly half of the Fortune 500, it gives leaders a live view into how work is really happening across approved business apps without interviews, manual process mapping, or extra effort from the team.

And because it's continuously analyzing real workflow activity, the insights stay current instead of going stale the moment a process change. changes. You can see which workflows are happening, where time is going, and which tools are involved. It automatically surfaces top issues, explains why they're happening, and even recommends ways to fix them with estimated time savings. And importantly, it's built with privacy in mind. So activities only captured in admin-approved business apps, and user-level data is anonymized by default. The kind of visibility that used to take months, now it's just always on. If you're ready to stop guessing and start seeing, visit scribe. how slash big tech. That's s-c-c-r-I-B-E-E-D-H-R-E-E-E- Every company says AI will make employees more productive, but most employees are still stuck waiting on IT,

waiting for app access, waiting for password resets, waiting for someone to fix a laptop issues so they can get back to work. That operational drag adds up fast and IT teams are overwhelmed trying to keep up. Server was built to automate that work. You describe what you want automated in plain English and Serval builds it for you. No complicated workflow builders, no consultants, just faster support and fewer tickets slowing everyone down. The platform is designed to eliminate repetitive tickets so IT can focus on the strategic work instead of constant firefighting, and it enables IT teams to build automations using plain English instead of drag-and-drop workflow builders. Learn more or start a free four-week pilot at serval.com slash big tech.

That's S-E-R-V-A-L-com slash big tech. certifle.com slash big tech. Look, if you have a kid in school right now, you know the drill. What should take 20 minutes of homework ends up taking two hours and usually ends in tears. And every good tutor, well, they're fully booked for months. This episode is brought to you by Brainley. Brainly is an AI-powered personal tutor built by educators, not a general purpose chatbot. It doesn't just give your kid the answer.

It walks them through step-by-step explanations so they actually understand the material. It learns how your child learns, diagnosis when they're struggling, and builds a personalized learning path in under three minutes. Available 24-7, there's no scheduling headaches, and it's just a fraction of the cost of a private tutor. Finals are coming. Build your teen's study plan now. It only takes minutes. Go to brainy.com slash big tech to get 50% off your first brainly subscription with my code, big tech. That's B-R-A-I-N-L-Y-com slash big tech. And we're back here on Big Technology Podcast with Boris Terny, the head of Claude at Anthropic.

Boris, it's great having you here. Like I said, I'm in your product daily, so it's really fun to speak with you about it. We talked a little bit about this, but I think one thing we should highlight is that this is really going to extend beyond the chatbot. We talked about booking flights. I talked about it with marketing presentations. And, you know, the week that we're talking, you have a new use case out where Claude Co-work can be used for small businesses, including taking over QuickBooks and doing some bookkeeping. Where does this go?

I mean, what do you think the broad roadmap? Where does the broad roadmap take you? We're thinking about a few things for Quad Code and for Co-work. There's a few big themes. One is improving intelligence. And, you know, I think almost all of this is just the model. As the model improves, we can do more and more ambitious work. For coding, it used to be writing a line of code at a time.

Now it's building entire features or entire products. For co-work, it used to be, you know, like, you know, it started pretty recently. But it was like, you know, making a document. And now it's things like booking flights, combining many tools doing your QuickBooks. So this frontier is improving and moving just very, very quickly. We're also thinking about how to do longer running tasks. For Cloud Code, we recently shipped this thing called Auto Mode, and Auto Mode is essentially a replacement for permission prompts.

Before what we used to do is whenever the model uses a tool, Claude would ask you, is it okay if I use this tool? And usually you just say yes, and you get kind of tired of saying yes, kind of over and over. Always allow. That's the button to hit. That's right, that's right. But it's actually very important for security that you're very thoughtful about this. And the thing that we're

realizing is actually instead of being thoughtful about every prompt, because we're showing people so many of these dialogues, they just kind of got fatigued. And they would just say yes or always allow. And so auto mode is the answer. And this is a new way of routing these tool

calls. And the way that it works is whenever Claude wants to use a tool, it asks another quad. Is it safe to use this tool? Quad has some of the context. It doesn't have all the context. And there's also a number of layers of safety checks, and we spent months iterating on this to make it really safe. There's thousands of different benchmarks and evils that we use to make sure that this is safe.

And essentially, we found both in the laboratory setting, and now we're finding in the wild, this is safer than what we had before. So as a user, it's a really nice benefit, because you don't have to sit there and say yes over and over. And actually, the result is better, because if there's one unsafe command buried somewhere in this big list of things that quad asks you to do, You might have accidentally said yes, but actually if you ask a second quad using auto mode, it's not going to say yes. So this is kind of one big investment.

Maybe the third big one is just running more quads in parallel. One of the cool things about quad, and this is something that we started to see pretty early with quad code users, is actually very few people nowadays run one quad code at a time. Most people run many, many quad codes, ranging from a few to thousands. And with co-work, we're starting to see the same exact thing. As you get more comfortable letting co-work run, you start a task, and then you start a second task, and you move on and just do more in parallel. And I think there's just a lot of opportunity to make this experience very nice and to make it more obvious for people. How do you do this? When do you do it?

Right. And it probably extends to the way that you use a chatbot, right? And it's interesting because Anthropics had this kind of interesting relationship with this. chatbot started out as technology first, decided to build the chatbot, ship Claude, and then just kind of moved more towards enterprise like you looked at all the charts, and Claude was always at the bottom. But now you're seeing Claude's usage rise. And I have a thought, and I'd love to check this by you, that the future of the chatbot is, is not like I'm going to give you a question and you'll give me an answer. It's I will give you a question or,

you know, talk to you about. a problem and you the chatbot will then suggest some sort of action you can take on my behalf. Like right now I'm talking a lot about a trip to India. And what I think I'm going to get back in the future is this thing being like, like what you said, not having this like secondary step between having to go there and book the flights. A more proactive chatbot that's going to say, okay, let me take the, let me take care of this for you. Is that the right direction? Like, am I thinking about that? I could see that. I could see that. Yeah. Are you working on it?

Agents are the future. And, you know, we're trying all these different experiments. Okay. There's some stuff that we're trying that's like this. Yeah. Okay. But there is a limit here, right, to what this can do. A funny way people have talked about the limits of the thousands of clods that you can run in parallel is kind of looking at who Anthropic is hiring.

My favorite job listing on the Anthropic site is that you're hiring Salesforce administrators. you're also hiring consultants to help enterprises deploy this technology. And many are viewing that as like a sort of tacit admission that this stuff can only take you so far. Here's Wharton Professor Ethan Mollock on it. He says, you will know that the AI labs believe in artificial superintelligence when they disband their newly formed consulting, sorry forward deployed engineering groups. As long as people are required to figure out how AI. is useful and do organizational change and systems integrations, jobs seem pretty safe.

What do you think about that? Yeah. When you look at the kind of engineering that I do, I don't write code. I prompt quad. And actually nowadays, mostly what I'm doing is I have a quad that prompts other clods. So I don't even talk to clod. I have a quad that's talking to my quads. And I think in engineering, you've seen just this explosion in the amount of leverage that a single person has.

It's about how big of a business can a person build? How many products can one person support? The leverage that one engineer has now at Anthropic is just insane. And I think we're starting to see this across other disciplines too. So we're starting to see this with marketers that are using Clod to do things. We're starting to see this also for forward-deployed engineers that are using Cloud code to build implementations. We're seeing this for our sales team because, you know, actually at Anthropic, I think, like, half the go-to-market team uses quad code. And the other half uses core.

You know, I think everyone's using all these products. And so the thing that we're saying is the amount of leverage an individual has goes up. And we are still bottlenecked on the number of good people. And so even if the leverage per person goes up, you still just can't hire enough good people because the demand is so insane. And there's so much more to build. So that's still the bottleneck for us. But I would say like if people would argue that if this stuff was so powerful, you could say take a look at the way my sales organizations operates

and then configure Salesforce that way with a prompt. Is this, and another example people give is I'll believe that Anthropic has very powerful AI if they let it handle the IPO paperwork and don't, hire an investment bank. Are these unfair tests? Well, we're starting to see, there's one personality that I was using Quad to do their taxes. I would not necessarily recommend this, but I'll admit, I've run my taxes through Claude and compared it against my accountant, and it was pretty close. Yeah. I did the same thing. Folks not saying you should do that, but it is, it's an interesting use case. That's right. But I think fundamentally what people are missing in this conversation is,

in the end, it's a person that has to talk to Claude to ask Claude to do this thing. So even if Salesforce is automatically configured and it's not a person pressing all the buttons, it's Claude doing it. Someone has to ask Quad to do that. And if you have to configure Salesforce in a bunch of different ways,

it could actually be a full-time job to ask Quad to do this. And at some point, Claude is going to become really good at asking Claude to do this. And that person is going to be asking Claude that asks Claude to do this. And this chain will just keep getting deeper,

but in the end, you still need people that are piloting this. But maybe their job is just asking one question then in the future. Yeah, but imagine how much leverage that has asking the right question. That's true. That's a good point.

So, you know, we talked about Salesforce, so we have to talk about the SaaSpocalypse. You have some interesting views on the type of software companies that will be safe as we get more automated programming and those that might be in trouble.

And you've talked previously about the different moats that exist and which moats are more important and which modes are less important. Can you just share that briefly while we're talking about it? There's this really good framework called The Seven Powers for talking about modes and business. There's so many of these frameworks for this, but this is my favorite. I actually studied economics in school. I didn't study computer science.

So this is still kind of the way that I think is in terms of these kind of frameworks. There's a lot of these different modes in business. And some companies have one modes, some have a few modes. you know, they have like a portfolio of modes. There's a bunch of these modes. So like one is scale economies. So as you scale up your production, then there's increasing returns to scale. Another one is network effects.

So this is like a, you know, like a messaging app or something like that. The more people that are on it, the more valuable it is for any person. Another one is switching costs. There's another one that's process power. I think most of these modes are still going to matter. And relatively some are going to increase in importance. over the next year and some are going to decrease in importance. One that I think will increase in importance is something like network effects,

because it doesn't matter who's writing the code. It doesn't matter if it's an agent at the core of your product or something else, or if there's intelligence in your product. If there's a network effect in your product, that's still going to matter. Some modes get less important, and this is, for example, switching costs, because if you want to switch from vendor A to vendor B, you can just ask Quad to do that. And Quad is going to get better and better over time at it. And so I think as a company, a thing that you should be thinking about is what are your modes?

And I think a lot of the largest companies just have many, many modes. It's not just one thing because the way you get to a scale and the way you build a defensible business over time is you accumulate these modes. You need a number of them. But yeah, I would just think what's going to be more valuable in the year and what's less valuable. I think that when you think about these different software companies, though, if you're using a cloud code, do they, almost kind of blend away because you could potentially be in this one app that is interfacing with all software, which means therefore there's really only one software company. Yeah, I mean, there's just like a lot of ways that this could play out.

I think something like this is possible, but it seems a little far-fetched to me. Because if I think about, for example, like, let's say I'm using a messaging app, how do I decide which app to use? I use the app that my friends are on that I can reach. So it doesn't matter if I can build a really awesome app for myself, which I can do today. Like, I can build a great messaging app with quad code in like a few hours. It's still not useful because they can't talk to my friends. But this is the example exactly.

You'll have, you can fact check me on this. You're going to have an agent in your messaging apps that's going to let you know when your friends have messaged you. I know you use cloud code on your iPhone a lot, right? So then you will just see the notification and you'll speak back to people. All your communication could potentially be centralized. And as long as the companies play ball. Yeah, I mean, it could be kind of the agent in the end, but how does the communication actually happen?

So, like, you know, for example, if you look at a messaging app like a, you know, like Signal, there's a protocol that it uses to communicate. And, you know, I can build an app. It can maybe use that same protocol, but I think it actually can't message other people that are on Signal. But, yeah, like, I can have an agent that uses my app to do that message using an existing app that supports this. So, yeah, it's not obvious how it's going to play out.

I think today people use a mix of, you know, apps and agents. But, you know, I do fundamentally think that a lot of these modes are actually still going to increase in value over time. You can think of another example. Let's say, you know, like a TSM or some kind of like chip manufacturer. If you think about the amount of work that they put into making a process and in making a process where the costs go down with scale. This is a fundamental economic force. And there's a lot of companies that do this kind of thing, where, you know, especially in manufacturing, where with scale, the cost goes down. With tech companies, this is the case for infrastructure. So if you build a really great infrastructure,

you can support more users and the marginal cost per user goes down over time. So if you have this kind of effect, it doesn't matter if you or I can build apps. That's still a really powerful mode. But I do think for sure both things are in play. Okay, I got three more in 10 minutes. Let's see if we can get to them all. Jack Clark, one of the Anthropic founders, recently said, I think that he believes there's like a 60% chance that these models will start improving themselves by 2028. It could be off by a percentage or a year. But ballpark, that's accurate. You're in the app where coding happens autonomously. You're running this app. Do you agree with Jack? Seems right. Yeah. When I look at the way that quad code is written, 100% of quad code is written using quad code. This has been the case since, I think, November of last year since Op. 4.5. It's like a fast takeoff scenario then. So you anticipate that.

I mean, it's possible. And like, this is why Anthropic exists. If you ask anyone, any engineer or any research or why they joined Anthropic, they're going to tell you it's for AI safety. and it's because for us when we think about the future, you know, years from now, the thing that's the most important and the thing that we want to get right, you know, for our kids is we want to make sure this thing is safe and we want to make sure it goes well. Because, yeah, like that is one of the possible outcomes. I think that's not yet what we're saying. You know, right now, quad code is writing itself, but it's still a person that's doing the prompting. Quad is starting to generate its own ideas for what to build next for Quad Code,

but it's, you know, it's not always good ideas. And I still generate most of the ideas. and, you know, at some point it's going to change. The model is going to improve, and it's going to become more of a self-reinforcing loop. Okay. I definitely want to get your thoughts on the world model argument here, where people who are pro-world model say that a large language model has no understanding of the consequences, and you need to build a world model into it to have effective agents. Here's something from Jan Lacoon.

He says you cannot build a reliable agentic system. Without a world model, LLMs don't have world models. They can't predict the consequences of their actions before taking them, according to yon. They just act, and whatever happens next is someone else's problem. I was speaking with Greg Brockman from OpenAI recently, and he said, basically, he doesn't accept that argument, and he thinks LLMs are the way directly, these text models are the way to AGI. Which side are you on? Are you believer that that world model intelligence needs to be baked in?

or do you think that LLMs alone are good enough? I would put out an offer to Jan if he wants to sit down and quad go together for an hour. I'd love to show him. You guys should do that on this show. Yeah, and then I'm curious to hear what he thinks. Maybe he'll change his mind. Maybe he doesn't. Right.

But your perspective, though. You know, I'm pretty firmly on the product side. So, you know, I don't really have a perspective on it. Okay, let me drill down a tiny bit deeper, if you don't mind. you know, you're on the product side, but I've heard multiple people bring out this idea that without a conception of the way the world works, like in a world model, a LLM just doesn't have an understanding of the way that the world works and consequences and stuff. You use co-work to book how many flights, eight flights in hotels?

Like, you must think that it has some understanding of consequences, otherwise you wouldn't have given it your credit card, which I presume you did. So what do you think about that argument in particular? I think from what I've read from folks working on a research at Anthropic, it is surprising the degree to which these models are intelligent. Because like you said at the beginning, the thing that they fundamentally do is they predict the next token. And so you think like this is kind of like a stupid thing. Like how can this possibly lead to intelligence?

But, you know, we've actually published a lot of work about how the models are able to plan. They're able to actually reason. There was all these like very surprising behaviors. that you actually wouldn't expect from a model that just predicts the next token. So, I don't know. I wouldn't discount that. I mean, I think my favorite is when they write poetry, as they're writing the first line, you can see in the model, this is anthropic research, that they're already thinking about the next line.

That's right. Which is like, how is that even possible, but. That's right. I mean, and that's kind of, you know, how I think about it. Like, if I wear poetry, that's how I would do it too. And it's crazy. Like, you teach this thing to predict the next word. And somehow, if the next word.

it is hard enough, it has to learn to really plan ahead and it has to learn how to do all of this. Okay, last one for you. Sometimes I wonder when I see big tech changes underway and in my career covering this stuff, some have worked out and some haven't. I always have to ask myself, how are we sure that this is the future and this is not a fever dream? And I think the data indicates that this is a real thing. But I also wonder, you have to sort of, you have to question. how much you can extrapolate towards the future in terms of how will this continue to progress.

The argument that this is a fever dream is that maybe people just want simple interfaces and they don't mind tapping through things. And, you know, speaking in a cloud code feels a little bit too techie. And it just won't appeal to the everyday user as much as it's really taken off with developers. I mean, how would you answer that? We had this hackathon for Opus 4.7 recently, and one of the winners was a doctor that built an app. There was an electrician. There was a carpenter. And a lot of these people didn't have coding experience, but they used quad code to build something useful.

There's one person that built and sold a startup as a result of one of these hackathons that we put on. And undoubtedly, when we first built quad code code, it was for. for engineers and engineers kind of figured out how to use it. But very quickly, people that were not engineers figured out how to use this to build economically useful things. And actually, if you look at a lot of the usage today, it's like it's not engineers. And it's just so useful for people that they're going out of their way. They're jumping through hoops even before co-work. People were like installing quad code in a terminal. For a lot of people, this was their first time using a terminal. And of course, now, you know, for quad code, we have a desktop app, we have

iOS app. We have a Slack app. There's many ways to interact with it. But people were jumping through hoops to use it because it was so useful. And so for me as a product person, this is the ultimate market test of is this thing useful? Is there a lot of people that use this every day and that keep using

it every day? And yeah, it's a lot of people and it just keeps growing. And I'm just constantly surprised by the way that people use this. Yeah, I will say I've been surprised by the way that I found myself using the tools. And I don't know.

Well, we'll see what comes next. So I'm excited to keep using it and thrilled to have a chance to speak with you. I hope we can do it again. Yeah. Thanks for having me on. All right. Thank you, Boris. Great speaking with you.

All right, everybody. Thank you so much for listening and watching. And we'll see you next time on Big Technology Podcast. Every Sunday, we cover the week's tech news on this week in Tech. Hi, this is Leo Lipport, inviting you to join me this week. As Berber Jin from the Wall Street Journal and Paris Martino from Consumer Reports, join Ian Thompson. And we'll talk about, of course, open AI and anthropic. They got together with a bunch of religious leaders and decided what religion AI is.

They've also figured out how to keep it from blackmailing you. You just say, well, that would be wrong. This week in tech, you'll find it at twit.tv and wherever you get your podcasts.