The AI Daily Brief: Artificial Intelligence News and Analysis - Opus 5.5 vs GPT-6 Sol and Luna

Episode Date: September 23, 2026

Anthropic and OpenAI release new models on the same day, with Opus 5.5 winning early acclaim while GPT-6 Sol and Luna push the frontier of affordable intelligence. NLW breaks down the benchmarks, real...-world use cases, and first reactions—and why model personality, falling costs, and the tools surrounding AI increasingly shape which models people actually use.AIDB Fall Listener Survey - https://aidailybrief.ai/surveyMultiplayer AI Sprint - ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://multiplayerai.ai/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Brought to you by:KPMG – Research from KPMG and the University of Texas at Austin shows the highest-impact AI users treat AI like a reasoning partner — and those skills can be taught at scale. Learn more at ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://kpmg.com/us/Sophisticated⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Harbor - Invest in the AI ecosystem. ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://www.harborcapital.com/aidaily⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Hyperagent - Hire a team of always-on agents. New users get $100 in free credits. ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠hyperagent.com/aidailybrief⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Rackspace Technology- One accountable partner to build, operate and run your full enterprise AI stack ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://www.rackspace.com/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Section - Section turns AI investment into workforce transformation and ROI - ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://www.sectionai.com/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Blitzy - Want to accelerate enterprise software development velocity by 5x? ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://blitzy.com/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Robots & Pencils - Cloud-native AI solutions that power results ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://robotsandpencils.com/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠The AI Daily Brief helps you understand the most important news and discussions in AI. Newsletter: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://aidailybrief.beehiiv.com/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Interested in sponsoring the show? sponsors@aidailybrief.ai

Transcript
Discussion (0)
Starting point is 00:00:00 The first half of this week has seen not one, not two, not three, but four major model releases, including two on Tuesday this week, a pair from OpenAI and one from Anthropic. For OpenAI, GPT6, Seoul, and Luna continue their quest to build cost-efficient models at every level of the intelligence stack. And for Anthropic, early indications suggest that Opus 55 is a return to glory or at least early adopter acclaim that the company has not seen since Opus 4.6. The AI Daily Brief is a daily podcast and video about the most. important news and discussions in AI.
Starting point is 00:00:35 All right, friends, quick announcements before we dive in. First of all, thank you to today's sponsors, KPMG, Blitzy, Section, and Hyperagent. To get an ad-free version of the show, go to patreon.com slash AI Daily Brief, or you can subscribe in Apple Podcasts. And to learn more about sponsoring the show, send us a note at sponsors at AIdailybrief.aI. Now, as is normal when it comes to big new model releases, this will be a main-only episode. And honestly, we're going to have a hard time getting it all in even with that, so let's dive in.
Starting point is 00:01:05 Welcome back to the AI Daily Brief. It's fairly undeniable that the best days on the AI Daily Brief, certainly the most fun, exciting, dynamic. Oh boy, I can't wait to be done with this episode because now I get to go do things, types of episodes are ones where we get new models. And yesterday, we got the absolute rarest of treats,
Starting point is 00:01:25 a thing which I can't frankly remember ever happening before, which is the two most important labs of the moment. OpenAI and Anthropic, both releasing new models on the same day. Certainly we've had models released close together before. In fact, usually the pattern that we see is what SpaceX AI did yesterday, releasing their model in advance, so as not to be drowned out by models that they knew would get more attention than them. The challenge of the same day release is that it inevitably gets people to ask,
Starting point is 00:01:53 not what's valuable about this particular model and where it's going to fit in my rotation, but instead, which of these is better, and what does it say about which lab is in the lead? So today we are going to go through what was released, where things stand on the benchmarks, the first reactions, examples around some particular use cases, the impact on the competitive landscape, what it says about the whole pacing the frontier thing, and in the community's estimation, who won the day. The first model we got was Claude Opus 5.5. And frankly, it's been some time since an Opus Class model was the big show. Now, the biggest reason for that is, of course, the interesting
Starting point is 00:02:29 introduction of mythos and then fable, but even before that, people had so much love for Opus 4.6 that 4.7 and 48 were for many, if not a regression, certainly very incremental at best, and not even incrementally ahead in certain cases. And in fact, when it came to Opus 5, people just genuinely did not like the thing at all. Now, jumping ahead to where this conversation is landing, the perfect encapsulation comes from AI content creator Peter Yang, who used a meme of an illustration of a horse, beautiful and complete at the beginning, representing opus 46, of course, to a much scratchier, more simplistic and childlike line drawing for Opus 47 and Opus 48, culminating in near scribbles for Opus 5, to finally, once again, the beautiful front side of a horse in perfect
Starting point is 00:03:13 illustrated detail for Opus 5.5. The people, in other words, are really liking this model. But how did Anthropic pitch it? In their announcement post, they said that Opus 55 performs at the level of Claude Fable 51 for most tasks, but costs 40% less to run, not even just than Fable 51, but then Opus 5. In their announcement thread, they point out that it is a major step up from Opus 5, but also, frankly, at least when it comes to the benchmarks, it's also a step up from Fable 51. On Terminal Bench 4-0, the model jumped from Fable 51's 55.8% to Opus 55.6.4%.
Starting point is 00:03:49 cursor bench, frontier code v1.1, and Humanity's last exam also all saw jumps, not only from Opus 5, but from Fabal 51 as well. In fact, there wasn't a single benchmark that Opus 55 wasn't ahead of the other Anthropic models Fable 51 in Opus 5, and only two, automation bench, which measures business workflows, and terminal bench science, which measures a gentic scientific research, where Opus 55 wasn't ahead of GPT6 Astra as well. Importantly, this is not just a performance gain, but also a pricing gain as well. The clot account wrote that because Opus 55 requires less compute to serve than Opus 5, its pricing is consequently down compared to Opus 5's $5 per million tokens and 25 per million output, Opus 55 is $4 per million input, and $20 per million output.
Starting point is 00:04:36 However, because of additional efficiencies, they said that the cost gains will actually be about 40% as opposed to just the 20% reflected in the cost. Although it's not pitched as a model focused on speed, they do note that because many of its default effort settings deliver better results than other models running at higher settings, that Opus 5-5 generates output much faster than those other models, including an average of 30% faster than Opus 5. As a cherry on top, they increased five-hour usage limits on all of their Pro Max and Team plans, and through in the rest of the subscription users a rate limit reset which can be used whenever people need. On the safety front, they note that this is their first model released in the wake of the pacing the frontier note, and that
Starting point is 00:05:15 Opus 5-5 was tested before released by external evaluators, including Frontier Design and Meter, and overall they argued that Opus 5-5 is basically the best-aligned model they've released yet. Sam Bowman, who works on alignment at Anthropic, wrote, We think Opus 5-5 is sufficiently safer than its predecessors that releasing it, more likely than not, reduces risks related to misalignment. Now, Opus 5-5 alone would be more than enough for a complete episode, but OpenAI was determined not to let Claude have all the fun, and in the early afternoon Eastern time on Tuesday, they dropped their own set of models, GPT6 Sol and GPT6 Luna.
Starting point is 00:05:50 And if the Opus 5-5 announcement was a little bit focused on cost and efficiency, the Six Sol and Six Luna announcement was all about cost and efficiency. Their announcement post on X reads, GPT6 Sol and Luna build on the advances behind GPT6 Astra, bringing much of its strengths into faster and more affordable models to support work at scale. We've also made caching and inference more efficient, and we're passing the savings directly to you, 50% lower API prices for Sol and Luna
Starting point is 00:06:17 compared with GBT56 promotional pricing. In other words, they're not just talking about this pricing being lower than Astra. They're cutting costs from the previous generation even before that. And what's interesting is that they're clearly presenting cost as enabling new ways to use the tool as well. As they put it, higher usage limits and lower cost give you more flexibility and room to iterate. In other words, one of the ways that they think that people should cash in on those cost savings
Starting point is 00:06:41 is to be more iterative in how they use the model. Going back a couple of generations of models at this point, one of the subtle divides between Codex and GPT usage, and Claude and FABEL usage, on the other hand, has been an impulse to use Fable and Claude, for more hands-off long-running tasks, and the GPT models inside Codex, for things where you need more interaction and iteration,
Starting point is 00:07:01 and these new Sol and Luna models seem to build on that as well. Like the Opus 5-5 announcement, OpenAI also points to advancements in alignment, and what's notable when you get into the benchmarks on the OpenAI page, is that where Anthropic is still using the traditional charts, which show a benchmark name and then a set of percentage scores across a set of models, OpenAI has entirely abandoned that, only showing benchmarks on graphs that map performance on the Y-axis versus cost on the X-axis.
Starting point is 00:07:27 Sam Altman tweeted, GPT's 6-Soul and Luna are big improvements on intelligence, alignment, work output, coding, computer use, and more over their 5-6 family predecessors. They are also half the price per token and even less per task. He then went and followed up and really reinforced just how important this way of thinking is to OpenAI now, especially compared by per-task pricing, which is the metric that should matter, Sam says, I don't think there is anything competitive anywhere in the market. We want people to be able to use tons of AI. It's important to being able to explore this new renaissance in front of us. Putting some magnitude around what they mean by tons, in the announcement
Starting point is 00:08:00 post they point out that valued at API prices, the median researcher at OpenAI uses $600 in tokens per day, while the 90th percentile of researchers use $7,000 of $2,000 of tokens per day. Almost understating it, they write, as coding agents take on longer and more demanding tasks, the cost of sustained use matters more. The upshot, GPT6 Sol and Luna, they write, combine strong coding performance with lower API prices, giving developers more room to iterate, and teams the confidence to be more ambitious about what they ask codecs to take on. But what about external benchmarks? Even for those folks who care about benchmarks, everyone assumes you have to take any internal measures with a grain of salt, and one of the first places
Starting point is 00:08:38 that people look when a new model comes out is independent sources like artificial analysis. On their new V3 index, GBT56 Luna and GPT6 Luna are basically score the same at 37 overall, while GPT6 Sol slightly beats GPT56 Sol. That said, both of those models get those scores at a lower cost per intelligence. Indeed, artificial analysis's first sentence is, GPT6 Sol and Luna pushed the cost efficiency frontier by halving cost relative to GPT56 Sol and Luna. In another positive highlight, artificial analysis found that both models saw a significant reduction in hallucination.
Starting point is 00:09:12 Zapier also tested GPT6-Sole. On a slate of real workflows, they found that six-soul scored 33.2% compared to GBT56s 28.77% and did so at roughly half the price of 5-6. Their summation was pretty simple. Upgrade any of your workflows that are using 5-6. It's cheaper and better, a rare combo. Opus 5-5, however, was a different kettle of fish entirely. Opus 55 was notable because it absolutely thwumped everything else to get the new top score on the intelligence index by five whole points.
Starting point is 00:09:45 Claude Fable 51 and GPT6 Astro were previously holding it down at the top with scores of 53, but Claude Opus 55 jumped all the way to 58. And while its cost and efficiency gains might not have been as much as GPT6 hole, artificial analysis did note that this increase in performance also came with the 20% price cut. And honestly, while I've been trying to keep this analysis largely aligned in equivalent so far, watching people's first responses, there is absolutely no doubt which model among these dominated the discourse. Matthew Berman wrote,
Starting point is 00:10:17 Opus 55 being the absolute best model on the planet and being cheaper than Astra and Fable was not on my bingo card. Chubby Keminismis on X writes, The more I use, the more I fall in love with Opus 5.5, it's so good and so much faster and so much less verbose. It's everything I could have asked you. for. It's as if my beloved Opus 4-6 came back, but better and rebranded as 5-5. Now, we'll get more into that love, but what were some of the specific areas that people
Starting point is 00:10:43 were testing Opus 5-5 on? Aaron Levy and the team at Brocks brought it into, quote, a variety of complex enterprise knowledge work tasks dealing with unstructured data and saw not just improvements in performance, but major efficiency gains as well. Versus Opus 5, they found 63% fewer tokens used, 42% less verbosity, and 30% faster. On financial services tasks, they found an increase of 39% task accuracy. On cloud cost analysis and technology use cases, they found an increase of 65% task accuracy. And in use cases related to consumer products and clinical diagnostics, they found an increase of 17% and 15% task accuracy respectively. If you're leading AI inside an enterprise, you already know that the gap right now isn't capability but execution.
Starting point is 00:11:29 That's why KPMG's You Can with AI is back with a new season featuring conversations with leaders like Sorosia Chatterjee of Emma, May Habib of Writer, McKess and CIO, Elery Fisher, and others focused on practical execution. What's working, what's not, and what it actually takes to move from pilots to real scaled impact, across strategy, data readiness, governance, workforce, and value. And of course, it's co-hosted by me, Nathania Whittemore. Go listen and subscribe at www.kpmg.us slash AI Podcasts. That's www.kpmg.org slash AI Podcasts. Here's why most legacy modernization projects fail.
Starting point is 00:12:05 The AI doing the work can't understand codebases at scale. It sees a small slice of context, examines syntax, and misses years of decisions distributed across the global application ecosystem. Blitzy solves this the way it solves everything. Grounded in your code before any migration begins, Blitzie's agents reverse engineer the entire legacy system into a persistent knowledge graph, every dependency, every constraint, every piece of tribal knowledge that used to live in one engineer's head.
Starting point is 00:12:29 From that understanding, Blitzy autonomously executes language migrations, framework upgrades, and monolith to microservices transformations, all validated end-to-end. One Blitzy customer modernized a $10 million monolithic insurance stack in 16 weeks, against a 137-week baseline with coding agents. That's 9x compression. Retire technical debt while accelerating your roadmap. See how at blitzy.com. That's BLITZY.com.
Starting point is 00:12:54 Here's a harsh truth. Your company is probably spending thousands or millions of dollars on AI tools that are being massively underutilized. Half of companies have AI tools, but only 12% use them for business value. Most employees are still using AI to summarize meeting notes. If you're the one responsible for AI adoption at your company, you need Section. Section is a platform that helps you manage AI transformation across your entire organization. It coaches employees on real use cases, tracks who's using AI for business impact,
Starting point is 00:13:21 and shows you exactly where AI is and isn't creating value. The result, you go from rolling out tools to driving measurable AI value. Your employees move from meeting summaries to solving actual business problems, and you can prove the ROI. Stop guessing if your AI investment is working. Check out section at sectionaI.com. That's SECTIONAI.com. This episode of the AI Daily Brief is brought to you by HyperAgent, where you run fleets of agents your team can manage together. Forget local agents and chat workflows waiting on your laptop to be prompted.
Starting point is 00:13:54 Hyperagent deploys always-on agents in the cloud, doing real work across the tools your team already uses. Marketing agents turn competitor moves into landing pages. Sales agents enrich leads, draft emails, and updates the CRM. Ops agent chases the paperwork and tracks the budget. Every agent has access to shared context and follows your rules about scope and approvals. It's time you add agents that feel like teammates. Hire yours at Hyperagent. Get $100 in credits at hyperagent.com slash AI Daily Brief.
Starting point is 00:14:22 Now, when it came to the social media demos, as has been the case with the last several models, a huge amount of the posts were highly visual things like graphics, 3D render, and game design, which are interesting to look at on the internet, if not necessarily super reflective of the type of use cases that most people are going to actually have for this model. Still, given how much 3D graphics and visuals and Blender were a big part of the story of the GPT6 Astra release, a lot of the demos of Opus 5-5 basically have it mogging that model on exactly that type of use. And given that my analysis, just a week or two ago or whenever it was that we got GPT6 Astra was about how much those sort of capabilities asked us to think in more
Starting point is 00:15:00 expansive terms about the opportunities that AI opened up, it's worth noting that Opus 55, at least initially, seems to be another jump in those capability sets as well. Alex Albert from the Anthropic team showed Opus 55 using Blender to make claymations with a single prompt. Chase Lean made an interactive coral reef wallpaper, and some people showed how the models were powerful enough to use generated code rather than image models to create real visual representations of the world. Peter Yang shares what looks like a video of the Golden Gate Bridge, but notes that it's actually entirely generated using code by Opus 5.5. He adds, from my testing, I think Opus is just as good at building 3D scenes as Astra.
Starting point is 00:15:37 Alex Albert again did something similar, visualizing a historically accurate San Francisco Market Street in 1906 pre-E earthquake using only Opus 55 code and blender, no image generation. Dan Wood says that Opus 55, quote, absolutely frame-mogs every other model on these sort of 3D generated worlds, adding that it is a, quote, astounding leap in spatial awareness. In a wildly viral post, Jake Eaton from Anthropic shared a number of different what appear to be paintings and said, For the past few months, I've been asking our models to paint. Opus 5.5 is very skilled at emulating different styles.
Starting point is 00:16:10 Every image here is a Python program generated pixel by pixel. There is no image model and no off-the-shelf art software. Instead, it's about 7,500 lines of code using standard libraries to emulate different brush styles. The agents don't use any pictures as reference, instead working only from what they do. know about each painter. And certainly this is where you can see these capabilities, which might otherwise be cool to look at on social media, but not necessarily all that relevant for most of us, maybe start to become a little bit more relevant. If the advanced coding capabilities of Opus 55 are enough that it can, as in the case of this post by tack, generate a one-shot 30-second long
Starting point is 00:16:45 marketing animation, well, certainly all of a sudden a bunch of use cases open up that you might not have thought of before. Tarig from the Claude Code team asked Opus to do a bunch of redesigns on his personal website and then make a trailer with all of its iterations. And at first glance, it seems to have done a great job. For what it's worth, this is one use case that I tried on Opus 55 as well. And I was definitely pleased with its analysis and review of my AI Daily Brief website. It was clear, had good concision of thought, and was very practical. Although I will say for those who are just trying to live in the world of strictly betters or strictly worse's, it wasn't that it was necessarily strictly better than Fable 51's analysis. It was just different.
Starting point is 00:17:21 And yet one area where almost everyone seems to be in agreement that Opus 5-5 is indeed strictly better is writing. Anthropic Shulte Douglas reposted their announcement and wrote, Also important news we fixed the writing. So what does that mean? Well, part of it is, as Theo put it in all caps, they removed the MDashes. But what the Anthropic account actually said about this is, Opus 5-5 communicates more naturally, addressing some of the most common feedback we heard on Opus 5. It puts the most important information up front and follows the writing rules you give it,
Starting point is 00:17:55 which makes long sessions easier to follow. The team at every who have one of the best benchmarks and processes for testing AI writing wrote, Opus 55 produces the most readable pros we've seen from an Anthropic or Open AI model. In fact, presaging a point that would come up a lot more later in the conversation, they wrote that while Opus 5 had made their writers kick Claude models to the curb, 55, quote, makes us want Claude back in the room. They continue, it responds well to feedback, builds on the measurements,
Starting point is 00:18:21 material you give it and explains its choices where Opus 5 wouldn't. And importantly, it turns out that this isn't just an improvement on the output of writing, but an improvement on the actual process itself. They write that Opus 55 is a pleasure to write with. It takes feedback without a fight and builds on material instead of handing it back tidier. In fact, the team writes, The biggest upgrade is not even exactly about the writing. It's about the feel and vibe of the model.
Starting point is 00:18:46 As the every team puts it, Anthropic fixed Opus's personality. It's not an obstinate little turd anymore. And this is an experience that many have had. AI builder McKay Wrigley writes, Opus 55 equals the personality of Opus 46 that we all desperately wanted back, and the intelligence and taste of Fable 5.1. And certainly Anthropic knew it.
Starting point is 00:19:07 Nat McAlly's from Anthropic posted. Opus 55 is way, way, way better than Opus 5. Sorry about that model. Please try this one. So have people had any issues yet with Opus 55? There is one that stands out and that for certain use cases will be effectively a non-starter. Chief of Staff on X wrote, I burned all my usage reset benchmarking Opus 55 against Fable 51 for complex open-ended legal work,
Starting point is 00:19:33 i.e. drafting client and court-ready documents, draft and contract redlining, legal and matter-related research. As far as I can tell, Opus 55 is much worse due to increased safety rejections and what I'd guess you would call poor effort budgeting. Simon Smith writes, Opus 55 looks good, but as a life science commercialization company, I'm a bit concerned by this. Quote, because Opus 55 is comparable to Claude Mythos 51 in biology and cybersecurity, we're deploying it with safeguards similar to those on Claude Fable 51.
Starting point is 00:20:02 Simon continues, We've faced issues using Fable for some tasks because of these guardrails. We've applied for Anthropics Life Science Verification Program but haven't yet been approved. We had used Opus when Fable refused to request because of Fable's biology guardrails, but now it seems like this won't be possible anymore with Opus either. It's not everywhere, but I certainly have seen a number of people complaining about these overzealous safeguards, which is unfortunately the type of thing where if that hits your use case, it basically makes the model null and void.
Starting point is 00:20:29 So what are some of the big takeaways for folks after this huge slate of releases? Aaron Levy writes, What an insane day in AI. The frontier models just became substantially cheaper with the Opus 55 price cuts, and now with GPT6 Sol and Luna dropping token prices by 50%. The rate at which the cost per task on a like-for-like basis drops in AI is unlike any other type of technology in history. And every time the cost of AI drops, the use cases you can deploy agents against dramatically
Starting point is 00:20:56 increase. This is J-Von's paradox applied to agents. Making a bit of a prediction error continues, these improvements will directly lead to broader diffusion of AI in the economy, as we can use agents to process all of our data, scan our code for security issues, read through all log data to make decisions, have agents' swarms in workflows, and much more. The cost of tokens is directly correlated to these use cases being opened up at scale. And putting some research heft behind that, Epic AI research yesterday also dropped data arguing that,
Starting point is 00:21:24 quote, AI is getting cheaper more quickly than any other transformative tech in history. At a given level of performance, cost has fallen around 47% per quarter since 2023. They point out that that's 4x faster than DNA sequencing, 6x faster than compute, 18x faster than lithium batteries, and at least up to 1973, 54 times faster than electricity. Now, when it comes to a head-to-head analysis, you can find people arguing all sides when it comes to which of these models are the most valuable in aggregate. To your taxes, writes,
Starting point is 00:21:55 cheaper, better soul, and Luna. I assume they're natively trained for being Astras henchman. This makes OpenAI's value proposition considerably stronger. I suspect that Opus 5-5 wins on cost and multi-agent are effectively negated with Astra plus Sol plus Luna. And there are also many of folks, just happy to enjoy the unique values that each of these different models provided on their own terms. In answering the question of whether there was a winner, Chubby writes, both OpenAI and Anthropic
Starting point is 00:22:19 gave us plenty to be excited about. And if you have any question about the strategy that OpenAI is pursuing, Sam Alman could not have made it any more clear. He wrote, We want the OpenAI API to feature the best model at every price point and to be the best at every modality, text, code, image, video, etc. And then we all want you to come up with great ideas and build them and get to be happy users. Again, remember that he had written in a separate post, we want people to be able to use tons of AI. It is important to being able to explore this new renaissance in front of us.
Starting point is 00:22:48 I think in many ways, you can view this set of releases from OpenAI as a continuation of the strategy that they've clearly been pursuing for a while now, which is be really aggressive about focusing on cost and efficiencies and building a model slate for an era in which people are moving away from a single model towards complex model architectures that actually match tasks with the right type of intelligence. Claude, on the other hand, feels like it was out to reclaim some momentum. And if that is the case, they've done so pretty successfully. Here's how every put it. Soul feels like an S-class iPhone
Starting point is 00:23:21 release. It will give you much of Astros power at about a fifth of the price. Opus 5-5 is the bigger surprise. 5-5 is tempting a few people on our team to switch back from codex. You'll love this model if you're already in the Claude ecosystem, and if you're a code, user, it's worth a look, especially for your top-end coding tasks. Now, in some ways, this is just a continuation of the divide which I mentioned before in which we've seen for several model iterations now. Dan from Every concludes that article. You'll like Soul 6 if you want a fast, affordable daily driver for reading, writing, and getting things done. It's the model I keep reaching for. You'll like Opus 5-5 if you're willing to pay more for stronger performance
Starting point is 00:23:57 on ambitious coding and visual projects. It's best works for past Sol in our tests, enough to pull some of our team back towards Claude. And the pulled people back to Claude is a real take that I'm seeing from a number of different people. Yu Chen Jin writes, Claude is back. Time for me to open Claude code again after ignoring it for a month. And if anything, the more time that goes on, the more positive I'm seeing people get on Opus 55. This morning, former investor turned AI builder, Jeffrey Emanuel chimed back in, my God, Opus 55 is breathtaking. It's just grinding through incredibly tricky stuff like it's nothing, finding bugs and problems that eluded Fable and for weeks in some cases, and showing a level of agency and resolve I haven't seen before.
Starting point is 00:24:38 Now, for me personally, I'm going to save a bit of my personal analysis for a little bit more time with the models, which will come together in more of a how-to episode for getting the most head of both of these models later in the week. That said, I do think that there are a few interesting observations that are worth closing on. By the way, this visual that I'm talking over was created by GPT6 Sol, which added quite a bit of text that I didn't have in there, but I left it perhaps as an example of particular model quirks. observation number one is that even early adopters who are more ruthless about switching and who profess to really only care about performance definitely have personality preferences. So much of the
Starting point is 00:25:13 excitement around Opus 55 is not about wow it does this thing which AI has never been able to do before, but about oh my gosh, it is such a pleasure to use this in a way that it hasn't been for some time. I actually think that this is extremely important. When there was such a big dust-up around Chatchipit 4O being deprecated, there was a temptation to treat it like a phenomenon exclusively for Crazy Normies who had gotten obsessed with a sycophantic model. But as time has gone on, for as much as AI might be a tool to some of us, it's clearly a very different type of tool. It's a tool that at least approximate having a personality, and different versions of that tool's personalities are more or less enjoyable to use actually has implications for how much we can get out of
Starting point is 00:25:53 them. In short, when it comes to LLM's personality is UX, and we should make sure we're treating it as such. Observation number two. While it is definitely the case that if you were just looking to declare one winner from the standpoint of buzz and excitement, it would be Opus 5-5, the battle of LLMs is not really about one thing anymore. It's about one, figuring out what the stack of options needs to be, and then two, battling for each slot in that stack. In other words, even the people who loved Opus 5-5 the most aren't saying you have to use this for absolutely every single use case. And in many ways, I'd even argue that although at first glance, Opus 5-5 and GPD6 Sol seem to be direct competitors, the way that their respective builders are thinking about
Starting point is 00:26:33 them is a little bit different. What matters at this stage is individuals and companies being able to understand their complete set of needs and how different models and harnesses combine to best fill those needs with respect to performance, capability, cost efficiency, and speed. A third observation is that we're definitely in the era where you can't really separate models from harnesses anymore, at least not fully. For a lot of folks who are fully invested, for example, in the Codex ecosystem now, it doesn't matter if Opus 55 is much better. As long as their open AI options are close enough, they're not going to fully shift out of that harness. Will Brown from Prime Intellect wrote, I keep switching desktop agents every week and it's getting out
Starting point is 00:27:13 of control. Codex didn't have Fable 5-1, Claude didn't have Astra, Amp had them both, but now doesn't have Opus 5-5, so I'm back to Claude. Self-Build is annoying to maintain. We didn't talk much about harnesses in this episode, but give it about a week, and the real proof in the pudding will be whether anyone has actually switched their overall behavior because of any of these model changes, or whether everyone tested things, found out what they liked, and just went back to the ecosystem that they were already using before, dictated in large part by the harness, where they store their context, their tools, their rules, etc. A fourth observation is actually not so much about either Anthropic or Open AI, but about the fact that as these models were being released,
Starting point is 00:27:47 The other big, buzzy thing that people were talking about was, I would argue, the first AI product that is seeing a lot of traction where the people using it genuinely don't know or don't care about the model underneath. I'm talking, of course, about Muse, which you can tell just from the posting from Meta's chief AI officer Alexander Wang, the team over there at Meta is very excited about the uptake and reception for. How will it change this sort of new model conversation if the models actually start to get abstracted away. That's something we've talked about for a long time, but which so far hasn't really played out
Starting point is 00:28:21 in practice. But who knows, maybe we're at the beginning of the product rather than the model era of AI in which the models really will disappear into the system. The fifth and final observation for today is what this all says about pacing the frontier. One of the standard jokes that could get you a bunch of reposts and likes on X was people staring with bleary eyes at four major model releases in two days and asking some version of, this is pacing the frontier? But I think Theo had the right of this when he wrote, Hot Take, this is what pacing looks like. None of today's releases were Astra or Fable Tier.
Starting point is 00:28:52 This is intentional. The point of pacing isn't to stop iteration and improvement. The goal is to prevent the development of bigger models from spiraling out of control. Opus and Soul Class models are a great place for our focus to go right now. Lots of opportunity for real wins without as much risk. And I think that that's correct. If this is what we get from the pacing the frontier era, in other words, models that solve specific problems with previous iterations of those models,
Starting point is 00:29:17 and deliver incremental performance or value gains at significant cost and efficiency gains, that seems like a pretty good place to spend some time. And not one where somehow all sorts of adoption is going to slow down. Tarik from the Cloud Code team is clearly pointing at this as a key direction for the labs. He wrote, The right way to use model capabilities is not to ship 10x more features to prod. It's to spend more time understanding your users, trying experiments, building prototypes, learning about things you don't understand so that you can ship things that
Starting point is 00:29:45 actually work. In fact, I think you could argue that because there have been such radical capability increases at such a fast clip for the entire history of generative AI post-chatch GPT, the labs have never really had to think in product terms. The raw capabilities jumps have been so pronounced throughout the entire period that they can just splatter the latest thing at us and we're going to eat it up. But at some point, the market of people who are willing to do that saturates, the percentage of business use cases that that approach can get to saturates, and you actually have to think in terms of human and system realities. Now, I don't at all think that somehow this means that all of a sudden all the resources
Starting point is 00:30:23 are going to go to perfecting existing classes of models rather than trying to build bigger things, but it certainly shows that the endless pursuit of bigger models is not the only be-all and end-all for the labs. Anyways, guys, it is a pretty phenomenal day. If you haven't yet, I would highly encourage you to go out and spend some time with these new models. For now, that is going to do it for this edition of the AI Daily Brief. I appreciate you listening or watching as always. Until next time, peace.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.