Everyday AI Podcast – An AI and ChatGPT Podcast - Ep 865: Open Source AI 101: Why Local Models, Cheap APIs, and AI Agents Change Everything (Start Here Series Vol 24)
Episode Date: September 18, 2026Until a few months ago, open source AI was kinda a hobby project. Now, it's tearing corporate boardrooms apart. Why? Over the past 6ish months, the gap between frontier closed AI and open sour...ced AI has shrunk to pretty much nothing. And with the surge of always on agents driving open models, their development and release schedule is on pace with the frontier labs. So if your team isn't paying attention to -- and running test cases through -- open AI models, there's a good chance you'll either be overpaying or playing catch up soon. We walk you through the 101 and what you need to know when it comes to open source AI in this Start Here Series special. Newsletter: Sign up for our free daily newsletterMore on this Episode: Episode PageToday's Episode on LinkedIn: Thoughts on this? Join the convo on LinkedIn and connect with other AI leaders.Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineupWebsite: YourEverydayAI.comEmail The Show: info@youreverydayai.comConnect with Jordan on LinkedInTopics Covered in This Episode:Open Source AI vs Closed Models ShiftChinese Model Distillation & Legal ImpactsEnterprise AI Cost Triage StrategiesGoogle Gemma 4 Local Model CapabilitiesFrontier Model Performance Gap Closing24/7 Agentic AI Systems OverviewAPI Pricing War: DeepSeek vs US VendorsLegal Protection Tradeoffs for Open Source AIAI Workflow Triage: Task-Specific ModelsFuture Trends: Local and Specialized LLMsTimestamps:00:00 Introducing the Firefly AI assistant03:33 Open source AI cost benefits09:25 AI model performance differences10:19 Open source model improvements15:28 Advancements in local AI capabilities17:04 Impact of Google's Gemma four22:15 Introducing Adobe's Firefly AI Assistant24:19 Adobe Firefly AI assistant beta launch29:26 Choosing the right AI tools32:00 Shifting workloads to open source33:31 Using open-source and closed models36:47 The future of open modelsKeywords: open source AI, open source models, local AI models, local models, closed source AI, closed models, proprietary AI, proprietary models, AI agents, agentic AI, AI workflow triage, cheap API, AI API costs, model distillation, Chinese open source models, China AI models, US AI models,Send Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info)
Transcript
Discussion (0)
Welcome to the Everyday AI podcast.
My name is Jordan Wilson, and for the past three and a half years, we put out more than 800 episodes.
Yet, one of the most common questions I get I didn't really have an answer for.
Where do I start on the Everyday AI podcast?
And that's why we started the Start Here series.
And with the fall now back in full swing, the Everyday AI podcast is going back to school and playing back the entire Start Here series from front to back.
We've hit pause on our normal Monday to Friday programming to run back our most popular series ever for the next 30 days.
We made the Start Here series for beginners and AI champions alike.
So whether you're just trying to get a grasp on large language models or grappling with the best coding harness for multi-agentic workflows,
the Start Here series covers it all.
Plain language, no jargon, and easy to follow along each day.
So make sure to subscribe to the podcast.
podcast and check back each day for new insights day by day. The series is a culmination of spending
more than 10,000 hours covering generative AI over the past three and a half years. So you don't
want to miss a single episode of the start here series. Let's get into it. A few weeks ago,
the United States government said the quiet part out loud when it comes to open source models,
at least from China. That's because in April, the White House sent out an official memo
accusing China of using distillation to illegally copy American AI models to create cheaper domestic knockoffs.
And that declaration is really nothing new if you've followed AI for years.
However, the recent distillation trend has completely reshaped one important landscape of enterprise AI,
the decision between using open source models versus proprietary closed models.
And in 2026, at least, it can actually be a tough choice between saving potentially millions of dollars versus running up your legal liability.
About two years ago, before Chenney's distillation was come in place, there was a sizable gap between frontier models and open source AI models or those models that you can essentially download or use for close to free.
But now, the gap is all but closed, which has thrust the open.
open source versus closed source question into every enterprise boardroom in 2026.
And although there's no one size fits all answer, we're going to be tackling the toughest
topics and the most important takeaways as we take a zoomed out view of open source models
on today's show.
That's why we're going over open source AI 101, why local models, cheap APIs, and AI agents
change everything about making AI decisions in 2026.
as part of our start here series.
All right, welcome to everyday AI.
Before we dig in, let's first zoom out and talk about the big picture here when it comes to
open source AI.
That's because, well, it's actually a legitimate thing now, right?
Two years ago, enterprise companies weren't saying, let's use an open source AI model in production.
Today, it's actually happened.
It's happening.
That's because, you know, maybe the most powerful open source.
models are only about two to six months behind frontier models. But on even consumer hardware,
you can be running essentially frontier level AI models from like just over 12 months ago.
And the Chinese labs now distilling US models have kind of crashed the open API prices to
pennies. Right. So yeah, not everyone out there on, you know, consumer or prosumer hardware can
run the most powerful open source models, although I do think Google has something to say about
that. But the most powerful open source models run for a fraction of the actual cost if you can't
afford to run them locally, which has completely shifted the paradigm when it comes to
enterprises making decisions on, well, are we going to use a model from one of the big three,
OpenAI, Google or Anthropic, or are we going to use a Chinese open source model and pay for it that
way. And well, what this is also led to in 2026 is essentially 24-7 local agents that can run.
And also without costing a ton and now having to actively and almost aggressively,
aggressively go through kind of an AI cost triage. But going full open source does strip away
the legal protection that the closed models often include.
So stick with me for.
for 25-ish minutes on today's Start Here series show.
And here's what you're going to learn.
You're going to know why the open versus close source AI default just officially flipped.
You're going to know how Gemma 4 from Google puts year old frontier capability on your laptop.
You're going to understand the two payoffs already shaping and reshaping how individuals and enterprises run AI.
And the hidden legal tradeoff most executives miss when going fully open.
source. Let's get into it. My name's Jordan Wilson. Welcome to Everyday AI's Start Here series.
This is the essential podcast series to us learn the AI basics. And if you're an AI expert,
this is your chance to freshen up and double down on your AI knowledge. Why do we start this
start here series? Well, after 750 plus podcast, I never really had a good answer when someone was like,
where do I start? What podcast do I start with? That's why we created the start here series.
it's best, I think, if you listen in order.
I think this is now volume 24 of the Start Here series.
So maybe we'll wrap it up at 25.
Maybe we'll wrap it up at 30.
I'm not sure.
But the whole point of this is you can go to start here series.com.
That's going to give you free access to our exclusive inner circle community.
And in the Start Here Series space, we make it even easier for you.
So you can actually go listen.
We have a Spotify playlist ready for all of the different Start Here series shows,
as well as a breakdown on each individual episode all in one place.
So make sure you go to start here series.com for exclusive access to that inside of our
inner circle community.
All right.
And if you miss our last Start Here series show, that was Volume 23.
We talked about headless software and why companies are building software for AI agents
and not humans and, well, what that means.
So today in volume 24 of the Start Here series, we're going over open source AI 101.
So here's the reality. Closed AI used to be the de facto, right? And I mean, honestly, there was really
never even much of a discussion about open source AI in the enterprise, maybe until 2025,
at least not serious enterprise companies. Now it's a real conversation. Right. So it's no longer,
you know, hey, we're just going to choose whichever API works best for us, right? Whether that's
Open AI Anthropic or Google, now most companies are looking at some of the open source alternatives,
most of them coming from China.
And the big kind of thing here is companies are starting to standardize around one frontier vendor in 2025 before this happened.
And then they called it an AI strategy.
And the assumption originally was, well, that worked for three years until two very specific forces broke the standard.
paradigm when it came to open source models.
First, the proprietary versus closed gap capabilities just completely changed.
All right.
So we talk about Arena on here a lot.
Previously had a different name.
Now it's just Arena.
So you put in a prompt, you don't know the outputs, you know, what models they're from,
and you vote for which one is better.
Right.
So all these different models get an ELO score.
And to really zoom out for our non-technical audience,
because I know a lot of you in the start here series
are not technical.
I'd probably even say what an open source model even is.
So the very simplified version is certain companies
can release models open source under like an MIT or Apache 2.0 license.
And that gives people the ability to download these actual models
and to run them locally on your machine.
And that is, well, one of the big tradeoffs, right?
So you're not sending any private or potentially
proprietary data in the cloud at all. Everything runs locally on your machine. So number one,
it's private. Number two, it's, well, free, right? And then there are open source models that if you
can't download them on your, you know, computer, because not everyone can. Some of them are much
larger. You can still essentially run those in the cloud for a fraction of the cost of what it would
cost to run a proprietary model. So essentially, open source models are ones that you can download,
you can modify. In some instances, you can even build products.
on top of it. All right. Anyways, right, until late 2025, there was a monstrous gap in the arena
scores, right? So these Elo scores, when you put in the same prompt, you look at two outputs.
Everyone overwhelmingly always chose the best front, the best frontier closed source model.
And that really started to change, right? So the gap between the Elo scores, well, it cut down by about
90%. So it went from about a 250 point gap from the best frontier or close source model.
Well, now it's only about 30 points, right?
Give or take, depending on the day, right?
But it's even, you know, recently a couple months ago, it was like 15 points, right?
So at that point, you really have to be an AI expert to be able to decipher the difference.
I think 30 points, you know, most people could look at different outputs over time and, you know,
a 30 point, you can kind of realize that if you're looking at the best, you know, open source model versus the best proprietary closed models, 30 points you can understand.
But 10 to 15 points, it's kind of a coin flip, even for people who are, you know, spending most of their days inside of large language models.
But this collapse came from those two different forces working in parallel.
So I have a little, a little graphic here on the screen for our live stream audience.
if you are listening on the podcast, FYI, you can always get the video version on our website
at Your EverydayAI.com.
But going from a 250 point gap to essentially a 30 point gap.
This is huge, right?
Because like I said, in 2023 to mid-2025, it was noticeable, right?
It was extremely, when you looked at the outputs, you could say, my business can use output
A, but it cannot use output B.
And now we're at the point where the open source models in terms of an Elo score,
and I think that's a good metric to look at over time, right, because the frontier is always
improving.
But if you look at the ELO scores of the open source models now, so those that you can kind
of, you know, if you have a beefy enough computer, you can download some of the best open
source models on your actual local machine, right?
Those scores are where we were at.
with proprietary models three to six months ago, right? So think back to the very end of 2025,
you know, and there's some models like I think at the time was probably GPT 53, Gemini 3 Pro,
and at that at that time, I think we're at like Opus, maybe four, six or maybe four, five, right?
Now you have open source models that you can run for free 24-7, run agentically,
that are at that same level. And that's why now,
This is a real enterprise boardroom problem, especially for large companies that have invested heavily into AI.
Right. So I'm not talking about companies that, you know, with a couple hundred employees.
I'm talking about companies that were spending seven, maybe eight, maybe even more seven to eight figures on AI each year.
Now, all of a sudden, they're saying, hey, in theory, if we switched, you know, part of our, you know,
summarization tasks alone, right?
There's, I've read a lot, I've talked with a lot of people that have done something similar.
You know, if, if we just, you know, chunk off everything that we're using, you know, open source model or sorry, close source model just for summarizing text, right?
Some of those lower hanging fruit, people are saying, well, yeah, we could save one, two, three, four million dollars.
And this is an actual reality that a lot of companies are grappling with right now.
So the force one was just the capability moving locally.
right.
And this, I think we have to credit Google for pushing the edge of edge AI.
That's because with their Gemma 4 model completely shook up the landscape of open source
AI, right?
This thing was 20 times more efficient than other open.
source AI models at the time. So essentially, let me describe it like this. Do you remember GBT40,
right? One of the best models, you know, about 14, 15 months ago. It was at the absolute frontier,
right? So now you can download Gemma 4 on a consumer laptop. And it has, you know, roughly,
you look at the scientific benchmarks and the ELO score. It's essentially about a GBT
4-0-level model that you can run on your laptop.
So what's the big deal?
What's the big difference, right?
14-15 months ago, I mean, there's thousands of companies spending millions of dollars a year to get that type of technology, to get GPT-40-level technology for their employees.
Now, doesn't they take anything, really?
It takes a new-ish piece of Apple, right?
I just got a new MacBook Pro, that thing can run Gemma 4 very easily, right?
It can run even better models than that.
And this really changes.
I think what is ultimately capable when you look at the open source versus close
source because, yes, I think most people look at normal usage and they're comparing
apples to apples, right?
Here's what our marketing team did 15 months ago with a GPT4-0 level model.
model, oh, now they can do that on Gemma 4.
Well, yeah, you can't do it, but now you can do it agentically because not only in the
last year or so have the models obviously improved with now thinking models, reasoning
models being the default, but now we have these agentic harnesses, you know, not just
the ones that you can use, you know, inside of chat, GPT, Gemini, Claude co-pilot, but, well,
you have these local autonomous AI systems as well, such as OpenClaw, such as, I always forget
if it's Hermes or Hermes agent, right?
So now you can have essentially the level of AI from 14 months ago running for free 24-7
agentically, even if you're just doing it, you know, summarization, content creation, research,
things like that. So when capabilities went local, right, Gemma Ford leading the way,
but obviously all the Chinese models followed soup because of, right, distillation,
which we'll talk about a little bit here in a couple of minutes. But you can't overlook
Gemma because it put frontier capability on literally a laptop, right? Because two years ago,
to be able to run something like a GPD 4-0 level model, right,
which rumors have been swirling that it's a $2 trillion parameter model, right?
You would need a small little data center to run something like that,
you know, two-ish years ago.
Now you have these capabilities.
So, you know, I've been lucky to talk to a lot of smart people in AI.
And now you really have executives grappling with, well,
should we be buying a bunch of, as an example, new MacBooks?
Should we be, you know, buying a bunch of DGX sparks for our employees and setting them up with 24-7,
always on agentic AI, right, to take advantage of these now local and powerful models that,
well, you don't pay, right?
You download them once, you don't pay again.
And they work and they can work while you sleep, like I said, because of some of the new
autonomous capabilities from local agents that can run around the clock.
So this has obviously led to, and I think Google putting the pressure on the open source world
with Gemma 4, like I said, it was 20 times more efficient in terms of what it was able to
achieve on the benchmarks in terms of size, right?
Because when it came out, if you looked at the other Chinese models, it was about 10 to 20 times
smaller in size, right?
So you wouldn't have been able to, you know, use the best open source model pre-GEMA 4 on a
local machine, right, at least a consumer laptop that you can just go walk into the store
and buy.
Now you can't.
And open Chinese models are amazing.
And I think they've been getting better and better and smaller and smaller and more and more
efficient since Google's Gemma 4, but you have to talk about the elephant in the room.
That is, these models are distilled, right?
We can say that all the big labs have said that, you know, are, I don't know,
maybe some of our audience in China won't appreciate hearing that.
But, I mean, Google, Anthropic, Open AI have all accused China and have said they have proof,
right?
But the White House.
So in April, the White House actually officially said that China was using, you know,
of illegal tactics to distill U.S.A.I models to create cheaper domestic knockoffs.
So it got to the point that at least the White House said that they had enough information
or intel to make that declaration. So what is model distillation and, well, why does it
matter? So the easiest way is like I can spend 10 hours studying for a test, right?
think back in the classroom.
I can spend 10 hours sitting for a test.
Someone behind me can look over my shoulder and spend 10 minutes and get the exact same
answers.
That's kind of like what model distillation is, right?
You have the big AI companies here in the U.S.
spending billions of dollars, right, on any single new, you know, model pre-training as an
example.
And essentially, you have certain actors in China.
who will use the API and, you know, different companies have come out with different levels
of proof and say, okay, well, they're creating, you know, thousands of spoof accounts,
more or less.
They're putting in all these inputs and training it on our model's outputs versus training
it themselves.
So, yeah, just kind of copying the homework.
So what this has led to is China has been able to put out these open source models,
really technically just pushing the frontier.
of open source by allegedly just copying the best U.S. models out there.
And what this has led to is, well, it's a crashing out at the bottom price of intelligence.
So, DeepSeek v4 as an example, Deepseek, one of those companies that many of the AI labs here in the U.S.
have accused of model distillation.
Deepseek V4 Pro, one of their newer models, now lists their price at 43 cents per million token inputs
and 87 cents per million token outputs.
That's like more than 25 times cheaper
than the premium, you know,
closed source proprietary models.
And that is the reality that a lot of boardrooms
are looking at right now, right?
To make that math easy, it's like, okay,
if we're spending $1,000 per month per employee
on the API side, right?
If you're sorry, if you're spending,
let's to say, $40,000,
a year, okay, we can be spending $1,000 a year if we switch over to an open source model as an example.
So here's what that actual leads, what that actually leads to, right?
Kind of the model distillation leads to more powerful, cheaper, open source models from China.
And, well, it leads to people using them, but not always knowing the ramifications.
Right. So obviously, Google doing things the right way. But I think with these Chinese models,
they've become increasingly popular, even in the enterprise, which is tricky. And I don't think that
most executives are fully understanding some of the consequences of using open source models.
But this has led to essentially having a workforce of always on assistance. And they've shipped
from expensive special projects to, well, that's just now the default operating model.
So, you know, this has just allowed kind of this new swarm of agentic AI that couldn't have
really have existed before. Number one, the technology and the harnessing wasn't there.
But number two, you take out, you know, at least Gemma and the Chinese models that have been
accuse of distillation.
And your, your options, aside from those, aren't really that good.
All right.
We're going to talk more here after we take a quick break for a word from our partners.
Adobe just introduced an entirely new way to create, bringing the power and precision of
its creative suite into one conversational experience.
Meet Firefly AI assistant now live in the Adobe Firefly app, the all in one creative
AI Studio. Powered by Adobe's creative agent, Firefly AI assistant lets you start with your vision,
just describe what you want, and shape the outcome as it takes form with the assistant.
The assistant orchestrates multi-step workflows, drawing on 60 plus pro-grade tools across
Adobe Creative Cloud apps, including Photoshop, Illustrator, Premiere, Lightroom Express, and
more to help bring your ideas to life. You can also get started with creative skills, a growing
library of pre-built workflows for common creative tasks like batch editing photos, creating mood boards,
portrait retouching, and creating social variations. Every step the assistant takes is visible so you can
refine, redirect, or take over at any time. You stay in the driver's seat as the creative director.
Adobe Firefly AI assistant now in public beta. See it today at firefly.adobie.com. Aside from
Always on AI agents, what this open source movement has led to is, well, now enterprises
maybe moving away from having the one model fits all solution.
So now, as an example, you might be able to put out an 100 agent swarm goes from, you know,
$1,200 plus on Opus to, well, maybe like $60 some dollars on Deep Seek.
And now essentially you can look at AI as more of a triage or a categorization of which models to use for which tasks, right?
Especially when you're talking about high volume operations.
So things like when you're going through it in bulk, things like summarization, extraction, parsing PDFs, classification, right?
Now, so many even large enterprise companies are no longer doing that on the back end using the frontier U.S. companies.
Well, I mean, many still are, but you've already seen a big segment of those companies move to these open source or Chinese open source models.
But if you're thinking right now, if you're like, wow, our bill is pretty high, our API bill, right?
I'm not talking about on the front end, you know, the number of seats you have in chat,
GPT Enterprise or, you know, in Gemini Enterprise or anything like that, right?
I'm talking about back end, all of these special projects that you have running via the API.
So if you're looking at your API building, you're like, yeah, we're going through a lot.
Or, you know, hey, we're using, you know, Opus 4-7 and GPD-5 to run our agents.
Maybe we should be looking at, you know, Kimmy or Deepseek or whatever it is.
Before you do that, you have to know that there is a big tradeoff.
Because just because a model is free or open source or cheapish to run via the API, right,
if you are running some of these open models via the API,
there's still an expensive price to pay.
And that price might be unknown at this point.
but it can cost your company a lot more than maybe just using that closed proprietary AI
would have cost you via the API.
That's because using open source strips away all of that legal protection that you
probably overlook or take for granted.
What do I mean?
Well, when you're using Anthropic, Open AI, Microsoft,
who did I forget?
Microsoft Open AI, Google Anthropic, right?
When you're using those enterprise offerings, you have a level of legal protection, right?
So as an example, if you use, right, I'm not going to go through all the fine prints, right?
But the four companies at the enterprise level all offer, you know, some sort of essential,
I won't call it insurance, right?
But think of it kind of like that, right?
Like, hey, if you use something produced by our systems and if you use it ethically and responsibly
and with guardrails and it produces something that's not.
you know, correct. There is some level of protection there, right, which you don't get that with
open source models. Right. So as an example, you know, deep seek, you know, they used different
MIT licenses Apache 2.0. Yeah. Essentially, there's no warranty or non-infringement agreements.
All right. So for regulated work and customer facing output, you have to look at the tradeoff.
yeah, you might save six, seven, who knows, maybe eight figures by switching the bulk of some of your
maybe agentic or bulk workloads.
You write, especially if you're a fortune, Fortune 500, Fortune 100 company.
There's minimum seven, eight figures that you could, in theory, save by switching some of those
heavier agentic or, you know, parsing, you know, I know, I know, parsing is a big one,
shifting some of those workflows to open models.
But you lose that legal protection that maybe you've had to rely on it before.
Maybe you have it.
But that one time that you would actually need it.
And if you do switch over to open source, you have to understand those ramifications
because at that point, you're going to actually be paying for it.
So that gets us to the real question here as we get close to rapid.
up because I don't want my takeaway here to be don't use open models.
They're not safe because that's not the takeaway.
I think you need to start looking at your AI workflow like a triage, right?
At least when it comes to back end tasks, right?
Front end, I've always been a firm believer and I still am today.
You need to pick your AI operating system of choice, whether that's co-pilot,
But Chad GPT, Claude Gemini on the front end.
And that's where you should move, especially your non-technical people, should move the majority
of their day-to-day knowledge work tasks should be happening on the front end there.
But you still have a multitude of back-end tasks.
And I think you have to look at it like triaging in an emergency room, right?
You wouldn't send your top neurosurgeon in when someone's having an alert
allergic reaction to honey, right?
You wouldn't do that.
You would save that neurosurgeon for, well, someone that needs a neurosurgeon.
And I think that there's so many companies that haven't gone through the basics of this.
For the most part, on the API side, they pick, well, one model.
And they say, all right, well, we have our AIA operating system of choice.
And then for everything else, as an example, we,
go to Sonnet 4-6 or we go to, you know, Gemini 3-1 Flash or whatever that model may be.
And maybe that's the right model.
Maybe those companies have done their due diligence and have betted out their different use cases and have priced it out.
And maybe that's the right move.
But maybe it's not because I know from experience and talking to a lot of people, a lot of companies just choose whatever is on the cutting edge.
And they say, well, this is the best.
So we're going to pay for it because there is a push internally to use more AI, to use the best
AI.
We see all these new benchmarks.
We want to make sure that we're taking advantage of it.
Well, is that neurosurgeon going to be able to, you know, properly diagnose the allergic
reaction to someone eating honey?
Well, yeah, probably.
But it's going to cost you a lot more.
So you need to think about sending those high volume, low stakes work, right?
like summarization, research, content creation, maybe to cheaper open source models that you can
either run locally or, you know, running via the API for just cost efficiency.
If there's essentially like no legal ramifications if you get something wrong, right?
So if you're in a highly regulated sector, this is probably not the advice for you, right?
You shouldn't probably be using, you know, or just taking my advice on a whole lot of anything as
truth, you always need to be vetting these things out for yourself.
Right.
But if it is something relatively in a sector that's not highly regulated, where there's not a
quote unquote, a lot on the line, that's one of those instances where you need to say,
can we shift some of our more expensive API workloads to an open source model?
Or if you need to run sensitive private workflows on self-hosted open models, that's
another thing.
I think that there's still, even to this day, even though.
though I think there's plenty of reasons.
One thing I always ask companies when they're like, oh, we don't, well, we don't run this
through AI, right, because it's sensitive data.
And I'm like, okay, well, do you have a cloud provider?
And they're like, of course.
It's like, okay, well, it's the same thing, more or less, right?
As long as you take proper precautions, turn off model training and all that, it's, it's more
or less using the same level grade of security that, you know, cloud uses.
Anyways, there are still some things that companies won't even put on the cloud, right?
which I understand.
But having these now extremely powerful open source models and extremely efficient open source models,
now you can start running those private workloads or workflows on-prem, right?
Or self-hosted that you can fully control.
And then you can reserve those more premium, those more high value, highly sensitive tasks.
you know, that for those models that can reason and think and offer kind of that,
that level of security and legal support that you don't get if you opt for open models instead.
So, you know, have a nice little chart here.
So maybe when you look at the cheap open APIs, you look at simple tasks like
summarization, extraction, or classification for local self-hosted open
models, private workflows, great for that, running agents locally, having more control,
right?
And then for the premium closed models, which are the ones that a lot of people are using on
the front end, on the back end, you should still be using these for a lot of reasons,
right?
Those that, well, carry a lot of business value, hard tasks that require reasoning, right?
Your final review, maybe you do, you know, draft version either with a cheap API,
or local self-hosted open model,
but or anything, you know,
that requires customer-facing output
should probably be going on that premium closed models
for that level of protection.
Like I said, you cannot overlook the hidden trade-off
that these open licenses may disclaim warranty
and non-infringement,
where the enterprise offerings do usually include that IP indemnification.
So for regulated work, that protection,
in almost all cases, justifies the premium that you pay.
However, as we wrap up here, let me just quickly encapsulate all of this.
Local models aren't going anywhere.
All right.
And I actually think, especially as we officially welcome in the era of models that can improve
themselves and can create own versions.
you know, smaller versions of themselves, right?
All the big companies have essentially said, you know,
have hinted at RSI or, you know, the fact that our big models
make smaller versions of themselves.
I think that we're going to not only see a continued trend toward,
uh, local open source models.
I think we're going to start seeing a lot of smaller models, uh, for very specific use
cases.
It's something I've been, you know, predicting now for multiple years.
We've started to see it slowly.
I think it is going to pick up steam now that we're starting to get some hints of recursive self-improvement with these models.
So your company has to be paying attention because this is a trend that is not going away.
The open models are going to become more and more capable.
They're going to become faster.
They're going to become more efficient.
And the options are going to start to become even greater, right?
Not just great general purpose, open models that can run on consumer hardware,
like Gemma 4, but small open models for very specific tasks that can be highly valuable for your
company.
So you have to understand the pros and the cons of these local models, when you might use a cheap API
and how this changes the agentic outlook for your company.
So don't write them off just because you always want to use the latest and the greatest.
Yes, you should do that.
But don't send the neurosurgeon to.
you know, triage a basic thing happening in the waiting room.
Send the right model at the right time for the right purpose.
So I hope this was helpful as we recapped open source AI 101 as part of our Start Here series.
If this was helpful, number one, make sure you subscribe to the podcast.
I'd appreciate that.
But then make sure you go to start here series.com.
That's going to give you free access to our exclusive Inner Circle community.
Right now, there's no other way to join except by going to start here.
series.com. So make sure you do that. Thank you for tuning in. I hope to see you back tomorrow and
every day for more Everyday AI. Thanks y'all. And that's a wrap for today's edition of Everyday
AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps
keep us going. For a little more AI magic, visit Your EverydayAI.com and sign up to our daily
newsletter so you don't get left behind. Go break some barriers and we'll see you next time.
