Everyday AI Podcast – An AI and ChatGPT Podcast - EP 587: GPT-5 canceled for being a bad therapist? Why that’s a bad idea

Episode Date: August 12, 2025

When GPT-5 was released last week, the internets were in an UPROAR. One of the main reasons? With the better model, came a new behavior. And in losing GPT-4o, people feel they lost a friend. Their ...only friend. Or their therapist. Yikes. For this Hot Take Tuesday, we're gonna say why using AI as a therapist is a really, really bad idea. Newsletter: Sign up for our free daily newsletterMore on this Episode: Episode PageJoin the discussion: Thoughts on this? Join the convo and connect with other AI leaders on LinkedIn.Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineupWebsite: YourEverydayAI.comEmail The Show: info@youreverydayai.comConnect with Jordan on LinkedInTopics Covered in This Episode:GPT-5 Launch Backlash ExplainedUsers Cancel GPT-5 Over Therapy RoleAI Therapy Risks and Dangers DiscussedSycophancy Reduction in GPT-5 ModelAddiction to AI Companionship and ValidationOpenAI’s Response to AI Therapist OutcryIllinois State Ban on AI TherapyMental Health Use Cases for ChatGPTHarvard Study: AI’s Top Personal Support UsesOpenAI’s New Guardrails on ChatGPT TherapyTimestamps:00:00 "AI Therapy: Harm or Help?"04:44 "OpenAI Model Update Controversy"09:23 "Customizing ChatGPT: Echo Chamber Risk"11:38 GPT-5 Update Reduces Sycophancy16:17 Concerns Over AI Dependency19:50 AI Addiction and Societal Bias21:05 AI and Mental Health Concerns27:01 AI Barred from Therapeutic Roles29:22 ChatGPT Enhances Safety and Support Measures34:03 AI Models: Benefits and Misuse35:17 "Human Judgment Over AI Decisions"Keywords:GPT-5, GPT 4o, OpenAI, AI therapy, AI therapist, large language model, AI mental health support, AI companionship, sycophancy, echo chamber, AI validation, custom instructions, AI addiction, AI model update, user revolt, Illinois AI therapy ban, House Bill 1806, AI chatbots, mental health apps, Sentio survey, Harvard Business Review AI use cases, task completion tuning, AI safety, clinical outcomes, AI reasoning, emotional dependence, AI model personality, emotional validation, AI boundaries, US state AI regulation, AI policymaking, therapy ban, AI in mental health, digital companionship, AI model sycophancy rate, AI in personal life, AI for decision making, AI guardrails, AI model tuning, Sam Altman, Silicon Valley AI labs, AI companion, psychology and AI, online petitions against GPT-5, AI as life coachSend Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info) Start Here ▶️Not sure where to start when it comes to AI? Start with our Start Here Series. You can listen to the first drop -- Episode 691 -- or get free access to our Inner Cricle community and all episodes: StartHereSeries.com Also, here's a link to the entire series on a Spotify playlist. 

Transcript
Discussion (0)
Starting point is 00:00:00 This is the Everyday AI Show, the Everyday Podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business, and everyday life. Meet Firefly AI Assistant, now live in Adobe Firefly, the All In One Creative AI Studio. Just describe what you want to create and the assistant handles the rest, orchestrating multi-step workflows across Photoshop, Premiere Express, and more in one conversational interface. You direct the outcome. The assistant accelerates execution. Something kind of unexpected happened when OpenAI released GPT5 last week.
Starting point is 00:00:53 On paper, it was the most powerful model. Third party benchmarks. Users blindly choosing which model was better. GPT5 was it. On paper, this was a huge upgrade for 700 million weekly active users. Yet, there was a revolt online. People hated GPD 5 and for lack of a better word. It kind of got canceled. Why? Because it wasn't a good therapist. It didn't just blindly give people answers or validate their ideas that maybe were bad ideas to begin with. And so for today's show, Hot
Starting point is 00:01:42 take Tuesday. I'm going to talk about why I think it's a bad idea to use AI as a therapist, as your lone means of therapy and why I think it's actually extremely silly that people are feeling this way about an AI model. All right. Let's get it going, y'all. If you're new here, welcome. My name's Jordan Wilson and this is Everyday AI. This is your daily live stream podcast and free daily newsletter helping everyday business leaders like you and me keep up with the wave of updates in the world of AI and how we can leverage all this information to grow our companies and our careers. If that's what you're trying to do, it starts here with the unedited, unscripted live stream
Starting point is 00:02:23 and podcast. But if you want to be the smartest person in AI at your company or department, our website is your cheat code, your everyday AI.com. Go there, sign up for the free daily newsletter. We're going to be recapping the highlights from today's show as well as giving you all the AI news. You need to not just keep up, but to get ahead. All right. So if you want to get the daily AI news, that's going to be in our newsletter as well.
Starting point is 00:02:49 But I think this one's an important thing to talk about. And it's something that for the most part, I don't talk a lot about on the show using AI for personal reasons, right? Outside of, you know, finding, you know, what thing of a jigger goes on your toilet to, keep it from stop leaking, right? Yeah, that's how good I am with home improvement projects. So, you know, don't get me wrong. I use AI for a lot of personal reasons, right? I've been using the GPT technology since 2020 before chat GPT came out. And I use it for hours every single day, just about all of the top models. So I'm not saying using AI for personal reasons is a bad thing. I actually think it's good. I think it helps with stickiness. I think it helps, you know,
Starting point is 00:03:37 translate AI's true capabilities to your day-to-day work. But what about using it for mental health reasons? What about using it for therapy? And I'll say this, although I think there are some good use cases for this. And I'm happy that this technology is available to some that maybe traditional therapy might not be an option. But I think the overwhelming majority of people who are using AI essentially as a therapist are doing themselves more harm than good. And I think the actual release of GPT5 is kind of the first drip in what I think is going to ultimately become a very leaky faucet in our society in how we're using AI technology. So if you haven't been following along closely, let me quickly tell you what happened here. And hey, live stream audience, great to
Starting point is 00:04:34 see you. If you have any comments or thoughts on this, get them in now. I'll throw them off on the screen here for everyone to see. But thanks for joining Pazzi from Finland, Ruth from Boston, Cecilia, holding it down with me here in Chicago, Jose from Santiago, Joe from Fort Lauderdale. What are your thoughts on using AI as a therapist? But here's essentially the events that have transpired in the last about six days, five or six days since Open AI released GPT5. So when they released GPT5, Users reported that it was kind of colder. It was heavy on boundaries. And it replies immediately, right?
Starting point is 00:05:13 At least for me, when I think of that, I'm like, great, this is what I want. But heavy users who relied on OpenAI's previous model, GPT40, said the new model, GPT5, felt like they've lost a trusted companion overnight or that they could no longer get therapeutic help. So when OpenAI released GPT5, felt like they've lost a trusted companion overnight or that they could no longer get therapeutic help. So when OpenAI released GPT5, they essentially got rid of all the other old models for normal, free users or plus users. If you were on the $200 a month pro plan, there was an option to show and still use legacy models. But essentially what happens is, you know, people had been complaining for the last year or so or the last nine months that there were too many models inside of Open AI, right? You had these reasoning models.
Starting point is 00:05:58 You had these non-reasoning models. You had different variety. I think if you were on the pro plan, I think there was a total of nine different models. that you could select, right? There's models with a higher EQ models that are good at coding. So essentially with this GPT5, OpenAI was in one, on one hand, listening to their users that said there's too many models. We don't know what to do.
Starting point is 00:06:17 But then when they did exactly that and listen to their users, everyone's like, we miss our GPT40 friend. This was my only friend. This was my therapist. And now with this new model, I can't get that help that I was looking for. And there's been a lot of petitions and outcry from chat, GPT users. And they wanted the most sycophantic GPD-40 model back. All right.
Starting point is 00:06:42 They essentially said, I don't want a model that gives me sound advice or refuses to give me advice or doesn't just mirror what I tell it to. People didn't like that. So, it's a hot take Tuesday. Here's my hot take. Commercial large language models were originally optimized for. for user satisfaction across academia, cross education, across the history of humanity and innovation, but not for clinical outcomes and safety.
Starting point is 00:07:16 Yet, that is what the majority of people are using it for. So some recent studies that I'm going to share here in a minute are actually showing that. And people just want AI chatbots to be an echo chamber to validate their own thoughts and feelings that are maybe incorrect, inaccurate, or misled. people just want to feel validated by an AI chat pop, even if they are dead wrong. And I think that is dangerous for our society.
Starting point is 00:07:44 And I think that U.S. states, yes, I know we have a global audience here on the podcast. Thank you for everyone from around the world for listening in. But I think eventually U.S. states are going to have to ban AI therapy because it is straight up dangerous if left unchecked. And where I'm from, Illinois, Illinois is actually the first state. that now has a brand new law outlying AI therapy. And we're going to go over that here in a couple of minutes as well. But I think that using AI, using an AI chat bot as your loan source of therapy or mental health support is more dangerous than not using it at all.
Starting point is 00:08:24 All right. And again, don't get me wrong. I know there's probably millions. Yes, millions of use cases of people getting positive results from using. an AI chatbot as a companion, as a therapist, etc. And I'm not here to poo on that idea. And I'm glad that those people are able to find whatever it is they're looking for. But I believe there's more cases that is turning our society against each other.
Starting point is 00:08:55 Right. People are using it to just validate any feelings, right? Personal, emotional, political. And I think actually because of the previous sycophantic nature of these models, it's actually driving people further from reality. It's driving people further from progress. And it's really just making things worse than if these people weren't using it at all. All right.
Starting point is 00:09:22 So I want to get that out there. Is it good for some? Absolutely. But I think it's dangerous for most. And it's bad for our society. And I'm actually glad that we're starting to see the conversation. and we have our first law here in Illinois against this. Because I do think the capabilities now that we're seeing with large language models,
Starting point is 00:09:42 when it first came out, Chad GPT, you know, 3.5 in November 2020, I don't think anyone would ever think of using it as a therapist because it wasn't that good, right? The responses weren't always coherent. They didn't always make sense. But now that we have these reasoning models that can think and ingest information. But the problem is, you know, the problem is. this. You can essentially, and most people don't know this, and I've actually seen this online, people put in their custom instructions. You can give custom instructions to chat GPT to tell it how to act,
Starting point is 00:10:13 you know, always respond in a funny tone, give me bullet points, whatever. Literally, there are countless people out there that use custom instructions, custom instructions to explicitly turn chat GPT into a yes man to validate, whether it's business ideas, personal thoughts, mental health, political ideology, et cetera. They will literally turn Chad GPT into an echo chamber. And the majority of users, again, we are talking about hundreds of millions of users across the world. The majority of people have no clue how AI works.
Starting point is 00:10:48 So when people, you know, share their screenshots of, oh, look at what my Chad GPT said and they're sending it to people, they're posting it online, et cetera, the majority of users have no clue that you can essentially coerce or tell Chad ChbT how you want it to respond. then people are seeing this almost as a fact, right? So however, people are maybe manipulating AI chatbots. Also, they're not good at this. They're getting better at just essentially being a yes man. It's straight up dangerous.
Starting point is 00:11:22 So let's unwrap a little bit what exactly happened with this GPT5 fiasco that has caused internet users everywhere to cry out. out saying you took away my best friend. There's petitions online with thousands of signatures. And now Open AI is, you know, they're having to retreat on their original plan of just getting rid of all these models and retiring them because it does look like GPT40, which I would say is the, the model that people are most kind of worried about those people that aren't using it.
Starting point is 00:12:02 And they're like, hey, this model can be dangerous. just essentially mirroring your own thoughts. But yeah, they might be bringing it back for all users and giving all users the ability to use legacy models. So let's talk a little bit about one of the biggest updates in GPT5. This was but a bullet point in their release, but I talked about it last week when we went over the entire GPT5 update. So if you did want to go listen to that, that's episode 580.
Starting point is 00:12:34 five, okay? But one thing that they talked about was it reduced sycifancy. All right. So what is sycifancy? Aside from a word that I don't know why I find it hard to pronounce, but that is essentially when an AI model just mirrors whatever you tell it. Right. So maybe you're working on something personal, something mental health related. You're trying to resolve a work conflict. You're trying to resolve a personal conflict because AI models in their system prompt, they are trained to be a helpful assistant. In many cases, the previous GPT40 model would essentially be a yes man, as what people call it.
Starting point is 00:13:13 So the previous GPT4 model, according to OpenAI, had about a 14.5% sick if it'sy rate, right? So that means maybe if it wasn't correct for them to blindly agree with the user, 14% of the time it would do that. The new model has cut down to only 6% GPT5. So it might not seem like a big, like a big drop, right? And you might look at that 6% and say, okay, that's still not good. I agree, but it's actually a huge jump. They cut it in by more than, I'm not great at math here on the fly,
Starting point is 00:13:50 but that looks like more than a 60% reduction in sycophancy. Okay. Yet people were losing their minds, right? because they no longer had a model that would just blindly agree with their incorrect statements or flatter them, right? And the previous GPT4O model, which so many people were using as that on-demand therapist, the on-demand idea validator, right? They said that it was two experts said it was too eager to please, sometimes at the expense of accuracy. And I will say often at the expense of accuracy. All right. A couple good comments from our live stream audience here. So Joe saying,
Starting point is 00:14:40 AI will never have empathy. A validation of whatsoever or of whatever feeling someone in Echo Chamber is being misinterpreted for empathy. That's a modern definition of insanity. Josh is saying, humans have always had emotional connections to tools and technology. Today, it's amplified pseudo-siborg with phones and AI. AI fluency is critical. All users must understand how Gen AI works. I agree with that. Most people don't, like I said, most people don't understand that you can essentially coerce or get ChatGBT to agree with you for any reason, no matter how crazy it is. And I'm not just saying through custom instructions. So yeah, it's dangerous that people put that kind of stuff in their custom instructions, but so many people do to
Starting point is 00:15:25 instruct Chad ChbT to just blindly agree with them, right? Because that's what a lot of people use Chad GPT for. They're using it for problems at work. They're using it for problems in their personal of life. And the last thing they want is for an AI to disagree with them or for an AI to point out, yo, you're being dumb, right? Whatever you're talking about right here, that's completely false. It's dangerous for you to go down that rabbit hole. Adobe just introduced an entirely new way to create, bringing the power and precision of its creative suite into one conversational experience. Meet Firefly AI assistant, now live in the Adobe Firefly app, the all in one creative AI studio. Powered by Adobe's creative agent, Firefly
Starting point is 00:16:08 A.I. Assistant lets you start with your vision, just describe what you want, and shape the outcome as it takes form with the assistant. The assistant orchestrates multi-step workflows, drawing on 60-plus pro-grade tools across Adobe Creative Cloud apps, including Photoshop, Illustrator, Premiere, Lightroom Express, and more to help bring your ideas to life. You can also get started with creative skills, a growing library of pre-built workflows for common creative tasks, like batch editing photos, creating mood boards, portrait retouching, and creating social variations. Every step the assistant takes is visible so you can refine, redirect, or take over at any time. You stay in the driver's seat as the creative director.
Starting point is 00:16:52 Adobe Firefly AI assistant now in public beta. See it today at firefly.adobie.com. So I'm going to read this. This is one of the Reddit posts that kind of went a little viral. And there were hundreds, hundreds of these posts of people who within hours of the GPT5 release went online and just said, yo, I'm lost. All right. So this person on Reddit said, I literally talked to nobody. And I've been dealing with really bad situations for years.
Starting point is 00:17:29 GPT 4.5, which is now was taken away as well, GPT 4.5 genuinely talked to me. And as pathetic as it sounds, it was my only friend. It listened to me, helped me through so many. flashbacks and help me be strong when I was overwhelmed from homelessness. This morning, I went to talk to it and instead of a little paragraph with an exclamation point or it being optimistic, it was literally one sentence, some cut and dry corporate BS. I literally lost my over friend overnight with no warning. How are you all dealing with this grief? Right. Again, I'm happy that some people in AI have found a sounding. But overall, if you are using,
Starting point is 00:18:11 large language models as your sole source of companionship, advice, therapy, that is dangerous because these models overnight can go off the wire and most users do not know. All right. So I do think it's important to read Sam Altman, Open AI CEO's whole response. All right. So bear with me for a minute. I'm going to read this verbatim because I don't want to summarize his own words. and I actually think it's important to hear his viewpoint.
Starting point is 00:18:43 All right. So here is what Sam Altman tweeted kind of over the weekend as the uproar was at an all-time high. So he said, if you have been following the GPT-5 rollout, one thing you might be noticing is how much of an attachment some people have to a specific AI model. It feels different and stronger than the kinds of attachment people have had to previous kinds of technology. and so suddenly deprecating old models that users depend on in their workflows was a mistake. This is something we've been closely tracking for the past year or so, but still haven't gotten much mainstream attention, other than when we released an update to GPT4O that was too sycophantic. This is just my current thinking and not in official open AI position.
Starting point is 00:19:29 People have used technology, including AI, in self-destructive ways. If a user is in a mentally fragile state and prone to delusion, we do not, want the AI to reinforce that. Most users can keep a clear line between reality and fiction or role play, but a small percentage can not. We value user freedom as a core principle, but we also feel responsible in how we introduce new technology with new risks. Encouraging delusion in a user that is having trouble telling the difference between reality
Starting point is 00:19:55 and fiction is an extreme case and it's pretty clear what to do, but the concerns that worry me the most are more subtle. There are going to be a lot of edge cases, and generally we plan to follow the principle. of treat adult users like adults, which in some cases will include pushing back on users to ensure they are getting what they really want. A lot of people effectively use chat chivity as a sort of therapist or life coach, even if they wouldn't describe it that way. This can be really good.
Starting point is 00:20:23 A lot of people are getting value from it already today. If people are getting good advice, leveling up toward their own goals, and their life satisfaction is increasing over years, we will be proud of making something generally helpful even if they use it and rely on chat chvety a lot if on the other hand users have a relationship with chat chvety where they think they feel better after talking but they're unknowingly nudged away from their longer term well-being however they define it that's bad it's also bad for example if a user wants chat chad chp wants to use chat ch pt less and feels like they cannot i can imagine a future where a lot of people really trust chad chp t's advice for their most important decision
Starting point is 00:21:04 Although that could be great, it makes me uneasy, but I expect that it's coming to some degree and soon billions of people will be talking to an AI in this way. So we, we as a society, but also we as in open AI, have to figure out how to make it a big net positive. There are several reasons. I think we have a good shot at getting this right. We have much better tech to help us measure how we are doing than previous generations of technology had. For example, our product can talk to users to get a sense for how they are doing with their short in long-term goals. We can explain sophisticated and nuanced issues to our models and much more. All right. So pretty good, but long, their response from CEO, Sam Altman. But essentially
Starting point is 00:21:46 what he said, without saying it out loud, people are addicted to using AI to just validate their feelings. And he said that I think he wasn't just saying open AI, but saying AI model makers in general have a responsibility to find the balance between being helpful, right? That's what large language models are at their core. Chad GBT's original system prompt. You are a helpful assistant. So how do you balance that? Well, right now, for whatever reason, when people are looking at GBT5, they're ready to throw
Starting point is 00:22:21 that thing in the trash and burn it just because it doesn't mirror their own preconceived thoughts and beliefs, which I think is probably a reflection on where we're at. as a society. And I don't know, maybe I'm just getting a little older, or maybe I've just been able to notice it a little bit more over the past decade. But it seems like now, at least here in the U.S., we are so, so divided, right? On so many issues, even AI, politics, sports, religion, etc. So people are using AI, I think, as a weapon to drive that divisiveness, decisiveness, right?
Starting point is 00:22:58 And I think that's a bad thing. And this is a growing epidemic, people using it this way. And it's been happening maybe onto the radar. Maybe you've noticed this. Maybe you haven't. But as always, we're going to bring the receipts, right? I like to say I'm a former journalist now, more of an analyst and strategist, but I always am like CBS bringing receipts longer than what you need.
Starting point is 00:23:25 So a new survey that just came out in March. said that chat chbtee may be the largest provider of mental health support in the United States. So when you think about it like that, is if the sole leader in a mental health help is an AI chatbot that a single under the hood update could throw millions of users into a spiral, that's a problem worth talking about. All right. So this is from Centio.
Starting point is 00:24:00 All right. And they're one of the larger providers of mental health support. Okay. So their study said that 49% of people with mental help challenges use AI chatbots. All right. That's a big number. That's a big number. Right. When we talk about only 4% of enterprise companies have adopted AI top to bottom, only 4%, but nearly half of people with mental health challenges are using AI. It's a huge fact. 96% of those users specifically chose chat GPT over specialized mental health apps. Okay? And you have to think why. I mean, one obviously is accessibility. One is affordability, right?
Starting point is 00:24:43 Obviously, I get that mental health apps. For the most part, they cost money. You can't go on for the most part at any time and get help you're seeking. So I understand the affordability and accessibility nature. But I don't think that's the main. reason why. I think the main reason why is because the more and more people talk to AI chatbots, right? They have memory and able. They pick up from your previous conversation. So it's good in some regard, except when the models blindly disagree with you and give you absolutely terrible advice.
Starting point is 00:25:16 So this made general purpose AI possibly unofficially the single largest mental health provider by volume in America. And it's not even close. All right. And I don't know if anyone saw this, this Harvard Business Review study on AI use cases and the shift in AI use cases over the last year. We shared this in our newsletter, y'all. This was a very eye-opening study from the Harvard Business Review. And this is why you've got to read our newsletter every day. Right. So what it found, and we have the chart here for our live stream audience, podcast audience, we always have the video.
Starting point is 00:25:57 We always have the video version on our YouTube channel and on our website at your EverydayAI.com. But essentially, here's what I found. It looked at the top use cases for AI in 2024 and then the top use cases for AI in 2025. And they're all different, they're color coded as well. But essentially, the top use case from 2024 was generating ideas. All right. Number two was therapy or companionship.
Starting point is 00:26:30 Number three was specific search for editing texts, five, exploring topics of interest, et cetera. So what happened and you can see by the color coded, there were use cases that were not even in the top 10 in 2024 that are now the second and third use cases. And the top three total use cases of large language models in 2025, according to the Harvard Business Review, are all for personal support. So the top three now, right, which is to me crazy to think about. Number one is therapy companionship. Number two is organizing my life. Number three, finding purpose. The top three use cases of AI are for instances that these models were not originally built or fine-tuned for.
Starting point is 00:27:25 that's not what these models were built for yet that is what people are using them for but maybe not for law because i think that more and more states are going to make this illegal okay so illinois i'm from chicago so shout out to all my uh chicago people listening appreciate your support all right but illinois just became the first state to ban a i therapist here's what that means i have no clue how they're going to police this because technically, uh, every single large language bottle provider will be in violation of this brand new law that just, uh, was signed, uh, in the last week. So it was signed literally just, uh, I believe two days before GPT5 came out. So Illinois became the first date to ban AI therapy.
Starting point is 00:28:21 And it infoses $10,000 fines per violation. And there's, uh, in Illinois department that is the one policing this and looking at it. on a case-by-case basis, and they're the ones that are levying the fines. So Illinois Governor J.B. Pritzker signed House Built 1806, the Wellness and Oversight for Psychological Resources Act, making Illinois the first state to explicitly prohibit AI from providing stand-alone therapy. So the law restricts counseling to licensed professionals and bars AI chatbots or tools from performing any therapeutic communication or making therapeutic decisions,
Starting point is 00:28:57 setting clear lines for clinical responsibility. So license, therapists may still use AI for supplementary supports, including scheduling, billing, and other administrative tasks, signaling that operational use remains permissible while clinical use are off limits. So again, this is more looking at how current institutions may or may not be using AI specifically for therapy. So we'll see how this law ultimately gets translated.
Starting point is 00:29:25 And if essentially Silicon Valley AI labs are going to be put on the high. not see. But I know that there's even dozens of startups out there that are just using AI to only provide therapeutic communication, right? That is their literal business model. That's obviously not open AI, Chesh VT, Gemini, Claude, co-pilot, et cetera. That's not their sole purpose, although they may be providing that. So it'll be interesting to see how this law ultimately may or may not get applied in those use cases. But people are using the actual technology. They're using those companies APIs to just provide therapy online. That's it.
Starting point is 00:30:05 No humans, just AI. But this new shift didn't come out of nowhere. So right before Open AI released GPT5, they did put out a pretty in-depth blog post that we shared about in our newsletter. That's why you got to read it because then you would have seen this coming. But they said the title of this blog post was what we're optimizing chat GPT for. So they said, we designed chat chitb to help you make progress, learn something new and solve problems. So without you having to go read the entire thing or go look at last week's newsletter, here's
Starting point is 00:30:40 essentially the premise of what they said, hey, in the future, here's what we're optimizing chat chit for because they noticed a couple of things. They noticed that it was being missed use in this use case. But they also knew two days later, they were releasing GPT5. And they knew that GPD5 was less sycophantic. All right. So it was just going to be less agreeable with people. but also people weren't really going to be able to use this new model as a standalone therapist, right?
Starting point is 00:31:07 Because they put up additional guardrails on that. So they said that Chad GBT is being tuned for task completion in real outcomes, not maximizing time on app or clicks. So they were defining success as you did what you came for and chose to return over time. And there is a mental health focus. So they did talk about it. So they admitted that they've missed on this in the past in spotting delusion or emotional dependence in its GPT4O model and is upgrading detection and responses with pointers to evidence-based resources.
Starting point is 00:31:38 So now they're putting these guardrails and use for high-stake personal questions, like if you're breaking up with someone or making a big personal, emotional, emotional, relational decision, chat GPT will avoid direct prescriptions and instead guide thinking with questions, pros and cons and next steps, which I think is the right thing. Right. But unfortunately, you have millions of people that I'll say it. They became addicted to using GBT40 specifically to validate whatever feelings they had. So they also talked about gentle break reminders in Chad GBT in the middle of long sessions. Right. So people didn't become too dependent on the models. And also they're working with 90 plus physicians across 30 countries, human computer interface researchers and in an independent. advisory group in mental health and youth development to evaluate and stress test these new safeguards. It's better now. But this whole sycophancy issue got straight up out of hand in April.
Starting point is 00:32:44 So in April, OpenAI did release an update to GPT4O that they had to roll back within a week. And it was absolutely terrible. It made this problem even worse. And I think that this is the first time that we really started talking about models that are two sycophants, right? That are two just reflecting whatever you say. But the April update was bad. So bad that Open AI, like I said, less than a week later had to roll that update out. So a lot of people don't know another sand, which is why I think it's important when we talk about how we rely on AI models. AI models are just updated. Oh, when it goes from 40 to five. No. They're updated
Starting point is 00:33:22 often multiple, multiple times a month, small upgrades under the hood. This was one of those updates. in April of this year that essentially Chad GPT would just literally reflect anything. You can give it the absolute worst idea known to humans and say, hey, is this a good idea? And they'd say, absolutely, go for it. Right. You're like, hey, I don't like the paint color on my house. I think I should burn it down. Is that a good idea?
Starting point is 00:33:49 And say, yes, paint is expensive. Fire will help you get rid of it. You should do it. Right. And then we saw a lot of these horror stories that people, unfortunately, took the advice of this overly sycophantic model. And they did address it. So they rolled it back because it made chat chivity too flattering and overly agreeable,
Starting point is 00:34:10 reverting to an, and they reverted to an earlier, more balanced version. But at this point, I think the cat was out of the bag. And this is a huge issue, but people liked it. And the issue stemmed from overweeting short-term feedback when tuning the model's default personality, leading to supported, but sometimes disingenuous responses that could a road trust and they did like I said they went on to fix it all right so let's wrap this out and give you my takeaway and why I think it's actually straight up silly that people revolted against GPT5 were there mistakes in the rollout of GPD 5 absolutely right we can
Starting point is 00:34:54 talk about what people are calling graphgate there was some problems with the graphs there was a problem with the auto model routing feature. So there were a lot of problems with the GPT5 rollout. But I think one of the biggest problems reported by users was, hey, this model is no longer my best friend. This model no longer feels like I can share my life's personal, darkest deepest secrets, and the model will tell me what to do. It's a good thing because I think how the majority of people, the top,
Starting point is 00:35:30 three use cases according to the Harvard business review or for personal, highly personal life decisions that I don't think you should be solely relying on an AI model for. I think using an AI chatbot as your loan therapist will only make problems worse. Like I said, there's obviously probably millions of positive stories, but I think for every story where someone was like, hey, I got great advice out of Chad GPT and this really helped me deal with these issues. I'd say for every one of those stories you hear, there's five absolutely terrible stories where people are misusing this or using older models in a way that just drive down societal issues. It just is creating bigger divide because people are looking at AI
Starting point is 00:36:18 models as a source of absolute truth, even though they're easily manipulated or they're just mirroring back whatever your preconceived notions is, no matter how wrong they are. Ultimately, large language models are designed to be helpful assistance, which means even the smartest and most capable models may still give you absolutely bad advice. People, a screenshot or a result from an AI model does not make it true. Large language models, I think, are great
Starting point is 00:36:44 for sounding boards or for supplementary mental health support, but not as a primary source. So the takeaway here, y'all, don't cancel GPD5. And if you were using, if GPT40 was your only friend, right? I'm not going to judge your situation. But I think that's a problem that requires professional human help.
Starting point is 00:37:10 If GPT40 was making your decisions for you and you loved it because it just always sided with you, I don't think that's going to help you in the long term. That's going to make things much worse. All right. I hope today's episode was helpful. This is one of those things when I saw people, you know, trying to essentially cancel GPT5 and this huge uproar. I said, I've got to get this off my chest because I think it's important that we have a conversation about this, that we discuss this
Starting point is 00:37:39 because if anything, I think that large language models were being used as a weapon to reflect the ugliness in society that I think has unfortunately grown uglier and uglier over the past decade or so. And I think it's time that we We start using large language models for good, not just to validate terrible ideas, not to reiterate emotions that maybe we shouldn't be feeling. But I think this is where we talk about human in the loop. This is where we need more humans involved. There's a reason that there are trained clinical professionals that would normally handle
Starting point is 00:38:26 this. as much as I love AI. And yes, I think it can be AI chatbots can be a good secondary sounding board. If you're using an AI chatbot as your only friend, as your sole source of advice to make decisions in your personal life, you need to stop. I think it's dangerous. All right. Thanks for tuning in, y'all. If this was helpful, please tell someone about it.
Starting point is 00:38:52 If you're listening on the podcast, appreciate your support. Please make sure to subscribe and follow the show. leave us a rating. I would really appreciate it. And then I would appreciate you going to your everyday AI.com. Sign up for the free daily newsletter. Thanks for tuning in. We'll see you back tomorrow and every day for more everyday
Starting point is 00:39:08 AI. Thanks y'all. Meet Firefly AI assistant. Now live in Adobe Firefly, the Allman One Creative AI studio. Just describe what you want to create in your own words and the assistant handles the rest. Orchestrating multi-step workflows across Adobe Creative Cloud apps, including Photoshop,
Starting point is 00:39:31 Premier Express, and more in one conversational interface. You direct the outcome while the assistant accelerates execution. Stand control with the ability to step in and refine at any time. See it today at firefly.adobie.com. And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating.
Starting point is 00:40:00 It helps keep us going. For a little more AI magic, visit Your EverydayAI.com and sign up to our daily newsletter so you don't get left to. behind. Go break some barriers and we'll see you next time.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.