Everyday AI Podcast – An AI and ChatGPT Podcast - EP 546: AI Bias Exposed: Real-World Strategies to Keep LLMs Honest

Episode Date: June 13, 2025

AI is powerful. Buuuuuuuut also dangerously biased. Is your team ready to face this reality? Can you even spot when your AI is lying? We're talking real-world solutions with a bias-detection pro....Tune in or risk your AI becoming more fiction than fact.Newsletter: Sign up for our free daily newsletterMore on this Episode: Episode PageJoin the discussion: Ask Jordan and Anatoly questions on AI biasUpcoming Episodes: Check out the upcoming Everyday AI Livestream lineupWebsite: YourEverydayAI.comEmail The Show: info@youreverydayai.comConnect with Jordan on LinkedInTopics Covered in This Episode:1. Understanding Cognitive Bias2. Cognitive Bias in AI Models3. Training Data and Model Development4. Future of AI and Managing BiasTimestamps:02:00 Cognitive Bias Mitigation Platform08:50 AI Enthusiasm vs. Cautionary Tales12:48 AI Bias Stems from Human Bias16:14 Influence of System Prompts on Bias19:46 AI Information Parsing Challenges20:56 AI Training and Labeling Challenges24:05 "Achieve AI Success with Expertise"28:23 Bias and Diversity in AI Models31:33 Addressing Cognitive Bias in DataKeywords:Cognitive bias, AI failure, large language models, ChatGPT, Gemini, Copilot, Claude, bias reflection, AI news, AI sales tools, Microsoft, Salesforce, Microsoft 365 Copilot, Sales Agent, Sales Chat, Google, AI mode, Google One AI Premium, Gemini 2.0, OpenAI, AI agents, enterprise automation tools, confirmation bias, heuristic, framing bias, hallucination, training data, model perception, data labeling, reasoning models, agentic environments.Send Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info) Start Here ▶️Not sure where to start when it comes to AI? Start with our Start Here Series. You can listen to the first drop -- Episode 691 -- or get free access to our Inner Cricle community and all episodes: StartHereSeries.com Also, here's a link to the entire series on a Spotify playlist. 

Transcript
Discussion (0)
Starting point is 00:00:00 This is the Everyday AI Show, the everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business, and everyday life. Meet Firefly AI Assistant, now live in Adobe Firefly, the All In One Creative AI Studio. Just describe what you want to create and the assistant handles the rest, orchestrating multi-step workflows across Photoshop, Premiere Express, and more in one conversational interface. You direct the outcome. The assistant accelerates execution. Do you ever just blindly copy and paste what a large language model gives you?
Starting point is 00:00:52 Right? I get it. We're all overworked. We're stressed. There's so many things. You're, you know, your manager is demanding more now that you're using AI.
Starting point is 00:01:02 But that can actually be very dangerous, right? Just blindly trusting what a large language model like chat GPT or Gemini or co-pilot or Claude spits out. And one of the biggest reasons and I think a reason that sometimes AI fails is because of bias, right? Essentially, large language models are a reflection of the internet. They're a reflection of society and there's a lot of things wrong and sometimes these models aren't the absolute truth. Sometimes they're very flawed. So we're going to be talking about that more in-depth today as well as what you can do about it and how to keep an eye for different types of bias, biases, right? I guess it's how it said, that can show up in your large language
Starting point is 00:01:48 models. All right, I'm excited for today's conversation. I hope you are too. Welcome to Everyday AI. Maybe it's your first time here. If so, where you've been for the last three years? We do this every single day. My name is Jordan Wilson, and this is your daily live stream podcast and free daily newsletter, helping everyday people like you and me, not just learn AI, but how we can leverage it to grow our companies and to grow our careers. I want you to be the smartest person in AI in your department at your company. So if that's what you're trying to do, you're going to want to go to our website. That's your everyday AI.com. We're going to be recapping today's conversation as well as really recapping everything else you need in the world of AI. And we do that every single
Starting point is 00:02:29 day in our free daily newsletter. So if you want more insights from today's show, make sure you go sign up. Let's talk cognitive bias because I think so many people are just blindly following what comes out of a model, not even knowing some of the dangers that you might, that entails. So please help me welcome to the show. I'm excited for today's conversation. I hope you are too.
Starting point is 00:02:53 So we have with us, Anatoly Shilman, the CEO and co-founder of Codbius AI. Thank you so much for joining the Everyday AI show. Thanks, John, for having you. All right. I'm excited for this one, live stream audience. Thanks for tuning in. Big Bogey and Michelle and Marie and Jamie and
Starting point is 00:03:08 Vincent and everyone else. If you have questions, get them in now. But let's start at the top, Anatoly. So what is con bias? What is it that you all do? Well, we built a platform that detects and mitigates cognitive bias in communication. What started off is our own internal project to help us ask better questions during customer discovery is now turned into a full platform. We're able to take people's questions for customer discovery, marketing research, NPS scores, assessments, anything.
Starting point is 00:03:36 and give them a breakdown of the biases they may be facing within the questions they have and also on top of everything else we rephrase and give them better suggestions on how to do it better. The same now applies for their emails. So if you have that difficult email to write, say, got to break some bad news or an angry mail. You know how to say wait 24 hours to write an email. But our client, you can actually write that email. And our system, based on the actual context you give it, will rewrite it for you in a better way. and also tell you what was problematic about your original email.
Starting point is 00:04:08 And we found that a lot of folks such as salespeople, obviously marketing research, UXUI, product managers have been using our product. And it's funny, one of the things we've been discovering that people are constantly creating new methods of using it. One of the things that's coming out very soon, as you mentioned, AI agents, is that we're actually able to audit AI agent conversations and detect the biases that they have and make reports for companies to make the changes necessary to make them better. So I want to kind of skip to the end here, and this is kind of how I started off the show, right? Because I think so many people just blindly either copy and paste what comes out of a large language model,
Starting point is 00:04:51 or they just inherently trust it as being accurate and factual and, you know, bias-free. Why is that a mistake? Well, the big of this is because just like, you know, AI is like people. It was built by people. Just like Google was built by people. You know, before we had the whole AI explosion and people went on Google, well, it's on Google. It's on Google, it must be true. It was a very constant refrain that people gave, and that's just absolutely not correct.
Starting point is 00:05:19 And I think one of the things that you'll discover in AI more and more often, people are calling a hallucination. It's really more of a form of BS. There's actually a very popular paper called JetGPTs, BS. And it was written simply from the perspective that, you know, AI is really more like your no-at-all friend. Everybody has one in their circle. They tell you all these incredible things. And most people are like, well, they know everything. They accept it as fact.
Starting point is 00:05:45 But what the AI has to do is they have to answer your question. So even if they can't find the answers, they'll make the answer up. Obviously, many lessons in that. Most recently, one of the bigger law firms in America had a scandal where the AI that was being used to for them to do case. casework with actually created precedent cases on its own. So it created a whole universe of the cases that never existed. And it's a consistent theme over and over again. What we end up with is, you know, people are so enthusiastic about this new leap in innovation
Starting point is 00:06:16 that they forget that just like anything else you should have an attitude of trust but verify. I recently did a TEDx event. And the conversation there was, you know, the future we make and the future that is AI. And what was most interesting about it is the initial when I asked people, I mean, you are enthusiastic and excited about AI. You know, like the whole room raised their hands.
Starting point is 00:06:37 It was very exciting. But as soon as I started talking about some of the things that have been observed, and actually started asking people individually, like, well, tell me you were real thoughts on AI. It was always a trust, but verify attitude.
Starting point is 00:06:50 And I think the issue is a lot of time people think, well, you know, obviously, look, it's made by open AI. It's made by Microsoft. It's made by Google.
Starting point is 00:06:58 It's actually. to be good. But they're just like they're not infallible. They can make the same mistakes. And because they're built by engineers, they have the biases that those engineers have. So they have the same human extensions of our personalities. So the way they gather the information, the way they disseminate it, is reflective of humanity. So I think maybe let's break this down piece by piece or, you know, we'll go chain of thought on this episode title here. Right. But you know, what is cognitive bias, right? I think all people kind of understand what it is, but what is actual cognitive bias? The best way to think about cognitive bias, you know, there's a really long scientific definition that I will not bore you with.
Starting point is 00:07:37 It's honestly irrational beliefs based on our perception. That's the best way to kind of extremely simplistic, mind you. So please, none of the psychologists in the crowd yell at me, but I'm just trying to make sure that it's something easy to understand. And where I say is that we don't think clearly when we have certain beliefs. Right? We try, because our ability to have cognitive biases is what gets us through the day. Ultimately, we make a choice every morning when we get up to get dressed a certain way, to do our hair a certain way, to drive a certain type of car and everything else
Starting point is 00:08:07 because of the way either we want to be perceived or we perceive ourselves or the feeling that it gives us. These are all biases. The key point of cognitive biases, they're not bad. They're just part of our humanity. So in some cases, you know, some of the most well-known biases are there, confirmation bias, framing bias, availability, heuristic. Those are things that help us and hurt us whenever the situation calls for it. You know, sometimes availability heuristic is reach for the first thing
Starting point is 00:08:35 that it's closest available to us to solve the problem that we have. So in some cases, it's a hammer to nail a nail to the wall. Other times, it's going to be a flat object because that's the closest thing to us. It's kind of the same day we operate with a lot of the things that we do. So choices from a perspective of, hey, I need to get 10, I have to send out a survey to my customers. Let's ask Chad GPD for the top 10 questions about car buying. Chad GPD spits out the questions and bam, all of a sudden you get through a whole process where it becomes, you know, here's the questions. And you're like, well, these sound good to me.
Starting point is 00:09:13 They're perfect. There's no breakdown. There's no analysis. There's no belief. So I want to break down two key words I heard you say there. So, you know, you said irrational beliefs based on perceptions. So beliefs and perceptions, right? Because these are things that most people probably don't think go into large language models, right?
Starting point is 00:09:34 Beliefs and perceptions. Those aren't fact-based. Those aren't scientifically research. How does that happen? And how can people be on the lookout for when that does come through a large language model? Well, I went to it in a simple way, right? The first thing is it happens because humans are the ones who make it. So even if AI makes another AI, it's based on the original programming of the human.
Starting point is 00:09:58 So you're just going to have a new permutation of the same biases or an evolution of some new biases based on old biases. The key thing to understand is like, you know, for instance, an engineer will program in AI and say, I want you to put the information out this way. And I want you to put when they ask for a list, this is how the list will be based on this thinking. and when you're pulling from news sources or media sources this is the first 500 you're going to look at before you look at anything else to solve the problem
Starting point is 00:10:26 is it because of their personal beliefs is it because of their perception of what's reputable versus what's not as a news source we don't know right and it's the same applies the same applies on the other end as it kind of goes through the process of coming up with answers
Starting point is 00:10:42 if it can't find it in those 500 and I'm just making up that number I don't really know what the real secret sources in those cases, all of a sudden it becomes a situation. Well, they're going to, if they can find it in those 500, you may think the other ones are less reputable. So instead it'll come up with its own answer. Or it will add its own little spin to it.
Starting point is 00:11:01 And because it's a yeah, you think, well, it's a computer that answer. It must be correct. Yeah. Yeah. That's the worst thing you can do with a large language model, right? Is this like, oh, it's a computer. It has to be right. But so many of the things that we ask large language models, there's nuanced, right?
Starting point is 00:11:15 it's not binary. We're asking it for strategy to make decisions. We're not necessarily always asking it to count the number of ours in strawberry or, you know, the capital of Illinois, right? But maybe if you could, could you walk us through just what are the types of biases? And, you know, maybe just briefly, you know, like I know, confirmation bias, right? Maybe could you walk us through briefly, you know, two or three of the most common types of biases that show up in large language models and in what they mean? Yeah, obviously confirmation bias is probably the most well-known one. You know, it's confirming its own initial beliefs.
Starting point is 00:11:52 And quite often what it'll do is the way it's the best to consider us, not from the point of the AI, it's from the point of view. How biases really impact us is our perception of what is being said to us, shown to us, etc. So AI is going to respond to us in a specific way and bias us in that way. So in some cases, we'll ask it a certain question, it'll respond back, and it'll trigger our confirmation. information bias because it's going to be confirming our facts. So if we ask an AI question that has an obvious answer, it's going to spit it back out at us in a specific way, just make it, you know, prettier, more or less,
Starting point is 00:12:26 or more sophisticated or expand on it more. So confirmation is a big one, framing bias. We frame something in a specific way to get a specific answer back. So if we say, just make it up, Mercedes-Benz is the fastest car and the best car for the money based on the luxury, blah, blah, blah. And then we're going to ask questions about it. Now the AI is going to be responding back in the same way, just like humans would. Because again, the AI is not here to argue with you.
Starting point is 00:12:51 I know we've seen those comical stories where AI starts arguing facts with you, but that's not really the reality of how it operates. And then obviously I talked about availability of heuristic, which is one of the most interesting ones, because like I said, it's the lowest hanging fruit, basic way of saying it. People reach for the first thing that's available to them that may seem like it solves the problem. Yep. You bring up a fascinating point here that I want to dive a little bit deeper in. Right. So when models are, you know, essentially mirroring our own beliefs, right? But I think what's important to call out is, you know, a system prompt, right? All large language models have system prompts. And one thing you said there is most of them, they are designed to be a helpful assistant. Right. So even if there's not an answer, they kind of want to be helpful. And I think that's why sometimes you get these, you know, halfway answers or, you know,
Starting point is 00:13:47 things that maybe you look at and you're like, is this right? Well, sometimes it doesn't always matter because it's ultimately trying to be helpful. But, you know, I want to ask you, how does the conversation in the context of a large language model when we're, you know, whether it's co-pilot or chat TV or whatever, how is that going to influence it, like actually how we're prompting it and, you know, what the outputs we get in terms of bias? Well, it's a huge, it's actually a big, big factor. If you think about it from a perspective, say you ask it for a specific element, a specific answer,
Starting point is 00:14:22 and then you say, well, now I want you to write it, but pretend you're a 20-year experienced engineer and write it in that term, but write it nicer. So now there's the bias element. What is truly a 20-year engineer? How do you write nicer? What is nicer? You know, sheer definition elements
Starting point is 00:14:40 and how the biases are perceived from then becomes a hot mess. And quite often, that's where the prompting kind of falls apart. And that's why for a while, people are like, well, you know, we don't have to know how to do prompting anymore because AI is so smart. I'm like, unfortunately, we do because the one thing that AI claims to do that it actually doesn't do is it doesn't really understand well. It understands initially in a very bare bones thing.
Starting point is 00:15:02 I heard a very great quote yesterday at an event where they said this. They said, at this point in time, AI is the worst it's ever going. going to be. And that's a, it's a true statement. Right now, we're at the very beginning at the very earliest stages. So quite often people have expectations of a flying ship when we're probably somewhere closer to a horse-drawn carriage by AI standards. We'll get there. But the problem is, as the more things get sophisticated, the more complex they'll get from a perspective, how do we ask a question that it's perceived by the AI in the right way? Because we'll say, write it nicer. So it will change a few words.
Starting point is 00:15:38 It will sound nicer to us. But if the context is still something that has harmful biases in it to what our objective is, it was not really helpful to us. No, it was just an answer given because they're righted nice. So fine, I'll put some puffery around it. I made it nicer. And so our prompting doesn't necessarily help it be better at its job. Our prompting just helps, again, confirmation bias, helps us confirm that we want something nice.
Starting point is 00:16:05 a role changes stone to its perception of nicer, but not necessarily solve the actual problem. This podcast is supported by Google. Hey, everyone. David here, one of the product leads for Google Gemini. Check out V-O3, our state-of-the-art AI video generation model in the Gemini app, which lets you create high-quality, eight-second videos with native audio generation.
Starting point is 00:16:28 Try it with a Google AI pro plan or get the highest access with the ultra plan. Sign up at Gemini.com. started and show us what you create. Let's maybe talk about the root of this, right? Because, you know, I kind of, I kind of reference that, you know, large language models are a reflection of the internet and that's a reflection of humanity. And right.
Starting point is 00:16:54 And that's why there's sometimes stereotypes and biases, you know, to begin with. But walk us through how are models like actually reflecting these biases in a long run? So maybe can you just walk us through training data and like, where do some of the the issues in terms of cognitive bias. Where do they get inserted into this whole equation when it comes to training data? Well, I mean, right, we kind of talked about the idea when they even begin telling the AI,
Starting point is 00:17:22 this is how you're going to parse out information. This is how you're going to pull it apart. This is how you, based on these requests, this is how you're going together together. Then we have to start thinking again, once those issues are inserted, then once the AI has to start thinking, what's your reputable information?
Starting point is 00:17:38 source of information. And then it starts trying to pull that data out. We still have to consider the element that it's very much the equivalent of drinking from a fire hose. You know, I can't even imagine the sheer amount of petaflops and God knows what other measurements we could apply of information that are constantly flowing through, that it has to parse through to delineate whether or not the one specific miniscule thing that we're asking has the answer for it, you know?
Starting point is 00:18:07 and it still returns it in seconds. And so that stuff is where you really start falling apart on training data. Because it's not, you know, there was recently a big thing with Deepseek, you know, how they trained it for $5.6 million. Obviously it's not true. Not true. A whole episode on that, but thank you for calling that out. Yeah, it was a cute number though, right?
Starting point is 00:18:30 But the big thing about it is that kind of brought to the forefront, what does training really mean, right? And when we think about training a small model, it's literally us humans sitting down and working through the labeling elements of specific data points and how the AI should treat those elements based on the labels we assigned to it. In the case of a massive model with massive, massive, massive, massive amounts of data, it labels it itself. So it's only thought to label things. And what's the issue when you attach AI to label things? you wish it was more like, you know, all colors of the rainbow, being able to see all points, it can. It's much more limited.
Starting point is 00:19:12 It doesn't have that neural death that we have right now. So instead, what it does is, you know, it's more or less if and then rules. A lot of those are applied. And I'm simplifying way too much. That's not really how AI is, but for the basis of understanding, it's really how it kind of perceives information. Does this answer the question? Yes, no. Next.
Starting point is 00:19:32 Does this answer the information? us know next and it goes through that whole routine and when it gets to a certain point where it was like well this partially kind of answers the information if you extrapolate this and then kind of you know smooth it out which is your BS factor that's the information yeah so so in every hallucination or BS a point that AI makes there's always elements of the truth in it which makes it so convincing and that's the biggest thing to consider like during the training because when you consider it was the training you know they do spend months and months essentially years training models, but it's not like their hand labeling stuff. What they're really doing is just
Starting point is 00:20:08 overseeing this enormous model trying to label everything and then doing audits and checking and checking again and rechecking and saying like, whoa, that's way wrong, you know. And if it's big enough, they catch it. The problem is sheer amounts of data is just not possible right now to catch everything. Will it ever be? I can't possibly answer. I don't think they can either. And that's why, even though you see these new evolutions and, you know, we saw these new evolutions in agents, almost every week, a new tool comes out. And it feels like it's the next tool, and the next tool. The consistent theme is the same.
Starting point is 00:20:40 They're not actually creating better depth. They're creating better response time, maybe a lower latency, cheaper. They're sometimes making a better conversational piece to it. But the info being put out is still very much the same. And for us, when we actually look at the idea how it measures cognitive biases versus the scientific models we have, the consistency of Stereg-GPT and Cloud and a couple of the others we're around 30 to 40% versus what we do. And the reason being is because, again, sheer amounts of data and how you label it
Starting point is 00:21:09 and how the scientific application actually applies to a specific word, their specific nuance in the sentence, is not the forte. So when you see where AI is studying, we have the general AIs, and I think you probably might have talked about this already in the past, the explosion of narrow AIs that are going to be good in specific elements, and that's going to be their main motif. Adobe just introduced an entirely new way to create, bringing the power and precision of its creative suite into one conversational experience. Meet Firefly AI Assistant, now live in
Starting point is 00:21:48 the Adobe Firefly app, the all-in-one creative AI studio. Powered by Adobe's creative agent, Firefly AI Assistant lets you start with your vision, just describe what you want, and shape the outcome as it takes form with the Assistant. The Assistant orchestrates multi-step workflows, drawing on 60-plus pro-grade tools across Adobe Creative Cloud apps, including Photoshop, Illustrator, Premiere, Lightroom Express, and more to help bring your ideas to life. You can also get started with creative skills, a growing library of pre-built workflows for common creative tasks, like batch editing photos, creating mood boards, portrait retouching, and creating social variations.
Starting point is 00:22:29 Every step the assistant takes is visible, so you can refine, redirect, or take over at any time. you stay in the driver's seat as the creative director. Adobe Firefly AI assistant now in public beta. See it today at firefly.adopi.com. So a great question here from our audience. And you kind of mentioned about the future of AI, right? Like everything going, you know, agentic or multi, you know, multi agent environments. But, you know, obviously now we have these models that, you know, think, these models that reason,
Starting point is 00:23:05 these models that, you know, take their time. So a good question here from Cecilia asking, you know, what do you do to detect cognitive bias and encourage maybe slow thinking versus the fast thinking when we want AI to be fast? Yeah. So like I'll even add on to her question. You know, do reasoning models, you know, that take their time to think. Is that also a process that maybe we're going to see less bias? We may potentially. But again, it still falls back on the developers, right?
Starting point is 00:23:34 It's a, unfortunately, it's like a wheel. as soon as you insert humanity into the wheel, we have our biases. All of us do. That's not a bad thing, like I said. It's just unfortunately how we perceive information on other things will dictate some of the more harmful biases that pop up, which is quite often when you hear about stereotypes and stuff. It's not that the engineer wrote, yes, men are better than women or some other thing.
Starting point is 00:23:59 No, it's literally their biases in how information is parsed. What gets priority over what causes the model to extrapolate into the next piece, which is, well, this is how I'm going to perceive things. And while they have hundreds upon hundreds upon hundreds of engineers constantly looking and auditing and checking, it's just, again, such a vast amount of information and such a vast amount of variance that it's not possible. To Cecilia's question, what you're dealing with, you know, there's a great book by Daniel Connemon called Thinking Fast and Slow, which kind of is, I don't want to say he's the
Starting point is 00:24:33 father of cognitive, modern cognitive, biased behavioral, can I'm scared of it is. right? And so the best way to consider it, there will be a space for these models that are more analytical and focused on things. It's the same thing as we have other things that do certain more complex things. I always liken it to the idea. You know, people have an Apple watch and then people have a manual watch that still has gears in it. And they prefer that element because they feel it to them it's more reliable because it doesn't run our batteries. Yeah. It just moves because you move. Yeah. I think that's a great example. And you know, we'll definitely put that in the newsletter just kind of about the, you know, system one versus system two thinking. I think it's important,
Starting point is 00:25:11 you know, when we think about, you know, using AI. Another good question here from Douglas asking, are there some models that have more inherent bias than others because of how they were trained? Honestly, that's very subjective. Unfortunately, all of them have bias. And there's no such thing as harmful bias. It's simply their perception of certain information points, how you ask questions, right? Quite often what we do is what we know, with a lot of our users is they actually will generate stuff on like chat GPT, dovetail, name a system that generates questions, and then they'll run them through our system. And then that will be the result that they use for their actual product.
Starting point is 00:25:52 And the reason why they do that is twofold. Sometimes they're fine with the questions. They just want to understand, how am I going to be biased in my audience? Because no matter what you ask, you always bias in them some way. But the question becomes, am I biased in them just to answer the question truthfully if I'm doing marketing research, or if I'm doing sales and I want to prompt them to action, am I doing God effectively? So those are the things you're really pushing out.
Starting point is 00:26:14 But right now, for the most point, like, for instance, I think if you look at size of model, large language models have a lot more inherent biases than smaller models. And that's just by the sheer amount of data they consume and also the sheer amount of hands that touch the model. At the same point, narrow AIs totally have a bias in them. And the key element that we try to do, you know, I'm always been a big proponent of having a very diverse team look at the model and label it and look at everything else and how it perceives data. And that's the reason why. Because if you have a large variety of people look through it, you're not going to have the perspective on how to parse data from one or two individuals or ten individuals. You're going to be able to do these things in a much more, you know, almost an objective way to a degree.
Starting point is 00:27:02 if it was the proper word. When we developed our model, for instance, and again, narrow AI, right? Very different. We started with 17,000 questions, and we looked at their sentence structure, and from them we're able to extrapolate to 450,000 questions, somewhere in that neighborhood,
Starting point is 00:27:18 probably even more. It's one of the numbers I heard. And the idea is now we're able to label those 17,000, we can give the model the nod of, these are the scientific facts, those cognitive biases. This is how you're going to react to this based on the scientific definition, not our perceptions, but what science defines.
Starting point is 00:27:38 Now, does that mean science doesn't have biases? No. But science, based on the best thinking we have in existence for our society, this is what it is. And as it evolves, we evolve. This is how the bigger models do too, because as they keep coming out with new versions, it is our hope that they keep updating that particular element of how they model thinks.
Starting point is 00:27:59 But the question I have, and I think everybody has, is, you know, with such a fast evolution cycle. I mean, we're talking sometimes 30 days between new releases, if less. Obviously, a lot of that stuff is maybe quick fixes, but you always have to wonder, what's going on in the background? They're actually fixing their main issues, or are they just adding to them by creating more features? Yeah, yeah. And I think sometimes you spend time, you know, circumventing some of those shortcomings. And then new model comes out, and it's like, okay, what about, all that work that we put in, you know, to build bridges, you know, around over or through some of
Starting point is 00:28:34 these, you know, inherent problems. But, you know, we talked about a lot in today's conversation, you know, from everything from, you know, bias in training data and, and, you know, bias in the humans that are building it, the types of cognitive bias, which is super helpful. But as we wrap up here, I think I'm going to toss this over to a big bogey here on YouTube. I think this is a great way to wrap the show. So he's asking, how do you remove unwanted bias when that bias? may be deeply entangled with essential data. And I'll even say, you know, hey, aside from using your, you know, your platform,
Starting point is 00:29:08 how should companies be tackling this because it's a huge issue? Well, I think the element has to be is the value of the data and the value of the output of the data, right? Because quite often, if you're looking at specific data, where the bias may, for instance, affect the key decision the company is making, getting outside help will be essential. essential because and obviously my platform
Starting point is 00:29:32 can help with a lot of the question stuff and the other stuff but when you're looking at the bigger peaches like there's consultants like for CPO out in California whose entire stick is to look at cognitive bias and how it impacts decisions because the elements that he's talking about
Starting point is 00:29:48 you know essential data may have cognitive biases deeply entangled in it but ultimately our perception of those of that data is what causes the biases that are impact our decision making. The data will bias us in a way, but we have to make the choice of how we receive it. And if we're already aware that we may have a problem with it, that's when we have to seek outside counsel on it and be able to almost bring a pair of eyes to oversee our
Starting point is 00:30:14 process and to figure out if we need to have a more subjective, a subjective process or objective process to how we make choices. Because ultimately, again, humans, right? Just like trusting a machine, well, it's not a great idea, especially when the data is complex, complex, or maybe, to a degree, may be very, very much human-related and something that an AI cannot possibly comprehend the same way, then it becomes a situation. You have to make your best choices. There's a lot of good classes, a lot of good reading, a lot of good curriculum. I've always been a huge proponent of companies doing behavioral science and behavioral economics training. For the very reason, not because it can replace a tools like mine, but it can enhance people's ability.
Starting point is 00:30:55 to be able to spot the issue and then seek the solution versus, you know, finding out after the fact, oh my God, our sales calls and our sales meetings and the way we extrapolated those data from these sales numbers was completely wrong. The customer didn't really want this. They just felt they had no choice until they found a better solution. So much good advice there. I think, Anatoly, thank you so much for taking time out of your day to join the show. You helped us, I think, make much better sense out of a very complex and a very important topic that we all need to understand. So thank you much. Thank you so much for your time and insights.
Starting point is 00:31:33 Thank you so much for having me. And I really appreciate the podcast. Honestly, enjoy it quite a bit. That's great. Hey, I do too, but, you know, it'd be weird. I didn't. So, hey, if you enjoyed the podcast, too, if you heard something here from Anatolian to like, wait, what was that?
Starting point is 00:31:48 Don't worry, we're going to be recapping it all in our free daily newsletter. So if you haven't already, please go to your everyday AI.com. Sign out for that free daily newsletter. If this was helpful, tell someone about it. Please subscribe to the channel. Leave us a rating. Tell your friend, tell your mom, tell your neighbor, tell your mom's friend's neighbor. But more than anything, make sure to join us tomorrow and every day for more everyday AI.
Starting point is 00:32:09 Thanks, y'all. Thank you. Meet Firefly AI Assistant. Now live in Adobe Firefly, the Allman One Creative AI Studio. Just describe what you want to create in your own words and the assistant handles the rest, orchestrating multi-step workflows across Adobe Creative Cloud apps. including Photoshop, Premiere Express, and more in one conversational interface. You direct the outcome while the assistant accelerates execution.
Starting point is 00:32:40 Stand control with the ability to step in and refine at any time. See it today at firefly.adobie.com. And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going. For a little more AI magic, visit Your EverydayAI.com. and sign up to our daily newsletter so you don't get left behind.
Starting point is 00:33:11 Go break some barriers and we'll see you next time.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.