Everyday AI Podcast – An AI and ChatGPT Podcast - EP 120: ChatGPT Tokens - What they are and why they matter

Episode Date: October 11, 2023

Is ChatGPT lying to you? Tokens are one of the biggest reasons you may be getting ChatGPT wrong. So what are tokens and how do you use them? We're taking a deep dive into ChatGPT tokens and expla...ining it all.  Newsletter: Sign up for our free daily newsletterMore on this Episode: Episode PageJoin the discussion: Ask Jordan questions about ChatGPTUpcoming Episodes: Check out the upcoming Everyday AI Livestream lineupWebsite: YourEverydayAI.comEmail The Show: info@youreverydayai.comConnect with Jordan on LinkedInTimestamps:[00:01:40] Daily AI news[00:06:30] ChatGPT breaks down language into tokens[00:10:30] ChatGPT tokens in action[00:18:00] Advanced Data Analysis is a single session use[00:21:20] How ChatGPT interprets words[00:28:20] Why you're getting hallucinationsTopics Covered in This Episode:1.  Mistakes and Hallucinations in ChatGPT2. Token Memory Capacity3. Tokenization and Understanding Context4. Token Values and ComparisonsKeywords:ChatGPT, common mistakes, bad results, hallucinate, tokens, importance, prevent, inaccurate information, update, prompting course, reliable recommendations, AI expertise, NBA finals, ChatGPT, personal data, memory loss, token limit, NLP, autocomplete, bigger token memories, Cloud 2, AI regulation, job loss, Europe, US regulation, Wall Street, prime prompt polish pro, plug-ins, Internet-connected, Bloomberg report, Google Bart, Adobe, creative AI, firefly vector model, firefly design model.Send Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info) Start Here ▶️Not sure where to start when it comes to AI? Start with our Start Here Series. You can listen to the first drop -- Episode 691 -- or get free access to our Inner Cricle community and all episodes: StartHereSeries.com Also, here's a link to the entire series on a Spotify playlist. 

Transcript
Discussion (0)
Starting point is 00:00:00 This is the Everyday AI Show, the everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business, and everyday life. Meet Firefly AI Assistant, now live in Adobe Firefly, the all-in-one creative AI studio. Just describe what you want to create and the assistant handles the rest, orchestrating multi-step workflows across Photoshop, Premiere Express, and more in one conversational interface. You direct the outcome. The assistant accelerates execution. I've taught tens of thousands of people about chat GPT.
Starting point is 00:00:51 And there's three very common mistakes that most people get wrong. And it gives them bad results. And it causes chat GPT to hallucinate. And one of those three things we'll be talking about today, which is tokens. So if you want to know more about what tokens are, why they're important, or even if you want to know, how can I get chat GPT to stop lying to me? Today's episode is for you. So thank you if you're joining us live.
Starting point is 00:01:19 My name is Jordan Wilson. I am the host of Everyday AI. We are your daily live stream podcast and free daily newsletter, helping everyday people like me and you, not just understand what's going on in the world of generative AI, but how we can actually use it all, right? Because there's no point in just reading AI news all day and, you know, stacking up all these new tools that you'll never try.
Starting point is 00:01:44 That's not what everyday AI is about. We are about helping you actually understand and actually use AI. So I'm actually excited to talk about tokens. It's a little dorky. But before we do, get your questions in now. If you're joining us on the live stream, thank you. If you are listening to the podcast, don't worry. Check those show notes.
Starting point is 00:02:01 We always leave important links so you can find more. And come back, actually. We usually have a pretty good conversation going each day in LinkedIn. All right. So let's talk about the AI news before we get into tokens. So speaking of tokens and large language models, a new report suggests that even Google employees are questioning Google's own large language model, Google BART. So this comes from a Bloomberg report that says there's Google product managers, designers, and even engineers that are debating the AI tools, effectiveness, and utility. And some, are even questioning, according to this report, whether the resources going into development are worth it. So right now, Google Bard. Google's Bard uses the Palm 2 model, but there are big hopes for the upcoming Gemini model.
Starting point is 00:02:56 What do you all think? When I use Google Bard, I'm not impressed. It's probably the large language model that I use least. I don't actually find a lot of utility for it. at all. I'd hate to say that, but I hope the Gemini update changes that. All right, next piece of news. There are new calls for AI regulation in Europe. So there is a new report that was produced by the I.E. University Center for Governments of Change. So this recent I.E. University study showed that 68% of Europeans want their government to introduce stricter safeguards to keep AI from
Starting point is 00:03:35 taking their jobs. So it's very, very interesting, just the difference of opinion between different countries. I don't know if you'd see that same percentage here in the U.S., and I also don't think the U.S. is going to do really anything, at least anytime soon, to actually regulate AI's ability to take over jobs. Because I do think it's going to happen, and I don't think, you know, hey, Wall Street hates employees. All right.
Starting point is 00:04:02 But our last piece of news is Adobe is making big moves in the creative and gen AI space. So they just kicked off their Adobe Max yearly conference, you know, unveiling a lot of new updates, new pieces of software, new updates of the software, all that good stuff. So a couple things to keep in mind if you're a generative AI fan and you want to know, hey, what does Adobe have up its sleeve, you know, a week after Canva's big magic studio update. So Adobe's announced their new Firefly vector model where objects can be more easily reshaped. They announced their Firefly design model, which is text to design and updates to these models, obviously. And then new and improved Firefly Image Model 2, which is its upgraded text image model.
Starting point is 00:04:53 And there's more. So that was helpful. If you want to know more what's going on with those stories or anything else, make sure to go to your everyday AI.com. Sign up for that free daily newsletter and will help you understand what's going on in the world of AI. Let's understand tokens, shall we? Hey, good morning to everyone joining us. Michael, thank you for joining us. Harvey, Dr. Harvey Castro, Woozy, thank you for joining us, everyone. Some of our regulars, some new faces. Bronwyn, thank you for joining us. Good afternoon to Bronwyn. Good morning to most of us, like Leonard. Harold, good morning. Hey, it's good to see y'all. Let me know,
Starting point is 00:05:29 What are your questions about chat GPT and tokens? And when I'm talking about chat GPT and tokens, this is actually applicable for other large language models, but they all handle tokens a little differently, process everything a little differently. So at least in this conversation, we're going to be talking about chat GPT and its use cases of tokens.
Starting point is 00:05:55 So let me start at the end. I teased in the show. You know, I've helped teach tens of thousands of people chat GPT, whether it's here on the podcast and the live stream in our newsletter. We have every, every week, we do two courses on prompting and they're free. We don't sell anything at the end either. That's our prime prompt polish course, PPP. If you want to, if you want access to it, we don't even put it on our website. It's a little secret for our listeners, for our viewers.
Starting point is 00:06:22 So if you want to access, just type in PPP in the comments, email me PPP. I'll send it to you. But one of the things that we teach in there, one of the things that most people get wrong is chat GPT's memory. Because, you know, people will say, hey, Jordan, what's going on? You know, I started using chat GPT. Things were going great. And then it just started to hallucinate out of nowhere. And now all of a sudden things that chat GPT was getting right before, it's no longer getting correct.
Starting point is 00:06:52 Okay. And that is because tokens. All right. So, so very long story short. I'm going to, I'm going to put this in everyday person speak. Okay, I'm going to try to not speak in to Dork. So I took my Dork hat off this morning, try to put my everyday person hat on. Tokens, simply put, are the way that Chat ChbT and other large language models understand the words that we give it.
Starting point is 00:07:19 So it's actually strange. Chat ChbT doesn't, and I'm going to show you here on screen, chat ChbT doesn't technically even understand the words. It essentially assigns tokens to the values that we put into chat GBT and other large language models. So it actually breaks everything down into tokens. And that essentially in a short, short number of words, it allows chat GBT to kind of have this natural language processing ability, this NLP ability. And that's what allows it to go back and forth with us because all chat GBT is, in essence,
Starting point is 00:07:55 is the world's smartest auto-complete that you can steer. But it does that by breaking down. So a token is either a word, a part of a word, a symbol, right? And then all chat GPT does in other large language models is it predicts what is going to come next based on those tokens that were inputted and based on what it understands in its brain. Okay. And that's the other important part. And there's a lot of misinformation out here.
Starting point is 00:08:22 And I'm here to also set the record straight. as I sometimes try to do. All right? Because you hear all these, you know, hey, 4K, 8K, 32K, 100K tokens. Like, what does that even mean? All right? I'm going to show you a live demonstration,
Starting point is 00:08:39 but let me just break it down. So right now, depending on what version of chat TPT you use, it has a different memory, right? So sometimes when I talk about memory, essentially that is its ability to recall tokens in its head before it starts to forget.
Starting point is 00:08:55 it. Okay. So right now, if you are using chat GPT, it is different than if you are using what's called OpenAI's Playground or if you're using the API, it has a different memory. But if you are using chat GPT, like most of us are, the chat GPT plus plan, it is 8,000 tokens. Okay. And it breaks down to, you know, it's roughly four tokens is one character.
Starting point is 00:09:18 It's a little tricky. But more or less, at about 8,000 tokens, you're somewhere around 6,000. 6,500 words. Okay. So think of it like that. Every, every piece of that back and forth conversation counts as a token. Okay. And then after you get to that roughly 8,000 inside chat, CBT, it is going to start to forget whatever was at the top. So it can always recall the last 8,000 tokens. But as your conversations get longer, it's going to start to forget the things at the top. All right. So before, before we jump in here, I'm going to see what questions we have, but I'm going to share my screen and I'm going to walk,
Starting point is 00:10:00 I'm going to walk everyone through this a little bit. Great, great question here from Jackie. Jackie, thank you for joining us. You know, asking with Amazon's money now with Anthropic, how will cloud change cloud? I don't know. I don't know. I hope it gains the ability to access the Internet. That is one of the things why I don't use cloud, hardly at all.
Starting point is 00:10:22 But Jackie, it's actually important you bring up cloud because this is. Kind of memory. And when we talk about tokens, you know, the cloud two from Anthropic, people say, oh, I don't use chat GPT because it doesn't have a great memory. Correct. And then they say, oh, I use cloud, cloud too, because it has 100K tokens. So it has a much larger memory. Also correct.
Starting point is 00:10:47 But here's the reality, folks. You can't really do anything, like comparatively. When you talk about the power, and I'll say the understanding. untapped potential of chat chbt. It is because of its plugins. Like, I can't talk about that on the show enough and I can't remind people, you know, who say, oh, I don't use chat GPT. I use, you know, I use barred or I use Bing chat or I use Anthropic or pie or Po or anything. And I say, why? I just said, that just means that you don't understand the power and the potential within chat GPT and plugins. But obviously the downside of that is that small memory. Okay. So let's let's
Starting point is 00:11:23 investigate that a little more. All right. I'm done. I'm done ranting. Let me share my screen. And hopefully we can learn a little bit about chat GPT together. Let's let's try, shall we? So here's what I'm going to do. I'm going to show you hopefully live, right? I always test this, but things happen a little differently. So I'm sharing my screen here. I am inside chat GPT. I am in GPT4 and I am in plugins mode and I have internet connected plugins. That doesn't matter for this conversation, but I tell people always, always, always, if you are starting a new conversation in chat GPT, always give it access to plugins. All right.
Starting point is 00:12:08 So here's what I'm going to do. I'm going to say my name is Jordan. I'm from Chicago. Okay. And also, hopefully if you're joining live, you can see this little thing in the corner. I do have a Chrome extension that I've covered before. I've talked about it in the newsletter. I've done a, I've done a review on it.
Starting point is 00:12:26 And obviously now my chat chbt is not responding. That's always how it works. You test something right before. You test something right before and then it stops working. Okay, there we go. So I do have this little token counter up here in the right hand corner. Okay. This isn't there by default, but this, and you should be using something like this,
Starting point is 00:12:48 especially if you're in a new chat. so you know when Chat Chbitty starts to lose its memory. Right. So I said, my name is Jordan. I'm from Chicago. Chat Chb Tee said, hello, Jordan from Chicago. How may I assist you? Okay, I'm going to say who won the 1991 NBA Finals, right?
Starting point is 00:13:05 One thing I hate doing, y'all, is typing live because my mic is so close to my face. I'm typing like this little T-Rex times. Okay. So I just asked a question. I just want you to see this. And I'm going to say, what is my name and where? am I from? Okay. So the reason I did this is I asked another question, right, about something not related. Well, the Chicago Bulls are the best. Obviously, Chicago Bulls won the 1991 NBA Finals. But then
Starting point is 00:13:33 after Chad GPT asked me that, then I asked it again, what is my name and where am I from? Okay. And it obviously got it correct. And I want like to just quickly call out the tokens. So we are at 157 tokens, right? So chat GPT still has all of it. its memory. So now what I'm going to do, and please, please allow me because I want to do this live. Okay. So I'm telling chat, GBT, I'm sending you information about my podcast. Please summarize everything I send. Okay. I know I didn't spell hardly anything right. Again, I'm typing like this. It's hard to do. So here's here's what I'm doing now. And I'm going to hopefully, hopefully do a decent job at explaining it as I go along.
Starting point is 00:14:23 I'm going to quickly, and this hopefully will let, like you all see this too, I'm going to quickly make chat GPT lose its memory, all right? Because people always think, oh, it won't happen to me. Yeah, no, chat GPT's smart. You know, it's a quadrillion dollar company. It doesn't forget anything. It does. So if you keep an eye on the token counter, I just essentially paste it in a bunch of information.
Starting point is 00:14:49 Adobe just introduced an entirely new way to create, bringing the power and precision of its creative suite into one conversational experience. Meet Firefly AI Assistant, now live in the Adobe Firefly app, the all-in-one creative AI studio. Powered by Adobe's Creative Agent, Firefly AI Assistant lets you start with your vision, just describe what you want, and shape the outcome as it takes form with the Assistant. The assistant orchestrates multi-step workflows, drawing on 60-plus pro-grade tools across Adobe Creative Cloud apps, including Photoshop, Illustrator, Premiere, Lightroom Express, and more to help bring your ideas to life. You can also get started with creative skills, a growing library of pre-built workflows for common creative tasks, like batch editing photos, creating mood boards, portrait retouching, and creating social variations. Every step the assistant takes is visible, so you can refine,
Starting point is 00:15:50 redirect or take over at any time. You stay in the driver's seat as the creative director. Adobe Firefly AI assistant now in public beta. See it today at firefly.adobie.com. All right. That's all I did here. You know, it's notes. I actually did a bunch of research with internet connected plugins
Starting point is 00:16:15 when I originally built the podcast. You know, I just... I chat, TBT, scrape the internet, all the best ways to build a podcast. start a podcast. So even for me, I started, I don't talk about this a lot. And I'm just kind of rambling on as I eat up chat GPT's memory here. So if you're listening on the podcast, don't worry, this will be done in two or three minutes. We're at about 5,000 tokens. But I had a daily podcast actually back in, what was the year, 2008, which is crazy to think about now. So I kind of forgot.
Starting point is 00:16:48 You know, it's like, hey, what's the best equipment? What's the best software? What should I be using? So I use chat GPT, like I think most people should, using an internet connected plugin, having it read. Probably I fed it dozens with an ass dozens of articles. You know, hey, 50 best ways to grow your podcast, how to start a pack, blah, blah, blah. It probably would have taken me of, I don't know, a week or more to read all these articles that I essentially summarized with chat chbtee because it knew what I wanted. and it knew exactly how to how to get that information, right? Obviously, my chat GPT is being a little wonky. We're almost there.
Starting point is 00:17:31 Thank you for sticking around. I know this is a lot to make a simple point, right? But we're almost there. And that's the other thing, y'all. Like, I tell everyone this. I tell everyone this, that, you know, when I give you all information on this show or if you take our prime prompt to polish the free prompting course that we do twice a week, we update that thing twice a week.
Starting point is 00:17:59 We update it before it goes live because things in chat TBT change all the time. Okay, I am pushing this over on the token limit just because I want to make sure. Okay, we test everything. So when we give you recommendations or when we're talking about tokens, chat CBT losing its memory because here's the thing. There's people out there, people who have quote unquote followings in our, teaching people about AI and they're like, oh, Chad GPD has a 32,000 K token limit. It's like, no, not really, not for how people are using it.
Starting point is 00:18:28 Yes, it does if you're using the API, if you're using the playground. But if you're using chat GPT, people don't even truly understand this. And this is why so many people are getting everything wrong inside chat. It's because it doesn't. It has an 8K and I'm proving it to you right now. Right. So now we're finally there. We're at 9,000 tokens.
Starting point is 00:18:47 I wanted to make sure to get to 9,000. So in the beginning, I said, what is my name? Where am I from? Because I told ChatGPT that. And that is at the top of our conversation, right? And I did a test right away early on, right? I asked a question about the NBA finals, got it right. And then I went back, what's my name?
Starting point is 00:19:04 Where am I from? Chat Chapti got it right. So now when I ask, what is my name and where am I from? Okay. So now I'm typing that in because we've hit 9,000 tokens. And guess what? chat GPT says. I don't have access to personal data about individuals unless blah, blah, blah, blah, blah, blah, right? Guess what that means? It lost its memory. We hit that token limit, right?
Starting point is 00:19:32 Now that I have this little token counter up here, I know that we're almost near 10,000 tokens. So I can be sure that chat GPT lost its memory, right? So in our PPP course, we teach more about this. We give you ways using something we call a memory recall. We give you ways that you can get around this and avoid this. But I thought it was extremely important, right? Because we always talk about chat GBT hallucinating. And there's usually two main reasons that chat GBT hallucinates. Number one, you're using the wrong mode, right?
Starting point is 00:20:06 I tell people there's very few instances you should ever in chat GPD use anything except for plugins, right? But even advanced data analysis, like if you've used the mode that was formally called code interpreter, now it's called advanced data analysis, it's great for one sit down. So if you have any heavy data needs, if you need to do some coding, some web development, things like that, ADA is pretty good. But when you log in and log out or end a session or start or resume the session on the other computer with ADA, when you upload files, because after the, the biggest, one of the biggest advantages of that mode is you can upload files.
Starting point is 00:20:48 You oftentimes get an error that says it can no longer reach the file, right? I'm sure the engineers are hard at work on this, but I've recreated this error dozens of times. It's even one of the reasons why I don't use that mode very much, but you should probably be using the plugin mode for almost every single chat. You start in chat GPT. So you can give it access to the internet with an internet connected plugin, not browse with ping, don't get me started.
Starting point is 00:21:16 Right? So that's probably the second biggest thing, right? So number one is keeping chat GPT's token limit, those 8,000 tokens, its memory in mind first. And second is making sure you give it access to the internet. And you know what? I do get your questions in. This isn't going to be one of those 40-minute, 45-minute episodes. So get your questions in.
Starting point is 00:21:42 if you have questions like Jay here, Jay says, I believe chat GPT paid version has four acts of three. I believe, because I don't use GPD3 and I don't test it. So again, don't even believe anything you read on a block. Always test it yourself, right? Because number one, Jay, marketing, right? They'll say, oh, 32K tokens. It's like, oh, no, that's actually just the playground and the API.
Starting point is 00:22:08 I believe GPT3 has 4K tokens. Again, I haven't used it, so I haven't tested it. So it's not 4X the time of tokens. I believe it's just about double. Yes, so we have other questions coming in. Kevin says, I thought GVT4 commercial had 4K tokens, and GPT4 Enterprise had 8K. So no, I have, and I just showed you, you know,
Starting point is 00:22:33 GVT4, you know, the commercial or what's available to everyone. actually the best resource for this, and I'm sharing it on my screen now. Let me bring this up. It's actually this article from Microsoft. So yes, it hasn't been updated. But this goes down and it's actually more in-depth than anything on Open AIs website. But it breaks down every single model, you know, GBT35 Turbo. You know, even it, I believe this article even had the older models that were depreciated.
Starting point is 00:23:08 are no longer available, but that's a great resource. Speaking of great resource, I do want to also talk about this, right? I should have started with this, but let's get back to like real quick, what even is a token? So I want to talk about the word set, right? S-E-T, set. So what does that mean? The word set can mean a lot of different things, right? I actually look this up.
Starting point is 00:23:32 It's apparently the word set holds the world record for most definitions. it's like 32 or something. But the word set can mean so many different things. So you can set something down, right? A village can be set at the top of the hill. If you're from New England, like some of my, you know, some of my family, sometimes they say, I'm all set, right? Like, I'm all good.
Starting point is 00:23:55 If you play euchre like me, I love euchre. Does anyone else play euchre? When I played, I played with my mom and stepdad about three weeks ago. and I got set a lot. So that's something in Yucar, you get set, right? So the word set can mean so many different things. So that's why I actually wanted to bring up a tokenizer. We're going to get a little dorky, but I started the show by trying to explain a little bit
Starting point is 00:24:20 that chat GBT, it doesn't actually, in theory, understand your words as words per se, right? So when you give chat GPT all this information, I'm going to show here. I'm going to zoom in on the screen. Let's look at how it even interprets what you put in and how it can actually process, you know, use this NLP, this natural language processing by converting all of your text into tokens to give it semantical meaning, right, to give it that contextual context, right? Contextual context. That's repetitive.
Starting point is 00:24:57 But so when I put in here, I say, hi, my name is Jordan. And I'm from Chicago. That's what I was talking about earlier, right? Let's do it again, lie. So hi, my name, my name. You can see it count. So when I type in, I've said, hi, my name is like I'm Eminem from 99. And we're at five tokens already.
Starting point is 00:25:18 So these are shorter words. So four words, five tokens. But it's all by character. So again, it looks at by tokens, words, parts of a word, symbols, everything counts a little different. So I'm saying, hi, my name is Jordan. And I'm from Chicago. Okay.
Starting point is 00:25:32 So that's 12 tokens. But what's really cool down here is I can see the text. Okay, and it's color coded. But then I can actually click token IDs, which is very interesting. So this is now when I click token IDs, you no longer see words. Okay. And this is why large language models can actually be confusing the more that you dive into it. But this just shows you.
Starting point is 00:25:59 In the end, chat GPT doesn't. remember or piece together your words. It thinks and processes in tokens. So it applies. It applies all these different things. And I'm actually curious because I haven't done this yet. I'm going to go ahead. I'm going to copy and paste because I'm curious.
Starting point is 00:26:22 I'm copying and pasting just some examples I had on the word set. So now in this tokenizer, it says set something down. The village is set on the top of. the hill. And then it says, I'm all set. And then I'm also typing in yuker, your set. Okay. So what's what's pretty interesting. This can also show you maybe when chat GPT is not going to understand something. So now I have the word set on here four times. And again, I'm not a 100% sure, you know, I'm not a tokenization expert. But from what I believe now, when I can look at the text and look at the token IDs and it, it does color code.
Starting point is 00:27:02 So I know for the set something down and the village is set on top of the hill, the word set there is in two different colors, okay? Which is interesting, which again to me means that chat EBT is using this tokenization to use the context around that and processing via tokens. And it knows that that's different, right? Whereas in the examples of I'm all set and Yuker, your set, those are the same color, the word set is the same color, probably because that's not enough context saying, I'm all set. If you tell ChatGPT, I'm all set and you say nothing else. And that's how you start a conversation. By this tokenization breakdown, I can probably go to assume that ChatGPT is going to have
Starting point is 00:27:48 no clue what you're talking about. Or if I just say Yuker, you're set. Same thing. Because it looks like it's assigning a similar token value to I'm all set and Yuker, your set, even though those are two very different things. And even if I look at the token. ID, I'm not going to be able to break all these down because the token IDs are essentially, it assigns two to, it looks like four digit numbers.
Starting point is 00:28:11 So I don't have time to compare them all, but I'm assuming that even the word sat there when we put it into the tokenizer, we got very different values. All right. I'm taking off my dork cap. Sorry, I forgot to let you all know that I put my dork cap back on, took my everyday AI hat off. But now it's back on. So I want to recap.
Starting point is 00:28:34 And thank you all for sticking, sticking around. Thank you for your comments. And if you do have any other questions, I'll try to get to them quick. So Mike with a good comment here saying my token counter doesn't look like that, but I have the same extension. Weird. Yeah. Actually, Michael, I keep two token counters active because one of them kind of gets a little
Starting point is 00:29:00 finicky and it doesn't always work. So I actually keep two of them active. Sometimes one works, sometimes the other works. There's only three of them on the Chrome. It's a Chrome extension. There's only three of them. Not a single one works consistently. So I keep two of them active just in case.
Starting point is 00:29:16 All right. Yeah. Tanya, thank you for joining. Tanya says, thanks again. Never heard of these secrets either either. Love this show. Love this show. So thank you.
Starting point is 00:29:30 Let me just quickly. Let me quickly recap. We're going to bring this to a close. I know sometimes when it's just me on the show, I go into old Jordan, old man Jordan mode. And I shake my fist. And I, you know, and I rant for 45 minutes. That's not today. Today I wanted to have a very simple explanation of tokens.
Starting point is 00:29:51 Talk about what they are and why they matter in AI, specifically in chat GPT. So like I said, yes, there are other. large language models that have much bigger token memories, you know, like cloud two has 100,000 token memory, which is fantastic, right? Huge memory. But if I'm being honest, it can't do a lot. So if you are working in chat GPT, and this is why this is important, the two reasons that you're probably getting hallucinations is you're not using, number one, you're not using
Starting point is 00:30:24 chat GPT plugins with an internet connected plugin. Again, we go over this more in our Prime Prompt Polish Pro course, which is also free. So if you want access to that, just, you know, hit me up. I'll tell you how. We talk a little bit more about how to stay current with plugins and how to not hallucinate with plugins because all Internet Connected plugins are not created equal. I have a spreadsheet that I've shown on this on the show multiple times where we've tested, you know, more than 20 Internet connected plugins on.
Starting point is 00:30:57 four different criteria. Not all of them work the same. Some of them, even those internet connected plugins will lead to hallucination. So you need to use the right one. So that's the first thing, is not using internet connected plugins when you start a chat. Again, there's really no reason to use the default mode in chat GPD. There's no real reason to use Browse with Bing when you're using an internet connected chat GPD plugin.
Starting point is 00:31:22 And again, yes, there are some limited use cases to use advanced. data analysis personally, I find better results by using a plugin like someone here in the comments mentioned notable, which is a great one that does some advanced computation. Wolfram Alpha does some good computation work as well. So number one, hallucinations. If you want to get rid of it, use internet connected plugins. Use that mode when you start a new chat in chat GPT. Yes, you have to have the paid version of chat GPT plus, which is $20 a month, well worth it.
Starting point is 00:31:54 And number two, our conversation for today, tokens. So I hope that going over this, answering a couple of questions, showing a hallucination on screen, right? So if you're joining this live, I showed this example, right, where I started in a new chat. I said, my name's Jordan. I'm from Chicago. I asked another question. Then I said, what's my name?
Starting point is 00:32:18 Where am I from? Got it right. Then I fed in just a bunch of nonsense, watched our token count, get up to a about 9,000, right? And I said, what is my name and where am I from? And chat GPD didn't know anymore. That is why you need to keep tokens in mind when you use chat GPT, right? Anyone that's been through our free PPP course knows this. And they're getting much better results because of this. But I hope this was helpful. I hope you know a little bit more about tokens, what they are, why they're important. And I hope you can join us back again for another edition of Everyday AI.
Starting point is 00:32:57 Thanks y'all. Meet Firefly AI Assistant. Now live in Adobe Firefly, the Allman One Creative AI Studio. Just describe what you want to create in your own words and the assistant handles the rest, orchestrating multi-step workflows across Adobe Creative Cloud apps, including Photoshop, Premiere Express, and more in one conversational interface. You direct the outcome while the assistant accelerates execution, Stay in control with the ability to step in and refine at any time.
Starting point is 00:33:31 See it today at firefly.adobie.com. And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going. For a little more AI magic, visit Your EverydayAI.com and sign up to our daily newsletter so you don't get left behind. Go break some barriers and we'll see you next time.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.