Everyday AI Podcast – An AI and ChatGPT Podcast - EP 259: ChatGPT's New Memory Feature - the good and the bad

Episode Date: April 26, 2024

Do we want ChatGPT to remember everything about us? Or, is this a new ChatGPT solution looking for a problem? We're covering ChatGPT's new cross-chat memory feature and how it might change t...he way you prompt. (For better or worse.) Newsletter: Sign up for our free daily newsletterMore on this Episode: Episode PageJoin the discussion: Ask Jordan questions on ChatGPTRelated Episodes:Ep 217: 7 Steps on How To ACTUALLY Use ChatGPT in 2024Ep 246: No that’s not how ChatGPT works. A guide on who to trust around LLMsUpcoming Episodes: Check out the upcoming Everyday AI Livestream lineupWebsite: YourEverydayAI.comEmail The Show: info@youreverydayai.comConnect with Jordan on LinkedInTimestamps:01:55 Daily AI news07:16 New ChatGPT memory feature08:08 Large language models struggle with remembering conversations.10:16 OpenAI posted about a new feature.15:06 Training AI to generate personalized responses efficiently.22:11 Temporary chats won't improve our GPT models.24:29 Problematic chat behavior requires better AI training.27:07 Custom instructions control informal tone and memory crossover.30:23 New memory feature slowing down response times.34:01 New memory feature works best with limits.36:00 AI newsletter referral contest for Meta Ray-Ban glasses.Topics Covered in This Episode:1. ChatGPT’s New Memory Feature2. Benefits and Drawbacks of the Memory Feature3. Suggestions for Improving ChatGPT4. Application and Actual UseKeywords:Temporary chat, UI, memory feature, ChatGPT, AI news, Elon Musk, XAI startup, AI podcast, AI newsletter, AI giveaway, smart glasses, Doctor Harvey Castro, Michael, YouTube, user engagement, memory management, corrections, Checkatrade, chat history, training data, profile improvements, referral contest, meta Ray Bans, OpenAI, paid users, settings, UI/UX improvement, auto-commit memory.Send Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info) Start Here ▶️Not sure where to start when it comes to AI? Start with our Start Here Series. You can listen to the first drop -- Episode 691 -- or get free access to our Inner Cricle community and all episodes: StartHereSeries.com Also, here's a link to the entire series on a Spotify playlist. 

Transcript
Discussion (0)
Starting point is 00:00:00 This is the Everyday AI Show, the everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business, and everyday life. Meet Firefly AI Assistant, now live in Adobe Firefly, the all-in-one creative AI studio. Just describe what you want to create and the assistant handles the rest, orchestrating multi-step workflows across Photoshop, Premiere Express, and more in one conversational interface. You direct the outcome. The assistant accelerates execution. One common thing that people complain about chat GPD and other large language models is they say it forgets things.
Starting point is 00:00:54 They say, oh, this model doesn't have a good memory. It gets confused. Well, there's a new chat GPT feature that might help this. It's called memory. But I think it's maybe a little more marketing than actual function. So we're going to be talking about that today and more on Everyday AI. What's going on, y'all? My name's Jordan Wilson, and I'm the host of Everyday AI.
Starting point is 00:01:19 We do this every single day. It's a live stream, podcast, and free daily newsletter, helping people like you and me just learn and leverage generative AI. So there's always new models, new tools, new features. So we're going to be talking about that today and see if we can help you get a little bit more out of chat, GPT, in this instance, to grow your company and to grow your career. So if you're new here, please go to your. for EverydayAI.com.
Starting point is 00:01:43 Sign it for that free daily newsletter. Maybe you can't make the live stream every day. Check us out on the podcast. Maybe you're on the podcast and you want to come hang out of the live stream and ask questions. You can do that too. So always make sure to check the show notes in the podcast for links to do that. So before we get into this new feature from Chat Chb-T,
Starting point is 00:01:59 and we're going to go over some of the pros and the cons. So, you know, I'm going to tell you right now, I'm not going to be using this a whole lot or at least not relying on it because it's actually going to be enabled by default once you do enable it. But we're going to get to that in a couple of minutes. But before we get to that, we're going to start as we always do. Well, not as we always do with the AI news. Actually, a quick reminder.
Starting point is 00:02:24 Oh, no, let's just go into the AI news. All right. So there was an athletic director in Baltimore was arrested for using AI to fake an audio recording. So a Baltimore high school athletic director was arrested for allegedly using AI to fake an audio recording of the school's principal, leading to his temporary removal. So the audio clip contained racist comments against black and Jewish individuals, causing significant repercussions within the school community. There was a three-month probe by local police and the FBI concluded that the audio was forged by using AI tools by this. high school athletic director. So apparently what happened is the principal had initiated an investigation into the athletic
Starting point is 00:03:12 director for potentially mishandling school funds leading to this retaliatory fake audio creation. You know, kind of a wild story, but I actually think this is going to become pretty commonplace with how good, you know, deep fake audio is and how easy it is now to, to replicate someone's voice. All right. Next piece of AI news. U.S. and China are holding their first. first high-level talks on artificial intelligence.
Starting point is 00:03:39 So the U.S. Secretary of State Anthony Blinken announced that the U.S. and China will engage in their first intergovernmental dialogue on artificial intelligence in the coming weeks. So the talks aim to address the risk and safety concerns associated with advanced AI technologies. And despite the discussions, no update was provided on the future of Chinese social media giant TikTok during the recent talks in Beijing. Yeah, that's going to be obviously a hot topic here in the next. couple of weeks. And the agreement also includes effort to stabilize and develop U.S.-China relations,
Starting point is 00:04:12 expand cultural exchanges, and to consult on international and regional issues. Yeah, I think the conversation on artificial intelligence is going to be an important one for the two different heads of state to have. I'd say right now, you know, the U.S. is in first, second, and third place when it comes to artificial intelligence and generative AI development. But I'd say China is probably right there after, right. It isn't really a race so far, I would say, but China is, I would say, top three world power when it does come to artificial intelligence, specifically when it comes to large language models. Speaking of large language models, last but not least, Elon Musk's XAI startup is nearing $6 billion in a new fundraising round. So XAI Corporation,
Starting point is 00:04:58 which is Elon Musk AI startup, is on the verge of closing a $6 billion fundraising round, according to reports. The fundraising would value the company at $18 billion, showcasing significant investor interest in the AI technology. So Sequoia Capital, big name there, among other investors, are set to participate in this funding round. So this move positions XAI to compete with, you know, more established players like Open AI, Google Gemini,
Starting point is 00:05:25 Anthropics Clawed in the AI market. So we'll see how this shakes out. I've said this. You know, I had a, you know, show, kind of my prediction show in December for 2024. And I said, you know, hey, there's going to be a lot of noise around XAI and GROC, which is the XAI chatbot platform. I'm like, you know, probably you shouldn't pay attention to it.
Starting point is 00:05:48 I still think that that's just my personal opinion. I don't see a lot of utility in this specific large language model, considering a lot of it is trained off of Twitter data, which is not the best data. All right. There's going to be more on those stories. and a lot, a lot other things that we dive into in the newsletter. So if you haven't already signed up, make sure you go do that. And, hey, did you not see this yesterday?
Starting point is 00:06:11 I know we had a long, you know, super long podcast for our one year anniversary. And, you know, maybe the newsletter went out a little late. But, hey, if you know, like two friends right now, I think the leader in our giveaway that we just launched was two. So we are giving away meta's AI powered Rayban smart glasses. and our giveaway ends Monday. So all you have to do is refer one friend to be entered, but the person who gets the most referrals is going to get their pick from our prize pool,
Starting point is 00:06:42 which does include the metast, you know, Rayvan glasses. So if you've looked at those, you're like, oh, those are cool. And we talked about on the news here the other day, now they have multimodal input and output. So, sorry, multimodal input, which is really, really cool. Hey, if you know three people, you're going to be in the lead. So make sure to check our newsletter, if you, you haven't already, you're going to get a unique referral code and you can go in and, hey, if you refer three friends as of like yesterday, you be in the lead.
Starting point is 00:07:10 All right. So let's get into this new chat GPT feature. And good morning from everyone joining this live. Dr. Harvey Castro said, hey, he just got the memory feature today. You need to test it out. All right. Well, hey, thanks. Thanks for letting me know, Harvey, because that's what we're going to be doing today.
Starting point is 00:07:26 We're not going to be testing it live per se, but we're going to be going over what you need to know a Michael Michael from YouTube said that he just referred someone hoping he wins well hey Michael if you know one or two more people you'll probably be in the lead so all right so let's talk about this new memory feature from chat GPT so I'm going to tell you what it is what it isn't how it works and suggest to you if if you should use it so here's how you will know if you have the feature I wish there was a better way but essentially you're just going to pop up so you know if this does sound like something that you're going to be taking advantage of, or if you're a pretty regular chat GPT user, make sure to look for that pop-up.
Starting point is 00:08:08 Also worth noting, if you use chat GPT on different devices, which is like what I do, you only see the pop-up once. Don't worry, I'm going to share it here, but this kind of just gives you a good overview of what this feature is. So it does a couple of things. I'm going to read kind of the marketing speak here, but don't worry. We're not just going to tell you what it is. We're going to dive into it.
Starting point is 00:08:30 So chat GPT says that it now has memory access across chats. That's the important thing here, right? Before, you know, whenever you would start a new chat inside of chat GPT or any large language model, one of the biggest things is it doesn't remember anything. So let's say that you're, you know, creating a chat in any model and, you know, you're getting some good outputs. Well, what happens then if you go into any other chat? It doesn't know anything that was going on in that chat, right?
Starting point is 00:08:58 So let's say you're telling it about your company, you're working on a research project, et cetera. And then if you start a new chat, that's kind of related to that. And if you wanted to recall some of that information, you can't. So that has been one of a pretty common downside of large language models is they think of it as siloed information. So, you know, when you're clicking new chat or if you go find an old chat and pick up the conversation, all of that information is siloed, which is obviously a huge downside. So this new feature from OpenAI inside ChatGPD looks to change that.
Starting point is 00:09:29 So essentially, it says you can keep the conversation going. It says chat GPT will carry what it learns between chats, allowing it to provide more relevant responses. It says it becomes more helpful over time. So it says chat GPT will become more helpful as you chats, continually remembering details and preferences. And that says manage what it remembers. It says you're in control, review and delete specific memories, restart from scratch, or turn off the feature in settings. All right. So yeah, I'm curious for the rest of you joining live if you have this feature yet or if what questions that you have about it. All right. So we're going to get into kind of the details of how it works. We're going to give you a guide.
Starting point is 00:10:10 But if you do have questions for our live stream audience, make sure you get them in now. But if you're listed on the podcast, we always leave a link back to this kind of LinkedIn thread. So if you are maybe driving or walking your dog and I say something, you're like, wait, that doesn't make sense. You can always come back and ask me and I'll answer. All right. So here's what you need to do. Well, number one, you need to enable it in the settings. All right. So this is actually in a different spot than when they first previewed it.
Starting point is 00:10:36 And this is also kind of important to talk about. So this is one of the first features that Open AI has posted publicly about before they did a general rollout. So they actually posted about this two months ago. And a lot of people forgot about it. You know, Open AI put out some information, I think, on their, on their, Twitter account on their blog on their blog posts. And this was two months ago. So normally when opening I post about something, they kind of just release it within a
Starting point is 00:11:03 day or two or it has already been a release and it's just a gradual rollout. So if you do have a paid chat GBT account, I do believe it is only for paid users. They were testing it with free and paid. So if you do have a free account and you go in and if you see this memory feature, let me know. But I do believe it is only rolling out to paid users. So like I said, when you log in, maybe today or tomorrow. The next time you go in there, you're going to get this pop up. And then you can go into
Starting point is 00:11:28 settings. So previously, this was its own dedicated kind of side panel. So you didn't even need to go into settings first. So they didn't move it. So you need to go into your regular settings. And there will be a personalization tab. Okay. And you'll see you can still have custom instructions going. So we're going to go over kind of the differences in the pros and the cons of working with each or working with one or the other. But then you'll see there's a simple memory toggle. So if you do maybe miss it on that pop out on that pop up and you don't enable it, or if you're starting to use it and later you're like, wait, this stinks. Don't worry, you can always toggle it off.
Starting point is 00:12:05 All right. So that's step one. You need to enable it in the settings. So here's what it's going to look like in action. All right. So I just did an example. I just started playing with this yesterday. We obviously had our big, you know, one year anniversary show yesterday.
Starting point is 00:12:21 So I've been a little busy. You know, we had a show of will AI take your jobs. It was our longest show ever. So make sure you go check that out if you haven't already. But so when you go into chat, you putt and you enter something, essentially, you're going to get this new little prompt. And it says memory updated. So in this example, I didn't have anything in, you know, kind of the memory bank, so to speak. So, you know, think of it like this. You bank memories. So if we literally think of the silo, you know, the silo analogy that normally they work in silos. So think of it like this.
Starting point is 00:12:53 You're going to have a base that's below all of your silos. So it doesn't matter. And this memory bank is that base. So it is going to selectively pull things out of your chats. And then you can go in and manage those memories as well. But this is essentially kind of like what it looks like for our live stream audience. It just committed these things to memory. So I just said in a new chat, I said, my name is Jordan.
Starting point is 00:13:19 I like deep dish pizza. I'm from Chicago. and I said people call me a robot sometimes. So right after I entered that, a new pop-up came. So I'm glad that ChatGPT did this piece because when this first came out, I did a little video review on it, at least on the blog post because they shared screenshots, they shared video recordings. And I said, this is terrible.
Starting point is 00:13:39 I said, if OpenAI actually releases it like this, this is going to make ChatGPT bad for everyone because in the original release, there was no pop-up kind of notification in your chat. So you could be chatting with chat GPT, put in whatever information, and it would just commit things to memory. And at least in their initial release that very few beta testers had access to, you didn't know when things were kind of put in the memory bank versus when they weren't, which can be problematic. And we're going to talk about that. So I'm glad they made that update, you know, maybe me bugging open AI so much about certain things. Who knows? Maybe that influenced them.
Starting point is 00:14:18 But now at least in the chat, it will tell you. memory updated. And then you get this little new pop-up that, you know, you probably haven't seen before. And it kind of shows you what was committed to memory. And then it gives you an option right within the chat to click on managed memory, which is pretty nice. So as an example, I said, my name is Jordan. I like deep dish pizza. I'm from Chicago. People call me a robot. So there's a little UI, ux tweak here that I think that they should make because I gave it multiple facts. And at least in this response back from chat, GPT, it looks like it just committed it as one. memory because it says Jordan likes deep dish pizza is from Chicago and is nicknamed robot.
Starting point is 00:14:56 Even though I didn't say I was a nicknamed robot, I just said people call me at robot. So a little in the details there, but still. All right. So now I can go in and manage that memory if I want to. So here's the other thing that you need to know. So now I opened a brand new chat. So we just committed that to memory. I'm going to show you how you can manage or talk to you and tell you how you can manage
Starting point is 00:15:20 that memory in the past, but I wanted to skip to the end and say, hey, here's how that works, right? So I kind of put those things into chat GPT. Chat GPT decided this is an important detail that I'm going to commit to memory. And again, it will do that automatically. You can tell it, you can say, hey, you know, put that in my memory and it will do that. But, you know, especially early on, it's going to be grabbing a lot of different things in your early on chats once you first enable this and just committing it to your memory. But then what happens? you know, let's skip to the end. So I just open a new chat and I said, write a poem about my favorite food.
Starting point is 00:15:55 So in this case, I didn't have to mention a memory. I didn't have to tell Chad GPT what my favorite food was. And then it responds with, here's a poem about Deep Dish pizza, inspired by your favorites, right? And then it even talks about there about Chicago, right? Because I said I'm from Chicago. So you can see right away how this could be useful, right? I'm sure that so many of you have to spend a lot of time in chat, GPT, or any other large language models, right?
Starting point is 00:16:22 Kind of re-reminding a chat, like, hey, like, I'm a researcher. This is what I do. You know, this is the type of information that I care about. This is how I want your outputs to look. So all of these different things can be committed to memory. All right. And then you'll see, you know, it's pretty useful in that regard, right? That you don't have to, you know, always remind it of certain things about you.
Starting point is 00:16:45 All right. So then you can manage your memory from the settings. So in the same way that you enabled it, you can also go click the manage button and then you can manage it. So I have some other kind of memory things here. I was trying to trip chat chp tup. You know, we always try to test these things and break them. So as an example, you know, here in another chat, I said, hey, Bob hates pizza. So I was seeing if it could, if it was going to get mixed up and if I said, hey, write a poem about my favorite food,
Starting point is 00:17:16 if I gave it kind of conflicting points of points of information, right? I said, hey, my name's Jordan. I love pizza. And then I just said, a imaginary story about this guy named Bob who hates pizza. And I was seeing if it would trip up,
Starting point is 00:17:28 but it didn't. But anyway, so you can go in and manage your memory. And you'll see, luckily here, so I said when it originally committed that kind of statement to memory, it looked like it was putting it in as one big chunk, but it didn't.
Starting point is 00:17:40 So it made separate kind of memory instances. So it said, Jordan likes deep dish pizza. That's one memory. Jordan is from Chicago. That's another memory. Jordan is nicknamed robot. That's another memory. So what you can do from this managed memory section is you can delete them all individually
Starting point is 00:17:57 or you can clear the memory. So one thing that I would like to see is the ability to edit a memory. So like even as small example there, when it says Jordan is nicknamed robot, I'm not. I was just saying people call me a robot sometimes. So I'd like to be able to edit that and update it. or even from this instance, I think it would be great if you could add new memories here, but you cannot.
Starting point is 00:18:22 So that's something important to keep in mind. Once chat GPD has kind of committed something to your memory bank, you can't edit it. Also, you can't go into manage your memory and add or, you know, can't edit things, but you can't add things either. All you can do is delete them. So you might have to,
Starting point is 00:18:37 if you are trying to commit certain things to your chat GPT memory, you can obviously tell it and say, hey, commit these things to memory, list them in bullet points on. new lines and it will kind of put it in that way. So that's probably how I would recommend people use this versus just giving, you know, chat GPT the freedom early on. So if you're going to go out and, you know, test this today or if you want to use it early
Starting point is 00:18:59 next week for a project, I would suggest doing it like that saying, hey, chat deputy, commit these things to my memory, bullet point them, make them very specific. Otherwise, what's going to happen is chat chip deep is going to take some, it's going to take some creative freedom in thinking what you want. committed to memory and even how it interprets certain things that you say. So that's important. You know, the managed memory part is a little tricky. So a couple of great questions here from from Woozy and Harold. So thanks for the questions. So Woosie said, interesting. In your opinion, as you're using, does it feel like it's trying to commit the appropriate things to memory?
Starting point is 00:19:40 So I'll say yes, you know, again, but early on, you know, I don't have a lot in the memory. I just started playing with this, you know, probably for an hour so far because, yes, it did just release to most people within the last day or so. So I haven't had a ton of chance, Woozy, to play with it. But I do have some thoughts on that here later in my little presentation. And then Harold says, I'm guessing if you correct it, that it will override its training information. Yes, that's a great question.
Starting point is 00:20:07 So it will delete those pieces of memory. So let's say it gets something incorrect. So even if you are in the challenge, chat and say, you know, I can say, oh, I'm not nicknamed robot. People just call me that, you know, update the memory. It will actually delete the old one so there won't be contradictory things. So yes, chat TPT will on its own kind of manage the memory on its own. So it's not like, you know, if I say, oh, people call me robot. It got it wrong. It said Jordan's nickname robot. So it's not going to have two of those different things. It will automatically delete the one,
Starting point is 00:20:40 you know, if I tell it to or if it realizes that it made a mistake in committing something to memory. Great questions. Great questions. All right. So let's get this thing. Let's keep going because here's some important things. So kind of number five thing that you need to know is you can start a temporary chat without memory. So you are going to have a new option when you go into chat GPT after you've enabled memory is there's something called temporary chat. So this is important and this is kind of where custom instructions actually come into play. And I'm going to tell you about that here in a second. So if you choose temporary chat, here's some of the toggles that come up. Also, I apparently, like, I have four chat GPT accounts. Apparently, I need more because I have two on
Starting point is 00:21:25 teams and I have two on free. But I just realized I don't have any on the normal chat GPT plus. So I don't know if this current feature, so, hey, if you do have normal chat GPT plus, which is $20 a month, I should actually explain them. So our team has chat GPT teams. So it's a little different. You pay an extra $10 a month, and there's actually a lot of nice features. There's some better sharing features, some more data control. And the thing that I actually like is you get double the limits. So you don't have that 40 message limit within a three hour period, which is what the chat GPT plus account limits are. So if you're on a Teams account, you actually have double that. You have 80 messages within a three hour window. But what I just realized is, I believe this
Starting point is 00:22:06 feature here may only be available to those on chat GPT teams. So apologies. but hey, if someone could let me know, so the temporary chat has something at the very bottom, but let me just tell you what it is. So it says not in history. It says temporary chats won't appear in your history. For safety purposes, we may keep a copy of your chat for up to 30 days. On a temporary chat, there's obviously no memory. So it says chat GPT won't use or create memories in temporary chats.
Starting point is 00:22:35 If you have custom instructions, they'll still be followed. Then it says no model training. So temporary chats won't be used to improve our models. Another important thing kind of related to this. So GPTs still work normally. However, you cannot commit things to memory right now while chatting with a GPT, just because for this very issue, because with the temporary kind of chat and what that kind of gives you a little additional,
Starting point is 00:23:08 you know, think of it like an incognito browser almost. saying, hey, when I'm, you know, doing all this chatting, it's not going to commit things to memory. So right now, at least as of my testing yesterday, the memory feature, if you are, quote, unquote, talking to a GPT will not work, mainly because, you know, the third party GPTs, it sounds like there's probably some data and security things that just aren't in place yet to be able to still have that, you know, quote unquote temporary chat functionality and still chat with third party GPTs. So that's important to keep in mind. So let's get back to the temporary chat and see what that looks like. So I actually like the, the, the, the, the, the,
Starting point is 00:23:44 UI of this, right? So when you have a temporary chat, I like this. It tells you at the top. So that's good. So you don't have to say, okay, is this a temporary chat where I'm not using the memory? But so in this case, I said, what is my favorite food? And then chat GPT says, I don't know what your favorite food is. But if you tell me, we can chat about it. So the good thing I like as well is at the bottom, the kind of text input box becomes this kind of dark gray or black color. So it's nice. So you have multiple kind of reminders that this is a temporary chat and you're not using that memory feature. So you might ask why, right? Well, there might be times when I don't want chat GPT to be maybe knowing about I'm writing about pizza or I'm from Chicago, right? So let's say
Starting point is 00:24:27 I'm, you know, or maybe you are writing something for a client. Maybe you're using this to write for, you know, multiple clients. So that's something with this memory feature and even custom instructions, which we're going to get to in a second. That's something I don't necessarily like, that it's not always super easy to toggle this on and off. I wish that there was an ability to toggle this memory feature on and off within a chat, but you do almost have to go into this own dedicated mode of a temporary chat. Because here's what I think, why that's problematic.
Starting point is 00:25:01 I think a lot of people are going to start a normal chat. They're going to keep going. And then all of a sudden, they're going to get this crazy response, right? And they're going to be like, oh, you know, I'm writing this for a, you know, I'm creating an SOP for a banking client. And now of a sudden it's bringing in my personal information, like what's going on here? And then you remember, oh, I'm in a normal chat. So it's bringing in all my memory. So you kind of have to start over at that point and go in and create a new chat and make sure it's temporary.
Starting point is 00:25:26 So I wish that there was a way to toggle this on and off within individual chats, which is another reason why I don't use custom instructions, kind of the same, same reasoning. So, uh, Adobe just introduced an entirely new way to create, bringing the power and precision of its creative suite into one conversational experience. Meet Firefly AI assistant now live in the Adobe Firefly app, the all in one creative AI studio. Powered by Adobe's creative agent, Firefly AI assistant lets you start with your vision, just describe what you want, and shape the outcome as it takes form with the assistant. The assistant orchestrates multi-step workflows.
Starting point is 00:26:12 drawing on 60 plus pro-grade tools across Adobe Creative Cloud apps, including Photoshop, Illustrator, Premiere, Lightroom Express, and more to help bring your ideas to life. You can also get started with creative skills, a growing library of pre-built workflows for common creative tasks like batch editing photos, creating mood boards, portrait retouching, and creating social variations. Every step the assistant takes is visible so you can refine, redirect, or take over at any time. You stay in the driver's seat as the creative director. Adobe Firefly AI assistant now in
Starting point is 00:26:47 public beta. See it today at firefly.adobie.com. So speaking of that, that is one of our last points that we want to make here in today's show is it can be used with or instead of custom instructions. So when you do go in your settings and you go to personalization to look at your memory, you'll see that you can still use custom instructions and memory at the exact same time. So here's kind of the difference, okay, custom instructions, if you haven't used them, or if you maybe don't know what they are, it is literally that. So you are giving instructions to chat TPT specifically on how you want it to act or how it should perform.
Starting point is 00:27:34 So you're kind of giving it instructions and you're saying, hey, you know, when you respond, always respond in an informal tone. So this is where I think there's, I wouldn't say confusion, but there's actually a lot of crossover here. Because when you go into your custom instructions within chat GPT, there's actually two different things. So custom instructions ask you, what would you like chat GPT to know about you to provide better responses?
Starting point is 00:28:02 Which is kind of what this whole memory thing is. And then there's another feature or another segment in custom responses that says, how would you like chat GPT to respond? So with memory, you should think of memory as, certain details about whether you, your client, your business, the type of work that you're using chat GPT4. So there is still a lot of crossover. And I think it's actually going to be problematic for people that like and use custom instructions to use memory because there might be some conflicting or slightly different custom instructions versus what's in your memory. So at least
Starting point is 00:28:39 for me, personally, I don't like using custom instructions because, again, you're you have to either enable it or disable it account-wide. So at least with the new memory feature, you can still use memory for some of those things that you might normally use custom instructions for. As an example, you know, all of your replies should be in informal tone or, you know, when summarizing a long article, you know, summarize in short bullet points. So you can still add those things to your memory, even though that might be something that you would generally use custom instructions for.
Starting point is 00:29:12 So the benefit here and kind of one of the reasons why I might be using this feature when I don't really use custom instructions is for that. So I can have now different chats that are saved in my account. Some of them are using memory and some of them aren't where at least with custom instructions, you do not have that ability. You have to essentially toggle it on and off for your entire account. So let's say if you did want to toggle custom instructions on and you were in an old chat, well, that one doesn't have custom instructions. So I kind of wish that chat GPT would just merge these things.
Starting point is 00:29:49 That would be a lot better. I think you kind of have these two different layers of customization. One, you can toggle with memory. You can toggle it on and off. Well, you can't really toggle it on and off, but you can choose a temporary chat, which essentially toggles it off. And then you have custom instructions,
Starting point is 00:30:07 which, again, can only be toggled on and off system wide. So a little confusing there, I'd say from chat, GPT. I would hope that OpenAI just combines these two features. But who knows? So that's something important. If you do want to use this new memory feature, again, think of it as you're pulling little bits and pieces of information, whether it's about you, your company, how you like to receive things.
Starting point is 00:30:31 Maybe you like similes and metaphors, right? So you can add a, you know, you can do this in custom instructions, but you can also do it in memory. You can say, you know, when explaining complex. topics, use similes or metaphors, right? So these are things, but they're going to follow you around in all of your chats unless you start a temporary chat. And then the last thing that's important to know, well, at least right now, this new
Starting point is 00:30:54 memory feature is really slowing down responses. Again, I'm not sure how it's working under the hood, but in my testing, it is taking a little bit longer, even if I'm, you know, asking something that maybe is not related to memory. or it's not pulling the memory, I'm finding the responses a little slower. The reason being now is, you know, you could think of this as like super mini rag, right? You know, you're putting these, you know, retrieval augmented generation, right? You're not putting in, you know, gigabytes of files. But each time that you're now interacting with chat GPT, it is kind of checking with this third party, quote unquote,
Starting point is 00:31:34 but it's checking with your memory bank each and every time. And at least in my early testing, I did know. notice that it was markedly slower, not a lot, but maybe I would say response times were taking 30 to 50% longer. It could be because this is a new feature. It's not fully optimized. It could be there's an influx of new users trying out this feature. But at least right now, this was slowing down responses. So whether it was committing things to memory, checking if something that I talked about was in memory or not, or replying to something that was in the memory, this new feature was slowing chat chaptimit down just a little bit. So that's
Starting point is 00:32:10 something to keep into consideration. All right. So that is it. I think there's a couple of questions. Let's go ahead and get to them. So Tanya saying doesn't mean that doesn't this mean that chat GPT could conduct bio, bio, sorry, this is very small, small font, essentially bio research on us. Yeah, I mean, technically, yes, but this has already been going on anyways. So yeah, Open AI can use all of this information for training data. So if you do start a temporary chat, it doesn't do that, right? So it's not going to be training, you know, its models on your memory and, you know, how it responds to those memories.
Starting point is 00:32:50 So yeah, I definitely, and Tanya, thanks, thanks for that. I always say never put any, you know, confidential, proprietary, you know, personal health information into any large language model, but the same thing. You probably shouldn't be putting in, you know, very personal details because in theory, those would be used to train future models. So that doesn't mean it's going to be in its data set, but it is going to be used to train their future models. Jonathan, good question.
Starting point is 00:33:18 Says, is it clear how to define when you were using a temporary chat versus a non-temporary chat? Thanks for that reminder. Yes. So it does have the little banner up top as well as the kind of darker response at the bottom. Whereas normally, if you're in a normal chat, it's kind of the white message input box. So you have kind of two different reminders there. All right.
Starting point is 00:33:40 I think we made it to the end. So I hope this was helpful getting this overview of the brand new memory chat. I'll tell you this. I'm going to be using this at least early on. I haven't used custom instructions because I use chat chbtee for a variety of tasks, right? I'm in chat dbt essentially all day. And this is where at least for custom instructions, you know, having this blanket application to everything, to all of your chats didn't really work out for me.
Starting point is 00:34:07 So I'll probably start using this because there are certain things that I would like to kind of commit to memory. And then having the ability to do this temporary chat is great as well. So if I don't want all of those kind of personal memory things to influence my other outputs, you have that option as well. So I would recommend that most people at least give this a try. It's going to work best. So this new memory feature is going to work best.
Starting point is 00:34:30 if you have a limited or a more limited use of chat TPT. So let's just say you use it just for your business or just for personal or maybe if you have clients, you use it just for helping create content or research for one client. But if you're using it for many different clients or many different reasons or, you know, personal business and side projects and clients, that's where I think you might run into some issues. And that's kind of how I use chat chbtee. So I'm going to give you this a try.
Starting point is 00:35:00 If you use ChantypT a ton for many different use cases, I think it's going to be a little tricky to manage that quote unquote memory bank. I think it would be nice if in the future that if it gave you kind of profiles to work on and you can choose a profile and hey, here's these 20 pieces of memory that go with my, you know, personal profile. Here's these 20 pieces of memory that go with, you know, the everyday AI business profile. But for me, I personally use Chats Chb-T and other large language models for so many. varied use cases that I don't think I'm going to be able to get a ton out of the memory,
Starting point is 00:35:32 but I'm going to try it out and I'm sure we'll be checking in. So that's it. I'd love to hear your thoughts and what you think if this is going to be a feature that you use. So if this is helpful, please consider sharing this with your network, leaving us a review on Spotify or Apple if you're listening on the podcast. And hey, do not forget, do you literally have three friends? Do you have three people in your network?
Starting point is 00:35:53 So literally to enter our giveaway, all you have to do is check our newsletter. either from yesterday or from today. There's going to be a unique referral link. Grab that, you can post it on social media. You can email it to 10 people, the two people. You can text it to someone. All right now, all you have to do is refer one friend to enter our giveaway. We're going to have multiple prizes, but our kind of marquee prize is these new AI-powered
Starting point is 00:36:19 meta-rayband smart glasses. They're really cool. They just added this multimodal functionality so you can put them on and you can say, hey, meta, what am I looking at? And it'll tell you, really cool. And like I said, we didn't have a lot of entries yesterday, which was surprising. So, but that's good for you. So if you find value in everyday AI, please consider signing up for that referral contest.
Starting point is 00:36:42 Check out the newsletter from yesterday or today. Tell a couple friends about it because, hey, as of yesterday, if you refer three people, you're in the lead for the meta rayban glasses. So that's not hard. We all know three people. All right. So that's it. Make sure to go to your everyday AI.
Starting point is 00:36:56 sign up for the free daily newsletter. Check out our giveaway, which ends Monday, and we hope to see you back for more everyday AI. Thanks y'all. Meet Firefly AI assistant. Now live in Adobe Firefly, the Allman One Creative AI Studio. Just describe what you want to create in your own words and the assistant handles the rest, orchestrating multi-step workflows across Adobe Creative Cloud apps, including Photoshop, Premiere Express, and more in one conversational interface. You direct the outcome while the assistant accelerates execution. Stay in control with the ability to step in and refine at any time. See it today at firefly.adobie.com.
Starting point is 00:37:40 And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going. For a little more AI magic, visit Your EverydayAI.com and sign up to our daily newsletter so you don't get left behind. Go break some barriers and we'll see you next time.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.