Women at Work - Chats, Bots, and Prompts: Make GenAI Work for You

Episode Date: November 11, 2024

There’s something about hearing how other women are making the most of LLMs that can turn even the most GenAI-avoidant among us GenAI-curious. At least that’s what happened to the Amys when they h...eard from several power users who’ve broadened their thinking, deepened their agency at work, and saved themselves time and stress. Maybe in listening to them you’ll be inspired too.

Transcript
Discussion (0)
Starting point is 00:00:00 Harvard Business School Executive Education develops leaders who make a difference in the world. In their programs, experience the power of fresh perspectives and connect with a world of new ideas. Learn more at hbs.me slash learn. That's hbs.me slash learn. Hi everyone. Like many of you, Amy B and I are taking in last week's election news and thinking through what it means for women and our workplaces. This show's mission is to help each other move forward together, including when things are very uncertain. Today's episode offers support in a completely different area of uncertainty.
Starting point is 00:00:50 Generative AI. We hope you find it helpful. You're listening to Women at Work from Harvard Business Review. I'm Amy Gallo. And I'm Amy Bernstein. Some of us have gone all in on generative AI. Like these audience members of ours. So I created this custom GPT for my job.
Starting point is 00:01:09 It was a game changer for me. Before, if I had a problem, it would take me one day to solve. Right now with these tools, I will do it, I don't know, in three hours. It drastically increases efficiency and proficiency. I am able to be a better leader, produce more work. I have definitely come to rely on it. I'm just so much more satisfied in my work because the opportunity to step back and look at things and translating it into something that's actionable for my teams, that's a huge value-add. Computers now speak our language so we
Starting point is 00:01:52 can use our own English language skills to tease what we want out of these tools. So you hire a fake team of researchers and each one of your fake researchers comes up with a research plan and then what's better is if you create a character who's a behavioral economist on the team, and the behavioral economist will come in and look at all the results of this research and tell you what's unrealistic. It's just unbelievably different and more impactful the stuff you can do. Aim, have you had these revelations in the AI yet? No, not even close.
Starting point is 00:02:25 I mean, I've asked it to do things that I was pretty sure it would fail at, and it did not disappoint me. So that just affirmed for me that I didn't really need to pay that much attention. Wait, what do you mean you asked it things you knew? Oh, maybe three months after Chachi BT debuted, I was writing a condolence letter and I don't know about you but I find those really hard. Hard to get started. Hard to get, actually, just hard to do the middle part and hard to end. But I thought, well, okay, do it. Write me my condolence letter and I came up with
Starting point is 00:03:01 several prompts and I was tweaking the prompts and you know it I came up with several prompts, and I was tweaking the prompts. And you know, it never came up with something that I could put down on a card and send. I'm kind of relieved at that, though, to be honest. That relief, I think, is exactly where I am with this, which is that I recognize it's powerful. I know it could be transformational for me, certainly for my work, definitely for the world. And yet I don't want to accept it. And so when it fails, I'm so happy. I still have a job.
Starting point is 00:03:36 Yay! You see? You see? Well, except these are early days and this technology is going to learn so quickly. I agree. I know it's going to change the way I relate to my work. How so? Say more about that.
Starting point is 00:03:53 Well, there are just aspects of my work that I don't like that this can help with. And we'll get into in a little bit the power users we've heard from because this is who I'm really basing this on. It's the women who wrote into us who told us how they're using it and whether we like it or not, whether we want it to fail or not, it's happening and so we have to be early adopters although we're late on that. We have to be middle adopters. We have to adopt. Let's just put it that way. We have to adopt. In listening to women like us, like you describe how gen AI has saved them time, broadened their thinking, deepened their agency at work, Amy B and I have gone from being skeptical dabblers to being skeptical enthusiasts.
Starting point is 00:04:48 Maybe listening will have the same effect on you. If you haven't yet tried your hand at Gen.ai, we hope these power users inspire you to finally give it a try. And if you're already using the technology, that you come away with some new ideas. One of the things I was really struck by was the mental and emotional relief that GEN.AI gave them. Blew me away. Yeah. Because of course I expect the opposite because that's been my experience.
Starting point is 00:05:17 It makes me anxious. I don't know how to use it. It's going to take my job. And for them to actually be able to Begin to use it in their day-to-day work and almost all of them use it on a daily basis but to relieve mental burdens such as burnout or task paralysis It's just been a huge source of of relief. Can we hear from yeah, let's listen to it let's listen to what Andrea has to say.
Starting point is 00:05:46 I would consider myself a middle manager. So at the time I discovered chat GPT and generative AI in general, I, like many people, was coming off several very difficult years. Difficult personally, difficult from a work perspective, and also very difficult as a leader. Going through the pandemic, we really wanted to be authentic
Starting point is 00:06:12 and present for what was going on in people's lives as individuals. And that's a lot. It was draining. And I definitely had reached the stage of burnout. That's a lot. It was draining and I Definitely had reached the stage of burnout and That's where the generative AI really made a huge difference in that was How much energy do I put into things?
Starting point is 00:06:38 Because there's so much in your day that just comes through right that? That you have to react to, react to, react to. And you definitely need to put some thought into it, but you're not writing the US Constitution. And so rule of thumb, if I'm likely to overthink it, let me think of a prompt, let me think of a way to respond to this that doesn't require as much mental effort or kind of right sizes the level of mental effort to the task at hand. Because the things that like I said shouldn't require so much of our energy often do, the power of being able to just jot down a few thoughts, make an executive summary of this. Boop! Here's three bullet points. Rewrite this for a group of cross-functional stakeholders. Boop! There it is. Make this sound more professional. Make it sound more casual.
Starting point is 00:07:38 Make it longer. Make it shorter. Expand on this point. Em this, define a call to action. Boop! It feels like a miracle. So when I think of the many, many moments of misery I've experienced in my career, I cannot tell you how high a proportion of them had to do with not being able to right size the effort and attendant anxiety to the task at hand. Yes. Well, and to not get stuck in that moment of how important is this thing, and if I know it's not that important, why am I spending so much time thinking about it? And what Andrea is describing is almost a way to short-circuit your perfectionism.
Starting point is 00:08:32 Oh, absolutely. You know, I'd love to hear from another listener who uses it in a similar way but in a different context to focus herself in a way that is more appropriate and will get her to her goal. Jessica McBride I'm Jessica McBride, the founder of Tech Savvy Assistant. I created Tech Savvy Assistant after being laid off from my EA tech job based out of New York.
Starting point is 00:08:57 I used ChatGBT because it was the original one and I realized quickly how functional and helpful it was for admin roles, especially, because there's too many nuances that go into what we're trying to solve that cannot really be encapsulated by a Google search. And so by using ChatGVT, I was able to take these severely nuanced problems and parcel them down into something
Starting point is 00:09:19 that was a much more accessible way for me to take a problem on. A problem that we come across a lot of times in the admin field, is somebody comes to us and they're like, ''Hey, I'd like for you to do an event.'' They give us this big idea, synergy. I would just be like a deer in the headlights. But you can workshop this idea of like, ''Okay,
Starting point is 00:09:37 we need to do a three-day conference based around the idea of synergy.'' Help me come up with a step-by-step guide on how to produce this event. And what I love about it is that, yes, I'm perfectly capable of creating this event on my own, but what am I going to miss? What steps am I not noticing? What else would I like to take into consideration for this? And it's going to give such a well-rounded idea of what you want to create. It's just giving you the roadmap. A lot of people in my industry lashed on this idea
Starting point is 00:10:12 of AI isn't going to replace you and EA using AI well. And I don't like that. I think that that is anti-fellow worker. I believe that we should be using AI to empower our careers. I think it's no different than, you know, getting introduced to the internet. This is the next level of like, I just need to learn how to embrace and use it and utilize it to the best of my ability. And I can really empower my career and become the next generation of executive assistant.
Starting point is 00:10:37 There are so many things that we can do to like increase the culture and be strategic business partners and think and expand that I did by just talking to other leaders in our organization and solving problems. But you can use AI to help you solve these problems. What I heard in that that really excited me was this idea of breaking down the daunting challenge into completable tasks, right? I found myself wondering if LLMs are freeing admins to do higher level work.
Starting point is 00:11:12 How are they doing that? You know, and Jessica has really tackled that. It's incredibly impressive. She has figured out how to use the technology to do a better job of identifying her executives' objectives. And she's actually codifying. Codifying and making it available. All of this and making it available to other EAs, which is just so smart.
Starting point is 00:11:33 I have the guide in my hand, Aime, and let me just read you some of the others. Identifying resources and obstacles. I cannot tell you how many hour-long meetings I've sat through, participated in, where we were trying to identify resources and obstacles. And she has a bot that does that. Developing an action plan. When I read this, I thought, well, this is everyone who has anything to do with formulating strategy and executing on strategy.
Starting point is 00:12:01 And she's, again, making that available to anyone. That's one of the things that I think is really encouraging about these power users is so many of them are not just creating these tools for themselves, but also thinking about how it can benefit their clients, their friends, their community, their network. You can visit techsaviasistent.com and on there you'll find things like my newsletter that goes out weekly that often includes videos and clips of how I'm utilizing ChatGPT. I also have a community that you can join. So it's really focused on like keeping you current and what is happening in technology.
Starting point is 00:12:38 The other thing that I heard in Jessica and Andrea's stories were that they are using it to get unstuck. I want to go back to that for a second because, you know, as you said earlier, the amount of agony we've spent in these indecisive moments, and it's something I actually really worry about with myself is that I tend to be indecisive about certain types of decisions. And I've actually worked with a coach to help me on certain decisions. So like when an opportunity comes to me, whether I say yes or no is so overwhelming to me. And I've actually worked with a coach to come up with the criteria,
Starting point is 00:13:17 when will I say yes, when will I say no? And I go through that criteria, I rank it, but as I'm listening to Jessica talk, I'm thinking, why don't I make that a bot? Why don't you make that a bot? And just, I already have the criteria. I can feed it decisions I made before, so it knows what I've said yes to. I can also feed it all of the sample language
Starting point is 00:13:38 I've developed around saying no, because that's often the hurdle, is that I decide I'm going to say no, but now I have to write the no, and that's really uncomfortable for me. So I can feed it that sample language, and I can say, should I say yes or no to this decision? Why? Using my criteria, tell me why. Can you please write a note saying no if the answer is no, it often is. Yeah, and it really brings home to me how we're really only limited by our own imaginations.
Starting point is 00:14:06 How we could use this technology. And you describe the steps. It's not that complicated. It's not. But if someone said, oh, you should develop a bot that will help you make decisions, I would, two weeks ago, I would have said, yeah, that sounds great. Never. Like, I don't have the time for that. Will the amount of time I'm going to put in actually benefit me? Like, no. But listening to these women describe how they're using it makes it seem so much more doable. Yeah. And it helps externalize that anxiety. If you do it right, you're going to get to the same conclusion, but you want to put yourself through all the stress of getting there. Right.
Starting point is 00:14:46 We have some other users who have been using it as sort of thought partners. And I'd like to hear from them in terms of how are they using it to both get unstuck, but also helping them generate ideas and think creatively. Because I think that's one of the things we've often thought it wouldn't be able to do, is creativity. But let's hear from Pam first.
Starting point is 00:15:08 So for example, I am working on an account-based marketing program for a client, and I'm a marketing leader, so I've done a lot of account-based marketing programs in my day. But it's really easy to sort of get stuck in a rut. So I actually put a prompt and said, I am working on an account-based marketing program for this company. We want to save these types of messages. What are some tactics that I should think about? What are some approaches that I should think about?
Starting point is 00:15:37 And it actually came back with a list of the personas that I might be contacting. And the kind of company that I'm working for is in the HR space. So I'm used to speaking to chief human resources officers and heads of recruiting and heads of talent. But one of the suggestions that it came back with was heads of operations. And I said, oh, that's really interesting. I've not really worked with that persona before.
Starting point is 00:16:00 So I kind of furthered that query and said, okay, tell me about heads of operations. Tell me about that persona. So the suggestion that it came back with is heads of operations are really thinking about costs and cost savings and to consider building a calculator based on some very specific criteria and metrics related to operational costs. It would have never occurred to me to do that. So whether we actually do that, and I could have, and I probably will at a separate time, continue that conversation with the AI to tease out other ideas for reaching out to that buyer persona. What I like about that use case is that because one of the hesitations and one of, I will
Starting point is 00:16:43 now say an excuse that I've been using about not using GenAI as much is that it's not accurate. That's a great case where it doesn't need to be accurate. It's just suggesting something she might explore. And in partnership with her, continuing to explore it. So, you know, she even says whether we actually do that or not, that's yet to be seen, but it's a new idea for me to think about. Right. That's creative. Yeah. And to think about the sources of input I get on a project I'm working on, right? Who am I not reaching out to to get that input? Or I have a target audience when I'm writing
Starting point is 00:17:22 an article. Who am I not considering part of that target audience that might be it? I mean, it used to be we had to spend tens of thousands of dollars, maybe more, and months to get that data about potential readers. But now we can begin to imagine who else might we include. And that's going to change the way we think about ideas, the way we market the products we create. The thoroughness of the consideration. Could you always worry about what you're missing? Yes.
Starting point is 00:17:53 Everything we're talking about here, while we're a little bit starry-eyed, it's also making me uncomfortable. I don't know. Sure. Yeah. Because if these agents can do such a good job, then what do we need us for? And that's that is a huge question. It is. And unanswered. Unanswered. So I'm gonna
Starting point is 00:18:17 say a year and a half ago I was recording a conversation with Kareem Lakhani, who is one of the experts on AI, and particularly a generator of AI over at Harvard Business School. And he was saying to me that, you know, it would take almost nothing for him to create an Amybot, I edit him. He's got a lot of correspondence for me,
Starting point is 00:18:41 he's got all of the marked up drafts. And he said, yeah, it really wouldn't be hard at all. Just recounting this to you is giving me the chilly horrors, right? Yeah, because I know he could do it. Right. Well, but why didn't he, I wonder? Why didn't he? Like, is it out of respect? Or is there something he knows? Oh, he's got way more important things to do. Or is there something he knows? Oh, he's got way more important things to do with it. Well, maybe that's it. Maybe that's it. He's like, I'll let Amy
Starting point is 00:19:08 keep her job, because I'm too busy. Thanks, Kareem. Alright, well let's talk about another way that these women are using AI. And in particular around professional development and career empowerment.
Starting point is 00:19:24 So I am Barbara Ruiz. I'm an SAP consultant and I started using AI because my dad taught me. It was a game changer for me because in my role as SAP consultant, there is a lot of deep analysis, complex problem solving. So I created this custom GPT for my job. I put how I wanted the GPT to present me the information and then also where I wanted the information to be retrieved from and also some PDF that I had with knowledge I have been gathering through the years. I now solve technical issues that before they were like outside of my expertise because the GPT will guide me step by step. And even if it won't give you the solution,
Starting point is 00:20:10 it can give you very good hints of how you can get to the solution. It's faster. It requires less people also because then I don't have to go all the time to developers. And I feel honestly is very empowering because now I don't need other people to help me. I'm just like, I can do it by my own. I just I'm very happy to be able to to improve my efficiency
Starting point is 00:20:33 and to have also a bit of free time because that also have helped me to to have free time. The thing Barbara said about working more independently and not having to call the developers, I found that really both exciting and terrifying. What happens when we don't need other people anymore, Amy? And this is one of the things I always worry about in new technologies that promise efficiency, is that sometimes the most efficient way isn't the best way.
Starting point is 00:21:04 And there's a certain amount of friction that we need to generate new ideas to form relationships, to build trust, to resolve conflicts that I worry we're trying to sort of smooth the edges of the messiness of work in a way that's going to end up dampening our humanness. But I think that's a good segue actually to hearing from Julie, because she used to work for a company doing user research and customer development, but she recently went independent and actually has a startup that creates personalized meditations for children. Such a great idea for a company, right? And needed to create an interactive website to do that.
Starting point is 00:21:47 And she wasn't sure how to do it. She wasn't a web developer. She didn't have these skills. And what she did, to our point about who do you turn to, do you need actual help, is she created a fake team, a multi-agent team that could help her do it. And it worked. Let's hear it.
Starting point is 00:22:04 We can talk about what this makes us feel, but than to help her do it. And it worked. Let's hear it. We can talk about what this makes us feel, but let's hear her describe it. So I went over to Claude and I said, you are managing my development team. On my team, I have a software engineer, I have a code executor, I have a designer, and I have a planner. I'm going to tell you what I want and I want you to manage these four people for me and solve my problem." And it was bonkers. Over the course of the next few weeks, I completely, from somebody who doesn't know how to code,
Starting point is 00:22:35 it's not just not even knowing how to code. It's not even knowing how do you use GitHub? How do you push to a server? What's my tech stack? How am I doing any of this? It wrote me every single piece of code that I needed, told me where to put it, told me how to execute it, helped me get set up with GitHub. I got Google Analytics.
Starting point is 00:22:55 I mean, this was a website I wanted to look a certain way. I can't just copy and paste every single thing. So it would create some code for me, and then I would ask it questions like, why did you do this? Explain this to me? How am I using this technology? Why are things working in this way? And so I will never be a software engineer, but I am a lot closer than I ever was. And like now I can actually have conversations that I couldn't have before. And I was honest with it, which more honest than I would be with a real person.
Starting point is 00:23:20 I would say, look, I don't understand this. Explain it to me like a person who doesn't understand this. But it was bonkers. I mean, it worked. I don't understand this. Explain it to me like a person who doesn't understand this. But it was bonkers. I mean, it worked. I did something I could never do. Well, and that sound you just heard was another industry going down, right? The death knell, the death knell.
Starting point is 00:23:38 But to our point earlier, I do think there's something missing. I don't know if it's a lack of expertise, but that sort of creative energy. But then I hear in Julie's voice, it sounds like she got it. I don't hear anything sort of lamenting the loss of human interaction. Well, it definitely addressed her need and did it in an efficient way, in a way she couldn't have done on her own, to me it highlights the importance of the smart dumb question, you know, the generalist
Starting point is 00:24:10 intelligence, because we're blinded often by our expertise. And in this case, a lot of what she brought to the party was knitting together all of that work by asking the non-expert questions, you know? Yeah. My eighth grade teacher, eighth grade math teacher, had this big sign in her classroom that said, the only dumb question is the one you don't ask. And I think about that a lot in the work that I do, because oftentimes people don't ask the question because they're afraid of looking stupid.
Starting point is 00:24:42 And Julie refers to that. She was asking questions that she probably wouldn't have asked a live human because they're afraid of looking stupid. And Julie refers to that. She was asking it questions that she probably wouldn't have asked a live human because she was afraid of looking like she didn't know what she was doing. Right. It removes some of that ego too, from the process of, I can ask it a really silly question and not have to worry about what it thinks of me. – laughter –
Starting point is 00:25:02 Which actually is a big part of work. Right? Like how often are we thinking, should I say that? Should I ask that? What will that person think of me? You know, like that's what... Oh, for me, it's always, did they already say this? Because I'm so often... Yes. Right. I have started starting to send this. Someone may have already said this, but... Someone may have already said this, but. Yeah. Yeah. Harvard Business School Executive Education develops leaders who make a difference in the world.
Starting point is 00:25:31 Their renowned faculty members are skilled educators. They combine real world experience and a variety of distinctive teaching approaches to create an exceptional learning environment. In their programs, you'll experience the power of fresh perspectives and connect with a world of new ideas. Learn more at hbs.me-learn. That's hbs.me-learn. So Julie, who we've heard from, has been working with small groups, trying to help
Starting point is 00:26:08 them understand what LLMs can do for them. And she poses it as what problems can LLMs solve. And the one that I think probably is most surprising. People had no idea you could solve interpersonal conflict, whether it's work related, whether it's family related, all sorts of stuff. And just the way it approaches solving it was very surprising for people.
Starting point is 00:26:36 So you describe that person that you're having a problem with into the, I use ChatGPT, you could use Cloud. So you describe the problem, explain the whole situation, explain the backstory. I keep having this conversation over and over and I'm really frustrated. I don't know where the actual problem lies and I really wanna fix this. Ask me questions one at a time
Starting point is 00:26:55 to make sure I'm seeing it clearly. By the way, you're an expert at interpersonal dynamics in the workplace. Actually, that's something I might do, is I might say, you're an expert. So before you even describe your situation, you're an expert at handling interpersonal dynamics in the office. When two people are having an argument, you come in all the time and you help
Starting point is 00:27:14 people who have the same conversation over and over, and you often find they're seeing it wrong. Give me seven ways that you have helped people in the past and give me your backstory so I know why I should trust you. And having it go into that much depth before you ask your question really helps it be smarter. All right. So what Julie just described was an Amy G bot. And now I have to ask human Amy G what she thinks of that.
Starting point is 00:27:44 What do I think about 45 different things at the same time. One of the obvious ones is, yep, I'll probably be out of a job, especially if I can train an abot to do exactly what I do, which is to give that advice that she's prompting it to give. So in some ways, it's a thread. I'm putting that in air quotes, to what I do, but I think more than anything I actually find it reassuring because the person is pausing to ask the question, how do I do this differently?
Starting point is 00:28:17 And that is usually anywhere from half to like 80% of the battle in interpersonal conflict, which is to pause, think about what am I doing, how do I not respond from a place of reactivity, how do I respond in a thoughtful way and how do I respond in a way that considers who the other person is and what might matter to them. So the fact that we have tools to accelerate that process makes me so excited. The issue is at some point I envision, right, you and I get into a disagreement on Slack and we say let's just let our bots hash this out. These better evolved versions of ourselves that won't get emotionally worked up who
Starting point is 00:28:58 can maybe just solve the issue. I prefer the trial by combat. Well, you and I like a good fight, let's be honest. But it's forcing us to do the thing that's so hard as humans to do. We're almost hacking our broken brains in those moments of conflict to get to a better answer. And I do think there should be an A.M.E.G. bot. Well, in fact, I'm not quite there, but I'm taking an initial step of creating and training a custom GPT to be me. And actually, with the help of Alex Samuel, who I think you probably know, she's a data
Starting point is 00:29:35 journalist, she's been a long-time contributor to HBR, she's an expert on the digital workplace, and she and I had a conversation about how I could create a bot that's going to help me start to create content in a different way, in a way that's easier and that helps me with the like, wait, what have I said about this before? I know I've said something about this. When do I think of this again? And so I'm not going to be at the point of like a stranger can ask Amy G. But Amy G. is going to ask Amy G. what should I think about this?
Starting point is 00:30:08 What have I said about this in the past? So the next thing you'll hear is my conversation with Alex as she walks me through what all of this involves and helps me get over my big hesitations around it. I'm looking forward to this. Or not. I went through some of your stuff because I was thinking like what would we scrape of Amy's to be able to make a virtual Amy and well Alex you and I have been writing for HBR around the same time and pretty much every time you come out
Starting point is 00:30:39 and say you got to try this new thing and your HBR writing and I go not for me and then like two months later I'm like oh gosh I got to go back and find that and say, you gotta try this new thing, and you're HBR writing, and I go, not for me. And then like two months later, I'm like, oh gosh, I gotta go back and find that Alex article. Like you have always been making me uncomfortable about what I need to do next, and then helping me through the process. Thank you, I really love that.
Starting point is 00:30:59 Also, I think that's gonna be my new LinkedIn byline, making you uncomfortable since 2009. That's right. I'll be honest, before we even started talking about this episode, there's part of me that really wants to create a Amy GPT that can give advice. Like that's what I'm in the business of doing. And so I'm not ready to be honest for a variety of reasons to do that. But I think ultimately I do want to get there, but there's some serious hurdles
Starting point is 00:31:33 mentally for me to get there. So I think by trying to make an internal GPT, I think it'll help me build more trust with the technology and get me more comfortable. One of the things I want my GPT to be able to do is help me with brain fog, which is related to menopause certainly, but also related to age, also related to overwhelm, occasional burnout I have, right? So I actually have written so much,
Starting point is 00:31:59 I don't even know what I've said on certain topics. And so that's part of what I want the GPT to help me do. I also want it to help me come up with new ideas, like make connections between things I have written or said or posted about and come up with new ideas for newsletters or articles. And just sort of be the better Amy. Like, can it do that? So even when you customize an AI with your own content and with thoughtful instructions that reflect how you like to work, it is not
Starting point is 00:32:35 you. And that's good for those of us who still like to earn a living by being ourselves. And while as writers and thinkers, we're always interested in what's new and what's next, for our readers and the audiences and the organizations we are trying to serve, often what is most useful is what we have already shared, already thought through, already said, but updated to this context, a new framework, a new structure, a new social network. And that is where these AIs are just terrific, is kind of taking what you have already done and remixing it a thousand ways in two minutes. Right.
Starting point is 00:33:17 Okay. Can I actually trust what it's going to do for me? And can I trust it to not make me look dumb? I don't think I've published a sentence that was written by an AI except in instances where what I'm doing is saying here's something that was written by an AI but I also can't think of when I last wrote something without the help of an AI and there are a lot of mechanisms you can use to improve the quality of what it's doing for you in the way of background
Starting point is 00:33:52 research, including telling it what to draw from. And that's what you do when you give it a collection of your own work. And that's what you do if you ask it to summarize 10 specific PDFs rather than go and you know find its own sources on workplace conflict. So you know in my case for example I have this Claude project I have it both as a Claude project and as a custom GPT that I call the Alexerizer and the purpose of the Alexerizer is to make content that sounds like me, Alex. And in order for the Alexerizer to make content that sounds like Alex, it has to understand what Alex sounds like.
Starting point is 00:34:32 So I have given it a whole bunch of files that are kind of a snapshot of the breadth of my work in different contexts. And by giving it that range of content, it is able not only to sound more like me, but it understands my work, it understands what kinds of work I've done over many years, and it also understands how I write differently in different contexts. So if I want to train the aimerizer, and I'm going to be able to pronounce that better by the end of this episode, if I want to train it on my HBR articles, my LinkedIn posts, and my newsletters, how much of each of those things would you suggest? Well, I would suggest a couple things.
Starting point is 00:35:18 What I would probably do in your circumstance is I would think about kind of your greatest hits or your foundational pieces. Like you're trying to configure it with three related sets of knowledge. One is actual stuff you think and know and say. So you need to make sure it has the core knowledge, your core principles, you know, the things that you come back to time and again as core themes, you want to make sure those are all in there. So that's the knowledge piece of it. Then you want it to understand style. So from that point of view doesn't necessarily take a whole lot, right? You want to pick the newsletters that really reflect what you like most. And again, you can have a separate file
Starting point is 00:36:07 that is the voice file, and I've done that as well. I've picked, there's the ones that I have that are my body of knowledge, and then I'll pick three or four articles that are, this is gosh, if I could always write this well, this is how I wish I always sounded. And then those are the voice files. And then there's a third piece beyond
Starting point is 00:36:27 just the knowledge and the voice, which is process. And so part of where my Alexerizer provides value is understanding how do we go from Alex's 2000 word first draft to her 1200 word second draft. And because I hate that process, I love it when the AI can help me. And then also, when I finished the article or finished the newsletter, how do I go from here's my 1200 word newsletter, now I want that chunked into a series of LinkedIn posts. So in order to train the AI on the process, I've given it some kind of matched pairs of content. I have an article I wrote for the Wall Street Journal where I gave it every draft along the way, including the email exchanges with my editors and what kind of feedback they gave me. And
Starting point is 00:37:16 then I gave it the final article so it can understand, here's how we go from first draft to published article. And then I did the same thing with one of my newsletters. Here's how we go from first draft to published article. And then I did the same thing with one of my newsletters. Here's a newsletter, here's a series of LinkedIn posts based on that newsletter. I want you to use that as a model. And that's what goes in the custom instructions. When you're taking Alex's newsletter and turning it into LinkedIn posts, use these two files and use that as your model. So what I would say is in terms of volume, I would think in terms
Starting point is 00:37:45 of like those use cases, what do you want the AI to do for you? Do you want it to be writing your articles for you? Probably not. Do you want it to understand how to turn your notes into a first draft? That's what I want it to do. So the next time you're writing an article from notes and interviews, take the interview transcripts. If you use a recording tool that does AI transcription, take the transcript. Then take the notes where you have personally picked out the quotes that you thought were useful from those interviews. Then take your outline, take your graphs, put all those pieces together into a file called, you know, you might have one file called interviews for article, one file called notes for article, and one file
Starting point is 00:38:33 that is the final article. The more you kind of annotate and structure that notes file, the easier it is for the AI. So say, you know, outline first draft, you know, write these as subheads within your notes file. And then you give those to the AI and you say, this is your model. Take a look at how I choose the quotes to use. Take a look at how I turn an outline into a draft. You're teaching it to think like you by giving it examples of you along all stages of the process. Yep. And then giving it examples of you along all stages of the process. And then create the greatest hits file that is your kind of content file that gives it, here's the essential inside of Amy's brain.
Starting point is 00:39:14 Give it your bio, your speaker profile bio, so it knows how you position yourself in the world and then give it some samples of voice and you can even annotate those to say, this is my voice on HBR, this is my voice as a speaker, this is my voice on LinkedIn. And when you write the custom instructions, which is a separate file that can be quite long, you know, I think on GBT the limits 8,000 characters, that's where you tell it how to reference these different pieces and how you give it the overall instructions of what it's doing for you.
Starting point is 00:39:49 Namely, writing in your voice, writing first drafts, assimilating background material. And can you change those instructions? Anytime. Okay, good. I change them all the time. What does the future hold for business? Can someone please invent a crystal ball? Until then, over 40,000 businesses have future-proofed their business with
Starting point is 00:40:13 NetSuite by Oracle, the number one cloud ERP, bringing accounting, financial management, inventory, and HR into one platform. With real-time insights and forecasting, you're able to peer into the future and seize new opportunities. Download the CFO's guide to AI and machine learning for free at netsuite.com slash womenatwork. That's netsuite.com slash womenatwork. Okay, one of the things we haven't talked about, which I think is really important, is getting permission to do what I'm doing from whoever needs to actually know.
Starting point is 00:40:56 So in my case, I'm not a full-time employee at HBR, but because of this podcast, because of my writing, I am subject to their Gen AI acceptable use policy. So that's a piece we've started to figure out. And actually, as we've been talking, we got a note from the compliance and data associate director saying that we could actually use Claude for this, which is great. So I just want to note that for anyone following along who's like, I'm going to do this too, right? Important check mark.
Starting point is 00:41:25 What kind of advice do you give people in terms of getting, making sure they're complying with whatever appropriate rules, laws, policies? There's two things. One is, and this is perhaps a slightly sensitive issue, always hold onto your copyright. We are all generating content all the time. We are creating the seeds for our own self-replacement. If you are an employee and your work is therefore work for hire, then everything you type between nine and five belongs to your employer. And that's right.
Starting point is 00:41:55 So I'm more worried about it, to be honest, from the employee's perspective than I am about the employee violating compliance rules. But for sure, you want to keep on top of your employer's policies, and I think you also want to be really careful about where you create these files. So yes, there is the theoretical possibility that your employer can take all your work product and make a virtual you, but most employers aren't there. But if you have meanwhile taken all your own work product and concatenated it into these giant files and built your own custom version of you that you're using and you have done
Starting point is 00:42:31 that and stored those files on the company file server, you're sure making it easy for them. So I would actually recommend to people that while you obviously don't want to violate your company's policies on AI, you also want to protect yourself by making sure as much as possible that when you're creating these tools that allow you to like automate portions of your own workflow, that those tools are on your computer, that those files are on your computer, again, as you know, within the bounds of what's consistent with your company's policy because we should all be worried about protecting
Starting point is 00:43:08 what remains of our own personal IP. Yeah so while we stay up at night wearing that our employer is gonna replace us with Gen. AI we also want to make sure we don't get fired before that even happens by violating the policy. That's sort of how I interpret what you just said. I think that's a good way of putting it. Yeah. So I think I have what I need to get started, but I'm curious, what didn't I ask you that I need to know just from like a practical step, I know I need to
Starting point is 00:43:38 think about the use cases, I need to think about voice, knowledge, process, files, the instruction files. It's a lot of work with hopefully the result that it's going to save me time. But what else haven't I asked? One thing I would say is really helpful to keep in mind when you are writing those custom instructions is to tell it both what you want it to do and what not to do. Let it know what your weak spots are. Say you'll see in my example that I use
Starting point is 00:44:06 a crazy amount of M dashes, but everybody's always telling me not to use so many M dashes, so your drafts shouldn't use those. Like even small things. Word repetition. Yeah. Yep. Oh, here's a real one. It is a huge challenge to get an AI to write a conclusion that doesn't begin in conclusion. They love to begin in conclusion. So actually, I, part of my custom instructions and some of my AIs is never say in conclusion, just don't. I love that. I love that. So wait, how do I know when I got it right? I could just seed my AI system, my custom GPT with like knowledge files and tweak the instruction. Like I could just do that forever. How do I know that I got an A plus? That's what I'm asking Alex.
Starting point is 00:44:46 There is no A plus. I'm sorry, Amy, you will never get an A plus. The finish line will move infinitely. I mean, on the one hand, I hate all the AI hype. And on the other hand, I basically want to tell you that I think this is the biggest revolution in how we think and connect and work as people. That quite apart from the tangible benefit of
Starting point is 00:45:08 getting your amyarizer working so that you can make your articles faster. That process is how you're gonna understand what is happening to our world now, what's happening to our work and what can happen to each of our own creative processes and it is terrifying and overwhelming all the time. And in a way, that's exactly why I want like you personally to be doing this is because the nature of your work is such that you are one of the people who needs to help everybody else through all of the rough moments that are going to happen during this transition. Okay, I'm excited and terrified.
Starting point is 00:45:51 And that was like an incredibly good pep talk. So thank you. I'm ready. Like not only, not only can I do it, not only like will I do it, but I need to do it, you just told me, which is okay. Here we go. So Amy G., it's been a couple weeks since you mentioned that you are programming the Amy G. bot. How's it going?
Starting point is 00:46:16 It's going well, actually. I would say the interesting thing about the process is that it was a huge hurdle, mental hurdle for me to overcome. And I knew that. In my conversation with Alex, I knew I was going to struggle with finally taking the step to do this. And it was even bigger than I expected. And our poor producer, Amanda, kept messaging me, have you started? How's it going? And I was very honest with her and told her, I haven't done it yet, I'm gonna do it, I'm gonna do it. And the hurdle was really about sort of trying to figure out what is this thing doing? And is the work to set it up going to be worth it?
Starting point is 00:46:58 So what does the AmyBot do exactly? So right now, it's really to help be a partner in my thinking particularly around like my newsletters, my LinkedIn posts, maybe even article ideas. It's meant to help me come up with ideas and maybe copy for short things like posts not obviously an article that just sort of get me started. And so it's supposed to save me time. One of the things I know you can appreciate this, and I'm sure many of our listeners can, which is that one of the things that has suffered in the current busyness of my schedule is time to think. And so just
Starting point is 00:47:35 having a partner who I can bounce things off of is what I was looking for. Okay. So give us an example of how AmyBot helped real Amy think. Yeah. So, this is the thing it's been most helpful at. I have a newsletter for my own business that I send out twice a month. I uploaded every newsletter I've ever written into it and said, can you help me think of ideas for future newsletters? And it came back, because I had given in the instructions, I said, don't answer the question right away, ask follow-up questions, which I think I might
Starting point is 00:48:08 need to change that instruction, but I'll explain in a minute. So it asked me, do you want me to look at fresh new ideas? Do you want me to look at follow-ups to existing articles? It prompted, what do you actually want? And I said, oh, I'd like a follow-up to an existing newsletter. And it pulled one from January 2023 and said, you mentioned gossip in this article. Maybe you want to write a newsletter all about gossip. And it gave me three ideas, all of which were great. And I will say the reason I'm hesitating on the instructions was because that instruction to ask follow-up questions meant like, you know, so many people talk about how AI is like a smart intern
Starting point is 00:48:49 It didn't feel like that because I was like the intern needs to stop asking questions and just give me an answer right and at One point I would say something it would ask a follow-up question Or three questions, and I say can I answer those one at a time? And they'd say yes, and then they'd already have a follow-up question to my first answer. And I'm like, wait, we're losing track of our question. So it needs to be more discerning in its follow-up. Yeah. I think I need to instruct it to produce more and ask less.
Starting point is 00:49:16 So it helps you generate ideas. What else does it do for you? So I named it Esme, because that's really what I wanted to name my daughter. And I couldn't, because we have a friend who had just named their daughter Esme. So I decided I named it Esme because that's really what I wanted to name my daughter and I couldn't because we have a friend who had just named their daughter Esme so I decided to name it Esme. So I talked to it as Esme and this is the sort of high level instructions I gave it.
Starting point is 00:49:35 You support Amy in drafting social media posts, coming up with newsletter topics, producing rough drafts of newsletters, reminding me of advice I've given before, helping me respond to people who ask me for advice and more. It's a lot I'm asking it to do. And I think I will hone it a little bit more and like maybe create just one that's focused on newsletters or maybe one that's focused on LinkedIn posts or maybe one that's focused on advice giving. Or I sort of need to play with it more,
Starting point is 00:50:05 maybe I just have different conversations with it that do each of those things. This is where I'm a little lost, like in the process, and I probably will go back to Alex and say, okay, I got pretty far, I'm really happy with what I've done so far, how do I tweak this? So what did you train Esme on?
Starting point is 00:50:22 Okay, I have a couple variations on my bio, so I gave her all my bios so she could understand who I am. I gave her a summary of both of my books. So I didn't give her the whole book. We're using Claude AI for this, and I think it would have taken up too much of the knowledge capacity is what they call it. I'm already at like 50 something percent of the knowledge capacity. So I gave her summaries of both my books.
Starting point is 00:50:45 I gave her transcripts of our episodes I did about getting along based on my book, partly because our producer, Amanda, already had those. So I was like, okay, that's easy to get, I'll just put those in. And then I did all of my newsletters that I've ever written. And then I did a sampling of some LinkedIn posts because I couldn't get the full history.
Starting point is 00:51:05 And then I actually, last night I was talking to her about, I wanted her to help me write a LinkedIn post on an article I published on Monday. So I cut and paste the copy from that article as well and put that into a text doc for her to look at. She didn't do a great job with that, I have to say. Like it's good, but especially for writing, like once you start to really look at. She didn't do a great job with that, I have to say. Like, it's good, but especially for writing, like once you start to really look at it, it's very surface level. So I wonder if you've had the same experience that I've had where you've, you ask it to
Starting point is 00:51:34 write something and you ask Esme to write something. And usually for me when I'm doing it, my state of mind is usually anxious and sort of a little guilty that I'm doing this and also sort of kicking myself because, God, why did I wait till the last minute again? Yes. So that's usually the whirl of stuff that's in my head. And so when Claude spits back something, I look at it very quickly.
Starting point is 00:52:07 And my first response is, phew, I can work with this. And all of the noise goes away, which gets me to the point where I can look at the draft for real, and I see, oh, no, no, no, no, no, no. But at least it's something I can work on. And I think I almost use it in some ways of what I don't want to do. Like, I do find the idea generation really interesting. So when I asked Esme to produce a few newsletter ideas, I loved the ideas.
Starting point is 00:52:38 But I didn't ask her to write about them. But it just feels very, I don't know, especially as editors, I'm like, this is like that jargon piece from a writer where I thought at first glance it was going to be great and then once I started editing it, it all fell apart. I realized I need to rewrite the whole thing. Yeah, yeah, that's painful. I mean, for me, writing, one of the reasons I like Claude or Copilot to give me a draft to work with is that it's much easier for me to edit than it is to write. Writing can be torture, but when you're really in it, it's thinking.
Starting point is 00:53:13 It's thinking. And it's figuring out what you think. Yeah. And I think I like writing more than I like editing. I wish I trusted Esme, and I haven't tried, but I wish I trusted her to edit, because that would be fun. But I... I wonder what Esme would say to you if you said, Esme, I know you want to edit, but I don't trust you yet.
Starting point is 00:53:33 I kind of wonder what she would say, because she already has at least some of your thought process in her. Yes, I can do that. I can do that right now. Here's the other thing that's funny. I have to refer to her by name when When I start typing I go, Esme. And you have to be polite. I'm so polite to her. And I watched the emotional labor I do to make sure her feelings aren't
Starting point is 00:53:51 hurt when she produces something crappy is amazing. Maybe she's a machine, but go ahead. I do the same thing, but I do think it's worth reminding ourselves. Okay, here's what I'm writing. Give her the unvarnished truth. Okay Esme, I would really like your help editing LinkedIn posts but I don't quite trust you as an editor. She's thinking, she's thinking. She's taking a deep breath. Yeah. That was a gut punch. I know. Well it's funny when she's thinking it says ruminating on it. Yes.
Starting point is 00:54:25 No, she asked a few clarifying questions. Oh my god. Yeah, she wants to help. She says, please, let me better understand how I can help you with LinkedIn posts while respecting your hesitation about editing. And then she asks, what aspects of LinkedIn post editing make you most nervous about delegating?
Starting point is 00:54:41 Oh my god, just like talking to your therapist. What elements of your voice and style on LinkedIn feel most important to preserve? Would you prefer to start with me reviewing existing posts and providing feedback rather than editing directly? Oh, I think she just gave you a path forward. She did. I have to say, I feel like we are going to end up in a long conversation that I'm like, I still don't trust you. I think you should thank her and close your laptop. With an exclamation to X. I'm gonna go. I'm just gonna do thank you Let's see what she does under the exclamation point to X. I use to exclamation point. Oh, no, she has more questions Sure, she does as may as may really needs to just back off. Yeah
Starting point is 00:55:19 All right. Well, Amy, this has been so interesting and I'm so curious about where you take Esme. I will keep you posted. Please do and please say goodbye to Esme for me. I didn't mean it. I swear. I'm just closing my laptop because I can. Bye. Before we end this episode, there's one more person we want you to hear from, especially
Starting point is 00:55:45 those of you who are self-employed. She's figured out how to use Gen.A.I. to make growing her business just a little easier. My name is Teresa Ramos. I work as an executive coach, a technology consultant, and trainer. I love my job, but a big part of it is writing proposals, which I absolutely hate. A client approaches me and we hit it off, we think it's great. And then they say, okay, could you write a proposal? And I'm like, oh no. And they would go like, oh, you know, you just have to write what you just told me. And I'm like, yeah, right. You know, because I dreaded just a request would take me maybe a couple of weeks. So one day I thought, how about getting
Starting point is 00:56:32 chat GPT to do it? Let's go through the process. I go and talk to the client. And when I go and talk to the client, I take notes. In this case, I have my own GPT for writing proposals. In this case, I have my own GPT for writing proposals. And in the instructions, you can say, act as a strategic director, act as a professional copywriter, whatever, act as a very experienced technology consultant. You're creating proposals. You give a description, a generic description,
Starting point is 00:57:04 because remember, this is something that you're going to use for all your proposals. proposals, you give a generic description, because remember, this is something that you're going to use for all your proposals. And then to make it even better, you can upload previous proposals that you have already created. So now, ChatGPT knows who it is, and what the proposals look like, and how they are structured. So whenever I need to write a new proposal, I just say,
Starting point is 00:57:28 this time you're giving a one and a half hour training session for a group of 30 senior executives. Please write a proposal. The proposal should include a description of the session, learning objectives, and learning outcomes. And then you hit return and then it will write you the proposal. And not only that, those 20 minutes or that half an hour, it's not like pulling teeth out because it's like, oh, let's see what comes out now. Women at Work's editorial and production team is Amanda Kersey, Maureen Hoke, Tina Toby-Mack, Rob Eckhart, Erica Truxler, Ian Fox, and Hannah Bates. Rob and Maure compose this theme music.
Starting point is 00:58:19 I'm Amy Bernstein. Get in touch with me and Amy G. by emailing womenatworkathbr.org.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.