Everyday AI Podcast – An AI and ChatGPT Podcast - EP 37: Using ChatGPT Across Different Functions of a Company

Episode Date: June 14, 2023

How can you apply ChatGPT across multiple aspects of a company?  Today our guest Erik Boemanns, VP, Technology/Security of Improving, joins us to discuss how ChatGPT can act as an input provider, not a replacement for human work. From assisting professionals in writing policies, marketing campaigns, and proposals more effectively, we break it down.Time Stamps:AI News -[00:00:17] EU Parliament passes first Western AI Law[00:02:10] Salesforce's new AI cloud software[00:02:52] Meta releasing its own AI image creation modelGuest - [00:05:00] What Erik and Improving are doing[00:06:48] Using ChatGPT and CoPilot in a business[00:10:11] ChatGPT - a helpful teammate for input[00:13:11] Accuracy and trust in AI language tools[00:17:03] Copilot: produces documentation & incident reports automatically[00:19:23] AI improving productivity and output in companiesFor full show notes, head to YourEverydayAI.comTopics Covered in This Episode:1. Trusting AI language models- Concerns about accuracy of AI output- Importance of measuring AI's accuracy and detecting inaccuracies- Importance of trust in language models2. Impact of AI on productivity and output for larger companies- Discussion of Microsoft Copilot and its potential to improve productivity- Use cases for ChatGPT in smaller and larger companies- Acknowledgement of barriers to using ChatGPT in enterprise-sized companies- Speaker's belief that AI products enable improved productivity without resulting in job loss3. Potential of AI product called Copilot- Ability to streamline documentation and reporting processes in consulting workKey points:- AI language models such as ChatGPT can be used in any department of a company, not just software development.- ChatGPT can be used to help professionals write policies, marketing campaigns, and proposals more effectively.- Need to always double check ChatGPT's suggestions.- ChatGPT is a helpful input provider, but not a replacement for human work.- Using AI products leads to improved productivity and does not result in job loss.- Companies need to consider how they use AI products to remain competitive while also protecting their intellectual property.- Microsoft Copilot and similar products have potential to streamline processes and improve productivity in consulting work.Keywords:IT consulting, software development, AI, internal business capabilities, consulting practices, EU AI Act, foundation models, copyright laws, Salesforce, AI-infused software suite, Salesforce AI cloud, Meta, AI image creation model, I Jeppa, Eric Bowman, VP of technology and security, language models, accuracy, foreign language translation, confidence score, ChatGPT, Microsoft Copilot, productivity, output, content creation, ideation research, barriers, input provider, competitive disadvantage, intellectual property, job loss, improved productivity, distilling large amounts of information, Copilot, documentation, reports, After Action Report, Excel, PowerPoint, Word.Send Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info) Start Here ▶️Not sure where to start when it comes to AI? Start with our Start Here Series. You can listen to the first drop -- Episode 691 -- or get free access to our Inner Cricle community and all episodes: StartHereSeries.com Also, here's a link to the entire series on a Spotify playlist. 

This is the Everyday AI Show, the everyday podcast where we simplify AI and bring its power to your fingertips. Listen daily for practical advice to boost your career, business, and everyday life. Meet Firefly AI Assistant, now live in Adobe Firefly, the All In One Creative AI Studio. Just describe what you want to create and the assistant handles the rest, orchestrating multi-step workflows across Photoshop, Premiere Express, and more in one conversational interface. You direct the outcome. The assistant accelerates execution. Can you use chat GPT across all areas of a company?

That's one of the things that we're going to be talking about today on Everyday AI. This is your daily live stream podcast and daily newsletter. That's right. Go to Your EverydayAAI.com to sign it for that newsletter. But this is yours. We talk about everything that's happening in the world of AI. And we bring on experts in their field to talk about. how they or them or their companies are using AI.

So before we bring on our guests, let's quickly talk about what's happening in the world of AI news. There's always a lot going on. It's hard to keep up. You can spend hours a day and spend instead just spend, you know, 15 minutes with us every morning. So as a reminder, if you're listening live, please drop a comment, especially when I bring our guests on for the day. But let's go ahead and run down what's happening because we have some big stories that are going on in the world of AI.

So first, and this is hot off. the presses. This has only been out for, I think, a couple of minutes, but the EU parliament has moved ahead with a monumental AI Act. So it's called the European AI Act. And it is the first law in the kind of West, in the Western world. So essentially what's happening is they are saying these foundation models, such as ChatGPT, need to include provisions to ensure that their training data does not violate copyright law. So again, this is just, kind of fresh and new. And there's been a lot of kind of back and forth between OpenAI, the ChatGPT parent company and just different, you know, EU nations in terms of regulation.

So this is going to be very, I'm not going to say exciting because it's depending on, you know, your thoughts on chat GPT, but regardless, there's going to be a lot of activity on this in the coming months and also what this means for the U.S. So more on that in the newsletter. Salesforce, you know, they've really been going all in on AI lately. So they just recently announced a comprehensive suite of just AI-infused software. They're calling it these, I believe the software or sorry, Salesforce AI Cloud and they have a starter pack. This does seem to be geared more toward enterprise companies, given its reported price tag

of about $360,000 annually. So, you know, if you're a small business, or an entrepreneur, probably not for you, but if you're an enterprise company that's using Salesforce in every part of your business, that's something to keep an eye out on. Last but not least, the third of our news stories and we'll have more in the newsletter, meta is releasing its own AI image creation model. So there's a lot of popular ones already on the market. From OpenAI, you have Dolly, private company called Mid Journey, who I think is leading to the

pack. Meta has released. So this is the Facebook parent company. They've released their own version of an AI image creation model called IJEPA. And it's apparently is doing kind of this AI image creation a little different than the other models. And it's using what it says, knowledge of the world to complete images rather than kind of the similar technology that the other companies use, which is looking at nearby pixels to kind of like auto complete an image. So they haven't released a ton of samples.

We'll go ahead and link their research paper in the newsletter that shows kind of some basic methodologies. But it should be exciting to see what comes next and how meta can really push, you know, what's going on in that space. So those are the big pieces of news. Make sure to go to your EverydayAI.com. Sign it for the newsletter. Read it because we're going to have a lot more about these and other stories. But let's bring in our. guest for today. Very excited. So we are welcome to the show. We have Eric Bowman's. He is the

VP of Technology and Security at Improving. Eric, thank you so much for joining us. Yeah, absolutely. Thanks for having me. We have a great conversation to get to. We're going to talk about chat GPT, not just chat GPT, but also how companies like Improving are using it and, you know, even talk a little bit about Microsoft co-pilot. So as a reminder, we have a couple of comments. comments for people who are tuning in. So if you do have a question for Eric, please go ahead and drop that comment. So a couple of people are already commenting and excited to hear what we're talking about. So Eric, just give everyone a quick overview of improving what you guys do and kind of what your role is at improving. Yeah, absolutely. So improving is a IT consulting company. We do a lot of

different IT consulting software development for mid-market and large clients and some small as well. We actually have offices in Canada, US, and Mexico now around 1,500 consultants and growing. So a pretty big consulting team and a lot of different technical services. And so one of the things that is super important to us is we are both advising our clients on technology, but also using technology yourself, is what AI is going to be doing for us, an internal business capability, but also as a consultant area as well. And so I do want to quickly just kind of disclaim that as we're talking today, you know, this is not improving its internal official stance on that.

That's something that we are just like the rest of the world, learning to figure out that working with our in-house counsel. I'm thinking about the security side. And then we have another gentleman who's helping us from the consulting practices side. And so just kind of that, we're thinking about this the same way a lot of other companies are. So as we talk today, it's more how do we approach that problem? How are we, what issues are we seeing and how are we helping our clients as well think through this? So I just wanted to get that out there as well.

Yeah. And that's, and that's a great point. So let's, let's even talk about this because I'm sure you have people internally who are looking at you and you're obviously working with other decision makers as well. You know, so whether you want to talk about it through, you know, the lens of improving and what you guys are doing or just, you know, businesses of your size in general. But how do you think companies should be handling the use of, you know, iTools, you know, specifically, you know, chat GPT because it's, you know, there's great power,

but also, you know, great responsibility. So, so what's your take on just, you know, how you can moderate it and, in, I guess, respectfully use it, you know, in an office setting. Yeah, no, exactly. And I do think that's something that there's so many aspects to it, right, because it is a super powerful and capable product today. And of course, some of the things that we're talking about, too, like co-pilot is coming soon. And so not using it. really is not an option, right? You are definitely going to cripple yourself competitively if you decide we're just not going to use it. And so as I think about it, I'm a technologist, but I also have that legal and compliance background as well. So I have almost competing minds as I think

about things like this. You talked about the copyright law, right, coming from the EU. That's also something that already existed as a concern. We think about recent cases where software developers put code proprietary copyrighted code in a chat GPT, didn't realize if they then would train on that, and then it would later spit that out. And now they violated a U.S. copyright law, probably, we would assume, but also enable chat CPT to do that. And so as a consulting company or as just any company that has your own intellectual property, yeah,

are you exposing it? Are you losing it because you are using a product like chat GPT? But also, how do you use it and get to where you need to be competitively? Because again, like I said, not using it, it's not an option. Yeah. And I'd say, you know, when companies are hiring and proving, whether it's an IT consulting or software development, I'm sure on the client side, there's maybe different expectations or maybe sometimes unspoken expectations in terms of your use of chat GPT or, you know,

like we talked about, you know, Microsoft co-pilot or other AI tools. How do you handle that kind of balancing act between like, yes, you know, even if a client asked for something, like how do you handle that? Because it is kind of a gray area, at least here in the U.S. for now. Adobe just introduced an entirely new way to create, bringing the power and precision of its creative suite into one conversational experience. Meet Firefly AI assistant, now live in the Adobe Firefly app. app, the all-in-one creative AI studio.

Powered by Adobe's creative agent, Firefly AI assistant lets you start with your vision, just describe what you want, and shape the outcome as it takes form with the assistant. The assistant orchestrates multi-step workflows, drawing on 60 plus pro-grade tools across Adobe Creative Cloud apps, including Photoshop, Illustrator, Premiere, Lightroom Express, and more to help bring your ideas to life. You can also get started with creative skills,

a growing library of pre-built workflows for common creative tasks, like batch editing photos, creating mood boards, portrait retouching, and creating social variations. Every step the assistant takes is visible, so you can refine, redirect, or take over at any time. You stay in the driver's seat as the creative director. Adobe Firefly AI assistant now in public beta. See it today at firefly.adopi.com.

Well, first and foremost, we'd always refer to our clients. own decisions on that. So if they, for example, has said, you know what, we are using copilot. We are using chat TPT. We would say, that's great. Give us the contours of how you want us to use it. Do you already have policies? Do you already have accounts and all those sort of things? Do you have your own controls in place with them to protect your intellectual property? If you do, awesome. Problem solved, right? Because they have made those business decisions. They've put the relationships in place.

They put the safeguards in place. And we kind of know those, the contours of that. that's the minority yeah no yeah yeah that's that's a good point and you know um explain a little bit you know and this is something i'm very curious about eric you know at a at a larger company such as improving um you know that is you know it's it's it's always evolving right like what check even what chat gpc means or can do you know four months ago is much different than now you know if you have access to the internet and the ability to bring in third-party plugins. But, you know, what are some of the more, I guess, meaningful or impactful ways that you guys have used it, you know, so far, at least internally, because I know with clients, it's obviously on a case-by-case basis. But what are some ways that you've used it internally that you think kind of the everyday person can can learn from that?

Yeah. So I think it's, what's amazing about it is that it can really reach into any vertical of your company, right? So we've talked about software development. That's kind of one of its oldest use cases. But even as we think about compliance and policies, for example, it's a great tool to get you started. And I guess that's the other thing. My other caveat is I know that it makes mistakes. And so as I'm using it, I'm always going to double check and make sure that what it's giving me back is valid.

So think about a policy. Think about we'll just use privacy policy, for example. It needs certain things to be in it to be effective. And so as a professional, I could do all the research. I could write that out and I could then produce a perfectly good privacy policy. Or I could also say, hey, chat, TPT, what are the good elements of a good privacy policy? And make sure that if it says point number seven is XYZ, oh, yeah, that's also something I should be including, right? So it's almost like that teammate that's giving me input into the topic.

I'm not relying on it. I'm not having it right the policy. I'd rather do that myself still. but it can absolutely give me that input. Likewise, if we're in marketing, what are the good elements of a marketing campaign? It's going to spit out something, and there's a decent chance.

It'll remember something that you've forgotten. So thinking about it as that friend that sits next to you that has some good ideas, it's always an easy use case, no matter what department you're in. If it's compliance, marketing, sales, salespeople who are working on a proposal and could I say this more effectively?

Here's all these words that I've written about about what we're going to do. Pace that in, again, assuming that you're not violating any sort of intellectual property and say, can you summarize us, right? Can you give me the three bullets that summarize these 500 words so that I can be a more effective communicator? Yeah.

Yeah, I think you bring up a good point because, you know, for smaller businesses as an example, had a great entrepreneur on the show yesterday. And entrepreneurs are really, I think, using chat GPT more for content creation or just AI programs in general for content creation, where it sounds like, you know, maybe a better use case for a company of your size is more of ideation, research, brainstorming, some of those things. So what, I guess, at least if we're talking just chat GPT, you know, what other barriers or, you know, kind of boxes, to check still have to happen in your mind to be able to use it more at scale. Because you kind of talked about, you know, chat GPT making things up, you know, hallucinations. That's something that we're actually going to talk about later in the week on the show.

But, you know, what steps do you think have to be taken on the chat GPT side or features until you can use it much more frequently across, you know, all areas of kind of a more enterprise-sized company. Yeah. So I think it's going to have to be two-fold one, obviously the safeguards around my information so I feel more comfortable sharing because it's better the more I share with it, right? Everybody knows that.

If I don't tell it what I need it to produce, it won't produce what I want. And so I do have to share a decent amount of information with it. And I know, you know, Open AI has the checkbox that says, we won't use your data anymore. But also that has other features that, that turns off other features that are used. I don't think they struck that balance yet. But then the other side of that is how can we measure its accuracy with some confidence, right? So if it's reporting back to me in a subject matter that I know, then I can be like, I think you're making stuff up.

If I've asked it to talk about something that I don't really have that subject matter expertise in, it can make stuff up. And I'll be like, that makes sense to me. And so how do we put that layer of self-evaluation almost of like, can it detect its own hallucinations, I'm not even sure, right? But give you a confidence from us of like, hey, I'm highly confident that I'm not making stuff up or, you know what, I probably made a bunch of stuff up. You should, you should go fact check what I just about. But I use the example here of a foreign language translation, right? And so, so we're international, Canada, US, Mexico. We have, you know,

three languages within our company. I received an email from one of our Spanish co-workers. I can read in a Spanish that I know what he's talking about, but I can't. at write Spanish in a way that wouldn't sound like Google Translate. Just for an experiment, did it in Google Translate and then also did it in chat GPT and had it output what I would have wanted to say in Spanish. And I read it. I'm like, I just don't think that's what a native speaker would have said. I think it's grammatically correct.

Just like Google Translate tends to be grammatically correct. The chat GPT answer, I think was right. But it wasn't actually how someone would talk. And so if I just said, hey, translate my entire website to Spanish. I believe I would be creating a very embarrassing piece of marketing for Spanish speakers, right? And so how do you take that expertise of, again, it's an area that I have enough knowledge that I can believe it and not enough knowledge that I can validate it? And so that's, I think, maybe the question that I want to know how to trust it, right? Sure.

Sure. And you bring up, you bring up some fascinating points, you know, even asking chat GPT, how confident are you in this response? You know, I actually, you know, a pretty frequent listener of the show, I'll give her credit. Maybrit says that she asked chat GPT, give me a confidence score on this, you know, is it zero percent? Is it 100 percent? And, you know, she says she's getting varying degrees. So it's a, that's an interesting take to ask, you know, chat GPT. how confident it is. Daniel, thank you for the comment saying, you know, exactly kind of echoing what Eric is saying that you need to be checking the answer regardless of where you get it from, whether it's Stack Overflow or ChatGBT.EBT.T. That's a great point, Eric. You know, let's quickly talk, though, Eric, about Microsoft co-pilot. So for the everyday person, if you're not super familiar, Microsoft co-pilot is going to be a, it's getting slowly rolled out. So it is kind of live for a select few customers. But if you think of what chat GPT is capable of and you have to log into a browser,

think of that throughout your entire operating system experience on Windows. So regardless of what Windows program you're using or on the actual operating system, you have that AI capability there. Eric, what does this mean for improving specifically, you know, when that is rolling out? And also, what does it mean for other companies and just the, future of work. Yeah. I think this is going to be super exciting when it starts to produce the promised outcomes. As with all marketing, it reads, it sounds amazing. It's going to be wonderful.

Reality, it will take some time. But, you know, consulting, for those of you who haven't worked with consultants before, not only do we produce the work you asked us for, but one of things that we also have to produce is a decent amount of documentation around what we're doing, status reports, summaries, kind of all the sort of things that that show that we are doing what you asked us to do in a way that you can report to your leadership. Co-pilot is one of those products that promises to help us do that. So I think a great example I saw, this is a slightly different tangent, but let's say you have an incident, you have a production outage, and from 7 p.m. to midnight, the team is just shooting emails

back and forth. They're chatting in teams. All these things are happening. And it's midnight. the problem solved. Everybody just wants to go to bed. However, there's an executive someone who needs that kind of an after-action report. Well, co-pilot promises to say, hey, you know what? I can read all the emails that are related.

I can read all the team's messages that related, and I can produce that after-action report. And I can even do it in PowerPoint for you with graphs and pretty things. And so you can go to bed and have this executive report automatically sent. You can really just say, hey, co-pilot, create an after-action report for this incident with these people and send it to Jordan and I'm going to bed. Again, I don't believe that's going to happen this year that it's that amazing, but that kind of thing is going to change it. Because you think about all the documents that you're processing as a human,

you think about all the emails that you're reading, all the meetings you're attending, all these, a ton of information flows past us, and we just sort of pick and choose what matters to us. If we have that co-pilot sitting next to us, and it's paying attention to all that, It can help us catch the things that we missed and create those summaries. And I like the idea that if I have an Excel document, fill of data, I can say, hey, analyze this data,

summarize it in a Word document and a PowerPoint and send it to my CEO, right? Like, that's a thing they're promising. And so I think that, again, five years, 10 years maybe, that'll do exactly what we want. But just the fact that we can see it now is what I think is amazing. Or at least, you know, to get a start, right? Because someone's ultimately going to be responsible to be turning those reports in. And instead of starting from scratch, maybe you have a document that's maybe 50% complete already, which is a game changer, I think, just right there. So as a reminder, we are kind of getting toward the end of our conversation.

But if you do have any last comments for Eric, please, please drop it in the chat. I will ask one, Eric. Yeah. You know, as someone, and, you know, we talked about using chat GPT throughout just all, all different parts of the organization. So combining that with, you know, Microsoft copilot and kind of what you just previewed there. How do you see AI in general impacting? Just, I won't say jobs, because that's a whole other discussion. But how do you see it impacting kind of productivity and outreach?

for larger companies. I mean, do you think the expectation will be, all right, now that we have all these tools that make us much more efficient, we should be doing 30, 40, 50% more business? Are those expectations going to come? Or do you think it'll be maybe just companies aren't going to be hiring, you know, new positions because of that increased output? I know it's a big, you know, that requires a lot of, you know, deep and thoughtful conversation, but I'd love to get your quick take on it.

Sure. Yeah, definitely a quick take. I do think that there's a certain segment of jobs that are doing what I just described today that should be figuring out how they can leverage these products to continue to do their job, right? Because otherwise, the products will probably do their jobs for them. But the truth is, most companies don't have all of those employees today anyway. Like, I don't have somebody who can read all my emails and summarize them for an accident. I don't have that person. And so I think it's more to your point of improved productivity. I've become more effective doing what I do because those products exist and are able to take the information that I'm producing and distill it down in a way that then becomes more useful.

And so, in our case, we're not losing people because of it. We're actually getting more productivity out of it. and in a way that doesn't impact jobs. It's not that, hey, Eric is now 30% more productive. We don't need a second Eric. They probably didn't need a second Eric anyway. Right. But now I can actually do my job better. And so it is an overall net benefit to both me as an employee

and improving as an employer as opposed to a risk. But no question that there are job segments that are threatened today by this because if that's all your job is, is to produce these after-action reports. If you're at a company that's big enough to have those, that I could see being an impact. But I think most companies, again, don't actually have that staff today.

And so this is more enabling than threat. More opportunity than threat. Yeah. No, that's obviously these things require a lot of conversation. But I really appreciate your quick take on that because I think that, you know, my takeaway from hearing you say that, is if you're in a position where you can be using AI, you should be, right? Because it's,

you know, it is the way of the future. And even what you talked about, Eric, you know, when companies like Microsoft are infusing, you know, this, this type of technology into their core product offering, that's a signal of what's to come, right? Absolutely. Yeah. It's, it is going to happen whether we want it to or not, barring some crazy legislation or something that's not that's not the topic of today's show. Yeah, this is funny. Yeah, yeah, we'll see. We'll see what's happening, you know, unfolding in the EU ever makes its way to the U.S. That's another, another conversation for the other day. But Eric, thank you so much for joining us on the Everyday AI show. Absolutely. Glad to be here. Thank you. All right. And just as a quick reminder,

if you haven't already, please go to Your EverydayaI.com. Sign up for our daily newsletter. Also, if you're not listening or if you are listening to this live, we come every day at 7.30 a.m. Central Standard time, but it's also put out on a podcast. So go to Spotify, Apple Podcasts, wherever you get your podcast. Make sure to subscribe and follow us there. So we hope to see you back tomorrow and every day on everyday AI. Thank you. Meet Firefly AI assistant. Now live in Adobe Firefly, the Allman One Creative AI Studio. Just describe what you want to create in your own words and the assistant handles the rest, orchestrating multi-step workflows across Adobe Creative Cloud apps, including Photoshop, Premiere Express, and more in one conversational interface.

You direct the outcome while the assistant accelerates execution. Stand control with the ability to step in and refine at any time. See it today at firefly.adobie.com. And that's a wrap for today's edition of Everyday AI. Thanks for joining us. If you enjoyed this episode, please subscribe and leave us a rating. It helps keep us going. For a little more AI magic, visit Your Everyday.

EverydayAI.com and sign up to our daily newsletter so you don't get left behind. Go break some barriers and we'll see you next time.