The Koerner Office - Business Ideas and Deep Dives with Chris Koerner - What AI Tools Are Worth Your Time in 2025⏐Holdco Bros. Ep. #158

Episode Date: April 18, 2025

HoldCo Bros are back! In this episode, Nik shares what he learned from 30+ conversations with entrepreneurs using AI in their businesses—what tools they’re using, what’s actually working, and so...me surprising patterns that came up. We also talk about how he built a full workflow using Google CoLab and OpenAI to analyze all the data.I also share my experiment with a real-world billboard ad for the podcast, how I’m testing taglines with Facebook ads, and different ways I’m tracking the results. We even get into some fun ideas around using AI for things like relationship advice and business mediation.Learn more about Nik here: http://linktr.ee/cofoundersnikCheck out Limitless pendant hereShare your ideas with us:Nik@cofounders.comChris@cofounders.comTimestamps below. Enjoy!---Watch this on YouTube instead here: tkopod.co/p-ytAsk me a question on or off the show here: http://tkopod.co/p-askLearn more about me: http://tkopod.co/p-cjkLearn about my company: http://tkopod.co/p-cofFollow me on Twitter here: http://tkopod.co/p-xFree weekly business ideas newsletter: http://tkopod.co/p-nlShare this podcast: http://tkopod.co/p-allScrape small business data: http://tkopod.co/p-os---00:00 Highlights00:33 ChatGPT's Bias and Trustworthiness vs. Google02:58 Seeking Unbiased Feedback from AI (and its Challenges)07:38 AI for Business Mediation and Conflict Resolution10:04 Most Popular LLMs and Their Use Cases (ChatGPT, Claude, Perplexity)12:33 Claude’s Advanced Project Structure & Writing Strengths15:02 Cursor vs. Replit: Coding Tools and Usability vs. Functionality17:26 AI Tools Summary: Use Cases and Strengths by Model19:52 Cleaning and Analyzing Podcast Transcripts Using AI & Google Colab22:20 Automating Insights: Creating Lead Magnets and Quizzes with AI24:40 The Importance of Data for Personal AI Assistants27:07 Billboard A/B Testing Strategy for Podcast Growth29:27 The Power of “Best” in Marketing and Ratings Psychology31:54 Measuring Billboard Effectiveness via Download Geography34:19 Saturating Small Cities with Ads: A Contagion-Style Growth Idea

Transcript
Discussion (0)
Starting point is 00:00:00 Over the last two weeks, I've talked to 30 entrepreneurs who are using AI in their business. Because of that, I now understand the use cases that they're using it for. Chat GPT as a general thought partner. Claude coding partner. Perplexity, research. Everyone I spoke to who actually uses these models, they're like, it's as good as deep research. And it's real time. Gemini workflows within the Google suite.
Starting point is 00:00:19 There's a ton of good ideas, not a lot of good execution. Stay close to the money. Build something that people can use to directly make more money. That will have the highest likelihood of succeeding. The number one use case for it right now? You know what I love about Chad GBT? I just realized this. And you might have had a different experience.
Starting point is 00:00:39 And it may change because incentives aren't aligned. It is not biased. Like if I ask it about Republicans or Democrats or the Mormon Church or the Catholic Church or seed oils or health or carbs versus fats versus proteins, I really feel like it's unbiased. Like it is a superpower. So here's one example. I saw this Instagram real. And do you know what G-H-E-E-E? No.
Starting point is 00:01:03 It's like a clarified butter. It's like a different version of butter that we've been using for hundreds of years. It's whole food. It's healthy. It's like an alternative to seed oils or canola oil or butter. So I saw this stupid Instagram reel that was saying basically, ghee is unhealthy, actually. And canola oil is healthier than ghee.
Starting point is 00:01:23 And I'm like, oh my gosh, what are we doing? Like, there's so much info out there that like literally no one knows what to eat. Because you don't know who to believe because you don't know who has the incentive to say whatever. So I went to Chad GPT-40 and I said, who paid for this study that says replacing ghee with canola oil is better? So this is what I said, who paid for this, right? And it's like, great question. Here's the deal with most of those. Canola is better than ghee studies.
Starting point is 00:01:49 Many are funded by big food or ag companies. Examples in the past that have been backed by groups like the Canola Council of Canada, American Heart Association. Or Unilever. Like literally, like Coke and Pepsi are funding the American Heart Association, right? So then they put out these studies that are like, Coke is actually good for you. It's like, but like chat GPT has no bias because there's nothing to click. The incentive is there. Whereas if I Google the same thing, like the incentives are for me to click on stuff. So I still can't believe what I Google, right? As optimistic as I am, I don't think that chat GPT will stay like this
Starting point is 00:02:24 forever because money, right? But I love that it's like this for now. Have you had the same experience? I have, but a little bit different. So I think it's pretty unbiased when I'm asking it semi-factual questions, but I do think it's biased when I'm asking it for feedback. And this is either it's biased or I'm insecure. Because whenever I ask it for feedback on something that I'm doing or about me, I feel like it's overly praising me, if that makes sense. Where I'm like, hey, take a look at this post I wrote.
Starting point is 00:02:57 What do you think? This post is fire, fire emoji. By the way, opening I, can we cut the emojis? Like, what's happening? Why have there so many freaking emojis? I hate them. Anyways, this post is fire. And I'm like, how would you rate it?
Starting point is 00:03:08 I would rate it a 9.5 out of 10. And it's like, okay. And then I have to go back to it. I'm like, you're a neutral third party. Your job is, you know, content management. You've seen everything. It wants you to hear. Right, right, right.
Starting point is 00:03:22 So to me, that's where I am seeing bias is like, it says what it thinks that I want to hear. and there are times where like I want it to be totally unbiased and like give me an actual opinion of what it thinks of my business plan or this post or the argument that I'm making with my lawyer. You know what I mean? So anyways, that's the only piece that I would say I do see it biased. It's funny because I'm going to directly contradict myself. And it's like it's not that it's unbiased.
Starting point is 00:03:47 It's just biased in a different way. There's always incentives. It's impossible to remove incentives. Opening eyes incentive is to keep us using chat GPT. Right. Yeah. So it's like the bias is not click. on this study, it's like, make sure Nick never churns, right? We want to keep Nick happy,
Starting point is 00:04:03 you know? Right. I have a custom GPT where in the GPT prompt, I'm like, you're a hard-nosed, no-nonsense content specialist. I need you to give me direct advice because bad advice is terrible. I give an analogy about being on the war field, warfield. I'm so stupid. Being on the battlefield field and, you know, field generals need to have not only real-time information, but accurate information to make good decisions, otherwise bad things happen. So I give it that analogy of like, this is why I need you to give me good information because I need to make good decisions. And so that GPT is great because it gives me sort of unfiltered responses. But it's, it's when I'm just like trying to ask it a general like question that it's definitely biased.
Starting point is 00:04:49 I'm kind of debating if I should say this next part or not. I don't think I want to. I don't think I want to. Relationship advice? Have you, like, with your spouse, have you used it for that? No, but like, what do you use it for? Dude, like, I'm going to say this. You and I have talked about we each have superpowers.
Starting point is 00:05:17 When you have a superpower, you have to know when to use it and when not to use it. And you also have to recognize that you can use your superpower. for evil. To me, the reasoning that Chat Tipt has, like, let's say you have an argument with your spouse and you're trying to get your way, where it can help you frame an argument is out of this world. And then it's a very unfair fight because you've got... You're not citing to your wife, Chat, GPT. According to... No, you're not doing that. No, you're not citing. You're like, well, that's an interesting point, honey, because I would think that you would want to do X, Y, and Z based on your previous... You know what I mean? And she's...
Starting point is 00:05:54 She's like, yeah, that's a really good point. And meanwhile, you're like looking down at your phone, you're like, she said it was a good point. What do I do now? This has never happened. She said, I'm smart. What's happening right now? Dude, I have been very impressed with how chat chepti is handled like relationship advice with my spouse. And I've never, we've never seen like a marriage counselor or a therapist or really talk to anyone.
Starting point is 00:06:22 Like, we've got a good marriage, right? but I've just been asking it some things and it has been so helpful and it I feel like it's advice that like a very expensive very very good marriage counselor would gift and it's literally made our marriage better and she has no idea she has no idea but it's the perfect use case for it right and if you're like if you're trying to come out it from a genuine way and you're like look I'm going to try to give you all the facts that I can help me understand it then you're getting like this impartial third party and you're like well it's AI so like if AI thinks I'm being a prick yeah I guess I am being a prick about that right or vice versa and it's it's pretty incredible with
Starting point is 00:07:03 the way if you give it enough context right because you and I might have a disagreement I might give it all the context in the world and it's me like yeah Nick you're right and then you might have the same disagreement put it doesn't want Nick to churn it doesn't want Chris to churn well it doesn't want it doesn't want me to turn but also I'm just giving it my context yeah and then you do the same It's your side of the story, right? Like if you feed it biased info, it's going to give you biased info. Yeah. The trick is I would like to start using freaking out a way to use this for mediation in business disputes.
Starting point is 00:07:35 I think would be really fascinating. If everybody just had, if everybody just had the limitless, which I ordered, by the way. Oh, awesome. And it's like, it's like, okay, upload all your limitless data. Now, you'd have to have two parties who are like, okay with everything being uploaded. But that in and of itself would be a tell, right? Where you're like, oh, this guy doesn't want it uploaded. What's going on?
Starting point is 00:07:57 But it's like, all right, take all of the side of their story, enter all the information, because that's essentially what an arbitrator is doing anyways. Yeah, that's really good. You just create a fresh chat GPT account. And the two people could sit side by side. So here's my side of the story. Here's my side of the story. And then they both agree like what the prompt is.
Starting point is 00:08:17 Right? And it's neither one of their accounts. You just hit enter and see what happens. Now, the hard part would probably be agreeing what the prompt is. Right. Yeah. And just like any other mediation, the hard part would be actually agreeing on the output. Because even if we're in a mediation and it sides with you, I'm going to be like, what? Yeah. Well, it didn't take into- It's stupid. It doesn't know what it's talking about. Yeah. But I do think if you're a mediator and your business is mediation, for those types of businesses, your bottleneck is you. It's your time, essentially, because you're an agency and you can only bill as much as you can actually go out and meet with clients, if you could use chat TPT to build a wrapper or to build a
Starting point is 00:08:52 prompting system to get that information quicker so that you save an hour per mediation, then all of a sudden you can take on 20 more clients a month. Like you just you just grew your business in a way that's AI enabled. That would be a really, really cool use case. That is cool. You and I talked about this idea a couple weeks ago where it's just like buy limitless pendant and give it to somebody, almost like a lead magnet to get into their business. and you're already doing this because you're recording everything, at some point, the ability
Starting point is 00:09:22 of these models to digest more data is going to happen. So what becomes the limiting factor in how well these models will get to know you and be your own personal assistant? The limiting factor will be data. Context window? Yeah. Or the ability to process or you know what I mean? Or the ability.
Starting point is 00:09:41 Because what's happening right now is it may have this massive data set, but it's optimizing for speed. only looking for certain whatever. At some point, it's going to get way better. And the limiting factor is going to be the amount of data that you have to input it into the system for it to then tailor itself to you. So I don't have a business model off of this. I just think using chat TBT, using a limitless pendant where you're recording every conversation that you have, it just creates more and more and more and more data so that when it's there, it's fed in and you're accelerated even faster. Yeah. Can we barbell this for a minute and go offline? Yeah. So you see my tweet about the podcast billboard?
Starting point is 00:10:20 Yeah. Put in up. So that's been a lot of fun. It won't go live for like two or three weeks, but I used AI to generate a bunch of phrases. Right. So you saw that I shared my screen. I put the podcast art on the left, corner office in the middle, icons to YouTube, Spotify, Apple podcast, and then like a catchy slogan at the top. So I had Simon make 34 of these.
Starting point is 00:10:43 They all look the exact same except for the catchy slogan at the top. is all different. Two to five words. Like you only have so much time to read a billboard, right? And so the catchy slogans that I'm testing are your dream is dying, sell stuff, not hours. Nine to five's kill dreams. Own your time. Never job again. Jobs or jail. Delete LinkedIn. Work sucks, question mark. Escape the grind. Fire your boss. Still rat racing, question mark. And what was the last one? Or then there was best business podcast. and then quit your job with an exclamation point. And then there's a bunch of others.
Starting point is 00:11:22 But I started Facebook ads that are all the exact same. It's just like the Kerner Office podcast, title, text, description, they all say the same thing. The Kerner Office podcast. The audience, the four counties in and around where the billboard will be. And then I exclude anyone that's ever interacted with my content. So they don't follow me. They've never seen my video.
Starting point is 00:11:43 And they live in those counties because that's by it. The people driving by don't know who I am, right? Right, right. And then I just run the ads on any meta platform meta things, messenger, marketplace, Instagram, it chooses. And then I just look at the clicks. Lowest cost per click wins. And then I get, because it's $950 to print that billboard.
Starting point is 00:12:05 The image that I'm using on the Facebook ad is literally a picture of the billboard with like trees in the background instead of just the image, you know? And it's 18 plus. any gender in those counties that don't know who I am. What do you think? I think it's amazing. I have an idea for it as well. I know we're offline, but I'm going to take it back to AI.
Starting point is 00:12:25 I used AI to generate most of those phrases, by the way. What I like to do with AI when I'm like creating a title for a video is I'll be like, generate me the 10 best titles and rank them. And then I'll like iterate from there. I would take all of your pictures. And I would go to chat, TPT, Grock, Claude. Gemini, four of them. Upload them and say, rank these from what you think would be most to least effective.
Starting point is 00:12:53 See what the four models spit out and then compare it to the actual results from Facebook ads. Yeah. I'm just going to do it with the phrases because all the pictures are the same. Oh, okay. Yeah. Yeah. So, like, I think that would be a really, really cool case study of like, all right, I'm trying it with real humans. This AI has been trained on the totality of humans.
Starting point is 00:13:15 and whatever experience, which one of them wins or how accurate is it? Because then in the future, if it's like, oh, they all said the same five and those were actually the five that won, it might save you time running Facebook ads in the future. Yeah, I like that. It's interesting. I didn't exclude my audience at first and I started running the ads and the winning one was Best Business Podcast. And that surprised me. And I was like, I wonder if that's because like they recognize me, they see me. Right. And I don't yet know. It's still too early. But it just made me think, like, how much power there is in marketing to call your thing the best. I had Greg Eisenberg on a couple weeks ago. His story was he was walking around Miami. He had just moved there. He walks by a dentist
Starting point is 00:13:59 and he sees a sign on the window that says voted best dentist. By who? What? I don't know. I don't care. He walks in because he saw that sign, became a customer, been a customer for eight years, giving them tens of thousands of dollars, referred 20 friends there. Because he saw the sign. So his idea was like there needs to be some sort of like a marketplace where you could get like certified by whoever. It's a racket. It doesn't matter.
Starting point is 00:14:23 You pay 200 bucks. You get a sign. And so it's like I just put up this billboard. Yeah. I think it's the best. My mom thinks it's the best. Whatever. Best business podcast according to Chris's mom,
Starting point is 00:14:33 fine print asterisk. Right? It doesn't matter. So maybe people clicked that the most because they knew who I was and I'm going to find out that's actually bad data. Maybe not. Maybe it's the winner again. And people just, it's confirmation bias. They're like, I believe you, internet stranger. I will now click and listen because you said it's the best. Hearing you talk about Greg Eisenberg makes me think of that meme that's like,
Starting point is 00:14:55 internet guy discovers rating agency. It's like these these things exist, right? Like you can they're already businesses in it of themselves. But yeah, this cracks me up. Well, there needs to be like for SaaS companies or for AI rappers. Like you could do a rating agency for any number of things, right? Yeah. I mean, that's what No BS Crypto was when you were launching it, right? It's like, hey, this is a rating agency. I don't know.
Starting point is 00:15:22 Looks like we made it. I just like that idea a lot because you're like you're currently competing all of the tools, all of the advice if you go and look at, hey, how do I grow a podcast is do it on someone else's newsletter. Go do paid ads. Appear on other podcasts. Brokers. Go to other podcasts.
Starting point is 00:15:39 It's like, okay, well, everybody else is doing the same thing. They're all doing the same exact thing. And we know that's a strategy, Zig while everybody's zacking. Yeah. So, like, either this is going to be a total waste of money, and I'm prepared for that to happen because I don't see other podcasts billboards, probably for a reason, or I'm going to unlock something really cool, right? Right.
Starting point is 00:15:58 Aren't you going to ask me how I'm going to track if I'm getting new downloads from this, Nick? How are you going to track? Softball me here. Set me out. Chris, let me ask you a question. Like, I get it. But how do you freaking track that? It's on a billboard.
Starting point is 00:16:10 Probably with, like, a QR code, right? No. QR codes are not allowed by Clear Channel, the company I'm using for this. Okay. Okay. So Buzzsprout is the hosting platform that we use. You can export your downloads by location by every little city. So like when I export mine, there's like 8,500 cities that have listened to my podcast, sometimes once, sometimes a thousand times, right? Now what you don't know is how many unique listeners there are per city. You just know how many downloads. So 25 downloads could mean one person downloading your podcast. podcast, 25 episodes of it. It could mean 25 different people once each, right? You don't know. So what I did was I went to the bailboarder will be in Tomball, Texas, which is a city of 10,000 just north of Houston. I took Tomball, the Woodlands, Spring, all the cities and Houston itself, in and around
Starting point is 00:16:59 Tomball. And I exported every city by download. And then I found a percentage, like a ratio. How many downloads have I had all time that were in Tomball and or Houston? 0.012%. of my downloads. And that's been consistent. And so I'm just going to run that export every week and see the raw number and the percentage as a ratio and see if it's climbing or not. Do you see any fault in that? I do see a couple of faults. You don't necessarily know where it is as a percentage
Starting point is 00:17:28 over time as it's mapped. Well, I'm going to run the export every week because that's really the only way with Buzzsprout you can do it. The other problem would be it's just all attribution related, right? like you're looking at this geography or did you capture the right cities. What I would do, this is just a suggestion, is I would ask chat TPT the best way to track this and the best way to analyze it. You can throw data into chat TPT and then like ask it to run a regression model. And the regression model will tell you whether or not that's statistically significant or not. Because you could just have, you could just blow up over the next month.
Starting point is 00:18:06 Let's say you have like a couple episodes that are amazing. and it's like everybody saw a bump, right? So of course, Turnball would see a bump. It would be proportional in that sense, right? In that instance, I would have to look at the percentage, not the raw number. You have so many downloads, you have so much data that it would be easy to say with confidence, whether or not it's statistically significant. And I would just, I would just ask chat TPT. No matter what I do, it won't be exact.
Starting point is 00:18:31 No, but I think it's amazing. It would be too coincidental if a disproportionate amount of people in that part of Houston suddenly started downloading my podcast. podcast, right? What I wish I knew is how many, because you just don't know how many raw people it is, how many loyal listeners. Because there could be 100 people that listen to five seconds of it once and then bounce. And it could look really good, but not actually be good. Why didn't you do the, here's the website and then have like one letter off? Right. I just don't want to mess with like URLs. I kind of want to go more for brand awareness. That's why I put the image of the podcast and, One of them has tkopod.com in it. I just want people to search for it. Another thing you can do is you can put up Facebook ads based on a latitude and longitude
Starting point is 00:19:16 point of the exact billboard and it will show your ad to people that drive by that billboard. And so then you get double exposure, triple exposure. The billboard even more effective, but it will make it even harder to find the attribution because you're adding another variable, right? At that point, it's like, okay, I'll spend $780 for a billboard and I'll run $1,000 with the Facebook and, you know, Facebook ads. Who cares about the attribution?
Starting point is 00:19:41 I know it works. You know what I mean? Yeah. Because any Joe Schmoe can run a Facebook ad, but you don't see a lot of billboards. It just adds another layer of legitimacy to it. Right. Yeah. And that feeling of like, dude, I'm seeing this guy everywhere.
Starting point is 00:19:51 Right. I kind of have the thought. Like, wouldn't it be interesting if one of us, anyone, ran a test where they took like a random city in the middle of nowhere, like Sue Falls, Iowa. And they ran Facebook ads, like saturated for your podcast, your, your brand, whatever, just in that city. And like, you just became a freaking rock star in that one city. And you just put them everywhere, Instagram ads, TikTok ads everywhere, only geo-fenced to that city. And just, I don't know, go speak, have an event there. Like, it would be an interesting experiment.
Starting point is 00:20:24 Like, no one else in the world knows who you are except for Sue Falls. What if you went to chat, GBT? And you said, I want you to run a contagion analysis or model. only have cities less than a million people in the United States and tell me which city would have the highest likelihood of spreading this contagion the fastest. So it's like, you know, it's going to go look at Des Moines. It's like, well, Des Moines actually has the most connecting flights of any airport in the United States. Contagion. I don't know, right? I'm just like, yeah, yeah, yeah.
Starting point is 00:20:56 And then it's like, okay, cool. I'm going to go target Grand Junction, Colorado, because it says that of any city under a million people, that's the one that would have the. have the like worst contagion and that's the city I'm going to go target. Like Vegas, like a city or Orlando where people are coming in and out of all the time. Right. Like New York City has 20 million people anyway, right? People are coming in and out, but proportionally speaking, there's just a lot of people there. But for New York City, it's like you're or L.A. or San Francisco, there's just a lot of competitors.
Starting point is 00:21:26 So standing out is going to be hard, generally speaking, right? But a smaller market, like Orlando, I don't know, you probably have a better chance of standing out. That'd be a cool idea. So video is cool, but you know what's better? Long form audio via podcast and my newsletter. TKOPod.com. Go there to subscribe for free to my newsletter. It's one email a week, very tactical. And then go to my audio podcast, three episodes a week, stuff like this. You're going to love it. All free. No sleazy sales bitch. TKO pod.com. So over the last two weeks, I've talked to 30 entrepreneurs who are using AI in their business because I feel like you and I've talked about this, there's a ton of good ideas, not a lot of good execution. Like Replit. How many things
Starting point is 00:22:07 have you made on Replit that you haven't actually finished? Seven. So it's like, oh, this is cool. I can build an app. This is great. And then you get to the final point and you're like, oh, how do I actually complete it? It's like that last 10%. So I've been having conversations with people. And it's been awesome. I've learned so much. My brain hurts every single day because I'm learning so much. But there are some really cool insights that I've gotten out of this. So I'm going to share some of my findings with you because I had chat chbtee take all my findings and put them in a summary for me. Question number one, Chris, what do you think is the most popular LLM for people to use as their primary LLM?
Starting point is 00:22:47 Chachyptu. It is. What do you think is the most popular use case? Like, what are they using chat chpT for? Writing emails? Like rewording emails? Mainly they're using it as a thought partner. So it could be rewriting emails.
Starting point is 00:23:00 generally not that. It's usually like, hey, I have an idea for this. How would I do X, Y, and Z thing? And it's like, just to get them started, which was fascinating to me. Second most used LLM. What do you think it is? Gemini. No. Grock. Nope. Perplexity. Nope. Claude. Claude. And the surprising thing about Claude is it's actually used more in aggregate, because I asked them two questions. Like, what's the primary? Like, what's your primary favorite? And then what are the other LLMs you use? And I, mapped it all out, Claude is actually used more by more people than chat GPT is. But chat TPT is the most preferred, if that makes sense. What do you think that they're using Cloud for? I have no idea. That's like the only one I really hardly ever use. So I have it broken down in three tiers, non-technical, technical, intermediate, and then expert. For chat TPT, the majority of the distribution is in the non-technical and intermediate. For Claude, the majority of the distribution is an expert and intermediate. And the main use case that I see people use it for is coding.
Starting point is 00:24:11 It's the best coding tool, like to help them actually write code. And then the second best thing, this one blew my mind. Its organization structure is fantastic. So you know how a chat JPT has projects? Cloud, you can set up projects. But it, you can set up projects. But it, you You have two fields. One is what is this project about? And so you can write a prompt to say like, this is my content project. And then it has files that you can upload for context. How's that different from chat GPT?
Starting point is 00:24:42 From what I've seen, chat TPT doesn't have the same functionality with the uploading of files and the reference for each one of the threads. Maybe I'm just not using chat TPT. That's how I use it. So you do, you upload instructions? They call it files and instructions. And so you use it individual. files for each one of your projects.
Starting point is 00:25:02 Yeah. I don't always use files, but it can. One of the people I spoke to is she's a writer. And she's like, Claude does a much better. It's a much better writer, apparently. And she has this whole setup where it's like, this is my brand voice. Here are recent projects that I've done. And so she's like constantly changing the context so that it's up to date.
Starting point is 00:25:22 But the interesting thing is, I didn't know this. You can only upload however big the context window is. Does that make sense what I'm saying? Yeah. So that was interesting. What was the least mentioned tool? Well, I would say GROC, but I think that a lot of these calls came from people on Twitter. So it may be Gemini.
Starting point is 00:25:43 Gemini. Yeah, it was the least mentioned. And everybody like dogged on it. They're like, well, Gemini. It's not good. So that was just really interesting to me. That's interesting. Are they dogging on it because they've actually given it a fair shake and they don't like it?
Starting point is 00:25:57 or they're just, it kind of has that brand around it because I dog on it, but I don't really use it. So it could be great. They're dogging on it not that it sucks. They're dogging on it because it's not as good as what else they use, if that makes sense. They're like the Claude model, Chad TPT. And I think chat GPT just has a head start because so many people were using it. The two use cases that I found out about Gemini are if you're trying to create workflows within the Google Suite, Gemini is the best because it just knows Google so well.
Starting point is 00:26:30 Makes sense. I thought that was really interesting. And then the second thing that I thought was really interesting is the context window. I didn't realize this. But do you know how big the context window is for Gemini? I looked this up a while ago, but I can't remember. I think Claude was the biggest that I saw. Let's back up.
Starting point is 00:26:43 The context window is essentially how much information you can give the model for context of a specific question that you're asking it. For ChatT, it's 120,000 tokens. And with that is, it's like a 300-page book. Okay. For Claude, it's 200,000 tokens. So it's a lot bigger than ChatsyPT. For Gemini, it's a million.
Starting point is 00:27:02 Wow. Yeah, so it's a much larger context window. I thought that was just really, really interesting. Next finding. What do you think was the most used tool that interfaced with the LLMs that they worked with? Like feature of the specific LLM? No, let me ask it a different way. What do you think is the most used AI tool?
Starting point is 00:27:24 that was not an LLM. Something that I would have heard of? Yeah. I had no idea. Cursor. Okay. Cursor. And from several of them that, like, multiple people said, I think cursor's going to be
Starting point is 00:27:36 bigger than Google. They were like so. What? Yeah, they were just like so in love. You must have talked to some coders then. I did. I talked to a couple of coders. It blew my mind, though, like on the call with them.
Starting point is 00:27:47 They were on cursor. And they were showing me you can natural language prompt into building an actual website. All of them who had like actual coding knowledge crapped on Replit. Yeah. Which was really interesting to me. They're like, well, but I'm like, yeah, in order to use cursor, you actually kind of have to have some coding experience. Like you can still, you can use it at using natural language, but it would help if you had coding experience. Here's my push pull framework for for this Friday. Usability and functionality. That's the push pull of today. Replet is more appropriate. to more people, but it's less functional as like a coding assistant. Whereas cursor is harder to
Starting point is 00:28:30 use for more people, but it's a more functional coding assistant. And the magic happens, like the unicorn status happens when you have like an Airbnb with beautiful design, beautiful user interface, like easy for anyone on the planet to use, yet so freaking functional. It just works. Everything just works and it looks simple. Like from the outside looking in, you assume that it's very simply built. But on the back end, it is just a hairy mess of complexity. And it's just really good engineering and design, right? But most companies, 99% of companies have one or the other. They have good UI or they have good functionality, not both. I agree. So I'm going to go through generally, broadly speaking, this is what I found to be the use cases. Chat GPT as a general
Starting point is 00:29:17 thought partner. Like someone they're collaborating with and like trying to figure out ideas. Claude, coding in particular. It's like that's their coding partner. Perplexity, research. Everyone I spoke to who actually uses these models, they're like, it's as good as deep research and it's real time. So it can go and crawl the web in real time, which fascinating in and of itself. Grock, there was no like best use case, but it just seemed like generally speaking, everybody was impressed with Grock. The speed and responsiveness. I don't know if you've messed. with Grock, like it spits answers out very quickly. They're very good, has access to real-time data. It's, everybody's like, it's amazing what they've built a top-tier model in such a short period of time.
Starting point is 00:30:01 And then Gemini is just, hey, it's really good for the Google suite. Those were like the general use cases that I'm seeing people actually use with it. And I thought that was, those things were fascinating. Can I give you my personal takeaways from what you just said? I need to be thinking of using Jim and I more since I'm so embedded in the Google workspace, right? I just don't think of it. We've talked about notebook LM a bunch. I like the contact window size. I just don't like what it spits out. I don't like what it gives me, right? So who cares how big the context window is if it's not working with it well, in my opinion? I'm using perplexity more and more every day. As of today, I don't see a need to keep my $200 a month pro subscription because perplexity
Starting point is 00:30:44 does deep research, which is the only thing I'm using pro for. Now, I still like a second layer of redundancy. I still take my prompts, my deep research prompts, and I put them in deep research and perplexity at the same time, because it does give me different answers. And I still kind of like deep research a little better. I think it's more thorough. It gives me a longer answer with good relevant info. Have you tried Grox deep research? I've barely even tested it. I can't really speak to It's very, very good. Very good. Surprisingly good.
Starting point is 00:31:16 I want to make a YouTube video where I take the same prompts and put them in all three for specifically for deep research. So you think you need to use cursor more? I need to use cursor more. And I need to use Rapplet less, just because I'm not able to wrap up these projects. This is one of the things has been fascinating to me. It's like I wanted to learn how to do these things. So I did a project.
Starting point is 00:31:39 And have you ever heard of, I hate bringing these things up to you. because I feel like a high schooler who's in chemistry 101 or whatever talking to a PhD chemist. And it's like, have you ever heard of gravity? You did ask me what a lead magnet was a while back. That was offensive. Yeah. It's a offense. Have you ever worked in Google CoLab?
Starting point is 00:31:59 Nick, it's a good thing you ask because no, I haven't. Okay. I haven't. Do you know what it is? No, I don't. Okay. Genuine. So I have all of these transcripts from my podcasts.
Starting point is 00:32:10 And specifically, I just wanted to focus on the AI podcast. So what I wanted to do, and you know how this works, is I want to take all the conversations, aggregate them, and then be able to pull out information. Okay. But how do you do that? The context windows on only 120,000 tokens. And like four of those transcripts are more than 120,000. It doesn't work. So I needed to clean the transcripts, get rid of all the dead space, ums, Oz, timestamps, et cetera, and then get them into a format where they would all be combined. And I had them all saved. Yeah.
Starting point is 00:32:43 What about, do the transcripts identify who's speaking? Yes, I kept the speaker. Okay. I did keep the speaker because I wanted to know by person and I'll show you the output that I got. But I wanted to know by speaker, who's talking and what are they saying and why? Anyways, I don't know what to do. And what do I literally just go to chat TPT and I'm like, hey, this is what I want to do.
Starting point is 00:33:05 I want to take all these transcripts. I want to combine them. I don't want to clean them. And it's like, okay, where are they stored? and say Google. Okay, perfect. You're going to go to Google CoLab. Great.
Starting point is 00:33:13 Open a new project. Attach your drive. Great. I did that. And run this script. So Google CoLab is an environment where you can run Python script for it to actually execute a function. So I'm like, okay.
Starting point is 00:33:25 So it gives me the Python script. First couple of times it doesn't work. Then I go to Claude. Claude fixes my Python script. And it starts working. The first iteration, suck. Second iteration, suck. But by the, you know, a couple hours later,
Starting point is 00:33:39 I've got some really, really good data. In fact, I'm going to share my screen with you. Again, it took time for me to get to this place. Once it was spit out, I took it back to chat TPT. And I was like, hey, please clean up this data for me, make it look presentable, et cetera. And this is what it spit out. So now I have the episode with the person, okay, interview name, their business type, the industry, their technical knowledge, what their primary LLM was that they used.
Starting point is 00:34:12 Oh, this is cool. The main tasks and use cases. This looks like a lead magnet to me, Nate. Hmm. Hmm. Hmm. I'm not on that. Motivation for using these LLM, strengths, weaknesses, the ideal user profile, and then the key
Starting point is 00:34:25 insights. And like the key insight, I was like, hey, write me a 500 character summary of this conversation. Mm-hmm. But then I had to do a couple of other things. Then I had to actually go to Zapier and create a zap so that it, would interface with open AI, and then I learned I could actually just attach the API. I'm going like real technical here, but whatever. The API key into Google CoLab, so I didn't need Zapier anymore.
Starting point is 00:34:49 But because of that, I now have this amazing spreadsheet with tons of conversations with entrepreneurs who are actually using AI. And I understand the use cases that they're using it for. So now I can go to this and just ask it questions or, I don't know, make a quiz that says, or tell chatypte, which I've been working on. create a quiz for me. I'm a business owner and I want to know which one of these models I should use. So create a quiz that I can decide which model to use.
Starting point is 00:35:16 And it uses this information to create a quiz for somebody so they know which model to use. Dude, it's been just so fascinating to learn from these people and see how much application there actually is, even in the limited state that we currently see it. That's amazing. I love that you did that because we know that I hate helping on calls of people. So you're able to do it and enjoy it and then relay what you learn. Yeah. The number one use case for it.
Starting point is 00:35:39 right now sales for AI in general. Was there a selection bias? Did you happen to talk to a bunch of sales guys? No, they were all either owners or coders. And they were like, oh, I'm using it for my sales team to follow up with them. I'm using it to track leads. I'm using it as an after hours phone service. I'm using it as a chat bot for customers.
Starting point is 00:36:02 I'm using my sales team to prepare for calls. It was just all sales related. I thought that was really interesting. You know what framework that is? No, what? When you're launching products or services, stay close to the money, right? Stay close to the things that directly generate revenue and you can tie it to revenue easily, right? So let's say you want to start a SaaS, a B-to-B SaaS app.
Starting point is 00:36:23 It's like, oh, let's do HR. Should we do, you know, administrative assistance? It's like, no, like build something that people can use to directly make more money. And they know that your thing help them generate more money. That will have the highest likelihood of succeeding. Yeah. Yeah, yeah, it's a great point. And that's exactly what I found. We're talking to these people. It's all sales related. All right, what did you think? Please share it with a friend and we'll see you next time on the Kerner office.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.