The Startup Ideas Podcast - 5 New Tools from Google AI to make money/be productive (INSANITY)

Episode Date: July 21, 2025

Join me as I chat with Josh Woodward, VP of Google Labs & Gemini, as he showcases Google's latest AI products and their capabilities. The conversation covers Gemini's advanced features including perso...nalized context integration and video generation, Flow's AI filmmaking capabilities, Notebook LM's research and knowledge exploration tools, Stitch's UI design automation, and Project Mariner's autonomous web task execution. Throughout the demonstration, Josh highlights how these tools can empower both professionals and individuals to create high-quality content and automate tasks. Timestamps: 00:00 - Intro 01:57 - Gemini app features and capabilities 06:53 - Video generation with Gemini 13:53 - Flow AI filmmaking tool demonstration 21:17 - Notebook LM research and knowledge exploration 26:47 - Stitch UI design tool overview 31:04 - Project Mariner autonomous web agent demo Checkout Google’s AI Product Suite: https://labs.google Key Points: • Josh Woodward demonstrates five Google AI products: Gemini, Flow, Notebook LM, Stitch, and Project Mariner • Gemini features include scheduled actions, personalized context, and video generation capabilities • Flow is an AI filmmaking tool that allows users to create and edit high-quality videos with simple prompts • Project Mariner enables AI agents to perform web-based tasks autonomously with human oversight The #1 tool to find startup ideas/trends - https://www.ideabrowser.com LCA helps Fortune 500s and fast-growing startups build their future - from Warner Music to Fortnite to Dropbox. We turn 'what if' into reality with AI, apps, and next-gen products https://latecheckout.agency/ Boringmarketing - Vibe Marketing for Companies: http://boringmarketing.com/ The Vibe Marketer - Join the Community and Learn: http://thevibemarketer.com/ Startup Empire - a membership for builders who want to build cash-flowing businesses https://www.skool.com/startupempire/about FIND ME ON SOCIAL X/Twitter: https://twitter.com/gregisenberg Instagram: https://instagram.com/gregisenberg/ LinkedIn: https://www.linkedin.com/in/gisenberg/ FIND JOSH ON SOCIAL X/Twitter: https://x.com/joshwoodward LinkedIn: https://www.linkedin.com/in/joshwoodward/

Transcript
Discussion (0)
Starting point is 00:00:00 Honestly, Google AI has been absolutely crushing it. Josh Woodward, who's leading up a lot of Google AI's efforts, came on the pod and showed some unreleased features, some experimental features, and some products that are going to make you a more productive person. I brought him on. I'm not sponsored by Google at all, just so I can learn how to use these products.
Starting point is 00:00:21 I feel like I haven't spent enough time with Google AI products. So I had one of the top guys, one of the top dogs, come in and explain it to us. This is a primer on how to use Google AI product suite and what you need to know. So I'm glad Josh came on and showed me what I need to pay attention. All right, Josh, we're going to cover some of the most interesting of Google's AI products today. What are you going to take us through? And by the end of the episode, what are people going to learn?
Starting point is 00:01:05 Well, we're going to try to show a lot of stuff today. So I'll try to do these five demos in about the next 20 or 30 minutes. And I'm really hoping you're going to learn kind of where a lot of Google's AI is at the frontier. So we're going to talk about the Gemini app. We're going to create some videos. We'll be able to go dive into research, create UI and screens for code, and then do some automation computer use stuff. And while you're taking us through that, could you give your sort of inside tips and tricks on how to use these apps? Because I know that some people, you know, people play to a Gemini, people play with No EpicLM,
Starting point is 00:01:40 but they're looking for, you know, how do I get the most out of these products? Yeah, definitely. Yeah, we'll do that. Okay, cool. All right. Let's, I mean, let's start from the top, Gemini. All right. Sounds good.
Starting point is 00:01:52 So we've opened a bunch of tabs here. So you get to see how we go. So I think a lot of your viewers have used Gemini. Hopefully they use it every day. What you've got here is basically the home street, right where you land. And I'm going to show you some stuff that's available in our kind of pro version of Gemini. That's the one that's $20 a month. And one of the things we've been putting a lot of emphasis into is how do we start to create
Starting point is 00:02:18 more interesting replies? I'm just going to paste in a prompt I had written earlier. Teach me about photosynthesis, make a quiz to go with it. And so you can see here in the upper left, we're using the 2.5 pro model. This is the great model that's great, not only at kind of thinking, which is what it's doing now, you can expand that and kind of see how it's starting to put all this together. We've also got the 2.5 flash model really fast replies. And so as this is coming together, what you're going to start to see is like not only a traditional reply as it breaks down and
Starting point is 00:02:52 teaches you the concepts, but also this quiz that is going to go along with it. So here comes the reply back. I'm just going to close the thinking. And you can see here it's given a nice little succinct answer. And then you see it's linked to YouTube video, which is great. That's a new feature we've been adding in as well as this quiz. And so what are the main ingredients for plants? What does it need? And you can even built in a hint here it looks like so you can think about this. So let's see. They probably need something like this. Do you want to take a guest here, Greg? You know, this is bringing me back, Josh, to be honest, you know? Like my elementary school, it is. Yeah. It's the water and carbon dioxide seems about right.
Starting point is 00:03:30 There you go. There you go. So that's one of the things we're seeing with Gemini, tons of students are using it. Right. This pro plan, we've just done a big student offer. We'll start some more of that for back to school. So anyway, that's coming for a lot of new student teachers. It's kind of fun. I'm going to create a new chat here. And one of the other things are seeing people do a lot with Gemini. You asked about tips and tricks. And so what the power users are doing is they're actually creating scheduled actions. So again, I'll just type in a prompt or paste in here. Send me a digital. of the OkC Thunder info every morning at 7 a.m.
Starting point is 00:04:04 If you're an NBA fan, I love the thunder. So this is going to go out and it's going to do a couple of things. It's actually going to construct kind of the first info digest. Think if you're the president, for example, you'll get like a daily briefing. And so this you can think of as almost a daily briefing. And here it is. It's gone ahead and created this digest. And what's cool is every morning I'll just get an update about here's what the players are doing.
Starting point is 00:04:28 here's any kind of off-season trades. And you can go in and edit this. You know, in the past, people would have created maybe Google news alerts or had to go through and dig and assemble all this info. So this makes it really easy to do. So that's that one. On that piece, if you're like an entrepreneur or solopreneur type person, like what are similar digest that you think would be helpful for someone who's, you know,
Starting point is 00:04:58 know, a business. Yeah. Yeah, so we see a lot of business owners starting to use Gemini, too. They do a couple of things. One, they track how their own brand or their own store is doing. And so it's good to kind of keep an eye on what people are saying about you, how you might be out there. The other thing they do is they do that for competitors. So they may get their own digest, but they also study that. The other thing we've seen with some of these actions, Greg, as well as deep research, one of the main features in Gemini too is they really will send certain products they're tracking and they may do research on those products. I know someone who kicks off a new product every morning for a deep research report and maybe they're thinking about a product they might want to build or put
Starting point is 00:05:41 something in their inventory. So those are ways people are using it. Cool. Yeah, yeah. Sam Altman, the co-founder of OpenAI, just said that it is the era of the idea guy and he is not wrong. I think that right now is an incredible time to be building a startup. And if you listen to this podcast, chances are you think so too. Now, I think that you can look at trends to basically figure out what are the startup ideas you should be building. So that's exactly why I built ideabrowser.com. Every single day, you're going to get a free startup idea in your inbox, and it's all backed by high-quality data trends. How we do it, people always ask.
Starting point is 00:06:23 We use AI agents to go and search what are people looking for and what are they screaming for in terms of products that you should be building. And then we hand it on a silver platter for you to go check out. We do have a few paid plans that take it to the next level, give you more ideas, give you more AI agents and more almost like a chatGVT for ideas with it. But you can start for free ideabrowser.com. And if you're listening to this, I highly recommend it. Okay, the next one is actually when it's been a little bit in the news this morning, just about an hour ago. So we've been adding a lot of video into Gemini.
Starting point is 00:07:06 And today's announcement is actually the ability to take this V-O-3 model, which is unbelievable because it has incredible realism and physics and everything on the visual side, but it also adds sound. And so you can create these videos. is there eight second clips, 720P. In this version, it's now two times faster than we first announced it at Google I.O. And I'm curious, Greg, we can just take a request here. Is there a certain video or anything you're interested in?
Starting point is 00:07:37 Or we can try one? Yeah, I mean, I recently launched a new startup called Idea Browser.com, which basically brings you new startup ideas every single day. And I've been playing with ads, AI sort of ads. So I wonder, like, could you do something like, I don't know if this is possible. Yeah. You know, you ever see those TikTok or Instagram ads where it's like a podcast studio, but it's like a fake podcast studio? Hmm.
Starting point is 00:08:10 So it's like, you know, it's like it almost looks like a Joe Rogan studio. Yeah. So it's almost like a fake podcast studio with two people maybe. Yeah, exactly. a host and a guest. And what do you want them to be talking about or the sound effects or something maybe? Well, so can I have them like say something, like a script almost? Yeah, in the new version, you will be able to.
Starting point is 00:08:35 Yeah. So I mean, like, yeah, I just found out about ideabrowser.com, you know, I'm finding the most interesting startup ideas and trends there. Can't believe I didn't know it existed. Okay, let's try it. I'm going to make it a little shorter just because, it's an eight second clip. Oh, true.
Starting point is 00:08:54 We can send this one off and then we can come back and look at it. You can see it's going to take about a minute or two to generate. Right. Okay, cool. So let's keep that going in the background. That'll be interesting to see. The big new feature today is rolling out. It's at about 1% right now because we just started it is the ability to also bring an image
Starting point is 00:09:14 as a reference in or a photo. So you'd be able to maybe have a photo of that podcast studio. Right. And then maybe have the certain people. or whatnot and kind of have that sort of animate and come to life. So that's pretty cool. Which is so important, right? Like you need, you know, having that context ultimately is going to get better results. Exactly. Yeah, you got it. You got it. The last thing I want to show is actually, well, this is generating, I'll just create a new chat. There's some stuff we've been talking about
Starting point is 00:09:43 and started rolling out around how we're going to make Gemini the most personal, proactive, and powerful assistant for you. And that first P, the personal, is something that I just want to show maybe teaser for, but keep it kind of short here. But if I go in, there's an area called personal context. And you can see here, we've been talking about this or testing it internally, where with your permission, you'll be able to link in things like your Google Photos data or your search data or your YouTube data.
Starting point is 00:10:14 And you can start to get some pretty interesting replies, again, with your permit, your ability to kind of turn these on and off. But I've been using it when you're asking about tips and tricks. It's really amazing if you're planning like an upcoming trip. It knows that I have my wife and I have four kids. It can suggest things based on places I've been in the past that I might like. So like, oh, you're going to go to Italy. You have four kids.
Starting point is 00:10:43 Here's family, family, friendly, friendly restaurants near the Coliseum. or it might be like, hey, I checked your past trip photos, and it looks like you have this interest in this hobby, like, I don't know, pottery or sketching, and it will kind of suggest things that way. So I just wanted to show this to you and your viewers is like a little bit of kind of a view of what's coming, and so we can share more of that when it's ready.
Starting point is 00:11:06 Cool, I appreciate that. Yeah, I think I actually tweeted this morning that, you know, I think it was, I said, Chrome's 3 billion users suddenly look like the most value data set on earth. And I think it's really, you know, Google is such an interesting, at such an interesting place because it, it knows so much about you because we, you know, use the products every day. We live in those products. So my hope is like, that's why I think a lot of people are getting a lot of good, you know, are starting to get really good outputs out of these
Starting point is 00:11:36 products is because of that context. So just something, I mean, obviously, I'm not like sponsored by Google or anything like that. We have no relationship. But I'm just something that I've notice, and I'm hopeful that the more context that Google starts, you know, feed it drip feeding into me because I use Chrome, because I use Gmail, because I use these other products, I'm hopeful that the outputs are going to continue to get better. Yeah, well, that's actually how we're thinking about it is, you know, for someone like you who's excited to link this context together, we want to meet that possible. And then you can see from that kind of look ahead, there'll be other Google products that, you know, again, if you want to
Starting point is 00:12:11 you'll be able to link in and then use it as context. So, okay, cool. Let's check back in real quick and see if our video. Oh, here it is. All right, here we go. Okay, so here's our fake podcast studio. I'm sure I got my audio on. Let's see how it came out.
Starting point is 00:12:29 Just found out about ideabrowser.com. I'm finding the most interesting startup ideas there. Yeah. Cool. I mean, visually, by the way, this looks stunning. Like, this is exactly what I had in mind. And I think, like, from my perspective, I'm looking at this is people don't want to read anymore.
Starting point is 00:12:47 So if you're designing a website, if you're building apps and stuff like that, they're used to Instagram stories. They're used to just consume YouTube. They're used to consuming video. So I'm looking at like my portfolio businesses and I'm thinking like, okay, where can I create video to make it more engaging, to tell my story better? And to me, this is like an unfair advantage. Well, I think one of the things we're seeing both with the V or,
Starting point is 00:13:11 video generation and imagine image generation is Gemini makes it so easy to just quickly explore lots of ideas. And then, yeah, you can download it, share it, drop it in wherever you want. So yeah, I totally agree with you. I guess the hard part becomes how do you come up with good ideas to generate, you know, interesting content, right? People, you know, on X, you know, they call it taste, you know? That's like the word of the month. Do you have any insight as to like if you're trying to get the most out of some of these video models and you want to come up with good ideas, what do you recommend to people? Yeah. Well, I think one thing is actually an interesting segue because we can start talking about flow, one of our other products.
Starting point is 00:13:58 But it's like I try to just look at lots of content for inspiration. And so like if I cut over here just to show you like this is a product we announced at Google I.O. 50 days ago when we're recording this now. And this is really an idea of like, how do you make an AI filmmaking tool where lots of people can create with it? And so we worked with some incredible creators, there's all kinds of features.
Starting point is 00:14:23 But I think one of the things, just to jump to it, is like one of the parts of this product, which is fun, is called Flow TV. And it's just a huge gallery of lots of different things people have created. So here's like always a fun one.
Starting point is 00:14:37 This is like off-season sanks. And what's fun is just like with your keyboard, you can navigate through these different channels and kind of see stuff people are creating. And we've actually made it where you can show the prompts too for each of these. And so one of the big themes we're seeing around all of this generative media creation is around remixing and being able to kind of take inspiration and kind of put your own sort of touch on it. So this is kind of the gallery viewing, see people skydiving with glaciers and all kinds of crazy stuff. stuff. But how this tool works is actually kind of fun. You go out to labs.comgoogle slash flow and you have a landing page here where it's like different projects I've been working on, giant penguin walking around or like mountain biking through like a lava field here. But you can
Starting point is 00:15:27 kind of go into these things and create different shots, different scenes. And all of this, of course, is backed by both V02 and VO3. And so you can go in and so, you can test some of these that goes with you actually hear the like lava magma crackling in the background as the bike is going through and what's interesting with this is we've tried to make it where say you generate something with a prompt and you just say add the seam and now you're suddenly in a really easy to use lightweight kind of editor and you can do all the normal things like make clips shorter but you can also do things like extend them. And this is real the power of AI starts to come through because you can say things like, I don't know, make a huge vulture come in from the sky, right? And this is something where we can stitch this together. And when you send this off, it'll take a minute or so here and it'll generate. And what's amazing about flow and VO as a model is that we're starting to
Starting point is 00:16:33 get to this point where you have consistent characters and scenes. And that's been one of the biggest requests from creatives all around the world. And so there's a few other things that are cool about flow. Maybe I can show you while this is generating. So one is we make it really easy for you as a creative to generate lots of options. So you can get two videos at a time or four at a time. And this is really propelling how fast people can explore a creative space. We also give you in this tool, again, because it's kind of for filmmakers,
Starting point is 00:17:05 creative types, lots of choice on the model. Do you want audio? Do you not want audio? Do you want the fast version? Do you want the high quality version? So a lot of control here The other thing that's cool is we allow you to go text to video if you want to write you know big prompt or frame to video and this is actually where you can give it a reference image and then be able to kind of create things based on that and so it's very similar to what I was showing you with Gemini Oh look. It just came back. So I'm just going to play it from the top you can see we've now stitched together two shots So we're at 14 seconds total. So I'll just play it here. It's honestly like mind-numbingly good. Like, you know, it's so good that it's just like, I can't believe.
Starting point is 00:17:52 I just, it's hard to believe how good it is. It's crazy. And when you think about it, it's all generated here in seconds. You saw that big vulture. So I think what we're starting to see is, and what's been really interesting as we've been building flow, it's a Google Labs product. One of our big values is we like to co-create with people.
Starting point is 00:18:12 So we've been working with filmmakers around the world to develop this tool. And that's really how we see it as a tool. And what's interesting, Greg, is folks that are, you know, top tier Hollywood types, they see this thing and they're like, oh my goodness, I can do so much with this. And it kind of raises the ceiling of what's possible. Then you've got people like me. I'm not a filmmaker, but I might have an idea or I might have a project I want to work on. And now I've suddenly got this incredible tool that's so easy to use.
Starting point is 00:18:41 it makes it happen. There's a huge roadmap here of where we're going. Like if I switch over here to like the frames to video, I'm able to kind of bring in different frames here and sort of compare them. This is super cool. We've got tons of camera shots like dolly in, dolly out. You can jib, you know, all the things you might expect to kind of pan, tilt, zoom around this. And I think this is really where it's going is like making these things super easy
Starting point is 00:19:10 and intuitive to use for people. Yeah, and my guess is, you know, if you're not a creative director and you don't know what Dolly In means or Dolly Out, whatever, like, I'm sure you could go to Gemini, say, I'm creating a script and, right? Like, and I need help kind of thinking about how I can get the most out of this product. Yep. And that's actually what a lot of people do. They'll start in Gemini.
Starting point is 00:19:36 They'll craft the prompts. They'll get help. They'll iterate really quickly. and then you can bring that right into flow, or you can create it from Gemini itself now. And so we're seeing a lot of that kind of back and forth. I think flow, you can think of it as really for folks who might have a longer duration project.
Starting point is 00:19:52 They may want to do something over several minutes, or maybe we've seen people do up close to an hour of stitching things together, whereas Gemini is really quick, those little eight-second hits and that you can kind of put together really fast. Very cool. Yeah.
Starting point is 00:20:05 And then, by the way, real quick on like the Hollywood versus individuals, piece. For me, I'll only speak for myself. I'm I'm most interested. Like, of course, I think this is going to change Hollywood, but, and make their lives more productive. But I'm more interested in, like, for me, I'm looking at this and I'm like, okay, as a person who's building startups, and you need to tell stories, this is going to help me compete at a way higher level than I've ever been able before. I mean, of course I could have done this, but it would have cost me hundreds of thousands of dollars to pay an agency to build it. Yeah, what's interesting. What we're seeing is kind of this barbell effect where folks that maybe have the knowledge, have the expertise,
Starting point is 00:20:51 they're taking tools like this and running with it. And then we're seeing folks, maybe solopreneurs or others who may have never had the skills or the access or the money or any number of things. And now they suddenly have a tool that they can kind of use to customize for what they want. It's interesting. Both of those effects are true in this case. So yeah. Yeah. So that's flow. It's a lot of fun to play with. So you can check it out. Okay, I want to shift gears a little bit. This is one. I'm sure your audience has heard a bit more about NoBook L.N. And you've talked about it too. So thank you. I think I want to show a couple of ways, again, more just like power user things. So NoBook, obviously a lot of people know if you don't. You can bring in your sources. You can get insights.
Starting point is 00:21:33 you can create podcasts and sort of see kind of where the answers are coming from. So that's kind of the high level idea behind notebook. It's been so fun to watch it grow. And it just keeps growing. So this is the home screen of notebook. Just as a quick walkthrough, if no one's ever seen it, you've got three panels here. You've got your sources. You can bring in any kind of file that you want, docs, websites, YouTube videos,
Starting point is 00:21:59 PDF, et cetera. You can chat with those sources. and then you can also just start creating stuff in the studio panel. And so kind of the most common use case, a lot of people do is they'll load up some sources. And this is a notebook about the California Gold Rush. We were studying this, my son and I, right before the end of the year. And you can type in a question like,
Starting point is 00:22:20 what were the economic implications of the Gold Rush? And the real thing that sets Notebook LM apart from other tools out there is its incredible ability to sort of show its work and cite things. So you're seeing it come back right now as it streams in. And of course it'll give you these nice replies. Like here are the implications of it. But as you scroll through this, you might be like, oh, I really want to learn more about that. And when you click on it, you can see it just takes you right to the document and kind of where you found the information.
Starting point is 00:22:47 So that's that's kind of one of the core things. I think people have heard about the podcast. I don't have to play the podcast here today. But I wanted to show you some of the new stuff coming and some of the newer features. So what a lot of people have started doing is actually you can make. manually add sources, but you can also discover sources now. And you can just describe things like give me more economic info about the gold rush. And what's going to happen there is when you send this out, we're going to take kind of a shot at trying to find other sources that are relevant to
Starting point is 00:23:21 what you're looking for. And so here it's come back. These are a set of websites. You can see some PDS on the web. What's really cool about this, Greg, one of my favorite features is it gives you the name of the source. And then this little byline, it tells you why we think this source is relevant to your notebook and what you might learn from it. So it's super cool to be able to kind of see like, oh, this is talking more about banking or this is talking more about wages and labor market. So with one click, you just tap it. They all get added to your notebook. It's made it really easy for people to kind of spider out and find other information. And then once you've got the information in there, you can start to transform it.
Starting point is 00:24:01 And one of the kind of sleeper hits that's gone really great is this mine map feature. So this gives you the ability to take all that knowledge and you can just expand these and find kind of like all kinds of little trails down here, like hard rock mining and what goes into it. And as you click through these, it'll bring you back to your sources. It'll help you understand it. And so we think the big idea with Notebook LM is it's a whole new way to understand knowledge. And what's been really cool is we've enabled a lot of sharing recently in the last couple of weeks.
Starting point is 00:24:34 So people are creating notebooks and sharing them either with their friends or their colleagues at work or even in a class. And you're starting to get almost like this collaborative knowledge exploration, which is a whole new level of notebook LM and what's driving a lot of growth too right now. Yeah, this is really cool. My quick use case for this sort of stuff is I'm constantly looking at building or buying businesses. and if I'm if I am going to do that I need to get smart about a particular topic so for whatever reason right now I'm like exploring like the book publishing industry and the music management space and the music publishing industry so kind of like media rights and stuff like that of course
Starting point is 00:25:19 I can go and read posts and books about it but you know when I'm in the car or I'm going for walks. I just like to just listen. Yeah, just drop it. Just drop it in. Yeah. So, you know, if you're like me, I think that using something like this to get like a very personalized level up is good. Of course, I still use, listen to podcasts. Of course, I still watch YouTube videos. But this is kind of like, for me, has been like a completely different experience. Yeah. Well, and one of the other really interesting things we're seeing people do with notebook. And there's a ton of students that use notebook.
Starting point is 00:26:02 And I think that's been another area. It's great for kind of being able to go deep in the areas you want to. And I don't know if you do this with the podcast feature, I'll get it going. And then there's, you know, an ability where you can like have this interactive mode, right? Where you can call in and they'll be like,
Starting point is 00:26:18 oh, hey, Greg, what's your question? You could ask your question. And it's all grounded again in those sources. So it kind of makes this really personalized learning and knowledge exploration possible. Totally. Yeah. And yeah, that's really cool.
Starting point is 00:26:31 I think, like, a lot of people listening here, like these are the people that like to level up. Yeah. And so, yeah, I'm excited for people to try this out. Yeah, yeah. All right, cool. We can keep going. Are you good?
Starting point is 00:26:46 We can go for another one. Okay, so the next one I want to show you, this is a super new one. It's called Stitch. So there's a Google Labs experiment. You can see it's in beta. And what we're really interested in is how can you can see here, design at the speed of AI, but how can you go from an idea to like a mobile or a web interface?
Starting point is 00:27:04 And we've got a bunch of examples and we're kind of playing around with this where we make it really easy for you to kind of describe what you want and Stitch kind of builds it with Gemini. So why don't I, I'll jump into this one. I'll just jump over tabs. This was one I was working on this morning just before just to show you kind of how it works. But you basically describe something like make me an app for discovering California activities, show some destination, musical events, and trip planning. And it's just like gets to work.
Starting point is 00:27:35 Like it will start creating all of these different screens for you. And what we're finding was super interesting, Greg, like if I click on one, I'll just go into the first one is California is like with one description in a tap, you can copy this code and you've got like the front end code ready to go. Or this is super cool. You just tap Figma and it'll copy it. You can see in the bottom right. And you've got a Figma file or like ready to paste in.
Starting point is 00:28:03 And these are not screenshots. These are actual designs, which is what's really amazing. You can go in then in Figma if you want and move stuff around, change it, etc. And so this one is a, I mean, maybe a good example of a Google Labs experiment where it's hyper-focused on, in this case, Greg, since you're talking a lot about how do you, kind of level up or get started. We originally thought like, okay, who might like this? Maybe it's designers, maybe it's PMs. Turns out engineers really like this tool because they can describe maybe a screen if it's like someone trying to start a company and they get like good base level of designs and then they can edit it from there. And so front end code always
Starting point is 00:28:43 maybe a little bit harder for some people. Maybe you don't want to do all the details or whatever. This kind of helps accelerate that and get you to kind of a baseline that you can edit that draft basically. If you had to, you know, if you had to say, what is the one killer feature of Stitch? Like, what is, you know, what is the one thing that Stitch does better than any other vibe coding tool? What do you think that is? Yeah, I mean, I think right now we're really trying to make it where a lot of vibe coding
Starting point is 00:29:14 today you might write a long prompt and then there's a lot of back and forth. And so what we've tried to do with Stitch is minimize that back and forth. and then give you the assets and the controls to kind of do common things. So, like, one of the things I love about Stitch is you can also just go up here and say, edit theme, make it all dark mode, change all the corner radius, change all the font. Like, common things that people get stuck on. We're really trying to focus on, like, the design quality here, but also making it really portable so you can move it to a tool like Figma if you want to go deeper.
Starting point is 00:29:47 And I think that's starting with the design process is kind of how we're really thinking about stitch. That's interesting because I think in general with AI, like the chat has become the interface understandably. But I think that some things are just not meant for chat. And sometimes chat is overwhelming. So I think having sort of a hybrid of chat with some, you know, productized buttons and stuff like that, I think it's interesting. Well, it's one of the things, it's interesting. You're hitting on an interesting pattern we're seeing is how do you get beyond the chat box? Because, you know, and it doesn't mean we're going to get rid of it. You can see Stitch, obviously, you can chat with it over here on the left and kind of edit if you want or bring in images as references.
Starting point is 00:30:31 But I think across Stitch, across flow, definitely across the Gemini app, you're going to see a lot more features like that photosynthesis example where we're trying to get people into a more natural state. Chat is not always the most natural state for interacting with these models. So, yeah. Totally. And yeah, it's not. and I don't know, for someone like me, like, I just find that sometimes chat is for me, and then sometimes I just, I need a click around and that it works better for me. So this is interesting.
Starting point is 00:31:02 Yeah, yeah. Do we have time for one more? Do you want to do one more? Can we do it? Okay, let's do it. Okay, the last one I want to show you is Project Mariner. So Project Mariner, this is our project. It's really experimental, again, prototype, fresh out of the lab.
Starting point is 00:31:17 we're really trying to understand how can these models navigate things like the web where you can give it tasks and it can go off and either do research or data entry or other things and kind of put this together. So what's really amazing about our Gemini models right now is they've gotten very good with the 2.5 series at planning, multi-step actions, and being able to also kind of raise their hand and be like, hey, I need help, I'm stuck here. And so that's one of the things we're exploring with this Mariner project.
Starting point is 00:31:51 Okay, Greg, so here's the home screen of Project Mariner. And you can see the giant experimental label at the top. And what we've been exploring this idea of computer use and agents, actually back since December. Our first version of Mariner was a Chrome extension. It didn't always work all the time, but it was like eager and it tried hard. So what we've tried to do with this, this is kind of you can think of almost as like Mariner 2.0 is pull it out of the Chrome extension,
Starting point is 00:32:18 put it in a website. And in the background, instead of operating on your local browser, we've created an entire infrastructure with virtual machines. And so what that means is you can spin off lots of tasks at the same time. And so what's really cool here is with Mariner, you've got these tabs at the top, your active tasks, things maybe you've saved, tasks that have ended. And I'm just going to show you this is a test account I have here, but we'll just pick one. I don't know, find me three jobs. This is one of the sample ones to kick off. And what's interesting is you can see here is kind of preparing your session. This is actually firing up that virtual machine that I was talking about. And it's going to go off and spark creating kind of a plan for
Starting point is 00:33:02 this action. And you can see there's the browser. It's up. And you can actually see how the model thinks here on the right panel. And this has been fun. Actually, as we've been testing this. This is available for some of our Google AI subscribers right now. It's kind of in a limited test use case. People sometimes will just watch this thing because it's actually kind of interesting. It will navigate through pages. It'll scroll. You can see its thought process. And I mean, I remember the first time Greg I saw this. It was like, I was just shocked. I was just kind of watching something that was like, oh, I know how to do that. And it now knows how to start to do that. And so you can see we gave it a thing here, like find three job possibilities
Starting point is 00:33:47 for, you know, engineers in New York on this thing, climate base. And it's going through, it's now navigated to the site. It's finding a job posting for a senior data engineer. Now it's searching through kind of a broader set of listings. It's just going to keep going. And so it's kind of interesting as you go back to the home screen and you're now going to imagine like a whole dashboard of these tasks you can fire up. So I'll throw another one in the next. We were talking before we jumped on about, I'm in Oklahoma City right now as we're recording this. And this one is like kind of a fun one. It's like, go find five restaurants in Oklahoma City, add them to my Google Maps, places to visit.
Starting point is 00:34:25 And so it's going to, again, fire up the browser. There's the browser. Goes to Google. Does some searches. And what's interesting about this is it'll start to do kind of the searches as it goes through, and we haven't sped this up. This is happening in real time right here. it's going to start trying to navigate through and do the research.
Starting point is 00:34:44 And you'll eventually get to a point here in the video where it's going to pause and be like, okay, wait, I'm not signed in. You can see this is a signed out browser here, right? And it'll intervene and it'll say, can you help me? And so these are some of the rails that we've built into the product also to kind of let you know about what's going on. And what's amazing now is as people are using these. You can see that they're just running. And so a lot of the early users may fire up like five or ten of these.
Starting point is 00:35:15 And, you know, if something gets in in one of these stuck states or it needs a human in the loop, it'll kind of change status. And it'll be a little flag and it'll be like, hey, Greg, I need your attention here. And this is a pattern we're seeing across a lot of our Google Labs projects right now. This one is for agents and kind of task-based stuff. We have another product for coding agents called Jules, where you can deploy lots of of coding agents to go fix bugs or build features. And there's a really interesting, you were talking about how do you get beyond the chat interface?
Starting point is 00:35:46 These kind of dashboard interfaces are these bird's-eye views of what's happening. To me, this feels like a glimpse of what's coming in the future, where you're able to kind of manage and oversee and give different assignments, in this case, to kind of an AI agent that we call Project Mariner. Yeah, I mean, you're essentially spinning up interns to do tasks for you.
Starting point is 00:36:07 It's interesting. in a lot of these cases, it's sometimes there are tasks that no human could ever do. And I think to me, those are the really interesting ones. What's an example of something like that? Well, one of the things we do with our project Jules, the coding agent, is, you know, we'll do a bug bash. We'll file a bunch of bugs. Now we're kind of dictating bugs and we let AI transform them into bugs. But it's like, you can just put Jules on a GitHub backlog and it'll fix like 30 bugs in a minute.
Starting point is 00:36:36 Do you know what I mean? So it's like you can you can kind of imagine these leaps that are coming. They're kind of superhuman in that way. Yeah. It's one of those things where I think that we don't even know how people are going to be using this because it's so early. You know, like there's going to be so many different tasks that like I'm trying to think in my mind. I'm like, okay, like how would I use this in my day to day? Right.
Starting point is 00:37:02 Like what are tasks that I have? Yeah, yeah. Well, and I think the key to all the. this is how do you design these AI systems in a way that are both transparent and you can trust them and intervene. This is a good example. It just came back. Look here. It says like needs your attention, right? So it's like I tried to click this site. You can review it. And if you read through the log here, it's like we've paused because I'm trying to click the save button, but since I can't log into your account, would you like me to do something else and kind of help
Starting point is 00:37:28 here? And so this is actually a good example of how we're exploring. And this is why it's all experimental right now, but like, when is the right time to come back to you? And when is the time where over time, maybe you build up trust with this and you kind of let it go? But all of these are new kind of human computer interaction design problems as well as technical challenges. That's awesome. Yeah. All right, Josh. You got me fired up. Like, I did, first of all, I didn't even know that this existed. You know, I've played with, you know, chat GPT operator. I've done a tutorial on it. I want to do, I want to play with this. I want to try it out.
Starting point is 00:38:07 I want to play with all this. So I, you know, thank you for getting my creative juices flowing on this. Yeah, definitely. Well, and if you or others, like, we put all this stuff on the Google lab side, it's just labs.com. As far as I know, it's the only site that has like a hot pink navigation banner. But you can see as you scroll through, there's Mariner, Stitch, jewels.
Starting point is 00:38:29 We talk about all these. But, yeah, this can be a place you can go get some of the cutting edge ladies. experiments from Google and AI. Cool. Well, I'll include that in the show notes for people to go and check out, take a first spin. And that's all I ask people do is like, you know, yes, it's great to, Josh, I appreciate you coming on, sharing all this sauce. But it's, you know, stop listening to us and just start playing with the tools, right? The best way to learn is to play. Definitely. Thanks for having me.
Starting point is 00:38:56 Thanks, Josh. See ya. See ya.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.