Lenny's Podcast: Product | Career | Growth - Lessons in product leadership and AI strategy from Glean, Google, Amazon, and Slack | Tamar Yehoshua (Product at Glean, ex-Google and Slack)

Episode Date: September 26, 2024

Tamar Yehoshua is the president of product and technology at Glean. Prior to joining Glean, Tamar was chief product officer at Slack, where she led product, design, and research as the company scaled,... including a 10x increase in revenue, its public listing, and an acquisition by Salesforce. She also led product and engineering teams at Google, working on search, identity, and privacy, and at A9.com, an Amazon company. Tamar has served on the board of directors for RetailMeNot, ServiceNow, Snyk, and Yext. In our conversation, we discuss:• Why you don’t need to be a well-run company to win• The impact of AI on product management and the future of work• How to build strong cross-functional relationships, especially with engineers• Lessons learned from working with leaders like Jeff Bezos and Stewart Butterfield• Strategies for staying ahead in a rapidly evolving tech landscape• Much more—Brought to you by:• Explo—Embed customer-facing analytics in your product• Sprig⁠⁠—Build products for people, not data points• Sidebar—Accelerate your career by surrounding yourself with extraordinary peers—Find the transcript and show notes at: https://www.lennysnewsletter.com/p/you-dont-need-to-be-a-well-run-company-to-win-tamar-yehoshua—Where to find Tamar Yehoshua:• X: https://x.com/TYehoshua• LinkedIn: https://www.linkedin.com/in/tamar-yehoshua-886217/• Newsletter: https://tamaryehoshua.substack.com/—Where to find Lenny:• Newsletter: https://www.lennysnewsletter.com• X: https://twitter.com/lennysan• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/—In this episode, we cover:(00:00) Tamar’s background(02:09) Key advice for career success(06:54) Understanding people and motivations(09:33) The importance of impact(11:20) Navigating company chaos(18:40) Career planning: a different perspective(26:22) Lessons from industry leaders(37:59) Building stronger cross-functional relationships(42:00) Streamlining OKR reviews with async methods(45:26) Why you shouldn’t worry so much about making users unhappy(47:50) The power of listening in leadership(52:34) How to leverage AI so you don’t fall behind(01:06:39) Closing thoughts and lightning round—Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com.—Lenny may be an investor in the companies discussed. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.lennysnewsletter.com/subscribe

Transcript
Discussion (0)
Starting point is 00:00:00 Make sure you go somewhere where you have a good engineering partner because if you have great ideas of what to build, but you can't get them built, then you go nowhere. So that has to be part of your evaluation criteria that you meet and value your engineering partner before you join. And then I think what's really important is that you're aligned. You understand your roles and responsibilities and where you're going to divide and conquer and where you're going to be aligned. You don't want any of this like people in the organization, they ask mom, they ask dad, and they got different opinions. and playing one against the other, like, that doesn't work. Today, my guest is Tamar Yehoshua. Tamar is currently president of product and technology at Gleen,
Starting point is 00:00:43 one of the most successful enterprise AI companies out there right now. Prior to joining Gleen, Tamar was chief product officer at Slack for four years, where she let product, design, and research, as the company scaled, 10x their revenue, went through IPO and then got bought by Salesforce. Tamar also led product and engineering teams at Google, where for many years she was responsible for the Google search experience. She also spent five years at Amazon as Director of Engineering and Vice President at A9.com. She was also venture partner at IVP and has been on board of directors for Service Now, Sneak, Retail Me Not, Yacht.
Starting point is 00:01:17 In our conversation, we get into all kinds of juicy advice, including why companies don't have to be run well to win, why you don't need a career plan, the two habits she credits most for helping her succeed throughout her career, what she learned from Jeff Bezos and Stuart Butterfield and Mark Benioff, how to build stronger cross-functional relationships, and a bunch of advice on AI, including how it will likely change your jobs, examples of how she and her colleagues are already using AI to be more productive in their work, and what she's learned about building AI-based products that are non-deterministic and can be very unpredictable.
Starting point is 00:01:51 This episode is for anyone looking to level up as a leader and get a better sense of how AI will change your job. If you enjoy this podcast, don't forget to subscribe and following your favorite podcasting app or YouTube. It's the best way to avoid missing future episodes and it helps the podcast tremendously. With that, I bring you Tamar Yehoshua. Tamar, thank you so much for being here and welcome to the podcast. Thank you so much for having me. I've got so many people recommend you coming on this podcast. I'm really happy that we're finally doing this.
Starting point is 00:02:23 I want to start with a question that I've started to ask people who have had extraordinarily successful careers, which you've had. So let me ask you, what are one or two specific skills or mindset or habits that you think most contributed to your success during the course of your career that you think might be helpful to people who are trying to figure out how to accelerate their career or just be more successful in their career. One of the things that I think is overlooked is do a really good job at whatever your job is at that point. So people have a tendency, especially product managers, are very ambitious and they want to
Starting point is 00:03:00 get to the next level and they're always eyeing the next job. But you're not going to get the next job. job unless you do really well at the job that you're in. Like, knock it out of the park, however simple, however easy it may be to you, do a great job. And in tech jobs, there's like table stakes. There's table stakes of you need to be technical, you need to know the latest technology. You need to understand your product, the product you're working on, no matter what your role is. You have to understand it deeply. You need to understand metrics. So especially product managers have kind of a wide berth of things that they need to understand. So,
Starting point is 00:03:35 So those are a given. You need to do that. This episode is brought to you by Explo, a game changer for customer-facing analytics and data reporting. Are your users craving more dashboards, reports, and analytics within your product? Are you tired of trying to build it yourself? As a product leader, you probably have these requests on your roadmap, but the struggle to prioritize them is real. Building analytics from scratch can be time-consuming, expensive, and a really challenging
Starting point is 00:04:03 process. Enter EXPO. Explo. Explo is a fully white-labeled embedded analytics solution designed entirely with your user in mind. Getting started is easy. Explo connects to any relational database or warehouse and with its low-code functionality,
Starting point is 00:04:19 you can build and style dashboards in minutes. Once you're ready, simply embed the dashboard or report into your application with a tiny code snippet. The best part, your end users can use Explos' AI features for their own report and dashboard generation. eliminating customer data requests for your support team. Build and embed a fully white-labeled analytics experience in days.
Starting point is 00:04:42 Tried for free at Explo.co.clo.com slash Lenny. That's EXPLO.0.com slash Lenny. This episode is brought to you by Sprigg. What if product teams knew exactly what to build to reach their goals? From increasing conversion to boosting engagement, these challenges require a deep understanding of your users, something that you can't get from product analytics alone. Meet Sprigg, a product experience platform that generates AI-powered opportunities to continuously improve your product at scale. First, Sprigg captures your product experience in real-time
Starting point is 00:05:19 through heat maps, replays, surveys, and feedback studies. Then, Sprigg's industry-leading AI instantly analyzes all of your product experience data to generate real-time insights. Spriga-I. goes even further with actionable product recommendations to drive revenue, retention, and user satisfaction. Join product teams at Figma and at the notion by uncovering AI-powered product opportunities at scale. Visit sprig.com slash Lenny to book a demo and get a $75 gift card. That's sprrig.org.com slash lenny. So now the question is the difference in leadership and executive roles and like when you're getting there. How do you start transitioning?
Starting point is 00:06:04 So after you've done a great job at everything and you understand the core skills that you need, another thing you really need to know is understanding people and motivations. And when you're building products, you have to understand why does somebody want to use your product? What problem are they selling? Why do they want to click on that button? What's going to make them feel good when they click on them? what's going to give them delight and what's also going to make them feel bad and frustrated and what do they not want to do? So you need to understand motivations and people for building products and for
Starting point is 00:06:42 building teams and organizations. So just like why does somebody want to click on a button? Why does somebody want to join your team? Why do they want to work hard? What are they trying to accomplish? What's the goal for their career? So you have to be able to read people, ask lots of questions to understand them. And I'll say one thing that really helped me, this is a strange segue, but my father was a psychiatrist. And when I was growing up, we would have family occasions, go to the fence, whatever. And afterwards, in the car ride back, he would always give his perspective of analyzing what happened at the event. What this person was thinking, why did they say this? And then he would, he would like quiz me of like, why do you
Starting point is 00:07:28 think they did that? And it was really interesting because it taught me to see the whole room, to see how people react. Like Lenny, if you say something and somebody else is there, look at the other person, what's their face saying? You can understand so much if you're paying attention. So I think when you want to build for people and lead organizations, it is about the people and understanding them and motivating them. I love this advice. And I feel like we could do a whole podcast on just this topic. So on this last point about understanding people,
Starting point is 00:08:05 is there an example of this in either a product you built of just like, oh, here's something I noticed about someone using Slack or Google or Amazon that changed the way I think about building this specific feature? One of the things that I caution product managers about is that you don't want to be too overly reliant on metrics. and you want to also have an intuition. You want product managers who understand intuitively their customers and their product. And sometimes you'll make decisions because you just know it's the right thing to do because
Starting point is 00:08:36 it feels right. And it usually is right if you understand your product well enough. How do you get good at it? Ask a lot of questions. Don't assume you know. Go in, Mark Benyoff would always say, have a beginner's mind. Go in assuming that you know nothing. and listen to your customers, listen to the people, because I also see this as like,
Starting point is 00:09:02 you're building a feature and you think it's the best thing, because of course everyone's going to want it because you worked on it and you're going to put it front and center in the interface where everybody's going to see it. Well, no, you've got to earn that right. And that is another thing that people do is they want the thing they worked on to be right there, but it might not be the most important thing that a person needs at that point. So have perspective, have perspective of what your users are actually trying to achieve. Going back to your first point about doing a great job at the job you have, I imagine some people hear this and the advice is do a great job at the job you're already doing
Starting point is 00:09:42 and they may feel like they are and there's other reasons that are being promoted. Is there an example from your career or a story you could tell of just like to clarify, like what doing a great job look like where it's not just like I hit my goals. It's like here's what it looks like. Here's how you actually get ahead. Are you helping the business move forward? So it's not about I achieved what I was asked to do, but did you build something that people actually used? It's not about just launching something. And did you do the right thing for the company. And that is different. It's a different mindset. Did you enable the entire organization to be more productive despite you? So I remember very early in my career, I was working as an
Starting point is 00:10:33 engineer, and I was offered a job to manage a team that was across different programs. And I went back to my, I took a vacation. I came back and I said, you know, I don't think this team should exist. It was my first management job. And they were like, and I wanted to be a manager. And I said, here's why I don't think that this team should exist. It's not the right thing for the company. It's not going to be productive. And my manager was so stunned. He was like, wait, you're saying no. And I'm like, yeah, because here's how you should organize it. And then he's like, you know, you're right. And I'll find you something else. And he did. If I were to put this into one word, it's impact. Drive impact.
Starting point is 00:11:18 Yeah. Amazing. Okay. Going in a different direction, we were chatting before we started recording this, and something that you shared with me, and some people may be really surprised to hear this, but I completely agree with this take, is that you don't need to be a well-run business to win. I've seen this myself.
Starting point is 00:11:38 I'd love to hear your insights here, and especially where you notice this. What parts of your career noticed this to be true? I love working at well-run companies. it's more fun. Your people are happier. I like running a well-run team. So I aspire to have a very well-run team and to work at a well-run company. But what I've seen is when a company isn't well-run, like IT isn't working, marketing is broken,
Starting point is 00:12:05 they're not enough people in HR, there's a lot of turnover, all of these things. I have seen that they're not correlated to the company being successful. So I can think of a couple examples right now of companies I know, not glean where I'm working today, where there's like high executive turnover, where people get yelled at, there are lots of people fired, there's reorgs all the time, people I talk to are super unhappy, but the numbers are amazing. Like they're growing like crazy. And the opposite to sit is also true.
Starting point is 00:12:40 I can think of one company I know really well, amazing CEO, well run, well-oiled, machine, everything, hires that executives, and they flatlined. So you just see it. You see it over and over again, and people get very upset about these things that aren't working. And one of the things I try and do is give a perspective of what matters and what doesn't. And it might even be to the sales team because you get like all these requests for features all the time. If you did every single one, it would be impossible. But even if you did, 80, 90% of them won't matter for the success of the company. But then there are some that really matter. So what are the things that really matter? We always talk about product market fit. Nobody really knows what product market
Starting point is 00:13:26 fit is. Everybody has a different explanation, but it means like people want to use your product, that they're like clamoring for it. So you've built something that people value and that they're, people value and that solves a problem for them, but that's also not good enough. You need to build a great product, but you also have to have distribution, and you need to have a sales team that works. And those are probably, and you have to have enough money in the bank to get there. So those are probably the things that are the most important. I might be missing something. And then within each of those, there's the things that really mattered. And there's so many features that we built at Slack that were the most important features ever that failed and nobody used,
Starting point is 00:14:08 so that clearly didn't have an impact. And you can see that in retrospect, but I think after being at multiple different big companies and small companies, I have that perspective of let's just make sure that we do the right things and don't get too worked up about all the things that are broken, because every startup has so many things that are broken. So I think a really interesting insight here is that if you're working at a company that is just chaotic and it feels like,
Starting point is 00:14:35 like we don't know what we're doing. I don't know how this thing is running. I don't know how this will continue to be successful. Your experience is that most, is it that most of the successful companies you've been at are just like chaotic internally and aren't like incredibly run? And that's normal.
Starting point is 00:14:50 That's very typical. Until they get to a certain scale. Now, once you reach a certain scale and you've already conquered the market, then you kind of need to be well run. Then you bring in professional managers and things are about the cost and executing and getting all the, like, once you get to like over 5,000 people or 10,000
Starting point is 00:15:10 people, like you got to have things that, I mean, then you're like a growth engine. So different, you have to know what phase you're in and what's important at that phase. So it isn't that at every phase, chaos is okay. And also some chaos is okay. And some chaos is not okay. If you're changing your strategy all the time and you're changing your direction and you're changing, like, you're changing projects on people all the time so that they can't, like, actually achieve anything. So there's, this is, again, so you can't simplify it that some chaos is okay and some isn't. And also, some chaos is right for you as a person. Like, there are some well-run, there's some really great companies I would never work at, because
Starting point is 00:15:53 they don't fit me. They're not a company I would enjoy going to work in the morning, or they're not aligned with what I'm good at. So just because a company is doing well, if the chaos is chaos and something that's going to make you upset and unhappy, don't work that. Is there a correlation there just like companies that have strong product market fit? Things are just breaking as they're going through hyper growth, just thoughts on why this is the case. A lot of it is that because if you are in hypergrowth, you've got customers coming at a really fast pace. You're growing your company really quickly and the number of employees and it's just really hard to keep up because things in the infrastructure break, things in the communication breakdown, you've got
Starting point is 00:16:39 at any given point, 50% of the company has been there less than six months. So, but you have to grow really fast because once you hit product market fit, if you don't, then your growth will stop. So if you're suddenly growing, especially if your enterprise company, you have to have salespeople. If you're a consumer company, your systems have to keep running. running as you scale and, you know, look at companies like MySpace. Well, they died because their product got too slow. And so some companies have initial product market fit and then they don't keep up. And so I do think a lot of it is it's very hard to grow that fast. And so things really do start breaking. But then once you get all the right leadership and plays processes in place,
Starting point is 00:17:23 then it starts to get better. So it goes through ups and downs and level of chaos. There's one takeaway here that product market fit solves a lot of problems, strong product market fit. Well, no product market fit is a death sentence, I would say it more like that. Like if you built a product that people aren't really excited to use, then you don't have a company because it's very hard to do that unless you have a distribution machine and then you catch up over time. But we will not name companies like that. So there are other ways of doing it. But yeah, that is the most important thing. Yeah, I will say during my experience at Airbnb, I absolutely saw this.
Starting point is 00:18:04 It was just nonstop chaos. And it always felt like, well, how is this continuing to operate and succeed? Things are just out of control. Everything's changing every six months. I don't know what's happening here. And I think a lesson here is just that's normal for hypergrowth business. That has strong product market fit. But again, not a good excuse to just allow chaos.
Starting point is 00:18:26 And it's not like chaos means success. Right. And it's not a good excuse to like not have an organization that's functioning. You should still strive to have an organization that's functioning and keep people happy and motivated and all that. Great. Okay. Another maybe contrarian opinion that you hold along the career track is that you don't need to plan your career. I also 100% agree with this.
Starting point is 00:18:52 I had no plan for my career. I never knew where the hell it was going to go. I never had this vision of here's what I want to do. I just kind of followed things that were pulling me and things that seemed interesting. I love that you also tell people this. I'd love to hear your insights here, especially for someone that's either struggling with their career or just stressed. They don't have a plan or their plans networking the way they wanted it to.
Starting point is 00:19:12 I really recently I was talking to somebody in their 20s who was asking me for career advice and should I be a product manager, et cetera. And like I'm trying to put together my five-year plan. and I said, I never had a five-year plan. So to be clear, some people need that. That's the kind of people they are. They want the planning. I said, it's great if you want that, but I never had it.
Starting point is 00:19:36 And the person I was talking to just relaxed. And they're like, oh, my God, that's so great to hear. Because I have no idea what I want to do in five years. I'm like, I still have no idea what I want to do in five years. I've never had an idea what I want to do in five years. So, and when, you know, early in your career, you have a lot more angst about it because the forks in the road are more significant because they can go, like, do I go get an MBA or do I go work for somebody? Do I be a product manager or an engineer? And those really take you in very different paths. And I meet a lot of kids in their, I shouldn't call them kids. Because they're my kids friends. But I mean, a lot of people who are younger in their career who are struggling with this a little. bit. So what I believe, and I've always believed, is that you follow people. You learn the most from people. I don't look for domains. I mean, some people have a domain like I'm super interested in, like,
Starting point is 00:20:36 you know, climate or whatever, and they really want to work in that area, and that's fine. So maybe within that area, but you follow people who are the best at what they do. So it's not good enough to follow somebody who you like. You want to follow somebody who's either the best product thinker or the best engineer or the best salesperson. And so that you will learn the skill of how to be the best at that. So you follow people where you're going to learn the most. And a way to do that also is you look at where the great people are going. So you want to go to companies where there's also a nexus of great people because they together will do great things. And even if the company fails, or succeeds, but not as much as you'd like, you still have those connections.
Starting point is 00:21:25 I mean, everybody talks about the PayPal Mafia and how they've gone on to do things. I was super lucky to be at Google for so many years, and I know I spent a lot of time with ex-googlers that I met and that are all working in different companies now because you build those relationships by working together. So if you follow people and where you're going to learn the most, and you go step by step, I think that's a great way of progressing in your career. That's such tactical advice,
Starting point is 00:21:55 and I've seen this work for a lot of people that just go where their favorite former employees work and not favorite, to your point, but the people that they most respect and have been most impressed by. And I think it's such an easy thing to do. It's a really easy tourist for understanding where to go. There's something Mark Andrews,
Starting point is 00:22:16 recent one shared that I'm reminded of when you say this is that there's this like there's like a term for this. I forget the actual term, but there's like certain companies have this gravitational pull where they are acquiring all the best talent. They're currently like the gravity in the space and everyone awesome is going there. And you have to as a company know, you're one of those companies or you're the opposite. You're losing all the people and they're all going to this other company. I guess any thoughts on that? Yeah. And it's it's really bad when you don't have a gravitation. pull. It's super hard. I would say that one thing that if you're a manager, I always advise managers, go somewhere where you can recruit. And one, I got a piece of advice from a friend that I
Starting point is 00:23:00 thought was amazing advice as a leader. She said to me, take a job where if you hire people, it's going to make their careers. Oh, I was like, whoa, because I was getting offers for like some kind of turn around jobs. And, you know, if you think you can turn around, great. But you want, if you're going to hire the best people, you want to make sure that it's going to be a good place for them and that they're going to learn and they're going to grow up. And so you want to do right by them and you really earnestly want to say, you can make your career by coming here. And I thought that gave such a higher bar for every job I was looking at as a leader that I thought It was just amazing advice.
Starting point is 00:23:47 And then on the flip side, on the negative side, some people are looking, putting too much emphasis on where will I get a big financial return. And I found that financial returns are the hardest to predict. You know who's good. You know who you want to work with. You can predict where you're going to learn. Because even if a company fails, you learn a lot. But predicting financial success is so hard.
Starting point is 00:24:15 because you don't know what's going to happen with the market, with the world, with, like, crypto and then AI. And people who do that and say, like, I had one person say, I took this job because I'm a mercenary. They just paid me a ton. Did not work out for him. And I feel really bad when you, when people do that. But I think that that it's just a, it's a dangerous thing to do. I imagine some people hearing this advice are going to feel like I'm not going to get a job Open AI or Glean or other awesome companies that everyone wants to go work at. Any advice to those folks? There's lots of good companies and there's lots of smart people.
Starting point is 00:24:56 You don't have to be at the top brand. And if you go somewhere where you're going to learn and it's going to get you there. I mean, I made mistakes. I went to some companies, multiple companies that failed or stopped growing and didn't do well or didn't have all the right people. Like careers, you don't make every step is to the, right place. You remember in what you cited all the companies I went to that did well. You left out all the ones that I went to that didn't do well. And so then people will assume that every time I made
Starting point is 00:25:25 a job change, it was to a company that did well. No, that was not the case. So if you focus on that learning bit, you will get there and there are lots of paths. There isn't just the, you know, open AI or lean or anthropic. Awesome. And again, I love how tactical this is. Like, If someone is trying to figure out where to go work, if they're unhappy in their current job or don't have a job right now, is just make a list of the people you most respect that are the best at the thing they do, see where they work,
Starting point is 00:25:54 and there's your list of companies to potentially go after. There's a lot of benefits to this, as you shared. It's not just helping you pick the place to work, it's the network. It'll level you up. Is there anything else along those lines that is helpful for people to think about why this is a really good strategy? Skills can't be taken away. A company can fail, but if you learn a skill,
Starting point is 00:26:14 you will always have that skill. I love that. I've totally seen this to work, so I really love that you're focusing on this advice. You've mentioned places you've worked and folks you've worked with, worked with folks like Jeff Bezos, Stuart Butterfield, some of the top product thinkers, leaders in the world. So let me just ask, what's one thing you learn from Jeff Bezos and Stuart Butterfield? Probably can't narrow down to one, but I'll talk about Bezos first.
Starting point is 00:26:40 I was very lucky to join Amazon early when I still, like, headquarterly meetings with Jeff Bezos. Oh, wow. And this was before AWS launched. So it was before Amazon was known in the Valley. And this is another example. I went there because I went to work for Oudy Manbar, who started A-9, and he was talking to me one night trying to recruit me, and he spent two hours on the phone with me telling
Starting point is 00:27:03 me how amazing Jeff Bezos was. And this was before, like, there were any books on him. And that really convinced me to go there. So there's a lot written on Bezos. just read his shareholder letters, read the books about him, read Colin Breyer's working backwards, the Everything Box, I think it's called, or the Everything Store. Everything Store, yeah.
Starting point is 00:27:25 And I mean, there's so many good books, and there's so much to learn about how he works. So I won't try and cover those things. The things that stood out to me from the meetings I had with him were a couple things. One, a lot of people have written about these six-pagers. So he doesn't believe in PowerPoint. You write a six-pager about,
Starting point is 00:27:45 I mean, it's like, you know, studying for a final exam. It's writing these six-rays years. So you go into the meeting and there's people around the table, his executive team and him. First, he does not speak until everybody around the table speaks. So he goes around to all his leads and says, what do you think? What do you think? What do you think? And I'm sitting there like, I don't care what I don't think.
Starting point is 00:28:06 I just want to hear what face those things. But he wants to make sure that it's a team effort and that he's listening to what everyone in his organization thinks. And he always spoke last. He is by far the smartest person I've ever met in my life in that I've worked a lot of smart people, but he's ability to go deep in any domain and nail the core issue and remember, like we would have quarterly meetings. And from quarter to quarter, he would like remember things that he had talked about before. And then he would go into like the architecture of search and why are you doing it this way or that way. And and you're just like blown away that he knows that. But the thing that for me, the biggest takeaway from this meeting was
Starting point is 00:28:55 his consistency, which is he had principles that you, it made it easier for you to operate in his company because you knew what he cared about. Because he always had these principles. Everything had to be customer driven. Everything had to be relevant for the customer. He hated icons. That was just the thing. You had to write what they were because people couldn't figure out what they are. So anytime you show an icon, he would get annoyed. But you were like, so, but you would go in and after a couple meetings, you're like, okay, I know what he's going to ask about. I know how he's thinking. And I know what his principles are. And I think that consistency enables you to operate a large organization more effectively. And then there was one other thing that I really remember was a very, one of the few
Starting point is 00:29:42 really small meetings I was in with him and we were presenting working on a new product. And I was like, you know, our competitors have like 10 times as many people as we do on this. And he looks at me and he said, that is your advantage. And then he goes into his talk about how it's a hill and it takes seven years to build a product. You can't look at it in the near term. It's going to, you have to be in it for the long term. And you can be sure I never went in and said, I need a lot more resources. So that was BASAS. Awesome.
Starting point is 00:30:16 Stuart, again, I went to Slack because I wanted to work with Stewart Butterfield. I think he is the best product thinker in the Valley, or he's not working in product right now. He's taking time off. But he's got this combination of long-term thinking and in the details. So in 2014, he wrote a master plan for Slack, which was. was build a product people love, build a network that Slack Connect, build a platform that makes all of your other SaaS products more valuable,
Starting point is 00:30:48 the Slack platform, and then do some magic AI stuff. Magic AI stuff took a lot longer. That was part of his plan early on, is Magic AI stuff? Literally was. There was a grid with four boxes in 2014, and it never changed. That was his master pan. And what we worked on each year changed. But somebody recently asked me, well, did he always?
Starting point is 00:31:10 Like, you know, you guys did Slack Connect much later. I'm like, yeah, but it was always part of the plan. It was always part of his vision. So he saw forward in the vision, but he also was very much into the details. And I think the thing that I learned from him the most was the power of prototyping. And that even though he was such a great product thinker, he would always say, I can't tell you if this is going to work. I have to feel it.
Starting point is 00:31:33 I have to try it. And a mock up doesn't tell you what. it's going to feel like. And he would push people to do prototypes, not incremental of just to get a feature out, but really to think very soon after I started, we launched a hired a design lead, Ethan Eisenman, and he led a redesign of the new information architecture for Sla. I worked with Ethan at Airbnb. Oh, yeah. He was head of design for the search experience in the search team. Yeah, Ethan is awesome. And he came in and his first task was to work with Stewart on this redesign. And Story came in and said, I want you to take everything in the interface and put it behind one button. And everyone's like,
Starting point is 00:32:19 that's never going to work. And he's like, do it. Just do it. And so we had our prototypers. We had also engineers front end engineers who were really good at prototyping, like literally took everything in the interface and put it behind one button. And he said, this is how you're going to see what you really need in the interface. So we were never going to. to ship that. But it was the beginning of the redesign. Let me tell you about a product called Sidebar. The most successful people that I know surround themselves with incredible peers. When you have a trusted group of peers, you can discuss challenges you're having,
Starting point is 00:32:54 get career advice, and just gut check how you're thinking about your work, your career, and your life. This gives you more than a leg up. It gives you a leap forward. Having a group of trusted and amazing peers was key to my career growth, and this is the Sidebar ethos. But it's hard to build this trusted group of peers on your own. Sidebar is a platform for senior tech professionals director to sea level to advance in their career. Members are matched into peer groups to lean on for unbiased opinions, diverse perspectives, and raw feedback. Guided by world-class programming and facilitation, all running on Sidebar's technology, sidebar enables you to get focused, tactical feedback at every step of your career journey.
Starting point is 00:33:34 If you're a listener of this podcast, you're already committed to great. growth. Sidebar is the missing piece to catalyze your career. Ninety-three percent of members say Sidebar helped them achieve a significant positive change in their career. Check them out at sidebar.com slash Lenny. As a product leader, how do you think about just the time it takes to create a prototype in something like this? You know, as a PM, I'm just like, a lot of times, we have time to build this whole prototype. We've got to ship stuff. We've got to hit these calls. We've got experiments to run. We'll just build it and see how it goes. How do you think about making time for something like that. If you're doing it right, it'll be faster. And you need to have an
Starting point is 00:34:13 engineering infrastructure that enables prototyping. So some engineering infrastructures are too heavy, and they don't actually enable prototyping. Like we had a problem with our mobile apps that it was too hard to prototype, and we actually redesigned our mobile apps until we got to the point where it was easier because our desktop app was pretty easy to prototype. But you have to have a layer of abstraction that enables you to do that, and you have to have engineers who have a prototyping mindset. And if you build multiple things
Starting point is 00:34:42 and you have this mindset as I'm willing to throw it away, you write code that you know is never going to make it to production, so you can just crank it out much faster. And then you can see what works, and then you build the production code. And so you actually get to your end goal
Starting point is 00:34:59 of something working faster. But you need the engineering team to have this same mindset, the product and engineering have to work together and design, because design is just in it as much as sometimes you can get design engineers who are doing the prototyping. So your first prototypes are like Figma prototypes, and then you get prototypes on real data. I had a, when I was at Google, one of our teams, the front end team, I remember we got, we hired a bunch of prototypers and our head of front end engineering said to me one day, this is my secret weapon. This is how we move faster.
Starting point is 00:35:33 So I do think it's a mindset shift and a tech stack shift. It's also, we're going to talk about AI later, but it's also getting easier to build prototypes with AI. There's this video recently that went around on Twitter where an eight-year-old girl was building an app. And in like 45 minutes, she built like a chat bot using this product called cursor. So I think that'll unlock a lot of great product opportunities and just accelerate this sort of work. I asked about Jeff Bezos and Stuart Butterfield. I'm curious if there's another leader you've worked with that maybe is less known that you also learned a ton from that might be worth talking about. I think that there are people who are really, really good at what they do.
Starting point is 00:36:17 So Mark Benioff is an amazing marketeer. He's so like his marketing mind. So after the acquisition, I got the opportunity to, be on stage with him at Dreamforce for, because Slack was a new shiny thing. So of course, Slack was going to be in the keynote. And so I was in the Benioff's keynote two years in a row. And so I watched how he approaches his keynote and the whole thing around Dreamforce. I mean, Dreamforce is incredible at the impact that it has in the ecosystem. And so I think that as a product people don't think of him as much, but as his marketing abilities are amazing what he's done.
Starting point is 00:37:06 I've written posts about how various companies got started in Salesforce's story. Always comes to mind where they go to conferences with us like no software mascot walking around. And I remember they did something around one of the competitors where they just like created some real controversy around someone. Well, they went into their competitors conference and stood outside their competitors' conference. It was, this is in the Beyond Software. This is in his book that he wrote about the early sales force.
Starting point is 00:37:35 And Ed Tays'Hey's guts, he pushes the envelope. I love that. It's a really good point that people don't think of Mark Benioff as a marketer. And that's interesting that that's one of the, maybe the main thing you took away from him was just the power of marketing and the skill. He approaches his marketing presentations, like a product person approaches their building their product. Amazing. Okay. Speaking of former colleagues, I asked one of your former colleagues, his name is Fuzzy Kose. He's now the CTO of Notion. You worked with him, I believe, at Slack. And at Google. Wow. Okay. So I asked him what to ask you. And he said that you're amazing at building strong cross-functional relationships, especially with engineers. I know you used to be an engineer, so I get where that skill comes from. What can you teach people about building stronger cross-functional relationships?
Starting point is 00:38:27 functional relationships, especially PMs, to build better relationships with their engineers, designers, other folks on their team. Probably the most important thing that a product leader does, because if you have great ideas of what to build, but you can't get them built, then you go nowhere. So one, make sure you're somewhere where you have a good engineering partner. So Cal Henderson was a co-founder and CTO of Slack, and like I couldn't have asked for a better engineering partner. It's just awesome.
Starting point is 00:38:55 and you need to, that has to be part of your evaluation criteria that you meet and value your engineering partner before you join and or you know that it's not the right one and the organization is willing to make a change. So that can happen too. You can go in and understand that something has to change, but that is a very, very important thing of what you're doing and what you're assessing when you go in. And then I think what's really important is that you're aligned. You understand your roles and responsibilities and where you're going to divide and conquer and where you're going to be aligned. You don't want any of this. Like people in the organization, they ask mom, they asked dad, and they got different opinions and playing one against the other. Like, that doesn't work. So when you
Starting point is 00:39:39 have to know that you're not going to do that. So if somebody would ask me something that was in Cal's domain, I'd be like, did you talk to Cal? I would never try and go around him. So we were very clear on you're going to drive this. I'm going to drive this. And if it was unclear, we would talk. And we would say, okay, who's going to take this one? And we would do all our reviews together. And so all of the okayR reviews, all of the, we had weekly exec reviews. We had the updates on our OKRs. So we did them all together, but I knew like here's the things that he was going to ask the questions on and dig deep. And then when I was, he would take a back seat, but of course we could ask questions in each other things, but I knew that he was taking ownership. And he knew what I was taking ownership. And he knew what I was
Starting point is 00:40:23 taking ownership of. But I think the bottom line was respect is that you have to respect and trust that they actually will follow up on what they say. They well in Cal and Fuzzy were like amazing that. I would go to Fuzzy and be like, hey, we need more mobile engineers because this one product is not going to ship. And he's like, I'm on it. Got it. And that was all I needed to do. And like, obviously he couldn't do it. He'd come back to me and like, hey, there's going to be a problem. but it was like just things got done. That's the best part of it. You talked about being aligned,
Starting point is 00:40:57 which I love and I fully have seen that power of that, of you and your engine manager, your designer manager being aligned on, and you tell me if I'm wrong, but specifically on what goals you're trying to achieve, what success looks like, things like that. Are there any tactics you found to create that alignment?
Starting point is 00:41:13 And also, if there's anything else you want to add to the point I just made about what it is, you're specifically aligned on, that'd be great. one, you got to spend a lot of time together. I mean, there isn't kind of a way around that, and you have to document things and make sure that you've talked it through. And if you don't agree with something and you're not sure it's a priority, you have to speak up and you can't just be like, okay, whatever, and then go to somebody in your team and be like,
Starting point is 00:41:38 oh, God, that CTO, like, why did he make this decision? Like, that just doesn't work. So I'm a very direct person. So if I don't think that something is the right priority or is working, I will be very clear. We had different forms, so I'll be very tactical here on the forms that Cal and I had together. Perfect. So we had, we used OKRs to drive our processes, and we would have the teams present OKRs to us.
Starting point is 00:42:06 When the team got too large, it got to be too much time to go through every team's OKR review. So we had them, we had a Slack channel for each team. They're OKRs, a planning channel for each one. and people would post a doc and then a Slack video of going through the major points. And we had a time limit of how long they were allowed to be. And they would say, here's the ROKRs, here's the things that you would pay attention to. And then Cal and I would do a marathon and we would watch them all together. And a room sitting there watching them together.
Starting point is 00:42:38 Correct. And then we would like say, do we have any follow-up questions? then we put in channel our follow-up questions to the team. And sometimes there would be, there'd be like five to ten teams that we would then have a follow-up meeting with. We would say there's things that we, this is like a really high priority project, or there's a lot of questions that we have.
Starting point is 00:42:58 And then we would do a meeting, but we were always doing those meetings together. So that was the okay. Our reviews of getting the alignment. And by asking the questions, we could then, by adjusting us, we could kind of dig into the team. And we had, we had a chief of staff.
Starting point is 00:43:11 So it was the two of us plus our two chiefs. staff and which they also did a divide and conquer and they worked really well together. They were both longtime slash employees. So for years, they had, one had been an engineering director and one had been a TPM. And then we, every Monday, we had a Monday meeting where we reviewed the progress on the top okayers and red, yellow, green, and don't talk through the green ones, only talk through the red ones, and what are the issues? And again, both there. And then we had a weekly meeting with the four of us, where we would just go through any issues in the organization, what's going on, what's not. And the four of us is you, the CTO, the chiefs of staff. Yeah. And sometimes
Starting point is 00:43:55 we would invite people like, there's an issue with QA, so we'd have the QA leader come in and present us. But we tried to limit the number of meetings with like teams. So it'd be like the okay, the Monday meeting was the big meeting that you had to be there and you had to be able to talk to your project and that was it. There's so much awesome this here. I love the idea of this async, share your plan and a video instead of meetings with everyone in real time and you could just do a lot of this stuff async. We iterated every quarter, just like you iterate on a product. So every quarter we would say, did the okay our planning work or not? And then we would adjust. So we got to the point where at one point we added up all the hours of okay hour reviews and all the people in
Starting point is 00:44:37 them and it was like some insane number like 300 and something and we're like this has gotten out of hand and so then we're like we have to do something drastic and that's when we moved them to async it was also right after slack clips launched i got it that's the video feature very cool and then i don't know if you're you launched huddles right slack huddles your uh did you use that as a part of this where eventually just get people into a little huddle asynchronously and talk sometimes absolutely we would be in the reviews and we would huddle with somebody to ask a quick question we just huddled all the time. I still do. I love those. I love it. One crazy thing about Slack is people in Slack don't actually use email internally, right? It's like all in Slack. It's like the actual
Starting point is 00:45:16 vision of Slack working within Slack. No email, unless you're dealing with somebody external and now it's mostly Slack Connect anyway. Wow. That's amazing. Okay, I have one more question around product stuff and then I want to talk about AI. So I was reading your newsletter on Substack, which we'll link to you. and you share this really interesting insight that I've experienced myself that I'll quote you here. One of the mistakes that I see a lot of product managers make is they overindex on people who are going to be unhappy with the products they're launching. And you basically, your advice is not to worry so much about making users unhappy, which I think is counterintuitive to some people. You just talk about this lesson. And I'd love to hear what product you launched that made people unhappy that you realized, oh, maybe we don't need to worry about this as much.
Starting point is 00:46:02 I saw it more when, yeah, you unlaunch things, you tank things away. There's always some set of users that are using a feature that nobody else does. And then you take it away and they're super unhappy, but there are more people you're going to make happy. So you get a product manager gets caught in this trap of the vocal minority. And the number of people using your product depends on. what phase? Are you a Google? Are you a Slack? Are you a Glean? But the number of people using your product today is usually, unless you're at Google, far smaller than the number of people are going to be using your product tomorrow. So design it for the people, the bigger number of
Starting point is 00:46:47 people who are going to be using it tomorrow, like, if you have to redo the UI and, you know, the like, who move my cheese, people will be unhappy. But all the new people are going to be like, this is so much easier, then do it and deal with the people who are unhappy. But But the trick is you have to be respectful and you have to be transparent and you have to explain. You have to go to people and say, this is why we made this change and you have to be authentic. You can't be dismissive and you can't have marketing speak. You have to really say, here's for real why and you have to listen to your audience. You don't want to alienate your early users.
Starting point is 00:47:28 because most people, like if you made a good decision on why you move this or why we like stopped using Slack calls and move to huddles and like you have to do it over time and give people choice and then give them enough time to move. So you have to do it in the right way. But if people feel heard, it makes a difference. And I have an example that's not a product example, but I think is a really good one. It's a leadership example. So when I was at Google, there was always a controversy about something, but there was a controversy about it was like blogger or something. I can't even remember what it was. It was like we made a change. And there was an engineer in my, or, we were like 50,000 people at this time. It was an engineer in my team, and I see an engineer
Starting point is 00:48:13 was like super unhappy about the change. And I knew Rachel Whedstone. She was in charge of all of PR and global policy at Google. So a huge job. And I emailed Rachel and I'm like, hey, do you have like an FAQ or something that I can help me because I don't know why you made this change and that I can help explain to the engineer in my team. She did not respond to my email. She picked up the phone and she called him. I had no idea. She was, she did this. She just called this icy engineer and she listened to him and she heard why he was upset and she explained her reasoning. He was so blown away that she called him that he completely changed his opinion and then he told everyone else in the art. And so it had this effect. And I learned a lot from watching her do that.
Starting point is 00:49:02 Like, she never even told me she did it. Like later, she just did it. You just act. You're authentic. You listen to people and you're transparent. It's so funny. This reminds me of a book I'm reading, a parenting book I'm reading right now that a former guest recommended called Listen. And the core thesis of the book is when your kids are acting up or they're getting. off track, so much of what they need is a sense that you're connected to them, a connection, which is rooted in you listening to them. My favorite parenting book, I don't know if this is the same one or a different one. It's how to talk so your kids will listen and how to listen so your kids will talk.
Starting point is 00:49:42 Maybe it's the new name of that book, but it's so good and it's so true in everything and also in products. So whether you're in a forum in explaining to customers, whether you're enterprise customers, you're explaining, you're hearing them out, people want to understand. Amazing. There's so many applications of just the power of listening. Okay, well, not quite a segue, but let's talk about AI. You're kind of at the epicenter of AI now with Clean.
Starting point is 00:50:11 How do you anticipate AI will change our jobs in product? What do you think people maybe aren't recognizing it, realizing it, what have you seen? I'm going to give you a little bit of my history with AI. to get to that point. So I actually, when AI was a completely different technology stack, I have a master's in AI. So I started like working in AI when it's evolved so much. And then of course at Google, using it for auto complete and search. And it's transformed so many times.
Starting point is 00:50:43 But then with this last transformation of Gen AI, and that's what brought me to glean of seeing this like meeting lots of AI companies and like, wow, this is really going to transform how we work. And it's just fascinating seeing these products. I was kind of one of those people like, oh, yeah, it's going to be so far away until like I saw GP3. And I think AI is, we are underestimating how much it's going to change how we work. It's not going to be sudden from today to tomorrow because people haven't figured it out yet. They kind of haven't figured out how exactly to leverage it, but the people who have are going to be so far ahead. They're going to be far ahead of everyone else because they're going to be working faster. They're going to be working better.
Starting point is 00:51:32 And in five to ten years, I think the lines between product managers and engineers and designers are going to blur because AI will enable product managers to build prototypes, to build designs, designers to build a, to build a product like Figma already has their Figma AI. You can press a button and you can get your initial prototype working. You've got all the cold pilots. So they're not quite there. You still like with co-pilot or with cursor, you need to be an experienced engineer to know when it's getting it on. But they're going to keep getting better. So I think people have to be careful about not getting left behind, but their jobs aren't going to go away. They're just going to change. And we're going to, I'm of a believer that we're just going to have a lot more
Starting point is 00:52:19 software. But I talk to engineers and to PMs, like, yeah, I tried that. It doesn't really work. And then go back to how I worked before. And that's a, that's a dangerous spot to be in, I think. For people, they get anxiety hearing this where they're feeling they're going to be left behind. And like, oh, my God, I don't know enough time to do this or I don't know what I'm doing here. Give me advice for how some, what's something someone can do to not fall behind? Use the products. like this is what good PMs should do, period. Always be using new products.
Starting point is 00:52:55 It's not a unique thing for AI. When mobile came out, PMs needed to be using mobile apps all the time to try them out, see what the UIs are, see what's working, what isn't. And the same goes even more for AI. Use chat chit. If your organization has glean, use glean, use clod, try them all.
Starting point is 00:53:14 Like, try them and see what they do. I was talking to a product manager, I know, who is more forward-thinking and loves playing with new products. And he had this use case that, like, blew me away. So he said, and this was like a couple months ago. So before, it was right when Gemini had expanded the context window. So his product had a Discord channel. And he took the transcript from the Discord channel, which was huge, right?
Starting point is 00:53:42 And he fed it into Gemini, the entire channel, and then used it to ask questions. Like, what is the sentiment of my product? What is the most requested feature? What are the things people are unhappy with? Like, this never would have heard to make. That's like, that is so smart. And he's like, it was like a goldmine. Do you know how long it would have taken him to read?
Starting point is 00:54:04 And he just wouldn't have done it, right? So you're, think about, like for the argument, oh, I'm too busy. Well, if you use these products, you're actually not going to, you're going to, it's going to be leverage on your time. So you get a lot of articles sent to you. you summarize them. You use AI to summarize the articles. We use Gong at Glean to record all our sales calls. We have a GLEAN app that will read all the GONG transcripts, put them in a spreadsheet in a certain format of who the AE is, et cetera, and then summarize all the top requested features
Starting point is 00:54:41 from all the GONG calls. And we took a while to get it right. Like at first it would the summarization, the prompt wasn't good enough and would give us features that like our salespeople would recommend and didn't distinguish that this was actually the customer. See, you have to tweak it. It's not going to work out of the box. But then we got it to the point where it worked. And like these things really save time. And you have to use your creative juices as a P.N.
Starting point is 00:55:09 To figure out how it can help you and have patience to iterate and keep trying because the models that we have today can do a lot already. Yeah. I love your example of the PM and what they did with the Discord channel. Is there anything else along those lines that either you've done to leverage some AI tool to be more productive or folks in your team have done to be more productive, if they're product leaders or other folks? So many examples. So one that I did really recently is I wrote a prompt in Gleon. to help me get the status of features. And like, we have a launch cal and you can look at launch cal and we'll say a date.
Starting point is 00:55:54 But then, like, is it really the date? What are the outstanding issues? So it will look at our launch cal and it will look at see if there are any open year tickets, what the Slack conversations are to see. And the customers who are beta testing it and bring all these together to tell me, okay, launch date is this according to Launchdale, but here are all the open issues and here the open conversations that people are talking about. So then I can give me the confidence level of the future.
Starting point is 00:56:22 So I can run the prompt, just put in the name of the feature and get like, so I don't have to read all of these channels. So this is a prompt that I built like two weeks ago because we're advancing our prompting capabilities. And so I was testing it out. And I was like, ooh, I could do this. So that's like, and that's another example. And engineers are using it for automating part of.
Starting point is 00:56:46 of the incident management of like I got an incident. How do I see all of where there were previous incidents that were similar to it where they're not? And so these are the type of things you can look at to say to help you. But like the simplest simplest is there's so much news. Let me just like paste in all these things and and summarize them like as a product manager at Gleam, hear all the latest news. What do I have to care about? what's what's impacting me and potentially competitive to any of the products that I have and putting that into say collater jet ch pt you're saying yeah yeah i think that just i think that beginning of the prompt is something a lot of people don't know is the power of just giving
Starting point is 00:57:32 it a role like you are a product manager at glean from that perspective give me this summary versus just summarize this and that ends up being really powerful right 100% and you can compare and like, what is Claude, you know, PR saying that they just launched Cloud Enterprise? How is Cloud Enterprise different from OpenAI Enterprise? And what are, like, because these things, again, you can do it yourself, but these micro-improvements in your productivity help. There's a, for my newsletter, I interviewed Claire Vow who came out with chat PRD. And so product managers are using it. We're just starting to evaluate it.
Starting point is 00:58:14 and internally includes. I haven't personally used it yet, but it's super cool. And you can use chat PRD, chat GPT to do a PRD. And Chad PRD gives it's more templatized and more frameworks of how to do that. And these,
Starting point is 00:58:30 again, these things are going to keep getting better. Claire's been on the podcast. She's going to be speaking at the Lenny and Friends Summit coming up October 24th. Oh, cool. Yeah.
Starting point is 00:58:38 And she, a crazy statue shirt is she's making six figures off this product that she builds on the weekends, chat PRD. So cool. But it also shows what you can build with AI. Right.
Starting point is 00:58:49 And it's just her. I think she just recently hired some engineers to help because she has, she has like three kids, CTO launched darkly and just is building this on the side, making $100,000 plus dollars. Incredible. I want to add one, a couple things here. So one is for folks looking for ideas for how to use AI tooling for their PM job. There's a couple of posts I've written that I'll link to in the show notes just to put that out there of just a bunch of PM sharing. here's what I've done with these various tools.
Starting point is 00:59:16 Another thought, I'd love you to get your take on. There's a lot of fear that the PM job will be replaced by AI, and I recently realized that it's the opposite. I think the PM role is the best positioned to thrive in a world of AI, because if you just think about it, you have a tool that can just build a thing for you, just like you're staring at this blank thing that can build anything for you, which function would you think would have the best chance of building some, of asking it of what to build and how to articulate what to build best.
Starting point is 00:59:47 To me, it's clearly product people. They're best at figuring out what to build, what matters most, where the impact's going to be, what customers need. Not to say other functions don't also have these skills, but I feel like of all functions, PMs have the most of that specific skill. I love to get your take on that. I think that AI, the one thing it's not good at is being creative. So if you're a PM who's doing the kind of route work,
Starting point is 01:00:09 it's going to take your job away. But if you're a PM who actually is strategic and can pull the pieces together and be creative and think how you do something that it's going to differentiate because it's not going to give you that leap, it'll say, here's what customers are asking for. Here are the problems today. But you have to figure out how to solve it.
Starting point is 01:00:29 So in some ways, it might weed out the good from the bad PMs. Because there are a significant number of PMs who are more like just execution. And I think that part of the job, hopefully will be lowered because I hope a lot more of the execution will be able automate like updating Jira and like, you know, all these things that just take time and creating even though like launch cows, which PMs have to do manually now. So hopefully a lot of that work goes away and then people can be more creative. And I think designers and PMs are kind of going to
Starting point is 01:01:03 blend because the best designers I've worked with are product thinkers. And a lot of really good PMs can also design. It depends on what kind of product you're PMing for. So I agree with the caveat that it will become harder to be a great PM. Wait, say more about that. It'll be harder to be a great PM because many PMs are doing things that are mostly like project management, and that's the stuff that you. Yeah, let me rephrase. It's not going to be harder to be a great PM, but to be a PM, the not so good PMs jobs will go away. The great PMs will still have great jobs. Yeah, I totally hear you.
Starting point is 01:01:42 So in the sense there might be fewer. You might need fewer PMs, but I think that applies in theory to every function. You might need fewer engineers, fewer designers. I don't think you'll need fewer. I think you'll be able to do more things. So like think about every company, our head of sales came to me the other day.
Starting point is 01:01:58 You need to hire more engineers because we just have so many things we need to build. Like, when have you ever worked in a company where you thought that like you didn't need more engineers? It's like you always want people to build more stuff. So I don't think you're going to need fewer. I think you're just going to get so much more done. A lot of people are building AI into their product.
Starting point is 01:02:19 Gleena is obviously an example, which integrates LLMs, which inately are non-deterministic and hard to know if they're going to provide anything good. Sometimes something really dumb comes out. Do you have any advice on working with these very complicated systems that don't necessarily... You can't control and building them into your products.
Starting point is 01:02:38 Anything you've learned that might be helpful. My first week at Glean was eye-opening in learning some of these things. But let me first just explain what Glean does for people who may not know. So Gleen was started as Enterprise Search, which it read, Glein reads content of all your SaaS apps. So it reads the content from Microsoft, Google, Slack, Salesforce, Gero, like any SaaS tool that you use, it indexes it and enables you to search. So it started as just enterprise search. Then when, and using AI. So it was an AI search using Burt models and using vector embeddings in 2019.
Starting point is 01:03:16 Because the early engineers at Glein came from Google. And Google created BERT to enhance search. And so it was obvious that they would be using ML techniques for search. Then GPD3 came along and they added a natural language interface, a chat interface. You can ask the question in actual language. and get an answer, and it basically is a knowledge graph of your organization, so you can ask any question, think of chat chpd for your enterprise, ask any question about your enterprise. So search, people understand search, because they understand Google and you put in a query, and then you refine it.
Starting point is 01:03:53 But chat interfaces, people still don't really know how to use. If you look at the stats from chat GPT from what I understand. The retention is fairly low. Like people use it, they play with it, and then they don't get back to it because it's not in their workflow, and they have a hard time figuring out what they can and can't do for it. When I got to Gleam, the first week, I met with the assistant quality team. And one of the biggest issues they have is people, you're trying to use Glein for things that there's like no way it could know. Like, what should my top priority be next week when, like, we don't even know what your priorities are? And but then there's golden cases that are just amazing.
Starting point is 01:04:42 So we're not the example of refining queries in search for people to understand how to do. And I took a lot of features of like auto-complete and refinements at the bottom of the page. So we need to build in those things to guardrails to help with the change, to help suggest, oh, Lenny, here's what you could do. Here's a prompt to find out the status of your feature that Tamar built. So how do you give people guardrails so that they're, that they understand what is going to work and what isn't going to work? Because this whole, I don't know what I can ask. And then on top of that, the non-deterministic, like an enterprise CIO will go use chat GPT on the weekends, but they come to work and they expect their software to be deterministic.
Starting point is 01:05:30 So how do you help educate users about that? And then the other thing I'll say about using LLMs is the industry is transforming so rapidly. You need to make sure that your product gets better as the LLMs get better. And that too many people are building things to make up and compensate for the LLMs, that all that work is going to go away. So it's okay to do it to understand that it's going to go away. but that can't be your differentiator. You have to understand
Starting point is 01:06:02 that your differentiator is something that will continue to be there as the LLMs get better and smarter. And as part of that, because the LMs get so much smarter, everyone else will become awesome. And to keep up, you need something that is actually outside of the LM that continues to differentiate you
Starting point is 01:06:21 and is better than what other people are doing. Well, yeah, that your whole product gets better as the LLMs get better. Yeah. And that, I think, I think is it's a frame of a frame of mind of how you approach the value add your head. Awesome. Tamar, to close out our conversation, is there anything else that we did not cover that you think
Starting point is 01:06:44 is important to share or you think might be helpful to leave listeners with before we get to our very exciting lightning round? I, in my decades of working in tech, have never been working in an environment that's moving so quickly. And it's really exciting. I mean, it's super energizing. And it's also scary. But you have to change how you're working. You have to change how you're working so that you can keep up because it is going to be, it's going to be an interesting decade ahead with all these new tools that are coming out. And staying ahead will be hard. But it's also, there's so much, I think, richness and opportunity here. So I advise people to get in the thick of it and try it out because you'll be surprised at how much, how many products we can build.
Starting point is 01:07:36 I love that. I can't help but drill in one level deeper. Is there anything you found to help you stay ahead and help you stay, you know, aware of what's happening? Are there like newsletters you find useful podcasts that just like help you keep up to data where things are going? Is it like a person you look to like, hey, what's new? There are definitely like AI newsletters that I look at. There's AI podcast that I listen to. I now have a commute. So in some ways, that's good because I get to keep up on the AI podcast. So I just try and listen. I'm trying to build some prompts for myself to make it easier to say, like, taken to, I haven't perfected this, but the chat cheap ETT voice mode where you can load it. Somebody who just, I just hired it at Glein was saying he does this. He loads up stuff before his commute. and then he'll be like summarize these articles, and then he can ask questions to it. So I need to up my game there, but I definitely have a list of like Ben's bites and the neuron. And I love, I like those are good summaries.
Starting point is 01:08:41 And like I let Gill and Sarah Go's podcast I listen to, Cognitive Revolution. There's kind of too many of them right now, but I pick and choose. Also. Okay, we'll link to those ones you just mentioned in the show notes. to the Elon, Gill and Sarah Gros podcast.
Starting point is 01:08:56 It's called No Priors. I was actually just listening to it on the way here. Sarah is going to also be at Lenny and Friends Summit. She's going to be moderating a panel between Kevin Whale and Mikey Krieger,
Starting point is 01:09:08 who are the CIPOs of Anthropic and Open AI. So there we go, another quick plug for Lenny and Friends Summit.com. I think it's Lenny's summit.com. Awesome. With that, Tamara, we've reached our very exciting lightning round.
Starting point is 01:09:20 Are you ready? I am ready. Okay, let's do this. First question, what are two or three books that you have recommended most to other people? So one book was recommended to me by Shishir, the CEO of Kota. When I started at Slack, he recommended the book Switch, how to change things when change is hard by Chip and Dan Heath. And it's such a good book.
Starting point is 01:09:45 And it's about like how do you set a path for people to follow the whole elephant and the writer so setting the path, but yet motivating people to go down the path. And I read it. We had an all-hands about, like, there was, I don't even remember the topic. It was something that we were like all up in arms about that we had to do. And I just read the book. And after the all-hands, I went up to store it, and I'm like, you did that all wrong. Like, you need to read this book.
Starting point is 01:10:14 That is not how to get people motivated. And he read the book, and he's like, you're right. So it just changes how you think in organizations. to affect change. So that's on the kind of organizational leadership. And one book I really liked was a team of rivals. It's a book about Lincoln and putting together his cabinet during the Civil War. One, I just learned a lot about the Civil War that I didn't really know.
Starting point is 01:10:44 And it's about, again, a book about leadership. And it's fascinating. Don't think anyone's recommended either of these, so love them. Next question, do you have a favorite recent movie or TV show you've really enjoyed? I don't know if you like British murder mysteries. I don't know either. It's kind of a niche thing, but there's a guy named Anthony Horowitz, and the latest series he did was called Nagpie Murders,
Starting point is 01:11:15 and it's just like kind of an intricate story, so I enjoyed it. Very niche, but amazing. Do you have a favorite product you've recently discovered that you really like? Well, I'm going to give two. One is tech and one is non-tech. So non-tech, I really like dark chocolate. Like just like a dark chocolate bar. A really good dark chocolate that's simple.
Starting point is 01:11:40 Like no frills, none of this, just dark chocolate. And I discovered this chocolate called Bazoo Chocolate. And it's a guy in Oakland who makes it himself super niche. He was selling at the farmer's market. And it's just like if you were like a simple like no nuts, no anything, Justin. And he's like great pride in the beings and resources and from. Wow. It's called Bazoo with a Bizzou with a B.
Starting point is 01:12:07 Yeah, Bazoo as in Kiss in French. Okay. And then on the tech side, I mean, that honest answer is gleaned is I was listening to your podcast with Nikita who said that people over 22 don't use new products except at work and that like stuck with me and I the products, new products I usually use are at work and I use lean 10, 15 times a day. Like I use it so much and it changed the way I onboarded. It changed the way I work. I like, I just, even like the simplest questions, you don't bother people, you don't interrupt people.
Starting point is 01:12:46 on Slack. You're like, you know, what's the latest status with this deal? What's the last time we talked to them? I meet somebody at a conference and I can quickly say, have we ever talked to this company before? And I can just get an answer and or without asking an engineer, where's the latest design doc? It's just, it has really transformed how I work. So I know, I know it's cheating in that it's the product I work on it, but it's the actual honest, is the actual honest answer. And for folks that haven't heard of Gleen, it's one of the most successful B2B AI companies out there, right? It's like a very large successful business and company that if you haven't checked it out, you should definitely check it out. As our investors say, it's one of the AI companies that's actually making money.
Starting point is 01:13:29 Very few of those. Awesome. Two more questions. Do you have a favorite life motto that you often come back to repeat to yourself, share with friends or family and worker in life? I have one that my father told me when I was being really indecisive about what college to go to. He was really kind of bored of the conversation. And he said there are no right decisions. You make a decision right.
Starting point is 01:13:55 And it is so true. Because you'd ever know what's going to happen in life. You just have to commit to whatever you're doing and have no regrets about it. You can't be like, oh, you know, 10 years later. or what if I had taken that job over there? It's like you make your success based on how you approach the decisions that you've made. So if you feel regret about something, this is a good one to pull out of just, I will make this the best I can make it.
Starting point is 01:14:25 And that's all the best I can do. You're going to move forward. Move forward. I love that. Last question. I know you're a parent. I'm a new parent. I have a 14-month-old at this point.
Starting point is 01:14:37 Is there a piece of a piece of? of parenting advice that you learned early on that you think might be helpful to me or folks that are new parents or something you've just learned yourself that you think might be helpful. 14 months. I think the best parenting book I read besides the how to talk to your kid will listen and how to your kiddle talk is I think it's called healthy sleep habits, happy baby. Like we are much happier when we sleep well. We perform better at work when we sleep well. children need to sleep. So making sure that they sleep well.
Starting point is 01:15:13 And sometimes that's like I did the whole sleep training, like cry until you fall asleep. And my kids still speak to me. So it was okay. And so you just like that is like the basic things. Like make sure that their basic needs are met. And then as they grow up, share your life with them. So a piece of advice I was given was, kind of analogous to talk so your kids listen is when they come home from school,
Starting point is 01:15:41 you can't just say, how was your day? Say, you know what? I did a podcast with this person and it was super interesting because they talked about this or that or I'm massively screwed up and I should have asked them this or that. And they'll be like, oh my God, I was at school today and this is what happened. Like if you share your life with them, they will share their life with you. Such good advice. I really appreciate it. Tamar, thank you so much for being here. awesome. We got through so much great stuff. Everything I was hoping we get through. Two final questions. Where can folks find you if they want to read up on more stuff that you share and just follow you online? And how can listeners be useful to you? Find me on LinkedIn. And I have a
Starting point is 01:16:22 sub-sad called Practical Intelligence where I've been interviewing practitioners who are working with AI. It was my way of learning. I started when I was a VC, trying to continue doing it. And how can they be helpful if you're a customer? customer glean. I'd love to know what you think, what works and what doesn't work. What's the best way to share that with you? Is it like messaging on LinkedIn? Subscribe. Message on LinkedIn or comment on your, on your post. Yeah. Those probably be the two ways. Awesome. Tamara, thank you so much for being here. Thank you for having me. Bye, everyone. Thank you so much for listening. If you found this valuable, you can subscribe to the show on Apple Podcasts, Spotify, or your favorite podcast app.
Starting point is 01:17:08 Also, please consider giving us a rating or leaving a review, as that really helps other listeners find the podcast. You can find all past episodes or learn more about the show at lenniespodcast.com. See you in the next episode.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.