Lenny's Podcast: Product | Career | Growth - Mastering onboarding | Lauryn Isford (Head of Growth at Airtable)

Starting point is 00:00:00 an activation rate that falls in a lower percentage range, maybe for most companies, 5 to 15% is better than one that falls in a higher percentage range because it means that there's likely much higher correlation with long-term retention and you're really working hard to get most of your users to reach a state that they're not reaching today. Welcome to Lenny's podcast where I interview world-class product leaders and growth experts to help you get better at the craft of building and growing products. Today, my guest is Lauren Isford. Lauren was most recently head of growth at Airtable. Before that, she was a product growth lead at Facebook, working on user growth, internet.org, and growth of Facebook at India. Before that, interestingly,

Starting point is 00:00:44 she led growth for Blue Bottles' e-commerce business. In a conversation, we dive deep into Lauren's favorite topic, onboarding. Why, it's one of the biggest and most undervalued growth levers, What she's learned about optimizing onboarding flows through her work redoing airtables onboarding flow. What she's seen work and common pitfalls around onboarding, plus a ton of advice around figuring out your activation metric. I could talk all day with Lauren about growth, but we had to cut this off to keep this to a reasonable length. Enjoy my conversation with Lauren Isford after a short word from our wonderful sponsors. This episode is brought to you by public.com. You want to tell you about their new treasury accounts, which earn a 4.8% yield on your cash.

Starting point is 00:01:27 That is higher than a high yield savings account while still being backed by the full faith and credit of the U.S. government. Treasury yields are at a 15-year high, but buying U.S. treasuries is super complicated if you go to a bank or navigate an ancient government website. Or at least that was the case. Now you can move your cash into U.S. treasuries with the flexibility of a bank account. You can access your cash whenever you want, even before your treasury bills hit maturity. There are no hold periods, no settlement days, just a safe place to park your cash and earn a reliable yield. Public will automatically reinvest your treasury bills at maturity, so you don't have to do anything to continue growing your yield. And you can manage your treasuries alongside stocks, ETFs, crypto, and any alternative assets.

Starting point is 00:02:12 Do all your investing in one place and earn 4.8%, a higher yield than a high yield savings. only with a treasury account at public.com slash Lenny. Today's episode is brought to you by Mero, an online visual whiteboard that's designed specifically for teams like yours and mine. I have a quick request. Head on over to my board at Mero.com slash Lenny. And let me know which guest you'd love for me to have on in 2023. And while you're on the mirror board, feel free to play around with the tool.

Starting point is 00:02:42 It's a great shared space to work closely with your colleagues to capture ideas, get feedback, and iterate quickly and easily on anything you're working on. For example, in Miro, you can build out your product strategy by brainstorming with sticky notes, comments, live reactions, voting tool, even an estimation app to scope out your team sprints. Your whole distributed team can come together around a wireframe and dry ideas with the pen tool or even put moks right into the mirror board. And with one of Miro's ready-made template, you can go from discovery and research to product

Starting point is 00:03:11 roadmap to customer journey flows, final mocks, you get the picture. head on over to mero.com slash lenny to leave your suggestions. That's mireo.com slash lenny. Lauren, welcome to the podcast. Thank you. I'm so excited to be here. We've chatted a bunch over slacks, like all these different slacks we're in and Twitter and emails, but we've never actually chatted real time. And so I have a million questions that I want to ask you. So thank you again for being here. We have never chatted real time. So everybody's getting the first conversation. and I'm really looking forward to it. I know that you have this pretty spicy,

Starting point is 00:03:50 contrary on experimentation and that I think you believe people run experiments too often and maybe not everything should be an experiment. Can you talk about that? Yes. So experimentation is a really big part. Growth culture, growth hacking culture, PLG culture,

Starting point is 00:04:07 growth marketing culture, any kind of growth, at least in my sphere. And sometimes teams can be really, really dependent. on experimentation when trying to grow a business. A great example of this would be consumer growth at scale. Think your classic big social company. I worked at one of them. I am a former employee of Meta back when it was called Facebook.

Starting point is 00:04:32 And when you're at scale, trying to grow a social app, experimenting can feel second nature. It can feel like a necessary step in your product development process that you want to drive more signups or you want to drive better. activation with new customers. So you change some buttons, change a design, and A, B, test it, and then see if numbers go up or down and then make your ship decision based on that. I find that there's generally two reasons why a growth team wants to experiment. And one of them is to understand more precisely the metric impact of what they're building and what they're

Starting point is 00:05:11 putting in front of customers. And the other is risk mitigation, where you're making so many big dramatic changes that there's some risk that while this could be really great for the business, it could also be really bad. And it would be good to understand that before everybody's experiencing that in production. So with that framework in mind, sometimes you don't need to experiment. Sometimes if the business, you know, if let's say activation, right, activation rates go up six percent versus seven percent. That precision actually doesn't help all that much beyond being able to say in your performance review, hey, I increased activation by 7%. So it also is expensive to have folks on the ground, be it engineers, analysts, product managers,

Starting point is 00:05:57 spending time understanding the results of an experiment that could otherwise be spent on road mapping, on foundational analysis, on shipping things. So experiments can be expensive. So with all that said, generally my advice is to experiment when you need to. and to primarily see it as a risk mitigation tactic when you're making dramatic changes. And to let the product development process do more work. So spend more time with customers, be more rigorous in understanding precisely what problem you're solving, get mocks in front of people and see how they react,

Starting point is 00:06:35 and hopefully have more conviction than you otherwise would when you ship something that it's okay if every customer sees it tomorrow and that the experiment doesn't actually matter as much. It's so interesting hearing that from a head of growth person. Working at Airbnb for a long time, and you talked about this, there's so much value put into the amount your experiment moves the metric is so important to be, like you said, your performance review, your team's status, your team's ability to show they were successful, right? Like people look at like, you drove this metric 14%,

Starting point is 00:07:09 which oftentimes you add up from experiments you've ran. How do you like work in a culture like that? or is it just in that culture, you may as well run experiments because that's the only way you get credit for the work you do. Or is there a way to just be like, wow, like that is how we're measured, but it's still maybe not worth running everything as an experiment. How do you kind of find that balance? It feels to me like that is the default culture, especially as growth teams become organizations and as those organizations grow with companies into growth stage, public company, territory, and beyond. However, I do think you can build a different culture, and the only way to escape the trap of experimenting everything is to have a very intentional culture about doing right by customers

Starting point is 00:07:53 and doing the right thing for the business. A growth team or growth org exists in service of improving the business and delivering results for the business. And whether or not you measure those precisely in an AV test, you still shipped them or you didn't. So the rigor around your process was either there or it wasn't. This means, though, that there have to be other ways to motivate, reward, retain, and develop really good talent. So a culture around the impact you had on customers as measured by qualitative feedback, or as measured by deals that were closed, or deals that weren't lost, or other kinds of indicators that you did the right thing for customers is important.

Starting point is 00:08:35 And there shouldn't be, especially in engineering within the world of growth, a culture around having to point to numbers, demonstrate your impact because if there is, then the team will bias experiments all the time. And that's not necessarily the right thing for the business. It's a very expensive cost. Wow. It's so wild hearing this from, again, I had a growth, someone that's so analytical like you. Is there an example of some you launched that maybe most people would have run an experiment and you decided not to for one of these reasons? There is a feature, a product, really, that Airtable offers called Airtable Forms. It's possible you've used it. I'm not sure if you have, but...

Starting point is 00:09:10 I don't think so, but I will go check it. Check it out. You can check it out. There are some new features I'm about to tell you about. So maybe that will entice you. There we go. Scoops. So airtable forms is much like other forms products. You can create a form and then send it to anybody to submit. The people who submit your form don't need to be a user of air table. Oh yeah. I have used that. Okay. It's just like the turn an air table into form. Yes. Exactly. So something we noticed is that there was a gap in feature parity for airtable forms where. The submitter could not request a copy of their submission. So I might send my t-shirt size to Lenny for a form around ordering swag for the company, and then I might want to remember which t-shirt size that I ordered and get a copy of that in my email. We created that feature, which as a result was gated on creating an account with Airtable, and we just turned it on and wanted to see what would happen, because we knew from rigor of a wonderful product team doing robust customer analysis and also doing

Starting point is 00:10:17 the dataware that this is something that people wanted, that it was a feature that would bring value to customers, and that even if it didn't move certain metrics like a sign up percentage, even if it might affect the mix shift of activation rate from folks who signed up, it would be net good for customers who were using forms and who were submitting them. So we did roll that one out without an AB test. It did have a big enough impact on our sign-up metrics that we saw at top line and didn't need the AB test to see what was happening. And we also were able to use attribution to make some analysis possible after we rolled it out so we could learn from what was happening to the base afterward. Fascinating. That's a really good example. And I imagine that helps a lot when

Starting point is 00:10:56 the head of growth is encouraging the team not to run as an experiment versus like, you know, PM on a sub-team, like, nah, but I didn't need to run this as an experiment. Because in that case, you're already acknowledging that team. You did a great job. Look at this metric. Clearly this one move. Clearly customers want it. So to your point, basically,

Starting point is 00:11:12 this kind of stuff has to come top down, probably for it to work well. I think it does. And it also cannot be an excuse for rigor around building well and being precise in what customers need. But overall, if you can be a results-oriented organization that just wants to do the right thing

Starting point is 00:11:28 and move with urgency, then in my opinion, that's the way that you can have the most impact. Cool. Okay. I didn't expect to spend that much time. on that question, but there's so much there. That was really interesting. What I want to spend the bulk of our time on is onboarding. Something that I found myself, and I think you agree with a lot of this,

Starting point is 00:11:45 but I'll confirm, is that I've done a lot of research into the growth stories of the most successful startups. And what I find, one, is that retention ends up being the thing you got to crack. If you can't crack retention, nothing else matters. And then two, more interestingly, onboarding ends up being one of the biggest levers to increasing retention, which basically A, then B equals C, onboarding ends up being one of the biggest areas of opportunity for growth teams, both early on and late stage. And so I guess the first question, would you agree with that general sentiment that onboarding is this huge opportunity and often undervalued? Yes, I definitely agree. It depends, of course, on the shape of business. Not every business

Starting point is 00:12:27 should prioritize onboarding first. But if you have some sort of self-serve element of your product. If someone can give your product a try, maybe you have a playground or a sandbox demo, if there's a freemium element to your pricing scheme, if you maybe offer things totally for free and don't even have monetization yet. Onboarding is that first really important choke point that from which downstream of onboarding so many important metrics and results flow for the business, from converting someone to a paid customer to closing a deal to, you know, growing, how many people in an organization are using your product. So all of that really comes back to onboarding. If you can get that right, lots of good things will

Starting point is 00:13:12 follow. Okay, great. I'm glad we agree. I already know this, but you spent a lot of time on airtables' onboarding flow. Yes. And so I'm curious to just learn about what did you do over the time that you spent optimizing AirTables' onboarding experience, a bit of impact did you see through the work that you did there. And then just any big kind of general takeaways that either you think people should know or that you'll take with you to future opportunities around optimizing an onboarding experience.

Starting point is 00:13:42 We could talk about onboarding all day. This is my most of my favorite things to chat about recently. So we did have a wonderful activation team rebuild Airtable's onboarding flow. over the past 12 to 18 months. This included many projects, including several big ones. So what you've probably experienced, if you signed up for Airtable recently, or what you might experience if you create a new account soon,

Starting point is 00:14:10 is we built an immersive wizard that we called guided onboarding that helped guide you through setting up your first workflow on Airtable, and in doing that, reduced the cognitive load of getting started, helped you make more progress faster and created scaffolding that more than 90% of customers would benefit from to be able to get up and running on a product that's pretty complicated. That was the first piece. We also then introduced some personalization to use case on top of that. So instead of helping you build something generic, having you build something that's relevant to you.

Starting point is 00:14:50 And then we also worked on ongoing education. So once you're in a workflow, once you've built, once you've built something, how do we help you level it up to go from a beginner to intermediate to advanced? And one funny anecdote about this is that we actually called that project the mole, M-O-L-E, because the design pattern in product looks like a mole. It pops up from the bottom of the screen and gives you tips as you're exploring. So there are some of the biggest changes we made. We did retire a bunch of our tool tips, which were a big part of onboarding a really long time. So happy to chat more about that. And then also did a bunch of more incremental

Starting point is 00:15:30 optimizations as well. In general, tried to take a portfolio approach to what we did. Cool. Okay, a few questions real quick. So there's, what were the three buckets real quick? So personalization, ongoing education, what was the first one? The first one was guided onboarding. Guided onboarding. What was the impact of this work just to give people sense of the kind of impact you can have on conversion and then whatever other metrics you looked at there? We were working on activation for a few years. Before I arrived at Airtable, there was already an awesome activation team,

Starting point is 00:16:03 hard at work. Overall, the investments we made in onboarding over about a 6 to 8-month period that included the wizard, the mole with ongoing education, and also some personalization. Together drove a 20% lift and activation rate for Airtable. Wow. That sounds quite impactful, especially at a company that scale. It's awesome. I would say celebrate any clear statistical significant improvement in activation rate. It's a big victory. And credit goes to the team that really spent many, many hours with customers and designing precisely to build something that could have that big of an impact. I think it speaks to the importance of really understanding what a user needs to be onboarded well, which is not the same as what your business wants the user to be onboarded to. So to Eliminating those and building carefully is really what made it successful.

Starting point is 00:16:57 Which of these three buckets would you say had the biggest impact? Because I want to kind of get a couple levels deeper to get to like what exactly did you do that worked really well. I would say that the guided onboarding wizard, which is the immersive wizard that helps you figure out how to get started was the most impactful thing we did. And it's interesting that you had tooltips and this feels like a tooltapy thing. What is it conceptually? What's the simple way to think about the onboarding wizard versus a bunch of tool tips telling you like, hey, Lauren, click here next. go here and then check this thing out. Totally. Imagine being in a step-by-step guide where you are asked question.

Starting point is 00:17:33 For example, pick which kind of project you're working on. Pick what kinds of things you'd like to track for this project. And then as you select from beautiful, easy-to-click buttons that require very little work on your part, something is visualized for you on the right half of the screen. So you can see your workflow visually come to light. as you do the work on the left half of the screen, and all of this is done for you in a very guided and instructive way.

Starting point is 00:18:00 Are there any generalized learnings from that experience of just how to do a great onboarding experience? It sounds like probably avoid tooltips, instead just kind of ask questions and show them progress as they're going through it and kind of like an immersive experience versus here's the product, check out all the cool features. I think there is something to be said for reducing reliance on tooltips, but I'm not sure I would go so far as to say the tooltip is dead as much as I maybe would like to

Starting point is 00:18:29 because there are too many of them out there. The reason for this is that I do believe Airtable's customers had a very specific need, which was that the effort required to build basic scaffolding was too much, and they needed more support guardrails, bumpers to help them through that. And this kind of guided or immersive wizard was the best mechanism we could come up with to reduce that effort required and to make them feel more supported in their journey. I'm not sure that this pattern is one that works for every product. I think it's one that works well for a complicated product where figuring out where to go next and how to get started is actually very challenging or has a high cognitive load. So I would keep that in mind. But in this case,

Starting point is 00:19:17 it did work really well for us. I have seen some other products in the wild adopt similar patterns, which gives me confidence that it is transferable beyond Airtable and that there's probably something to it. That's definitely a big learning. And then, you know, I think one other big learning for us was that we had to meet users where they are. We have some awesome, advanced features of really cool stuff you can do with Airtable. Automations being a great example. However, users don't necessarily need to get that started on day one. They don't need to learn about the advanced stuff when they haven't even looked at a workflow before. So we really worked hard to prioritize what the user actually needed and to consider what was

Starting point is 00:20:01 necessary education versus what could be ongoing education and building it out. Can you talk a bit more about what that was? What did you actually do to understand kind of the type of user? And then what did you change for them? because we actually did something like this at Airbnb, and it was a tiny bit successful when for host onboarding, but it wasn't anything big.

Starting point is 00:20:21 And I'm so I'm curious what it is you specifically did. Did you ask them a few questions and then group them in a group and then changed the way the rest of the flow went? Yeah, what did you do there? Good question. So at the very, very beginning, we sort of said new users broadly need help. Who are they?

Starting point is 00:20:38 What do we know about them? How can we help them? And we spoke to a bunch of customers and also watched them get started and looked for patterns in behavior and also clusters. So someone who is familiar with databases, somewhat technical, and prefers to and has experience in building things, might have a different need from onboarding than someone who is exploring a tool that was recommended to them for Project Minute. And with that in mind, there were some clear segments of personas or buckets of users that

Starting point is 00:21:11 we could split out to give different experiences. Now that said, when we rolled out the guided onboarding wizard, it was actually just one generic onboarding. That was one-size-fits-all. And while escape patches are great, we felt like we could solve, as I think I referenced earlier, more than 90% of use cases or users' needs

Starting point is 00:21:30 with one generic onboarding to start. And then we could personalize from there. When we started to personalize, generally we found bucketing customers by their learning style and their building style was more effective than more classic segmentation like do you work in marketing, do you work in product management,

Starting point is 00:21:53 do you work in operation? The reason for this is that there are many different types of building or workflows that are possible in Airtable. Some are sophisticated, for use at work. Some are simple for use at work. Some are somewhere in between and are for a hobby use case or a consulting use case. And knowing how someone would go about building was more effective than what do you actually want to see on the other side. This means that something like a template, which can give you an example of how to build a use case for project management, can be helpful

Starting point is 00:22:27 for inspiration, but might not actually be the best way to teach you how to use a product like Airtable, when instead we could learn that you're someone who needs more familiarity with databases and to be able to get to the next level or who might need a more visual learning experience instead of a more data forward learning experience. So we tried to segment the experience that way and found that that yielded better results on activation than some of the more traditional segments. And how did you decide which segment that user was in? Was it a question you asked them right at the beginning?

Starting point is 00:22:57 We had a really awesome research team that would do some surveys and conversations with customers away from our production experience and away from individual projects. So we had a really robust read going in to the project of who these different personas were, different building types, different learning types. That said, we do also ask folks when they sign up some questions. And depending on who you are or what we might think we know about you or want to know about you, we might ask you different questions. And that's in service of helping you get started. I had some big ideas for how we might, you know, bring this to life even further that might come to life in the future, such as if somebody's there to just help out, if there may be a teammate rather

Starting point is 00:23:40 than a builder, if they're just there to work with someone else because they, you know, Lenny invited Lauren to work on Airtable because he needs Lauren to do something or update a sprint, whatever. Lauren needs really different onboarding than Lenny. So actually getting that data in the flow is really useful because then we can route customers to a fully different experience. And it's amazing how much low-hanging fruit there is to personalize and segment that onboarding experience in so many products that are out there, you just need to be really detail-oriented and precise on who you're working with. You talked about this experience as activation, and so just digging it a little bit further into that idea. One of the important kind of metrics milestones you've got to figure out

Starting point is 00:24:20 when you're working on onboarding is what is an activated user? What's the activation milestone? What's the activation metric? I know you have some strong opinions and some really interesting insights into activation milestones based on your experience at Air Table. Can you chat a bit about that and just share what AirTable's activation metric ended up being? Yes. So overall, every growth team needs a North Star metric. It's so important to have singular focus on what the business results are that you are working to drive in your team.

Starting point is 00:24:49 On our activation team, which, as I mentioned, focused on onboarding, though in theory there could be other ways that you want to focus on driving activation. we had one North Star metric, which was what we called our team activation metric. So this representative, a team of people were activated on Airtable's product and using it in a way that suggested they would be long-term retained. And for us, that was week four multi-user. Meaning in the fourth week, more than one person on that team is active and contributing to a workflow on Airtable. This metric is something that our wonderful analytics team determined to be highly. correlated with long-term retention. It's also a metric that holds a relatively high bar.

Starting point is 00:25:33 So it requires a number of things to be true that something of substance has been built, that people persist and continue to collaborate, that they're collaborating on a weekly cadence, and also holds a relatively high bar on exactly how they're contributing, meaning that the sum total of this is somewhat hard to achieve, which means that we have a hard job and also a high bar as an activation team to achieve that for as many customers as possible. In general, I think an activation rate that falls in a lower percentage range, maybe for most companies, 5 to 15 percent, is better than one that falls in a higher percentage range because it means that there's likely much higher correlation with long-term retention and you're really working

Starting point is 00:26:17 hard to get most of your users to reach a state that they're not reaching today. I really like that heuristic. So the idea there is when you're picking an activation metric, you want it to be like in the single digits potentially because you're saying that's more likely to be correlated with retention because retention's probably pretty low long term. Is that kind of the rough idea? That's a rough idea.

Starting point is 00:26:39 Of course, the metric should be correlated with retention no matter what. But if 40% of your customers are still, you know, active at week four, maybe with a metric that would be week four active rate, then only a fraction of those are still going to be active in month 12, in month 18, and month 24. And I would much prefer to pick a more specific, more precise metric that maybe only 5% of users reach, but know that those 5% of users will be with us for the long haul.

Starting point is 00:27:10 And if we could get that 5% even to 6% or 7%, it would have huge downstream effects on long-term metrics for the business. So that's why I would opt for a more specific metric. Okay, so this activation metric, week four multi-user active, is really interesting metric. Can you talk a bit about how you actually operationalize this and put this to work on your team to help people understand what to work on and make sure they're moving the right sorts of numbers? Totally. So one of the first things that we did when me and my team started to revisit week four multi-user active right before we started. started to rebuild onboarding is break that metric down into all of its component. So if you really

Starting point is 00:27:55 think about what goes into that number, how many teams sign up as a team versus as an individual? How many of them make it to week four? How many of them have more than two people invited versus more than two people who've ever been active versus more than two people who were active in the fourth week? Maybe they have one person active in the fourth week. And then what does active mean? and what are the different kinds of behaviors that constitute contribution or being active? Doing that really detailed work on the metric helped us understand what levers we could pull to have a really big impact on activation overall. Additionally, we actually started using more metrics,

Starting point is 00:28:37 so we didn't just use our activation rate metric week four multi-user active to make all of our decisions. We introduced a few more. and one of them was purely a retention metric for an individual. Are you week two retained? Are you week four retained? The other was what we called build with a capital B. And this was roughly a sophistication score.

Starting point is 00:29:01 So for someone who's building something, have they reached sort of intermediate levels of use of Airtable? The reason why we added these metrics is we were building new mechanisms for onboarding that were helping users build more effectively. and find more value in Airtable, but sometimes those treatments helped users become more sophisticated but didn't help them invite more teammate. Or sometimes those new mechanisms made someone more interested in giving us a shot for a few more weeks, but what they built was actually not any more impressive than if they had done it on their own. So this group of metrics actually really set us free.

Starting point is 00:29:42 It gave us those constraints where we could actually measure success in a few different ways. and think about activation as being more complicated than just a single metric and celebrate anything we could do to help on a couple of dimensions. So I know it's a little unconventional to have a few metrics that you work with, but we did find that that was really helpful when we were making big changes. That is actually really interesting. So it makes it feel like the core activation metric you talked about was more of an output metric. And you kind of realize here's the things we could actually be moving directly. Is that roughly how you thought about it? Exactly. It also helped us grapple with some of the tensions we felt, which I know a lot of teams working on activation

Starting point is 00:30:22 and onboarding seal, which is picking one metric doesn't paint the whole picture of what you're trying to achieve when you help a user onboard to your product and when you educate them about what's possible. So in having sophistication and retention and an element of team use, all as part of the fabric of how we talked about activation, it made us much more well-rounded as a team. that connects a bit to so we worked on this post together about how to choose an activation metric and you shared part of this story for that post

Starting point is 00:30:52 and there's a little bit of debate amongst folks that contributed their opinion on how to decide an activation metric where it's a debate between is it okay to have like a workspace activation metric where it's like how many boards somebody creates how many air table table somebody has created versus like

Starting point is 00:31:09 a user action like user has created 10 tables or user using it two times week And I think you're on the side of like workspace is maybe a more interesting metric for a collaboration tool. And it's interesting that you end up with both in the end, which I think is kind of where folks landed. Like you probably look at how is the company using this tool and then like per user, are they using it consistently? So I guess the question is just what's your take on user specific activation metric versus workspace level activation metric? I really like this question. I agree it is a great debate. I'm not sure there's a clear answer because it does depend on your product.

Starting point is 00:31:47 In the case of Airtable, which is a product that has seat-based pricing and generally horizontal adoption, it totally makes sense to have a workspace activation metric. Because you want to understand in an account, in an organization, how many folks are actually using a product and finding value. That can be different for tools that might look like Airtable but have different mechanisms for growth or different pricing or different vertical personas that tend to adopt it. So I do think there is some variance. I do have a reaction to share with you that's a little spicy. Please. Is that it's important that growth teams are agile. And this means that North Stars,

Starting point is 00:32:29 key metrics, focus metrics will change. And if you're working on the same metric forever, there's probably some inefficiency in actually chasing the biggest impact for the business. So I would be open-minded about if a workspace or team or account activation metric is always the right thing to focus on. Team activation looks really healthy because your growth team did some really amazing work on it. Maybe user retention is the right place to focus next year. Maybe it's more about conversion. Maybe it's more about some other signal for long-term retention. And I would be open to being dynamic and changing that metric over time. Stability in metric is great. It helps with momentum. It helps with building expertise.

Starting point is 00:33:13 But sometimes we overfocus on picking the perfect North Star metric. And by the time you feel like you found the perfect one, it's actually time to move on to something different and work on a different opportunity. This episode is brought to by Epo. Epo is a next generation AB testing platform built by Airbnb Alums for modern growth teams. Companies like Netlify, Contentful, and Cameo, rely on Epo to power their experiments. Wherever you work, running experiments is increasingly. increasingly essential, but there are no commercial tools that integrate with a modern

Starting point is 00:33:45 growth team stack. This leads to waste of time building internal tools or trying to run your experiments through a clunky marketing tool. When I was at Airbnb, one of the things that I loved about our experimentation platform was being able to easily slice results by device, by country, and by user stage. Epo does all that and more, delivering results quickly, avoiding annoying, prolonged analytics cycles, and helping you easily get to the root cause of any issue you do. discover. Epo lets you go beyond basic click-through metrics, and instead use your Northstar metrics,

Starting point is 00:34:16 like activation, retention, subscriptions, and payments. And Epo supports test on the front end, the back end, email marketing, and even machine learning clients. Check out Epo at getepo.com, get EPPO.com, and 10X your experiment velocity. Is there an example of that that comes to mind when you talk about being a little stuck on a metric? Is that something you went through at table or anywhere else. It worked. I've gone through plenty of times. We actually at the organizational level on the air table growth org changed our North Star metric a couple times, which is a big deal that manifests for several teams. Roughly the arc of that change for us was shifting from being a growth org focused on revenue to a growth or focused on user growth and customer growth. And this for us

Starting point is 00:35:08 was a really important moment where we decided that it was most essential in our work to grow the business to bring millions more people onto the platform using the product and finding value in the product because we were taking a decades-long view that they could always become monetized or converted customers later. And there wasn't really a rush. And we felt that focusing on revenue led us to make some decisions that were a bit more short-term oriented than would be ideal. There's also a dynamic here where in the world of enterprise SaaS, the world of B2B SaaS, there's a new theme called product-led sales that's very hot right now. And this means that often in a PLG company, there's some ideal end goal of handing off certain customers to have a sales

Starting point is 00:35:57 conversation or to close an enterprise contract. In that case, you might actually prefer to delay revenue for months or quarters or years to manifest it later. And when that's the case, your growth team should be fully aligned in lockstep with sales and with go-to-market team. Focusing on user growth is actually the right call. So that's an example of a big pivot that we made. And in doing that, we felt more strategic clarity and we're able to move faster. That is an awesome story. How long did that process take and any advice for folks that might be going through a similar journey of like, Maybe we should rethink our North Star metric and not be revenue. Any advice there?

Starting point is 00:36:36 In general, I would say having stability in North Star metric for at least six months feels like table stakes to me. And that's for the reasons that I cited before, for building momentum, for building domain expertise, and also for compounding impact in areas where you see success, where you notice growth flywheels that you can often mind. However, if you're reaching a point where that North Star metric feels like it's old news, maybe you're outgrowing it, maybe you want to work on different things. I think that's great. Be open-minded about changing it up. I would generally try to start with the mechanics of the

Starting point is 00:37:11 business and what you think you might be able to drive in terms of metric impact with the resources you have on your growth team. That can look different for every growth team because some of them have marketing, some are more product and engineering, some are kind of a mix of both or even something different than that. So I would start with what impact do we think we could have? Where do we think the biggest opportunity is to chase and you can literally draw a funnel on a whiteboard and map it out and brainstorm together, do some analysis on the side. And when you see what opportunity feels like the most important thing to chase, try to build a North Star metric that reflects the output of that work rather than drives all of your decision making from the beginning. A North Star metric

Starting point is 00:37:54 should really be a measure of what you plan to do, the strategy you plan to deliver, is delivering results for the business on the other side rather than the other way around. So you mentioned trials and freemium at one point, and I want to spend a little time on this. And I know you also have some strong opinions about this kind of debate. Another debate people have, there's all these debates and growth between offering a trial or offering a freemium product self-serve. And I think your perspective is you should do both. And I think maybe you call it a reverse trial because I was doing some research. So I guess is that true? Is that how you see the world? And then just generally, why do you believe

Starting point is 00:38:29 that that is the right approach? What is it about all these growth people with their strong opinion? I guess I have so many of them. You're educating me on my own perspectives today. Freemium and free trial. So to get on the same page with definitions for all of our wonderful listeners, a free trial is when you can use the product for free for a limited time, and then your only option beyond that limited time is to pay for use of the product.

Starting point is 00:38:58 Freemium would be when there are, multiple options for how to use the product, and one of those options is an infinitely free version of the product. So you can use Airtable for free forever, or you can pay some amount and have access to premium features. So with all that in mind, personally, I'm in the camp of offering a reverse trial. Funky name, but what that means is offer a trial, but also offer freemio. Do both. And the reason why I like this is you get an operational. when somebody shows up and says, hey, I'm going to give your product a try today to show them everything that's possible. Onboarding is a huge component of that. Help somebody get started,

Starting point is 00:39:42 have those aha moments and experience initial value. But also, this is your moment to showcase everything that can be done with your really cool product. And you have some limited number of days, maybe seven days, 14 days, 30 days to showcase all of the cool things that your company is building for your customers. That is the beauty of a free trial. It's not just that someone can try your product without paying. It's that they can try even more of the product, all of the premium, amazing, advanced offerings that could be possible if they decide they want to settle on a premium plan. When you are deciding if this is something you want to do, I would actually take a big step back from looking at competitive pricing pages and getting into the details and reading

Starting point is 00:40:26 blogs and just think about what your philosophy is as a business on monetizing customers. The reason for this is generally the reason to offer a free plan or a free trial, but really a free plan, the freemium type of pricing model, is if you value letting millions, tens of millions of customers give your product a try, even if they never pay you a dollar. that shows to me prioritization and value of user grab, brand awareness, and exposure of your product

Starting point is 00:41:02 more than just revenue. And if that's the case, a freemium pricing structure can be really great for your product and give you the space to see if your product can become that household name that everybody is familiar with and can give a try

Starting point is 00:41:20 and get some early value and even experience some aha moments. On top of that, you can offer a free trial to show what's possible with premium value, and then that really can just be focused space for you to say, hey, look what's possible if you pay us $5 a month, $10 a month. And you might even get some extra converting out of that and some more paid customers. So in general, that's how I think about it. I like the reverse trial because user growth is important. And if you're in a long game where you're trying to grow a business for a decade or more,

Starting point is 00:41:51 ideally you're trying to get millions of people onto your product and you can always have that monetization conversation later but you only get a couple moments where you can say hey pull out your credit card or let's get on the phone and talk about an enterprise contract with a customer before you lose trust or lose patience and so that focus on helping them discover value and build loyalty to you is much more important i really like this concept that's super cool name too i'm also thinking back to some of the SaaS tools I've used that have had this where I go straight into the pro plan. And then I'm like, oh, I don't want to lose all these features and then I actually end up buying it. So when I'm hearing this, it's, it sounds to me like it's a better version of the freemium approach.

Starting point is 00:42:31 I imagine there's still many SaaS tools that are very enterprising, take handholding. Maybe this goes away. I know Elena Vernon who's been on the podcast is just like a huge proponent of everyone will be product led, self-serve eventually. But until that day, they're still like, I don't know, I think of retool. think is very like hands-on, hand-holdy front, I think is like that. There's all these tools that are, people don't get really quickly. And so I guess do you still think there's a need for some of these tools that need sales and customer success involvement to stick with just trial, at least for now?

Starting point is 00:43:06 Or do you think they should all for kind of find a way to get to self-serve and a reverse trial? I do really agree with what Elena said. I really look forward to the day when self-serve and free me, are possible for every product, but I also recognize that that can be really expensive to build and implement and is not for everyone. So that's cool too. There are other options. In general, I think freemium and also free trials tend to be most effective when there's something that the person who signed up can actually do on their own without being handheld. It doesn't have to be full functionality. It can be exploring a sandbox or a demo or

Starting point is 00:43:47 something they can poke around in and, you know, experience value, see that aha moment. That's great. That's a moment where you can give value to that person who's chosen to spend time with your product. If that's not possible, there are different ways to be creative that don't require having premium pricing. You can think about how to use concepts related to PLG and related to top of funnel adoption in different ways. So maybe, maybe. Maybe you can create custom landing pages or experiences that help showcase value without a full sign-up or free plan or free trial experience. Maybe you give folks the ability to sign up, and while they've sort of signed up as an interested customer, they're not fully experiencing things. They might not even have the option to pay for something yet, but they can learn.

Starting point is 00:44:44 There's some resources. There's some education for them to experience. Or maybe you can think about top of funnel adoption or traffic as being most helpful for expansion within customers you already. So if you've signed contracts with a couple really large Fortune 500 companies and somebody wants to join and signs up on your website from the same email domain, then you can provide an experience for them that might feel like it helps them learn the mechanics. that's actually only available to folks who are part of organizations that already have contracts with you. It's a different way of thinking about PLG and not necessarily something you would offer for free. They're already an enterprise customer, but some of those concepts can still have a lot of value and help you grow the footprint of an account in an organization.

Starting point is 00:45:32 And those are definitely awesome things to try if you can't offer something self-serve. So what I'm hearing is find ways to make things some component of itself serve so that you don't need to necessarily. talk to someone immediately. They can start to understand some element of it on maybe an interactive landing page or some very simple part of the product. Exactly. I think the key is to figure out what it would be like

Starting point is 00:45:54 for someone to experience value when there's no human sitting next to them. And that value doesn't have to be full functionality of the product. Awesome. Coming back to onboarding, and this is my last onboarding question. I have another topic I wanted to touch on. Do you have any just general

Starting point is 00:46:10 pieces of advice, either probably this will work if you're working on onboarding slash things that probably won't work and are common traps that people fall into when they're trying to optimize onboarding activation flows in general. I do see a very common trap that I would love to caution against, which is that employees of a company build onboarding for customers, but they build what they think customers want rather than what customers actually want. And that manifests in an onboarding experience that's not very helpful.

Starting point is 00:46:46 So there are two patterns that I typically see. One is naming features. So imagine you're using Airtable for the first time, and you see a tooltip, and it says, this is automations. And it explains what automations is to you. That's not that useful for a user who doesn't really know what's going on yet, because they aren't sure if automations are relevant to them, if they're suited to their use case,

Starting point is 00:47:11 what exactly the word automation entails. We've named a feature, but it's really sort of an announcement of something awesome that Airtable built rather than an application that can help educate the user on how they'll receive more value from that feature.

Starting point is 00:47:27 Try not to name features. It can be very tempting in practice, even though it sounds easy in theory. Before you move on, what have you learned about how to actually name things in such a way people understand? Is there some of you do there?

Starting point is 00:47:39 Ooh, naming things in a way people understand. versus the feature name, like you just said. So instead of that, I think what would be more useful, given the constraints of using a tooltip that's pushing someone to try an automation, would be to explain how the automation is relevant to them, or even better to enable a one-touch turn-on of the automation feature or set up an automation to complete your workflow, where we actually do some of the work.

Starting point is 00:48:09 And if you click into here, we will show you what, value as possible and help you get it to the finish line. So really focusing on that contextual application or helping to drive towards an outcome rather than just educating on the name. And there's like an element of smart defaulting just like starting to do it for them versus do you want this or not. Exactly. There's also an element here of segmentation or personalization where you should be sensible about if everybody needs to know what an automation is or if there only certain folks who actually need to learn about it and others might not need to know. Awesome. All right. Back to your other suggestions. Oh, yes. There is one other suggestion,

Starting point is 00:48:48 which is if you're working on a SaaS product, especially a premium product, there's probably some pricing and packaging scheme that explains which features are available for free, which features are not, how many you get and sort of maps out usage of the product, both for free users, if you offer a free plan, and then for premium users if you offer premium plans. I find sometimes teams working on onboarding will map onboarding to that pricing or packaging. So, for example, maybe automations, to use the same example of the same feature, is something that's generally premium, that if somebody uses automations, they're more likely to be a paying customer.

Starting point is 00:49:27 It can be tempting then for an onboarding team to try to push automations to people when they're getting started, because of course, we'd prefer if customers use premium feature because then they might be more likely to become premium customers. But that is not in the best interest of educating a user on how to get started. So I do think it's very important to be careful that you are rooted in the customer need and rooted in helping that customer achieve maximum value rather than sitting in the prides of what your packaging scheme might suggest or what might be in the best interest of the company. As a growth leader, how do you operationalize that?

Starting point is 00:50:05 Is it set some drag metrics? Is it just philosophically? Let's make sure we're optimizing the right metric. What's worked to actually avoid that problem? I think North Star metrics help because a team can be singularly focused on the most important result for their roadmap and their charter. However, guard rail metrics are equally important. So an onboarding team that builds amazing onboarding that causes a 10% drop in revenue would need some sort of guardrail to make sure that they knew that that might not be the right

Starting point is 00:50:41 trade for the business and importantly should have the rigor and passion to go deep and understand what caused that drop in revenue and figure out what it was about that onboarding that ultimately caused a guardrail metric to suffer. So with that in mind, I think guardrail metrics can be very useful and are important to choose wisely. I love working with strong analytics partners on a growth team because rigor and education around how to think about guard rail metrics is something that we should always be thinking about whether you are a data analyst in functional specialty or a PM or an engineer or a designer. So that's how I kind of like to think about it. I do think guard rail metrics help and then just being well-reasoned and thinking about what's best for the business

Starting point is 00:51:25 and speaking about your work as being what's best for the business and the customer overall, rather than being too narrow in your own swim lanes of what you work on. Great advice. I want to move shift to a different topic, and this will be much shorter. You have this really cool framework for thinking about the PLG funnel, product like growth, and interestingly, it kind of trickles down to the team you build, metrics you choose and things like that. So can you just briefly talk about just this framework they use to think about

Starting point is 00:51:52 PLG growth in the PLG funnel? When I think about how to grow with PLG in a business that has some element of PLG self-server premium, I usually start with a funnel that roughly maps to the same scaffolding regardless of business. Whether I've worked on the business, whether I'm supporting the business as an advisor, I love starting with this framework. The first step is join. The second is evaluate. the third is upgrade and the fourth is expand. This funnel represents the journey of a customer in a PLG product as they advance and develop in their lifetime of using the product.

Starting point is 00:52:36 It starts with becoming a part of the account that's using the product or signing up. And you might join because you found Airtable on Twitter or you might join because Lenny invited you to use Airtable. So there are different ways that you can join that product in the first place. Then importantly, you evaluate if it's right for you. And that word choice of evaluate is deliberately not onboard or activate because it's about what the user needs to see that they are going to get the value that they want in using your product and in building a habit around it. Next is upgrade. Ideally, someone has gone from beginner to intermediate or even advanced in their ongoing education and in getting to know your product over some amount of time,

Starting point is 00:53:23 and they see premium value and raise their hand and say, I will convert to it. Now, if you offer self-serve premium plans, that's awesome. They can do it with a credit card right in the product. Sometimes this means raising their hand to talk to sales, and that's great too, but they upgrade to some sort of premium experience or to more value than what they had when they got started. And finally, expand. In VerticalSAS, this can be nuanced, but with more horizontal,

Starting point is 00:53:48 tools, ideally, a few folks, maybe one, maybe a few, are using a tool in an organization, and then many more adopt it over time. And that expansion drives net dollar retention, it drives brand awareness, it drives more usage and more pockets of the company. It is awesome for renewal rates if you're working with enterprise contracts and ultimately then also brings new referrals into the product that loop all the way back to the beginning at Join. I love it. And what's cool is about upgrade and expansion, kind of bake in retention. You're not going to upgrade. You're not going to expand if you're not retained. Can you talk a little bit about how you use this framework? Like, do you bucket, you have these four

Starting point is 00:54:30 teams on your growth team that focus on each of these stages is a more of a conceptual framework? Do you come up with KPIs for each of these steps? How do you actually operationalize this concept? I think this framework is a step too abstract to represent exactly how you should structure your teams or to be represented with four metrics or KPIs. However, it's a really good conceptual way of grounding your team or your organization in the mechanics of how the machine that is the business you work on run. And from there, it can become much easier to communicate with each other on where you see opportunity on specific pockets of the product that might be impactful.

Starting point is 00:55:14 So, for example, you might be working on a, strategy related to landing pages and be able to name that that's going to help drive joins in new organizations. And that's a really awesome way to communicate why you might invest there versus investing in something related to onboarding that would help with evaluate. So I love this framework because it helps everyone communicate clearly. And also you can derive from it more specifically what are the opportunities that are relevant to us with this framework in mind and then revisit it over time to gut check if you feel like maybe what you're investing in now is a bit outdated and needs a refresh or if there are other pockets of the business that need more attention that you might

Starting point is 00:55:56 be able to work. Can you talk a bit about how you structure the growth team potentially based on this framework and just generally how you thought about building the growth team at AirT? We had what I think is a pretty relevant set of teams if you're thinking about building out a few in your own product or organization that focuses on sort of a PLG shape of business, we had one team working on acquisition, and they were really responsible for the join. So they mapped actually really well to this funnel. One team working on activation, and they mapped pretty closely to evaluate. It wasn't a full representation of what's possible in Evaluate.

Starting point is 00:56:36 We were pretty focused on the self-serve business, and that was different than, for example, helping an enterprise customer evaluate the right offering for them. But that activation team was most closely tied to that second step in the funnel. And then we had a monetization team that worked on monetization and pricing. And they mapped really closely to the upgrade part of the funnel. They did touch some other things as well. So they worked on churn prevention and downgrades. They worked on some billing related projects. But in general, they were most thematically aligned with that upgrade step of the funnel. One area that is more emerging that's interesting is expand.

Starting point is 00:57:16 So when we got started on Airtable Growth, we didn't have a team dedicated to that expand piece, and it became increasingly interesting to us over time as we started to notice that larger companies were using the product. This meant that there was a bigger opportunity than there had been before to really help drive expansion and get more folks using the product in those accounts. that's an area that emerged later. That's a really good example of revisiting your priors and being resilient or agile in your org structure

Starting point is 00:57:47 because it wasn't something we set out to work on initially, but it became a really clear opportunity later. You mentioned that Airtable is thinking a little bit more about B2B growth versus just kind of B2C where I think it's been historically. Can you talk about that and just how are you thinking about that? B2B growth is an emerging space for growth practitioners. and hobbyists like me because the playbook hasn't been written the same way that B2C growth or consumer social growth has been. It's a new space. And there are quite a few companies that are really excited about exploring B2B growth and how to apply the DNA and the mechanics of a growth organization to more of that B2B motion or to working with more upmarket customers or enterprise

Starting point is 00:58:37 customers. So it's very top of mind for me. It's an active conversation in the growth community, especially in San Francisco. And overall, I'm really excited to see what we can do by applying this approach to growing businesses to new types of businesses. It will require some differences in execution model. So in B2C or in consumer social as to examples, You can experiment at large volumes or you can make changes that impact thousands or millions of people pretty easily. In B2B growth, generally you're working with a much smaller set of customers, and also the risk profile can be very different because smaller numbers of customers that represent larger percentages of your company's total revenue must be treated with absolute care,

Starting point is 00:59:32 as opposed to a world where you might have millions of folks coming through your product every day and small changes might not have as big of an impact. In an enterprise organization, it's important to be very careful and rigorous and to prioritize that customer's needs all the time. This means that rigor, that customer conversations, that beta testing, that live prototypes and demos are significantly more important, and that FaceTime with the customer is significantly more important than it is in B2C growth.

Starting point is 01:00:03 So we'll see what happens. I'm really excited to see more folks who have given growth a try in B2C or in consumer spaces. Try applying it to B2B because it will become increasingly common in the industry. Well, with that, we have reached our very exciting lightning round. I've got six questions for you. I'll go through it pretty fast. Are you ready? I'm ready.

Starting point is 01:00:28 All right. First question, what are two or three books that you recommend most? to other people. Ride of a Lifetime by Bob Eiger. I give this to new reports on my team. Great book to read when you're thinking about your leadership style. And Rocket Men. Really fun story.

Starting point is 01:00:46 I love a good story about ambition and achieving awesome things. What's a favorite other podcast other than the one you're currently on? I like Fifth in Mission, which is a local San Francisco podcast on local politics. Favorite recent movie or TV shows? showed that you have watched that you've really enjoyed. I really like the White Lotus season two. White Lotus was very fun to watch. I also, on the movie front, I'm in a habit of watching Best Picture nominees every year. And last year, there were a couple movies I really enjoyed. One of them was Belfast. Oh man, that was an intense movie. I watched that recently. And also, if we should turn this

Starting point is 01:01:27 into a drinking game every time someone mentions White Lotus, we drink. It's a, it's a It's an amazing show, but it definitely comes up often. It's so interesting. Comes up too much. Not like, it deserves to come up often. I love it. That's true. It's great.

Starting point is 01:01:41 But that'd be okay. We're going to do a drinking game from now on, and I'll have a shot here. Love White Lotus. Favorite interview question that you like to ask people. Tell me about a time that you delivered something that was impactful. Hmm. What do you look for in an answer when you ask that question? What's kind of a good sign and what's maybe a bad sign?

Starting point is 01:02:02 I'm looking for someone to help me understand how they define impact and what it means to them. I think a good answer for growth practitioner is intrinsic motivation about having an impact on the business. You're here. What are five SaaS products that you use day to day and you can't say your table? Figma, Mira, Slack, Gmail, Gmail, I'm the fifth one. I need to think about it. It's because I cut out air table. I got you. I know. I always say air table. Air table is definitely number five. Okay, probably number one. Okay, final question. What's speaking of air table? What's the coolest use of air table you've seen?

Starting point is 01:02:48 There was a great embedded view, which is the internal term, for when you put air table on your website in an embedded way so people can check out cool stuff related to finding COVID vaccine when they came out, which was really awesome. I also appreciated that a similar use of air table has become quite popular this year in support of facilitating folks who've been laid off to help them find new opportunities. Lauren, this was amazing. I learned a ton. We got through everything I was hoping to get through, which I had not expect. Two final questions. Where can folks find you online if they want to reach out and learn more and teach you up to? And then two, how can listeners be useful to you? You all can find me on Twitter. I'm at Lauren Isford. I love hearing about how folks with all different kinds of cool products are thinking about growth. In general, I find all of us are better at growing businesses when we study the awesome wins and learnings

Starting point is 01:03:45 of others. So please, my DMs are open. Send me cool things you're working on. I'd love to learn about it. Amazing. Lauren, thank you. Let's go drive some growth. All right. Thank you so much for listening. If you found this valuable, you can subscribe to the show on Apple podcast, Spotify, or your favorite podcast app. Also, please consider giving us a rating or leaving a review, as that really helps other listeners find the podcast. You can find all past episodes or learn more about the show at Lenny's Podcast.com. See you in the next episode.

Lenny's Podcast: Product | Career | Growth - Mastering onboarding | Lauryn Isford (Head of Growth at Airtable)

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.