Finding Peak w/ Ryan Hanley - AI, Data & When to Ask the Right Questions

Starting point is 00:00:10 prude laboratory in the basement of his home. Well, everyone, and welcome back to the show. Today we have an absolutely tremendous episode for you. It is a conversation with Dave and Helen Edwards, the authors of Make Better Decisions, a tremendous new book with the subtitle of How to Improve Your Decision Making in the Digital Age. And we talk, this is really a fantastic conversation. It's one of those conversations that like, it's why I love doing these podcasts.

Starting point is 00:00:43 You get to meet new people that you didn't know who are doing awesome things with great ideas. We talk a lot about how to make great decisions, how to integrate those decisions in the massive amount of data that we have. What is the value of data? When should we use data? When should we go with intuition and instinct as leaders? This is a fantastic conversation. I took quite literally two and a half, three full pages of notes during this conversation. I could have talked to these guys all day.

Starting point is 00:01:13 And I have the book. I'm reading the book. It's wonderful. It is very much something that is worth picking up. You can make better decisions on Amazon or anywhere that books are sold. You can always go to the show notes for the page and find the book link there if you want. Wherever you consume books, you can find this book. I highly recommend it.

Starting point is 00:01:34 I really like it. I think you're going to know exactly what I'm talking about after you have a chance to listen to Dave and Helen and their thoughts on how to make better decisions. It's a tremendous conversation. Before we get there, guys, make sure that you are subscribed to Finding Peak. Go to FindingPeek.com. It is my new substack, free content coming out every week around peak performance in business, in life, and in insurance, specifically tailored to us, the insurance industry. We do a wide range of topics, everything from personal development to leadership development, development and business, our relationships, and also deep dives into marketing,

Starting point is 00:02:13 into lead generation, into digital sales, into what we're doing at rogue risk to be a human-optimized digital agency, very much the model that I believe is the future of the insurance industry, the future of the independent agency. If you want to learn how we're doing it, go to finypeak.com, subscribe, get the emails, and if you want the deep dives, you can pay for that, which is like seven bucks a month. So I appreciate you guys for listening to this show. As always, this is a labor of love, and I just love that you guys give me your time. So I appreciate you. With all that said, it is time to get on to our conversation with Dave and Helen Edwards, co-founders of Saunders Studios and the authors of Make Better Decisions.

Starting point is 00:03:04 Awesome. Well, I'm excited to talk to you guys. Thank you. Same here. Yeah. I went through and looked at a lot of what you're doing. And I think that it's incredibly relevant to particularly the audience who listens to this show, which is primarily insurance professionals from up and down the spectrum.

Starting point is 00:03:24 So our audience is individual. from, you know, everything from one person, startup agencies in small town, wherever America, to executives at the highest level and, you know, corporations in Hartford and all the different places, Des Moines and Columbus and all the places where insurance companies operate, primarily in the U.S. So just so, you know, who we're talking to today. But normally I like to get right into the show. So I'd love if you guys maybe start with your origin story. Obviously, I'd done some background, but I'd love to hear kind of, you know, every good superhero duo has an origin story.

Starting point is 00:04:07 And maybe we start there and we dig into some of the stuff that I think is incredibly relevant to what's happening. Okay. Do you just launch in? Yeah. Yeah, rock and roll. We're talking. Sounds good.

Starting point is 00:04:20 Awesome. Well, thanks for having us. So I guess we've been working together for more than a decade. I've lost track of the number of years. We've been, we've started multiple companies. Some have worked out. Some haven't as well as the others. Saunders Studio has been around since 2019-ish.

Starting point is 00:04:41 And it continues work that we've done for several years. We started off working really closely around thinking about how do humans and machines come together. And what's happening to us as individuals, as we are digitized, as our behavior is being monitored, as our communications are being, you know, managed, as the algorithm. are making decisions for us and pointing things out in the world. As we've been put into finer and finer grain buckets. Finer and finer grain buckets and being ultra personalized, but in a way that we can't interrogate and understand because we can't see it. And we sort of started Sondra Studio with the mission of really wanting to open people's

Starting point is 00:05:19 minds of the richness of humans while we're in this digital age, that it's not us being supplanted. It is actually where's the beauty and where's the wonderful parts of being human. and how do we help people understand that? Yeah, I mean, there's so many, you know, when we kind of got into this, the, the zeitgeist, if you like, was, you know, very much in either or, it's either machines or humans, and the machines are going to rule us all. And the more we looked into it, the more we did the research,

Starting point is 00:05:46 the more we talked to people, the less we were convinced of that story. And so this is very much a, how do we do both? Yeah. And we spent time with organizations that sit there and say, we've spent all of this money on these huge days. projects and putting all kinds of AI into organizations to make more predictive analytics, and it's not really working, or people aren't really using it, or they feel like decisions are harder than they would have been before with all of this data. What do we do about this?

Starting point is 00:06:13 And that was the genesis of the book, Make Better Decisions, was helping people really understand the core of who we are as humans and who we are as decision makers, as individuals, who we are as team decision makers, and how we think about making decisions with data and with AI. And that book accompanies workshops that we do with large organizations. And we also have started up working in complex problem solving, which is an interesting area of thinking about complexity. And how do you think about solving complex problems

Starting point is 00:06:46 in a way that it's quite different from simple or complicated problems? There's lots to unpack there, which is awesome. That makes my job very easy. So I'll give you some context to some of the issues that we're facing specifically in the insurance industry. And then I think it's going to be highly relevant to what you guys do. And I think we'll have an awesome conversation here. So, you know, I actually, I own a independent insurance agency called Rogue Risk. One of the very first things that I wrote down was the term human optimized.

Starting point is 00:07:23 And what I meant by that was not necessarily all the way to. a AIML situation. However, what I realized throughout my career, having done this for 17 years and spending a lot of time on the traditional side, is that the all-human version of our business was dying. There are plenty of boomers that are holding on for dear life to the paper, file cabinet, very human, all-human version of this business. and they've been highly successful in that method, but we are rapidly changing into an ecosystem

Starting point is 00:08:03 that most industries have already moved into, which is this mixed up, mashed up, you know, what is the value of data, what do we use, what data actually allows us to have better outcomes, you know, how do we capture it, who owns it? You know, I mean, there's all these crazy decisions happening. And kind of the premise of my agency was that there are moments that add value and there are moments that don't. And I want the humans only spending time or spending

Starting point is 00:08:31 the most time possible in the moments that add value and have systems, processes, use data, feedbacks. And eventually, I think we get to a place where we're using some form of AI. I've been playing around with Open AI a lot lately to handle those processes that don't add value. The humans don't add value to, right? So you waste a lot of time, a lot of energy, resources. brain cycles throughout the day doing stuff as a straight human that as a full human, not necessarily that wasn't a comment on sexual orientation. As a just a human, you lose a lot of time and value and energy, just doing all these things that don't matter.

Starting point is 00:09:11 So where do you mash those up? Where do you? What value, what that actually is value are our enormous questions in our industry. I mean, we still, I think we employ, I think. I think something like 80% of the cobal programmers left in the world are employed in the insurance industry in the United States. So like it's this, it's this snap forward of technology. And now we're having these types of conversations. And I don't think anybody has an answer and no one is doing it well. So, you know, kind of unpacking what you said and maybe one place that I'd

Starting point is 00:09:49 like to start, just because it's a enormous buzz term in most industries, but certainly in ours, is data. And frankly, the two questions that I wrote down and related to them was, can we have too much value and how, can we have too much data and what does that look like? And does data even have value? And this is a conversation I've had multiple times in this podcast. Is it the data that has value or is it what you bring out of the data? What does all that mean? you know, kind of, let's start with the actual nuts and bolts and try to get to how we use it to make better decisions as we go. Data definitely has value once people understand it, right? Or machines understand it.

Starting point is 00:10:35 And let's start with that, that why do we even want AI in the first place? And it's because humans think in one, two, three, four lots and lots. and machines can think in unlimited dimensions. And this ability for machines to take data that in some cases is really quite alien or seemingly inhuman, like collected below our conscious, outside of our conscious recognition, eye tracking, mouse clicks and things like that, that the machines can find patterns in that at enormous dimensions. Now, there's really no real sort of practical limit other than compute power and cost. But the problem with that is that eventually, for most situations, a human has to be able to justify

Starting point is 00:11:34 how they use that prediction from a machine. So if the prediction from the machine is decoupled from the human-level decision-making, which is what you'd expect in most human-facing products, then we need to have accountability and responsibility, and we need some sort of justification, which generally means some kind of causality, some not just a correlation, which is what the machines are good at.

Starting point is 00:12:05 And humans come in because they need to be, it's only us that can really put the causation in and put the justification in. say, yeah, the machine says this, but we're going to do this, or we're going to do this anyway, or we're going to follow what the machine says, and this is why. And that level of responsibility and accountability that sits only with humans for now, the danger is, of course, that we fail to recognize that. And that's really what the sort of AI ethicists work on, is how do you stitch together

Starting point is 00:12:41 hidden bias in data sets and make the right decision on top of that. So I can see Dave's itching to jump in here. I would add that, you know, what matters with humans is that data can be utterly overwhelming. That high dimensional space is completely, it's like trying to imagine, you know, it's like trying to apply quantum theory to something. It's just not intuitive. And people make mistakes on that basis and become overwhelmed.

Starting point is 00:13:11 So I think a lot of the dichotomy that we hear around, well, as data of, you know, is data of value? Is it too big? Is it this or that? It's actually really more about how humans tackle overwhelming amounts of data. That's really what our books is about is ways to not be overwhelmed and to recognize when human cognitive biases work against you in your judgment and decision making. I think that there's a, the distinction for me is that data has value. or at least hypothetically value, right?

Starting point is 00:13:44 There can obviously be data that has zero value, I guess. But the challenge is what in order for it for that value to translate to us, we humans have to know what it means. And we generally communicate things about what one thing means when we're communicating with each other by telling stories. It could be a simple story, you know. Here's the story for why this is the primary customer target. Here's the story for why this is the right insurance product for you.

Starting point is 00:14:14 Here's the story of the U.S. American dollar, which is essentially a story. The challenge is that data doesn't tell stories. We have to tell the stories with the data. And that's a gap that is, I think, misunderstood and easily overlooked. Because people are used to seeing these great dashboards. You log in and you look at your tableau, and it's got all kinds of colors and lots. and things and, well, doesn't that tell you everything you need? Well, no, because it's not telling you any sort of story over time. It's not telling you any cause and effect. It's not applying

Starting point is 00:14:48 it any form of context that we understand naturally because we've evolved to be able to communicate with each other using stories. But data is a really recent, you know, addition into this whole concept. And we actually just don't look at data. Even when it's presented in a two-by-two in a two-dimensional space, we don't naturally know and understand and agree upon the story that's there. So we have to translate it. That's a difficult thing for a lot of people. One of the one of my most interesting takeaways in the move from being a foot soldier and a company to being a leader was how differently the same piece of information could be

Starting point is 00:15:33 interpreted by a group of people, right? you present a stat on a screen to a group of 10 leaders in an executive forum. And the feedback you get from the angles that everyone slices that singular piece of data up is incredible. We recently did. So we were acquired back in April by a larger holding company. And I'm now on the executive leadership team of that holding company. and, you know, so all the division leaders get together and there's 17 of us total and whatever. And we're walking through different departments and, hey, you know, this result and we're seeing this.

Starting point is 00:16:15 And, you know, where our variance is off here and, you know, why do we think that might be happening? And like you said, without a story to the data, the why of that of something all, I mean, it is just personal content. text, filters, biases, experience, you know, all the, it gets passed through all these different things. And what comes out the other side is like, you're, you almost start to think like, which one of us is the crazy one? Like, we're all staring at the same piece of data yet it's seemingly seeing completely different pictures. And I think that's where, um, I, I, I sometimes get lost, uh, in my own leadership is how much do I trust the data and how much do I trust my gut?

Starting point is 00:17:01 And what does that look like? Where is, you know, one of the things I wrote down during your, your kind of introduction or origin story was, you know, where's the nuance? Where do we, how do we understand nuance in a data rich world? Or something that scares me, mostly because probably I read too much, is I'm a big fan of Nassim Nicholas Taleb. And right now I'm plowing through his epic anti-fragile.

Starting point is 00:17:28 I don't know if you've read that book, but he talks about black swans and, you know, the triad or whatever. And I always think to myself, when I look at data and I think patterns and I think pattern recognition and all these kind of things, are we creating fragility in our business because pattern recognition essentially starts to carve out black swan events? You're right? We start to see things as how they happen on the mean or in the average and we don't realize. that there could be this massive thing coming that maybe our gut as humans and experience could possibly see, not always, but a pattern recognized data set that's pushing everything to means and averages and giving you variances tends to carve off. And, you know, is that a concern or something we have to negotiate? Well, there's a couple of things that you raised there.

Starting point is 00:18:23 First, I'll go back to the very first thing you pulled up, which is essentially sort of an analysis versus gut feeling. That's where we start our leadership workshops with exactly that question. And we start it from the perspective of, well, you know, modern neuroscience is telling us that everything that we, that all decisions are emotional and that here's why. And we kind of unpack that. And we unpack what heart versus head means these days, you know, the sort of, and then we look at the sort of fastening.

Starting point is 00:18:58 slow thinking that and how to how to trigger better ways of thinking and what what's really going on and when it comes to finding that nuance is is quite complex you know you've got a mix of a bias for machine learning or a bias for automation and taking what a machine says at giving higher weight to that recommendation than you would in the even in the face of evidence to the contrary so you know the classic example of the people that follow Google Maps into a lake. But these things happen all the time with data because you put a good dashboard in front of someone and all of a sudden they forget to ask the good question. So it's like how do you step in and how do you intervene and know when you should ask the right

Starting point is 00:19:47 questions and what are those questions? This is a very human process and sitting around that table presenting people with one data point that they see differently, we sort of give people a bit of a release from that because that's quite anxiety provoking. And because the promise of the analytics movement has bled into how we think about each other. So the promise of the analytics movement is that there's one single optimizable answer that can be found best by a machine, not a human. And we forget that all difficult decisions by definition are difficult because people have different perspectives. So then why do we have different perspectives?

Starting point is 00:20:34 Our cause and effect reasoning causes us to think in quite noisy ways. This is recent work by Daniel Kahneman and Saboni. And we have this noisy, undesirable variability in our thinking. That variability can be desirable. It's called creativity, right? We all have a different perspective. But we'll show people perception illusions, perception pictures. We'll ask them what do they see and everyone sees something different.

Starting point is 00:21:07 It's quite predictable that everyone sees something different. So we shouldn't be surprised that everyone sees something different in the same data. The question that then becomes, what do you do about that? And what you do about that is firstly embrace that diversity, that diversity in thinking is what's going to get you through a complex problem. And there's lots of techniques for optimizing and maximizing the human part of that. Some of it is, well, people do need to have what we call minimum viable math. You know, you really, especially in something like insurance, you should be sitting there,

Starting point is 00:21:47 should know what a mean is, should know what a standard deviation is. You'd be surprised, unfortunately. Yeah, I get it. That's why we teach minimum viable math. To give everyone the same common language. And so that especially if you're using machine learning or any kind of predictive analytics, you really need to understand what a false positive is. You really need to understand what a false negative is.

Starting point is 00:22:12 You really need to understand how different cohorts in the data will, can, can, optimizing for different things in those different cohorts can give you unintended outcomes and overall profitability, for example. And the final thing I just want to touch on is what you were talking about there in terms of the Black Swan. And this is a new product for us, but moving from decisions to complexity,

Starting point is 00:22:41 a lot of our traditional tools, whether they be analysis tools or processes and decision-making structures in organizations, are just not fit for purpose when it comes to this new world of complexity. And whether it's because we have, because we are sorting by such finer and finer grain cohorts in the data, whether people on the other end have so much more agency.

Starting point is 00:23:11 You used to, 20 years ago, you didn't really know what someone thought of you. And now you know, you know, social media will tell you what, what they think of you. And these things can be organized. the self-organization and this decentralization of control and this emergent property that is now humanity on the internet that touches all businesses. Normal statistics just flat out doesn't work. We have to turn to complexity science, which is coming to the point that there are new heuristics and new shortcuts that we can take.

Starting point is 00:23:53 out of complexity research, and a huge amount happened during the, during COVID, just in terms of understanding epidemiological models and things like that. But that math is just, I mean, the insurance industry is probably one of the few industries that's poised to adopt some of that complex math to help with decision making. But until humans really have access to some of this new science, we have to kind of glean lessons out of it. And that's how we deal with the Black Swan. is releasing yourself from this need to sort of have every, it's really a different way of looking at uncertainty. It's not trying to say that, well, there's a 0.01% chance of X,

Starting point is 00:24:41 because we know that that's just too hard for people to deal with. In fact, actually, that one's not so bad. I mean, what are the probabilities we understand? 1%, 99%, 50%, 0%, and 100%. Those are the only five probabilities that humans intuitively understand. I think that came from Richard Thaler. But we try and help people think in a much more dynamic, open, complex, networked way so that you can be sort of released from this tyranny of having to really

Starting point is 00:25:14 sort of grapple with uncertainty in a way that's just counter or not intuitive to us. and open up the team to thinking much more dynamically, to solving problems as they come at you, to being much more agile about how you use experimentation. And you just see the data in a different way. It really is a totally different way of thinking. Yeah. One of the things that you have in your book,

Starting point is 00:25:43 which wasn't a huge topic, but it was a topic that I was very interested in, I just want to bring it up considering, you know, my audience probably has is on the lighter side with some of these topics of familiarity with them. But I think, you know, when we're looking at, say the, and I know where you've talked about predictive analytics, but still those predictions are based on past experience. And, you know, one of the, one of the, I don't want to say questions because it hasn't been presented to me, but that, you know, people have framed multiple times in different, you know,

Starting point is 00:26:21 when I'm dealing with big dashboards and stuff is, you know, the concept of how do we know, how do we know when to step away from the data and trust, say, our gut, right? And having been in business for 20 plus years now, and I know you guys have been in business for a long time too, I think it's undeniable to say there's moments where you look at everything the way that it looks and you're like, nah, we got to go this way, right? Here's the answer's here. And you're like, why? I'm not 100% sure. I see this and I see this over here and I feel this and, you know, there's this swelling and I just can't explain 100% other than I know this is a direction. We at least have to try, right? And that's a really hard call. Those calls are becoming even tougher now that we have so much data behind every decision, right? You you struggle to justify, you know, one of the things I say, seemingly have seen in some of the organizations that I've been in is that more data leads to more bureaucracy. People are less willing to take chances because that those chances aren't necessarily

Starting point is 00:27:27 backed up by the data that's giving to them. So how do you, if you're a leader and like, unfortunately, my style tends to be more wrecking ball than craftsmen, but how do you know or what is a good heuristic for when to take the leap away from the data and when to stick to it. And I know that's not an easy question, but I know it's a question a lot of people in our industry in particularly that are dealing with. I'm sure many more are as well. But it's a very common question. Okay, we see this happening.

Starting point is 00:28:01 Feels like we should go this way, really. But the data is telling us to go here. And, you know, how do we manage that? How do we manage that divergent? Yeah, I mean, I think it's a terrific question. I think it's the core of sort of where we all are right now, because what you highlighted is that the data can make us quite risk averse. Yeah.

Starting point is 00:28:20 We need the next, we need the next data. If we, if, if we need, if so much data is available, surely the answer's there. So there's a couple of things. And this is really why we wrote this book, because you can't, you can't go head on into any of this. That, you know, there's, there's a subtlety. The real nuance has been able to sort of look at it from lots of different angles. It's, you know, pick up your wrecking ball and turn it around a few times. And the first one is, is feelings that there's no question that feelings come first.

Starting point is 00:28:51 If you don't like the way that graph looks, you're going to feel it. You're going to feel it. And that feeling is going to, is going to impact how you evaluate it. Yeah, it's part of how you, it's part of the, we don't sample from our brains in a way that like a computer does. It's a probability distribution. Depending on how we feel, we're going to take a different, different. reaction to data. So the first thing is, how are your feelings actually influencing the way

Starting point is 00:29:16 you process information? Another reason, another thing, another nudge that I use all the time is ambiguous data. If the data is unclear, if the answer isn't in the data, then we have a natural tendency to use our intuition and our gut. So as a leader, you step back and you say, well, why is the answer not in the data? Is this question actually not able to be answered by the Or is the data not representative in a way that helps me, you know, helps me make a decision? Yeah. So going to that next level of, of am I, do I want to use my gut because the data's not clear or do I want to use my gut because of some other reason? There's a lot of interesting research out of, I can't remember who did it now, but that that founder-led organizations

Starting point is 00:30:05 are able to take a lot more step away from the data moments. And that's because, the founder has more scope. They're seen as more able to take risky bets. And it's because their names on it, there's an accountability thing. So being able to decouple what the data says is the right decision from what the decision that is made by the actual human. And that's okay.

Starting point is 00:30:34 You know, there's data is past events. It's relying on a stable world. it's possibly biased so are people but there's going to be bias in there data is not imaginative it has no ability to make transformational creative leaps it can only be used in the service of those things so in the end it's totally fine that a human makes that decision but i think that we have got ourselves in a little bit of a knot because of this promise of the analytics movement that the answers in the data. It may not be. Let me go back to what you. You started with around feelings. And I think that it's an

Starting point is 00:31:17 important one, especially as you described yourself as saying that, you know, my leadership style is using a reckonable. So my question is what's the, what's your emotional sweet spot for making a good decision? Because when we're highly charged, when they're highly stressed, we will lean more on intuition. That's, we've evolved to do that. That's why we run when something is really stressful, when something is scary. Those kinds of emotions when we're highly charged will lead us to user intuition more. So the question is, what is your emotional sweet spot that allows you to find the places where your intuition is actually reliable? Intuition is great, by the way. It's cheap, cognitively cheap. It's generally good enough. It is all based on data,

Starting point is 00:32:01 meaning the data of our own individual experience. But it is something that's quite useful. the question is though where's the emotional sweet spot that allows you to say, I'm going to slow down and I'm going to consider this a little bit more. I'm going to think through this. And I think the next step would be to really evaluate one of the nudges in our book is talking about experience versus data. So when you look at that data and you go, I don't think so. To stop and query, what is it? What is it about your experience that's different from what the data is telling you? And then thinking about how those two might be, well, you might want to rely on one or the other experience versus data or combine the two of them. So for instance, we recently done some work with a big retail

Starting point is 00:32:42 operation. And the data about what happens in the retail stores can differ from individual experiences working in those stores. That makes sense, right? Large data, individual experience. Sometimes one is more important than the other, but sometimes you have to put, you have to mesh them together in order to make a decision. You can't just blind. follow one or the other. You have to go into it and you learn from the extra context of, well, my experience is different from the data and here's why. Okay, now that I know why, what do I want to do with that? Why? Resolving that anomaly is, I think, a really important step. And it's actually really fun to do. If your gut feeling is telling you something really

Starting point is 00:33:24 different than the data, like you said, you explained the process of sort of digging into it more. But resolving that anomaly can be extremely satisfying. It's that one of those aha moments. Oh, you know, for example, we use a fun little case study that it's come out of Tim Hartford's work about his experience of the London Underground, where the trains are just packed all the time. But the data collected by Transport London suggests that the trains are empty. And he's like, wow, this doesn't make any sense. So he dug into the data and he explained about how the measurements taken, because you know, really understanding that exactly the moment the measurements taken

Starting point is 00:34:09 and why and who's looking at it. And his pithy sort of putting to, you know, integration of the story is, well, one, Transport for London measures the experience of the trains, whereas he measures the experience of the people. And that's such an lovely insight, right? How do you move from measuring the experience of the trains to measuring the experience of the people? So we sort of nudge, we have these nudges that have you really dig into it from the perspective of, well, where is exactly that data point is taken?

Starting point is 00:34:41 Why is it taken? Who's looking at it and what kind of processing happens before you see it as a chart or a graph or a table? And what you find is you step through that process is you realize, huh, some of this was taken for an entirely different reason. It's measuring a completely different experience. Yeah. What's up, guys? Sorry to take you away from the episode, but as you know, we do not run ads on this show.

Starting point is 00:35:09 In an exchange for that, I need your help. If you're loving this episode, if you enjoy this podcast, whether you're watching on YouTube or you're listening on your favorite podcast platform, I would love for you to subscribe, share, comment if you're on YouTube, leave a rating review if you're on Spotify or Apple iTunes, etc. This helps the show grow. It helps me bring more guests in. We have a tremendous lineup of people coming in, men and women who've done incredible things, sharing their stories around peak performance, leadership, growth, sales.

Starting point is 00:35:43 The things that are going to help you grow as a person and grow your business, but they all check out comments, ratings, reviews, They check out all this information before they come on. So as I reach out to more and more people and want to bring them in and share their stories with you, I need your help. Share the show. Subscribe if you're not subscribed. And I love for you to leave a comment about the show because I read all the comments.

Starting point is 00:36:05 Or if you're on Apple or Spotify, leave a rating review of this show. I love you for listening to this show. And I hope you enjoy it listening as much as I do, creating the show for you. All right, I'm out of here. Peace. Let's get back to the episode. I love that concept of whose experience are you measuring. I love that.

Starting point is 00:36:26 So a couple things. One, they actually just discussed the concept of around founders making more decisions off of judgment. I don't know if you guys listen to the All In podcast, which is like a big entrepreneurial podcast and whatever. But one of the hosts, Jason Calcanus said that there's, I'm going to forget the stat, so I'm not even going to try to quote it, but there's some statistic on there's a certain percentage of equity at which once the founder is below that, they compressed down into almost like, like they stop taking chances, they stop stretching, they stop breaking new boundaries, they just really start like day-to-day operationally running the company, but any like innovation

Starting point is 00:37:12 slows, all these things kind of slow because it has to do with the fact that at a certain point of equity, they know they can be fired. And like when they, as soon as the founder hits, whatever that percentage of equity is that they can potentially be fired, like the, the percentage of growth, innovation and everything just compresses way down because now they can't step out onto a ledge and come back from it. And I find that to be incredibly interesting because I have been fired multiple times and seemingly because I have not learned whatever that trigger point is that's broken in my brain. So, you know, and again, to the part you ask the question, like, you know, your leadership style is to be more of a wrecking ball. And oftentimes, I think,

Starting point is 00:37:57 um, the reason that I prefer that method personally is I like to know the actual answer. I really struggle with, um, uh, arm chair. I don't know what I call it quarterbacking because we're not playing football, but, you know, armchair decision making, you know what I mean? Where we're we kind of, if I try something and I get a result, then I know what the answer is versus if I just kind of sit back and go, well, you know, we think this is what would happen if we tried that thing, so we're not going to do it. I tend to just be like, you know, okay, let's do it. Let's go try that thing. And if it works, then, you know, sure enough, we know, we know what the answer is. And I don't know that that's for everybody or the right way because it gets you in a lot of

Starting point is 00:38:46 trouble. But what I do think you get is very real tangible data points on what actually happens and what doesn't. It's why the reason... I definitely think you want to, you know, you want to differentiate between throwing stuff at the wall and just trying things versus a good experiment, you know, testing everything is a good thing. So if you can write, I mean, the discipline is write down the hypothesis, design the experiment, go do it. That is the way to sort of not be overwhelmed by data. It's also the way to be cautious, to be sort of

Starting point is 00:39:20 realistic in what the outcomes are that you're expecting. One of the nudges that we use an awful lot and so do people that, you know, we come back and talk to people after a year or so and it's become sort of one of their favorites

Starting point is 00:39:35 is called calibrate confidence. And it's the idea that you that most people are overconfident most of the time. and that's not that's served as well as a species right you don't go and try stuff if you don't have some degree of overconfidence if you knew everything that you were up against over the last decade how many different decisions would you have made sometimes it's better not to know you know

Starting point is 00:40:03 it's good so you've got to balance this a bit but in general that it's a good idea to have a good understanding of the state of your own knowledge and that being able to calibrate your accuracy with how well you understand something is actually a pretty good thing. And so one of the, so, so being able to put a number on, on your knowledge, I'm, you know, 100% sure of that, or I'm 90% sure of that, or I'm 75% sure of that. One of the things that that enables is it enables one, you to think, huh, okay, I have to put a number on it. So you come up with one and you realize as you do that, you sort of generate this curve in your own mind as to where you sit in your state of your own knowledge.

Starting point is 00:40:52 But it also allows other people or you to someone else to flip it around and say, 80% confident? Why not 100? What's that 20%? What's up with that? And what it does is it forces an explanation and explanations are generative. You don't just blurt out something. You actually have to sort of sit and think.

Starting point is 00:41:12 and most people most of the time under-explain. So the minute they have to explain, and you can do it to yourself, it really draws out and you generate new knowledge by actually doing it. You generate a new understanding in yourself and in others. It's a very, very powerful technique. And it doesn't mean that you become a risk-averse, sort of institutionalized ops guy. it means that you are more able to recognize the state of your own knowledge.

Starting point is 00:41:49 Because, you know, none of us want to program in regrets or live a life where we're sort of denying that we regretted a decision. A bit of regrets, okay. You know, you want a few false positives, right? You want to be able to do a few things that were kind of wrong. They were just, there were the right call statistically to sort of have enough risk taking in your life. but starting out with this at least the knowledge of your own sort of state of knowledge,

Starting point is 00:42:16 I think is really powerful. And yeah, you might back off a few things that you otherwise would have plowed into, but you might not. You might actually have a better perspective on why you're doing something, even though it is risky. So I'm only 60% sure, but this is a real high stakes call. If we win this one, we've cracked this nut. So you're able to differentiate.

Starting point is 00:42:40 between sort of wild-ass, non-thought-out risks and are really calculated. We're doing this because if we win it, we've won everything. Yeah. Is it, is it, and I'm going to, I'm going to butcher this, whatever I'm trying to explain to you. I always get metaphors and analogies. I was a math major, so this words are not always my specialty. But is it fair to say that like, if you're trying to make a decision, data gives you kind of, the the the vector that the the direction that you should be looking and then your intuition got

Starting point is 00:43:20 experienced the accumulation of of what you've had as a professional gives you the ability to pinpoint in and where you actually go like like inside that that range it's going to give you a range of a direction if you have 360 degrees it's going to say here this is this data shows us this is kind of where we want to be pointed and then because I've been doing this for 10 years and I've had these seven experiences, here's the three places inside that range that we want to run test. It's more, that's the scalpel. Your intuition is the scalpel kind of, is that, or is it the opposite? Or is that just a crazy example? Yeah, well, no, it's a, it's a really good example. The neuroscientists would say it's exactly the opposite.

Starting point is 00:43:57 Antonio de Mazzio, who says, feelings come first say, says that this is how it works, feelings and intuition will point you to the appropriate space in the decision in the decision space to look and then data out actually allows you to really sort of hone in on that exactly where that what that analysis outcome is then you would add again that your your humanity your sense of accountability, your risk aversion, your, your, your, your, you enables you to actually grapple with the uncertainty and make the decision. So it's kind of like a data sandwich is what you're described. Yes. It's like that. That data sandwich. I'm, I'm, I'm reflecting back in what you're saying about the, the data about founders and their percentages of ownership and their risks and

Starting point is 00:44:51 so forth. Because I think about, you know, you express one, I, I haven't seen the study. So I can't, I can't I can't have any reflection other than just hearing what you said and then go, huh, really? Because my intuition is telling me, I don't know, I'm questioning that conclusion from that data. And it's because of my lived experience, right? Of which companies have been, I think, the most innovative at different eras in time, GE under Jack Welch and Apple, you know, after Steve came back and Disney under Bob Eiger. Those are all remarkable success stories where the leader didn't have meaningful ownership percentage. Does that mean that my experience overrules the data? No, but it does mean that if I was presented with that and I was thinking about actually using that for some purpose, I'd want to dig deeper into it and question it a little bit more to be able to understand that Delta.

Starting point is 00:45:46 And one of the nudges we do have in our book is around who are the humans and the data. So understanding what the data representation is. So who are the humans in the data? What are the company? Where is it? And then there's also the question of how are you actually drawing what story out of it? So there could be an alternate example. So we talk about list which you'd have to believe to believe the opposite.

Starting point is 00:46:07 Is it about the founder's percentage? Or could it be about the size of the company? I don't know. Is there other alternative answers and other alternative causes to the result? Yeah. I think this is really good to your point. And I can forget which one of you made it. around like what is good data, right? Because I, and again, now that you say that I didn't

Starting point is 00:46:25 put this piece of information and not on purpose, I just didn't add it, is that they were talking specifically about early stage companies. So you're going from a founder who owns 100% to when they lose that percentage, it is often because one, they just got paid. So they went from usually broke to not broke. And now they went from no one can fire me because I'm, you know, one or three people or whatever to now I can be fired and I have something to lose. capitalists like the people who you quote again like they're showing up and actually firing the CEO it's gas yeah exactly so it's like so you know you take that and it's a really interesting it's a really interesting conversation because you say at this you know you take that same

Starting point is 00:47:05 individual you know they're they're you know maybe a co-founder or the the only founder they own the majority of the of the company they're growing it they can't be fired they can also go broke tomorrow but they're you know and they're growing they bring in a big investor they take a smaller cut now they're you know they have some money they have something to lose they have a board that can kick them out right now all of a sudden they start to play it a little safer because you don't want to make that decision against the grain of the data where the board of directors and your vCs can come in and go the data told you to do this you did this it didn't work you're out right where the flip side of everyone that you just named while 100% true the incredibly innovative

Starting point is 00:47:46 were also late stage enormous companies that also those guys had big huge contracts and there's a loss cost fallacy. I would believe in the people who gave them those contracts. And then if I'm playing Bob Iger, $10 million a year plus a $50 million bonus to run, you know, Disney or whatever, that I'm going to kind of give him some leeway in making some decisions and that we're paying this person. And again, I'm just fitballing off the time of head. But like it is, it's incredibly interesting how that one data point of these were early stage companies versus all companies completely changes the reference of what that story can mean. So that actually worked out. I didn't mean it to. That actually worked out pretty well. I think it worked out quite well.

Starting point is 00:48:28 The serendipity of a good conversation. So, all right. So I wanted to go back to, because this is a concept I think is tremendous. And I just want to flush it out. out a little more. That concept with the train, the subway system, we were talking about whose experience are we measuring, right? That to me feels like that that feels incredibly powerful to me because it feels like just as we just had a slight miscommunication drastically changed our experience with a comment. Now, again, he just threw this comment out on a podcast. Who knows how real the study is, right? It seemingly felt real, good conversation for what we're talking about. But my point is, how do we know we're measuring the right experience for our business? How do we, how do we know that?

Starting point is 00:49:19 What's that filter system or heuristic, I guess? Tick, I'm thinking. It's a good question. So I mean, I think the, how do you know whether you're measuring the right experience? I think I'm pausing because there's so many different sort of contextual answers to the question. Yeah. If you think about it in the insurance industry, obviously you've got the perspective of the insurer and the insured, potentially also the re-insurer, right, because you've got lots of different layers in the industry. And thinking about, let's say, you're trying to, you know, assess whether a new insurance product is successful. I'm following your lead and just kind of spitballing here.

Starting point is 00:50:07 Yeah, yeah, yeah, go ahead. You know, I mean, understanding, the first question is, I would say whether you're measuring the right question, the right data and the right perspective is to be a little bit more in depth in terms of what the question is. So define success more deeply. Think about what you mean by that. So there's sort of this question of making sure you're starting with that. I think there's also when you actually get to the conclusion and you say, yes, this has been a very successful product, going through the classic five wise to make sure you're really digging through to the right answer. you know, have you actually gotten to an answer that you actually think is truly there?

Starting point is 00:50:46 Because success could be high revenue, you know, for the company. Success could be low risk for the reinsurer. Success could be customer satisfaction for the, you know, for the insured. There's a lot of different layers of what success might mean. And that's usually where I think people get caught is that they're not sure exactly what they're asking of data and so therefore they're not sure which experience to rely on. Well, data is generally, it's harder to collect the thing you really want to know about than it is to collect the easy thing.

Starting point is 00:51:27 So I think the first answer is it depends on what your goal is, right? So that's the kind of overarching meta answer. But if you go down a layer from that, there's a couple of things that can happen. One is that pretty quickly you're in a complex situation like insurance and customer service, you probably pretty quickly find there's some sort of paradox. There's some sort of dilemma. You can't have the perfect customer service at the same time as keeping costs down. Or you can't have the, I mean, in insurance, there's always this background of,

Starting point is 00:52:08 We want to have great customer service and settle claims and make everyone happy. But at the same time, everybody knows that they're on the call with some sort of rationing process, some sort of gotcha kind of process. So I think that being able to very quickly get down to the point that you know why measuring something is hard. Why is this a hard problem to solve? what's the dilemma that we're constantly going back and forth on? What are the poles of the dilemma? So I think that's an important one.

Starting point is 00:52:43 And another one is a, which is more sort of on the complexity side of our house. But in the decision one, there's a really important concept that, again, came from Danny Kahneman, which is that we tend to substitute an easy answer for the right answer. So the simplest example is the right question is how happy am I with my life. The easy question is, how do I feel right now? And that happens all the time when it comes to data, all the time when it comes to measurement. So using this nudge of right versus easy, what is the right measure? Like write that down.

Starting point is 00:53:28 what do we really want to know? And then what's the easy measure? And actually putting them in front of you. And because in this world of data gathering by machine, of unconscious staff or of, you know, using a product like Cogito to capture, you know, emotional responses and what have you, and put nudges into, say, a call center,

Starting point is 00:53:54 into with agents in a call center. There are so many things that are easy to make. measure, not necessarily right measures. So, but doesn't mean you don't do them. It just means that you really need to be much more consciously aware of, on one level, what are the proxies? But then on the other, just what, what's the right answer? What's the right thing we're trying to get versus what's the easy thing? Yeah. There's two really incredibly relevant problems that you guys addressed in there. One is, so technically, insurance agents, work for carriers. So all the marketing that you'll see out of insurance agents is that we work for you.

Starting point is 00:54:34 That is technically not accurate. Now, there is a term for that. It's called a broker. But in the United States, 90 plus percent of the property casualty insurance agents are not brokers, they're agents, which means that technically they work for the carrier. While in order to get paid by the carrier, you have to convince your client to come buy a product from that carrier. So when you think about that and that you have two very large stakeholders who are, you know, in some cases, at odds with each other, who's, do you care if the, do you want the carrier to be happy? Because if the carrier is happy, you get faster response time, oftentimes higher and more inclusive compensation.

Starting point is 00:55:18 You get access to additional products. You get access to special programs, special pricing, right? If the carrier is happy. but if the carrier's happy, that doesn't necessarily mean that the clients are as happy, even if they purchased for you. It doesn't mean they're as happy as they could be. And if you measure straight client happiness and you're only about the client and all that matters is the client relationship, well, oftentimes, and this is very, very common, your relationship with the carriers starts to actually become at odds.

Starting point is 00:55:45 And now who you've actually signed a contract with and technically are responsible to and is, is at you're at odds with to the client, which sounds good and feels good. And everyone likes to thump their chest and say, my clients love me. But if your carriers hate you, then your business is making less money. You oftentimes can't offer as good a product set. You may not get first pass into different beta programs or specialty programs or specialty lines programs that can ultimately provide either greater access or just better products to your customers.

Starting point is 00:56:17 And it is a very, and that's not even to mention, do you care what your, what your, with your employees, how they feel, how they're doing, their metrics, like, you know, or the vendors that you work with or, you know, any referral partners that come in. So, like, you have, and we're not alone in this. The, the, the, uh, principal agent, uh, problem in the insurance industry is fairly unique, not, not wholly unique, but fairly unique. But, but it is this like, I'm, I'm thinking through just the millions of conversations are probably thousands, is technically accurate of conversations that I've had around

Starting point is 00:56:49 this particular problem. where do you focus your attention and which relationship is more important to value? And I think that goes all the way down to the baser of where you said to begin your answer, which was how do you define success? Like, is success maximizing revenue in every way, shape, or form? Then probably you need your carriers to be happy and focus on the things that make them happy. Do you care more about the relationship you have with your clients, the longevity of those relationships, the ancillary benefits that comes out of having deep, rich, well, well built, a solid foundation with your clients,

Starting point is 00:57:24 which can also be profitable as well, but probably not maximizing profit. And I think that's going to be different for every agency or every individual business and who those leaders are and who the people are inside them. And that's, that is, there's no, I get, particularly in our industry, again, and I'm sure this is the case with others,

Starting point is 00:57:46 is just I've spent almost two decades in my life in this one is as soon as someone starts telling me like this is the way you should do it. I am like every bell in my in my being starts to go off and say like, I've been part of too many different conversations that to be true. So it does seem like this is work that very much needs to be done on an individual basis. And this is maybe where my question is my next question is coming from being that I want to be cognizant of your time. respectful to our audience this time. It does very, it seems very much like we should be doing

Starting point is 00:58:23 this work on an individual basis versus, and not that we can't look at best practice studies and stuff like that. They're probably good, good benchmarks, but versus relying solely on the benchmarks or the frameworks passed down by a consultant. We need to be maybe working with a consultant to figure out what this is individually. This is individual work that we need to do because it oftentimes is going to be very unique to us. Is that a fair? Is that a fair assessment? I think that's fair.

Starting point is 00:58:50 And I'd actually make it even more individual in the sense that, well, basically everything's moving to sort of more personalize. But I'd take it, I'd hazard a guess that, you know, when you started out 20 years ago, these relationships were sort of much more one-to-one and not a lot of, not a lot of machines involved. Now, what if 50% of the value of that relationship is now done by machine and that inside of that there's an artificial intelligence that's making predictions that

Starting point is 00:59:19 sometimes decisions are coupled still with that prediction because there are policies that are put in, their rules that are set across at scale across the whole, across the whole client base or whatever. But if there's agency in that, if there's if there's variability, if there's agency in the way that you're making your judgments and your decisions, this is a much more complex system. suddenly we're down into self-organizing, we're down into emergent properties, we're down into adaptation, things that you make decisions on within your own discretion and judgment, that are fundamentally different than you would have made 20 years ago.

Starting point is 00:59:54 You've got totally different access to information. Rules are different. There's either more rules or less rules, more decisions, less decisions. They're sort of on a spectrum. So I think that that's actually the real reason that this is so individual and so unique is and why we went to nudges, because in the end, this is about personal practice. This is about getting to know what it is that you value

Starting point is 01:00:18 and being able to understand how you specifically understand context, how your imagination works, how your creativity works. You're clearly a bit of a status quo bust to yourself. So that's worked really well for you, right? That wrecking balls worked well. worked really well for me until I turned 40 and then it just didn't work. And I don't know what it was about that. Some sort of transition.

Starting point is 01:00:47 It's a little bit of, you know, you can be a kind of young upstart. And a lot of us who are contrarians in our younger years, that doesn't work as you get older. People expect the gray hairs. They expect that wisdom. They're not really as forgiving of those behaviors. And plus there's a lot of survivor bias, you know, you're here. It's worked. You don't, you're not looking at the people who haven't survived when they were wrecking balls. I can, I, I won't, but I can tell you some names of people who just didn't survive that process. Yeah. And then no longer

Starting point is 01:01:27 that those kind of decision makers. So I think it really is, this world of personalization exists It's because we can do it. I think that it's quite wise to think about this as an individual decision bubbling up to your organization's decision, whatever size your organization is. And you think about other sort of industries that have gone through perhaps somewhat similar major transitions, just looking at the financial services business and thinking about portfolio management. 20 years ago, it was all about stockbrokers, making individual stock calls for their clients,

Starting point is 01:02:02 you'd be wanting to work with one of the big banks because they had the flow. They had the trading desk right there. Their optimization was around what's the, you know, how much am I getting in terms of my, you know, trading commissions versus how much money am I making for my clients? It was that kind of a, you know, sort of tension. You could go to smaller places, but they wouldn't have the same access to the market timing that you could get at the big banks. Now, fast forward 20 years, and it's a totally different world.

Starting point is 01:02:29 A lot of the portfolios that you're picking are optimized around ETS that are all, you know, set up in terms of in large-scale research situations. If you go to the little brokers, they can pick anything you want in the market. Actually, when you go to the big banks now, they're all regulated out of a single, you know, central research organizations of what they're allowed to give to their clients because the regulations have changed. Still, same sorts of tensions. Am I making money for the bank? I'm making money from my client? But the whole profile of who you are and what you do and what you can offer has changed. And I have friends who've lived through that entire timeline, you know, being sort of the high

Starting point is 01:03:06 net worth folks at big banks. And their jobs are completely different from what they were 20, 25 years ago. But now do they stay there? Well, that's their own individual personal decision. And that's fine. And I would echo, I think, what Helen said is our premise in our book and our premise around decision making is that there isn't one optimizable answer. There isn't one heuristic to follow.

Starting point is 01:03:26 There isn't one process to follow. There isn't a six-step process to make a good decision. We believe this is truly a practice, which is why we have 50 nudges that help you get better. That's what we call it make better decisions. It's more like meditation, you know, in terms of practice and thinking about what works for you as an individual inside the sphere of people that you're making decisions with than it is about some sort of step-by-step process that you can put on boxes and have a framework and do. That can be really unsatisfying for people when we say it.

Starting point is 01:04:01 We truly believe it. We're not having some sort of like easy get out of jail free card by saying there isn't a six-step process and we haven't invented it. We actually just truly believe decision-making is way too complex to be able to have a set process. You have to think about what, how am I, what nudge do I want to use right now in this situation with this topic with this group of people to make my decisions just a little bit better than they would have been otherwise. Yeah, I love that. I love it.

Starting point is 01:04:31 Guys, I have thoroughly enjoyed this conversation. The book is make better decisions, how to improve your decision making in the digital age on Amazon. I'm assuming the rest of the places.com.com. Yep, local bookshops wherever you need it. Where, if people want to connect with you guys in the digital space, where, you know, what's your spot? Website, LinkedIn, where do you want people to go to connect with you? Yeah, our website is get saundra.com. And you can reach us there. Hello at get saundra.com is an easy email address.

Starting point is 01:05:04 You can find us both on LinkedIn. We also have a, we have a podcast ourselves called the artificiality, which is a combination podcast newsletter that we host on Substack. So you can find us there. That's great. And I'm on TikTok. Yes, we do, we do, we do have participate in. some of the other social medias. How do you like the TikTok and Instagram and Facebook?

Starting point is 01:05:26 TikTok, I set a time limit. Like, it's just, any more than five minutes, I'm wasting too much time, but it's just too damn addictive. I think that the interesting thing about that, but TikTok and Instagram for us is that, you know, we wrote this book coming out of working in a corporate setting and working at workshops, but it's so quickly becomes really applicable for people in the personal lives. So we got a wonderful comment on a TikTok. talk video where someone said, you just explain why my, my marriage has been in the shitter for the last five years. Thank you. Like, and so that was quite an eye-opening moment. Um, especially, and it was quite encouraging, especially since we're obviously a married couple. We work together. We've done this for a long

Starting point is 01:06:09 time. It's kind of nice to feel like maybe actually this could be, you know, this people find applicability in their personal lives too. That's good. That's tremendous. I mean, I think, I mean, all the concepts we're talking about while applied obviously to business, you know, I'm sure there's a derivative that applies very much to how you. And I really like the fact that you position it as a practice. I think that, you know, in my own life, I very much try to approach things as a practice versus when I was younger, I think I oftentimes was shooting for the goal, right? I just was, it was, you know, did I get to this thing or did I not get to this thing? And today, I think hopefully maybe it's turning 40, which I did recently.

Starting point is 01:06:48 You know, I seemingly viewing all changes in our lives as practices, unless it's something very acute, tends to be a more sustainable and predictable and proactive way of getting stuff done. So I love it. This has been absolutely wonderful conversation. I wish you guys nothing but success on the book and everything that you're doing. I obviously highly recommend this and hope everyone will. check it out who's listening.

Starting point is 01:07:15 Guys, I appreciate your time and I hope you have a wonderful day. It's been fun. Thanks so much. Close twice as many deals by this time next week. Sound impossible, it's not. With the one call closed system, you'll stop chasing leads and start closing deals in one call. This is the exact method we use to close 1,200 clients under three years during the pandemic.

Starting point is 01:07:51 No fluff, no endless follow-ups, just results fast. Based in behavioral psychology and battle tested, the one-call closed system eliminates excuses and gets the prospect saying yes, more than you ever thought possible. If you're ready to stop losing opportunities and start winning, visit masteroftheclose.com. That's masteroftheclose.com. Do it today.

Finding Peak w/ Ryan Hanley - AI, Data & When to Ask the Right Questions

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.