Open Book with Anthony Scaramucci - Can You Invest & Do Nothing? With Andrew Parrillo

Episode Date: November 26, 2024

This week, Anthony talks with institutional investor, author, and speaker Andrew Parrillo, about his new book Beat the Wealth Management Hustle. Andrew discusses his career in wealth management and the flaws in the industry. He emphasizes the importance of investing independently and understanding the fees charged by advisors, whilst suggesting that advisors focus on behavioral finance and help clients determine their risk tolerance. The conversation then touches on the value of doing nothing in investing. Learn more about your ad choices. Visit podcastchoices.com/adchoices

Okay, when I sell my business, I want the best tax and investment advice. I want to help my kids, and I want to give back to the community. Ooh, then it's the vacation of a lifetime. I wonder if my head of office has a forever setting. An IG Private Wealth advisor creates the clarity you need with plans that harmonize your business, your family, and your dreams. Get financial advice that puts you at the center. Find your advisor at IG Private Wealth.com.

When a country's productivity cycle is broken, people feel it in their paychecks, their communities, their futures. What does this mean for individuals, communities, and businesses across the country? Join business leaders, policymakers, and influencers for CGs' national series on the Canadian Standard of Living, productivity and innovation. Learn what's driving Canada's productivity decline and discover actionable solutions to reverse it. This episode is brought to you by Tell Us Online Security. Tax season is the worst. You mean hack season?

Sorry, what? Yeah, cybercriminals love tax forms. But I've got Tellus Online Security. It helps protect against identity theft and financial fraud, so I can stress less during tax season, or any season. Plan started just $12 a month. Learn more at tellus.com slash online security. No one can prevent all cybercrime or identity theft.

Conditions apply. Hello, I'm Anthony Scaramucci, and this is Open Book, where I talk with some of the brightest minds out there about everything surrounding the written word from authors and historians to figures and entertainment, neuroscientists, political activists, and of course, Wall Street. Sorry, I can't resist. Before we get into today's episode, if you haven't already, please hit follow or subscribe, wherever you get your podcast, and leave us a review. We all love a review, even the bad ones. I want to hear the parts you're enjoying or how we can do better. You know, I can roll with the punches, so let me know.

Anyways, let's get to it. How do we beat the wealth management hustle? My guest today, Andrew Perillo, was here to tell us. From investing independently to the value of doing absolutely nothing, Andrew has some great advice for us, so let's listen. Okay, so joining us now on Open Book is Andrew Perillo. He's a dear friend, institutional investor. He's an author and speaker, and he's out with a new book, Beat the Wealth Management Hustle,

invest independently to grow savings faster with peace of mind. So, wow, that's a mouthfall because you and I have been in wealth management. I think you and I are like Donald Trump and Joe Biden of wealth management. We're two ancient fossils in the industry. And there's a lot of things that are great about the industry, a lot of things not so great about the industry. You've written beautifully about all of this stuff. But let's start, Andrew, with your career. Tell us about your background, how he got started, why you've been doing this for so long.

Okay, great. Thanks, first of all, thanks for having me on. This is really an honor to be with such an August host here. I appreciate it. August, yeah, emphasis on the word August. An icon of inspiration, especially with your partner, Katie, or Caddy, I should say. But anyway, okay, how did I get started? Well, look, I went to Boston University.

I'm from Rhode Island. Went to Boston University. It was in my military obligation, Air Force Navigator. Got out, went to a bank training program. They put me in the investment department back in the early 70s because, yeah, I'm really ancient. You're just a child. Yeah, and then I just kind of, it was, yeah, in those days, investing was not a really popular career. So, you know, I didn't know any better.

I didn't know anything about stocks or bonds. I learned. And I guess I learned well enough because then I was attracted to eventually at the age of 31, manage the largest department or pension investment department of the largest bank in Rhode Island, which ultimately became part of the bank of market. And then the early 80s, I went to an independent firm in Boston. And I had trouble with the ethics of that business. I then switched to having managed money and having met with investors and fiduciaries,

There's always fiduciaries and rarely individuals, although I did have some of the larger individual clients of the bank as clients. But, you know, it was an interesting time. I mean, in the early 70s, you know, interest rates went crazy. Interest rates by 81 were 15, almost 16 percent on 20-year treasuries. And they went down to 55 basis points in August of 20. So we had the biggest bull market in history. Actually, not as big as the bull market.

and bonds in Japan before that. But anyway, so, you know, market history is fun for me. It's a big part of my life. I enjoy the competition. Anyway, in 95, I found myself in a position where, you know, I really thought I could do a better job for clients on my own. So I started my own firm. And the name of the firm was Newport Capital Advisors. And I had endowment clients. They were referrals. They were referrals. I was charmed in my life. I never had to go out soliciting business. People came to me. They knew who I was. They liked me. And so they trusted. me and they hired me. And why did they do that? Well, I can only attribute it to, and I talk about this in the book, I thought independently. I was different from the crowd. I didn't, I wasn't

on the well-worn institutional path of hiring the big famous, you know, firms. I was like, no, let me let me find the people who are poor, driven, and hungry, kind of a Mario Gavelli thing. And although I never actually engaged Mario's firm, but anyway. another story. But we probably know a lot of the same people. We've had the same experiences. But, you know, the bottom line of this all is, so by the end of 2019, after 25 years of wanting my own firm, and we had endowment clients and family offices as clients. And I had a small hedge fund of funds, a multi-strategy fund, which was interesting and a learning experience. And by the end of 19, I was getting a little tired of it.

And so I closed the firm, and I tried retirement for a couple of years. And I got super bored. And in late 22, I was at a party, a holiday party. And I didn't know anybody there. It was a friend of mine's house in New Hampshire, actually. And I introduced myself. And I said, well, I have three sons, three grandchildren. I retired from the investment business.

And in December 22, you may recall, I'm sure you do, that the market was down roughly 20% that year. And bonds were also down, depending on your duration, 15%. or more, people were a little bit concerned. What should I do with my portfolio? So, thank you for asking. I said, but I, you know, I'm not an advisor anymore and do you have an advisor? Yeah, well, you probably should ask your advisor. I don't, I don't talk about investments casually in a social setting with people. But, you know, yeah, talk to your advisor. And then, well, what's the Fed going to do next week? Well, the Fed is probably going to do what it's been telling us since March of 22 that they're going to do, and that is raise interest rates until inflation begins to subside, which, you know, but will it be enough of the change to change your portfolio strategy? I don't think so, but you should ask your advisor. All right. So that led me to an epiphany.

It's like, wait a minute. Why are strangers asking somebody about what to do with their money? Don't they have advisors? Don't they talk to their advisors? And I started asking friends, you know, who had advisors? Yeah, we have a, do you know how much you pay your advisor? Nope. And this is like a dozen people.

They didn't know what they were paying their advisor. Okay. So that was my epiphany. That was my, that's what really caused me to start to write the book. And what basically happens in the world in wealth, so-called wealth management, which is a term that I think is specious and pretentious, frankly, but it's investment management. But anyway, let's face it, people, according to Daniel Kahneman, the late Daniel

common now, people and he won a Nobel Prize in economics as a psychologist in 2002 and wrote a book Thinking Fast, Thinking Slow, which I commend to everybody. And as to people are two and a half times more likely to avoid risk than to embrace the opportunity for gain. And Wall Street, I shouldn't say Wall Street, the wealth so well, a wealth manager industry has done an expert job of exploiting that phenomenon and that tendency for people. to avoid risk. And people go to wealth managers for comfort. They rarely ask them, you know, how much they charge. I think that they have no idea of what compound interest is, you know. And here are the numbers, Anthony. And there are no charts and graphs in my book. There are some

numbers. The numbers are pretty, and my book is a simple book. It's a simple idea, okay, there's nothing complicated about it. But we know that in the last 25 years, the world, has changed so that accessibility of information, competition has increased. Prices in many cases have gone down a lot, especially driven by technology. That's been true in the investment business, where now you can invest for little or no cost, really, and you could have a prudent portfolio with using the services of the major custodial brokerage firms and banks for a little or no cost. And so why are you paying somebody to do that? Because they don't think they don't think they're paying very much.

Well, they know how much they pay their lawyer to put together a will and a trust and other agreements they need for their business or their family planning. They know how much they pay their CPA. But they don't have a clue about how much they're paying their advisors. And that's just a fact. And it's a multi-trillion dollar industry that's charging hundreds of billions of dollars a year in fees. And most people have no idea whether they're getting value. from the fees that they pay. And that's as simple as I can put it.

And so my book is about disclosure, transparency. It has some questions. It advocates to people that they look at their investment process, the way institutions look at investing their own money. And that is to conduct due diligence. That's not rocket science. It's common sense questions. And, you know, I'm not that smart.

I just have been around for a while and I've seen stuff. And, you know, you can't time them work. Let's go over some mistakes. Let's go over some mistakes. So that's one of them. You can't time the market. Number two, if you overly listen to people on the pundits, you may move your portfolio, pursuant to Federal Reserve Interest rates move.

That's also probably not a good idea. Fees matter, right? Lower fees, higher returns over long periods of time. Tell us some other mistakes that people make. Let's say you did run into somebody at one of these cocktail parties and you said, okay, here are five or six things you should do with your money, which will be better for you and your family. Tell us what those are. Well, five or six things is to first of all understand what is important to you about money. That's the first thing. It's really like it a value-based, you know,

query. You know, what's important to you about money? You know, one of the things I talk about in the book, firstly, is what is wealth? Well, to me, wealth is health. And, um, So does money convey some sense of security? Of course it does. But just seeking money for money is not the answer. So you have to understand what's important to you about money. Do you, can you, and then what are your prospects for generating money? What kind of time preferences have you selected? Do you want to save more or spend more? Do you understand? Have you thought through that? So you have to think through that. Time purpose for money is super important. And the reality is, and you know this very well, that if you start early, you don't have to put a lot of money aside to have a whole bunch of money in 30 or 40 or 50 years. And you don't have to be a hedge fund manager to make a lot of money. You can do it just by investing in the market.

When you were a kid, Andrew, did you ever read The Richest Man in Babylon? I have not, unfortunately. I'm not as well read as you, Anthony. Your book is a lot like that. That's the reason why I was asking me, because your book is, it's a very, very straightforward thing. I've ordered a bunch of them, and I'm trying to get them into as many hands as possible because I just think it's a beautiful guidepost. But also, I'm going to bring you on the Wealtheon Network, which is another show that I do called SpeakUp, where registered investment advisors actually tune into this show. And so if you were a registered investment advisor and they read your book and a lot of people are cynical about wealth management and a lot of the stuff you say in the book is true. But put me in the seat of the registered investment advisor. How do I make myself valuable to somebody after reading your book? Visit BetMDMDM Casino and check out the newest exclusive.

The Price is Right Fortune Pick. BetMDM and Game Sense remind you to play responsibly. 19 plus to wager. Ontario only. Please play responsibly. If you have questions or concerns about your gambling or someone close to you, please contact connects Ontario at 1-866-531-2,600 to speak to an advisor. Free of charge.

BetMGM operates pursuant to an operating agreement with Eye Gaming Ontario. Yeah, okay. Here's my approach. My approach, and this is what we use, sort of I used at my firm. First of all, behavioral finance is really a big deal, okay, because you, because huge, Human behavior changes over time, but the pattern is roughly similar. So the reaction to market events, which are, you know, sometimes, you know, surprising and chaotic, tend to follow a path, tend to follow.

I mean, the reality is that let's just talk about the standard of corporate performance for 100 years has been the standard of course 500, okay, and it's gone up roughly 10% a year. Three years during the Depression, the Great Depression, it was down 85%. It was down 50% for the two and a half years of dot com decline. It was down a year and a half, but it was down 50% for a year and a half during the great financial crisis. It was down, goodness, it was down 35% and 30 days in the COVID crisis. Okay. But it's always come back.

Why has it come back? It's because corporate managements are incentive to provide a return to their shareholders. And if they do not, they're out of business and people will go on to the next company. And I don't expect that to change. Yes, inflation rates have changed. The value of the dollar has been destroyed, particularly since we suspended the convertibility of gold in 1971. And I'm not a gold bug.

I've never thought that gold was a good investment. However, I do think Bitcoin is a different proposition. It is a good investment. But that's a different level of thing. What would I tell advisors? I would tell advisors, focus on allowing the client to determine his or her own tolerance for preference for risk and return. And I use something that's based on prospect theory, which is an objective way to determine

somebody's tolerance for risk and return. So it asks a series of iterative questions. And the questions are, okay, how do you feel about possibly making, and this again is using what we know as mean variance analysis, but it's essentially using history as a guide to what may happen in the future in the market, which has been pretty reliable. So looking over a six month interval, would you be comfortable making 20 or losing 12? Well, I don't want to lose 12%, but how about making 15 and losing maybe 8? Well, that sounds a little better.

And so you could actually quantify those preferences with a risk score. And for what it's worth, the standard in Purs 500 has a risk score about 75 on a scale of zero to 99. And so, and most people have a lot more risk in their lives and in their portfolios than they even know. So one of the things you could do as an advisor is say, let's take a look at your portfolio and see how it scores and see if it comports with your own preference for risk and return by using that score that we've just determined iteratively and objectively. So it's not like, well, you know, you're a 50, you're a 60-year-old man, Anthony. So you must be relatively conservative in your investing. The reality is that, no, surveys have shown that people who are under 30, half people under 30 are just as conservative as people, half the people over 70. And that's just a fact.

So it's a very subjective saying, well, I'm growth oriented, I'm risk oriented, I'm conservative, I'm capital preservation oriented. That doesn't mean anything. Those are subjective terms. And I think that they should be, they should be quantified objectively. and therefore you could review them and you could calibrate a portfolio to that risk score. And that's what I would suggest that advisors do. The only thing I would suggest that advisors do is be very transparent on how much they have charged their clients over what interval from beginning to end. One of the things that happens in our business is every minute you get a, or every throughout the day, you'll get a notice on your mobile device that you have a charge against your card or your bank account or something, right?

You get those notices. Do you get a notice every quarter when your advisor charges you their management fee? No. The fee comes out of the custody account. People don't even see it. They don't read the custody accounts anyway until and unless the market goes down a lot and they get freaked out. And where do the advisors make their money? They make their money by setting the appropriate strategy and risk profile for each client

and then revisiting that on a systematic basis probably at least a couple of times a year. but at least annually. And so that's what I would tell advisors to do. And I would also encourage advisors to charge their fees on a fair basis. Now, you and I both know that the margins in the investment management business are really high. What a great business. You get a client that has recurring fees. They're going to grow in line with the market, which, again, is roughly 10% a year.

Call it 8%. You know, call it 7%. Still doubles in 10 years. And so you have the stream of revenue that's growing at 7% a year. You know, it's a value because it has a residual value because you could put a number on that and sell it to somebody to a larger firm that wants to buy your book of business, so-called. And it's a great business. And oh, by the way, it takes almost zero capital to be in the business. It's probably one of the most attractive businesses I can think of that's legal.

And the only reason it's legal is because the SEC is so permissive. and people don't even know that fees by the SEC's mandate are negotiable. That doesn't mean the manager is going to lower the fees, but all management fees are negotiable. And people don't even know that. So it's trying to just enlighten people to look. I said before I have some numbers, and I know we don't have a lot of time left. But, okay, so let's say you have a half million dollars and you have an advisor who makes 7% a year for 20 years. And they charge you 1% a year, which is generally the management.

management fee that people charge. It might be a little less. It might even be more. It frequently is. All right. So how much does that amount to it? Well, that fee, that 1% over 20 years, amongst the $331,000. So if you want to put your half million out there to an advisor at 1% and you don't mind paying them $331,000 over 20 years, great. That's your choice. But you should go into that with your eyes open. Could you do that yourself for almost no fee, for a few basis points, for a few horn hundreds of 1%. The answer is yes. So all I'm saying is what Warren Buffett and the late Jack Bogle have said for years, and that is just invest in the S&P 500 and forget about it. You know, and just be, you cannot deal with the noise of Wall Street on a day-to-day or week-to-week

basis because it will drive you bananas. You want to. You want to be... You want to be... You want to be... You don't know what to do. And you know, you'll hear these talking heads. And that's another thing I talk about in the book, but there's not time to go into it here, but the people who get interviewed on the daily financial shows are talking about what's going to happen next week in the market. I don't know, you know, you know, and I know there are a few people who can actually time the market. But it's probably not me, Andrew, I can tell you that. Not you, not you, but I'm saying there are some people who are good at that. But you could count them on maybe two hands, And they're not accessible.

They're closed to, you know, they're brilliant investors. Absolutely. They're savants, really, is what they are. I'm going to say something to you, and I want you to react to it. I feel I get paid as an investment advisor or as a manager to do nothing. And you say, well, what are you talking about? What do you mean to do nothing? Well, I have set up a portfolio.

And if I can condition my clients to listen to me and take the long-term approach with the portfolio that I have set up. I haven't met Warren Buffett many times, but he said something to me about 20 years ago that has rung true in my life and has rung true in investing for me. Sometimes the best thing to do is absolutely nothing. And we have all of these impulses on our personalities where, well, I'm getting paid this big fee. And so let me go out and do something for my clients as a result of this fee. And so what's your reaction to that? Because I really think that's, when I talk to my clients are like, you know where you've added value, Anthony? You've kept me on the ledge. You kept me from jumping off the ledge, going to cash at the worst possible times, etc.

And that is precisely the right way to look at it. And that's exactly the right. And look, I've been through a lot of crashes. I've been around this industry for 50 years. I know what's. And I've been through it with real people. And I've seen how difficult it is. It's terrifying when you lose 50% of the value of your money. money or more. But in every case, it's come back. And of course, the advice has been, yes, stay with the program, do not sell at the bottom, do not try to reduce risk. Because what you're really doing, if you sell out after you lose, you're not reducing risk. You're actually increasing the risk that you will not succeed. And so, you know, that advice about doing nothing is exactly the right advice. My point is, why are you paying somebody an annual asset-based fee? And you're

paying them every day of the year, that fee, by the way, to tell you, every time the market It goes down, you know, 10 or 15 or 20 percent or more to just stay the course, stay put. Maybe we'll rebalance a little bit. But, you know, does your advisor make changes on a daily basis to your portfolio? No. And if they do, they're probably not very tax efficient or, for that matter, investment efficient. It's just not necessary to do that. Warren Buffett's favorite holding period is forever, and that's good advice.

Now, if you hold down to something that's fundamentally deteriorating, that's kind of dumb. You can't do that. but if you've spread your risk among, you know, say an index of stocks like the broad index that Vanguard has or the S&P 500, you know, yeah, you're going to get the decisions. And oh, by the way, many investment managers, and you know this as well as I do, have gotten rich underperforming the S&P 500. And they literally have gotten, why is that? Are they making money for themselves or are they making money of their clients?

So I'm with you. It's why I wanted to bring you on. So we're at the point in the podcast where, um, My staff and I, we put together five words that are tied to your book. And so I'm going to say the word and then you're going to say to me what you think of. It could be a sentence. It could be a word. It could be a few thoughts.

Okay. You ready? When I see the word money, Andrew, you think of what? I think of confusion. Okay. It's interesting. It's a good point. I've got the word success.

Achievement. How about when I say hustle? Let's see. Resolute energy. Wealth. Health. Well, isn't that the truth? When we're kids, we don't think of it that way, right? But what do we think about that as we get older, that it's really just the health is the wealth.

Last word, investing. Joy. Well, it has been, it's been for me, too. I mean, this has been the best business I could have gone into is this business. It's just the business of understanding. understanding other businesses. If you like business, what could be better than that? The title of the book is beat the wealth management hustle, invest independently to grow savings faster with peace of mind. I was very proud to write the forward of this book. It's written by Andrew Perillo. Thank you so much for

joining us today on Open Book. Thanks, Anthony. Take care. All right. So Andrew is a genius F.A. He's old school. And obviously he said a few things that I love. You can't time the market. But the most important thing, and I guess as you get older in life and you get older in the world of investing, this is why Buffett is so good, his patience is everything. I think some of my best investments, frankly, my best investment decision making has been, frankly, not doing anything. And sometimes we don't understand that when we're young, but Mr. Perillo obviously understands it a great deal. And his book is a great guidance tool. It's almost like if you need a life coach for investing, read Andrew's book.

You want to come on the podcast? You feel up to it now? You're back into saddle. All right. Lower to TV, Ma. You got too much background music. Ma. Come on.

Lower the TV. I got it. All right. So Ma, okay. My next guest is a fellow Italian American. His name is Andrew Perillo. And he's a wealth manager. And he was a, you know, he started out as a stock broker, but now he's sort of an asset allocator.

Okay. which I've been for the last 30 years, Ma. But for some reason, you wanted to be a lawyer, right? Well, in my generation, a lawyer in society. Today, it's more common. What you are is because you like doing what you're doing. But not only that, you share your wealth. I mean, you definitely have made me survive.

I mean, let's say it's the way it is. But let me ask you this question, though, Ma. Did you tell your friends that Goldman Sachs was a law firm? Yes or no? Not really, but I didn't tell them that you were. You did. You're revising history. Oh, did you tell him I was a lawyer at Goldman Sachs?

Go ahead. You know you did because I ran into somebody at Rosano's Deli. And you see, you know you did. And you said, oh, my son's a lawyer. And they said, how's the law firm Goldman and Sachs? I'm like, oh, my God. First of all, wasn't even called that. You were trying to deny that?

You did that to me? Well, it was many years ago. And I'm going to be 88. So you get away with it. It's okay. No, no, no. You can get away with it. It's all good.

I thought it was funny. But you made me take the bar exam. Do you remember that? Absolutely. Yeah. I mean, you can't go to Harvard law and have a law degree. So I did that for you, you're going to use it or not use it. You drove me.

I never used it once. I drove me crazy. I went and passed the exam so you could come to the swearing-in ceremony. But if I was a lawyer, I would have stabbed out one of my eyeballs with a butter knife. You know, come on, Ma. Don't you think you should do what you love? I think you should do what you love to do, yes, because that's why you're successful at it. You love it.

You love the challenge and your beautiful homes and take care of your family. Nothing like a mom. All right, ma, all right. Nothing like a mom to bring around the podcast. Okay, all right. All right. Love you, baby. All right.

you hear tell your friends and make sure you hit follow or subscribe wherever you listen to your podcast while you're there please leave us a rating or review if you want to connect with me or chat more about the discussions it's at scaramucci on twitter or instagram i'd love to hear from you i'll see you back here next week