Motley Fool Money - A New Trend in AI is Emerging: Efficiency

Episode Date: March 26, 2026

The approach to AI so far can be best described as a using brute force to make things happen. It’s been effective so far, but the approach starts to run into problems when the numbers get really big.... Thankfully, some new developments in AI could help alleviate that challenge. Matt, Jon, and Tyler discuss how Google and ARM are advancing AI efficiency. Plus, social media’s bad week in court and the mailbag. Tyler Crowe, Jon, Quast, and Matt Frankel discuss: Meta and Alphabet losing watershed social media cases Is a “tobacco moment” as bad as it sounds? Advancements in AI efficiency Mailbag: Auto invest or buy the dip? Companies discussed:  GOOG, META, BP, DD, DOW, MMM, ARM, AAPL, MU, SNDK, INTC, NVDA, AMD Got investing questions for the podcast? Email us at podcasts@fool.com Host: Tyler CroweGuests: Matt Frankel, Jon QuastEngineer: Bart Shannon Advertisements are sponsored content and provided for informational purposes only. The Motley Fool and its affiliates (collectively, "TMF") do not endorse, recommend, or verify the accuracy or completeness of the statements made within advertisements. TMF is not involved in the offer, sale, or solicitation of any securities advertised herein and makes no representations regarding the suitability, or risks associated with any investment opportunity presented. Investors should conduct their own due diligence and consult with legal, tax, and financial advisors before making any investment decisions. TMF assumes no responsibility for any losses or damages arising from this advertisement. Learn more about your ad choices. Visit megaphone.fm/adchoices

Transcript
Discussion (0)
Starting point is 00:00:00 Efficiency in AI could be just what the doctor ordered. This is Motley Full Money. Welcome to Motley Full Money. I'm Tyler Crow, and today I'm joined by longtime full contributors, Matt Frankel and John Kost. We got a really interesting show today. We're going to talk about some stepwise gains in the world of AI, but not in the way we've been talking about it for quite some time.
Starting point is 00:00:36 And we're going to hit a mailbag. question because we are already getting them even after announcing that we're going to start taking them at our email address. We'll get into that in a second. But first, probably the biggest newsday's story outside of, you know, global war conflicts and things like that was there was some pretty big legislative decisions that happened for big tech. And it wasn't exactly the way they wanted to go. In a couple of pibble cases, one of them, meta platforms and alphabet were found liable for a woman's mental health straddles related to social media addiction. And they had to have a couple of people. had to pay punitive damages. Also, Meta lost a similar case in New Mexico related to misleading
Starting point is 00:01:14 statements about safety on their sites. Now, admittedly, this one's kind of a hard one to discuss on an investing podcast. I think there's a lot of emotions wrapped up in our use of social media and how that affects things. But there is going to be some investing takeaways here. But I wanted to get your guys' thoughts here are either of you shareholders in meta? And as you kind of like viewed these verdicts and things like that, has it really changed your view of the company? So to your first question, Tyler, no, I'm not a meta shareholder personally. That's not a indictment on the company. I've gone on record that meta is one of my more favorite companies in the Magnificent
Starting point is 00:01:49 Seven. But to your second question, does this change my view of the company? The answer is not yet, but it could potentially. Specifically with the issue of mental health, I think that all the statistics point to an indisputable conclusion. We do have a mental health epidemic, unlike anything we've ever seen. and I believe two things can be true here. First, social media apps are engineered to maximize user engagement.
Starting point is 00:02:15 I don't think that that's a controversial take. It is how they generate revenue. Of course, they want their users on there as much as possible so they can generate ad revenue. The second thing, I mean, I wouldn't blame social media apps entirely for mental health issues, but it does seem to be a contributing factor when it comes to this topic. I think if you're new to this discussion, the book I'd recommend is The Anxious Generation by Jonathan Haidt. It does a great job of laying out the rise of anxiety in Western culture, also potential remedies, some suggestions by the author. I know this might sound off topic for an investing podcast, but I do believe it is pertinent.
Starting point is 00:02:52 The jury verdict here is far from the final conclusion when it comes to Meta. Meta is going to appeal this case, is going to go higher. but if social media is ultimately deemed harmful, like other harmful things, we could see some substantial reforms from legislators that could have an impact on these cash cows. So I'm not saying that it's the final word, but it is something material to keep an eye on. I'm not a meta-shareholder, but we do own shares of alphabet, you know, which is YouTube's parent company in my household. My wife does in her account. It doesn't really change my opinion on either company. I've already had my kind of opinion formed. I'm a parent of young children. I think all three of us here are parents
Starting point is 00:03:30 of young children. So I'm sure we have our own opinions of social media when it comes to, you know, how it impacts the mental health of our kids. I feel like people are becoming a lot more cognizant of the dangers of social media right now than they were a few years ago, which is what the basis of this case was. It was people who used social media and were addicted to it a few years ago. But my kids, I can tell you, won't be on social media until they're at least in their late teens. And one of the reasons is that it's so difficult to say what's safe and what's not. So I guess this doesn't change my opinion. I already kind of had this opinion about these companies.
Starting point is 00:04:03 This is a hard topic to discuss. And I want to try to bring like the investment thesis around to this because one of the comparisons that I've seen with social media outlets and these cases that we saw was this, they're calling it like, for example, Bloomberg called it the tobacco moment, basically where legislative action starts to chip away at the business. because we start to realize the physical, mental harm that these can cause, and it leads to a lot of legislative stuff. But here's the weird part about it, is even after decades of litigation and fines and anti-smoking campaigns and declining tobacco use in the U.S., tobacco stocks have still been excellent investments over the years. And I want to contrast that a little bit to other companies where punitive legislation
Starting point is 00:04:49 have kind of crippled the company. And I think of examples like BP with the Deepwater Horizon space. Bill. Companies that have been making per floral alkalate substances like PFS, or we also call them forever chemicals, you know, the liabilities on those, you have like Dow DuPont 3M. They've tried enormous, like corporate changes to try to mitigate the liabilities here. And of those, none of the, like, over very long periods, none of these companies have really like fared nearly as well when, for example, compared to tobacco as like actual investments. Litigation against, you know, company met out is obviously bad and payouts are not like ideal, but if social media is treated similar to tobacco, like in
Starting point is 00:05:29 this tobacco moment, couldn't social media still have similar returns as investments in tobacco stocks? I mean, like you said, these are still cash cows. There's a lot to unpack there. I'm not sure if social media is about to have its, you know, tobacco moment, but I will say that the most interesting thing about this, it's not necessarily the fines that were just imposed. I mean, $3 million split between meta and alphabet. is nothing for these companies. But it's really the precedence they could set. So the verdict related to safety on social media,
Starting point is 00:05:59 that could certainly have some legislative impacts. I mean, for example, there are countries that already banned social media for people under 16 years old. So something like that could happen here potentially. That wouldn't exactly be crippling to these companies. It would have a material impact, but it wouldn't be crippling.
Starting point is 00:06:16 The mental health lawsuit, which is the one that was split between meta and YouTube, is a little more interesting to me. So Facebook has over three billion users worldwide. So would this pave the way for everyone whose life has been harmed by a social media addiction to potentially try to get millions of dollars from these companies?
Starting point is 00:06:34 Virtually anyone, I know I could, can make the argument that their lives would have been better or more productive at least if it weren't for social media. You know, how much more could I have written over the years if I wasn't, you know, on Facebook? Keep in mind that this was an initial decision, as John correctly pointed out, Met is going to appeal, as they should. The final ruling could be a little more consequential.
Starting point is 00:06:55 I personally don't think we'll see a wave of successful litigation against these social media giants for mental health lawsuits, but we'll have to wait and see here. Yeah, I mean, it's an interesting hypothesis to compare tobacco to social media. I would agree with Matt here. I think it's far too early to draw that parallel. This case is going to go up the chain, and it remains unseen how things would be regulated if they become regulated at all. So stand by. Yeah, this is certainly something that's been kind of on the back burner for a long time. We've been thinking about it. But now with these litigation actions, it really starts to bring this into the forefront. Something we'll be following in the coming weeks, months, years,
Starting point is 00:07:35 we'll see. After the break, we're going to talk about AI and one of the more interesting gains that we've seen in the past couple weeks. Getting ready for a game means being ready for anything. Like packing a spare stick. I like to be prepared. That's why I remember 988, Canada's suicide crisis helpline. It's good to know just in case. Anyone can call or text for free confidential support from a train responder anytime. 988 suicide crisis helpline is funded by the government in Canada. This isn't a single news story that we want to talk about here with about AI, but it's kind of a kernel from a couple of recent press releases that I want to think about as an essential topic when we think about AI.
Starting point is 00:08:24 and it's making it happen more efficiently. I'm going to let you guys kind of cover the topics a little bit more with the news stories, but one of them came out from Google talking about some of their ways of running AI models, and the other one came out from chipmaker ARM or ARM where they were announcing new AI-specific chip design. So, John, why don't you cover Arm, Matt,
Starting point is 00:08:43 and you can cover the Google announcement after that. Okay, so, yeah, Arm, it's always been known for these lower power CPU designs compared to Intel's X-86 architecture, but in the past it's licensed its technology to companies such as Apple. The news that we are getting now is that Arm is actually going to make its own CPUs using a Fabless model, so just like Nvidia or AMD, and Meta is going to be the first
Starting point is 00:09:09 customer here for Arm of its custom silicon. I think it's a big deal because it is a pivot for Arm's business model. I would temper the news with a comment that Meta is a customer, but it's not an exclusive agreement. Meta's going to continue to buy products from multiple companies. It's probably more about diversification of the supply chain than anything, but it is something to watch. Yeah, so on the Google side of things, they said that their recent research showed that a new memory compression method that they call TurboQuant could potentially reduce the memory requirements of large language models, you know, the AI models, by a factor of six.
Starting point is 00:09:46 And understandably, shareholders of memory focused chip makers like Micron and Sandisk were panicking about this. You know, memory efficiency, it's a big focus of AI development recently. And the demands are so high that these memory companies literally can't make chips fast enough. And if Google's right, that might not be the case anymore. Yeah. And this is what I found kind of interesting when I was, I saw both of these stories come at the same time because we have been talking about AI deployments and things like that. And obviously the knee jerk reaction in the market was for memory companies. Oh, this is bad. And if Arm were to take market share with lower, you, know, power-demand chips. I could see some of the downstream AI infrastructure companies that
Starting point is 00:10:26 have to do all this build-out. It would say, oh, yeah, they're going to take hits as well. And I want to get to how you guys are thinking about this as well. But this was kind of like, as I started reading the tea leaves between these like two announcements, this was kind of my hot take is I think the efficiency gains that we're talking about here with using less memory, using less power, these aren't just like good for the AI infrastructure buildout. They're absolutely necessary to come anywhere close to meeting the goals and targets that we've been talking about. Yeah, Tyler, I feel like you've been playing Doc Brown on this podcast, and I've been Marty McFly. Any single time we get an announcement for these data centers, there's massive power
Starting point is 00:11:06 requirements, and you've been yelling, great Scott, and I've been yelling, what the heck is a gigawatt? You've actually helped me see that they're basically saying that we need all this power, and we can't generate that much power. We can't generate at the scale that the hyperscalers are talking about. And there's data to back this up. 30 to 50% of the data centers in 2026 will be delayed because of power shortfalls, according to a report from Sightland Climate. Morgan Stanley projects a 44-gigawatt shortfall through 2028. There are already some data centers in California that have been built, but not turned on because the grid needs some fortification. And this leads to an undeniable conclusion that the current path is unsustainable.
Starting point is 00:11:47 We need something to change. We either need a power generation, breakthrough, a compute breakthrough, or an AI model breakthrough. And I think that we're a long ways away from having a true compute or a power generation breakthrough. The AI model breakthrough is the easiest path forward. And that's what this thing with Google is potentially talking about. We've maybe come up with a more efficient model. That said, we do need to tap the brakes just a little bit when it comes to the memory requirements. So some memory stocks are selling off because of this. The Google announcement only optimizes a small part of the memory need. specifically the key value cash.
Starting point is 00:12:23 It doesn't reduce the memory needs across the board. It reduces a fraction of a fraction, not a fraction of a hole. The memory imbalance will likely continue, in my opinion. Yeah, I would add to that that, you know, take this with a grain of salt and zoom out. Memory stocks like Micron are still up over 300% over the past year, even after the recent pullback. And if LLMs evolve like most analysts believe they will,
Starting point is 00:12:47 one-sixth of the current memory usage will still be a lot of memory chips that they need. And it will still keep these companies very busy for the foreseeable future. Every new technology gets more efficient over time, consuming less power. The hardware becomes smaller, et cetera. Think of like flat screen TVs. This is a natural evolution of AI technology, and it's a good thing. Yeah, one is certainly going to help. And again, I'm going to emphasize this is my takeaway as we watch things like supply chains get strained and we talk about these massive numbers. The only way to make this possible, it like, was saying is we need some breakthroughs in terms of efficiency, in terms of power generation.
Starting point is 00:13:26 Something is going to happen along the way because the numbers that we're talking about are just so hard to wrap our heads around in terms of the physical supply chain. It's going to be difficult to happen. So I'm very encouraged to see stuff like this because it is going to make it more viable in the shorter term and hopefully clear some of those backlogs that you were just talking about. And coming after the break, we're going to hit the mailbag. When WestJet first took flight in 1996, the vibes were a bit different. People thought denim on denim was peak fashion, inline skates were everywhere, and two out of three women rocked, the Rachel.
Starting point is 00:13:57 While those things stayed in the 90s, one thing that hasn't is that fuzzy feeling you get when WestJetting welcomes you on board. Here's to WestJetting since 96. Travel back in time with us and actually travel with us at westjet.com slash 30 years. Before we get to our first mailbag question, we want to make you part of the conversation as well. If you have a stock or investing in question for John, Matt, me, or anyone else on the show, you can now email us at Podcasts at Fool.com. We'd love to have mailbag segments whenever possible, so send in your questions.
Starting point is 00:14:29 Just remember to keep them foolish. That email again is Podcasts at Fool.com, Podcasts at Fool.com. And we're going to finish out today, and this is a mailbag question that comes from Jay Fung. I apologize if I mispronounced your name. But the question is, is setting up automatic investments always the best move bursting wanting to buy the dip, which is very much in the parlance these days when we're talking about investing for individuals. His email goes on, I know the answer is probably a mix of both, have automatic investments going, and then save a portion to buy the dip. I haven't been able
Starting point is 00:15:02 to get myself to pull the trigger yet on automatic investments since the markets have been so high. I'd love your insights, and am I unwise to hold off setting up automatic investments? Now, before we answer this question, we do have to stipulate because this is a podcast, We can't give personalized advice, and none of this should be taken as personalized advice. So, Matt, John, as you give your answers, just remember, we're going to think of a hypothetical situation and what you would do personally in this situation. Yeah, so thanks for that, Tyler. And thanks for the question.
Starting point is 00:15:31 I do a combination of the two, just like the email said, but I'll build it out a little bit. So I like to build stock positions and ETFs, if that's what you're asking about, automatically over time, as it really takes the emotion out of the equation, and it mathematically forces you to buy more shares when stocks are cheaper. So think of it this way. Let's say that I want to invest $5,000 in a certain stock. I might commit to investing $1,000 on the first day of the next five months instead of all at once. So the way that this works is if I buy $1,000 worth on April 1st, and then the stock falls 20% before May, I'm getting my next round of shares at a nice discount.
Starting point is 00:16:08 I'm buying the dip. If it goes up, well, my initial shares will be sitting on a nice gain and I'll be happy in that situation too. So at the same time, I like to maintain a little bit of cash on the sidelines to be opportunistic. So in my example, if a stock that I'm gradually buying falls by 20%, with no change in the fundamentals or my investing thesis, I've been known to take some of my extra cash and make my next purchase a little bit larger to take advantage. So to directly answer the question, I will never try to talk somebody out of setting up automatic investments, regardless of whether I think the market is cheap, expensive, whatever. Simply accumulating cash to, quote, buy on a dip, it more often results in missing out on a big gain. So I clearly remember
Starting point is 00:16:48 that many people thought the market was ridiculously expensive in 2015 after roughly tripling from the financial crisis lows just six years before and decided to pull some cash out, stay on the sidelines, and, quote, wait for the next dip. But then the S&P gained another 60% before it hit any significant correction at all. So keep things like that in mind. Yeah, I want to build on this, Matt. You talked about taking emotions out of it. you know, people, we have feelings. We're emotional beings. We're not going to change that entirely. I think that's okay. But personally, when it comes to my financial decisions, I don't want to be making that based on my feelings because my feelings aren't reliable. They do change. I'd rather be making my
Starting point is 00:17:31 financial decisions based on the facts because the facts don't change. And so I want to bring a factual study into this conversation. So Fidelity analyze some returns. a hypothetical 5,000 annual investment from 1980 to 2023. So basically $200,000 invested over 42, 43 years. If you invested all of that money on January 1st of each of those years, you wound up with $5.1 million. If you invested $417 a month, which is $5,000 a year, but broken out monthly, at the start of each month,
Starting point is 00:18:07 you had slightly less $4.8 million. I think that this supports a belief that the earlier you, get the money in the market working for you, the better. Yeah, in that study, I would out, well, I'll spare you the mathematics, but it essentially works out to your investing for an additional half of a year overall in the $5.1 million case. So that is still a form of averaging into positions like I'm talking about. So it's just wider intervals. You're not trying to buy the dip. I've read that study. And the biggest difference was getting your money in sooner. Like I said, for the first year, you'd have $5,000 in the market right away versus, you know, an average of $2,500
Starting point is 00:18:40 in the market at any given point that year. So that makes a big difference over time. And second, I will say it's not always practical for listeners to invest in large lump sums once a year. For many people, putting $500 a month in the market is the earliest that they can invest. So it's still a very interesting point mathematically. So let's break this down a little bit more from what the study showed. So let's pretend that you were the best trader out there. Somehow you had the $5,000 all up front, as Matt pointed out, that's not always practical. But let's assume you did. You had $5,000 to invest for the year and you could invest it all in a single day. And you picked the very best day of that year, the day that the market was at its lowest point for the entire year.
Starting point is 00:19:19 Somehow you had a crystal ball. You predicted that. And let's just say that there's another person out there who is the worst possible trader possible. They picked the top of the market for a single day of that year and invested all their money on that one. Well, if you were the best, you wound up with $5.6 million. If you were the worst, you still had 4.2 million. So you picked the best day of the year for 40 some years. You pick the worst day of the year for 40 some years.
Starting point is 00:19:47 So if you timed things perfectly, you did about 10% better than if you had just invested everything on January 1st. And if you timed things terribly, you did about 18% worse. So I'd ask myself two questions here. Am I the best? If not, is that 10% upside worth the downside risk of trying to wait for that dip? I don't think so. I think it's better to get invested.
Starting point is 00:20:08 However, I think a hybrid approach that you're talking about, Matt, is still a really good idea. So maybe some people would decide, I'm going to invest 80% or 90% of my money on a schedule. And I'm going to set aside 10 to 20% in case the market drops, in case I want to be opportunistic. That way, you do get that money working for you sooner. You're not dramatically, statistically altering your long-term performance. But you still do have that cash on hand to take advantage of things as things drop. You're not forced to say, oh, should I sell this one to buy that one? You have some cash already on the sidelines ready to go.
Starting point is 00:20:45 So maybe it is the best approach, that hybrid, a little bit of cash, but mostly invested. I think the best part of this conversation is I get to use my favorite Charlie Munger quote, which is, I have nothing else to add. And that is actually all the time we have for the show today. Matt, John, thanks for sharing your thoughts. I thought this was a great conversation about when timing the market works and when it doesn't. I'm going to hit the disclosure and then we'll get out of here. As always, people on the program may have interests in the stocks they talk about and the Motley Fool may have formal recommendations for or against,
Starting point is 00:21:16 so don't buy yourself stocks based solely on what you're here. All personal finance content follows Motley Fool editorial standards is not approved by advertisers. Advertisements are sponsored content and provided for informational purposes only. To see our full advertising disclosure, please check out our show notes. Thanks for producer Bart Shannon for pulling spot duty this week and the rest of the Motley Fool team. for Matt, John, and myself. Thanks for listening, and we'll chat again soon.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.