Motley Fool Hidden Gems Investing - How Nvidia Changed the World

Episode Date: January 25, 2025

There’s more to the legendary chipmaker than its tech stack. Tae Kim is a Senior Technology writer at Barron’s and author of the new book, “The Nvidia Way.” Best-selling author Morgan Housel interviews Kim for a conversation about: - The early days at Nvidia and its long path to “overnight” success. - What drives Nvidia’s employees. - How Jensen Huang takes long-term thinking to the extreme. Premium Motley Fool members can catch Morgan and Tae’s full conversation here: https://www.fool.com/premium/4056/coverage/2025/01/15/ai-summit-the-nvidia-way To become a premium Motley Fool member, go to www.fool.com/signup Host: Morgan Housel Guest: Tae Kim Producer: Mac Greer, Mary Long Engineer: Tim Sparks, Rick Engdahl Learn more about your ad choices. Visit megaphone.fm/adchoices

New from Nespresso. Blend wellness into your coffee routine with the Coffee Plus range. Infused with functional benefits. Choose the coffee you love with added B vitamins. Like Coffee Plus B12 to help support immune function. And Coffee Plus B6 to keep your day moving. Or go with the flow and choose Ginseng Delight. Our new double espresso with ginseng extract.

Whatever lies ahead, don't change your morning. Let your morning change you. Discover Coffee Plus on Nespresso.com. Jensen was so committed that this is going to be the future of computing. He was like, no, we're going to put CUDA on all our processors, all our gaming graphics cards and chips, and he did this for 15 years. Who does that? Most executives look out the next quarter or the next year,

or maybe two, three years. Jensen is looking out five, 10, 15 years. I'm Mary Long, and that's Tae Kim. He's a senior technology writer at Barron's and author of the new book, The NVIDIA Way. Bestselling author and friend of The Fool, Morgan Housel, interviewed Kim last week during our virtual member event, the AI Summit. Today, we're playing a piece of that full conversation for listeners of Motley Fool Money. Premium Motley Fool members can catch the whole discussion on our site. I'll drop a link in the show notes for you to do just that if you're interested, but in the opening segment we're playing for you now, Morgan and Tay

talk about the long path to NVIDIA's overnight success, how culture differentiates NVIDIA from its competitors, and what keeps Jensen Huang up at night. Tay, I want to start off with what I think is so interesting to me as an outside observer about NVIDIA, which is it seems like to a lot of people, NVIDIA just hit its stride a couple of years ago. But NVIDIA is now a 32-year-old company. And I actually think in the history of business, that is very rare. Microsoft exploded right away. Apple exploded right away. Uber exploded right away. But now you have NVIDIA that's more than 30 years old and just exploded in the last two or three years. So maybe especially for those who are

not very familiar with NVIDIA, can you take me back to the early days of how it was founded, what Jensen Huang did to create it, and what it was like before it became what it is now, one of the largest companies in the world. So it's such a great story. I kind of compare it to it's a real-life Goodwill hunting story. I mean, it's such an amazing origin. You have three engineers, Jensen Huang, Chris Malkowski, Curtis Preem, meeting at a Denny's in 1993 with this great idea to make 3D graphics chips. And the first market was video games for PC gamers. And people say NVIDIA just started on the scene three years ago,

but for PC gaming nerds like me, I've known them for 30 years. They were making the graphics cards for graphics chips for graphics cards that really boosted the frame rates and made PC games take off. If you remember the early days of Doom, John Carmack created that And then Quake was the game that Carmack made, which every PC gamer knows is the first kind of multiplayer 3D graphics game. And it was just such a great time. And NVIDIA's revenue just took off like a rocket. Its graphics cards were the best in the business a few years into this revolution.

And those three engineers just figured out a better way to create a technology company. And the most important thing, which I quickly realized after I was interviewing the entire early management team, the thing that separated NVIDIA from its competitors, which there are about 100 in its early years, was the distinct work culture that they brought and created. So even more so than technology, which has been great, and they've been on the forefront of all these innovations technically, I think the culture is the unique distinctive thing that makes NVIDIA great today. And it's the reason why it's been so successful. I want to talk a little bit about those early days. We now know NVIDIA today as just a company that just has mega success, all the demand that they can possibly take in. Talk about some of the early stumbles, though, when this was not the company that we know it is today.

So the first two chips that NVIDIA made were complete flops. The first one was called NV1, and they built a few hundred thousand, and almost 99% of the chips were returned because gamers returned them. So if you think about that, most companies can't survive your first two products being total disasters. And NVIDIA, because of Jensen Huang and his kind of resilience and his charisma, he was able to convince more people to give him more money at the time. But yeah, the first two chips were complete disasters.

And the thing that Jensen and NVIDIA does time and time again is when they make mistakes, like the NV1, which was a jack of all trades, it wasn't good at one thing. It was decent at like five different things. And Jensen realized that's not the way you succeed in the marketplace. You have to be really good at one thing and the thing that people want. But yeah, the first two chips were terrible. And somehow NVIDIA was able to survive and be resilient. One of the things that I think about with NVIDIA's success in recent years as it pertains

to AI, two-part question, I'm just going to start with the first one here. Did Jensen and the company see AI coming or was it right place at the right time? And they happen to be making these chips that could be used for AI. I remember it wasn't just a couple of years ago that why NVIDIA stock was surging was because you could use them in a crypto mining facility. And that was a big use case. AI just exploded what seems like out of the middle of nowhere when ChatGPT launched about two years ago. Did Jensen see AI coming and prepare for it, or was it right place at the right time?

I think it's actually both. They were at the right place at the right time because Jensen always believed in parallel computing, which is what their chips are good at. It's called graphics processing in your GPUs. Basically, the way it works is that GPUs have thousands of thousands of cores and they split computing workloads into smaller jobs and they run on those cores at the same time that compared to traditional processors which are called cpus they might have four to eight cores and they do computational workloads serially so he always thought parallel computing and gpus would be the future of computing and he worked nvidia to innovate and do the technical background for that so they've been working on that with cuda and all that from like

2007 2008 but then when ai took off around 2012 2013 when a couple teams figured out you could use gpus and it really accelerated the workloads and made the image recognition software work jensen saw that and said this is a game changer i need to put resources behind it so he put tons of employees to write software libraries to accelerate the ai stuff and he invested for like 10 years before ChatGPT came in. So it's a combination of both. They were in the right position with dominating the parallel computing processing technology,

but then he saw deep learning and neural networks really take off that if you add more computation, if you add the algorithms and the libraries that using GPUs can make AI work a hundred times faster than CPUs. So then he told NVIDIA and all his employees, we need to invest in this, Even though some of the executives told him,

this is a fad, this isn't going to work. Jensen was like, no, this is going to be real. But then again, this is 2012 and ChatGP is 2022. You're talking about a 10-year run where they kept investing, even though the revenue wasn't really coming in, it wasn't really taking off. That's the genius behind Jensen. I actually compare him a lot to Reed Hastings.

Reed Hastings had this intuitive sense that someday we're going to stream video of the Internet, and that was going to be the future. but consumers didn't have the broadband infrastructure, the technology wasn't ready. Reed just basically stuck around, positioned Netflix to be on top of the technology as improved, but he did the DVD by rental business

and used that as the revenue to come in. But when the technology got ready, Netflix was all over it and was ahead of everyone else. Jensen and Nvidia have done this time and time again, every big computing shift in graphics from programmable GPUs, to CUDA, to data center of full stack solutions. He was ahead of the game, he was there early,

and then when it took off, he was there. The ChatGPT moment in late 2022, the key architecture there is the Transformer architecture. It came out in this famous paper that everyone knows that Google's engineers wrote. Jensen saw that paper and was like, this is going to be a game changer. We need to accelerate that and create

these tensor cores that make these workloads and transformer models work better. He saw how important that was. When the Hopper GPU came out a month before ChatGPT was launched in November of 2022, the Hopper GPU that NVIDIA made, had a thing called the transformer engine on it already, which is a combination of hardware and software.

They were preparing for that ChatGPT moment like a year, two years beforehand, even before it happened. I remember this Ian Buck who's considered the father of CUDA. He had this podcast which I recommend everyone listen to it. NVIDIA has an AI podcast. I think it's just called AI podcast. While I was researching the book in 2019, he did this podcast interview for NVIDIA's AI podcast,

and he was talking about natural language processing, the need for AI models to look into knowledge repositories. All that stuff that became ChatGPT three years later, he was talking about in 2019. NVIDIA was all over this technology, and we can talk about Mellanox, which is going to go down as one of the biggest successful acquisitions of all time.

Jensen, when he bought Mellanox in 2019, he put in the press release, someday AI workloads are going to be scaled across thousands and tens of thousands of AI GPUs made by us, and Mellanox is going to be the key technology behind how these AI server clusters work, which is exactly what's happening right now. This year, you have 100,000 NVIDIA GPUs

and Elon Musk's XAI cluster. Mark Zuckerberg has talked about they have a cluster that's even larger than that, over 100,000, and now Broadcom is talking about in two, three years, you can have one million GPU clusters out there. Jensen has been able to see the future, know how the technology is going to develop, beforehand, years beforehand, and he positions NVIDIA to invest in the technology before it

happens. Time and time again, it's unbelievable how he's been able to predict the future. There's a book that Bill Gates wrote in 1994, I think, it's called The Road Ahead, where he talks about what the Internet would be like. This is 1994, so most people don't even know what the Internet is yet. I read it a couple of years ago, I went back and scanned it. I was expecting to find all the areas that he was wrong, all the false predictions he made. And it's astounding when you read it because he got virtually everything right. So in this book in 1994, he perfectly explains what would become Netflix, Facebook, Google Maps. He saw all of that coming. And it's astounding to watch someone who can truly see the next wave of where it is a

decade before it happens and a decade before everyone else. And it sounds like that's what Jensen was as well. But how rare was it, how crazy was it for Jensen to be talking about and focusing on and investing a ton of money in AI 10 or 15 years ago? I agree Bill Gates was very pressing about that, but I think the difference with Jensen is he was able to predict the future and then commercialize that technology to win,

and actually do well. When CUDA came out, which is the critical technology and the platform that enables the parallel computing on NVIDIA's processors, when CUDA came out in 2006 and they're investing in the hardware circuitry, Wall Street was like, what the hell is this? It's not really generating revenue.

You're dedicating die space on the chip towards this CUDA thing that it doesn't seem like people are accepting. Jensen's like, this is the future, I believe in it, and I'm going to do it. Gross margins plummeted from 45 percent to 35 percent, and the stock got punished. The stock was down 80 percent. People inside Nvidia,

employees were grumbling as to why are we doing this CUDA thing? It's killing our profits. It's not generating anything. But Jensen was so committed that this is going to be future computing. He was like, no, we're going to put CUDA on all our processors, all our gaming graphics cards and chips. And he did this for like 15 years. Like who does that?

Most executives look out the next quarter or the next year, or maybe two, three years. Jensen is looking at five, 10, 15 years. And this isn't the only example of this. There's this thing called ray tracing, which does better lighting effects. Jensen invests in this technology for 10 years before it was commercialized on gaming GPUs.

Same thing with DLSS. He invented this in a meeting, which is one of the scoops in my book. Literally, one of his research scientists came to him with this DLAA anti-aliasing technology. He's like, how about you take some of that, transpose it this way, and that will be something that's very interesting.

The research scientist is like, maybe that will work. Let me look into it, and then a few weeks later, I think we can do this. This DLSS technology, which basically uses AI to upscale graphics into higher resolutions, They worked on the frame generation version of that for seven years. No other company, in my knowledge, does that. They invest in stuff that becomes commercialized seven, 10 years later.

Xerox PARC is legendary for creating the technology behind the GU, the GUI, graphic user interface for operating systems and all this stuff, but they never commercialize it. Steve Jobs with the Macintosh, they were able to commercialize it and benefit and take that to market. NVIDIA does the research, commercializes it, and wins 5-10 years later. I think that's a key differentiator for NVIDIA.

They have this long-term thinking mentality. Jensen is so paranoid about getting disrupted because he's a student of history and sees how every major technology company in history gets disrupted by innovation and startups. He's willing to disrupt himself and cannibalize himself at all times. He knows if you don't invest, you're dead in technology eventually. So that's why he's willing to invest longer term than anyone else.

Stop wasting your nights on a mattress that doesn't get you. Experience the most comfortable mattress in the world. The Sleep Number Smart Bed. At the touch of a button, you can personalize your comfort. Choose firmer or softer. Adjust cooler to warmer. And right now, save up to $2,500 during our massive Labor Day event. Hurry into your local Sleep Number store today, because we have your number.

I want to talk a little bit more about Jensen, who is obviously now the public face, the founder and CEO of NVIDIA. So many of the big, dominant, very successful CEOs in history, whether it's Henry Ford or Bill Gates or Elon Musk or Steve Jobs, a lot of their business success comes at the expense of their personality and their friendliness. And a lot of the reason they are so successful is because they are such demanding bosses. You've met Jensen. I'm just curious, what is he like in real life when you meet him? What's his personality like? I think this is a key characteristic of personality and key reason why he's successful. He's very blunt and direct.

I was asking him questions about his culture and different questions here and there. And he was like, Tay, you're not doing a good job now. You're not getting NVIDIA right now. And I'm just like taking it back. Most people are nice to each other. They're friendly. No, Jensen wants you to know what he's thinking at all times. And he's blunt and direct to me.

He's blunt and direct to his employees. And he doesn't believe in coddling. I think all of us have been in large organizations where, you know, the HR, you have to be professional. If you have a problem with someone, you should take them aside and, you know, gently tell them and be constructive. No. He says, why should Tay be the only one that gets to learning here? Everyone in the room, more employees across NVIDIA should learn what the problem is, so that we could all improve together.

There's this one story in the book where a manager of the Tegra 3 project, which is a chip, was late, and he was having problems sticking to his schedule. He dressed him down in front of the entire company, and he got the cameraman to go into his face and says, Rayfield, you need to get Tegra 3 back on schedule. This is not how you run a business. Multiple Nvidia employees told me this

is the most humiliating thing I've ever seen. But Jensen's thinking is, no, you need to know exactly what you're doing wrong, how you can learn from it, and I don't care about your feelings. Your feelings doesn't help the company move forward. That blunt and directness, they call it intellectual honesty,

be willing to say the unpleasant truth. By doing that, he tells people, you're not doing a good job, this analysis is not good enough. You get embarrassed, your feelings are hurt. But next time, those employees are going to work on a different level to make sure they don't get dressed down in front of everyone again.

It's a strategy that works. I'm sure like NVIDIA employees, it's a hard driving culture, It doesn't feel good in the moment, but it develops this winning culture. The track record speaks for itself. Steve Jobs was like this. I'm sure Bill Gates was like this.

I don't think he does it to be mean. Like people say you can't take it personally because that's just the way Jensen is. And I think it works. Like there's no question about it. And it's such a fine line for this between a hard driving motivational leader and just being a jerk.

It's actually a very fine line. And I know a lot of people historically, of course, it was an honor and a privilege to work for Steve Jobs back in the day, but incredibly demanding and incredibly difficult and incredibly stressful. What is it about Jensen? So we've detailed the hard driving, blunt side of him. What is it about his characteristic and his personality that is so motivating to all these employees that are willing to put up with that?

I think one reason why there's near universal praise when I talk to former NVIDIA employees is that they know that Jensen does this level of excellence expectation on himself. He works more than anyone at NVIDIA. In the early days, he was going from nine to midnight. He considers work relaxing. He says, I might not be the smartest person, but I know no one's going to outwork me.

He works all day, Saturday, Sunday. I have a funny story in the book where he's drinking a scotch on Sunday evenings, reading employee e-mails. People don't want to send him e-mails on a Friday afternoon because they know he's going to reply back and ask for more work to be done and it's going to ruin their weekend. I think that expectation where they know Jensen is working just as hard as they are,

alleviates that thing where they might get annoyed or whatever. The other thing is, this is such a competitive industry. Chip companies die all the time, they go bankrupt. No one wants to spend three, four years of their lives working on a chip project that becomes nothing and the company goes bankrupt. You want the work you do every day,

you work like crazy hours. You want it to be successful in the market and have an impact on the world. NVIDIA, you're going to do that. You're going to work with some of the best and smartest people, and you know the work you do is going to probably win in the marketplace, and have an impact on the world.

Winners want to stay on the winning team, and winning begets winning, and that's why people say NVIDIA. I think the biggest evidence of that is the turnover rate at NVIDIA is 3%, which is unheard of. Most technology companies are 13-15%, probably 17% as some chip companies. The reason is people want to stay at a winning culture and a winning company. Obviously, financially, this is an extraordinary outcome. Literally, NVIDIA is the best performing stock in US history with any company with 20-year returns. If you put $10,000 on the first day of its IPO in

1999, that holding would be worth $40 million today. Financial rewards, the meritocracy are obvious attractors of employees to NVIDIA. I think there are plenty of Motley Fool investors who maybe didn't get on the IPO day, but got it more than a decade ago and have done quite well. I want to read you a quote that I heard from Jensen in an interview that gets to his motivation and his drive and his work ethic the quote is he he was asked what companies keep him up at night and his answer was quote that shouldn't keep me up at night because i should make sure that i am sufficiently exhausted from working that nobody can keep me up at night that's really the only thing that i can control uh it's one of those quotes that you read and i just think

i would hate to compete against that guy who just has there's nothing else in his life going on accept his work and he's willing to work 24 hours a day to get there, especially now that he is personally worth over $100 billion. He's one of the top 10 richest people in the world. What motivates Jensen? I don't think the money, I mean, money is nice, but the whole executive team, a lot of them have been there for 20, 25, 30 years, and there really isn't much turnover so all of them kind of buy in into thinking that we are changing the world and more so than ever this this ai revolution is going to change the world and drug discovery i mean i've had multiple executives tell me they're so excited about what

what the ai gpus are going to mean for healthcare and the capacity and the ability to do all the simulations for drug permutations and possibly you know cure cancer i mean these are like life-changing, humanity-changing possibilities, and that motivates people beyond the money. I think with Jensen, from the beginning, I actually compare him to Michael Jordan. Michael Jordan has this thing where he would create chips on his shoulder and take things personally because he had this extreme competitive desire to win at all costs. One story that shows a similar extreme competitiveness is Jensen had this early CFO and the CFO was a grandmaster at chess. He was one of the top 50 chess players in the country. Jensen knew this, but he had to beat

them. He would learn all the chess openings and ask Jeffrey Barr to play chess. Invariably, Jensen will lose every time because Jeff is a chess master and he knows how to beat a novice. Then after he lost, Jensen would knock all the chess pieces off the board and then force Jeff to play him in table tennis, where Jensen used to be a table tennis champion when he was a teenager, and he would beat him at table tennis. It would fulfill his desire to win after he lost. That's the mentality that Jensen is. He needs to win. He's extremely competitive. If you have that kind of mentality where you need to win, you have a work ethic that's better than anyone else exactly what you said like i multiple nvidia employees told me they would

never want to join amd or intel because they would have to compete against jensen and they they know like that kind of work ethic that kind of competitiveness it will be almost impossible to to beat them and it's not just the work ethic it's the business genius which time and time again he creates these amazing business strategies but he combines that with like a deep technical understanding, which I think separates them. One chapter in a book, I go off on all these technology CEOs that have backgrounds in marketing or business management, MBAs. Those people can't compete with someone like Jensen who reads AI papers as soon as they're published. He trades the latest trends and articles with all his top AI engineers. So the combination of that deep

technical expertise, and the business genius is what makes Jensen special and successful. I want to follow up on that point that you just said, because I think historically, there are a lot of good technology minds. There are a lot of very talented MBAs. It's pretty rare that you get a technological genius and a business titan in the same mind. Jeff Bezos was that. I think Elon Musk is that. I think Jensen is that. Talk about some of the business moves that NVIDIA has made. We've been talking about their technology and seeing AI 10 years ahead, but talk about some of the business moves they've

made that made the company so successful. The biggest one that I actually think is happening right now in AI too. In the late 90s, he had a meeting with his top executives and I was like, how come all these 3D graphics companies, these graphic chips companies and PC market, how come they always lose their leadership? Every two years, there's a new 3D graphics company on

the top of the heap and doing well. He basically figured out that PC makers decided to pick their graphics vendor every six months, two season of the year, back to school and in the spring. Then he thought most graphics companies, when they create a new graphic ship, it took 18 months to create a new graphic ship, and then they start again and it takes another 18 months,

basically around two years. The problem was you would be inside a gateway or compact or whatever, but then in the next two years, another graphics chip company would come out with a better product that was faster. He was like, how do I fix this? How do I keep NVIDIA on top? Instead of 18th month cycle,

he decided why don't we just do a graphic chip every six months? Who does that? Everyone's like, no, it takes two years, it takes 18 months. He's like, we're going to make three graphics chips in the times it makes one graphics chip. It wasn't that easy. They made one 18th month architecture and then created two faster derivatives every six months.

But he had the genius to be like, we're just going to accelerate the product cycle. If you do that, competitors can't compete. All these other graphic chip companies went bankrupt after NVIDIA decided to make a new graphic chip every six months. He's doing the exact same thing with AI GPUs now. Typically, it took two years to create AI GPU architecture. And then last October, he's like, no, two years, forget two years. We're going

to do this video game playbook we did in the 1990s. We're going to make a new AI GPU every 12 months. Think about if you're AMD. How do you keep up with that? NVIDIA already makes a GPU that's five to 30 times faster every two years. And now they're going to do every year. If you're a competitor, it's nearly impossible to keep up with that. And that's just Jensen's mentality. They call it, it's one of their key philosophies, it's called speed of light. We don't compare ourselves to other competitors. We don't compare ourselves to what we did last time.

If you do that as employee and tell your intelligence, oh, I did 10 percent better than last time. I did 10 percent better than other competitor. He will yell at you and dress you down and say, we don't do that. We do it compared to what's physically possible by the law of physics. If you broke down the task by each component with no lag, no queue. What's physically possible? What's the best time you can do based on the law of physics? And if you do that, if NVIDIA does that, that's literally the most maximum speed you can do

in reality. And if you're a competitor, you can't beat that. As always, people on the program may have interest in the stocks they talk about, And The Motley Fool may have formal recommendations for or against, so don't buy or sell stocks based solely on what you hear. All personal finance content follows Motley Fool editorial standards and are not approved by advertisers. The Motley Fool only picks products that it would personally recommend to friends like you. I'm Mary Long. Thanks for listening. We'll be back on Monday. Thank you.