In Good Company with Nicolai Tangen - Jensen Huang Founder and CEO of Nvidia

Episode Date: April 12, 2023

What’s the most important problems that AI can solve? How close are we to artificial general intelligence? And how can we use AI responsibly? Tune in and find out! The production team on this e...pisode were PLAN-B’s Nikolai Ovenberg and Niklas Figenschau Johansen. Background research was done by Sigurd Brekke with additional input from our portfolio manager Richard Green.  Links:Watch the episode on YouTube: Norges Bank Investment Management - YouTubeWant to learn more about the fund? The fund | Norges Bank Investment Management (nbim.no)Follow Nicolai Tangen on LinkedIn: Nicolai Tangen | LinkedInFollow NBIM on LinkedIn: Norges Bank Investment Management: Administrator for bedriftsside | LinkedInFollow NBIM on Instagram: Explore Norges Bank Investment Management on Instagram Hosted on Acast. See acast.com/privacy for more information.

Transcript
Discussion (0)
Starting point is 00:00:00 Hi everyone, and welcome to our podcast, In Good Company. I'm Nikolaj Tangen, the CEO of the Norwegian Southern Wealth Fund. In this podcast, I talk to the leaders of some of the largest companies we are invested in, so that you can learn what we own and meet these impressive leaders. Today, I'm speaking to Jensen Huang, the founder and CEO of NVIDIA, the world's most valuable chip company. It is NVIDIA which is shaping the artificial intelligence age. They are powering chat GPT and other cutting-edge AI technologies.
Starting point is 00:00:34 We own over 1% of NVIDIA, translating into 38 billion kroner or almost 4 billion US dollars. Now what's next up in artificial intelligence? How is it going to change the world? Will it lead to unemployment, new jobs, and how will it change your life? Stay tuned. Jens, a big thank you for taking the time today. I have to say, I'm normally very excited when I record this podcast. But wow, when I did the preparation for this, incredible.
Starting point is 00:01:12 You really are in the middle of all the important things which are happening in society just now. How does it feel? It is gratifying and rewarding. And I'm happy for our company to be able to contribute to so many different areas of science and rewarding. And I'm happy for our company to be able to contribute to so many different areas of science and society. And so it is a thrilling time. Now you delivered, well, you hand-delivered actually, the first supercomputer to open AI some years ago.
Starting point is 00:01:39 Tell us about that. We were just getting into artificial intelligence ourselves and we're working on autonomous vehicles. And so we were imagining what kind of computer has to be built for this new way of doing software. probably know by now that artificial intelligence is a computer that works with software programmers to write software that is refined from data. And that software is impossible for humans to write. It's a gigantic body of code. And it requires a special type of computer. And so when deep learning first came along, we reasoned about how it would fundamentally change computer science. Because the early effectiveness of the first deep learning network that the industry, a lot of people saw, was AlexNet. And AlexNet was designed for computer vision and its effectiveness was so incredible.
Starting point is 00:02:52 It shattered records and shattered the effectiveness of computer scientists of several decades. And it was a piece of software that required NVIDIA's GPUs to produce. And we were so inspired by that. We reasoned about what kind of software is this? Where can it go? What kind of problems can it solve?
Starting point is 00:03:32 And what is the implications to everything about computer science, from chips to systems, to operating systems, to data centers, to networking, to the algorithms, all the way to applications. And we came to the conclusion that a new type of computer had to be created. And we created this new computer we call DGX. It's a deep learning system. And it's an AI supercomputer, if you will. And I delivered the world's very first one when I announced it, that we were building it for ourselves. I thought that some people would be interested, but it turned out a lot of people were interested. And so I delivered the very first one outside of our own company to OpenAI.
Starting point is 00:04:09 What were the big breakthroughs that you had to go through to get there? Well, the way that the software is written, it processes a giant amount of data to find patterns and relationships, patterns and relationships in the data. And the data is ones and zeros. And somehow using these architectures of deep learning models and the way that the deep learning neural network is constructed, it was possible to scale into very large models, very large networks, and process a gigantic amount of data looking for patterns and relationships. And so the question is, what kind of computer would be good at that?
Starting point is 00:04:59 And so we reasoned through the computer architecture and came to the conclusion that every aspect of the computer has to change from the way the processor is designed. Our GPUs, our graphics processors, which simulate the world, was almost a perfect starting point for understanding the world. You know, a graphics chip that was designed to simulate the virtual world, as it turns out, is fairly good at understanding the world of mathematics is similar. But yet, the size of the amount, the size of the data and the amount of computation necessary to do it, to find it, to go through all of that data is enormous. And so we broke it down
Starting point is 00:05:41 chip by chip and the CPU was no longer the ideal processor. And so we evolved our GPU to become a deep learning, if you will, an artificial intelligence processor. The PC architecture is suited for personal computing, but it's not suited for giant AI systems to learn from data. The IO has to change. The networking has to change. to learn from data. The IO has to change, the networking has to change. We bought a company called Mellanox so that we can change the way computers are connected and the way computers can work together. Instead of, instead of maybe a handful of CPU cores working together, we have millions of GPU cores working together to process the data,
Starting point is 00:06:24 define patterns and to learn what is called a representation, to learn the language of the subject that you're trying to learn. You could be learning the language of music. You could be learning the language of language, human language, or the language of the world, the physical world, the learned computer vision, we can learn proteins, we can learn chemicals, we can learn all kinds of things now. And of all these things, what were the biggest challenges? Well, the biggest challenges, and it remains now is that the
Starting point is 00:06:59 problem space is gigantic. um an application for a phone can fit in a few gigabytes uh you know or a pc a few gigabytes the the software that we're talking about here you know chat gpt is 100 and well chat gpt3 uh is 175 billion parameters And each one of the parameters could be a floating point number. And so 175 billion parameters just for the neural network math, not to mention the applications that sits around it.
Starting point is 00:07:36 And so this is a giant application that doesn't fit in one PC, doesn't fit on any phone, doesn't fit on one PC. And it takes many computers working together just to run it. It takes a giant data center to learn from it. And it takes an entire, you know, it takes a large number of computers just to run it. And so this type of application has never existed before.
Starting point is 00:08:00 And so every aspect was changed. We literally re-architected everything of computers that we know of from the ground all the way to the top. And so now these AI computers are unlike anything that we've ever built before. And because the performance needed is so great, it takes weeks and weeks to process the data so that we can learn from the data and learn its representation, learn the model, if you will, the model of the subjects, the world model that you're trying to learn from the data. It takes so much time to train these models that if you could even shave half of the time off, it's measured in weeks. You mentioned GPT-3. What's the progress from three to four, just in terms of complexity? Well, the complexity is hard to estimate because OpenAI hasn't really described it. But there's
Starting point is 00:08:56 a great number of new breakthroughs. One of the ones is the fact that it can learn from both language and images at the same time. Just as with humans, we learn more about anything if we could see, if we could, you know, read the words and see the images. And, you know, one good example is if you've only seen horses and you've never seen a zebra, but I told you that a zebra is like a horse, but with black and white stripes, the fact that you have knowledge of both modalities, images and language allows you to connect the two and learn something in your brain, even though you imagine a zebra in your brain, even though maybe you've never seen one actually. And so the ability for us to learn from multi-modality
Starting point is 00:09:51 is very important and GPT-4 has learned that capability. You mentioned recently that we have now reached the iPhone moment for artificial intelligence. What do you mean by that? Over the last 40 years or so that I've been in the computer industry, we transitioned. We phase shifted, you know, at first slowly and all of a sudden abruptly, just like water turning to ice or water turning to vapor. At first, the temperature kind of increases linearly.
Starting point is 00:10:33 And then all of a sudden, at some phase shift, the structure of the molecule changes all of a sudden, and instantly something happens. instantly something happens. It happened when we went from many computers and workstations, client servers to personal computers. The very first four or five years, it grew linearly. All of a sudden, Windows 95 came
Starting point is 00:10:59 and everything about the personal computer changed. And yet the personal computer was introduced some 10 years before that. And the same thing happened with the internet. The first five, six, eight years, scientists and researchers were already using the internet. And then all of a sudden, one day Mosaic came along, Yahoo came along, and bam, there's a phase shift in the way that that the internet
Starting point is 00:11:27 was perceived and used in every single one of these transitions then cloud then the iPhone the mobile cloud in each one of these transitions the computer itself is programmed differently it's easier to. Let me give you one example. The number of mainframe applications in the world is not that many, but the number of iPhone applications is over 5 million. And so the fact that there are so many applications must suggest that it's easier to create amazing applications. And it's absolutely true. The applications we have on iPhones and the mobile devices is surely beyond expectation, beyond imagination just 30 years ago. And yet, you know, people are creating these applications, obviously, very, very quickly.
Starting point is 00:12:19 And so the programming model has changed. The application capability has changed. model has changed, the application capability has changed, and the reach of the computing has changed. And so let's apply that to GPT. Let's apply that to artificial intelligence as we know it. The way that you program this is just with human language. This is the only computer, this first computer in the history of humanity that everyone can program the computer to do something. And there's no programming language. You don't have to use BASIC, you have
Starting point is 00:12:49 to use FORTRAN, Pascal, C, C++, Java. You don't have to use any of those programming languages. Python, you don't have to learn anything. Which is really good because I tried to learn Python last year and it didn't quite work out to the extent that I now have to sing at the summer party. The number of programmers in the world just increased from tens of millions to several billion. And so we've narrowed, if you will, we've democratized computers,
Starting point is 00:13:15 we've democratized computer programming, and we've closed the gap between the have and the have not access to technology. The technology divide has now been closed. What are the implications of this democratization? When you democratize technology and you put it in the hands of almost everybody, you empower everyone.
Starting point is 00:13:37 Look at the number of applications that are coming out now that are based on ChatGPT, where people are connecting it to applications, making the applications better. People are using it to write stories, create music, write programs. So instead of writing a program, you tell ChatGPT to help you write a program. You tell it the problem you're trying to solve, and it writes you a Python program, or it writes you a SQL query. And it might even, well, it even creates a website for you. And so if you want to go into business and you don't know how to create a website, you can now just tell Jachy BD to help you create a website. You describe what you want and it connects it all up for you and it's operating. And so here's a computer that can
Starting point is 00:14:19 help you write programs, solve problems, empower you. And so that's one of the greatest things of democratization of technology. We've now put this amazing tool in the hands of everyone. What do you think it will do to society? Well, the first thing that's going to happen is our productivity will go up. You know, any profession that relies on knowledge and the access of knowledge, the application of knowledge will now be boosted. And so if you have domain knowledge, and most companies in the world has very, very deep domain
Starting point is 00:14:54 knowledge, it's the reason why they're a company. Their domain knowledge can now be put in the hands of their employees and applied and accessed and applied in a much more rapid way. Of course, there's a lot of mundane information tasks that are now, if you will, commoditized, and it's automated. One of the things that's really incredible about artificial intelligence, and the reason why this is definitely going to be the next industrial revolution is instead of producing steam to electricity, instead of mass producing physical things, we are now going to be producing the most valuable asset, the most valuable commodity that we know as society, information, knowledge. asset, the most valuable commodity that we know as society, information, knowledge. And so the production of intelligence is going to be what all companies do in the future. We have, NVIDIA has AI factories. We put data into it and improved software, and the software is artificial intelligence intelligence improved intelligence software comes out every
Starting point is 00:16:05 single day. I go to sleep and it keeps producing it. And we keep refining more data. We keep improving the software. The software helps us design chips. It helps us operate robots like self-driving cars. It helps us do computer vision for quality inspection. It helps us develop software that helps us, you know, design and manufacture chips better. And so every company will be able to do that for their own particular domain. So I think the the next industrial revolution is going to be about the production of intelligence. And, and for for industries that relies on intelligence, our productivity will be insanely boosted.
Starting point is 00:16:48 And of course, there will be some jobs that will be changed. There'll be some jobs that will be created. Right now, we're creating a whole lot of jobs for artificial intelligence data scientists and people who understand this field. Of course, some jobs will be displaced. And so we have to make sure that as a society that we understand what this technology is and take advantage of it as fast as we can so that we understand it and apply it to social benefits. How much do you think productivity could increase on the back of this? Well, there's a few ways we can measure it. So let me give you a couple examples. One of the hardest things that we do in our company is designing chips. The chips that we build are the largest chips, the most complex chips the world builds today. No singular entity
Starting point is 00:17:37 builds such large, enormous semiconductor chips. And these chips are simply impossible to build anymore without artificial intelligence. And the reason for that is because the number of transistors and the way that we can connect up those transistors, the combinations is just so insanely great. And because so many people work on it, the optimization of the mathematics, the optimization of how to place, it's kind of like imagine a New York City, but it's a thousand times bigger than New York City. And you're trying to figure out how to organize New York City from the ground up such that it is the most optimal placement of every single building. And then you have to understand where the traffic goes from building to building. You have to understand which buildings are associated with other buildings and what buildings are necessary to support certain buildings and certain infrastructure. Where do you put the parks? Where
Starting point is 00:18:43 do you put the restaurants? It's insanely complicated, as you can imagine. The number of combinations is off the charts, and we can't solve these problems anymore without artificial intelligence. On the one hand, it lets us do things that we can't otherwise do. On the other hand, let me give you another example. We use artificial intelligence right now to try to better understand climate change. artificial intelligence right now to try to better understand climate change. And in order to understand climate change, you have to simulate the weather a lot more quickly because you're trying to further extrapolate the implications of climate out in the distance, not just tomorrow, but ideally next month, next year, next 10 years, next 30 years. So in order to do that, we have to do weather simulation a lot, lot faster.
Starting point is 00:19:32 And so we've created artificial intelligence that helps us simulate the multi-physics of weather. And we're already simulating weather now 10,000, 50,000 times faster than using numerics. And so that's another way of thinking about productivity. When you can do something 10,000 times faster, you're doing it 10,000 times faster. One last example, the single greatest expense in our company is software engineers. And now with Microsoft's co-pilot, you could, and they've estimated that some 40, 50% of the software that's now written in GitHub is produced by AI. It's a little bit like text completion. It's a little bit like grammar correction in our word editing documents, except this is for program
Starting point is 00:20:22 completion. And so the AI can suggest, based on what you've already written and what you intend to write, it can write the program for you. So if you could imagine the single most expensive population at NVIDIA is now amplified by a factor of two, that's incredible. And so our estimate is we're going to improve
Starting point is 00:20:43 the productivity of our engineers by a factor of 10. When you talked about complexity being a thousand times the complexity of New York City, that you put in on what kind of area? How big is one of the chips? Rich chips are probably, comparing it to a stamp, it's it's a couple of inches per side and um uh what is what is a couple of inches per side it's kind of like a it's smaller than a cough you know coffee cup a coaster probably you know probably a two-thirds the area of a coaster if you will just to get put
Starting point is 00:21:23 in perspective the r d budget for it is probably something like $5 billion. And then it costs more to build one of these generations than, for example, to build a rocket. And the R&D budget is very high. When you put together everything you said about productivity gains, when you look at the whole society, how do you think this could drive productivity gains in the whole society, if you were to put a number on it? I don't know how to do that. But one thing for sure,
Starting point is 00:21:54 the countries that don't have the richness of computer scientists and haven't benefited as greatly from the enormous capabilities of computers, this should be a reckoning moment for them. This should be just an extraordinary opportunity for them. The up-and-coming economies, the up-and-coming industries, up and coming economies, the up and coming industries. I think India, Southeast Asia, Africa, these are regions and economies that I think has a real benefit from artificial intelligence,
Starting point is 00:22:37 enhancing the capabilities of the entire industry and their, and their economy and then, you know then driving productivity to the limits. And so I think for the rest of the world, for the developed countries, the ability to reduce costs is incredible, not to mention accelerating everything that we do. So when you look at the most important problems that AI will solve over the next five to 10 years, what are they? One of the most important ones is digital biology, drug discovery. Just as we've learned the language of humans, we've now learned the language of proteins.
Starting point is 00:23:16 And we've learned how to understand proteins. And we've learned how to, from the desired function, a protein is a machine, the biological machine, the way that it's connected, the amino acids, the chain of amino acids, and the way that it comes together, the 3D shape of that protein determines its mechanical functionality, if you will. It's kind of like the difference between the shape of a motorcycle and the shape of a car and the shape of a unicycle. The fact that they're different shapes, their functionality is different. A plier and hammer, the functionality is different because of their shape. And so proteins have different shapes and different functions.
Starting point is 00:23:56 We can now, from the desired function of a protein, synthesize other proteins, other potential proteins that have properties that are maybe better for temperature or better ability so that it goes into our bloodstream better. Or maybe we can use it to synthesize energy from light. Maybe we can break down plastics. Maybe it could break down oil leaks in the ocean or you know whatever the the interesting problem is we can now use protein machinery and protein engineering to go help solve that problem i think that that's tremendous incredible potentials we can understand the language of chemicals. And now that you can understand chemicals and proteins, you can understand their interactions and do a better
Starting point is 00:24:51 job discovering drugs. Drug discovery still costs enormous amounts of money. It takes a very long period of time and our success rate is very low. And so now we can improve the odds of that. And so drug discovery is one. The other one is climate change, both in understanding the impact of human factors to climate change, predicting climate change and the climate effects in regional climate impact, whether it's extreme weather in whether it's extreme weather in the Gulf of Mexico or the number of fires that, because we just have so many dry days in Northern California, climate change has a different impact in different parts of the world. And, you know, people are interested in average climate change, but not really. You know, People want to know what climate change has an impact on them and their local economy and their agriculture and their water supply and the
Starting point is 00:25:53 quality of life and the impact of extreme weather and so on and so forth. And so we want to have a better understanding of the future of climate. And by doing that that the side effect is that the the algorithms the mathematics that we uh and the the way that we do computational physics uh can have a tremendous impact in just all other physical fields in reducing the amount of computation necessary to do it and so on the one hand we use um we have the ability to predict climate. On the other hand, we use less energy to predict climate. And so that artificial intelligence makes that possible. We had Bill Gates on the podcast recently, and he talked about a personal agent in a way like a digital personal assistant. How do you see that?
Starting point is 00:26:42 We'll have personal digital assistants. We'll have personal digital assistants. We'll have group digital assistants. Maybe we have a study group and we have a digital assistant to help us. We'll have a company digital assistants of all kinds. Somebody who is a digital assistant for HR,
Starting point is 00:26:59 somebody who is a digital assistant for IT, somebody who is a digital assistant for programming, somebody who assistant for programming, somebody who just wants to, you want to understand, you want to model our company's business or model the potential effectiveness of a new product or a new service. And so there'll be digital assistants of all kinds. How close are we now to artificial general intelligence? I think Microsoft said that they have seen some sparks of it.
Starting point is 00:27:28 What's going to happen here? Well, I'm anxious to see the paper. And it's 150 pages. And so I'm looking for it. I've downloaded it in one of these weekends. I'm going to go through it. Intelligence is about perception, reasoning, and planning. We have done an extraordinary job with perception, but we still have a long ways to go.
Starting point is 00:27:54 In order to really have, the goal of perception is to create a model of the world around you. A model of the world around you in a static form, but also in its dynamic form. You know, if I did this, what would happen to that? You know, we do this all the time. Today, the conversation is you're imagining, if you ask this question, it might lead to this answer, which leads to another question, which leads to another answer.
Starting point is 00:28:21 And we do this in human interaction. We do this in company and industrial interaction. We do this all the time. And we have a mental model. Some of it is supported by simulation, a mental model of how the world behaves. We have to go create that model of the world. And there's so many different worlds.
Starting point is 00:28:39 There's the world that is the human scale world, but there's the world that is molecular scale. There's the world that's atomic scale scale world, but there's the world that is molecular scale. There's the world that's atomic scale. And then there's, of course, there's the world that's galactic scale. Each one of these worlds are described sometimes by different physics, right? At some level, you have to go to quantum physics. And all of these, understanding these different worlds all matter. And so the first thing is just understanding the world.
Starting point is 00:29:07 The second part is how do you reason through problems in a way that achieves the objectives but are supportive and within the realms of your core values, your principles, keeping other people safe, that's explainable, interpretable, and that's in a transparent way. How do you reason through all of this with those things in mind? And then how do you come up with a plan that is efficient and cost effective? And all of the things that we do we do as as humans and and as industries and so those three those steps if you will um ai is making tremendous progress along that entire arc uh robotics is making great progress and and that's uh understanding the world and being able to to plan your your motion. We're making great progress in autonomous vehicles. We're making great progress. Chat GPT, obviously the fact that it can take a
Starting point is 00:30:14 problem that you described and be able to break it down into a computer program, obviously suggests it has the ability to reason through several steps. It might not be able to reason through as many conceptual steps as we can, but it's surely demonstrating the ability to do some early level reasoning. And so the progress is quite fast. Changing tack a bit and zooming in on the ethical side of this. Now, we just had a letter recently from a thousand really well-respected people who said it's time to slow down, think, and reassess.
Starting point is 00:30:52 What do you think about it? AI is a very powerful technology. And it's a very powerful technology because it can perform tasks and do things that are of great value. It can perform tasks and do things that are of great value. And technology that has this level of capability obviously can also be applied to do harm. And so regulation is necessary. We regulate cereal, for God's sakes. We should regulate AI.
Starting point is 00:31:30 And this technology, of course, is moving very quickly. And so it's sensible that regulators really have to get engaged and understand the technology to the best of their ability, but put some guardrails in, put some regulation in so that the technology can advance in a way that's helpful to society and not hurtful. Have we got any guardrails in place now? No, not really. Who should put them in place? Well, the same people that governments. There's really no choice but for governments to step in and regulate this. We regulate food. We regulate this. We regulate food.
Starting point is 00:32:07 We regulate drugs. We regulate transportation. We regulate industries, the creation of chemicals, the creation of materials that could be toxic. We regulate just about everything. We regulate electricity. We regulate communications. We regulate the broadcast of television. There are certain things that you can't broadcast. There should be certain things you can't generate. Generative AI generates information. There are certain things you can't generate. On the one hand, it's hard to regulate people expressing themselves because of open speech. However, it is possible to regulate what information you produce.
Starting point is 00:33:02 And so the regulation of the production of things, and now we're producing information using computers, you can regulate that. And there are many things that you can regulate. When you look at this arms race we are having now in AI and, you know, powered by your technology, are you afraid? Whatever power of technology there is, we should try to democratize it the best we can. If it were to land in the hands of one company, it's obviously less good than being available to everybody. It's less likely that in the near term that AI is going to displace our jobs. It's more likely that someone uses AI is going to displace our jobs.
Starting point is 00:33:42 And the same thing could be taken to all kinds of extremes. And so when a new technology that comes along that produces so much productivity gains, whether it's the steam engine or heavy machinery, it gave us superpower, a tractor gave us superpower, forklift gave us superpower human strength. And now we have this capability to give us amplifier intelligence and help us solve problems a lot more quickly. We've got to find a way to use that technology as soon as we can, but make sure that that technology is available to everybody who would like to use it and regulate it as soon as we can. You said it should be democratized.
Starting point is 00:34:30 And, of course, open AI was meant to be open, right? Now it's turning into a commercial product. You were more guarded when you talked about the specifications. You know, there is a lot less disclosure about the underpinnings of it. How do you read that? Well, that's a company choice of theirs, and they have the right to do that. In the meantime, there's a great deal of AI research that's still done in the open. The number of large language models that are available in the open is quite abundant. It's not about access to the technology that is keeping anybody
Starting point is 00:35:06 back. It's simply the willpower to go and the insight that the technology is at a very close to useful state. That insight was terrific. The insight that between GPT-2 and GPT-3 is a very useful product. The difference between a marginally useful product to an incredible useful product, that was a great insight. Those are the same insights that led to the iPhone or that led to the PC, that led to the internet. Before each one of those that led to Google search,
Starting point is 00:35:43 the insight that led to each one of those innovations is really about timing. Technology was invented early on, and it was even cultivating and brewing in certain circles for quite some time. And yet the innovators are the ones that realized the timing is now and to jump on it and industrialized it and turned it into a really great product. ChatGPT is unquestionably the single best software product the world's ever made. And by that definition, let me defend that. A great software product is something that does amazing things and surprisingly amazing things. And a great software product is also easy to use.
Starting point is 00:36:30 This is the easiest product to use on the planet. Anybody could use it. Over 100 million people have used it. And there's no instructional manual. You don't read anything. You just start typing into it. And if it's not sure what you meant, it asks you questions back and tells you that it's not sure. You just keep talking to it with whatever
Starting point is 00:36:51 language you use. And it produces amazing things, surprising things. It is the single most useful, best application the world's ever written. How is this going to change geopolitics? How is it going to change the relationship between the US and China? Well, hard to say. Hard to say. I think there's a genuine harm that can come from fake news that's being generated, fake information that's being generated. And that could cause real harm. The same harm that's currently happening in social media and fake news, and some of it is generated by human. Well, most of it is generated by human today. And so you could imagine that this AI has a better ability to detect human-generated fake news.
Starting point is 00:37:47 But this technology also has the ability to generate fake news. And so both of those possibilities exist in abundance. Changing tack here. Let's talk about the young Jensen. Who were you when you were young? Let's see. I was... I'm not saying you're not young still, but you were really young. Statistically, I'm on the other side of that hill. Let's see. I was focused. I was curious.
Starting point is 00:38:29 I was a perfectionist. I wanted to do everything well. I worked hard. I mean, I would say that those things characterize me. Do you think it's understood how much hard work that goes into great achievements? Oh, yeah. I mean, the amount of hard work. There's hard work and then there's much hard work that goes into great achievements oh yeah i mean the amount of hard work that there's hard work and then there's insanely hard work in order to in order to be and
Starting point is 00:38:53 where are you where are you and where are you on that scale i'm on on the insanely hard work you know i'm i'm what does that mean what does a day look like i i work every day there's not a day that goes by i don't work and if i I'm not working, I'm thinking about working. And when do you kick off in the morning? Well, you know, I wake up at five o'clock and the moment I wake up, I start working. And so I work every single day. There's not a day that goes by I don't work.
Starting point is 00:39:18 When do you go to bed? As early as possible. I'm in bed probably, but I'm asleep probably by 9.30. And I like my sleep and sleep is really important to me. What do you do to relax? What do you relax? I relax all the time. I enjoy relaxing at work.
Starting point is 00:39:35 Just working is relaxing for me. Solving problems is relaxing for me. Achieving something is relaxing for me. And the most relaxing, just hanging out with my family, doing anything is relaxing for me. I relax in a whole bunch of ways. Reading about things that's important to me is relaxing to me. So just hanging out with my family is relaxing. I relax in a lot of different ways.
Starting point is 00:40:03 I'm pretty relaxed. What do you read? Let's see. I just read Chip Wars. I skimmed through a lot of AI papers. I don't understand all of them, but I try to understand all of them. I try to read everything
Starting point is 00:40:21 that's of curiosity to me. You started Avidya in 93. You were 30 years old. If you were to boil down the essence of the success, what type of characteristics is it that the company has that makes it so successful? Your perspective about the future has to be on a fairly long arc, pretty important.
Starting point is 00:40:47 And it has to be somewhat directionally right. And we were, I would say, absolutely directionally right. Now, the question is, along that direction, there are a lot of different paths. And some of those paths would have been easier if you had better if we had better skills you know i didn't know how to be a ceo and nobody in the company knew how to build a company and we didn't even know what a pc looked like at the time i never even used one before and so there were a lot of things about about the company that uh the skills that that we didn't have we that we had to we had to develop those skills,
Starting point is 00:41:26 how to raise money, how to organize the company, how to recruit people. Those were all skills that we had to develop along the way. I think that those skills are probably, skills are learnable. I think the attitude of an entrepreneur and the attitude of somebody who does something new is how hard can it be? You know, and my attitude has always been, you know, how hard could it be to learn, learn PC? How hard can it be to build a company? How
Starting point is 00:41:54 hard can it be to hire people? How hard could it be to, to create an organization? It turns out all of those things were super hard. All of those things were super, it turned out it was super, super hard. But I think you want to go into it with the attitude, how hard can it be? And so when we got into the journey of artificial intelligence, we got into the journey of scientific computing, we got into the journey of autonomous vehicles, we started with the attitude, how hard can it be? And so if it's a solvable problem, how hard can it be? And we reasoned about everything from first principles. And if anybody could do it, I'm sure we could.
Starting point is 00:42:34 We could, and we'll just learn as fast as we can. And so I would say we didn't have any of those skills, but if I had to boil down what led the company to be successful, our vision was right. But the character of the company is probably the most important thing. The character of a company is what makes it ultimately successful. And how resilient is it? How does it deal with adversity? How does it deal with learning?
Starting point is 00:43:14 When it's presented with new assumptions, if the conditions change, how agile is the company? The world changed around us continuously. Those values, the learning, the agility, the ability to change, how do you install those values into the company? You talk about it. You teach it. You live it.
Starting point is 00:43:36 NVIDIA is really fortunate. As a long-term successful company, we have excellent chance. And the reason for that is because we suffered so greatly in the beginning. For the first 15 years of our company, it was one adversity after another. And after that, there were adversity after another, but the company was able to deal with it. The first 15 years, the adversity were incredible. Maybe five, six, seven times it was existential.
Starting point is 00:44:08 What's the key to coping with adversity? I think in the beginning of a company forming the corporate character, the corporate culture, it's people. It's the people's resilience. It's the character of the people there. Unfortunately, a company is made of people. It's the people's resilience. It's the character of the people there. Unfortunately, there's this, you know, a company is made of people and it's not made of the document that describes the culture. It's not made of the document that, you know, the inscription of the core values on the building. And that's not what makes the company's culture is the people and how the company overcame existential crises, how the company overcame the incredible adversity that was presented at the time, both in the agility of the people, the cleverness and the creativity of the people, the ingenuity of the people, and then also the will of the people,
Starting point is 00:45:07 the countless times that our company has been presented with challenges and the willpower, the utter incredible ability to suffer, willpower to be able to do something even in just extraordinary pain. That is corporate character. In 2003 at Stanford, you said, my will to survive exceeds almost everybody else's will to kill me. Yeah, right. Exactly. Where does that come from? Well, I think everybody's upbringing is unique to them. I've just always had that. I've just always had that.
Starting point is 00:45:46 You know, it's pretty hard to discourage me. And if I believe in something, I'm just going to, if I believe in it, I'm just going to keep on doing it until it's done, until we're great at it. It's hard to deter me. It's hard to distract me. It's hard to, you know, discourage me. And in my mind, it's always, how hard can this be? And it turns out, every time I say, how hard can this be? It turns out it's incredibly hard. And I'm surrounded by amazing people helping me. And it remains incredibly hard.
Starting point is 00:46:25 And last question, what is your advice to young people? Well, there are a lot of things to learn. I would advise be a learner. But probably the best advice that I can imagine is think from first principles. Don't worry about anybody else's advice. I've been given a lot of advice over the years. Some of it have been very good. Most of it has been irrelevant.
Starting point is 00:47:01 And the reason for that is because the advice was either an opinion, it was perspective of the time. It was based on on wrong assumptions. And my advice would be, you know, think for yourself. Think from first principles. And and and a lot of people say, you know, find something you love. I don't know about that. I guess I guess I've fallen fallen in love in many things that I
Starting point is 00:47:29 do. I loved it when I was a dishwasher. I loved it when I was a busboy. I loved it when I was delivering papers. I loved it when I was waiting tables. I've loved every single job that I've ever had. And I loved every single day at NVIDIA that I've ever had. And I just learned to love what I'm doing. And so I guess it's probably harder to find something that you love, but it's easier to fall in love with what you're doing. And once you fall in love with what you're doing, because you just desperately want to do a good job at it, it's easier to do it hard. It's easier to do it well and do it hard. Well, I think that's a beautiful place to end.
Starting point is 00:48:15 I have to say this has been one of the most intriguing and interesting conversations I ever had in my whole life. And I think, you know, when we look back at this time, 20 years from now, 30 years from now, you could potentially have been the person who's changed the world the most. I enjoyed our conversation, Nikolaj. Thank you so much. Thanks for the time. Thanks for the opportunity. Keep it up. Thanks.
Starting point is 00:48:35 All right. Take care.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.