In Good Company with Nicolai Tangen - Rerun: Jensen Huang Founder and CEO of Nvidia

Episode Date: July 10, 2024

Rerun:What’s the most important problems that AI can solve? How close are we to artificial general intelligence? And how can we use AI responsibly? Tune in and find out! The production team on ...this episode were PLAN-B’s Nikolai Ovenberg and Niklas Figenschau Johansen. Background research was done by Sigurd Brekke with additional input from our portfolio manager Richard Green.Watch the episode on YouTube: Norges Bank Investment Management - YouTubeWant to learn more about the fund? The fund | Norges Bank Investment Management (nbim.no)Follow Nicolai Tangen on LinkedIn: Nicolai Tangen | LinkedInFollow NBIM on LinkedIn: Norges Bank Investment Management: Administrator for bedriftsside | LinkedInFollow NBIM on Instagram: Explore Norges Bank Investment Management on Instagram Hosted on Acast. See acast.com/privacy for more information.

Transcript
Discussion (0)
Starting point is 00:00:00 Hi everyone. Now, given what's been going on in the world with AI and the incredible developments we've seen, and with the rocketing share price of NVIDIA, which at some stage was the largest company in the world, we have decided to rerun this podcast. It's one of the most interesting conversations I've ever had, and it's more topical than ever. We are back on the 7th of August with a total new lineup for the autumn. You will be amazed. Tune in. Jensen, a big thank you for taking the time today.
Starting point is 00:00:39 I have to say, I'm normally very excited when I record this podcast. But wow, when I did the preparation for this, incredible. You really are in the middle of all the important things which are happening in society just now. How does it feel? It is gratifying and rewarding. And I'm happy for our company to be able to contribute to so many different areas of science and society. And so it is a thrilling time. contribute to so many different areas of science and society. And so it is a thrilling time.
Starting point is 00:01:11 Now, you delivered, well, you hand-delivered, actually, the first supercomputer to open AI some years ago. Tell us about that. We were just getting into artificial intelligence ourselves, and we're working on autonomous vehicles. And so we were imagining what kind of computer has to be built for this new way of doing software. As the audience probably know by now, that artificial intelligence is a computer
Starting point is 00:01:38 that works with software programmers to write software that is refined from data. And that software is impossible for humans to write. It's a gigantic body of code. And it requires a special type of computer. And so when deep learning first came along, we reasoned about how it would fundamentally change computer science because the early effectiveness of of the first deep learning network that we that the industry a lot of people saw was AlexNet and AlexNet was designed for computer vision and its effectiveness was so incredible.
Starting point is 00:02:27 It shattered records and shattered the effectiveness of computer scientists of several decades. And it was a piece of software that required NVIDIA's GPUs to produce. And we were so inspired by that. We reasoned about what kind of computer, what kind of software is this? Where can it go? What kind of problems can it solve? And what is the implications to everything about computer science from chips to systems, to operating systems, to data centers, to networking, to the algorithms, all the way to applications. And we came to the conclusion that a new type of computer had to be created. And we created this new computer we call DGX. It's a deep learning system. And it's an AI
Starting point is 00:03:21 supercomputer, if you will. And I delivered the world's very first one when I announced it, that we were building it for ourselves. I thought that some people would be interested, but it turned out a lot of people were interested. And so I delivered the very first one outside of our own company to OpenAI. What were the big breakthroughs that you had to go through to get there? Well, the way that the software is written, it processes a giant amount of data to find patterns and relationships in the data. And the data is ones and zeros. relationships in the data. And the data is ones and zeros. And somehow using these architectures of deep learning models and the way that the deep learning neural network is constructed, it was possible to scale into very large models, very large networks,
Starting point is 00:04:22 and process a gigantic amount of data looking for patterns and relationships. And so the question is, what kind of computer would be good at that? And so we reasoned through the computer architecture and came to the conclusion that every aspect of the computer has to change from the way the processor is designed. Our GPUs, our graphics processors, which simulates the world, was almost a perfect starting point for understanding the world. A graphics chip that was designed to simulate the virtual world, as it turns out, is fairly good at understanding the world of mathematics. It's similar.
Starting point is 00:05:06 But yet, the size of the amount, the size of the data and the amount of computation necessary to do it, to find it, to go through all of that data is enormous. And so we broke it down chip by chip. And the CPU was no longer the ideal processor. And so we evolved our GPU to become a deep learning, if you will, a artificial intelligence processor. The PC architecture is suited for personal computing, but it's not suited for giant AI systems to learn from data. The IO has to change, the networking has to change. We bought a company called Mellanox so that we can
Starting point is 00:05:41 change the way computers are connected and the way computers can work together. Instead of maybe a handful of CPU cores working together, we have millions of GPU cores working together to process the data, define patterns, and to learn what is called a representation, to learn the language of the subject that you're trying to learn. You could be learning the language of music. You could be learning the language of language, human language, or the language of the world, the physical world, to learn computer vision.
Starting point is 00:06:22 We can learn proteins. We can learn chemicals. We can learn all kinds of things now. And all these things what were the biggest challenges well the biggest challenges um and it remains now is that the the problem space is gigantic whereas um an application for a phone can fit in a few gigabytes uh you know, or a PC, a few gigabytes. The software that we're talking about here, you know, ChatGPT is a hundred and, well, ChatGPT 3 is 175 billion parameters. And each one of the parameters could be a floating point number. And so 175 billion parameters just for the neural network math, not to mention the applications that sit around it. And so this is a giant application that doesn't fit in one PC, doesn't fit on any phone, doesn't fit on one PC.
Starting point is 00:07:17 And it takes many computers working together just to run it. It takes a giant data center to learn from it. And it takes an entire, you know, it takes a large number of computers just to run it. It takes a giant data center to learn from it. And it takes an entire, you know, it takes a large number of computers just to run it. And so this type of application has never existed before. And so every aspect was changed. We literally re-architected everything of computers that we know of from the ground all the way to the top and so now now these uh these ai computers are are unlike anything that we've ever built before and and because the performance the performance needed is so great it takes uh it takes weeks and weeks to um process the data so that we can learn from the data and learn its representation, learn
Starting point is 00:08:06 the model, if you will, the model of the subjects, the world model that you're trying to learn from the data. It takes so much time to train these models that if you could even shave half of the time off, it's measured in weeks. You mentioned GPT-3. What's the progress from three to four, just in terms of complexity? Well, the complexity is hard to estimate because OpenAI hasn't really described it, but there's a great number of new breakthroughs. One of the ones is the fact that it can learn from both
Starting point is 00:08:38 language and images at the same time. Just as with humans, we learn more about anything if we could see, if we could read the words and see the images. And one good example is if you've only seen horses and you've never seen a zebra, but I told you that a zebra is like a horse, but with black and white stripes. The fact that you have knowledge of both modalities, images and language allows you to connect the two and learn something in your brain, even though you imagine a zebra in your brain, even though maybe you've never seen one actually. And so the ability for us to learn from multi-modality is very important and GPT-4 has learned that capability. You mentioned recently that we have now reached the iPhone moment for artificial intelligence.
Starting point is 00:09:39 What do you mean by that? Over the last 40 years or so that I've been in the computer industry, we transitioned. We phase shifted at first slowly and all of a sudden abruptly, just like water turning to ice or water turning to vapor. At first, the temperature kind of, you know, increases linearly. And then all of a sudden at some phase shift, the structure of the molecule changes all of a sudden and instantly something happens. It happened when we went from many computers and workstations, client servers to personal computers.
Starting point is 00:10:26 The very first four or five years, it grew linearly. All of a sudden, Windows 95 came and everything about the personal computer changed. And yet the personal computer was introduced some 10 years before that. And the same thing happened with the Internet. was introduced some 10 years before that. And the same thing happened with the internet. The first five, six, eight years, scientists and researchers were already using the internet.
Starting point is 00:10:56 And then all of a sudden, one day, Mosaic came along, Yahoo came along, and bam, there's a phase shift in the way that the internet was perceived and used. In every single one of these transitions, then cloud, then the iPhone, the mobile cloud, in each one of these transitions, the computer itself is programmed differently. It's easier to program. Let me give you one example. The number of mainframe applications in the world is not that many, but the number of iPhone applications is over 5 million. And so the fact that there are so many applications must suggest that it's easier to create amazing applications. And it's absolutely true. The applications we have on iPhones and the mobile devices is surely beyond expectation, beyond imagination just 30
Starting point is 00:11:46 years ago. And yet, people are creating these applications, obviously, very, very quickly. And so the programming model has changed. The application capability has changed. And the reach of the computing has changed. And so let's apply that to GPT. Let's apply that to artificial intelligence as we know it. The way that you program this is just with human language. This is the only computer, this first computer in the history of humanity that everyone can program the computer to do something.
Starting point is 00:12:22 And there's no programming language. You don't have to use BASIC. You don't have to use FORTRAN, PASCAL, C, C++, Java. You don't have to use BASIC. You don't have to use Fortran, Pascal, C, C++, Java. You don't have to use any of those programming languages. Python, you don't have to learn anything. Which is really good because I tried to learn Python last year and it didn't quite work out to the extent that I now have to sing at the summer party.
Starting point is 00:12:38 The number of programmers in the world just increased from tens of millions to several billion. And so we've narrowed, if you will, we've democratized computers, we've democratized computer programming, and we've closed the gap between the have and the have not access to technology. The technology divide has now been closed. What are the implications of this democratization? When you democratize technology and you put it in the hands of almost everybody, you empower everyone. Look at the number of applications that are coming out now that are based on ChatGPT,
Starting point is 00:13:17 where people are connecting it to applications, making the applications better. People are using it to write stories, create music, write programs. So instead of writing a program, you tell ChatGPT to help you write a program. You tell it that the problem you're trying to solve and it writes you a Python program, or it writes you a SQL query. And it might even, well, it even creates a website for you. And so if you want to go into business and you don't know how to create a website, you can now just tell JachiBD to help you create a website.
Starting point is 00:13:49 You describe what you want and it connects it all up for you and it's operating. And so here's a computer that can help you write programs, solve problems, empower you. And so that's one of the greatest things of democratization of technology. We've now put this amazing tool in the hands of everyone. What do you think it would do to society?
Starting point is 00:14:06 Well, the first thing that's going to happen is our productivity will go up. Any profession that relies on knowledge and the access of knowledge, the application of knowledge will now be boosted. And so if you have domain knowledge, and most companies in the world has very, very deep domain knowledge, it's the reason why they're a company. Their domain knowledge can now be put in the hands of their employees
Starting point is 00:14:37 and applied and accessed and applied in a much more rapid way. Of course, there's a lot of mundane information tasks that are now, if you will, commoditized and it's automated. One of the things that's really incredible about artificial intelligence, and the reason why this is definitely going to be the next industrial revolution, is instead of producing steam to electricity, instead of mass producing physical things, we are now going to be producing the most valuable asset, the most valuable commodity that we know as society, information, knowledge.
Starting point is 00:15:20 And so the production of intelligence is going to be what all companies do in the future. We have, NVIDIA has AI factories. We put data into it and improved software. And the software is artificial intelligence. Improved intelligence software comes out every single day. I go to sleep and it keeps producing it. And we keep refining more data we keep improving the the software the software helps us design chips it helps us operate robots like self-driving
Starting point is 00:15:53 cars it helps us do computer vision for quality inspection it helps us develop software that helps us you know design and manufacture chips better and so every company will be able to do that for their own particular domain so i think the the next industrial revolution is going to be about the the production of intelligence and and for for industries that relies on intelligence our productivity will be insanely boosted and of course there will be some jobs that will be changed. There'll be some jobs that will be created. Right now, we're creating a whole lot of jobs for artificial intelligence data scientists
Starting point is 00:16:30 and people who understand this field. Of course, some jobs will be displaced. And so we have to make sure that as a society that we understand what this technology is and take advantage of it as fast as we can so that we understand what this technology is and take advantage of it as fast as we can so that we understand it and apply it to social benefits. How much do you think productivity could increase on the back of this? Well, there's a few ways we can measure it. So let me give you a couple examples. One of the hardest things that we do in our company is designing chips. The chips that we
Starting point is 00:17:06 build are the largest chips, the most complex chips the world builds today. No singular entity builds such large, enormous semiconductor chips. And these chips are simply impossible to build anymore without artificial intelligence. And the reason for that is because the number of transistors and the way that we can connect up those transistors, the combinations is just so insanely great. And because so many people work on it, the optimization of the mathematics, the optimization of how to place, it's kind of like imagine a New York City, but it's a thousand times bigger than New York City. And you're trying to figure out how to organize New York City from the ground up such that it is the most optimal placement of every single building. And then you
Starting point is 00:18:04 have to understand which, you know, where the traffic goes from building to building. You have to understand which buildings are associated with other building and, you know, what buildings are necessary to support certain buildings and certain infrastructure. Where do you put the parks? Where do you put the restaurants? It's insanely complicated, as you can imagine. You know, it's the number of combinations is off the charts and we can't solve these problems anymore without artificial intelligence. So on the one hand, It's insanely complicated, as you can imagine. You know, it's the number of combinations is off the charts. And we can't solve these problems anymore without artificial intelligence. On the one hand, it lets us do things that we can't otherwise do.
Starting point is 00:18:33 Another hand, let me give you another example. We use artificial intelligence right now to try to better understand climate change, you have to simulate the weather a lot more quickly because you're trying to further extrapolate the implications of climate out in the distance, not just tomorrow, but ideally next month, next year, next 10 years, next 30 years. 10 years, next 30 years. So in order to do that, we have to do weather simulation a lot, lot faster. And so we've created artificial intelligence that helps us simulate the multi-physics of weather. And we're already simulating weather now 10,000, 50,000 times faster than using numerics. And so that's another way of thinking about productivity. When you can do something 10,000 times faster, you're doing it 10,000 times faster. One last example, the single greatest expense in our company is software engineers. And now with Microsoft's co-pilot, and they've estimated that some 40, 50% of the software that's now written in GitHub is produced by AI. It's a little bit like text completion.
Starting point is 00:19:49 It's a little bit like grammar correction in our word editing documents, except this is for program completion. And so the AI can suggest, based on what you've already written and what you intend to write, it can write the program for you. So if you could imagine the single most expensive population at NVIDIA is now amplified by a factor of two. That's incredible. And so our estimate is we're going to improve the productivity of our engineers by a factor of 10. When you talked about complexity being a thousand times the complexity of New York City, that you put in on what kind of area? How big is one of the chips? Rich chips are probably,
Starting point is 00:20:34 comparing it to a stamp, it's a couple of inches per side. And what is a couple of inches per side. And what is what is a couple of inches per side, it's kind of like a, it's smaller than a coffee, you know, coffee cup, a coaster, probably, you know, probably a two thirds the area of a coaster, if you will, just to get put in perspective, the RD budget for it is probably something like $5 billion. And then, you know, it costs more to build one of these generations
Starting point is 00:21:08 than, for example, to build a rocket. And, you know, the R&D budget is very high. When you put together everything you said about productivity gains, when you look at the whole society, how do you think this could drive productivity gains in the whole society if you were to put a number on it? I don't know how to do that. But one thing for sure, the countries that don't have the richness of computer scientists and haven't benefited as greatly from the enormous capabilities of computers, this should be a reckoning moment for them. This should be just an extraordinary opportunity for them. The up and coming economies,
Starting point is 00:21:57 the up and coming industries, I think India, Southeast Asia, Africa, these are regions and economies that I think has a real benefit from artificial intelligence enhancing the capabilities of the entire industry and their economy and then driving productivity to the limits. productivity to the limits. And so I think for the rest of the world, for the developed countries, the ability to reduce costs is incredible, not to mention accelerating everything that we do. So when you look at the most important problems that AI will solve over the next five to 10 years, what are they?
Starting point is 00:22:39 One of the most important ones is digital biology, drug discovery. Just as we've learned the language of humans, we've now learned the language of proteins. And we've learned how to understand proteins, and we've learned how to, from the desired function, a protein is a machine, the biological machine, the way that it's connected, the amino acids, the chain of amino acids, and the way that it comes together, the 3D shape of that protein determines its mechanical functionality, if you will. It's kind of like the difference between the shape of a motorcycle and the shape of a car
Starting point is 00:23:20 and the shape of a unicycle. The fact that they're different shapes, their functionality is different. A plier and hammer, the functionality is different because of their shape. And so proteins have different shapes and different functions. We can now, from the desired function of a protein, synthesize other proteins, other potential proteins that have properties that are maybe better for temperature or better ability so that we could it goes into our bloodstream better or maybe we can use it to synthesize energy from light maybe we can break down plastics maybe it could break down oil leaks in the ocean or whatever the interesting problem is. We can now use
Starting point is 00:24:06 protein machinery and protein engineering to go help solve that problem. I think that that's tremendous and incredible potentials. We can understand the language of chemicals. Now that you can understand chemicals and proteins, you can understand their interactions and do a better job discovering drugs. You know, drug discovery still costs enormous amounts of money. It takes a very long period of time and our success rate is very low. And so now we can improve the odds of that. And so drug discovery is one. both in understanding the impact of human factors to climate change, predicting climate change and the climate effects in regional climate impact,
Starting point is 00:25:04 whether it's extreme weather in the Gulf of Mexico or the number of fires that, because we just have so many dry days in Northern California, climate change has a different impact in different parts of the world. And, you know, people are interested in average climate change, but not really. You know, people want to know what climate change has an impact on them and their local economy and their agriculture and their water supply and the quality of life and the impact of extreme weather that we, and the way that we do computation of physics can have a tremendous impact in just about all other physical fields in reducing the amount of computation necessary to do it. And so on the one hand,
Starting point is 00:25:56 we have the ability to predict climate. On the other hand, we use less energy to predict climate. And so that artificial intelligence makes that possible. we use less energy to predict climate. And so that artificial intelligence makes that possible. We had Bill Gates on the podcast recently, and he talked about a personal agent in a way like a digital personal assistant.
Starting point is 00:26:16 How do you see that? We'll have personal digital assistants. We'll have group digital assistants. Maybe we have a study group and we have a digital assistant to help us we'll have a company digital assistants of all kinds somebody who is a digital assistant for HR somebody who's a digital assistant for IT somebody digital assistant for you know for programming somebody who just wants to you you want to understand, you want to model our company's business or model the potential effectiveness of a new product or a new service. And so there'll be digital assistants of all kinds. How close are we now to
Starting point is 00:26:57 artificial general intelligence? I think Microsoft said that they have seen some sparks of it. I think Microsoft said that they have seen some sparks of it. What's going to happen here? Well, I'm anxious to see the paper. And it's 150 pages. And so I'm looking for it. I've downloaded it, and one of these weekends I'm going to go through it. Intelligence is about perception, reasoning, and planning. We have done an extraordinary job with perception, but we still have a long ways to
Starting point is 00:27:28 go. The goal of perception is to create a model of the world around you. A model of the world around you in a static form, but also in its dynamic form. If I did this, what would happen to that? We do this all the time. Today, the conversation is you're imagining if you ask this question, it might lead to this answer, which leads to another question, which leads to another answer. And we do this in human interaction. We do this in company and industrial interaction. We do this all the time. And we have a mental model. some of it is supported by simulation a mental model of how the world behaves uh we have to go create that model of the world and there's so many different worlds there's the world that is the the human scale
Starting point is 00:28:17 world but there's the world that is molecular scale there's the world that's atomic scale and then there's of course there's the world that's atomic scale. And then there's, of course, there's the world that's galactic scale. Each one of these worlds are described sometimes by different physics, right? At some level, you have to go to quantum physics. And all of these, understanding these different worlds all matter. And so the first thing is just understanding the world. The second part is how do you reason through problems in a way that achieves the objectives but are supportive and within the realms of your core values, your principles, keeping other people safe, that's explainable, interpretable, and that's in a transparent way. How do you reason through all of this with those things in mind? And then how do you come up with a plan that is efficient and cost effective? And all of the things that we do, we do as humans and as industries.
Starting point is 00:29:25 we do as humans and as industries. And so those three, those steps, if you will, AI is making tremendous progress along that entire arc. Robotics is making great progress, and that's understanding the world and being able to plan your motion. We're making great progress in autonomous vehicles. We're making great progress. ChatGPT, obviously the fact that it can take a problem that you described and be able to break it down into a computer program, obviously suggests it has the ability to reason through several steps. It might not be able to reason through as many conceptual steps as we can, but it's surely demonstrating the ability to do some early-level reasoning. And so the progress is quite fast.
Starting point is 00:30:13 Changing tack a bit and zooming in on the ethical side of this, now we just had a letter recently from 1,000 really well-respected people who said it's time to slow down, think, and reassess. What do you think about it? AI is a very powerful technology. And it's a very powerful technology because it can perform tasks
Starting point is 00:30:36 and do things that are of great value. And technology that has this level of capability obviously can also be applied to do harm. And so regulation is necessary. We regulate cereal, for God's sakes. We should regulate AI. And this technology, of course, is moving very quickly, and so it's sensible that regulators really have to get
Starting point is 00:31:06 engaged and understand the technology to the best of their ability, but put some guardrails in, put some regulation in so that the technology can advance in a way that's helpful to society and not hurtful. Have we got any guardrails in place now? No, not really. Not really. Who should put them in place? Well, the same people that governments. There's really no choice but for governments to step in and regulate this. We regulate food.
Starting point is 00:31:42 We regulate drugs. We regulate food, we regulate drugs, we regulate transportation, we regulate industries, the creation of chemicals, the creation of materials that could be toxic. We regulate just about everything. We regulate electricity, we regulate communications, we regulate the broadcast of television. There are certain things that you can't broadcast. There should be certain things you can't generate. Generative AI generates information. There are certain things you can't generate. On the one hand, it's hard to regulate people expressing themselves because of open speech.
Starting point is 00:32:24 However, it is possible to regulate what information you produce. And so the regulation of the production of things, and now we're producing information using computers, you can regulate that. And there are many things that you can regulate. When you look at this arms race we are having now in AI and, you know, powered by your technology, are you afraid? Whatever power of technology there is, we should try to democratize it the best we can. If it were to land in the hands of one company, it's obviously less good than being available to everybody. than being available to everybody. It's less likely that in the near term that AI is going to displace our jobs.
Starting point is 00:33:16 It's more likely that someone uses AI is going to displace our jobs. And the same thing could be taken to all kinds of extremes. And so when a new technology that comes along that produces so much productivity gains, you know, whether it's the steam engine or heavy machinery, it gives it gave us superpower, a tractor gave us superpower, forklift gave us superpower human strength. And now we have this capability to give us amplifier intelligence and help us solve problems a lot more quickly. We've got to find a way to use that technology as soon as we can, but make sure that that technology is available to everybody who would like to use it and regulate it as soon as
Starting point is 00:34:02 we can. You said it should be democratized, and of course, OpenAI was meant to be open, right? Now it's turning into a commercial product. You were more guarded when you talked about the specifications. You know, there is a lot less disclosure about the underpinnings of it.
Starting point is 00:34:20 How do you read that? Well, that's a company choice of theirs, and they have the right to do that. And in the meantime, there's a great deal of AI research that's still done in the open. The number of large language models that are available in the open is quite abundant. And so it's not about access to the technology that is keeping anybody back is simply the willpower to go. And the insight that the technology is at a very close to useful state, that insight was terrific. The insight that between GPT-2 and GPT-3 is a very useful product.
Starting point is 00:34:59 The difference between a marginally useful product to an incredible useful product, that was a great insight. Those are the same insights that led to the iPhone or that led to the PC, that led to the internet. Before each one of those that led to Google search, the insight that led to each one of those innovations is really about timing. You know, technology was invented early on
Starting point is 00:35:28 and it was even cultivating and brewing in certain circles for quite some time. And yet the innovators are the ones that realized the timing is now and to jump on it and industrialized it and turned it into a really great product. ChatGPT is unquestionably the single best software product the world's ever made. And by that definition, let me defend that.
Starting point is 00:35:56 A great software product is something that does amazing things and surprisingly amazing things. And a great software product's also easy to use. This is the easiest product to use on the planet. Anybody could use it. You know, over 100 million people have used it. And there's no instructional manual. You don't read anything.
Starting point is 00:36:15 You just start typing into it. And if it's not sure what you meant, it asks you questions back and tells you that it's not sure. You just keep, you know, talking to it with whatever language you use. And it produces amazing things, surprising things. It is the single most useful, best application the world's ever written. How is this going to change geopolitics? How is it going to change the relationship between the US and China? Well, hard to say. Hard to say. I think
Starting point is 00:36:45 there's a genuine harm that can come from fake news that's being generated, fake information that's being generated. And that could cause real harm. The same harm that's currently happening in in social media and and uh fake news and um some of it is generated by human uh um well most of it is generated by human today and so so um uh you could imagine that that this ai has a better ability to detect human generated fake news um but this technology also has the ability to generate fake news. And so both of those possibilities exist in abundance. Changing tack here. Let's talk about the young Jensen. Who were you when you were young? Let's see about the young Jensen. Who were you when you were young? Let's see.
Starting point is 00:37:46 I was... I'm not saying you're not young still, but you were really young. Statistically, I'm on the other side of that hill. Let's see. I was focused. I was curious. I was a perfectionist. I wanted to do everything well.
Starting point is 00:38:10 I worked hard. I mean, I would say that those things characterize me. Do you think it's understood how much hard work that goes into great achievements? Oh, yeah. I mean, the amount of hard work. There's hard work, and then there's insanely hard work. In order to be… and where are you and where are you on that scale i'm on on the insanely hard work you know i'm what does that mean what does a day look like i i work every day there's not a day that goes by i don't work and if i'm not working i'm thinking about working and
Starting point is 00:38:41 when do you kick off in the morning well you know i wake up at five o'clock and and uh the moment i wake up i start working and so i work i work every single day there's not a day that goes by i don't work when do you go to bed as early as possible i i um i'm in bed probably but i'm asleep right by 9 30 and i i like my sleep and and uh sleep is really important to me what do you do to relax? What do you relax? I relax all the time. I enjoy relaxing at work. Just working is relaxing for me.
Starting point is 00:39:14 Solving problems is relaxing for me. Achieving something is relaxing for me. And the most relaxing, just hanging out with my family, doing anything is relaxing for me. I relax in a whole bunch of ways. I'm reading about things that's important to me is relaxing to me. So just hanging out with my family is relaxing. I relax in a lot of different ways.
Starting point is 00:39:39 I'm pretty relaxed. What do you read? Let's see. I just read Chip Wars. I skimmed through a lot of AI papers. I don't understand all of them, but I try to understand all of them. I try to read everything that's of curiosity to me. You started NVIDIA in 93. You were 30 years old. If you were to boil down the essence of the success, what type of characteristics is it that the company has that makes it so successful? Your perspective about the future has to be on a fairly long arc, pretty important. And it has to be somewhat directionally right. And we were, I would say,
Starting point is 00:40:28 absolutely directionally right. Now, the question is, along that direction, there are a lot of different paths. And some of those paths would have been easier if we had better skills. I didn't know how to be a CEO and nobody in the company knew how to build a company. And we didn't even know what a PC looked like at the time. I never even used one before. And so there were a lot of things about the company that the skills that we didn't have, that we had to develop those skills. how to raise money, how to organize the company, how to recruit people. Those were all skills that we had to develop along the way. I think that those skills are probably skills are learnable. I think the attitude of an entrepreneur and attitude of somebody who does
Starting point is 00:41:20 something new is how hard can it be? And my attitude has always been, how hard could it be to learn PC? How hard can it be to build a company? How hard can it be to hire people? How hard could it be to create an organization? It turns out all of those things were super hard. All of those things were super, it turned out it was super, super hard. But I think you want to go into it with the attitude, how hard can it be? And so when we got into the journey of artificial intelligence, we got into the journey of scientific computing, we got into the journey of autonomous vehicles, we started with the attitude, how hard can it be? And so if it's a solvable problem, how hard can it be? And we
Starting point is 00:42:02 reasoned about everything from first principles. And if anybody could do it, I'm sure we could. We could. And we'll just learn as fast as we can. And so I would say we didn't have any of those skills. But if I had to boil down what led the company to be successful, our vision was right. But the character of the company is probably the most important thing. The character of a company is what makes it ultimately successful. And how resilient is it? How does it deal with adversity? How resilient is it? How does it deal with adversity?
Starting point is 00:42:47 How does it deal with learning? When it's presented with new assumptions, if the conditions change, how agile is the company? The world changed around us continuously. Those values, the learning, the agility, the ability to change, how do you install those values into the company? You talk about it. You teach it. You live it. NVIDIA is really fortunate. As a long-term successful company, we have excellent chance. And the reason for that is because we suffered so greatly in the beginning. For the first 15 years of our
Starting point is 00:43:25 company, it was one adversity after another. And after that, there were adversity after another, but the company was able to deal with it. The first 15 years, the adversity were incredible. Maybe five, six, seven times it was existential. What's the key to coping with adversity? I think in the beginning of a company forming the corporate character, the corporate culture, it's people. It's the people's resilience. It's the character of the people there. Unfortunately, a company is made of people, and it's not made of the document that describes the culture. It's not made of the document that, you know, the
Starting point is 00:44:11 inscription of the core values on the building. And that's not what makes the company's culture is the people and how the company overcame existential crises, how the company overcame the incredible adversity that was presented at the time, both in the agility of the people, the cleverness and the creativity of the people, the ingenuity of the people, and then also the will of the people, the countless times that our company has been presented with challenges and the willpower, the utter incredible ability to suffer, willpower to be able to do something even in just extraordinary pain. That is corporate character. In 2003 at Stanford, you said, my will to survive exceeds almost everybody else's will to kill me. Yeah, right. Exactly. Where does that come from?
Starting point is 00:45:09 Well, you know, I think everybody's upbringing is unique to them. I've just always had that. You know, it's pretty hard to discourage me. hard to discourage me. And if I believe in something, I'm just going to, if I believe in it, I'm just going to keep on doing it until it's done, until we're great at it. It's hard to deter me. It's hard to distract me. It's hard to discourage me. And in my mind, it's always, how hard can this be? And it turns out, every time I say, how hard can this be? It turns out it's incredibly hard. And I'm surrounded by amazing people helping me.
Starting point is 00:45:55 And it remains incredibly hard. And last question, what is your advice to young people? Well, there are a lot of things to learn. I would advise, be a learner. But probably the best advice that I can imagine is think from first principles. Don't worry about anybody else's advice. I've been given a lot of advice over the years. Some of it have been very good. Most of it has been irrelevant. And the reason for that is because the advice was either an opinion, it was perspective of the time, it was based on wrong assumptions. And my advice would be, think for yourself, think from first principles. And a lot of people say, find something you love.
Starting point is 00:46:57 I don't know about that. I guess I've fallen in love in many things that I do. I've fallen in love in many things that I do. I loved it when I was a dishwasher. I loved it when I was a busboy. I loved it when I was delivering papers. I loved it when I was waiting tables. I've loved every single job that I've ever had. And I loved every single day at NVIDIA that I've ever had.
Starting point is 00:47:27 And I just learned to love what I'm doing. And so I guess it's probably harder to find something that you love, but it's easier to fall in love with what you're doing. And once you fall in love with what you're doing, because you just desperately want to do a good job at it, it's easier to do it well and do it hard. Well, I think that's a beautiful place to end. I have to say this has been one of the most intriguing and interesting conversations I've ever had in my whole life. And I think, you know, when we look back at this time, 20 years from now, 30 years from now, you could potentially have been the person who's changed the world the most. I enjoyed our conversation, Nikolaj.
Starting point is 00:48:05 Thank you so much. Thanks for the person who's changed the world the most. I enjoyed our conversation, Nikolaj. Thank you so much. Thanks for the time. Thanks for the opportunity. Keep it up. Thanks. All right. Take care.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.