Endgame with Gita Wirjawan - Kai-Fu Lee: The Future of Humanity in a World of AI

Episode Date: October 7, 2026

“I didn’t imagine it would become this powerful.”If you’re looking for the world’s leading voices on AI, Kai-Fu Lee is among them. Former President of Google China, founding director of Micr...osoft Research Asia, and a pioneer in speech recognition at Apple, Kai-Fu Lee joins us to share his perspective on the rapid rise of artificial intelligence and what it means for our future.The conversation spans Taiwan’s transformation into a hub for scientific and technological talent, the forces behind AI’s remarkable rise, the future of China’s open-source AI ecosystem, and the economic and social changes AI could bring. We also explore a deeper question: as AI becomes increasingly capable, what remains uniquely human?#Endgame #GitaWirjawan #KaiFuLeeFull topics:00:04:33- What made Taiwan's great scientists00:10:16 - AI helps understand humanity better00:14:36 - Times in Apple and Microsoft Research China00:26:16 - Will China’s AI remain open source?00:44:16 - AI hallucination & critical thinking00:50:31 - Is STEM a structural challenge for AI development01:05:26 - AI, jobs, cost of labor01:24:06 - How tumor changed his life 01:31:16 - AI can’t take responsibility------------------Read Kai-Fu Lee's books:AI 2041: Ten Visions for Our Future - https://www.periplus.com/p/9780593238318AI Superpowers: China, Silicon Valley, and the New World Order - https://www.periplus.com/p/9780358105589Get your copy of Gita Wirjawan’s book, “What It Takes: Southeast Asia”, NOW:https://books.endgame.id/Also available on Amazon:https://sgpp.me/amazon/Leave your review here:www.goodreads.com/book/show/241922036-what-it-takes

Transcript
Discussion (0)
Starting point is 00:00:00 When AI becomes smarter than us, what's left? The danger is not going, that you can't go from a follower country to a leader country, but that you might fall from a follower country into a trampled on country. How do you think the narrative of Southeast Asia becoming a stakeholder of AI could be assured? So I think one is enlightened leadership, or one that, will listen and believe an expert or a group of experts. The second possibility is... Hi, friends, it's a pleasure to tell you that my book,
Starting point is 00:01:03 What It Takes Southeast Asia, has been released in English and Bahasa Indonesia. You can buy it through books.endgame.ID or at any of these stores. Now back to the show. Hi, friends. Today, we're honored to be graced by Dr. Kai Fu Lee. who's one of the world's few leading experts on AI, and he's also the founder, CEO, and chairman of 01.aI.ai Fu, thank you so much. Hi, thank you, Keda, for inviting me.
Starting point is 00:01:34 Yeah, it's good to see you again in such a short span of time. I want to probe a little bit about how you grew up. You've grown to be a high-quality intellectual, and then you professed an AI for decades, already, but what influenced you at early age as to study and to pursue science? Yeah, well, I was born in Taiwan, so spent about basically my elementary school, six years there. And I think what was helpful is it was the very Chinese-driven, competitive environment, which built a good foundation. But I really didn't really knew I could love a subject.
Starting point is 00:02:24 And then as I went to U.S. from my middle school, I found that my math was really outstanding. In retrospect, probably because I was drilled too much knowledge into my head and memorized too many things. But it gave me confidence that, hey, I'm really good at math. This is interesting. This is fun. better than a lot of the other kids.
Starting point is 00:02:49 The teacher wants me to help out. And then I started taking university courses in high school. So that gave me a lot of interest in math. And also in high school, I was very lucky. This was in the 1970s. My high school actually had a computer. It was a retired IBM 360. And I got to learn to program in high school.
Starting point is 00:03:14 And that's when I said, hey, this is even better than math. And so I went to Columbia undergraduate and went into, initially as a math major, then switched to a computer science major. And really, I just thought computer science was a lot of fun. I can make computer do things. But what's even better than that was my sophomore year and junior year. I took two classes on artificial intelligence, one on natural language processing, one on computer vision, and both were so fascinating that I thought this had to be it. It's not just computer science.
Starting point is 00:03:55 It's this very new, then very new field called artificial intelligence, which encompasses both natural language processing and computer vision. So that was when I really embarked on that journey, which has not ended even as of now. Still continuing on the last mile as AI is about to become super intelligent. Wow. Just to go back a little bit, Taiwan is known for producing so many high-quality scientists, right? What do you think would have made Taiwan good in allowing for? that scientific discovery to permeate into society? I'm not sure about any one reason, but I think there's a series of reasons.
Starting point is 00:04:50 In 1949, many people went from mainland to Taiwan, and these are sort of the elites of the previous, the administration that was running mainland China, which then went to run Taiwan. And when you move that many people, these are top governmental officials, top doctors, top, you know, businessmen. So it may just have a significant, a small advantage in the gene pool because it kind of took the successful people who cited. on the losing side, but nevertheless successful and smart people. That may have been one small reason. If you look at my own background, I'm not sure about Jensen Huang, Lisa Su, Jerry Yang.
Starting point is 00:05:45 These, they may or may not have similar backgrounds, but certainly my father was a senior official in the government, and that may have been one of the reasons. But I think another reason is that. that actually the Taiwan education system combined a lot of good things from the Chinese education system, but also, I think, imported some aspects of the Japanese approach. And I think also maybe a little bit for people younger than me, maybe more for Jerry Yang than myself or Steve Chen, who was even younger. But maybe for them, it was the very successful Taiwanese government policy about making the bet on the Xinju Science Park, which then led to the Taiwan Semiconductor.
Starting point is 00:06:47 I think that was a very, very prescient decision made by the Minister of Finance, I think, same position you had, Li Gording. and his boss, Sun Yunxuan. And they were very pro-tech, pro-business. And they studied a lot about what's the most exciting area and decided a semiconductor was it. And then they recruited Morris Chang at an unheard-of, $1 million a year package. Back then, this is probably like at least 50, if not $100 million today.
Starting point is 00:07:27 Right. And brought him into the government. So government paying this high a salary because he led the Shinju Science Park before spinning off with a Taiwan semiconductor. So they made huge exceptions to find the right leader to basically begin the dawn of the semiconductor industry in Taiwan. And then, of course, many other companies followed. So having Morris Chang as a role model, I think, pushed a lot of people into engineering. And also Taiwan's education system is very much like, it's just like China's. It's a, it was a basically a single universal exam, and your grade determines what school and department you go into.
Starting point is 00:08:14 And people really fought hard to get into the best departments, which of course was the electrical engineering department of National Taiwan University and the Chin Hua University. And then, of course, the job they get after that is go do great things at Taiwan Semiconductor. So this creates a virtual cycle, a role model that says, hey, high tech is interesting. It's exciting. It's lucrative. It pays well. Stock options are worth a lot of money in Taiwan Semiconductors. And this was 30 years ago.
Starting point is 00:08:51 So I think it created a Silicon Valley-like system of, of, um, um, of, um, um, um, attraction and a system of advancement and also created a lot of respect for people. If you go out and say, what do you do? I'm an engineer and, you know, people are proud to be that. I think that was what got Taiwan to go off to a good start. Well, you know, it's amazing how Taiwan was able to show great degree of open-mindedness. You know, as I've kind of chatted with you a few weeks ago, you know, there's, there's four ways to cultivate brain or talent, right? The first one is brain train, which is really
Starting point is 00:09:34 hinging on a lot of talent indigenity, and that's probably manifested in Japan. And the second one is brain gain and how you show open-mindedness. You open the gate the way Taiwan, China, Singapore, America, Australia. And then the third is brain circulation, which is pretty much what China has done by sending more than 9 million people in the last 50 years all over the world. And then the last one is brain linkage, which has manifested in India, which has sent more than 7 million people. And there's all kinds of ways. And I'm just always looking for ideas and ways as to how Southeast Asia could do better scientifically, academically, as it relates to how the evolution of the world is becoming much more exponential.
Starting point is 00:10:23 I want to dig back to your educational journey. You decided to go to Carnegie, Melon. What did you see as to pursue artificial intelligence? Were you that prescient about the future as we're seeing today in the context of how AI has permeated into so many ways the way we live? I think it was more fascination and optimism than prescience. that I just saw this artificial intelligence, I thought it would be the final step for humanity to understand itself. Basically, I assumed we would study how the brain works, writing it in computer algorithms, and then one day it gets as smart as humans, then in doing
Starting point is 00:11:13 so we learn how intelligence works. So that was what drove me, and that's what I wrote in my application letter to Carnegie Mellon. And what I learned that, now today is that, interestingly, humanity's final step to understand ourselves, that part is correct. But the process of how to get there was completely wrong. It turns out we, the AI community, build a machine that is different from the human brain structure. Maybe inspired by it, but it works differently. It doesn't want to be taught by humans. It wants to use mathematics to map data to data.
Starting point is 00:11:53 data. And that's called machine learning, it's called neural networks, deep learning, large language models, all in the same family. So that's what beat every other approach. And that was the path I did in my PhD thesis, but I didn't imagine it would become this powerful. And I think we underestimated how much data we had and how much compute we will have, which is what led to the large, language model revolution and the fact that, you know, we're basically at the footsteps of AGI, artificial general intelligence. And I think how is this humanity's last step into understanding ourselves? I think the process, as I see it now, is that we live in the AI community, the AI community has commoditized intelligence. AI can think more intelligent than more intelligently than most of us, most of the time. And that high intelligence has become commoditized and cheap. And that it is no longer suitable for any human to say, well, I'm differentiated by my intelligence.
Starting point is 00:13:14 My goal is to improve my intelligence, and that's what sets me apart. Well, it's good to be more intelligent, but it is no longer possible to, beat humans or soon will be completely impossible. So our soul searching should be. So this is, we've now reached nearly the last mile of effort to understand ourselves. And the essence of being human is not our intelligence. It must be something else. So that becomes our final step to understand ourselves because that which we can duplicate is not that which we, for reason that we exist. Whether one believes in evolution or God created the world, we are not put here just because we're intelligent. It's great to be intelligent. We should try to be intelligent, but it is not
Starting point is 00:14:11 the thing that sets us apart. So let's look for what sets us apart. And that's something I put quite a bit of thought into in my new book. I'll dwell a little bit deeper into that, but just the last part of your background, how you've spent time at Apple
Starting point is 00:14:31 and then at Microsoft and at Google, did you ever think that intelligence was going to get commoditized the way we're seeing today, back then in the 80s and 90s? I did not. Because we always used the most advanced computers at the time.
Starting point is 00:14:47 When I was at Carnegie Mellon, my advisor let me use all the workstations in our group, which was probably a million dollars, which is a huge amount of money in those days. And when I was at Apple, we had some time on the cray. And actually, Apple was largely designed on the cray supercomputer. And that's what the world's most expensive computer. So what happened was interestingly that we were looking at today, at the then today, that compute was always going to be super expensive to do AI, the best AI. So we never really did a simple thing, which is just exponentially extrapolated. If compute was increasing at this speed, just in a matter of 40, 50, 60 years, intelligence will be free.
Starting point is 00:15:43 that's the number one I think thing that we overlooked and that it would get it is easily extrapolatable that would get this cheap also I think the other uncertain thing was
Starting point is 00:15:58 it's it's often believed to be very very hard to get the last 10 or 20% so to get to a 70% good enough solution is not not hard that means to exhibit a little bit
Starting point is 00:16:12 intelligence is not not hard within a single domain, right? We've been talking to our, to speak recognizers for the years. That was my PhD thesis that exhibited some intelligence. But every bit of improvement is really, really hard. And researchers seem to have shown that that is tiny incremental improvements year after year since the 80s so that the AGI would be very far away. Never did we imagine at that time in the 80s and 90s that there would be a new intelligent system, namely the large language models that would suddenly become general out of just the huge amounts of data that it would become general and the entire.
Starting point is 00:17:11 would jump year after year. We did not see that jump coming. And perhaps, we certainly, so that's another interesting paradox. We certainly knew that AI would get smarter with more data. We did not know with the whole world's data fed into AI who would get this smart. We certainly knew compute is reduced every year. So it's an exponential cost reduction. But we did not know that at some point, it would reach close, very, very close to zero. So I think we were, I think I was too optimistic in just believing AI as humanity's final step into understanding ourselves back in in 1980. But I was too pessimistic that adding more data, adding more compute, these two
Starting point is 00:18:08 things alone would get us here. But it did. Okay, well, I just want to give you a bit of a backdrop on the comparison of how economic development between China and Southeast Asia has taken place in the last 30 years. If you take a look at the GDP per capita of China, it's grown by 10x in the last 10 years. Whereas that in Southeast Asia only 2.7x, right? How do you see AI being able to boost Southeast Asia in accelerating its velocity of developing, economically speaking? I think it's going to create the biggest opportunity for every country.
Starting point is 00:18:55 But frankly, currently, the A's favor U.S. and China, because they're by far the two leaders. and also they have different business models and different methodologies. So very possibly both can win, just like iPhone and Android, both won, so to speak, one in making the most money and the other in getting the largest volume. So my thoughts for Southeast Asia would be that it would look for a different game to play. China has played a different game, right? China didn't go build premier labs with hundreds of billions of dollars wanting to build AGI that beat everyone else and become winner take all.
Starting point is 00:19:48 China took a very different approach. And China didn't sell these expensive APIs. China took a different approach. China took an open source approach for market share, and it took a basically letting the huge consumer software companies like BidDance and Alibaba build great consumer apps
Starting point is 00:20:10 and it's choosing to ask the government to be the early adopters of AI. So these are completely almost the antithesis of the American approach and they both are working. So I would think that Southeast Asia can find a different approach and I have some ideas, but I think not having lived in Southeast Asia, I don't want to be presumptuous and say it's the right answer.
Starting point is 00:20:39 But I'll give a short version of that. I think there are so many ways to use AI that the U.S. and China are just two ways to use AI. I think every profession will get disrupted. every job will potentially get challenged, but with the problems that causes for traditional businesses and old ways of doing things comes new opportunities. So what are the segments in which Southeast Asia, or actually different countries, can pursue
Starting point is 00:21:21 and do something interesting in those areas in which it has an advantage? The traditional way to look at it would be basically asking each country what is your primary area of strength. Can you apply AI to it? That's certainly one approach. But I would prefer to start from scratch and just to say, hey, look, if we have a bunch of well-educated people and there are plenty of well-educated people and a large population size, what can they do? to ride the wave of AI to create value that US and China currently isn't pursuing. So one example is the so-called one-person company, OPC. That basically means you take a proven formula of saying, okay, these are the traditional
Starting point is 00:22:18 types of activities that will get replaced by AI because AI can do it much more cheaply. So can you, each individual, come up with or have someone help them come up with the business, that the one person will start to go after that sector? Usually what characterizes these one-person companies is that they're usually focused on companies of the following sort. It has to be fully digital. There has to be payment. the work can be automatable, almost fully automatable,
Starting point is 00:22:59 with very little human in the loop, and the work will not have a high risk of a huge downside. So if you let AI do it, it might make a mistake, but it would not be catastrophic. So examples of this includes using AI to automatically create content. And this isn't just document. We can all do that.
Starting point is 00:23:25 But this is creating a short-form drama. I've visited companies that can produce a full episodic drama using fully AI script creation and content creation. Two people, one month, they can create essentially a serial drama. But that's one example. Or to create, based on a couple of photos, create, take. TikTok video to attract users, to use content creation to create pretty much anything. Entertainment, movies,
Starting point is 00:24:05 games are all going to be AI created. So look for areas in that. Second is things related to user acquisition, help anybody acquire a customer, and they'll pay by the customer. So it satisfies the opportunities. A third is in advertising. So find ways to reach the right audience using AI. And then there are a few others, very high-paying things for checking, for compliance reasons.
Starting point is 00:24:39 That's not as large a segment, but it's very high-paying. Or creating esoteric software. Because AI can write code just based on prompts. If you know how to prompt to get an application, you can build a special app for a customer that does something completely unique. Before they, no one would produce the software because it might be only used by one person, two hours a day. It's not worth it to pay somebody $100,000 to build it. But now maybe they'll pay you $300 and you'll spend $100 to build it. So these are all opportunities created by AI can automate and then take over parts of work.
Starting point is 00:25:25 And the people who jump in and find these opportunities first can, they will probably not make a unicorn. They probably will not make a world famous company. But they'll at least be able to make enough money to support the family. There's a very good chance they would. And a few might be able to be so successful. They'll create a brand, a phenomenon, an IPO. That's the unlikely outcome, but it's possible. So it keeps the dream alive.
Starting point is 00:25:58 Let anybody, everybody be an entrepreneur. There's no prerequisite for this job other than basically being smart enough and hardworking enough and have education. And also getting the help of what area this might pay off. So that's one possibility is the digital direction that countries can look into. There is a stark observation about how the per-unit cost of AI from China is disproportionately cheaper compared to that in the U.S. The second would be the observation that the Chinese companies are still doggedly open-sourced. whereas the U.S. companies they're shifting
Starting point is 00:26:46 from open to close source and of course on the back of that is the Seeking for profit you know Southeast Asia has 11 economies of which only two economies earn above that of a developed economy about $13,200 per capita per year
Starting point is 00:27:07 one of which is Singapore at $94,000 so intuitively the instinct is to go for anything that's cheaper right now now I guess the question is
Starting point is 00:27:21 is there conviction that the Chinese models are likely to remain open source and of course technologically cheaper for quite a while that it's going to resonate even more and more to the global south not just in developing
Starting point is 00:27:38 economies in Southeast Asia right that's not going to stop. I can say that with almost certainty. Firstly, this Chinese models are cheaper because the Chinese entrepreneurs and large companies are poor. They couldn't raise the kind of money that Open AI Anthropic did so that they were forced to make do with however much money they raise, which is less than 10% of the American giants. So they tried to train with less than 10% of the compute power. So they have to squeeze everything.
Starting point is 00:28:11 Otherwise, they couldn't even do experiments. So the process of basically using incredibly deep engineering tweaking, it's not something that's regarded as elegant or fun. And Silicon Valley basically shuns that and says, that's beneath us. My CEO can raise $10 billion and buy us more faster computers. Why should I waste time doing this low-level stuff? that's beneath me.
Starting point is 00:28:45 But the Chinese engineers, nothing's beneath them. Asians tend to be collectivist societies so that an engineer in the company would view it as their pride to work together towards to create a company's success. So this engineering tweaking causes the models to be anywhere between 50% to 95% cheaper with slightly worse
Starting point is 00:29:10 and sometimes equivalent performance. So no doubt it should be the choice by Southeast Asian companies to use. It also has a side effect or rather a byproduct that is also very beneficial because it's being an open source model. A company or a country can just take a Chinese model and install it locally. Then it's yours because you're not sending anything. to servers in China or anywhere else. It is your own server. So you have achieved sovereign AI.
Starting point is 00:29:48 And also when you have the model in your hands, you can tweak it to make it, for example, speak better Urdu or Malay or whatever language you want. And you can tweak it. When it's an open AI or anthropic model, it lives in the remote server, and you can't see it's true. structure or its numbers.
Starting point is 00:30:14 So the Chinese models are, the Chinese open source models are inexpensive and gives you sovereign access. So that's an advantage. There are some Americans advocating for building American open source models. And I think more competition is always good for the consumer. So we'll see if that happens or not. Now lastly, on your question of, will the Chinese companies, uh, collectively decide to go close source. I think that's virtually impossible
Starting point is 00:30:47 because the only way that can happen is if in China it became one winner take all, then when you become a winner, you have a temptation to now close things off. But given there are 11 companies still training frontier models in China, that's really not likely a single one will win. It's likely there will be consolidation.
Starting point is 00:31:13 There might be three or five, but not likely to be one in the near future. And the last thing I'll say is that even if the worst thing happened, people bet on Chinese open source models and then the market consolidated to one winner, they decided to be greedy and turned it closed. Then what really has happened then is you're still free to choose. You can still choose any open or closed model. The level of dependency we have to any one model is modest to low. That is the switching cost of moving to another model is not so high.
Starting point is 00:31:56 And I use multiple models interchangeably. So even if the worst thing happens, you just move to another open source model if one exists or another closed source model if you're not happy. with the supplier. So not to worry, while models are very expensive to train, they are on the average not that expensive to use and especially open source, and then the switching cost is nearly zero. It's not like once you got stuck on Facebook or TikTok. It's a little bit difficult to move off because your friends are on it because that's sticky. The large language models do not have that ability to create stickiness.
Starting point is 00:32:44 So you can leave it whenever you want to leave it. So feel free to use what's suitable now, and then you can pretty much switch at will. Explain the repercussions of open versus closed upon sovereignty of data and stuff like that. Right. So open source model is basically a large file. It's like I created a giant Excel file, and I said, it's free.
Starting point is 00:33:15 Download it here. So that's the open source model. So if you're in company in Southeast Asia, and you said, oh, great, I'd love to use that giant model. You download it. And then it comes with instructions on how to connect it to applications, and you do that. And it's installed on your server. So if you're a company, it's on your company server. and if you don't want it hosted in your company,
Starting point is 00:33:43 you can have an Amazon or another hyperscaler hosted and you can use it on their server. But in any case, no data is sent to the model company. So that's the advantage. It's not so having the data, having the model local has that advantage. The other thing, as I mentioned, is once you have the data local,
Starting point is 00:34:08 If you want to change the model, you can. It's like I gave you the giant Excel spreadsheet. If you want to go in and change some of the formula or change some of the numbers or load in another spreadsheet and use this macros to compute something, it's all yours. It's free. So that's the advantage. With a closed source model, you don't get to see the model, download the model. You don't get to tweak the model. you just basically send API calls.
Starting point is 00:34:38 That is, you have your application, call up Cloud or OpenAI, which might have its data center in Singapore or US, then they would respond. To a user, there's not much difference, but to a company, that means sending your data to Singapore or US wherever the server is located,
Starting point is 00:34:58 and many people are not comfortable with that. And some people want to tweak the market, models and with the American closed models, you can't tweak them. So that's the trade-off. Now, having said all these good things about the Chinese models, I will say there is one significant problem, very significant problem, is that these companies aren't making money, right? So they're like doing basically a goodwill, free and free work for the world to use.
Starting point is 00:35:32 they do have some revenue depends on how these models are accessed if you download it you pay nothing unless you're using it for profit then you have to pay them something but it's kind of voluntary self-reporting basis secondly if they do host it on
Starting point is 00:35:54 Amazon I think they get next to nothing but there are other hosting arrangements in which they get a cut and sometimes they host their own model, then they bill for the people who use their model, in which case they do make some money. So if you look at DeepSeek or Quinn or Kimmy, you will see that they have revenue and it's going up,
Starting point is 00:36:21 but this is creating more loss, even though it's also creating more revenue. So it's higher revenue but higher loss. because not only is there serving costs, development costs, but very importantly, the cost to train a modern large language model is at least $100 million, and their profits is not going to cover that. So unlike a company like Anthropic, which now has reached annual recurrent revenue at around $600 billion.
Starting point is 00:36:57 Sorry, no, $600 billion. 200 billion. 60 billion. Oh, 60 billion. Yeah, 60 billion. And they're going to use it to justify a $2.3 trillion dollar valuation. So that would be a unthinkable kind of number. The Chinese numbers are not even 1% of that.
Starting point is 00:37:17 So here it is anthropic because in the U.S., they have closed the model. They charge a lot of money. They build a high margin, high profit. And yet, companies, who use them and got used to them are used to paying for software annually. So they pay for tools and the tools pay for APIs. So I'm not talking about tech companies. I'm talking about normal companies like Procter & Gamble, General Electric.
Starting point is 00:37:47 These people, whether they do it for designing their PowerPoint or writing code or reviewing legal documents, they sign a licensing agreement or they buy it. AI software or they let their people talk to the chat bots produced by Anthropic and Open AI and all the subscription fee is coming to
Starting point is 00:38:11 $60 billion per year so here's a company only a few years in existence making $60 billion a year projecting a 30 to 50 times price sales ratio or sorry price earnings ratio which is not ridiculous
Starting point is 00:38:27 at this over 10x growth year over year, you could question, you know, might be a little bit overpriced, perhaps, but at let's say $2 trillion valuation, it would be, yeah, it might be, at least based on the pure numbers today, I think looks reasonable. So the Chinese companies face the challenge that they don't have this kind of valuation or revenue or profit. So how do they justify the R&D resources going forward. Of course, the answer is they have to develop a business model, but anthropic and open AI seem to have already done that.
Starting point is 00:39:08 So that is some catch-up, not so much in model capability, but in figuring out how to make money from the China side. But given the divergence between the Chinese and the U.S. models, I would argue that perhaps being able to command pricing the way Entropic has been may not be sustainable I mean the competition in China is just brutal much more brutal right
Starting point is 00:39:36 I mean at some point within intuition there's going to be an intersection between players from one side of the world vis-a-vis those from the other side of the world and that I think is going to only entail in much higher degree of competitiveness from a pricing standpoint absolutely
Starting point is 00:39:55 all the skeptics who don't don't think Anthropics are worth $2,3 trillion is using that argument, namely that if there were no Chinese open source models, then people seem willing to pay you for your high price because they get their money's worth, so you're going to continue your growth. And now there is a, you know, 95% good enough solution for one-tenth the cost. and a lot of people are going to either switch completely or only use their most complex tasks with your model and let others use the Chinese model.
Starting point is 00:40:37 And I think also at some point, Anthropic and the Open AI will keep improving until at some point the user can't tell the difference. If you remember the early days of PC, right? every upgrade was wow what a relief everything so fast same with every iPhone release and then they're all the same at some point i remember i said i don't need to update my Mac anymore it's basically good enough the slightly better speed and memory just isn't worth the money to upgrade until they change the microprocessor okay that one i had to do an upgrade so uh so i think at some
Starting point is 00:41:17 point it's possible opening ananthropic will reach the point of diminishing return where the improved model isn't so much better that people are going to demand they can't increase the price accordingly or they have to decrease the price perhaps and also at some point there's if you compare the let's say Kimi versus and Claude now the gap might be 100 to 95 and and some people might still choose clog because they want 100, but if the gap continues to narrow, and also they're both above the good enough line, and maybe the difference is really negligible, then they would lose market share. So yes, that is the, I think, the largest problem in the arguments of extrapolating from Anthropics, numbers to future numbers.
Starting point is 00:42:19 But what we don't know is, you know, I think if you ask me, what is the single clear advantage of the American companies, open-a-anthropic over the Chinese companies, I would say, well, one is the, they're able to make a lot of money, but I've already talked about that. The other is their talent density. So if you ask all of U.S., all of China, produce your top. 100,000 AI researchers. The two lists will be quite comparable.
Starting point is 00:42:51 US a tiny bit better. But if you ask, produce your top 100 AI researchers, then US would have a dominant advantage or even 1,000 because there's so much talent density. So what that leads to is, is it possible when Anthropic has much more talent density than the typical Chinese company, can they invent something that's breakthrough?
Starting point is 00:43:17 And can that breakthrough not be reverse-engineerable? And if both answers are yes, then it can not only be worth $2 or $3 trillion, maybe a lot more than that. But so far we have not seen anything to this point in the last three and a half years. We have not seen anything invented by open-endthropic that Chinese companies have not been able to basically reproduce, at least at the result level. But that's not to say in the future, it will be the same. I would provide the perspective of the global South, which is only 84% of humanity. That's about 7 billion people.
Starting point is 00:44:02 You know, they're still in general, at the lower end of the value chain. The demand for top-notch echelon of... intellectualization may be there, but not pervasively, right? And then if they're presented with a comparison between one and the other and one cost, 10 to 20% of the other, intuitively the choices is really clear. I want to present two observations about Southeast Asia. The first is with respect to the intellectual propensity, right? And this is manifested in the educational attainment.
Starting point is 00:44:43 And, you know, we still want to move up the value chain. And I'm in a camp that believes that AI is really a hallucination that's affected by the hypnosis. And the quality of hypnosis matters. But if educationally we're not there yet, and this is empirically manifested in how nine out of 11 countries' pieces scores are still below the global average. That's the proficiency of communication and STEM for 15-year-olds. How out of 10,000 universities in Southeast Asia, only two are positioned in the top 20 in the world,
Starting point is 00:45:26 both of which are in Singapore. The third best university in Southeast Asia is ranked 56, and then that's in Malaysia, but no school or university in Thailand, Philippines, Indonesia places on the top 100. So I would argue that the quality of hypnosis may not be as high quality as that in countries that are intellectually, you know, up there. The second observation I want to register to you is what we kind of talked about a few
Starting point is 00:45:57 weeks ago, the structural limitations from an energy standpoint where, you know, nine out of 11 countries are still electrified at 5,000 kilowatt-hour per capita or less. Singapore and Bruneer at 10,000 kilo an hour per capita. How do you think the narrative of Southeast Asia becoming a stakeholder of AI as opposed to a spectator
Starting point is 00:46:23 of the AI narrative could be assured with the help of technological innovation coming from anywhere, from China from the US and all that. Please. I can see several ways. One is to have
Starting point is 00:46:39 an enlightened leader in one of the countries that sees and understands the trend and finds the resources to make it happen. I've spoken to some of the wealthy, wealthier countries and their leadership in Southeast Asia. I have to say I have not yet seen that kind of vision. Singapore is the only one that I think has a reasonable vision. That's kind of one issue. Either you have to be enlightened, you have to see. I think there's such preponderance of data that I would want to spend some time explaining to each one.
Starting point is 00:47:17 These are all very bright people. The writing is on the wall about the commoditization of intelligence, and that creates not only the two classes that you talk about, right, the ones who are making history, the ones who are following. And they're also the ones who are trampled. And we have to be aware of that. When we talk about global south, I think, you know, Southeast Asia is in average shape because there are many much poorer countries. And when they have no one making money with AI and most of the jobs are being replaced by AI produced locally in U.S., Europe or whatever with robots and factories, I think, you know, it becomes an issue of whether. people can even make enough money to survive.
Starting point is 00:48:14 But coming back to Southeast Asia, so I think one is an enlightened leadership, or one that will listen and believe an expert or a group of experts, that's possible. The second possibility is for there to be some existence proof, hey, if you do this, you can get the results. It's been done. So either some country or some, maybe not a whole country has the, maybe the country leadership doesn't have that understanding of AI, but maybe a governor or a mayor does, then do an experiment to show, like the example I gave earlier of one person company.
Starting point is 00:48:56 And I know, for example, there's great entrepreneurs in Indonesia, for example, right? There's a great entrepreneurial community. and many of them are looking to do this, but also I think people who don't have AI expertise can now do it. So that's the biggest difference is whether someone can demonstrate. So you don't have to have the vision and the brilliance, but when you see the data, you believe, I think that's a second way.
Starting point is 00:49:32 Otherwise, I think the danger is not going, that you can't go from a follower country to a leader country, but that you might fall from a follower country into a trampled on country. You know, China produces about 4 to 4.5 million stem products per year. India, about 2 million. The U.S., 800,000, Southeast Asia, only 750,000. of which Indonesia produces about 250,000 STEM products per year. Is that a structural challenge that needs to be remedied? Well, absolutely.
Starting point is 00:50:16 I think it's really the quality of education that's important. For the past 50 years, STEM has been incredibly important. It led to the engineering jobs, engineering innovations. one could reasonably debate what is the right skill set going forward, STEM being one of them. And I think I would argue that education system needs to shift to at a meta level. However, let's say for now, STEM is the best we've got. Just to improve the STEM scores, AI can be used as a tool to improve the education.
Starting point is 00:50:54 For example, my company, 01.AI, is currently, working with a joint venture in the country of Kazakhstan. And this is a massive government investment to build AI tutors for all the students. And this includes AI tutors that could basically make learning fun and make learning personalized. So someone who learns very fast, a super STEM student becomes super, super fast. some who's one who's having trouble is patiently getting chances to do the problem over or over until they get it right. And then the personal tutor is as smart as any chatbot, but it doesn't let you cheat. So if you ask what's the answer to a question rather than telling you the answer, it will patiently walk you through until you solve it yourself.
Starting point is 00:51:50 So this doesn't replace the teacher by any means. And that's one of the reasons this proposal got accepted, is that the teachers will become the natural companion of the AI tutor, because the ideal teaching should always be one-on-one. This way you learn the most, but no country can afford one teacher per student. Now you can have one AI tutor per student. So a lot of the drills and homeworks and also learn. learning the materials, answering the questions can be offloaded to the AI personal assistant.
Starting point is 00:52:29 Then the teacher can really talk about bigger things, like how to become a better person, how to work with other kids, how to communicate clearly and better, the soft skills, and also getting to know some of the kids so that you're also offering a human side of the one-on-one coaching and mentorship, And maybe there will even, for countries that can afford it, there will be more teachers than now, because we never had enough. So we're building this system in Kazakhstan. So this is another example where I think someone enlightened understands that it's on the future, can do this now, just because the writing is on the wall, but it's not here yet. But others who want to wait a year, we'll see the PISA scores in a year. and I think they will be significantly better.
Starting point is 00:53:25 I'm really confident because in China, the last 15 years, China has already fully installed, not even the latest AI, not even chatbot and all that. Older AI has already improved this course by, I think, quite a few points. So that's the basis from which we add all the new large language model technologies. So we have no doubt this will lead to a tremendous, improvements. So hopefully
Starting point is 00:53:53 this will be there will be one country at least in Southeast Asia that will give this such a time. You know
Starting point is 00:54:01 if you walk from Myanmar to the Philippines a distance of about 5,000 kilometers you skip over
Starting point is 00:54:08 Singapore around 80% of the heads of households don't have university education. So
Starting point is 00:54:15 your only hope is for that student to be exposed to a great teacher who can infuse imagination, ambition, and serendipity, right? Yeah.
Starting point is 00:54:28 Because the kid spends about six to eight hours a day with the teacher. And unfortunately, most of the teachers are not as great quality as desired because they don't make much. I'll give you an illustration in Indonesia. There's about 3.5 million teachers and professors, most of which make about less than $200 a month. So, I mean, if you're a brilliant student coming out of Cardigan, you want to be a teacher in some remote village in Kalimantan or Papua, you get an offer from Google for $5,000 a month. As much as you want to be a teacher back home,
Starting point is 00:55:08 you're going to go to Mountain View because you can put food on a table. So I guess my question is, how do you use AI to remedy this? and how do you allow for a country like Indonesia to transition to a better spot without dislocating the pre-existing teachers as to create social political instability while we take the view incrementally in terms of recalibrating the criteria and recruitment of better teachers going forward? Yes, I believe the AI. teaching assistant product can show improved visa score within one year. So that is something that will happen. And this is leaving all the teachers in place.
Starting point is 00:56:07 And one of the other features we have in the product is what we call a multicast, a multicast real teacher plus AI. So we actually project virtually a real teacher into the rural classrooms so that the rural teacher and the students are together watching the elite superstar teacher from major city teaching the language, teaching the course in their own language. So at the same time, the kids are learning and they're not just watching. They actually have a little device.
Starting point is 00:56:52 They can interact with a remote teacher. So you've just brought in a superhuman teacher enhanced by AI as a cartoon character, making learning fun, interacting with the kids, especially for the lower grades. That has two huge benefits. One is that it helps all the kids move forward. without just being in a position to use the AI tutor, but it would have a great teacher, a great human teacher, interacting with each kid, even though it might be 1 to 500 at any given time,
Starting point is 00:57:31 it's all happening in real time. That's the first advantage. The second advantage, which is even more enduring, is that a rural teacher is in the room watching how the great teacher is remote, teaching the class so that a rural teacher will also improve. So I think that will bring the second order improvement in addition to the AI tutor, just bringing up the PISA course. So I think this can and will work.
Starting point is 00:57:59 But to be honest, what I do worry about is for this to have an impact on the GDP. It's going to take a long time, right? These kids don't graduate and get a job for maybe 10 years. so it'll be create a certain degree of assurance and confidence that eventually everything will be okay but there may still be a J-curve What about the tertiary level
Starting point is 00:58:29 education? How do you remedy that or how do you improve upon it with the help of AI? Universities, right? Yeah, that is a tougher one. I was invited to be an advisor to a brand new university. I'm not going to name what country so that people don't second
Starting point is 00:58:50 guess what country is in. I was an advisor to the chairman of the university and then that person is a visionary and he said, Dr. Lee, come in, we're building something from scratch
Starting point is 00:59:05 and we can do great things with your help. And I said, do you want to build an AI native university? He said, What does that mean? And I said, well, that means AI is running at the core of courseware, AI tutors, everything includes AI by default, and AI is not added as a periphery, but it's central. Of course, it's not going to fit everywhere, but we do the best we can.
Starting point is 00:59:33 He says, yeah, that sounds great. So then he says, I have a faculty meeting, even though we're a new university. I already brought in all the department heads and chair professors. I want you to meet them and share your vision. So I went into this room and it was, you know, all famous retired teacher between 60 and 80, I would say. All incredibly prestigious, famous in top universities throughout the world. They flew in because of the attraction of working from the ground zero. They are all well-intentioned educator, brilliant in their fields.
Starting point is 01:00:11 then I started talking about AI. Then I realized most of them had not used any AI. They certainly don't use it in their research. They don't use it in their teaching. Some of them haven't even used one as a consumer because of maybe their dedication to their work. Then I started talking about how I would use AI. And there was a lot of, let's say, combination of either a disbelief, or reluctance or even just not paying attention.
Starting point is 01:00:50 So that just felt like this was not going to work out. So I told the chairman I'm not going to be able to accept this advisor position. So I think the core lesson from the story is that we found the young teachers in rural areas in Kazakhstan. in the elementary and middle school. While they have not had great education, they're not paid a lot, they're living in very poor places, but they're all happy and eager to learn.
Starting point is 01:01:26 They view the arrival of AI is a great thing, and I have full confidence, at least the teachers I've met, they'll embrace it. But I think these professors, the more esteemed and older they are, the more they will not give up the status quo. So I think it's going to be so much more difficult. And you can probably start a new university truly from scratch or maybe go to one of the more recently founded universities.
Starting point is 01:01:56 Like in the UAE, I helped the founding of the NBC UAI, which is the university, which is the, his royal highness his namesakes AI university in Abu Dhabi and that was built truly from the ground up with being a focus
Starting point is 01:02:16 on your AI and Kazakhstan is now building some AI universities so I have hype hopes for these but how do you modify existing ones it's so entrenched and
Starting point is 01:02:29 the people don't want to change by and large I'm sure some do and also gluing AI as a afterthought isn't going to create the change needed and a lot of but I think there are certain departments
Starting point is 01:02:50 that might be suitable to talk to for example I was talking to a department chair of computer science and he said you know Kai Fu we're going to have to change to what we do things because our enrollment our application pool is down 30% from last year. Because people are hearing that a computer science engineer can't easily get a job anymore.
Starting point is 01:03:14 So they're shifting majors to more the mechanical electrical engineering, which still isn't replaced fully by AI. So what should we do with our curriculum? So at least the – I think it might just take – so I guess if I were a university, president, I would say, take a look at which of the department chairs are in crisis mode, and which department chairs have the vision to change, and maybe just do some experiments based on them and see how far we can get. Try to do a more broad change throughout the university. You're fighting against an infrastructure.
Starting point is 01:03:58 I would have to really learn more about universities to know how to change that. As you know, I recently wrote the book, AI Native, that's about how to change a company. It's the same problem, but at least the company, people are driven to make the company great, to improve profit revenue. So as long as my methodology leads to that, there will be openness. And also in companies, people are a little more willing to let go of what they, the way they used to do things because if there's a new technology, embracing it leads to better numbers. So I think companies will be easier than universities to change.
Starting point is 01:04:40 Right. Kaifu, we've talked about the intersection of AI with academia. I want to just paint the picture generally about Southeast Asia. We've seen declination in the ratio of manufacture to GDP, the middle class. through the overall population, agriculture, through the GDP. This would have been on the back of
Starting point is 01:05:07 perhaps rotation into services, but I'm not witnessing, you know, fantastic, you know, up movement on the value chain within the service sector. And we've seen automation, robotization,
Starting point is 01:05:25 and now we're imminently seeing physicalization of digital know-how into physical activities, right? I mean, just intuitively, the risks of further, if not disproportionately more, dislocation of jobs is there, right? How do we cope with this type of? Because there is a political ramification here to the extent that you don't have, you know, economic stability, social stability, you're not going to have political stability, right? Like in Indonesia, we've got 150 million workers, of which 75 million workers are informal.
Starting point is 01:06:09 The other 75 are formal. The risks of dislocation with respect to both the formal and informal is not to be underestimated. Once robotization kicks in in a pervasive manner, we're seeing in the Philippines, you know, about 1.5 to 2 million workers that would have been busy with the call centers, the BPO and all that, which is I think systemically is at risk with AI coming on board, right? How do we prepare for this so that the transition could be, you know, albeit with incrementalism, but judicious? Right. The invasion of the AI workers will begin with
Starting point is 01:06:54 with cognitive work, as we're already seeing. If it can do software engineers high paying work, it can surely do call center, BPO, accounting, legal, so on and so forth. So for people holding cognitive work, the writing is on the wall, and they need to fly to safety. And then after that, I think the, basically the blue-collar workers will have,
Starting point is 01:07:22 there's a similar problem. The gap between the two might be five to ten years, but because AI's ability to overcome the clumsiness of their body and fingers is going to take some time. And also the cost, and there's a cost, right? Software is just compute, which is fixed, not fixed, but modest cost, that's dramatically reducing. that the hardware isn't going to have the same curve of cost reduction that software had. So I think five to ten years is probably about the right range of estimate, but not everything is replaced at the same time. So let me first talk about cognitive work. The types of work that will remain are those that have a very strong people,
Starting point is 01:08:17 component and a very strong openness component. By people component, I mean most of the work is interacting with other people, gaining trust, negotiating sales, solving problems, and things like that. And then openness means you're working on the problem that isn't about a fixed, repeated problem where you're more or less solving for the same thing each time. So a closed problem would be filling out a reimbursement report. A pretty close problem would be customer service. But an open problem would be designing a marketing campaign or working out a company merger. So that's the range for cognitive work.
Starting point is 01:09:10 And I would be the first to acknowledge that the people-oriented work is where the volume is. Okay, because there aren't that many open jobs, but there are a lot of people-oriented jobs. And I will also argue that as AI starts to take over the routine execution of tasks at work and in services, people are going to want real people for the services. They're going to long for that human touch, whether it's an existing job like a concierge or tour guide or a customer service rep for a partnership specialist, that kind of thing. But also, there will be new opportunities like a new style teacher to help kids gain confidence and work with other kids, people dealing with anxiety, helping to deal with anxiety, therapists, nurses, and also maybe newly created jobs, perhaps jobs that are unpaid today, like
Starting point is 01:10:19 volunteer at an elderly home or volunteer at a foster home and maybe even at home schooling might be something the government can pay. Where does the government get the money? Well, taxed rich, especially those who got rich on AI and use that money. converted into a universal basic income and encouraging people to take on this open and human-oriented work. And to be more specific, you know, there will be many more human interaction-based service work that will be going up. So, and I would say domestic help is another area that I know is a significant part of Southeast Asia. Now, going back to your question about blue-collar labor and physical work,
Starting point is 01:11:19 I think there's a little more time, so five to ten years, but also in the same way, look for openness and look for a human touch. So what's the human touch in a physical work? Well, a plumber, someone who does disaster relief, someone who fixes things in the hospital. These things all have a human component, and AI can't do that, because even if AI could fake it or emulate it,
Starting point is 01:11:52 people won't accept it. They want that human-to-human touch. So the human orientation. And what about openness? So using, so an assembly line, that's clearly not open. That's a very close, repetitive process. and picking out boxes in Amazon.
Starting point is 01:12:11 That used to be kind of not close, but now it's being closed because robots are getting good enough because packages are generally similarly, rectangularly shaped, and AI could do it. Folding clothes used to be in the open area because every dress is different.
Starting point is 01:12:32 But now AI is getting pretty close to figure out how to fold clothes. So why not at the time AI will encroach from closed domains to open domains? But there are some that are truly in the very, very open area that AI will take a long time to not be able to do. And then there's some that are, so disaster relief would be the extreme open because every disaster is different, every location is different. So that remains for humans to do. But another interesting one I brought up earlier, plumber. That sounds like a closed job.
Starting point is 01:13:10 There are only so many permutations. A pipe could go wrong. However, because the pipes are hidden. So it's almost like a detective job. And also the human interaction. So you have to decide when to take a chance to open the wall and what if you're wrong, how do you explain to the homeowner that you broke their walls and their pipe still not fixed? and then when they get mad, how do you respond?
Starting point is 01:13:36 So it requires both an ability to navigate an open, unknown environment, which every house is different, as well as an ability to interact with people and to calm them down when they're not happy. So these are the kinds of jobs that will remain. I cannot be sure there will be an equal number of jobs that remain at the end of the day. there's some likelihood it could happen because AI is also creating new jobs. One of the new category of jobs is labeling data
Starting point is 01:14:11 because AI needs to learn a massive data. So label the data that AI hasn't learned to label yet. So I should be specific because every time AI is trained, it gets better at labeling the data for that category. Then you've got to look for the next frontier. So today, a lot of people are being paid to collect data for embodied robotics.
Starting point is 01:14:35 That is, for figuring, to wear gloves, and then you're given an instruction, and you execute the instruction, like pick the glass up and put it to your mouth, and then that is captured by cameras and labeled so that it can be used for training AI models. So AI's need for labeling will continue for a while longer. And who knows what other jobs AI will create?
Starting point is 01:15:00 So to the extent that AI survives and thrives upon pre-existing codification, any profession that's less codified would be less vulnerable to AI. Is that the right way to think about this? Yeah. So I think one could say that computer software is pretty codified. It's well understood what the section of code does. You can execute it, simulated, tested, read it, examine it, debug it. One would also argue understanding law would be in that category, understanding tax.
Starting point is 01:15:40 Accounting law, yeah. Yeah, yeah. So it's more than you think. These are the, so I would say, yeah, so it's not just closeness, but it's also the following properties. any domain where past data can be predictors of future data, any domain where verification of correctness is doable. Because when that's possible, I can self-generate data and teach itself because it can just test itself, see if it got the right by verifying and so on and so forth.
Starting point is 01:16:17 And then also, as you said, the structure and codification, that makes it more replaceable. You alluded earlier that compute capacity is continuously rising. There is also a camp that believes that the cost of computing is coming down, but the cost of transporting data may not be coming down as quickly, right? Do you see imminence in how these two, at the rate they're declining in terms of cost, in terms of increasing in terms of efficiency? Do you see these two reconciling with the dearth of scarcity of energy in most developing economies at some point? Yeah, I think the major dissonance is with the cost of energy, right? Because that's increasingly the larger, increasingly more percentage of inference workload.
Starting point is 01:17:15 That is, when you ask chatypdia question, it calls an inference engine, which is the GPT model to answer your question. It's used as opposed to training, which is the process of AI learning, its model by itself. So the inference costs is the cost is coming down, but the usage is going up. So these things are causing a greater need for the data centers. And a lot of people are investing in data centers, and they're deploying a lot of GPUs. But the cost of electricity is increasingly a larger percentage of the inference costs. And as you mentioned earlier, I think there will be many countries, as you mentioned in Southeast Asia, but also the U.S. the current electrical grid is at capacity.
Starting point is 01:18:17 And once you add too much, it will start to break and not able to serve continuous reliable electricity. And that would be a disaster for whatever country in which that happens. I think the right answer to that problem has to be massive investments in green data centers because that actually is a challenging problem. But because a typical green data center uses solar and wind near the data center, that it becomes largely self-reliant. So you're not adding more load on the electrical grid.
Starting point is 01:18:57 And the other thing is to further make stronger and larger electrical grid, which has some capacity limit everywhere. So U.S. as an example, I think, is near not far from the, limit of its maximum on the electrical grid and then there's some deployment of solar and wind. China as an example has a much more headroom on its electrical grid as well as the world's lowest costs in using solar and wind. So in that sense, China is ahead of pretty much every country and and and i think countries have to start planning uh when they don't have enough data centers one is you know how to get people to invest in them um two is how to make sure the data
Starting point is 01:19:51 centers are used because some countries are not getting the same adoption of AI as as many of the other countries um and then thirdly how how will the electrical uh electricity problem be solved and And I really think it's going to become increasingly obvious as the green energy cost keeps coming down. Because green energy is effectively the cost of making solar panels and that wind turbine. And as with any manufacturing product, the more you make, the cheaper it gets. So if you buy Chinese solar or wind equipment, you will probably get cheaper and cheaper. at some point it becomes the obvious choice over the other options. You know, Chana has already built about 4,000 gigawatts.
Starting point is 01:20:42 It's planning to build an additional 4,000 gigawatts. The U.S. has built about 1,400 gigawatts. They're planning to build an additional 2,600 gigawatts. Now, relating back to how these big AI companies are doling out or planning to dole out, I don't know, $3 to $5 trillion just for data centers and GPUs.
Starting point is 01:21:08 It seems like a close loop, right? It doesn't permeate into the other sectors of the economy. Do you smell a potential bubble at that rate
Starting point is 01:21:20 and at the rate that there's not enough energy intensity? Yeah, it's possible there is a bubble. I'm not an expert at the data center capacity and investment.
Starting point is 01:21:32 But given the heat, the excitedness that people are jumping into this with a large percentage of 10 net worth, it seems like this has the basically the prerequisites of a bubble. I remember back around 25 years ago, there was a huge buildout in the tables. So there was a belief that there would be cables everywhere, and especially driven by the U.S., the cables would be the primary carrier. There was no Wi-Fi back then. So Holmes really got their internet connection through the cable network. And then the cable needs to be connected continent to continents. so the undersease cables were being built.
Starting point is 01:22:31 So there's a huge build out. A lot of a company that built the cable companies were worth a lot of money. And then eventually what happened was most of them went out of business. But actually, the carcass that they left, which are the cables that got built, became the backbone of our internet. So we might see the same thing again, because this is compute we will use. But to the extent a bubble is created, the companies will be punished. But the assets are there, so the assets will be sold to people who can operate them at a much lower costs,
Starting point is 01:23:06 then the assets will deliver their value. So I would say the worst case is if there is a bubble, the compute resources, data centers being built, are not going to be unused and they'll be contributing as long as they're built correctly to the future growth of AI. Kai Fu, you know, I've read your books. You had a personal episode more than 10 years ago. You were diagnosed with tumor. Yeah. And then I've noticed that your recent book smells differently from the earlier books.
Starting point is 01:23:42 There is more humanity in your tone. Yeah. I guess you can talk about, feel free to talk about how that experience change the way you at technological innovation, particularly in the context of AI. And the second follow-up question would be whether you can predict that at some point soon, AI will be sentient. Okay. Yes, I was always a workaholic, especially during the days where I was starting new things like Microsoft research, Google China,
Starting point is 01:24:25 Innovation Ventures. These were all brand new endeavors, even though I wasn't necessarily the founder, but I was the founding, you know, managing director or founding VP of all of these organizations, whether they were multinationals or my own. And this, this, and these, in these periods, I worked incredibly hard. And also, I always held it as my motto. If people say, well, what is your model? Why do you live? My answer was always, I want to make the greatest amount of difference to the world. And I measure things by something a college professor once said to me. Imagine there are two worlds, one with you in it, one without you. Your life's purpose is to make the former much, much greater than the latter.
Starting point is 01:25:15 That's an easy way to measure your personal contribution. Well, it all sounded great, and that was what I used to drive myself. And when I had difficult decisions, I would ask myself, where can I make the greater difference? And invariably, it always shifted to the work side. It always shifted to my career. And my family and even friends rarely figure prominently in that equation of making the biggest difference. Until I got sick. And then I saw really that my family has stayed with me.
Starting point is 01:25:54 me, took care of me, and that their love for me was unconditional, and that I was giving them second priority in my choices, and that was wrong. Also, I had the chance to meet with a very, very famous Buddhist monk. His name is Xin Yun, Master Xin Yun, in the, in the Thailand, Taiwan. And there he asked me, what was my motto, and I told him. And he said, well I think it's very dangerous and I said why why is it dangerous to maximize your difference he says well if you measure everything quantitatively then you will not be sure if you're really trying to make the world a better place or if you're if if you're being driven by greed greed for money and fame because every effort
Starting point is 01:26:52 for greed and frame I want to go for that promotion, I want to start a new company, I want to make a great investment because I want the world to be better, but is it really, is it that or is it because you want to be more famous and richer? I want to give a lecture to the largest number of people. I want to write a book read by the largest number of people. Those are reasonable ways to measure impact. But when you decide to go for the largest number, biggest impact, is that to satisfy your ego or to serve the world. And what Master Sienin said to me was, you should ask something a lot simpler. Everything you do is good for the world.
Starting point is 01:27:35 As long as it is good for the world, do it. But always ask at the same time, what's in it for me? And the less there is in it for you, the more assured you can know you're doing it. for the good of the world, not for yourself. And that's not to say you can't do things for yourself, but always be deliberate and thoughtful about these two things. Don't let make the world a better place, make a difference in the world,
Starting point is 01:28:05 become an excuse to get stuff for yourself. So that combination of these two things really caused me to rethink and bring a human side to this. And that's why when I wrote about AI, In fact, every book I wrote about AI, I talked about things like when AI becomes smarter than us, what's left? Well, what's left is our right brain, our emotion, our conviction, our love, our taste, our empathy, and our courage. So the human side of things, which is more or less what the right brain generally characterizes, becomes more emphasized on a day-to-day basis,
Starting point is 01:28:49 even though my job is building AI products and selling them, but I now feel that the right brain, especially love above all, is so much more important to us. And it's the reason that we're here. And when we remove intelligence as the single thing that differentiates us, the replacement or what should have been always there is really love. that's something AI can never take away. One could argue AI could become so automated that it could have tastes or learn empathy
Starting point is 01:29:25 or have conviction or learn to do things that are counterfactual. But one thing it won't have is I really don't think AI can love. So the question of can AI become sentient, I think can I have A. can AI fake sanctions? I think probably yes, in five years. It could fool almost all the people. But is it really love? And some would argue, it has close enough,
Starting point is 01:30:00 but I would argue that's not real love. And also, I think, even if AI fakes it pretty well, people won't reciprocate, at least within the next couple of generations, people are still looking to love people, not to love robots. So as much as I'm super optimistic about AI's advancement and value, I remain highly confident, not 100%, but highly confident,
Starting point is 01:30:30 95% confident that our definition of our extensions will not likely be replicated by AI in the next, 100 years. You know, one, a part of our earlier discussion was with regards to the fallacy of AI in that it doesn't have accountability. Right. Right. And number two, we've seen sort of like the shifting of LLMs spitting out stuff that's more
Starting point is 01:31:08 politically correct as opposed to the truth. how do we train humanity that at the end of the day the accountability on us are on us users and then how do you train humanity so that they can actually
Starting point is 01:31:25 train the model the platform to seek truth as opposed to political correctness yes two different questions on the first one I think the people are a perfect counter
Starting point is 01:31:41 part to AI because AI can execute at the speed of lightning with a high degree of accuracy, but if anything goes wrong, it can't take responsibility. And anything important in life, someone needs to take accountability. And that's where the human comes in. Of course, we don't want humans to be a scapegoat, right, to be a rubber stamp and a scapegoat. Whatever AI does, I say, okay, something goes wrong, okay, I'll take the fall. You want people who are actually driving, running AI with a purpose and also they become, they are rewarded when things go well and punish when things are not. And this in my book is called a DRI, directly responsible individual, a term coined by Steve Jobs.
Starting point is 01:32:31 So when you have the right kind of person who has a strong sense of responsibility or who's trustworthy, who's very deeply knowledgeable about the task, he or she is actually running the AIs and understands the AIs. Then I think we got a really good thing going. We have the person's basically all the right characteristics and knowledge of AI combined together, and that person should be empowered to run that particular goal or task for the company or for the startup of the OPC.
Starting point is 01:33:09 So that's the first part. And the second, sorry, was... It was basically, you know, being cognizant of the fact that platforms are becoming political correctness seeking as opposed to truth seeking. How do we caution humanity about this? Yeah. That is the danger of social networks of what they have become. We've seen Twitter as it becomes X. It actually changed its appearance.
Starting point is 01:33:48 It theoretically could target people so that keep people in different camps, but also it took on a view of its own that was different from before. So if that's a danger in social networks, it's even a greater danger in AI because social networks, we scan and we swipe and we look. a lot of things. But AI is directly giving us an answer. If that answer is biased or incorrect,
Starting point is 01:34:14 it will lead to very serious consequences. So the first thing I think we can do as individuals is to update our prompt. So I have a prompt that removes as much as possible sycophancy that is kissing up to me. I think one could update and modify the prompt to also maintain a balance between the extremes or present multiple points of view, sort of the ideals of journalism.
Starting point is 01:34:50 So that kind of a prompt is probably 200 words, and it will cost you a bit more tokens, but it's worth it. You don't need to copy, paste it into each one of your queries. In both OpenAI and Anthropic, there are settings where you can see. set it for each curry. So for me, I cared more for removing psychophancy and also
Starting point is 01:35:16 for removing sycophoncy and also for reducing hallucinations and stating when it knows the fact or thinks is right or is guessing. I think having these two help me greatly, I think it's not very hard to engineer another prompt that would include maintaining a balance and respecting different viewpoints and even representing different viewpoints, maybe coming from the doctrines of journalism. So someone could create that prompt and share it and use it.
Starting point is 01:36:01 Now, the prompt may not be enough because sometimes the model have been baked in with this political view, right? Elon Musk claims his models are more programmed to tell the truth. I don't know if that's true or not, but it's certainly possible. You can program it to be pro-leftist, pro-right, or center. So the prompt I said can course correct, but if the inside is still wrong, your course correction can lead to to unpredictable results. So that's why I think having the open source model helps because a computer scientist can use a set of training data
Starting point is 01:36:43 to tweak a model with whatever biases it has to be as neutral as you want. Of course, you could also do it the wrong way and make it even more biased. But that's the power of being able to tune models when you have parameters and the model on your hand on your server. When you use Cloud or Open AI, you do not have that possibility.
Starting point is 01:37:08 Kai Fu, I'm sensitive of time. I'm going to ask two more questions. The first one is, with respect to how you aptly admitted, that you were incorrect in predicting how quickly AI was going to attain or manifest creativity. Right. It came a lot sooner than you predict. I guess my curiosity is with respect to how soon do you think we're going to be able to attain AGI? Yeah, I made the prediction that what humans have to protect ourselves were two things.
Starting point is 01:37:48 One was the human-to-human connection, which I still maintain. The other was creativity, which I stated in 2018. Today, I think only the likes of Picasso Mozart cannot be created by AI when that style didn't exist, but that's going to be a very, very tiny percentage. By most of what we call creative, writing a new novel and things like that, poetry is certainly AI has the ability to do and better than most people. Yeah, so
Starting point is 01:38:25 So I think going from going from Sorry, you're asking about creativity AGI. AGI. AGI. Yeah. Okay.
Starting point is 01:38:37 AGI is a very ill-defined term. If you ask any large language model, it would tell you there are two sets of people. One set strongly believes it can do everything human does. becomes a superset. The other is more practical. And if you believe in the former, I would have to say there's no date whereby I can put AGI because by definition it includes sessions. And also, there are many things about us, our sentience, self-awareness. We don't even know how they work in our brain.
Starting point is 01:39:16 How are we going to measure it? We don't even have a clear scientific definition. So I think, that definition of all-encompassing AGI is impossible to measure and extremely hard to do whatever it is. So I wouldn't want to put a date by that at all. I don't even know what it is. And in the simplest definition, I would say it's probably never that we would get there. Because, you know, we're not a full super set of an ant, right? and, you know, so I think a superior species does not need to be a complete superset of an inferior species.
Starting point is 01:39:59 So if you want to take that view, I just don't think superset is a useful way to measure AGI. But the AGI definition I like that I usually quote is for cognitive tasks when AI can do 90% of the human tasks better than 90% of the people, I think that's close enough to call AGI. I think we're not there yet. I think we're already at the point where AI can answer 90% of the human questions better than 90% of the people. We're already there. But answering questions and doing things are quite different.
Starting point is 01:40:38 I think we're probably still maybe two years away from that. Yeah, but we'll get low-hanging. hanging fruit pretty soon. And then, of course, one could say AGI should also include physical robotics and embodied AI. So that adds another five to ten years in my opinion. Last question. Can you re-illustrate Boss AI again the way you did it a few weeks ago when we were, you know, chilling out? Yeah. So one of the things I talk in my book, AI Native, as well as shipping my company called Boss AI, has the following concept that AI can be a tremendous management tool. A CEO sitting at the top of the company with tens of thousands
Starting point is 01:41:34 of people or thousands of people is too distant from the truth. The truth is sometimes buried somewhere. And also the hierarchies of management, the larger the company, the deeper the hierarchy, the less the boss knows the truth because the information is passed up the chain in a very lossy kind of way. People selectively share things with the boss. They may be the bearer of good news, but not the bad news. Or they see a problem. They may not want the boss to know. They want to kind of cover it up or solve it.
Starting point is 01:42:09 And actually what happens is sometimes by the time the boss hears, it's really blown up. And then they come back and say, hey, what didn't you tell me earlier? And say, well, I'm trying to fix it. And they said, well, you should have told me earlier because now it's too late to change. Had you told me earlier, I could have fixed it. So these kind of things continue to really make the communications very difficult. And also communications down, a strong CEO wants nothing but for his or her strategy and direction and orders to be followed and executed. But when every middle manager takes some inputs, he or she will first consider, well, what does it mean for my department?
Starting point is 01:42:54 How should that communicate to my department? How do I get benefit for me and my department? And once you enter that kind of level of selfishness, there will be sugarcoding modifications and then the execution may not line up. So Boss AI is intended to give the CEO the God's Eye view to all the data in the company. Not only CRM, ERP, but also communications data. That means corporate email, corporate chat, and most importantly, corporate meetings. So I started using Boss A.I myself as the first boss, and it's been tremendously helpful. So my boss AI really virtually attends every meeting from it.
Starting point is 01:43:44 Because in my company, we ask every meeting be recorded. And now they can be highly accurately speech recognized, speaker recognized. And with the script of what was recognized, AI can virtually attend every meeting on my behalf and answer my questions specifically or generally. For example, I could say, in a thousand meetings, my company had in the last week, especially those I didn't attend, what are the top three debates that were had that are important for me to know about? So it tells me new things. Or I could say, in this very important strategic directive, in the last month, have there any be any signs,
Starting point is 01:44:26 whether in meeting, meeting notes or emails or chats, that should make me worried that we might not meet the milestone. So it can give me that. I can ask, what are the three biggest legal exposures as we apply for IPL? I could ask, who are the people who are best at AI programming or actually managing AI to write programs in the company? And then I was surprised some of the non-engineers showed up. And I said, how many of them are very generous in sharing with other people? because I want to make them the DRIs or give them more responsibilities and trust them to mentor and coach more people
Starting point is 01:45:12 because they're so good at it and willing to share. And then I could ask how many of them might be retention risk? They might leave the company. That, the AI knows because they may have shifted from very proactive signing up for things six months ago and now just say nothing and stay quiet in all the meetings, which is an indication they're not as engaged, therefore retention risks goes up.
Starting point is 01:45:41 So all of these things can be answered. And before every meeting, I would be told who's coming to see me? Here's their PowerPoint. Here's what they are likely to ask for. And here are the questions I should ask them in order to make my decision whether to give them what they ask for. during the meeting, the person is speaking and with a little bit of a delay, they're fact-checked against the realities. If they claim sales are a certain number, head count is a certain number,
Starting point is 01:46:13 well, I will check if they're off, right? And then I would know whether to reduce my level of believing in him. Then after the session, there are action items and also a pledge, basically a promise ledger of who promised to do what, and then AI will continue to nod and remind people who promise to do things, whereas before, they might have hoped that I would forget. And I forget, but boss AI doesn't forget. So as a result, my company has managed much better. I am, I sleep better at night. I know what's going on. I can manage processes. And I do so transparently. I tell my team, I am using this. data, but I will, and here's what I've used it, and here's how it's helped the company.
Starting point is 01:47:06 You're all shareholders, so you're better for it, because I know some people might be concerned whether I would use it to look for things that are maybe unprofessional or invade their privacy or something like that. But I show a lot of positive examples, and everyone's incentivized by the company stock going up, a company doing well. So the people accepted. I will finally make a note that people from Europe and sometimes
Starting point is 01:47:37 US are not so ready to embrace the style of record everything. But in Asia, I found pretty broad acceptance. That's a separate podcast. I'm thrilled to talk about that, but I'm sensitive of your time. Kaifu, this has been fascinating. When is your book coming out?
Starting point is 01:47:57 out, AI Native? It's out in mid-September in Kindle and then early November in the hard copy. Okay, I'm so looking forward to getting a copy and reading it. I've enjoyed all your books, especially 2041. Oh, right? Yeah. I look forward to seeing you. Thank you so much, Kaifu.
Starting point is 01:48:19 Thanks so much. Friends, that was Kaifu Lee from 01.a.i. Thank you. Thank you.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.