Y Combinator Startup Podcast - #47 - Baidu's COO, Qi Lu Discusses AI with Daniel Gross

Episode Date: November 15, 2017

Qi Lu is the COO of Baidu.Daniel Gross is a Partner at YC. ...

Transcript
Discussion (0)
Starting point is 00:00:00 Hey, this is Craig Cannon, and you're listening to Y Combinators podcast. Today's episode is with Chi Liu and Daniel Gross. Chi is the C-O-O of Baidu, and Daniel's a partner here at YC. So just before we get going, if you haven't yet subscribed or reviewed the podcast, it'd be awesome if you did. All right, here we go. All right, hello. My name is Daniel. I'm a partner at Y Combinator, and I'm here today with Chi-Lu, who's the CEO of Baidu, and is in particular focused on a lot of their AI strategy. So, Chi, thank you so much for coming today.
Starting point is 00:00:32 You bet. Thanks for having me. Cool. So I guess first question that is on my mind is, and I think many others, is help us understand why you left, previous to Bidu, you were very senior at Microsoft, and a lot of us are wondering why you decided to leave to Bidu. So two things. One is I left to Microsoft purely for personal reasons, because I had an injury. I broke my left hip. So I needed a second surgery and need to take some time off
Starting point is 00:01:09 because my job at the macrocelltor was very critical to the company. I thought it's for the best interest of the company for me to move on. A great thing was that I had a good successor who was extremely capable. I'm super happy that he is taking over and leading the company. company's productivity business moving forward. And in particular, also, I was able to have a very good relationship with Microsoft.
Starting point is 00:01:38 I continue to serve as the personal advisor to the CEO, Satya Nadara, and also to Bill Gates. So when I go back to Seattle, I often go see them. And then how did you decide to go to Baidu as opposed to any other place? Yeah. So that's for a simple reason, which is. AI plus China because we all know, I guess most people in our field will agree. AI is the next big wave. I think AI plus China is particularly meaningful because, in my views, China has a structural advantage in terms of AI technological development and commercializations.
Starting point is 00:02:26 In that context, Baidu offers a very unique opportunity for me. First of all, Baidu, in many ways, is the Google of China. Its heritage was so changing. And as a result, from engineering capability perspective and a cultural perspective, is uniquely positioned to seize the AI opportunity. And also, I happen to be a friend, knows Robin Lee, the founder and CEO, for almost 20 years. So there's a lot of long-tone relationship and trust.
Starting point is 00:03:02 So that was just a good opportunity for me to take on. So in what ways is China's approach to AI different from Americas? I think, first of all, I think it's environmentally different. And approach-wise, I'll come back to the approach aspects from my advantage point. From environmental perspective, I think China has unique structural advantage for AI technological development and commercialization of AI technologies. For a simple reason, if I may just explain my thinking on why this is so. Because in this wave of technology development, there's one aspect to the fundamentally different from previous generation of big, technology wave, which is data plays a essential role.
Starting point is 00:04:01 Because I often use this as a simple example. You can have 10,000 engineers, great engineers, or you can have a million great engineers. You will not be able to build a system that understands human conversations. You will not be able to build a system that will recognize objects or seeings of images because you need to have data.
Starting point is 00:04:25 A simple analogy is very much like human. When you and I grew up, it's not like our parents or God is writing coding to our brains. Our built-in neural engines has the ability to learn through our sensory systems, essentially our perceptive systems, whether it's visual systems or it's auditory systems, that we are able to observe the world. our observation, those sensors, these are data, because these data carries knowledge, and we are able to learn from our interaction with the world. So as we grew up, we acquire knowledge. And same thing happens for AI technology.
Starting point is 00:05:08 It's not about writing code this time. It's about writing code that implements AI algorithms with both soft and hardwares. They are able to learn and learn knowledge from the data. So if you take that perspective, data, in my view, is for the AI era, what becomes a primary means of production, which is by definition means of production is a form of capital. Because you look at historically, in our human history, let's say in the agriculture era, land is the primary means of production
Starting point is 00:05:41 so that you can see everything is organized around the land. All the walls are competing for land. In the industrial errors, the means of production is primarily labor, as an equipment, different type of equipment, and certainly financial capital, human talent. But in the AI era, my view is data will become the primary means of production. So harnessing data becomes key. And then comes back to China, because China has a different social, economical policy environment that makes, for certain segments, not on everything, for certain segments, it's much
Starting point is 00:06:18 easier to acquire and harness data. And with that, it creates an environment for developing air technologies and then commercialize those technologies towards market-oriented applications or social applications. So in that context, China has a structured advantage. And then in terms of approach, there will be cultural differences, even in entrepreneurial world, the startups in China environment, they tend to work in their ways. That, I would say Silicon Valley in China, there's commonalities, there's some different approaches,
Starting point is 00:06:57 but that's not the bigger factor. In my view, it's the environment that's the more determinant factors making China to be relatively compared to other marketplaces or other regions, a better place for AI development because of data. Interesting. And I guess one question, I'm wondering in particular is in the U.S. there's this belief that one of the ways China's somehow doing better when it comes to technology is that the government is much more integrated with companies and their initiatives. Is that something that you see it by due as you guys focus
Starting point is 00:07:36 on your different AI initiatives? Are you able to work very closely with the government? In general, the Chinese government at this stage has a lot more willingness to invest in infrastructures in talent, and they in particular see AI as the opportunity for China to, in many ways, to ride that big wave, to elevate its innovation capacity. So there was a, about somewhat between one month, two months ago, there was a white paper that's published by the Chinese government. It actually spells it in pretty much a certain level of details about by 2030, how the Chinese government plan to systematically invest in infrastructure, talent, technologies to enable China to lead in AI technologies in many different dimensions.
Starting point is 00:08:31 So in general, the government indeed has a lot more willingness and commitment to invest. And with regard to private company, particularly company like Baidu, which is more viewed as culture, practice-wise, closer to. to American companies, listed in NASDAQ, internal working culture is very entrepreneurial, closer to Silicon Valley style. So we do, in many ways, operate independently. We view essentially market opportunities
Starting point is 00:09:04 as the primary objectives to pursue those opportunities. And when there are a win-wing alignment with the government initiative, we welcome that. For example, by do is the, host of a national deep learning labs. And Baidu is also working with various different government entities when they have expressed willingness to support in certain areas of AI technology, for example, let's say for self-driving cars. So we will work with those government entities to discuss opportunities that are mutual beneficial. But as a company, our primary means is
Starting point is 00:09:47 market success. We don't have sort of any other agendas because we are an independent company. We want to build products that serves our users. When there's synergics opportunity with government support, we will collaborate with government when they
Starting point is 00:10:03 are truly mutual benefit, mutual win-wins. Do you think that China will beat the United States to having mass adoption of self-driving cars? So my belief is the opportunity to commercialize and deploy
Starting point is 00:10:22 autonomous driving technologies in various forms, China will have opportunities get ahead of the United States over the next three to five years. Primary for, I would say, a few areas. One is different regions, whether it's municipality or provincial government or central government, they see this as an opportunity for the China's auto industry to get out of where, right now the China auto industries, there's no real strong technology,
Starting point is 00:10:55 heavy fragmentation with over 250 OEMs. The Chinese government very much would like to take the autonomous driving dimension of innovations to enable the Chinese, China auto industry to leapfrog, to be the world's best in the world. So the government is a factor. For example, there's five municipal government right now, members or partners by those open autonomous driving ecosystem, open platform called Apollo.
Starting point is 00:11:32 So they work towards us on a variety initiative, for example, new kind of driving schools that were certify autonomous vehicles for different level of maneuverability. Just like a driving school today, they will certify human drivers. You pass through certain tests. So we are working on that. And we're working with a new city is being kind of built up by the Chinese government plan
Starting point is 00:12:02 would be bigger than Shenzhen, will be bigger than Dubai in the five to ten years. It's called Shon. It's a massive new city is being built up from pretty much zero. So working with them on designing new infrastructures, new segment of the cities, that makes much easier for autonomous vehicles to be deployed. Just as an example, let's say today's cities, you have streetlights, and the streetlights in many ways is a sensor device. It enable the sensors of a vehicle to be able to better see the road. It just happened to be the one entity that does the sensing are human, and the human uses the eyeballs. When it's dark, you won't be able to see the road, see the separation of the roads, and you have streetlights.
Starting point is 00:12:51 But imagine in the future, when the sensor is not done by the human eyeballs, but different sensors, whether it's a radar, radar, or cameras, whatever the sensor technology use, the future city infrastructures, those streetlights will be intended for, non-human sensor capabilities to see the road, to be able to navigate the road. So we are actively designing those new type of infrastructures and having an ongoing discussion with these municipal government to lay out plans to build those infrastructures with the intent to have commercial deployment of autonomous driving in various forms. So if you combine all those efforts, together, I very much believe in the next three to five years, we'll see autonomous driving in China gets deployed in more variety in larger scales than other markets.
Starting point is 00:13:50 Fascinating. Going back a little bit to kind of more broadly, China and the United States, you were managing very large software engineering teams here in the United States, and now you're doing the equivalent in China. What are some questions? cultural differences you've noticed in terms of how people work, how you have to manage in between those two countries? Yeah. First of all, Baidu's engineering culture, product culture, is very similar to Microsoft, very similar to what I know of Google, even though I haven't worked at Google, but I have enough interaction
Starting point is 00:14:28 with friends who work at Google. Essentially, very heavy in technology, very heavy in algorithms, very heavy in large-scale computings. very weak in product design, very weak in understand user needs, human needs. As a result, the technology is good. The product generally isn't great. I'm not critiquing or criticizing my former colleagues, but Microsoft as a company, in many ways, lacked behind companies such as Apple
Starting point is 00:15:01 and Facebook in building truly mobile, particularly mobile, consumer product that struck the emotional connections with users and whether it's application or services or devices the fit and the finish the experience
Starting point is 00:15:20 design is very much more than appeal to young demographic, young generations. Microsoft as a company struggled on that and I see similar things from what I can see. Google as a company their products that I use and the by do exactly the same way. That's one of the
Starting point is 00:15:36 I was trying to change the engineering culture at Microsoft. Actually, that was the reason why I broke my leg. But it's a different story. Because you need to earn, learn, learning new way, doing things. Can you just tell us, yeah, about the bicycle that you rode, which is, I think, how you got that injury? Yeah, because it was a, there's something called a backward brain bike. If you search on YouTube, how to ride a bicycle,
Starting point is 00:16:01 there's plenty of videos. Essentially, the bike goes the other way. the other way. If you turn to handle this way, the wheel actually go the other way. The reason, there's some profoundly important reasons, because first of all, we human learn, there's three primary reasons we learn. This is called experiential learning, and the bicycle riding is the often set as best example, because you cannot learn how to ride a bicycle by watching other people riding bicycle, by reading about it, by people telling about it. You have to ride bicycle yourself and often bumping, bruising, hurting.
Starting point is 00:16:37 But guess what? There's one thing. Once you learned, you never forget. It's in the muscle memory. You don't think about it. And that's the problem for a large organization for cultures. Because the reason those big companies, they couldn't survive when you've come, that's based on Professor Rebecca Hedarsson's study at the Harvard Business School,
Starting point is 00:16:55 is that those mature organizations, their muscle memory, the way they talk to customer, that they will do research. the day we design experiences was built like 30 years ago. And they don't, you know, they try to think, but their muscle memory don't think, right? So they were just to do things that way. So if I ask me why Microsoft couldn't get mobile at all, isn't that we're not working hard, we're working super hard,
Starting point is 00:17:19 isn't that people are not smart, we tried everything, we buy no gear, we built a katana, you know, you name it, we tried everything. But the product honestly sucks. It's just because the muscle memory. So I was searching for an answer. Rebecca Henderson was the one who convinced me this is the real problem.
Starting point is 00:17:38 So Microsoft colleague of mine, his name is Bill Buxton. He's one of the kind of people. He's like, hey, gee, you should try this bicycle thing. It was really illustrating. So we built the bike, Bill Buxter and another one, the three of us, will try to practice because this bike, for a normal adult,
Starting point is 00:17:58 who knows how to bike, takes you about eight months training every day. And once you learn how to ride that bike, you won't be able to ride the normal bike anymore. Because you need to rewire your muscle, your brains. And I think for larger, in addition, culture change, is that difficult because it's your muscle memory. The way you do things, it just becomes,
Starting point is 00:18:20 you don't even think about. Even though the CEOs say, we're going to die, you guys have to figure out mobile. You know, they try, try, the mobile product just like a PC product, smaller phone, right? Because that's how they do it. So coming back on culture, I see Baidu has very similar traits of Microsoft that I work with.
Starting point is 00:18:39 So what I'm working on today with Baidu is really to change that engineering cultures to be a lot more product-centric, to be a lot more understanding user needs, particularly for mobile product, for AI product. And then I briefly answer the engineering culture between companies that are in China versus companies in the United States. There are various different aspects of it. The biggest thing,
Starting point is 00:19:08 I need to perhaps think more about summarizing my head what I observed so far, some of the key differences in terms of product engineering culture. The one thing I would say is start for me, I learned a lot in my eight months plus living, working in China, is the product people in China. a lot more philosophical.
Starting point is 00:19:29 They are a lot more reflective. They think a lot deeper than what you would typically observe from a product people when they describe their product. And also the Chinese, the R&D product leaders emphasize a lot more self-reflection.
Starting point is 00:19:49 They use the word cognition, but it means a person's ability to understand. to make judgment, make decisions, essentially they emphasize a lot more self-improvement for product people in particular, how you elevate your cognitive capacity. So if you ask me, the one thing started out for me
Starting point is 00:20:13 is I used to believe the product people in the United States companies is better than, now I kind of help the other way around. I see better product people more often, in Baidu, in other Chinese company that in Rattow was then, perhaps, I would say, on average, the percentage. Huh. Well, so on that point, there's another belief, I think, in the West, that, you know, California and Silicon Valley
Starting point is 00:20:45 are very creative environments, and they really allow ideas to come up and bubble up from any person in an organization, versus China where the image, I guess, that we think to ourselves is a very structured society that is very good at implementing something, but maybe not as good at creative free thought. Would you agree with this sentiment at all?
Starting point is 00:21:09 And if so, how do you think that plays out for, say, doing core research that involves a lot of creativity? Yeah. So great question. That's a good one. So I would say there are different degree of, choose towards the top-down nature for Chinese company.
Starting point is 00:21:28 Baidu, even though among the Chinese tech company, Baidu is the kind of the closest in terms of culture to Silicon Valley. A lot of people, their pedigrees are Google, worked at Google or with the Microsoft. Meaning English is also kind of a common working language. You won't have any problem if you just speak English or writing email English. But even that, the top-down phenomenon happens. And my hypothesis was, this is perhaps due to 2000 plus years of Confucius.
Starting point is 00:22:01 You know, the Confucius is essentially harmony through hierarchy, right? So that's the central idea of Confuciism. So having said that, the company that I work with, including Bidu, or realize driver innovations is a lot more about empowering teams, empowering capable leaders to experiment, to try new ideas at the fast velocity. Baidu does a lot of those, and in the startups that I interact with, they emphasize that aspects a lot. There's no difference in terms of belief and practices than Silicon Valley startups that I see.
Starting point is 00:22:43 And the large company, one company I'll probably point to, I believe, overall does a good job is Tencent. Tencent, they have this challenging culture. Any ideas, they encourage to challenge the more authority of senior peoples. And also, for any major initiatives or any areas of new innovation, they tend to have two teams, three teams, working on the same thing. There's a lot more internal competitive dynamics that are going on. And one last thing, in Baidu, we have this quarterly meeting.
Starting point is 00:23:19 we have all our companies directors. We have about 200 directors. Once a quarter, we'll invite speakers. And the past few speakers, they all emphasize the aspects of building a learning organization so that a truly thriving organization, each cell, each teams, they are able to be nimble, adapt, quickly learn.
Starting point is 00:23:43 So even though there are this couple thousand years, the Confucian, I think it's still somewhat there, reflects to different degree in different companies. But by and the large, driving innovation empowering teams, empower leaders are the common understanding. And everyone's the decision is striving to do more and do better in that regard. So there's no fundamental difference than Silicon Valley, I would say. Interesting. And do you think that by Do you think that Baidu and Tencent then are kind of the exception to the role? Like, is, is, are you guys feel? somewhat alien compared to other Chinese companies, which may be more structured?
Starting point is 00:24:23 Yeah. So I would say among the Internet or technology, IT technology related to the companies, even though I haven't talked to a whole lot of them yet, based on what I have seen so far, are largely in the mode that I just described. But when you go out of that range, you go to much more traditional companies, let's say steel industries or traditional retails, then you will see more of the
Starting point is 00:24:53 Confucius and hierarchical styles in management. Again, I haven't done studies just my perception. I would say this is how I perceived. So today it feels like, in particular,
Starting point is 00:25:11 when it comes to AI research, most of the great research is still being done, here in the United States. Do you think that will change over time when we start to see 20, 30% of the papers suddenly be published from China, or will America kind of always be the hub of AI innovation? Yeah, so this is one topic I had
Starting point is 00:25:32 somewhat ongoing discussion with many of my colleagues in China. Our current view is the very top end of research that's fundamentally paving new ground. I would say the example in AI will be, let's say, deep-minded open AI. I think that won't happen in the next few years. That won't happen in China. Unlikely, what I don't say?
Starting point is 00:26:00 Won't say, it's unlikely to happen. The odds of that type of research happening in China perhaps will take quite a few years. Right now, we see the research community, particularly the upper echelon, the gap is closed. the leading Chinese universities. The way the gap is being closed is, a lot of those researchers, they are pedigree, they study in top-tier university in the United States,
Starting point is 00:26:28 where it's Stanford, Princeton, and they go back. So the gap is closing, but the overall environment, the culture context, isn't quite there yet, meaning that it's completely driven by your imagination. the social economic surrounding is still not quite the same as the United States, whereby you have truly world-class people driven by pure the desire to seek knowledge,
Starting point is 00:27:00 the desire to unleash imagination. Often these researchers are done in the context of personal fame, economic payback. Once you have those, you constrain yourself. you don't see very far, you don't go pursue the bigger dreams. But our collective belief, at least myself, my bunch of colleagues, friends, we all believe giving enough time, let's say in the next five to 10 years,
Starting point is 00:27:29 you will see top echelon research work happen in Chinese institutions. And it's certainly my hope that in the next, in somewhere between five years to 10 years windows, We will have equivalent of research organizations, let's say, open AI, deep mind type. That would be truly do groundbreaking research towards AGI or different type of initiatives that would be at the very four frontiers of extending the scope of humaneness. It takes time, we believe it takes time, not in the short future yet, but it will happen.
Starting point is 00:28:11 How are you going to nurture that? Are you going to try to create a Baidu research lab that somehow has a different culture around it than what traditional Chinese academia has? So there are several dimensions. One is corporate research labs. Baidu is doing quite a bit, and our peers, whether it's Alibaba or Tencent,
Starting point is 00:28:34 they are also investing quite heavy in corporate research labs. At the same time, the national labs, the top-tier universities, They are doing more and more. And there's also, in the private sectors, there's always ongoing discussion, a new type of research entities can be envisioned and they can be created.
Starting point is 00:28:55 So there's an ongoing set of ideas being explored. I think likely it will be a combination of corporate research lab university and somewhat new generation, let's say open-air type of research organizations, will be established over time that will be capable of carrying top-tier research work
Starting point is 00:29:15 that's based in China. Interesting. Shifting gears to a completely different topic. Another thing that is a hotly debated topic out here in Silicon Valley is cryptocurrency. No one really knows how to understand China's approach to cryptocurrency. So what's your take on it?
Starting point is 00:29:38 So I would speak from Baidu's perspective, not necessarily my personal view, because I haven't spent enough time at this particular subject to kind of develop views that I thought would be educated views. I would say it's more from Bidu's company perspective. One is we view blockchain, the underlying technology as a fundamental,
Starting point is 00:30:05 foundational capabilities the company needs to have. because BIDU is in the financial services businesses. We have a unit we offer our financial services, and we try to turn that into a platforms to enable traditional financial institutions to be able to modernize their businesses. And we have a team internally built up a set of core infrastructures that enable us to build a future generation of financial services
Starting point is 00:30:36 using that. And at the same time, we're also using blockchain-based technologies to build a new generation of data platforms because when I said earlier, data will be a primary means of production and the ownership, provenance, value attribution of data will become increasingly important.
Starting point is 00:30:58 So we want to make sure that we, by the way, by the way, build the right infrastructure to anticipate for that future of the world. We, as a company at this stage, do not have active participation in the cryptocurrency aspects of the equation. I want to add one more thing about the research you mentioned,
Starting point is 00:31:16 which is in some ways important, I forgot to mention. Essentially, we now have a view. This is more of a by-doo's view. We thought China as a nation has been a talent exporter. We essentially send our best people to the United States. Some of them come back. Most of them don't. We believe China as economy,
Starting point is 00:31:35 as a market has the opportunity to become a net, not necessarily net, but at least top-tier talent importers. So in some ways, the Baidu research lab in Silicon Valley is intent to be the base station, if you will, to attract truly world-class researchers to work in an environment whereby they can have access to vast amount computing resources, data assets, they may not otherwise necessarily have access to had they work in a
Starting point is 00:32:10 organization, research organization in the United States. And also in terms of collaborations, we are actually working with top-tier university, whether it's MIT, Stanford, CMUs, and the goal I set for my team is, one is we want to collaborate and have found some of the very best faculty members, graduate students, and when PhD students in the future, those top-tier university graduate, Baido needs to be the top five names when they think about which company they want to work for.
Starting point is 00:32:40 So it's not necessarily Chinese companies' research labs are done by Chinese. Those research labs increasingly will be done by global talent, and they're working on problems that's targeted towards the China market and then has the opportunity to globalize it. So can I maybe spend one minute to begin? give you that because I think it's important
Starting point is 00:33:06 lens on how we think about top-tier researchers. The context is the technology market up to this point. By and the large is something we at the Microsoft always say it's
Starting point is 00:33:21 Design for America, trick slightly sell global industry. Because the United States is the only country has all those ingredients, talent, capital, risk capital, technology, market, it's the only place. This conditions, this combination of conditions doesn't exist in Europe, doesn't exist in any other
Starting point is 00:33:43 regions, but China now has all these. Not quite at the top tier, not quite as good as the United States, but they have all those agreements. It is my belief the technology industry would be a, for a while, would be a two pillar, essentially driven by the United States and a portion of the company come from China. So if we view from that perspective, the product that increasingly initially targeting for China market, we have globalization opportunities increasingly because this is how we're going to attract truly world-class people to work at the company like Baidu. Just as one example, let's say, for smart homes, we believe the product that's landing in China market well for small home product, whether it's speakers or new TVs, use voice, dialogue-based interfaces, we have a better shot of globalize it than those products will be designed in the United States for one important reason.
Starting point is 00:34:46 homes in the United States only works in North America maybe a little bit of Europe outside those you don't have homes like this you have very spacious different rooms the acoustic environment far-filled speech recognition wake up water has to be five meters or long
Starting point is 00:35:04 you optimize for this a home in China is a lot closer to a home in Japan a home in India a home in Brazil so we actually do have that view So in Baidu, we're building our version of Alexa, our version of echo type of systems with the long-term aspiration of globalizing those products.
Starting point is 00:35:26 And because we believe we are targeting a home environment, acoustic environment, usage environment, that's closer to our initial target market than the United States, the initial target market. So I think these cases, we will find more, more of those cases, as we move forward. And that's one important factor.
Starting point is 00:35:49 Those leading Chinese companies, increasing in my views, we have the opportunity or ability to attract world-class researchers to be part of what they try to do. Interesting. I want to shift gears kind of one last time to a different collection of topics, which is around management. A lot of people listening to this podcast,
Starting point is 00:36:12 maybe CEOs or managers, and they're trying to figure out how to manage their first engineering team. So what are some learnings that I guess you've collected along your way, managing very large teams at Yahoo, Microsoft, and now Bidu, that you would give to someone who's just starting out in engineering management? First of all, I would say managing an engineering team, particularly for the first time you're managing an engineering team, you need to focus on making sure that the,
Starting point is 00:36:45 the engineering foundations, particularly build processes, build tools, are well-designed, well-engineered, well-taking care of. My learning of managing engineering teams is that if you take slacks in those regards, ultimately, what you pay, it's like the both angles, becomes bigger and bigger. Anytime you, because you will always have pressure to ship product, build the business, get customers, there's always the temptations to cut corners
Starting point is 00:37:20 don't, because you will be far better served up front, making sure that engineering foundations are sound. That's only important aspects for first-time managers to manage engineering ingenuity. The second is engineers, I would say, is means to end. The leader himself or herself, and the teams pay attention to product, pay attention to how the product gets used,
Starting point is 00:37:49 understand that today's usage scenario usage patterns anticipate the future usages, in my view, is extremely important because you won't be able to truly build great engineering systems or engineering capabilities without grounding those in the product contest. In particular, immerse yourself truly understanding what the users are using. product today and how that usage will grow in the future so you can anticipate. That's another aspect.
Starting point is 00:38:19 The third related to that is understand the business because a lot of times the engineering work will be driven by monetizations, driven by distributions. And these are just as important as you grow the company's business. And understanding the business models, how that impacts your product, how that impacts your engineering capabilities early on and embrace those challenges up front. It may slow you down in certain aspects, but it pays off for you to take time to understand these, build those capabilities in, and anticipate the future needs. Also, the last thing is just cultivate a learning, iterative experimentation culture and mindset, because it's always a journey. You may think
Starting point is 00:39:10 at a very point you figure out. I know how to do this. This product should do it this way. But the market is always fluid. The competition is always dynamic. Setting yourself your team up for rapid iterations, for quick iterates through different type of ideas and be able to seize new opportunities
Starting point is 00:39:30 is also very important part for a first-time engineering managers to set the team up for. And I guess a related question is, what does Chi Liu look for in people when you interview them? They plan on different jobs. So right now, for my current job, the type of people I'm looking forward to people who really
Starting point is 00:39:54 understand the future mainstream users, usage patterns, particularly in-depth understandings for human needs, and also be able to see through the noise and understand that the fundamental mental undercurrent that driving those human needs because I think more and more engineering tools become more mature, product development methodology become more mature, those all become table stick. What's at the premium will be those individuals who really understands human and they can anticipate human needs and they can envision experience in that context. That's what I think we will be at the premium for most the companies that I can see.
Starting point is 00:40:46 And if I look for different type of jobs, even though I may not necessarily be hiring a product manager, but I still look for that aspect. My view on this is product sensitivity is the center of every line of work, whether you are salesperson or marketing person, engineers, even HR person.
Starting point is 00:41:05 If you understand the product, it helps you to do your job better. So kind of understanding products and predicting future usage patterns. Anticipating. Seeing the future, to me this is increasing a foundational strength for any type of leaders. I spoke to some of your earlier colleagues in Microsoft, and almost everyone said that you were an incredibly productive person. And so I'm curious to ask you if you were always that way, and if not, what are some tips or tricks you've learned along the way that have kind of made you you are today. I wouldn't say I'm always productive. I try to be productive. And I think
Starting point is 00:41:46 what helped me was a simple mindset, more of a personal belief, which is a very simple view. I view myself as a piece of software. Today's version must be better than yesterday's version. Because there's a cliche, life is too short, why live the same day twice? And tomorrow's version has to be better than today's. So even though I make mistakes, the mistakes are an important opportunity to learn. So you can imagine the software will have
Starting point is 00:42:17 more if statement so that when similar situation happened, you will avoid those. So it's that simple mindset. Keep the curiosity, keep learning. Again, I wouldn't say I'm always productive, but I always try to be more productive.
Starting point is 00:42:33 If someone is listening to this podcast now and is just thinking of somehow getting started, either in the AI world or software engineering more broadly. What would you recommend they do? How should they go about figuring out what to do, where to apply, where to work? I would say go to Hacker News slash.github. Read a few articles, comments, and go to GitHub's.
Starting point is 00:43:01 To me, get your hands dirty, grab some piece of code, run a model, and soon you will have inspirations, ideas coming to your mind. And as you keep doing this, I'm pretty confident you'll find what you love to do. Was there a point in your career where you considered doing something else, or was it always clear to you that this was going to be your craft? I actually, yeah, along the way, I thought about doing various different things. when I was in China in early childhood, I always wanted to be a philosopher
Starting point is 00:43:38 because I thought that in order to truly solve the world's a lot of problems, we need to have philosophical end up opinions. At the time, it was a little bit of influenced by studying communism because it was a required study.
Starting point is 00:43:58 We're required to study you know what Marxists said there's the communist manifesto. In my view is one of the, even though the theory in my view has issues, but it was one of the best written manifestos. So I was always envisioning myself being a philosopher. But along the way,
Starting point is 00:44:19 pragmatic constraint led me to the current past because when I was young, I tried to be engineers, go to a ship, building factory. At the time, I think that was like in the mid or late 70s, building big ships was kind of the most glamorous job. So if you say I work for a ship building company,
Starting point is 00:44:43 you're kind of wow, people. But I wasn't strong enough because in my years, only 3% people can go to college. I wasn't tall enough, I wasn't heavy enough. You have to be like, for those type of schools, you need to be over 50 kilograms. And the way they do is they weigh you before you kind of go to the exam. So I remember, you know, keep eating, keep eating.
Starting point is 00:45:08 Every day, weighing, just couldn't get to that 50 kilograms. So I couldn't get to that. So I wasn't qualified for a lot of those. And then ask around, the people say, oh, I have eyesight problem. I have a near side. I couldn't really go to some of the discipline that I want to study. And then there are only two choices left to four. for me to go into the field of study,
Starting point is 00:45:33 mathematics and computer science. And ask my neighbors, people for feedback or advice, what should I pick? People would say, if you study mathematics, you can be a kind of a middle school teacher. If you study computer science, maybe you get to work at the radio factory. So my parents thought radio factory was better.
Starting point is 00:45:54 So I was like, okay, let's pick computer science. So really had no idea why. Why, once I start to work on this, I truly fell in love. I think a very, very blessed, lucky that I get to work on the things that I was able to do. Do you still code? Not anymore. So I read the code. I read, because coding, I gave up quite a while ago, actually, when I was a Yahoo.
Starting point is 00:46:25 I was still doing coding when I was SVP. I felt that's important for me to remain hands-on. But when it was reaching a point, my boss saw that at the time, he was yelling at me, like, you are blocking your teams. I think he was right. Because if I don't check in
Starting point is 00:46:42 or if I have more bugs, it's actually hurting them more. So what I end up doing is, this is actually a brainstorm at the Microsoft to build quite a bit. Essentially, you need to remain hands-on, remain sharp.
Starting point is 00:46:55 My approach is for the core algorithm, I must understand all the details. For the foundational systems, the architecture design, I want to put myself, I can go toe-to-to-to was the best architect, best algorithm people to debate with them why you design that way. But coding, I thought it wasn't the productive thing for me to do anymore. So I gave up when I was at Yahoo at that late stage. I actually want to dig into that a little bit because it's a question I noticed as well at Apple, which is if the SVP is involved intimately in the algorithms,
Starting point is 00:47:34 on the one hand, you're in control of the entire system. It's quite good. On the other hand, it could be seen as kind of micromanagement. You're not giving an opportunity for the directors and the managers to grow. So did you ever get that feedback? Oh, yeah. All the time. This is, to me, it can be managed properly.
Starting point is 00:47:53 Because I view my role is not to make decisions. My role is to challenge you. So I always say, why you have to design this way? No, I want you to give me a perfect solution because I know algorithm can be this way, but also always made it clear, it's your decision to make. But I see you have holes in your thinking. I want to challenge you.
Starting point is 00:48:13 I want to debate with you. So I kind of ask Bill, how do you keep up? What's your approach? He essentially uses a similar approach. He knows Excel code base, extremely, probably better than anybody else. And, Bill Gates. Yeah, yeah.
Starting point is 00:48:28 So, you're like, when sometimes we have, I mean, like, gee, trust me, I know the code better than you do. I know. I got that. But I, the, and then you also surround yourself with a bunch of technical, technical talent. That they all are super in each of domains. You have ongoing dialogues. This is how you essentially keep your mentally very, very sharp. But the decision making to me is managing entirely different.
Starting point is 00:48:55 I think it's very, very. As a principle, you want to make sure that your chief scientist gets to make algorithmic decisions. For me, like Young Patterson, now he has a Twitter. He and I have debate, arguments for, I don't know, God knows on so many fundamental issues, but always medically young, and you make the decisions. But I think you're wrong here. I disagree with you. I want to debate with you.
Starting point is 00:49:19 So I participate on a lot of those to keep myself grounded in my thinkings, understand the low-level detail of the algorithm, the key algorithms, whether it's in rankings or content quality, all those, and then on key systems, the underlying systems, low-level fabric, I thought it's very important to understand those. And you pick a few more of a pillar type so that your high-level understanding
Starting point is 00:49:46 can all the way go to the physical layers. And that helps to calibrate other different type of systems. You have something to anchor your thought with. And then in management, maybe I will say one more thing. This is a great way to not people bullshit you. It's bullshit it all the time. If you do a few times, they don't know you can't bullshit this guy because he's going to challenge you.
Starting point is 00:50:07 So otherwise, you know, people will cook a couple beautiful stories, try to, you know, bullshit, right? So because it's, in large organizations, everybody wants to be promoted. Not just for anybody intent, but sugar, coating, exaggeration happens all the time. If you yourself are grounded in core technologies, it helps to set the tone right. When we talk about technology, let's have honest debate, sharp contrast debate, but make it clear, the leaders are in charge making decisions.
Starting point is 00:50:40 So pick a few key technologies that you actually have full stack knowledge of, but don't try to have that knowledge for every single part of the organization. I think it's impossible. I used to... Then you break, yeah. In terms of management, I can tell you my practice, a Yahoo, I was able to largely do this. Essentially, my requirement for myself is I can do the jobs to level down. For a number of important reasons,
Starting point is 00:51:02 because I can tell whether my guy gets bullshit or not. Right. Because I can often tell you, dude, you got bullshit about your guys because I talk to them, I know what they do. Because I do that a few times, you set the tune. They work super hard. They make sure that I don't spot them, they got bullshit. So it really kind of anchors the engineering organizations.
Starting point is 00:51:24 Everybody is doing the best work. Everybody's honesty in that communication. Nobody tried to bullshit your boss. So I insist I would be able to do the jobs to level down. So I always do that. But at some point, it's just too much. It's just physically impossible. Then you pick a few key.
Starting point is 00:51:44 To me, I call it, my mental model, there's a right-hand left-air, particularly for product. Search essentially, Algorithm and system architecture play equally important role. Pick the core set of algorithms. I study everything, essentially. All the details I study and debate, discuss who is the best people.
Starting point is 00:52:02 And then core systems, whether it's content systems, serving systems, from all the low level, all the way up, just to pick those. And then you can calibrate all other systems. You can just see, oh, that system is similar to this. I don't need to understand detail, but I can extrapolate on how that system works. That's a very interesting rule. So be able to do the job two levels down. Now, something that I think will be on the mind of any CEO listening to this, does that apply to Satcha? That is to say, do you anticipate Satcha being able to do your job and the people that report to you's job? Sata used to report to me for two years. We kind of talk about that. We all understand there's a spirit of that approach and there's also limitation on what you can. physically do. But if you can find ways that works for you, but achieve the same effect,
Starting point is 00:52:58 meaning the effect is each leader's, you are granted on technological, the real end-the-peeing of technology. You don't build your strategy based on shallow, unsupported understanding of technology. That to me is important. Our industry is driven by technology, and there's many different ways to do that. Different people may have different approach. As long as you achieve that, as long as you set the tune for any sort of discussions, nobody should bullshit on things. You don't exaggerate, you don't try to get extra credit that you don't deserve. You honestly talk about your technology, honestly talk about your prone-the-cons. As long as you achieve that, I think, because it's the outcome versus the approach.
Starting point is 00:53:44 For me, I used to do that because I was Yahoo is kind of easy for me to do it. I was, when I, leaving Yahoo, I had an organization about 3,000 people. I thought that I pretty much know all of them, hired a lot of them, work with a lot of them.
Starting point is 00:54:04 So you kind of get used to it, say, okay, tell me, show me your code, let's look at the system, how you do that things. But in Microsoft, it's a different setting. I don't think you necessarily have to follow that approach. As long as the goal is achieved,
Starting point is 00:54:19 each senior executives making your decisions based on grounded understanding of the end-appeating technology and its trajectory, what's drive those technology forward. And then, organizationally, there is a truthful, honest conversations. If there's a side to err on too much or too little rope, it seems like you would err on the side of, too little rope. That is to say if you can micromanage or be too distant, would you err on the side of micromanaging almost?
Starting point is 00:54:51 No. Let me say this, it's a evolving journey for me. If you ask me today, I will err on the side of giving more for seven important reasons. It's my learning, particularly more recent, in China. Increasingly, what I come to realize to is each company, there's overall operating output capacity. The capacity is really driven by the leaders' understanding and the learning capabilities, and the structures they set up to enable unleash more independent points of views, independent learnings, to pursue for the same objective, which is the company's overarching, vision, and the mission. If you overly constrain to say there's some degrees of a tight harmony along certain dimensions, you tend to overly constrain the collective
Starting point is 00:55:58 imagination, creativity, capacities, organizations. So therefore, I'm more and more in the mystery of designing organization structures and meta models that enable organizations have more leaders, senior leaders, that are able to exercise different way of thinking, different lens of looking at the same problems, and to be able to pursue an experiment when we try to solve a larger problem, so achieve larger missions. In the past, I was more on the operating more of a so-called tight ship, ensure everything
Starting point is 00:56:44 falls in line. But out of my own learnings, at this stage I see a lot more good by having an organization that gives more ropes to our leaders, give them more autonomy, give them more independence. But somehow orchestrate the entire endeavor in a way that the effort or effort or add up towards a common mission, common goals.
Starting point is 00:57:10 That to me is an important quest, but I will lean towards giving more ropes. So I guess you just have to be very careful with those leaders to make sure that they themselves are not giving too much rope and so forth and so forth. Yes. You need to design a meta structure. In that context, motivation is very, very important. Understand the human motivation become a key part of designing that,
Starting point is 00:57:36 metastructure. And I think what Reed Hoffman's book, Alliance actually is one of the simple but effective model. Essentially, you have three different type of tour duties. And particularly for senior ones, are you really foundational? Let's say we're going to go all the way into the end. We're so aligned our share the goals, or you are much more of a transformational. You just want to get something into your belt so you can move on next phase. As long as you are very clear, and then you know that you are senior leaders or your important position,
Starting point is 00:58:11 each people, they're motivated driven by what? Because motivation is very important. Capacity, motivation, in a structure that ties these things, loosely tie these things together. To me is perhaps at the, again, we use the word, at the premium of company design, organization designs that enables an original funding teams or management teams, to unleash a lot more innovation capacities. Hmm. As someone who's very philosophical, but also has an engineering mindset,
Starting point is 00:58:47 how do you kind of marry both of those worlds to live by specific rules? The answer I will give you is, when I joined Microsoft, Steve Baumar asked me to, my first speech is give a self-introduction about myself. what I live for, how to do my work. So essentially I wrote a simple set of slides. I think I mentioned five things.
Starting point is 00:59:15 These are not necessarily rules, but I think largely I think we'll answer your questions. Essentially, first, learn every day. What I do talk about? I view myself as a piece of software. Don't leave the same day twice. The second is, integrity. To me, integrity has three subsets. One is always speak truthfully. You will not hear me
Starting point is 00:59:47 say the same thing differently when I talk to different people. Always say, I may be wrong, but I will say the way I see it. That's one aspect of integrity. The other is keep my word. If I give you my word, I would do everything I can to give my word. To me, it's very important. A third part of integrity is acknowledge my mistake or weakness. To me, as a leader, this is an important part of have high integrity, because we're going to make mistakes. The leadership publicly acknowledge the mistake you made, all your weaknesses. So that's integrity.
Starting point is 01:00:23 And being frugal, to me, a penny earned is, a penny saved is same as a penny earned. there's always rainy day when you can save financial resources, always save because there's always better way to use those resources. So being frugal to me is always important to part of what I do. Let me see. There's five things, integrity, learning every day, work ethics. I always say for me personally, I would do something, I will do a work only if this work I thought I love so much, I will be all in, essentially leave nothing behind. Every ensemble energy, it's all in there. So that's work ethics.
Starting point is 01:01:13 When I say work ethic is always making clear that people in my own, you don't have to follow what I do. Because having a balance to work-life balance is always a good thing for, but for me, I'll always be all in. I forgot there's one more thing. there's one more thing I remember there's five things I said give me a little more time maybe able to remember but this is what I
Starting point is 01:01:38 share with my teams when I initially joined Microsoft to say who I am how do my work you can consider those are rules but these are the fundamental sort of beliefs that guides what I do
Starting point is 01:01:54 I feel like that's a very good note to close on Chi, thank you so much for spending the time with us today. You bet. Thanks for having me. Real pleasure. All right, thanks for listening. So as always, the video and transcript are at blog.w.combinator.com. And if you have a second, please subscribe and review the show. All right.
Starting point is 01:02:12 See you next week.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.