Microsoft Research Podcast - Abstracts: Heat Transfer and Deep Learning with Hongxia Hao and Bing Lv

Episode Date: May 8, 2025

Silicon has long borne the burden of heat transfer in electronics, but in a post-Moore’s Law world, researchers like Hongxia Hao and Bing Lv are using AI to discover and design next-generation mater...ials that exceed the limits of silicon’s thermal conductivity.Read the paper

Transcript
Discussion (0)
Starting point is 00:00:00 Welcome to Abstracts, a Microsoft research podcast that puts the spotlight on world-class research in brief. I'm Brechen Husinga. In this series, members of the research community at Microsoft give us a quick snapshot or a podcast abstract of their new and noteworthy papers. Today I'm talking to two researchers, Hongxia Hao, a senior researcher at Microsoft Research AI for Science, and Bing Liu, an associate professor in physics at the University of Texas at Dallas.
Starting point is 00:00:38 Hongxia and Bing are co-authors of a paper called Probing the Limit of Heat Transfer in Inorganic Crystals with Deep Learning. I'm excited to learn more about this. Hongxia and Bing, it's great to have you both on abstracts. Nice to be here. Nice to be here too. So Hongxia, let's start with you and a brief overview of this paper in just a few sentences. Tell us about the problem your research addresses and more importantly, why we should care about it. Let me start with a very simple yet profound question.
Starting point is 00:01:10 What's the fastest heat can travel through a solid material? This is not just an academic career's or policy, but it's a question that touches the bottom of how we build technologies around us. So for the moment when you type your smartphone and the moment where the laptop is turned on and functioning, heat is always flowing. So we're trying to answer the question of the century-old mystery of the upper limit of heat transfer in solids. So we care about this not just because it's a fundamental problem in physics and material science, but because solving it could really rewrite the rulebook for designing high-efficiency electronics and
Starting point is 00:01:48 sustainable energy etc. And nowadays with very cutting-edge nanometer chips or very fancy technologies, we are packing more competing power into smaller space, but the faster and denser we build, the harder it becomes to remove the heat. So in many ways, thermal bottlenecks, not just transistor density, are now the ceiling of the most lore. And also the stakes are very enormous. We really wish to bring more thermal solutions by finding more high thermal conductor choices from the perspective of materials discovery with the help of AI. So Bing, most research builds on or even challenges existing work.
Starting point is 00:02:35 So tell us some of the work in this field to date and what gap your research fills. So I think one of the biggest thing as Hongxia said, right? Thermal solution will eventually become a bottleneck for all type of heterogeneous integration of the materials. So from this perspective, so how people actually have been finding out previously all the thermal was the last solution to solve. But now people actually more and more realize all these things have to be upfront. This co-design, all these things become very important. So I think what we are doing right now integrated with AI, helping to identify this large space of the materials, identify fundamental what will be the limit of this material will become very important for the society.
Starting point is 00:03:30 Yeah. Hongxiao, did you have anything to add to that? Yes. So previously, many people are working, exploring these material science questions through experimental tradition. And the past few decades, people see a new trend using computational materials discovery. Like for example, we do the fundamental solving
Starting point is 00:03:52 of the Schrodinger equation using density functional theory. Actually, this brings us a lot of opportunities. The question here is, as the theory getting more and more developed is too expensive for us to make a very large skill and to study tons of materials. Think about this. The bottleneck here now is not just about having a very good theory, it's about the skill. So there is why AI, specifically now we are using deep learning comes into play. Well, Hongxiao, let's stay with you for a minute
Starting point is 00:04:25 and talk about methodology. How did you do this research and what was the methodology you employed? So here we, for this question, we built a pipeline that spans the AI, the quantum mechanics and computational brute force with a blend of efficiency and accuracy. It begins with generating an enormous chemical and structure
Starting point is 00:04:47 design space, because this is inspired by select principle. We focus first on simple crystals. And there are the systems most likely to have low and harmonious state, fewer phononic scattering events, and therefore potentially have high thermal conductivity. But we didn't stop here. We also included a huge pool of more complex and higher energy structures to ensure diversity and avoid bias. And for each candidate, we first run like a structuralization using MEDESIM, which
Starting point is 00:05:20 is deep learning foundational model for the material sense for us to characterize the properties of materials. And we use that screen for dynamic stability and now it's about 200 K structures past this filter. And then came another real challenge, calculating the thermal conductivity. We try to solve this problem using the Boltzmann transport equation and the three-photon scattering process. The twist here is all of this was not done by traditional DFT solvers, but with our deep learning
Starting point is 00:05:57 model, the medicine. It's trained to predict energy, force, and stress. And we can get second and third order interatomic force constants directly from here, which can guarantee the accuracy of the solution. And finally, to validate the model's predictions, we performed a full DFT-based calculations on the top candidates that we found, some of which
Starting point is 00:06:21 even include higher order scattering mechanism, electron phonon coupling effect, etc. And this rigorous validation gave us confidence in the speed and accuracy trade-offs and revealed a spectrum of materials that has either previously been overlooked or were never before conceived. So Bing, let's talk about your research findings. How did things work out for you on this project and what did you find? I think one of the biggest thing for this paper is it creates a very large material base. Basically, you can say it's a smart database which eventually will be made accessible to the public. I think that's a big achievement because people who actually,
Starting point is 00:07:07 if they have to look into it, they actually can go search Microsoft database, finding out all this material does have this type of thermal properties. This database concerned about 230,000 materials. One of the things we confirm is the highest thermal conductivity material based on all the wisdom slack criteria predict the diamond with the heavy highest
Starting point is 00:07:35 thermal conductivity. We more or less really very solidly prove diamond at this stage will remain with the highest thermal conductivity. We have a lot of new materials, exotic materials, which some of them, Kong Xia can elaborate a little bit more. So which having all these very exotic combination of probably similar with other properties,
Starting point is 00:07:57 which could actually provide a new insight for new physics development, new material development, and a new device perspective. All of these combined will have actually a very profound impact to society. Nicole Corman Yeah. Hongxiao, go a little deeper on that because that was an interesting part of the paper when you talked about diamond still being the sort of gold standard to mix metaphors. But you've also found some other materials that are remarkable compared to silicon. Hongxiao Wang Yeah. Yeah. Among this search space, even though we didn't find that like something that's higher than diamonds, but we do discover more than like 20 new materials with thermal
Starting point is 00:08:35 conductivity exceeding that of silicon. And silicon is something like a benchmark for like a criteria that we think we want to compare with because it's a backbone of modern electronics. More interestingly, I think, is the magnet one idea. It shows some very interesting and surprising phenomena like it's a metallic compound, but with very high lattice homo-connectivity. And this is the first time discovered through our search pattern. It's something that cannot be easily discovered without the hope of AI. And right now, I think
Starting point is 00:09:16 Bing can explain more on this and show some interesting results. Yeah. Go ahead, Bing. This is actually very surprising to me as an experimentalist because of when Hongxia presented their theory work to me. This material, the magnesium valandium, it's discovered back in 1938, almost 100 years ago. But there's no more than 20 papers But there's no more than 20 papers talking about this. A lot of them was on theory, not even on experimental part. We actually did quite a bit of work on this. We actually are in the process, we'll characterize this and then moving forward even for the
Starting point is 00:09:57 thermal conductivity measurements. So that will be hopefully we're adding to the value of these things, showing, hey, AI does help to predict the materials, could really generate new materials with very good high thermal connectivity. Yeah. So Bing, stay with you for a minute. I want you to talk about some kind of real world applications of this. I know you've alluded to a couple of things, but how is this work significant in that respect? And who might be most excited about it aside from the two of you?
Starting point is 00:10:28 I think as I mentioned before, the first thing is this database. I believe that's the first ever large material database regarding to the thermal connectivity. It has, as I said, 230,000 materials with AI-predicted thermal connectivity. And it has, as I said, 230,000 materials with AI-predicted thermal connectivity. This will provide not only science but engineering with a vastly expanding catalog of candidate materials for the future roadmap of material integration. And all this bottleneck we are talking about the thermal solution for the semiconductors or for even beyond the semiconductor integration, people actually can have a database to looking for.
Starting point is 00:11:11 So these things, it will become very important and I believe over a long time, it will generate a very long impact for the research community, for the society development. Yeah. Hongxiao, did you have anything to add to that one too? Yeah. So this study receives how we think about limits. I like the sentence that the only way to discover the limits of possible is to go beyond them into the impossible. In this case, we tried,
Starting point is 00:11:41 but we didn't break the diamond limit. But we proved this more rigorous than ever before. In doing so, we also uncovered some uncharted peaks in the thermal conductivity landscape. This will not happen without new AI capabilities for material science. I think in the long run, I believe researchers could benefit from using this AI design and shift their way on how to do material research with AI. Yeah, it'll be interesting to see if anyone ever does break the diamond limit with the
Starting point is 00:12:14 new tools that are available. So this is the part of the abstracts podcast where I like to ask for sort of a golden nugget, a one sentence takeaway that listeners might get from this paper. If you had one, Hongxiao, what would it be? And then I'll ask Bing to maybe give his. Yes. AI is no longer just a tool. It's becoming a creative partner for us in scientific discovery. So our work proved that the large-scale data-driven science can now approach long-standing and fundamental questions with very fresh eyes. But when trained well and guided with physical intuition, models like MEDICIM can really
Starting point is 00:12:55 realize a full in silico characterization for materials and don't just simulate some known materials, but they're really trying to imagine what nature hasn't yet revealed. Our work points to a path forward, not just incrementally better materials, but entirely new class of high-performance compounds where we could never have a guest without AI. Yeah. Bing, what's your one takeaway? I think I want to add a few things on top of Hongxia's comments because I think Hongxia has a very good critical word I would like to emphasize. When we train the AI well, if we guided AI well, it could be very useful to become our
Starting point is 00:13:41 partner. So I think all in all, our human beings intellectual merit here is still going to play a significantly important role. We are generating this AI, we should really train the AI, we should be using our human being intellectual merit to guide them to be useful for our human and then we actually now incorporate with AI then combine all pieces together hopefully we're really able to accelerating material discovery in a much faster pace than ever which your whole society will eventually get a benefit from it. Yeah well as we close Bing I want you to go a little further and talk about what's next
Starting point is 00:14:41 then research wise what are the open questions or outstanding challenges that remain in this field and what's on your research agenda to address them? Dr. Wang So first of all, I think this paper is addressing primarily on this crystalline ordered inorganic bulk materials. And also with the condition we are targeting at the ambient pressure room temperature because that's normally how the instrument is working, right? But what is on the extremely conditions? We want to go to space, right? There will have extremely conditions, some very, sometimes very cold, sometimes very hot. We have some places which extremely probably require high pressure or we have some conditions are highly probably require high pressure, or we have some conditions that are highly radioactive.
Starting point is 00:15:28 So under that condition, there's going to be a new database could be emerged. Can we do something beyond that? Another good important thing is we are targeting this paper on the high thermal connectivity. What if about extremely low thermal connectivity? Those will actually bring a very good challenge for serious and also the machine learning approach. I think that's something Hongxia probably is very excited to work on that direction. I know it's ambitious.
Starting point is 00:15:55 They want to do something more than beyond what we actually achieved so far. Yeah. So Hongxia, how would you encapsulate what your dream research is next? Yeah. So I think besides all of these exciting research directions, on my end, another direction is perhaps kind of exciting is we want to move from search to design. So right now we are kind of good at asking like what exists by just doing a forward prediction and brute force. But with generative AI, we can start asking what should exist. In the future, we can have an incorporation between a forward prediction and backwards generative design to really tackle questions.
Starting point is 00:16:42 If you have a materials like you want to have desert properties, how would you design the problems? Well, it sounds like there's a full plate of research agenda goodness going forward in this field, both with human brains and AI. So Hongxiao Hao and Bing Liu, thanks for joining us today. And to our listeners, thanks for tuning in. If you wanna read this paper, you can find a link at aka.ms forward slash abstracts, or you can read a preprint of it on archive. See you next time on abstracts. you

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.