Abstracts: Heat Transfer and Deep Learning with Hongxia Hao and Bing Lv - podcast episode cover

Abstracts: Heat Transfer and Deep Learning with Hongxia Hao and Bing Lv

May 08, 202518 min
--:--
--:--
Download Metacast podcast app
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episode description

Silicon has long borne the burden of heat transfer in electronics, but in a post-Moore’s Law world, researchers like Hongxia Hao and Bing Lv are using AI to discover and design next-generation materials that exceed the limits of silicon’s thermal conductivity.

Read the paper

Transcript

spotlight on world-class research in brief.  I’m Gretchen Huizinga. In this series,   members of the research community  at Microsoft give us a quick   snapshot – or a podcast abstract –  of their new and noteworthy papers. Today I'm talking to two researchers, Hongxia  Hao, a senior researcher at Microsoft Research   AI for Science, and Bing Lv, an associate  professor in physics at the University of   Texas at Dallas. Hongxia and Bing are  co-authors of a paper called Probing  

the Limit of Heat Transfer in Inorganic  Crystals with Deep Learning. I'm excited   to learn more about this! Hongxia and Bing,  it's great to have you both on Abstracts!

HONGXIA HAO

Nice to be here.

BING LV

Nice to be here, too.

HUIZINGA

So Hongxia, let's start with  you and a brief overview of this paper.   In just a few sentences. Tell us  about the problem your research   addresses and more importantly,  why we should care about it.

HAO

Let me start with a very simple yet profound  question. What's the fastest the heat can travel   through a solid material? This is not just an  academic curiosity, but it's a question that   touched the bottom of how we build technologies  around us. So from the moment when you tap your   smartphone, and the moment where the laptop  is turned on and functioning, heat is always   flowing. So we're trying to answer the question  of a century-old mystery of the upper limit of  

heat transfer in solids. So we care about this  not just because it's a fundamental problem in   physics and material science, but because solving  it could really rewrite the rulebook for designing   high-efficiency electronics and sustainable  energy, etc. And nowadays, with very cutting-edge   nanometer chips or very fancy technologies, we are  packing more computing power into smaller space,   but the faster and denser we build, the harder  it becomes to remove the heat. So in many ways,  

thermal bottlenecks, not just transistor density,  are now the ceiling of the Moore’s Law. And also   the stakes are very enormous. We really wish to  bring more thermal solutions by finding more high   thermal conductor choices from the perspective  of materials discovery with the help of AI.

LV

So I think one of the biggest things  as Hongxia said, right? Thermal solutions   will become, eventually become, a bottleneck  for all type of heterogeneous integration of   the materials. So from this perspective, so how  people actually have been finding out previously,   all the thermal was the last solution  to solve. But now people actually more   and more realize all these things  have to be upfront. This co-design,  

all these things become very important.  So I think what we are doing right now,   integrated with AI, helping to identify the large  space of the materials, identify fundamentally   what will be the limit of this material,  will become very important for the society.

HUIZINGA

Hmm. Yeah. Hongxia, did  you have anything to add to that?

HAO

Yes, so previously many people are working  on exploring these material science questions   through experimental tradition and the  past few decades people see a new trend   using computational materials discovery. Like  for example, we do the fundamental solving of   the Schrödinger equation using Density Functional  Theory [DFT]. Actually, this brings us a lot of   opportunities. The question here is, as the  theory is getting more and more developed,  

it’s too expensive for us to make it very large  scale and to study tons of materials. Think about   this. The bottleneck here, now, is not just  about having a very good theory, it's about   the scale. So, there is where AI, specifically  now we are using deep learning, comes into play.

HUIZINGA

Well, Hongxia, let's stay with  you for a minute and talk about methodology.   How did you do this research and what  was the methodology you employed?

HAO

So here we, for this question,  we built a pipeline that spans the AI,   the quantum mechanics, and computational  brute-force with a blend of efficiency   and accuracy. It begins with generating an  enormous chemical and structure design space   because this is inspired by Slack’s principle. We  focus first on simple crystals, and there are the   systems most likely to have low and harmonious  state, fewer phononic scattering events,  

and therefore potentially have high thermal  conductivities. But we didn't stop here. We   also included a huge pool of more complex and  higher energy structures to ensure diversity   and avoid bias. And for each candidate, we first  run like a structure relaxation using MatterSim,   which is a deep learning foundational model  for material science for us to characterize   the properties of materials. And we use that  screen for dynamic stability. And now it's about  

200K structures past this filter. And then came  another real challenge: calculating the thermal   conductivity. We try to solve this problem  using the Boltzmann transport equation and   the three-phonon scattering process. The twist  here is all of this was not done by traditional   DFT solvers, but with our deep learning model, the  MatterSim. It's trained to predict energy, force,   and stress. And we can get second- and third-order  interatomic force constants directly from here,  

which can guarantee the accuracy of the solution.  And finally, to validate the model's predictions,   we performed full DFT-based calculations  on the top candidates that we found,   some of which even include higher-order scattering  mechanism, electron phonon coupling effect, etc.   And this rigorous validation gave us confidence in  the speed and accuracy trade-offs and revealed a   spectrum of materials that had either previously  been overlooked or were never before conceived.

HUIZINGA

So Bing, let's talk  about your research findings.   How did things work out for you on  this project and what did you find?

LV

I think one of the biggest things  for this paper is it creates a very   large material base. Basically, you can say  it's a smart database which eventually will   be made accessible to the public. I think  that's a big achievement because people who   actually if they have to look into it, they  actually can go search Microsoft database,   finding out, oh, this material does have this  type of thermal properties. This is actually,  

this database can send about 230,000 materials.  And one of the things we confirm is the highest   thermal conductivity material based on all the  wisdom of Slack criteria, predicted diamond would   have the highest thermal conductivity. We more  or less really very solidly prove diamond, at   this stage, will remain with the highest thermal  conductivity. We have a lot of new materials,  

exotic materials, which some of them, Hongxia can  elaborate a little bit more. So, which having all   this very exotic combination of properties,  thermal with other properties, which could   actually provide a new insight for new physics  development, new material development, and a   new device perspective. All of this combined will  have actually a very profound impact to society.

HUIZINGA

Yeah, Hongxia, go a little deeper on  that because that was an interesting part of the   paper when you talked about diamond still being  the sort of “gold standard,” to mix metaphors!   But you've also found some other materials  that are remarkable compared to silicon.

HAO

Yeah, yeah. Among this search space,  even though we didn't find like something   that's higher than diamonds, but we do discover  more than like twenty new materials with thermal   conductivity exceeding that of silicon.  And silicon is something like a benchmark   for criteria that we think we want to  compare with because it's a backbone of   modern electronics. More interestingly,  I think, is the manganese vanadium.  

It shows some very interesting and surprising  phenomena. Like it's a metallic compound,   but with very high lattice thermal connectivity.  And this is the first time discovered by, like,   through our search pattern, and it’s something  that cannot be easily discovered without the hope   with AI. And right now, think Bing can explain  more on this, and show some interesting results.

HUIZINGA

Yeah, go ahead Bing.

LV

So this is actually very surprising to me  as an experimentalist because of when Hongxia   presented their theory work to me, this material,  magnesium vanadium, it's discovered back in 1938,   almost 100 years ago, but there's no more  than twenty papers talking about this! A   lot of them was on theory, okay, not even  on experimental part. We actually did quite   a bit of work on this. We actually are in the  process; will characterize this and then moving  

forward even for the thermal conductivity  measurements. So that will be hopefully,   will be adding to the value of these things,  showing you, Hey, AI does help to predict the   materials could really generate the new materials  with very good high thermal conductivity.

HUIZINGA

Yeah, so Bing, stay with you for  a minute. I want you to talk about some   kind of real-world applications of this.  I know you alluded to a couple of things,   but how is this work significant in that respect,   and who might be most excited about  it, aside from the two of you? [LAUGHS]

LV

So I think as I mentioned before, the first  thing is this database. I believe that's the   first ever large material database regarding to  the thermal conductivity. And it has, as I said,  

230,000 materials with AI-predicted thermal  connectivity. This will provide not only   science but engineering with a vastly expanding  catalog of candidate materials for the future   roadmap of integration, material integration,  and all these bottlenecks we are talking about,   the thermal solution for the semiconductors or  for even beyond the semiconductor integration,  

people actually can have a database  to looking for. So these things,   it will become very important, and  I believe over a long time it will   generate a very long impact for the research  community, for the society development.

HUIZINGA

Yeah. Hongxia, did you  have anything to add to that one too?

HAO

Yeah, so this study reshapes how we think  about limits. I like the sentence that the only   way to discover the limits of possible is to go  beyond them into the impossible. In this case,   we tried, but we didn't break the diamond  limit. But we proved it even more rigorously   than ever before. In doing so, we also  uncovered some uncharted peaks in the   thermal conductivity landscape. This would  not happen without new AI capabilities for  

material science. I think in the long run,  I believe researchers could benefit from   using this AI design and shift their way  on how to do materials research with AI.

HUIZINGA

Yeah, it'll be interesting to  see if anyone ever does break the diamond   limit with the new tools that are available, but…

HAO

Yeah!

HUIZINGA

So this is the part of the  abstracts podcast where I like to ask   for sort of a golden nugget, a one sentence  takeaway that listeners might get from this   paper. If you had one Hongxia, what would it  be? And then I'll ask Bing to maybe give his.

HAO

Yes. AI is no longer just a tool.  It's becoming a critical partner for us in   scientific discovery. So our work proved that the  large-scale data-driven science can now approach   long-standing and fundamental questions  with very fresh eyes. When trained well,   and guided with physical intuition, models  like MatterSim can really realize a full   in-silico characterization for materials and  don't just simulate some known materials,  

but really trying to imagine what nature hasn't  yet revealed. Our work points to a path forward,   not just incrementally better  materials, but entirely new   class of high-performance compounds where  we could never have guessed without AI.

HUIZINGA

Yeah. Bing, what's your one takeaway?

LV

I think I want to add a few things on  top of Hongxia’s comments because I think   Hongxia has very good critical words I would  like to emphasize. When we train the AI well,   if we guide the AI well, it could be very useful  to become our partner. So I think all in all,   our human being’s intellectual merit here is still  going to play a significantly important role,  

okay? We are generating this AI, we should  really train the AI, we should be using our   human being intellectual merit to guide them to  be useful for our human being society advancement.  

Now with all these AI tools, I think it's a very  golden time right now. Experimentalists could   work very closely with like Hongxia, who’s a good  theorist who has very good intellectual merits,   and then we actually now incorporate with  AI, then combine all pieces together,   hopefully we’re really able to accelerating  material discovery in a much faster pace than   ever which the whole society will  eventually get a benefit from it.

HUIZINGA

Yeah. Well, as we close, Bing,  I want you to go a little further and talk   about what's next then, research wise. What are  the open questions or outstanding challenges   that remain in this field and what's on  your research agenda to address them?

LV

So first of all, I think this paper is  addressing primarily on these crystalline ordered   inorganic bulk materials. And also with the  condition we are targeting at ambient pressure,   room temperature, because that's normally  how the instrument is working, right? But   what if under extreme conditions? We want to go to  space, right? There we’ll have extreme conditions,   some very… sometimes very cold, sometimes very  hot. We have some places with extremely probably  

quite high pressure. Or we have some conditions  that are highly radioactive. So under that   condition, there’s going to be a new database  could be emerged. Can we do something beyond   that? Another good important thing is we are  targeting this paper on high thermal conductivity.   What about extremely low thermal conductivity?  Those will actually bring a very good challenge   for theorists and also the machine learning  approach. I think that's something Hongxia  

probably is very excited to work on in that  direction. I know since she’s ambitious,   she wants to do something more than  beyond what we actually achieved so far.

HUIZINGA

Yeah, so Hongxia, how would you  encapsulate what your dream research is next?

HAO

Yeah, so I think besides all of  these exciting research directions,   on my end, another direction is perhaps  kind of exciting is we want to move from   search to design. So right now we are  kind of good at asking like what exists   by just doing a forward prediction and  brute force. But with generative AI,   we can start asking what should exist? In the  future, we can have an incorporation between  

forward prediction and backwards generative  design to really tackle questions. If you have   materials like you want to have desired like  properties, how would you design the problems?

HUIZINGA

Well, it sounds like there's  a full plate of research agenda goodness   going forward in this field, both with human  brains and AI. So, Hongxia Hao and Bing Lv,   thanks for joining us today. And to  our listeners, thanks for tuning in.   If you want to read this paper, you  can find a link at aka.ms/Abstracts,   or you can read a pre-print of it on  arXiv. See you next time on Abstracts!

Transcript source: Provided by creator in RSS feed: download file
For the best experience, listen in Metacast app for iOS or Android