From First Principles - The Tech Elon Has Been Waiting For (EP 51)

Episode Date: July 31, 2026

What happens when electronics can operate at temperatures hot enough to melt aluminum?In this deep-dive episode, Lester Nare and Krishna Choudhary examine a new high-temperature memory device develope...d by researchers at USC, the Air Force Research Laboratory, Kumamoto University, and their collaborators.Published in Science, the experimental memristor combines tungsten, hafnium oxide, and graphene. It operated reliably at 700°C—roughly 1,300°F—retained data for more than 50 hours, and survived more than one billion switching cycles.We begin by explaining why conventional electronics and flash memory fail when temperatures rise. From deep-earth drilling and hypersonic aircraft to nuclear systems and the surface of Venus, many environments where intelligent electronics would be useful remain inaccessible to today’s hardware.Krishna then builds the memristor from first principles. We explore the history of the “missing” fourth circuit element, how oxygen vacancies create low- and high-resistance memory states, why conventional platinum electrodes fail under extreme heat, and how graphene prevents tungsten atoms from diffusing through the device.Finally, we examine the implications for artificial intelligence. Memristors can potentially store neural-network weights and perform matrix multiplication in the same physical location, reducing the energy wasted moving information between processors and memory.Could that combination of heat tolerance and energy efficiency make AI data centers in space more practical? Lester and Krishna work through thermal radiation, radiator size, power consumption, radiation resilience, and the considerable engineering challenges that remain.Support the showDonate: FFPod.com/donateFollow: @FFPod on X / Instagram / TikTok / FacebookResearch and Show NotesHigh-temperature memristors enabled by interfacial engineeringUSC: A memory device that operates at 700°CThe development of carbon-neutral data centres in spaceNASA Venus facts

Transcript
Discussion (0)
Starting point is 00:00:00 Industrial flash memory tops out at around 200 degrees Celsius. And above that, there's essentially nothing that works. It's a memorister, which is a memory switching device, and it's made from graphene, hafeneum oxide, and tungsten. And it operates reliably at 700 degrees Celsius. It's really cool. I mean, it's hotter than molten aluminum. Aluminum melts at 660 degrees Celsius.
Starting point is 00:00:25 If you put this thing in a vat of aluminum, it will still retain memory. Hello, Internet. This is your captain speaking, Lester Nare, joined as always by my co-host and our resident PhD Krishna Chowdery. We have a special deep dive today for you all. Be sure to check out our rundown from last week. But this week, we'll be sure to heat up the future of electronics as we look at a breakthrough in high temperature memory. This is something that Elon has been with. for for a long time that may enable electronics that can survive lava. I'm going to need the details. I'm going to need to understand what's going on. Yeah. This comes from a new research paper in the Journal of Science. Shout out to Science.
Starting point is 00:01:13 From March 26, 2026, it was a collaboration between researchers at USC here in California, the Air Force Research Lab in Dayton, Ohio, and the Kumamoto University in Japan. Please correct my pronunciation with funding for this research. research being provided by National Science Foundation, the Army Research Office, and the Air Force Research Lab. So clearly they think there is military applications. I'm sure it relates to hypersonics. As always, we are going to learn about the science from the ground up today because this is from first principles. Today we're covering an invention that I think is going to be a game changer for the future of computing. You know, we live in the digital age of electronics.
Starting point is 00:02:14 Chips are the bedrock of our economy. And yet all of those chips really have a Goldilocks zone when it comes to when they work. Goldilocks in the traditional sense of like not too hot, not too cold. This research is getting to that not too hot part. You know, the Papa Bear that was like too hot, the porridge was too hot. Now we're getting a chip that can withstand that porridge. Okay. These are memory chips that happen in our phone, in our laptop, in the cameras that we have here in the studio.
Starting point is 00:02:46 They're all designed to work reliably, roughly between 85 degrees Celsius, so 200 Fahrenheit, where our Americans, to about 150 degrees Celsius, so 300 Fahrenheit. Okay? That's where they sit. And industrial flash memory tops out at around 200 degrees Celsius, even with. a lot of the heroic packaging where you will try to insulate temperature and things like that. And above that, there's essentially nothing that works. Okay? There's no computation happening above 300 degrees Celsius. But that doesn't mean that we don't want to have computation happening
Starting point is 00:03:26 at that temperature. Okay? There are a lot of applications that even I can think of here, not being in the field, that would be really great to have at 300 degrees or above. Okay? For example, Oil and gas. Oil and gas drillers, they push deep into the earth's crust. The deeper you get into the earth's crust, the closer you're getting to the mantle where all of the magma is.
Starting point is 00:03:48 So the temperature is going to go up. At five kilometers, you're flirting with like 150 degrees Celsius. That's already pushing it. At 10 kilometers, you're well past 300 degrees. And the sensor packages that we have today, when you send them down these boreholes, they need to either operate
Starting point is 00:04:06 with like an active cooling thing. where like there's something with the drill that's trying to cool the sensors that's always not convenient. Not ideal. Yeah, and then they have to transmit their data to the surface in real time. They can't do any computation down there.
Starting point is 00:04:23 Right? So then there's this massive wiring problem that you have to deal with. The wires are going through this really hot. The engineering is way more complex. Unnecessarily if you could just have it. Yes. If you could just have like a chip
Starting point is 00:04:37 that's right on top of the drill, right? That's right there. Then you can have something like an autonomous downhole drill, like electronics that decides where to go right there. I mean, we've got all this AI, but we can't actually put that to use when we're going all the way down there, right? I'm going to make another Armageddon reference
Starting point is 00:04:58 when we need to go to an asteroid and we need to draw. I guess that's a bad example because it's not that hot. Yeah. Well, I mean, but even the friction is going to create made like a hot, some heat. You know, we're going to want to be able to do that. Yeah, we just look.
Starting point is 00:05:12 Planetary defense. Yes. As always, you know, we are defense first here, not war, only defense. Now, you mentioned hypersonics. That's another big thing, right? In aerospace engineering, the inside of a jet engine or the inside of a rocket engine or the nose of a hypersonic aircraft, these things are getting to really, really high temperatures.
Starting point is 00:05:34 We've covered this in previous stories where the temperature gets. so high, that chemistry starts mattering. It's a little weird. Yeah, and it starts getting a little weird. And we can't make any intelligent decisions on site because of the chip. The chip is just going to get fried. And finally, the thing that Elon has been worried about and all of these tech bros are worried about is putting data centers in space, right? This is the number one conversation in SF right now.
Starting point is 00:06:00 Yeah, yeah. I mean, Elon wants to put data centers in space. He's not the only one. SpaceX had an IPO of $1.7 trillion, and I think a lot of that hinges on Elon's promise that he can put AI data centers in space. We're going to get into the details there, but there's been a lot of pushback because of fundamental physics, right? They're saying, oh, like, fundamental physics is telling you that you can't put data centers in space. Well, yes and no, okay? Yes, in the sense that, yes, the physics and the electronics that we have today, it's probably not a good idea to put data centers in space.
Starting point is 00:06:41 But with this problem, you can have innovation like the one that we're going to talk about. And perhaps it's possible. The main problem, really, is that to keep a one megawatt artificial intelligence server cool in the vacuum of space, you need a radiator that's roughly the size of four tennis courts. That's because the space is a vacuum. there's no way to extract heat other than radiation. And radiation is not a great way to let go of heat because you're relying on photons. It's not, is it, it's like, because it's not efficient? Yes, exactly.
Starting point is 00:07:14 It's just not efficient. We're going to get into some of the physics of that later. And my favorite sort of conundrum that I think this is going to solve is planetary exploration. I think you're going to like this too. There's a reason why we have so many. photos of Mars and not that many photos of Venus. Okay? Mars is pretty chill to go to.
Starting point is 00:07:36 It's like kind of cold. Literally. It's like literally, it's farther away from the sun and it's fine. Venus is closer to the Earth and it's got this massive greenhouse effect, which means that it's really hard to put stuff down there. Actually, the first guys to do it were the Soviets. Venus has a surface temperature of about 465 degrees Celsius and an atmospheric pressure that's 92 times that of the earth.
Starting point is 00:08:01 The Soviets put down the Soviet venera landers, and they're the only spacecraft that have ever survived on the Venus surface. But guess how long they survived? Over under an hour? It's got to be under an hour. It's under an hour, yeah. It's between like 23 minutes.
Starting point is 00:08:19 I think the record was like two hours later on, but like two hours? Yeah, yeah. Right? Like the stuff the JPL puts on Mars, has lasted like 20 years. Yeah, we're talking about two decades versus an hour. Versus two hours.
Starting point is 00:08:33 Right, right, right. Is the best that they can do. I will note, this is for those who are TV fans, we've talked about for all mankind on the show before, but Apple TV has a second, Apple TV has a second show called Star City. Okay. It looks at the Russian space program in the same alternative history timeline where they got to the moon first,
Starting point is 00:08:53 and they do a whole, all of season one, part of it relates to the VN. mission. Dude, I got to watch that. And it's, it's an alternative reality. So,
Starting point is 00:09:04 no spoilers. I love that kind of stuff. But it is interesting to kind of understand the technical challenges, which they brushed on at a high level in the show. But recently,
Starting point is 00:09:15 I've been watching it, and this brought it up as a concept, and the engineering problem is non-trivial. Yeah, no, completely, right? It's like going towards the center of the earth. It's the same drilling thing.
Starting point is 00:09:26 High pressure, high temperature. Your electronics. are going to get completely wrecked, right? The photo we have from the Venera 9 in 1975, this is the best photo they got. It's the first image of a planet other than the Earth. Credit to the Soviets. Yeah, they did it.
Starting point is 00:09:41 The first image of a planet other than the Earth was not the United States and Mars. It was Venus, and that's all they got, but still, that's kind of crazy. But who got to the moon, though? Yeah, that's the real question. They were like, okay, let's go the other direction. Yeah, yeah, yeah. The race is actually this way, guys.
Starting point is 00:09:58 Yeah. Later missions, they were actually able to get some color photos. This is the one that lasted two hours. Okay. And you could get some color photos. You can see the sort of yellow haze that we know that the Venus has. If you point a telescope to it. But again, only two hours. And you can see there's like it kind of looks like the surface of a volcanic debris field because there's a bunch of volcanoes on Venus. But that's it. That's all we could get. And we can imagine, you know, as we continue to expand in our own local solar system and otherwise having electronics that can survive high temperature environments is going to become a valuable asset to expand where we can actually go. Exactly. I mean, I'd like to know more about the surface of Venus, right? We know we have better surface images of Mars Pluto. We have better surface images of Pluto than we do with large swats of Venus, which is our nearest. neighbor. Venus is closer to us than the Earth. And we still don't know what's under those clouds.
Starting point is 00:10:59 That's so unbelievable. Right? And it's just because it's just, it's a completely messed up situation to get down there on the surface. Everything fails. We can't stand the heat so we can't go in the kitchen. Yeah, exactly. Exactly. And into this landscape comes this paper that was published by USC. It's describing something I think genuinely new. Okay. It's a memorister, which is a memory switching device. We're going to get into what that is. And it's made from graphene, hafeneum oxide, and tungsten.
Starting point is 00:11:31 And it operates reliably at 700 degrees Celsius. That's unreal. 700 degrees. Yeah. They've raised the temperature by a factor of more than two. And so there's something fundamental. There's a real breakthrough here.
Starting point is 00:11:47 That's beyond an iterative upgrade. Yes. Yeah. There's, I think it's really cool. I mean, it's hotter than multiple. in aluminum. Aluminum melts at 660 degrees Celsius.
Starting point is 00:11:58 If you put this thing in a vat of aluminum, it will still retain memory. It's hotter than the surface of a lava flow on Earth. Not all lava flows. I know there's going to be people in the comments being like, no. The volcanologist? Yeah, yeah. The volcanologist is going to be like, no, of lava's hotter than that.
Starting point is 00:12:13 Actually, there is a volcano in Tanzania, the old Doinio-Lengai volcano, where the lava is 600 degrees Celsius. So there exists a lava on earth where I could put this chip and it would still work fine. So the tagline still kind of works, right? If you took it to Hawaii and put it in the lava in Hawaii, it would not.
Starting point is 00:12:37 I think Hawaii is like a thousand plus. But it perhaps might, and we'll get into that later. We're on the path. Yeah. The other crazy thing about this is the chip, the memorister device, it maintains stable data retention for 50 hours. Really? 50 hours. And it retained that data retention after a billion switching cycles without failure.
Starting point is 00:13:02 So this is both high temperature and long duration. Yes. Comparatively to where we were before. Yeah. And the physics is actually like, it gives you both. Which is because both are different. Yeah. It's like a graph of different axes.
Starting point is 00:13:17 And you can have high temperature. It's like, okay, great, but it's a microsecond. Yeah. Yeah. But here, what's cool is it's the same physics that's giving. you both endurance limits, which I think is really, really cool. It's by, I think it's by a large margin, the highest temperature at which any non-volatile memory has ever been demonstrated to work.
Starting point is 00:13:35 This is phenomenal. It's really, really cool. And I mean, why should, like, normal people care, okay? Not scientists. Sure. Well, I think the border between environments where we can put intelligent electronics and environments where we cannot is about to shift dramatically. And then our understanding of everything about the world around us changes in a very big way.
Starting point is 00:13:55 Yeah, I mean, it affects how we drill energy, how we explore planets, how we monitor volcanoes, how we put data centers in space. That has a lot of social and political implications for our society because then maybe we don't need to, you know, like take everyone's water. If you don't want a data center in your backyard, this story matters a lot because we can just put them in space. Yeah, yeah. I mean, it's one of these, like, quiet material science results that it doesn't make the front page of the New York Times, but I think it's going to expand the frontier of what our civilization can do.
Starting point is 00:14:33 You're saying there's a chance. Yeah. And I think it's an incredible story. We are going to get into the details of, this has been such a big conversation in the business and technology world. we are so over leveraged on AI in the U.S. in terms of its impact on our GDP. Everyone's saying it's fine because we're going to put data centers in space and it's been very contentious.
Starting point is 00:15:00 As a one aspect of that larger conversation, the potential for this to be an enabling layer is interesting. But before we get into the details of that story, a brief note of housekeeping. For our longtime listeners in FFP Nation, welcome back. If you happen to be catching this episode for the first time, it is the two of us here bringing you the latest breaking science news every week and any way that you can help to support the show so we can combat against the billionaire algorithms, like, share, a comment, bring it to the journal club, put it into the group chat. All of those things help us reach more people with the way in which our world is changing and growing because of the journal club, put it into the group chat. all of those things help us reach more people with the way in which our world is changing and growing because of the advances we have at the frontier of science. Our website has all of our episodes,
Starting point is 00:15:53 all of the research papers, and show notes that we cover. So if you are someone who's a grad student, a postdoc, or someone who just really wants to get actually more into the weeds of any of these stories, go to fFPpod.com. You can check out our research paper library. If you want to support the show, you can donate at fFPpod.com backslash donate. And you can also check out the merch shop if you want to let the world know that you yourself are a member of FFP Nation. But enough of the riffraff. Let's get back
Starting point is 00:16:29 to this very juicy story. I do like my stakes. Medium rare. But I guess I can make it much quicker if I do it at 700 degrees Celsius. Yes. Yeah, it would only cook the outside like micron, and then it would be all rare. Gordon Ramsey would love that. So let's first talk about why the conventional electronics that are in our phone, that are in the laptop, everywhere else, why they fail at high temperature. Why I can't bring my iPhone and put it in a lava flow. Yeah, yeah, yeah, yeah.
Starting point is 00:17:01 I'd like to. Yeah, I can put it in water. Yeah, but lava is something you can't do, okay? the physics of high temperature failure. We first have to understand the traditional Seymos architecture that is at the base of all of our technology. This is complementary metal oxide semiconductor. These devices fail at around 200 degrees Celsius.
Starting point is 00:17:22 Here's how it usually works, okay? So at zero Kelvin, which means absolute zero, everything is stationary. Silicon is a insulator. What ends up happening is, atoms have something called a conduction and a valence electron shell. Okay? They've got parts where valence electrons can occupy all of the shell.
Starting point is 00:17:48 So there's nothing going on. All of the shells are occupied, right? Then there's a conduction shell. There's a conduction energy level where there's like one or two electrons hanging out. And those electrons are the ones that skip from one atom to the next to the next. And they create current, which is what we use. Okay. Now, at zero degrees Kelvin, all of silicon's valence band is completely filled.
Starting point is 00:18:12 If you put a bunch of metal and a bunch of silicon together, the gap between the conduction band and the valence band gets bigger just because of neighboring effects. It's like the neighboring atoms start pulling on your own energy gaps, and it expands the gap between these two energy bands. The wiggle crease starts getting more intense. Exactly. And so at finite temperature, what you can do is you can bump an electron. You get some wiggle, right? Because like there's jiggling happening. There's photons that are at some energy level. That's going to come in, strike an electron. The electron is going to move up
Starting point is 00:18:51 to the conduction band. And then voila. You can have a little bit of conduction. Okay. Now, let's get into exactly how this happens. We've got a video that shows exactly how this conduction and valence band works. So on the bottom, you've got your silicon. You've got all of the sites that are now occupied by electrons, which are in the, in the blue. It's like the housing market. Yeah. There's nothing on the market. Yeah, yeah, yeah. There's no openings. Now, all of a sudden, somebody sells a house. So an electron from the valence band moves into the conduction band. Now that conduction band electron can move around and create a current. Notice at the same time, the hole that was left in the valence band can also move around.
Starting point is 00:19:34 It's like you have a bunch of packed theater seats and everybody moves one seat over, but then the empty seat can start moving around too. That's a positive charge in some sense, right, because it's a hole. The electron has gone away, so it's left a positive hole. And that hole can move around in the same sense that the electron can also move around. Because it's attracting because it's that empty space and it needs to be filled. Yeah, yeah, yeah. It's the movement.
Starting point is 00:20:00 Yeah. The actual movement, the physical movement that's happening is always electrons, right? It's the negative charge carriers. But the sort of thing that matters
Starting point is 00:20:10 in the valence band is that positive hole that's moving around, right? It unlocks the stationary state that exists because it's now moved up to. Yeah, yeah, yeah. Exactly. And so you can have two different types
Starting point is 00:20:24 of semiconductors here. Engineers can make silicon switches. using either phosphorus or boron, you can dope the silicon with either phosphorus or boron. And then these artificially dictate how many charge carriers you're going to get.
Starting point is 00:20:38 Are you going to get more electrons in the conduction demand? Are you going to get more holes? So that's where you get, if you've ever heard of like P-type and N-type semiconductors. The N-type is the negative-type semiconductor, because the electrons
Starting point is 00:20:51 are the ones that are moving around. The P-type is the positive-type semiconductor because the holes are the one that are moving around. And when you combine the two, you get things like LEDs, transistors, but at too high of a temperature, you're going to get wrecked. Why? Because if you have too high of a temperature, everything is going to go into the conduction band, because there's so much jiggle, and then I'm just going to get a short circuit. It's
Starting point is 00:21:13 always going to be conducting. With a transistor, I'd like to control when it's conducting current for a one, and when it stops conducting current and becomes an insulator for a zero. But at a high enough temperature, it's always going to be conducting because there's so much jiggle that the electrons are just like, oh, I'm just going to, I'm free to move around. Everything moves. Okay. And so part of what we're saying is we're trying to engineer a level of control of how this movement happens. And at high temperatures currently in our traditional chips and systems, they are unable, at high temperatures, you lose the ability to engineer and control the jiggle, the movement, how things move like to the conduction layer.
Starting point is 00:21:54 and back according. Yeah, yeah. You can't control the transistor going from a one to a zero. It's just always going to be a one. Right, right, because it's always. Yeah, and that's the bedrock of computation. Right, right, right. Now, people have managed to make the band gap way bigger.
Starting point is 00:22:07 Because if you make the band gap way bigger, then the temperature might not be enough to actually put it up. Right. Right. And then, and then you can, like, preserve this transistor property. But these are authors, the authors of the paper that we're talking about, they cite this research from NASA research. it shows that you can get all the way up to 800 degrees Celsius. But memory is still an issue. You've created a sort of circuit element here,
Starting point is 00:22:35 digital integrated circuit, but non-volatile memory, something that retains data even when it's powered down, the stuff that's in our RAM, like I turn off my computer, it's not like I'm going to lose everything. Everything, right? That kind of stuff is still not up to that scale.
Starting point is 00:22:52 So through public funding, we discovered that it's possible to go above 800. But the issue still remains, memory does not in this context have that high temperature limits. Exactly. And if we want to do anything, we got to store data, right? We got to store weights if we want to do a neural network. We got to store what the algorithm is supposed to do. Even if without the AI stuff, right, it's just like instructions on what to do. That is stored in your RAM.
Starting point is 00:23:20 And if the RAM fails. but like your circuit is doing fine, what's it going to do? There's no instructions. Right. Right. So most of the applications that we have,
Starting point is 00:23:29 like in our computer, in the phone, they use something called flash memory. This also uses a transistor. This is the MOSFET transistor, where you combine a P and an N type, and it runs into the same issue with the high temperature
Starting point is 00:23:43 because you're using P&N types, right? And if even at like a low temperature, like, Room temperature, right? Consumer electronics, like the flash in our in our computers, it wears off after about 10,000 to 100,000 read, right? So they're not, they can't run forever. Yeah. There's deterioration. Doing work deteriorate just like our own human body. Yeah. As an athlete, you can't be an athlete forever. Your body eventually gives up. Similarly, in this context, flash memory deteriorates at some time interval. Exactly. Yeah. Exactly. And so because of that, people have been slowly looking at other substrates of computation,
Starting point is 00:24:29 specifically something called resistive memory, R-R-R-R-R-R-M. Okay? This is resistive random access memory. And to understand that, we really have to understand something called the MemRister. Okay. Okay. Let's go back to 1970. There are three types of fundamental circuit components, the resistor, the inductor, and the capacitor.
Starting point is 00:24:51 This is the stuff of undergraduate physics. And if you're an electrical engineer, I'm really sorry for your loss. But you probably deal with this every single day, right? A resistor is something that resists electric current. So it drops a voltage across a resistor. And an inductor is something that takes a changing current and creates another current that's going in the opposite direction. so it kind of stores energy using a change in current. And a capacitor is something that stores energy using charge.
Starting point is 00:25:26 Okay. Now, Leon Chua in 1971, he was at UC Berkeley, he said, let's look at these three components that we've got. We've got a capacitor, right? A capacitor is something that has a relationship between charge and voltage. If I store a bunch of charge, that stores a voltage difference. I've got a resistor. that's a relationship between voltage and current, right? As current goes through, there's a voltage drop.
Starting point is 00:25:56 And I've got an inductor. That's something that has to do with current and magnetic flux. Okay? There's four variables, though. Right. And there's only three components. Right. So for those who may be audio listeners, we're looking at a square,
Starting point is 00:26:14 it kind of looks like those, those one, two, three, four. I don't know what you call it. Oh, yeah, the thing we used to do in elementary school. They would tell me like what my fate was. Yeah, the paper thing. Yeah. You can let us know in the comments. But on each of the four sides, you have exactly the components you mentioned.
Starting point is 00:26:33 In each of the four corners, you have the charge voltage, current, and flux. And the point here being, we've talked about every relationship but one side of the square. But one side of the square, right? There should be Leon Chua decided. there should be a relationship between flux and charge. The flux capacitor. In some sense, yeah. Yeah.
Starting point is 00:26:56 And he deemed this thing the memorister. He said there should be something out there, okay? This is a component where the resistance changes dynamically based on the charge flow. And he ruled that if there is such a relationship, what this thing is going to do is it's going to remember the state when the power is off. Okay? Let's, the telltale sign, he also showed, okay, if experimenters are looking at this thing, he was a theorist. And he said, if experimenters are looking at this thing, all you got to do is look at the IV curve.
Starting point is 00:27:26 Okay. The, the IV curve is the current and the voltage. Current on the y, on the two axes. Voltage on the x. Yes, okay. And if we look at the IV curves, they're all very unique. On the top left, that's a normal resistor. Okay, as I increase the voltage, I'm going to increase the current across the resistor.
Starting point is 00:27:48 And there you've got a line. This is a nonlinear resistor. A linear resistor would be like the stuff that we do in undergrad physics is just like, oh, V equals IR. That's not entirely true, right? The R is a function of the V. So there's going to be like some nonlinear resistance where like at low voltage, the resistance is not that high.
Starting point is 00:28:08 And then at high voltage, the resistance is way higher, things like that. Or maybe, no, it's the other way around. At high voltage, the resistance is lower because, you know, there's more pull. So, like, it's easier to shuttle electrons through. Okay, so that's what we're seeing in the top left corner, okay? On the top right corner and the top, in the bottom left corner, we're seeing the IV curves for a capacitor and an inductor. Okay? Those things cycle around.
Starting point is 00:28:33 Those things, and this is something that everyone knows from, you know, if you've ever done RC circuits, you'll, you'll know that there's an oscillation that happens in RC and RL circuits especially. If you combine a capacitor and an inductor, the capacitor gets charged and the inductor doesn't get charged, and then the inductor gets charged, the capacitor gets discharged. So there's a cycling that happens. And that is something that
Starting point is 00:28:56 is characteristic of like sign and cosine. You got the unit circle, the x-axis is sign, the y-axis is cosine. Great. Leon Chua said, I should be looking for something called a memorister where charge and magnetic flux.
Starting point is 00:29:12 are related to one another. And what I would see is a curve that looks like a loop, a figure eight loop. And the challenge is there is no way to combine the other three curves to get that fourth curve. Interesting. Okay? It is an independent element in electronics. It's fundamental. It's not derivative.
Starting point is 00:29:40 Yes, exactly. You know what? You see what I'm saying? Yeah. It's like you can't make an electron out of quarks. Right. Right. Similarly, you can't make a memorister by just cleverly placing resistors, capacitors, and
Starting point is 00:29:54 inductors together. This is an independent component that is one of the four fundamental components of electronics. And this sort of goes back to our previous visual, which, you know, in this context of those four parts, you needed, this is sort of the missing piece to the puzzle of the fundamental elements. Yeah. And it's just a mathematical argument. Which is so cool to think about. Right. Right. Right. That it's just like there's four variables. We've only got three components. There should be a fourth one. Theorists have value everybody. Okay. It's very cool. And one more thing I
Starting point is 00:30:27 want to say about the Memoristur IV curve, right? Notice that for a capacitor and an inductor at zero voltage, there is a non-zero current. Okay. That means it can't store. data because if I turn the thing off, there's going to be current and that's going to dissipate whatever the stuff was happening, right? A resistor could store data because at a zero voltage, there's zero current, but it only stores a one. It's whatever the resistance is. So it's not really storing anything. If we go back to Claude Shannon's information theory, I need two things to store data. I need a zero and a one. A memory store, on the other hand, at zero voltage, it can be in two states. It can be in a low-resistant state or a high-resistant state. This is so good.
Starting point is 00:31:16 Right? This is so good. Now all of a sudden people start paying attention because this could be a substrate for non-volatile memory, meaning I turned the thing off, but depending on the history of where I was on the curve, I could be in either a low-resistant state or a high-resistant state. If I can sense that, that's my zero-on-one computers. As a quick visual analogy here, because we're basically looking at this figure-8 that's kind of like a racetrack. Remember Hot Wheels as a kid? Yeah, yeah, yeah. So you remember how you could have the, you can have a figure rate like that,
Starting point is 00:31:45 but one side would be going under and you would come back and it would be going over. And that's kind of what we're saying where it can be in two states at that center point. It can be on the top part of the Hot Wheels track or on the bottom part of the Hot Wheels track. Yes. And that's, that mechanism is how we're storing the zero and how we're able to have two states, which means we can have a zero and we can have a one. Exactly, yeah. And for the Formula One fans, the only circuit that does this is Suzuki in Japan.
Starting point is 00:32:10 It's the, there's a figure eight that's beautiful. One day we'll go. So the theorist has done his job. He's like, there should be this thing. And specifically, this is what you guys should look for. It takes 40 years. Oh my God. Nearly 40 years.
Starting point is 00:32:29 Stanley Williams at Hewlett Packard Labs. So that's HP Labs. I love these nature articles that are just like bombshell articles because the title is just a banger. every single time. The missing memorister found. It's nearly 40 years after Leon Chua postulated that this fourth passive element
Starting point is 00:32:50 should exist. Stanley Williams announces it in nature and he shows that there is a memorister that he's created using titanium dioxide and platinum electrodes and it uses something called oxygen vacancy migration. I just want to note that we're talking about 2008.
Starting point is 00:33:09 Yeah. Very soon. We were in high school. So it wasn't that crazy. It wasn't that long ago. It wasn't that long ago. No, we were in high school when the first memorister, like when it went from theory to reality. Right.
Starting point is 00:33:22 And it's still at a research stage level. We're not talking about in-end consumer products. Yeah. The iPhone came out a year before this. Yeah, that's crazy. Just to put it in time context. Wow. Which is, that's a good way to, yeah, that's a good way to think about it.
Starting point is 00:33:40 Yeah. I mean, we had an iPhone before we even knew that a memberister was possible, which is so crazy. That's knowing what we use it for now. Yeah. Yeah. I mean, it's insane. Okay. So let's talk about this valence charge mechanism that I was telling you about, about how the memberster works.
Starting point is 00:33:54 Here's the idea. So I told you, right, he got a titanium electrode, a platinum electrode. And in the middle were oxygen vacancies. Now, vacancies is something that I alluded to earlier. When I was talking about the holes, the whole. the holes are vacancies in the sense that I have taken something out but now those holes
Starting point is 00:34:16 where I took that thing out those are mobile just like the stuff that I took out those are mobile elements and if those mobile elements can rearrange they can create electronic components on their own right in the same way that a P-type
Starting point is 00:34:30 semiconductor can use the holes to do all of its electronics the point being that vacancy is not stationary. It has the ability independent of the thing that left to move on its own. Yeah, exactly. Okay. So let's get into a little bit more about how these oxygen vacancies work, because this is going to be the central thing we need to understand about why the physics of this modern paper is working. Okay? When you have these two electrodes, you've got a positive electrode
Starting point is 00:35:05 and a negative electrode, right? What you do is a switching process. Okay? So this is effectively how it works. Let's say I've got a top electrode and a bottom electrode. In this case, it's like silver and titanium on the bottom. But it doesn't really matter what the identity of the two electrodes are yet. It's going to matter later.
Starting point is 00:35:29 What happens is, in order to understand what this valence charge mechanism is, let's try to think of an analogy, a simple analogy. Imagine like a really thick, densely packed forest, like the forests of Endor in the Star Wars episode six, Return of the Jedi. Okay. Okay. Now, if you remember, the Force of Endor,
Starting point is 00:35:51 they had those like motorbike thingies. I actually looked up what they were called. They were called Forest Motorbikes, 74 Z speeder bikes. Okay. Remember like they like zoom through the forest at really, really high speed. Now imagine a really, really dense forest. Okay. If you've got a speeder bike in a really, really dense forest, you're going to crash. You have to be in Lewis Hamilton. Yes, yes. And even that, you know, like, I'm talking about like there's, there's a tree literally everywhere. It's not, it's not feasible. It's not going to work. It's not going to work. So what you could do instead is have. A bulldozer come in, or let's say a really high wind, and that's going to take down some of the trees.
Starting point is 00:36:36 Yeah. Okay? When you take down some of the trees, that's kind of like creating oxygen vacancies in something like a transition metal oxide, like hafnium oxide or titanium dioxide, right? These are transition metal oxides that are metals bonded to oxygen. That's in the middle, sandwiched in between the two electrodes, right? If I've got an electric field, the oxygen, which has these, like, it's just got these properties where it wants to go towards the negative electrode, right? This is why oxygen is so reactive and why it russes everything. The oxygen is going to start moving.
Starting point is 00:37:11 When it starts moving, it's going to leave behind holes. Okay? So it's kind of like the trees are coming down, and now I've got a pathway. Now my motorbike can move really fast. The motorbike in this analogy represents the electron. The electron is piggybacking on these vacancies. And part of your point is being until the wind or the bulldozer comes and knocks a tree's over, which is the oxygen leaving, the electrons can't move through. Yeah.
Starting point is 00:37:42 So that would be a high-resistant state, right? That's one of the states that we were thinking a memorister should have. It's got a memory, right? There was no wind. And so I am at a high-resistance. Now all of a sudden I applied an electric field. I got a low resistance. Can I go backwards?
Starting point is 00:37:57 Yeah. Just apply the electric field in the other direction. The trees stand up. Low resistance. Got it. Got it. Right? This is the mechanism behind the switching behavior,
Starting point is 00:38:08 the set and the reset that we think of in Memoristers. That's the Memorister jargon. It's like you set it to the low resistance state. So then there's like conduction happening. So that's your one, let's say. And then you reset it back to the high resistance state. So then the trees are all up. The vacancies are back.
Starting point is 00:38:25 The oxygen is back, I mean. There's no more vacancies. And the electrons don't have a highway to go through. And what's interesting about this is you can go, you have the ability to return to return back and forth in between each of these states. Exactly. So now you've got a cycling. Right.
Starting point is 00:38:41 And that's something that you need for non-volatile memory. Right. Okay. That's effectively what this vacancy mechanism is. Mm-hmm. Got it? Now, a lot of times now we're going to try and use Haphnemoxide. The advantage here is that half-neem oxide is something that silicon chip makers have already been using in transistor gate stacks.
Starting point is 00:39:02 It's already replaced the silicon dioxide transition metal oxide in the famous high K-delectric constant metal gate transition that happened in like 2007. I wasn't aware of this, obviously, because I was in school. But in 2007, like, there was sort of a plateau on Moore's law because we couldn't get stuff. smaller. And then somebody decided, hey, actually, we can use half-name oxide. That reduces power leakage and it allows these transistors to shrink even
Starting point is 00:39:35 further without having a significant decrease in performance. The smaller you get, right, the harder it is to keep the same level of performance. Yeah, because you're trying to dissipate heat. The smaller you get now that the heat is starting to mess with the components themselves. And so this hafnium oxide, it's CMOS compatible.
Starting point is 00:39:52 It scales to very small dimensions. it switches fast and it shows really good endurance, right? And by the mid-2010s, all the major semiconductor companies, that's like Samsung, Micron, TSM, they all have active memorister R-R-R-R-R-D development programs, and they still do. And just to make a quick clarification point. So chipmakers were already using this for other chips prior to using it in memoristers. Yeah. And so part of it was like they had the initial.
Starting point is 00:40:24 industrial scale working with this particular material. And so they were like, it would be ideal if we could use this same thing we already do at scale in another chip type. Exactly. Is that fair? That's exactly right. And so the original paper that was by Stanley Williams, that one used titanium dioxide as the transition metal oxide.
Starting point is 00:40:44 But people have rapidly switched now to half-neum oxide as the sort of sandwich, the thing in between the sandwich. okay. Now, we've got half-neum oxide. Okay, that's the meat in between the sandwich. What do we want to use for the electrodes? Usually we use tungsten and platinum. Why tungsten? Well, tungsten is, has a very high affinity for oxygen. So that's good. This is trying to get the oxygen. And it's also really good at withstanding high temperatures. That's why the Thomas Edison light bulbs use a tungsten filament, right? And here we've got to zoom in of one of those filaments. It's made out of tungsten because it's not going to melt. Okay. So that makes sense. The basic idea now to make this
Starting point is 00:41:31 memorister is the following. We've got a top electrode. We've got a bottom electrode. Tungsten, hafneum oxide, something else. And we use the oxygen vacancies in the Haphnium oxide to transport electrons and turn that highway on or off. Okay? That's effectively the idea. And I'm guessing the idea then here is whatever is on the opposite side of the tungsten, depending on what it is, changes the dynamics of the back and forth. And so there's fertile ground to optimize for different use cases. That is exactly right. And let's stay here. Okay. So you called it. The, top is tungsten, the meat in the middle is half-neum oxide, what should go on the bottom?
Starting point is 00:42:19 Okay? For a long time, people have been talking about platinum. Usually you want some kind of inert metal. It's a metal that doesn't, like, react with stuff, right? Because obviously if it reacts, that's going to cause performance degradation. So platinum is a pretty good metal. This is where the valence charge mechanism takes over, right? The problem is when you pump up the temperature, at high temperature, the tungsten starts diffusing.
Starting point is 00:42:51 Right? If you get into a high enough temperature, the tungsten now starts jiggling around, and the tungsten starts exploring the forest. Okay? And we don't want that. We don't want that. We just want the oxygen. Yeah. We want only the oxygen to move around, create these vacancies, and then there's a highway.
Starting point is 00:43:07 But if the tungsten starts moving around, all of a sudden, maybe you've got filaments of tungsten, and maybe filaments. and maybe filaments of platinum that are coming together. And if those two meet, you've got a shorted circuit. Now, there's no way to, I mean, even if you cut down all the trees, you've just paved a highway. Yeah, yeah, yeah. And there's no longer cycle. Yeah, yeah.
Starting point is 00:43:29 Why would anyone take the trees? You just go through the highway. Right. Right. You go through the tungsten and the platinum filaments. And that's been the big problem. Okay. Right.
Starting point is 00:43:37 They mix in ways that destroy this precise nanoscale. structure. Platinum and tungsten is not the way. Okay. You're going to effectively short circuit at high temperatures. At low temperatures, this thing is working. Great. Right. But you start pumping this thing up to 500, 600, 700 degrees Celsius. All of a sudden, the metal atoms in the two electrodes, they start getting agitated. This is giving me a feeling similar to the hypersonics episode that we talked about where Navier Stokes gets weird at higher temperatures. And so there's different regimes depending on the temperature ban you're working in. And I'm just making the connection between the two things. Different physics starts matter. Right. It's like the titanium
Starting point is 00:44:25 to titanium bond is now smaller than the thermal noise. And so the titanium's like, all right, I'm going to dip out. Let's start exploring. I don't know. I'm going to go this way. And the platinum's like, hey, hey, you know? Yeah, and the structure, the way you've kind of laid it out, no, that that makes sense in terms of, okay, we've discovered the fourth side, which is the memorister, we've figured out ways in which, because of the way the industry was at the time, what kind of works and is good for most of the use cases we thought we needed. But then as we got to higher temperatures, physics gets different, and it does, the current regime of tungsten and platinum. doesn't work. Doesn't work. Yes, exactly.
Starting point is 00:45:07 And now we get to the paper. Okay, this was out in science. Shout out triple A.S. High temperature memoristers enabled by interfacial engineering. One of the co-authors, actually, is Stanley Lee Williams, who's the original memoristers guy. The nature for, four. Oh, my God. What a legend.
Starting point is 00:45:30 I thought that was a nice, like, throughput. What a legend. So Joshua Yang, who's at USC, he worked with Stanley at HP Labs, and then now he's a professor of electrical engineering at USC. So this is a collaboration between, as you said, USC Air Force Research and Kumamoto. But it's like the same lab that created the memorister is now like just upping the game. We're the best. So what do you want us to do? Which is kind of cool.
Starting point is 00:45:55 Their big idea is to replace that bottom inert electrode instead of platinum, we're going to use graphene. Okay. So this is the one that we need to be more stable. Yeah. Doesn't want to do stuff. Yeah. I want it to not talk to the platinum. Or sorry, I wanted to not talk to the titanium.
Starting point is 00:46:13 I want them to not be friends. Yes. Platinum and titanium, they're friends at high temperature. Turns out graphene, even at high temperature, it's fine on its own. I'm good. Yeah, it's good. And for very good reason. So graphene, it won the Nobel Prize in 2010.
Starting point is 00:46:28 It was isolated in 2004 by Andre Gaim and Constantine. Noyoslov. Nooslov. Nooslov. Okay. They were in the UK. It's a very funny story where they actually, they took graphite, which is the stuff in pencil lead. They put it on pieces of paper, and then they got scotch tape, put it on the piece of paper, and removed it.
Starting point is 00:46:56 And the physics between the scotch tape and the graphite that's on the piece of paper would create single layers. of graphite, right? Single layers of carbon hexagonal shells. Graphite is a bunch of layers stacked together. Graphene is a single layer. Okay? It's an incredible story because it was scotch tape and a pencil and it won them the Nobel Prize.
Starting point is 00:47:21 Sometimes curiosity and just trying stuff is the key to breakthroughs that will last a lifetime as we again have discussed multiple times from the show. And I mean, since then, we've done loads of research. on how to make graphene. Obviously, like, if you're trying to do industrial scale, you're not going to be doing scotch tape and pencil, right? But you wouldn't have known. But you wouldn't have known, right? And now people do chemical vapor deposition to make graphene.
Starting point is 00:47:47 Graphene has extraordinary properties, okay? It's the strongest material ever measured. It's an excellent electrical conductor. It's transparent. It's chemically inert. It doesn't really mess around with other things. And that chemical inertness is the key property here. Side note, graphene for the longest time was overhyped. It was in Batman's suit, isn't it? Doesn't everybody uses in a suit? No, it's in all the movies.
Starting point is 00:48:20 All the movies. And then when you go out, you're like, where is the graphy? Okay, it won the Nobel Prize and everything. But like, I think if you talk to a lot of material, scientists, they're going to be like, this thing was super overhyped. Because of those, it was the strongest material, it was a conductor, it was transparent, it was inert. It didn't really find a lot of chemical, like a lot of industrial applications. So it's really nice to see that it's actually doing something. I'm sure there's going to be people in the comments
Starting point is 00:48:52 that tell me that there's all sorts of other stuff the graphene does. It's just, I haven't heard it, right? I've heard of silken chips. I've heard of all these other things. Carbon nanofibers. Like in F1, they use like carbon nanofibers in the, but that's not graphene. And carbon nanofibers never won a Nobel Prize. So I'm just saying. Bad PR. Right. This is a totally new purpose though.
Starting point is 00:49:14 Because a lot of times people like to use graphene for, as you said, the, the mylar and Batman suit, like, because it's strong or it's like electrically conducting. Here, we're exploiting the chemical inertness of graphene. And it may be finally getting its. moment in the in the in the light because the the implications of this uh could be just so enormous yeah it really could it really could so let's now get into the paper let's talk about figure one the graphene solution uh figure one a on the top left that is their memorister okay you've got a little tungsten electrode up top you've got half name oxide in the middle and you've got a graphine on the bottom. Okay. And that's effectively what's happening. The tungsten doesn't want to mess with the
Starting point is 00:50:07 graphene. We're going to get into some of the cool physics about that later. On the right hand side is what I want to show. You see that curve, that hysteresis curve? That's characteristic of your memorister. So that is where they're showing the memorister. All of the colors are from zero degrees Celsius all the way down to 700 degrees Celsius. And notice, the curve maintains its shape. Yes. All the way down to 700 degrees Celsius. This is crazy.
Starting point is 00:50:39 Yeah, yeah, yeah. Right? Because we're talking about 2.5, 3x. Yeah. The current level that we can. Yeah. And if you, I mean, usually in temperature, we always, as physicists like to talk in Kelvin, right? Zero degree Celsius is going to be like 270, let's say 300, 300 Kelvin.
Starting point is 00:50:55 700 degrees Celsius is 1,000 Kelvin. So this is three times the thermal energy that this thing is able to withstand. Because Kelvin is really how you scale how much kinetic energy is in the system. Right? Like at 1,000 Kelvin, or at 900 Kelvin, let's say, your atoms are moving with three times the kinetic energy
Starting point is 00:51:18 as the atoms at 300 Kelvin, okay? At room temperature. So this is crazy. Yeah, it's, yeah. Yeah. On the bottom left plot, you're seeing the time axis on the X axis, right? Yep. That's 10 to the four seconds, you're maintaining those two states of high resistance, low resistance. So the cycling is maintaining that we talked about.
Starting point is 00:51:46 The forest is going up and down. Yeah, and it's fine. And it's no problem. And it's not even coming together. It's just flat. Which is right, right, right. Like there's not a D, like there's not approaching the collapse. Yeah. It's not approaching the circuit, the short circuit.
Starting point is 00:52:01 No, it's not. Yeah, short circuit would exactly mean that like they're both coming to the same thing. We're not seeing that at 700 degrees Celsius. This is cycling at 700 degrees Celsius. So we have, it's stable. Yes. And on the right hand side, we've got endurance of cycles. The x-axis there on the bottom right, that's in log scale.
Starting point is 00:52:19 Holy. Okay, that's not a linear scale. Each of those tick marks is 10 endurance cycles. then 100, then 1,000, then 10,000, 100,000. It goes all the way up to a billion cycles. Before we start to see it. Yeah, and even then, that could just be noise because there's enough like, you know, jitter in the beginning.
Starting point is 00:52:37 Yeah, yeah, yeah. It's not clearly, this is incredible. Right? Because what we're sort of saying, there's two things here. Like one, stability at high temperature, which is C, and then D is stability over time, which goes back to the two things. And I'm kind of getting what you were saying before about why the fundamentals of the structure impact both of these variables.
Starting point is 00:53:03 Exactly. It's impacting both the temperature side of things, which is in the B and the time side of things. Because it's like stable. The whole thing is stable. And actually the next one, which is in, I think this is figure two in the paper, this shows a schematic. You always want a cartoon for all us stupid people like me who are trying to understand what's going on. On the left is an old memorister, okay? Tungsten, half-neum oxide, platinum.
Starting point is 00:53:28 At high temperatures, the tungsten is migrating and creating a paved highway. So the electrons will just move through that. Yes. Because that's the path of least resistance. Yeah, no one's going to take the vacancies, the oxygen vacancies. Why would you do that when there's a highway right next door?
Starting point is 00:53:44 It's like the cars movie, you know, when the interstate was formed. Nobody went through Route 66, and then your town got wrecked. Right. Okay. So on the right-hand side, now there's no highway because the tungsten is trying to diffuse, but it just bounces back from the graphene.
Starting point is 00:54:00 The graphene's like, I'm good. I'm all carbon and I'm good. It's like California's high-speed train. Yeah. 86 miles of track, you can't really use it. Yeah, you can't. Yeah. No, where is it going?
Starting point is 00:54:13 Where is it going? Nowhere. Nowhere, right? And so, and so that's exactly right. Yeah. And so the tungsten is sort of just like trying. It's still diffusing around. The atoms are still diffusing because of the high temperature,
Starting point is 00:54:26 but it can't bind to the graphene. And so the only way through is with the vacancy centers that are created through that hikers paradise. And that's where the electrons shuttle. And so now we have exquisite control of the resistance state. The one on the right here, the hikers path that you talk about, that structure, which is the forest, the bike analogy where we have the ability to control when they're up or down,
Starting point is 00:54:53 that's the point, is that that's the lever that gives us programmatic control for lack of a better term. Exactly, exactly. And Professor Joshua Wang, who is the principal investigator, he described this interface interaction between the tungsten and the graphene as oil and water. It's just like they're just not going to mix, right? Makes sense. This is so good.
Starting point is 00:55:15 It's pretty cool, right? So now let's, you know, to get into a paper in science, you can't just have a cartoon. Yeah. Right? That's for me. But in order to publish in science and convince your competitors that this is legit and all that other kind of stuff, you need actual analytical verification. So let's go to the first analytical verification. This is high resolution transmission electron microscopy.
Starting point is 00:55:42 Electron microscopes, we've covered this a lot. Instead of light, we're using high energy electrons. to really get down to, you know, tiny, tiny nanometer level resolution. On the top is a traditional memorister. Okay. You can see after, after like not a lot of time, the curves collapse. Yeah. Right?
Starting point is 00:56:05 After just like 2,000 seconds, which is like less than an hour, there's no memorister. It's the slope of a mammoth. Yeah, yeah, yeah, exactly. Straight down. Yeah, yeah. Chair 30. I believe. Correct me in the comments.
Starting point is 00:56:20 I never go on those chairs, so that'll be you lunatics. But on the right-hand side is the transmission electron microscopes. And you can see at high temperature, you see this like mushroom cloud that's forming on the right-hand side. That's the platinum and the tungsten meeting up.
Starting point is 00:56:36 And so instead of sort of maintaining the same, like substrate texture or orientation, there's just this disturbance in the force. Exactly. And you can visually see it. Yeah, and you can see the Haphnium oxide in the middle. right, the meat.
Starting point is 00:56:48 Yes. But like the platinum is just like going through. Yeah. Why would you, why would you go through the hafonymoxide? Right?
Starting point is 00:56:53 On the bottom is our new memorister with graphene. And there you can see even at high temperature, even after all of that cycling, the graphene layer, the graphene layer is inert. The tungsten layer is inert.
Starting point is 00:57:07 Nothing is happening. This is incredible. There's no chemistry happening. And it's also so verifiable. Yeah. You can literally look at it under the microscope. I can see.
Starting point is 00:57:16 And you can see. And you can see. that is happening. That stupid analogy is like imagine you have a BLT sandwich from a deli and they put the thumb, the toothpick through it. In the first case, it's like, you know, the toothpick through where you can see it disturbs the nice layers you have of your tomato, bacon, lettuce. Yeah.
Starting point is 00:57:34 And it looks like a very nice, undisturbed. But the point here is the high resolution imagery that is able to validate that this graphene based memorister actually sustains at high temperature is undeniable. Yeah, yeah, yeah. It's like now you don't need a cartoon. This is the thing that the cartoon is inspired from. Right. Like you're just seeing it.
Starting point is 00:57:58 I can see it. Here's another way to see it. You can use energy dispersive x-ray spectroscopy. The idea here is that, like, so during, in the previous photo, we had transmission electron microscopy, so you're like sending these high-energy electron beams, right, that strike the sample. Now, when those electrons strike the sample, it can transfer energy and violently kick electrons out. And when the electrons come back, they're going to release x-rays, right?
Starting point is 00:58:25 And if I monitor the x-rays during that electron microscopy, because every atom is unique, the x-ray signature is going to be unique. Like in the transmission electron microscopy, people could be like, oh, like, there's some weird thing happening. How do you know that's tungsten? how do you know that's platinum, right? It's just a gray image. Well, now we can tell that it is, in fact, tungsten that is leaking through
Starting point is 00:58:52 because only a certain energy comes from tungsten, and we're seeing that energy spike. Yeah. In the old memorister, but in the new memorister, there's no tungsten spike. There's no tons of spike. The W, by the way, for those watching, W is the chemical symbol for tungsten because of Latin.
Starting point is 00:59:11 And so it's interesting, because I think part of this is like you're doing both of these things almost simultaneously. Yeah, yeah, yeah, yeah. Because the electron microscopy is triggering an event that you track with the x-ray spectroscopy. And so you're getting both the visual and the signature. Yeah, exactly. That allows you to identify the composition of what you're looking at and can see visually. Exactly. And so if you look in the platinum electrode, there is tungsten there.
Starting point is 00:59:39 If you look in the graphene, there's no tungsten, right? Undeniable. There were also some calculations that were done from first principles. So you've got electron densities with density functional theory. Density functional theory is something that we covered in our America 250 episode. It won the Nobel Prize. This is what I mean by density functional theory. It's like you don't have to worry about every single electron.
Starting point is 01:00:02 You can just be like the electron clouds are like a potential. What happens when tungsten atom goes through? Does it bind or not? On the right-hand side is what platinum looks like, these giant sort of honeycomb structures, where the de-orbital, which is the stuff that these are these large de-orbital of metals, right? They're extremely large.
Starting point is 01:00:27 The tungsten is fine kind of just binding to one of these de-orbital because they're so big, right? And there's a lot of vacant spots where the tungsten can go and bind. On the left-hand side is graphene. pristine hexagonal structure I think it's only just like SP2 binding or maybe SP3
Starting point is 01:00:48 I forget my chemistry but in any case the bond lengths in between the carbons are smaller the graphene electron clouds are a lot smaller so the tungsten has nowhere to go it's incredible right there's the
Starting point is 01:01:04 you see the fat little like pimple that's the tungsten atom and it's trying to find somewhere to bind and it can't. It's like the grill on like your microphone or a speaker cover. Yeah. Versus like you described like a bunch of donuts that got blend or like, you know, Hawaiian rolls that got baked together.
Starting point is 01:01:24 Yeah, exactly. No clear actual like structural, you know, like a well-defined small structural positioning. Exactly. And it's part of your point that the smaller size of the electron cloud is a material aspect of why the, Because the tungsten is just not small enough to... Yeah, yeah. The tungsten is not small enough. The smaller size also means that you need a higher energy to get in there.
Starting point is 01:01:47 That makes sense. Right? Yeah. Yeah. And all of the stuff is taken. Yes. Right? With graphene, because of that hexagonal structure, it's just carbon on carbon on carbon. There's no...
Starting point is 01:01:55 All of the carbon atoms are happy. They don't want anything else. They don't want anything. Right? Yeah. Yeah. Oh, that's so good. So it's all coming together.
Starting point is 01:02:04 It's so good. And the final thing that I want to talk about is the nudgeed elastic band. this isn't the final thing but I just I'm going through their figures because they're just so cool okay so on the left hand side again that's the old memorister
Starting point is 01:02:16 this is an activation energy diagram that shows if I want the tungsten to bind to my platinum I need to go over this hill and then there's like a valley on the other side where I'm bound to the platinum
Starting point is 01:02:31 the height of the hill is 0.3 electron volts and then there's a nice valley where I can just like sit. On the right hand side is the same diagram but for graphene. The height of the hill is now one to two electron volts
Starting point is 01:02:46 and there's no nice valley, right? Like if I'm up there and I'm jiggling around, I'll just come right back to my original state. So again, same idea. It's really hard to bind to graphene. It's really good. Okay? Now, one thing that I was thinking about was
Starting point is 01:03:04 there's kind of a paradox in my head, right? Like the high resistance state makes sense. High resistance meaning there's no oxygen vacancy highway. Right now for a limited time, everyone's part of the Buick team, even you. Buick's employee pricing for you event is on now. Get a purchase credit of up to $3,168 on a
Starting point is 01:03:27 $26 Buick Envision. Surround yourself with signature Buick refinement from an available massaging driver's seat to an expansive pansexual. anoramic moonroof and a stunning ultra-wide 30-inch diagonal screen. Don't miss Buick's employee pricing for you event. Visit buick.ca for more details. And so, like my electrons aren't going through, but everything is kind of inert, right?
Starting point is 01:03:53 Now, let's say I have oxygen vacancy highway in that low-resistant state. What prevents the oxygen vacancy highway from moving around? Yeah. at high temperature. Yeah, yeah. Right? At high temperature, if I've got these like vacancy lines
Starting point is 01:04:11 where the electrons are going through, but those vacancies can move, as I was saying. As we talked about earlier, they're not stationary. They're not stationed. They're not fixed or whatever. Yeah, yeah, yeah. So what's preventing those guys
Starting point is 01:04:20 from moving around at high temperature when there's all this jiggle? It has to do with something called phase separation. There was a paper about this where the system reaches thermodynamic flux equilibrium where there's a net migration of zero, meaning that the material separates into an oxygen-rich insulating phase
Starting point is 01:04:38 and then an oxygen-poor conducting phase. And it's that same argument about oil and water. There's going to be parts of the half-neum oxide that have a lot of these oxygen vacancies. And then there's going to be parts that don't. And those guys don't want to mix together. They don't want to mix. Because they become like oil and water.
Starting point is 01:04:55 Now, how can we tell in our new memorister? Well, they did electron energy loss spectroscopy, which is similar to the x-ray stuff that I was talking about. Like the electrons are now coming out, and then we measure the energy of the electrons. The main thing that I want you to see is in the low-resistant state, which is on the bottom. So the color tells you how much oxygen vacancy there is.
Starting point is 01:05:21 The darker it is, the more oxygen vacancy there is. So that's why the low-resistant state at the bottom, that has, it's kind of darker because there's a lot more oxygen vacancies. The key thing that I want you to notice is on the bottom, we're plotting the number of oxygen vacancies as a function of space. Like we're moving along in nanometer position, we're moving along our memorister, and we're plotting how much oxygen vacancy there is. If you expect a lot of mixing, it should be at equilibrium. But if there's not a lot of mixing, there should be clumps. Where there's a lot of oxygen vacancy and then not a lot of oxygen vacancy.
Starting point is 01:05:59 Because of this oil and oil and oil. water you just talked about. And that's what we're seeing. We're seeing a very bumpy profile. Yeah. There's certain spots where there's a lot of oxygen vacancy and then other spots that there aren't. If this stuff mixed, it would look like the middle plot in that high resistance state. Right? Yes. But because it's not mixing, you get this valley and mountain landscape. And so part of what we're saying is there's two dynamics here. There's both the dynamic between how the tungsten and the
Starting point is 01:06:28 graphene relate and then the halphide oxygen? Yeah, hafnium. Halfneum oxide in the middle also has dynamics that are, that combined with the relationship between the tungsten and the graphene, such that the graphene doesn't want to create the highway and the oxide in the middle also doesn't allow movement. Yeah. And so both of these things combined are meaningful for the impact in terms of from an industrial or performance perspective. Exactly. And it's both things, not just the ends of the sandwich. Exactly.
Starting point is 01:07:11 Yeah. So both the high resistance state, which is the one, or sorry now, the high resistance is the zero. Because that's like the electrons aren't moving. And then the low resistance state where there is current, that's the one. Both of those are now stable. Right. Right. For dynamics that we just walk through.
Starting point is 01:07:26 which is an important point because I was going to end up asking, but what about the middle stuff? Yeah. Yeah. The middle stuff is also oil and water. Right, right, right. It's kind of cool. Yeah.
Starting point is 01:07:38 And they did a lot of benchmarking of like, okay, what is all the state of the art? And then where is this? And it's kind of crazy. A retention, which is how long it takes and the temperature, that's part A. You want it to be high temperature, high retention. So you've got a desired corner. That's the shaded and there's a star where the current work is and all of the other riffraff. This is not even close.
Starting point is 01:08:04 You've got the writing endurance in B versus temperature. Again, the only star in the desired corner is this work. See the on-off ratio versus the temperature. Desired corner is us. The spider web diagram. The yellow is the current work. And it's always larger in temperature. in retention, in endurance, in the device size, all sorts of stuff.
Starting point is 01:08:32 Now, there is a little bit of Photoshoppery happening here, right? Because I could easily make the desired corner like elsewhere. But in any case, by every metric, it's always in, it's the most in that corner. So whatever desired corner you made, it would always be the most out there. Right. Right. It's the closest to the optimal regardless of me, whether you made the desired option. smaller or large or whatever.
Starting point is 01:08:58 Yeah, yeah, yeah. But a game recognized game because, like, I done that. I know what you're up to. Yeah, I'm going to make the square right here so that all the other... Or out, but, like, buy, you just mix it in. Yeah, but in this case, I think it's, like, fairly obvious. And I don't think they're doing any shenanigans. I just thought that was kind of funny as a plot.
Starting point is 01:09:17 And finally, like, because I think they knew that people would call BS. Right. So they took a video of their lab. They're like proof. They're like, this is proof. And the thing he shows, oh, 700 degrees Celsius. And they've got, they've got like a computer with their, with the two electrodes on the two, on the titanium and the graphene.
Starting point is 01:09:41 And they're measuring the on-off ratio. And they're measuring the hysteresis curve. And here you can see the hysteresis curve. Like, okay, I turn the voltage up. I turn the voltage down. I'm getting this hysteresis. Guys. this is happening in real time.
Starting point is 01:09:56 I'm not making this stuff up. I think it's really cool that this is part of the supplement on the science website. Whenever you publish, right, there's the main figures and the main text, and then you provide supplementary data and supplementary figures. A lot of the figures that we've seen here in today's episode are from the supplement. And this is a supplementary video that they show. Okay, guys, here's my hysteresis curve. It's definitely a memorister.
Starting point is 01:10:22 this is happening at 700 degrees Celsius and it's definitely working. Picks or it didn't happen. Yeah. In Frontier science research. But it's also kind of like, I think one thing, you know, as we always talk about is scientists are some of the most skeptical people, especially when it's other people that say they did something. It's like, why didn't I think of that?
Starting point is 01:10:47 I don't believe you. Yeah. But here, yeah, it's like, okay, here, 740. degrees Celsius, guys. There's my thermometer. God, this is so good because, you know, and I think you've done a good job of walking us through to kind of understand that there's a fundamental insight that happens, that then you take to the end of possibility or the end of kind of the story in order to get to something that's practical. And it was a very, it was maybe subtle for folks who are matured.
Starting point is 01:11:22 material scientists and who work in the space. But if you're not in this lane, it can seem like, oh, this is a subtle point that has such huge implications. And they've used graphene as the other part of this layer here. Are there other things that have different performance characteristics for different use cases? Maybe we can now start replacing the tungsten. I don't know.
Starting point is 01:11:50 Right. And then what does that do? Yeah, it opens up all sorts of possibilities. Right. So now let's talk about the future. Okay? What would this current research have to do with how we move forward in computation as a society? We've talked about the Von Neumann bottleneck for a long time.
Starting point is 01:12:08 This is the tyranny of the processor having to be separate from our memory. Modern architectures waste a lot of power and time trying to move data between our CPU, which is where all of the computation is happening, and the RAM, which is where the data and the memory is stored. Von Neumann came up with this, and it's the bedrock of almost all of the computation that we have in our society today. Now, with neural networks, this is especially bad, because you've got to load the weights,
Starting point is 01:12:41 and then you've got to do the computation, then you've got to load a new set of weights, so you've got to dump the old weights, right? And all of this takes a lot of time. it takes a lot of energy, dissipates heat, and what exactly is the computation that happens in these AI systems? When you've got a neural network, what we're really doing fundamentally
Starting point is 01:13:01 is we're relying on matrix times vector multiplication. The vector is your state, and the matrix is the weights of your network. You multiply the matrix, you multiply the matrix to the vector, and then you get a new vector that tells you how the state is changing. At the end of the whole thing, you get a giant vector in the example of LLMs, you have a giant vector with all of the next possible tokens,
Starting point is 01:13:28 and you pick usually the one with the highest probability. Okay, how does matrix multiplication work? How do you multiply a matrix by a vector? For those from linear algebra, you already know this, but let's just do a little bit of a review. Okay, let's say I've got a 3x3 by 3 matrix. On the left there, I've got 112, 2, 1,13, 142. and I want to multiply it by a vector 312.
Starting point is 01:13:51 312 is the vector that's my state of like next tokens, let's say. And the matrix tells us how to change that vector to create a new probability vector with the new tokens. What you do is you go row by row, and you take each row, you multiply it by the vector. So the one gets multiplied by the three, the one gets multiplied by the one, two gets multiplied by the two, and you add it all up.
Starting point is 01:14:15 That's your first row. then you go to the second row, add it all up, third row, multiply, add it all up, and you get your new vector. Okay? That's fundamentally what most of the AI computation that we all know and love, I guess, that's what that is. Okay? That's what's happening. Key word, I guess. Yeah.
Starting point is 01:14:37 That's what's happening. Now, we'd like to do better. We'd like to not load the weights every single time in order to do this computation. And this is part of the reason why, for example, the cloud versus local with AI models and stuff, it's why if you want to do it locally, you need a very powerful machine because it has to do this. Yeah, it has to store all of those matrices and it's got to do all of that computation. That's why GPUs are so important because GPUs are just insanely good at matrix multiplication. At that specific test.
Starting point is 01:15:10 At that very specific task, okay? They're not good at, like, doing normal emails, but it turns out, Nvidia made the big gamble way back in the day that actually graphics, which is matrix multiplication, is going to have use for later. And it turns out, yeah. In things other than video games,
Starting point is 01:15:31 for those who are gamers, we've been very familiar with GPUs for a while, and now everyone is making custom PC builds unnecessarily expensive. Yeah, yeah, exactly. So instead of doing all this von Neumann nonsense, instead we can do something called in-memory computing. In-memory computing meaning, I don't have to move anything. Okay?
Starting point is 01:15:51 We can use something like a resistor to do the computation without changing anything. So again, let's talk about how that would work. I told you about how matrix multiplication works, right? like matrices, you multiply it by a vector, and then you get a new vector. Well, now, what if we had the old vector come in like wires? Okay? And this is what we see on the right. And let me see if I can say this correctly, okay?
Starting point is 01:16:22 So I've got a matrix, and I've got an old vector, and I want to make a new vector. And the way that I do that is the rows get multiplied to each of them, and then I get added up, right? I can use the rules of electronics, V equals IR, and the summing of voltages, the summing of currents, to then just do that using physics. Here's what I do. My old vector is represented by the old currents that are going at the very top, the old voltages, I should say. Each of the wires at the very top is held at a certain voltage, right?
Starting point is 01:16:58 I've got resistors that are attached to these voltages, and then I've got a new set of wires at the bottom. because of electronics, the new current, it's a new set of currents at the bottom. Because of electronics, right, the new currents are going to be related to the voltage at the top and the resistance in between. And all I have to do is add up the currents. I'm so mad. Right?
Starting point is 01:17:28 In this case, it's not really resistance. It's one over resistance. It's the conductance. And then the current is just voltage multiplied by conductance. But it's the same thing. It's just V equals IR the other way around. And all we're doing is using the physics in place, right? We don't have to move weights around.
Starting point is 01:17:46 As long as the weights are the same, I can use the physics to be like voltage multiplied by conductance gives me a current. Voltage multiplied by another conductance gives me another current. And so my new vector is going to be the sum of all of those currents. And there you go. Matrix multiplication using physics. I'm so mad. It's so good.
Starting point is 01:18:08 It's so good. And part of the point here is then you can get around the Bonoimann bottleneck as a result of that because you're not having to transition between your compute layer and your memory layer. Yeah. And all you have to do is the weights have to be programmed into the conductance. The input is the voltage and the resulting multiplication comes out as current. I'm just using Olms law and Kirchhoff's junction rules, the stuff that you learn in like intro physics. Right. Now, are we capable of doing something like this?
Starting point is 01:18:35 this particular paper itself made a 32 by 32 analog resistance state, and it works at 1,300 degrees Fahrenheit. It works at low voltage, 0.5 volts is all you need, 30 nanosecond switching in the speed, and it definitively, it proves that you can be fully capable of storing complex multi-level analog neural weights for whatever A, interface that you're working with, it can do it in extreme environments, 1,300 degrees Fahrenheit, and the standard digital GPU, which relies on all these transistors and the CMOS and all that
Starting point is 01:19:15 other kind of stuff, the traditional GPU is going to get fried. But if I use this memorister, where the conductances, the weights, are stored using this memorister, now all of a sudden, I've got something that can actually work. Golly. It's so, it's so good, and it's this interesting combination of both things, which is, the fundamental discovery around the memorist reconstruction for high temperature, plus the concept of in-memory computing together. Yeah. Because it's not just one or the other.
Starting point is 01:19:57 Both things give you now the single chip that can work in high temperature, that can, you know, run comparably for a long time. Faster. Faster. And can do both your compute and memory at the same time. Exactly. And of course, the authors have made a startup. Okay?
Starting point is 01:20:19 There's a startup called Tetramem. It was co-founded by Joshua Yang, who's the PI of the paper that we're talking about, along with Chiang Fei Shia and the other authors. And it's already working to commercialize this crossbar memorister device to replace power-hungry GPUs, right? They're getting acquired immediately. Yeah, no, especially with this.
Starting point is 01:20:41 Immediately. Now, let's talk about what this has to do with data centers in space. Okay. Okay. Elon wants to put data centers in space. Why? Because it's probably possible. And, I mean, it helps SpaceX, obviously.
Starting point is 01:20:55 And it's not just SpaceX that's trying to do this, right? Google is trying to do this. There's a bunch of startups that are trying to do this. and it's looked impossible for a very, very long time because of a sort of fundamental physics quandary. The reason why is because these GPUs are highly reliant on cooling mechanisms because the GPUs can't withstand a lot of heat. That's why whenever you hear about all these data centers taking up local water,
Starting point is 01:21:25 the water is being used to cool down the GPUs effectively. At the end of the day, that's most of the water being used. used is just to extract heat from these GPUs and put it out into the environment. That's why the data centers, the climate around the data centers, there's like a microclimate that's created and the temperature gets raised. And then all the environmental people are like, okay, what's happening in the flora and fauna, which is completely reasonable, right? I don't want to hurt like the planet and especially the planet that's right around those
Starting point is 01:21:57 data centers. So let's talk about how heat transfer happens. There's three types of heat transfer. There's convection, conduction, and radiation. Convection is hot stuff moves around to the cold part, and then the cold part goes down to where the hot stuff is. That's how, like, if you put a pot on a stove, the water gets heated uniformly because the hot packets are moving
Starting point is 01:22:20 and the cold packets are moving. So that's convection. Conduction is the atoms themselves jiggling around to conduct heat from one. spot to the other. That's why the handle gets hot. And then finally, the most inefficient part is radiation, which is literally photons coming out. Like, the reason why a fire is hot, but if you put your hand in front of the fire, all of a sudden you don't feel that hot is because you've stopped photons from getting to your face.
Starting point is 01:22:51 Okay? And that's why like when a shade is so important because now the photons, the infrared photons from the sun are not hitting you. And then all of a sudden you feel like 10 or 20 degrees cooler. You're right next to the sun, right? The shade is only shading your part, but the reason why it's so effective is because the photons aren't getting to you. The convection and the conduction still is, right?
Starting point is 01:23:12 The hot pockets of air are still moving towards you, but the photons are not. Okay, so those are the three types of heat transfer. Now, terrestrial data centers, they mostly use the first two. Mostly it's convection. That's why you've got water pipes going through, because the water gets hot and then you move the water to a colder spot, it dumps the heat,
Starting point is 01:23:35 and you cycle it back, and so on and so forth, right? Terrestrial data centers have issues, right? Where is the power going to come from? Where is the water going to come from? Who's going to build it? Yeah, who's going to pay for it? Yeah, there's a lot of nimbiness going on, and in this case, the nimbiness is a good thing, right? We don't want, I don't want data centers in my neighborhood.
Starting point is 01:23:56 Yeah. Okay? I might want the AI, but I really don't want it. the data centers. Right? And so that's why people are looking into space. Now, people have already started looking. This is StarCloud. It's a startup that's backed by NVIDIA. Google is doing its own thing. And there's a lot of smart people betting on this thing. Here it shows a five gigawatt data center. But the radiator that you would need to dissipate all that heat with radiation is something like a four kilometer square. And you have real, you know, getting any payload into space.
Starting point is 01:24:29 is cost prohibitive. Yeah. And so getting a payload that's four kilometers by four kilometers wide will take a modular system, multiple launches. Yes, the cost of launches is going down. Yeah. But still, it's four kilometers worth of stuff, worth of stuff, right? It's not a joke.
Starting point is 01:24:47 It's not trivial, right? And there's several important papers that are coming out trying to plan for this kind of thing. Like how do we develop carbon neutral data centers in space? I want to highlight this because this is in nature electronics. this is a top journal. It's not impossible. There's a lot of rhetoric out there
Starting point is 01:25:04 that's saying that data centers in space is impossible because of the vacuum of space and people need to take undergraduate physics. It's not true. Right. Okay? It's hard. But that's a key distinction from it's impossible.
Starting point is 01:25:18 Okay? I mean, we obviously do it, right? The International Space Station is already doing this. If we look at a photo of the International Space Station, the curved panels that we, see, those are solar panels that are facing the sun. The flat ones, those are radiators. Those are radiating out heat into space so that the astronauts that are on board don't get cooked alive in all of the electronics that is, you know, doing computation. There's several computers up there.
Starting point is 01:25:46 Those don't get cooked alive. The way that works is using both convection and radiation. So you've got convection in that they use ammonia instead of water because ammonia has a low freezing point. If you use water, then the water's just going to freeze when it gets to the radiator and then like what? So that's why you use ammonia. The ammonia uses convection to take the heat to the radiator, and then the radiator takes that heat and radiates it out into space. Okay. Now, what we want to do is make this thing cheaper. And that is perhaps an engineering problem, especially in the context of the paper that we've just covered. I'd like to pose that as a challenge and then see if we can work through with just some like first principles back of
Starting point is 01:26:31 the envelope thinking. Okay. The technology poses three advantages. One, let's talk about the physics of thermal radiation. The reason why everyone's saying that it's going to be impossible, right? Thermal radiation is governed by something called the Stefan Boltzmann Law, which states that the energy that is radiated by a surface at a certain temperature is proportional to the fourth power of that temperature. This is why it's hard. Okay? It's not T squared.
Starting point is 01:27:01 It's T to the fourth. So if I double the temperature, I'm increasing the amount of power output I need, or the power output that's going out, by a factor of 16. Okay? Now, this is actually a good thing, okay, in the context of this current paper.
Starting point is 01:27:19 Now, standard silicon processors, they've got to be relatively cool to prevent failure, right? But you can only allow that chip with the standard silicon, to run at like tops 100 degrees Celsius. At 100 degrees Celsius, right, let's say 400 Kelvin is the tops that you can do. At 400 Kelvin, the amount of radiation that I'm letting off is going to be some amount. Some amount of photons are going off. Now, what if I could make that go up to 700 degrees Celsius, 1,000 Kelvin?
Starting point is 01:27:55 So I've effectively doubled the temperature that I'm working with. Well, the number of photons, the amount of power that I'm dissipating has now gone up by a 16, by a factor of 16. If the amount of power per unit area has gone up by a factor of 16, then in order to dissipate the same amount of power, I only need a 16th, the size of radiator. Yes? The size of the radiator goes down, the higher the temperature that you can operate. And this is crucial for putting the stuff into space. Right? Because of what you said, it's hard to put stuff in space.
Starting point is 01:28:32 Yes. It's hard. It's expensive. I'd like to put less stuff in space. This could be the key, right? Because now I can operate things at a much higher temperature, meaning that the amount of watts that are going out as radiation into space is higher, which means the amount of area that I need for my radiator is smaller.
Starting point is 01:28:52 This is so interesting. And it is enabled by this high temperature, Mimrister, and the fundamentals that we just walked through that, again, now give you a different substrate, a whole different computing paradigm when you think about the concept of a data center in space. Yeah, exactly. And I did some back-of-the-envelope calculations, right?
Starting point is 01:29:13 So let's say I need a radiator for a one-megawatt space server. Okay? That means one megawatt of electricity is coming in from my solar panels. Okay. Now, at standard 30 degrees Celsius, so that's 300 Kelvin, if I want to dump one megawatt of heat, I would need 2,000 meters squared. That's eight tennis courts.
Starting point is 01:29:37 And I want to dump just as much energy that's coming in, right? Because if I don't dump the energy that's coming in, then my temperature increases, and then the electronics are not stable. My satellite keeps increasing in temperature. So whatever energy is coming in, I'd like to dump out. So one megawatts in, one megawatts out. What matters is the temperature that I'm operating at, okay?
Starting point is 01:29:59 Now, if one megawatt is coming in, and now let's say I'm operating at 300 degrees Celsius, that's around 600 Kelvin-ish, my area has gone down to 150 meter squared. I've gone from 2,000 meters squared to 150 meter squared. That's a reduction of 90%. Right? If I go even further, because this thing was at 700 degrees Celsius, right? If I go even further to 600 degrees Celsius now, meaning 900 Kelvin, now my radiators only need to be 30 meters squared.
Starting point is 01:30:31 And that's totally doable. Yeah, that's very reasonable. Right. That's already in the ballpark of stuff that we've already put out there. Right, right. Right. Right. That's so fat.
Starting point is 01:30:41 It's, for me, it's a little counterintuitive where it's at the higher, you know, before we started this, what the higher. the temperature, the less surface you need to dissipate the heat. It doesn't feel. Yeah. As long as the stuff is not cooking. Right. Right.
Starting point is 01:30:56 But like it kind of makes sense because like if you think about like, you know those like electric stoves with the coils? Yeah. Right? The higher the temperature, the more the more heat is coming out. That's the whole point of how it cooks stuff. No. Right?
Starting point is 01:31:10 I mean, no, I guess that's not true because there's like contact. But you get what I'm saying, right? Like if you're around that thing. Yeah, I know what you mean. It's like there's a lot. more photons that are coming out. So you're dumping a lot more energy. And as long as you can live at 700 degrees Celsius, you're good to go. And it's just because we've never been able to think about it because we've never been able to operate. Yeah. So it's never was even a possibility.
Starting point is 01:31:31 Exactly. There were no chip components that could withstand that temperature. So everyone was doing these calculations at the lower temperature being like, oh, I need tennis court sized, four kilometers squared size. But now I've reduced stuff down to like 95, 99 percent the area, just being, because my components can withstand the higher temperature. My components, my computer can be hotter. And so the amount of radiator I need is a lot, lot lower by T to the fourth. This is so, I mean, you know, again, there is the industrial scale question and all of these other, you know, engineering. But to the point you brought up earlier, a lot of the narrative and rhetoric has been dismissive on its face in a
Starting point is 01:32:17 way that doesn't even take into account what we're doing at the frontier. Yeah. I mean, this paper came out in March, by the way. And this discussion about data centers in space has really heated up as we've gotten into the summer, which was after this paper had come out. And most of the folks who have been like, it's impossible, you know, certainly one, from a fundamental physics perspective. It's not impossible.
Starting point is 01:32:41 And then also from where we are on the frontier, both from a basic research and an engineering perspective, it's a very different paradigm than, you know, just talking about putting the same thing we have in a data center on the ground. Yeah. And just putting it in space. Exactly. And if you combine that with the fact that payloads to space are going to get cheaper, as you said, the amount of payload that I need is going to go down. This is totally a doable thing. Right. Right. As long as we keep innovating and we keep going through with high temperature memorysters, high temperature memory, high temperature computation, that's going to be the key, I think, to unlocking data centers in space. Yeah. Yeah, because you can have a lot more smaller,
Starting point is 01:33:20 you could have, you know, much smaller space servers with high output capability, meaning we're not going to be, you know, looking up at the night sky and seeing, you know, these giant floating radiators. Yeah. And I mean, it perhaps is is going to be bad for astronomy, terrestrial astronomy. But there's got to be ways around it. I mean, it's already bad with the Starlink satellites that are up. But does that mean that like we don't provide internet to like these remote areas? Like, you know, technology and innovation comes at a cost and we're just going to have to figure out ways to battle. And with the lower cost of payload, you could argue we could have a much larger array of space-based instrumentation.
Starting point is 01:34:08 Exactly. That exists that negates the need to have terrestrial observatories. Again, there's some caveats there. Yeah, yeah. There's a lot of caveats. A lot of caveats, right? But, you know, they're tradeoffs and we'll have to continue to figure out. Maybe we can make the orbits, like, avoid Chile, which is where, like, half of everything
Starting point is 01:34:25 is. Right, right. If you just avoid, like, Hawaii and Chile, like, no fly zones. Like, half of the astronomers are going to be happy. Yeah, right. You know? So, I mean, that's going to be hard. even that it's like high Earth orbit and whatever.
Starting point is 01:34:37 But in any case, the other thing that I want to bring up is this is not just an advantage in terms of cooling. Okay? There's two other things that this new memorister technology would give us for data centers in space. One is the extreme power efficiency. I was talking about how it only takes
Starting point is 01:34:56 like very little amount of voltage in order to do that computation with a memorister. Now, satellites operate on extremely strict power budgets. you can imagine, right? Often it's under 20 watts. And in standard AI chips, nearly every single watt of electricity is consumed directly into heat.
Starting point is 01:35:15 But memoristers use this in-memory analog computing. They don't have to do with this Von Neumon bottle name. Right. So if we're applying memoristers here, then that complex mathematics instantaneously happens without shuttling the data back and forth. Now you're consuming a fraction of the power
Starting point is 01:35:31 of a traditional GPU, and that's going to bring down the amount of power that you need to dissipate again. So this is both, you can have the radiators be smaller and you can have the solar panels be smaller. Exactly. Because you don't need as much power intake. Exactly. Or with the same solar panels,
Starting point is 01:35:47 you can do a lot more. Right. You know, either way. Right. Right. Efficiency is always great. Yeah, yeah. Both in power dissipation and in terms of computing. And finally, the other big thing that people talk about with data centers in space is like normal GPUs,
Starting point is 01:36:00 a cosmic ray comes in. Yeah. I don't know where that, if that bit was a zero or a one, right? Like, what? So, like, a galaxy decided to fart. Yeah. And then now, like, my AI query is giving me nonsense.
Starting point is 01:36:16 Right. That's not great. Right. You need electronics that is able to sustain performance in a high radiation environment. Memoristers are great for this because memoristers store memory by physically moving atoms and creating structural bridges, right? this like valence charge mechanism rather than relying on these
Starting point is 01:36:36 easily disrupted pockets of electrical charge. So now you can imagine a cosmic ray comes in, it's not really going to upset the valence charge mechanism all that much compared to if there was a single like sort of point of failure. Right. And so there is the, we have a
Starting point is 01:36:55 thermal radiation benefit, a power efficiency benefit and a resilience benefit. And it's hard for me to imagine. Again, there is the engineering problem, but it's kind of like when NVIDIA started with GPUs before you could really understand what the impact would be.
Starting point is 01:37:14 We already can see now, in the case of data centers in space, why, if you can figure out the industrial scaling of this, it makes the execution of it in three, the three of the most important categories. that you care about as an operator significantly better in order or orders of magnitude from what you would otherwise be doing
Starting point is 01:37:44 with the current conventional options. Exactly, yeah. I mean, I think it's an incredibly exciting time for electronics at the cutting edge. Yeah. Right? Because we're starting to see that things like GPUs
Starting point is 01:37:58 and things that are capable of doing matrix multiplication and things like that are going to become increasingly important, perhaps even more important than traditional von Neumann architectures. We've still got a long way to go, so I do want to temper the brakes here and not dream too much
Starting point is 01:38:13 because memory alone does not make a complete computer. You need high-temperature logic circuits that also need to be developed and integrated alongside whatever chip that you're trying to put in. And current devices are built by hand sub-micron scale in the lab. this is from their paper in the supplement.
Starting point is 01:38:34 That length bar there says five micrometers. Okay. So that's like a thousand times bigger than the chips that we have, like the transistors that we have in our chips in my computer, for example. So we got to make this thing smaller while still retaining the memorister characteristics, the graphene. That's going to be a problem, right? scale up is going to take time
Starting point is 01:38:59 on the manufacturing side two of the three devices two of the three materials in this device namely the tungsten and the Haphnium oxide those are already standard in semiconductor manufacturing making the graphene smaller that's going to be kind of tough right
Starting point is 01:39:15 it's newer to the industry but actually TSM and Samsung both have that in their development roadmaps if you go look they have like the shareholder like pitch decks or like we're still innovating guys, you know. So they have graphene in their roadmap and it's already grown at
Starting point is 01:39:35 wafer scale in research settings. We need to make it industrial if we want to have this thing grow. I mean the startup that these USC scientists, Tetramem, co-founded by Joshua Yang and Shia, I mean, it's already like doing things. So we're heading for a new era in computation in a era where computation is becoming the bread and butter for our society, more than ever, more so than ever.
Starting point is 01:40:03 I mean, we used to think, right, ever since the advent of the 90s and the advent of the personal computer, the computation would be big. Now it's like cloud computing and these large-scale computing. Large-scale computing is now taking precedence over personal small-scale computing.
Starting point is 01:40:19 Right? So we're entering into a new era of computation. We've lived through one in the 9th. 90s, and now this is a new one. As if, as it relates to TSMC, it's interesting that both TSMC and Samsung are already working on, you know, integrating graphene into their industrial process, as if we needed another reason for Taiwan to be a geopolitical matchbox, particularly given the stakes of the perceived and real benefits of the race as it relates to AI writ large.
Starting point is 01:40:55 large. This is going to be, and again, you know, we talk about breaking science research papers on this story. There is a delta between or a distance between it working in a lab and it being in your phone at home or in a data center in space. But it is a, we're trying to continue to build this roadmap for people to understand where we're going as a society and what some of the best and brightest among us are trying to bring to us.
Starting point is 01:41:24 And again, we talked about this in the context of data centers in space. But there are other things that you've mentioned, you know, that would be used. This will be useful for an extreme computing. That's right. Exploration and other things. Space exploration. I'd like to get better photos of Venus. Yeah.
Starting point is 01:41:45 Yeah. That'd be really nice. That'd be great. I'd like to have a rover on Venus that's like running around and stuff. That would be cool. heavy energy like geothermal, nuclear monitoring. I'd like to have safer nuclear power. If you're a green or clean energy person,
Starting point is 01:42:03 I mean, this can have real, real impacts in that space because it can help us better both understand and also execute in terms of production, maintenance, operational aspects. Yeah, really anything that requires high-temperature computing, right? I mean, with the advent of fusion, right? If we're trying to make fusion a thing, stuff is hot. Yep. And so if we want real-time monitoring and decision-making using some AI algorithm about how to confine the plasma, I'm just thinking out loud, right?
Starting point is 01:42:33 Like, that's something that this would be used for. I don't need, like, to cool it down to room temp. I can just cool it down to 700 degrees. Who needs a room temperature semiconductor? Yeah. Well, we still want that. We still want that. We still want that.
Starting point is 01:42:46 This was a really great. Electronics that can survive lava. Again, this was a recent science paper, March 2026, a collaboration led by researchers here in California, Forever Goodbye at USC alongside the Air Force Research Lab in Dayton, Ohio, and the Kumamoto University in Japan, with funding from the National Science Foundation, the Army Research Office and the Air Force Research Lab.
Starting point is 01:43:20 Can't wait to see high-temperature immersers in a hypersonic vehicle near you because certainly they're going to be using it for command and control systems integrated with, you know, next generation military stuff. So before they do that, we would like to have it be used for the good of mankind. Do you have any last notes before we wrap up today?
Starting point is 01:43:45 No, if you want to leave a comment, think of a really funny application for high-temperature computing. Where would you want to put a chip? Run wild. Keep it PG, everybody. This is a family-friendly show. As always, my name is Lester Nare, joined by my co-host, our resident data centers in space are possible PhD. Krishna Chowdhury. We are approaching our one-year anniversary, so be sure to be tuned in for our anniversary episode. For our longtime listeners, we are extremely grateful. If you just happen to be
Starting point is 01:44:27 listening to us for the first time, catalog is a bunch of episodes that are just like this. 50 of some of the best science, entertainment on the planet. We will see you all next week. Car shopping this civic holiday weekend, most car dealerships are closed and all you'll find are crickets. Not Performance Auto Group. They're open this Saturday and Holiday Monday for their annual Civic Holiday Sales Events. Celebrate this long weekend with rates from 0%. They might be closed. Performance Auto Group is open to serve you. Join Performance Auto Group this Saturday or Civic Holiday Monday 9 to 5 for the best time to shop this summer.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.