Daniel and Kelly’s Extraordinary Universe - How do we predict the weather?

Episode Date: December 9, 2025

Daniel and Kelly explain how physics predicts the future rain and shine, and all of the incredible science involved.See omnystudio.com/listener for privacy information....

Transcript
Discussion (0)
Starting point is 00:00:00 This is an I-Heart podcast. Guaranteed Human. I know he has a reputation, but it's going to catch up to him. Gabe Ortiz is a cop. His brother Larry, a mystery Gabe didn't want to solve until it was too late. He was the head of this gang. You're going to push that line for the cause. Took us under his wing and showed us the game, as they call it.
Starting point is 00:00:22 When Larry's killed, Gabe must untangle a dangerous past, one that could destroy everything he thought he knew. Listen to the brothers Ortiz. the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. Hi, Kyle. Could you draw up a quick document with the basic business plan? Just one page as a Google Doc. And send me the link.
Starting point is 00:00:40 Thanks. Hey, just finished drawing up that quick one-page business plan for you. Here's the link. But there was no link. There was no business plan. I hadn't programmed Kyle to be able to do that yet. I'm Evan Ratliff here with a story of entrepreneurship in the AI age. Listen as I attempt to build a real startup run by fake people.
Starting point is 00:00:58 check out the second season of my podcast shell game on the iHeart radio app or wherever you get your podcasts what are the cycles fathers passed down that sons are left to heal what if being a man wasn't about holding it all together but learning how to let go this is a space where men speak truth and find the power to heal and transform i'm mike delarocha welcome to sacred lessons Listen to Sacred Lessons on the IHartRadio app, Apple Podcasts, or wherever you get your podcast. Hi, I'm Dr. Priyanko Wally. And I'm Hurricane DeBolu. On our new podcast Health Stuff, we demystify your burning health questions.
Starting point is 00:01:42 You'll hear us being completely honest about our own health. My residency colon was like a cry for help, honestly. And you'll hear candid advice and personal stories from experts who want to make health. health care, more human. I feel like I never felt like I truly belonged in medicine. We want to make health less confusing and maybe even a little fun. Find health stuff on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. When I moved to Southern California, I felt this immediate, immense relief.
Starting point is 00:02:22 Not just because I was free of the tyranny of outside. clothing, but because I was released from the anxiety of not knowing if the weather was going to ruin my plans. Were you planning an outdoor birthday party for your toddler? No need to make backup plans just in case it rains. Do you need to drive a few hours away? No problem. You don't have to worry that a snowstorm might make the roads impassable. Because I could predict the weather myself since it was the same every single day. But not all of us are lucky enough to live in such calm climb, so it's still very important that we try to anticipate storms so that the less fortunate among us can be prepared. It's not often described as important physics, but predicting
Starting point is 00:03:04 the weather is one of physics's great success stories. John Martin, professor of atmospheric and oceanic sciences, told me that weather predictions are, quote, the most unheralded scientific advance of the second half of the 20th century. If you keep score every day, I can't believe how well we predict the weather three to five days in advance. In 30 years, we've gone from predictions from one to two days to now five to seven days. We have made unbelievable progress. So how does that all work? What is the physics underlying the weather? Why has it gotten better and what can we expect into the future? I talked to Professor Martin and my good friend, Professor Jane Baldwin, here at UC Irvine, about how the weather all works. So we'll dig into all of that in today's
Starting point is 00:03:46 episode dedicated to all of y'all who still experience regular weather. Welcome to Daniel and Kelly's extraordinarily sunny universe. Hello, I'm Kelly Weiner Smith. I study parasites and space, and I love rainy days. Hi, I'm Daniel, I'm a particle physicist, and I can predict the weather in California for the next hundred years with my eyes closed. How boring. How massively dull. How wonderfully, delightfully, predictably, reliably boring. Oh, you know, one of my favorite weather moments, I have to admit, was a Southern California morning. So I was a visiting scholar at the University of California Santa Barbara for a little while, and I had an office that was like right out on the ocean.
Starting point is 00:04:43 It was amazing. And when I was driving in one day, there was just a little bit of water on the ground, and the car tires were kicking up a little bit of a spray, and there were literally rainbows following all of the cars into school. And then I got out of the car, and the rain had stopped, and there was a rainbow over the ocean, and there were hummingbirds, and it was like a Disney movie scene. I expected, like, a bunny to hop out and be like, can I help you with anything? And it was, anyway, it was kind of magical.
Starting point is 00:05:13 I'll give you that. California is heaven, yes. What happens when you die in Virginia is you end up in California. Do you know that not all California is Southern California? I mean, all of real California. Oh, I see. Because Northern California's got some weather. You're absolutely right.
Starting point is 00:05:30 In fact, I heard Katrina say something really insightful the other day. You know, she's from Northern California, but now we've lived in Southern California for quite a while. And she said to somebody that she's now a complete Californian because she's lived in both Northern and Southern California. And I was like, oh, that's cool. She's like accepted Southern California, which is hard for Northern Californians, I am aware. Yes, not everything is Southern California, unfortunately. I really like the variability. Virginia weather is amazing for me. But so my question for you is, what is the worst weather situation that you've experienced? Great question. I was on the East Coast last year doing a college tour with my son, and we were in Massachusetts,
Starting point is 00:06:12 I think we were visiting Amherst, or maybe it was Williams, I don't remember. And there was some freak tornado, which tore up a bunch of trees and knocked down a bunch of power lines. What? And there was no power in the whole town for, like, almost half a day. It was crazy. And the winds were insane. And it felt a little scary. Like, we saw, like, huge branches flying by the window.
Starting point is 00:06:36 Yeah. Yep. And he didn't end up going to school there. Yeah, I get that. that, I get that. So we lived in Alabama, Tuscaloosa, and we moved there pretty soon after that giant tornado that, like, made the news. And you could see the path of the tornado, because, like, you know, you'd be driving through an area with lots of, like, you know, Starbucks, Panera, lots of stores or whatever. And then suddenly there would be a, like, an opening in between all of the
Starting point is 00:07:03 stores with nothing. And, like, the tornado had just gone through there and just absolutely picked up and thrown everything that was in there. And even after they cleaned it out, there were still, you know, you could tell where the tornado had gone. And we were also in Houston during some pretty bad storms. And we had the kids and our dog and our cats in a little hallway in the interior of the house. And my in-laws were visiting. And my mother-in-law was so sweet. She, like, looked around and she was trying to see, you know, who could get hurt and how. And she gave her glasses to Zach in case there was any, like, flying glass. And she just insisted that he have her glasses. And I was like, in that moment, I was like, gosh, you are the
Starting point is 00:07:42 sweetest person in the whole world. Like, you are thinking about the tiny little things you could do to help the people around you. And anyway, she's the best. Yeah. But we've all been caught in surprise weather, right? I remember going backpacking in Arkansas one time and being caught in a snowstorm and the temperatures dropped into the teens and we weren't 100% sure we were going to make it.
Starting point is 00:08:02 And everybody's been like, you know, caught in a snowstorm or a rainstorm or in a heat wave, right? And these things are exciting. They can be dramatic. They can also be very dangerous, right? People die in these crazy weather storms. And so it's valuable to be able to know in advance what's going to happen, not just so you can play in your picnics, but also so that you can survive the increasingly dramatic weather
Starting point is 00:08:26 that we're all facing as the planet warms. Yeah, that's right. More severe weather is becoming more common. And so today we're going to talk about how good we are at making predictions and how we go about making those predictions. Exactly. And I wanted to pull back the curtain on like the science of this. How does this actually happen?
Starting point is 00:08:42 What are we doing? Why is it hard? What are the challenges? What improvements might we be seeing in the next five or ten years? What problems are just fundamentally impossible and might never be solved? And so today we're going to dig into science of all that. But before we explained to you how the experts do it, I was wondering what everybody knew about how weather predictions happen.
Starting point is 00:09:02 How do those numbers end up on your phone? So I went out there to ask our listeners what they knew about how we predict the weather. If you would like to answer these kind of questions for a future episode, don't be shy, write to us to Questions at Danielnkelly.org. We will send you fun questions every week in your inbox. In the meantime, think about it for a minute. What do you know about how we predict the weather? Here's what our listeners had to say. Sophisticated computer models, which with an understanding of chaos theory, allows us to understand the limitations. predicting the weather is like quantum particles. There are many probabilities, but it is not known until it is observed. Meteorologists, they look at the current weather, and they try to predict it by looking at the moving clouds and all of that. By measuring wind velocity and atmospheric pressure and maybe modeling these data in superiors,
Starting point is 00:10:06 computers. When a cow lies down in the field, it's going to rain, and when my knee aches, it's going to snow. Running multiple models. Big computers. Really, really big computers. Feed that to complicated models that run on very powerful spoken peers. I'd say with surface measurements, satellite information, and sophisticated models, and perhaps even artificial intelligence. observations taken by ships, planes, ground stations, satellites, combined with models built by really, really smart people that run on some of the fastest computers that humans have ever built. There are sophisticated bottles that use a wide range of observational and predictive inputs. By observing weather patterns and the types of weather those patterns tend to bring.
Starting point is 00:10:58 So I don't know if there's actually like scientific evidence that sometimes knees will ache if like a stormfront is coming through, but I have to admit that there's a problem. part of me that really hopes that if I get arthritis when I'm older, I do have like the ability to tell when the weather's coming because I'll feel like I'm really intimately connected to my environment. Oh, the knees acting up again. Storm's coming. Get the goats in the barn. I think that really shows your fundamental optimistic nature, Kelly, because you're like, oh, if I get arthritis, there'll be a silver lining. I can predict the weather. You know, life is easier when you try to see the silver lining. That's wonderful. But our audience had great
Starting point is 00:11:35 answers and they were, you know, a lot of them said, you know, exactly the right thing, which is you've got to have data. Those are the observations and you feed them into computers. Yeah, essentially. And that's the big picture. Not just of weather prediction, but any kind of prediction. There are two fundamental ingredients to how you make a prediction. There's the models and then there's the data. So let's take those each in turn. When we say the models, we mean like we're running a computer simulation or you're calculating things on paper. Fundamentally, this is encoding the rules of the system, what the future can be given what the past was. And this doesn't have to be some really complicated thing like the weather over Istanbul.
Starting point is 00:12:16 Think about a much simpler situation, like you're tossing a ball in your backyard. You want to know where does it go? Well, the laws of physics predict the future, right? This is the model. These are the rules that tell you how the past becomes the future, right? In this case, it's simple. It's a parabola. It flies through the air.
Starting point is 00:12:33 Things to keep in mind here, though, is that a model like this is always approximate. If I use F equals MA and I just account for gravity, ignore air resistance when I'm describing the ball, I'm going to get a quick answer, and it's going to be pretty good. It's not going to be exactly bang on correct. It can't account for everything, all the little wind gusts and the air resistance
Starting point is 00:12:54 and the slight change in humidity, maybe the spin on the ball. My model ignores some details, and that's crucial, right? If I included every single particle in the backyard, I would never get a calculation. So in order to make this tractable, I've got to simplify the problem. I've got to pull out the things that are important and ignore the things I think are unimportant
Starting point is 00:13:12 because I don't think they're going to make a big enough difference in the answer. And this is where the juice is. This is what physics is. Physics is taking the universe and simplifying it into a model that represents the bits you're excited about, the bits you think are interesting and relevant. And then you use those rules and manipulate it. That's your model of the universe and the model gives you an answer. And hopefully, if the model is close enough,
Starting point is 00:13:35 to your description of the universe, the answer you get from the model is similar to the answer in the actual universe. So one thing I think that's amazing is that something as simple as throwing a ball up in the air and then seeing where it lands is something we can't completely model because there's so many complicating things. And now you're talking about weather, which is so much more complicated and requires so many more inputs. And of course, you can update your model.
Starting point is 00:13:58 So, you know, if you threw the ball in the air and you were like, you know what, it's a windy day, I absolutely need to add wind. Now you've learned something. You add wind. And so, you know, it's an iterative process where you keep trying to say what is important and do I need to include it and does it make my predictions better. But I also will note that you put predicting weather under the physics umbrella. You think you guys get to claim weather predictions?
Starting point is 00:14:23 I mean, we're not using economics to predict the weather. What else is in the running for taking credit for predicting the weather? Is it chemistry? I feel like that also is some ecology, you know, like because you're tracking, like... Cow farts or something? No, no. Yeah, it's cow fart play a role, actually. So do you think that Noah has cow farts in their weather prediction models?
Starting point is 00:14:48 I think the climate models do include bovine methane emissions, yes. So not the daily predictions, but the bigger trends, yes, cow farts do help determine the future of our planet. Amazing. I want to go back to the point you made earlier. You're exactly right. that we're always approximating, and not just when we're doing the weather, not just when we're tossing balls, always, every single time, every model is approximation. There's this famous phrase I remember who said it, like, all models are wrong, some of them are useful. Even our description
Starting point is 00:15:18 of like the fundamental particles in the universe as far as we know, these are approximations. Every bit of science we have has boundaries of where it's relevant because there are approximations made when we construct those models. Everything, literally everything. We have no piece of science that isn't an approximation of the universe. Maybe one day we have a theory of everything and it's beautiful and we can do exact calculations on very, very simple situations, but we're not there. We may never be there. And even if we are there, it will be totally impractical for anything useful. Like you couldn't use string theory to predict the path of a hurricane because the complexity would be insane, right? How many strings are you modeling the amount of computation required?
Starting point is 00:16:03 To do it exactly would be impossible. So it's always an approximation. It's just a question of which approximations. And that's where the science comes in, like which ones are important, having a nose for what to approximate and what not to approximate. That's what helps some scientists make more progress than others. Yeah. And I think another thing to just sort of note is that because this is a human endeavor, sometimes you're limited by what you can afford to get data on. You know, like, maybe you do want to know how much cows are farting, but in order to get that data, you would need $70 billion so that farmers could attach sensors to the rear end of every cow. And so, like, you know, sometimes you know there's data you want, but you can't get it because there's not enough money or it's not possible. Maybe one day you can get it.
Starting point is 00:16:47 Maybe those sensors will become cheap. Is $70 billion your, like, fantastical number for some, like, absurd amount of money for a science experiment? Yeah, I guess. Wow. Yeah, what is yours? I guess you're a physicist, so it's going to be like... Well, that's embarrassing because our next project is $100 billion. So we're like already above the Kelly threshold for like absurd amounts of money.
Starting point is 00:17:09 But wait, like, okay, but that's not like your personal project. That's like LHC or like a new particle collider or something, right? Yeah, the new next particle collider budget is about $100 billion. Oh my gosh. Exactly. So more than a planet-wide cowfarth sensor network. Well, you guys better make some really important discoveries with that money. Otherwise, I'm disappointed.
Starting point is 00:17:27 Because I want to know what's happening with the cow farts. But you bring up another point, which is the data. So models are useful. They're a system to tell us how the past becomes the future. But you also need some data so you know which past you had, right? Models describe essentially any possible universe. The rules determine which set of universes we might live in, but the data constrain it. It tells us which past we had.
Starting point is 00:17:53 So the rules tell you how the past becomes the future, but you need to know which past we were in so we know which future will have. So in our ball tossing analogy, there's lots of different ways I could toss a ball. I could toss it high or low or fast or slow or east or west. The rules connect the initial conditions, the data, the past, to the future. But you need to know where did I throw the ball? So if I'm writing a simulation of that ball toss, I got to encode in the laws of physics, but then I need a data point. I need to say the ball was here and it was moving in this direction at this velocity. Then I can predict the future. Without that, it's useless, right?
Starting point is 00:18:29 So you need these two components. You need the models, plus you need the data. And then you need more data. Say I'm predicting the ball toss. I want to check in halfway and say, hey, is my model correct? Does it need an adjustment? A way to improve your modeling is to shorten the prediction time to say, I'm not going to predict the whole path.
Starting point is 00:18:48 I'm going to predict the second, and then I'm going to take a measurement. And if it's off, I'm going to correct it so that if my model has veered off from reality, it doesn't get further off. And so the more data you have, the better your model is going to be. So you need these two elements dancing together, the models and the data. Yeah, and I checked my weather app today, and the prediction for tomorrow was changed. And so I'm guessing we do the same thing with weather. We update.
Starting point is 00:19:13 So I think we should talk in a second about what kinds of data we collect to help us inform models. But I guess my first question is, so we've talked about models in general, how long have we been trying to model weather? Aristotle probably. So people have had some crazy ideas about the weather for thousands of years. The first real weather models were conceived of in the 1920s. And remember, we didn't have computers, really, until the 50s or so. So this was like a conception. And somebody did a proof of principle prediction.
Starting point is 00:19:45 They tried to predict the weather six hours later. They took a bunch of measurements and said, let's try to do some calculations. We have an early model. That calculation took six weeks. So not helpful. Not helpful, exactly. But they did it and it wasn't terrible. And they sort of proved like, hey, you know, if you could do this calculation more quickly,
Starting point is 00:20:04 then maybe you could even know the weather in advance. Oh my gosh, what an idea, right? Yeah. It wasn't until the 1950s that we had the first computing models to do these calculations so we can make predictions in time shorter than the prediction period. You could have enough data and run your model and get an answer before the universe revealed it. Right? That's a prediction instead of a post-diction. That's better.
Starting point is 00:20:29 So we've been doing this for decades. And the last, you know, 70 years or so have been improving the models and improving the data. Man, it's exciting to think that we, you know, we're going from slide rules to make these predictions to massive supercomputers. I'm appreciating my weather apps a bit more. And also, like, six weeks sounds ridiculous. I don't know that I could do that in six weeks. Oh, yeah. It's an amazing calculation.
Starting point is 00:20:54 think about, like, not just the ideas, but all the grunt work are doing all those calculations and the human error that's possible. Like, it's amazing they did it in six weeks, you know. So don't laugh at that. Absolutely. So we've been doing this since the 1950s. Let's talk about what kind of data we're collecting to inform these models when we get back from the break. Hi, Kyle. Could you draw up a quick document with a little bit of a quick document with a the basic business plan, just one page as a Google Doc, and send me the link. Thanks. Hey, just finished drawing up that quick one-page business plan for you. Here's the link. But there was no link. There was no business plan. It's not his fault. I hadn't programmed Kyle
Starting point is 00:21:39 to be able to do that yet. My name is Evan Ratliff. I decided to create Kyle, my AI co-founder, after hearing a lot of stuff like this from OpenAI CEO Sam Aldman. There's this betting pool for the first year that there's a one-person billion dollar company, which would have been like unimaginable without AI and now will happen. I got to thinking, could I be that one person? I'd made AI agents before for my award-winning podcast, Shell Game. This season on Shell Game, I'm trying to build a real company with a real product run by fake people. Oh, hey, Evan. Good to have you join us.
Starting point is 00:22:11 I found some really interesting data on adoption rates for AI agents and small to medium businesses. Listen to Shell Game on the IHeart Radio app or wherever you get your podcasts. I'm Robert Smith, and this is Jacob Goldstein, and we used to host a show called Planet Money. And now we're back making this new podcast called Business History about the best ideas and people and businesses in history. And some of the worst people, horrible ideas and destructive companies in the history of business. Having a genius idea without a need for it is nothing. It's like not having it at all. It's a very simple, elegant lesson.
Starting point is 00:22:50 Make something people want. First episode, how Southwest Airlines use cheap seats and free whiskey to fight its way into the airline business. The most Texas story ever. There's a lot of mavericks in that story. We're going to have mavericks on the show. We're going to have plenty of robber barons. So many robber barons. And you know what?
Starting point is 00:23:07 They're not all bad. And we'll talk about some of the classic great moments of famous business geniuses, along with some of the darker moments that often get overlooked. Like Thomas Edison and the electric chair. Listen to business history on the IHeart radio app, Apple Podcasts, or wherever. You get it, your podcast. For 25 years, I've explored what it means to heal, not just for myself, but alongside others. I'm Mike Delarocha.
Starting point is 00:23:35 This is Sacred Lessons, a space for reflection, growth, and collective healing. What do you tell men that are hurting right now? Everything's going to be okay on the other side, you know, just push through it. And, you know, ironically, the root of the word spirit is breath. Wow. Which is why one of the most revolutionary acts that we can do as people just breathe. Next to the wound is their gifts. You can't even find your gifts unless you go through the wound.
Starting point is 00:24:04 That's the hard thing. You think, well, I'm going to get my gifts. I don't want to go through all that. You've got to go through the wounds you're laughing. Listening to other people's near-death experiences, and it's all they say. In conclusion, love is the answer. Listen to sacred lessons as part of the Maikutura podcast network, available on the iHeart radio app, Apple Podcasts, or wherever you get your podcast.
Starting point is 00:24:26 Hi, I'm Radhdi Dvlukaya, and I am the host of a really good cry podcast. This week, I am joined by Anna Runkle, also known as the crappy childhood fairy, a creator, teacher, and guide helping people heal from the lasting emotional wounds of unsafe or chaotic childhoods. We talk about how the things we went through when we were younger can still show up in our adult lives, in our relationships, our reactions, even in the way we feel in our own bodies. And Anna opens up about her own story,
Starting point is 00:24:52 what helped her notice the patterns she was stuck in and how she slowly started teaching her body that it is safe now. So when I got attacked, it was very random. Four guys jumped out of a car and just started beating me and my friend. And they broke my jaw on my teeth. I was unconscious.
Starting point is 00:25:07 Then I woke up and I screamed. And I screamed because even though I didn't know who I was or where I was, something in me was just like, hold on, wait, they could kill me and I'm not going to let that happen. I'm not going to let that happen. I'm going to get through this, and I did. Listen to a really good cry on the Iheart radio app, Apple Podcasts, or wherever you get your podcast. All right, and we are back. So now we're going to talk about the kinds of data that we use to make weather predictions. And I'm going to bet it involves satellites.
Starting point is 00:25:47 Always going with space first, right? Yep, yep. It does involve satellites, but there's an amazing, incredible variety of data sources we have to understand the weather. And yet still, it's not nearly enough, right? As you'll hear, our weather prediction would be so much better if we had more data. We're really limited by the data. But we have lots of different kinds.
Starting point is 00:26:08 We have weather stations on the surface, and so a lot of these are called, like, automatic weather stations that are scattered across the country. They're just basically a bunch of sensors with a battery. and like either a wind turbine or a solar panel to get power. And they measure things like temperature and pressure and wind speed and, you know, precipitation. Just the raw measurements you need to know like what's going on out there. What is the state of the weather right now? Because again, if you want to predict the future weather, you've got to know what's going on right now.
Starting point is 00:26:40 So is this like a citizen science thing where like I could purchase one of these weather stations and hook it in to what's happening at like the national level? Yes and no. So there are a few sort of official stations. There's a bunch of different networks. The highest quality ones, there's like 10,000 of these scattered around the earth and they're operated by weather services and government agencies. But there's a bigger network of like quarter million of these things. Some of these are personal weather stations that, yeah, people just build and publish the data. And there's an amazing network. It's called Cocoa-R-R-A-H-S, community, collaborative, rain, hail, and science. know. Wow. Okay. You can just like build your own device and add it to the network and contribute. And I think that's super awesome because it's definitely limited by the data we have. One problem is that these things tend to be where the people are. Like we have a few, you know, top of Mount Washington or whatever, but mostly these things are put up by people where people are near. And so like there's lots in India, for example, but very few across Siberia. And often the best ones are places like airports.
Starting point is 00:27:47 Airports really need to know weather, so they have excellent weather stations. But like the weather at LaGuardia is not the same as the weather in Manhattan. And so often the airport weather stations are very, very precise and used heavily in the models, but they're not giving you the measurements exactly where you want them to be. Okay, so is that a problem for just the people who are in areas where there's not enough weather detectors? Or is that a problem for all of us? because what's happening in Siberia is important to what's happening in India. Yeah, what happens in Siberia doesn't stay in Siberia, unfortunately.
Starting point is 00:28:20 Oh, man. It contributes to uncertainty and error across the model, and the Earth is one big system, which is why you can't just be like, I'm only going to predict the weather in Manhattan. I only need to think about Manhattan. You need to model the whole planet in order to get the weather in Manhattan. So, yeah, absolutely. And that's why we have lots of different kinds of sensors, not just these automatic weather stations. We also have things like weather radar, and you might have seen these on your local weather
Starting point is 00:28:46 channel, like, let's look at the Doppler. This measure of precipitation. It also measures the velocity of those raindrops. And this is a really cool story because it comes out of World War II. It's another example of, like, reusing military technology and infrastructure after World War II to do some science. Thank you, war. Ooh, boy. Hot take.
Starting point is 00:29:07 Pulling it back. Well, there you are again, finding the silver lining. Tens of millions of people died, but we have better weather predictions. So the way radar works is that it sends these pulses of microwave radiation. The wavelengths are like 1 to 10 centimeters. That's the microwave region. And it sends a pulse for like a microsecond. And then it listens for return signals.
Starting point is 00:29:30 So like it sends this pulse and rainjobs will reflect. So it gets a signal back. And it listens for like a few milliseconds and then it sends another pulse. And so it can tell where the. clouds are, and it can tell the velocity of those clouds by the change in frequency. This is the Doppler effect, right? And this is exactly the same effect as like stars are moving away from you, so their light is red shifted. When the radar pulse comes back, if the frequency is shifted, you can tell which direction that raindrop is moving. So that sounds complicated because
Starting point is 00:30:03 like there's not just one raindrop out there. There's a bunch. And so I can imagine like your pulse getting lost as it bounces off of multiple raindrops and doesn't make it back to you. What am I missing? This sounds hard. No, it is hard, but you're not detecting individual raindrops. You're detecting clouds, mostly, like, which direction is this cloud going? And, you know, initially, this was a problem because in World War II, radar operators were trying to use radar to discover, like, enemy planes, and they noticed, like, man, clouds are getting
Starting point is 00:30:30 in the way. And then other folks were like, oh, wait, you can use radar to see clouds? Awesome. And so. And so then after. World War II, they started using this to measure the velocity of clouds and to see them. And there was this moment in like 1961 when Hurricane Carla was approaching the coast of Texas. And Dan Rather went down there to a weather station and they were using radar to see the clouds
Starting point is 00:30:54 and to see their direction. And he had them drawn like the coast of Texas over this image of the hurricane that showed everybody like, wow, this is a massive hurricane moving fast towards the shore and probably saved thousands of lives because he publicized this like incoming. storm much more rapidly than we could otherwise without this kind of technology. Wow. So this, yeah, this weather radar is really helpful. Do you think it still has the same effect, or do you think people are just kind of like,
Starting point is 00:31:19 oh, there's hurricanes, I've seen them before, they get big, and they don't always leave. People don't always leave. There's always somebody who's going to ride out the storm, right? Yeah, and I don't know with the psychology there, but at least now we can inform people further in advance and let them know where these things are likely to go. But there's still always uncertainty, and we'll talk about that in a minute. you don't just have one weather prediction, you have an ensemble, you have an envelope of predictions because you don't have perfect data and you don't have a perfect model. And so often what you do
Starting point is 00:31:48 is you vary your data a little bit within the uncertainties and run the model again, and then you get a different prediction, and it'll give you a sense of the spread of the possible outcomes. So you might see when there's like a hurricane approaching the coast of Florida, they have a bunch of possible trajectories. Those are all like different runs of the weather model, assuming different initial conditions because we have uncertainty. We don't have perfect data. I personally really enjoy learning about the uncertainty like in life in general. And whenever I look at those, I have this weird feeling of like security. Like they figured it out and they know what the errors are. We're good. We know what to avoid. Maybe that's maybe that's a little bit giving it a little too much credit,
Starting point is 00:32:28 but it's still amazing. Another really important source of uncertainty in our models is what's happening in the ocean. Like how hot is it? How cold is it? How cold is it? how are things circulating all this kind of stuff. And so we need data about the ocean, but not a lot of people live in the ocean, so we don't have like these automatic weather stations, but we do have buoys. These are like floating weather stations. And around the world, there's a couple of thousand of these depending on the type that have these like temperature sensors on the surface.
Starting point is 00:32:57 But we also have this hilarious data from what's going on deeper in the ocean that historically has come from people on ships. taking a bucket, dropping it into the ocean, pulling it up, and then measuring the temperature of the water. And it's like really that lo-fi. But for many years, that's all we had. We had like no other way reliably to know how cold is it in the ocean. And this is an example of like, it's not just data. You need to take data and interpret it and clean it and correct it. And I spoke to an expert here at UCI, Jane Baldwin, who told me that like, you had to correct for like how long the bucket was out of the water before they dunked the thermometer in it and how Japanese ships and
Starting point is 00:33:40 U.S. ships use a different bucket and it had different effects. And like, you got to really know you've got to be an expert in how this data was taken at what it really means. Yeah. So for a while, I was doing some water quality work and we had this like tube and you would put the tube underwater and then you'd sort of press a button and like caps would pop into place on both sides of the tube. And then you could lift it up. And so you could get a water sample from specifically different depths. And it It was always kind of fun to use that device. Yeah. And you might think, like, that's ridiculous.
Starting point is 00:34:09 What a silly system. And it's a little bit silly. But if it's the only data you have, it's better than no data. Yeah. Right? As long as you understand the uncertainties in it. And my friend Jane was telling me that misunderstanding this data might be a cause for some weird pauses and global warming trends. That it could just be like a misinterpretation of this ship bucket dunk data.
Starting point is 00:34:30 Oh, no. I know. We're so low five. It's amazing. These days we have these cool robotic floats that float on the surface of the ocean and then dive down up to 2,000 meters, measure things down in the ocean, and then come back up and beam it to satellites or whatever. So we're getting better, obviously. But, you know, what's really valuable is longitudinal data. Like, you want data as far back as you can so you can understand bigger trends.
Starting point is 00:34:57 So you can't just, like, say, oh, that ship bucket dunk data is ridiculous. Let's ignore it. It's the only data you have for like 30 years. And so trends in that data do tell you something. Very cool. Okay, so now we've gone down deep. How do we get data from up high? Yeah, because the weather's not just at the surface, right?
Starting point is 00:35:14 And the weather folks call the surface the two meter level because they want to measure the temperature, not on the ground, literally, but like two meters up, like where your head is, essentially. But they also need to know what's going on even further. So we take measurements in the upper atmosphere. We use weather balloons. And these are literally what you imagine. You put like a bunch of helium in a balloon and you put a weather station on it that can measure altitude, pressure, temperature, humidity, wind speed, etc. And you just let it go and it rises because helium rises. And as it goes up, the balloon expands because the pressure in the upper atmosphere is less.
Starting point is 00:35:49 And eventually it pops and then the thing comes back down. So these are like one-time uses. And they can go up like 20 kilometers. When I visited St. Catherine's University in Minnesota to give a talk, they, They had a special day where they launched a weather balloon, like, you know, for my visit and, you know, did a demonstration for all the students. And it was the coolest thing ever. It was awesome, right? These are amazing experiments.
Starting point is 00:36:15 And I know people who do physics experiments on balloons where they, like, go to the Antarctic, and they let up a balloon and it floats in the atmosphere for, like, up to a month or something. And, like, that's really brave work. Because you spent, like, four years building this instrument, and then you're putting it on a balloon and sending to the atmosphere. And sometimes it's just gone. Like, it just disappears and you lose your whole thesis. And this seems like kind of bespoke, right? And it is. There's like a couple hundred launches per day in the United States.
Starting point is 00:36:43 But it's not reliable. It's not like the place you visited. They do exactly the same balloon launch every single day at the same time, right? Which is the most useful thing for a weather model is like reliable data. And we don't have a lot of them. But again, this helps you probe the upper atmosphere. We don't have many ways to measure the temperature in the upper atmosphere. sphere. This is a really powerful one. Do we also use planes? We do use planes because every airplane
Starting point is 00:37:07 you've been on has really valuable information about weather because it samples from the two meter level up to like 30,000 feet. And aircraft, of course, have sensors to measure wind speed and temperature and all this kind of stuff. So every commercial airplane has these sensors, collects this data, and then sells it to the government. Noah buys this data because there's so many flights. Like, look at a map of airplane flights for a single day in the United States. There are so many flights. They crisscross the country. And it's incredibly valuable data. And this is usually very high quality data because it's very important for these planes to understand the weather. I had no idea. Noah was getting access to all of that data. That's super cool. It's super cool.
Starting point is 00:37:49 Basically, any way you can imagine to learn the state of the weather somewhere on Earth, somebody's doing it because the more data we have, the better these models get. But then, of course, we can go all the way up to space, right? Because there are places where there are no automatic weather stations and there are no buoys and there are no airplane flights, yet they still contribute to the weather prediction in Kansas or in Mexico City or whatever. And so we have satellites. And since about 1979, we've had weather satellites. We of course had satellites earlier than that, but none devoted to like gathering weather data. And these primarily cover things like storm systems in cloud patterns. They can tell you where the snow is. They can also tell you like where wildfires are,
Starting point is 00:38:31 which is an important part of the weather. Oh, yeah. And so they can't directly measure like, what is the temperature in Houston right now? But they can make indirect measurements. Like, for example, they can measure the amount of infrared radiation from the surface and that is connected to the temperature, but it's actually connected to the temperature of the surface, not the two meter level. Oh. Right. So like how hot is the blacktop in Houston right? right now, that's what your satellite is telling you. And you have to use that to infer how hot is it two meters above the blacktop in Houston, which is what you actually want to know.
Starting point is 00:39:05 That sounds hard. It's hard. Yeah, exactly. And so we also don't have a lot of satellites because they're expensive. There's something like 20 satellites, a mixture between geostationary and polar orbits. Eight of them are operated by NOAA, but there's a bunch out there. But my friend the climate scientist says that we might be on the verge of having a lot more data because launching stuff in the space is cheaper, and now we can do like small satellites, cube sets. These might give us more data, but not as high quality as like the dedicated, you know, super nerd designed billion-dollar satellites. On the other hand, we don't know what the future holds for like
Starting point is 00:39:42 supporting and operating these satellites. This requires money to fund these things and have people interpreting these things. We don't know how long the government is going to continue to support it. They could just like unfund this stuff for it, turn off weather stations. Oh, my gosh. And, you know, it's more than just like, oh, we turned it off for a year. Having continuous records is super important for these models for predicting the immediate weather, but also for the long-term climate models, which are essentially an average of the weather. And so even turning it off briefly could be very damaging for our ability to do long-term predictions. And I'm kind of blown away by the fact that we only have 20 satellites.
Starting point is 00:40:20 I guess I had assumed since, you know, there's like 5,000 satellites up there or something. I guess most of them are dedicated to, like, beaming. cat videos to us from anywhere in the world. But like, weather seems so important, you know, for farmers, for like people who are traveling, just like for everything. Yeah, that's true. But the satellites don't give you a direct measurement of what you're most interested in. They're essentially like really good for filling in the gaps for places where you have no other measurements. So yeah, it would be great. But they're also super expensive. So you'll hear at the end, I asked one of the climate scientists I spoke to like, if you had a billion dollars, what would you
Starting point is 00:40:53 spend it on? And satellites is not their top priority. Okay. All right. So maybe 20 is the right number. So you have all these different kinds of data. You have automatic weather stations. You have radar. You have buoys. You have ship bucket data. You have weather balloons, aircraft. You have satellites. What you need for your model are the initial conditions. What you need for your model is a set of what is the temperature and the pressure and the humidity everywhere on the planet right now so that I can run it and predict it in the future. And there's not a trivial step from like, here I have all this data. to what are the initial conditions? Because the data can disagree, right? You have multiple measurements sometimes nearby using different kinds of sensors. How do you incorporate that?
Starting point is 00:41:36 How do you clean this data? How do you decide what to use? How do you merge all of this into your best prediction? And so there's a lot of work in this area. It's called data assimilation of running sort of mini models, fluid dynamics to do like physics-informed interpolations between the places where you don't have measurements and to factor in the various
Starting point is 00:41:56 various uncertainties from the various different kinds of measurements. So sometimes you back up the model a little bit and feed in some data and then use it to predict the current initial conditions before you go to your full model. And then you do what we talked about earlier, which is ensemble. And you say, well, here's my best guess for the weather like right now before we even run the model. But I'm going to make like a hundred versions of it. And each one, I'm going to tweak my assumptions a little bit so I get an envelope where I hope reality somehow is described by one of these models or near one of these models or the spread in these models describes my uncertainty in the state of the initial conditions. We haven't even
Starting point is 00:42:34 done any predictions yet. This is just like measuring what's happening now, right? And what's so stressful for me to thinking about this is like your data are coming in constantly. And so it's not like you do this once and then you're like, okay, good. Now we will project. It's like every second more data are coming in. So this has to be like a constant process that's happening over and over again and integrating the information into bigger models and it's amazing exactly and yeah we haven't even talked about how the models work and so let's take a break and when we get back we'll talk about how those models work hi kyle could you draw up a quick document with the basic business plan just one page as a google doc and send me the link thanks hey just finished drawing up that
Starting point is 00:43:22 quick one-page business plan for you. Here's the link. But there was no link. There was no business plan. It's not his fault. I hadn't programmed Kyle to be able to do that yet. My name is Evan Ratliff. I decided to create Kyle, my AI co-founder, after hearing a lot of stuff like this from OpenAI CEO Sam Aldman. There's this betting pool for the first year that there's a one-person billion dollar company, which would have been like unimaginable without AI and now will happen. I got to thinking, could I be that one person? I'd made AI agents before for my award-winning podcast, Shell Game. This season on Shell Game, I'm trying to build a real company
Starting point is 00:43:58 with a real product run by fake people. Oh, hey, Evan. Good to have you join us. I found some really interesting data on adoption rates for AI agents and small to medium businesses. Listen to Shell Game on the IHeart Radio app or wherever you get your podcasts. I'm Robert Smith, and this is Jacob Goldstein,
Starting point is 00:44:17 and we used to host a show called Planet Money. And now we're back making this new podcast called Business History about the best ideas and people and businesses in history. And some of the worst people, horrible ideas and destructive companies in the history of business. Having a genius idea without a need for it is nothing. It's like not having it at all. It's a very simple, elegant lesson. Make something people want. First episode, How Southwest Airlines Use Cheap Seats and Free Whiskey to, to fight its way into the airline business. The most Texas story ever.
Starting point is 00:44:53 There's a lot of mavericks in that story. We're going to have mavericks on the show. We're going to have plenty of robber barons. So many robber barons. And you know what? They're not all bad. And we'll talk about some of the classic great moments of famous business geniuses, along with some of the darker moments that often get overlooked.
Starting point is 00:45:07 Like Thomas Edison and the electric chair. Listen to business history on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. For 25 years, I've explored what it means to heal, not just for myself, but alongside others. I'm Mike De La Rocha. This is Sacred Lessons, a space for reflection, growth, and collective healing. What do you tell men that are hurting right now? Everything's going to be okay on the other side, you know, just push through it.
Starting point is 00:45:40 And, you know, ironically, the root of the word spirit is breath. Wow. Which is why one of the most revolutionary acts that we can do as people just breathe. Next to the wound is their gifts. You can't even find your gifts unless you go through the wound. That's the hard thing. You think, well, I'm going to get my gifts. I don't want to go through all that.
Starting point is 00:46:00 You've got to go through the wounds you're laughing. Listening to other people's near-death experiences, and it's all they say. In conclusion, love is the answer. Listen to sacred lessons as part of the Maikultura podcast network, available on the iHeart Radio app, Apple Podcast, or wherever you get your podcast. Hi, I'm Radhid Dvluca, and I am the host of a really good cry podcast. This week, I am joined by Anna Runkle, also known as the crappy childhood fairy,
Starting point is 00:46:27 a creator, teacher, and guide helping people heal from the lasting emotional wounds of unsafe or chaotic childhoods. We talk about how the things we went through when we were younger can still show up in our adult lives, in our relationships, our reactions, even in the way we feel in our own bodies. And Anna opens up about her own story, what helped her know. noticed the patterns she was stuck in and how she slowly started teaching her body that it is safe now. So when I got attacked, it was very random.
Starting point is 00:46:53 Four guys jumped out of a car and just started beating me and my friend. And they broke my jaw on my teeth. I was unconscious. Then I woke up and I screamed. And I screamed because even though I didn't know who I was or where I was, something in me was just like, hold on, wait, they could kill me and I'm not going to let that happen. I'm not going to let that happen. I'm going to get through this and I did.
Starting point is 00:47:13 Listen to a really good cry on the IHeart Radio app, Apple Podcasts, or wherever you get your podcast. All right. So now we have all of this data and you've got it into an ensemble and you sort of maybe know what's happening right now, plus some uncertainty. How do you now predict what's going to happen next? Yeah, so simple. You just break out your pencil and paper and you do a bunch of. string theory calculations and that's it right it's just like physics it into the future finally string theory is useful yeah unfortunately not um as we said earlier like you can't describe everything you have to make assumptions about what you're going to calculate and what you're going to simplify otherwise you're never going to be able to make a prediction right or your predictions are
Starting point is 00:48:04 going to be done in a thousand years for the weather that's happening in an hour and that's not useful and so it's always a question of how to judiciously make those assumptions So the current state of the art for weather modeling has basically two big pieces. One is directly model the atmosphere itself as if it's a big fluid. So you use like Navier-Stokes equations and think about how it flows and how temperature moves through it. That's the like dynamical core of the model. But there's a bunch of stuff that influences the atmosphere that you don't explicitly include in the model. The clouds, the convection, the ocean, the radiation, the surface temperature, all this.
Starting point is 00:48:43 kind of stuff. Your model doesn't explicitly include that stuff. We don't have like a complete model of the ocean or the clouds, et cetera. And so we have like various inputs to this core piece that they call parameterizations that like capture the big picture effects of all these pieces that are not included directly in our model, but are influencing us. So I feel I, this is a question where you think to yourself, am I about to ask a really stupid question? But I'm going to move forward because that's my job in this podcast. The atmosphere is not a fluid, though, right? And so, like, am I wrong about, so why, why are we doing, are we modeling it as a fluid because we just can't model it as something else because it's too complicated and fluids are a simplification?
Starting point is 00:49:31 Or, Daniel, I don't think the atmosphere is a fluid. Well, it depends on what you mean by a fluid. And, you know, when it comes to like how things flow and pressure, et cetera, the fluid dynamic equations do describe the atmosphere. And so, you know, fluid doesn't mean liquid, right? Fluid is about how things flow and move, right? So, for example, like the mantle of the earth is a fluid. It flows. It's not a liquid, right? It's this weird, solidy kind of state and it moves, but it also flows. And so you can describe it, and it has convection. You can describe it with fluid equations. And so the Navier-Stokes equations are these famous equations that describe fluid dynamics, and they're pretty good at modeling the atmosphere.
Starting point is 00:50:16 They're not perfect, right? They're not perfect, but they're pretty good at it. So, yeah, I think fluid is not a liquid. It's just things that flow. Okay. In my head, fluid is synonymous with liquid, and so I have learned something today that will probably help me not look silly in the future. That's great.
Starting point is 00:50:31 No, it was a great question. And so this is the big picture. You have the dynamical core, and then you have these parameterizations, and we'll dig into that. And we'll describe sort of the U.S. approach to it, but there are three sort of major weather communities. There's the U.S., the U.K. and the Japanese. And they have slightly different approaches, which is good because, you know, different predictions can cross-check each other. But then some people think it's bad because, hey, let's pool all of our resources
Starting point is 00:50:57 and make one big global model. And that's awesome. But then you only have the one and you're not sure maybe it's all wrong. There's a lot of debate about, you know, how to deal with global questions and global resources. But who's the best? Oh, I'll give you a ranking at the Okay. All right. So the dynamical core, right, think of the atmosphere. We're going to treat the atmosphere basically like a spherical cow, right? It is a spherical fluid, right? I guess this is physics. Yeah, it's a thin shell around the earth and you know the temperature and the pressure, and then you can describe how it's going to flow, how the temperature and pressure are going to change using the Navier-Stokes equation. So Navier-Stokes is a set of really gnarly equations. They're non-linear, partial. differential equations. A differential equation is one where, like, the value depends on how quickly it's changing. For example, like in ecology, you have differential equations that describe like predator and prey, right? These two things are coupled. And so these are nonlinear, partial differential equations, which means, like, that depends on things squared or cubed.
Starting point is 00:52:03 All that to say, they're very, very difficult to solve. In fact, differential equations in general are hard to solve. If you've taken a differential equations class, it's basically like differential equations are not solvable except for these four examples that we have answers to and we know how to solve them and so you just got to memorize those it's a little bit like chemistry i got to say oh no it's mostly unsolved right and the navvia stokes equations we've known about them for like 200 years they were initially developed to try to answer these questions about like how do things flow and how does momentum and mass flow through pipes etc essentially people took Newton's second law, F equals M.A, and applied it to fluids and then added terms for like stress
Starting point is 00:52:45 and pressure and viscosity. And it's like a real triumph that we can describe this at all. But calculationally, it's a real bear. You can't like sit down and derive a solution and say, here's my pressure and temperature. Let me crunch it through the Navivostok's equation. It's going to give me a formula. It's all numerical approximations, which means it takes a lot of computing to go from now to one second from now or two seconds from now. And that computing means approximating things. You're like doing numerical derivatives instead of exact analytical derivatives. Okay. So some of that got pretty complicated. But what I guess what I want to know is when this is all done, I feel like if we are trying to model fluids, does this just tell us that like the wind is now over here going this fast,
Starting point is 00:53:30 but before it was over there? And how many are we going to get to like how you get from that to like and it's raining? because that seems like a different problem, sort of, that how fluid is moving around. Yeah, so there's a couple of things to know there. You're exactly right. It takes the current conditions and tries to predict the future conditions, and those conditions are pressure and temperature,
Starting point is 00:53:48 wind speed, humidity, right? These kinds of things. But because we're solving this numerically, we can't solve it everywhere. If you have a formula, an analytic description, you can write down for, like, where is my ball as I've thrown it?
Starting point is 00:54:02 I can write that down on a piece of paper. I have a formula that can tell you where the ball is at any point in time. You ask me any point, literally any value of T, I could plug it into my formula, I give you an answer. But if I don't have a formula that's called an analytic description, if all I have is a numerical estimate, then I've made a grid. I've said, I'm going to sample it at time one, time two, time three, time four. I'm going to make an estimate of those times. And I don't have an answer everywhere. And that's the situation we have with weather, is that they put a grid on the planet
Starting point is 00:54:30 and they estimate what's going to be the weather temperature, et cetera, in a grid of points, not everywhere over the planet. And you might think, oh, I bet that grid's pretty small, right? Maybe they measure it down to the centimeter or something. No, the grid sizes are like 10 kilometer cubes. What? Yes. That's too big.
Starting point is 00:54:49 It's too big, right? They are averaging the temperature and the humidity over cubes of atmosphere, 10 kilometers on a side. It's crazy. And you might think that's way too big. On the other hand, that's still a lot of cubes, right? Like the atmosphere is a lot of 10 kilometer size cubes. And then the time steps are tens of minutes.
Starting point is 00:55:10 Okay. Right. And this is awesome that we can even do this. It requires massive supercomputers we'll talk about it in a minute. But the problem is that it ignores a lot of little details, like how big is a cloud? Usually they're like a kilometer or less. And so you're missing out on a lot of stuff by making your grid. Anything that happens that's subgrid, that's crucial and important, but is small than the size of your grid, is not being described by your grid.
Starting point is 00:55:36 model. But your question was like, is this directly outputting like, hey, it's going to rain on Kelly's picnic? In a sense, yes, the direct outputs are things like temperature, pressure, humidity, and those are enough to tell you like, okay, it's going to rain because the pressure and the humidity are above some threshold or whatever. So it's not directly outputting like three centimeters of snow. There's another step you have to take after that, but it feeds into that. So those are the inputs you need to the next step, which says how much snow is going to fall. Okay. So let me see if I can do a super simplified version of this. You get all of the data that you have about a square in the grid and you do the best job you can to sort of summarize it and ensemble it. And then you put it in the model. The model runs through the equations. Then does the information from the surrounding grids feed into your grid as well? Because you would, okay, because you would expect there to be similarities between closely related squares in the grid. Yeah, you can't solve one grid at a time. You have to solve one grid at a time. You have to solve.
Starting point is 00:56:34 all the grids, right? Because the grids touch each other and influence each other and wind flows, right? Right. And that's why Siberia affects Manhattan over time because you've propagated these things from grid cell to grid cell, absolutely. So does Siberia have bigger grid cells or just the same number of small grid cells, each with poorer data in them? Yeah, great question. So some of these models are adaptive, right? They have bigger grid cells where you have more uncertainty and smaller where you have more data. The most precise ones, are the UK supercomputers that go down to two kilometers
Starting point is 00:57:07 in some cases. Some of them are like fixed grids and some of them are adaptive. Exactly. It depends a little bit on the model. But there's lots of details that are not described here. And these are called the parameterizations,
Starting point is 00:57:20 like especially subgrid stuff and exchanges with other parts of the system. They're not just the fluid. And one important thing are the clouds. You cannot model every individual cloud because clouds are smaller than your grid size. We do not have the compute to do that. have tried, and you can do dedicated runs on subsets to try to resolve clouds, but then you
Starting point is 00:57:40 don't have enough computing to do, like, ensemble. So you make one prediction. You're like, well, here's a prediction, but I don't know what the uncertainties are on it at all. And so instead, what you tend to do is parameterize the bulk outcomes, you know, the vapor, the clouds, the liquid, the ice, the rain, the snow, et cetera, the condensation, all this kind of stuff. You try to, like, grab all of that average over what's happening in that grid cell. and use that to inform your Navier-Stokes equation. So things you're not explicitly modeling, you're sort of like averaging over.
Starting point is 00:58:11 You're losing all the details and saying like, well, on average, this is going to be the effect of clouds on my grid cell. And do you think that as, oh, well, I was going to say, do you think that as we continue to have more and more computing power and more and more supercomputers at some point we'll be doing better here? But we were just talking about how Moore's law we've maybe hit the end of that. So are we like, is this as good as we're going to get at it? This is probably an end of the podcast question, but I'm thinking it right now.
Starting point is 00:58:40 No, I think that there's lots of possibilities for making this faster and more efficient and not just wait till computers get faster. There's definitely clever ideas and we'll get there, yeah. But there are lots of parts of the weather that are not directly described in the dynamical core, so not just the clouds, but also things like convection, like vertical transport of heat, you know, especially there's this complex boundary mixing near the surface, like the lowest kilometer or so of the atmosphere, where you have like heat from the surface and turbulent momentum exchanges as wind is like hitting mountains and stuff. These things, you can't model all of those
Starting point is 00:59:17 details. And so you have like parametization schemes that model the turbulence and the boundary level mixings. There's radiation from the surface also, right, that changes from day to night. You have models of vegetation and snow, how those things couple. But then the biggest one is the ocean, right? Like, we would love for our models to include also a Navaristoc simulation of the whole ocean, right? Might as well do that, because the ocean plays a big role. But we don't have the compute for that at all. So we just like use a slab ocean model. We just say, let's just assume the ocean is like simple and we have a certain temperature and we assume like how the energy transfers from the boundaries, and it's really quite simplified, but that's, we're just limited, right?
Starting point is 01:00:04 We don't have great data in the ocean, and we don't have the compute to also model the ocean as well as the atmosphere. So places where we don't do our best approximations, which is like Navier-Stokes-Equations of the atmosphere, we have simplified versions, which are called parameterization, says, feed in to the core. But in the end, you've got to take it to the computers, and this is why we have, like, massive supercomputers to make weather predictions. So Noah in the U.S. has a couple of really big facilities. They're called Dogwood and Cactus. One of them is in Virginia. You're welcome, everyone. And one of them is in Arizona. And they're huge, amazing computers. Those two have like 12.1 petaflops. You made that word up. It sounds like a made up
Starting point is 01:00:47 word. Peta means quadrillion and flops are floating point operations. So, you know, it takes the computer time to add like 3.91 to 14.42. And floating point numbers, those numbers with a dot in them, right, not integers, are more computationally expensive to add or subtract. And that's what most of these models do. They're like, add this number, multiply by this. And so this is like the way you measure the speed of a computer. And so these computers can each do 12.1 quadrillion floating point operations per second. Wow. Right. Imagine the guys back in the 19, 20s, they're like adding two numbers. It probably takes them a minute, right? Or they're super good. It takes them 20 seconds. The computer does 12 quadrillion of these per second, right? So together with all
Starting point is 01:01:37 of their computers, Noah has about 50 petaflops. And that's what it uses to run its model. And so that's the state of the art in the United States. The Europeans have a couple of computers. It's one really big one in Bologna called Bull Sequania and it has about 30 petaflops. But the biggest, most powerful weather computer in the world is in the UK. It's at the Met Office and it's built by Microsoft and it has 60 petaflops. And this is why the UK has some of the best weather prediction in the world. Because they have the biggest computer. They beat us. Yeah, exactly. They just spent more money. They bought more compute. This is literally like money equals computing power. Those tea-drinking bastards.
Starting point is 01:02:20 Oh, day. Yeah. Well, you know, they got tricky weather over there, and so they need it. It's an island after all. Good job, guys, and gals. The Japanese have a big investment in weather prediction computers also. There's one called Prime HBC. It has 31 petaflops.
Starting point is 01:02:37 So these are really powerful devices, and they run these huge models. And, you know, think about what the model does. It predicts the state of the atmosphere on these pretty chunky grids, but it's still, it's a huge amount of data. Like every few minutes, every 10 kilometers, my friend Jane was telling me that sometimes the data is so big that you just throw it away. You run it, you get like a summary number,
Starting point is 01:03:00 but you can't keep all of the data because it would just like fill up all of the hard drives everywhere. And this is familiar for me because like at the LHC, we also, we run these experiments every 25 nanoseconds. We throw away most of the data from that because it would just fill up all of our storage. And they're in a similar situation. They produce more data than they can store.
Starting point is 01:03:19 So are these facilities where the Navier-Stokes equations are being run? Or are these facilities where you have the output from each grid, and now you are translating that into information about where the rain is falling? Both, yeah. Okay. So these programs do the data simulation, come up with the current initial conditions, and then also run the model forward to make those predictions, and from that gleaned things like weather details, snowfall, et cetera.
Starting point is 01:03:50 And so what you're getting on your phone, what you're hearing on TV, is not just like what Jane, your local forecaster, came up with. She's relying heavily on these central predictions from major resources. So, for example, if worldwide governments decide, we don't need these computers anymore, we don't need these satellites. It's not like you can be like, that's cool. I got my local weather forecaster. I don't need you.
Starting point is 01:04:13 No, your local weather forecaster is. getting that information from these big models that are being run by the government. Oh, wow. Yeah. And did Noah get cuts recently? I'm going to bet they did. There were some talk about cuts. I don't know how much of that is going through.
Starting point is 01:04:28 It's all kind of scary. It's hard to know. Okay. All right. We won't get into that. Moving on. But amazingly, currently, we can pretty accurately predict the weather five to six days in the future. You know, and you mostly remember when the weather prediction is wrong.
Starting point is 01:04:44 you mostly don't realize that most of the time it's right. Yeah. You know, it tells you it's going to rain. It tells you it's going to be said it's mostly correct. It's amazing. But, you know, there's still challenges. Things are not perfect. One of the biggest challenge is just incomplete information.
Starting point is 01:04:59 You know, we don't have sensors in enough places and we don't have enough sensors. And sometimes there's data availability changes. You know, things go offline or come online. Now your model has to compensate for that. I don't have the data. Do I assume it's similar to the past? Do I try to ignore the data? that kind of data, it's not easy to be running a model if the inputs are constantly changing.
Starting point is 01:05:19 The bucket had a hole in it, so now you don't have good bucket data. Exactly, exactly. They got a new kind of bucket. You don't know how to calibrate it. I spoke to John Martin. He's a professor of meteorology, and he said that this might be the biggest challenge is how to combine the data to make a high quality initial state. That's one challenge. The other are these subgrid parametizations. Can we develop better models for turbulent flow at the boundaries or for latent heat release back into the environment. And another limiting factor is just the computing cost. More compute, more GPUs from Nvidia, means smaller grids,
Starting point is 01:05:56 which means the effect of these approximations, these parameterizations, is less. Another continuing challenge are rare and extreme events. Like, we're pretty good at predicting the bigger picture. Like, is it going to be sunny here? Is it going to be rainy here? But like small, rare, extreme events, like there's a tornado right here. That's more challenging because they depend in detail on things that happen within the grid that we're averaging over. And so there's a lot of work being done right now.
Starting point is 01:06:25 One thing we're hoping to do is like, let's reduce the grid size, get more computing, more accurate, right? But another really promising error of research is using machine learning. Oh. There's this movement in many fields of science to use machine learning to make predictions. by essentially skipping the physics. Like, the physics is hard. It takes a lot of time to push the initial conditions through these equations. In the end, you have an input and an output.
Starting point is 01:06:51 And the idea is, well, can we train machine learning, not a chatbot, not LLMs, right? It's AI, but it's not LLMs, to map the initial conditions to the output. Because in the end, it's just a mapping, and one could learn it. And so we have these machine learning models that are simple functions that take the input and give you the output. And they don't have the physics encoded in them, but they learn from the simulations. They learn the patterns. They learn what the rules are implicitly. And so you don't have to go through all the detailed calculations. So this can dramatically speed up your predictions. We use these at the large handrum collider all the time
Starting point is 01:07:29 so that we don't have to, for example, model every single particle that might hit the detector and create another particle and another particle. We can learn to predict the final thing we're interested in and just sort of leapfrog over all the tiny details. And is machine learning being used right now for weather predictions, or they're just starting to work on how you would do that? They're using that now. They're sort of experimental, but there's a guy here at UC Irvine, Mike Pritchard, who's an expert in this kind of stuff.
Starting point is 01:07:54 And it's very powerful, absolutely. Cool. Yeah. So I asked John Martin, if I gave you a billion dollars to improve weather predictions, what would you do? And he said he would spend a billion dollars on ocean probes. Like, he wanted a more substantial understanding of. how water is circulating in the ocean and temperature in the ocean and how that's all working.
Starting point is 01:08:13 Because his suspicion was like, we're right next to this other big fluid that's affecting our temperature and we don't have much enough data about it. We just knew more about the ocean. And this just highlights like how little information we have. It's not just a question of like puzzling out the rules of the universe, but just like knowing what's happening. If we had more data everywhere about temperature pressure, about cosmic rays, we would just learn so much about the universe, and we have so few ways to probe it. We're really just like taking the tiniest teaspoon out of this massive river of data and trying to use that to understand the whole river. It's crazy. How good do you think weather prediction would have to be before people
Starting point is 01:08:53 stopped complaining about weather prediction? I asked John that question, and his prediction was, quote, the complaining will never stop. Amazing. I think that, you know, weather prediction has improved a lot over the last few decades. It used to be you couldn't get any reliable prediction, more than a day in advance. Now, five, six days is pretty reliable. But people expect that and they get used to it. And they're like, what? You didn't predict the weather on my ski trip. In two weeks, I'm mad at you. And so, yeah, the complaining will never stop because we always just get used to the level of technological prowess that we've had. And so people want more because it's so important. And it's a hard problem. There's so much physics here. There's instrumental science. There's so many
Starting point is 01:09:34 different kinds of science and interface with each other. It's really an exciting field. And let me throw a special thanks to Professor Jane Baldwin here at UCI, who told me a lot about weather predictions and Professor John Martin at Wisconsin, who answered a lot of naive questions of mine. Thanks to both of you. Thank you, community. All right, see you all next time. I hope the weather is nice where you are. It always will be nice where I am. Daniel and Kelly's Extraordinary Universe is produced by IHeart Radio. We would love to hear from you. We really would.
Starting point is 01:10:11 We want to know what questions you have about this extraordinary universe. We want to know your thoughts on recent shows, suggestions for future shows. If you contact us, we will get back to you. We really mean it. We answer every message. Email us at questions at daniel and Kelly.org. Or you can find us on social media. We have accounts on X, Instagram, Blue Sky, and on our message.
Starting point is 01:10:34 all of those platforms, you can find us at D and K Universe. Don't be shy. Write to us. I know he has a reputation, but it's going to catch up to him. Gabe Ortiz is a cop. His brother Larry, a mystery Gabe didn't want to solve until it was too late. He was the head of this gang. You're going to push that line for the cause?
Starting point is 01:10:55 Took us under his wing and showed us the game, as they call it. When Larry's killed, Gabe must untangle a dangerous past, one that could destroy. destroy everything he thought he knew. Listen to the Brothers Ortiz on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. Hi, Kyle. Could you draw up a quick document with the basic business plan? Just one page as a Google Doc and send me the link. Thanks.
Starting point is 01:11:18 Hey, just finished drawing up that quick one page business plan for you. Here's the link. But there was no link. There was no business plan. I hadn't programmed Kyle to be able to do that yet. I'm Evan Ratliff here with a story of entrepreneurship in the AI age. Listen as I attempted. build a real startup run by fake people check out the second season of my podcast shell game on
Starting point is 01:11:39 the iHeart radio app or wherever you get your podcasts what are the cycles fathers passed down that sons are left to heal what if being a man wasn't about holding it all together but learning how to let go this is a space where men speak truth and find the power to heal and transform i'm mike delarocha welcome to sacred lessons Listen to Sacred Lessons on the IHart Radio app, Apple Podcasts, or wherever you get your podcasts. The show was ahead of its time to represent a black family in ways the television hadn't shown before. Exactly. It's Telma Hopkins, also known as Aunt Rachel.
Starting point is 01:12:20 And I'm Kelly Williams or Laura Winslow. On our podcast, welcome to the family with Telma and Kelly. We're re-watching every episode of Family Matters. We'll share behind-the-scenes stories about making the show. Yeah, we'll even bring in some special guests to... spill some teeth. Listen to welcome to the family with Telma and Kelly on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. This is an IHeart podcast. Guaranteed Human.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.