Utilizing Tech - Season 7: AI Data Infrastructure Presented by Solidigm - 08x10: Cooling at the Edge with DUG

Episode Date: June 2, 2025

More episodes and seasons of Utilizing Tech: https://utilizingtech.com/Modern AI servers generate a lot of heat, but the industry is ready with revolutionary technologies like immersion cooling. This episode of Utilizing Tech features Micah Jordan from DUG, discussing specialized server solutions with Jeniece Wnorowski of Solidigm and Stephen Foskett. Although it sounds exotic, companies like DUG have been using immersion cooling for decades. Once they proved the value of the technology in their own datacenter, DUG began delivering immersion cooled containers wherever they are needed, especially at the edge. This uniform and efficient cooling allows servers to work harder while also extending their lifespan and reducing the risk of component failure. DUG’s containerized AI racks are being deployed around the world closer to users, lowering the latency and enabling rapid response to demands. DUG is working with partners like Hypertec to build, certify, and support immersion cooling for end customers, achieving higher density and lower energy consumption. Guest: Micah Jordan, Account Executive at DUGLinkedIn: https://www.linkedin.com/in/micah-jordan1/Hosts: ⁠⁠⁠Stephen Foskett⁠⁠⁠, President of the Tech Field Day Business Unit and Organizer of the ⁠⁠⁠Tech Field Day Event Series⁠⁠⁠⁠⁠⁠Jeniece Wnorowski⁠⁠⁠, Head of Influencer Marketing at ⁠⁠⁠Solidigm⁠⁠⁠ ⁠⁠⁠Scott Shadley⁠⁠⁠, Leadership Narrative Director and Evangelist at ⁠⁠⁠Solidigm⁠⁠⁠Follow Tech Field Day ⁠⁠⁠on LinkedIn⁠⁠⁠, ⁠⁠⁠on X/Twitter,⁠⁠⁠ ⁠⁠⁠on Bluesky⁠⁠⁠, and ⁠⁠⁠on Mastodon⁠⁠⁠. Visit the ⁠⁠⁠Tech Field Day website⁠⁠⁠ for more information on upcoming events. For more episodes of Utilizing Tech, head to ⁠⁠⁠the dedicated website⁠⁠⁠ and follow the show ⁠⁠⁠on X/Twitter⁠⁠⁠, ⁠⁠⁠on Bluesky⁠⁠⁠, and ⁠⁠⁠on Mastodon⁠⁠⁠.

Modern AI servers generate a lot of heat, but the industry is ready with revolutionary technologies like immersion cooling. This episode of Utilizing Tech features Micah Jordan from Doug discussing specialized server solutions with Janice Narowski of SolidIME and myself. Join us and learn how these servers are dissipating heat and becoming more reliable in the process.

Welcome to Utilizing Tech, the podcast about emerging technology from Tech Field Day, part of the Futurum Group. This season is presented by SolidIME and focuses on AI at the Edge and related technologies. And today's episode is especially talking about AI at the Edge, as you will soon hear. I'm your host, Stephen Foskett, organizer

of the Tech Field Day event series and joining me today from SolidIME as my co-host is the fabulous Janice Narowski. Welcome to the show. Thank you, Steven. It's great to be back. Appreciate that intro. It's great to have you.

This has been a lot of fun talking to various companies and of course, it's always fun to nerd out with the latest technology. And that's just what we're going to do today. We're talking some pretty cool cooling technology, aren't we? Very cool. This is going to be literally and maybe figuratively the coolest episode we've done. We'll see. Well, I guess with that introduction, you know, let's I guess let's dive in. Do you want to introduce our guest today? I would love to. I am I am so excited about Micah Jordan, who is joining us from Down Under Geo.

Micah, welcome to this program today. Thank you. I appreciate the invite and welcome here. Yeah, as you said, my name is Micah. I'm the account executive here at Doug Technologies and really excited to be here and chat a little bit about cooling. So you guys are doing something very, very cool. Now you're not just blowing a bunch of air at these things. You're cooling these servers in a special way. Tell us a little bit more about it. That's right. I feel like I need

to push my glasses up for this bit. So I'm gonna geek out a little with you and tell you a little bit how immersion works. We are using immersion cooling to cool all of your high-performance compute GPUs AI, right? So your standard data center, the way it works, they have them in racks, they're air-cooled via crack or crawl units, hot and cold aisles. We take those racks, lay them down on their back, and then fill them up kind of like a bathtub with a dielectric hydrocarbon fluid.

That fluid pulls the heat away from the servers and then expresses it out via kind of like a car radiator. They're called fluid control modules, which then either pulls the heat out and expresses it with the chiller or adiabatic or dry cooler. So it's a much more efficient method of cooling your IT hardware and something

we've been using for decades. So we're talking a lot about, we just jumped right in and started talking about the cooling, right? But tell us, Micah, a little bit more about the overall solution. Obviously, Down Under Geo creates some very fascinating technologies, but this one is very, very different and unique. So as you mentioned, lots of cooling capability, which is terrific. But tell us a little bit more about the overall container and what's inside. Well, so a little background information.

Doug was built on a simple idea, find smarter ways to solve really tough geoscience problems, right? We're called Down Under Geo because that's where we started was in the geosciences. So when we started back in 2003, we didn't really have a lot of money, just a lot of really big ideas and the drive to get things done. So that meant we had to stay very agile, invent our own technologies from the ground up, including very energy efficient and immersion cooling systems. Well, those technologies led us to create one of the largest

and most efficient immersion cool data centers in the world at Skybox, just outside our US office in Houston, Texas. So we've been running Skybox now as an immersion cooling data center at scale for well over a decade. Yeah. And let me tell you, the benefits have been pretty amazing from reduced water

usage to increased IT hardware lifespan. It's just been very surprising. So when we would show that location off to customers, they started telling us. You should sell this. And that's what we did. that location off to customers, they started telling us, you should sell this. And that's what we did. Uh, Doug Nomad is built on that idea of immersion, cooling, efficiency at the edge. Um, so you can put HPC AI anywhere you need it.

Uh, it's where the data is born and processed, um processed using our patented Doug Cool technology. So we're talking, I mean, the harshest environments. You could put a Nomad 10 anywhere from Abu Dhabi to Anchorage. The benefit here, as you said, is that with immersion cooling, it's not just cooling like one spot or one component, it's cooling the entire system, right? And so essentially rather than having this sort of, you know, hot and cool and lots of fans

and lots of air guides and all that kind of stuff, you're just pulling the heat out of the entire server. And I think that would lend the server to being more reliable and being able to be maybe turned up the entire server. And I think that would lend the server to being more reliable and being able to be maybe turned up a little a little notch, right? That that's exactly right. A lot of the things you see nowadays is directed flow, especially direct liquid cooling to the

hottest pieces of the IT hardware, right? Your CPUs, your GPUs. And absolutely, those places need help. They need directed flow. But the benefit of immersion here is that it covers everything, including the things that are starting to generate a lot more heat now and used to not. Plus, you said it yourself, you remove your fans, there's no more vibration, there's no more dust settling in the IT hardware components. And that's what I meant when I said we were surprised by some of the benefits.

We're recognizing a lifespan increase of some of our IT hardware by two, three, even four times. And that's mind you, overclocked. That's running them hotter and stronger than they normally are running in their cooled environment. So, pretty surprising and remarkable benefit. So a lot of edge computing today is driven by mission-critical workloads. Can you comment a little bit on how this device or this box is really

being used for mission critical AI workloads at the edge? Yeah, yeah. So we, like I said, we have been using our immersion cooling for our own products since 2003, right? We do geoscience data processing in our data hall in Katy, Texas. And we essentially take everything that we've learned, all the experience we've gained from those compute processes in-house and take that experience and put it inside our Nomad 10 and help our customers run their AI at the edge.

Now mind you, we're building the infrastructure. We let the customers, the clients run it how they want, because it's going to be different than a GeoSolution company is going to run it. But we can kind of handhold a lot of them through what that looks like in the infrastructure side because we've been doing it. And you know, I imagine, yeah, geoscience, for what it's worth, I used to work in Houston

for a geoscience company as well. And so I know the demands that they've been placing on hardware for many, many years. But of course, AI, frankly, has taken this whole thing to another level. You know, I mean, it's just like with HPC technology, you know, what's happening in AI workloads, especially at the edge is pretty remarkable. And this is one of those areas, I think, where people are starting to wake up and realize

that they're gonna need not just a little compute, but a lot of compute all over the place, because we're collecting more and more data everywhere. I think that the container, that you sort of, the containerized liquid cold solution that you're suggesting, what is the scale of that thing? What kind of processing can be performed in one of these containers?

The space in the Nomad 10, we're talking about 26 RU of space in one of our tanks, right? Essentially 56 kilowatts of IT heat rejection. So we have an outstanding partnership with Hypertech via their Trident line, where you can essentially put six of the H100 NVIDIA GPUs in a 2RU space. You put 10 of those in one of our tanks, and what is that, 60 GPUs in the space of a 10-foot container? That's quite a bit of workloads.

When you compare that to a standard data center rack running at 5, 10, 15 kilowatts per rack. It's night and day. I mean, getting that level of power at the edge is unheard of. So that's an interesting, gives me an interesting thought here. So who really is utilizing these types of systems? Like what types of end customers do you see really gravitating toward this technology? That's a great question. Without using any names, just talking kind of verticals, right? So obviously, AI use cases. I think I mentioned earlier just in conversations, an LLM company could build out their data centers somewhere remote because it's less expensive and learn the LLM and then put some

of our products at the edge where their end users are. Say San Francisco, they could put five of our Nomad 10s so that the latency is not nearly as intense as it would be if it was in the middle of South Dakota. So LLM companies are really interesting fits for this, but some of the less obvious ones that kind of surprised some of us would be things like cloud gaming, where latency is absolutely imperative. Putting that at the edge. Precision agriculture. So gathering a bunch of data around your crops and your livestock, processing it at the edge and

making decisions same day without having to run all your fields. That's a pretty exciting option, right? Defense contracts and being able to deploy something like this, which can deploy in three months in the middle of Abu Dhabi or, well, let's say a more remote location. That's something that not a lot of people can offer. Right. Yeah. The desert somewhere. Yeah.

There you go. Yeah. Thank you. Yes. And, I mean, there's others, like mining is a big, interesting fit, oil and gas and energy. You know, I usually don't do this, but I have a question for you, Janiece. Yes. So theoretically, you know, maybe not specifically Solidaim, but, you know, component suppliers, when somebody like Doug comes to them and says hey We're gonna be taking this server and immersing it in this special liquid for cooling

How does a component supplier react to that and what's their? Well, I mean, I imagine that you react by saying cool fun technology challenge. Let's make this happen But what does that mean for component suppliers and how do you build and modify your products to be used in an environment like this? Yeah, yeah. It's a great question. And there's a lot of SSD suppliers out there kind of looking at, okay, the overall solution, right? The GPUs are running really hot a lot of times. The overall system, you've got fans to cool those things, but you don't always look at how do you cool the SSD, right?

And so our company is really big and bullish on this. They are going out and figuring out how do we liquid cool our SSDs in a number of ways. The diabolic cooling that Mike is talking about is a little bit unique for us as well. When we started working with Hypertech and now working with Down Under Geo, it was an opportunity for us to say, hey, how can we dip these into the cooling solution? And the worst thing that happened at first was I think the label fell off. So we had to get that put back on. But at the end of the day, I think our team's really always on the cusp of innovation.

And we take this very seriously as an opportunity. We know energy and edge is a growing market. And we see this as an opportunity to take a different look at how our SSDs work. So our team is continuously innovating with companies like Down Under Geo and Hypertech to make these solutions real. I honestly don't know of any others really leaning into it, but we're kind of fearless at SolidIME when it comes to these things. Micah, I mean, kind of the same question back to you too.

So we just heard, you know, what has been your experience in working with customers? Because there are so many varied components in these systems. How do your suppliers react? And what have they needed to do to make their products ready for an immersion cooling environment? Well, the easy answer to this question is talk to Hypertech or an IT hardware provider who has already done this work for you, right? Because they've built servers from the ground up for immersion.

Now, to be clear, we are totally IT hardware agnostic. So it doesn't matter whether you're buying Dell, Lenovo, HPE, Hypertech, 2C-RSI, what have you, right? It all works in ours. And we know this because we've done a lot of them in our own data centers, right? But some of the steps that Hypertech takes and say Dell through Unicom takes is

they remove the fans first off, they remove the thermal paste on the processors and replace it with indium foil. Then some of the cables that connect different things need to be replaced if they have PVC in the casing, because that PVC does break down in some of the dielectric fluids, and it'll just get really brittle. So yeah, those are kind of some of the steps. And then I think in bios, you need to go into the bios and say like, hey, don't freak out.

You don't have a fan running, right? I imagine you would because I think most of these servers would be like, ah, no man. Yeah, exactly. I know. So it's definitely we're in the stage, but literally the cutting edge of moving, shifting this entire industry towards a more efficient means of heat rejection because air just can't keep up with what's being put out by the likes of NVIDIA, AMD, and Intel. So Micah, I'm going to take it back for a second because I'm just really interested in the use cases.

I kind of keep coming back to this. But what's the most interesting place that you guys have deployed this? Can you share that? So one that has been really exciting for me is an area that's close to a coast in a very hot arid environment, right? That has been historically one of the hardest places to cool your data centers, right? And so think about like Iceland would be perfect.

If you could have all your data centers in Iceland, you just open the doors and everything is cooled with the environment, right? Now imagine putting it in, you know, the middle of a desert that's right on the coast. So you've got really humid air. You have very hot temperatures that don't really get below 70 degrees. Those two things, you're just kind of stuck.

What are you going to do? How are you going to build the data center that if you want low latency? That's an example of one of our, I mean, our Nomad 10 is running in that environment today and performing spectacularly. It's really exciting to talk about some of that stuff. I wish I had a little bit more meat to say like names and locations, but that's always been really fun to point to. Say with confidence too, because we're doing it.

So how do you power all this if you're dropping it into a remote location like that though? Yeah. Yeah, so There's a lot of ways if you want to be entirely green. There are some companies who have very remote deployable solar Setups that kind of fold up into like a 40 foot container shaped thing. You also have like a portable wind. Those are really green solutions. You also have, I mean, generators.

You can put a generator out and run that anywhere. And then some of them, like the example of running five in San Francisco, just run power and networking directly to the Nomad, right? And it's powered. All we really need is level ground. And of course, you know, it's not enough just to pull the heat away from the servers. You have to dissipate the heat as well. So you got me thinking when you're talking about that hot, humid coastline. How are you dissipating the heat from the container itself? Depends on the mechanical method by which we're heat rejecting, right?

If we were in a Nomad 40, which uses either idiomatic or dry cooling, it expresses the heat based on your dry and wet bulb temp. We kind of tailor the chiller or the cooler based on where it's going. But the Nomad 10 uses a chiller, which is refrigerant, right? Not as efficient, but deployable anywhere, no matter the environment. And that's what we're using in that example I gave. Yeah. So, because that's a pretty proven technology, the challenge is getting that cool down to the component level, not being able to dissipate that amount of heat. Well, I mean, the fluid, just basic physics, fluid is a much better method of heat rejection than air is, right? You think about jumping into a 70 degree swimming pool, right, and standing out in

a 70 degree temperature air, one of those is much cooler and that's because it's pulling your body heat away a lot more efficiently. It's the exact same method that we're using here, right? Just a little bit hotter and more consistently. And of course it's not water, it's especially... Right, yeah, right. That's valid. Actually, I'm glad you said that. I do kind of want to talk about the fluid a little bit. That's one thing that we are also agnostic on. Doesn't matter what dielectric hydrocarbon fluid you use, it all works in our system. But some of the similar properties they all have would be so dielectric,

so they tend to have flash points upwards of 250 C. I've seen some as low as 150 C. They are all biodegradable. They break down into their carbon-based components within 30 days in the environment. So if there is some sort of a spill, it's not like an oil spill. This is a completely different type of fluid. In fact, when we're transporting it, it's considered a food grade lubricant during transportation. So it's non-toxic.

I've actually tasted it. Doesn't taste good, but it is edible. And I think actually I've heard that there's talk about a peanut butter and jelly flavored one. We don't want that. We do not want to be drinking our peanut butter and jelly flavored one. We don't want that. We do not want to be drinking our peanut butter and jelly hydra marbons out of our data center. I don't know, Stephen. I think I would try it.

You wouldn't try it? No. I would try it. It's funny though, because you go to these HPC shows and you see companies like yours on display and right next to them are some of the big names in industrial chemicals. I think people are scratching their heads like, why is the company that I buy gasoline from at the supercomputing show? This is the answer, right?

Yep. That's right. That's exactly right. These fluids that are being produced by them are pretty remarkable. And mind you, they have been around for decades. Some of these fluids, similar fluids, are used in your transformers and they're right around you right now. They're the same types of dielectric fluid used there. They are tailored a bit more for the data center market and made specific, but they're not anything new and cutting edge in that respect. They're tried and true and

it's perfect for this use case. Yeah, because we've been seeing immersion cooling in computing, in high performance computing and specialized approaches for a long time. I guess just sort of to sum up, I mean, the interesting thing here is that you're taking this tried-and-true technology, but that you're deploying it specifically for challenging applications and specifically at the edge, which again, I think a lot of people might say, whoa, whoa, whoa, you're taking this stuff out into these challenging environments. But in many ways, these things are better at the edge than conventional solutions, right?

That's exactly right. I mean, think about your entire infrastructure is insulated by this fluid, right? There's no more dust concerns. There's no vibrations. It's lasting longer. And this is expensive hardware. This is the kind of stuff you want to protect.

And that's what this does exactly. So even though it might be a little scary to people to think about, you know, it's not like you're dipping your server in water. It's proven technology. And yeah, I think the fact that it's insulated from shocks, thermal shocks, physical shocks, and so on, I think is another thing that people might not consider, but that could be pretty valuable. Well, it's incredible stuff. Will we see you at some of these future shows?

Where can we get our, I don't want to say get our hands on it because frankly, I don't want to pick my hands in there, but. Well, you can. I mean, you have the softest hands in the data center world. It's really good fluid. I know I do. So where are we going to see you? Where can we run into this solution? So you can actually come and see the Nomad 10 fully kitted out at the Yotta conference in a few months in Vegas.

I think it's September 8th. We'll have our Nomad 10 there showing it off in a booth, and our CIO will be speaking at that conference as well. So really interesting conference created by some of the creators of data center dynamics. I think George Rocket is his name. So come check us out there in Vegas in September. And of course, Vegas in September is a hot environment that you could deploy one of these things. It is absolutely. Yeah, it both certainly is. How about you, Janice?

I mean, we'll be all over. Where are we going to, it both certainly is. How about you, Janice? I mean, we'll be all over. Where are we going to see us next? Yes, we might see us at the Yata conference as well, but certainly Dell Technologies World. We'll be at Flash Memory Summit. We'll be at the Open Compute Summit as well. So we'll be in a lot of places.

We go everywhere. But we might be in a lot of places. We go everywhere. But we might show up with Micah and his team in a couple more occasions. So stay tuned. Maybe not quite ready to announce anything, but it would be very fun to be able to get, I'd love to get the Tech Field Day delegates hands on some of this stuff too.

So Micah, we will make sure that we do that at some point in the next little bit here because it's just neat. It's just very cool stuff and I really appreciate having you on the show. Yeah, I appreciate you guys letting me join and talk a little bit about this really cool tech. Thanks for listening to this episode of Utilizing Tech. If you enjoyed this, you can find this podcast in your favorite. I'm going to just redo that because I stumbled twice. Here we go.

Well, thank you very much for joining us. And thank you, everyone, for listening to this episode of Utilizing Tech. You can find this podcast in your favorite podcast application, as well as on YouTube. If you enjoyed the discussion, please leave us a rating. Please leave us a review. And maybe provide a comment, too. We'd love to hear from you.

This podcast was brought to you by SolidIMim, as well as Tech Field Day, part of the Futurum group. For show notes and more episodes, head over to our dedicated website, which is utilizingtech.com or find us on X Twitter, Blue Sky and Mastodon as Utilizing Tech. Thanks for listening and we will catch you next week.