Podcast Archive - StorageReview.com - Podcast #123: Cloud-Based GPUs For AI

Episode Date: September 26, 2023

This podcast features a conversation between Brian and Jeffrey Gregor (he prefers Gregor).  Gregor… The post Podcast #123: Cloud-Based GPUs For AI appeared first on StorageReview.com. ...

Transcript
Discussion (0)
Starting point is 00:00:00 Hey guys, thanks for checking out the podcast again. We've got a great conversation with a company called OVHcloud. They may not be the biggest cloud provider in the world, but they are very well established and one that you should definitely know about. We just did a paper on their GPU instances. We'll talk about that in terms of what that means in AI development, most importantly, and also how you can get started with OVH, what their services are, and all sorts of other things. So Jeffrey Greger, or Greger as I'm told you prefer to go by, is here from OVH. Thanks, Greger, for doing this with me. Yeah, great to be here. Very happy to talk to you and whatever live audience we have on the internet. Yeah, absolutely. So thanks for setting that up, Gregor. We are streaming this
Starting point is 00:00:52 live to our Discord audience. So if you've got questions, feel free to post them in the chat. Jordan's moderating and we'll make sure to get the good ones to me if you guys come up with such a thing. And for you guys catching this on iTunes or whatever your podcast tool is or on YouTube for the video, we do have a Discord highly active where you can participate with our team in real time and a couple hundred other friends that are into IT topics. And that is linked to from the top right corner of storageofyou.com and I'll put a link to it in the description as well. Less on me, more on you, Gregor. I set this up as OVH is a cloud that we've known about, of course, for many, many years. The GPU project was the first time that we'd worked together on a review. So I'm thrilled to have
Starting point is 00:01:45 gotten that done and for what we can do with you guys in the future. But set up for the audience, who is OVHcloud and what's your target? If you can do that in a few minutes or less, that's a big question. Yeah, sure. So yeah, so I expect that this is a mostly or maybe exclusively US audience, or maybe it's international. But as you mentioned at the top, OVH Cloud used to be known only as OVH, but we've been OVH Cloud for several years, is, depending on which survey you look at, the seventh or eighth largest cloud provider in the world. And we're the only one that's in the top 10 that's headquartered in Europe. So I'm the general manager and president of OVHcloud US. We're a Delawarean corporate LLC. So we're our own
Starting point is 00:02:38 separate company, but we're a wholly owned subsidiary of OVHcloud in France, and they've been doing business since 1999. And like I said, globally, they're the seventh or eighth largest cloud provider in the world and the only one that's not a U.S. or Chinese company in the top 10. We've been operating the U.S. company since – well, we started selling in 2018. We actually started it. It was incorporated late 2016, started hiring selling in 2018. We actually started it. It was incorporated late 2016, started hiring employees in 2017. And both OVHcloud in France
Starting point is 00:03:12 and OVHcloud US are in themselves global companies. So about a third of my customers are from outside of the US and we serve US residential customers and we serve anyone in the world who wants to buy our servers or services here. And we also can deliver services in any of OVHcloud's global data centers.
Starting point is 00:03:34 So North America, US, Canada, Europe, in the UK, Germany, and France, India, Singapore, and Australia. And you might have seen some news recently, we just made an acquisition of a company called Gridscale out of Germany, and that's gonna allow us to put our services in a lot more edge locations that we'll be rolling out soon. Last thing, maybe just to close out this question is,
Starting point is 00:04:04 so what you need to know about OVHcloud is we're a pure play cloud provider. All we do is cloud, but unlike other competitors who are mostly either focused on public cloud or private cloud or some niche folks who do just bare metal, we do all the clouds and we always have. So we're very strong in bare metal. And that, you know, was our basis from, you know, many years ago. We also offer private cloud, which is, you know, dedicated resources on, you know, industry standard sort of stacks, like we've been long term partners with VMware, we're partners with Nutanix. So if you need dedicated resources, for both, you know, physical and logical isolation, bare metal or a well-known
Starting point is 00:04:48 stack on VMware or Nutanix. And then we also run our own public cloud. Again, I'm not 100% sure, but it either is or at some point it was the largest operation of OpenStack in the world. And we're really focused on public cloud because that's where we know the market is growing very fast and it's very easy for people to get in and use public cloud. We're also building some key platform as a service offerings like databases as a service
Starting point is 00:05:17 and AI and machine learning tools on top of it. So that's what you need to know about OVHcloud. Okay. Well, you did well. tools on top of it. So that's what you need to know about OVHcloud. Okay, well you did well. I said in a few minutes and you hit that target. So I get the scale and that's important. I'm glad you set that up. When we think about your big competitors, your big global competitors, and I know you probably don't want to name them and go head to head, but when we think about AWS, Azure, GCP, the common ones here, at least in the US, many of them have made their focus to have a little more targeted about where you make those investments to make sure that you're able to implement support and that obviously customers want to pay for those. When you think about some of these new services like the GPU offering, which we'll get into here in a little bit, what does OVH have to do there that may be different from your massive competitors
Starting point is 00:06:20 or maybe even different from your much smaller, you know, regional CSPs or whatever that might kind of dip a toe into this kind of thing as well? Sure. Well, I think, you know, even Google and Microsoft and the other hyperscalers, you know, realized and admitted, you know, years ago that AWS had, you know, such a large start. And I don't think anybody is really trying to match them on item by item. And we're certainly not. So we are trying to give our customers all of the right building blocks that they need. And we certainly support multi-cloud. We know the research that's out there, both from talking to analysts and folks like you
Starting point is 00:07:05 and our customers and others that, you know, most companies are using at least two cloud providers, if not three. And so we think we have a place in that multi-cloud environment. Again, we're strong maybe in some areas where others aren't, particularly on bare metal or some of our private cloud offerings. And then on the public cloud side, yeah, we're not trying to give every microservice and everything that the hyperscalers or even some other providers might have. We're trying to give the key building blocks plus the main platform as a service offerings that we think our customers in the market need.
Starting point is 00:07:48 And like I said, those are mostly around databases of service and of course, AI and machine learning and notebooks and things that support data lakes and various different types of storage offerings is the sweet spot for us right now. So we're not trying to be everything to everybody, but I think we certainly fit in this ecosystem. And another key aspect of how OVHcloud operates is that we don't lock our customers in, even though we have offerings, like I said,
Starting point is 00:08:18 with VMware and Nutanix, and we offer Microsoft Windows licenses on our bare metal servers and different things. Those are sort of the de facto industry standards, but we really support open source software. And even through acquisitions that we've done, our founder, Octav Klava, has a vision to generally productize but then open source some of that software that we get from companies that we acquire.
Starting point is 00:08:46 So our customers are free to come and go and use us for the workloads that are appropriate for them. And if they need to put other workloads elsewhere, we recognize that it's a multi-cloud world. Well, I mean, you're not wrong about that, of course. And your strength in Europe has got to be nice for your U.S.-based customers to know that if they're with you here in the U.S., that you're as strong or stronger maybe in, I don't know, say, France or like you mentioned for the HQ. What do you guys think about in terms of footprint of where these data centers are? Are you expanding that through new investment or is that largely through acquisition? It's generally through new investments. So OVHcloud, we're a build-it-here company and we're very
Starting point is 00:09:35 vertically integrated. So another thing to know about OVHcloud is again, unlike most other providers, we design and build our own servers. So we sort the components, but it's OVH cloud designs. We do everything from bending the sheet metal to putting the racks together, building the servers, cabling them. And then we own and operate our data centers around the world. And I gave you an overview of the locations before. But in the coming years and months, we're planning to expand rapidly. So at some point in the future, we're going to add a central U.S. data center, probably in Texas or somewhere in the central region. We
Starting point is 00:10:20 have a data center in Virginia and we have a data center in Oregon. So we've got the east and west coast of the US covered. We've had a data center in Montreal in Canada for about 10 years, a little over 10 years. And early next year, we're launching a new data center in Toronto. So we'll have four North American data centers. We just opened a data center in India, which I mentioned earlier in the
Starting point is 00:10:45 call, and we're looking to expand our Singapore and our Australian data centers, as well as some additional data centers in Europe. And also, like I mentioned earlier, with this acquisition we've just done of the German company called Gridscale, they're going to allow us to get out into other locations where we already have points of presence. So we've got many points of presence around the world where we don't necessarily have a data center full of servers that we're operating. But that will very quickly allow us to expand our reach, you know, first by tens of locations and then eventually by hundreds. Well, I mean, I'm a hardware nerd, so I kind of stopped listening
Starting point is 00:11:29 after you said you bend your own metal. I mean, that's somewhat unheard of anymore, right? Because you've got the OCP movement, of course, you know, that Meta and Azure and some of the enterprise guys are supporting, which is one thing, but that doesn't necessarily mean they're making what you want to consume on the hardware side. Then you've got a lot of the ISG, the server guys that are trying to build solutions exactly for your scale of hyperscale to give you pre-packaged solutions. And obviously,
Starting point is 00:12:08 those aren't working for you either economically or feature set. Tell me a little bit more. I mean, I realize you may not be the metal bending guy, but tell me a little bit more about that program and what you're doing there and why you feel like that gives you guys a competitive advantage. Sure, it's a couple of things. So it allows us to control the whole part of the supply chain from when we get the components through, like I said, when we build it and deliver it to our data center. It also allows us to come up with the configurations that our customers need in the market. So we can design these to have various different configurations of RAM and disks, from spinning disks for a lot of slower storage up to the latest NVMe drives. So we offer a wide variety of configurations. And the other reason that we do it is we've
Starting point is 00:13:06 been operating since around 2000 or the early 2000s, our own proprietary water cooling. So instead of air conditioning all of our data centers, we use water cooling directly to the chips and other components on the board. So it's very efficient. Most of it operates at ambient temperature. Although in the summer months, we do have supplemental cooling, but it allows us to be very environmentally friendly and have some industry-leading power usage effectiveness,
Starting point is 00:13:43 water usage effectiveness, and even carbon usage effectiveness, PUE, WE, and CUE. We've got commitments to be a leader in that area and also with this vertical integration and cyclic internal
Starting point is 00:13:59 lifecycle for our servers, we also give multiple lives to these servers. So every 18 months or so, we refresh our business and enterprise class of servers and come out with the latest CPUs and fastest RAM and drives, et cetera. But then we don't just get the old ones and we have a commitment to not put you know you waste to landfills and in the next coming years we repurpose those existing servers maybe we remove some of the features adjust some of the you know
Starting point is 00:14:33 feeds and speeds but we you know reprice them and we keep offering them you know in different configurations for several years down the line because we know that there's a huge market out there and not everybody needs the latest and greatest for every application or workload or not everyone can afford it. So if you're an individual just trying to learn to be a sysadmin and you need to get your hands on a bare metal server so you can use IPMI and do some other things to get yourself set up, then you can do it. Or again, depending on the workload, we've actually had a lot of customers come to us asking for four core servers. And hey, it's not the 1990s anymore. Like most of the servers have tons of cores, right? But, you know, some people want
Starting point is 00:15:27 four core machines because of, you know, databases and other software that, you know, is very punitive on charging you for every core. And so there's still some use cases out there for that, even if it's a several year old server,
Starting point is 00:15:41 you know, somebody's got to use for it. I'm laughing a little bit because we're seeing eight cores or more on DPUs now, which are net add-ins, which is kind of funny. But you're right. And you said early on in the conversation that OVH didn't want to penalize customers with long contracts and give you some flexibility. What you didn't say, but you started to say there, though, too, is that in my experience with OVH, you guys tend to be much more cost effective than other solutions, right? And maybe some of that's because of the flexibility
Starting point is 00:16:16 to come in and out without having to contract a big chunk of credits that you burn against, which is a common modality. So I don't want to position you guys as always low cost because I'm sure customers will spend plenty of money with you, but you do have a lot of low cost options, which I think from the, like you said, the experience from training, from experience, from getting hands-on with these things, if you can do it for a couple bucks here and there,
Starting point is 00:16:45 you probably don't care if the system's a little bit older. It doesn't make any difference. You're still learning how to be a practitioner of some of these services and setting up, you know, you're in Kubernetes or database, as you said, or whatever you want. It's a great way to have access to a pretty robust playground.
Starting point is 00:17:00 Yeah, again, that's the view of our founder, Oktav Klaba, like one of his sayings, and his sayings and one of the sayings at OVH Cloud is innovation for freedom. And he really wants to let everyone in the world build their freedom in the cloud. And so we can offer something at the appropriate price point for everyone, you know, along the spectrum, that's a benefit to us and a benefit to them. And yeah, I certainly don't position OVH cloud as, you know, cheap or low priced, although we do have very competitively priced offerings, and some of them are low, know we look at at look at it as delivering high value and high performance for uh price and that you know uh again allows us to address this you know long tail of the market and also allow some of our partners to use our infrastructure
Starting point is 00:17:59 with their value-added services on top of it and uh you know offer it to folks who might not be able to pay enterprise sort of rates. And just on that point, our customer base ranges from people who literally do pay us $1 a month for a very small VPS up to enterprise customers who pay us $1 million a month and everywhere in between. Sure. But right now in the US, our sweet spot is, you know, SMBs and smaller enterprise customers who pay us, you know, say between, you know, 50 and 200k per month. But, you know, anywhere in between, we certainly service lots of customers that pay us 10,000, 1000. And like I said,
Starting point is 00:18:43 lots of individuals, you of individuals that maybe just have a VPS or an older bare metal server that maybe pay us $50 a month. Well, there's two things there. When you're talking about building your own servers and being able to adopt the latest technologies, Gen 5 Flash, high-speed interconnects, which in your business is probably extremely critical when you get into talking about shared storage and things like that. That's at one end of the high performance scale. And also, as you're mentioning, the fact of the matter is that most SMBs, SMEs, robo deployments, anything edgy really doesn't need that much performance.
Starting point is 00:19:22 What they need is reliability. They need uptime. They need cost effectiveness. They need that much performance. What they need is reliability. They need uptime. They need cost effectiveness. They need ease of use. They need a bunch of other stuff that the cloud can deliver, doesn't always, but can deliver. And it seems like that you're finding a sweet spot right there. Well, maybe a couple of different sweet spots, depending on the persona of your customer. Yeah, I think it's the right price for you, as you're saying, what the market or the customers need. And also, I think we've got a very compelling story
Starting point is 00:19:55 for helping people move to the cloud. And that's one of the things that I think we position ourselves well against the hyperscalers and some other ones because years ago the cloud was what AWS said it was and a lot of people said, oh, well we need to move the cloud but they didn't really understand
Starting point is 00:20:14 that moving to the public cloud requires you to do some refactoring and changing how you operate your workloads and then especially even more so with Kubernetes and containerization. But with our broad range of products, people who want to get the benefits of the cloud, which are predictable pricing, great performance, monthly subscription payments instead of upfront, capital expenditures every couple years,
Starting point is 00:20:46 etc. You can do that with a lift and shift to our bare metal cloud. You can do it if you're used to running VMware or Nutanix on-prem or in a colo, you know, zero skills gap, because we know there's a lot of skills gap in the market. And for companies who do want to modernize their apps or build modern apps and there's a you know a lack of skills out in the market so as I like to you know joke and say you know you there's plenty of these you know like me graybeard sysadmins who know their way around linux box or a Windows server and you know you can take that first step and get a lot of the benefits from the cloud even if you're not ready to modernize your apps and then you're already in the cloud
Starting point is 00:21:30 in an ecosystem that you understand that you're not locked into and then you can work on moving over to public cloud or Kubernetes. And even on that point, Kubernetes, we offer, you can run Kubernetes on everything we have. We've got, you know, a fully CNCF certified, you know, managed Kubernetes service on our public cloud. Of course, you can get Kubernetes on Bare Metal if you want to install it yourself, any flavor. And then there's Tanzu on VMware and Nutanix has their own version of Kubernetes. So
Starting point is 00:22:07 if you want Kubernetes, you can do it again, public cloud, private cloud on data. Bunch of different ways, yeah. Whatever skill set you have. Right. Hey, so I also want to go back to what you're talking about on the sustainability side. Obviously being liquid cooled gives you some advantages for all of the efficiency that you were talking about. But reusing the servers for as long as possible is something that's become a hot button lately, maybe a little more from get storage from going in the shredder to being securely erased and repurposed and so that it can be used again and have future life. But the same can be said for GPUs, for servers, for other technology that
Starting point is 00:22:58 just because it ages out and may not be as economically efficient or fiscally as efficient as whatever new servers you're putting in there, shredding that just seems like a tremendous disservice to, not to be hyperbolic, but to the planet, right? I mean, that doesn't make a lot of sense to me. So I'm glad to see you guys trying to get more life out of these systems. Can you talk at all about what you do at the very end of life of these systems? Is there any recycling program or something a little more harmonious, I'm hoping,
Starting point is 00:23:31 than just chucking it in a e-waste pile? Oh yeah, like I said, we have a commitment in the next couple years to not send any of this to e-waste. So yeah, we certainly try and, yeah, again, use it and get the maximum amount of life out of it and then recycle as much as we can. And I do just want to make one other point is that this isn't something that we've just jumped on the bandwagon because sustainability and green and, you know, sort of greenwashing and all that is, you know, the hot topic of the day. This has been in the company's DNA since the beginning and
Starting point is 00:24:10 you know like I said we've been doing the water cooling since you know the early 2000s and we didn't even know how good we were at this because again like it's just how we're used to operating. The parent company in France went public a few years ago, about 18 months to 20 months ago on the Euronext exchange in Paris. And when they were doing the due diligence for that and all the road shows and everything, that's when they realized, the investors and the banks and everyone were telling them, do you guys realize what a great story you have here? This is just like what you do and this is what everybody's like trying to
Starting point is 00:24:50 get to and you've just been doing it the whole time you've existed. So I think that's a great part of our story. No, it's certainly compelling. Of course, when we talk to enterprise customers that are figuring out how to make their data centers more efficient, especially when it comes to GPU servers, which as you know, can be thousands of watts just in their own box. It's daunting. So the HPC guys, educational institutions have been on this for some time now, but the enterprise, I don't know how many more generations of air-cooled, pure air-cooled servers, and especially GPU servers there will be. It can't be too much more until something has to be done there, whether it's a closed radiated loop, whether it's a liquid door,
Starting point is 00:25:37 whether it's full immersion or full liquid loop. I mean, there's a lot of choices, but it will come to it at a certain point. I've got a question here around security and I want to ask you here too, in terms of you're building all of your hardware is one thing, securing it is another. Can you talk a little bit about your security approach? And then I've got a follow up for you. Okay, sure.
Starting point is 00:25:59 I mean, we're certified to all the standards, SOC and ISO, and we've got for all of our product offerings here at OVHcloud US, we're certified at the infrastructure level what we deliver to our customers, certainly not to the applications that they're running on them. But what we deliver, you know, PCI DSS and HIPAA compliance. Of course, we've got, you know, our own physical security protocols. So yeah, just like any data center, we've got all the physical and logical security to keep your data safe. And I mean, at this point, having the appropriate security and certification so customers can be confident in the safety of their data is table stakes. Nobody's gonna be in the business
Starting point is 00:26:55 if they can't deliver that at this point. Well, one of our guys in Discord, I think echoes your sentiment and says, "'Since OVH is known to handle DDoS attacks exceptionally well, I wanted to ask how the network can basically handle everything and what's the process of patching new vectors? I mean, you talked a little bit about it right there. I was unaware that you guys have such a great reputation when it comes to something as specific as DDoS attacks, but clearly that's a focus for you guys. And I mean, it's a focus for everyone, but it's a fair question. Like, how do you keep your eye on the
Starting point is 00:27:32 ball from enabling all the services we've been talking about and then layering on these additional and emerging and continually changing cyber attack issues at the same time? Yeah, well, again, it's not a plant, but whoever brought that up, I'll just make a few words about it. But yeah, that's another feature that we have. It's a homegrown system, our anti-DDoS solution. And I think you can look it up on the internet. It was maybe three or four years ago,
Starting point is 00:28:04 somewhere in that timeframe. Yeah, our anti-DDoS solution has withstood some of the largest attacks on the internet and protected our customers. So that's something we're proud of and something that comes with all of the servers that we deliver to our customers. And then, yeah, of course, internally for all of our systems that we use to support and deliver the services to our customers, we're always vigilant and have lots of very good internal controls to keep those safe and make sure everything is patched. And then really,
Starting point is 00:28:39 because we're an infrastructure as a service and a platform as a service provider, you know, what we deliver to the customer goes to that level. And I think really where a lot of the vulnerabilities come in is more than on, you know, the end user level that they're responsible for, you know, keeping their applications and what they install on our infrastructure and platforms safe, but we do everything that we can to make sure that what's delivered to them is patched. And then the services that we deliver that we operate the backplane for,
Starting point is 00:29:16 like our VMware solution or Nutanix or, of course, our OpenStack and platform as a service offerings, of course, you know, we're managing the patching and things for those for the customer. But if they're buying, you know, bare metal or some other, you know, dedicated resources, then of course they're, they have to manage, you know, the application level. Yeah. Well, yeah, it's good. So I'm glad that that came through and you're able to share some of that history. And I guess, too, I mean, this goes back to, again, I'm a hardware guy, so I get stuck on this.
Starting point is 00:29:51 But when you bend your own stuff, you select your own parts, you standardize on some things, it does make it easier in some ways to be able to ensure the root of trust there to build that out to make sure that you're testing and validating firmware and then pushing it to hopefully fewer different components across your entire stack. So we started this project with you guys on the GPU servers. I know that's a relatively new offering for you in OVHcloud US anyway. You've got the Nvidia V100s in there. Jordan on our team did some of his AI work through that instance, those cards.
Starting point is 00:30:38 Also Vince from our video team was in there messing around a little bit too. And both of them came away with like, this is pretty neat, easy to use and really cost effective. I think all of those themes came through in our review, which we'll link to in the notes for anyone that wants to check out the GPU instances that OVHcloud offers. But talk a little bit about the GPU instances and why that's important going forward for your customers. Yeah, I think it really ties into, or ties together everything we've been talking about.
Starting point is 00:31:14 So that's certainly where the interest is in the market right now. And what we're offering at the moment is just, you know, the bare GPUs. So they're part of our public cloud stacks. You get them in a public cloud VM with one, two, or four GPUs attached to the instance. And to tie in the story, so they're an older model, right, at this point. So they're an older model, right, at this point. So they're V100S, but they're still really appropriate and set up to do the key things like, you know,
Starting point is 00:31:50 learning or, you know, training the large language models and, you know, a lot of the things that customers are interested in right now with the craze of AI and machine learning. And we are going to be coming out with, you know, more recent H100s and A100s. But everybody knows, I think, that those are A, very expensive, and B, very difficult to get. So we're making a great offering out to the market that it's not the latest and greatest. But if you can't find anything else and or you can't afford the latest and greatest, these will definitely get the job done. And the way we have them priced again, I think it's a very compelling offer. So they're a little slower, but, you know, the price offset, you know, I think gives the performance, the price ratio, you know, well, well above one compared to, you know, something that's newer or faster. And then looking forward...
Starting point is 00:32:46 Well, yeah, before you go forward, on that point, just to make it abundantly clear, is having access to basically the graphics DDR is really what you're after. And so these V100s still have a reasonable footprint there. And for anyone, any small org, any org at all, that's developing models on a workstation of some kind now that has some GPU or limited GPU in it, even an A4, 5, 6,000, and you want to take that to the next level, that was our use case with what we were doing here, saying, look, all of this action is happening on workstations. Much of it's happening on workstations. So if we segment out HPC, if we segment out the top Fortune 100, 150, whatever, and then look at everything else, a lot of that's happening on workstations.
Starting point is 00:33:46 And so the cloud, and especially the instances that you guys offer, yours are a super cost-effective way to take that model to the next level. And I don't think you always need the latest NVIDIA or Instinct or Gaudi or whatever to be able to bring those to life. It's really about AI as a progression. And there are instances like this out there that a lot of people don't know about. So that's why we were excited about it. And I know you said that already, but I really wanted to hammer home the point that this isn't just an alternate GPU instance. This is a perfect instance for a lot of use cases to go forward with. Yeah, thanks for that.
Starting point is 00:34:18 I appreciate it. And again, yeah, there's no lock-in. There's no long-term contract. You can get it. We've got this great pricing for you just pay for it by the hour. If you want to commit to a whole month, it's cheaper. And if you want to buy high volume and you've got some large training sets that you want to run for a couple of weeks or a couple of months, you'll call us and I'm sure we can make a deal. Absolutely. But you're evaluating, I mean, you must be all the time looking at new GPUs, new accelerators, new, I mentioned DPUs before. I mean, there's so much stuff out there. It feels
Starting point is 00:34:59 more dynamic than ever in terms of networking interfaces and protocols, GPUs, FPGAs, smart this, smart that. Your team always evaluating these things, but they must be either having the time of their life or the living nightmare to sort through not only the testing and validation, but as you said, the access to even be able to, a couple hundred units of whatever it is that they're that they want to adopt. Yeah, we've got some great and in a in a positive in a positive way. Yeah, like some really geeky, nerdy, you know, great engineers to Yeah, they love this. They love building and testing and, you know, you know, evaluating what the next products will be. And what we're looking at in addition to just offering,
Starting point is 00:35:50 like I said, the instances with the GPUs for people to use directly is we know a lot of people are very interested in large language models and they want to run it on their own data, but they don't want to run it on, don't want to expose their data to these services in the cloud. So as part of further platform offering
Starting point is 00:36:13 that we're going to come out with, we're looking at building out that offering where you can have a large language model that you can have operate on your own data. And again, that's a huge thing for OVHcloud. Like you're always in control of your data. We don't move it and put it somewhere that you don't know where it is or make backups and put them offshore or something. So we respect our customers' data and they always know and are in complete control of their data. And so that's why, you know, some solutions that we're looking at coming out to
Starting point is 00:36:46 the market in the future are in that sort of vein. Well, it's funny you bring that up because the podcast that will air right before this one is Jordan from our team and I talking AI. And we talked about this specific part of the progression too, is that, you know, how do you get started in AI? And most of us know AI through chat GBT or one of the image generators or something along those lines. But you're right that organizations are apprehensive to put their data into those models in the public version, but there are APIs, there are other ways to consume those things. And what you're talking about, it sounds like a productized kind of way to do that. And that will be very interesting. So certainly keep us in the loop as you progress
Starting point is 00:37:31 on that. I think a lot of smaller organizations especially would be very interested in that. Yeah, it's a cloud AI machine learning model, a know catchphrase over in Europe and it's starting to get some traction here Although it's probably not the right term is you know data sovereignty They really want to be in control of their data And so you know we'll we'll guarantee that you know if you run it on you know these resources with OVH cloud You know you're in complete control And you know we don't look at our customers' data or even do, we don't even do any AI
Starting point is 00:38:08 or machine learning ourselves, like looking at their metadata, trying to understand anything about how they're using it. That's just not our mindset or how we're designed. We really respect our customers' data and their privacy. Well, that is another key point on the privacy side. I mean, I think it was Zoom that got in trouble for that a couple of weeks ago, making some sort of intimation, or maybe it was a full-fledged statement that they were doing that kind of
Starting point is 00:38:33 thing. And the customers are all like, well, hold up now. Are we sure? Yeah. Okay. So it's not the conversation itself, but the metadata. What exactly does that include? And what sort of inferences are you making based on that
Starting point is 00:38:45 data? And that's very uncomfortable when you talk about, and there's a perpetual fear of trade secrets being stolen, IP being harvested, especially if you're in the physical manufacturing of anything or even software. I mean, we see this every week, there's another breach or leak or competitive espionage kind of thing going on. It's relatively scary from that front. Yeah. So I'm glad to hear you're not doing that. Yeah. Well, and yeah, we also always say, yeah, like I said, we're a cloud provider and that's all we aspire to be.
Starting point is 00:39:20 So we're not trying to compete with our customers. So we want to deliver them the cloud that they can use and then build their service and deliver their value add to their customers. And yeah, we're perceived that, you know, there are stories out there about other, you know, large cloud providers who might be doing some of that metadata mining or whatever, and then say, oh, hey, yeah, this customer of ours, they seem to be pretty successful or getting a lot of traffic on this thing. And then, you know, in a couple weeks, you know, they've got their own version of whatever that, you know, tool or software is. That's not how we operate at OVHcloud. That's good to know. And I would tell you that I'm
Starting point is 00:40:02 getting some feedback from the Discord team and other messages that a lot of these guys up in Toronto want to come see your data center to the extent that I don't know where you are in the process there, you guys probably don't want to show too much, but if you do, let me know. We'd be happy to send a crew of cross between AI nerds and home labbers that want to come check out your operation. Okay, great. Well, yeah, we can certainly explore that in the future, but I think we have, and we might need to, you know, do a little more editing on it. But I think for an anniversary that we did, it was the 10-year anniversary of the data center in Montreal last year, or about 18 months ago. I think we did a virtual reality, you know,
Starting point is 00:41:02 run-through of the data center. Let me see if we've got that and maybe we can post it or share it with you and you can share it with your Discord followers. Absolutely. That'd be great. I've got another question about GovCloud or FedCloud, depending on where you are. Do you have that support for that or other
Starting point is 00:41:20 super high security options for that type of critical user data? Is that available or something that you guys are evaluating? We don't yet here in the US, only because it just has not come time for that in the company's history. We've only been operating for a little over five and a half years. So yeah, we don't have FedRAMP and we're not currently pursuing that. But I'm sure in the future we will have it. We do have a lot of customers who are, you know, SLED, state and local government and higher education that don't need the full FedRAMP certification.
Starting point is 00:42:02 And like I said, we've got HIPAA and PCI DSS and some other certifications. Now over in Europe, that is a big play for them. But again, they've been around for 20 years and they're really well known in France. They do a lot of government and public sector work in France, and they do have specific offerings that meet those types of need over there. One of them is called Secnum Cloud that they have for, again, French government and public sector and military and things like that. So in the future, I'm sure, but we're still evaluating the market demand for the sort of customers that we're servicing or going to service in the future.
Starting point is 00:42:45 Okay. So anyone can go check out the OVHcloud website or the OVHcloud US, depending on where you are. We do have a lot of US listeners, but also global as well. But I do have one last question for you. You talked about the guys spending a dollar a month. How can young people or people that are reskilling that want to learn how the cloud works, how some of these instances work, or how can a small business kind of get engaged with you to start small? Do you offer any sort of starting credit or free tier or anything like that to help them kind of edge into a relationship with OVH? Yeah, great question.
Starting point is 00:43:29 So we've got a couple options. So, yeah, if you want to jump right into a bare metal server, like often, you know, we have some of the, you know, the older ranges on sale. The, you know, private cloud, you know, the VMware and the Nutanix stacks, those are larger clusters and more expensive. So that's probably not appropriate for who you're talking about. But on the public cloud side, and again, we do it slightly differently than the hyperscalers and some other competitors. But yes, you can sign up right now today, go to our website, us.ovhcloud.com. You can create an account, create a public cloud project,
Starting point is 00:44:10 which is the first step. That's where all your VMs and resources are going to live. And we'll give you $200 credit to get started. So you can have $200 worth of credits to operate until they run out. So that's different than you'll find some other providers where you get only like the small micro mini resources. Now again, we have some limitations so you can't come in and just get necessarily anything until we've vetted you a little bit.
Starting point is 00:44:39 But yeah, you can certainly get $200 credit to try out our public cloud. And then if you're a small or medium business and you want to move to the cloud, like I said, we're a cloud provider through and through, and we don't want to be, and we're not going to be a managed service provider, but we do have something called professional services. We've got experts in cloud architects and system engineers who, for a fee, provide you and show you how to get set up or how to move to the cloud. And then if you're a partner, if you are a managed service provider
Starting point is 00:45:15 or a system integrator, we're always looking for partners who can help us stand between our cloud and end users. So if you're an MSP or a system integrator and you want to work with OVH cloud, please contact us. We're happy to meet and want to work with you so that, again, you can help all the end customers who might need your services on very high performance for price cloud
Starting point is 00:45:47 that they might not be able to afford with some other providers. Well, that's all very good info. The credit to let these guys get in and get started, I think is a pretty compelling feature. So we'll make sure, or option, we'll link to that in the description so people can find you. This has been a great conversation. I appreciate it, Gregor. It sounds like everything that we had sort of anecdotally thought about OVH, because I'm
Starting point is 00:46:15 going to be honest, like when we did the review of the GPU servers, your team pretty much said, hey, Storage Review, what do you guys want to do? And we said, we're not exactly sure, but give us a couple weeks to get in there and figure it out. And they said, OK, and set up, to be clear, set up a credit for us. And Jordan and Vince and Kevin and the guys got in there and got to work and played around with it. And the fact that you guys just let us come in and do our thing without being prescriptive, without asking, honestly, that many questions was kind of brave for a first engagement on a review. So, you know, appreciate the transparency and more of it here in this podcast and your willingness to engage with a couple of these questions on Discord. So, you know, like I said, we appreciate it.
Starting point is 00:47:06 It's been a great relationship so far. We can't wait to see, you know, where you go with this and what's next. And, you know, like, you know, we'll link to the resources you described on the conversation today for those that want to learn more. But yeah, thanks again for doing this.
Starting point is 00:47:20 We greatly appreciate it. Oh yeah, thanks so much for having me. Great conversation. And yeah, really enjoyed talking to you. And hopefully all of the listeners out there got something out of it. Absolutely. All right. Thanks again, Gregor. Appreciate it. Yeah. Have a great rest of your day. Take care. You too.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.