Screaming in the Cloud - Finding a Fix for the Cloud with Stephen Barr

Episode Date: November 7, 2024

Corey Quinn sits down with Stephen Barr, Chief Evangelist of CloudFix. With his extensive history in the cloud, the pair delve into Stephen's journey with AWS, relatable anecdotes on optimizi...ng cloud costs, and the complex role of tech evangelists in fostering better communication between engineering and finance teams. Corey and Stephen also weigh the pitfalls of early AI adoption, how to come up with effective content creation strategies, and even postulate a hopeful vision of a tech-driven future (from a Trekkie’s point of view at least).Show Highlights(0:00) Intro(0:40) Gitpod sponsor read(1:52) How Stephen defines his role(4:26) Breaking down recent shakeups at AWS and the ever-growing promotion of AI(9:36) How will AI impact how we teach younger people about coding?(13:45) AI marketing, crypto, and other professional grifts(16:56) Stephen's history with AWS and the cloud ecosystem(20:42) Wiz sponsor read(21:30)Oversights that can easily inflate a cloud bill(25:32) Acting as a marriage counselor between engineering and finance(30:09 Stephen's creative process as a Chief Evangelist(33:54) Stephen's thoughts on the future of technology(35:28) Where you can find more from StephenAbout Stephen BarrStephen Barr, Principal Architect and Technical Evangelist at CloudFix, is known throughout the technology industry for his joyful frame of mind and deep expertise in data engineering, machine learning, LLMs, systems architecture, and all things AWS.Even as a teenager, Stephen’s digital curiosity and drive landed him at an email hosting startup working on network administration. He also worked at Microsoft while still a high school student.After graduating from the University of Washington, he continued graduate studies at the University of Rochester and Washington. Stephen has also worked as a data scientist, software developer, technical consultant and more.When he’s not researching or communicating about the power of AWS, Stephen enjoys spending time with his family at home in Seattle. His interests outside of work include science fiction, 3D printing, and the outdoors., Stephen Barr, Principal Architect and Technical Evangelist at CloudFix, is known throughout the technology industry for his joyful frame of mind and deep expertise in data engineering, machine learning, LLMs, systems architecture, and all things AWS.Even as a teenager, Stephen’s digital curiosity and drive landed him at an email hosting startup working on network administration. He also worked at Microsoft while still a high school student.After graduating from the University of Washington, he continued graduate studies at the University of Rochester and Washington. Stephen has also worked as a data scientist, software developer, technical consultant and more.When he’s not researching or communicating about the power of AWS, Stephen enjoys spending time with his family at home in Seattle. His interests outside of work include science fiction, 3D printing, and the outdoors., Stephen Barr, Principal Architect and Technical Evangelist at CloudFix, is known throughout the technology industry for his joyful frame of mind and deep expertise in data engineering, machine learning, LLMs, systems architecture, and all things AWS.Even as a teenager, Stephen’s digital curiosity and drive landed him at an email hosting startup working on network administration. He also worked at Microsoft while still a high school student.After graduating from the University of Washington, he continued graduate studies at the University of Rochester and Washington. Stephen has also worked as a data scientist, software developer, technical consultant and more.When he’s not researching or communicating about the power of AWS, Stephen enjoys spending time with his family at home in Seattle. His interests outside of work include science fiction, 3D printing, and the outdoors.Links ReferencedLinkedIn: https://www.linkedin.com/in/stephenjbarr/AWS Made Easy: https://awsmadeeasy.com/SponsorsGitpod: gitpod.ioWiz: https://www.wiz.io/scream

Transcript
Discussion (0)
Starting point is 00:00:00 think that the fundamentals of cryptocurrency, it makes sense and I like it. But then on top of that little core of truth is this giant pile of scams and garbage and hype. Welcome to Screaming in the Cloud. I'm Corey Quinn. Thrilled to be able to talk with Stephen Barr today. We've talked many times previously, but this is the first time we're doing it in public on one of my properties instead of his. Stephen is the chief evangelist over at CloudFix. Stephen, how are you? Really well, Corey.
Starting point is 00:00:35 It's great to be here on your property talking in an official capacity. This episode is brought to you by Gitpod. Do you ever feel like you spend more time fighting your dev environment than actually coding? Works on my machine issues are too familiar and the VDI setup in your organization drives you mad? Gitpod brings automated, standardized development environments to your laptop and the cloud. Describe your dev environment as code and streamline development workflows with automations. The click of a button, you get a perfectly configured environment, and you can automate tasks and services like seeding your database, provisioning infrastructure, running security or scanning tools,
Starting point is 00:01:15 or any other development workflows. You can self-host Gitpod in your cloud account for free in under three minutes, or run Gitpod Desktop locally on your computer. Gitpod's automated, standardized development environments are the fastest and most secure way to develop software. They're trusted by over one and a half million developers, including some of the largest financial institutions in the world. Visit gitpod.io and try it for free with your whole team. And also, let me know what you think about it. I've honestly been looking for this for a while,
Starting point is 00:01:46 and it's been on my list of things to try. I'll be trying it this week. Please, reach out. Let me know what you think. I have to say that you and I suffer a similar affliction in that it is kind of hard to describe what you do. How do you define yourself as far as the starting, the stopping?
Starting point is 00:02:01 So I like to see it as facilitating a two-way relationship between our customers who are interested in cost optimization and then the engineering and the internals of the company to make sure I can be a trusted source for developers to go to, for the more technical folks within the business to go to and say, hey, does this actually do what we're claiming it to
Starting point is 00:02:25 do to be able to talk shop with the developers in our, with our clients, and then also to make sure to advocate for them. So I see the evangelism as a two-way street. It's not just, it's me doing a lot of talking and that goes through content creation, through marketing, that sort of thing, but also a lot of listening and bringing that, bringing that back to the rest of the team. I've always found that cost optimization tends to be a content area that people care about at very fixed points in time, usually when there's a burning fire, and the rest of the time they could not possibly care less. So my strategy around it has always been to talk about the greater AWS ecosystem and architectural
Starting point is 00:03:02 fun things thereabouts, and just make it a point to periodically throw some of the cost content in to remind people that I exist. And I found that that's been working for eight years so far. I almost see it as like, well, like you said, it comes up when there's a fire and almost like fitness, right? You go to your doctor and he's, hey, your cholesterol is way off. And all of a sudden you're like, all right, I'm going to the gym. I'm getting serious.
Starting point is 00:03:23 I'm going to change my diet. And then we're human. We tend to regress. Three weeks later, we're on the couch eating chips. Exactly. And so it has to be this constant pressure. And I want to see myself as being, in a way, a bit of a constant, friendly encouragement, constant pressure to say, hey, here's something else you can do. And then, yeah, here's something you can try. Have you looked at your EBS volumes? Just like you'd have a personal trainer who is saying, let's push it on this exercise. Let's try and do an extra set this week. That kind of thing, to be that constant pressure.
Starting point is 00:03:54 It's interesting just seeing how difficult it is to define what we do in the context of what we do. I like to sometimes say that we're marriage counseling between engineering and finance, which feels like it is not that far from where a lot of these things tend to play. You don't have a trademark on that phrase, do you? No, no, I don't. I'm sure that will come up in conversation. You have to sit down on the couch here and what are your needs and are you being heard here? That's definitely the case. Exactly. We can talk about insecurities as a safe space Trusting. It'll be great. It'll be great. So lately, it seems like there have been some shakeups over at AWS. There are a lot of things going on over at AWS as of late. I know that they've been chasing a lot of the ML dragons lately. They've had some significant and notable departures that I'm not seeing backfilled. That doesn't mean it's not happening, but it's not happening in the public eye.
Starting point is 00:04:45 My Rolodex, people I know at AWS seems to get slimmer every year. A Rolodex is a list of contact cards for those of the audience who are, you know, younger than we are. It's funny that those analogies are starting to break a little bit. The save button is still a floppy disk.
Starting point is 00:04:59 Yeah, I mean, so just at point in time, we've learned about Matt Wood's departure and there's no official word on where he's going. As of this recording. This is one of those things where just invariably, as soon as we say this and the track is laid down, 10 minutes later, there'll be an announcement and it'll be all over the place and we'll sound like fools. Check the show notes for an asterisk somewhere.
Starting point is 00:05:20 Exactly. Yeah. But I guess with anyone involved in the generative AI space with that larger of a persona, you probably have a lot of opportunities coming your way. So that's my speculation. I don't have any inside information as to where he's going. It's always interesting to me watching how senior executives manage transitions between companies, the way that they talk about it, how they structure it. Like when you talk about like the Uber executive types, the executive VPs at giant companies,
Starting point is 00:05:49 in many cases, they'll do a departure. They'll have a long handoff period. There will be a farewell tour with a lot of the clients. They're generally on gardening leave for three to six months. And then it comes out where they're going to go is generally a step up. The inverse of this is stepping down immediately to spend time with family. It's like, ooh.
Starting point is 00:06:09 We can read between the lines there. Yeah, that sends a message that isn't terrific. And the fun thing is when companies don't realize that that's the message it sends, and it's a legitimate, oh, that's actually what happened, but no one believes it because of the messaging. They need to get new PR for them. Honestly, lately, it feels like so much of the AWS corporate comms apparatus has been aimed at talking about machine learning. And when you start digging really deep into it,
Starting point is 00:06:34 the teams that build and run the services that we know and depend on are still there. They're still doing things that are neat and that are going to be trotted out and reinvent, which is freaking terrific. The problem is, is that that's not at all what gets talked about. I mean, yeah, certainly I'm a machine learning AI optimist, but it has to, it can't take the place, right? I think the pie should get bigger, right? It shouldn't redraw the pie. I really hope reInvent's keynote is not a rehashing what we saw at Google Cloud Next earlier this year, wherein the entire keynote was about
Starting point is 00:07:06 AI and it never pivoted away from that. The problem I'm seeing when these companies flood the zone like this is that when there actually is a fascinating and useful breakthrough that hits from wherever it happens to come from, we're never going to see it because it'll just sound like, no, no, this one is actually transformative and revelatory. You've said that for the last five disappointing flops. So what makes this one different? transformative and revelatory. You've said that for the last five disappointing flops. So what makes this one different? And I think that there's a line, right? And I think that Steve Jobs used to represent this
Starting point is 00:07:31 in this reality distortion field, right? Where you want to be far enough ahead that it's optimistic, but not so far ahead that you have lost sight. Hey, we still have to have EC2 instances and databases and managed services and that sort of thing. And I talk to customers. I fix AWS bills. I see the spend. There is an awful lot of money in cloud and a surprisingly small percentage of that is even tangentially related to AI. Companies have not suddenly given up doing the block and tackle the things that generate the revenue and keep
Starting point is 00:08:03 people employed. You're a 50,000 person company. You're not suddenly going to pivot everyone to AI. You're just not. I mean, I guess I could speak for myself personally and the company where I'm at. I think right now people are doing the similar things, but they're doing it differently. Like right now, whenever I'm trying to do something, I'd spend some time with, how can I do it with AI or using AI or trying to make the scale? But it's also the classic programmer trap, right? Of how do I spend 40 hours to automate this 10 second job? That's part of it. I found that it's useful for certain things and not useful for others. One area where it excels, obviously, is coding assistance. That is effectively a superpower.
Starting point is 00:08:42 Every developer I work with these days is using some form of Copilot or something similar. That is magic. Doing it, something similar for writing blog posts or whatnot, I find it helpful, but only because when it spits something out, it is so bad that I feel the need to dive in and fix almost everything. So there's like 10% of what it originally had that was there by the time I'm done. Usefully for me, that's structure.
Starting point is 00:09:06 So great. I've just filled in the content with things that aren't inane. Yeah, I really like using it to modify and to play with text and help me rephrase this another way and help me turn these notes into a more useful general content. I think starting from zero and saying, write me a blog post about cost optimization, you're going to get out the effort that you put into it. Oh yeah. But even that is helpful for those of us who struggle when staring at an empty screen. Yeah, absolutely. Well, I guess, so here's a question, especially with the coding
Starting point is 00:09:38 assistants for young people who are just starting with programming. Like, how do you, I still wonder about that because I have kids who are of the age where they can start learning about programming, but like, is it now worth it to talk about here's how you write a program or should we just focus just on here's how you use an AI assistant? I mean, cause I don't know much about assembly language. I know the principles, but nothing beyond that. And is programming, is Python going to be assembly for kids? I'm taking my guidance from educators, by and large. Math is a good example of this. Very often we'll see that, okay, we have calculators everywhere now. They're in our pocket. They're ambient in the room around
Starting point is 00:10:15 us. So being able to say, okay, you're not going to have a calculator with you is ludicrous. But I have a second grader who's still learning math without aid of a calculator because you need to understand what is reasonable for a calculator to return. And I feel like there's a similar progression on this, but it comes down to what is your goal? Are you trying to be a computer scientist? Are you trying to get a job as a front-end developer as your first gig out of school or bootcamp? Are you just looking to something that keep the lights on 40 hours a week? What is your goal here? I've always found that a deeper understanding of fundamentals is a terrific thing to fall back on when automated things break, which they tend to do. We've all seen ridiculous suggestions from AI, some of them funnier than others. It's not nearly as funny when it makes
Starting point is 00:10:57 it into production, but there's a strong sense of you need to have a grown-up looking at these things. But senior engineers can see this, sure, but where do senior engineers come from? We didn't just emerge from nowhere. I love how you mentioned math. Have you read the essay Lockhart's Lament? Not yet. Okay, so it's about this math teacher. He is terrified that he's talking about, imagine if music was taught the way math is, and you have to learn all of these scales and all of these theory before you could ever touch an instrument. Isn't that how classical piano training works? The idea is you can just sit down at the piano and just start playing, try and make some noise, and you can learn a lot just by playing.
Starting point is 00:11:37 And I feel like with AI, I can play with programming more freely. But you're right, you still have to go back and learn the basics. You still have to go and learn algorithmic thinking and data structures to some extent, but being able to play more easily. And I think a lot of poor math education is basically like learn all of this stuff, but you don't actually just sit there and play with a number, right? Draw a right triangle and try and understand the relationships between the length of the sides or try and figure out why numbers, when you square them, are always positive or something like that, where you can just sit there and play and you don't have to, it doesn't have to be formal. That's how I learned a lot of math. So much of it was just listening to teachers droning on about
Starting point is 00:12:16 stuff that I already got the first time they explained it. And I'm just sitting there playing with numbers in a notebook because this was before the time you could just waste time on your phone. We could be bored back then. And the exploration that you just do for the fun and the joy of it is where you learn a lot. Yeah. It's being second or third grade and we're doing those, what are those trigonometry proofs where you have like angle, side, angle, and it shows that, okay, if you have an angle and a side and an angle, then these two triangles are, what are they called, congruent. I use some argument that we hadn't officially learned yet. It's like, well, you can't use that because we haven't been taught yet. But it's true, because
Starting point is 00:12:46 if you have this and this, then that has to be true. Yes, we haven't learned it yet. I think some of this formalism can kind of beat the joy out of things. Oh, yeah. Things I love, when I find them being taught formally, become things I hate. I'm going to get grief for this, I'm sure, but so often in English
Starting point is 00:13:02 classes growing up, they pick some of the worst books, and you can tell those books are terrible because they won the Caldecott medal. And it's they have the big seal on the front of it. And it is so heavy with meaning and symbolism that they forgot to tell an actual story. And it's just like, I love reading, but this is crap. If I didn't already love reading, this certainly wouldn't help. I'm remembering an online English class that I took. We were all supposed to write a comment on the book. And I said, the thing I liked about this book, it led to one of the best naps I've had this year. It was so boring and incomprehensible, right? There was no fun in it.
Starting point is 00:13:37 There was no story. It was just lots of metaphor and simile and stuff to analyze. But there's no, there's nothing, there's no substance. Which brings us back to AI marketing, which is what worries me, because in many cases, there is substance behind these things, but it's attenuated, and it's difficult to get to a point where you can see it being useful. And there's also a lot of defensiveness that factors into this. People are, in many cases, worried about, how is this thing going to take my job away from me? As a counterpoint, I don't see too many jobs except at the margins where that is a realistic possibility in the near term. So there is time.
Starting point is 00:14:09 If the crypto world is hard to sort out, AI is going to be so much worse, right? And I think that the fundamentals of cryptocurrency, it makes sense and I like it. But then on top of that little core of truth is this giant pile of scams and garbage and hype. And so I think with AI, it's going to be even harder to sort out what's hype, what is someone just with a cool website and going for venture capital and taking us off a ride versus, hey, this is a new innovation, this is a new model. I think that's going to be harder to sort out. And that's where, well, hopefully people, I'm trying to keep myself in the know as much as
Starting point is 00:14:45 possible and try to be able to sort that back to the reference point for that yeah it's i think there's going to become a future where this is just how computers work like it just it's unthinkable to sell a computer these days without an ssd attached it's similarly it's going to go oh of course it's going to have an ai compatible gpu equivalent whether it can actually display graphics or not is almost beside the point. Yeah, maybe we've kind of topped out on what we need in terms of graphics, but AI, yeah, AI focused processors
Starting point is 00:15:11 probably have lots of room to grow. For text-based LLMs, for the conversational stuff, I'm getting great results just on my existing Mac hardware, which is not terrific when it comes to GPU, because that's never been its goal, but the performance is just fine. I'm getting, in some cases,
Starting point is 00:15:28 what, 200 tokens a second? Yeah, are you using, like, Ollama, or what are you using? I'm using Ollama with a bunch of, obviously, submodels under that, where people have, where I've done a lot of, I've done a lot of playing with some of the custom models, people have tweaked and done some enhancements on top of Ollama itself,
Starting point is 00:15:44 of course, people playing with Gemini as well, or Gemma, whichever one, the one that you can run locally is like, Google's bad at naming things. Who knew? Yeah. My most capable local machine is a Mac M2 Max. And yeah, I use a Llama as well. And it is impressive what you can do locally. Although I do wish I had maxed out the internal storage. I didn't realize we're going to be downloading these 70 gigabyte blobs. Yeah. When I wound up building out my Mac Studio M1 Ultra back when the pandemic was just getting started, it was the first generation of Mac Studio. I went for the middle of the road processor and I wish I'd gotten higher just for the GPU story on that. It's hindsight. Is it worth paying another $7,000 to correct the mistake? Not so much. I was in an Apple store just the other
Starting point is 00:16:30 day and it's like, I can't think of a reason to upgrade my stuff at the moment. I mean, this is an M1 Max and then I have an M2 Max Studio. Yeah, I'm on a laptop myself, M1 Max. I got it as a quick laptop in a hurry for re-invent in 2021, and I haven't felt the need to upgrade it since. Of course, I also used to travel exclusively with an iPad Pro, so I'm probably not the best example of this. If I need some actual heavy compute, well, that's what the cloud is for. So I'm curious as far as what is your history with AWS? You've been around the ecosystem an awful lot. It's fun talking to folks who've been in this back. We can remember when there were enough services that most people could hold them all in
Starting point is 00:17:10 their head at the same time. Okay, this is an interesting one. So I was doing a research project with some professors at the UW. I was an undergraduate at the time and they were finance professors. And we were looking at this lending marketplace called Prosper. And Prosper, it was a peer-to-peer lending platform where someone who was applying for a loan, so they wanted, I don't know, $5,000 to deal with a plumbing emergency, and they'd write who they were, and they'd have their standard loan information, but they'd also provide a writing sample and a photograph. So you get all the standard loan information, right? What's their credit score? What's their debt to income ratio, that stuff. But you'd also have their writing in
Starting point is 00:17:49 a photograph or several photographs. And at the time we had a relatively new service. This was 2007, I think we had Mechanical Turk. And so I wrote a bunch of Perl scripts for these professors to put all these images onto Mechanical Turk. And for those of you who don't know Mechanical Turk, you can pay one cent or two cents or three cents and you can get people to do these little jobs called human interface tasks. A lot of those jobs are now replaced with image recognition, that sort of thing. But at the time, you'd use it for looking for something in an image. It was a good use of that. And so we'd ask, is there a dog in the photo? Is there a puppy?
Starting point is 00:18:26 Is there children? And try to figure out, did these photos that people were putting in to their loan applications, did they add extra value in terms of people estimating probability of repayment? Maybe the people who put puppies in their loan photos, are they better loan candidates and why? These were behavioral finance professors and so i spent a lot of my undergraduate my last year writing a mountain of pearl scripts i learned about mechanical turk i actually i asked my dad so my dad jeff barr chief evangelist aws i asked
Starting point is 00:18:57 him we set up a little meeting with these professors and it was all it was just such a little ecosystem at the time it was so so fun just how small it was. Yeah, we wound up building out a lot of stuff in Mechanical Turk in the early days at Expensify for receipt optical character recognition on that and understanding what a receipt is because there's a lot of variety in receipts. These days, systems are pretty decent at doing that. But, you know, 2012 when I was there,
Starting point is 00:19:22 that wasn't the case. Mechanical Turk was great for it. You'd spend fractions of a penny per read on this, or a couple pennies, and it would work out. Yeah, absolutely. So that was my first exposure to AWS. Later, I was in grad school, and I was helping another finance professor. She had this really expensive GPU rig, and she had written this simulation that had run for like three weeks on her desktop, running the simulation over and over again for different parameters. And she had submitted this paper to get what is called reviewed by her peers. And she got really nervous that she wanted to make sure that the simulation was reproducible, but she only had three or four days to do that.
Starting point is 00:20:05 And her simulation took three weeks to run on her local machine. And so at that time, there were six regions. And so I maxed out what my account could do, which was 100 instances per region. And that was the first time I had written a program that could spend a substantial amount of money. And it was really simple architecture. It was pull from an SQS queue
Starting point is 00:20:26 and committing private keys to GitHub. Yeah, I accidentally helped someone start a Bitcoin farm once. I don't think that there are too many people from those days who didn't. I'm so glad that GitHub will detect that now. That has saved many a person from financial ruin. This episode is brought to us by our friends at Wiz.
Starting point is 00:20:44 Wiz is on a mission to help every organization many a person from financial ruin. In other words, nobody beats the WIZ. WIZ connects in minutes using an agentless approach that scans both platform configurations and inside of every workload. They provide a deep assessment that goes well beyond what standalone CSPM, CWPP, and other unknowable acronym-based tools offer and find the toxic combination of flaws that represent real risk.
Starting point is 00:21:23 To learn more, visit wiz.io. That's W-I-Z dot I-O. What I find interesting is that the large scale of company that I tend to spend most of my time talking to, if there's a breach and someone gets keys and starts mining Bitcoin, it's a lot harder to detect because, yeah, my personal bill is what, 50, 70 bucks a month, something like that, depending on how aggressive I've been with serverless that month. And yeah, OK, now it's $5,000. I'm going to notice that or 50,000 or 500. Whereas when you're spending tens of millions of dollars a month, that starts to really disappear into the background noise. You got to be paying a lot of attention to even notice it happens. Oh, gosh. I was working for a company that shall remain nameless, but they gave every consultant and
Starting point is 00:22:09 every person who needed it the same root credentials to their AWS account. Everybody. There's no, no, I... In my early days, someone emailed me theirs, which scared the crap out of me. And so they had this app that could have run on a Raspberry Pi, and the spend was like $30,000 a month and growing. And they didn't know what to shut off and what not to. And it was a well-funded organization, so they could kind of live with this. And I think there was some accounting maneuver to subdivide this.
Starting point is 00:22:37 But yeah, it was really terrifying what could happen through these bad practices. Oh, yeah. I care a lot less, to be very transparent, about the big companies taking the unexpected financial blows. They can absorb those. It's the independent learners who are just figuring out how this stuff works. Maybe they trust the wrong person on Discord or whatnot, and suddenly they're staring at what they believe to be an insurmountable amount of money. $700,000, that's more than I'll ever make in the course of my life, which is not generally true, but it feels like it's the world is ending then. And AWS has never been great at making people feel reassured while they're looking into that. I haven't heard too many stories where they haven't made it right, at least the first time, but you're twisting in the wind for a week or two first,
Starting point is 00:23:19 not knowing. Yeah. There's that moment where you're like, oh my gosh, what am I going to do? And does it even cross your mind? Okay. Do I, if I get on chat, are they going to forgive me? And if I call up support and yeah, like you said, they all, they usually let you off the hook unless you were phenomenally egregious and have done this multiple times. But if they determined that it was a genuine mistake, they'll, they'll look after you. Yeah. It can be frightening to get a bill that's multiple times your monthly income. Oh, yeah, it's horrifying. And I'm just glad that it seems like I haven't had seen nearly as many of those stories lately. I think a change that is absolutely for the better
Starting point is 00:23:57 that is in the process of rolling out is mandating MFA when you spin up an AWS account. It's so many other things mandate this, and it's just such a no brainers. Well, it'll act as a break on growth. If someone's not willing to give a phone number for a text message or use Authy or something like that, then I don't know that you want them in your cloud environment in the first place, do you? No, I agree with that. Use MFA. That is a good idea. And even the inconveniences that it can sometimes cause, like if you're not good with your backups and you lose your phone, well, yeah, that could hurt. You're going to have to go through some manual steps to deal with that. But the blast radius protection that it gives you is well worth that. And that's what we always say, limit your blast radius, right? If you have
Starting point is 00:24:45 an AWS account, you can turn off people being able to start GPU instances or the SAP HANA instances, the X ones. You don't want to accidentally turn one of those on. I haven't, I confess, I haven't put a lot of those in place for our internal corporate org, just because everyone who has access to touch that stuff has multiple years of experience within the AWS universe. So there's, at some point, we're absolutely going to have to get some religion around stuff like that. And we do have segregation of who can look at data, but we, at this point, it's assumed that, oh, if you're spinning up a GPU instance, you probably know what you're doing. Maybe it's time to revisit that assumption. Yeah, I think we have it in our larger org,
Starting point is 00:25:20 just to make sure, okay, if, and it's not to stop people, but it's saying, okay, there's a hurdle because this hurts. So just make a hurdle in place so that if you're doing this, you know that you're doing it. Don't, it's principle of least surprise on some level, I think is really where it winds up hitting. Speaking of surprising people. So when you talk to folks who have been at big companies and are being confronted with areas for improvement when it comes to their
Starting point is 00:25:46 cloud spend. You and I were talking about this earlier. It's why I call myself basically marriage counseling between engineering and finance. There's a lot more people and behavioral aspects to this than there are raw math. The reason that cloud costs are complicated is only partially due to the fact that arithmetic is hard. There's a lot more to it than that. What's your take on it? I completely agree that many of the issues are people issues, right? People who might be scared of change or want to protect territory and don't want any... There's a lot of those types of things. And also, people don't want to look bad. Their careers are on the line. So if you say,
Starting point is 00:26:24 look, we can save you this amount of money. It's easy for someone to react and say, wait, why didn't you do that? You were my AWS person. Why do we have to hire these external people who are then pointing out what you should have been doing in the first place? But that's what you don't want is this finger pointing to start happening. So ideally when people see the savings they can do, they have to say, okay, I know you were doing the best you can. We brought in some experts to help you. And look, there's so much more on the table. We're really excited. Now we can do this project and that project. And you're right, it's a marriage something successful while trying to do it for the absolute least amount of money physically possible saying no to something else. Where do you draw the line? What is the priority? Because when everything's the priority, then nothing is. Where do you want people's energies focused? Because there's a certain mindset, and I admit I'm one of them, where I will spend, belieffully, a month just knocking a few hundred bucks off the AWS bill. I cost more than that.
Starting point is 00:27:46 So what is the actual value that I'm contributing? At some point, one of my roles is to tell people, okay, stop saving money here and go back to doing the thing your business does. That's a really, really good point, right? There's only, there's diminishing returns to this process. That's why having to automate what you can, I think we're big believers in that. So for example, GP2 to GP3, right? That should be automatable.
Starting point is 00:28:08 I view them in buckets on some level. Like the first pass is generally, okay, great. Click three buttons and you'll save 10%. The next 10% is going to require some re-engineering work. And the 10% after that is borderline taking hostages in Seattle.
Starting point is 00:28:20 So there's a, it gets harder and harder once the low-hanging fruit gets found and sorted out. But there's also a question once the low-hanging fruit gets found and sorted out. But there's also a question, increasing the enterprise, of how you handle governance. How do you get 1,300 teams all rowing in the same direction? And that's where it has to be, is that relational thing, getting the top-down buy-in, but then also having the credibility with the engineering teams. They look, we're doing things. This is, we know our stuff.
Starting point is 00:28:48 We're trying to do things that are generally applicable. And that's the other thing we find. I'm sure people in my position, your position, you get to see a lot of different AWS accounts. And so you can think very generally about them. Whereas often when you talk to someone at their company and they've been there 10 years and they've nurtured it from the very first EC2 instance up to where it is today, it's very easy to convince yourself that no one else uses AWS like we do. It's one of those ideas where you're right. At enterprise scale, no one is going
Starting point is 00:29:14 to use it exactly like you do, but there are patterns, history rhymes. There are, okay, great. Maybe your naming structure is different, but you're still going to run into the same foundational problem that other companies are. I i mean it's like the marriage counseling example again right you're doing this every problem is unique because you can't come in as a consultant under the tagline you're not special it does not go well because who who wants to be like everyone else yeah exactly but at the end of the day they said there's patterns there's things that you can do that are generally applicable and that's what one of um like talking to private equity firms who have a portfolio of
Starting point is 00:29:51 companies and they want a policy across their companies that often resonates a bit better we found because they're in the mindset of thinking at a process level about companies and a process level about operation whether than like some idiosyncratic, here's the one AWS account for this one, I don't know, company. There's a lot there, but I do want to get to one more topic before we call it an episode
Starting point is 00:30:13 because you are a chief evangelist. Huzzah. Talk to me about content creation. What's your process? Quick self-promotion. We have a show, AWS Made Easy. Myself, my co-host, Raul Subramaniam, try and stream every week.
Starting point is 00:30:25 We interview AWS guests. We try and cover AWS news. We rate and review articles, that sort of thing. I got some really great advice early on, which was get to 20 episodes. And I heard somewhere that on the Spotify distribution, most podcasts are like three or four episodes and then they just vanish, right?
Starting point is 00:30:43 It's a couple of people. They meet up for a few drinks, do it in their garage, launch a podcast. They lose momentum. So my first thing was get to 20 episodes. And then we did that. So number one is prioritize shipping it over quality. And I'm sure you've seen that with video editing. There is no end to how much you can kind of polish an episode.
Starting point is 00:31:03 I've never touched it. I've always just handed it off to professionals. It's the most common piece of advice I give to people who ask me when they're starting out. I'm like, okay, what microphone, camera, et cetera, should I buy? Doesn't matter. Doesn't matter. You can record something just fine on your smartphone to get you started. If the content's good, people will forgive an awful lot in production value.
Starting point is 00:31:21 And if your content isn't good and isn't compelling, it doesn't matter, because no one's going to stick around to see it. It's trash, but it's so well produced trash doesn't matter. No one wants to watch trash. There's an attention economy. I agree. But also at some level, you do need to pay attention to that stuff. And maybe it's just, you know, when your head gets into it, you hear a great piece of content, but you're like, it sounds like it was recorded in a bathroom. maybe that's part of uh having been in that content creation space for a while right maybe i would have never noticed it before and now i notice it's almost how like people audiophiles say that it kind of ruins music for them because they say oh it doesn't sound right it was recorded on this instead
Starting point is 00:31:57 of that so in general try and prioritize shipping try and do the best we can quality wise in a bounded box of time and money and effort. And yeah, most importantly, like you said, make it usable and try and distill down our experience of dealing with a lot of AWS accounts to make it useful for people, people to be able to submit questions. And we try to make shorts and clips.
Starting point is 00:32:21 That's been really nice to be able to give people a small taste of it because our episodes are an hour-ish and being able to have a 60-second clip that shows, it just plants a seed and then a link to more. That's been really nice. It's nice to see people grow, but I think that people also try to early optimize that. And the problem is there's no end to it, right? There's literally no end. And then as a tech person, right? It's fun to nerd out on the gear and the stuff and the switchers and the distribution. And then you have the AI layer.
Starting point is 00:32:51 We say, can I automate everything? And then it takes 30 minutes to get your audio working to join a Zoom call. I've been there. Yeah, exactly. I mean, if I open up my audio devices, it's like nine different things, right? Because you keep changing your setup. Okay, sorry. Is it this one?
Starting point is 00:33:04 Is it that one? Is that one? Oh, wait, I'm on my UMC 404 HD today and not my Blackmagic. But I think it's with any approach, right? Try to do the best you can within a bounded level. And ideally, it's about the listener and adding value for them. And we always try to ask our listeners for feedback, answer questions when they ask, Not making it about ourselves, but about remembering who the audience is and trying to add value for them. I find you have to write with someone in mind. Otherwise, you're just speaking in generalities and that doesn't help. Yeah.
Starting point is 00:33:35 Think about who is our persona. Our persona is someone who they have AWS. Managing their AWS account is one of their many responsibilities. And if they listen to us, they can pick up something useful that can help them without having to hit refresh on the AWS What's New page like you and I do. Exactly. I have one last question for you, because I'm going to invite you to embarrass yourself as, you know, it is always the way it works when you make predictions. Where do you see the future of technology going? You've been around in this space a long time. I have as well. Where do you think the future is? Is it darkness? Is it awesome
Starting point is 00:34:09 stuff? Is it something in between? I'd like to be an optimist, and I hope that we're heading more towards the Star Trek universe than a dystopian future. I think about some of the building blocks that we're working with right now with LLMs all the generative things there's a great scene in star trek first contact where the crew of the enterprise is transporting to earth and they've traveled back to the late 21st century and they say okay beam us down switch us to late 21st century civilian clothing and thinking about okay what had to happen for that to work right there has to be some ai about well what what clothing were the civilians of this time wearing and what were they doing and there's a lot of stuff that had to happen in order to make that work and i think we're playing with those building blocks right now right that are
Starting point is 00:34:56 our descendants are going to be playing with you know bedrock 3.0 which might power a transporter um so maybe maybe that's the case or i'm hopeful that that's that's the case the flip side of that is the amount of monitoring that we can do on ourselves and trying to squeeze the humanity out of some of the processes in the name of i don't know efficiency so i worry about that i'm hoping that uh in general i'm an optimist so i want that i'm hoping that we tend towards the Star Trek outcome. I do too. I really hope you're right. I really want to thank you for taking the time to speak with me today. If people want to learn more, where's the best place for
Starting point is 00:35:33 them to find you? Find me on LinkedIn, Stephen J. Barr. Type that in, look for a guy with my face, and that's probably me. So thank you. Stephen Barr, Chief Evangelist at CloudFix. I'm cloud economist Corey Quinn, and this is Screaming in the Cloud. If you've enjoyed this podcast, please leave a five-star review on your podcast platform of choice. Whereas if you hated this podcast, please leave a five-star review on your podcast platform of choice, along with an angry, insulting comment that your descendants using Bedrock 3.0 will one day discover.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.