Algorithms + Data Structures = Programs - Episode 301: My Existential Crisis, AI Fluency & the Death of Conferences?

Episode Date: August 28, 2026

In this episode, Conor and Bryce chat about the future of technical communities, AI fluency, Conor's existential crisis, Auto Research Academy and more!Link to Episode 301 on WebsiteDiscuss this ...episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioBryce Adelstein Lelbach: Twitter | BlueSkyShow NotesDate Recorded: 2026-08-12Date Released: 2026-08-28GOSIM ConferencesModalEURO PYTHONGPU MODEIntro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusicCreative Commons — Attribution 3.0 Unported — CC BY 3.0Free Download / Stream: http://bit.ly/l-miss-youMusic promoted by Audio Library https://youtu.be/iYYxnasvfx8

Transcript
Discussion (0)
Starting point is 00:00:00 And so your estimation of how rapidly this will be put into production across the industry, your meter may be a little miscalibrated. And two, I think because we work at Nvidia, we're in a bubble, and we don't realize how early things are. But like, generally, I think you are more optimistic about what current models' capabilities are. I am constantly frustrated by what current models' capabilities are, but can still get a lot done with them. And this is the reason why the C++ evolution process, it's just not competitive. Is C++, like a three-year cycle does not reflect the rate at which our industry is changing.
Starting point is 00:00:41 Think about how much our industry will change in three years. So the next C++ standard will be C++29. Given everything we know about the revolution undergoing our industry right now, how can we possibly expect to get anything meaningful, out of C++ plus 29. Welcome to ADSP, the podcast, episode 301, recorded on August 12, 2026. My name is Connor, and today with my co-host, Bryce, we chat about my existential crisis due to AI, AI fluency, the potential death of conferences, auto-auto-rearch, and more.
Starting point is 00:01:32 All right, I mean, should we pick up where we left off? You believe humans still needed. I am doubtful. Tell me your topic. All right, my topic, I mean, my topic is dovetails off of, you know, if we assume, you know, humans aren't really needed for coding. You know, what happens? I've been spending a lot of time thinking about this, like, post-AGI, you know, kind of world we live in. And it's the title of the episode that I had in my head, which may or may not change by the end of this recording with you, is the illusion of necessity.
Starting point is 00:02:07 And in a nutshell, or a larger nut with or without a shell, the idea is that I've come to realize that, like, technical conferences, technical committee meetings, a lot of stuff is just, you know, it's like that Matthew McConaughey scene from the Wolf of Wall Street. Do no, no. Where he beats his chest. It's a Fagazi, it's a Fagasy. It's all a Fugazi. You know what Fugazi is? Pugazi, it's a fake. Yeah, Fugazi, Fagazi, it's a Wazi, it's a Ferrydust.
Starting point is 00:02:44 It doesn't exist. It's never landed. It is no matter. It's not on the elemental chart. It's all just kind of, we just made it all up, you know? Do you know what I mean? It's like Microsoft, Bloomberg, all these companies that use C++, they are companies that created value for some definition of the word value for the world.
Starting point is 00:03:04 you know, they're profit generating entities, and they use C++ as a tool to generate that value. And so, you know, they started saying we should get together in person because if this is a tool that you're using to generate value, you can justify sending people to these places to meet, even if it isn't necessary. But it's like, you know, these people are creating us value. We've got to keep them happy.
Starting point is 00:03:29 Let's send them to Hawaii. Let's send them to whatever, all over the world. and then like these changes in the language, which some definitely are good, you know, move semantics, you know, helps speed up programs, et cetera. Not all of it's bad, but you could argue that 50% of what the C++ committee does in terms of library development, which I know, you know, you were a library chair for a while. I don't mean to shoot on your past. But, you know, arguably we could have just had a package manager and called it a day, you know?
Starting point is 00:03:57 So like, it's like these meetings lead to language changes and library. standard library changes, which then lead to an ecosystem of conferences where people are meeting to do conference stuff. And it's all just like, you know, other communities evolve their languages without, you know, meeting in person. And it's just, what's my whole point is just that, like, I think the real reason that all of this stuff ends up being created is just to keep people happy. You know, there's two people that I will not name that I have an immense amount of respect
Starting point is 00:04:28 for that said the C++ committee is just a social. Club. At the end of the day, that's what it is. It's people that like getting together to talk about technical stuff. And yeah, I do not, I do not disagree with that. The pandemic was a great opportunity. Ever since I joined the C++ plus committee, I found the process of language evolution to be archaic and just burdened by process and acronyms and unwritten rules. rules and guidelines and procedure. And I try my best to modernize and improve it. And we had a real opportunity with the pandemic to modernize our process, to move to
Starting point is 00:05:16 asynchronous work. And a large part of the committee was like, nope, we should just shut down and not do any work during the pandemic. We can only possibly evolve this language by meeting in person. And I mean, the argument, on the other hand, is that asynchronous work. Not everybody can make time during their regular job to do asynchronous work and that there is a value to the intensity of, and the focus of everybody being in the same place at the same time, and that when you're there, you are 100% focused on the work that you're doing for the week.
Starting point is 00:05:50 And I do think that that is true that you do end up 100% focus for that time. However, I've never found the argument compelling that people can't make time asynchronously to work on the C++ standard throughout the year. And I think that, you know, there's a large, there's a large part of the C++ committee that, that for whom it is a hobby and not part of their day job, and those people would be disenfranchised by moving to a different process. But I actually think that was beneficial. We had too many stakeholders in C++. The people who should be making the decisions about C++ should be the people for whom working on C++ is their primary job. So the implementers and the other key stakeholders in the language,
Starting point is 00:06:39 like, that would have been better. I think that would have been a better model. But during the pandemic, there were many opportunities for the committee to modernize, and the committee rejected almost all of them. And in fact, many things, innovations and improvements that were made during the pandemic, my impression is that they have been rolled back and that now we have moved back to more or less the same process that we had beforehand,
Starting point is 00:07:10 which was entirely in-person meetings. And this is the reason why the C++ evolution process, it's just not competitive. C++, like a three-year cycle does not reflect the rate at which our industry is changing. Think about how much our industry will change in three years, right? The next C++ standard will be C++29. Given everything we know about the revolution undergoing our industry right now,
Starting point is 00:07:41 how can we possibly expect to get anything meaningful out of C++29? Like a three-year cycle, right? Like how is the process that we've previously used for evolving C++ plus? How does that make sense when everything is changing? So no, I don't think that C++ will continue to be relevant for that reason. The length of the cycle is an artifact of the archaic process that is used to evolve C++. And there has been no, it's very hard to get people to vote to disenfranchise themselves, but that was the only way that that could have happened.
Starting point is 00:08:28 But the industry has moved on. I don't think we, C++ does not have the same level of priority they used to have. in the barrier to entry for language compiler evolution is a lot lower now. And at least for my industry, for the compute industry, most of the interesting work doesn't happen in C++. It's a legacy language there. Most of the interesting work happens in dialects or compilers, in Python dialects or compilers. That's something we've talked about a lot on this podcast before.
Starting point is 00:09:01 But, like, was it all just a social club? I think there was a time in the 90s in which the collaboration model of the C++ committee was the only model that could have worked. So it literally started like at the beginning of the internet era when we did not have the tools that we had today. So no, it was not always just a social club. But the fundamental flaw was that the committee modernized C++ but never modernized itself. And that is why it has failed. So I want to separate two things here because there's the C++ committee as a, is it successful? Is it not successful?
Starting point is 00:09:42 We both agree. It's not going well. Not going the right direction. That being said, you know, a part of my whole existential crisis thing and realizing that a lot of the ecosystems that exist in the world, technical ecosystems, whatever, other ecosystems, you know, we've created them. And a huge aspect of them is the... social component. Whether or not you agree that like the C++ committee is like primarily a social club
Starting point is 00:10:12 or not, you know, you can agree, disagree. But the thing that I guess it leads to my existential crisis is that I think social clubs are good, you know, whether or not they should be, you know, there's a fire truck in the background, whether or not, you know, they should be whether the C++ committee that has the task of evolving the language and the library and a lot of people, you know, there's a lot of people are paying a lot of money to fly these places. You know, as a side point, it's more that, like, there's a part of me that's, like, sad because, you know, the, I don't go to the C++ committee
Starting point is 00:10:46 and haven't for years, for other reasons. And I still go to conferences, but are conferences going to disappear too? I think language. No, no, I actually, I said this at the Platsy Conf in Mexico. It was actually a very interesting talk about mentors and sort of my career journey and how to volunteer and get involved in tech communities. One of the points I made there was that in the current age where every internet,
Starting point is 00:11:19 social media platform and forum is filled with AI generated content, I actually think that there is a higher value placed on in-person events because it's a higher value placed on in-person events because it's more genuine. It is hard to fill. The signal to noise ratio on social media platforms, on online communities is a lot higher than it used to be. And so if you're getting started in this industry, how are you going to make connections on the internet?
Starting point is 00:11:58 I think it's harder than it used to be, and I think that there is still a great value in local events and in conferences. And one of the points I made is like, yeah, if you want to get started in tech, it is important to have a network. And the best events are the events that you can get to. So you don't necessarily need to go to a big conference if you can find a conference or a meetup in your community. And if there isn't one, you can start one. But I do think that these have a great value, maybe even even. more of a value than they had in the post-pandemic pre-AI era.
Starting point is 00:12:37 To a certain extent, I agree. I guess the part I'm worried about is like... Hang on, every time you're talking, you've got to say that again, you broke up. I've got my recursive self-improvement agent running, though. But we can start it up again once I... What is it recursively self-improving? Well, I figured I've got my little colonel agent program and, you know, I'm trying to get it to improve. And I just figured, I was like, you know what, why don't I just put my loop inside a loop and tell it to improve itself?
Starting point is 00:13:10 Yeah, that's, I've been, I've been looking at doing that, at doing auto research. Yeah, I've been looking at that recently. This is like auto auto auto research, though. Yeah, yes, that's, that's specifically what I've been calling it is auto auto research. Yeah. It's very compute intensive, though. Yeah, I haven't cracked it, cracked it the code perfectly yet, but it is very colorful to look at. Anyways, I mean, the question is, it's like, you know, there are conferences that I want to go to because it's fun.
Starting point is 00:13:38 But, you know, I feel like I should be careful with the words that I say, you know, because it's not like I don't want to get, like, I don't want to be uninvited from conferences and stuff, but I just, I don't see the value in going to a C++ conference or going to. Oh, yeah, I haven't, I haven't, I haven't been to a C++ conference in a while. I'm going to a Gentic conference. Yeah, but that's the thing. So I was going to say, like, insert any programming language conference, really, is like, I just, yeah, I don't, I don't really see the value from a, like, technical perspective. Like, I could make that argument two, three years ago, and it's also enjoyable to go to the conferences, but now I'm just like, if it's not AI-related, but then it's kind of sad because then, like,
Starting point is 00:14:23 you're you're kind of like not abandoning a community you were a part of and this is like the whole like I feel like I kind of bouncing back and forth and not coherently making my point but like I think the community is like super important is it was one of the outcomes of my existential crisis is that like being a part of a community whether it's technical whether it's like friends and family it's very important it's like it's like part of the essence of being human in my opinion if you don't have like a community it's like that's what leads to depression or I'm sure like one of the things that contributes to depression. And so like to be in this moment where for a while I was going to either functional conferences
Starting point is 00:15:02 or C++ conferences or Python conferences and then realizing that like there's a huge shift in the industry that I work in, which is now kind of like rendering those communities. Like it sounds harsh to say obsolete. But like that's kind of how it feels a little bit. like and anyways it's just coming to turns that's why like i said like the illusion of necessity like was it even necessary before not really but like you can justify meeting up because it is good for continuous learning and it's very it's very healthy to like especially if you're a remote no i i still i still get a ton of i still got a ton of value out of interacting directly with
Starting point is 00:15:45 our with like users and with tech communities at conferences but like you said you said you started going to agentic conferences now. Not C++ conferences. Yeah, but like I still go to Python conferences. I'll probably still go to some rest conferences. Like the events I've gone to changed a bit, but, and like the focus has changed. Like, I used to go
Starting point is 00:16:04 to conferences to go for the talks. Now I go almost exclusively to, like, talk to people. But like, I, I don't know, I may, I may, I may go to less events in the future just because I feel like it's cutting, like, I feel like I have more to do as an IC
Starting point is 00:16:20 contributor now than I have had in a long time and that feels more impactful and I want to spend more time doing that and I don't know that and the amount of travel that I do cuts into that so I may like I've turned down speaking opportunities through part of the rest of the year I may I may do less travel in the future so like rattle off to me because I know you were at a couple python events like what are the agentic conferences you've gone to and like have you been invited to speak at these? Have you applied to speak at these? I went to GOSM. I went to GOSM Paris. There's Agent Conf that's in Poland that I heard about. There's another GOSM that I might go to. There's a bunch of these conferences out there. There's a bunch popping. I don't know which ones
Starting point is 00:17:05 are like necessarily the most popular. There's like the Pi Torch conference, the MLSys, like ICML, like all the big AI conferences. Like I think those ones are still like, you know, super important and relevant to go to. And like you do also have to keep in mind that like, Like, we're still very early in the AI era. And it's going to be, like, this is an industry that moves very slowly and is a lot of inertia. And, like, yeah, like, things are moving fast now. But if you look at, like, adoption, like, adoption is still relatively slow. And, like, I continue having conversations with people.
Starting point is 00:17:41 Like, one of the biggest takeaways I have from going to conferences is talking to people and realizing the disconnect between where I am on AI. and where other people are on AI. I did this thing that I may try to turn into... So I have a vision. So I... Let me take a step back. I don't know how to teach CUDA anymore
Starting point is 00:18:01 because I, for the last 18 months, have, like, been the person maintaining and developing a lot of the CUDA educational content that's on NVIDIA's Accelerated Computing Hub. Like, I rebuilt all of our CUDA Python stuff from the ground up. I sort of took on the maintenance of the CUDA C++ stuff that our colleague Georgie maintained, and I've sort of been the steward and shepherd for this content. I've been doing a lot of teaching and training sort of prior to the long horizon, agentic revolution at the start of this year.
Starting point is 00:18:31 And then since that start of that revolution, my interest in focus on the educational content has decreased a lot because it just feels so outdated, like popping up a Jupyter notebook and having people like type code into it. And so I did this thing at EuroPython and Eurocypi sprints that was kind of impromptu. And I have to give a big thank you to Modal. Model is a serverless GPU provider. So they provide GPU compute for inference, for training, and also for like sandboxes and notebooks. And so instead of you like renting a GPU node for where you're charged per hour or whatnot, they let you like spin up a GPU environment where you can like run one function on a GPU. And they have this checkpoint and restore thing.
Starting point is 00:19:22 So like you can run one function and then like go do other stuff and then go run another function later in the same environment. And what they'll do is they'll cache your environment somewhere and then they'll restore it later and they can restore it very, very quickly in a matter of milliseconds or something like that. Anyways, modal people were at EuroPython and I basically propositioned them. on like Friday morning for a pile of credits to go do this sprint and they were able to get me set up very quickly, which I greatly appreciate. And what I did for the sprint is a prototype of what I'm going to call Auto Research Academy. And our listeners may or may not know about GPU mode. GPU mode is this kernel coding, this kernel, GPU kernel programming community. And they regularly run these GPU kernel coding competitions. And one of the reasons to run these GPU kernel coding
Starting point is 00:20:21 competitions is that they are a great way to generate high quality data on what good GPU kernels look like and what optimizing new kernels look like. And that data is very useful for people that want to go and train models to be better at writing Kuta code. And the kernels themselves can be very useful. Some of the kernels generated by this coding competition. So this training data, or this data from GPU mode can be very valuable. One, the kernels themselves are very valuable. Some of the kernels developed for these coding competitions have influenced things that have gone into open source libraries or in video products. The data itself is published openly and people can use it when they're doing research on developing new open models or using it in their model
Starting point is 00:21:10 training to make their models better at writing GPU kernels. But so we did a bunch of contests, the GPU mud did a bunch of contests over the summer, and those contests were all focused on these linear algebra kernels, so QR solvers, Chilleschi solvers, and eigenvalue solvers. And one of the competes was ongoing during the EuroPython and Eurocypy sprints. So the premise of the sprint was you're going to come and learn how to compete in these contests. And you don't need to know anything about GPU programming.
Starting point is 00:21:40 because what you're going to learn is how to set up an agentic loop to compete in these contests, so how to do auto research. So no GPU knowledge is required. And I just gave people, you know, an inference key for Nvidia's inference hub. So I just like set up an inference key for seven days. And I just, you know, told people, just go wild, do whatever. And we had, I think, eight or nine people show up in total. and the sprints are over course of two days,
Starting point is 00:22:12 and it was absolutely amazing. Some people had never done any GPU programming before at all. Most people had never used AI in this way. They had maybe used cursor. Some of them had used Claude Code or some form of agent, but nobody had done long horizon tasks. Part of the reason for that is because, you know, it's expensive. a lot of these people were using their own personal subscriptions, or some of them were telling me,
Starting point is 00:22:42 yeah, we're not allowed to use AI at work at all. Like, you know, I've used it for some personal projects, but we're not allowed to use this in work, so they've not really had a chance to use it in anger. And this is one of the reasons why, like, I specifically wanted to give them access to, like, unrestricted access to a variety of frontier models, because I wanted people to have the experience of what you do in that setup. And I gave everybody a sandbox and the inference keys and then we had these modal credits and I just let people go wild. And I think that I tweeted about it that like every like we had four or five people who sort of got working loops up and running and submitted like placed in the
Starting point is 00:23:29 the between top 10 and top 20. Ironically, some of the people who did best, were some of the people who had the least knowledge about CUDA. And I attribute that in part to unguided versus guided, that the people who knew about CUDA were more likely to guide the model, to say do a specific thing to keep the human in the loop, versus the people who had no knowledge about CUDA had no option but to do something unguided. But everybody did really well.
Starting point is 00:24:01 Everybody had submissions, like everybody who stayed for both days, had submissions on the leaderboard. And a lot of, I think it was very, rewarding for everybody involved. And I came away with that, with this idea that like, okay, this is how you would teach Kuda programming going forward. And that's where the idea for Auto Research Academy comes from. And the way I would do Auto Research Academy is as follows. So it would be two hours a day in the morning at like a week-long conference like GTC. And instead of being a tutorial, it would be more like a study group. So you come and meet for, two hours in the morning or so. And part of it is set up in teaching you, okay, we're going to, here's how we do our agentic loop. Here's the problem that we're trying to solve. It would be some sort of GPU mode like problem that everybody would be competing in. So some part of it would be set up, getting everybody onboarded. You would get access to inference. You would get access
Starting point is 00:24:58 to compute. You'd get access to sandboxes so that you could play around with this. And then the other part of this two hours every day would be a lecture, but the lecture wouldn't be on coding. The lecture would be on theory and system fundamentals. Like, have somebody like Stephen Jones give a lecture on like the basics of Kuta of like how a GPU works. Or like on the next day, have somebody give a lecture on the math behind the particular problem that we're writing a kernel for. but none of the lectures would have anything to do with code. They would all be about the theory. And as the week goes on in the mornings, you know, you would basically, you'd come in and sort of,
Starting point is 00:25:43 it would be a check-in on like, how are things going? What problems have you had? Because in between each two-hour study group session, your agents have been working on in doing stuff. And so when you'd come to check in, it would sort of be your time to like report in on your progress and like chat with people who might be able to help you if you're run into some weird problem or something. And yeah, this is, this is, I think, the future of how I would teach Kuda. Yeah, I would, if I, I will pitch the idea for GTC 2026. I already know, I already know, like the five speakers that I would have speak. And that would be a pretty great lineup.
Starting point is 00:26:23 It was, it was really something else. Like, you know, we had some students who come. And, you know, the thing is like you think like oh but if the agent's doing all the work like what do they learn well just people couldn't be more wrong about that because i guarantee you if i had pitched a sprint of like come write kuda kernels half of those people wouldn't have shown up because it would have been too intimidating but instead i specifically said you don't need to know this because we're just going to learn how to automate it and yeah like they didn't write the code themselves. But after the two days, on the second day, when people started having results, we started talking about, like, okay, how do we analyze these results? And like, what's the actual
Starting point is 00:27:10 problem that we're solving? Like, what's the math behind the problem that we're solving? And, like, what does a good solution look like? And, like, what is your agent doing versus your agent? And we started, like, looking at, like, okay, well, you know, to understand why this worked, then you need to understand this piece of how GPUs work. And then I would show them this is how this aspect of GPU programming would work. And sort of like, because they, it was their agent, they felt like an ownership of it, you know, and they felt motivated to try to understand what it was doing. And so, like, instead of learning by doing something yourself, you have the agent do something and then you, the human, had to try to figure out what did it do? And did it do? And did it do?
Starting point is 00:27:57 do something valuable and like, why did this work and why did that not work? And through that process, I think those people learned more about CUDA than they would have in other settings. And they also learned a more valuable skill than writing CUDA kernels. They learned how to automate writing CUDA kernels and then how to evaluate the results of that automation. And that is the skill I would want to teach people going forward. So yeah, like I think I would delete all of the current way that we teach and that this is what I would teach going forward. Yeah, it's funny that you've had this whole thought exercise because I've not in the exact same articulation,
Starting point is 00:28:35 but once again to come back to the existential crisis, I've been thinking like if programming languages don't matter, like all of the insights and valuable things I feel like I have to talk about are like in that space. And then I was even talking to my wife, Shima. I was like, you know, like, sure, okay, you find a new AI community or whatever, about like what am I going to talk about and and then she made me realize that like I don't think that like what I now call like AI fluency is what do you call it like I don't think I have anything
Starting point is 00:29:08 to say there but the truth of the matter is is like most people aren't even close to being like AI fluent and like both you and I are and that itself is like and that's what you're describing right like putting people in front of these agents and then having a workshop over a week. And then, like, you don't realize, like, how much you've internalized how to use these things well. And, you know, that, I'm not going to go start, like, a company called, like, AI Fluent, you know, Academy.
Starting point is 00:29:38 But, you know, if I were going to go do something, like, it would be an idea, right? Because it's like, on one hand, you're correct that the adoption rate of the larger industry outside of tech, but just like the white collar spreadsheet intellectual work has adopted this stuff very slowly. On the other hand, though, I think that it's going to like, it's going to be like a tidal wave of disruption way faster than people think. Because if you're a company that doesn't adopt this stuff, you're going to be displaced by a new competitor that is operating this way because it's just impossible to compete. And yes, the large Microsofts, and sales forces and whatever,
Starting point is 00:30:20 they're still going to have the way that they operate, but just like, I don't think in five years, like the landscape is going to look anything remotely close to like what it looks like right now. I think it's going to be, I think it's going to be a,
Starting point is 00:30:33 I think the long tail is going to be a slower journey than you might think. I think that it's going to be a long time before it's saturated. I mean, it was, honestly, it was the most valuable part of Euro Python and Euro SciPy for me,
Starting point is 00:30:48 was this experience. And just the degree to which folks had not tried this before. And like I'm constantly running into people who have not tried or have not had the opportunity to try before and who I push to give it a shot. And then I check back in on them three or six months later. And they've, their workflows have changed. And like in part because I convinced them to try.
Starting point is 00:31:17 And I just think it's going to take. a longer to drive adoption than you might think. I think that this, this, the frontier will continue advancing, but the frontier is a small group of people. And in, in right now, it is very expensive to try stuff out. Like, I do think, I do think to get good at this, you've got to make a couple $10,000 mistakes. And not everybody has the budget to make $10,000 mistakes. And that's not going to be true in two to three years, because the frontier intelligence of today will get more commoditized. And the, like, Opus 4.5 level intelligence, maybe like Opus 4.8 level intelligence, is really good enough for a lot of these long horizon tasks. Like, those are the
Starting point is 00:32:02 models starting like January, February of this year are the models that really unlocked long horizon tasks, which have been the big game changer. And those capabilities will get commoditized and token prices will go down as new hardware comes out, as new open models come out, token prices will go down and it will not always be the case where you have to make a few $10,000 mistakes to really learn how to use this stuff. But at least right now, you've got to make a couple $10,000 mistakes to learn how to use this stuff. I do think there's a huge value to giving people an environment in which they can make those mistakes in not $10,000, but maybe $1,000 mistakes in an environment where they can, they can feel like they can experiment without having fear about the repercussions of failure. And I think that's one of the problems that people have right now is that either they don't have
Starting point is 00:33:00 access to tokens and frontier models or they do have access, but they're afraid to make those big mistakes. And even you, even you were afraid. I don't worry about my inference bill that much because... Oh, I thought I was going to say I was just afraid of making mistakes. I was like, what are you talking about? But the... Yes.
Starting point is 00:33:24 You were afraid of your inference bill, right? Yes, and still am, but... Yeah, I'm at... Let's see, I'm checking right now. The last few days has made it worse. Let's see. Why is location not Berlin? Why is this a filter on the AI spend
Starting point is 00:33:43 dashboard, that there's a filter that's on by default, that is location is not Berlin. 1.3 billion cursor tokens, 50.1 billion cloud code tokens, 63.9 billion codex tokens, and then 256 billion tokens on our internal inference hub. So that is 256 plus 63 plus 505,000, one. So let's say it's 370 billion tokens that I've spent year to date, which is a lot.
Starting point is 00:34:23 It probably puts me in the top, I don't know, the top hundred of spend it, NVIDIA, probably. But, but like there's stuff that I've learned in that process that I don't think I could have learned without doing things at scale. Like, certainly I've made mistakes, but if I didn't make those mistakes, how would I have known that they were mistakes? You know? If I didn't go and try stuff, how would I have known? And there's certain behaviors that only emerge, like, at scale. And, like, there's certain stuff that only happens, like, when I'm 100 hours into an auto research loop. And there's just, there's no way to get 100 hours into an auto research loop without spending a couple billion tokens.
Starting point is 00:35:12 Anyways, we got to cut everything we just talked about for the last 20 minutes. And how do we wrap up this episode? Because I probably need to go soon. How are we wrapping up this episode? I don't know, man. It started off, this wasn't the episode I thought it was going to be. What did you think this episode was going to be? I don't know.
Starting point is 00:35:35 Like I said, it started off as existential crisis, conferences, committees, Fagazi, Fagasy. and then we started talking about being AI fluent in like auto research. I'm going to diagnose you. I think you have two problems. One, I think that because you are, you're in the research side of things, you've not been exposed to like the difficult, like the challenges with like deploying this stuff and scale that other people have. And so your estimation of how rapidly this will be put into production across the industry, your meter may be a little miscalibrated.
Starting point is 00:36:21 And in two, I think because we work at Nvidia, we're in a bubble, and we don't realize how early things are. But generally, I think you are more optimistic about what current models' capabilities are. I am constantly frustrated by what current models' capabilities are. but can still get a lot done with them. So I think that the current models are not as good as you think they are, and not as many people are using them as quickly as you think they are. So the skills that you have are still valuable.
Starting point is 00:36:53 I also think that understanding the theory and the systems behind software is a more valuable skill now than it has ever been in this industry. This is maybe the only time that a CS degree is actually, may be really helpful because for strategic decisions a human is still going to be involved. And so like understand like your knowledge of algorithms, your knowledge of like programming language theory, like all those things are still going to be valuable in how you direct and use agents. I don't know.
Starting point is 00:37:31 I think that like the fifth interview of the classic DSA data structures and algorithms interview where you did four algorithms and data structures, and then the fifth one was large-scale system design. I think the large-scale system design is the thing that's really important. But like knowing the different flavors of like chunk-by, chunk-by-key, you know, partition, stable partition. I don't know, ma'am. I hope I'm wrong, but I think, you know, I don't know.
Starting point is 00:38:05 I don't think that stuff is that useful. I think that knowledge of like minutia of like language syntax and stuff like that is less useful. But like knowledge of like systems, knowledge of like performance, like all of that is valuable. And field experience is valuable. And so I don't think that like, I don't think that your experience is any less valuable because anything that you're experienced with, you're going to be better at figuring out how to automate it well than other people are. Time will tell.
Starting point is 00:38:37 And also, like, you also have to keep in mind, like, somebody has to figure out how to train these models and build these models and make them good at coding. And people who have skills like you and I do are probably uniquely well suited to work on those sorts of things. Just wait. Eventually, eventually you're going to get a little further down the road and start getting into, like, the RL and Eval's side of things. I mean, yeah, we got Nemotron. You know, I'm not worried about my employability. I'm more worried about just society. Nothing, nothing important, nothing big.
Starting point is 00:39:11 Just society as a whole, you know. What are your concerns about society? I thought you were concerned about our society of like the field of suffering. I can't help you with your concerns, your existential concerns about the impacts on society. I can't help you with the impacts of this on, you know, our industry. Oh, no, I mean, I'm going to, we're going to be fine. We're good to go. I mean, I mean more...
Starting point is 00:39:38 And what are you worried about? Like I said, I just think like a ton of communities... Well, I've realized, like I said, by my existential crisis and it's just that, like, I think a lot of the motivation for certain meetings and whether it's a conference or a committee meeting was like, it's actually social. It's not actually technical. And you can justify it with technical talks. but it's really a social thing.
Starting point is 00:40:06 But why is that a problem? Why is that a problem? Because you're not going to be able to justify it. There's no technical justification anymore. And those communities and conferences are going to... You're telling me that while our field undergoes a massive revolution that changes all aspects of software engineering, that continued education is not going to be something that companies are going to prioritize?
Starting point is 00:40:32 not at the types of conferences that we have historically gone to I think that all of those conferences are slowly gonna like all of those conferences are going to either go away or they're going to have more and more than that's what I mean you just said it you just said it they're going to go away that is the point I think I think that the majority of them AI will become a part of those conferences because it will become a part of the whole industry
Starting point is 00:40:58 the the software development and AI-assisted software development will become one in the same. It's like, you know, there's talks about, like, package management at CPP-Con. Like, people talk about, like, version control and branching strategies, right? Like, it's a C++ conference, but people still talk about, like, software engineering, and AI is going to become inexplicably linked with software engineering. I guarantee you, if you go look at the agenda for any C++ conference, like, A good chunk of the talks are going to be talking about AI and vibe coding and code review and the challenges of using AI for particular language.
Starting point is 00:41:41 It's everywhere, man. The conferences are going to adapt. Maybe. And if they do, I don't think it's willingly. I get the sense that, like, the world hates AI. You are correct that there is a large part of the world that, yes, you're correct about that. There's a large part that is afraid. even within our industry.
Starting point is 00:42:03 There's a large part that don't like it, and it does centralize power to some degree. And I do think that big tech benefits more than smaller tech companies. And in particular, if you're a software freelancer, if you work at a smaller company, you just have a lot fewer resources, a lot less access to resources than other people do,
Starting point is 00:42:25 and that's going to be tough. But eventually this technology will commoditize and will be more widely available. I mean, just imagine, Connor, if you will, what happens when the token prices go down 100X? When the stuff that would cost us, you know, $1,000 today costs, you know, $10. It's going to be game-changing. I mean, it already is game-changing. Yeah, but, but, like, once doing like a billion token task costs like $10, not $1,000,
Starting point is 00:42:58 then like everybody's going to be able to do the stuff that we're doing. And that's really when the like, wait, the thing that I think you, you think you don't realize how early we are. I think AGI is right around the corner. We are, as Demis Hasabas said, former head of GDM, Google Deep Mine. Now I think he's head of alphabet. They promoted them. We are in the foothills of the singularity.
Starting point is 00:43:26 And you may think we're, early and probably for tons of corners of industries. You know, it is early, but I think coding is dead. And maybe this should just be episode 300. We were going to, we were planning on bringing on a special, no, no, no, no, no, no, because come on, because we got, we got to do a Sean episode for episode 300. All right, so this will be episode 301 then, so, you've already heard the Sean episode. Be sure to check these show notes, either in your podcast app or at ADSP, the podcast.
Starting point is 00:43:58 podcast.com for links to anything we mentioned in today's episode, as well as a link to a get-up discussion where you can leave thoughts, comments, and questions. Thanks for listening. We hope you enjoyed and have a great day. Low quality, high quantity. That is the tagline of our podcast. It's not the tagline. Our tagline is chaos with sprinkles of information.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.