Tech Won't Save Us - Do Chatbots Really Belong in Schools? w/ Tom Mullaney

Episode Date: May 28, 2026

Generative AI is making its way into many parts of society, and schools are no different. Tom Mullaney joins Paris Marx to discuss how generative AI has been adopted in K-12 education and the many con...cerns it presents for students and teachers.Tom Mullaney is a high school social studies teacher in the suburbs of Philadelphia.Tech Won’t Save Us offers a critical perspective on tech, its worldview, and wider society with the goal of inspiring people to demand better tech and a better world. Support the show on Patreon.The podcast is made in partnership with The Nation. Production is by Kyla Hewson.Also mentioned in this episode:Here is the New Yorker article on AI in schools.For those looking for a refresher on Weizenbaum and ELIZA.Here is the paper “On the Dangers of Stochastic Parrots: Can Language Models Be Too Big”.For those curious about the Canvas breach.Students have been booing pro-AI speeches and AI presence in graduation ceremonies.xAI is facing a lawsuit for polluting Black neighborhoods.Support the show

Transcript
Discussion (0)
Starting point is 00:00:00 I don't remember being an elementary school student and thinking, like, okay, this is what I'm doing to learn how to do a job, right? You're there to be educated. And we as a society, as a K-12 profession, we need to have that conversation and figure that out. I personally don't think of education as job training, but I think so many people do now that it's a situation that we need to resolve. And I don't know that thinking of it as job training is the most child-friendly answer to that. question. Hello and welcome to Tech Won't Save Us, made in partnership with The Nation magazine. I'm your host, Paris Marks, and this week my guest is Tom Malaney.
Starting point is 00:00:53 Tom is a high school teacher who teaches social studies in the suburbs of Philadelphia. And Tom has been writing a lot about generative AI in schools, you know, has been talking about this. Certainly, we ran into one another on Blue Sky, which is where I started to get to know him and his work and, you know, get to know his opinions on this, right? And I was thinking about doing an episode on generative AI in education for quite some time. And then I was reminded recently when there was a New Yorker article, but also some listeners asked for an episode on this. And I said, yeah, I need to reach out to Tom.
Starting point is 00:01:28 We need to finally kind of do this episode, understand what is going on, had this discussion. And I was really happy he could make the time because I think that we had a great and wide-ranging chat where certainly we talked about generative AI in education and what that means for. students, how students are using it, but also what it means for teachers and school districts. And we extend that conversation as well to talk about the use of digital technology more broadly, how that has been pushed for the past couple of decades, you know, what that actually means for schools and teachers and students, you know, going from kind of Google and Google Classroom and the reliance on those sorts of tools, but also, you know, how teaching and how education has changed over the past number of years.
Starting point is 00:02:12 And how that's tough on both students and teachers alike. And these tech companies really take advantage of it to push their products and make it seem like they're going to make things easier and more efficient while really, you know, they're just getting data, getting information, getting money, certainly. And, you know, does that really work for us? You know, and we end by talking about the growing backlash, right? Not just to generative AI in schools, but also to screens more broadly and what that is doing to education.
Starting point is 00:02:38 and where these things might be going. I think it's fair to say we both see this as kind of a hopeful movement to try to bring education away from the technology and actually focus more on critical thought and the general principles of education. So, yeah, I guess that's all to say that I had a really good time talking with Tom. I learned a lot from him, and I thought it was really insightful. I think that you're going to learn a lot as well. And if you're a parent, you're probably more familiar with this than I would be. But hopefully you think I could have asked the right questions.
Starting point is 00:03:17 And certainly even if I didn't, Tom has a bunch of examples and a bunch of insights to share with us. So I think you're going to really enjoy it. As always, if you enjoy this episode, you can leave a five-star review on your podcast platform of choice. You can share the show on social media or with any friends or colleagues who you think would learn from it. And of course, just a reminder that we do have a video version now that is available on YouTube, modify, and I think we'll be on Apple soon. I don't know 100% how that works, but we'll see when that starts or if it has started already. And of course, if you do want to support the work that goes into making tech won't save us every single week, so we can keep having these
Starting point is 00:03:50 critical in-depth conversations exploring so many different parts of the tech industry, you can join supporters like Michelle from Montreal or Belinda in Baltimore, who also wanted me to say long-live Logan Hollinger. And you can do that by going to patreon.com slash tech won't save us, where you can become a supporter, get some stickers if you support at a certain level, and certainly get access to premium episodes, which I'll have more information on soon. So enjoy this week's conversation.
Starting point is 00:04:18 I think you're really going to like it. Tom, welcome to Tech Won't Save Us. Paris, I'm a long-time fan. Pleasure to be here. Thanks so much. I obviously really appreciate that. And we've been talking for a little while and have a meaning to do an episode on AI in education.
Starting point is 00:04:35 And so I wanted to start, just by asking, like, you know, generative AI in schools has become a big topic of conversation. I feel like even just, you know, the kind of digital technology use in schools is becoming something that is more debated broadly. But I wonder, chat GPT was announced in November of 2022. How quickly did you start seeing these chatbots and things making their way into schools? So they made their way into the discourse about what students should be doing, almost the media. And what I mean by that is by the spring of 2023, there were multiple books available that promoted generative AI in K-12 schools.
Starting point is 00:05:18 Think about that. Spring of 2023, multiple. And the authors of them then go on to keynote at education conferences. So that was immediate. What was not immediate and what's still lacking is kind of that balance that, okay, well, what do we know about generative AI? and how humans use it. So what did we learn from the stochastic Paris paper?
Starting point is 00:05:41 What do we learn from Eliza and Weissbaum? That has been missing from the discourse in K-12 the entire time. So, yes, very, very immediate. And schools, the animating principle behind generative AI in K-12, both I think amongst that discourse early on about how great this is going to be. And as schools, they, all right, we have to incorporate this because it's here and it's inevitable. it's fear of missing out. Nobody wants to be an archaic dinosaur,
Starting point is 00:06:10 and so fear of missing out has been the animating principle behind a lot of this. That's so frustrating. But it's wild to hear that there were books available so quickly, and unfortunately it doesn't surprise me that then these people go on to kind of speak at the conferences and to promote it, because we see this cycle again and again, right? But it did feel notable with generative AI that very quickly, if you listen to people like Sam Altman,
Starting point is 00:06:36 the potential educational, you know, implementations of this technology were something that they were hyping up from the very beginning, right? You know, kind of this notion that the chatbots can eventually become teachers or teachers' assistants and,
Starting point is 00:06:50 you know, can kind of improve access to education and all this kind of stuff was like, part of the grand, you know, amazing things that generative AI is going to do, which I'm sure kind of affects the discourse around, you know, education and how teachers and school boards and things like that are thinking about it and talking about it. So a lot of K-12 professional development and discourse has focused on people like Sam Altman
Starting point is 00:07:16 or even say Ethan Mollick, have you heard of him? He's that UPenn professor who's always promoting generative AI and always saying, this is amazing. He's always promising that it's going to revolutionize everything and then, you know, it'll just do it the next time something was released. And voices like that who have a bias and an interest in us thinking that generative AI is truly transformative, those voices have dominated the conversation and they're cited as experts. As a socialized teacher, I want my students critical thinking.
Starting point is 00:07:48 And we need to have critical thinking as well. And so if we're going to listen to those voices, we need to acknowledge their biases and why they have an interest in us thinking a certain way. And we should also listen to voices such as Dr. Emily M. Bender. Dr. Timna Gavru, let's listen to all of that and let's evaluate and critically think about that. And then let's proceed with what we want to do with technology. It is kind of wild how even in institutions like, you know, schools and universities, that that kind of critical approach to the technologies, whether it's generative AI or any others, doesn't seem to be at the forefront of the discussion early on, right?
Starting point is 00:08:26 You would think that if any kind of institutions in society are going to take a hard look, at the technologies being proposed for society and certainly for their institutions in particular, you know, what's it going to mean for schools? What's it going to mean for teachers? What's it going to mean for students? You would think that they would be on the forefront of, you know, considering those questions. And it's wild that that is often not the case, right? So I'll give you an example. So at Google's I.O. event, Google I.O. They start talking, they talked about something that's been basically debunked by now, but this idea of singularity or AGI that Generative AI, large language models that just generate text, that's all they do,
Starting point is 00:09:05 they're going to achieve consciousness and humanity, right, and be smarter than humans. And so I've seen, since that, at least two ed tech influencers talking about that and saying, this is why this is so compelling. Wired Magazine, Wired Magazine is not super anti-AI, but they quoted that stuff and said, that's the most unhinged stuff said at this conference. So it's kind of like, you know, we're hearing that computers are about to be human, but the tech media who have been somewhat supportive, genera of AI are saying, come on, that's ridiculous.
Starting point is 00:09:41 So that's the problem is that I think in K-12, we're hearing this message that, you know, if I didn't know you better, I would say, oh, my God, like, if the computers are going to be smarter than us, then, yeah, we have to do something rather than saying, all right, this outputs synthetic text based on prompts that we enter. So what are the consequences? That's what we should be saying. But instead, it's, no, we're going to have superhuman computers, right? Unfortunately, we see the same problem in government and other kind of institutions
Starting point is 00:10:15 and places of governance that should be thinking through these questions, but instead they buy into these narratives coming from the tech companies, just as you're saying, right, whether it's around singularity or whatever else. And so I want to dive in and talk about generative AI, but I wonder before we start, you know, to really dig into that conversation, obviously there have been, you know, concerns around how these tech companies have been relating to schools for a while. And I wonder, in your view, how did the rollout of generative AI in schools build on some of the existing concerns that existed with, I guess, the influence of these companies on what happens in K to 12 schools? Okay. So that started. So what got me down. path because for years, I was someone who incorporated technology and promoted technology in schools. And I do think there are some real valid uses for it that make teacher lives easier, student lives easier that make things more inclusive. I think there's absolutely some things to be done
Starting point is 00:11:14 there and said. But what happened was, you know how brands use influencers and things like that? That's really what, especially Google, they led the league in that in like the early to mid. 2010s. They were excellent at that. And then they're offering their stuff to schools for free. And it wasn't until later in the pandemic when schools really were dependent on it that they started charging for it. But that's really... That's so ridiculous. Yeah. That's how it really happened. And I would say, I would encourage schools. I've actually talked to some administrators and they say, look, we have to have Google. We have to have Microsoft. It's just for all of the things that happens student information systems. I would say like look at things like ellipsis. That's an
Starting point is 00:11:57 It's a word processing tool that's available for free. I would still pilot that or have just a few advanced teachers play with that and see if they could use that as opposed to, say, like a Google Docs or something like that. These companies did Google, Adobe. They were very adept at conferring prestige on people for using their products. And schools can be a very isolating place. I might do a lesson about the New Deal. And maybe it just home run just is amazing.
Starting point is 00:12:27 And maybe my students know that, right? And maybe if a principal was there observing, they know that. And then besides that, not much outside recognition. So these tech companies were very smart about, and what happened was, by the time we get to like pre-pandemic or pandemic, I would get emails from teachers or from tech leaders at schools. And on the signature, there'd be 50 badges of 50 ed tech companies I'd never heard of. Here, we'll give you a badge.
Starting point is 00:12:55 And my thing was, I was one of the prestige of the. the companies that my friends outside of education would know. So I, as I look back, I promoted those companies, not these smaller ones, but I don't, I'm not super proud of that. But we've all made mistakes. It's okay. Yeah. Yeah, definitely.
Starting point is 00:13:10 Anyway, so they use prestige to get in and get teachers on board, typical influencing, brand ambassador stuff. And that, the people I see in those spaces, they are not, I think, taking to heart the lessons now that are coming out of families being very concerned about technology in schools. They're not taking that to heart or at least considering that, hey, maybe we need to like really think deeply about this. You know, I've definitely reconsider a lot of my beliefs or the last two, three, four years.
Starting point is 00:13:48 And I think that's only for the best for sure. And I think what you're saying there is something that a lot of people have experienced over the past number of years, right? You know, kind of a lot of us bought into the ideas that the tech company sold us, whether that was about implementation in schools or how these technologies should be used in our general lives. And I think there are a lot more people who are kind of asking the question as to whether that made sense and changing their practices and changing their views on those things.
Starting point is 00:14:15 So I don't think you're like outside of the norm on that at all, right? Well, thank you for saying that. It's definitely something I've struggled with. And as I've returned to the classroom in the last year or so, I'm kind of like, okay, well, maybe I can like do some good here, you know? Yeah, no, I hope so. I feel like hearing you talk about that as well, like it brings back a story to me that that always stood out when I think about these tech companies and education.
Starting point is 00:14:42 And that is how back in the 1980s, Apple was one of like the first movers to get Macintosh, you know, to get computers in general, but it really wanted to get Macintosh computers into schools. And in particular in California, where it was based. I think it just gave a ton to schools for free, if I'm, if I'm remembering correctly, or they were very cheap, but I think they were free. And really, the goal was like to introduce people to the products, to get people depending on the products, to get people used to them, you know, potentially cultivating future customers, of course, but also just kind of building in that
Starting point is 00:15:13 dependence early in a place where, you know, you have a bunch of, you know, employees who are, who are going to be using these things. But also, you know, you're kind of getting to people when they're young and they're developing an association with the brand, or if you're thinking of like Google or Google classroom, like they're actually getting a Google account very early in their lives. And I'm sure the hope is that they're going to then carry that through, you know, much of the rest of their lives, right? So Google and Google classroom, they, you know, it's about 2015. And I'm, it's actually, sorry, 2014. And so when that happened, and I would say having an LMS does give you, you know,
Starting point is 00:15:52 students are absent, bam, they just go to the LMS. Like, there are definitely some... And can you just say what that abbreviation stands for? Thank you. Sorry. Learning management system. And there are others. One is kind of notorious right now because it just had a ransomware attack, Canvas learning management system.
Starting point is 00:16:10 So what's happened is, yes, everything's become Google Classroom. And the funny thing is that when the pandemic, at the onset of the pandemic, Google Classroom became almost ubiquitous. but in the Apple store, students would review bond. They would all give it like one star. And I don't even know, I think a certain point it was cut off. But what does that tell you? Like, what does that tell you if students are doing that?
Starting point is 00:16:36 Maybe we should like listen to that rather than consider that bad behavior. Maybe that's like honest testimony. So yeah, it became basically ubiquitous with the pandemic. I remember thinking before the pandemic, you know, this is like a third, like maybe near a half, but not quite. And then at the pandemic, it was like, well, we're in Google classroom. And there's, you know, there's Microsoft schools. And so they might use another learning management system like Schoology or Canvas.
Starting point is 00:17:02 I will say this, having worked with all of them, Google Classrooms, Schoology, Canvas, they're not the most exciting things to ever work in. They're not amazing. Even just if you use Slack, and I've used Slack for different things when I was consulting, Slack is so much more fun and, like, things you can do. but I think there's kind of an inherent mistrust of kids. So it's kind of like, okay, well, don't let them like do certain things. Don't let them like emoji react in certain contexts.
Starting point is 00:17:31 Just little things like that, that it's kind of unfortunate that that's how, a lot of ways, like, I think of how I experienced technology and how I, for years, technology has been like, oh, this is like better. This is like better than what I could do before. Even like Adobe Photoshop in the 90s, when I first, was exposed that. I was like so excited. Wow, that's amazing. And now it's a subscription thing and people who use it are resentful about that, right? This is the way our kids are experiencing technology for the first time on 11-inch Chromebooks. So I wonder if they get to, you know,
Starting point is 00:18:06 they get to my age, they're just like so over it. They're so like, yeah, technology is for unfun things. Maybe that'll happen. I don't know. Yeah. And maybe it's even in high school when they're when they're reaching that point as we see these like Luddite clubs and things like that in Brooklyn and whatnot. Definitely see that. I mean, we know about the backlash about generative AI and the commencement addresses, but I think I see that among students too, where students are want to get analog. And of course, I don't know if Canada is experiencing this, but the big trend now,
Starting point is 00:18:38 the big thing that kids, high school kids are doing in the United States is playing hacky sack. I mean, I'm going to talk about the most untechnological thing you can do, hacky sack. So I think there is something to that. Interesting. That's really interesting. I feel like when you're talking about the learning management systems, one of the first things that came to my mind is like, I think they came in just like sort of after I finished high school and stuff,
Starting point is 00:19:03 like a number of years after. And I was like, but I think my brother had them or one of my brothers did. And I was like, if my parents would have been able to look up my grades that easily, I would have hated everything. Like I would have been so mad. So that's, and that. That's even a different system called the student information system. And sometimes learning management systems play nicely with student information systems,
Starting point is 00:19:27 and sometimes they don't. And typically your student information system, which is this thing usually called Power School, and that's a whole other thing. Parents and guardians have quick access to grades. So yes, I would say, I always say, it would be my nightmare to wake up and be one of my students. Not that I think I'm that better teacher,
Starting point is 00:19:48 But what we ask of students today in this digital age, the amount of work we give them, their life experience, what they're looking at with generative AI and their future and just the world we're giving them, it would be a nightmare to be in that position. I feel nothing but solidarity with kids today, for sure. Yeah, I think that makes a lot of sense, right? And I want to start moving into talking about generative AI specifically, but hearing you say that, it actually brings to mind something I've heard a lot about, universities, right? That, you know, part of the reason that generative AI and that these tech companies
Starting point is 00:20:25 can so easily kind of move into universities is that they're taking advantage of some of the flaws that have already developed in kind of the model of the university, right? What university education has become, you know, how it has been transformed by administration and consultants over so many years. And, you know, you don't have the same student experience. You don't have the same kind of expectation from a university as you might have in the past. You're maybe trying to get a degree to get a job rather than develop your critical thinking skills and all those sorts of things. And I feel like, you know, in that sense, the companies can take advantage of this flaws
Starting point is 00:20:59 that already exists in the model. And I wonder then in K to 12 schools, if you think that how K to 12 education has kind of developed over time or has evolved because of financial pressures and all this kind of stuff, if the companies are also taking advantage of those problems to kind of move in. All right, so this is a reckoning we have to have in K-12. Either K-12, and I'm talking to kindergarten, you know, what is that? Five years old through 12, which is 18 years old, either it's job training or it's education. Because I hear so much about, well, we need, you know, corporate America needs this and kids need these job skills.
Starting point is 00:21:40 And I'm sitting there thinking, does a fifth grader need to be ready to work it for a corporation? this, what are we getting at? And the justification for so much of this technology is that students need real-world skills and they need to be trained for employment. I don't remember being an elementary school student and thinking, like, okay, this is what I'm doing to learn how to do a job, right? You're there to be educated. And we as a society, as a K-12 profession, we need to have that conversation and, we need to have
Starting point is 00:22:14 that conversation and figure that out. I personally don't think of education as job training, but I think so many people do now that it's a situation that we need to resolve. And I don't know that thinking of it as job training is the most child-friendly answer to that question. I couldn't agree with you more. I think it causes a lot of issues in K-12 education and also in university education, right, with how these systems have, transformed and how they've been so reoriented toward preparing people for the job market, employment, all those sorts of things, rather than, which is not to say cultivating other skills is not done, but it feels like it's not the focus in the way that it should be or that maybe
Starting point is 00:22:59 it was at a certain moment, you know? Right. And critical thinking amongst our students, especially because I don't know that being iconoclastic and being different and thinking, you know, outside the box to be cliche is really what employers want. You know, they say it is, but is that really what an employer wants? They want a bunch of employees who are going to do things differently, go their own way, disagree. Is that what they really want? But I thought education was for critical thinking.
Starting point is 00:23:29 So there's a bit of a conflict there. And I hope that's resolved in, like I said, a child-friendly way. It makes me think of all those articles that are like, Gen Z workers are complained so much on the job or are so willing to, like, leave their jobs if they, don't like their boss or whatnot. And it's like, I feel like when you're talking about is a critical thought or is a job training, what do employers want? Like, that's the first thing that comes to mind how they're annoyed if people do push back. Right. Self-advocacy in a lot of context is not valued. And I hope that students learn self-agocacy. Can I give you an example? So the UFT
Starting point is 00:24:06 recently promoted a generative AI app and they told a story about it. And that's the United Federation of Teachers, Teachers Union, one of the teachers, one of the teachers union, one of the teachers in the United States. And they tell an anecdote with a student who says, you know, I don't want to bother my teacher so I can ask this chatbotic question. That is the bleakest possible outcome. As a teacher, when a student asked me a content-related question, that is the highlight of my day. That is what I want. I want them curious. I want them to think of me as a support and a resource. The last thing I want is them saying, you know, Mr. Mulini doesn't want to hear you. hear this right now. Let me ask the chat button. That is not the outcome. And that the UFT of all
Starting point is 00:24:50 people is promoting that, that is really, really scary. And again, like, we really need to reconsider the role of technology in education for sure. Very well said. And on that point, then, I want to dig into the specifics, but I think I'll just start with more of a general question. How are you seeing generative AI being used and rolled out in K-12 education now, you know, more than three years on from the release of ChanchiBT. Okay, so at the schools using it with kids level, there's a lot of chatbots, tutoring. If you go to the ISTE conference,
Starting point is 00:25:26 I don't recommend that you do. And I've been there and I've actually presented there. I've presented there for a vendor there, it was not a generative AI vendor. Actually, I did do one. I did a session about the Eliza effect and historical speakers. It was for a teacher-centered generative AI. They brought me to do it.
Starting point is 00:25:44 It was pretty cool. But their stuff was not student facing, so I don't think they thought of it as a threat in anyway. But ISTE is now overrun with just AI apps, right? And that's a conference for teachers or? That's a conference, the International Society for Technology and Education. So that's for, it's supposed to be, you know, K-12, it's very expensive. So it winds up being mostly like district folks who can expense it.
Starting point is 00:26:06 So a lot of it is some sort of chatbot teacher, tutor, and then lesson plan. generator. And as a lesson plan generator, that just breaks my heart. I think about the best lessons I've ever done. And they've involved one million small decisions over time, whether it be my summer or like, you know, I get it. Teachers are overworked. They have so much work to do. And I don't know that large language model chatbots are the answer to that. But that's the big thing. Now, on the student side, there are some that, you know, interact with students, but a lot of students will turn to generative AI, whether, you know, usually chat GPT, of all things, to get answers. And I personally think that it's a matter of solidarity with students.
Starting point is 00:26:54 If our students are so overworked, if they feel so overworked, that we need to like reconsider a lot of the systems, a lot of the assessment, a lot of things like that. I think that's the answer to that. That's not easy. That's not a quick fix. But students relying on a chatbot, which we know as an error in accuracy, we know that I don't know if it's documented by research, but it's documented anecdotally a ton, that long-term use of chatbots, at least in some people, has some bad effects. So there's some things that we need to think about as far as, okay, if we know our students are using them, why and what, like, what is it that we can do to get students to a place where curiosity is driving the learning, not, I have to get this done, is driving the learning.
Starting point is 00:27:39 Yeah, I think that makes a lot of sense. And I want to dig in on some of the different places where we potentially see chatbots, right, or, you know, generative AI being used. And I wanted to start with the students because I feel like, you know, we've had a lot of stories, you know, a lot of media reporting and things like that about student reliance on chatbots, the amount that students are using chatbots. And I think some of that has been kind of debated the degree to which that is happening or like how they're using it. I remember one time seeing like the user graphs of ChatGBTBT and like when the school year would end, you would see the user numbers drop off, which you know, kind of suggested a lot of students were using it. But yeah, so I wonder what you're seeing in, you know, the kind of student use of generative AI. And I imagine that is probably more prevalent on the high school end where you are rather than the earlier grades. But yeah, what are you seeing?
Starting point is 00:28:33 So the big thing I'm seeing is students turn to it to help them understand more difficult concepts. So I'll give you an example. So I was teaching a course that had some very difficult reading, some very dense, difficult reading. And so I had a student who was turning to it to kind of summarize it. I think they were taking like the big questions and themes from the reading and entering it into chat GPT and seeing what came up. And what happens is, and this happens to a lot of people seemingly who use generative A on chat pots, They were very confident that they knew what was in the text. And then when I started asking a few questions, it was kind of, oh, you know,
Starting point is 00:29:12 so I think that's a big thing that students are using it for, trying to kind of like figure things out. And I think a big problem that I think also, you know, the foundational knowledge about it should be Saccharis, Eliza, but also just like little language that gets away from anthropomorphization. So verbs like ask, that's what they would say. That's what most people would say. But we don't ask chatbots things.
Starting point is 00:29:41 We ask people things. So I would say they enter text in with questions about American history concepts, about a chapter in a textbook. And then the chatbot generates text that in their mind, to their mind, responds to that. I know that's very difficult. But otherwise, we're just anthropomorphizing these chatbots. and that causes all sorts of problems. But anyway, so that's what's going on there. That's what I'm seeing as far as student use.
Starting point is 00:30:11 And I think it varies. It could be, I've seen, you know, I saw a student, you know, they copy-pasted an answer to a question clearly from chat GPT. And so I just had to say, like, look, you know, the policy of this was no generative AI allowed. As a teacher, I want to hear from my students. Like, what an LLM generates is of no interest to me. One, it's just not interesting.
Starting point is 00:30:34 And two, it doesn't help me assess a student in any way, right? If an alum, generate and trade, so what does that tell me about a student's understanding of the subject? I have a couple questions based on that. The first is, does discussion of the use of generative AI or even like what it is, does that kind of come up in conversation in the classroom? Is that something that you discuss with students at any point? So yes and no. as I've come back, I've come back to the classroom.
Starting point is 00:31:05 So I came back in 2025, and I'm covering for another teacher. Next year, I'll be able to do it all on my own. I'm very excited. And so then I'll cross that bridge. And I do think, I have some ideas. I can get into those about how I might do that. But another example. So I was talking to a student about a rubric that's generated by a third part, long
Starting point is 00:31:25 story short, it's like these advanced exams. And so there's this third part rubric that we just as teachers use. and the student cited, he said, chat GPT said, and I said, that's not a source, right? If you show me the document, the PDF or the web link, yeah, great, we'll have that conversation, but chat CPT is not a source.
Starting point is 00:31:46 And so that's, it does come up. I've had students say that like, oh, yeah, I love chat. And they sometimes call it chat, like it's a friend. And that's kind of, I've heard that as well. Yeah. Yeah. Again,
Starting point is 00:32:00 if you're told this stuff is like going to be sentient. And because chatbots use personal pronouns, which is a choice that developers make, these are choices that are made. So I understand why that happens. And, you know, I was a teenager too. And if you told me that there was a shortcut to getting something done, in most of my classes, in my history class,
Starting point is 00:32:25 I wouldn't have because I was just interested in history. But to get through my AP bio, class, yeah, I would have definitely done it. So we have to understand that temptation as well. But yeah, I would have done it. It wouldn't have really helped long term, but I would have done it for sure. Yeah. I'm sure I would have been doing the same as a high school student. Like, you know, there's no question about it. I wonder as well, like, I've heard stories of teachers and even university professors also changing the way that they do like assessments and tests now that generative AI is a thing. I wonder, has that entered your kind of thinking?
Starting point is 00:33:00 you know, again, I know that you're covering this year. I don't know if you can change the way that works, but if you're thinking about how you might approach things next year as well, like, you know, is there less kind of like essay writing at home and more writing essays in class so you know that, you know, that LLMs can't be used while doing it? Like, I don't know, is that entering into your thought process at all? That definitely is entering into my thought process.
Starting point is 00:33:20 I do think, and I think it's just more equitable in the first place, that bigger assignments be done in classroom anyway, because you just don't know the obligation, of a teenager when they're at home, and that's very socioeconomic driven. So that's just more equitable in the first place. And I will say, I'm not in love with the idea of if a student has a long piece of writing, they have to do a paper pencil because there are some students who use speech or text. There are some people who for writing, it's a challenge.
Starting point is 00:33:50 So I don't love that. But if it's taking place in my classroom, then I have more eyes on it and I have more ability to do that. But having said that, being more analog is definitely, oh, my goodness, it's time to rediscover that. I recently inherited a project from the teacher I'm currently covering for in a history class called the stamp project where students would just draw and design a stamp, like a postage stamp of any big topic in American history. I mean anything. And the results are amazing. I'm taking pictures of them and texting to my friends just saying,
Starting point is 00:34:26 I'm like, can you believe what these kids did? I texted them to the teacher I'm covering for. And the teacher I'm covering for almost expected it. They almost were like, yeah, I know these kids are amazing. You know, so that to me and that class is at a higher level. And I'm saying to myself, if I'm teaching that same content at a lower level, we're still doing that project next year. Like, that's happening because it is so wonderful to see that art.
Starting point is 00:34:51 So I think that's going to be a big driving thing. is like, what can we do analog, what can we do in the classroom? And knowing that if I give my students a very big piece of writing, then it's going to have to be, you know, maybe the brainstorming, the first pieces in the classroom are going to be maybe more of what I focus on when I assess it. Because I know that there will be a temptation there for sure. Yeah, I think that makes a lot of sense. I was wondering as well on that front, like, you know, as you mentioned earlier, we do see these reports that, you know, extended use or using and relying too much on chatbots can affect people's critical thinking skills, their cognitive abilities, their ability to retain information.
Starting point is 00:35:41 Do you see much of that or do you worry about that kind of in class with the use of these technologies? Oh, I definitely do. I do. The cognitive offloading. And I think just the overconfidence, there's now, there is not. not a humongous research base here. But I'll give you an example. One of the few ones that exists, it's a, I think it's a Penn study, and I'm going to do my best to summarize it, but basically, you know, students were given a math problem, and then they were given an AI tutor, and some weren't.
Starting point is 00:36:09 And what happens is in the immediate aftermath, students do great. Okay. And then on the long-term assessment, not only do they think they did well, but they don't do as well. So they have this overconfidence and underperformance. and I can really see that that makes a lot of sense to me just from the little I know about LLMs and what I know about teaching and students.
Starting point is 00:36:31 Yeah, yeah, that's going to be it. That's going to be a real challenge for teachers is students who are overconfident because they've interacted with a large language model and then, oh, but you didn't really have real learning experiences where you got the fingers in the dough. So yeah, that might be a real thing to consider as we go forward.
Starting point is 00:36:54 I don't know about you, but as I hear you describe that, what comes to mind is kind of the discussions that we were having a few years ago about students, you know, being at home and learning virtually during the pandemic and how that potentially impacted social skills or learning and all those sorts of things. And it felt like at the time there was a lot of concern about that, right? You know, obviously some of that was motivated by people who didn't want lockdowns to happen. and all that kind of stuff. But there were, I think, legitimate concerns there as well, right?
Starting point is 00:37:27 Like, it is important to be around people, to be, you know, in person when you're learning and those sorts of things. And I, and I, I don't know, it's a bit weird to me maybe that I feel like, you know, those kind of concerns about students and their learning experience and kind of their mental development and all those things are maybe not getting that same degree of attention as I feel like virtual learning had a few years ago. And I'm sure that there are like commercial reasons for that and all sorts of things. But yeah, I wonder if that's something that comes up for you. Okay. So personalized learning, the idea is, is that each student has different lesson materials or lesson materials that meet their unique needs and or interests. And especially if we go to say, really the whole decade of the 2010s, personalized learning
Starting point is 00:38:15 was everywhere. And technology makes personalized learning so much easier. And what I've noticed is that in the 20s, 20s, personalized learning has been dropped. It has been dropped like a hot potato. And my guess on that is that it's because as a society, it's becoming very obvious that we don't have a collective agreement and understanding on truth. And so the idea of things being more individualized is actually not something that people really want to see. And of course, an LLM tutor is like personalized learning on technology enhanced.
Starting point is 00:38:52 Now, again, steroids do actually make you lift more and hit home runs farther, right? LLMs. Anyway, what I'm seeing there is that the idea that each student is in front of a device, which is now getting so much pushback in the United States of America, so much pushback from families. But that's really where this is where this would be going. If we're saying that we want students interacting with the chat GPT or other LLM, that's where it's going.
Starting point is 00:39:24 You're going to literally student and device one-on-one. And as far as community, collective understanding of the truth, social skills, that's not going to help that situation at all. And I actually think I'm really almost surprised at how excited people in K-12 are about LLMs and generative AI tutors when personalized learning has become kind of passe. day. I'm surprised that that's happened because it's kind of like, that is personalized. What do you know? Yeah, that's fascinating. It's really interesting to hear. I wanted to flip it a bit.
Starting point is 00:40:00 You know, we've been talking about students, what you're seeing with students' use of AI and those sorts of things. If we turn it around to the teacher side of things, obviously, you know, teachers are using generative AI as well. You know, you mentioned some uses earlier. I wonder what you're seeing on that side of things, on how teachers generally are thinking about generative AI, you know, is there a lot of kind of critical views on it, or are people adopting it, as you say, because they're overworked and they see this as a potential tool?
Starting point is 00:40:30 And do you see the adoption coming largely from the teachers themselves, or is it often being pushed by administration, by the school board, things like that? So what I'm seeing is a huge mix. And I'm happy, I don't think that you can say by and large teachers, are doing A or B, I think it's a mix. And I think, one, it's definitely not informed by deep understandings of large language models. And when I say that, something I hear a lot is that,
Starting point is 00:41:02 oh, well, students and teachers need to learn how to use these tools. Using them is so easy. You literally enter a prompt and then something comes out, right? Using them is so easy. And if we think, well, you have to refine your prompt, well then maybe it's not like then come on like if you have to do if you have to refine things 50 times is there's really a time saver but what's happening is you see a lot of of things that are true about teachers so teachers are overworked teachers are also huge BS detectors like teachers are so
Starting point is 00:41:36 skeptical you know they're kind of trained to be like that life experience makes them like that and so you have the ones who they they've never heard of the stochastic parrots paper but they're sitting there saying, come on. And they've also been through ed tech over promising over the years. So they're kind of like, come on, really. And then there's the teachers who are like, look, you know, I just want to generate this rubric and be done with it. And then it gets generated, right?
Starting point is 00:42:02 I see some that just ignore it, just don't care one way or the other. I think a lot of teachers are annoyed at students for using it. I think the student usage thing is a lot more complex thing that we have to, again, have some solidarity with students around. but I think it's all over the place. And I just want the conversation to start with the actual experts, with the computational linguists, with Eliza and with Weiss and Baum,
Starting point is 00:42:30 like, let's start there. And that's just not part of the conversation right now. That's what I want to see happen. That's fascinating to hear. And like, I'm not surprised, right, that there's going to be different approaches. And obviously that teachers are going to approach this with a critical eye, because they've seen so many of these promises before not pay off.
Starting point is 00:42:49 I did want to go back to the part about administration and school board. Is there trainings on generative AI that are put on for teachers? Is there kind of like a push from higher up to use these technologies? That really devours school by school. And you see, so what I'm seeing is the big thing that gets people in positions of power to pause is the environmental stuff. For whatever reason, the environmental thing, now there are a lot of other documented harms,
Starting point is 00:43:21 generally they have. When people hear that environmental thing, they pause. Some people mention it and then just go the heck on and keep going forward. Other people, though, say, like, hey, this is really a problem. Because now we know about data centers. We know, well, at least I think a lot of people know about Boxtown where, because of Elon Musk's data,
Starting point is 00:43:44 center, people are saying, how come I can't breathe? And we know, by the way, that this isn't like a you and me, Paris and Tom thing. This is a historically marginalized and oppressed people, environmental racism thing. That's what generative AI is. They're not building data centers in the affluent places, but so we know about that. But then there's the other people who, I think they have that fear of missing out. They do not want to be considered archaic. They do not want to be considered out of date. They are grappling with the idea that K-12 education is job training, and so therefore we have to have our students current and relevant, and our instruction current and relevant. And so I think that's what's happening there. And just like it's really
Starting point is 00:44:31 hard to say that all teachers are in or out. It's really hard to say whether or not all school boards, all administrations are in or out one way or another. It really runs a gamut. But I do think they all feel that pressure to, like, hey, we're not outdated. We're not dinosaurs. We are cutting edge. But I also kind of wonder, you know, it's becoming such a thing that there's a backlash against general AI, against tech companies, against it being mentioned in commencement addresses. I wonder if that whole cutting edge thing is going to kind of diminish a little bit.
Starting point is 00:45:09 I wonder if that's almost going to be kind of like, oh, you know, We don't want to, you know, like traditions. And again, I get it. Tradition in a lot of ways is traditional things that harm people. And so tradition isn't really a great value either. I like to say it should be about solidarity with students and teachers. Like what is the most solidaritist place to be for those groups? And that's what should animate it, not innovation.
Starting point is 00:45:38 And I will say, by the way, if there's been a word in K-12 in the last 10 years, that has done more harm. I don't know of any word other than innovation. What's happened is what little Johnny and Hakim and Aaron and Sandra need has been put on the back burner to innovation.
Starting point is 00:46:03 Innovation at all costs. And innovation at all costs is not what our kids need. It feels like that's not just a K-12 schools thing. It feels like it's our whole society, right? Everything has been put on the backburner to so-called innovation, whether it is even that at all, right? That's really interesting to hear. And I wonder, you know, as we start to kind of close off our conversation,
Starting point is 00:46:28 what you see in the pushback to this, right? You know, you mentioned the data centers there, and obviously we're seeing a growing pushback to data centers, and I feel like we're seeing more and more reporting on the use of generative AI in school, So I wonder what you're seeing on your end to the rollout of these technologies and whether students are pushing back on them, whether teachers are pushing back, how parents are reacting. How is the discussion evolved in schools around generative AI? So in the Philadelphia suburbs, there's a district where I think there are up to like 600 parents who are petitioning that their kids no longer receive a Chromebook.
Starting point is 00:47:10 They actually have a motto, and I see it, they put it on lawn signs, like it's an election campaign. It's called pencils up, screen down. And that, I think, is going to be the biggest factor. So there's been some resistance from districts who say, hey, we need one-to-one devices in order to do education. And I've thought about that. And I realize, like, do I need technology to do education? Yes, like, I need my computer. I need a projector.
Starting point is 00:47:36 I need a photocopier. I absolutely need those. But if you were to tell me that if I have those and my kids lost their devices tomorrow, I feel like I could deliver education. And I think saying that you couldn't is a very dangerous thing. I get it. I'm not very good at organizing stacks of paper. You know, I get it.
Starting point is 00:47:58 You know, I, oh, Mr. Malaney, what do we do yesterday? And then I have to go find it because I'm not great with that. But the idea that we can't do school without screens, and I, And I get it. I've already counted a screen for myself in a projector screen. So I've already, I'm not at zero screens. But I don't want to be in a position where I say we have to have student one to one. I think that digital instruction can happen, but it can be, you know, maybe a little bit more special.
Starting point is 00:48:27 And it should be things that really excite the kids. There's an app that I plan on getting into this summer. ArcGIS has these story maps that you can create. And I'm like, oh, I want to play with that. But do we have to word process every single day? You know, I think we can have some fun with it and do some interesting creative things. But for it to be a daily driver, I think we need to really have some conversations about that and really have some thought about that. But so that's what I'm getting at is the backlash against screen time, which I get it.
Starting point is 00:49:02 It doesn't, in some ways, it doesn't address inequity. It doesn't address a lot of real, real big problems with. education in the United States, segregation, which is still very much a big problem, inequality, wealth inequality, all that stuff. But that backlash against screen time, I think, is really starting to take hold. And I think it's only going to get bigger and better. And I think in a lot of ways, the promotion of ed tech and innovation over all other things, it's kind of like, hey, you know, you were cruising for a bruising and the bruising is common.
Starting point is 00:49:35 And, you know, I think it's like kind of justified. I love that. A bruising is coming. They deserve it 100%. It's fascinating too, right? Because it feels like at the moment when they are really kind of even pushing to ramp up the amount of technology, you know, to get people using generative AI and all this kind of stuff. It's like you have this counterforce of parents, you know, and I'm sure of students and teachers to a certain degree as well who are like, hold on. It's not just the generative AI. That's the problem here. But maybe we've gone far too much. much into this adoption of screens. Like, I don't know of your school. I know it's becoming really common in Canada now for phones just to be kind of banned in schools or like they need to stay in the locker kind of a thing through the day. That's becoming really common here. Yeah, I'm not surprised to see that there is this growing, not just pushback to, but skepticism of, you know, the idea that everyone having a screen, everyone having a Chromebook or a laptop is the best way for people be learning. Oh, absolutely. And if Pennsylvania doesn't have a law about cell phones, I think
Starting point is 00:50:45 New Jersey does. I think New Jersey right next door has, has a ban. And yes, cell phones are, that's just, we all know when we have a cell phone near us, we're distracted. That's just basic common sense, right? That's just what is what that is. But I do think a lot of people are starting to really question and try to be a little bit more analog for sure. I'm really curious to how this plays out, but we are definitely at a moment of backlash. Yeah, I'm kind of curious how this plays out. But my thing is I just want some critical thinking. I just want, like, if I can attend a professional development session on generative AI and they acknowledge that the sarcastic paper exists, they mention Eliza and what, what had Weiss and Baum's conclusions
Starting point is 00:51:32 from Eliza, then I'm like, okay, we're at least thinking about this critically. That's what I want see, I want to see that in K-12, and I just haven't seen that in that discourse yet. Yeah, if we're going to have the discussion, let's at least have the broader discussion, not just the kind of boostery, hyped-up discussion that tries to get us to adopt it. Exactly right. And let's also keep our examples relevant. Robotaxies are not part of the decision about whether or not large language models are part of effective pedagogy. They're not generative AI, all right? As terrible as it is that
Starting point is 00:52:09 technology labeled artificial intelligence AI marketing term is used in determining who to bomb, as awful as that is, I don't think that bears one way or another about whether or not a large language model should be used in a K-12 classroom. So let's keep it
Starting point is 00:52:25 through generative AI, to things that might actually be used in a classroom, and let's be fact-based, not boosterism, and let's not quote people who are selling it to us. That's definitely not do that. Oh my God, that's such a problem.
Starting point is 00:52:40 I've done interviews before where they push back on me for being critical of the technology, you know, saying, oh, you just don't like it because you're more on the left, all this kind of stuff. And I'm like, when you have the promoters on here, do you push back on them and be like, oh, it's because you're financially incentivized to push us to adopt it? No, they don't, right? Right. And I would say, I don't even think that, I mean, I didn't get.
Starting point is 00:53:05 edit, like the Trump administration loves generative AI. Like, that's, that's 100% true, which is funny because I see a lot of people who I see promoting it for K-12. If you were to look at their other posts, they're very anti-Trump, but they don't make that connection. I just think, though, as far as the backlash, as far as the backlash, especially in screens, but also there's the backlash going on in this country about generative AI and data centers, that cuts across political spectrum.
Starting point is 00:53:33 That's Mandami and that's Trump as far as who the supporters who are very, very concerned about these things for sure. Yeah, absolutely. Parents of either political persuasion are on this. Tom, this has been really fascinating to learn about what is going on in K to 12 schools, what you have been seeing. And, you know, the real important questions that we need to be asking about this technology and what we're doing to kids,
Starting point is 00:54:03 but also to our broader society in rolling this stuff out in schools and not thinking about the bigger question. So I really appreciate you taking the time to come on the show. Absolutely. Thank you so much. It was a pleasure, Paris.
Starting point is 00:54:16 Tom Mullaney is a high school teacher in Philadelphia. Tech Won't Save Us is made in partnership with The Nation magazine as host by me, Paris Marks. Production is by Kyla Houston. Tech Won't Save Us relies on the support of listeners like you to keep providing critical perspectives on the tech industry.
Starting point is 00:54:29 You can join hundreds of other supporters by going to patreon.com slash tech won't save us and making a pleasure of your own. Thanks for listening and make sure to come back next week.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.