Tech Won't Save Us - Do Chatbots Really Belong in Schools? w/ Tom Mullaney
Episode Date: May 28, 2026Generative AI is making its way into many parts of society, and schools are no different. Tom Mullaney joins Paris Marx to discuss how generative AI has been adopted in K-12 education and the many con...cerns it presents for students and teachers.Tom Mullaney is a high school social studies teacher in the suburbs of Philadelphia.Tech Won’t Save Us offers a critical perspective on tech, its worldview, and wider society with the goal of inspiring people to demand better tech and a better world. Support the show on Patreon.The podcast is made in partnership with The Nation. Production is by Kyla Hewson.Also mentioned in this episode:Here is the New Yorker article on AI in schools.For those looking for a refresher on Weizenbaum and ELIZA.Here is the paper “On the Dangers of Stochastic Parrots: Can Language Models Be Too Big”.For those curious about the Canvas breach.Students have been booing pro-AI speeches and AI presence in graduation ceremonies.xAI is facing a lawsuit for polluting Black neighborhoods.Support the show
Transcript
Discussion (0)
I don't remember being an elementary school student and thinking, like, okay, this is what I'm doing to learn how to do a job, right?
You're there to be educated.
And we as a society, as a K-12 profession, we need to have that conversation and figure that out.
I personally don't think of education as job training, but I think so many people do now that it's a situation that we need to resolve.
And I don't know that thinking of it as job training is the most child-friendly answer to that.
question.
Hello and welcome to Tech Won't Save Us, made in partnership with The Nation magazine.
I'm your host, Paris Marks, and this week my guest is Tom Malaney.
Tom is a high school teacher who teaches social studies in the suburbs of Philadelphia.
And Tom has been writing a lot about generative AI in schools, you know, has been talking about
this.
Certainly, we ran into one another on Blue Sky, which is where I started to get to know him and
his work and, you know, get to know his opinions on this, right?
And I was thinking about doing an episode on generative AI in education for quite some time.
And then I was reminded recently when there was a New Yorker article, but also some listeners asked for an episode on this.
And I said, yeah, I need to reach out to Tom.
We need to finally kind of do this episode, understand what is going on, had this discussion.
And I was really happy he could make the time because I think that we had a great and wide-ranging chat where certainly we talked about generative AI in education and what that means for.
students, how students are using it, but also what it means for teachers and school districts.
And we extend that conversation as well to talk about the use of digital technology more broadly,
how that has been pushed for the past couple of decades, you know, what that actually means
for schools and teachers and students, you know, going from kind of Google and Google Classroom
and the reliance on those sorts of tools, but also, you know, how teaching and how education
has changed over the past number of years.
And how that's tough on both students and teachers alike.
And these tech companies really take advantage of it to push their products and make it
seem like they're going to make things easier and more efficient while really, you know,
they're just getting data, getting information, getting money, certainly.
And, you know, does that really work for us?
You know, and we end by talking about the growing backlash, right?
Not just to generative AI in schools, but also to screens more broadly and what that is doing
to education.
and where these things might be going.
I think it's fair to say we both see this as kind of a hopeful movement to try to bring education away from the technology
and actually focus more on critical thought and the general principles of education.
So, yeah, I guess that's all to say that I had a really good time talking with Tom.
I learned a lot from him, and I thought it was really insightful.
I think that you're going to learn a lot as well.
And if you're a parent, you're probably more familiar with this than I would be.
But hopefully you think I could have asked the right questions.
And certainly even if I didn't, Tom has a bunch of examples and a bunch of insights to share with us.
So I think you're going to really enjoy it.
As always, if you enjoy this episode, you can leave a five-star review on your podcast platform of choice.
You can share the show on social media or with any friends or colleagues who you think would learn from it.
And of course, just a reminder that we do have a video version now that is available on YouTube,
modify, and I think we'll be on Apple soon. I don't know 100% how that works, but we'll see
when that starts or if it has started already. And of course, if you do want to support the
work that goes into making tech won't save us every single week, so we can keep having these
critical in-depth conversations exploring so many different parts of the tech industry, you can
join supporters like Michelle from Montreal or Belinda in Baltimore, who also wanted me to say
long-live Logan Hollinger. And you can do that by going to patreon.com slash tech won't save us,
where you can become a supporter,
get some stickers if you support at a certain level,
and certainly get access to premium episodes,
which I'll have more information on soon.
So enjoy this week's conversation.
I think you're really going to like it.
Tom, welcome to Tech Won't Save Us.
Paris, I'm a long-time fan.
Pleasure to be here.
Thanks so much.
I obviously really appreciate that.
And we've been talking for a little while
and have a meaning to do an episode on AI in education.
And so I wanted to start,
just by asking, like, you know, generative AI in schools has become a big topic of conversation.
I feel like even just, you know, the kind of digital technology use in schools is becoming something
that is more debated broadly. But I wonder, chat GPT was announced in November of 2022.
How quickly did you start seeing these chatbots and things making their way into schools?
So they made their way into the discourse about what students should be doing, almost the media.
And what I mean by that is by the spring of 2023, there were multiple books available
that promoted generative AI in K-12 schools.
Think about that.
Spring of 2023, multiple.
And the authors of them then go on to keynote at education conferences.
So that was immediate.
What was not immediate and what's still lacking is kind of that balance that, okay, well,
what do we know about generative AI?
and how humans use it.
So what did we learn from the stochastic Paris paper?
What do we learn from Eliza and Weissbaum?
That has been missing from the discourse in K-12 the entire time.
So, yes, very, very immediate.
And schools, the animating principle behind generative AI in K-12,
both I think amongst that discourse early on about how great this is going to be.
And as schools, they, all right, we have to incorporate this because it's here and it's inevitable.
it's fear of missing out.
Nobody wants to be an archaic dinosaur,
and so fear of missing out has been the animating principle behind a lot of this.
That's so frustrating.
But it's wild to hear that there were books available so quickly,
and unfortunately it doesn't surprise me that then these people go on
to kind of speak at the conferences and to promote it,
because we see this cycle again and again, right?
But it did feel notable with generative AI that very quickly,
if you listen to people like Sam Altman,
the potential educational,
you know,
implementations of this technology
were something that they were hyping up
from the very beginning, right?
You know, kind of this notion that
the chatbots can eventually become teachers
or teachers' assistants and,
you know, can kind of improve access to education
and all this kind of stuff was like,
part of the grand, you know,
amazing things that generative AI is going to do,
which I'm sure kind of affects the discourse
around, you know, education and how teachers and school boards and things like that are
thinking about it and talking about it.
So a lot of K-12 professional development and discourse has focused on people like Sam Altman
or even say Ethan Mollick, have you heard of him?
He's that UPenn professor who's always promoting generative AI and always saying, this is
amazing.
He's always promising that it's going to revolutionize everything and then, you know,
it'll just do it the next time something was released.
And voices like that who have a bias and an interest in us thinking that generative AI is truly transformative,
those voices have dominated the conversation and they're cited as experts.
As a socialized teacher, I want my students critical thinking.
And we need to have critical thinking as well.
And so if we're going to listen to those voices, we need to acknowledge their biases and why they have an interest in us thinking a certain way.
And we should also listen to voices such as Dr. Emily M. Bender.
Dr. Timna Gavru, let's listen to all of that and let's evaluate and critically think about that.
And then let's proceed with what we want to do with technology.
It is kind of wild how even in institutions like, you know, schools and universities,
that that kind of critical approach to the technologies, whether it's generative AI or any others,
doesn't seem to be at the forefront of the discussion early on, right?
You would think that if any kind of institutions in society are going to take a hard look,
at the technologies being proposed for society and certainly for their institutions in particular,
you know, what's it going to mean for schools? What's it going to mean for teachers? What's it
going to mean for students? You would think that they would be on the forefront of, you know,
considering those questions. And it's wild that that is often not the case, right?
So I'll give you an example. So at Google's I.O. event, Google I.O. They start talking,
they talked about something that's been basically debunked by now, but this idea of singularity or AGI that
Generative AI, large language models that just generate text, that's all they do,
they're going to achieve consciousness and humanity, right, and be smarter than humans.
And so I've seen, since that, at least two ed tech influencers talking about that and saying,
this is why this is so compelling.
Wired Magazine, Wired Magazine is not super anti-AI, but they quoted that stuff and said,
that's the most unhinged stuff said at this conference.
So it's kind of like, you know, we're hearing that computers are about to be human,
but the tech media who have been somewhat supportive, genera of AI are saying,
come on, that's ridiculous.
So that's the problem is that I think in K-12, we're hearing this message that, you know,
if I didn't know you better, I would say, oh, my God, like, if the computers are going to be
smarter than us, then, yeah, we have to do something rather than saying, all right,
this outputs synthetic text based on prompts that we enter.
So what are the consequences?
That's what we should be saying.
But instead, it's, no, we're going to have superhuman computers, right?
Unfortunately, we see the same problem in government and other kind of institutions
and places of governance that should be thinking through these questions,
but instead they buy into these narratives coming from the tech companies,
just as you're saying, right, whether it's around singularity or whatever else.
And so I want to dive in and talk about generative AI, but I wonder before we start, you know, to really dig into that conversation, obviously there have been, you know, concerns around how these tech companies have been relating to schools for a while. And I wonder, in your view, how did the rollout of generative AI in schools build on some of the existing concerns that existed with, I guess, the influence of these companies on what happens in K to 12 schools?
Okay. So that started. So what got me down.
path because for years, I was someone who incorporated technology and promoted technology in schools.
And I do think there are some real valid uses for it that make teacher lives easier, student
lives easier that make things more inclusive. I think there's absolutely some things to be done
there and said. But what happened was, you know how brands use influencers and things like that?
That's really what, especially Google, they led the league in that in like the early to mid.
2010s. They were excellent at that. And then they're offering their stuff to schools for free.
And it wasn't until later in the pandemic when schools really were dependent on it that they
started charging for it. But that's really... That's so ridiculous. Yeah. That's how it really
happened. And I would say, I would encourage schools. I've actually talked to some administrators
and they say, look, we have to have Google. We have to have Microsoft. It's just for all of the things
that happens student information systems. I would say like look at things like ellipsis. That's an
It's a word processing tool that's available for free.
I would still pilot that or have just a few advanced teachers play with that
and see if they could use that as opposed to, say, like a Google Docs or something like that.
These companies did Google, Adobe.
They were very adept at conferring prestige on people for using their products.
And schools can be a very isolating place.
I might do a lesson about the New Deal.
And maybe it just home run just is amazing.
And maybe my students know that, right?
And maybe if a principal was there observing, they know that.
And then besides that, not much outside recognition.
So these tech companies were very smart about, and what happened was, by the time we get
to like pre-pandemic or pandemic, I would get emails from teachers or from tech leaders
at schools.
And on the signature, there'd be 50 badges of 50 ed tech companies I'd never heard of.
Here, we'll give you a badge.
And my thing was, I was one of the prestige of the.
the companies that my friends outside of education would know.
So I, as I look back, I promoted those companies, not these smaller ones, but I don't, I'm
not super proud of that.
But we've all made mistakes.
It's okay.
Yeah.
Yeah, definitely.
Anyway, so they use prestige to get in and get teachers on board, typical influencing,
brand ambassador stuff.
And that, the people I see in those spaces,
they are not, I think, taking to heart the lessons now that are coming out of families being
very concerned about technology in schools.
They're not taking that to heart or at least considering that, hey, maybe we need to like
really think deeply about this.
You know, I've definitely reconsider a lot of my beliefs or the last two, three, four years.
And I think that's only for the best for sure.
And I think what you're saying there is something that a lot of people have experienced
over the past number of years, right?
You know, kind of a lot of us bought into the ideas that the tech company sold us,
whether that was about implementation in schools or how these technologies should be used in our
general lives.
And I think there are a lot more people who are kind of asking the question as to whether
that made sense and changing their practices and changing their views on those things.
So I don't think you're like outside of the norm on that at all, right?
Well, thank you for saying that.
It's definitely something I've struggled with.
And as I've returned to the classroom in the last year or so,
I'm kind of like, okay, well, maybe I can like do some good here, you know?
Yeah, no, I hope so.
I feel like hearing you talk about that as well, like it brings back a story to me that
that always stood out when I think about these tech companies and education.
And that is how back in the 1980s, Apple was one of like the first movers to get Macintosh,
you know, to get computers in general, but it really wanted to get Macintosh computers into schools.
And in particular in California, where it was based.
I think it just gave a ton to schools for free, if I'm, if I'm remembering correctly,
or they were very cheap, but I think they were free.
And really, the goal was like to introduce people to the products,
to get people depending on the products, to get people used to them, you know,
potentially cultivating future customers, of course, but also just kind of building in that
dependence early in a place where, you know, you have a bunch of, you know, employees who are,
who are going to be using these things.
But also, you know, you're kind of getting to people when they're young and they're
developing an association with the brand, or if you're thinking of like Google or Google
classroom, like they're actually getting a Google account very early in their lives. And I'm sure
the hope is that they're going to then carry that through, you know, much of the rest of their
lives, right? So Google and Google classroom, they, you know, it's about 2015. And I'm,
it's actually, sorry, 2014. And so when that happened, and I would say having an LMS does give you, you know,
students are absent, bam, they just go to the LMS.
Like, there are definitely some...
And can you just say what that abbreviation stands for?
Thank you. Sorry.
Learning management system.
And there are others.
One is kind of notorious right now because it just had a ransomware attack,
Canvas learning management system.
So what's happened is, yes, everything's become Google Classroom.
And the funny thing is that when the pandemic, at the onset of the pandemic,
Google Classroom became almost ubiquitous.
but in the Apple store, students would review bond.
They would all give it like one star.
And I don't even know, I think a certain point it was cut off.
But what does that tell you?
Like, what does that tell you if students are doing that?
Maybe we should like listen to that rather than consider that bad behavior.
Maybe that's like honest testimony.
So yeah, it became basically ubiquitous with the pandemic.
I remember thinking before the pandemic, you know, this is like a third, like maybe near a
half, but not quite.
And then at the pandemic, it was like, well, we're in Google classroom.
And there's, you know, there's Microsoft schools.
And so they might use another learning management system like Schoology or Canvas.
I will say this, having worked with all of them, Google Classrooms, Schoology, Canvas,
they're not the most exciting things to ever work in.
They're not amazing.
Even just if you use Slack, and I've used Slack for different things when I was consulting,
Slack is so much more fun and, like, things you can do.
but I think there's kind of an inherent mistrust of kids.
So it's kind of like, okay, well, don't let them like do certain things.
Don't let them like emoji react in certain contexts.
Just little things like that, that it's kind of unfortunate that that's how,
a lot of ways, like, I think of how I experienced technology and how I,
for years, technology has been like, oh, this is like better.
This is like better than what I could do before.
Even like Adobe Photoshop in the 90s, when I first,
was exposed that. I was like so excited. Wow, that's amazing. And now it's a subscription thing
and people who use it are resentful about that, right? This is the way our kids are experiencing
technology for the first time on 11-inch Chromebooks. So I wonder if they get to, you know,
they get to my age, they're just like so over it. They're so like, yeah, technology is for
unfun things. Maybe that'll happen. I don't know. Yeah. And maybe it's even in high school
when they're when they're reaching that point as we see these like Luddite clubs and
things like that in Brooklyn and whatnot.
Definitely see that.
I mean, we know about the backlash about generative AI and the commencement addresses,
but I think I see that among students too, where students are want to get analog.
And of course, I don't know if Canada is experiencing this, but the big trend now,
the big thing that kids, high school kids are doing in the United States is playing hacky sack.
I mean, I'm going to talk about the most untechnological thing you can do, hacky sack.
So I think there is something to that.
Interesting.
That's really interesting.
I feel like when you're talking about the learning management systems,
one of the first things that came to my mind is like,
I think they came in just like sort of after I finished high school and stuff,
like a number of years after.
And I was like, but I think my brother had them or one of my brothers did.
And I was like, if my parents would have been able to look up my grades that easily,
I would have hated everything.
Like I would have been so mad.
So that's, and that.
That's even a different system called the student information system.
And sometimes learning management systems play nicely with student information systems,
and sometimes they don't.
And typically your student information system,
which is this thing usually called Power School,
and that's a whole other thing.
Parents and guardians have quick access to grades.
So yes, I would say, I always say,
it would be my nightmare to wake up and be one of my students.
Not that I think I'm that better teacher,
But what we ask of students today in this digital age, the amount of work we give them,
their life experience, what they're looking at with generative AI and their future and just
the world we're giving them, it would be a nightmare to be in that position.
I feel nothing but solidarity with kids today, for sure.
Yeah, I think that makes a lot of sense, right?
And I want to start moving into talking about generative AI specifically, but hearing you say
that, it actually brings to mind something I've heard a lot about,
universities, right? That, you know, part of the reason that generative AI and that these tech companies
can so easily kind of move into universities is that they're taking advantage of some of the flaws
that have already developed in kind of the model of the university, right? What university education
has become, you know, how it has been transformed by administration and consultants over so many years.
And, you know, you don't have the same student experience. You don't have the same kind of expectation
from a university as you might have in the past.
You're maybe trying to get a degree to get a job rather than develop your critical
thinking skills and all those sorts of things.
And I feel like, you know, in that sense, the companies can take advantage of this flaws
that already exists in the model.
And I wonder then in K to 12 schools, if you think that how K to 12 education has kind
of developed over time or has evolved because of financial pressures and all this kind of
stuff, if the companies are also taking advantage of those problems to kind of move in.
All right, so this is a reckoning we have to have in K-12.
Either K-12, and I'm talking to kindergarten, you know, what is that?
Five years old through 12, which is 18 years old, either it's job training or it's education.
Because I hear so much about, well, we need, you know, corporate America needs this and kids need these job skills.
And I'm sitting there thinking, does a fifth grader need to be ready to work it for a corporation?
this, what are we getting at?
And the justification for so much of this technology is that students need real-world skills
and they need to be trained for employment.
I don't remember being an elementary school student and thinking, like, okay, this is what
I'm doing to learn how to do a job, right?
You're there to be educated.
And we as a society, as a K-12 profession, we need to have that conversation and, we need to have
that conversation and figure that out. I personally don't think of education as job training,
but I think so many people do now that it's a situation that we need to resolve. And I don't know
that thinking of it as job training is the most child-friendly answer to that question.
I couldn't agree with you more. I think it causes a lot of issues in K-12 education and also
in university education, right, with how these systems have,
transformed and how they've been so reoriented toward preparing people for the job market,
employment, all those sorts of things, rather than, which is not to say cultivating other skills
is not done, but it feels like it's not the focus in the way that it should be or that maybe
it was at a certain moment, you know? Right. And critical thinking amongst our students,
especially because I don't know that being iconoclastic and being different and thinking,
you know, outside the box to be cliche is really what employers want.
You know, they say it is, but is that really what an employer wants?
They want a bunch of employees who are going to do things differently, go their own way,
disagree.
Is that what they really want?
But I thought education was for critical thinking.
So there's a bit of a conflict there.
And I hope that's resolved in, like I said, a child-friendly way.
It makes me think of all those articles that are like, Gen Z workers are complained so much on the job
or are so willing to, like, leave their jobs if they,
don't like their boss or whatnot. And it's like, I feel like when you're talking about is a
critical thought or is a job training, what do employers want? Like, that's the first thing that comes
to mind how they're annoyed if people do push back. Right. Self-advocacy in a lot of context is not
valued. And I hope that students learn self-agocacy. Can I give you an example? So the UFT
recently promoted a generative AI app and they told a story about it. And that's the United
Federation of Teachers, Teachers Union, one of the teachers, one of the teachers union, one of the teachers
in the United States. And they tell an anecdote with a student who says, you know, I don't want to
bother my teacher so I can ask this chatbotic question. That is the bleakest possible outcome.
As a teacher, when a student asked me a content-related question, that is the highlight of my day.
That is what I want. I want them curious. I want them to think of me as a support and a resource.
The last thing I want is them saying, you know, Mr. Mulini doesn't want to hear you.
hear this right now. Let me ask the chat button. That is not the outcome. And that the UFT of all
people is promoting that, that is really, really scary. And again, like, we really need to
reconsider the role of technology in education for sure. Very well said. And on that point,
then, I want to dig into the specifics, but I think I'll just start with more of a general question.
How are you seeing generative AI being used and rolled out in K-12 education now, you know,
more than three years on from the release of ChanchiBT.
Okay, so at the schools using it with kids level,
there's a lot of chatbots, tutoring.
If you go to the ISTE conference,
I don't recommend that you do.
And I've been there and I've actually presented there.
I've presented there for a vendor there,
it was not a generative AI vendor.
Actually, I did do one.
I did a session about the Eliza effect and historical speakers.
It was for a teacher-centered generative AI.
They brought me to do it.
It was pretty cool.
But their stuff was not student facing, so I don't think they thought of it as a threat in
anyway.
But ISTE is now overrun with just AI apps, right?
And that's a conference for teachers or?
That's a conference, the International Society for Technology and Education.
So that's for, it's supposed to be, you know, K-12, it's very expensive.
So it winds up being mostly like district folks who can expense it.
So a lot of it is some sort of chatbot teacher, tutor, and then lesson plan.
generator. And as a lesson plan generator, that just breaks my heart. I think about the best lessons
I've ever done. And they've involved one million small decisions over time, whether it be my summer or like,
you know, I get it. Teachers are overworked. They have so much work to do. And I don't know that
large language model chatbots are the answer to that. But that's the big thing. Now, on the
student side, there are some that, you know, interact with students, but a lot of students will turn to
generative AI, whether, you know, usually chat GPT, of all things, to get answers.
And I personally think that it's a matter of solidarity with students.
If our students are so overworked, if they feel so overworked, that we need to like reconsider
a lot of the systems, a lot of the assessment, a lot of things like that.
I think that's the answer to that.
That's not easy.
That's not a quick fix.
But students relying on a chatbot, which we know as an error in accuracy, we know that
I don't know if it's documented by research, but it's documented anecdotally a ton, that long-term use of chatbots, at least in some people, has some bad effects.
So there's some things that we need to think about as far as, okay, if we know our students are using them, why and what, like, what is it that we can do to get students to a place where curiosity is driving the learning, not, I have to get this done, is driving the learning.
Yeah, I think that makes a lot of sense.
And I want to dig in on some of the different places where we potentially see chatbots, right, or, you know, generative AI being used.
And I wanted to start with the students because I feel like, you know, we've had a lot of stories, you know, a lot of media reporting and things like that about student reliance on chatbots, the amount that students are using chatbots.
And I think some of that has been kind of debated the degree to which that is happening or like how they're using it.
I remember one time seeing like the user graphs of ChatGBTBT and like when the school year would end, you would see the user numbers drop off, which you know, kind of suggested a lot of students were using it.
But yeah, so I wonder what you're seeing in, you know, the kind of student use of generative AI.
And I imagine that is probably more prevalent on the high school end where you are rather than the earlier grades.
But yeah, what are you seeing?
So the big thing I'm seeing is students turn to it to help them understand more difficult concepts.
So I'll give you an example.
So I was teaching a course that had some very difficult reading, some very dense, difficult reading.
And so I had a student who was turning to it to kind of summarize it.
I think they were taking like the big questions and themes from the reading and entering it into chat GPT and seeing what came up.
And what happens is, and this happens to a lot of people seemingly who use generative A on chat pots,
They were very confident that they knew what was in the text.
And then when I started asking a few questions, it was kind of, oh, you know,
so I think that's a big thing that students are using it for,
trying to kind of like figure things out.
And I think a big problem that I think also, you know,
the foundational knowledge about it should be Saccharis, Eliza,
but also just like little language that gets away from anthropomorphization.
So verbs like ask, that's what they would say.
That's what most people would say.
But we don't ask chatbots things.
We ask people things.
So I would say they enter text in with questions about American history concepts, about a chapter in a textbook.
And then the chatbot generates text that in their mind, to their mind, responds to that.
I know that's very difficult.
But otherwise, we're just anthropomorphizing these chatbots.
and that causes all sorts of problems.
But anyway, so that's what's going on there.
That's what I'm seeing as far as student use.
And I think it varies.
It could be, I've seen, you know, I saw a student, you know,
they copy-pasted an answer to a question clearly from chat GPT.
And so I just had to say, like, look, you know,
the policy of this was no generative AI allowed.
As a teacher, I want to hear from my students.
Like, what an LLM generates is of no interest to me.
One, it's just not interesting.
And two, it doesn't help me assess a student in any way, right?
If an alum, generate and trade, so what does that tell me about a student's understanding of the subject?
I have a couple questions based on that.
The first is, does discussion of the use of generative AI or even like what it is,
does that kind of come up in conversation in the classroom?
Is that something that you discuss with students at any point?
So yes and no.
as I've come back, I've come back to the classroom.
So I came back in 2025, and I'm covering for another teacher.
Next year, I'll be able to do it all on my own.
I'm very excited.
And so then I'll cross that bridge.
And I do think, I have some ideas.
I can get into those about how I might do that.
But another example.
So I was talking to a student about a rubric that's generated by a third part, long
story short, it's like these advanced exams.
And so there's this third part rubric that we just as teachers use.
and the student cited,
he said, chat GPT said,
and I said, that's not a source, right?
If you show me the document, the PDF or the web link,
yeah, great, we'll have that conversation,
but chat CPT is not a source.
And so that's, it does come up.
I've had students say that like, oh, yeah, I love chat.
And they sometimes call it chat, like it's a friend.
And that's kind of,
I've heard that as well.
Yeah.
Yeah.
Again,
if you're told this stuff is like going to be sentient.
And because chatbots use personal pronouns,
which is a choice that developers make,
these are choices that are made.
So I understand why that happens.
And, you know, I was a teenager too.
And if you told me that there was a shortcut to getting something done,
in most of my classes, in my history class,
I wouldn't have because I was just interested in history.
But to get through my AP bio,
class, yeah, I would have definitely done it. So we have to understand that temptation as well.
But yeah, I would have done it. It wouldn't have really helped long term, but I would have done it for
sure. Yeah. I'm sure I would have been doing the same as a high school student. Like, you know,
there's no question about it. I wonder as well, like, I've heard stories of teachers and even
university professors also changing the way that they do like assessments and tests now that generative
AI is a thing. I wonder, has that entered your kind of thinking?
you know, again, I know that you're covering this year.
I don't know if you can change the way that works,
but if you're thinking about how you might approach things next year as well,
like, you know, is there less kind of like essay writing at home
and more writing essays in class so you know that, you know,
that LLMs can't be used while doing it?
Like, I don't know, is that entering into your thought process at all?
That definitely is entering into my thought process.
I do think, and I think it's just more equitable in the first place,
that bigger assignments be done in classroom anyway,
because you just don't know the obligation,
of a teenager when they're at home, and that's very socioeconomic driven.
So that's just more equitable in the first place.
And I will say, I'm not in love with the idea of if a student has a long piece of writing,
they have to do a paper pencil because there are some students who use speech or text.
There are some people who for writing, it's a challenge.
So I don't love that.
But if it's taking place in my classroom, then I have more eyes on it and I have more ability
to do that.
But having said that, being more analog is definitely, oh, my goodness, it's time to rediscover that.
I recently inherited a project from the teacher I'm currently covering for in a history class called the stamp project where students would just draw and design a stamp, like a postage stamp of any big topic in American history.
I mean anything.
And the results are amazing.
I'm taking pictures of them and texting to my friends just saying,
I'm like, can you believe what these kids did?
I texted them to the teacher I'm covering for.
And the teacher I'm covering for almost expected it.
They almost were like, yeah, I know these kids are amazing.
You know, so that to me and that class is at a higher level.
And I'm saying to myself, if I'm teaching that same content at a lower level,
we're still doing that project next year.
Like, that's happening because it is so wonderful to see that art.
So I think that's going to be a big driving thing.
is like, what can we do analog, what can we do in the classroom?
And knowing that if I give my students a very big piece of writing,
then it's going to have to be, you know, maybe the brainstorming,
the first pieces in the classroom are going to be maybe more of what I focus on when I assess it.
Because I know that there will be a temptation there for sure.
Yeah, I think that makes a lot of sense.
I was wondering as well on that front, like, you know, as you mentioned earlier, we do see these reports that, you know, extended use or using and relying too much on chatbots can affect people's critical thinking skills, their cognitive abilities, their ability to retain information.
Do you see much of that or do you worry about that kind of in class with the use of these technologies?
Oh, I definitely do.
I do. The cognitive offloading. And I think just the overconfidence, there's now, there is not.
not a humongous research base here.
But I'll give you an example.
One of the few ones that exists, it's a, I think it's a Penn study, and I'm going to do
my best to summarize it, but basically, you know, students were given a math problem,
and then they were given an AI tutor, and some weren't.
And what happens is in the immediate aftermath, students do great.
Okay.
And then on the long-term assessment, not only do they think they did well, but they don't do
as well.
So they have this overconfidence and underperformance.
and I can really see that that makes a lot of sense to me
just from the little I know about LLMs
and what I know about teaching and students.
Yeah, yeah, that's going to be it.
That's going to be a real challenge for teachers
is students who are overconfident
because they've interacted with a large language model
and then, oh, but you didn't really have real learning experiences
where you got the fingers in the dough.
So yeah, that might be a real thing to consider
as we go forward.
I don't know about you, but as I hear you describe that,
what comes to mind is kind of the discussions that we were having a few years ago
about students, you know, being at home and learning virtually during the pandemic
and how that potentially impacted social skills or learning and all those sorts of things.
And it felt like at the time there was a lot of concern about that, right?
You know, obviously some of that was motivated by people who didn't want lockdowns to happen.
and all that kind of stuff.
But there were, I think, legitimate concerns there as well, right?
Like, it is important to be around people, to be, you know, in person when you're learning and those sorts of things.
And I, and I, I don't know, it's a bit weird to me maybe that I feel like, you know, those kind of concerns about students and their learning experience and kind of their mental development and all those things are maybe not getting that same degree of attention as I feel like virtual learning had a few years ago.
And I'm sure that there are like commercial reasons for that and all sorts of things.
But yeah, I wonder if that's something that comes up for you.
Okay.
So personalized learning, the idea is, is that each student has different lesson materials
or lesson materials that meet their unique needs and or interests.
And especially if we go to say, really the whole decade of the 2010s, personalized learning
was everywhere.
And technology makes personalized learning so much easier.
And what I've noticed is that in the 20s,
20s, personalized learning has been dropped.
It has been dropped like a hot potato.
And my guess on that is that it's because as a society, it's becoming very obvious that we don't have a collective agreement and understanding on truth.
And so the idea of things being more individualized is actually not something that people really want to see.
And of course, an LLM tutor is like personalized learning on technology enhanced.
Now, again, steroids do actually make you lift more and hit home runs farther, right?
LLMs.
Anyway, what I'm seeing there is that the idea that each student is in front of a device,
which is now getting so much pushback in the United States of America,
so much pushback from families.
But that's really where this is where this would be going.
If we're saying that we want students interacting with the chat GPT or
other LLM, that's where it's going.
You're going to literally student and device one-on-one.
And as far as community, collective understanding of the truth, social skills, that's not
going to help that situation at all.
And I actually think I'm really almost surprised at how excited people in K-12 are about
LLMs and generative AI tutors when personalized learning has become kind of passe.
day. I'm surprised that that's happened because it's kind of like, that is personalized.
What do you know?
Yeah, that's fascinating. It's really interesting to hear. I wanted to flip it a bit.
You know, we've been talking about students, what you're seeing with students' use of
AI and those sorts of things. If we turn it around to the teacher side of things,
obviously, you know, teachers are using generative AI as well. You know, you mentioned some uses
earlier. I wonder what you're seeing on that side of things, on how teachers generally
are thinking about generative AI, you know,
is there a lot of kind of critical views on it,
or are people adopting it, as you say,
because they're overworked and they see this as a potential tool?
And do you see the adoption coming largely from the teachers themselves,
or is it often being pushed by administration, by the school board, things like that?
So what I'm seeing is a huge mix.
And I'm happy, I don't think that you can say by and large teachers,
are doing A or B, I think it's a mix.
And I think, one, it's definitely not informed by deep
understandings of large language models.
And when I say that, something I hear a lot is that,
oh, well, students and teachers need to learn how to use these tools.
Using them is so easy.
You literally enter a prompt and then something comes out, right?
Using them is so easy.
And if we think, well, you have to refine your prompt,
well then maybe it's not like then come on like if you have to do if you have to refine things 50 times
is there's really a time saver but what's happening is you see a lot of of things that are true about
teachers so teachers are overworked teachers are also huge BS detectors like teachers are so
skeptical you know they're kind of trained to be like that life experience makes them like that
and so you have the ones who they they've never heard of the stochastic parrots paper but
they're sitting there saying, come on.
And they've also been through ed tech over promising over the years.
So they're kind of like, come on, really.
And then there's the teachers who are like, look, you know,
I just want to generate this rubric and be done with it.
And then it gets generated, right?
I see some that just ignore it, just don't care one way or the other.
I think a lot of teachers are annoyed at students for using it.
I think the student usage thing is a lot more complex thing that we have to, again,
have some solidarity with students around.
but I think it's all over the place.
And I just want the conversation to start with the actual experts,
with the computational linguists,
with Eliza and with Weiss and Baum,
like, let's start there.
And that's just not part of the conversation right now.
That's what I want to see happen.
That's fascinating to hear.
And like, I'm not surprised, right,
that there's going to be different approaches.
And obviously that teachers are going to approach this with a critical eye,
because they've seen so many of these promises before not pay off.
I did want to go back to the part about administration and school board.
Is there trainings on generative AI that are put on for teachers?
Is there kind of like a push from higher up to use these technologies?
That really devours school by school.
And you see, so what I'm seeing is the big thing that gets people in positions of power
to pause is the environmental stuff.
For whatever reason, the environmental thing,
now there are a lot of other documented harms,
generally they have.
When people hear that environmental thing, they pause.
Some people mention it and then just go the heck on
and keep going forward.
Other people, though, say, like, hey, this is really a problem.
Because now we know about data centers.
We know, well, at least I think a lot of people know about Boxtown
where, because of Elon Musk's data,
center, people are saying, how come I can't breathe? And we know, by the way, that this isn't
like a you and me, Paris and Tom thing. This is a historically marginalized and oppressed people,
environmental racism thing. That's what generative AI is. They're not building data centers in
the affluent places, but so we know about that. But then there's the other people who, I think
they have that fear of missing out. They do not want to be considered archaic. They do not want to be
considered out of date. They are grappling with the idea that K-12 education is job training,
and so therefore we have to have our students current and relevant, and our instruction
current and relevant. And so I think that's what's happening there. And just like it's really
hard to say that all teachers are in or out. It's really hard to say whether or not all school
boards, all administrations are in or out one way or another. It really runs a gamut.
But I do think they all feel that pressure to, like, hey, we're not outdated.
We're not dinosaurs.
We are cutting edge.
But I also kind of wonder, you know, it's becoming such a thing that there's a backlash
against general AI, against tech companies, against it being mentioned in commencement addresses.
I wonder if that whole cutting edge thing is going to kind of diminish a little bit.
I wonder if that's almost going to be kind of like, oh, you know,
We don't want to, you know, like traditions.
And again, I get it.
Tradition in a lot of ways is traditional things that harm people.
And so tradition isn't really a great value either.
I like to say it should be about solidarity with students and teachers.
Like what is the most solidaritist place to be for those groups?
And that's what should animate it, not innovation.
And I will say, by the way, if there's been a word in K-12 in the last 10 years,
that has done more harm.
I don't know of any word
other than innovation.
What's happened is
what little Johnny and Hakim
and Aaron and Sandra need
has been put on the back burner to innovation.
Innovation at all costs.
And innovation at all costs is not what our kids need.
It feels like that's not just a K-12 schools thing.
It feels like it's our whole society, right?
Everything has been put on the backburner to so-called innovation,
whether it is even that at all, right?
That's really interesting to hear.
And I wonder, you know, as we start to kind of close off our conversation,
what you see in the pushback to this, right?
You know, you mentioned the data centers there,
and obviously we're seeing a growing pushback to data centers,
and I feel like we're seeing more and more reporting
on the use of generative AI in school,
So I wonder what you're seeing on your end to the rollout of these technologies and whether students are pushing back on them, whether teachers are pushing back, how parents are reacting.
How is the discussion evolved in schools around generative AI?
So in the Philadelphia suburbs, there's a district where I think there are up to like 600 parents who are petitioning that their kids no longer receive a Chromebook.
They actually have a motto, and I see it, they put it on lawn signs, like it's an election campaign.
It's called pencils up, screen down.
And that, I think, is going to be the biggest factor.
So there's been some resistance from districts who say, hey, we need one-to-one devices in order to do education.
And I've thought about that.
And I realize, like, do I need technology to do education?
Yes, like, I need my computer.
I need a projector.
I need a photocopier.
I absolutely need those.
But if you were to tell me that if I have those and my kids lost their devices tomorrow,
I feel like I could deliver education.
And I think saying that you couldn't is a very dangerous thing.
I get it.
I'm not very good at organizing stacks of paper.
You know, I get it.
You know, I, oh, Mr. Malaney, what do we do yesterday?
And then I have to go find it because I'm not great with that.
But the idea that we can't do school without screens, and I,
And I get it.
I've already counted a screen for myself in a projector screen.
So I've already, I'm not at zero screens.
But I don't want to be in a position where I say we have to have student one to one.
I think that digital instruction can happen, but it can be, you know, maybe a little bit more special.
And it should be things that really excite the kids.
There's an app that I plan on getting into this summer.
ArcGIS has these story maps that you can create.
And I'm like, oh, I want to play with that.
But do we have to word process every single day?
You know, I think we can have some fun with it and do some interesting creative things.
But for it to be a daily driver, I think we need to really have some conversations about that and really have some thought about that.
But so that's what I'm getting at is the backlash against screen time, which I get it.
It doesn't, in some ways, it doesn't address inequity.
It doesn't address a lot of real, real big problems with.
education in the United States, segregation, which is still very much a big problem,
inequality, wealth inequality, all that stuff.
But that backlash against screen time, I think, is really starting to take hold.
And I think it's only going to get bigger and better.
And I think in a lot of ways, the promotion of ed tech and innovation over all other things,
it's kind of like, hey, you know, you were cruising for a bruising and the bruising is common.
And, you know, I think it's like kind of justified.
I love that. A bruising is coming. They deserve it 100%. It's fascinating too, right? Because it feels like at the moment when they are really kind of even pushing to ramp up the amount of technology, you know, to get people using generative AI and all this kind of stuff. It's like you have this counterforce of parents, you know, and I'm sure of students and teachers to a certain degree as well who are like, hold on. It's not just the generative AI. That's the problem here. But maybe we've gone far too much.
much into this adoption of screens. Like, I don't know of your school. I know it's becoming really
common in Canada now for phones just to be kind of banned in schools or like they need to stay in
the locker kind of a thing through the day. That's becoming really common here. Yeah, I'm not surprised
to see that there is this growing, not just pushback to, but skepticism of, you know, the idea
that everyone having a screen, everyone having a Chromebook or a laptop is the best way for people
be learning. Oh, absolutely. And if Pennsylvania doesn't have a law about cell phones, I think
New Jersey does. I think New Jersey right next door has, has a ban. And yes, cell phones are,
that's just, we all know when we have a cell phone near us, we're distracted. That's just basic
common sense, right? That's just what is what that is. But I do think a lot of people are starting to
really question and try to be a little bit more analog for sure. I'm really curious to
how this plays out, but we are definitely at a moment of backlash. Yeah, I'm kind of curious
how this plays out. But my thing is I just want some critical thinking. I just want, like,
if I can attend a professional development session on generative AI and they acknowledge that
the sarcastic paper exists, they mention Eliza and what, what had Weiss and Baum's conclusions
from Eliza, then I'm like, okay, we're at least thinking about this critically. That's what I want
see, I want to see that in K-12, and I just haven't seen that in that discourse yet.
Yeah, if we're going to have the discussion, let's at least have the broader discussion,
not just the kind of boostery, hyped-up discussion that tries to get us to adopt it.
Exactly right. And let's also keep our examples relevant. Robotaxies are not part of the decision
about whether or not large language models are part of effective pedagogy. They're not
generative AI, all right?
As terrible as it is that
technology labeled
artificial intelligence AI
marketing term is used in
determining who to bomb, as
awful as that is, I don't think that
bears one way or another about whether or not a large
language model should be used in a K-12 classroom.
So let's keep it
through generative AI,
to things that might actually be
used in a classroom, and let's be
fact-based, not boosterism,
and let's not quote people
who are selling it to us.
That's definitely not do that.
Oh my God, that's such a problem.
I've done interviews before where they push back on me for being critical of the technology,
you know, saying, oh, you just don't like it because you're more on the left,
all this kind of stuff.
And I'm like, when you have the promoters on here, do you push back on them and be like,
oh, it's because you're financially incentivized to push us to adopt it?
No, they don't, right?
Right.
And I would say, I don't even think that, I mean, I didn't get.
edit, like the Trump administration loves generative AI.
Like, that's, that's 100% true, which is funny because I see a lot of people who I see
promoting it for K-12.
If you were to look at their other posts, they're very anti-Trump, but they don't make
that connection.
I just think, though, as far as the backlash, as far as the backlash, especially in
screens, but also there's the backlash going on in this country about generative AI
and data centers, that cuts across political spectrum.
That's Mandami and that's Trump as far as who the supporters who are very, very concerned about
these things for sure.
Yeah, absolutely.
Parents of either political persuasion are on this.
Tom, this has been really fascinating to learn about what is going on in K to 12 schools,
what you have been seeing.
And, you know, the real important questions that we need to be asking about this technology
and what we're doing to kids,
but also to our broader society
in rolling this stuff out in schools
and not thinking about the bigger question.
So I really appreciate you taking the time
to come on the show.
Absolutely.
Thank you so much.
It was a pleasure, Paris.
Tom Mullaney is a high school teacher in Philadelphia.
Tech Won't Save Us is made in partnership
with The Nation magazine
as host by me, Paris Marks.
Production is by Kyla Houston.
Tech Won't Save Us relies on the support
of listeners like you to keep providing
critical perspectives on the tech industry.
You can join hundreds of other supporters
by going to patreon.com slash tech won't save us and making a pleasure of your own.
Thanks for listening and make sure to come back next week.
