Speaking of Psychology - How teaching and learning will change in the age of AI, with C. Edward Watson, PhD, and Beth Schwartz, PhD

Episode Date: September 2, 2026

Over the past several years, generative AI has moved into classrooms at lightning speed. C. Edward Watson, PhD, author of “Teaching with AI: A Practical Guide to a New Era of Human Learning,” and ...Beth Schwartz, PhD, senior director of teaching and learning at APA, discuss how students and educators are navigating these changes; how AI can help or hinder learning; how teachers can redesign assignments and assessments; and what schools and universities should be teaching students about using AI responsibly. Learn more about your ad choices. Visit megaphone.fm/adchoices

Transcript
Discussion (0)
Starting point is 00:00:00 Over the past several years, generative AI has moved into the classroom at lightning speed. Students are using AI to brainstorm ideas, write papers, solve math problems, and study for exams. Teachers are experimenting with it to create lesson plans and develop assignments. Meanwhile, schools and universities are trying to adapt to a technology that is evolving faster than many policies and teaching practices can keep up. Today we're going to talk to two experts who are helping educators navigate these changes using the science of learning to help answer questions about how AI can support and not hinder student learning. So how are students using AI in their work right now? What counts as cheating in the age of AI? What kinds of assignments, projects, and exams can teachers use to make sure that their
Starting point is 00:00:50 students are really learning, not just copying AI-generated answers? What are the potential benefits of AI and education and how should colleges and universities think about educating an AI literate workforce in the future. Welcome to Speaking of Psychology, the flagship podcast of the American Psychological Association that examines the links between psychological science and everyday life. I'm Kim Mills. I have two guests today. First is Dr. Eddie Watson, Vice President for Digital Innovation at the American Association of Colleges and Universities and founding director of the Association Institute on AI, pedagogy, and the curriculum. His work aims to help colleges move beyond fear or hype
Starting point is 00:01:38 toward a thoughtful, evidence-informed integration of AI into teaching and learning. He has focused on how institutions can respond to AI's challenges for academic integrity, student learning, curriculum design, and workforce preparation. He's the author of the book, Teaching with AI, a practical guide to a new era of human learning and was recently recognized by Ed Tech Magazine,
Starting point is 00:02:01 seen as one of the top 25 higher education influencers to follow in 26. My second guest is Dr. Beth Schwartz, Senior Director of Teaching and Learning at APA. She leads the association's efforts to advance evidence-based teaching and learning across educational settings. Before joining APA, Dr. Schwartz spent decades working in higher education as a psychology professor, university dean, and provost. She's a fellow of APA's Division to the Society for the Teaching of Psychology, and she's leading APA's efforts to provide educators with practical evidence-informed strategies on how to use AI in their classrooms guided by psychological research on how students learn. Dr. Schwartz, Dr. Watson, thank you for joining me today.
Starting point is 00:02:48 Thanks for happiness. Yes, great to be here. Let's start by talking about how common AI use in the classroom is right now at the K-12 and university level. I mean, What do we know from research and surveys and what are you hearing from the educators you work with? Dr. Watson, maybe you want to grab that? Well, it's interesting that the data is a little bit mixed. We can probably estimate that it is a large percentage of students that are using it, especially at the university level. But surveys of students, you know, where they self-report how active they've been using Genitive AI, the results, depending on the survey, are wildly divergent.
Starting point is 00:03:30 I've seen them as low as in the 20% range and other surveys up near 90%. So I'm imagining that some students might not want to self-report that they have been using it. But without a doubt, I would imagine it's certainly more than half, maybe three-quarters of students are using it. And of course, there's a lot of different ways to use it. I mean, some students are using it for, you know, career planning or, to help them learn various topics. And of course, there are other ways that they might use it that might diminish their learning or might be outright cheating.
Starting point is 00:04:02 But certainly, the vast majority of students are indeed using AI today. And are we talking about mostly high school and college level or are kids younger than that using AI right now? In the primary schools and secondary schools, a lot of the surveys have focused less so on the student's use of AI and more so on the teacher's use of AI. And when we look at that, yeah, we see that it's obviously increased. a great deal in the last year and a half. The use by faculty or educators is about the same in the primary and secondary in higher ed where it's primary, it's about 43 percent and middle school.
Starting point is 00:04:39 We see it about 63 percent, up to 72 percent in high school and college. So, but the use for students is, is much less common to be asked on those surveys. So we have much less data on that. There is more in the high school use, but in the primary and secondary, schools, educators are still trying to figure out for themselves how to use it, let alone how to incorporate it into the learning environment for those younger students. Yeah, and we'll talk about that, but Dr. Schwartz, I want to ask you, what are the biggest concerns you hear from educators about how the students are using AI? And we see time and time again, I think the top two concerns reflect cognitive offloading,
Starting point is 00:05:19 which simply means that the AI is doing the thinking, the reasoning for them, and in other words, they're not learning. And there's the issue of cheating or academic integrity. Those kind of rise to the top when you ask educators about AI, but there's also concerns about the fact that the reliability of AI, so they're speaking less so about the learning part, but just what the content is when they're using it or their students are using it. Educators also speak sometimes about the erosion of trust that happens because whether or not students turn in work, then they have to determine whether or not it's the student's work or the work of AI and that relationship that exists between the student and the faculty member can be eroded just by those questions.
Starting point is 00:06:05 There's issues of equity that's of concern, so does everybody have the access that they need when AI is available, particularly since there are some that are free and some that are where there's costs? And I've heard often from faculty about just the lack of professional development. So there's an expectation sometimes for administrators that they should be using AI. And yet they are not given professional development on the technical professionacy that they need or the pedagogical strategies that they need to learn to incorporate AI into their everyday classrooms. Well, Dr. Watson, that's something that you're working on, right?
Starting point is 00:06:42 Can you talk about that? So specifically how faculty are using AI in the classroom? Yeah. Well, I guess what we're kind of. of seeing that there's maybe 20% of faculty, give or take, that are sort of leaning into figuring out how to use AI themselves, you know, leveraging it from the improvement of learning outcomes for their students. There's probably this big middle of 70% that are sort of like wait and see, but sort of like learning to use it in a variety of different small ways. And then there's
Starting point is 00:07:17 certainly a resistance pocket as well. So it's kind of like the broader land. of how faculty, at least are self-reporting that they're using AI. But then when it comes to specifically the notion of leveraging AI for maybe teaching and learning purposes or course improvement, there are literally tools out there that help with every aspect of sort of the teaching and learning lifecycle from developing a syllabus to finding course materials to sorting course materials to assignment design, putting together lectures, developing PowerPoint slide decks, creating active learning activities for the classroom, all the way through providing feedback to students and even grading about a year ago
Starting point is 00:08:04 or a little bit less than a year ago. One of the big learning management system providers came out with tools nested within university learning management systems that purports to be able to grade just about anything. So the question is, it's like, Like, yes, AI can do these things, but do we want AI to do these things? Is this something that we would like to ask AI to perform that kind of task? Or are there certain aspects that really belong within the identity of what it is to be a professor in higher education? A lot of that's being hotly debated right now. Yeah, because from what you described, I mean, basically AI, it sounds like can do almost anything, right? I mean, why do you need a teacher if AI can do all of these? these things. Well, isn't that that's one of the debated topics. In fact, I had an interview with a press outlet just yesterday about a new program that had
Starting point is 00:08:59 been launched in London. It's a master's program that's largely taught by AI. So is that a good idea? That was the question for me was like, do you think this is a good idea? And it's like, well, I guess I'm of different minds. I mean, one is very much from a learning aspect. Like, would there be evidence to show that how they've designed and are leveraging AI, does it result in learning outcomes that are at similar or the same level of proficiency as a face-to-face program? And indeed, these are questions that we ask about online learning 25, 30 years ago, right?
Starting point is 00:09:36 So it's kind of like the same kinds of questions. And then we, of course, through inquiry around face-to-face and online learning, we found that there's nuances, right? I mean, online learning can be done very successfully, but it's like when done well, it can have really good outcomes. And when done poorly, face-to-face instruction could be worse than an online course. So I think that that's likely going to be the outcomes of some of these, I guess, emerging studies around leveraging AI for instructional purposes. But we don't know yet, right?
Starting point is 00:10:09 I mean, those research studies haven't been done. And certainly evidence should guide, you know, the practice that we might have. employ or where we might encourage our students, you know. Well, Dr. Schwartz, let me ask you this. This is not the first time that people have worried about disruptive technology and education. I mean, AI is just the latest example of schools and universities and students needing to adapt to changing technology, whether it was calculators or Google, you know,
Starting point is 00:10:37 is now we've got AI as that fundamentally different from these earlier disruptions, do you think? Right. That's a great question. And one that I'm often asked on the. calculator examples often brought up and then the internet. And most educators would agree that it's fundamentally different. And it's fundamentally different because, well, the calculator, right, it did routine computations, right? It didn't do any arithmetic thinking.
Starting point is 00:11:03 It didn't come to arithmetic conclusions like concepts or reasoning. The search function, like of the Google search, it just removed the search process from the learning. And I remember as a faculty member, I would sit there and think about the times I had to go to the library, open up those onion-skinned abstract books to find the articles for psych info. And then I was teaching and my students could literally just lie they are with their laptop and just find something instantly. And I thought to myself, but that's not a learning goal of mine, right?
Starting point is 00:11:37 That's not one of my learning goals. So it's okay for the search process that's being assisted with the Internet and with Google search is to get in the way of learning. Whereas AI is a much different type of technology. Right now, it's producing the output. It's producing the evidence of learning that students are turning in. So it's a very different type of disruption. It generates explanations. It writes essays, right? It does problem solving instantly for students. So between solving problems, summarizing readings, and the list can go on, it's a very different type of output. Who can be? to the former technologies that were considered disruptive in the classroom.
Starting point is 00:12:20 Well, so Dr. Watson, keying off of that, do you think AI is going to erode students' critical thinking ability? Well, we did a survey at AAC and you. It was sealed it in November of 2025, published in January of 2026. It's available full text online. It's called the AI Challenge. And we surveyed faculty in higher education across all disciplines, all institutions, all institutions, types. And of that corpus of intelligence, 90% of respondents said that they thought that generative AI will diminish students' critical thinking skills, that that was their perception. And more than two-thirds said that it was going to have a significant impact, like a really large impact on students' critical thinking skills. So that's a lot of opinion that points in the
Starting point is 00:13:10 same direction that is likely suggestive of an outcome that we will around student usage of generative AI, if we're not careful, you know, there's definitely functional intervention that we could do to address that. But without that, we could expect that erosion. Well, and what are those interventions? What do you do to ensure that your students are still, you know, using their full brain power? Well, it's interesting. I mean, it varies from one discipline to the next.
Starting point is 00:13:38 But I think, you know, part of it is engendering in students a healthy dose of skepticism regarding the output of generative AI, that AI doesn't do the work for you, but it does work with you, but you're the executive decision maker. You see the output, you have to evaluate it. You should read every sentence. You should examine every line of code and you should anticipate that there will be things that you would need to correct. Or if it's not wrong, that you, as the human partner in this, as the one providing oversight, that you could improve the quality of the output given the nuance of understanding you have regarding whatever the particular task might be. So I think what we need to teach students going forward is a new habit of mind that is to have
Starting point is 00:14:25 this, this ongoing, almost moment to moment level of critique or criticism of the output of AI expecting that it will not have accurate outputs and then to engage with it appropriately. So that's new habit of mind that I think is part of a signature pedagogy for high education. And I'll just add that that requires faculty to to reconsider or redesign their assignments so that that can incorporate what Eddie just described into those assignments because a lot of the assignments that faculty for decades have used have not required that reflection because they didn't have that tool that would generate the answers for them. But now with that tool in mind, we have to sit back and think about the exact assignment and can it be done with AI?
Starting point is 00:15:17 Can it be done without AI? And when is AI removing the effort for learning, right? That we know that and leads to understanding, retaining information and when is AI actually enhancing the learning? So redesigning assignments with those thoughts in mind will help students also in the end with greater learning outcomes. We're going to take a short break. When we return, we'll talk more about cheating and what constitutes fair use of AI for both students and educators. I want to talk about cheating. A lot of the public conversation around AI and education has focused on this.
Starting point is 00:15:57 How should educators and students think about what constitutes cheating with AI versus what is legitimate permitted assistance? And cheating is a question and a concern that, as I said earlier, is a top concern for faculty. And I always always want to mention when people ask questions about generative AI and cheating is that it's not what created cheating, right? We know that cheating has been around for and has been a problem, academic dishonesty has been there long before generative AI came about because we had to do it with cutting and pasting from those searches that students were doing. And then we had the larger issue of paper mills
Starting point is 00:16:40 where students could purchase papers. And I don't know if you've ever gone to those sites, but in the past when I was researching cheating and you can put in the topic, the grade level, the grade that you want, the date that you wanted it. So they were very sophisticated ways of cheating prior to generative AI. When it comes to defining cheating,
Starting point is 00:17:01 what research shows us is that students and faculty define cheating very differently. When you give them examples of academic behavior, you don't get agreement in what they consider to be cheating. And a lot of that has to do with the fact that you have, faculty or educators have to define very clearly for their students what their expectations are and have clear policies on when they can use AI and when they should not use AI. And what we find is that the best practice that reduces cheating overall is when you talk about academic integrity with students. When you have that conversation and you talk openly and clearly and regularly and not just one time because we typically, most faculty have it on their syllabus and they
Starting point is 00:17:49 have a statement about academic integrity and define cheating there. But just stating it one time at the beginning of the semester is not enough. We find that if you repeat it over and over again with each assignment and explain to students what is allowable, then you reduce the likelihood of academic dishonesty. And the same is true for generative AI. You have to be clear how they can use AI in the assignment that you're giving to them. And if you don't, the assumptions will be made. And this is actually a big concern for students. We hear from students that they don't know when to use it, and it creates great anxiety. And that's the last thing that we want to do. So that communication piece is really important. So Dr. Watson, is there any work toward developing a
Starting point is 00:18:43 consensus around the standards so that if I'm a student, for example, I know, okay, I can't use AI to write my paper, but can I use AI to write the outline, for example? Well, that's a really good example, we actually gave, in that survey that I mentioned to faculty, we found that there were large disagreements about what constitutes legitimate and illegitimate uses of generative AI. We gave scenarios and writing, you know, working from an outline was one of them. In fact, we gave, the language was, a student receives a writing assignment and asks AI to provide a detailed outline of an appropriate response. The student then follows the outline to write the paper. 52% said that that was an example of how to use AI to cheat, while the other 48% said,
Starting point is 00:19:34 Mrs. Faculty again, said that it was either legitimate or they weren't quite sure. And to be honest, I think it depends on what the learning goal might be. Like if you wanted students to have practice writing, and sometimes it's difficult, you know, when you're 17, 18 years old to think of something to write about. And so having an outline and then now you have something that you can practice, you know, creating sentences and grammar and syntax and all of those things. For that goal, that learning goal, that's very helpful. But then on the other side of things, maybe you're not using writing to learn to write,
Starting point is 00:20:09 but you're using writing to learn other things. And then in that case, you want to see the students thinking as made transparent by their writing. So I think that's why there's such disagreement is like the scenario doesn't speak to what the learning goal is. I think the learning goal is going to vary from one assignment to the next, from one faculty member to the next, and as a result, I don't think we're going to find a consensus regarding what is the best way to use generative AI or what is a legitimate versus illegitimate way to use AI. In fact, I think that, you know, most institutions now have some level of policy, and often the policy says, look at the faculty members' syllabus. But I even go
Starting point is 00:20:48 further in recommending that we're probably at a moment where we don't just mention on the syllabus, but probably every assignment we give students, even a discussion board post should address that question. Like, can't use AI for this particular assignment and also address the question of why or why not? I think far more likely to follow along if we make our pedagogical choices transparent. Oh, I can see, you know, I don't have enough foundational knowledge to be able to use AI in this way.
Starting point is 00:21:20 yet as a partner, I would just be leaning on it too much. And so it's more of a conversation than we've ever had regarding our teaching choices and our teaching practice to make sure that we're providing students with guidance and understanding so that they'll be more willing to follow along with the recommendations that we make. And I'll just add, because Eddie brought up a great point, is the question of whether or not there should be an institutional policy versus just leaving it up to the faculty and giving the autonomy to the faculty. And when, if you put yourself in the role of the student, if they have to go from one class to the next and figure out what that each educator's policy is, that gets very confusing.
Starting point is 00:22:01 If there can be one overarching one, that could be helpful. But as Eddie pointed out, it's the learning goal of each and every assignment that will determine when it's appropriate and how is it appropriate to use AI for that particular piece of work. That's what's going to learn to, that's what will lead to achieving the learning goals and having students, you know, learn to whatever skill it is or content it is that you want them to achieve. Yeah, I think that that's really good points. I think students though have been, even whenever all of us were back in college, we navigated the syllabus, right? We'd go to one class that's like class participation's worth 40% of the grade here and here it's worth 5%. So then I might adjust my behaviors. I know I kind of
Starting point is 00:22:48 have to be social today because I'm in that particular psychology class versus my math class or whatever it might be. It adds additional levels of sophistication to that navigating from one class to the next. But given that learning should dictate a lot of the choices regarding technology use and and indeed, as grade breakdown is distributed within a class, it's complexity, and it does make it more difficult for the students, but that just further signals that this is additional change, not so much in student practice, but in faculty practice. What about for faculty, what would constitute, quote, cheating or an unethical use of AI? For example, could you use AI to read all your students' papers and assign grades?
Starting point is 00:23:41 Can you use it to develop the syllabus? And where is the line for the faculty member? Well, so we included questions in that survey, specifically about the profession of the faculty member. Like, is it okay to use it to, you know, create your syllabus? Or is it okay to leverage it in some minor ways in terms of scholarship? And when we're talking about, you know, creating an article to submit to a journal,
Starting point is 00:24:08 more than four out of five, a faculty said, know that is an illegitimate use, an unprofessional use of AI. And as you got sort of further down the food chain of teaching from syllabus to development all the way to grading, there is less and less comfort with using AI for those purposes. You know, so specifically like we ask a faculty member uses generative AI tools to grade essays in their course. 71% said that that was an illegitimate use for faculty to leverage AI in that way. 10% only 10% said outright, yes, that is acceptable. Another 20%, 19%, they said that they weren't really sure.
Starting point is 00:24:52 But it's suggestive that we need to have larger conversations because there are some that indeed see it as acceptable and are indeed doing it. And then there are others that see it as, you know, really just absurd for a professor to think about allowing AI to do the grading in a course. So there's, again, this everything is evolving, right? And we still haven't gotten to a sense of like what are the common norms, even for our own practice within our own disciplines regarding using generative AI. Right. And it brings up acceptance and transparency as well. If you think your colleagues believe that use of generative AI is not acceptable, you're, even when you do use it, you're not going to be transparent that you're using it. And that brings up a whole other issue in the world of education. So that, Eddie Sir Wright, in terms of that conversation is needed to really better understand when is it acceptable, when is it appropriate. Because I've also heard students of concern about their faculty members using generative AI to grade their work.
Starting point is 00:25:53 I mean, you're not reading my papers. You're using this technology to give me a grade, which for them is disconcerting. Sure, sure. Yeah, I think that's really, I think important for faculty to be transparent with their students if they do indeed make that choice. And if they do make that choice for grading specifically, again, the explanation of here's why I'm doing this, because you're going to get feedback immediately. Here's a process where if you want to debate the grade that you receive, you would prefer to have a human grade it. Here's a path for that. But you know, whatever the rules are, be transparent with students and talk about what the benefits are to them.
Starting point is 00:26:34 But there's, you know, also the other side of the clinic, what do students really think? And as we were putting together the second edition of teaching with AI, we did a number of different student focus groups. And we asked students the question. And I had made the erroneous assumption that students would not want this, that they would not want faculty to be using AI for grading. And it was diversity of perspectives that emerged. One student said, you know, I think I was. would prefer that because I think AI would be more fair. And he said, you know, I kind of have a, I lean more politically to the right. And I'm kind of careful about things that I say in class as a result. But, you know, I think if I voice some opinions, I'm afraid that the, that the faculty member might get back at me through grading. You know, I had another student say that they showed up
Starting point is 00:27:28 late for the first day of class and they thought that their professor had it out for them for the entire semester because of that first day of class. So they like the idea of AI grading as a unbiased arbiter of the graded work. Which is interesting because we know the bias that exists in AI itself, right? Sure. For like people who have English as a second language or even gender differences that there's some clear biases. So yeah, that's an interesting point, Eddie. But AI won't know that you were late. Well, how might AI change the sorts of tests and assessments that teachers use to evaluate their students? I mean, I've read that there's been an increase in orders for those old-fashioned blue books that a lot of us used in college.
Starting point is 00:28:21 Will teachers need to go back to handwritten or oral tests and assignments? There definitely has been an increase in blue books, and that's the one thing I hear from faculty most often is that they're asking. for some work that's taking place right in the classroom where it's proctered or supervised, and that's, or where no technology, so to speak, is available for students to use for answers. So essentially, many faculty are redesigning those assignments. In some cases, assignments where AI is not allowed to be used, or in other cases where AI is allowed, but there's clear guidelines to ensure that the learning goals are more. met. But he was really where basic learning science can guide the way because AI will hurt when
Starting point is 00:29:10 you remove the effort that's involved in learning. So when there's shortcuts for problem solving and it leads to what I guess you'll call it passive acceptance of answers, that's when AI acts like a substitute and it's doing the work for you. And faculty are trying to avoid take on tests, for example. I mean, I don't know what many faculty these days, even if you give clear guidance. When I worked at a college with an honor system and an honor code and all of my exams were just placed on at my door with two envelopes, one that said, here's the test and here's where you return the test, take it where you will throughout this 24 hours. I wonder how many faculty can still do that even at an institution with an honor system where AI is available.
Starting point is 00:29:59 faculty are more likely to do more assessment of learning in the classroom. So it could be oral exams where the person is, the student is speaking. It could be in classroom work using blue books or not, as opposed to, I'm, I would guess, and Eddie, I don't know if I don't recall if the AAC and you survey asked this, but less homework assignments, right? Will there be fewer homework assignments where there's less monitoring of what's taking place when the students are completing the work, because the big question is when students turn in that product, can you tell whether or it's student work or AI generated work? That's the ultimate question there. I had a colleague this spring. She was telling me that, well, you know, I'm making this
Starting point is 00:30:51 interesting observation. My students are doing really good on the homework, but they're doing really poorly on the in-class exams. I don't know what that means. It's like, well, what do you think that means? If when you're watching them, they do poorly, but when they're home, do you think they might be getting assistance in any sort? So there's things that we can do in our class
Starting point is 00:31:11 to collect, you know, information to better guide, you know, some of our practice or at least inform what's actually taking place within the classroom. But, you know, everything that Beth just shared are observations that we're seeing at AAC and you. And I also have the good fortune of having an end of two in my household. So I've got two sons that are college age. And this past summer, my youngest came home from college and I was doing the dad thing.
Starting point is 00:31:38 So son, how was college? You know, how did you do on the finals? And he said, well, you know, it was interesting. I did great on the finals. But for two of them, I had to go to the bookstore and buy a packet of paper stapled together. And I said, well, was the cover blue? Who? And he was like, Dan, how did you know? I keep up on the latest trends in higher education, son. That's my job.
Starting point is 00:32:02 Wow. I didn't have to pay for them. I was lucky, I guess. But speaking again about basically being able to suss out what's the students work and what's AI, I mean, do detectors work and should faculty rely on those tools to figure out whether their students are doing the work themselves or using AI? From the research that I read, the detectors, if I were in a classroom, I would not be using those detectors because the range of accuracy of the detectors is so great that if I was placing the percentage that was created by that detector on a high-stakes type of assignment, I just don't think it would provide fair grading. So I, and the interesting thing is that the people who are generating or developing the generative
Starting point is 00:32:56 AI technology is also generating the AI detectors at the same time. And I wonder about about that fact. You know, faculty often say, I can tell when a student has used AI. And I don't believe that there's evidence to date that shows that faculty are very good at differentiating papers written by their students. students versus AI. I will say that if you're in a small classroom and you know your students writing skills and you have trends in their assignments and you know their voice, then yes, you are much better at detecting whether or not the paper was written by AI versus the student. But when you
Starting point is 00:33:36 go to the larger classrooms, which many of our colleagues are in classrooms with 200 students and they have writing assignments, then that becomes a much more challenging issue. But I've just, Just to summarize, again, I don't believe that AI detectors are at the point where I would comfortably use them to differentiate AI written work versus student work. Yeah, they're definitely not smoking gun evidence of students cheating. I mean, at best, you might use it as one data point among other points of triangulation, such as, as Beth was describing, knowing the student's voice, like, this really doesn't sound like this student. But, you know, sometimes even that doesn't give you the evidence that you
Starting point is 00:34:20 think that it is. I had one student tell me that they were accused of using AI. And she said that the reason her work was so much better was that where she works, they were doing inventory over the weekend. And she usually works 16 to 20 hours on the weekend. So she had this one weekend where she had all day, both days. And so she was able to do really her best work. And so she turned in her best work. then the faculty member was like, well, this doesn't sound like your papers from earlier in the semester. You must be using AI. And the AI detector had flagged certain elements of it. So the student had to, when they had the actual, I guess, case heard on campus, her boss came in and said,
Starting point is 00:35:02 yeah, she was off that weekend. And she usually works every other weekend. And so she was able to win the case. But that's kind of a harrowing experience for students to go through. And I actually had another student in the focus group shared late last year that, whenever I finish writing a paper, if I think that it sounds too smart, I'll go back and dumb it down a bit so that my professor won't think it was produced by AI. And I just found that heartbreaking. That's not a skill you need in the real world is to dumb down your best
Starting point is 00:35:34 work. You know, that's not something we want to promote. But some students are indeed trying to walk that line to prevent themselves of being suspected of having, being used AI. There was also an interesting story that I heard about a student who was accused of using AI. There was a percentage that was generated for the paper that they turned in. And they took the faculty members work, something that the faculty member did, and put it into an AI generator and then provided for the faculty member a percentage of that work that was detected as AI generated as evidence of the purity of those types of detectors. I just thought that was ingenious.
Starting point is 00:36:17 That's great. Yeah. You had a book teaching with AI. We documented a case exactly like that where they went to the Honor Court meeting and they took the professor's last single-authored paper prior to November 2022 and ran it through one of those AI detectors tools. And sure enough, it was flagged as being 33% AI generated before generative AI existed.
Starting point is 00:36:40 So yeah, I think it's probably, you know, if you're going to use a gen AI detector, maybe run some of your own work through it and that might give you pause before you would actually bring that to your classroom. Is there an age below which you think students shouldn't be using AI at all? So I would say that as is true in any kind of a learning environment, it just has to be age appropriate or developmentally appropriate when you introduce any type of technology or technique. And for younger students, you have to be really careful and aware of protecting learning, making sure that students, particularly younger students, you're not outsourcing the learning
Starting point is 00:37:28 of basic reading skills or writing skills or mathematical skills or reasoning because you want to build those foundational thinking skills, right? So teaching. But at the same, but at the same time, you want to start to introduce, if you can, an understanding of what AI is, but at a very basic awareness level when it comes to elementary school. And then as when you start to look at middle school, you can look more at the guided use, teach the guided use of AI, where students can begin to learn how AI can give answers, but why the answers can be wrong or biased. And how how you can compare AI output to what are considered trusted resources for middle schools. You know, the emphasis for middle school should probably be more on the curiosity and safety
Starting point is 00:38:23 and responsible habit use of AI, not the nitty, gritty how AI works. But then when you start to get to the high school level and even higher ed, there's more the critical and ethical use of AI. So it just develops over time. and I'm higher at, it's more the advanced and workforce-oriented may be used. How does this transfer to the workforce when I'm in the college classroom and I'm learning how to use AI? How will this work when I've graduated?
Starting point is 00:38:52 So it's all about being age-appropriate. But I think we're going to learn over time as educators start to learn how to incorporate AI into the classroom. What is age-appropriate and what is the appropriate people? pieces to incorporate from a very early age. Well, just to wrap up, what are the big questions you're trying to answer? What are you each working on in this area right now? Dr. Schwartz, you want to take that first?
Starting point is 00:39:23 Yeah, well, at APA, a lot of what we're looking at is, well, one of the collaborations at APA and and AC, and you is going to start later this year is helping faculty to answer some of these questions and conduct some scholarship on teaching and learning, which means, like, what are they answers questions that they have, and how can they go about critically evaluating what it means to use AI and its impact on learning? So part of our efforts is teaching faculty to ask those right questions and figure out the methodology to answer them and to really fill the gap in the literature that exists when it comes to understanding AI's impact on learning. Because When you look at AI research to date, it's often, it's not long-term learning, so we know
Starting point is 00:40:12 more about short-term performance than we know about long-term learning. They're often quiz scores and assignment scores, but it's not retention over weeks or months later. Like that, I'm just not finding them. Many of the research these days focuses on perceptions and people's opinions rather than on learning, so that's why filling the gap in the literature will be so important. And most studies to date don't really isolate the cause and the effect, you know, the generative AI to the learning that's taken place. And so we don't know whether it's the fact that AI is creating better feedback or more
Starting point is 00:40:50 practice opportunities or is it more time on the task. Some of those questions on psychological science we ask when it comes to what is leading to the connection between using a certain type of learning tool and the learning that's taking place. And as I said earlier, it's heavily concentrated in higher ed, so we really need to help and support educators for the younger students to figure out how to really start to assess how AI would impact learning for elementary and secondary schools. And Dr. Watson, what's ahead for you? You struggling to update your book. You have to do another another edition every six months.
Starting point is 00:41:34 About every 18. Oh, wow. The rhythm that we're on. I guess the other thing that I'm really focused on these days is actually larger curricular structures. Like, you know, if we are incorporating AI literacy as a learning outcome, maybe as essential learning for college students, well, what do we actually teach them? And then what would be the compass for that?
Starting point is 00:41:56 I mean, certainly what the world of work demands would be a component of that. but then there's also sort of other moral, ethical, civic responsibilities as well that we would want to incorporate into that definition. But, you know, as you look at some of the AI literacy frameworks that have emerged, almost all of them predate agentic AI. And as we think about the world of work, there's a lot of shifts that are taking place. I was literally just talking to a friend last week who was at a, they're in sales and they were at a sales meeting. they learned that all of the support staff around the core sales team was going to be laid off before the end of the year. And the expectation was that they would begin using agentic AI to actually do a lot of those
Starting point is 00:42:43 discrete tasks that require some level of decision making that these more entry level positions were doing. So managing agentic AI, managing agents, you know, that's a different skill set that I had seen in any of the earlier models because it really agentic AI really was a present at that point. So there's this evolution of what is AI literacy. And, you know, one thing that we do well in higher ed is curriculum reform. One thing that we don't do well is curriculum reform fast. And the truth is, the target is changing quite quickly these days. So staying on top of that, you know, going through doing all of the processes that we always do to ensure quality and
Starting point is 00:43:29 an accuracy for the components of a learning outcome that we would then engender into our curriculum or into our major. We still need to be doing that work. But I think what's really needed of higher ed is a new kind of agility. How do we do this work more quickly and recursively? Like gen ed reform is maybe the biggest curricular reform effort that a campus can do. And on many campuses, they do gen ed reform every 10 to 20 years because it is such a, It takes a year to do, right. Right, exactly. And so how do we shorten that time frame for curriculum reform in service to a learning outcome that is shifting rapidly?
Starting point is 00:44:12 You know, you don't build something into the curriculum and then you don't change it for five years where we see the rate of change around AI is exceptionally fast. So that whole challenge of institutional change, agility, curricular agility, and the evolution of what AI literacy means to the population of students that we have and that will soon be beyond our campuses. Those are among the key things that I think about these days. And I'll just add one more thing. And my role from APA's perspective or from my own perspective is that we have this foundational learning science, foundational principles that we know leads to strong learning. And we have to keep that in mind when we're reconsidering the assignments
Starting point is 00:44:57 and what we're having students do because we know what leads to a student understanding, a student remembering, a student moving forward with that information in mind. If we don't keep that in mind, then we're just missing out on this important part of the scientific literature from psychology that can really provide a lot of answers. Well, Dr. Schwartz, Dr. Watson, I want to thank you both for joining me. I think you're doing really important work right now. Thanks for having us. You can find previous episodes of Speaking of Psychology on our website at speakingofpsychology.org
Starting point is 00:45:34 or on Apple, Spotify, YouTube, or wherever you get your podcasts. And if you like what you've heard, please subscribe and leave a safe review. If you have comments or ideas for future podcasts, you can email us at speakingof psychology at APA.org. Speaking of psychology is produced by Lee Weinerman. Thank you for listening for the American Psychological Association. I'm Kim Mills. Thank you.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.