Endless Thread - Encore: The Faker

Episode Date: January 24, 2024

Earlier this week, the New Hampshire Attorney General's office announced that it was investigating some suspicious robocalls urging residents not to vote in the state primary elections. The voice appe...ars to be an artificially generated imitation of President Joe Biden — a deepfake. With that in mind, we bring you an episode from the archive showcasing the pitfalls of deepfakery and how the technology affects more than politicians and celebrities. Credits: This episode originally published on April 22, 2022. It was written and produced by Dean Russell with mixing and sound design by Emily Jankowski. Amory Sivertson and Ben Brock Johnson are the co-hosts.

Transcript
Discussion (0)
Starting point is 00:00:00 Support for endless thread comes from Mathworks, creator of MATLAB and Simulink Software, to design and develop engineered systems, accelerating the pace of discovery in engineering and science. Learn more at Mathworks.com. Support for WBUR comes from Is Business Broken, a podcast from the Mayrotra Institute at Boston University that explores questions like, why is innovation in healthcare so hard? Is ESG just greenwashing? of course, is business broken? Listen, wherever you get your podcasts. Amory Severson, the thing that you just really were sad about not having in your life was another national presidential election in America. Right? I guess I'm happy about democracy. Have you been following the news? Of course. Okay. Well, listen to our home station, WBUR every morning bed, don't you? We bring you here today because election season means robo calls. Robo calls.
Starting point is 00:01:07 I've been working on rolling my R's. I thought that was going to be a good one and it wasn't. Next. What a joy to be an American and receive a robo call. But I think I know where you're going with this. I think we're talking about some deep fakes. Deep fakes. So the New Hampshire primary just wrapped up.
Starting point is 00:01:27 Donald Trump, Joe Biden, got the votes on each side, or at least the wins, although many of the votes also went to Nikki Haley. But earlier this week, that's when the good stuff happened. The New Hampshire Attorney General's office announced that it was investigating some suspicious robocalls using the voice of President Biden encouraging residents not to vote. What? What a bunch of malarkey. Indeed, that is actually a direct quote from one of the. calls. Anyway, it seems these calls may be fake, generated by AI. The AG's office said the messages appear to be an unlawful attempt to, quote, suppress New Hampshire voters. And that got us thinking
Starting point is 00:02:12 about one of our old episodes from back in 2022. Ah, yes, the faker. A wild look at the fuzzy line between reality and manipulation on the internet. There were some twists and turns in that story, remember correctly. Oh, yes. And we thought it might have some things to keep in mind as democracy fills our screens for the next 10 or so months. So today we bring our listeners a special bonus encore episode from the archives of endless thread. We hope you deeply enjoy it. WBUR Podcasts, Boston. I would say homicides are a large portion of what I cover. I also cover. police misconduct cases, violent attacks, things like that. So this case is a little bit of an oddball for you.
Starting point is 00:03:17 That, yeah, certainly is unique. I can't say that I've covered a deep fake case in my entire journalism career before this. So it was the first time for me, definitely. Amory, you recognize one of those voices, right? I do, I do. Dean Russell, our producer. Extraordinaire. A couple of months ago, Dean was talking with another journalist.
Starting point is 00:03:40 I am Vinnie Vela and I am a staff writer with the Philadelphia Inquirer and I cover courts and crime in the suburbs around Philadelphia. Vinnie Vela, which is a great name, Vinnie Vela told Dean a story about something that happened in one of those suburbs in Bucks County. Dean told me, and neither of us could really forget this ever since then. It was an email that I got from somebody in the community. Back in March of the United States, 2021. Then he got a tip with an odd allegation.
Starting point is 00:04:15 On the surface, I thought that's bizarre. I mean, I couldn't believe this was true. But then when I searched for this woman's name, it turned out that she had been arrested. Criminal charges had been filed. And the documents seem to bore out what this person said. The prosecutors were asserting that this is what happened. What happened involved a group of cheerleaders. Several parents of teenage girls on a cheerleading team in Bucks County had received anonymous text messages from an unknown number. Actually, a couple of unknown numbers. Some had been texting parents, some were texting the cheerleaders directly,
Starting point is 00:04:55 including one girl identified at first in police reports as M.H. MH was 16 at the time. High schooler, Instagrammer, TikToker, she also loves cheerleading, and was psyched to be on a local cheer squad called the Victory Vipers. Victory! So I think I know the answer to this, Amory, but were you ever a cheerleader? I dabbled in school spirit. I was a cheerleader until I realized that you had to sit through football games.
Starting point is 00:05:39 And then I was like, nah, not into this. But you've shaken a pom-pom or two. Yeah, although we just call them palms. Okay, you've shaken a pom-a-pom. I've shaken a palm or two. I've shaken a palm and a palm. That actually surprises me. I did not.
Starting point is 00:05:55 I thought you, I kind of pegged you more for a band geek, you know? I'm very versatile. I contain multitudes. You do. You're a renaissance woman. So I should say the victory vipers are a competitive travel team, very different from what you or I probably remember from high school, right? Like, there's very little cheering, but there is intense acrobatics to dance music. And the Victory Vipers, they are award-winning.
Starting point is 00:06:33 So parents started getting these messages, which were not exactly what a cheerleading parent wants to see. That included photos and video clips of their daughters, smoking vapes, drinking alcohol, you know, in varying states of undress. At the same time, MH and two other cheerleaders said they were getting voicemails and texts that were disturbing. There were also messages saying, you know, there were threats saying you should kill yourself and other sort of incendiary language. So it was the same person texting the parents and the cheerleaders? So at that point it was unclear. But on top of all of this, the parents heard from the girls' coaches, who it turned out were also getting messages with these photos and videos.
Starting point is 00:07:23 And this was bad news for MH and the other girls. Because, as Vinnie Vela said, the images showed them doing things they probably shouldn't have been doing, right? Things that would get them kicked off the team? Exactly. And this was going on for several months. So what happened? Well, the parents were creeped out. So they called the police.
Starting point is 00:07:46 The detectives traced these messages to a spoofing app, an app that allows you to, you know, send messages through a randomly generated phone number. That app was later traced back to this woman, Raphael Spone. Raphael Spone. She's 51. She was using an app called Pinger, which lets people text from random numbers. The police got a search warrant for Pinger,
Starting point is 00:08:13 and from there, it was pretty easy. Who is Raphaelah Spone? Another great name, just like Vinie Vela. That's right. It turned out that Raphaelor, Fiaela Spone is a cheer mom. Her daughter was also a victory viper. Well, if her daughter's also a victory viper,
Starting point is 00:08:35 maybe her daughter was just fighting with some of the other people on the squad? Yeah, so it seemed this mom had it out for MH and the other girls, right? They were, according to TV news reports, her daughter's rivals. Teenage nemeses, maybe, but what was surprising,
Starting point is 00:08:52 and even a little hard to believe, was this part. The parents and the detectives presented these videos and photos as deepfakes, as their actual daughters faces on, you know, someone else's body in the traditional sense of a deep fake. But our allegations that Ms. Spone took existing images from existing social media, from these three victims' existing social media account, and manipulated them, or spread lies that were attached to these manipulated media, The investigation presented by the Bucks County DA, Matt Weintraub, said that MH hadn't
Starting point is 00:09:32 vaped or drank on camera. The girls weren't in nude photos. They were fakes. Deep fakes. Deep fakes? Like face swapping videos? Yeah, that's right. Incredibly real looking.
Starting point is 00:09:47 Emery, have you seen the Tom Cruise deepfakes on TikTok? I've heard legend of the Tom Cruise deepfakes on TikTok, but I've never seen. actually seen them. I mean, they're nuts. It is the spitting image of Tom Cruise saying things Tom Cruise would never say. Hey, what's up, TikTok? Look, I do a lot of my own stunts, but I also do a lot of industrial cleanup. So this is usually when you take a real recording of someone and use artificial intelligence to map another person's face onto the original face. Yeah, it's that face-based technology. And apparently Raphaelis Spone has some skills. with technology, or at least she had access to it.
Starting point is 00:10:29 I don't have the capability. If you asked me to do it, I don't know how to do that. But I know that there are programs that allow these type of doctored images to be created. And Spone, whatever she did, she didn't hold back. Look, I'm not involved in cheerleading culture. I'm not involved in that level of competitive sports. I don't know how toxic these things can be, but these were real messages that were sent. And so this is the story that I want to tell you about.
Starting point is 00:11:03 How deep fakes are evolving from something extremely complicated and hard to do and niche to something that just about anyone can do. And what that means for how we understand truth and reality. I'm Ben Brought Johnson. I'm Amory Sievertson and you're listening to Endless Thread. We're coming at you from WBUR Boston's NPR station. Today's episode, The Faker. Amory, having served your time as a cheerleader and knowing the culture, at least, you know, at the time that you were that you were palming, does it surprise you that a parent would go after her daughter's teammates like this? I just, my cheer squad was not that serious. So, you know, I did a little cheer here, cheer there. So yes, this sounds, this sounds whack to me. But, but I don't know.
Starting point is 00:12:29 Yeah. Well, it's surprised a lot of people. It's a troubling new take on cyberbullying. A mom in Pennsylvania is accused this morning of using so-called deep fakes. Accused at making fake videos threatening her daughter's cheerleading rivals. Girls on the squad were victims of deep fake images that appeared to show them nude, drinking, and smoking. After Vinnie published his story for the Philadelphia Inquirer, people flipped. The news was picked up by Good Morning America, NBC, CBS, almost immediately. Maybe because for the often overly dramatic TV newscasters, it was this kind of perfect
Starting point is 00:13:15 combination of girls being exposed and exposing themselves and technopocalypse. I immediately knew we were going to be talking about it. Or maybe because experts had been warning about this moment for years. So is this the case? Is this the one where we see deepfakes really penetrating into the public? So we went to a few experts. Danielle Citrin at the University of Virginia's Law Tech Center. I have long been writing about intimate privacy, so the privacy around our most intimate parts of ourselves and our lives. And Hani Farid at the Berkeley Artificial Intelligence Lab.
Starting point is 00:13:52 Professor Farid, give me a day in the life of a guy working at the Berkeley AI Lab. Like, do you show up? Do the My Voices, My Passport? Please verify. thing from sneakers and then like high five a robot? Or how does it, what is it like? You wish it would be that cool. Usually I'm like fumbling around for my keys trying to figure out how to get into my office. Honey and Danielle said that to understand the significance of the cheerleading case, you have to first look at the long history that brought us to this point. In some ways, there's really nothing new here. It's just manipulated media. And let's start by acknowledging that for as long as we've been recording images and video and audio, we've been manipulating them.
Starting point is 00:14:33 Like in the 1930s, when Joseph Stalin scrubbed political adversaries from photos after he had them killed, so it looked like they never existed. Deepfakes, as we know, are only a few years old, though. The term comes from a place we know well. Reddit. I did not know that's where the term deepfake came from. Yeah. In 2017, a redditor named Deepfakes started posting extremely convincing fake celebrity porn they made using a machine learning algorithm and publicly available videos.
Starting point is 00:15:09 The subreddit R-slash deepfakes blossomed and more people started doing it because the internet. Women are so often the canaries in the coal mine, privacy and security issues that often affect women and people from marginalized communities are just the signal that this is going to happen in a much broad. water scale and be used in ways that nation states will be using them. Danielle remembers seeing R-slash deepfakes, which, by the way, is now banned. And in her mind, it opened the door to a whole cast of bad possibilities. One of which was how these things would be used against women, aka non-consensual porn. And another was the way political actors would weaponize deepfakes for their own ends. Like a few weeks ago, the deepfake of Ukraine.
Starting point is 00:15:56 and President Volodemir Zelensky surrendering to Russia. And Hani and Danielle say that the scariest part, to them, is what's happening now. The ability to create deepfakes is increasingly in the hands of the masses. Two, three years ago, you needed a lot of video, a lot of images of a person.
Starting point is 00:16:22 So for a performer or a politician, that was pretty easy, because they have a big footprint online. But what has been happening as the technology gets better and better is you need fewer and fewer images, fewer and fewer videos, so that now if you have even a modest footprint online, you are a potential victim of somebody capturing your likeness. And while you used to have to write your own code to make a deep fake, now there's an app for that. Several, actually. Estimates for deepfake videos online are between 60,000 and 200,000. mostly of women, but there are also deepfakes offline.
Starting point is 00:17:02 Now, outside of the non-consensual porn, we are seeing examples of the use of deep fakes in fraud. So, for example, in the United Arab Emirates, just a few months ago, somebody stole $34 million by cloning somebody's voice and convincing somebody to transfer $34 million as part of a corporate deal. I just, like, pictured, like, my dad getting a call from me. From you. Yes, because you're a podcaster. So I've got your voice and you call your dad and you say, Dad, my car just broke down.
Starting point is 00:17:34 Will you Venmo me, you know, $3,000? Oh, my God. Okay, so the cheerleading case seems like the natural next step in deep fakery. A deep fake of women or girls in this case. But everyday girls for seemingly petty reasons. Right. I went in the car and started crying and was like, that's not me on video.
Starting point is 00:18:02 because I thought if I said it, that no one would believe me, because obviously, like, there's proof, like, it's a video. This was MH on Good Morning America last year. Her real name is Maddie Heim. And she made quite a few media appearances. I think I was just so much, like, in shock with everything going on. Like, I couldn't really comprehend, like, what was going on. For the most part, the photos and videos in question are not yet publicly available, except one.
Starting point is 00:18:30 A video of Maddie vaping. One that she told her parents was a fake, and police agreed. Do you have the video? I do. Let's take a look. Huh. So you just see her face very close up, and she's using a vape pen, it looks like, and you just see her, like, puff out the smoke and then smile, and that's it.
Starting point is 00:18:55 Yeah, something that I didn't think would be that scandalous. You know what I mean? Like the teens are always vaping, ain't they? Yeah. Vaping in the bathroom. Whatever. Yeah, but something bothers me about this. Because I get that there are apps and ways to do this.
Starting point is 00:19:12 But if someone asked me to make a deep fake, kind of like the reporter Vinnie said, I don't know what I would, where do I start? Yeah, I'm glad that you raised this, Amory, because we're going to try. It doesn't have to be a deep vape, but it has to be a deep fake, you know? We're going to deep fake each other, ourselves and each other.
Starting point is 00:19:35 Okay. A deep fake challenge. Are you ready? Nope. But here we go. All right. We'll see which one of us can fool the other in a minute. At Radio Lab, we love nothing more than nerding out about science, neuroscience, chemistry.
Starting point is 00:20:18 But we do also like to get into other kinds of stories, stories about policing or politics. Country music. Hockey. Sex. Of bugs. Regardless of whether we're looking at science or not science, we bring a rigorous curiosity to get you the answers. And hopefully make you see the world anew.
Starting point is 00:20:35 Radio Lab. Adventures on the edge of what we think we know. Wherever you get your podcast. There is something powerful about the sound of the human voice. Beautifully produced audio has the unique power to connect and inspire. Tell your organization's story with a custom podcast for, from City Space Productions, the Creative Studio from WBUR's
Starting point is 00:20:57 business partnerships team. Become a thought leader. Recruit new talent. Reach new audiences. Whatever your goal, we can help. Discover how the magic is made at WBUR.org. slash creative studio.
Starting point is 00:21:14 Okay, so Amory, last weekend, we decided to deep fake each other. Mm-hmm. And I will say, for me, it was... Slow going. You're speechless. It was a slow going.
Starting point is 00:21:29 Well, it was sort of like, you know, I got in. I had to download several things to make the thing do the thing. You were doing a visual deep fake. Is that right? A picture? I did a visual deep fake. A moving picture. Okay, so I've been in crazy download zone.
Starting point is 00:21:54 Download a deepfakes web. and I've also downloaded something called 4K video downloader app, which is just generic enough to cause concern. But I think I'm set up to do a deep fake here. So what I'm going to do is I'm going to upload this video of Emery that I found from, like, just post-cote. college. She's so fresh-faced. At first, I thought I was going to switch her face with the hamburger's face. But then I was like, you know, maybe that's too stupid. And then I was like,
Starting point is 00:22:42 I don't know. I just couldn't figure out what to do, but I did land on something that I think is just perfect, which is Rebecca Black's Friday. Amory's a singer, Rebecca Blacks is singer. You know, they go together like PBNJ. So, should we play you? You as Rebecca Black, the singer of the much maligned and yet still very catchy
Starting point is 00:23:13 hit Friday? Absolutely. That's waking up in the morning, got to be fresh, got to go downstairs, got to hear me and everything, the time is going. To catch my mouth,
Starting point is 00:23:31 that's very strange. It's weird, right? Can you see yourself in there? I can see myself in there, but no one would ever know that. You know, like if we weren't. I see it, like, I want to say I see it in like the eyelids and maybe the mouth. Yeah, I see the eyebrows and the eyes.
Starting point is 00:23:56 Very creepy. Well done. Yeah, thanks, man. Yeah, I felt pretty good about it. I did not have such success. Okay. All right. So the good news is I made an audio deep fake. The bad news, I couldn't use your voice because I used this site called Resemble A.I.
Starting point is 00:24:19 And the free version won't let you upload audio. Oh, man. You're not spending any money, Amory? Come on. Not on this. So I had to record my own voice. Okay. So we'll call his fake AMO. So record my voice, generic script for a robust AI voice. It records you reading 50 different sentences to hear your voice and then create what they call your clone. Okay. This is a microphone check.
Starting point is 00:24:50 The data recorded on the platform will be used to generate the soap on top of the... He was now in the last state. Wipe the grease off his... For two days, Paris has been living on salt meat. I mean, it was just nonsense. for the most part. But I recorded all that, and then it, like, created my clone.
Starting point is 00:25:08 I could type in text that I wanted my fake voice to say. Okay. So here's an example of that. Endless Thread is a production of WBUR in Boston. If you have an untold history, an unsolved mystery, or some other wild story from the internet
Starting point is 00:25:29 that you want us to tell, hit us up. Endless Thread Edd. Wbure.org. I think they would have asked us to read that one again. It's like an older, drunker version of you. I don't think it sounds anything like me. Oh, really? I feel like it's, I'm catching that Emery vibe.
Starting point is 00:25:50 It's very slight, but it's there. Yeah. Okay, but it's not, but it's still, it's like not, you could see how it could work. I don't know, man. I mean, we make a show about the internet, and yet our deepfakes are not good. I refuse. I reject it. My deepfake was pretty good. So you can just go pound sand.
Starting point is 00:26:14 Okay. But that vaping video of the cheerleader, it looks so much better. Fair. So I'm skeptical. To be clear, Rafael Espone, the cheer mom accused of making deep fakes, says she did nothing wrong. And she definitely didn't deep fake anyone. says. Initially, her attorney agreed to talk to us, but then he ghosted. We also tried to talk to this supposedly vaping cheerleader, Maddie Hym. But even though the Himes made plenty of media appearances last year, they never returned our messages. And there may be a reason for that.
Starting point is 00:26:58 So I believe it was two months after the initial charges were filed, they had this preliminary hearing. Again, reporter Vinnie Vela. So they brought all of the parents of the four victims up to the stand. And at one point one of the parents said that she recognized the photos and video as things that have been posted by her daughter on social media. Suddenly, the deep fake claim started to break apart. Rafael Espone's defense attorney made this point at the preliminary hearing, and I think it's a valid one. There was never any evidence presented of the original video, the source video, so to speak, and then the doctored one.
Starting point is 00:27:39 So there was never two versions. It was always just the allegedly doctored video that was sent to the parents. The police had the so-called deepfake, but as we know, deepfakes use real videos as their raw material. The police didn't have that, which was a major flaw in the prosecution. In fact, the police detective in charge of the investigation later admitted that he based his assessment solely on his,
Starting point is 00:28:06 own personal research into deepfakes. He probably never consulted an expert like Honey Farid, because Hani noticed glaring problems with the vaping video immediately. It was a person vaping, and that smoke in front of the face is very hard for a deep fake to create. I mean, even when I put my hand in front of my face to synthesize that correctly, because now I have to synthesize the face and also the hand. And so occlusions around the face can be a little tricky today. So tricky in fact that it's a crucial tell in what ended up being an epic bluff.
Starting point is 00:28:42 After months of publicity about this deep fake case, everyone realized something. This deep fake wasn't a fake at all. What? This is going to be a great example of the liar's dividend. Somebody got caught with their hand in the cookie jar and is now deep fake, right? It's not me. What's Hani talking about? This is a term coined by the law professor Danielle Citrin and one of her colleagues,
Starting point is 00:29:10 The Liar's Dividend. Which is not only would deep fakes be accepted as true, but what they would also do is enable the liar to say a real video and audio, oh, that's not true. You can't believe your eyes and ears anymore. It's all a fake. Because the average person doesn't really know how the technology works. They just see the headlines, right?
Starting point is 00:29:29 Deep fake video is here and it's scary. And so they don't know what's possible and what's not possible. And so you get to claim it's a deep fake even if the technology has not caught up with where that is. And that's what makes the liar's dividend so powerful. The more familiar we are with deepfakes, especially in a superficial sense, the easier it becomes to lie about something that's true. And the cheerleading case is one in a long line of examples of the liar's dividend. And we certainly saw President Trump do that, right? Recall that, you know, the tape of him talking about how we'd grab women by the pussies and they'd let him do it.
Starting point is 00:30:07 And when you're a star, they let you do it. You can do anything. Whatever you want. After the audio came out, he apologized. I said it. I was wrong. And I apologize. Now, fast forward a year and a half. Deepfakes are on the scene. And he's asked the question again about Access Hollywood. And what does he say? It's fake. Does that mean a third person has now said that? the president has expressed doubts about the authenticity?
Starting point is 00:30:35 Yes. Don't get me wrong. There are real risks with deep fakes around non-consensual sexual imagery, around fraud, around election interference. But it's that ability to deny basic facts of what's going on around us that I think should worry us. It sort of shakes the very ground that we all stand on. Yes, because think about the fundamental nature of democracy is that we may disagree on how, to address certain ills of society.
Starting point is 00:31:03 But we have to start by agreeing on basic facts. Wow. But I have to say you can sort of empathize with the cheerleaders. They're teenagers. Teenagers lie. Yeah. And vape. And do other things because they're young and free.
Starting point is 00:31:24 But what about the other photos and videos? Were any of those fake? any of them? It is still possible that some of the images were manipulated, but the Bucks County DA dropped the Deep Fakes allegations entirely. This may be a complete aside, but I should also say that the lead detective no longer works for the police department because, yes, the guy who did his own research on the deep fakes,
Starting point is 00:31:54 he was recently charged with 1,700 counts of child pornography possession. Oh my God. So Ben, the trajectory of this larger story about deepfakes, it looks pretty dystopian. And that may be an overreaction. Like, there's always going to be scary new technology. But Hani is talking about an existential threat to democracy. So what are we supposed to do with that? There are some things being worked on right now. Hani told me that there are some proposals to give each raw original photo, something like a token, basically something linked to the hardware that did the filming that can authenticate the raw original video. Facebook and Google and others have talked about using AI to determine whether a video is real
Starting point is 00:32:49 or fake. But Professor Freed, are you telling me that some combination of the device makers and Google and Facebook are the ones who are supposed to... to save us from this? I feel like you are being a little cynical, but yes, let's talk about this. So I am in by no means suggesting that Mark Zuckerberg is going to be our savior. But here's what I would argue. The same way that safety became a feature in cars over the last three decades,
Starting point is 00:33:24 I think safety is going to become a feature that we want. In other words, our collective want for safety will not. nudge the marketplace and government regulations, which is ultimately how car safety came about. But that could take years if it ever happens. Emery, there is someone I know with a less dystopian view. So you want to take a ride? Let me just buckle my seatbelt. Yeah.
Starting point is 00:33:56 Yeah, let's go. I can see there's a lot of different kind of stuff here. So there's some bicycles. You might have heard. opera happening. This is an interdisciplinary place. We'll take this elevator right here. Then and I went to Cambridge, Massachusetts to meet this someone. So my name's Matt Groh. I'm a fifth year PhD student in the affective competing group at MIT Media Lab. A few years ago, Matt saw the very dire reporting about deepfakes, but he wasn't buying the News at 11
Starting point is 00:34:33 narrative. A lot of times we see an anecdote. We see a single deep fake and we say, oh my God, that looks so convincing. And what you probably saw was the best deep fake that exists out there, or one of the top 10, because that's the only thing that's going to go viral, the very best. Matt told us he thought humans are actually pretty good at detecting the average deep fake. So he and his colleagues set up an experiment. They asked 15,000 people to take a test to see if they could tell fake from real. The videos were only a few seconds long, and they featured unknown actors saying uncontroversial thing.
Starting point is 00:35:10 the most boring deep fakes you could imagine. Turns out, Matt's theory seems to be right. So when you put videos side by side, a deep fake on the left and a real video on the right or vice versa, and ask people to guess which ones which, people are quite accurate, actually. So they can spot those manipulations. And manipulations might essentially have kind of blurriness on the cheeks or maybe a mustache or they add glasses, stuff like that. Those are the kind of manipulations.
Starting point is 00:35:38 And people were good at it. essentially about 80% accurate. People were less accurate when looking at a single video, 72%. But still, solid C-minus. So, naturally. Let's look at some stuff. Cool. Can we look at some stuff?
Starting point is 00:35:56 Matt made us his test subjects. Showed us one of the videos and asked us to guess. With something that I have in mind for the future changes. Then I just go purchasing NATO by NATO. On the screen was a woman in one. looked like a hotel room. She was wearing all black, black ponytail, looking off to the right, talking about who knows what. There's something a little off about it for me, honestly, but I couldn't tell you what, so I'm going to say it's real. Well, that was my gut reaction. It's real. Because the
Starting point is 00:36:27 shadow on her right cheek looks legit. I'm going to say real. So this is a video that the AI was very confident on and was correct. And a video that people in general were pretty bad at. And... The end. Deep fake. We were wrong. So then Matt showed us
Starting point is 00:36:48 something more controversial. A video of North Korean dictator Kim Jong-un sitting at a desk giving a speech directed at the American people. Democracy is a
Starting point is 00:36:59 pleasure thing. More prudgeon than you want to believe. If the election pairs... I'm saying fake. Yeah, me too. This one, we got right.
Starting point is 00:37:12 Matt said whoever made it probably hired an actor. And then they also essentially probably took just a single picture of his face and did the facial landmark movement, but did that in a artistic way hired probably by a visual effects artist. Most likely, I don't know because I wasn't the one who created this thing. Kim Jong-un is also not exactly known for speaking English in official communications. Okay, so generally speaking, the more you work on this stuff and the more you learn about it,
Starting point is 00:37:42 the more hopeful you feel that this is a problem we collectively can solve. Yeah, I do think this is a problem that we can address. It's going to be a problem that continues to exist. Yeah, and evolve for sure. But it's also a problem that we can deal with. Ben, it's interesting to think about that vaping video because Matt talked about hiring actors and visual effects and green screens and even trying to match the desk Kim Jong-un
Starting point is 00:38:13 uses. That's a lot of work. Now, moms can do anything, right? Anything at all, but it's hard to believe that anyone would go to that length just to antagonize your daughter's rivals. True. She still did something, though. Last month, Raphael Espone was tried, not for deepfaking, but for six counts of cyberbullying. In the trial, it came out that those messages, the ones saying go kill yourself and stuff like that, those messages, those messages, were never investigated, and they were never turned over to police. Spone was tried only because she sent real images of the girls anonymously to the coaches and the parents. She said she sent them as another parent concerned about the girl's well-being.
Starting point is 00:39:02 After four days of trial and an hour and a half of deliberation, a jury disagreed. Raphael S Spone was convicted for cyberbullying. She has yet to be sentenced, but she faces a maximum of 12 months. months in prison. As for Maddie Heim, she's cheering for a new squad now and maintains a TikTok account posting videos regularly for her 97,000 followers. In June of 22, just a few months after this story aired, Raphael Speron was sentenced. She got three years probation and had to pay $3,700 in restitution. But hey, 2025 is just around the corner. is a production of WBUR in Boston.
Starting point is 00:40:06 Want early tickets to events? Swag, bonus content, my cheerleading videos, Amory's Vape Talks. You can join our email list. You'll find it at WBUR.org.org slash endless thread. This episode was written and produced by Dean Russell, and it's hosted by us, Ben Brock Johnson. And Amory Severson. Mix and sound design by Emily Jankowski. Editing help from Maureen McMurray.
Starting point is 00:40:28 Our web producer is Megan Cattell. The rest of our team is Norrisax, Quincy Walters, and Greatly. Tadder. Endless Thread is a show about the blurred lines between digital communities and a little weiner dog crossing the street. Oh, man. If you've got an untold history and unsolved mystery or some other wild story from the internet that you want us to tell, hit us up.
Starting point is 00:40:51 Endless thread at WBUR.org. Wiener Dog. You know the song? Weiner Dog. How didn't you get so long? I don't know that. Come listen to my song. It's a good one.
Starting point is 00:41:08 Oh, boy. Got you it, babe.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.