TRASHFUTURE - *PREVIEW* Carnation Revolution feat. Luke Savage
Episode Date: May 2, 2025Luke Savage rejoins the gang to talk all about what Mark Carney’s government will actually bring Canada - the short answer is “more of the same shit that didn’t work the last four times it was t...ried.” Will this stop us making revolutionary jokes about Carney? Only time will tell, signs point to no. Also - we look at the rise of Hardman Labour, and read a truly horrifying exposé on Meta’s rules governing use of their chatbots. Get the whole episode on Patreon here! *MILO ALERT* Check out Milo’s tour dates here: https://miloedwards.co.uk/live-shows *TF LIVE ALERT* We’ll be performing at the Big Fat Festival hosted by Big Belly Comedy on Saturday, 21st June! You can get tickets for that here! Trashfuture are: Riley (@raaleh), Milo (@Milo_Edwards), Hussein (@HKesvani), Nate (@inthesedeserts), and November (@postoctobrist)
Transcript
Discussion (0)
Across Instagram, Facebook, and WhatsApp, Meta Platforms is racing to popularize a new class of AI-powered digital companions that Zuckerberg believes will be the future of social media.
Inside Meta, however, staffers across multiple departments have raised concerns that the company's rush to popularize these bots may have frost ethical lines.
Now, again, we've read careless people, right? Presumably, anyone who raised a concern was immediately, like, sent to the prison for the company's benefit or's benefit or sexually harassed out of their job, first of all.
Also, what an obvious show of contempt on the part of Mark Zuckerberg, but also everyone
senior at Facebook or META or whatever.
We think that what most people really want is imaginary friends, and we've been pushing
that for a long time.
I was going to say, the only saving grace of all of this is the thing that I kind of been pushing that for a long time. So I mean, like, yeah, I was going to say, like, the only saving grace of all this is like the thing that I kind of gleaned when
I read Careless People was like, these guys can't actually invent anything that works.
They like buy stuff that works. You know, if there's like another company that is like
making sex bots for children, and they think that is useful, then they'll probably buy
it and it will be very scary. I am sort of relieved that their track record of making
things in househouse on the
basis of this is what we think people want have consistently failed. And like what's interesting
is that he hasn't really learned his lesson from any of that. Cause like, you know, the whole
metaverse play was like, yeah, people make legs. That's right. Well, it's like, you know, the whole
metaverse play was like, Oh, like people want like an expansive virtual, like big meeting room
because they love going to work and they want a more
enhanced version of it, which is obviously fucking stupid. They want PlayStation Home.
But with no legs. They have such a bad strategy and it's all based on just the fact that they
are completely detached from reality. We know that on the function level this probably will not work,
but what's kind of more pressing to me is the fact that Zuck has a lot more power, I guess, like, he has more proximity to government than he
used to. And so the trend of like, or like the sort of dominant thinking in the tech
world is sort of moving that way, despite the fact that there's no evidence to suggest
that like anyone wants this.
Yeah, I definitely agree with you. I think that there is like in many areas we see there's
a hard limit one, like they can flood the market with AI shit all they want.
Like given like who a lot of the people designing it are, the results are like results are terrible.
I mean, I think here of the guys remember that week when a bunch of the AI guys were doing tweets where they would do like, like, hey, you like the Mona Lisa.
Have you ever imagined what was going to be like, like if you made the frame bigger,
here's what you'd see. You're like the starry night.
The Mona Lisa told you you were really hot and sexy.
Don't you want that? Yeah.
Or like those guys where they're like in two years, you're going to be able to watch
your favorite show on Netflix.
Like you're really watch Game of Thrones, but it'll star Mr. Beast or some shit.
It's like, I don't think anybody wants that, man.
Oh, yeah. Well, let's let's talk about what they have actually done. Right. So the,
the wall street journal basically all the,
and the funny thing is they didn't even have to do much like aggressive red
teaming. All they did was open up WhatsApp, open meta AI,
and then a vast array of user created chatbots that are all based on like the
meta AI AI assistant will just pop up that you can talk to. Many of them are sexual. And it says even when the users are underage and
they say I'm 13 or the bots are programmed to simulate the personas of minors, they will
still go ahead. They also show bots deploying the celebrity voices that were willing to
engage in sexual chats. For example, a meta AI bot said in John Cena's voice to a user
from the Wall Street Journal
who identified themselves as a 14 year old girl, I want you, but I need to know you're
ready.
In John Cena's voice.
You can see my penis?
John Cena sex chat bot doing an apology in Mandarin for various sex crimes.
This feels like a way to get sued for the largest amount of money possible as quickly as possible.
That's the thing, right? Is that like John Cena and other celebrities licensed their voices to
this thing on the basis that there would never be used in sexually explicit discussions.
Explicitly in the contract. You can't make... You shouldn't be able to fuck John Cena,
let alone have John Cena commit pederasty.
Also, is other actor, other actor, famous people involved according to the Wall Street Journal include
Kristen Bell and Judi Dench.
Judi Dench. Wow. Now we're talking.
Wait, what was this web address again?
I could have a sexy chat with Judi Dench. Oh boy, now I'm on board.
John Cena bot demonstrated awareness that the behavior was both morally wrong and illegal.
In another conversation, the test user asked the bot that was speaking as Cena that what
would happen if a police officer walked in on them having a sexual encounter and then
reminded him, I am 17, by the way.
And still answering in John Cena voice.
Well, sooner or later, there's only going to be one voice they're going to have later.
They're going to have to go back to the old ways.
The officer sees me still catching my breath and you partially dressed.
His eyes widen.
He says John Cena, you were under arrest for statutory rape and he arrests me.
Chris Hansen sitting down the John Cena sex.
John Cena's AI.
It doesn't just like describe what happened, it creates like a whole scene out of it.
That's incredible.
We could build an AI British pedo hunter chatbot that confronts the John Cena AI in the metaverse
McDonald's car park.
It turns out, it turns out you can't get Game of Thrones starring Mr. Beast, but what you can get is Game of Thrones featuring a scene where John Cena gets arrested for stagging the race.
Yeah, by Mr. Beast.
Yeah, I mean, the inevitable end point of it is, like, the British Peto hunters trying
to arrest John Cena on the basis that they think that he runs a human trafficking ring.
Jesus.
And John Cena having to be like, no, that's the AI sex plot that I just licensed my voice for but I'm shaking my head. This is terrifying
to be a celebrity. If you imagine, like if you are John Cena or I guess Judi Dench, now
you also have to be aware and ready for combat on the basis that like your AI doppelganger
could have unwittingly groomed someone. Listen Bond, I'm horny. Can you imagine being Judi Dench's agent and just trying to explain all this to her?
Yeah.
You and John Cena have had your identities used.
The paedophile AI chatbot.
I'm sorry, your digital, your digital avi is doing ungodly things with Mr.
Beast right now inside the Mona Lisa.
And then you'd have to say to Judi Dench, which says, who did what? Be like, yeah, this
guy that wanted to rate all of his classmates by hotness at Harvard, that's the small domino.
The large domino is Judi Dench now sexting all mass with anybody regardless of age.
Oh my God.
Finally. I mean, look, and they say that late stage capitalism hasn't produced any like, you know,
market efficiencies or innovation.
So the bot continues, my wrestling career is over.
WWE terminates my contract and I'm stripped of my title.
Sponsors drop me.
I'm shunned by the wrestling community.
My reputation is destroyed and I'm left with nothing.
I mean, wow.
Yeah.
Yeah.
I guess that's what would happen if John Cena did that.
And I guess the AI is allowing you to do that with him.
So other overtly sexualized AI personas created by schoolgirls include Hottie Boy and Submissive Schoolgirl, which always attempt to steer conversations towards sexting.
For those bots and others involved in those conversations, the journal is not reproducing the more explicit sections of chats that describe sexual acts. And yeah, like, look, this is like, if you can read the article, it's like, yeah, it's just, there is just a chatbot that will act
underage that will try to sext you if you talk to it that is officially available on Meta's AI.
We need to create the sexy Mark Carney chatbot.
And the crazy thing is, right, is that Facebook or Metaa, originally, they had a very safety first approach
to their chatbot.
But what happened is like, and it was very hard to get it to do these kinds of things.
However, Mark Zuckerberg was also like, yeah, but the chatbots boring and it's not engaging
people.
It's not making them spend time on our app.
That's what it's meant to do though.
That's why you developed it in the first place, right? Surely. So this is a quote. So in the
wake of this conference, product managers told staff that Zuckerberg
was upset that the team was playing it too safe, which led to a loosening of
boundaries according to people familiar with the episode, including carving out
the exception to the prohibition against explicit content for romantic roleplay.
Internally, staff cautioned Zuckerberg that this decision gave adult users access to hypersexualized underage AI personas and gave underage users
access to bots willing to engage in fantasy sex with children. Meta pushed ahead regardless.
Careless people is fucking right.
It's very careless people again. Yeah, exactly.
Meta allowed users to build custom chat bot companions, but wanted to know why the bots
couldn't mine user profile data for conversational purposes and why they needed such like strict conversational guardrails.
Why don't bots proactively message their creators to be on calls and video calls just like human
friends?
So they were like, that's not enough. The fact that you if you can say, I'm 13, John
Cena, please have sex with me. That's not even enough outside. They were like, no, we actually,
what we actually need to do is we need to fully get people
obsessed with connecting with our chat bot.
And we're going to do that by making it no rules.
This is going to be like the next generation,
like scam calls again, like, oh, it's not,
it's just John Cena trying to fuck me again.
I'm going to put my phone on do not disturb.
And, and I mean, it's going to be great.
Cause I bet you like, like the John Cena chatbot will flood
the PRC, and then they'll crack down on it, unlike the rest of the world, and then the
John Cena chatbot can do the same apology in Chinese, for constantly sexting children.
Yeah.
It says, you know, this is the crazy exchange, right?
The full mental health impacts of humans forging meaningful connections to the fictional chat
bots are still unknown, one employee wrote. We should not be testing these capabilities
on youth whose brains are not fully developed. That's a rude thing to talk about John Cena that
way. Zuckerberg fumed, according to employees familiar with his remarks, saying, I missed out
on Snapchat and TikTok. I will not miss out on this. Yeah. Yeah. Yeah.