The MeidasTouch Podcast - Thought Reform and Cyber Security: Where Cult Manipulation Techniques Meet Technology With Dustin Rozario Steinhagen, PhD
Episode Date: December 23, 2024Dustin Rozario Steinhagen, PhD is a privacy expert who recently graduated with his doctorate degree in Cyber Defense from Dakota State University. His dissertation is titled “Defending the security ...of the mind: A mail survey of thought-reform literacy in South Dakota.” This quantitative analysis measured “what everyday people know about thought reform and psychologically manipulative groups.” One of the most powerful defenses a person can have against mind hacking is admitting they are vulnerable to it. After that, skills can be acquired and built upon to teach people how to protect themselves further. However, we mustn’t let our guard down when it comes to our brains and minds coming under attack. Like anti-virus software needing updates to protect against the latest cyber threats, our minds also require ongoing learning to maintain psychological security in addition to adequate rest, play, and sleep. Influences are also more challenging to detect, more frequent in occurrence, from multiple directions, and require vigilance when interacting with different levels of trusted or untrusted sources. Having trusted groups who respect personal privacy and have our best intentions in mind becomes extremely important in such an environment. Learn more about your ad choices. Visit megaphone.fm/adchoices
Transcript
Discussion (0)
Whether you own a bustling hair salon or a hot new bakery,
you need business insurance that can keep up with your evolving needs.
With flexible coverage options from TD Insurance, you only pay for what you need.
TD, ready for you.
Discover the magic of BetMGM Casino, where the excitement is always on deck.
Pull up a seat and check out a wide variety of table games with a live dealer.
From roulette to blackjack, watch as a dealer hosts your table game
and live chat with them throughout your experience to feel like you're actually at the casino.
The excitement doesn't stop there.
With over 3,000 games to choose from, including fan favorites like Cash Eruption, UFC Gold Blitz, and more,
make deposits instantly to jump in on the fun and make same day withdrawals
if you win download the bet mgm ontario app today you don't want to miss out visit betmgm.com for
terms and conditions 19 plus to wager ontario only please gamble responsibly if you have questions
or concerns about your gambling or someone close to you please contact connex ontario at 1-866-531-2600
to speak to an advisor free of charge.
BetMGM operates pursuant to an operating agreement with iGaming Ontario.
Hello, I'm Dr. Stephen Hassan with another episode of the Influence Continuum.
I have a newly minted doctor as a guest today.
I'm very, very excited to have with me Dr. Dustin Rosario-Steinhagen.
He's a privacy expert.
You just got your doctorate degree in cyber defense.
You published numerous times in privacy literature,
including fields of privacy education and neuro privacy.
And we want to talk today about the topic of your dissertation research, which is titled
Defending the Security of the Mind, a Male Survey of Thought Reform Literacy in South
Dakota.
And all I can say is I was very excited to learn about your doctoral research.
I know you approached me to be on your committee, which I unfortunately was overcommitted in
other ways.
I couldn't serve, but my dear friend and colleague John Atack did serve.
John is an ex-Scientologist and a brilliant mind unto himself.
And it sounds like you're really doing cutting-edge work. So I wanted to interview you, hear more about what you were interested in,
how you got interested in this, its applications, and get more people, especially young people,
interested in this topic. So Dustin So Dr. Dustin, welcome to the
Influence Continuum. Thanks, Dr. Hassan. And first, I just want to say it's an honor to be
on your show. I first caught wind of your research in 2019 when I was first researching
what's out there in terms of malicious influence. And we'll get into the backstory of
kind of how a cyber defense PhD got involved with thought reform research, because it's very
unintuitive and might even sound inappropriate without some context. Yeah, please tell us.
Sure. So in 2018, I was a senior at Cornell University in my undergrad program. And the
most important course I ever took in my life was this course called Computational Psychology. So the whole thesis of this course is
that the brain is literally a type of computer and the mind is computation. And we don't have
time to go through all the mechanics of that. But the citation I would provide would be the
professor's book, which is called Computing the Mind, How the Mind Really Works.
The author's name? Dr. Shimon Edelman.
Okay, thank you.
Also, in 2018, as your viewers and listeners might recall, that's when the Cambridge Analytica scandal broke in the news in the spring. So right around the same time I was taking this course.
And that really opened my mind to how much manipulation there is out there
and how our personal data is used to
politically manipulate us.
And that's really just the tip of the iceberg too.
And I didn't realize how deep and broad this subject is
until I really dug into the literature.
So may I interrupt you, Dustin,
and just for my listeners who may need a refresher
on Cambridge Analytica,
and I know I think Christopher Wiley wrote a book about it.
Tell our listeners just a bit about what that was about.
Sure. So Cambridge Analytica was,
I think it's most properly termed,
should be termed a psychological warfare firm.
They were doing political manipulation
using personal data in various countries
prior to essentially meddling
in the 2016 presidential election in our country
and then also the Brexit referendum in the UK.
So they got in big trouble and had to go
back and they eventually went bankrupt because of this huge privacy scandal where they were
essentially scraping thousands of data points from facebook and then combining that with
psychometrics uh analysis to target specific voters and and sway the election in um in unethical ways.
You know, I mean, influence doesn't have to be inherently unethical,
but the reason why it came into Analytica was wrong
was because people's data was being scraped that they didn't consent to
and that they didn't understand what was going on.
Right.
And it was on such a massive scale as well.
If I may add, there was a documentary, I believe, called The Great Hack for people who want more details about it.
And my recollection, if I may add, is just that they got into Facebook and were doing questionnaires and used the questionnaires to get to all the friends of the people who responded.
I was in that hack.
I got a notification from Facebook
that my data was scraped and all of my followers.
So I was very displeased.
So thanks for sharing that.
So that happened and you were like, wow.
The brain is a computer, but it's not just a computer.
It's a vulnerable computer and it's routinely hacked.
So then, you know, I, I mean, I'll just be honest.
I got really scared, you know, and it wasn't just Cambridge Analytica.
You know, I learned about during 2018,
I also learned about romance scams,
which are very sophisticated type of scam where a hacker will convince
someone to fall in love with them.
So it's like an online dating situation, usually.
But it's a false persona. So this person has genuine feelings of affection and love for this fake persona. And then there's this cover story of like, you know, maybe it's like a medical
emergency, or they're stuck in an airport, and they need money all of a sudden. So then they
have this cover story to extract money from the person who genuinely loves, you know, this fake
person. And oftentimes romance scams succeed
at draining a person's entire bank account.
It's actually one of the worst types of scams
that I'm aware of,
just in terms of the emotional damage.
And that's how cults like to recruit.
Yeah, it's very similar.
Using people to recruit others, right?
Except it's online often.
So people fall in love with a projection
based on false information.
And it's very, very nefarious and harmful and painful.
And forgive me for adding one more thing,
but just recently there was a young boy
who fell in love with a chatbot on Character AI
and killed himself because he wanted to be
with this chatbot for eternity.
Yeah, I saw that story in the news recently as well.
Yeah, so let's go back to you.
So there you were.
The brain is a computer.
It can be hacked.
Cambridge Analytica and you've got Cornell going,
okay, what do I want to do with my life?
Yeah, that's when I really decided to pursue a degree in cybersecurity.
And I'm not sure exactly how I first heard,
but cybersecurity professionals,
many of them deal with,
we call it social engineering in the field.
I'm not sure why we call it social engineering
because most other fields will call it
psychological manipulation, malicious influence.
I think there's better terms for it.
But be that
as it may, a lot of the literature in the cybersecurity field, you'll see the phrase
social engineering. So I was aware of social engineering. And I started reading books,
I really got interested, you know, I started kind of falling in love with learning about social
psychology. And so that's, and privacy too. I mean, and the privacy connection is from Cambridge
Analytica
and just realizing that
there's this intimate connection
between people losing their privacy
and their vulnerability to influence.
You know, the more data you have on someone,
the easier you can control and manipulate them
and deceive them.
Right.
And to state the obvious,
America does not have any data privacy laws in place.
So all of these companies are taking our data, putting
them on the dark web, right? So we have thousands of pieces of information about our choices on
some dark cloud somewhere that some bad actor could potentially buy and use. Is that right?
We do have some privacy protections, but they're quite inadequate.
And I mean, just as a comparison, over in the European Union, they have something called the
General Data Protection Regulation, or GDPR. So that covers all contexts, and it has very robust
protections for privacy. Here in America, we don't have a federal law like that. We have some federal laws and many state laws, and it's just, it's
uncomprehensive, so that there are some protections in place, but definitely not
enough. And again, Cambridge Analytica was kind of proof of that, so.
Right. So tell us more about your, how you went about the study, what you were hoping to,
you know, with science, you were always trying to do research that's cutting edge,
that moves the boulder a little bit further up the mountain. So tell us about your process.
Yeah. And again, a large part of coming up with your initial idea for research is just
reading what's out there currently. So actually, I read your book, Combating Cold Mind Control.
That was actually the first book on thought reform and destructive cults that I had read.
And that's when I really realized,
this is, thought reform, that is,
is the most serious security and privacy threat that we have.
It has the potential to destroy all humans
through nuclear war, like the Aum Shinrikyo case study.
And even if we do...
That's the Japanese sarin gas
apocalyptic conspiracy cult that issued sarin gas, killed and injured many Japanese.
And my mentor, Robert J. Lifton, who wrote the seminal book, Thought Reform and the Psychology
of Totalism, did a book called Destroying the World to Save It
about apocalyptic cults and featured the Aum Shinrikyo cult.
Yeah, and so there's that connection where, I mean, that's kind of the most extreme
negative consequence of unmitigated thought reform. But even just the smaller things too,
reading the different types of uh exploitation
that's out there like for example psychological warfare i mentioned romance scams the other types
of scams but the when i was learning about all those it really seemed like thought reform and
the consequence that it is it has for the people that are affected by it really it seems to be
the work one of the worst things that can happen to a person. And it's because it covers so many different contexts.
You know, it covers domestic abuse, human trafficking, terrorism, and so many more contexts.
So I really wanted to do a study that would help push the envelope in thought reform research,
especially since I learned that it was so underappreciated by social scientists.
And I think our colleague, A-Tech, has said that it's almost a neglected research field.
So I was learning as much as I could about thought reform.
And I realized that one of the best, we call them defensive controls in the security and privacy field.
So a defensive control is a technique or tool you put in place to reduce risk.
So education and awareness about thought reform is a defensive control.
And it really,
and I know you and many other experts have really are huge fans of this idea of education and awareness.
So that seems like the best area for me to do my work in.
I wanted to make a big difference. So the main idea of my survey is that i wanted to quantitatively measure
how much people knew about psychological manipulation and psychologically manipulative
groups so psychologically manipulative groups is is a term that's pretty much synonymous with
destructive cults and it's a less controversial descriptor so that was the the term that i led
with rather than cults right because that can be especially because i'm going to i was i was surveying
lay people i just wanted to make sure that um to reduce bias um right so how did you find your
your your respondees just out of curiosity so this was a a mail survey and what i did is i purchased
a comprehensive mailing address list. So the state
that I studied was South Dakota. So South Dakota is a pretty rural state here in the United States.
And it wasn't too expensive. It was within my budget, that is to purchase a whole list of
physical addresses. So then I could randomly sample that physical address list and essentially
get statistics that would represent
all of South Dakota. That was the idea. So you were doing snail mail surveys?
Yep. And the reason for that, it had the best coverage of the population. You choose your
survey type based on the population that you're studying. So it would cover the population better
and allow me to get more accurate statistics. So I guess that's a little ironic, you know, a cybersecurity student using snail mail.
And there's a higher rate of response for a mail survey compared to something like email or telephone.
Yeah, I believe that.
So do you live in South Dakota?
I did.
Yeah, I was a student employee of my university, Dakota State University, for four years.
I see.
I ended up finishing my PhD program after my work contract ended.
So I moved to Iowa, which is where I'm currently located.
Okay, good.
So please continue.
So tell us about what you asked and what the results were.
Yeah, so in collaboration with several thought reform experts,
I developed a curriculum
of 47 questions to ask
the South Dakota and L.A. people.
So
each question was weighted equally, so that means
that 47 was the max score on the test.
And I had
147 respondents, so that was the
sample size. And
the scores that I saw were between
one, so a single point correct, and 46. So no one got a perfect score, no one completely
flunked it with a score of zero. And the weighted average score was between 37 and 39. So that's
approximately equal to like a C plus or a B minus, if this was like a grade school test.
Okay. Okay, so then to get to some of the
individual questions, this is my favorite statistic of the entire survey. So it was a humility
question. So essentially asking people if they believe they're vulnerable to psychological
manipulation. So the question stem was, do you believe you could be lured into a psychologically
manipulative group or relationship? So they could answer, yes, it is possible or no, it is not
possible. 31% of my respondents said it's not possible. So they assumed that they were immune. And two
thirds, so 66% selected that it was possible. And I just found this very interesting because,
well, first of all, we didn't have any, like from a broad geographic population, that is,
we didn't have any statistics about what people believe
of their own vulnerability to thought reform.
So, I mean, two-thirds of people were humble.
I think that's hopeful, actually.
And I thought it was going to be a lot less.
I thought more people would be assuming that they were immune.
Yeah, well, folks like me from big cities have ideas about Dakota
and South Dakota and stuff. So I think it's really fascinating, frankly. I, you know,
I'll just comment that it is the biggest vulnerability to think that you're invulnerable
to being deceived and manipulated. It's like, oh my God. And it's
amazing when I talk to people who say, no, it would never happen to me. And then I ask them
questions and they're like, oh, actually, I did fall for someone who was a narcissist and they
did hurt me. And I did have this boss, but people walk around thinking they're too smart.
Yeah, the optimism bias and several other cognitive biases work against us for that.
I was going to say, in terms of the humility, the most interesting statistical finding
of my survey was that
there was a positive correlation
between those who were humble
and getting higher scores on the test.
So for the people who are methodologists
or researchers,
the exact correlation was 0.251,
which corresponds to a low to moderate
positive correlation.
And I guess just to put it in plain English,
if the respondents in my survey that were humble
knew more about thought reform and cults
than those who assumed that they were immune.
And I think this is a very...
I mean, we just didn't have data about this
prior to my dissertation
that there would even be a relation
between these two variables at all. And this really coincides with what is stated in the
thought reform literature, like you just alluded to a few minutes ago, that if you assume you're
immune, then you're vulnerable. And assuming that a person's knowledge is correlated with
how protected they are, then this study actually gives quantitative evidence for this theory that humility is protective.
Right. And I have a question because I didn't read your dissertation, forgive me, yet. But did you ask any questions if people had children? I did not. Yeah. And I can talk about the other demographic variables.
I didn't study
all the demographic variables.
I know it would have been
interesting to study
political affiliation
or religious beliefs.
I just wanted to keep the,
that could have harmed
response rates,
you know,
because those are more
sensitive questions.
And along with asking
about people's children as well,
that might have harmed
response rates.
So I just wanted to keep it
with kind of the bread
and butter demographics.
So I studied
educational attainment, age, biological sex,
something called subjective social status,
which is similar to socioeconomic status.
But instead of asking for a person's income,
you directly ask them about their social class.
So whether they're poor, working class, middle class, or affluent.
And race and ethnicity.
So there was these five other demographic variables.
And I ran a multiple regression analysis.
And first, just a caveat, pretty low sample size.
So that could have affected things.
But I did not find any statistically significant correlations between any of these five demographic
variables and people's knowledge.
And that's also consistent with what's said
in the literature that a person's
background really doesn't influence
their susceptibility to cult recruitment.
You can come from...
It affects the poor
and rich alike,
so to speak.
I would argue, though, in this day
and age that bad actors
want wealthy people and influencers,
so they'll target them over somebody
who is not knowledgeable, educated, well-situated.
So I think there's a targeting piece that may be at play.
Right, and I guess my thing wasn't a quantitative measure
of a person's exact vulnerability, just their knowledge,
but assuming those variables are related.
And the last thing I want to say about
general,
or the general idea of my survey is that I
found two thought reform deniers, is what
I called them. So these were the people that
answered,
well, rewinding a little bit, some of the
distractors of the questions in my survey
were like, psychological manipulation doesn't exist
or we don't know how it would work because it doesn't exist.
So I included those distractors
because for my literature review,
I realized that I think you and others have stated
that many people deny that thought reform,
brainwashing, mind control even exist at all.
And I want these people, if I did find them,
to be able to answer my survey in good faith.
So I'm really glad I kept those distractors in the survey because I did find two people who, and they were consistent with it too.
They didn't just answer it once.
They went through the whole survey and said, like, it doesn't, manipulation doesn't exist.
Zero people are being psychologically manipulated in the world.
That was one of the questions in the survey.
So that were one of the answers.
So these people do exist, the deniers.
I hadn't personally met one,
but it's just interesting to think.
And that's really important.
Sorry, go ahead.
No, I apologize. I told you I didn't want to interrupt and talk too much.
No, it's okay.
You know, it's the...
Anyway, please continue.
It's really important for future researchers in this field
to make sure that they keep those types of distractors
in the curriculum so that they can catch these deniers
and we can continue to estimate
what the proportion is in the population.
Again, my sample size was so small
that it's hard to know if it's just like the 1% to 2%, which the two out of 147 respondents, or if it could be higher because of non-response,
you know, maybe there's a higher proportion of people that I didn't catch,
but future research will have to discover that. So.
Yeah. I will add just that there are cult apologists who are paid sociologists of religion who go out of their way to say there's no such thing as brainwashing and mind that smoking class cancer and fossil fuel companies do that too.
But then there are people in cults who really don't believe that they've been brainwashed like I was in the Moonies.
I was like, no, definitely not.
So anyway, please continue.
Yeah, and I guess,
because if you consider denying the existence of thought reform and then just assuming that you're immune to it,
denying that it exists is probably far worse
for a person's vulnerability than acknowledging that it exists,
but then falsely believing the not-me myth
that Margaret Singer mentioned. So it's kind of three categories of people that I found in my survey,
deniers, people who thought they were immune, and then people who were humble.
So we don't have time to cover every single question in my survey, but I kind of picked
four individual questions that I thought you would find particularly interesting,
and then we can talk over. Great. All right. So one of the questions I asked was about
the extent of influence or what influence is possible. So which components of the mind can
be influenced? So the first distractor was just beliefs and behaviors, which 5% of people
selected. Then it was, it accumulated.
So if a person selected the second answer,
it would be beliefs, behaviors, plus thoughts and emotions.
So that was an additional 24%. So a total of 29% thought it was either just beliefs and behaviors
or plus thoughts and emotions.
So I would just mention that's kind of the four components
of your BITE model.
So 24% acknowledged just the byte components.
I've taught a social engineering class in the past.
And one thing I emphasize with my students is that,
although it's easy just to think of the byte components,
that the extent of influence is so much more than that.
You can implant false memories, altered states of consciousness,
and other things as well.
So the third distractor was memories and use of language
as the fifth and sixth things that can additionally be manipulated or influenced.
So that was an additional 5%.
Now, what surprised me was that 59% of my respondents selected the correct answer,
it was those prior six things plus a person's core identity and personality.
I really thought this was going to be less.
I was not expecting 59% to say that,
oh yeah, identity and personality
can be manipulated as well.
So I was very impressed with my respondents.
Because that is,
in the definition of thought reform,
it's really focused on identity manipulation.
So the fact that these lay people understood
that identity can be changed,
it's
hopeful that they can
protect themselves.
Very much so. And when the public
describes,
my son is different.
He came back one weekend
and he's a different person.
They're recognizing there's an identity shift that took place.
Yeah.
Okay, so that was the first question I wanted to talk about.
The next one was talking about cult leaders.
So the question, Sam, went something like,
which of the following describes all leaders of psychologically manipulative groups?
So it was really getting the respondent to select the core characteristic
of what makes a cult leader,
or the type of person who becomes a cult
leader, I should say. So
the correct answer was that cult leaders
are abusive people who have learned manipulation
techniques. So 42% of
my respondents selected that correct answer.
And
two of the distractors were selected
by a lot of people. so the first distractor was that
they were intelligent people with compelling ideologies which was 30 of the respondents and
then um the third or the second distractor was that they were highly charismatic people
who can influence people with little effort and that was 27 of the respondents who selected that
um so it was very close. You call them distractors?
Yeah, a distractor in a survey.
So mine was a knowledge survey.
So there's a single correct answer.
So a distractor is one of the false.
Got it.
Or false options in a multiple choice question.
Yeah, thanks.
Yeah, I guess I can't just assume everyone knows what I'm talking about.
No, you're teaching me because I'm not an expert in cyber education and social engineering.
So please, that's partly why I wanted to have you on the show.
Yeah.
So I guess with this question that I just mentioned, there was a lot of people who thought
that the core element of a cult leader is the charisma or the fact that they have compelling ideologies, which those are often things that are in place.
But that's not what defines a cult leader.
What defines it is the psychopathology where they're abusing people.
And that distinguishes them from benign leaders.
Okay, so the third question I want to talk about
was about legal protection.
So this is another one of my favorite questions.
And I know you wrote your whole dissertation
on legal protections and thought reform,
covered that in your lit review.
So this question asked,
what legal protections currently exist
to protect against psychological manipulation in America?
So 7% of people selected the wrong answer that it's a federal crime.
12% selected the distractor that it was a state crime in some states, but not all of them.
4% thought it was a state crime in all 50 states.
And 65% selected the correct answer that there are almost no legal protections in America against thought reform.
Wow, that's very impressive, right?
Two-thirds of people understood that, oh yeah, psychological manipulation, it's a problem, but our legislators aren't doing anything about it.
So people do understand what's going on in terms of the current legal landscape and how they're left to protect themselves.
I thought that awareness about this would be a lot less. So again, I was very impressed with
this question that so many people got it correct. It is impressive, but I can't help but
comment, Dustin, that I've been attacked by being called brainwashed by Soros and the libtards,
so they think that it exists.
Only the other side that's critical of Trump is getting it.
It's confusing for most people.
I guess just having a basic awareness
that psychological manipulation exists
doesn't mean that a person's aware of how to detect it
or fully appreciates that it can exist
on both sides of the political aisle
or all the different contexts.
Right. Yeah, good.
Okay, then the last question I wanted to cover was,
and this was actually the hardest question on the entire survey
in terms of the proportion of people that got it incorrect.
So it was which type of person is most commonly recruited
into a psychologically manipulative group?
And the first distractor was people of low intelligence.
So only 3% of people selected that.
So that's good.
27% selected the correct answer that it's the normal
and ordinary. So only a fourth of my respondents got this one correct. The majority, which was 57%,
said it was the needy independent. And I'll just stop right here to talk kind of why this is a
common misconception. People who are recruited into psychological manipulative groups do become
needy and dependent.
But what many people don't realize is that they probably didn't start out having a dependent personality disorder.
You know, it's pretty rare in the population.
So the overwhelming majority of people that are recruited into these cults have a change.
Again, it's that change in their personality. And Alexander Steen's book, Terror, Love, and Brainwashing,
is incredible at explaining that it's about attachment.
So people develop the trauma bond or the disorganized attachment
as they're getting recruited
and while they're in the cultic milieu.
So that's why they appear needy and dependent.
Huh?
Go ahead.
Yeah, so that's why this was probably the most difficult question
because it's partially correct
or it seems partially correct at least
they have the right idea I should say
that these cult members are needy and dependent
but they got the reasoning wrong
it wasn't a predisposing factor into the recruitment.
That was more about deception.
Exactly.
I was just going to comment,
Alexandra Steen is a social psychologist in the UK
and wrote this very good book
and connected the dots with attachment disorder.
And the other piece is just that it's a dissociative disorder. So the Mooney Steve
was dependent. It was a child personality that was going to follow the father figure,
whatever he said or did. And the real me would absolutely never do that.
Yeah, so it's not a shortcoming of the person's authentic personality.
Exactly.
Alright.
The last distractor for this question
was the mentally unstable
misconception. So only 3% of people
selected that one as well.
The most common misconception was the media
independent. So very interesting.
And again, there's many...
I only covered four of the 47
questions. My dissertation
is openly available on ProQuest,
so people can just search
my name, and anyone can
get a copy for free if they want to
look at the rest of the questions.
And we're going to do a blog
based on this, and
link it directly to it,
so it'll be in my sub stack.
And so I am wondering,
now that you've completed this
and I know how much work goes into doing a doctorate,
what do you want to see happen?
Talk about your personal, curious,
future research goals
and then what you would like to see the field do more of.
Yeah, I guess the first thing that comes to mind is
I really hope that I won't remain the only cybersecurity and privacy expert
that covers this important topic.
When I was doing my literature review,
I saw that there was a master's student who
wrote a thesis on psychological warfare. So that was about the closest I came to seeing
something related to thought reform among my colleagues in the field. So that's the
first thing I would say. But you know, thought reform is a multidisciplinary subject. So
it doesn't just belong to the cybersecurity and privacy field.
It doesn't just belong to social psychology.
So I just hope that it raises awareness
and really encourages other researchers in other fields,
not even just my own expertise,
but in other fields that they can cover this topic.
You can be the first one.
I'm not aware of any other,
um, yeah, cybersecurity PhDs who have covered this. So.
Yeah. I'll add clinical of, as a therapist that there's, you know, vast numbers of people in need
of specialized counseling. Uh, but the other big thing is public health. There's a whole discipline, master's and PhD level for public health, and I see this as a public health emergency. This is a mind virus, coming back to your original comments about the brain is a computing device and the mind can get hacked. So that speaks to the need for inoculation programs for all people to,
you know, at least have some filters. And I offer my influence continuum and bite model,
just as one model. But then, you know, doing training for clinicians, educators, media,
politicians, policymakers.
And then what do we do with people coming out of the rabbit hole who are going like,
what happened to me?
Because they need to be reintegrated back into the world and society.
Yeah, and kind of what you're suggesting is there's so much work that can be done.
And when I think of this through the lens of research, I mean, there's thousands of research ideas and thousands of things that haven't been researched yet.
Even just considering the overlap between security and thought reform, but also thought reform more generally.
Because as I alluded to earlier, it's an understudied discipline.
And that's part of the reason why it's unmitigated in society, largely. So, you know,
any amount of light that we can shed on this as researchers will be good. I do want to share with
your audience several research ideas. You know, I'm one researcher, you know, it'd be great if I
could throughout the course of my career, do all of these, you know, write research papers on all
of these, but you know, I'm just one, one guy, you know, one person. So I, and I like competition in this field,
because it helps everyone. You know, this isn't, this isn't about personally bettering myself,
this is about protecting humanity, protecting the security and privacy of our minds.
So I want people to, you know, pursue these research ideas. So hopefully I can
give some research ideas here. The first thing, and this is probably the most obvious
future work related to the
survey that we were just talking about, is this
is one state in the United States.
We need these surveys in all 49
states and plus the territories
and internationally.
The beautiful thing about this is that once we get
multiple states, then we can do comparison
studies. And eventually, if we get enough,
we can do a meta-analysis
and really start to understand
what the current state of public awareness
about thought reform and cults really is.
Because we're in the dark right now.
We really don't know.
And it's pretty ludicrous to me
as a security professional.
We're constantly measuring
whether people are aware of phishing,
phishing scams, for example.
We're constantly testing people. are aware of phishing, phishing scams, for example, we're constantly testing people,
but why are we not doing this for the thing that literally ruins people's
lives and drains their bank accounts?
And,
you know,
their minds get hijacked.
And,
you know,
this is the,
the paradigm of influence,
you know,
talking about thought reform,
it's the paradigm of influence that causes people to,
you know,
get involved with human trafficking.
Exactly.
That's so much more devastating than a phone scam or an email scam like why are we focusing more on those
things than this other you know paradigm of influence that does so much more damage in
society so i really think we need to ramp up education awareness research in this area. So kind of related to that
too is literacy studies in
specific professions. So do a literacy
study among licensed mental
health professionals. Are
they aware of
thought reform? Do they know the best
practices for
counseling
former cult members? Even identifying
whether a client has the background.
They don't know.
That's why I did an online course for them.
Yeah, so, and again, you could have specialized curricula
for mental health professionals, clergy,
law enforcement, medical doctors.
I mean, the list goes on and on.
And you had mentioned some earlier too
about the specific professions and fields
that probably need more of an awareness
about this issue
than just kind of the layperson-friendly curricula
that I developed
or curriculum that I developed.
So we'll need specialized curriculum.
And again, that's across so many different fields
that a single researcher can't do that.
So we need more people to get involved.
And then I got some other ideas in terms
of fully integrating
security and privacy research with
defending the mind.
For example,
I like the term
psychosecurity, psychoprivacy.
Mind security, mind privacy.
I'm not even sure if they appear in the literature.
We need definitions. What does it mean for security, mind privacy. I'm not even sure if they appear in the literature, but it's...
We need definitions. So what does it
mean for someone's mind
to be secure?
What does it mean to defend the privacy of the mind?
And I don't have answers to these questions.
And there's this very foundational
philosophical work. It might
sound unimportant, but
until we fully define these things,
we won't know what we're looking for,
and whether we've succeeded. So I kind of jumped the gun a little bit with my research because
I don't think we have the full theoretical foundation yet for integrating security and
thought reform, or defending the mind in general. But that would have been a lot harder of work
than my dissertation idea.
Yeah, dissertation committees always want you
to chunk it down to something that's actually finishable
within a reasonable amount of time
because people start out with grandiose ideas
and they're like, that'll take 20 years
and $20 million.
Yeah, do something simple.
Yeah, do something that you can afford that's just incrementally moving the ball down the thing.
I was going to comment on law professor Nita Farahani's work on cognitive security. She's been talking about all of these, you know,
AirPods and virtual reality things
and who's going to own the data
from all of these instruments that are being collected
and put in the cloud.
There's nothing on that.
And then I'll add that there's a graduate student-to-be,
Matthew Bywater, who's been talking about wanting to create a freedom of the mind human right that would be more comprehensive, that looks at bite model stuff and the subcomponents of that as well. But as you were talking, Dustin, I was thinking about China
and Xi and just how authoritarian the whole country is and how they won't allow other
cults to exist there, but the whole society is a cult and they have surveillance and AI for almost everything.
So what are your thoughts about that as a future?
That sense is so powerful.
Yeah, well, this might be related to the idea of surveillance capitalism,
which sadly I have not read that book yet.
But kind of the idea that, well, let me say this.
Privacy is a requirement for having an individual identity
and for exercising autonomy.
Say that again. That's really important.
Privacy is essential for having autonomy
and having an individual identity.
So if you look at totalitarian systems,
they'll strip people of their privacy.
And one thing I want to mention
in this interview is that a very important paper was written by Daniel Solove in 2006 called
A Taxonomy of Privacy. So in that, it's a long paper, he explained that there's 16 different
ways to harm privacy. And I'll just give a few examples um surveillance and interrogation so passively or actively
gathering information from people sometimes and with any privacy harm uh it's dependent on context
so in in certain contexts it's it's wrong um but other privacy harms include blackmail
um distortion which is like spreading rumors about people, spreading false information about other people
to ruin their reputation.
Decisional interference is robbing someone
of their autonomy. So that's literally
a privacy harm.
And I won't go through the whole list, but
if you look at these 16 privacy
harms, I think that
you'd find most or probably
all of them in most
thought reform environments. So when you mention
China taking away people's autonomy, that there's the social credit system where all this data is
being aggregated about people and being used to make decisions about whether they get certain
rights or privileges or not. So I think this could really be a benchmark of determining how free a
society is. It's looking at the privacy protections and how many privacy harms are being perpetuated in a society. And privacy is a human right, too. I know you've incorporated human rights into your work, and that eight criteria from 61 was the cult of confession, which not all cults formally get people together and have people stand up and confess all their sins. But the idea is there's no privacy, that the group owns and knows everything about your past and can use that information if you get out of line
or to punish you.
Yeah, that connects to the blackmail harm.
Again, blackmail can be used to limit people's autonomy.
Absolutely.
Yep.
Yeah.
So I wish you could get a huge grant and get a whole bunch of students. funding the Plandemic video and anti-vax videos. And I've talked to people who got converted to QAnon because of
watching those, just from watching it. And for me, when I watched it, it seemed hypnotic at places.
It had people pretending, you know, who asserted an expertise they didn't have. And typically with
propaganda, you say something true, you say another thing that's true, and then you slip
in something that's unverifiable. And then you go back to something that's true, and then you
put something in that's outrageous. But then you put something in that's true, and you're like sandwiching in these false beliefs
at such a fast rate that consciously people don't have time to,
unless you're pausing the video and looking it up,
it's just coming in.
So I'd love to see something like that done for a doctoral dissertation to analyze.
Yeah, I guess what I would say in terms of how security and privacy professionals can help with
that is we're really specialists in developing, researching, and deploying security and privacy
controls. That's one thing we focus on in the entire field is what are the tools and techniques we can use to mitigate risk?
And we need,
we call them control libraries
and frameworks. So you need to have
categories of what these tools and techniques are
and then specific implementation ideas
and technologies that
you can use. So we need these frameworks
for psychosecurity and
psychoprivacy. So we would have
lists of controls that we could
put in place for mitigating propaganda, for example, you know, the example that you were
just talking about. But I feel like in the social psychology field, they do talk about defense,
you know, for example, there's inoculation theory, which, you know, has applications for defending
people against propaganda. And I guess for your listeners, if they're not familiar with inoculation theory, that's when you present a weakened form of
influence to someone to help protect them against something similar. So you can do it for like
gang recruitment or propaganda videos, etc. Testimonies of former members can
serve that function to a certain extent. Have them tell their story of the step-by-step
and where they got tricked or where they got manipulated.
Yeah, so I guess where I was going with that
is that social psychologists do study defensive controls,
but they might not be developing comprehensive frameworks
in a way that security and privacy professionals naturally,
that's how we naturally think.
We want these broad frameworks that we can share with people that security and privacy professionals naturally, you know, that's how we naturally think. You know, we want, you know,
these broad frameworks that we can share with people
so that they can have kind of a menu
of different things that they can implement
to protect themselves.
So, and, you know, we typically focus on organizations,
but in terms of, you know,
psychosecurity and psychoprivacy,
maybe it's, I don't know if that's mainly something
that would happen at the organization or,
I mean, definitely the societal level, but it's... I don't know if that's mainly something that would happen at the organization. I mean, definitely at the societal
level, but it's also a personal
issue. A person has to put in
place controls for themselves and their loved ones.
So it's
more personal than...
Not giving your underage kid
a smartphone.
Not letting them have a computer
in their bedroom and having it in the
living room where you can monitor their use and all kinds of interesting things.
Can I ask you about AI agents?
Because we're very aware that these are just trillions of dollars are being poured into this area,
but there doesn't seem to be any ethical frameworks.
It's just more like, you know,
how do you get more time and attention from the person signing up or whatever?
Yeah, this kind of connects back to
what I was alluding to earlier,
that we don't have sufficient privacy laws in our country.
So that would help the
situation because if they're comprehensive privacy laws, they can cover all contexts.
So that's one thing I would recommend. I'm not an expert on AI policy or AI ethics. I do have
a personal interest in AI. I use ChatGPT personally. I think it's a wonderful technology.
Of course,
many risks associated with the
development of AI.
The one thing I would recommend to anyone who's using
these chatbots is just treat them like you would
if you're interacting with a person.
A person can lie to you or give you false
information. The AI chatbot
often does the same.
It was indispensable
for helping me prepare my data analysis for my dissertation, actually, it does well teaching code.
And that's one of the best applications for it. Because if the code doesn't work,
you know it right away. But asking you about other things is more risky, right? Because it can give
you false information, which you might not know right away whether
it's false or not.
It's a large language model
that it's working off
of, and Wikipedia
is rife with
bad information in the field
of cults and brainwashing and
mind control. So
they hallucinate,
they make up stuff, but it's because it's being fed junk.
Yeah, actually, this is a great research idea too. The intersection of these large language models
and cult education. What if we developed a curriculum for chat GPT and then asked it
questions about what is thought reform
or how would you define it or what type of person
is recruited into a cult and see
does it give out the right answers
or does it give out false information
so I'm not aware of any studies that have done that
yeah I've
experimented a little bit
and then I abandoned it because
I just don't have the funds
or the time. But I paid for a bot
from MIT AI Lab affiliations and I uploaded two million words of my writings and my lectures and my courses and everything else.
So instead of it drawing upon the general information of the world,
it just had Steve Hassan's expertise on the subject.
And I was thinking that it would be a great tool for people to come to my website and ask questions and such.
But even that was not to the level that I felt comfortable
using and stopped paying $100 a month because it was getting expensive to pay for that.
Yeah, well, it's definitely a research field that should be picked up by people. Because using AI to
spread the word about
educating people and inoculating the public,
if there can be a beneficial
application of that, we should be utilizing it.
Mm-hmm.
So are you teaching now?
What are you doing? Are you
working for a private firm?
I'm currently resting
after the dissertation. You know, it's a five-year
long journey. I'm currently figuring out what, you know's a five-year-long journey.
I'm currently figuring out in terms of employment and what I want to do.
I guess what I would say is I will be pursuing more thought reform research heading into the future.
I don't have any specific projects going on right now.
Again, I'm kind of in a resting phase.
Well, I'll publicly invite you.
I'm a Fielding fellow.
That's where I did my doctoral work at Fielding Graduate University,
and that gives me access to grants.
And Fielding will get a big chunk of it,
but it's a nonprofit,
and we could get grants.
So I'm extending a freedom of mind handshake to you
if you want to do something together.
Maybe it's a matter of just thinking what next
and writing a grant proposal and submitting it.
I definitely appreciate that.
Yeah, and this is probably no mystery to most of your
listeners but thought reform is a controversial
issue and topic
I won't go into too much detail but
it was hard to pursue it as a
dissertation topic because there's a lot
of red tape and research for universities
in general but there's a lot of
skepticism about whether it was
an appropriate topic for several reasons.
That's all I'll say, though.
But getting grants for something like that through traditional channels might be quite difficult.
I don't think so.
No?
I mean, it was.
But when I did my lit review, I was shocked.
And I shouldn't have been, but I was just shocked at how much
the sociologists of religion who were advancing the no such thing as brainwashing and no such
thing as thought reform existed in the literature. But what's shifting in the years since I
finished my dissertation in 2020 is there's more former members who are mental health professionals
and pursuing advanced degrees doing articles and research studies. And it's so obvious that people
are believing the earth is flat or there are green reptiles or that, you know, just so it's not just conspiracy theories, but they're actual cults,
online cults. So I don't think it'll be hard to get a grant if it's something you're interested in.
And I don't think it's controversial. I think people who are doing mind control don't want the public to be informed, so they may try to sabotage or censor.
But science needs to advance, even if there are those in power that say, no, no, no, we can't go
there. So as we're wrapping up, any other points you'd like to deal with, I mean, to think about, you know, just inherently, you know, thinking about human beings abusing each other. And kind of in the wake of our most recent election here in our country, you know, and Donald Trump returning to office, there's probably a lot of people feeling hopeless or, you know, despairing about the future of our country. And, you know, the totalitarians want us to lose hope. So the most major thing we can do to resist is to maintain hope.
Yeah, and I'll add to have community in real life with real people that you know and trust
and lean on each other and, you know, be in nature, listen to music, go dancing,
play with animals that you love, you know,
puppies and cats and whatever, your kids, and do things that bring us back to the human experience.
Yeah, taking care of yourself and the people around you. Yeah, and pets. Those are all,
you can, I like to frame those, they are forms of resistance, you know, against the totalitarian
influences, because they want us to be miserable. You know, so we, you know, take care of ourselves. I like to frame those, they are forms of resistance against the totalitarian influences
because they want us to be miserable.
So we take care of ourselves, maintain hope.
That's my message.
Yeah, and a lot of people are learning
not to be on their freaking phone for 10 hours a day
and certainly not to be up all night
because sleep is critical for our immune system
and for our brain to reset.
So to really learn hygiene, mind hygiene.
Yeah, limiting social media use or even deleting social media apps.
Actually, in the wake of Cambridge Analytica, I deleted my Facebook.
That's how disturbed I was.
But I do very, very much limit and believe in limiting social media use.
Because you hear about these teenagers that spend like six, seven, eight hours a day on social media and that's not healthy.
Right.
Yeah, make real friends in the real world. Defending the Security of the Mind, a male survey of thought reform literacy in South Dakota, newly minted PhD, and cyber expert.
Thank you so much.
It's been a pleasure, Dr. Hassan.
That's it for today's episode of the Influence Continuum.
I've been your host, Dr. Stephen Hasson.
Theme music for the podcast is by Nasser Malik.
To keep up to date with me and happenings that I think are important,
please visit my website at freedomofmind.com.
There you'll find in-depth articles about cults, mind control, and other relevant topics.
You can also find me on Twitter and Instagram at cultexpert. If you want to develop a comprehensive
understanding of these topics, I highly recommend my books, Combating Cult Mind Control, Freedom of Mind, and The Cult of Trump, in that order.
These books are a culmination of 45 plus years of experience and will really help you grasp
the complex web of Undo Influence. I have also launched a new nine-hour online course for anyone interested in a deep dive into issues related to recovering from undue influence in all forms.
While this course is designed for clinicians, everyone can benefit.
Remember, love is stronger than mind control.
And thanks for listening.