The MeidasTouch Podcast - Thought Reform and Cyber Security: Where Cult Manipulation Techniques Meet Technology With Dustin Rozario Steinhagen, PhD

Episode Date: December 23, 2024

Dustin Rozario Steinhagen, PhD is a privacy expert who recently graduated with his doctorate degree in Cyber Defense from Dakota State University. His dissertation is titled “Defending the security ...of the mind: A mail survey of thought-reform literacy in South Dakota.” This quantitative analysis measured “what everyday people know about thought reform and psychologically manipulative groups.” One of the most powerful defenses a person can have against mind hacking is admitting they are vulnerable to it. After that, skills can be acquired and built upon to teach people how to protect themselves further. However, we mustn’t let our guard down when it comes to our brains and minds coming under attack. Like anti-virus software needing updates to protect against the latest cyber threats, our minds also require ongoing learning to maintain psychological security in addition to adequate rest, play, and sleep. Influences are also more challenging to detect, more frequent in occurrence, from multiple directions, and require vigilance when interacting with different levels of trusted or untrusted sources. Having trusted groups who respect personal privacy and have our best intentions in mind becomes extremely important in such an environment. Learn more about your ad choices. Visit megaphone.fm/adchoices

Transcript
Discussion (0)
Starting point is 00:00:00 Whether you own a bustling hair salon or a hot new bakery, you need business insurance that can keep up with your evolving needs. With flexible coverage options from TD Insurance, you only pay for what you need. TD, ready for you. Discover the magic of BetMGM Casino, where the excitement is always on deck. Pull up a seat and check out a wide variety of table games with a live dealer. From roulette to blackjack, watch as a dealer hosts your table game and live chat with them throughout your experience to feel like you're actually at the casino.
Starting point is 00:00:32 The excitement doesn't stop there. With over 3,000 games to choose from, including fan favorites like Cash Eruption, UFC Gold Blitz, and more, make deposits instantly to jump in on the fun and make same day withdrawals if you win download the bet mgm ontario app today you don't want to miss out visit betmgm.com for terms and conditions 19 plus to wager ontario only please gamble responsibly if you have questions or concerns about your gambling or someone close to you please contact connex ontario at 1-866-531-2600 to speak to an advisor free of charge. BetMGM operates pursuant to an operating agreement with iGaming Ontario.
Starting point is 00:01:13 Hello, I'm Dr. Stephen Hassan with another episode of the Influence Continuum. I have a newly minted doctor as a guest today. I'm very, very excited to have with me Dr. Dustin Rosario-Steinhagen. He's a privacy expert. You just got your doctorate degree in cyber defense. You published numerous times in privacy literature, including fields of privacy education and neuro privacy. And we want to talk today about the topic of your dissertation research, which is titled
Starting point is 00:01:50 Defending the Security of the Mind, a Male Survey of Thought Reform Literacy in South Dakota. And all I can say is I was very excited to learn about your doctoral research. I know you approached me to be on your committee, which I unfortunately was overcommitted in other ways. I couldn't serve, but my dear friend and colleague John Atack did serve. John is an ex-Scientologist and a brilliant mind unto himself. And it sounds like you're really doing cutting-edge work. So I wanted to interview you, hear more about what you were interested in,
Starting point is 00:02:35 how you got interested in this, its applications, and get more people, especially young people, interested in this topic. So Dustin So Dr. Dustin, welcome to the Influence Continuum. Thanks, Dr. Hassan. And first, I just want to say it's an honor to be on your show. I first caught wind of your research in 2019 when I was first researching what's out there in terms of malicious influence. And we'll get into the backstory of kind of how a cyber defense PhD got involved with thought reform research, because it's very unintuitive and might even sound inappropriate without some context. Yeah, please tell us. Sure. So in 2018, I was a senior at Cornell University in my undergrad program. And the
Starting point is 00:03:22 most important course I ever took in my life was this course called Computational Psychology. So the whole thesis of this course is that the brain is literally a type of computer and the mind is computation. And we don't have time to go through all the mechanics of that. But the citation I would provide would be the professor's book, which is called Computing the Mind, How the Mind Really Works. The author's name? Dr. Shimon Edelman. Okay, thank you. Also, in 2018, as your viewers and listeners might recall, that's when the Cambridge Analytica scandal broke in the news in the spring. So right around the same time I was taking this course. And that really opened my mind to how much manipulation there is out there
Starting point is 00:04:11 and how our personal data is used to politically manipulate us. And that's really just the tip of the iceberg too. And I didn't realize how deep and broad this subject is until I really dug into the literature. So may I interrupt you, Dustin, and just for my listeners who may need a refresher on Cambridge Analytica,
Starting point is 00:04:33 and I know I think Christopher Wiley wrote a book about it. Tell our listeners just a bit about what that was about. Sure. So Cambridge Analytica was, I think it's most properly termed, should be termed a psychological warfare firm. They were doing political manipulation using personal data in various countries prior to essentially meddling
Starting point is 00:04:57 in the 2016 presidential election in our country and then also the Brexit referendum in the UK. So they got in big trouble and had to go back and they eventually went bankrupt because of this huge privacy scandal where they were essentially scraping thousands of data points from facebook and then combining that with psychometrics uh analysis to target specific voters and and sway the election in um in unethical ways. You know, I mean, influence doesn't have to be inherently unethical, but the reason why it came into Analytica was wrong
Starting point is 00:05:31 was because people's data was being scraped that they didn't consent to and that they didn't understand what was going on. Right. And it was on such a massive scale as well. If I may add, there was a documentary, I believe, called The Great Hack for people who want more details about it. And my recollection, if I may add, is just that they got into Facebook and were doing questionnaires and used the questionnaires to get to all the friends of the people who responded. I was in that hack. I got a notification from Facebook
Starting point is 00:06:06 that my data was scraped and all of my followers. So I was very displeased. So thanks for sharing that. So that happened and you were like, wow. The brain is a computer, but it's not just a computer. It's a vulnerable computer and it's routinely hacked. So then, you know, I, I mean, I'll just be honest. I got really scared, you know, and it wasn't just Cambridge Analytica.
Starting point is 00:06:31 You know, I learned about during 2018, I also learned about romance scams, which are very sophisticated type of scam where a hacker will convince someone to fall in love with them. So it's like an online dating situation, usually. But it's a false persona. So this person has genuine feelings of affection and love for this fake persona. And then there's this cover story of like, you know, maybe it's like a medical emergency, or they're stuck in an airport, and they need money all of a sudden. So then they have this cover story to extract money from the person who genuinely loves, you know, this fake
Starting point is 00:07:03 person. And oftentimes romance scams succeed at draining a person's entire bank account. It's actually one of the worst types of scams that I'm aware of, just in terms of the emotional damage. And that's how cults like to recruit. Yeah, it's very similar. Using people to recruit others, right?
Starting point is 00:07:16 Except it's online often. So people fall in love with a projection based on false information. And it's very, very nefarious and harmful and painful. And forgive me for adding one more thing, but just recently there was a young boy who fell in love with a chatbot on Character AI and killed himself because he wanted to be
Starting point is 00:07:42 with this chatbot for eternity. Yeah, I saw that story in the news recently as well. Yeah, so let's go back to you. So there you were. The brain is a computer. It can be hacked. Cambridge Analytica and you've got Cornell going, okay, what do I want to do with my life?
Starting point is 00:08:02 Yeah, that's when I really decided to pursue a degree in cybersecurity. And I'm not sure exactly how I first heard, but cybersecurity professionals, many of them deal with, we call it social engineering in the field. I'm not sure why we call it social engineering because most other fields will call it psychological manipulation, malicious influence.
Starting point is 00:08:22 I think there's better terms for it. But be that as it may, a lot of the literature in the cybersecurity field, you'll see the phrase social engineering. So I was aware of social engineering. And I started reading books, I really got interested, you know, I started kind of falling in love with learning about social psychology. And so that's, and privacy too. I mean, and the privacy connection is from Cambridge Analytica and just realizing that
Starting point is 00:08:45 there's this intimate connection between people losing their privacy and their vulnerability to influence. You know, the more data you have on someone, the easier you can control and manipulate them and deceive them. Right. And to state the obvious,
Starting point is 00:08:59 America does not have any data privacy laws in place. So all of these companies are taking our data, putting them on the dark web, right? So we have thousands of pieces of information about our choices on some dark cloud somewhere that some bad actor could potentially buy and use. Is that right? We do have some privacy protections, but they're quite inadequate. And I mean, just as a comparison, over in the European Union, they have something called the General Data Protection Regulation, or GDPR. So that covers all contexts, and it has very robust protections for privacy. Here in America, we don't have a federal law like that. We have some federal laws and many state laws, and it's just, it's
Starting point is 00:09:46 uncomprehensive, so that there are some protections in place, but definitely not enough. And again, Cambridge Analytica was kind of proof of that, so. Right. So tell us more about your, how you went about the study, what you were hoping to, you know, with science, you were always trying to do research that's cutting edge, that moves the boulder a little bit further up the mountain. So tell us about your process. Yeah. And again, a large part of coming up with your initial idea for research is just reading what's out there currently. So actually, I read your book, Combating Cold Mind Control. That was actually the first book on thought reform and destructive cults that I had read.
Starting point is 00:10:28 And that's when I really realized, this is, thought reform, that is, is the most serious security and privacy threat that we have. It has the potential to destroy all humans through nuclear war, like the Aum Shinrikyo case study. And even if we do... That's the Japanese sarin gas apocalyptic conspiracy cult that issued sarin gas, killed and injured many Japanese.
Starting point is 00:10:56 And my mentor, Robert J. Lifton, who wrote the seminal book, Thought Reform and the Psychology of Totalism, did a book called Destroying the World to Save It about apocalyptic cults and featured the Aum Shinrikyo cult. Yeah, and so there's that connection where, I mean, that's kind of the most extreme negative consequence of unmitigated thought reform. But even just the smaller things too, reading the different types of uh exploitation that's out there like for example psychological warfare i mentioned romance scams the other types of scams but the when i was learning about all those it really seemed like thought reform and
Starting point is 00:11:37 the consequence that it is it has for the people that are affected by it really it seems to be the work one of the worst things that can happen to a person. And it's because it covers so many different contexts. You know, it covers domestic abuse, human trafficking, terrorism, and so many more contexts. So I really wanted to do a study that would help push the envelope in thought reform research, especially since I learned that it was so underappreciated by social scientists. And I think our colleague, A-Tech, has said that it's almost a neglected research field. So I was learning as much as I could about thought reform. And I realized that one of the best, we call them defensive controls in the security and privacy field.
Starting point is 00:12:26 So a defensive control is a technique or tool you put in place to reduce risk. So education and awareness about thought reform is a defensive control. And it really, and I know you and many other experts have really are huge fans of this idea of education and awareness. So that seems like the best area for me to do my work in. I wanted to make a big difference. So the main idea of my survey is that i wanted to quantitatively measure how much people knew about psychological manipulation and psychologically manipulative groups so psychologically manipulative groups is is a term that's pretty much synonymous with
Starting point is 00:12:59 destructive cults and it's a less controversial descriptor so that was the the term that i led with rather than cults right because that can be especially because i'm going to i was i was surveying lay people i just wanted to make sure that um to reduce bias um right so how did you find your your your respondees just out of curiosity so this was a a mail survey and what i did is i purchased a comprehensive mailing address list. So the state that I studied was South Dakota. So South Dakota is a pretty rural state here in the United States. And it wasn't too expensive. It was within my budget, that is to purchase a whole list of physical addresses. So then I could randomly sample that physical address list and essentially
Starting point is 00:13:44 get statistics that would represent all of South Dakota. That was the idea. So you were doing snail mail surveys? Yep. And the reason for that, it had the best coverage of the population. You choose your survey type based on the population that you're studying. So it would cover the population better and allow me to get more accurate statistics. So I guess that's a little ironic, you know, a cybersecurity student using snail mail. And there's a higher rate of response for a mail survey compared to something like email or telephone. Yeah, I believe that. So do you live in South Dakota?
Starting point is 00:14:18 I did. Yeah, I was a student employee of my university, Dakota State University, for four years. I see. I ended up finishing my PhD program after my work contract ended. So I moved to Iowa, which is where I'm currently located. Okay, good. So please continue. So tell us about what you asked and what the results were.
Starting point is 00:14:41 Yeah, so in collaboration with several thought reform experts, I developed a curriculum of 47 questions to ask the South Dakota and L.A. people. So each question was weighted equally, so that means that 47 was the max score on the test. And I had
Starting point is 00:15:00 147 respondents, so that was the sample size. And the scores that I saw were between one, so a single point correct, and 46. So no one got a perfect score, no one completely flunked it with a score of zero. And the weighted average score was between 37 and 39. So that's approximately equal to like a C plus or a B minus, if this was like a grade school test. Okay. Okay, so then to get to some of the individual questions, this is my favorite statistic of the entire survey. So it was a humility
Starting point is 00:15:31 question. So essentially asking people if they believe they're vulnerable to psychological manipulation. So the question stem was, do you believe you could be lured into a psychologically manipulative group or relationship? So they could answer, yes, it is possible or no, it is not possible. 31% of my respondents said it's not possible. So they assumed that they were immune. And two thirds, so 66% selected that it was possible. And I just found this very interesting because, well, first of all, we didn't have any, like from a broad geographic population, that is, we didn't have any statistics about what people believe of their own vulnerability to thought reform.
Starting point is 00:16:09 So, I mean, two-thirds of people were humble. I think that's hopeful, actually. And I thought it was going to be a lot less. I thought more people would be assuming that they were immune. Yeah, well, folks like me from big cities have ideas about Dakota and South Dakota and stuff. So I think it's really fascinating, frankly. I, you know, I'll just comment that it is the biggest vulnerability to think that you're invulnerable to being deceived and manipulated. It's like, oh my God. And it's
Starting point is 00:16:48 amazing when I talk to people who say, no, it would never happen to me. And then I ask them questions and they're like, oh, actually, I did fall for someone who was a narcissist and they did hurt me. And I did have this boss, but people walk around thinking they're too smart. Yeah, the optimism bias and several other cognitive biases work against us for that. I was going to say, in terms of the humility, the most interesting statistical finding of my survey was that there was a positive correlation between those who were humble
Starting point is 00:17:29 and getting higher scores on the test. So for the people who are methodologists or researchers, the exact correlation was 0.251, which corresponds to a low to moderate positive correlation. And I guess just to put it in plain English, if the respondents in my survey that were humble
Starting point is 00:17:49 knew more about thought reform and cults than those who assumed that they were immune. And I think this is a very... I mean, we just didn't have data about this prior to my dissertation that there would even be a relation between these two variables at all. And this really coincides with what is stated in the thought reform literature, like you just alluded to a few minutes ago, that if you assume you're
Starting point is 00:18:18 immune, then you're vulnerable. And assuming that a person's knowledge is correlated with how protected they are, then this study actually gives quantitative evidence for this theory that humility is protective. Right. And I have a question because I didn't read your dissertation, forgive me, yet. But did you ask any questions if people had children? I did not. Yeah. And I can talk about the other demographic variables. I didn't study all the demographic variables. I know it would have been interesting to study political affiliation
Starting point is 00:18:50 or religious beliefs. I just wanted to keep the, that could have harmed response rates, you know, because those are more sensitive questions. And along with asking
Starting point is 00:18:58 about people's children as well, that might have harmed response rates. So I just wanted to keep it with kind of the bread and butter demographics. So I studied educational attainment, age, biological sex,
Starting point is 00:19:09 something called subjective social status, which is similar to socioeconomic status. But instead of asking for a person's income, you directly ask them about their social class. So whether they're poor, working class, middle class, or affluent. And race and ethnicity. So there was these five other demographic variables. And I ran a multiple regression analysis.
Starting point is 00:19:28 And first, just a caveat, pretty low sample size. So that could have affected things. But I did not find any statistically significant correlations between any of these five demographic variables and people's knowledge. And that's also consistent with what's said in the literature that a person's background really doesn't influence their susceptibility to cult recruitment.
Starting point is 00:19:52 You can come from... It affects the poor and rich alike, so to speak. I would argue, though, in this day and age that bad actors want wealthy people and influencers, so they'll target them over somebody
Starting point is 00:20:10 who is not knowledgeable, educated, well-situated. So I think there's a targeting piece that may be at play. Right, and I guess my thing wasn't a quantitative measure of a person's exact vulnerability, just their knowledge, but assuming those variables are related. And the last thing I want to say about general, or the general idea of my survey is that I
Starting point is 00:20:33 found two thought reform deniers, is what I called them. So these were the people that answered, well, rewinding a little bit, some of the distractors of the questions in my survey were like, psychological manipulation doesn't exist or we don't know how it would work because it doesn't exist. So I included those distractors
Starting point is 00:20:49 because for my literature review, I realized that I think you and others have stated that many people deny that thought reform, brainwashing, mind control even exist at all. And I want these people, if I did find them, to be able to answer my survey in good faith. So I'm really glad I kept those distractors in the survey because I did find two people who, and they were consistent with it too. They didn't just answer it once.
Starting point is 00:21:13 They went through the whole survey and said, like, it doesn't, manipulation doesn't exist. Zero people are being psychologically manipulated in the world. That was one of the questions in the survey. So that were one of the answers. So these people do exist, the deniers. I hadn't personally met one, but it's just interesting to think. And that's really important.
Starting point is 00:21:32 Sorry, go ahead. No, I apologize. I told you I didn't want to interrupt and talk too much. No, it's okay. You know, it's the... Anyway, please continue. It's really important for future researchers in this field to make sure that they keep those types of distractors in the curriculum so that they can catch these deniers
Starting point is 00:21:54 and we can continue to estimate what the proportion is in the population. Again, my sample size was so small that it's hard to know if it's just like the 1% to 2%, which the two out of 147 respondents, or if it could be higher because of non-response, you know, maybe there's a higher proportion of people that I didn't catch, but future research will have to discover that. So. Yeah. I will add just that there are cult apologists who are paid sociologists of religion who go out of their way to say there's no such thing as brainwashing and mind that smoking class cancer and fossil fuel companies do that too. But then there are people in cults who really don't believe that they've been brainwashed like I was in the Moonies.
Starting point is 00:22:59 I was like, no, definitely not. So anyway, please continue. Yeah, and I guess, because if you consider denying the existence of thought reform and then just assuming that you're immune to it, denying that it exists is probably far worse for a person's vulnerability than acknowledging that it exists, but then falsely believing the not-me myth that Margaret Singer mentioned. So it's kind of three categories of people that I found in my survey,
Starting point is 00:23:30 deniers, people who thought they were immune, and then people who were humble. So we don't have time to cover every single question in my survey, but I kind of picked four individual questions that I thought you would find particularly interesting, and then we can talk over. Great. All right. So one of the questions I asked was about the extent of influence or what influence is possible. So which components of the mind can be influenced? So the first distractor was just beliefs and behaviors, which 5% of people selected. Then it was, it accumulated. So if a person selected the second answer,
Starting point is 00:24:10 it would be beliefs, behaviors, plus thoughts and emotions. So that was an additional 24%. So a total of 29% thought it was either just beliefs and behaviors or plus thoughts and emotions. So I would just mention that's kind of the four components of your BITE model. So 24% acknowledged just the byte components. I've taught a social engineering class in the past. And one thing I emphasize with my students is that,
Starting point is 00:24:30 although it's easy just to think of the byte components, that the extent of influence is so much more than that. You can implant false memories, altered states of consciousness, and other things as well. So the third distractor was memories and use of language as the fifth and sixth things that can additionally be manipulated or influenced. So that was an additional 5%. Now, what surprised me was that 59% of my respondents selected the correct answer,
Starting point is 00:25:00 it was those prior six things plus a person's core identity and personality. I really thought this was going to be less. I was not expecting 59% to say that, oh yeah, identity and personality can be manipulated as well. So I was very impressed with my respondents. Because that is, in the definition of thought reform,
Starting point is 00:25:19 it's really focused on identity manipulation. So the fact that these lay people understood that identity can be changed, it's hopeful that they can protect themselves. Very much so. And when the public describes,
Starting point is 00:25:38 my son is different. He came back one weekend and he's a different person. They're recognizing there's an identity shift that took place. Yeah. Okay, so that was the first question I wanted to talk about. The next one was talking about cult leaders. So the question, Sam, went something like,
Starting point is 00:25:58 which of the following describes all leaders of psychologically manipulative groups? So it was really getting the respondent to select the core characteristic of what makes a cult leader, or the type of person who becomes a cult leader, I should say. So the correct answer was that cult leaders are abusive people who have learned manipulation techniques. So 42% of
Starting point is 00:26:18 my respondents selected that correct answer. And two of the distractors were selected by a lot of people. so the first distractor was that they were intelligent people with compelling ideologies which was 30 of the respondents and then um the third or the second distractor was that they were highly charismatic people who can influence people with little effort and that was 27 of the respondents who selected that um so it was very close. You call them distractors?
Starting point is 00:26:47 Yeah, a distractor in a survey. So mine was a knowledge survey. So there's a single correct answer. So a distractor is one of the false. Got it. Or false options in a multiple choice question. Yeah, thanks. Yeah, I guess I can't just assume everyone knows what I'm talking about.
Starting point is 00:27:03 No, you're teaching me because I'm not an expert in cyber education and social engineering. So please, that's partly why I wanted to have you on the show. Yeah. So I guess with this question that I just mentioned, there was a lot of people who thought that the core element of a cult leader is the charisma or the fact that they have compelling ideologies, which those are often things that are in place. But that's not what defines a cult leader. What defines it is the psychopathology where they're abusing people. And that distinguishes them from benign leaders.
Starting point is 00:27:45 Okay, so the third question I want to talk about was about legal protection. So this is another one of my favorite questions. And I know you wrote your whole dissertation on legal protections and thought reform, covered that in your lit review. So this question asked, what legal protections currently exist
Starting point is 00:28:02 to protect against psychological manipulation in America? So 7% of people selected the wrong answer that it's a federal crime. 12% selected the distractor that it was a state crime in some states, but not all of them. 4% thought it was a state crime in all 50 states. And 65% selected the correct answer that there are almost no legal protections in America against thought reform. Wow, that's very impressive, right? Two-thirds of people understood that, oh yeah, psychological manipulation, it's a problem, but our legislators aren't doing anything about it. So people do understand what's going on in terms of the current legal landscape and how they're left to protect themselves.
Starting point is 00:28:46 I thought that awareness about this would be a lot less. So again, I was very impressed with this question that so many people got it correct. It is impressive, but I can't help but comment, Dustin, that I've been attacked by being called brainwashed by Soros and the libtards, so they think that it exists. Only the other side that's critical of Trump is getting it. It's confusing for most people. I guess just having a basic awareness that psychological manipulation exists
Starting point is 00:29:28 doesn't mean that a person's aware of how to detect it or fully appreciates that it can exist on both sides of the political aisle or all the different contexts. Right. Yeah, good. Okay, then the last question I wanted to cover was, and this was actually the hardest question on the entire survey in terms of the proportion of people that got it incorrect.
Starting point is 00:29:50 So it was which type of person is most commonly recruited into a psychologically manipulative group? And the first distractor was people of low intelligence. So only 3% of people selected that. So that's good. 27% selected the correct answer that it's the normal and ordinary. So only a fourth of my respondents got this one correct. The majority, which was 57%, said it was the needy independent. And I'll just stop right here to talk kind of why this is a
Starting point is 00:30:18 common misconception. People who are recruited into psychological manipulative groups do become needy and dependent. But what many people don't realize is that they probably didn't start out having a dependent personality disorder. You know, it's pretty rare in the population. So the overwhelming majority of people that are recruited into these cults have a change. Again, it's that change in their personality. And Alexander Steen's book, Terror, Love, and Brainwashing, is incredible at explaining that it's about attachment. So people develop the trauma bond or the disorganized attachment
Starting point is 00:30:53 as they're getting recruited and while they're in the cultic milieu. So that's why they appear needy and dependent. Huh? Go ahead. Yeah, so that's why this was probably the most difficult question because it's partially correct or it seems partially correct at least
Starting point is 00:31:13 they have the right idea I should say that these cult members are needy and dependent but they got the reasoning wrong it wasn't a predisposing factor into the recruitment. That was more about deception. Exactly. I was just going to comment, Alexandra Steen is a social psychologist in the UK
Starting point is 00:31:35 and wrote this very good book and connected the dots with attachment disorder. And the other piece is just that it's a dissociative disorder. So the Mooney Steve was dependent. It was a child personality that was going to follow the father figure, whatever he said or did. And the real me would absolutely never do that. Yeah, so it's not a shortcoming of the person's authentic personality. Exactly. Alright.
Starting point is 00:32:09 The last distractor for this question was the mentally unstable misconception. So only 3% of people selected that one as well. The most common misconception was the media independent. So very interesting. And again, there's many... I only covered four of the 47
Starting point is 00:32:25 questions. My dissertation is openly available on ProQuest, so people can just search my name, and anyone can get a copy for free if they want to look at the rest of the questions. And we're going to do a blog based on this, and
Starting point is 00:32:41 link it directly to it, so it'll be in my sub stack. And so I am wondering, now that you've completed this and I know how much work goes into doing a doctorate, what do you want to see happen? Talk about your personal, curious, future research goals
Starting point is 00:33:06 and then what you would like to see the field do more of. Yeah, I guess the first thing that comes to mind is I really hope that I won't remain the only cybersecurity and privacy expert that covers this important topic. When I was doing my literature review, I saw that there was a master's student who wrote a thesis on psychological warfare. So that was about the closest I came to seeing something related to thought reform among my colleagues in the field. So that's the
Starting point is 00:33:37 first thing I would say. But you know, thought reform is a multidisciplinary subject. So it doesn't just belong to the cybersecurity and privacy field. It doesn't just belong to social psychology. So I just hope that it raises awareness and really encourages other researchers in other fields, not even just my own expertise, but in other fields that they can cover this topic. You can be the first one.
Starting point is 00:34:03 I'm not aware of any other, um, yeah, cybersecurity PhDs who have covered this. So. Yeah. I'll add clinical of, as a therapist that there's, you know, vast numbers of people in need of specialized counseling. Uh, but the other big thing is public health. There's a whole discipline, master's and PhD level for public health, and I see this as a public health emergency. This is a mind virus, coming back to your original comments about the brain is a computing device and the mind can get hacked. So that speaks to the need for inoculation programs for all people to, you know, at least have some filters. And I offer my influence continuum and bite model, just as one model. But then, you know, doing training for clinicians, educators, media, politicians, policymakers. And then what do we do with people coming out of the rabbit hole who are going like,
Starting point is 00:35:11 what happened to me? Because they need to be reintegrated back into the world and society. Yeah, and kind of what you're suggesting is there's so much work that can be done. And when I think of this through the lens of research, I mean, there's thousands of research ideas and thousands of things that haven't been researched yet. Even just considering the overlap between security and thought reform, but also thought reform more generally. Because as I alluded to earlier, it's an understudied discipline. And that's part of the reason why it's unmitigated in society, largely. So, you know, any amount of light that we can shed on this as researchers will be good. I do want to share with
Starting point is 00:35:55 your audience several research ideas. You know, I'm one researcher, you know, it'd be great if I could throughout the course of my career, do all of these, you know, write research papers on all of these, but you know, I'm just one, one guy, you know, one person. So I, and I like competition in this field, because it helps everyone. You know, this isn't, this isn't about personally bettering myself, this is about protecting humanity, protecting the security and privacy of our minds. So I want people to, you know, pursue these research ideas. So hopefully I can give some research ideas here. The first thing, and this is probably the most obvious future work related to the
Starting point is 00:36:28 survey that we were just talking about, is this is one state in the United States. We need these surveys in all 49 states and plus the territories and internationally. The beautiful thing about this is that once we get multiple states, then we can do comparison studies. And eventually, if we get enough,
Starting point is 00:36:44 we can do a meta-analysis and really start to understand what the current state of public awareness about thought reform and cults really is. Because we're in the dark right now. We really don't know. And it's pretty ludicrous to me as a security professional.
Starting point is 00:36:59 We're constantly measuring whether people are aware of phishing, phishing scams, for example. We're constantly testing people. are aware of phishing, phishing scams, for example, we're constantly testing people, but why are we not doing this for the thing that literally ruins people's lives and drains their bank accounts? And, you know,
Starting point is 00:37:14 their minds get hijacked. And, you know, this is the, the paradigm of influence, you know, talking about thought reform, it's the paradigm of influence that causes people to,
Starting point is 00:37:21 you know, get involved with human trafficking. Exactly. That's so much more devastating than a phone scam or an email scam like why are we focusing more on those things than this other you know paradigm of influence that does so much more damage in society so i really think we need to ramp up education awareness research in this area. So kind of related to that too is literacy studies in specific professions. So do a literacy
Starting point is 00:37:50 study among licensed mental health professionals. Are they aware of thought reform? Do they know the best practices for counseling former cult members? Even identifying whether a client has the background.
Starting point is 00:38:07 They don't know. That's why I did an online course for them. Yeah, so, and again, you could have specialized curricula for mental health professionals, clergy, law enforcement, medical doctors. I mean, the list goes on and on. And you had mentioned some earlier too about the specific professions and fields
Starting point is 00:38:25 that probably need more of an awareness about this issue than just kind of the layperson-friendly curricula that I developed or curriculum that I developed. So we'll need specialized curriculum. And again, that's across so many different fields that a single researcher can't do that.
Starting point is 00:38:42 So we need more people to get involved. And then I got some other ideas in terms of fully integrating security and privacy research with defending the mind. For example, I like the term psychosecurity, psychoprivacy.
Starting point is 00:38:59 Mind security, mind privacy. I'm not even sure if they appear in the literature. We need definitions. What does it mean for security, mind privacy. I'm not even sure if they appear in the literature, but it's... We need definitions. So what does it mean for someone's mind to be secure? What does it mean to defend the privacy of the mind? And I don't have answers to these questions.
Starting point is 00:39:16 And there's this very foundational philosophical work. It might sound unimportant, but until we fully define these things, we won't know what we're looking for, and whether we've succeeded. So I kind of jumped the gun a little bit with my research because I don't think we have the full theoretical foundation yet for integrating security and thought reform, or defending the mind in general. But that would have been a lot harder of work
Starting point is 00:39:46 than my dissertation idea. Yeah, dissertation committees always want you to chunk it down to something that's actually finishable within a reasonable amount of time because people start out with grandiose ideas and they're like, that'll take 20 years and $20 million. Yeah, do something simple.
Starting point is 00:40:07 Yeah, do something that you can afford that's just incrementally moving the ball down the thing. I was going to comment on law professor Nita Farahani's work on cognitive security. She's been talking about all of these, you know, AirPods and virtual reality things and who's going to own the data from all of these instruments that are being collected and put in the cloud. There's nothing on that. And then I'll add that there's a graduate student-to-be,
Starting point is 00:40:44 Matthew Bywater, who's been talking about wanting to create a freedom of the mind human right that would be more comprehensive, that looks at bite model stuff and the subcomponents of that as well. But as you were talking, Dustin, I was thinking about China and Xi and just how authoritarian the whole country is and how they won't allow other cults to exist there, but the whole society is a cult and they have surveillance and AI for almost everything. So what are your thoughts about that as a future? That sense is so powerful. Yeah, well, this might be related to the idea of surveillance capitalism, which sadly I have not read that book yet. But kind of the idea that, well, let me say this.
Starting point is 00:41:43 Privacy is a requirement for having an individual identity and for exercising autonomy. Say that again. That's really important. Privacy is essential for having autonomy and having an individual identity. So if you look at totalitarian systems, they'll strip people of their privacy. And one thing I want to mention
Starting point is 00:42:05 in this interview is that a very important paper was written by Daniel Solove in 2006 called A Taxonomy of Privacy. So in that, it's a long paper, he explained that there's 16 different ways to harm privacy. And I'll just give a few examples um surveillance and interrogation so passively or actively gathering information from people sometimes and with any privacy harm uh it's dependent on context so in in certain contexts it's it's wrong um but other privacy harms include blackmail um distortion which is like spreading rumors about people, spreading false information about other people to ruin their reputation. Decisional interference is robbing someone
Starting point is 00:42:50 of their autonomy. So that's literally a privacy harm. And I won't go through the whole list, but if you look at these 16 privacy harms, I think that you'd find most or probably all of them in most thought reform environments. So when you mention
Starting point is 00:43:05 China taking away people's autonomy, that there's the social credit system where all this data is being aggregated about people and being used to make decisions about whether they get certain rights or privileges or not. So I think this could really be a benchmark of determining how free a society is. It's looking at the privacy protections and how many privacy harms are being perpetuated in a society. And privacy is a human right, too. I know you've incorporated human rights into your work, and that eight criteria from 61 was the cult of confession, which not all cults formally get people together and have people stand up and confess all their sins. But the idea is there's no privacy, that the group owns and knows everything about your past and can use that information if you get out of line or to punish you. Yeah, that connects to the blackmail harm. Again, blackmail can be used to limit people's autonomy. Absolutely.
Starting point is 00:44:19 Yep. Yeah. So I wish you could get a huge grant and get a whole bunch of students. funding the Plandemic video and anti-vax videos. And I've talked to people who got converted to QAnon because of watching those, just from watching it. And for me, when I watched it, it seemed hypnotic at places. It had people pretending, you know, who asserted an expertise they didn't have. And typically with propaganda, you say something true, you say another thing that's true, and then you slip in something that's unverifiable. And then you go back to something that's true, and then you put something in that's outrageous. But then you put something in that's true, and you're like sandwiching in these false beliefs
Starting point is 00:45:48 at such a fast rate that consciously people don't have time to, unless you're pausing the video and looking it up, it's just coming in. So I'd love to see something like that done for a doctoral dissertation to analyze. Yeah, I guess what I would say in terms of how security and privacy professionals can help with that is we're really specialists in developing, researching, and deploying security and privacy controls. That's one thing we focus on in the entire field is what are the tools and techniques we can use to mitigate risk? And we need,
Starting point is 00:46:28 we call them control libraries and frameworks. So you need to have categories of what these tools and techniques are and then specific implementation ideas and technologies that you can use. So we need these frameworks for psychosecurity and psychoprivacy. So we would have
Starting point is 00:46:44 lists of controls that we could put in place for mitigating propaganda, for example, you know, the example that you were just talking about. But I feel like in the social psychology field, they do talk about defense, you know, for example, there's inoculation theory, which, you know, has applications for defending people against propaganda. And I guess for your listeners, if they're not familiar with inoculation theory, that's when you present a weakened form of influence to someone to help protect them against something similar. So you can do it for like gang recruitment or propaganda videos, etc. Testimonies of former members can serve that function to a certain extent. Have them tell their story of the step-by-step
Starting point is 00:47:27 and where they got tricked or where they got manipulated. Yeah, so I guess where I was going with that is that social psychologists do study defensive controls, but they might not be developing comprehensive frameworks in a way that security and privacy professionals naturally, that's how we naturally think. We want these broad frameworks that we can share with people that security and privacy professionals naturally, you know, that's how we naturally think. You know, we want, you know, these broad frameworks that we can share with people
Starting point is 00:47:48 so that they can have kind of a menu of different things that they can implement to protect themselves. So, and, you know, we typically focus on organizations, but in terms of, you know, psychosecurity and psychoprivacy, maybe it's, I don't know if that's mainly something that would happen at the organization or,
Starting point is 00:48:04 I mean, definitely the societal level, but it's... I don't know if that's mainly something that would happen at the organization. I mean, definitely at the societal level, but it's also a personal issue. A person has to put in place controls for themselves and their loved ones. So it's more personal than... Not giving your underage kid a smartphone.
Starting point is 00:48:20 Not letting them have a computer in their bedroom and having it in the living room where you can monitor their use and all kinds of interesting things. Can I ask you about AI agents? Because we're very aware that these are just trillions of dollars are being poured into this area, but there doesn't seem to be any ethical frameworks. It's just more like, you know, how do you get more time and attention from the person signing up or whatever?
Starting point is 00:48:57 Yeah, this kind of connects back to what I was alluding to earlier, that we don't have sufficient privacy laws in our country. So that would help the situation because if they're comprehensive privacy laws, they can cover all contexts. So that's one thing I would recommend. I'm not an expert on AI policy or AI ethics. I do have a personal interest in AI. I use ChatGPT personally. I think it's a wonderful technology. Of course,
Starting point is 00:49:27 many risks associated with the development of AI. The one thing I would recommend to anyone who's using these chatbots is just treat them like you would if you're interacting with a person. A person can lie to you or give you false information. The AI chatbot often does the same.
Starting point is 00:49:44 It was indispensable for helping me prepare my data analysis for my dissertation, actually, it does well teaching code. And that's one of the best applications for it. Because if the code doesn't work, you know it right away. But asking you about other things is more risky, right? Because it can give you false information, which you might not know right away whether it's false or not. It's a large language model that it's working off
Starting point is 00:50:12 of, and Wikipedia is rife with bad information in the field of cults and brainwashing and mind control. So they hallucinate, they make up stuff, but it's because it's being fed junk. Yeah, actually, this is a great research idea too. The intersection of these large language models
Starting point is 00:50:36 and cult education. What if we developed a curriculum for chat GPT and then asked it questions about what is thought reform or how would you define it or what type of person is recruited into a cult and see does it give out the right answers or does it give out false information so I'm not aware of any studies that have done that yeah I've
Starting point is 00:50:58 experimented a little bit and then I abandoned it because I just don't have the funds or the time. But I paid for a bot from MIT AI Lab affiliations and I uploaded two million words of my writings and my lectures and my courses and everything else. So instead of it drawing upon the general information of the world, it just had Steve Hassan's expertise on the subject. And I was thinking that it would be a great tool for people to come to my website and ask questions and such.
Starting point is 00:51:43 But even that was not to the level that I felt comfortable using and stopped paying $100 a month because it was getting expensive to pay for that. Yeah, well, it's definitely a research field that should be picked up by people. Because using AI to spread the word about educating people and inoculating the public, if there can be a beneficial application of that, we should be utilizing it. Mm-hmm.
Starting point is 00:52:13 So are you teaching now? What are you doing? Are you working for a private firm? I'm currently resting after the dissertation. You know, it's a five-year long journey. I'm currently figuring out what, you know's a five-year-long journey. I'm currently figuring out in terms of employment and what I want to do. I guess what I would say is I will be pursuing more thought reform research heading into the future.
Starting point is 00:52:39 I don't have any specific projects going on right now. Again, I'm kind of in a resting phase. Well, I'll publicly invite you. I'm a Fielding fellow. That's where I did my doctoral work at Fielding Graduate University, and that gives me access to grants. And Fielding will get a big chunk of it, but it's a nonprofit,
Starting point is 00:53:00 and we could get grants. So I'm extending a freedom of mind handshake to you if you want to do something together. Maybe it's a matter of just thinking what next and writing a grant proposal and submitting it. I definitely appreciate that. Yeah, and this is probably no mystery to most of your listeners but thought reform is a controversial
Starting point is 00:53:28 issue and topic I won't go into too much detail but it was hard to pursue it as a dissertation topic because there's a lot of red tape and research for universities in general but there's a lot of skepticism about whether it was an appropriate topic for several reasons.
Starting point is 00:53:45 That's all I'll say, though. But getting grants for something like that through traditional channels might be quite difficult. I don't think so. No? I mean, it was. But when I did my lit review, I was shocked. And I shouldn't have been, but I was just shocked at how much the sociologists of religion who were advancing the no such thing as brainwashing and no such
Starting point is 00:54:13 thing as thought reform existed in the literature. But what's shifting in the years since I finished my dissertation in 2020 is there's more former members who are mental health professionals and pursuing advanced degrees doing articles and research studies. And it's so obvious that people are believing the earth is flat or there are green reptiles or that, you know, just so it's not just conspiracy theories, but they're actual cults, online cults. So I don't think it'll be hard to get a grant if it's something you're interested in. And I don't think it's controversial. I think people who are doing mind control don't want the public to be informed, so they may try to sabotage or censor. But science needs to advance, even if there are those in power that say, no, no, no, we can't go there. So as we're wrapping up, any other points you'd like to deal with, I mean, to think about, you know, just inherently, you know, thinking about human beings abusing each other. And kind of in the wake of our most recent election here in our country, you know, and Donald Trump returning to office, there's probably a lot of people feeling hopeless or, you know, despairing about the future of our country. And, you know, the totalitarians want us to lose hope. So the most major thing we can do to resist is to maintain hope.
Starting point is 00:56:09 Yeah, and I'll add to have community in real life with real people that you know and trust and lean on each other and, you know, be in nature, listen to music, go dancing, play with animals that you love, you know, puppies and cats and whatever, your kids, and do things that bring us back to the human experience. Yeah, taking care of yourself and the people around you. Yeah, and pets. Those are all, you can, I like to frame those, they are forms of resistance, you know, against the totalitarian influences, because they want us to be miserable. You know, so we, you know, take care of ourselves. I like to frame those, they are forms of resistance against the totalitarian influences because they want us to be miserable.
Starting point is 00:56:47 So we take care of ourselves, maintain hope. That's my message. Yeah, and a lot of people are learning not to be on their freaking phone for 10 hours a day and certainly not to be up all night because sleep is critical for our immune system and for our brain to reset. So to really learn hygiene, mind hygiene.
Starting point is 00:57:09 Yeah, limiting social media use or even deleting social media apps. Actually, in the wake of Cambridge Analytica, I deleted my Facebook. That's how disturbed I was. But I do very, very much limit and believe in limiting social media use. Because you hear about these teenagers that spend like six, seven, eight hours a day on social media and that's not healthy. Right. Yeah, make real friends in the real world. Defending the Security of the Mind, a male survey of thought reform literacy in South Dakota, newly minted PhD, and cyber expert. Thank you so much.
Starting point is 00:57:53 It's been a pleasure, Dr. Hassan. That's it for today's episode of the Influence Continuum. I've been your host, Dr. Stephen Hasson. Theme music for the podcast is by Nasser Malik. To keep up to date with me and happenings that I think are important, please visit my website at freedomofmind.com. There you'll find in-depth articles about cults, mind control, and other relevant topics. You can also find me on Twitter and Instagram at cultexpert. If you want to develop a comprehensive
Starting point is 00:58:36 understanding of these topics, I highly recommend my books, Combating Cult Mind Control, Freedom of Mind, and The Cult of Trump, in that order. These books are a culmination of 45 plus years of experience and will really help you grasp the complex web of Undo Influence. I have also launched a new nine-hour online course for anyone interested in a deep dive into issues related to recovering from undue influence in all forms. While this course is designed for clinicians, everyone can benefit. Remember, love is stronger than mind control. And thanks for listening.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.