Decoding the Gurus - Andrew Huberman and Peter Attia: Self-enhancement, supplements & doughnuts?

Episode Date: November 9, 2023

In a kind of meta cross-over with our Decoding Academia series, we're going to decode a journal club discussion between two well-known health optimisers: Dr. Peter Attia and Dr. Andrew Huberman. So yo...u get to listen to two academics talk about two other academics talk about academic papers... we know...We've already been introduced to the bulging biceps and morning sun-drenched routines of Huberman elsewhere but this is our first introduction to Peter Attia, MD. Attia is a former ultra-endurance athlete and a physician in the field of longevity and performance, a podcaster (who isn't amirite?!?) and author of "Outlive: The Science And Art Of Longevity".Attia introduces us to a paper that casts doubt on the supposed general life-extending properties of a diabetes drug called Metformin. This is a drug that is apparently very well known in the biohacker/life extension communities and one that Attia administered to himself for a number of years despite the rather preliminary evidence. This is the first of many indicators that both gentlemen are certainly on the bleeding edge of self-medicating experimentation, doggedly pursuing the elusive goals of huge pectoral muscles, minds that laugh at the concept of cognitive decline, and bodies that will live... well for a lot longer than Matt and Chris!We get to hear about week-long starvation regimes, medications that take the edge of pizza and doughnut binges, dealing with month-long nausea from self-dosing experimental treatments, and frequent prick-blood tests all for the sake of optimising, optimising, optimising...Huberman's paper (a preprint, actually) falls more into the "big, if true" category - although he seems fairly confident himself. Does *believing* you are getting a treatment generate the relevant physiological and neurological effects in the body that could mean we can bypass the need for certain pharmacological substances entirely, including some vaccines?!? Based on the results of a small-N, fMRI study that reports mixed results, Huberman muses... maybe! Or how about those other small-N studies, with p-values hovering suspiciously close to 0.05 that report other counterintuitive findings? We will leave it to Huberman to explain.But the bad stuff aside, Huberman and Attia (especially Attia) actually do a pretty decent job talking about how to approach research papers and some of the pros and cons of different approaches. Chris and Matt thus have ample opportunities to give credit where credit's due and demonstrate that they are the fair-minded souls everyone knows them to be! In any case, it's an interesting peak into an alternative health optimiser world. It seems to be a rather "serious" hobby a bit like body modification or tattoos. But who are we to judge? Matt likes cultivating succulent plants and Chris is into eating sushi in lush forests. So biohacking, self-experimentation for longevity? Well, at least it's an ethos.Also featuring, an introduction that covers Irish history, the most humble guru in the gurusphere, and our very own theory of guru cringeosity!LinksJournal Club with Dr. Peter Attia | Metformin for Longevity & The Power of Belief EffectsThe Most Arrogant thing Bret Weinstein has ever said? Bad Stats ThreadKeys et al. (2022) Reassessing the evidence of a survival advantage in Type 2 diabetes treated with metformin compared with controls without diabetes: a retrospective cohort study.

Transcript
Discussion (0)
Starting point is 00:00:00 Hello and welcome to Decoding the Gurus, the podcast where an anthropologist and a psychologist listen to the greatest minds the world has to offer and we try to understand what they're talking about. I'm Professor Matt Brown, Chris Kavanagh is my co-host. Welcome Chris. Now we start the podcast. I forget how my spiel ends like i've just so i've noticed that yeah cognitive decline it's it's horrifying to witness in person but i know i've done it too many times um that's all right that should make it that should make it into non-reflexive memory you should be you know just able to read it off but you would think so wouldn't you yeah you got too comfortable that's your problem you're too relaxed
Starting point is 00:01:13 now that's it that's true before there was a frisson attention now like ah whatever i know i can do with my eyes closed yeah yeah so yeah yeah, I'll tell people why we are here. But first, Matt, I have a little surprise clip to play for you. It's from someone we barely mentioned. So you probably even forget who he is when you'll hear it. But let's see if you can work out who it is and what the issue is with this clip i'll i'll keep it very vague for you so just here you go okay all right a test um but there's a piece of the story that haunts me um and it will probably sound arrogant for me to describe it but i'm going to do it anyway because it's later than we think. You'll remember that in the
Starting point is 00:02:08 Hitchhiker's Guide, the Earth is actually a sophisticated computer designed to discover the meaning of life, the universe, and everything. After the initial computer that was designed to do this after, I think, thousands of years, spit out an insane answer, which was 42, which didn't mean anything. And then when asked to explain it, it said, well, what was the question? So the Earth was the 2.0 version of the investigator for what is the meaning of life, the universe, and everything. And as you will recall, the computer actually produced its result. The earth did figure out what the meaning of life, the universe, and everything was in the form of a young woman on whom it dawned. And she picked up the phone to convey the answer at the exact moment that the Vogons destroyed the place.
Starting point is 00:03:07 So anyway, the point is the earth spits out the answer, but we still don't know what it is because lo and behold, it was destroyed at exactly the moment that the answer was ready to be delivered. I feel a little bit like I might be the young woman in that story because I believe that actually evolutionarily, I do know what the next thing is supposed to be. And it isn't that complex. And it's, um, we describe it.
Starting point is 00:03:39 Heather and I, in our book, in the last chapter, it's called the fourth frontier. There we go. did you recognize that figure brett weinstein get your dirty hands off that book hitchhiker's guide to the galaxy is not your play thing you cannot use it you're banned it's too good for you the least of his crimes though is there's a couple of bits where his description goes slightly awry from the plot. I think he got the broad contours right.
Starting point is 00:04:07 Yeah, he probably got it right. I didn't like how he said that the computer, after delivering the answer of 42, said, what was the question? As if it had forgotten it or something. That's not right. Yeah, it was designed to provide the answer. That was the thing, And it gave an answer.
Starting point is 00:04:25 But then the issue is, well, how do you interpret just 42, right? Like, so. Yeah. But, yeah, so there's a little dimension on our garometer. And, well, which one is it? I was going to say Cassandra, but it kind of is. Yeah. It's basically he has the secret, the riddle that unlocks the future he knows it just
Starting point is 00:04:48 like the young lady in the hijackers god of the galaxy but unfortunately isn't able to tell anyone about it yeah an amazing display of hubris there chris brett has excelled himself yeah so the important thing from brett's perspective is she is the person provided the most important information in the universe right and that she tragically is ignored or you know faces calamity because of what the Vogons are doing and that kind of thing so brett is saying he feels a bit like the most in insightful person in the universe like he says it's it's gonna sound a bit arrogant it's not a bit arrogant that's like that has just smashed the wheel of the narcissism measure in the garometer it spun around so many times it came off the hinge yeah i mean brett brett and heather both really do believe that their insights into evolutionary
Starting point is 00:05:52 biology means that they can understand everything everything that happens in the world whether it's covert or ukraine or israel you it. He obviously famously explained the German invasion of Russia during World War II in terms of evolutionary biology. So, yeah, it really is quite amazing. No normal evolutionary biologist would think that, that you could riddle out conundrums in modern history and politics using evolutionary biology. So it's galaxy brainness as well, I guess, isn't it?
Starting point is 00:06:30 Yeah, yeah. So he gets some things wrong about the pot. That's a sin. And perhaps more significantly, he draws a parallel between himself and the most insightful person in the entire universe yeah i think i think one of the reasons um douglas adams chose a young lady to be almost a christ-like figure like he explicitly compares her to jesus christ right he basically figured it all out but jesus christ had to get nailed to a cross unfortunately but she'd figured it out no
Starting point is 00:07:03 one has to get nailed to a cross yada y But she'd figured it out. No one has to get nailed to a cross, yada, yada, yada. But I think he chose a young woman because rather than, say, a middle-aged man and an academic. A evolutionary biologist. Yeah, because the sort of joke in Hitchhiker's Guide is that, like, she really had figured it out. Like, she wasn't deluding herself. She wasn't just full of hot air.
Starting point is 00:07:24 But, yeah, that doesn't apply to brett no no so yeah i thought this was up your alley because you know the theme music for the show has a little hitchhiker's trying to add your username on twitter obviously fond of it so thought this would get you in the fields and again this is a clip from bad stats worst crossover ever chris worst crossover ever hitchhiker's guide to the galaxy exists in a part of my mind that is unsullied by the tawdry goings-on of the gurus so thank you brett for that um yeah yeah what will what depths will he plumb next who can tell it's uh it's always a surprise well i'm really loving
Starting point is 00:08:04 succulents at the moment so if any of the gurus start talking about succulents i'll be very upset oh this this is a good time to unveil our revolutionary theory about the secular gurus some of them at least and why they might be particularly appealing in a sense to to yeah yourself and me why can we withstand them i think these are slightly different because in some respect matt and i are slightly different in our characters you may not have noticed but i probably have a greater tolerance and appetite for consuming people's nonsense or that kind of thing like i can tolerate that more than most people including matt and it's helped by the fact that i can listen to things
Starting point is 00:08:52 at like two and a half times speed that makes a difference so but you have been listening to garth merengue's or watching garth merengue's dark Dark Place and consuming a kind of British dark comedy, cringe comedy, Alan Partridge, The Office, Garth Marenghi's Dark Place, this kind of... Yeah, imagine if Alan Partridge was Stephen King. That's Garth Marenghi. And he's also written a book called Terratome. Best listened to as an audiobook, highly recommended.
Starting point is 00:09:21 Just like in the TV series, it commits every sin of terrible terrible horror fiction genre fiction so but the fun thing about these characters and i think the reason why you and i both like them is that the humor is all character based alan partridge garth the idea is is that they are this arrogant, you know, what's the word? What are our gurus? What do we call them? They're always narcissists.
Starting point is 00:09:48 That's right. Narcissists, like totally lacking in self-awareness. And that's where a lot of the humor comes from. And they're kind of pompous, middle-aged men who believe that their insights are being ignored. Typically, not all of them, but this is a common theme in that kind of character study. And they're like tragic comic figures
Starting point is 00:10:11 because they regard themselves with such self-importance and gravitas. But you as the viewer can see that it's a very insecure and needy personality. And yeah, there are clear parallels there in some of the people we cover. Yeah. And I think the other thing I like about that humor is that I think all of us can detect, I think that the best character comedies win is when you can detect a little bit of
Starting point is 00:10:41 that in yourself, you know, like lot of british humor is like that right it's that cringe kind of thing like um the office for instance you know the character in the office yeah um we sort of wince and and we hate the idea of that others might see us like the audience sees yeah yeah peep show is another one which captures this quite well, you know, gives the internal monologue of the characters. And yeah, that's one where I can see various parallels. Yes. Too many, too many parallels with my life, Chris. So good.
Starting point is 00:11:16 So good. The gurus are basically all of that comedy, but none of the appealing aspects. Like they have no redeeming features. comedy but but none of the appealing aspects like they have no redeeming features we actually noted that the fictional versions that are enjoyable to consume if they did what the actual secular gurus did it would be too broad the company would seem like too on the nose right well i'll say that i think the thing that sets alan partridge apart from characters like that is that it's not superficial it's not two-dimensional like there are there are layers to alan partridge's character it isn't simply that he's whatever politically incorrect or something
Starting point is 00:11:56 it's more interesting than that you know he understands about political correctness and he wants to be politically correct and he sometimes succeeds and sometimes fails because he doesn't quite get it but he's not a total caricature you know there are there are layers to him and some of them are kind of appealing layers and many of them are totally cringeworthy and awful and yeah it's a great it's a great mix so i'd call characters like that deep garth merengue that character is a bit more broad it's a bit more straightforward like government he does compare himself to jesus christ like brett weinstein just sort of did there really um and that's funny too but yeah yeah he's like a
Starting point is 00:12:36 an arrogant horror writer making like 80s slasher and pulp horror but regarding it as a high art form discussing you know the plants turning into carnivores as a metaphor for a capitalist society and all this so yeah there was a great there's a great quote from him which was uh i've met writers who use subtext and they're all cowards yeah so it's just to say that those characters often have redeeming features that the actual guru people lack but they you know they maybe they're perfectly nice in their personal lives or whatever but like a when you can set up the narrative so that ultimately the character you know has some kind of self-awareness or whatever that doesn't actually tend to happen like our girls tend to become worse and become openly anti-vaccine or hard right apologists and stuff so yeah yeah reality is worse i think i think gad sad is probably the
Starting point is 00:13:36 one that approaches fictional characters more than any other simply because he is so obviously bunging it on sometimes transparently and sometimes apparently in earnest but it is still obviously an act um so a shtick yeah except he's except he's not funny yeah that's the that's the killer that's the killer And he's not a fictional character, unfortunately. But, oh yeah, Matt, one more thing. Just one, one more thing I need to mention. I know that you like history podcasts and you like to hear factoids and repeat them. So I'll just mention that I was listening to The Rest is History
Starting point is 00:14:22 and I went back into their back catalog and was listening about the Easter Rising, you know, Irish independence movement. Very interesting about the Hollywood Dublin, Dublin Wood story, you know, the fairytale version of it and the actual complexities of all the groups involved and their levels of support and how the events went and you know now how they are immortalized but how they were perceived at the time so it was very interesting so just and the takeaway was history's always more complicated always more complicated than a hollywood movie who would have thought i i remember i remember the most astonishing factoid i think i learned about that was that they like a an english warship like shells oh yeah yeah i remember when i first
Starting point is 00:15:12 heard about that i didn't actually know much about all that stuff i was like what like to my mind it was like an english warship is shelling newcastle or something like it just just didn't seem it's also an interesting case alone like because it's sort of utterly failed it wasn't a very well conducted uprising and it was actually cancelled by half of the uh participants the people that were supporting it because the whole shipment of arms from the kaiser were intercepted and and uh then they weren't going to go ahead with it but they went ahead with it anyway and it kind of went to shambles and but the thing is Matt that as the historian pointed out when describing that even though they go to shambles and that the
Starting point is 00:15:57 narrative is they were executed and that is what completely changed everything but you don't just get that from like a dozen executions or so there has to be latent sympathy and uh that as a catalyst so the the narrative is a bit too simple in either way if you want to say like they didn't have any popular support or they they had complete support so yeah it's all mixed and uh yeah and ireland wouldn't have been able to have a mass independence movement if that sentiment wasn't at least fermenting in the general populace so anyway interesting thing it's you know we learned about history and there was an Irish historian there, representation for my Southern Irish. Southern Irish people.
Starting point is 00:16:50 So there we go. Do the Southern Irish think of you guys as properly Irish or are you kind of a little bit... Oh, you're opening a can of worms there. That's a long-standing dispute. It depends on the Southern Irish, I guess, that you ask. But there are... There are degrees of parochialism, I assume.
Starting point is 00:17:10 Yeah. Really, do you ask a bastard or a reasonable person? The way that you go about it. But no, I will say that the general dynamic is Northern Irish Catholics might have a little bit of a chip on their shoulder about being authentically Irish. And the Southern Irish might have a tendency to dismiss the people in the North as not properly Irish. And this creates friction with the Northern Irish saying, we are up here defending the unified Ireland, the ireland this argument that's right that's right you were left in the lurch and you leave us you agree with the oppressors yeah that's the dynamic
Starting point is 00:17:54 that tends to go down so i'm imagining a australia new zealander type relationship that makes sense they got a chip on their shoulder too yeah i can tell you a funny story about that but maybe i'll do it off air involving young chris in a southern irish town and too many alcohol now set aside that that whole kerfuffle and let's turn to the topic for today now it's fair to say that you have been taken to this topic, the subject for this podcast this week, at my urging. You were a little bit unenthusiastic to cover this topic, it can be said. But I think you will change your tune as you realize through the decoding,
Starting point is 00:18:44 all of the things that you noticed which you didn't realize were so insightful and i'll tease it out to you it's fine it's fine i'm accustomed to this now i know he wears the pants in this podcast you're like don't worry about it'll be great it'll be great you'll see you'll see it i'm like okay yes you'll be a star man you'll be a star hey your name will be up yeah and well i will say that the reason that you're not enthusiastic i think is partly because on the one hand you watch things at times one speed so when we cover something which is like two hours long it is two hours for you it ultimately adds up the same for me because i have to watch it multiple times to remind myself by the time you get around to watching it so and then i have to clip it at times so anyway who
Starting point is 00:19:30 suffers more it's unclear it's unclear but it is journal club with dr peter atia and andrew huberman met foreman for longevity and the Power of Belief Effects. And it's from a month ago. So it's an episode that was out on Huberman's feed and Addy's feed, a kind of crossover. Yeah, so they're doing like what we do on Decoding Academia, talking about some journal articles. And now we're going to be decoding their decoding of the academic articles. I mean, it sounds riveting already. I could tell well look matt
Starting point is 00:20:06 listen up i i hear what you're saying but one thing is that like we've covered huberman but we only covered like a 15 minute segment thing about you know grinding this is longer form huberman and it's kind of an episode where he's presenting what I think you could say is like his better aspects, looking at studies, digging into research and talking about the ways that you can critically examine papers. So if you thought that us covering him when he's discussing grounding was a bit unfair, this would seem to be a better piece of content, potentially, right? Sure, yeah. And Peter Adia, we haven't covered him.
Starting point is 00:20:51 Who's he, Matt? You don't know anything about him, do you? If I asked you. He is a medical doctor, Johns Hopkins trained physician, but also more commonly known, I think, for his optimizer health diet recommendations. He's in that whole framework and space, the same place Huberman is, the same place a lot of the kind of health optimizer types are. And we haven't done that much on them except for lex and huberman really is
Starting point is 00:21:28 there anyone else that covers the optimizer kind of area no no one's no um chris williamson kind of yeah he does but he was only incidentally covered by the proximity to god's side so right well well it's true i didn't know anything about about him but i knew that he was in that health optimizer thing just by the size of his pectoral muscles they both have very impressive pectoral muscles um this is right they are both they are both optimized individuals and look very well this is a they a, they practice what they preach. And as we'll see, they genuinely do do that in a whole variety of ways.
Starting point is 00:22:10 But yeah, so there's that, Matt. And my last piece of justification for making you cover this is, as you say, this is a purported journal club. We do something very similar on the Decoding Academia episodes, which are on the patreon and as academics we have sat in on many many journal clubs where people are discussing
Starting point is 00:22:32 papers right so this is a very familiar area for us so i think in that respect it's a bit like when we covered eric and brett talking about you know his desk rejections and stuff. This is very normal for us, but it's not that normal for non-academics. So we can approach it from the point of view of people who are not unfamiliar with this kind of format. Right. So see. Sure. Okay. Makes sense. I'm on board. So the way that this is organized is basically they've both brought a paper with them. They've read it in advance and they're going to discuss it, right? And I'll let them introduce the framing a little bit. So by the end of today's episode, you will not only have learned about two novel sets of findings, one in the realm of
Starting point is 00:23:25 longevity as it relates to metformin and another in the realm of neurobiology and placebos or placebo effects, but you will also learn how a journal club is conducted. I think you'll see in observing how we parse these papers and discuss them, even arguing in them at times, that what scientists and clinicians do is they take a look at the existing peer-reviewed research and they look at that peer-reviewed research with a fresh eye asking, does this paper really show what it claims to show or not? And in some cases, the answer is yes.
Starting point is 00:23:55 And in other cases, the answer is no. What I know is for certain is that by the end of today's episode, you will learn a lot of science. You'll learn a lot about health practices, some of which you may want to apply or avoid, and you'll learn a lot about how science and medicine is carried out. Yeah, that's the pitch. Yeah. Okay. Got any issues? Well, it's broadly fine, but yeah, I think where you and I maybe diverge from
Starting point is 00:24:20 these guys, especially human, is that I don't think it's good advice for people to be reading the primary scientific literature and because you're an academic snob you can read it you can read it but you shouldn't be going okay now i'm going to change my diet and my supplement regime based on this paper that i just read i got that yeah that bit about you know you might have some things that you can apply to your actual life i wouldn't be so keen to recommend that especially you know if you're dealing with just like one or two papers i think the part that you could possibly give them credit for is that they talk about these kind of stuff a lot so maybe they're assuming that their audience is also you know consuming other sorts of stuff and has their regimes already so they're probably gearedness towards an optimizer
Starting point is 00:25:13 audience so yeah i still don't think you should do it but i'm just saying that you know it's not the same necessarily as telling a a normie audience that you're going to get health advice you can follow um but yeah yeah that takes that takes some of the edge off it i think still on principle i mean the kinds of optimizers that are yeah like changing their their regime based on the you know the latest papers that have just come out they're sort of making a mistake to begin with anyway but that's just my opinion that's my opinion it's a different with anyway but that's just my opinion that's my opinion it's a different it's a different world just an opinion that's all right everyone has
Starting point is 00:25:49 them anyway so the two papers a little bit about a more this is still the kind of framing but bit about journal club so here you go you know people probably ask you all the time because i know i get asked all the time hey what are the do's and don'ts of interpreting, you know, scientific papers? Is it enough to just read the abstract? And, you know, usually the answer is, well, no. But the how-to is tougher. And I think the two papers we've chosen today illustrate two opposite ends of the spectrum. You know, you're going to obviously talk about something that we're going to probably get into the technical nature of the assays, the limitations, et cetera. And the paper ultimately I've chosen to present, although I
Starting point is 00:26:27 apologize, I'm surprising you with this up until a few minutes ago, is actually a very straightforward, simple epidemiologic paper that I think has important significance. I had originally gone down the rabbit hole on a much more nuanced paper about ATP binding cassettes in cholesterol absorption. But ultimately, I thought this one might be more interesting to a broader audience. So the point there, you know, it is kind of framing it in the same way that we do, Matt, but, you know, it's useful to think about the way that you might assess the quality of studies, look critically at things. And that's what he's discussing that they're going to do i don't have much issue with
Starting point is 00:27:08 the framing about encouraging people to critically evaluate things although i grant that you should be aware of your limitations when doing that but you know as as saying this is what academics do that's true isn't it yeah that's basically fine i'm not super this is what academics do. That's true, isn't it? Yeah, that's basically fine. I'm not super interested myself in glucose binding and ATP inhibitors and so on. But, you know, each to their own. Each to their own. You've got your history podcasts and your...
Starting point is 00:27:38 Circulants. Circulants, yeah. Neither of which are your academic speciality. And they've got that. yes any i i admire i don't admire might be too strong but i'm kind of glad that he chose a less sexy paper than whatever he was previously considering so you know he says a bit boring but that's good boringness sometimes okay now before they get into the papers map there's just like you know there's there's some other things and i think this is not poisoning the well i just want to point out
Starting point is 00:28:10 a little bit of the dynamic because it will come up in various clips so you need this context adia describes a dream that he had about huberman do you remember this vaguely yeah so yeah you need this because it will come up in various clips so here's his dream about tuberman so i had a dream last night about you and um in this dream you were obsessed with making this certain drink that was like your elixir and it had all of these crazy ingredients in it supplements some tons of supplements in it. But the one thing I remembered when I woke up, because I forgot most of them, I was really trying so hard to remember them. One thing that you had in it was dew. Like you had to collect a certain amount of dew off
Starting point is 00:28:55 the leaves every morning to put into this drink. It was so, it was like, just sounds like something that I would do. And, and so. But here's the best part. You had a thermos of this stuff that had to be with you everywhere. And all of your clothing had to be tailored with a special pocket that you could put the thermos into so that you were never without the special Andrew drink. And again, you know how dreams, when you're having them, seem so logical and real, and then you wake up and you're like, that doesn't even make sense. Like, why would he want the thermos in his shirt like that? Yeah, so I actually think that's a fairly straightforward dream to interpret, because
Starting point is 00:29:37 he is someone that is obsessed with supplementation and various things. Yeah, and natural supplementation in particular so that explains the dew yeah no that's a very plausible dream to have about human i've had dreams about you chris am i doing that am i dancing through the forest i just want to emphasize then there's nothing sexual at all no it was that yeah you were just being you yeah podcast things probably trying to convince me to listen to something i didn't want to and i was going another hooverman episode yeah seven hours no yeah so and i i appreciated hooverman's reaction is good natured like i know
Starting point is 00:30:18 this doesn't bear mentioning it's just people you know having a joke about a dream that they have but it is worth mentioning in the guru sphere because they take themselves so seriously. So to promote these creditors, you know, that does sound like something that we're doing. Yeah, so it's just an amusing little dream. But dreams can be more to them. Oh my. Some other time we can talk about dreams. Recently, I've been doing some dream
Starting point is 00:30:45 exploration. I've had some absolutely transformative dreams for the first time in my life. One dream in particular that has, that allowed me to feel something I've never felt before and has catalyzed a large number of important decisions in a way that no other experience waking or sleep has ever impacted me. this was drug free etc um and do you think you could have had that dream we don't have to get into it if you don't talk about it now but was there a lot of work you had to do to prepare for that dream to have taken place oh yes yeah um at least uh 18 months of intensive um analysis type type work with a very skilled psychiatrist. But I wasn't trying to seed the dream. It was just I was at a sticking point with a certain process in my life. And then
Starting point is 00:31:34 I was taking a walk while waking and realized that my brain, my subconscious was going to keep working on this. I just decided it's going to keep working on it. And then two nights later, I traveled to a meeting in Aspen and I had the most profound dream ever where I was able to sense something and feel something I've always wanted to feel as so real within the dream, woke up, knew it was a dream and realized this is what people close to me that I respect have been talking about, but I was able to feel it. And therefore I can actually access this in my waking life. It was, it was, it was absolutely transformative for me. Um, anyway, sometime I can share more details
Starting point is 00:32:17 with you or the audience, but for now we should talk about these papers very well. Um, who should go first? Yeah, that's wild. Not to be. I mean, that's fine. I mean, but Chris, are all Americans like this? Like Americans talk like this. Some of them do anyway.
Starting point is 00:32:36 They're not. They're not. They're not all. To be fair, an American I once dated did ask me various questions about dreams. It was important. Like what colors I dreamed in and stuff. And it's like, I don't know, general, normal colors. But in any case, this is not the cast aspersions of all Americans, because I think here, I just want to highlight,
Starting point is 00:32:56 like there's a little bit of mysticism to Huberman, right? Like that's talking about 18 months of presumably some kind of psychoanalysis therapy that allowed him to have a breakthrough in a dream setting that, you know, is going to transform his life and make all these important decisions of the basis of that's, you know, that's something of a kind of Jordan Peterson-esque approach to things. I know, but it's also a little bit American. Like there is a culture in America of seeing a psychiatrist regularly, even when you are really perfectly psychologically well. That's not a cultural thing in Australia. People don't see psychiatrists. I know.
Starting point is 00:33:40 We're all repressed in the non-American Anglosphere. That's right. We just push those feelings down and drink more. That's how we handle it. It works fine. But Americans are built differently. And they're a lot more prone to be talking about an issue that they've been mulling over with their psychiatrists and then having revelations and so on.
Starting point is 00:33:59 I don't know. Australians don't get revelations like that. But it's fine. It's a different culture is what i'm saying chris if i were to interpret that matt i might think it relates to his disclosure on the lex friedman about having a religious experience and becoming spiritually inclined so he referenced people he respects talking about experiences that he couldn't properly comprehend so perhaps an encounter with the divine or you know i don't know could be the cosmic dwarfs that control the universe that you usually can only contact through dmt could be them who knows but then in any case i'm just pointing out there's that vibe as well
Starting point is 00:34:39 because like now we're going to get into the hard node science right but it's the um yeah there's a crunchy vibe there yeah i know But it's the, just before that. There's a crunchy vibe there. Yeah, I know. Yeah. It's at the intersection between sort of psychiatrist culture, therapy culture, and yeah, spiritual type culture. I don't know.
Starting point is 00:34:56 Where's he from? Is he from California or somewhere else? Who knows? He's at Stanford. So presumably somewhere around there. I don't know. Do Americans ever travel to places that they weren't born in? I don't know. I don't know what they do. So, yes, the first paper, Matt, this is Addy's pick goes first. OK, and here's a little bit about the framing of this paper. This is a pretty straightforward paper. So so we're going to talk about a paper titled Reassessing the Evidence of a Survival Advantage in Type 2 Diabetics Treated with Metformin
Starting point is 00:35:30 Compared with Controls Without Diabetes, a Retrospective Cohort Study. This is by Matthew Thomas Keyes and colleagues. This was published last fall. all. Why is this paper important? So this paper is important because in 2014, Bannister published a paper that I think in many ways kind of got the world very excited about metformin. So this is almost 10 years ago. And I'm sure many people have heard about this paper, even if they're not familiar with it, but they've heard the concept of the paper. And in many ways, it's the paper that has led to the excitement around the potential for Giro protection with metformin. So this paper, and part of the reason I kind of like this, Matt, is that it's a, as he describes, a paper looking at a previous finding and reassessing it, right? Some people that claim that there is a drug usually used to treat diabetes that seems to have a potential
Starting point is 00:36:34 life-extending property for non-diabetic people. And you can see why the optimizers and anti-aging community would be interested. Longativity, I think that's what they're, I can't remember how they describe themselves, but that whole against in essence. Yeah, life extension. Life extension. Yeah, those guys. There are a lot of rationalists hovering around the meetings in the corner with yudkowsky's fedora floating around so yes yeah you know the type yep but i guess it is a relatively common thing isn't it often they find
Starting point is 00:37:13 that a drug that's been used for something turns out to you know have these side effects which are like good side effects um so yeah yeah that's not unusual not unusual and um next clip is about describing the potential mechanism of metformin and i wanted to include this matt to just point out that this does get like pretty technical at various points and i i get the impression from the way that adia speaks and and huberman as well that they they know what they're talking about. They're very familiar with the terms, but it's not the kind of thing that I think if you were half listening to, that you would be able to follow that well. And I think a little bit of it, at least a little bit of the way that they're going to talk about it is presenting how much they know these subjects.
Starting point is 00:38:02 Maybe I'm being a little bit unfair, but just listen to this description. The mechanism by which metformin works is debated hotly. But what I think is not debated is the immediate thing that metformin does, which is it inhibits complex one of the mitochondria. So again, maybe just taking a step back. So the mitochondria, as everybody thinks of those as the cellular engine for making ATP. So the, maybe just taking a step back. So the mitochondria, as everybody thinks of those as the cellular engine for making ATP. So the most efficient way that we make ATP is through oxidative phosphorylation, where we take either fatty acid pieces or a breakdown product of glucose. Once it's partially metabolized to pyruvate. We put that into an electron transport chain, and we basically
Starting point is 00:38:46 trade chemical energy for electrons that can then be used to make phosphates onto ADP. So it's, you know, you think of everything you do. Eating is taking the chemical energy in food, taking the energy that's in those bonds, making electrical energy in the mitochondria. Those electrons pump a gradient that allow you to make ATP. Got it? Yeah, that was pretty good. No, it was. I will say this. I think if you're immersed in this world, that's a little bit second nature. But also, to Adia and Huberman's credit, they're very good at communicating complex ideas and like kind of doing it in the technical way and then they stop and break it down and one way they do this is one asks a question of the other one to you know okay so can you clarify what you said there and they're really good at it i think this
Starting point is 00:39:39 is part of the reason that people like their content right right? Because you get both the apparent technical depth and you get the layman descriptions, right? So you can, I don't know, feel a little bit like you're listening in on the technical discussion, but you're still able to follow. I have an example of that dynamic. One question, is it fair to provide this overly simplified summary of the biochemistry, which is that when we eat, the food is broken down, but the breaking of bonds creates energy that then our cells can use in the form of ATP and the mitochondriaiting the energy production process. And so even though we are eating, when we have metformin in our system,
Starting point is 00:40:28 presumably there is going to be less net glucose. The bonds are going to be broken down. We're chewing, we're digesting, but less of that is turned into blood sugar, glucose. Well, sort of. I mean, it's not depriving you of ultimately storing that energy. What it's doing is changing the way the body partitions fuel. That's probably a better way to think about it to be a little bit more accurate. That's good, right?
Starting point is 00:40:56 Isn't it? Huberman saying, okay, so what you're saying is this accurate? And then giving Addy a time to kind of say, well, that's not exactly, you know, let me change it a bit. And yeah, I thought we could learn. They do it very well. Like this is quite impressive in the way that, I mean, the professionals at this for a reason. But that's good science communication, I think.
Starting point is 00:41:21 Yeah. Yeah. Like, you know, you can compare it to the way brett and heather do science communication where there's just layers and layers of abstraction and blather whereas you know these guys are talking in concrete terms and yeah i think they did well at least as far as i could tell you know i can't tell if they're describing atp wrong or right sounded right to me yeah and i'm gonna play one more clip that i think is good because i genuinely think I can't tell if they're describing ATP wrong or right. Sounded right to me. Yeah.
Starting point is 00:41:49 And I'm going to play one more clip that I think is good because I genuinely think Adia is good at this. So this is him talking about the process associated with diabetes. And again, get a fair amount of medical jargon or biological jargon, but explained nicely, Matt, the kind of thing Eric never does. So again, what's happening when you have type 2 diabetes? The primary insult probably occurs in the muscles, and it is insulin resistance. Everybody hears that term. What does it mean? Insulin is a peptide. It binds to a receptor on a cell. So let's just talk about it through the lens of the muscle, because the muscle is responsible for most glucose disposal. It gets glucose out of the circulation. High glucose is
Starting point is 00:42:28 toxic. We have to put it away and we want to put most of it into our muscles. That's where we store 75 to 80% of it. When insulin binds to the insulin receptor, tyrosine kinase is triggered inside. So just ignore all that, but a chemical reaction takes place inside the cell that leads to a phosphorylation. So ATP donates a phosphate group. And a transporter, just think of like a little tunnel, like a little straw, goes up through the level of the cell. And now glucose can freely flow in. So I'm sure you've talked a lot about this with your audience. Things that move against gradients need pumps to move them. Things that move with gradients don't. Glucose is moving with its gradient into the cell. It doesn't need active transport, but it does need the transporter put
Starting point is 00:43:15 there. That requires the energy. That's the job of insulin. I understand insulin now. I feel like it reads in the metrics. matrix but that was and again not qualified to judge seemed like he was doing i know like so this you know we are not mindless haters i'm actually highlighting this to say i think this is pretty good i think this is why people like adia and huberman because this is the stuff that they do which actually if you listen to a proper academic who isn't good at science communication they could explain the exact same process and it would make no sense and they wouldn't factor in that people aren't going to follow along so they they add in the little descriptions to kind of keep you going along and i i think they pitch it
Starting point is 00:44:02 at generally the right level but it is clear that they're really comfortable talking about this kind of stuff so you know it it isn't really that difficult for them and matt you know we were saying that maybe people can't put things into practice that they hear here or maybe they shouldn't i just did want to note there was a bit of bad news related for me here, maybe some health advice. But there are other things that can cause insulin resistance. Sleep deprivation has a profound impact on insulin resistance. I think we probably talked about this previously.
Starting point is 00:44:33 But if you, you know, some very elegant mechanistic studies where you sleep deprive people, you know, you let them only sleep for four hours for a week. You'll reduce their glucose disposal by about half. Wow. Which is, I mean mean that's a staggering amount of you're basically inducing profound insulin resistance in just a week of sleep deprivation fucking hell this is terrible and you've had some blood tests done haven't you you don't need to tell us yeah so it's like oh my god yeah so see look what they're giving me we cover the girls they give me actionable health advice but yeah anyway i already knew
Starting point is 00:45:11 you're supposed to sleep longer than i currently am but let's you know just yeah i'll then enjoy hearing that so thank you peter had information um you might recall me, Chris, often recommending you just go home, go to sleep, get a good night's sleep for God's sake. And you're like, yeah, yeah, yeah, Matt. You think you're built out of cast iron steel, but you're a human just like the rest of us. You need to sleep. So well, so it turns out if I did that,
Starting point is 00:45:41 I just imagined the human I could be. Imagine the blood test I could get if I slept eight hours but I actually related to this but this is from much later in it there was a a discussion it's it's kind of comes later but they're talking about uh who comments binging tendencies but anyway Addy has said something which again I think endorses something that you've been talking about your kind of humans are rats thesis. So listen to this clip and we'll see if you think it endorses your worldview. I can imagine a scenario where a person could be in a negative energy balance,
Starting point is 00:46:15 eating Twix bars all day and drinking, you know, big gulps. But I also don't think that's a very sustainable thing to do, because if by definition, I'm going to put you in negative energy balance consuming that much crap, I'm going to destroy you. Like you're going to feel so miserable. You're going to be starving, right? You're not going to be satiated eating pure garbage and being in caloric deficit. You're going to end up having to go into caloric excess. So that's why it's an interesting thought experiment. I don't think it's a very practical experiment. For a person to be generally satiated and in energy balance,
Starting point is 00:46:48 they're probably eating about the right stuff. But I don't think that the specific macros matter as much as I used to think. I'm a believer in getting most of my nutrients from unprocessed or minimally processed sources, simply because it allows me to eat foods i like yeah and more of them and i just love to eat i i so physically enjoy the sensation of chewing that you know i'll just eat cucumber slices for for fun yeah right you know that's i mean that's not my only form of fun fortunately um so they there was it was sandwiched there with some things which you haven't advocated for like consuming crap at a caloric deficit being a good thing but yeah you know you have argued the macros are not that important it is calories and right that ultimately matter and they kind of mention that hooverman doesn't agree with you he likes you know organic jew drenched food he nibbles on organic cucumbers
Starting point is 00:47:53 for pleasure yeah yeah yeah definitely on the idea side of this one where um i just i do think people are rats and you know it's surprising how you know people get by pretty okay even if they're not super optimizing with regard to the micronutrients or whatever and you know if you basically eat a bunch of different things you know you're not eating twix bars and big gulps and you don't eat too much then you can forget about it you know it's you're probably fine yeah so i'm gonna go back to the idea paper here and he's talking about the the old paper the one from 2014 and some issues that might make it the finding that it was healthy more questionable or that metformin would have general life extension properties. So the way the study worked is if you were put on metformin, we're going to follow you.
Starting point is 00:48:52 If you're not on metformin, we're going to follow you. And we're going to track the number of deaths from any cause that occur. This is called all cause mortality or ACM. And it's really the gold standard in a trial of this nature or a study of this nature or even a clinical trial. You want to know how much are people dying from anything because we're trying to prevent or delay death of all causes. Informative censoring says if a person who's on metformin deviates from that inclusion criteria, we will not count them in the final assessment. So how are the ways that that can happen? Well, one, the person can be lost to follow-up. Two, they can just stop taking their metformin. Three, and more commonly, they can progress to needing
Starting point is 00:49:38 a more significant drug. So all of those patients were excluded from the study. drug. So all of those patients were excluded from the study. So think about that for a moment. This is, in my opinion, a significant limitation of this study. Because what you're basically doing is saying, we're only going to consider the patients who were on metformin, stayed on metformin, and never progressed through it. And we're going to compare those to people who were not having type 2 diabetes. So, you know, I thought that was a good thing describing the particular, I can't remember what it's called, information censoring or something like that as a significant limitation properly highlights why that could be an issue and give you a misleading perspective and flagging it up as a limitation that's that's good isn't that it's very good uh i like these methodological details it's uh it's a big issue with longitudinal studies um your data is censored for various reasons um sometimes
Starting point is 00:50:39 at the researcher's discretion sometimes not like with dropout. So it's good that he talks about it. This is just riveting, Chris. We're listening to people talking about a very technical academic article, and it's fine. It's all fine. It's fine. Look, it's going to get – trust me, we're not on Huberman's page. So, well, you're really going to like this.
Starting point is 00:51:02 So that was him describing the finding from that 2014 paper. Here's him emphasizing it in the science communication way that I've highlighted. Type 2 diabetes on average will shorten your life by six years. I see. So that's the actuarial difference between having type 2 diabetes and not all comers. But you're right. This is not a huge difference. It's only a difference of a little less than one year of life per thousand patient years studied. far worse crude death rate. And the fact that it was statistically significant in the other
Starting point is 00:51:46 direction, and it turned out on what's called a Cox proportional hazard, which is where you actually model the difference in lifespan. The people who took metformin and had diabetes had a 15%, one five, 15% relative reduction in-cause death over 2.8 years, which was the median duration of follow-up. Well, that seems to be the number that makes me go, wow. Yeah. Right? That because, could you repeat those numbers again? Yeah.
Starting point is 00:52:17 So 15% reduction in all-cause mortality over 2.8 years. That's a big deal. Yeah. So there, Matt, i'm highlighting the science communication dynamic right of like you know tell me those figures again right but also the reason that that initial banister at all study got attention was because of this right like they're they're finding 15 relative reduction in in death that's a big reduction right so you can you can see huberman's like antennas go up yeah 15 less likely to die yeah
Starting point is 00:52:54 that's it's good i mean that that is is that a big effect chris i'm not no i think yeah it has to all be counted into, it is significantly qualified by the way that they've compared the populations and all that. So yeah, I think he does highlight before, it depends what way you look at it, but this is the kind of result that had people at least a little bit exercised. And highlighting the type of audience that they have. You know, we sometimes
Starting point is 00:53:26 point out when people say people ask me these kind of questions a lot or whatever, they do mention this. Fast forward until a year ago, and I think most people took the Bannister study as kind of the best evidence we have for the benefits of metformin. And I'm sure you've had lots of people come up to you and ask you, should I be on metformin? Should I be on metformin and i'm sure you've had lots of people come up to you and ask you should i be on metformin should i be on metformin i mean i probably get asked that question almost as much as i'm asked any question outside of do i mean people definitely want to know if you should be consuming do but but after that it's metformin fresh off the leaves has to be while viewing morning sunlight yeah so you wouldn't cut that joke ma if Matt, if I played the dream one. Good thing you played the thing about the dream at the beginning.
Starting point is 00:54:11 To keep that context. But, you know, there, Matt, how often are our audience asking us for advice about Metformin? It's the frigging question that comes up all the time on the Patreon, you know. So I know this is their particular thing, I'm on the Patreon, you know, what should we do? So I know this is their particular thing, but I'm just noting that obviously this was a big deal in the longevity community. If this is your second most common question or whatever it is,
Starting point is 00:54:34 and it's on the basis of this, primarily this banister at All Study, like I am thinking that this seems very flimsy evidence to make that such a big deal. But, you know, that's what their audience are there for. They want these hacks that are going to give them 50% reduction and like some metric about mortality that, you know, might be significant for them. So, yeah.
Starting point is 00:54:59 Yeah. Yeah. That's the dream to live till 105 with huge pectoral muscles. It's a good dream. Yeah, it's the dream, to live till 105 with huge pectoral muscles. It's a good dream. Yeah, it's a good dream. So just a note here as well that kind of ties into the naturalism aspect as well as the optimizer bit. So there's an aside a little bit earlier where Huberman is talking about
Starting point is 00:55:23 his own kind of dalliances around these kind of chemicals or things which might cause that effect of metformin. Metformin tackles the problem elsewhere. It tamps down glucose by addressing the glucose, the hepatic glucose output channel. GLP-1 agonists are another drug. They increase insulin sensitivity, initially causing you to also make more insulin. So that's Ozempic? Yes. Yeah. And is it true that berberine is more or less the poor man's metformin? Yeah. Okay. It's from a tree bark. It just happens to have the same properties of reducing mTOR and reducing blood glucose. Yeah. And metformin, by the way, occurs from a lilac plant in France.
Starting point is 00:56:05 Like that's where it was discovered. So it's also, metformin is also based on a substance found in nature. So you need a prescription for metformin. You don't need a prescription for berberine. Correct. But yeah, we can talk about berberine a little bit later. I had a couple great experiences with berberine
Starting point is 00:56:18 and a couple bad experiences. I just noticed that, again, the kind of, you know, it comes from a tree bark oh this one comes from a lilac plant that's important right it's not purely synthetic because presumably that would be worse and uh and that huberman so this is our first mention of a substance that huberman is taking berberine which he says is the poor man's version of metformin and is available without a prescription so was it the berberine that he had a couple of good experiences and a couple of bad experiences with yeah and he'll return to that later this is what we call in the
Starting point is 00:56:57 uh what the fuck i forgot the word what do you call it when you plant something that will come back later uh um it's not priming god damn it man damn you is it a word oh it's on the tip of my tongue foreshadowing foreshadowing i had it exactly i got that no i had it foreshadowing foreshadowing another clip that we i mean this is a super mild thing it's not even a criticism but you know the little the little ways in which it does deviate from you know like a normal academic journal club is the working in of the personal lived experiences of hoobman in that case where it's kind of relevant that he's been taking this and he had some good experiences and bad experiences and and that's kind of weaved into the scientific evidence
Starting point is 00:57:50 um so you know it's a small observation what you could just say it's keeping it personal keeping it real um adding a bit of flavor um but i don't know it just does demark a slight difference well i think the difference that you're talking about a bit is not injecting personal references because I think that just naturally happens in this kind of long-form podcast, but it's more the self-experimentation aspect of it, right? Because like Hubert was just saying,
Starting point is 00:58:19 you know, this study I read at first when I was taking my cat out to the vet or whatever, you know, that's just, what you're just talking about. But it's this element of their personal experiences being tied into the way that you assess this literature, right? Yeah, that's right. Yeah. So Journal Club, Matt, they're actually up to now have been talking about the background.
Starting point is 00:58:45 They haven't been talking about the individual paper. This is the paper before the one that Adia is focused on. And actually, just one last thing, to be fair to Mr. Huberman, I've mainly played Adia doing good science communication. I think this is Huberman doing a little bit of good science communication. I'll just play an example of it. I'm sort of rusty on my neuroscience, but an action potential works in reverse the same way. Like you need the ATP gradient to restore the gradient, but once the action potential fires, it's passive outside, right? Yeah. So what Pierre's referring to is
Starting point is 00:59:22 the way that neurons become electrically active is by the flow of ions from the outside of the cell to the inside of the cell. And we have both active conductances, meaning they're triggered by changes in the gradients, by changes in electrical potential. And then there are passive gradients where things can just flow back and forth until there's a balance equal inside and outside the cell i think what's um what's different is that there's some movement of a lot of stuff inside of neurons when neurotransmitters like dopamine binds to its receptor and then a bunch of you know it's like a bucket brigade that gets kicked off internally but it's not often that you hear about receptors getting inserted into cells
Starting point is 00:59:59 very quickly normally have to go through a process of of you know transcribing genes and making sure that the specific proteins are made and then those are long slow things that take place over the course of many hours or days what you're talking about is a real on-demand insertion of a channel and it makes sense as to why that would be required but it's just oh so very cool was that okay you're the neuroscience expert what's your grade for that yeah it's it's the intersection of what i know about this stuff and what he knows that bit sounded totally fine i think it is true that axon potentials are once they get going they just they just go they don't need sort of active support um i never really learned about how like the neural cell actually regenerates its energy in terms of like these guys are interested in ATP and how cells get energy to be stronger and so on.
Starting point is 01:00:53 Whereas psychologists don't care about that. We just go, okay, this is what it did. The support system to keep the actual cells alive is sort of not something we care about. A telling difference. So you're learning something. That's what you're telling me. Uberman's giving you new information. Well, I didn't really follow the other bits, his explanation, but it sounded good.
Starting point is 01:01:16 It just sounded like it's probably just me being stupid. Okay. Well, if you are an expert in this, you can let us know. Did Uberman do good or was he terribly wrong? Sounded okay to me. Yeah, sounds fine. See, you Huberman haters on Reddit, you got Huberman all wrong. He's fine.
Starting point is 01:01:35 It's great. We'll see. Let's move on. Oh, we were talking about self-experimentation. We saw Huberman talking about his barbering or whatever it is. So Adia is in on this too, Matt. Let's just make that clear. So maybe taking one step back from this.
Starting point is 01:01:55 In 2011, I became very interested in metformin personally, just reading about it, obsessing over it, and just somehow decided, like, I should be taking this. So I actually began taking metformin. I still remember exactly when I started. I started it in May of 2011. And I realized that because I was on a trip with a bunch of buddies. We went to the Berkshire Hathaway shareholder meeting, which is the Buffett shareholder meeting. And it was kind of like a fun thing to do. And I remember being so sick the whole time because I didn't titrate up the dose of metformin. I just went
Starting point is 01:02:30 straight to two grams a day, which is kind of like the full dose. And we went to this. Is that characteristic of your approach to things? Yes. I think that's safe to say. Next time I'll give you a thermos of this dew that I collect in the morning. Oh, really? next time i'll give you a thermos of this dew that i collect in the morning so i remember being so sick that the whole time we were in nebraska or omaha i guess i couldn't we went to dairy queen because you do all the buffett things when you're there right like i couldn't have an ice cream at dairy queen you couldn't i mean i couldn't i'm so nauseous
Starting point is 01:03:01 again the dewey came in just pointed out again it was worth investing in that do clip um otherwise everybody's saying what's all this do about but uh so adia is interested in metformin before the banister at all paper self-experimenting apparently with a high a high dose immediately which caused bad reactions but's actually, it's that thing that he's dosing himself on this, you know, purely experimental treatment, right? But enough that he doesn't mind being extremely nauseous at a conference. So, yeah, this is the first sign about the self-experimentation kick that they're both on.
Starting point is 01:03:48 about the self-experimentation case that they're both on um so yeah so why remind me why would why is he taking metformin like why would he have been taking metformin to live longer to reduce his chance of 15 percent geroprotection or whatever they call that thing yeah life extension so presumably there were some indicators that it might be useful outside of diabetics before the banister study um so it's just an odd i just don't get it like like i rate my chance of death in the next five years as being extremely low so i'm not going to make myself nauseous to reduce that by 15 like yeah what's the thinking i don't get it it's a different well matt listen listen here you go i can let him answer for you but regardless that's the story on metformin there were a lot of reasons i was interested in it um i wasn't thinking true giro protection that term wasn't in my vernacular at the time
Starting point is 01:04:46 but what i was thinking is hey this is going to help you buffer glucose better it's got to be better and this was sort of my first foray into you know self-experimentation buffering glucose better that's just not something that's on my list of priorities yeah and um a gyro protection right that's what he said. It wasn't in his vocabulary. It's not in my vocabulary. It is now. Yeah, so geron as in gerontology, geriatric protection against being old.
Starting point is 01:05:16 I see. Yeah, like gerontocracy or whatever it is. So we've got Huberman on his poor man's metformin. Adia is ahead of the curve, doxing himself to the state of nausea on metformin, even before the Banister et al study. And I may as well follow this line a little bit. There's more clips that go down.
Starting point is 01:05:38 So here's the next stage when they're looking back at this period. So metformin has failed in the ITP. So you no longer take metformin. I stopped five years ago. I mean, you're not a diabetic. So presumably you were taking it. I was taking it has failed in the ITP. So you no longer take metformin. I stopped five years ago. I mean, you're not a diabetic. So presumably you were taking it for a giro protection to buffer blood glucose. Yeah. And ultimately, yes, exactly. And the reason I stopped and this will be the last thing before we move on. Well, because you couldn't go to the Dairy Queen at the buffet. No, finally, the nausea went away after a few weeks or a month, maybe. But once I got really into lactate testing, I noticed how high my lactate was at rest.
Starting point is 01:06:12 So resting fasted lactate in a healthy person should be below one, like somewhere between 0.3, 0.6 millimole. And only when you start to exercise should lactate go up. And in 2018 was when I started blood testing for my zone two. So previously, when I was doing zone two testing, I was just going off my power meter and heart rate. But this is when this is after I met Inigo San Milan, and I started, like wanting to use the lactate threshold of two millimole as my as my determinant of where to put my wattage on the bike and i'm like doing finger pricks before i start and i'm like 1.6 millimole and i'm like what the hell is going
Starting point is 01:06:51 on i can't be 1.6 but ran the flight of stairs up the back of the empire state building yeah well that's i i but this is the most relatable thing i'm just constantly pinpricking myself throughout the day to check my millimoles of lactase and just fretting constantly so this is the optimizer world but you were shaking your head of disbelief but um yeah it is really micro managing your whole internal system right like yeah it's fascinating to me i mean no judgment um you know it's fine is there no judgment no chance right there i can't judge them my pictorial muscles are nowhere near as big i'm sure they i'm sure they're much healthier than me is is like the thing which is doing that though I don't know. Because like this is a good example.
Starting point is 01:07:45 So he mentioned he's off the Met form now. And we'll see why because we talk about this paper. But he stopped five years ago. Right. But that means he was on it for a number of years. If I was taking something that made me nauseous, I would stop immediately. The nausea only lasted for one month, Matt. I would last about 15 minutes before I'm like, screw this.
Starting point is 01:08:12 That's why you don't have the pectoral muscles. This is true. This is the optimizer mindset. I get it. Matt likes his succulents. I like whatever the fuck I like. And these guys like measuring the millimoles before they go for a run, right? And Discovery, though,
Starting point is 01:08:32 is the thing that he was taking to extend his life was seemingly doing something, like, bad. So this is the hazards of, like, self-experimentation, presumably, because you're never quite sure about the exact effects. And maybe it is undoubtedly that this is not the only thing that they are taking, right? So isolating out the causal factor, it's not going to be a thing.
Starting point is 01:08:54 But yeah, so it's an interesting mindset. It is very different, I think, from the ordinary worker Joe. They are micromanaging their blood levels and a level huge for unheard of mortal man yeah i mean there's a lot involved in being a health and wellness optimizer right like we've got some little insight into the amount of testing the amount of calculation the amount of supplements, but just thinking and how it must affect all aspects of your day. I'm just amazed that people take all of that on.
Starting point is 01:09:34 Like I'm all for hobbies and obsessive type interests, but it's a big commitment. Let's stick on this a little bit. So Huberman's now going to talk about like why he was taking the berberine or right so what he was up to and basically he's talking about following a fasted eating schedule like a caloric restriction and various things but having a cheat day where you go mental and like binge all the cakes and stuff that you want. But then the next day, introducing like a complete fast, right? So anyway, let's let him explain that. So the last thing you want to do is eat
Starting point is 01:10:11 any food, I would just hydrate, and oftentimes to try and get some exercise. And what I read was that berberine, poor man's metformin, could buffer blood glucose in some ways make me feel less sick when ingesting all these calories and in many cases spiking my blood sugar and insulin because you're having ice cream and you know, et cetera. And indeed it worked. So if I took berberine and I don't recall the milligram count and then I ate, you know, 12 donuts, I felt fine. It was as if I had eaten one donut. Wow. I felt sort of okay in my body and I felt much, much better. Now, presumably because it's buffering the spikes in blood sugar, I wasn't crashing in the afternoon nap and that whole thing. And do you remember how much you were taking? I think it was a couple hundred milligrams. Does that sound about right?
Starting point is 01:11:00 It was a bright yellow capsule. I forget the source. But in any case, one thing I noticed was that if I took berberine and I did not ingest a profound number of carbohydrates very soon afterwards, I got brutal headaches. I think I was hypoglycemic. I didn't measure it, but I just felt I had headaches. I didn't feel good. And then I would eat a pizza or two and feel fine. And so I realized that berberine was putting me on this lower blood sugar state. That was the logic anyway.
Starting point is 01:11:29 And it allowed me to eat these cheat foods. But when I cycled off of the four out, because I don't follow the slow carb diet anymore, although I might again at some point, when I stopped doing those cheat days, I didn't have any reason to take the berberine. And I feared that I wasn't ingesting enough carbohydrates in order to really justify trying to buffer my blood glucose. It's such a complicated relationship with food, isn't it? It's, yeah. I know he's being tongue-in-cheek probably, but if you're eating 12 donuts at once or eating two pizzas at once, and you're buffering with berberine or whatever it is and then if you do take it,
Starting point is 01:12:08 it does this and if you don't, I mean, you're really screwing with things and I don't know. I guess I've got a kind of a, is it committing the naturalist fallacy to just say maybe just don't screw with it, just let nature take its course and let your body do its thing and don't screw with it just let just let nature take its course and let your body do its thing and don't be sort of oscillating between you know like weird diets and calorie restriction and cheap days where you just like stuff two pizzas and 12 donuts into your mouth and you need to take a chemical so you're like not really nauseous but if you if you don't eat
Starting point is 01:12:42 enough calories you're getting like these brutal headaches because something is good like this yeah it's pretty extreme but like to me matt the contrast here is like huberman and rogan and all these people they're always talking about nature being out in the forest sun bathing you know how great this is and you know you want to get tree bark supplements what they're talking about now is not natural it's and then they're doing you know, you want to get tree bark supplements. What they're talking about now is not natural. And then they're doing, you know, the cold plunges and the hormone replacement therapy and injecting, you know, taking ivermectin for prophylactic purposes or all those things. So it's like this weird mix of like, yeah, I guess this is what optimizers do, though. But, you know, nature is good. You need to be out in the though but you know nature is good you need to
Starting point is 01:13:26 be out in the wilderness you know getting the sun's rays to power you up plus you should be micromanaging your fucking blood glucose level and the lactose uh amounts to the micro millimeter so yeah it's there's a contradiction there isn't there like between the natural thing or the paleo thing where you're trying to replicate the natural interactions of of human bodies with foodstuffs and environments and make it as paleolithic and as natural as possible but at the same time they are really interfering with the mechanisms to an unholy degree and and i do i do actually mean it when i say kind of no judgment because i figure you know people could do what they want if you know if you want to make it your hobby to you know then
Starting point is 01:14:11 and play with yourself look it could be risky i wouldn't necessarily advise it but you know that's that's it's a bit like tattooing or body modification or something like that right it's like you know it's not for everyone but it's your body, do what you want with it. And, you know, as you say, they're both, they look at least outwardly, I don't know what their blood levels are, but they outwardly look, you know, very healthy individuals and they are doing exercise and stuff as well.
Starting point is 01:14:38 So it's, you know, I agree. I don't think this is the worst thing in the world for people to be doing by any stretch. It might even turn out, you know, that they do hit on something that's healthy, but it is a very odd way. And I guess I would say the way that they square the circle, reduce the dissonance, is that they are saying all that natural stuff is, you know, evolutionarily programmed to gel well with our biology. But now we can go a step further we can actually scientifically look at the aspects so that's why it's the negative ions that are out
Starting point is 01:15:11 in nature which are important right and this was part of my critique about you know the the scientism kind of creeping into hooverman's recommendations about being out in nature um because it yeah it very much wants to say it is because there's a scientific underpinning to all of this no you're right actually and i take that back because even though there's an apparent contradiction there it does actually make sense that they're kind of starting from a natural is good foundation but then optimizing further based on what science and stuff can can tell us and you, whether they're right or wrong, you know, it's a hobby.
Starting point is 01:15:47 You know, I'm into succulents. They're inter-optimizing their bodies. But that's not all, Matt. It's not just those drugs. Clearly exercise, meaning regular exercise, is the best way to keep that system in check. But in the absence of that tool, or I would say in addition to that tool, is there any glucose
Starting point is 01:16:06 disposal agent, because that's what we're talking about here, metformin, berberine, acarbosit, et cetera, that you take on a regular basis because you have that much confidence in it? The only one that I take is an SGLT2 inhibitor. So this is a class of drug that is used by people with type 2 diabetes but which i don't have but because of my faith in the mechanistic studies of this drug coupled with its results in the itp coupled with the human trial results that show profound benefit in non-diabetics taking it even for heart failure i think there's something very special about that drug so matt
Starting point is 01:16:45 matt foreman has been replaced with an sdlt inhibitor uh so yeah so he's he's taking it based on his understanding of the scientific literature thinks it's going to do some good even though it's not sort of medically prescribed um yeah i can see why right he might be right yeah that's right i can see why optimizers who are wanting to be at the bleeding edge of self-improvement who would be keen to listen to this because he's a medical doctor and he's probably got all kinds of qualifications and he does know how to read literature he's a smart guy i can tell so you're getting his kind of he's expressing it as this is what he does personally he's not he's not telling other people to do this
Starting point is 01:17:24 but definitely people who are listening to this are going okay that could work for me i might do that too yeah yeah so um we'll get off this self-experiment um tation with one more clip but the the last one but um so huberman you know he was doing his like fasting for our whatever consumption protocol from Tim Ferriss. And Adia himself has experimented with calorie restrictions. I think the short answer is no. For two reasons. One, I don't think that that duration would be sufficient if one is going to take that approach. But two, even if you went with something longer, like what I used to do, right? I used to do seven
Starting point is 01:18:09 days of water only per quarter, three days per month. So I was, but I was basically always like, it'd be three day fast, three day fast, seven day fast. Just imagine doing that all year, rotating, rotating, rotating. For many years, I did that. Now, I certainly believed, and to this day, I would say I have no idea if that provided a benefit. But my thesis was the downside of this is relatively circumscribed, which is profound misery for a few days. And what I didn't appreciate at the time, which I obviously now look back at and realize is muscle mass lost. It's very difficult to gain back the muscle cumulatively after all of that loss so i i just highlight that because you know this means that for a couple of years he was on like an extreme cyclical uh like water only fast right and And describes it as inducing profound misery
Starting point is 01:19:07 for a couple of days. And now he isn't sure if that actually has any benefit. Like that was Herman's question was, do you recommend caloric restriction? He was like, no, not intermittent caloric restriction. Not really, but he did for years. And on the one hand, it's kind of good to see somebody moderate their position
Starting point is 01:19:27 but it just does speak to that level of you know that's a hell of a commitment to do for a significant amount of years and then now i'd be like well maybe actually it was damaging my muscle mass and i'm not sure it actually produced any benefit like i have to respect the commitment yeah these guys are really into it and he's okay with the profound misery that's hardcore yeah but it's it's the loss in muscle mass that's that's a real concern that's a bigger concern yeah the pectoral muscles it is kind of deflating yeah we're making we're making fun but i i do you know it's a hobby it's an interest they take it seriously so that's that's okay you know we don't but look at us you wouldn't want to look at us naked um well you know
Starting point is 01:20:17 um so matt journal club back to the journal club so we'll get to the papers now we'll do it quick we'll be efficient don't worry so here's the Journal Club for me. The Bannister study used, I believe it was like roughly they sampled like 95,000 subjects from a UK biobank. Here, they used a larger sample. They did about half a million people sampled from a Danish health registry. And they did something pretty elegant. They created two groups to study. So the first was just a standard replication of what Bannister did, which was just a group of people with and without diabetic that they tried to match as perfectly as possible. But then they did a second analysis in parallel with discordant twins. So same-sex twins that
Starting point is 01:21:04 only differed in that one had diabetes and one didn't. I thought this was very elegant because here you have a degree of genetic similarity and you have similar environmental factors during childhood that might allow you to see if there's any sort of difference in signal. So now turning this back into a little bit of a journal club, and signal. So now turning this back into a little bit of a journal club, virtually any clinical paper you're going to read, table one is the characteristics of the people in the study. You always want to take a look at that. So there we go, Matt, you know, introducing the paper, starting off, let's look at table one. You're familiar with this. You've said it yourself a million times. The approach to papers, you know, this is normal.
Starting point is 01:21:51 Yeah, yeah, yeah. Table one. I think table one is the participant characteristics. Have a look at the people. Let's see. So table one in the keys paper shows the baseline characteristics. And again, it's almost always going to be the first table in a paper. Usually the first figure in the paper is a study design. It's usually a flow chart
Starting point is 01:22:10 that says, these are the inclusion criteria. These are all the people that got excluded. This is how we randomized, et cetera. And you can see here that there are four columns. So the first two are the singletons. These are people who are not related. And then the second two are the twins who are matched. And you can see, remember how I said they sampled about 500,000 people? You can see the numbers. So they got 7,842 singletons on metformin, the same number then they pulled out matched without diabetes. On the twins, they got 976 on metformin with diabetes.
Starting point is 01:22:44 And then by definition, 976 co-twins without them. And you look at all these characteristics. What was their age upon entry? How many were men? What was the year of indexing when we got them? What medications were they on? What was their highest level of education, marital status, et cetera? The one thing I want to call out here that really cannot be matched in a study like this, so this is a very important limitation, is the medication. So look at that column, Andrew. Notice how pretty much everything else is perfectly matched until you get to the medication list? I know that was long. I'm playing with this show like that's normal,
Starting point is 01:23:24 highlighting people, looking at the characteristics of the participants and I'm playing with this show. That's normal, highlighting a paper, looking at the characteristics of the participants and noting good advice that see if anything jumps out, especially if it's between groups. Is there something notable about the differences in the demographics or the medications? It's good. And I think he did spot some important differences
Starting point is 01:23:42 between the test and the control group. And he does talk about limitations here and also a nice way. Full credit, listen to this. Exactly. So this is, again, a fundamental flaw of epidemiology. You can never remove all the confounders. This is why I became an experimental scientist. So that we could control variables. That's right. Because without random assignment,
Starting point is 01:24:13 you cannot control every variable. Now you'll see in a moment when we get into the analysis, they go through three levels of corrections, but they can never correct this medication one. So just keep that in the back of your mind. Okay. good he's right highlighting the weakness of epidemiology studies right yeah or overlapping treatments that people are receiving it is good it is good um recent study of mine chris i was looking at um demonstrating the effects of problem gambling on quality of life we can't do an experimental study we can't give a group gambling problem we can't give that to people the bloody ethics board won't let us do it so we're forced to do this kind of epidemiological thing we do our best to balance the groups both methodologically statistically we try to control for all the comorbidities but i know chris
Starting point is 01:25:00 i know that there are other confounders out there. And Adia makes that point very forcefully. Yeah. And here's him again, I think, doing a good job correctly identifying strengths and limitations of this epidemiological approach. That's the way that epidemiology will make up for its deficit. So you could never do a randomized assignment study on half a million people. So epidemiology makes up for its biggest limitation, which is it can never compensate for inherent biases by saying we can do infinite duration if we want. Like we could survey people over the course of their lives and we can have the biggest sample size possible because this is relatively cheap. The cost of actually doing an experiment where you have tens of thousands of people is prohibitive.
Starting point is 01:25:52 I mean, if you look at the Women's Health Initiative, which was a five-year study on, I don't know, what was it, 50,000 women? I mean, that was a billion-dollar study. So this is the balancing act between epidemiology and randomized prospective experiments. And so they both offer something, but you just have to know the blind spots of each one. Yeah, I think elsewhere too, he talks a lot about those complementary strengths and weaknesses of experimental studies, very expensive as a result in normal circumstances. COVID was a bit of an exception. You can't do really large-end experiments. So the small end, on the flip side, you get to do random allocation
Starting point is 01:26:33 and you've got a really strong argument for causality. The other approach where it's more observational or epidemiological, you could say, you've got the capability of getting a huge number of participants. There's a big advantage there. It could be ecologically valid, all sorts of things like that. But you don't have that strong argument for direct causality of the thing you're manipulating.
Starting point is 01:26:54 No, and I'm going to give more credit. I'm a credit-giving machine today. I'm doing it like it's Christmas over here. Adia discusses confidence intervals i think does a pretty good job of that so here's him discussing confidence intervals now in this table they look different because it's 24.93 for the metformin group and 21.68 for the twin group in that's on metformin when you adjust for age they're almost identical it, it goes from 29 point 24.93 to 24.7. One other point I'll make here for people who are going to be looking at this table is, um, you'll notice there are parentheses after every one of these numbers.
Starting point is 01:27:36 What does that, what does that offer in there? Those parentheses are offering the 95% confidence interval. So for example, to take the number, you know, 24.93 is the crude death rate of how many people are dying who take metformin. What it's telling you is we're 95% confident that the actual number is between 23.23 and 26.64. If a 95% confidence interval does not cross the number zero, it's statistically significant. Okay. So no issues with any of that, right? That was a good summary there. Yep.
Starting point is 01:28:17 Okay. And then Huberman follows up that, talking about a similar sort of thing. So to your point, the people with diabetes taking metformin in both the matched singletons and the discordance are dropping much faster and they always stay below. And I was just going to say that the shading is just showing you a 95% confidence interval. So you're just putting basically error bars along this. So if this were experimental data, if you were doing an experiment with a group of mice and you were watching their survival and you were, you know, you'd have error bars on this, which you're actually measuring. So this is because you have much more data here. You're just showing this in this fashion.
Starting point is 01:28:58 For those that haven't been familiarized with statistics, no problem. Error bars correspond to like if you were just going to measure the heights of a room full of 10th graders, there's going to be a range, right? You have the very tall kid and the very shorter kid and the short kid and the medium kid. And so there's a range. There's going to be an average, a mean, and then there'll be standard deviations and standard errors. And so these confidence intervals just give a sense of how much range. Uh, so these confidence intervals just give a sense of how much range, you know, some people, um, die, die early. Some people die late within a given year, they're going to be different ages. Um, so it, these error bars can account for a lot of different forms of variability here.
Starting point is 01:29:36 You're talking about the variability is how many people in each group die. We're not tracking one diabetic taken metformin versus a control i know why you played this clip poor old huberman his explanation of confidence intervals isn't quite as good as that is it's a bit confused but you know he was just on the fly you know how dare you ma i was just i thought it wasn't that bad but yes he does get a bit lost tongue-tied because when he's describing it but he's not fundamentally doing things wrong he's using examples that people use about the distribution of heights and if you take a small sample you could end up with a skewed average or representation of the average height and so on so So yes, a little bit mean, but I'm just playing
Starting point is 01:30:26 clips math. That's all I'm doing. And well, let's see. There's some discussion about p-values and that kind of thing. So there's another chance, Matt. So they're using this quite complicated type of mathematics called a Cox proportional hazard, which is what generates hazard ratios. And basically any model has to is what generates hazard ratios. And basically any model has to have some error in it. And so they're basically saying this is the error. So you could argue when you look at that figure, we don't know exactly where the line is in there, but we know it's in that shaded area. Sorry to make one other point. If those shaded areas overlapped, you couldn't really make the conclusion.
Starting point is 01:31:06 You wouldn't know for sure that one is different from the other. Yeah, that's actually a good opportunity to raise a common myth, which is a lot of people, when they look at a paper, let's say it's a bar graph, you know, and they see these error bars, and they will say, people often think, oh, if the error bars overlap, it's not a significant difference. But if the error bars don't overlap, meaning there's enough separation, then that's a real and meaningful difference. And that's not always the case. It depends a lot on the form of the experiment. I often see some of the more robust Twitter battles over, you know over how people are reading graphs.
Starting point is 01:31:45 And I think it's important to remember that you run the statistics, hopefully the correct statistics for the sample, but determining significance, whether or not the result could be due to something other than chance, of course, your confidence in that increases as it becomes typically p-values, p less than 0.00001% chance that it's due to chance, right? So very low probability, less than 0.05 tends to be the kind of gold standard cutoff. But when you're talking about data like these, which are repeated measures over time, people are dropping out literally over time, you're saying they've modeled it to make predictions as to what would happen. Hoobman again getting a bit confused there.
Starting point is 01:32:28 What? What? What? I don't know what you mean. Like, it is mean, Matt. This is mean. It is mean. Because people are notoriously pretty.
Starting point is 01:32:38 They're difficult to explain. I know. Yeah. Yeah. But two slight red flags there a little bit bit he's not wrong about the error bars right uh he is correct that you can have overlapping and it still be statistical significance but the gold standard being p less than 0.05 i think that i like gold standard suggests that's when you get that you're really happy with it.
Starting point is 01:33:06 And I'm like, no, that is actually a very marginal cutoff, which is arbitrary in a lot of ways. And it's actually a relatively high error rate that isn't accepted in most card sciences, would not accept 0.05. I think I lost track of how many zeros he was saying. So he was referring to 0.05 um so i think i lost track of how many zeros he was saying so he was referring to initially he said 0.00001 percent but he but he got confused there and said that it's due to
Starting point is 01:33:34 chance it's not a percent it's not a percent either right it's a probability so yeah yeah and then but then he said p less than 0.05 is the gold standard cutoff. Now, again, this is nitpicking, but I think it matters because you'll see when we look at the paper that he's discussing later, if we go and look at the P values in that paper, a lot of them are hovering just below 0.05. Yeah. And if you look at it as a gold standard, that's not a problem. I'm nitpicking too a little bit, but I did raise my bar a little bit
Starting point is 01:34:08 when Hillman was talking about how it all depends on the methodology, whether it was repeated measures and things like that. And actually not so much, yeah. Like a p-value, the method that goes into the calculation of it takes into account extracting variance attributable to the repeated measures, for instance. So actually you don't need to kind of keep in mind the methodology when evaluating a p-value so much, except in a very broad sense.
Starting point is 01:34:34 And yeah, I don't know, it's just a bit odd. A little aside, Chris, by the way, is that nobody or very few people seem to understand how to understand confidence intervals in the context of repeated measures. Because when you put confidence intervals on bar graphs and there are repeated measures, then typically it's not straightforward to actually extract the variance attributable to individual differences variance and take that out of the error bars. And many researchers don't they just they just calculate your standard confidence intervals and they actually don't apply now a little aside
Starting point is 01:35:11 everyone knows that yeah yeah like i i know it's a little bit cruel, right, to focus on somebody's offhand description of statistics because everybody can make mistakes. And it's sometimes people perfectly know what they're talking about, but just on the fly, they say something, you know, which isn't accurate. I'm sure I do it all the time as well. But I also think there is an element where from this conversation, I would judge that Adia has a much stronger grasp of the relevant statistics and whatnot. But if you were a layman, I think you would have the impression
Starting point is 01:35:53 that they are both equally competent. And I don't get that impression. I get the impression. I'm not saying Huberman doesn't know anything about statistics and whatnot, but I do think he has a little bit of a pre-replication crisis mindset, as we'll see as he goes on to talk about the other studies. But I think that's what gets him in trouble is because he overhypes studies that other people regard as not being so impressive. So I don't think it's completely irrelevant, these small indicators about just maybe some issues around interpreting things, whereas Addy is much clearer about these are significant limitations
Starting point is 01:36:34 and that we have to adjust our level of confidence accordingly. Yeah, yeah, I think that's correct. I definitely, I'm never going to ding someone for not being confident in talking about statistical nuances off the top of their head. But, you know, it's fair to say Addy is a lot more confident talking about these technical things than Huberman. And also, Huberman is more bullish on interpreting the results. I think you're right to say those two things are connected. Yeah, when we get to the conclusions drawn from Piper, I think it'll be clearer. So I'll get off Adia's paper quite
Starting point is 01:37:11 shortly. So here's just an example, for instance, about Adia correcting an inference. But again, this paper is in his wheelhouse. So it's reasonable that this would happen. The more you need these medications, they're never able to erase the effect of diabetes. But in this case, it seems that they might be accelerating, possibly accelerating death due to diabetes, possibly. We could never know that from this because we don't see, we would need to see diabetics who don't take metformin, who take nothing. And I would bet that they would do even worse. So my intuition is that the metformin is helping, but not helping nearly as much as we thought before. Oh, and maybe for context, Matt, if I just play the summary of the paper, that will make clear, right, what they find from the re-examination of metformin for potential
Starting point is 01:38:07 life extension properties. The point here is the Keys paper makes it undeniably clear that in that population, there was no advantage offered by metformin that undid the disadvantage of having type 2 diabetes. This does not mean that metformin wasn't helping them because we don't know what these people would have been like without metformin. It could be that this bought them a 50% reduction in relative mortality to where they'd been. But what it says is, in a way, this is what you would have expected.
Starting point is 01:38:41 This is what you would have expected 10 years ago before the Bannister paper came out. So basically in this paper, when they compared and they did additional things in the paper to make the comparisons better, it's a better powered study. It controls for more things. They basically didn't see this dramatic improvement that was reported in the Bannister paper. So people who were taking metformin and had diabetes died more than a matched group that weren't taking metformin, but also they don't have diabetes. So that's something because it's a diabetes treatment. So what you don't have is a population who's taking metformin and doesn't have diabetes but in any case there isn't a signal that it's this wonder drug and that's the issue so it is what you would expect and then so when huberman suggests that it's potentially doing harm to be taking metformin
Starting point is 01:39:41 he's like no because it we don't know We can't say that from this data, right? Because they're doing worse than a healthy control. That's the comparison. Yeah. So you got it? You're right. You're not going to take Metformin now. Have I talked you out of it?
Starting point is 01:39:59 You have. So now, Matt, and this is coming to the end, so don't worry, don't worry. You're getting to Huberman's paper now. But on our Decoding Academia, we've talked about the way that you should approach papers, and they have some general advice about reading papers that I thought is interesting to look at. So here's one piece of advice that comes first. You see these big stacks of numbers numbers and it can be a little bit
Starting point is 01:40:25 overwhelming. But my additional suggestion on parsing papers is, notice that Peter said that he's read it several times. Unlike a newspaper article or an Instagram post, with a paper, you're not necessarily going to get it the first time. You certainly won't get everything. So I think spending some time with papers, for me, means reading it and then reading it again a little bit later. So read a paper that you want to understand multiple times. Good advice. I've often read that.
Starting point is 01:40:56 You don't oppose that, right? No. You're not anti that. If you have time and if you're not busy doing other things, then by all means. Yeah. This is what you can, you know, you're giving people advice. And Huberman goes on in greater detail about the way he approaches people.
Starting point is 01:41:12 And it actually sounds very similar to advice I give undergraduates, Matt, which is he outlines trying to find the key question, you know, what the topic is. Then how did they address it? What's the methodology? What is their result that they claim? And then lastly, does the evidence that they provided support the conclusions that they want to draw? And generally, I agree with all of that. That's a reasonable questions to add. There's more questions you can add in, but that's a pretty good initial way to approach a paper,
Starting point is 01:41:43 understand the question, check the methodology, look at the results, and then compare the quality of the evidence that the conclusion is drawn. Yeah, that's fine. Yeah, they talked a lot about sort of stepping backwards and forwards for the paper. And, you know, I think by all means, read any paper any way you like. I think it's okay. I think there's an argument for just reading it from the beginning all the way through to the end, personally.
Starting point is 01:42:03 Listen, here's their approach so what i do typically is i'll read title abstract i usually then will skip to the figures and see how much of it i can digest without reading the text and then go back and read the text but in fairness journals great journals like science like nature oftentimes will pack so much information the cell press journals too into each. And it's coded with no definition of the acronyms that almost always I'm into the introduction and results within a couple of minutes wondering what the hell this acronym is or that acronym is. And it's just, yeah, it's just wild how much nomenclature there really is. Yeah, but that's, I ain't gonna say Matt,
Starting point is 01:42:46 especially with more recent papers, I advise students that they should read the abstract and like, well, basically I know that students aren't going to read the full paper. So I tell them to go and read the figures and when they don't understand something in the figure, go and read the part of the paper to let them understand it right because i'm i i also make them do things like identify the outcomes and the
Starting point is 01:43:12 predictors and this kind of thing and they are usually plotted on graphs so figures can be very useful save you a lot of time yeah yeah i guess. If you're trying to speed read stuff and, you know, extract stuff. Optimize your consumption. I guess this is a bit of an optimizer approach, but it's a realistic one. You are doing the old professor thing of, well, you should just read 50 papers and you'll get the, if you do the literature review, but your students aren't going to do that, Matt. They're going to be in chat GPT, getting chat gpt to generate the summaries and stuff so you have to
Starting point is 01:43:49 play with the play-doh that is available not your dream play-doh yeah yeah fair enough i know like you listen to things at two and a half speed so you're always trying to you know maximize your time efficiency or whatever yeah look i think it's fair enough, you know, maximize your time efficiency or whatever. Yeah, look, I think it's fair enough. If you know the area really well, you might well just, you know, skip the introduction and the discussion and you just. Depends what you're doing. Wow. Yeah.
Starting point is 01:44:16 Depends. It all depends. It all depends. Sounds like something I heard. Did someone say that? Well, again, if I'm reading papers that are something that I know really well, I can basically glean everything I need to know from the figures. And then sometimes I'll just do a quick skim on methods. But I don't need to read the discussion. I don't need to read the
Starting point is 01:44:35 intro. I don't need to read anything else. If it's something that I know less about, then I usually do exactly what you say. I try to start with the figures. I usually end up generating more questions like, what do you mean? What is this? How did they do that? And then I got to go back and read methods typically. And one of the other things that's probably worth mentioning is a lot of papers these days have supplemental information that are not attached to the paper. So you're amazed at how much stuff gets put in the supplemental section so look right he had some advice come over you know if you know the topic and he i've actually also agreed that discussion sections often that's a lot of offers spin on the results so you have to
Starting point is 01:45:19 that's the stuff you can actually take with a pinch of salt usually yeah i agree i agree it all depends who you are what you know and right what your purposes are for reading the paper like you might be just kind of doing a brief skim of literature to figure out the the weight of evidence for and against such and such an area you know intimately in which case you might well just be looking at abstracts and checking the basics of the results so yeah depends i'm just giving credit map because we're going to talk about huberman's paper selection die so i'm just saying that's example of what i would consider good advice to people who may not have read that many scientific papers and want to know how to approach them in a potentially efficient way. You shouldn't overestimate your abilities. In many cases, I think, especially
Starting point is 01:46:12 with students that I teach, they don't have the capacities to understand the statistical analysis that's in the paper. So if they're reading a regression table and they don't know what regressions are not that helpful but nonetheless overall i sign off on this approach to reading papers there are many that you could do and this one is not bad so adia had a big large epidemiology study which essentially looked back at a previous finding that people were all excited about in the longevity area and said, actually doesn't look like it works very well. And he summarizes the paper nicely and says, I'm not taking metformin now.
Starting point is 01:46:51 You're fucking crazy. So now let's look at the last bit, what paper Huberman picks and what takeaways he has. I would hope Adi's takeaway is maybe I should be less automatically enthusiastic on the basis of like single studies or, but if you want to be on the cutting edge, you got to take risks with your lactose levels or whatever the hell it is. So here we go. Paper two from Huberman. Well, should we pivot to this other paper? Yeah. It's a very different sort of paper. It's an experimental paper where there's a manipulation. I must say, I love, love, love this paper. And I don't often say that about papers. I'm so excited about this paper for so many reasons. But I want to give a couple of caveats up front. First of all, the paper is not published yet. The only reason I was able to get this paper is because it's on bio archive.
Starting point is 01:47:44 The only reason I was able to get this paper is because it's on bioarchive. There's a new trend over the last, I would say, five, six years of people posting the papers that they've submitted to journals for peer review online so that people can look at them prior to those papers being peer reviewed. So there is a strong possibility that the final version of this paper, which again, we will provide a link to, is going to look different, maybe even quite a bit different than the one that we're going to discuss. Nonetheless, there are a couple of things that make me confident in the data that we're about to talk about. First of all, the group that published this paper is really playing in their wheelhouse. This is what they do. And they publish a lot of
Starting point is 01:48:19 really nice papers in this area. I'm going to mispronounce her first name, but I think it's Chao-Ci Gu, who's at the Econ School of Medicine in Mount Sinai, runs a laboratory there studying addiction in humans. And the first author of the paper is Ofer Pearl. This paper is wild. And I'll just give you a couple of the takeaways first as a bit of a hook to hopefully entice people into listening further, because this is an important paper. This paper basically addresses how our beliefs about the drugs we take impacts how they affect us at a real level, not just at a subjective level, but at a biological level. Okay. at a real level not just at a subjective level but at a biological level okay so yes so a very exciting experimental study showing these uh placebo type effects are actually reflected
Starting point is 01:49:13 biologically physically not just psychosomatic or mental or whatever i was inclined to complain about the framing about preprints being a new innovation, but I actually think he's correct. It is a trend that has, you know, become more popular in five or six years. They're long term things. But I mainly like I remember Brett Weinstein discovering during the pandemic that preprints were a thing and kind of treating it as there's this whole new system. It just goes to show how little that ecosphere is immersed in research or actual stuff that they weren't familiar with preprints. But Huberman is not doing that because he's correct.
Starting point is 01:50:00 There is a trend for this being more common in recent years. So just gonna say my instinct was to dunk but i i would have been wrong to do so well done well done yeah and there is that element though you know that i'm just gonna point it out again you know americans is it americans or is it the people that we cover that i'm so excited i love this paper it's the it's really this is hugely influential we need to talk about this you know like i know what you mean like we covered a paper recently that we both liked quite a bit yeah that's wallet finding paper it's into coding academia subscribe now listen um but um you know i i don't think i've ever really had a feeling of excitement about
Starting point is 01:50:48 papers even ones i really like oh i i get excited but like i i put it in context of like you know i think here to me matt the inclination would be saying this is an important paper at the same time as pointing out it's not been peer-reviewed and as we go on we might see some other issues but like is it an important paper yeah like even even if it was completely valid the finding that he's going to report it's a single paper right a small experimental study if you were a psychologist especially you might be wary of touting single studies claiming dramatic effects on small sample sizes just yeah yeah as being exciting yeah that's okay that's this is the framing so it's okay to be excited it's okay to be excited about things it's okay to be enthusiastic it is i'm just pointing out a
Starting point is 01:51:43 difference i'm just pointing out different saying. I'm just pointing out a difference, saying, you know, our American brethren, they're more expressive than us repressed Australians and Irish people. Anyway, it was about the placebo, the framing there. So here's another clip, a little bit more Huberman, you know, introducing placebo effects and their purported power. more Huberman introducing placebo effects and the purported power? Even more striking is the studies that Ali's lab did and others looking at, for instance, you give people a milkshake, you tell them it's a high calorie milkshake, has a lot of nutrients,
Starting point is 01:52:21 and then you measure ghrelin secretion in the blood. And ghrelin is a marker of hunger that increases the longer it's been since you've eaten. And what you notice is that it suppresses ghrelin to a great degree and for a long period of time. You give another group a shake, you tell them it's a low calorie shake, that it's got some nutrients in it, but that doesn't have much fat, not much sugar, et cetera. They drink the shake, less ghrelin suppression. And it's the same shake. And it's the same shake. And satiety lines up with that also in that study. And then the third one, which is also pretty striking, is they took hotel workers, they gave them a short tutorial or not, informing them that moving around during the day and vacuuming and doing all that kind of thing is great. It helps you lower your BMI, which is great for your health. You incentivize them.
Starting point is 01:52:58 And then you let them out into the wild of their everyday job. You measure their activity levels. The two groups don't differ. They're doing roughly the same task, leaning down, cleaning out trash cans, et cetera. Guess what? The group that was informed about the health benefits of exercise lose 12% more weight compared to the other group. And no difference in actual movement? Apparently not. Now, how could that be? So that is like a huge if true kind of finding, isn't it? That you tell these workers about the health benefits of doing it, their activity levels don't differ,
Starting point is 01:53:32 but your experimental manipulation of just people believing that it's good for them to do this hotel work makes them lose more weight, be healthier. Chris, I think you looked into some of these articles that Huberman references. Yeah, I did. And like, because whenever I hear this kind of description about studies that are counterintuitive and dramatic,
Starting point is 01:53:57 it rings the replication crisis warning bells, right? They jingle in my ear because this sounds very much of a piece like hurricanes that have female names lead to more fatalities because people don't take them as seriously. Himmikines and hurricanes. Yeah, the title did a lot of the work, I think. But yeah, so I'm wary of it for good reason, because, you know, cute results get lots of press, but the replication crisis has shown that many of those studies don't hold up when you dig into it or whenever you have a more robust replication. And I didn't do a huge deep dive, but I did go back and look at some of the studies that he's citing. And one of them is mind over milkshakes.
Starting point is 01:54:52 Mindsets, not just nutrients, determine ghrelin response, right? And this claim is saying that if you give people the exact same milkshake and you tell them in one case, like it's this super sweet one and then the other one that's a zero percent fat one that you see um this difference in the production of grayling or like in any case you see a physiological difference in the body in response to that and it's not such a dramatic claim because priming the body that it's about to receive a certain type of food maybe it could induce a type of reaction. But when I went and looked at the study, these are the kind of warning signs you would have for a pre-replication crisis or post-replication crisis questionable study. We'd want the study that isn't pre-registered, that has a small amount of participants that has measures which are noisy, right? And in particular, people might think that physiological measures allow you to be more precise because you can
Starting point is 01:55:55 measure heart rate or you can measure different hormones in the blood or so on. And it's a quantifiable objective measure. But anybody who's worked with physiological data should know that there's a lot of noise in it and there's a lot in exactly how you measure things which measures your kind what you're comparing to and this is especially the case if you have longitudinal heart rate measures or something like that right i've worked with heart rate can confirm yeah yeah so in any case following huberman's recommendation about looking at the figures in the paper two of them are showing the different advertisements they use one of them is showing the self-reported perceived difference in healthiness of the milkshake and the fourth one which is the key one is showing graylin over time
Starting point is 01:56:47 as a function of shake mindset and it has um 20 60 and 90 intervals and it's comparing the graylin production or whatever pattern and there is a difference And the amount of subjects in it were 53 participants. However, two did not attend. So 51 participants divided by two conditions, around 25 in each condition. P equals 0.02, 25 per condition study. Yeah. Doubt. Doubt about the little meme with doubt flashing above my head.
Starting point is 01:57:30 And similarly, there's a paper about hotel maids being told that they were doing exercise, right? That like their housework was exercise and they lost a bunch of weight if they were told that whereas the same maids doing the same amount of effort didn't lose as much weight in the control condition now again this would be a important result because it would mean you should just tell everyone everything they're doing this exercise because apparently their body will switch into like some burning calorie mode or whatever because they're saying the amount of physical exercise that they did was consistent according to self-reported measures but the group that was told that doing housework was exercise, lost weight, the kind of power of mindset over physical reality.
Starting point is 01:58:29 So here, Matt, looking at the sample size first, 84 subjects this time, 44 in the informed group, 40 in the control condition. So bigger, at least than the previous study, but still 40 odd per condition, not huge, right? And looking at the not the self-reported differences, the differences in terms of mean weight loss, the kind of objective measures the weight difference between the the two was 143.72 this was in the informed condition whereas the control condition had a weight of 146.71 i guess that's in pounds so around three pounds difference and the starting weights are
Starting point is 01:59:27 similar 145.5 146.92 so you're talking about a difference of around two pounds right over the period and it does reach high levels of significance like under 0.001. But again, Matt, color me skeptical here. It is possible that they've found a very large effect here. But when you have a sample size of 40 and you have a claim that just telling people over the course of 10 weeks one thing and then the rate decreases right like there's so many other aspects and of course they try to control for them or whatever but i seen in skeptical reporting somebody said okay well if you report people that it's exercise it might make them do more physical activity. But I also seen other people saying,
Starting point is 02:00:26 you know, just that they were skeptical that the result would replicate. And this is the kind of thing where like, I think you could report this in a manner which is responsible saying some studies that have small samples, but we're not pre-registered, have not been replicated,
Starting point is 02:00:43 that we might be wary of, have found these kind of effects. But that's not the way Huberman reports it, right? Huberman is like, these guys are stellar. These are the leaders in this field. And they find these incredible studies with amazing effects that demonstrate the placebo effect is just beyond powerful, right? Like it's kind of TED talky as opposed to post
Starting point is 02:01:06 replication crisis talk yeah yeah that's right i mean you know you do have to you don't have to do bayesian statistics but you i think you can apply that slightly bayesian reasoning which is that your prior expectation on the probability that just telling someone that something is good for you makes it better for them should should be pretty low right that there's an actual physical effect going on there and it and you know one small end study it shouldn't move the needle so far that you're breathlessly excited about these jaw-dropping earth earth-shattering results. Like you said, even in an experiment like that, there's all kinds of other mechanisms that could be at play. Like it could be true, right? It's possible. But it could also be that the people who are told that exercise is really great for
Starting point is 02:01:58 them, that their work is really good for them, could have been doing some other exercise or even eating a little bit less or who knows and they failed to measure that or self-report it exactly that there's a thousand possible explanations so you know you really would want to get excited about this kind of thing once it's been triangulated and confirmed using multiple different methods because if it really is true and it really is earth shattering, then you should see a bunch of different groups looking at it in different ways and confirming it. Exactly.
Starting point is 02:02:33 Yeah. Yeah, and it should be, you know, if the effect is this big, you get a couple of pints for just one short intervention, then like, great, you know, this is, this is huge news and you should be able to replicate it fairly easily. But in general, this doesn't happen, right? People don't make efforts to replicate them when they do, they do it in a completely different way. So yeah, so I'm just saying, again, Hooper Midami is like a pre-replication crisis TED talk guy. Like he, hooverman to me is like a pre-replication crisis ted talk guy like he he doesn't seem to have picked up about the issues with overhyping studies and stuff yeah which is all because like he sometimes
Starting point is 02:03:13 does reference it but it's it's obvious that he's much more about the hype than he is about temper your expectations yeah that's right um so yeah if you're even if you're a member of the public it's not hard to i think absorb what um i think is good practice these days which is that if you see a small end study if it's finding a counterintuitive and very surprising result if there's a p value somewhere between 0.01 and 0.05 you know there's probably other things other red flags too but you know just you know don't assume that it's definitely definitely true the findings so here's a bit more in the study ma and i i want to get your own reaction to the cell i won't prime you by saying what i thought let's just see what you think about this little segment about the study. And to make a long story short, we know that nicotine, vaped, smoked, dipped, or snuffed,
Starting point is 02:04:12 or these little Zin pouches, or taken in capsule form, does improve cognitive performance. I'm not suggesting people run out and start doing any of those things. I did a whole episode on nicotine. The delivery device often will kill you some other way or is bad for you. But it causes vasoconstriction, which is also not good for certain people. But nicotine is cognitive enhancing. Why? Well, you have a couple sites in the brain, namely, in the basal forebrain, nucleus basalis, in the back of the brain structures, like locus coeruleus, but also this what's called it's got a funny name, the pedunculopontine nucleus, which is this nucleus in the pons, in the back of the brain, in the brainstem, that sends those little axon wires into the thalamus. The thalamus is a gateway for sensory
Starting point is 02:04:52 information. And in the thalamus, the visual information, the auditory information, it has nicotinic receptors. And when the pedunculopontine nucleus releases nicotine, or when you ingest nicotine, what it does is it increases the signal to noise of information coming in through your senses. So the fidelity of the signal that gets up to your cortex, which is your conscious perception of those senses, is increased. And how much endogenous nicotine do we produce? Well, it's going to be acetylcholine binding to nicotinic receptors. I see. We're not making nicotine. We're not making nicotine.
Starting point is 02:05:28 So this is a nicotinic acetylcholine receptor. Right. Of which there are at least seven and probably like 14 subtypes. But so, right. They're called nicotinic receptors in an annoying way, in the same way that cannabinoid receptors are called cannabinoid receptors. But then everyone thinks, oh, you know, those receptors are there because we're supposed to smoke pot or those receptors are there because we're supposed to ingest nicotine no so what do you think there uh well there's so many little squishy parts of the brain i i'm not
Starting point is 02:05:55 super familiar with the with the exact mechanism that he's describing i'm sure i'm sure he's right he knows more about the the various neurotransmitters than I do. I think, though, you can't simplify the functions of those particular regions and even their interconnectivity into a simple thing, like activating this area is going to enhance your perceptions and make you reduce the signal-to-noise ratio. If there was some simple effect like that, then our brains would be wired to do that all the time
Starting point is 02:06:30 because it's by evolution. So it's generally not suboptimal. Tweaking something with nicotine or any other psychoactive drug is going to have a wide range of effects all over the place, and there's usually some downsides along with the plus sides those are some general thoughts you could talk about the brain forever no that was well that was interesting because you picked up on something different and i was just curious how this lands to somebody that is more familiar with the neural
Starting point is 02:07:00 anatomy kind of stuff because to me there's a lot of jargon there. And I don't think it's wrong. I think it's going to be accurate. But I, I do get the sense like sometimes when they're describing things, I feel like it's necessary, you know, that they're talking specifically about various pathways and stuff. But occasionally, it feels like a kind of flex you know just to reference all of the scientific names and stuff but i don't know if that's just my sense because i'm not as familiar with neuroanatomy well well it could be because if it's a flex then he's rattling off a bunch of extremely specialized bits of information that i'm not super familiar with at least in the but you know yeah you know i think only the researchers that are really focused on those
Starting point is 02:07:53 sorts of mechanisms would like there are some those are some pretty pretty specific little functional things that he's talking about yeah so in in this case i think part of the appeal of huberman and adia is that they get into the nitty-gritty like this but i do think that their audience generally is not well equipped to assess any of it and and i i'm certainly not well suited to assess these kind of descriptions but i i will say just on the flip side of that, that when he was talking about fMRIs, which I do know a bit about, at least, I think this description Huberman gives of how they function is kind of technical, but also pretty good in a nutshell. They measure carbon dioxide and they're measuring nicotine in the blood as well.
Starting point is 02:08:39 So they do a good job there. So then what they do is they have them vape and they're vaping either a low, medium, or high dose of nicotine. The doses just don't really matter because tolerance varies, et cetera. And then they are putting them into a functional magnetic resonance imaging machine. So where they can look at, it's really blood flow. It's really hemodynamic response. For those of you who want to know, it's the ratio of the oxygenated to deoxygenated blood because when blood blood will flow to neurons that are active to give it oxygen and then it's deoxygenated and then there's a change in what's called the bold signal so fmri when you see these like hot spots in the brain is really just
Starting point is 02:09:19 looking at blood flow that seems in line with what i understand there was a neat little short description that's correct yep that's right that's fmri and he gave some details about the study right uh he mentioned that the people are receiving different doses of nicotine and then being put into an fmri right this is what the study is i thought they were just being told that they you're like peter adia you spoiled the reveal yeah so that's what adia does and one of the clips is like but weren't they all given the same he's like well yes i was gonna reveal that at the but anyway and they were told they were told they got either this is a low amount a medium amount or a high amount and then of course they looked at brain area activation during this task and what they
Starting point is 02:10:11 found was very straightforward sorry they were all given the same amount yes this is this is the sneak i was going to offer it as a punchline but that's okay no i think that the cool thing about this experiment is that the subjects are unaware that they all got the exact same amount of relatively low nicotine containing vape pen but anyway so yeah they're all receiving the same dose so their behavior should not be different based on the actual chemical stimulation right yes and oh but on the fmris map there was a discussion about the limitations of fMRIs, or at least Peter Adia brought up a relevant issue about potential issues with fMRIs. And that leads to this exchange. with the magnet because my understanding is that, and this is definitely getting beyond my expertise,
Starting point is 02:11:10 but that the spin orientation of the protons, then it's going to relax back at a different rate as well. So by the relaxation at a different rate, you can also get not just resting state activation, like, oh, look at a banana, what areas of the brain light up, but you can look at connectivity between areas and how one area is driving the activity of another area. So very, very powerful technique. So what they do is they put people in a scanner and then you'll like this. What are the limitations of fMRI in terms of, I mean, how fine is the resolution? I mean, where are the blind spots of the technique? So resolution, you can get down to subcentimeter.
Starting point is 02:11:43 They talk about it always in these paper as a voxels which are these little cubic pixels um things um uh you know sub sub centimeter but you're not going to get down to millimeter okay um there are a number of little confounds that maybe we won't go into now that have been basically worked out over the last 10 years yeah yeah so i think he missed a couple like first the most important limitation of fmi which is the temporal resolution that's the big one um in terms of it being relatively low the spatial resolution is okay um might be a stretch to call it sub centimeter i mean could be i mean the thing is it's quite blob So, you might have voxels or pixels at a higher resolution, but it doesn't necessarily mean that the resolution is
Starting point is 02:12:31 really there. The other thing too, though, of course, with fMRI is that there's so much individual variability and just your baseline resting behavior. So, it does involve a lot of those complicated signal processing transformations and spatial and temporal statistics in order to extract out signals so you know this is one of the reasons why you know i know you've been skeptical of fmi studies chris because they do produce very nice sciencey looking pictures with heat maps superimposed over a picture of a of a brain looks super sciency but um could sometimes be a little bit misleading as to yeah there have been various studies on this topic showing that like if you if you just show people a picture of a brain like an fmri result
Starting point is 02:13:19 they read the paper as as more scientifically, right? Like it doesn't matter. Any other detail is different. Well, they're so bloody expensive. I mean, we should give them points just for that. Yeah. And they did have an issue as well, which I think Huberman might be gesturing vaguely out there when he says, you know, there were some issues for a decade, but we've mostly ironed that out.
Starting point is 02:13:43 I guess he's referencing about the issue with the software that people were using to analyze fmris which turned out to be calibrated incorrectly and leading to a whole bunch of false positives uh i believe right which was a very very serious issue and i believe has been mostly rectified but but the fact that it could occur and persist for such a significant amount of time is concerning yeah yeah i mean i think fmris as a technology is a good example of like this extended concept of like researcher degrees of freedom where just the technology is super advanced and super sophisticated um produces reams and reams of of raw data but um as a
Starting point is 02:14:33 consequence of that a huge amount of pre-processing has to go on and and even then when you get your filtered pre-processed data it it's still relatively high dimensional. That is like it's got a lot of pixels, voxels. And, you know, so you have to use pretty complicated spatial temporal statistics in order to compare them. And because they are so expensive to run, you almost always have low-end studies. So I think those things have contributed to some right skepticism about the method. Correct. And there was another paper, a quite famous one, which Adia references
Starting point is 02:15:14 here and who everyone is less familiar with, which I took as diagnostic, but we'll see why you did not after. Wasn't there a really funny study done as a spoof maybe a decade ago that put a dead salmon into an MRI machine and did an, like they did an fMRI of a dead salmon that demonstrated like some interesting signal? I didn't know that, but it- We got to find this one for the show notes.
Starting point is 02:15:41 We should do one of these wild papers ones. There are papers of you know people putting don't do this folks putting elephants on lsd that were published in science and things like like crazy experiments we should definitely do a crazy experiments journal club yeah i think he was missing is at his point there though it wasn't so much like oh wouldn't it be wild if we studied scanty dead were making a very specific point about problems with the methodology. Correct. This was Craig Bennett took an Atlantic salmon and scanned it
Starting point is 02:16:15 and showed that using normal methods, its brain was lighting up in specific areas in response to being shown like some trounce. So he wasn't saying that we shouldn't use fMRIs. It was just simply, I believe it was just a poster at a conference or something. But in any case, it was just an illustration, right? We have to be somewhat skeptical about the application of these methods now i thought this was a famous study that everyone in the science reform uber was familiar with and that not knowing this was like a big
Starting point is 02:16:56 tattletale that you know you were you weren't paying attention yeah but in our pre-podcast discussion, it emerged that you didn't know what that's about. I've never presented myself as someone who's all in on the science reform movement. I'm being dragged along. I'm an unwilling participant. Look, I will say this is an example of things being falsified. Because I would say, from my experience interacting with you over statistical issues that you are that you're completely in line with all of that about like not overhyping things we've been skeptical about claims with knowing that all the bullshit
Starting point is 02:17:36 that people do with statistics so that scanning a dead fish would light up an fmri you know it would be completely in line but but here's where we're not the same chris because you see me as someone who's all in on that stuff which i am but that's just because i'm a good statistician not not because i'm part of the science reform movement this is true so i'm saying it's a kind of parallel evolution effect yes so i i learned from your reaction not knowing about this paper and being like oh that's a funny paper that okay i cannot use it as diagnostic although i think in many occasions if someone was a science communicator and they don't know the study it does talk about the blind spots right but the difference is who woman does not have your background in statistics
Starting point is 02:18:25 so you know there's have to take each person it's a special case okay so the main thing is you cannot ding him and for not knowing about that study because i didn't because you also didn't know yeah that's why i can't take him for not knowing about it yes there is that but um whether or not you know about the fish he doesn't seem to entirely get the point that Adria is pushing towards about wanting to talk about limitations, like the way he did with the epidemiology study. So anyway, they put them into the fMRI, and then what do they do? So they put people into the scanner, and then they give them essentially a task that's designed to engage the thalamus, known to engage the thalamus, reward centers, and the ventromedial
Starting point is 02:19:12 prefrontal cortex. And it's a very simple game. You'll like this because you have a background in finance. You let people watch a market. Okay, here's the stock market, or you could say, or the price of peas. It doesn't really matter. It goes up, it goes down and they're looking at a squiggle line, then it stops. And then they have the option, but they have to pick one option. They're either going to invest a certain number of the hundred units that you've given them, or they can short it. They can say, oh, it's going to go down and try and make money on the, on the prediction. It's going to go down. You could explain shorting better than I could for sure. So depending on whether or not they get the prediction right or wrong,
Starting point is 02:19:46 they get more points or they lose points, and they're going to be rewarded in real money at the end of the experiment. This is an economic game in a way, right, Matt? These are things that psychologists and behavioral economists and a whole bunch of people like get people to play little games with money because there's actual money involved. The thought is that people will be actually more invested in the outcome and a nice little like investment prediction game, right?
Starting point is 02:20:15 Yeah. This is actually an area where I'm a bit more in my wheelhouse because it's kind of related to gambling reward approach behavior and decision making and stuff so all of that sounded plausible to me the ventromedial prefrontal cortex interacting with the thalamus and they cooperate certainly in terms of finding sources of reward making decisions about about how to approach it and you know modulating emotions and things like that. Yeah, and here I would just note, Matt, that I know,
Starting point is 02:20:49 I don't know if you've heard about this trick, but like basically you should sell when things are high and buy when they're low. And this is how you can kind of beat the market. You explained this theory of trading to me. And yeah, no, no, it's it's brilliant brilliant stuff i can't believe that no one's ever thought of that one before i mean my god i i know when the line is dying that's when you're buying when it goes up i'd say anyway it would be easy for me this game
Starting point is 02:21:15 but so whoever makes a note here so they're playing this game and they're getting told that they're having different doses and you might expect them that part of the goal is to see, do they perform better in this attention demanding game? But now remember, these groups were given a vape pen prior to this, where they've vaped what they were told is either a low, medium or high dose of nicotine. And they do this task. The goal is not to get them to perform better on the task. What they were told is either a low, medium, or high dose of nicotine. And they do this task. The goal is not to get them to perform better on the task.
Starting point is 02:21:54 The goal is to engage the specific brain areas that are relevant to this kind of error and reward type circuits. And we know that this task does that. Matt, here, as on note, this claim that the goal was not to make them perform better or worse in this task. What I would want to see to know that that is true is a pre-registration where people said that, right? We're going to do the game, but we don't actually think anybody will perform better or worse. Because that's kind of what the paper says now. But I wonder if the people had performed better in the like high dose condition the one where they're told would that really have been presented as this was you know not a part of our
Starting point is 02:22:33 goal like yeah yeah this is contrary to our expectations um yeah no yeah one suspect yeah yeah because because that's pretty plausible right because nicotine like some of the things he said at the beginning were all true right it's it's it's associated with especially amongst people who are like these are all vapers or smokers or people who have some level of nicotine addiction so like speaking from personal experience give them some nicotine and you'd probably expect their attention and cognitive performance to be slightly better. Yes, correct. So that would be the expectation.
Starting point is 02:23:13 Maybe their mental expectation could trip over into performance, right? It's not implausible, but it's just highlighted here that they didn't think that was going to happen. And you're like, hmm, I'd be curious if that were the case. Anyway, what the paper found overall, here's a general summary provided from Huberman after he goes through it a bit. Now, a number of things happen, but the most interesting things are the following. First of all, people's subjective feeling of being on the drug matches what they were told. So if they were told, hey, this is a high amount of nicotine, like, yeah, it feels like a high amount of nicotine.
Starting point is 02:23:50 And these are experienced smokers. If it was a medium amount, they're like, yeah, it feels like a medium amount. If it was a low amount, they think it was a low amount. Now that's perhaps not so surprising. That's the placebo effect. not so surprising. That's the placebo effect. But if you look at the activation of the thalamus in the exact regions where you would predict acetylcholine transmission to impact the function of the thalamus, so these include areas like what's called the centromedian nucleus, the ventroposterior nucleus, the names that really don't matter, but these are areas involved in
Starting point is 02:24:21 attention. It scales with what they thought they got in the vape pen. Meaning if you were told that you got a low amount of nicotine, you got a little bit of activation in these areas. If you were told that you got a medium amount of nicotine and that's what you vaped, then you had medium amounts or moderate amounts of activation. And if you were told you got high amounts of nicotine, you got a high degree of activation. And the performance on the task, believe it or not, scales with it somewhat. So keep in mind, everyone got the exact same amount of nicotine in reality. So here, the belief effect isn't just changing what one subjectively experiences. Oh, this is the effect
Starting point is 02:25:03 of high nicotine or low nicotine. It actually is changing the way that the brain responds to the belief. And that to me is absolutely wild. Okay. So that's the key result, isn't it? So I read the paper, but I've mostly forgotten it, Chris. Refresh my memory. They basically have got these different conditions, everyone got the same amount of nicotine. People told they got given different amounts and then when they had people in the fmri machine that are doing this task they found that those attention related regions of the pfc were more activated in the higher conditions. Yes? Yeah. So there's a bunch of results that they look at and report.
Starting point is 02:25:54 And they report, as he highlights at the start, the subjective thing that, you know, self-reported belief about dosage reflects what they were told, which makes sense, because why would they think otherwise and then they look at a bunch of activity in in the brain right and they have those little brain scans that you want from fmris looking at the thalamus and accumbens neural patterns. That's the other one, figure two and figure nucleus accumbens. You familiar with those, Matt? Not really. No. Well, but in any case, you've got like a little brain with bits lit up, and then you've got
Starting point is 02:26:36 various figures illustrating the effects. And the way Huberman presents it is that the effect is dramatic, that you can see it in the Brien's reactions, not just from the self-report. That's the crucial thing. But Matt, when I went and looked at these figures, okay, so first of all, you have one where you have parameter estimate representing reward-related activities extracted from an independent Falmus mask. Okay, whatever the case. So some part of the fMRI result extracted and then plotted. And then they split that out by category,
Starting point is 02:27:18 and they have the little amounts in each plotted on bar graphs with the distribution shown now here important to note is there's no significant difference between any of the groups except for the low to high group and then the significance is 0.04 0.04 right 0.036 to be precise. What was the N in this again? The N in this study overall is around 24 to 20 per condition. Yeah, yeah. So pretty typical for an fMRI study. Yeah, and the other thing too is,
Starting point is 02:28:05 like you read out with some of their methods descriptions there, this is the issue with these really high-tech studies, which is that they apply some mask that identifies a particular kind of little region. And, you know, there could be nothing wrong with that. That could be totally orthodox. But unless you are like an fMRI guy and are fully familiar with the software and all these things you really have no idea about the
Starting point is 02:28:30 research degrees of freedom that are involved there you don't know how much like was there any tinkering with with parameters are there different masks they could have had a look at there's like so many things there that are just, it's a bit of a black box. And I think that's what, you know, at least for me, it just increases my level of skepticism. But even that aside, even if it was a really simple methodology that you could really understand, you know what I mean, like a simple behavioral measure which you just counted something,
Starting point is 02:29:00 you know, something you could easily wrap your head around, it was all pre-registered. Even if all that were the case, yeah with that sample size and only finding one significant effect between the three groups that they looked at and it being p equals 0.04 all of those things would make me go yeah i mean i wouldn't put a huge degree of credence in it and this is not to say that chris i mean i wonder what you think about this because i've detected a note of skepticism from you regarding the effects of placebos having actual physical effects on the body but i mean my rough understanding of it is is that it's not a priori totally ridiculous like it is
Starting point is 02:29:42 it you know the mind and the body if we're going to do cartesian dualism are sort of intimately related they both have effects on the other and if if you believe something is true then it's going to have these psychological effects which are going to translate into physical effects at some point right yeah i have no skepticism about the placebo effect existing or that it um like you say, you know, what people expect about things that, you know, where else is it going to show up? Even the fact that the people's subjective self-reporting is different. It wouldn't be a surprise for me to find that, you know, you could find correlates with brain
Starting point is 02:30:18 activity that represent that. So it's not a huge reach, but it's the one, the evidence here is not hugely persuasive to me because like you said, the limitations of sample size, the fact that, so there is another figure towards the end, which is looking at foulness, the ventral medial prefrontal cortex functional connectivity. And there they say they do find a difference between the three conditions, right? But like, again, it's all this stuff where how many different measures you have on the fMRI, right? And you have the ones that are reported in the paper at the end.
Starting point is 02:31:01 And even then, they're highlighting ones which are on the verge of significance in a bunch of cases. But I would not be surprised if there are very many other possible candidates that are on the file drawer. And the way that you could prove me wrong about that is by pre-registering the study and saying which measures you're going to focus on right and in the absence of that and the absence of various replications my initial stance is skepticism but not skepticism overall like i and if the actual effect was validated it wouldn't destroy my worldview or anything because i expect the placebo effect to exist yeah i, I think this is a great example of where pre-registration would really, really help because you have this really sophisticated technology.
Starting point is 02:31:50 You have a bunch of different things, a bunch of different areas, a bunch of different co-activation of different areas. My assumption is that there's a huge number of options there. And, you know, it is tempting to suspect that they looked at more than just the two, the two ones where they found a significant difference. You have to suspect that they did.
Starting point is 02:32:10 But when they came to write up the paper, it's kind of human nature to focus on the interesting bits, right? Right. Yeah. And the authors often overhype things or present them in a dramatic fashion because this is what journals also like to see. So I'm not surprised at that. But the point of a journal club is that you are not the author, right? So you should be
Starting point is 02:32:30 approaching things critically. Otherwise, you're just the PR person for them. And so this is Huberman talking about the results. And let's see if he's looking at them critically or overhyping. What I find just outrageous and outrageously interesting about this study is simply that what we are told about the dose of a drug changes the way that our physiology responds to the dose of the drug. And in my understanding, this is the first study to ever look at dose dependence of belief effects, right? To really, and why would that be important? Well, for almost every study of drugs, you look at a dose dependent curve.
Starting point is 02:33:13 You look at zero, low dose, medium dose, high dose. And here they clearly are seeing a dose dependent response simply to the understanding of what they expect the drug ought to do. In other words, you can bypass pharmacology somewhat. That last line. Yeah, I think that's a big stretch. There's some evidence of placebo effects having measurable physiological effects, I think, even in the treatment of depression or something like that. But they're reasonably weak, I think. It's certainly not something that you could use to bypass pharmacological interventions, I would think.
Starting point is 02:34:08 interventions i would think yeah and so i want to contrast a little bit with the way adia responds when he sees this study right so he's he's looking at the same figures that i was highlighting and listen to his response look at figure 2b am i reading this correctly so it's got um four bars on there You've got the group who were told they got a low dose, the group who was told they got a medium dose, the group that was told they had a high dose, and then these healthy controls who presumably were non-smokers who were just put in the machine. That's right. Yeah. Yeah. This is measuring parameter estimate. What is that referring to their ability to play the trading game? The parameter estimate is the activation reward related activities from independent thalamus mask, right? So what they're doing is they're just saying, if we just look at the
Starting point is 02:34:59 thalamus, what is the level of activation? I see. So this suggests that the only statistical difference was between the low and the high. That's right. And nobody else was statistically different. That's right. But that's not the whole story. Yeah. So like him was super excited about it being a dose dependent relationship.
Starting point is 02:35:18 Right. But it's actually just the like nothing and the high one. So that's, but yeah, I mean, because... No, so he points out, Matt, just to give Huberman his jury. He does justify that claim by pointing to the 4b figure. Ah, okay, fair enough. And he says this. So figure 4b, if you look at parameter estimate so
Starting point is 02:35:46 this is the degree of activation between the thalamus and the ventromedial prefrontal cortex and it's called the instructed belief you can see that there's a low medium and high scatter of dots for each and that each one of those is significant so he he's saying no look at the solar measure you do see a difference between the conditions right on this one so just just so i understand they they observed a difference in the degree to which the thalamus was communicating with the prefrontal cortex right um but they didn't see any differences in performance on this game. So there's this activity which is supposedly indicative of better concentration, better signals and noise filtering or whatever, but it's not yielding any measurable changes in performance.
Starting point is 02:36:43 Yeah, I actually tried to go in because the reporting of the result of the behavioral measure wasn't completely clear i downloaded the file and had a look and uh i think they are claiming some signal like you know one that relies on like interpreting a particular kind of result and like way that you know you measure not not like an obvious right straightforward better performance overall but they're not they're not emphasizing that in the paper in any case so no this is about the activation in those conditions and in particular the the activation of the kind of network not the actual areas themselves yeah yeah yeah this sort of binding or whatever is going on but don't you think that's odd just
Starting point is 02:37:34 stepping back a moment that like if it were true that there was this placebo effect resulting in measurable changes in significant brain activity and that brain activity is meant to be indicative of better concentration and all of these things, that the fact that you don't see a difference in the primary behavioural measures is revealing. And I say that because the behavioural measure, like the simple scores of this game, is probably far less amenable to researcher degrees of freedom, Chris.
Starting point is 02:38:06 Like my suspicion is that you've got a lot of choices in terms of how you want to slice and dice your fMRI images. But, you know, with these standard games, economic games they set up, there isn't so much wiggle room. Yeah. So I would be inclined to think the same and actually adia is somewhat again notes
Starting point is 02:38:28 hits a skeptical note about focusing on this relationship measure instead of the the actual division in the areas yeah yeah so he says this so isn't it interesting that at the thalamus, which is and you'll you'll immediately appreciate my stupidity when it comes to neuroscience, which is more proximate to the nicotinamide or nicotine that nicotinamide. What do you call it? The nicotine acetylcholine receptor. You have a lower difference of signal strength. And somehow that got amplified as it made its way forward in the brain. Yeah. Does that surprise you? It is surprising. And it surprised them as well. The interpretation they give, again, as we're talking about before, important to
Starting point is 02:39:15 match their conclusions against what they actually found, which is what we're doing here. The interpretation that they give is that it doesn't take much nicotinic receptor occupancy in the thalamus to activate this pathway. But they too were surprised that they could not detect a raw difference in the activation of thalamus. But in terms of its output to the prefrontal cortex, that's when the difference showed. That figure 4B is more convincing than figure 2. Because even figure 2E, if you read the fine print the r
Starting point is 02:39:47 the correlation coefficient is 0.27 it's not that strong right it's weak so at the thalamus it's kind of like yeah there might be a signal and then the scatter graph he's mentioning as well like to say that there is a weak signal is perhaps a very scattered scatter graph yes it's a very scattered graph like you know color coded for high medium and low and if you can discern the pattern there you're um like yeah so anyway so idea throughout this i think i'm pretty much on board ad is coming at this stuff pretty much exactly the same way that I would. But I get the vibe that with Huberman, he's kind of got the stance of a believer, right? It's like, this is a really cool study.
Starting point is 02:40:34 It's very exciting. These results were amazing. Oh, there's some inconsistency. There's some weak spots. There's surprising that this doesn't happen. And he's kind of looking for explanations rather than saying well actually this it doesn't it's a weakness yeah and every time adia raises a point he's like this is what we do at journal club we you know we take things if i'm like but but you aren't like if adia wasn't
Starting point is 02:40:58 here basically you would have used the perfunctory you know this is a pre-print i'm not saying it's the be all and end all but adia is the one that is actually saying, well, but hold on. Like, so they didn't find this result in this one and so on. And there's a good contrast where you can see when they talk about sample size, which again, Adia raises here. By the way, this goes back to our earlier discussion. There could be a huge signal here and we're underpowered. How many subjects were in this? You wouldn't have a lot of subjects in this experiment. Yeah. No. And this just speaks to the general challenge of doing this kind of work. It's hard to get a lot of people in and through the scanner. Yeah, and it's expensive. And it's expensive. I should know this, but we can go back to the methods. But you can sort of just look at the number of dots on here. I mean, it's in the low tens, right? It's like 40, 30, something like that. So it's possible you do this
Starting point is 02:41:50 with a thousand people. This could all be statistically significant. Right. So they talk about this. Based on this, we estimate that an N of 20 and a sample size in each belief condition, the final sample would provide 90% power to detect an effect of this magnitude at an alpha of 0.5 in a two-tailed test. Okay. So that's them referring to what we just talked about, which is we believe at 90% confidence to get an alpha of 0.05, which means we'll want to be 95% confidence. We need 60 people, 20 per group. Right. Yeah. But if the difference is smaller than what they expected, they'll miss out on some of the significance, which that looks like they're missing between the medium and high group. Yep. And I too was surprised that they did not see
Starting point is 02:42:35 a difference between the medium and the high group, but they did in the output of the thalamus. I was also surprised that they didn't see a difference. This is kind of interesting in its own right. If figure three talks about the belief about nicotine strength did not modulate the reward response, the dopamine response. How was that measured? Also just in fMRI. Yeah, exactly. So if you look at figure three B, other people can't see it, but basically what you'll see
Starting point is 02:42:59 is that there's no difference between these different groups in terms of the amount of activation in these reward pathways. Right. there's no difference between these different groups um in terms of the amount of activation in these reward pathways right but adi is framing there is kind of kind right because he's suggesting that the study is underpowered and that's why you get these non-significant effects but the other possibility is that being more highly powered you would find that like uh yeah you could confirm you could confirm the effects are either non-existent or extremely small and yes exactly right yeah human keeps refining keeps referring to the findings are surprising like surprising they didn't find this difference surprising they didn't find that difference but it's it's not surprising though is
Starting point is 02:43:39 it i mean if your assumption is that if there's an effect here it's probably quite small and you've got a small and study then not surprising at all you know no no it would be surprising if you assumed the effect was huge and yeah exactly and so you know again i think that some people will regard that as like well you know this is just a difference in character you you know, Hooperman isn't allowed to get excited about a study. But I want to show the conclusion that he reaches. Having gone through this, and I talked about all these issues about small sample size, and actually they didn't find a result in two out of the three measures that they're using in the fMRI and not the behavioral measure, then... So, you know, my glee for this experiment is not, or this paper rather, is not because I think it's the be all end all, or it's a perfect experiment.
Starting point is 02:44:32 I just think it's so very cool that they're starting to explore dose dependence of belief, because that has all sorts of implications. I mean, use your imagination, folks, whether or not we're talking about a drug, we're, folks, whether or not we're talking about a drug, we're talking about a behavioral intervention, we're talking about a vaccine, and I'm not referring to any one specific vaccine. I'm just talking to vaccines generally. I'm talking about psychoactive drugs. I'm talking about illicit drugs. I'm talking about antidepressants. I'm talking about all the sorts of drugs we were talking about before, metformin, et cetera. Just throw our arms around all of it. What we believe about the effects of a drug, presumably, in addition to what we believe
Starting point is 02:45:18 about how much we're taking and what those effects ought to be, clearly are impacting at least the way that our brain reacts to those drugs. A little concerning. A few notes there that are concerning to me. Yeah. So, you know, because the first bit is like, you know, this isn't the perfect experiment, which is fine. That's good. But then it's like the implications about this dose-dependent effect are stunning, right?
Starting point is 02:45:47 They reach across all vaccines, like he references vaccines there. And he's quick to say, I'm not talking about any specific vaccine. This, I think, harkens to Huberman's absolute allergy to discussing vaccines in a positive way during the pandemic. But even if this were true matt right
Starting point is 02:46:07 vaccines what implication does this have because whatever your internal assessment does right like the extra power or whatever it adds it is not giving your immune system the information to help it fight a virus that it hasn't encountered right so that's right there's a huge difference i mean well first of all chris before we forget i just i just don't get his enthusiasm for this why it's so exciting that there's like a dose dependent relationship like they had a low medium and high condition in terms of the placebo that's been done heaps right you can give people a blue pill or a bright red pill or a you know medicine that tastes really strong or one that doesn't and you see these effects i mean you could vary the dose i don't understand why that's such a big deal but as you say the main thing is that you can see these
Starting point is 02:46:55 like placebo type psychosomatic effects which i accept are almost certainly real to some degree because the psychology interacts with the neurophysiology and percolates down into the body. And you could see effects even further afield in terms of cortisol levels or stress and things like that. You're going to see effects on things that are more psychosomatic or things that are more related to psychology. And that's why this study here is more plausible than, say, some of those other ones like the hotel people working
Starting point is 02:47:26 away because like that's that's just straight up metabolism right and it's happening over a period of weeks that's fairly different from from this which is about concentration and reward processing and stuff like that stuff which is actually more tightly connected to how you perceive things and like psychological effects but then when you actually go even further afield to like how the immune system works and you're talking about what t-cells getting trained to recognize antibodies and stuff like that and you're like the idea that there's going to be a placebo effect there um and that this has some implications for how other types of all kinds of drugs but including vaccines should be administered or or approached that seems nuts to me that's a huge it's not just a stretch it's it's a huge galloping flying leap yeah and and just to be clear that we're not over-interpreting. So he goes on a bit here.
Starting point is 02:48:28 Yeah. To take this to maybe the ADHD realm, let's say a kid has been on ADHD meds for a while and the parents, for whatever reason, the physician decide they want to cut back on the dosage. But if they were to tell the kid it's the same dosage they've always been taking and it's had a certain positive effect for them according to the results at least in this paper which are not definitive but are interesting the lower dose may be as effective simply on the basis of belief and and this is the part that makes it so cool to me is that and it's not a kid tricking themselves or the parents tricking the kid so much as the brain activation is corresponding to the belief, right? So that's where this is why, because it's done in the brain,
Starting point is 02:49:11 I think we can, you know, it gets to these kind of abstract, nearly mystical, but not quite mystical aspects of belief effects, which is that, you know, your brain is a prediction making machine. It's a data interpretation machine. But it's clear that one of the more important pieces of data are your beliefs about how these things impact you. So it's not that this bypasses physiology. People aren't deluding themselves. The thalamus is behaving as if it's a high dose when it's the same dose as the low-dose group. dose as the low dose group it's just like he's now kind of here apart from a couple of throwaway sentences but it's as if this fact effect is completely established right and that the
Starting point is 02:49:54 implications are stunning and what he describes is like he says you know it wouldn't be unethical but like actually telling the patient that they're receiving a different dosage that is inaccurate on the basis that their placebo reaction will potentially produce the same effect like no that is not ethical right and it's relying on you know an over extrapolation which is that you could produce these exact same effects and you know especially when he just talked about vaccines and stuff in the preceding discussion you're like yeah but that it doesn't work like that right like that you say you might be able to get it for some specific occasions or individuals or some specific drugs and maybe you can but the way that he's presenting it is like well this looks like it
Starting point is 02:50:47 can produce the same effect as taking the drug just tell someone that they're taking like a stronger drug and that will do all the same stuff and you're like yeah i know it's like the general theme and it's consistent with what we've seen of human before is just that kind of wild exuberance or you know overconfidence in in particular studies and and running with you know as you say apart from the kind of throwaway studies which is you know further research required etc but you can kind of tell that he kind of believes it and runs with it and is forms a like a view of all of these things, which is informed by the assumption that a lot of these studies are largely confirmed. The extrapolation is really quite large too.
Starting point is 02:51:33 I've got to keep delineating the reasonable and the unreasonable version of these kinds of things. A reasonable version is if you're wanting to quit smoking and say you're vaping, a good way to go about it is to gradually reduce the nicotine in your mix. All of the behavioral type of things are kind of the same. The sensory motor type feeling is the same.
Starting point is 02:51:53 And you're sort of disconnecting the physiological substance addiction from all of the psychological aspects of the addiction, and it's easier to sort of divide and conquer and quit that way that's that's a super reasonable application of what um he's talking about but but going on to and maybe we can do it for this and give it to kids with adhd we can tell kids and vaccines or any any supplement or any kind of medicine you can imagine just believe it and make it so um that's that's a wild extrapolation from what is a very weak set of results in this study yeah and and i know the vaccination one just like stuck with me but just that doesn't make any sense because it applies that the the kind of biological process for which vaccines work is manipulated by the
Starting point is 02:52:47 strength of believing in the vaccine but like vaccines work by giving the immune system experience of a particular kind of virus so you can store the the relative instructions for when you encounter the actual virus so just like that you can't do that through yeah your your mental power just think about covid right just think about it a lot there are some aspects of our physiology which you can control psychologically right like if you if you sit down you take deep breaths and you think calm thoughts you can reduce you can reduce your heart rate right there's lots of we could make a big list of things that are kind of controllable but there's there's a lot of things which really are not right and for the operation of the immune system except perhaps when the very limited degree of maybe if you're super stressed or something like
Starting point is 02:53:43 that then you know maybe that's going to have an effect but you know largely yeah it's just over extrapolation is how i would describe it yeah and so one last example matt before we get into rounding up on this episode so i think another good illustration it comes from much earlier in the discussion, where it shows the differences between them. And a little bit, I think, Huberman's particular interests come into play. So this is talking, Addy is talking about limitations, again, of research, and to get onto the topic of comparing mediators and non-mediators. Yes, although, again, this is a great opportunity to talk about why no matter how slick you are, no matter how slick your model is, you can't control
Starting point is 02:54:29 for everything. There's a reason that to my knowledge, virtually every study that compares meat eaters to non-meat eaters finds an advantage amongst the non-meat eaters. And we can talk about all the lifespan advantage. Yes. And we can, or disease, you know, incidence studies. And yeah, it might be tempting to say, well, therefore, eating meat is bad until you realize that it takes a lot of work to not eat meat. a person makes. And for a person to make that decision, they probably have a very high conviction about the benefit of that to their health. And it is probably the case that they're making other changes with respect to their health as well that are a little more difficult to measure. Now, there's a million other problems with that. I picked a silly example because the whole meat discussion then gets into, well, when we say eating meat, what do we mean? You're not talking about it as like deli meat versus grass fed.
Starting point is 02:55:26 Or a deer that you hunted with your ball. That's right. So how do we get into all those things? But my point is, it's very difficult to quantify some of the intangible differences. And I think that even a study that goes to great lengths, as this one does, epidemiologically, to make these corrections can never make the corrections. And so for me, the big takeaway of this study is one, this makes much more sense to me than the Bannister paper, which never really made sense to me. Yeah. Yeah. So Adia is making a good point throughout,
Starting point is 02:55:56 right? Which is worth repeating that experimental type studies and observational longitudinal epidemiological studies complement each other in a way in terms of their strengths and weaknesses and Nadia spells that out quite well the example of finding out that you know people who don't eat meat are healthier than people who do eat meat is a good example of where it's difficult to isolate and attribute causality to that one specific thing because it's confounded with a whole bunch of other things. Famous examples that people will probably remember the headlines to, which is drinking a glass of red wine every day
Starting point is 02:56:31 or eating dark chocolate or something is going to make you healthier in a variety of ways. It's almost certainly the case that it's other socioeconomic lifestyle correlates of those things that are having observed differences. But I feel like Hooverman is just kind of missing the point a bit when he's talking about, oh, well, yes, there's all these nuances, like was it grass-fed, was it deli meat,
Starting point is 02:56:55 or was it a deer that you hunted with a bow? That's really important. That's not what he was talking about. Yeah, just that bull hunting, you know the the reference there i wonder who that is pointing to but yeah so there's a there's a there's a difference um and this is not to say i think that adia is not part of that world also i i think he is but from my reading of this conversation i i think Addy really has chops when it comes to critically reading studies
Starting point is 02:57:28 and that kind of thing. And I'm not saying Huberman doesn't have them to some degree, but it definitely looks to be like a pre-replication crisis academic approach to reading papers. Yeah, yeah, I think that's fair um that is an interesting case isn't it because he like huberman is very much a self-experimenter he he talks about how he went on was it metformin i'm forgetting the metformin yeah forman he went on that based on the original study which which he said that he didn't really oh no no no he went
Starting point is 02:58:01 on it before even the banisterister study. Oh, okay. Yeah, I made that mistake. But he did kind of point out that the Bannister study was the, you know, the big thing that made it, like, become very influential. But he was on it years before. Based on even less evidence, right. Yeah. So that's interesting.
Starting point is 02:58:25 And then that one came out, and then he read this paper, which is kind of debunking the thing that he'd committed to. And he read it with like a receptive mind, shall we say. And for him, it kind of sealed the lid on this thing. And it's just an interesting combination of things because, like you said, he clearly can read studies. He's got a good sort of scientific approach to these things um that he's also a self-experimenter and is yes on one hand he does reevaluate like he is he's
Starting point is 02:58:50 reevaluating his yeah his choices based on the new evidence that comes in but it's just interesting that he he sort of is is yeah i'm impressed at the level of conviction that we see amongst like adi or whatever because you know they're talking about years of their life dedicated to taking something which they think actually it wasn't yeah and it's sometimes extremely dysphoric right like it makes yeah not eating yeah or it makes them nauseous for for days you know um yeah like i you know you gotta you gotta hand it to them it's impressive to do that um i guess yeah i so my take on this whole area like this content that we're covering is it is a separate area and it's much more aligned with the kind of academic sphere in a way
Starting point is 02:59:41 this is people sitting down and talking for hours about studies, doing critical analysis of studies, or at least purporting to, and lots of the information that they give, I think, is good, is valid. Unlike, say, a Brett Weinstein, where I think if you listen to it, you're actively being misinformed about the method. Yeah, that's right. These guys are like many many many rungs above above heather and brett for instance um yeah yeah so so our criticisms are you know a kind of a little bit subtle i suppose or not subtle well that's not the word but we're we're hitting some finer points except with the the vaccination thing that that's that's that's a big one with human yeah with human yeah
Starting point is 03:00:26 with human yeah but i mean i'm not quite sure how to think about these guys because on one hand like you can think of them as enthusiasts and as this being a very serious hobby you know some people are into model trains some people are into succulents for them this self-experimentation and optimizing their strength and their fitness and their health and their longevity and all that stuff is is like a an odd hobby like bodybuilders yeah like bodybuilders or people that are into piercings or whatever where you wouldn't necessarily recommend it to everyone everyone but it's like well you do you that's that's that's fine but i suppose you have to be careful when it comes to health and wellness because you know there's a reason why vaccines
Starting point is 03:01:10 attract so many delusional beliefs and conspiracy theories there's a reason why the supplement industry is worth untold billions of dollars and because i think it's different from model trains or or succulents in that i think people have an underlying vulnerability to these existential issues about death and about health and the relative levels of different micro particles in your blood and all this kind of thing. Like, Huberman never did an episode recommending vaccination, which is the most scientifically supported and lowest cost intervention for your health. And he steered away from it because, I'm extrapolating, but he's clearly implied that he doesn't want the alien part of his audience and that. But if you were a guy that was just about the science, about health optimizing, then you're willing to talk about these controversial things like metformin right which haven't been
Starting point is 03:02:30 proven you'll talk about them at some depth and yet you won't touch vaccination and you're good friends with joe rogan and all the influencers set and you're promoting supplements that's what makes me raise the eyebrow that it's not about that everything that Herman says is bullshit or the things that he promotes are wrong but like it is a kind of spin off the health and wellness space
Starting point is 03:02:58 I think it's health and wellness for men and that's why in a part of it I think the scientific aspect has an appeal, right? Because you're not doing dieting, you're doing optimizing, right? And so one thing that people dinged me for before when we talked about Huberman is saying like, he doesn't have his own supplement brand, right? He actually works with another company.
Starting point is 03:03:24 So let me just play the clip of him promoting supplements. Please also check out the sponsors mentioned at the beginning and throughout today's episode. That's the best way to support this podcast. Not so much on today's episode, but on many previous episodes of the Huberman Lab podcast, we discuss supplements. While supplements aren't necessary for everybody, many people derive tremendous benefit from them for things like enhancing sleep, for hormone support, and for focus. The Huberman Lab Podcast
Starting point is 03:03:50 has partnered with Momentous Supplements. If you'd like to access the supplements discussed on the Huberman Lab Podcast, you can go to livemomentous, spelled O-U-S, so it's livemomentous.com slash Huberman, and you can also receive 20% off. Again, that's livemomentous, spelled O-U-S, dot com slash Huberman. So I just, as I said, if you don't think Huberman's shilling supplements,
Starting point is 03:04:12 like, my God, he gives you the discount code at slash Huberman. If you go, his picture is there with, you know, Momentous X Huberman and um and that disclaimer not everyone needs supplements right or not everybody requires it but then immediately into but there are great benefits people find tremendous benefits for blah blah it is that's a that's the nature of a disclaimer right oh yeah and the whole the whole show is all about really being quite hypey about the amazing benefits of this, that, and the other supplement. And, yeah, the obligatory caveat, which is, you know, consult your doctor and see whether this is right for you. Yeah.
Starting point is 03:04:54 It's not, it doesn't hold water. And, yes, you could be selling supplements without owning a supplement company. There's a thing called affiliate marketing. It's out there. So, yeah, I mean, and I don't really pay the defense of, oh, well, I'm not going to talk about COVID or the vaccines because that's not my speciality. I'm not qualified to. But, you know, Huberman clearly considers himself qualified enough to talk about a wide range of different things that are not in his speciality why why carve out
Starting point is 03:05:26 an exception just for this one particular thing that joe rogan and the rest of the self-optimizing bros have got to be in their bonnet about um no it's quite obvious what's going on there yeah yeah so well that's that's it matzy this is why I thought it's good to go back into these waters, because I do think there's differences here from a lot of the more dramatic secular guru types that we cover making their profound conspiratorial statements. I do think this is an ecosystem where the kind of science-y aspect gets more play. But if you're consuming the content here, my recommendation, as it is with all of the content we cover, is just be skeptical. You can like Huberman. You can find that they give really good advice about caffeine or sun exposure or
Starting point is 03:06:20 whatever. Moving bottles of water. But be wary when he's talking about small land studies and overhyping them. Yeah. That's fair enough. I've got a final thought to leave you on, Chris, which is if we take Puberman's bullish approach to these placebo effects at face value, totally re-evaluating our approach to pretty much all medications and supplements,
Starting point is 03:06:49 then we could be taking sugar pills instead of the athletic greens or that other stuff you were just talking about there. Oh, yeah. Why didn't they go there? That's an interesting thing. You don't have to pay $80 for a three-month supply of whatever, the Hyperzone X. You just take some sugar pills and believe and believe yeah that's a good point yeah i didn't think about that i wonder why that wasn't what the takeaway was so yes a nice
Starting point is 03:07:13 a nice point to end on uh if it's all in the mind supplementation is a full zerun just oh you actually just take homeopathy because there's nothing there anyway um except whenever they're producing places with low quality control and there are actual toxins and that's so maybe don't there yeah just just eat a biscuit and tell yourself it's a hyper brain enhancing no tropic or new tropic whatever you pronounce it. So there we are, Matt. There we are. That's him. Yeah, that's right.
Starting point is 03:07:48 I don't think they're going to score particularly highly on the grommeter, but they're both going to be fed into it. And we said enough positive things about them. We don't need to pick out any particular thing. No, no, we don't. Goodbye and good luck, everyone. Hope you enjoyed it.
Starting point is 03:08:03 It's kind of a decoding academia meta. Oh, yeah, you're not signing out yet, Matt. You don't. Goodbye and good luck, everyone. Hope you enjoyed it. It's kind of a Decoding Academia meta. Oh, yeah, you're not signing out yet, Matt. You don't get off that easy. Oh, God damn it. We don't have a review of reviews this week, but we do have Patreon shoutouts. I know you're so loathe to thank people, but here I am to drag you down to their level and and to get you to
Starting point is 03:08:29 reward their kindness their generosity so shall i begin matt please do please do okay uh conspiracy conspiracy hypothesizers, the fruit soldiers in the Decoding Wars. We have Sam Offit, Joe Percy, No Lips or Joints, Sonia Benito, Matty Laycock, Marco Tresh, Young Bai,
Starting point is 03:08:58 Andy Walters, Dish, Gerard Sanderson, Nico Pomato, The Rootledge,erson, Nico Pomato, TheRootledge, Stephanie, Alan, Paul, Durka Palustris, MJson,
Starting point is 03:09:12 Yuki, Amy Hendrigan, Louise Nash, Jonathan Baker, Teddy Garland, Richard Husband, Anthony Pino, NotTheBeans, and Josia Martins. Fantastic. Thank you very much, everybody.
Starting point is 03:09:30 Conspiracy, hypothesizers, thank you all. I feel like there was a conference that none of us were invited to that came to some very strong conclusions, and they've all circulated this list of correct answers. I wasn't at this conference. This kind of shit makes me think, man, it's almost like someone is being paid. Like when you hear these George Soros stories, he's trying to destroy the country from within.
Starting point is 03:09:53 We are not going to advance conspiracy theories. We will advance conspiracy hypotheses. All right, you will, you will. Now, how about matt revolutionary thinkers of a few of those the people that can get access to the decoding academia hear us over hype small end studies that would include people like dag soros the norwegian comedian gretchen Koch, cartoonist. Ben Neihardt, anonymous ethicist, not a serial killer at all, just
Starting point is 03:10:29 asking questions. I feel he's re-racked before, but nonetheless, thank him again. Jar Gar, Magnus Glerem, Lindsay Kate Frey, Will, Catherine Collins, James Glover, Ed Smith, Randy Maranon,
Starting point is 03:10:48 Gavin Boynton, Michael, Jorgen, Joseph Necht, Amy Poza, Alessio Zaccaria, Samantha Hines, Christopher Innocent, John Butler, and George Tornay. Wow. A lot of them. I'm usually running, I don't know, 70 or 90 distinct paradigms simultaneously all the time. And the idea is not to try to collapse them down to a single master paradigm. I'm someone who's a true polymath. I'm all over the place. But my main claim to fame, if you'd like, in academia is that I founded the field of evolutionary consumption. Now, that's just a guess, and it could easily be wrong, but it also could not be
Starting point is 03:11:31 wrong. The fact that it's even plausible is stunning. Thank you, everybody. Thank you, revolutionary thinkers. Well, I think we've shouted out enough people for this week, so we'll end there, Matt, with the Revolutionary Thinkers. Do you have anything you would like to let our listeners know to end with? Okay. All right.
Starting point is 03:11:53 Thank you, Chris. It's been fantastic. Good fun. Bye, everyone. Ciao. Bye-bye. Bye-bye. See you next week. Thank you.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.