Science Friday - AI Word Choice | When Dwarf Lemurs Hibernate, Their Chromosomes Do Something Odd

Episode Date: March 27, 2025

Certain words are overrepresented in text written by AI language models. A study investigates why such patterns develop. Also, the ends of chromosomes, called telomeres, typically shorten as an organi...sm ages. But when some fat-tail dwarf lemurs hibernate, they lengthen.‘Delving’ Into The ‘Realm’ Of AI Word ChoiceSeveral years ago, some eagle-eyed readers of scientific papers noticed an unusual trend—an increase in the number of abstracts using certain words. The terms, including “delve,” “realm,” “evolving landscape,” and more, were suddenly appearing more often than they used to.Researchers analyzed the abstracts and compared them to abstracts written just a few years earlier, before the widespread availability of artificial intelligence large language model chatbots. They came to the conclusion that abstracts written by AI were more likely to use words from a list of around 20 favorites than regular human speech. The question was, why? If the models were trained on conventional writing, how did a preference for words such as “delve” creep in?Host Flora Lichtman talks with Dr. Tom Juzek and Dr. Zina Ward of Florida State University, who set out to try to understand the origins of some of AI’s favorite words.When Dwarf Lemurs Hibernate, Their Chromosomes Do Something OddThe fat-tail dwarf lemur is one of the only primates that hibernate for the winter. A new study published in the journal Biology Letters takes a closer look at what’s going on inside lemur cells when they are in this extended phase of suspended animation. It turns out that their telomeres, the ends of the chromosomes, actually grow longer when the dwarf lemurs hibernate. Typically telomeres shorten as we age, as cells continuously divide. So, what exactly does this finding mean for lemurs and other primates, like humans?Host Flora Lichtman talks with the co-authors of this study, Dr. Marina Blanco and Dr. Lydia Greene, research scientists at Duke University.Transcripts for each segment will be available after the show airs on sciencefriday.com. Subscribe to this podcast. Plus, to stay updated on all things science, sign up for Science Friday's newsletters.

Transcript
Discussion (0)
Starting point is 00:00:03 This is Science Friday. I'm Flora Lichten. Today in the podcast, the annoying words large language models overuse. And what that means for how we talk. It's like someone pulled a switch and here's the elf. Here's intricate. You know how when you read something, you can sometimes get a picture of the person who wrote it. Like if I start talking about touching base to synergize after we circle back, first of all, please call for an intervention. but second of all, you might reasonably suspect that someone from the e-suite got a hold of the script. Or if I talk about giving 110% or winners don't quit, you might clock me as a sports person. Well, in recent years, people started noticing that AI chatbots, large language models, had their own linguistic tells. Certain words that seem to crop up a lot more often in AI sentences than in human English.
Starting point is 00:01:03 Words like delve. and realm. And it wasn't subtle. It was a big sudden shift in word usage. Joining me now to talk about that are two researchers who decided to delve into the realm of AI linguistics. Tom Uzek is an assistant professor of computational linguistics in the Department of Modern Languages and Linguistics. And Zina Ward is an assistant professor in the Department of Philosophy, both at Florida State University in Tallahassee. Hello to you both. Welcome to Science Friday. Hi. Thanks for having us.
Starting point is 00:01:34 Yes, thanks for having us. Tom, I have to know more about AI vernacular. What are some of the words that AI loves to overuse? Some of the words that we found, and it's quite a list, is the more obvious ones, like Delph, Garnet, Realm, an evolving landscape. Evolving landscape is one of them? I've seen that a lot. So I think that's a candidate. And the more subtle ones are something like underscore, emphasize and showcase it. How did you figure this out?
Starting point is 00:02:15 It started with a discussion on social media that people noticed that certain words, especially Delft, really suddenly popped up everywhere, especially in scientific writing and education. And so people started to look into these more systematically. But then what interests us from the beginning was the why is that happening? Why does this happen? So our hypothesis, which we investigated with a couple of different experiments, is that the models prefer these words because they were trained on human feedback, where the humans exhibited a preference for those words.
Starting point is 00:02:52 So that's the thing we wanted to test, the idea we wanted to test. And in short, what we did is ran a couple of online studies where we asked participants to judge the quality of abstracts with and without those words. And we found in the most recent run of the study that participants do exhibit a very slight preference for abstracts with words like showcase and underscore and comprehend. And so the models are trained to produce responses that human evaluators like. The models learn from human feedback in a certain stage of their training. And so if these human evaluators are exhibiting that preference, the models are going to pick up on that and reproduce those words more frequently. So that's what we think is
Starting point is 00:03:37 happening. That's so fascinating. I mean, to me, delve and evolving landscape really feel like words I might hear in a Silicon Valley conference pod or whatever. Is that a coincidence? I mean, is that who's training these models? Well, we don't know for sure. Tech companies don't publish the details of their training procedures, but it seems likely that the workers in general are, employees in the global south. The tech companies often outsource that kind of labor to countries where wages are lower. And so those workers are seeing potential outputs from the models and providing their feedback on which ones are higher quality. And then the models are being trained to reproduce those sorts of responses. So it's really probably the preferences of these employees
Starting point is 00:04:24 in the global south that are filtering through and shaping the lexical choices of these large language models. Yeah, that's fascinating. Tom, I mean, we've seen linguistic fads before. You know, I'm old enough to remember the meteoric rise of touch base. How is what you observed here different? Rather rapid language change is also nothing new. Touch base, looked up some millennium speak. Awesome, cool.
Starting point is 00:04:55 What they exhibit when you look at the data over the time is that they have a period. of several years of pretty steep rise, almost like an S-cur. They start to rise, then they have this period of really quickly gaining traction, and then they plateau out. Sometimes we do see a sudden spike, which is when a real-world event occurred that motivates that spike, concretely SARS or Omicrom. Now what is different than now observed changes is
Starting point is 00:05:27 that there is a sudden spike, almost like a step function with an abrupt, crew, but there's no real-world motivation why it should be Delph or intricate or nuanced. And that is different. You mean like it's, it's, it's, it almost feels random. Yeah, it's like someone pulled a switch and here's Delph, here's intricate. I mean, that seems only possible using AI, right? Because humans maybe don't change as fast. Yes. And that is one of the areas where still a lot of research is directed to, the question, do these words really sit in our language systems now? I mean, is there delve in or intricate in the abstract of a scientific article or a student essay because
Starting point is 00:06:15 people have this in their language system and this is what they put down? Or is it actually tool usage, AI usage? And so far, this is under research. I mean, it's an hypothesis one way or the other. And I think what we will be seeing sooner or later is where people look at spontaneous spoken language. And I think chances are they will find some traces of these AI words having entered the human energy system. Well, I'm really interested in this. I mean, we talk a lot about us training AI. But is AI training us? I mean, is there evidence that these AI are changing the way that we talk and we write and we think? Yeah. The state of the research is that this an hypothesis and the key here is to look at spoken language. Most research has focused on
Starting point is 00:07:06 written language. And when it comes to spoken language, I think it's fair to say we do not see these abrupt changes that we've seen in written texts. But now there is first research coming out. There's an analysis of YouTube talks, which is still scripted spoken language, where there has been an uptick of these AI-induced words. And there is research in the making, I have a student working on this, that when it comes to semi-spontaneous spoken language, conversational language, there seems to be an uptick, but that seems to be more mixed.
Starting point is 00:07:44 I mean, that, to me, seems really profound. Absolutely. I mean, and it's interesting, too, that to the extent that these models are changing our language and to the extent that they're preferring, about words are shaped by these workers in the global south that we've talked about. It's a really interesting inversion of the usual way that linguistic change happens. So linguists and historians of language have studied over time how changes in language in the Western industrialized world
Starting point is 00:08:13 trickle outward, especially in this sort of globalized culture and economy to everywhere, to other English-speaking parts of the world, if we're looking in English in particular. And what's interesting about these linguistic changes is that if our language really is being shaped by LLMs, and LLM's language is in turn being shaped by employees of tech companies in the global south, there's a kind of reversal of the usual direction of influence. And I might come in on this. There are two sides to this. One is today's produced data will become tomorrow's training data for these models.
Starting point is 00:08:51 So there's a chance that we will see a loop and all this accelerating. And then the other side, there is what one could call the creep infector. We observe AI influences human language to quite some degree. But it might well be that when we reflect on it, we might come to the conclusion, this is not something we actually want. And so some of that language that now enters our sense. system does so beyond the level of perception. And items like underscore multifaceted or necessity, they're less discussed.
Starting point is 00:09:31 But of course, that links to the discourse of a more concerning version of this creepy-in factor, which is, say, undesired political beliefs, right, that then gradually seep into our belief system. And I think this is why the research to try and identify where this model behavior comes from matters to a good degree. Can these words be used as a diagnostic, like as a way to tell that something was written by AI? Not with high confidence. As you probably know, AI detection is a really, it's a cat and mouse game, and it's really quite difficult. So we're, I think, a little bit pessimistic about the potential to use this for diagnostics. But it certainly raises eyebrows,
Starting point is 00:10:18 I think for us when we see these words, it raises questions, even if it doesn't provide a conclusive answer. Zena, you're a philosopher. Why does this interest you? I'm a philosopher of science. And so these models just fascinate me. I mean, I think like many people, I'm amazed by how well they work. And it's all the more amazing, given that we don't really understand why they work as well as they do. And so it's also a kind of intellectual challenge, trying to figure out how they work, because it's not like you can just pop the hood and look at the word choice module, right? They're really complex systems. So you have to be quite creative in how you probe them to try to figure out what they're doing. So, yeah, for me, that's why
Starting point is 00:10:58 it's of interest. It's a complex system that really requires some ingenuity to understand. And Tom, what about you? From a linguistic perspective, I mean, what we're seeing right now is almost unprecedented language change. I mean, the shifts in word usage that we're observing over such a short period of time, that's really remarkable. I say almost because we've seen in history, I mean, we've seen technology influencing language. I'm thinking like the printing press, the internet, social media. But what we're observing right now is quite something.
Starting point is 00:11:38 We could be entering a period of rapid language change. So what we're seeing is not just a year or two, a few dozen words, but really this continues for an extended period of time. This is one possibility. The other possibility is that now we had two or three years of rapid language change and it will kind of fade out. And we don't know yet what is going to happen. We'll find out.
Starting point is 00:12:02 But there is a chance that we will see considerable language change over an extended period of time. I want to thank you both for joining me today to talk about this. Thanks for having us. Thank you so much. Tom Eusek is an assistant professor of computational linguistics in the Department of Modern Languages and Linguistics, and Zena Ward is an assistant professor in the Department of Philosophy, both at Florida State University in Tallahassee. Don't go away after the break. Leamers and the weird anti-aging things that happen inside their cells when they hibernate. Yeah, I don't think we've hacked the fountain of youth yet, but I do think that this provides some sort of like tantalizing clues about how longevity can be mapped.
Starting point is 00:12:46 Up next, new research into lemurs, those fluffy, big-eyed primates from Madagascar. Specifically, we're talking about the fat-tailed dwarf lemur, one of the few primates to hibernate. Lemaologists were curious about what's going on inside their cells during hibernation, and they found something really surprising. It turns out that these lemurs, telomeres, those are the ends of their chromosomes, grow longer when they hibernate. typically telomeres shorten as we age, as our cells continue to divide. So why do their telomeres lengthen? What does it mean for how they age?
Starting point is 00:13:31 Have these lemurs tapped into some longevity hack? Here to take us into the lemur borough, our co-authors on this study, who also happen to be married to each other. Dr. Marina Blanco and Dr. Lydia Green, research scientists at Duke University in Durham, North Carolina. Welcome to Science Friday. Thanks very much for having us. Thank you. Lydia, give me the 411.
Starting point is 00:13:51 on this lemur species. What do they look like? Where do they live? What's their deal? So imagine a fluffy, fat-tailed squirrel with forward-facing eyes and human-like hands that could grasp onto tree branches and lots of fruit. And then imagine them in the western forests of Madagascar that are dry deciduous forests, maybe hanging out in a baobab and facing food scarcity during the dry season. And so they decide to curl up inside a tree hole and live off the junk in their trunk, the fat in their tail that's been stored up in the pre-obeyed. preceding season and basically curl up and just past winter by not eating, not foraging, not moving and saving a lot of energy by living off the fat in their tail.
Starting point is 00:14:30 The junk in their trunk, that's where they store all their fat in their tail? Yes, as do I. Is that unusual though? Like, is that why it's in their name? I just want to go one level deeper on the tail, I think. Yeah, I think I would say that there is a good reason to store your fat in your tail because it's a pretty safe place to put it. If you were to put your fat, around your organs or in other places in your body cavity, that might be more dangerous. We know that those fats are not great for humans either. And so putting it in your tail just as a safe place to keep it out of harm's way and you can use it when you need it. And so they can hibernate for four to seven
Starting point is 00:15:07 months a year without eating and also without drinking and without even leaving their tree hole. So they'll spend up to seven months just living off that fat. Marina, tell me about what you found in this recent study. What was the kind of the biggest takeaway? So we knew that telomere elongation was possible in some animals, particularly in hibernators. Because a few studies had been published about 10 years ago where small temperate hibernators would elongate their telomeres after the hibernation season when they had access to rich fruits. And so we knew that hibernators may have a mechanism to elongate telomeres. and we also knew at the time that hibernators tend to live longer lives than similarly size animals.
Starting point is 00:15:55 So we wanted to test if telomere elongation was also possible in dwarf lemurs, which had tropical hibernators. After we were able to sort of facilitate hibernation in dwarf lemurs at the center, we separated in two groups. And so we had the dwarf lemurs that were housed in rooms with cold temperature during hibernation and no food at all so they could live of their fats. And then we had a group of dwarf lemurs that were also housed in cold rooms, but they were given a daily ration of food.
Starting point is 00:16:29 And so the expectation was that the dwarf lemurs in the cold rooms that had access to food probably could be able to elongate their telomeres because they had, in addition to the fats, a store they have extra food. And so if they needed to protect their cells and their bodies during hyperbolems, nation that they could be able to elongate their telomeres. But what we found is that it was actually the dwarf lemurs in the cold rooms with no food, the ones that elongated their telomeres at the end of the hibernation season. And so we were a little surprised by that and sort of concluded that it was the lemurs that were at
Starting point is 00:17:06 higher risk or maybe more vulnerable at the end of the hibernation season that needed to elongate telomeres to protect themselves. What does hibernation look like for them? So during the hibernation season, these animals do depress their metabolism. They go into these long torpor bouts. But these torpor bouts are interrupted by arousals. And arousals are these short periods where limors basically heat up and go from zero to a hundred metabolically. And they stay in this arousal time for about 24 hours.
Starting point is 00:17:41 During this time, you know, heart rates go up, breathing rates go up, they actually sleep. And then after the arousal, they return, they go back down into a torpor bout. What does a torpor bout look like? Like, what does that mean? So basically, your systems are shut down to a minimum, to a sort of a suspended animation state. So during a torpor bout, your brain basically is flatlining in an EEG, your high rates go down to maybe six or eight bits per minute instead of, you know, 300 when you're active. You don't breathe for several minutes, eight to ten minutes.
Starting point is 00:18:23 Wow. You don't breathe for several minutes. No, they have apnea. So they don't breathe. Everything is really shut down. They're called to detach. So it's minimum survival mode. But, you know, you can stay like this for maybe seven to ten days.
Starting point is 00:18:37 and after that torpor bout arousals come. So there is something inherently important about arousing from a torpor bout to sort of reset your systems. And it is during those arousals where their bodies really are at a vulnerable stage, because imagine these metabolic surges that have to happen in very few hours. And I think that's when we start looking at, you know, potential mechanisms of protection that these animals have to protect themselves from these arousals that could be dangerous. And that's why you think the telomeres are lengthening is that when they arouse, like there could be a lot of damage to cells.
Starting point is 00:19:18 And so you would want some extra protection. Is that the idea? Yeah, and I was going to add more context. At some point, you need to re-warm up again to go through these arousals to sort of maintain physiological health. And so during these arousals, they're essentially burning their fats to warm up. And there's a lot of potential damage that can happen to the cells as a result of that intense fat burn. And so there might be a reason why an animal sort of at the end of the hibernation season,
Starting point is 00:19:44 when they're burning through the ends of their fat, may put a last surge to lengthen their telomeres as a way to protect the integrity of the cell at the very end of the season. I mean, Lydia, we know that telomere shortening is associated with aging. Did these lemurs live longer? Yeah, so there's a fascinating correlation between hibernation and longevity. and that mammals that hibernate tend to live longer lives than do similarly sized counterparts that don't hibernate. So in the
Starting point is 00:20:13 counterpart to the dwarf lemurs would be the bush babies that are about the same size primates, but they have much shorter lifespans, what we're in like 12 to 13 years, whereas dwarf lemurs can live to almost 30. And so we've known for a long time that there's this interaction between
Starting point is 00:20:28 longevity and hibernation, but the mechanisms are not well understood, particularly in these dwarf lemurs. And so what we found in these animals is you might expect that the stress of hibernation would shorten telomeres much faster than it would in a non-hybernator. But what we seem to find is that these animals have some ability to lengthen their telomeres to protect themselves. And maybe that is what helps them live longer lives despite the fact that they're going through these stressful periods. Well, that's what I was going to ask. I mean, does this mechanism or understanding this mechanism
Starting point is 00:20:58 tell us anything about longevity or, of course, people are very interested in this? Yeah, I don't think we've, like, hacked the fountain of youth yet. But I do think that this provides some sort of, like, tantalizing clues about how longevity can be maximized. But I think the question for us is still always going back to this mechanism of how are telomere's lengthening. And, you know, we talk a lot about this lengthening in this project, but also two weeks after they came out of hibernation, their telomeres had shortened again. So maybe that stress of those first two weeks of being aroused and of trying to find a mate, because that's the reproductive season. So it's not the thing. So it's not the time.
Starting point is 00:21:34 that their telomeres lengthened and stayed long, they actually ultimately shortened again. And they started off the hibernation season of year two at the same length that they started off the hibernation season of year one. So it's not like they're sort of indefinitely lengthening their telomeres. But I do think that if we continue this work and if colleagues and peers and collaborators continue this work, there's a lot we can learn about the mechanisms underlying telemere dynamics that could downstream be applied to people. Yeah, I'm interested in this. I mean, I know bats can be a kind of poster child of longevity. And I know that in some species, researchers have found their telomeres lengthening during hibernation.
Starting point is 00:22:13 Like, do we need to get all the people who study animal superagers together to work on this mystery? Yeah, and I think we can throw in there people that do deep diving in the bottom of the ocean and people that are traveling to outer space because there's also been some interesting findings that maybe they are able to lengthen their telomeres under sort of the extreme physiological stress of humans at the maximum of their physiological potential. Hmm. That's really fascinating. What have we missed about this study? These are critically endangered primates from Madagascar, and so we're not going to be doing the invasive work to really challenge their cells in ways that would allow us to understand the mechanisms, but we can potentially grow cell lines from these animals and expose the cells in a petri dish to the sort of challenge that the animal would experience. And so we can answer some of these questions without, do we
Starting point is 00:23:02 any invasive work on the animals themselves. But I also think that there's real value in us looking to Madagascar and looking to wild populations of dwarf lemurs to try to understand the variety of conditions and environmental heterogeneity and environmental challenge that they're experiencing in the wild. And to start modeling some of these telomere dynamics just from the same cheek swabs we used applied to these captive animals to understand what are the dynamics going on in the wild for animals hibernating under cold conditions, for animals hibernating under warm conditions, for animals hibernating at the beginning of their lives or hibernating at the end of their lives. And I think there's all sorts of questions we can also ask in the wild.
Starting point is 00:23:36 So I think this dual approach of sort of the natural ecology, natural history perspective in Madagascar coupled with really high-quality, rigorous lab work that doesn't have the animal involved in it is really, I think, the duality of the approach that we see. Okay, well, when you head to Madagascar for your fieldwork, please phone us in. And thank you both for joining me today. Thank you so much for having us. Dr. Marina Blanco and Dr. Lydia Green, research science, at Duke University in Durham, North Carolina.
Starting point is 00:24:06 And that is about all we have time for. Lots of folks helped make the show happen, including Jordan Smudjik. Rasha Auretti. Charles Bergquist. Shoshana Bucksdown. I'm Flora Lichtman. Thanks for listening.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.