TED Radio Hour - The future of our memories

Episode Date: January 30, 2026

From creating “synthetic” memories to reviving ruined monuments, tech no longer simply stores the past — it can enhance it. This hour, we explore new ways to capture, share and even recreate our past. Guests include technologist Pau Aleikum Garcia, cartoonist Amy Kurzweil and digital archaeologist Chance Coughenour.(Original broadcast date: January 24, 2025)TED Radio Hour+ subscribers now get access to bonus episodes, with more ideas from TED speakers and a behind the scenes look with our producers. A Plus subscription also lets you listen to regular episodes (like this one!) without sponsors. Sign-up at plus.npr.org/ted.See pcm.adswizz.com for information about our collection and use of personal data for sponsorship and to manage your podcast sponsorship preferences.NPR Privacy Policy

This is the TED Radio Hour. Each week, groundbreaking TED Talks. Our job now is to dream big. Delivered at TED conferences. To bring about the future we want to see. Around the world. To understand who we are. From those talks, we bring you speakers and ideas that will surprise you.

You just don't know what you're going to find. Challenge you. We truly have to ask ourselves, like, why is it noteworthy? And even change you. I literally feel like I'm a different person. Yes. Do you feel that way? Ideas worth spreading.

From TED and NPR. I'm Anoush Zamorodi. On the show today, the future of our memories. So it was 2014 and it was during one of the biggest refugee crisis from the last decades here in Europe. This is Pao Alecum Garcia, Powell lives in Barcelona, but a decade ago, he was in Greece, helping relocate Syrian refugees who were escaping civil war. And I remember one conversation one night with this elderly woman, and she told me, Pao, I'm not afraid of being a refugee now, as I have lived my life.

What I'm afraid is that my grandkids will be refugees forever. and I said, how come? I don't think so. Like, they will find a new place, a new home, they will keep on. She told me, yes, the thing is that whenever they try to ask the question, where do I come from, they won't be able to answer it because we have lost our home. We have lost our neighborhoods, the streets where they were born.

And of course, we have lost all our photo albums from our family, the diaries of my husband. Not only community and country heritage have been lost, but also our family, individual family history, have been lost through this forced migration. And that kind of made us reflect on the role that memory and visual memory has in the build-up of our identity and how we construct ourselves.

and that idea of reconstructing memories was stuck in us. Reconstructing memories. This got Powell thinking. Could he help people capture their memories in a photograph, something to hold and see even if their family albums, diaries and letters were lost? Because Powell is a technologist. And so over the next decade, he and his colleagues at his desk,

design studio in Barcelona, worked with AI tools to create something that they now call synthetic memories. A synthetic memory in the context of this project, of course, refers to a digitally reconstructed representation of a personal memory. And we use artificial intelligence models that using words, prompting them with words, can generate certain images. But the goal is to find an image. that can bring a face to stories of people that have lost these images that have never been able to document part of their memories. Pao Al-Aikoum Garcia explains from the TED stage.

Memories are the architects of our identity. Memories remind us who we are. And visual memories are very important. We all have a picture of someone we love in our wallet, in our phones, in our homes. Visual memories shape our sense of self, and they can shape our sense of belonging to a specific place. They can teach us things from the past.

And because all that, they can actually make us understand in a deeper level how we react to things. And like organic memories, which are form and stored in the human brain, synthetic memories are visual memories from a person past, which have been never documented or lost, and that we can now, using Gen.I. Transform from a text or an oral description into an image. It's a new way of reconstructing a past that has been hidden to our eyes.

Part of me wonders, well, why do we need a synthetic memory? Why do we need artificial intelligence to create a visualization of it? It is, I think, a matter of sharing memory. with family members or members of their community. And what I have seen is that it kind of dignifies certain experiences in life. There is a lot of people that because the moments that they lived and some of these situations were very traumatic or very difficult, the only traces that they have of these experiences are psychological scars.

There are no visible ways to explain. what happened to them. And by reconstructing these memories, by documenting in this kind of subjective way what happened to them, you are also dignifying part of their own experience. From AI-generated memories to chatbots that let us speak to loved ones we've lost,

technology isn't just storing our memories anymore. It's transforming how we interact with them. But what happens when the past doesn't stay in the past? Will it change our conceptions of ourselves in the here and now? Today on the show, The Future of Memory, how technology is changing the way we capture, protect, and even recreate our past. Back to Pao Alicum Garcia. He says that synthetic memories can restore a fundamental part of

what makes us human, as it did for a 90-year-old woman named Carmen. Carmen was one of the very early participants of synthetic memories. She came to the studio, and we started as we started most of the sessions, asking what is your earliest memory. It was from 1941. She was six-year-old, and her mother would pay another family, so they could enter their house and go up to their balcony. What was particular about the balcony was that it was facing La Modelo prison.

During that time, during the Spanish dictatorship in Spain, it was a political prison. And her father, a doctor for the antifascist front, was a prisoner there. So the only way they could see each other was from that balcony to the window of the prison. And that was her earliest memory. of him between bars through that street. I asked her, Carmen, would you like to have an image of that memory?

And she said, yes, of course. I would love to show to my family what I experienced the things that I went through so they can remember where we all come from. Just so that the listener can picture it in their minds, the photograph that you ended up creating with AI was of a girl in a dress standing at a balcony, her mother has, you know, this old-fashioned haircut. Exactly. She described very well how her mother was dressed, the haircut that she remembered.

Also, the balcony, how is it? And kind of the general atmosphere of it. We went through several iterations. We generated tens of images. And then at some point she saw two images that was like, yes, that was it. that's how I remember it and it was I know it was very visceral really

it was something I didn't experience before something like this and is a feeling that I have seen over and over afterwards with other people when they see an image that was only in their mind

and then it's externalized by reconstructing an image that other people can see now and it's a kind of a release for them It's like, oh, okay, I don't have to hold it in my mind only. Now I can show it to other people.

And it's not only on me to keep that memory. But it's not very realistic looking. It's almost it has a painterly sort of dreamy feel about it. It's in black and white. It almost feels like you can't quite grab it, much like a memory. Exactly. At the beginning, it was because the models that we were using were not. good enough. They were very early models. But then, when we started to switch into more

hyper-realistic models, we discovered that actually the models that work better, the models that created images that people felt more comfortable with were the early models, models that would generate like this kind of blurriness. And it was because memories are also unstructured. And whenever you do a hyper-realistic image, people start to look at the things that were not exactly how they remember. It's not so much about the factual accuracy of the image. It's more about the emotional embedding that you'll find in them. You've been doing this for over three years now.

Who do you think this is most helpful for? So synthetic memories can be useful in several spaces. The first space is for communities that because forced migration, they have lost hard drives phones and photoalves. Another space that I think is relevant is in the space of dementia. So on the last two years, we have been actually starting pilots in different nursing homes and hospitals, transforming synthetic memories into a methodology within a bigger space of therapy, which is called reminiscent therapy. It's a therapy that uses old images and music from someone past to actual trigger this space. very visceral memories. And this has been proven to actually reduce anxiety and depression

for a big number of people. You've been very upfront about your concerns, your ethical concerns around using this kind of technology and helping people who maybe aren't, don't know how to use the technology do this. What are the worries that you are hoping to sidestep? The most obvious one is fake memory reconstruction, right? Like creating memories that never existed. And then making someone believe that that happened. And this is, of course, this is something that is not new. This has happened, science deaf, very early software like Photoshop,

transforming images to show things that were not there in reality. I think now with this technology, what can happen is that can happen at scale. And that's why whenever we create synthetic memories, we always use models that you can very easily see that they are algorithmic generations, that they are not images taken with a photographic camera. The other thing is that we want these memories to be subjective and individual. We don't want them to be collective. I think there is kind of a danger on reconstructing collective memories as they can build community perspective that never happened. This is something that have been studied a lot.

I think there are ways of using these technologies that can be good. But artificially intelligence is neither only a threat or just a simple opportunity. We have to learn to be okay with it being both at the same time. When we come back, more from Pao Alicum Garcia on the potential ethical problems with memory reconstruction. On the show today, the future of memory. I'm Anoush Zamorodi and you're listening to the TED Radio Hour from NPR. Stay with us. It's the TED Radio Hour from NPR.

I'm Anouche Zomerode. On the show today, the future of our memories. We were just talking to technologist Pao Alicum Garcia, who makes what he calls synthetic memories. Photographs created with AI to depict a moment from someone's past. But memories can be subjective. We know memory is fallible. It's unreliable. Have you seen, you know, is there a concern that some memories, say, from war zones or conflict areas that? that people create them and they're not necessarily real,

but they reinforce or perpetuate narratives that didn't actually happen, that maybe are not accurate. I think the danger is not on individual subjective experiences, but in general narratives. And I think that's one of the red lines for us. We always have to talk about individual subjective memory. It's not forensic truth. Actually, we had these interviews with people that were tortured during the dictatorship in one of the police quarters here in Barcelona.

At some point, they wanted to use these images. We didn't recommend it. We say that it's not an image and it's not a forensic proof of anything. It's just another format of subjective representation of what happened. Because, you know, memories are undefined and are imperfect. Like, every time we remember something, we turn it different. Like, we change a bit a part of it. And whenever we are creating an image with one of these models,

we are not only reconstructing the memory a bit, but we are also re-biasing it through the biases of the model that we are using. For example, here in Barcelona, at the beginning, we were using Dali 2 from Open AIA. and this is an inherently American algorithm like image generator. So it has been trained mainly with American culture images. And whenever you try to generate images from Barcelona from the 20s or the 30s or the 40s here, it's not very good at it.

It's not very good at reconstructing how a home from a person in Barcelona was in the 30s. So we had to do as a partnership with the municipal archive here in Barcelona and fine-tune. a model with a lot of images from the time in the city. So there are ways that you can somehow re-biased and find you on these models to look closer to the cultural context of the person that is trying to recall a memory. You know, I'm thinking about the way my kids live right now. Everything is documented. They take photos of absolutely everything and how much they think they remember a moment,

they can go back and check whether they were accurate. How is the potential for using this changing as you get to younger and younger people who do have photos of everything? Yeah. I think this project is right now very focused on this window that is closing of these elder generations that are starting to die. And with them, it's not only the body that dies is also all the experiences and memories and ways of looking at the wall. And a big part of these memories and realities were never documented. And I think sadly still, for future generations, they will still go through experiences like massive migration or forced migration that will leave them without the capacity to hold into visual memories. And some of them, they will lose tragically like all these images.

So I don't think this is something that only affects the elderly, but also in the future, can affect also a lot of the younger generation. That's pal al-a-cum Garcia. He leads the design studio Domestic Data Streamers in Barcelona. You can see his full talk at ted.com. On the show today, The Future of Memory. And now a story about three generations of the Kurzweil family and how technology has kept their family history alive. He was born in 1912 in Vienna.

This is cartoonist Amy Kurzweil talking about her grandfather, Holocaust survivor, Frederick Kurzweil. He was a very talented musician and he became a pianist and a conductor, and he had a really promising career in Vienna and was sort of, you know, looking forward to a life of being a professional musician in the music capital of the world. And in 1937, he conducted this choral concert. and there was an American woman in the audience who was a wealthy benefactor who loved music and she really loved his performance and afterwards she went up to him and she said, I just am so impressed with you

and if you ever need anything, let me know, here's my card. That was 1937. In 1938, the Nazis marched into Austria and took it over and my grandfather realized very quickly, you know, sort of overnight that he needed to get out of Yenna. And so he wrote to this woman and she ended up sponsoring him. And I grew up hearing the story and I think it took some time for me to realize just how significant and dramatic that moment of the concert and the decision to sponsor him was.

Because he really didn't have any other way out. Music is really what saved my grandfather's life. And so he, yeah, he left in 1938. He left a month before Kristallnach, and he settled eventually in New York. He met my grandmother, and that's where history unfolded. And they had a son, your father. Tell people, if you don't mind who your dad is. Yeah. My father is Ray Kurzweil, inventor and futurist. I've actually been in artificial intelligence since 1962.

This is Ray Kurzweil, being interviewed on. on NPR News in 2023. Which is actually a record. I don't think there's anybody else that's been in it for that long. He's, you know, known to the world as a kind of genius propagator of the singularity, somebody who has really fantastical ideas about the future of humanity and the rise of AI. But to me, he's just my dad. And he's like, you know, he's a really wonderful, sweet person who cares about his family.

Ray Kurzweil and his wife had Amy after his father Fred had died. Yeah, so I never met my grandfather because he died in 1970. He died when I was 22. So really what I had from him were these stories and these fragments of a life. Sort of filtered through my father. They said, oh, Fritz Kurzweil is in town. So she went to meet him. Six states later, they were engaged.

I wouldn't say my father talked about his father all the time, but I could tell that when he talked about him, there was great emotion and great longing and a sense that this is a person that he started to have a relationship with only at the end of his life or they would talk and they would share memories. My father felt there was kind of wasted. He could have done more creative work, and we talked a lot about that, and he was very enamored with that.

I think what impacted me in my father's stories about his story, his father was the absence and the longing and the sense of great admiration, that this was really someone who had dedicated his life to art and creativity and ideas. And that was really significant to my father and had a big impact on him. Amy's grandfather kept reams of artifacts and documents and letters from his life. Yeah. He was not able to bring very many things with him from Vienna when he immigrated. but documentation is very important in this German, Austrian tradition.

And so my grandfather came to America with this sense of the importance of documentation and the importance of information to save your life. So in America, he saved copies of all the letters he wrote, He saved copies of his programs when he would do musical performances. He just saved and saved. And so my father inherited this trove of salvaged documents and artifacts from my grandfather's life. I have actually many boxes of his projects, and we have everything he's ever written. Ray came up with an idea to do something radical with all these documents, and he drafted Amy to help.

help him. In 2018, when large language models were starting to gain capability, my father had this idea, which is that if he could collect all the writing from his father, he could create a chat bot that writes in my grandfather's voice. A bot that would respond via text as though it was her grandfather. And so what this required was collecting all the original writing from my grandfather, which was housed in the storage unit, and marrying it with natural language technology. And that would create this sort of first creation that represents my grandfather's identity in text. And so my role in the project was to collect these documents and transcribe them. And eventually that built this large language model, this Fredbot, as we called it. Back in 2018, this seemed very sci-fi. Amy Kurzweil picks up the story from the TED stage.

But I wanted to talk to my grandfather because he, like me, was an artist. I wondered, could I get to know him? Could I even come to love him, even though our lifespans didn't overlap? This was a selective chatbot, meaning it responded to questions with answers from the pool of sentences that Fred actually wrote at some point in his life. the more examples of Fred's writing we could find, the more dynamic the experience of chatting the bot would feel. Finally, I sat down to chat with this new intelligence, an algorithm commanding over 600 typed pages of letters, lectures, notes, essays,

and other written documents from the grandfather I never met. When I asked about Fred's dreams, he told me about the challenge of keeping his new orchestra afloat. When I asked about Fred's anxieties, I learned about the stress of being a new father while working so hard. When I asked about the meaning of life, Fred wrote about the joy of working with other musicians in pursuit of beauty, and he wrote about the highest aims of art. You ended up writing and illustrating a book called Artificial, A Love Story, about you and your father's quest to take your grandfather's archives and digitally told you. turn them into what you called Fred Bot. But just so people can picture it, there is a page in your book depicting you and Fred Bot texting each other. And it was less of a conversation,

more like you would ask a question and he would respond with a line pulled from the archives that was relevant. It was almost like you were reciting poetry to each other. Yeah, that's a nice way of putting it. The first time I chatted with Fred Bot was, I believe, in 2000, and I had to actually go to a physical place to chat with him because it was using technology that was not publicly available. Of course, today, I can create many different Fredbots on all these different platforms. I can create one using Notebook L.M. I can create one using ChatGBT.

And there's different techniques for prompting these large language models to get them to engage with me as Fredbot if I give them the corpus. of text that we built. But back in 2018, this stuff was not as productized. I would ask a question and it would offer something that was related. And then I was faced with this gap between what I asked and what it offered. And then I had all this space to kind of imagine where that line came from and I could really enter into my grandfather's experience because of that gap. And the metaphor that I use in my TED talk is this idea of time travel, that when I would ask a question that was relevant to me in my own life right now, like tell me about Hannah, my grandmother,

the Fred Bot would come back with a passage that just took me to this moment when my grandmother was in a car accident and he was worried about her. And then suddenly, out of nowhere, I would just be entered into this past situation where my grandfather was writing to a about how he was, you know, having to take care of my grandmother and she was lying in bed for weeks. And I think just the impact of suddenly being plunged into a totally different moment in time was so, so much more interesting than if the chatbot had tried to pretend that he was around right now. I had wondered if this project would feel like a resurrection. But rather than bringing my grandfather from the past into the present, it felt like I was the one time traveling,

visiting him for a moment at different points in his life. It felt like the kind of imaginative travel I do when I'm cartooning. When I'm cartooning, I'm always thinking about how I could possibly represent a person fully. And the answer is, I can't. Similarly, I know how many aspects of my grandfather can't be captured by digital text alone. There's his body, how it moved, and how it felt. There's his music and all the ineffable aspects of his performance. And of course, there's everything he thought, but didn't write down. What would we have to do to be able to capture all of this? To be clear, when you talked with Fred Bot, it would respond in written sentences, not his actual voice.

Written sentences, yeah. There is no voice. And something I should say about the voice is that, of course, voice recreation is now possible, but we have no recordings of my grandfather's voice. So we can't reproduce his voice. We can't have, you know, an algorithm say anything new in his voice. Does that make you sad? Or are you kind of like, it's kind of beautiful that we just can be immersed in his inner thoughts from his writings?

I think in the case of my grandfather, what's most significant is recordings of his music, because that's what was important to him. We do have recordings of his music. We have him playing piano. We have him conducting. For me, I think the piano is the most important because I see that as his greatest passion and the place where his personality really shined. I wish that I could see it, but just like on the idea of having some things that are gone forever, I think that's sad, but it's also part of what makes this whole experience precious. That there is something about absence that kind of calls us to attention. I want to go back to the motivation for your dad and your understanding of it. There's a page where your father talks about the idea of the, the, Mexican concept of death, that there are two of them. Can you tell us the story? He told you. I mean, it's

similar to the movie Coco, right? Yeah, my favorite Pixar movie Coco, which explores this idea of the two deaths. The first death is the death of the body. The second death is the death of your legacy. And what that means is when people forget you, when they stop talking about you. And that was a framework that I was putting on this project of my father's, that there was a way in which he was keeping his father alive through allowing us to engage with his memory. And in my book, I was grappling with these questions of like, what is a person, where does the person begin and end?

Is there a way in which we think about the Fred Bot as an extension of my grandfather's identity, a part of his identity? And I came to see the Fred Bot as an artistic representation of my grandfather. In a minute, more with Amy Kurzweil. On the limitations and beauty of using technology to capture who we really are. Can we be reduced to ones and zeros? On the show today, The Future of Memory. I'm Manus Shumeroody, and you're listening to the TED Radio Hour from NPR.

We'll be right back. It's the TED Radio Hour from NPR. I'm Manus Shumerode. On the show today, The Future of Memory. And we were talking to artist Amy Kurzweil, whose father is Ray Kurzweil, the futurist, famous for his ideas about the singularity, the merging of man with machine, so that we could, potentially, live forever. Amy thinks her dad's ideas can be interpreted in many ways. The way that I interpret my father's immortality aims is actually more about the present and about always trying to keep living. And living doesn't just mean not dying. Living means enjoying your relationships.

It means seeking meaning and really trying to push your life forward towards some creative aim. I find that to be inspiring. I love this quote so much. You write, A person is ever changing, but surely something makes you the same person over time. My father says a person is a series of patterns. And then there's a really funny section

where your mom plays different voicemails from your dad that he had left over weeks. And every time he leaves a voicemail, he starts the message the same way. it's me it's me yes yeah I love that you brought this up my mom has a great eye for humor and she saved all these voice messages from my father because he was doing a lot of traveling and he would always call and cough hi it's me and we just sat and laughed and I think people can relate to that because when you're close to somebody you have this really felt sense of who they are and the

things that they do and it's just funny and yeah I think patterns are what connect our identities over time. So, I mean, my father says a person is information. I think when people hear that, they hear a person is reducible to ones and zeros. But actually, like, in philosophical literature, the idea that we are patterns of information is, you know, pretty common. Lots of people think that. So the idea that we are the shapes of our life, the sort of stories and stories. preoccupations and relationships that we are living out. And the patterns of our lives could be

incredibly transcendently beautiful and complex. But nonetheless, they are patterns. They are things that we can observe. This episode is all about how we will be thinking about the past. And you say in your talk, AI has a special role to play in the mission of memory. Yeah. I mean, I think what AI can help us do is navigate incredible amounts of information. Something that I discovered in my writing my book is that the amount of information that a person is is so vast as to be potentially infinite. And of course, the process of memory is the process of choosing and selecting what moments and what details from a human life are important.

And so because AI has this capacity to process much more information than we consciously can, and because AI doesn't have emotion, it just has a different method for selecting what's significant in its series of patterns that it's recording. And I think it's really promising for sort of helping us keep archives alive and keep archives navigable. And I think when we have a sense of where we've come from, our own identities feel more solid. I did not come to see the chatbot of my grandfather as replacing my grandfather. I came to see it as one way to interact with his legacy. As somebody who has spent their whole life trying to document people,

I can assure you that people are much bigger and weirder than any one depiction or any one moment in time can possibly evoke. AI swirls our conception of time and space. It can remix and extend our identities. These technologies are animated portraits. They are one part of our true immortal selves. Seen this way, AI like cartooning and all good artistic endeavors could help us appreciate the vastness of humanity if we let it.

Thank you. That was Amy Kurzweil. She's a cartoonist at the New Yorker magazine and the author of two graphic memoirs, flying couch and artificial, a love story. You can see her full talk at ted.com. On the show today, The Future of Memory, how technology is changing, how we remember our past. So far, we have focused on preserving personal memories. But what about collective memories of a people and their culture? Take St. Sophia's Cathedral in Kiev. San Sofia Cathedral, which we name the heart of Ukraine, the main church in Ukraine, more than 1,000 years. This is Yerko Prepodobni. He says, for a thousand years, St. Sophia, with its stone towers and 13 gold cupolas, has stood at the center of historic Kiev.

It's not simple structure. from the underground few rooms to the main hall, corridors tunnels with arches inside, and a lot arches, a lot cupolis inside. The cathedral is a rare surviving example of Byzantine architecture and a UNESCO World Heritage Site. It's also considered the heart of Ukraine for the art within its sanctuaries

that depict the earliest moments of Ukrainian history. San Sofia has the oldest mosaics, fras on the walls. That walls include all our history like Ukrainian. It's layers and layers of the centuries. The capital of Ukraine under a new wave of Russian drones. A barrage of over 150 Russian. Military officials say Russia targeted the city with drones packed with it. Every building in Ukraine in danger.

San Sofia had missile attack 600 meters from them. St. Sophia and hundreds of other historic buildings have been damaged or destroyed in Ukraine over the last few years. Which is why Yorco and his team went to visit St. Sophia and scan it. Yeah, we scanned everything. Every morning, we woke up and we scanned that building for one week. Jerko is a co-founder of Skyron, a Ukrainian organization that does digital preservation by creating 3D digital versions of heritage sites. He's already scanned the city center of his hometown of Lviv, and he and his team are now scanning buildings across the entire country. Now we scan more than 50 per year.

In the past, when war, natural disasters, or the passage of time, damaged or destroyed buildings, All that were left were sketches, photographs, and memories. But now, high-tech 3D scans, like the ones Yerko is doing, preserve every physical aspect of these places in detailed digital files. What I've witnessed firsthand is the way that technology can safeguard the memories and heritage that we have of our shared humanity. This is Chan's Kokenauer. I'm a senior program manager at Google Arts and Culture. Google is one of Skyron's partners in Ukraine, offering both tech and financial support.

And Chance is an expert in scanning technology. He started out as a Mayan archaeologist and first learned about this technology in the 2000s. But it wasn't until 2015 that he was convinced of its potential in Iraq. So in 2015, ISIL, or the Islamic State of the Levant, they entered the Mosul Museum in Iraq. This morning, ISIS claims to have destroyed priceless pieces of history. A video posted yesterday. They recorded themselves destroying the museum collection. The museum reportedly housed more than 170 genuine antiquities.

That video went viral. I remember when it was shared online. People around the world were shocked at the loss of these ancient artifacts. And it made chance wonder if he could, at the very least, go back and create a digital record of them for posterity. If there were a number of photographs of these artifacts, maybe we could create a digital copy or 3D model that could bring that artifact back from being lost, at least in a digital form, to preserve its memory for future generations. It was like an aha moment that we thought, why not? At least try.

And at that point, to be clear, we had no idea that anyone had any photographs of these objects. So really it was just a hypothesis. And so two weeks after we saw this video, we started the project called Project Mosul. Chan's Kokonauer explained from the TED stage in 2016. The key to this technology is called photogrammetry, and it allows us to use two-dimensional images taken of the same object from different angles to create a 3D model.

I know you may be thinking this sounds like magic, But it's not. What the computer can do is it can detect similar features between the photographs, similar features of the object. Then, by using multiple photos, it can begin to reconstruct the object in 3D. It's very similar to how our eyes actually distinguish depth when we look at objects that are near or far from us. And so it's really the application of that.

It's comparing one photo with another and then another. and then another in the sequences. And then algorithms piece those together to form a three-dimensional representation of that object. So how do you go about tracking down photographs? I mean, tourists who'd visited Mosul? Is that where you start? Yeah. You know, we're talking about a location that had been closed to the public for a number of years.

You know, it was a zone of human conflict for decades, actually. And so we just kind of placed an open call to find anyone out there that, may have these photographs. And a U.S. service woman had happened to have visited the museum and taken photographs years prior. And I would say the most famous of the artifacts, she had taken 12 photographs of the Lion of Mosul. The Lion of Mosul was an eight-foot-tall statue carved around 3,000 years ago that stood guard at an Assyrian palace. They were perfectly taken from the different angles. So it was quite an incredible, we were just like, well, let's put the 12 photographs when we got them in.

We were like, let's just test it. And we were like, wow. After Chance got the photos, it came back to life on his computer. He could even 3D print it, a perfect reproduction, small enough to sit on his desk. And at the time, we were testing software that created. create 3D models through photogrammetry. And so we tested it with many of them. And we created the 3D model in only a couple of minutes,

even to the point where you can zoom in to see the original text that was inscribed on the side of this ancient carved lion. An amazing thing lost to history. And then you preserve it in some ways digitally. You can print out a 3D version of it. But that doesn't mean that. that it remains in people's minds, right? Like, how do you make it possible for people to even know that it ever existed?

Yeah. So in 2019, the Mosul Museum hosted its first exhibition after the occupation had ended. What they wanted to do was to have a celebration of art and music and bring the community together. And we were invited to participate. So we sent a number of events. these 3D prints to the museum. They were actually placed alongside artworks by local artists that had painted during the occupation. So this was kind of an example of connecting the past to the present. But we also used these 3D models to place them inside of a virtual museum. You could go

on a VR tour. And so many people became aware of incredible heritage from this region. And the object itself, as a digital twin is now accessible to zoom in, rotate, and see in a way that would not have been possible even if you visited a museum in Mosul. It's been a little while since you gave your talk, and since then, you've joined Google, you've continued doing this work, and the technology has advanced a lot. Yes, it really has. The technology has expanded and developed so rapidly. The technology that makes photogrammetry possible is the same that's used for AI today.

It's now accessible to so many more people that it's much cheaper to do. Photogrammetry is being done on small mobile devices. A drone can fly around outside of buildings or even inside of buildings. But essentially, we have vastly expanded the number of 3D objects and monuments that we're putting online, along with our partners that are doing this globally. with our partners in Ukraine, for example, we've launched more than 200 more 3D models that range not only from landmarks,

but in addition to that, museums that we've worked with could essentially take artworks and hang them in a virtual gallery. People around the world can virtually walk around inside of a museum. With accessing these things virtually or collecting them online,

is there part of you that feels, I mean, obviously that that's a wonderful thing to preserve it in some respect, but we are missing out on the tactile experience of seeing art and architecture right in front of us, which is an extraordinary feeling. I fully agree. I don't think it will ever replace the tactile way of being able to experience art in person. for me, the reason I became a Mayan archaeologist is because I walked into an ancient Maya city, had some interest in history at one point in my life, and I was just blown away at the experience of being there. But I'm still absolutely worried that things may be lost to natural disasters, climate change, time, human conflict.

And what I think digital technology offers us is a means to, to digitally protect and document the world's art and culture in a way that it's accessible to people, for people to know about it. And hopefully they have the opportunity to visit and see it themselves. That was Chan's Kokonauer. He is a senior program manager at Google Arts and Culture. You can see his full talk at TED.com.

Many thanks also to Yerko Prabadobni. His organization is called Skyron. To see their scans of St. Sophia and other historic sites, you can go to g-o-o-g-g-l-E-slash Ukraine. And before you go, thank you so much for listening to our episode. Please rate us on Apple or leave us a comment on Spotify. We love hearing directly from you. This episode was produced by Rachel Faulkner White, Katie Montalione, and Matthew Cloutier. It was edited by Sanaz Meshkampur and me.

Our production staff at NPR also includes James Delahousie, Hersha Nihada, and Fiona Giron. Our executive producer is Irene Noguchi. Our audio engineers were Robert Rodriguez and Gilly Moon. Our theme music was written by Romteen Arablewe. Our partners at TED are Chris Anderson, Roxanne Highlash, Alejandra Salazar, and Daniela Belarzzo. I'm Manus Zameroady, and you've been listening to the TED Radio Alaskar. from NPR.