Can AI preserve your most precious memories? | Pau Aleikum Garcia
12:27 Share

You're listening to TED Talks Daily, where we bring you new ideas to spark your curiosity every day. I'm your host, Elise Hume. What if we could expand the capacity of our minds and ease cognitive decline that comes with old age or disease? Data and design expert Pau Aleikom Garcia is working on it with the help of Generative AI.

In his 2024 talk, Garcia sheds light on the work of transforming our actual memories into blurry, undefined images to make something called synthetic memories. The promise this holds after the break.

If you love iPhone, you'll love Apple Card. It comes with the privacy and security you expect from Apple. Plus, you earn up to 3% daily cash back on every purchase, which can automatically earn interest when you open a high-yield savings account through Apple Card. Apply for Apple Card in the Wallet app. Subject to credit approval, savings is available to Apple Card owners. Subject to eligibility, Apple Card and savings by Goldman Sachs, Bank USA, Salt Lake City branch. Member FDIC. Terms and more at applecard.com.

Teams with big ideas start in Jira, the only project management tool you need to plan and track work across any team. Jira even helps our team here at TED, keeping us in sync to deliver the big ideas our listeners love. And there's a lot more that teams will love about Jira. It keeps cross-functional tasks organized with a project's timeline. That's always really key so that we make our deadlines. And cross-functional teams like TED working in one tool gives leaders the impartiality

important visibility they need to make better business decisions. Get started on your next big idea today in JIRA.

Thank you.

It's a better way to money. See why at northwesternmutual.com slash TED. The Northwestern Mutual Life Insurance Company headquartered in Milwaukee, Wisconsin. And now our TED Talk of the day. A year ago, I was in front of Carmen, a 90-year-old woman from Barcelona. I asked her, Carmen, what is your earliest memory?

Now, for someone who has almost seen a century unfold, this can be a difficult question. I was half expecting her to say, "Son, my earliest memory is of you asking me this question." But the truth was that it was from 1941. She was six years old, and her mother would pay another family so they could enter their house and go up to their balcony. What was particular about the balcony was that it was facing La Modelo prison,

During that time, during the Spanish dictatorship in Spain, it was a political prison, and her father, a doctor for the Antifascist Front, was a prisoner there. So the only way they could see each other was from that balcony to the window of the prison. And that was her earliest memory of him, between bars, through that street. I asked her, "Carmen, would you like to have an image of that memory?"

And she said, "Yes, of course. I would love to show to my family what I experienced, the things that I went through, so they can remember where we all come from." And this is how we started this experiment, trying to transform a memory into an image, in this case using generative AI. We started by creating a description of the memory, a prompt to say so, and then Carmen generated tens of images. You could see her going through all of them.

but it was not until she saw these two images that something clicked in her. She pointed at the image and said, "Yes, this is me and my mother in the balcony. I can see the haircut." It was as if she had found something long lost. From there, we did something else. We used that image as a starting point to generate a video, but this time, not only showing her and her mother, but also showing her father looking back at them from the other side of the street.

When she saw it, there was a long silence. And later she told me that it had been a long time since she had seen an image of her father. These are not factual recreations of the past. This feels a bit more like dreams. And in fact, they are. They are visualizations based in memories with their imperfections and definition.

That's how we discovered that blurry, undefined images work much better than hyper-realistic ones when we are trying to reconstruct memories. That's why early generative AI models work much better than the ultimate state-of-the-art ones. It's not the factual accuracy that moves us, but the emotional truth that we find embedded into some of these systems.

And we call this project Synthetic Memories. It's one of the several projects we are doing at Domestic Data Streamers, a team of researchers, designers and engineers exploring the impact that generative AI can have in society, going from media literacy to cultural heritage and, of course, memories. Now, memories are the architects of our identity. Memories remind us who we are.

And visual memories are very important. We all have a picture of someone we love in our wallet, in our phones, in our homes. Visual memories shape our sense of self, and they can shape our sense of belonging to a specific place. They can teach us things from the past. And because of all that, they can actually make us understand, on a deeper level, how we react to things. And organic memories, which are --

form and stored in the human brain. Synthetic memories are visual memories from a person's past which have been never documented or lost, and that we can now, using gene AI, transform from a text or a neural description into an image. Now, there are many reasons why we can lose visual memories and memories itself, but the most common one is the one that comes with aging and diseases like Alzheimer's or Parkinson's.

I myself have lived through that in my family, and I guess many of you have had similar experiences. It's a terrible disease, as you not only see the memories fade away, but also the character and the identity of someone that you love. And now, back to the episode. So two years ago, we started to create these meetups

to meet people from very different disciplines, trying to figure out how synthetic memories could be used in different social setups. And then I met David, a social worker in a nursing home. He was taking care of a group of Alzheimer's patients.

and he was using a therapy called reminiscence therapy. Now, reminiscence therapy is a kind of therapy that uses music and old photographs from a person's past to trigger these very visceral, emotional memories. Think of it as kind of lubricating an old rusty lock, making it much easier to open the doors of certain forgotten rooms that we have in our head. And it has been proven for certain people

help very much in the prevention of depression, of cognitive decay, and in some cases even improve cognitive abilities. So we designed a pilot experiment using synthetic memories within Raminisense therapy,

and for over two months, 12 patients in both individual sessions and group therapy. We could see a direct relation between their level of engagement and their cognitive abilities, pointing out that this could not only be a new way of doing therapy, but also it could be another way to detect early signs of cognitive decay. Now, this image was generated with Nuria, a 96-year-old woman,

from a nursing home, and she was telling me about one of her favorite memories of her husband. It was during Sundays, he would used to read the newspaper in the living room, and she would always play this old, jumpy gramophone with some music just to annoy him. When she saw the image, she was so happy, her eyes lighted up. But after a while, she looked at me and she said, "But Pau, we have a problem here. This man over here is not my husband."

And I say, "How come?" And she said, half laughing, "Well, my husband was much more ugly." Pointing once again that love is not just blind, but also inner-sighted. This is far from being a cure of Alzheimer's, but it could be a way of making the journey a bit less daunting. Another patient told me, "It feels a bit like finding your glasses in your head after searching for them everywhere. It's a small but very significant relief."

And from a medical perspective, it could be a new way to temporarily enhance cognitive abilities, making it much easier for family members and caregivers in moments of distress or disconnection. So the --

The pilot experiment was promising enough to partner up with the AgeWell Network here in Canada, together with researchers from the University of Toronto and the University of British Columbia. And during the summer, we will be exploring and designing an ethical framework to protect both family members and patients, as well as comparing this therapy to other therapeutic interventions and exploring how we can make it truly accessible both for families and institutions all over the world.

As you can imagine, synthetic memories in this project can go beyond the research on dementia. There are many other reasons why we can lose visual memories. There is the loss that comes from sudden displacement due to war, political persecution or natural disasters, situations in which our photo albums, hard drives, phones, diaries can be lost, damaged or just left behind.

Synthetic memories, it's a way to recover a part of this past heritage that has been lost and that right now is at risk of being forgotten. It's a new way of reconstructing a past that has been hidden to our eyes.

Now, soon we will open the first public office for visual memory reconstruction in the city of Barcelona. With the support of the city council, the idea is to make a city-scale experiment, a place where any citizen will be able to generate their own memories, to reconstruct a part of their past together in community, understanding which are the subjectivities of the past from different communities.

This image was sent to me not long ago by David, the social worker. And he did it with a dementia patient that for a very long time had not spoken with his daughter. They were in kind of bad terms. And he told David that he was terrified about horses, but because his daughter loved them, he would bring her to ride every week during her childhood.

He asked David to generate this image of both of them riding in this kind of dreamy landscape. This was not a memory, this never happened. It was a remembrance, it was a way that he wanted to remember his daughter. With his permission, David sent this image to his daughter, who because of that, after almost 10 years without speaking to each other, came back to Barcelona to speak back to him.

Afterwards, she told David that when she saw the image, she realized that her father still had good memories of her. An image can work as a witness to the world, we know that. But it can also change the way we see it. We have now tools that can help us understand a time that was not ours, experiences from others that have never been shown in images, and bridge realities that were hidden to our eyes.

Montserrat Roig, a beloved Catalan writer, once wrote, "If there is an act of love, that is to remember." And that is truly my hope, that we all get the opportunity to love and be loved in that way. Thank you very much.

This episode is brought to you by Progressive Insurance. Fiscally responsible, financial geniuses, monetary magicians. These are the things people say about drivers who switch their car insurance to Progressive and save hundreds. Visit Progressive.com to see if you can save. Progressive Casualty Insurance Company and affiliates. Potential savings will vary. Not available in all states or situations.

Hi, I'm Bilal Sadoo, host of TED's newest podcast, The TED AI Show, where I speak with the world's leading experts, artists, journalists, to help you live and thrive in a world where AI is changing everything. I'm stoked to be working with IBM, our official sponsor for this episode.

Now, the path from Gen AI pilots to real-world deployments is often filled with roadblocks, such as barriers to free data flow. But what if I told you there's a way to deploy AI wherever your data lives? With Watson X, you can deploy AI models across any environment, above the clouds helping pilots navigate flights, and on lots of clouds helping employees automate tasks, on-prem so designers can access proprietary data,

and on the edge so remote bank tellers can assist customers. Watson X helps you deploy AI wherever you need it, so you can take your business wherever it needs to go. Learn more at ibm.com slash Watson X and start infusing intelligence where you need it the most. That was Pau Alaykum-Garcia speaking at TED 2024. If you're curious about TED's curation, find out more at ted.com slash curation guidelines.

And that's it for today. TED Talks Daily is part of the TED Audio Collective. This episode was produced and edited by our team, Martha Estefanos, Oliver Friedman, Brian Green, Autumn Thompson, and Alejandra Salazar. It was mixed by Christopher Fazi-Bogan. Additional support from Emma Taubner and Daniela Balarezo. I'm Elise Hu. I'll be back tomorrow with a fresh idea for your feed. Thanks for listening.

Support for this podcast comes from Odoo. Imagine relying on a dozen different software programs to run your business, none of which are connected, and each one more expensive and more complicated than the last. It can be pretty stressful. Now imagine Odoo. Odoo has all the programs you'll ever need, and they're all connected on one platform.

Doesn't Odoo sound amazing? Let Odoo harmonize your business with simple, efficient software that can handle everything for a fraction of the price. Sign up today at Odoo.com. That's O-D-O-O dot com. PR.