cover of episode Laser Versus Parchment: Doomsday for the Disc

Laser Versus Parchment: Doomsday for the Disc

2023/11/10
logo of podcast Cautionary Tales with Tim Harford

Cautionary Tales with Tim Harford

AI Deep Dive AI Chapters Transcript
People
播音员
主持著名true crime播客《Crime Junkie》的播音员和创始人。
Topics
播音员:本节目探讨了档案保存的重要性及其面临的挑战,通过威廉征服者编纂《末日审判书》、BBC“末日审判项目”失败以及Windrush丑闻等案例,说明了无论纸质档案还是数字档案,都需要持续的努力和关注才能确保其长期保存。忽视档案保存可能导致严重后果,例如个人权利受损、历史信息丢失等。 Michael Braithwaite:由于英国政府销毁了大量的加勒比海地区移民的登陆卡,导致Michael Braithwaite无法证明其合法居留权,最终失去了工作,并面临被驱逐出境的风险。这突显了档案保存对个人权利的重要性。 Adrian Pearce 和 Sally Pearce:Adrian和Sally Pearce 尝试修复并数字化BBC“末日审判项目”的数据,但过程中也面临技术挑战和数据丢失的风险。这说明了数字化保存并非万无一失,也需要持续的维护和关注。 Peter Armstrong:Peter Armstrong 发起了BBC“末日审判项目”,旨在利用新兴技术收集和保存英国社会的数据,但由于技术更新和成本问题,最终数据丢失。 Amelia Gentleman:Amelia Gentleman 报道了Windrush丑闻,揭露了英国政府的错误做法以及由此导致的严重后果。

Deep Dive

Chapters
William the Conqueror initiated a comprehensive survey of his realm in 1086, resulting in the Doomsday Book, which provided detailed records of ownership and resources, crucial for governance and taxation.

Shownotes Transcript

Translations:
中文

Pushkin. So I have some big news for vegans and vegetarians everywhere. It's Hellman's plant-based mayo spread and dressing. Made for people with a plant-based diet or anyone really who wants to enjoy the great taste of Hellman's real without the eggs. Hellman's plant-based is perfect for sandwiches, salads, veggie burgers, or any of your family favorites.

To celebrate, Hellman's is sharing some easy, delicious plant-based recipes at hellmans.com. Hellman's Plant-Based Mayo Spread and Dressing. Same great taste, plant-based.

I'm Malcolm Gladwell, and I'd like to take a moment to talk about an amazing new podcast I'm hosting called Medal of Honor. It's a moving podcast series celebrating the untold stories of those who protect our country. And it's brought to you by LifeLock, the leader in identity theft protection. Your personal info is in a lot of places that can accidentally expose you to identity theft.

and not everyone who handles your personal info is as careful as you. LifeLock makes it easy to take control of your identity and will work to fix identity theft if it happens. Join the millions of Americans who trust LifeLock. Visit LifeLock.com slash metal today to save up to 40% off your first year.

The most innovative companies are going further with T-Mobile for Business. Red Bull harnessed the strength of the T-Mobile 5G network to launch point-of-view drones and give fans unmatched views of their extreme sports, while broadcasting in real time from some of the most remote locations in America. This is heart-pounding fan experiences. This is Red Bull with T-Mobile for Business.

Take your business further at T-Mobile.com slash now. As dawn broke on the 14th of October 1066, two great armies, each more than 5,000 men, lined up for battle near Hastings on the south coast of England. Ranged along a hilltop where the English forces of King Harold, they faced an invader from France.

William, Duke of Normandy, with his force of archers, infantry and mounted knights. At nine in the morning, the battle began with the terrible sound of trumpets on both sides. The English formed a shield wall holding the high ground. The Norman cavalry and archers probed for an opportunity to shatter the English line. Then word spread among the Norman army that their Duke, William, had fallen.

The left flank crumbled and fled down the hill, pursued by the English. But then, what's this? William himself, helmet raised to reveal his face, rode forth and proclaimed, "'Look at me! I live, and with God's help I shall conquer!' His forces rallied and counterattacked, slaughtering the English who'd surged forward."

The battle was brutal, but as the autumn sun began to set, the final Norman assault broke the English line. King Harold was slain. The next king of England would not be English, but Norman. "I shall conquer," William had said. And on Christmas Day 1066, William the Conqueror was crowned William I of England.

But the French invader William faced struggles to have his right to rule accepted. Two decades later, he stumbled upon an idea to establish his legitimacy over his vast fiefdom, an idea that still shapes the world today. He began a grand survey of what was in that fiefdom.

Commissioners set up special sessions of county courts to hear testimony about who owned what and what there was to own, from land to mills to people. There was no single hide nor a yard of land nor indeed one ox nor one cow nor one pig which was left out. The result of this great survey was the Doomsday Book. In fact, there were two of them, Great Doomsday and Little Doomsday.

Remarkably detailed snapshots of William's realm in 1086 AD. It was all a long time ago, and yet it's a very modern project. If the state wishes to govern, to tax, to help the deserving and punish the wicked, that state needs comprehensive, detailed records of where everyone lives, what they do, and where they came from. I'm Tim Harford, and you're listening to

to cautionary tales. Where they came from. Michael Braithwaite came from the sunny island of Barbados. In 1961, little Michael, just nine years old and travelling with his brother, crossed all the way over the ocean to arrive under the grey skies of Britain.

Despite the weather and the risk of a hostile reception from a mostly white British population, it was a journey many other people had taken. At the time of Michael's journey, Barbados was still part of the British Empire, and the UK government had been welcoming migrants and offering them considerable legal protections. Michael's father already had a job with the Royal Mail, his mother with the National Health Service.

Michael and his brother were travelling to be reunited with their parents. It must have been a daunting journey, but it was a one-way trip. Michael started attending a British school and from that moment, he recalls, we regarded Britain as our home. Michael and his brother entered the UK with a British Caribbean passport stamped 'Indefinite Leave to Remain'.

Michael grew up and started his own family. He went on to have three British children and five grandchildren. What he didn't have was a UK passport. Legally, he didn't need one and never applied for one, and for five decades there was no problem. But Michael Braithwaite was going to discover what William the Conqueror knew. Records matter. Something else matters too. What you record them on.

In 1983, a BBC television producer named Peter Armstrong is pondering the looming 900th anniversary of the Doomsday Survey. That anniversary will happen in 1986, just three years away. So what should the BBC do about it? Make a television series? Sure, they could do that. But Peter Armstrong had a better idea. I just thought...

If we were to have a Doomsday Book now, how would we do it? Oh indeed, Peter Armstrong had two ideas, both of which were ahead of their time. The first was that the whole community would be involved in gathering information. All of us who, like me, were British school kids in the 1980s knew about the BBC Doomsday Project.

The BBC will be writing to all 30,000 schools in Britain to ask them whether they want to participate in collecting facts during the summer term next year, explained a contemporary magazine. It is estimated that 10,000 schools will be needed to make the scheme work, which would involve about a million children.

It was dubbed a people's database, a kind of Wikipedia almost two decades before Wikipedia. There were organised surveys and questionnaires, but also plenty of cub reporting as children went out to photograph their local area. It was a massive grassroots effort. Peter Armstrong's second idea was just as visionary.

The BBC Doomsday Project would manifest itself not in some weighty encyclopaedia, but in an interactive digital format. The project team decided that the best way to store this vast trove of information would be on something called a laserdisc.

Laserdiscs were silvered discs of plastic, similar to the also newly invented CD, but much bigger. They were a foot across, like a vinyl album. The Doomsday Project was trying to use laserdiscs in a groundbreaking way.

It combined digital text and analogue video with a clever, if slightly Rube Goldberg-esque technique that produced revolutionary-looking results. A complete doomsday system consisted of a Laserdisc player, a monitor, a trackball device and a beautiful, boxy, beige computer with black and red keys called a BBC Master.

It was expensive. Each system cost half a year's salary at the typical wages of the day. But the BBC and its commercial partners hoped that the system would be the foundation of a whole new market for business and education, with a vast range of other Laserdiscs available.

That never really happened, alas. The system was too pricey for most schools. And the technology moved on, as technology does. The CD-ROM replaced the Laserdisc as a more practical way to put multimedia projects on a silvery platter. Still, there was no shame in the low sales of the doomsday multimedia system. Peter Armstrong's project team were years ahead of their time and had a great deal to be proud of.

they'd created the mother of all time capsules, a remarkably rich and detailed picture of the UK in 1986, one which future generations could consult, learn from and enjoy. Or could they? Because by 2002, when the internet age had truly arrived, the Doomsday Project had almost been forgotten.

The BBC department that had created it had been shut down for years. Nobody was in charge of keeping the project alive, and so it died. The British newspaper The Observer reported... ..a computer-based multimedia version of the Doomsday Book. But 16 years after it was created, the £2.5 million BBC Doomsday Project...

has achieved an unexpected and unwelcome status. It is now unreadable. Old documents have a habit of disappearing. Sometimes that's an unhappy accident. You have a Laserdisc, but you can't find anybody with a Laserdisc player anymore. Sometimes it's all too deliberate. The year is 2009.

In a basement in a towering government office in Croydon, south-east London, there are thousands upon thousands of ageing cardboard documents, each one recording the arrival in the UK of someone from the Caribbean or from other former colonies of the British Empire. These documents are hardly ever consulted.

Who needs old landing cards detailing the moment someone stepped off a boat from Barbados or Jamaica in the 1950s or 1960s? Actually, every now and again, someone did need one. If you'd arrived in the UK on one of those boats, the 1971 Immigration Act gave you the right to live in the UK for the rest of your life. You hardly ever had to prove you had that right. In daily life, nobody asked.

It was only if you were, say, applying for your first British passport that you might need to prove your date of arrival. And those landing cards provided that proof. One of the clerks who worked at the Croydon office recalled, "Sometimes the passport office would call up and people would say, 'I'll look in the basement.' Still, that didn't happen often anymore. After four or five decades, most people who'd ever want a passport would surely have applied for one."

And so, when an office relocation beckoned, someone higher up decided, let's get rid of those old bits of cardboard. They take up too much space. The clerks protested. Couldn't we at least make digital copies? But the bosses decided there was no money for any of that. And late in 2010, the landing cards were destroyed.

A couple of years later, the government introduced a new law. They wanted to get tough on illegal immigration. The law required landlords to check for proof that their tenants had the right to live in the UK, and banks to check their customers, and employers to check their workers. In principle, these rules applied to everyone, although you have to wonder if they were more tightly enforced for people with foreign accents.

or people who, like Michael Braithwaite, were black. More than half a century had passed since Michael Braithwaite stepped off the boat from Barbados as a nine-year-old boy and made Britain his home. He felt British. He had the permanent right to live and work in Britain. But he'd never had to prove it. Nobody had ever asked. Now they would. Cautionary Tales. We'll be back in a moment.

AI might be the most important new computer technology ever. It's storming every industry, and literally billions of dollars are being invested. So, buckle up. The problem is that AI needs a lot of speed and processing power. So how do you compete without costs spiraling out of control? It's time to upgrade to the next generation of the cloud, Oracle Cloud Infrastructure, or OCI.

OCI is a single platform for your infrastructure, database, application development, and AI needs. OCI has 4 to 8 times the bandwidth of other clouds, offers one consistent price instead of variable regional pricing, and of course, nobody does data better than Oracle. So now you can train your AI models at twice the speed and less than half the cost of other clouds.

If you want to do more and spend less, like Uber, 8x8, and Databricks Mosaic, take a free test drive of OCI at oracle.com slash strategic. That's oracle.com slash strategic. oracle.com slash strategic. I love cycling, and I'm eager to get my kids cycling too. It's a great way for them to stay fit and move around our home city independently. But of course, I also want them to be confident and safe.

which is where Guardian Bikes comes in. The bike comes in a box and it's easy to assemble with all the tools you need and simple online instructions. My son and I unboxed his bike together, spent about 20 minutes working as a team to assemble it and then he was on the bike and ready to ride.

The bike looks great and with the SureStop braking system it brakes quickly and safely without locking the front wheel and sending you over the handlebars. Guardian bikes offer a 365-day money-back guarantee covering returns, repairs and spare parts. Join hundreds of thousands of happy families by getting a Guardian bike today. Visit GuardianBikes.com to save up to 25% off bikes. No code needed. Plus

Plus, receive a free bike lock and pump with your first purchase after signing up for the newsletter. That's GuardianBikes.com. Happy riding! If you're listening to this right now, you probably like to stay on top of things, which is why I want to mention The Economist. Today, the world seems to be moving faster than ever. Climate and economics, politics and culture, science and technology, wherever you look, events are unfolding quickly. But now you can save 20% off an annual subscription to The Economist,

so you won't miss a thing. The Economist broadens your perspective with fact-checked, rigorous reporting and analysis. It's journalism you can truly trust. There is a lot going on these days, but with 20% off, you get access to in-depth, independent coverage of world events through podcasts, webinars, expert analysis, and even their extensive archives. So where

Whether you want to catch up on current events or dive deeper into specific issues, The Economist delivers global perspectives with distinctive clarity. Just to give an example, What's Next for Amazon as it turns 30? analyzes how Amazon's fourth decade looks like an area of integration for the company. Go beyond the headlines with The Economist. Save 20% for a limited time on an annual subscription. Go to economist.com and subscribe today.

For more than two decades, Michael Braithwaite had been a teaching assistant in a school in North London, working particularly with young children who had special educational needs. He loved his job and he loved the kids. "We grew a great bond between us," he told one interviewer. One day, Michael was summoned to see the head teacher. The head looked scared, Michael remembers. His mannerisms were nervous.

The head explained he'd been threatened with five years in prison if he was found to be employing anyone he had reason to suspect didn't have the right to work in the UK. As Michael had no passport, he was going to need an official biometric ID card. He kept asking, what are you going to do, Michael? Michael had felt like part of the school family. Now he realised he was on his own.

I was totally confused, he said, because I never knew of a biometric card or what it meant to someone like me. It was a perplexing and bewildering situation. The government department in charge of handing out biometric cards was called the Home Office. Michael Braithwaite, remember, absolutely had the right to live and work in the UK because he'd arrived before 1971.

But the cardboard landing card that would prove that had recently been destroyed by the Home Office. Now they told him he needed to provide documentary evidence that he had been living in the UK since the 1970s. At least one official document for every single year for more than four decades. It was an impossible demand. Michael was refused his biometric card and in 2017...

He was summoned to another meeting at the school and told that he couldn't keep his job. He'd have to leave that day. You could have pulled my heart out and chucked it on the floor, he said. Michael walked out of the headmaster's office. The children had their weekly swimming lesson that afternoon. He helped a colleague walk them safely to the pool and then back again. Then he slipped into the school storeroom, picked up a box of his belongings...

and left the building. Michael was not the only one treated in this way. A whistleblower who worked in the Home Office archives contacted a journalist, Amelia Gentleman, and told her what was happening. Every week or so, someone would say, ''I've got another one here.'' People were writing to say, ''I've been here 45 years. ''I've never had a passport. I've never needed a passport. ''Now I'm being told I'm not British.'' Previously, the Home Office worker would have said, ''I'll look in the basement.''

Now, the archive of landing cards was gone. Instead, the officials would send a standard reply. We have searched our records. We can find no trace of you in our files. Which was perfectly true and perfectly disgraceful. As Michael Braithwaite said, they took everything out of me. My confidence, my self-esteem, who I am. It tore me apart.

It's tempting to think, if only the archives had been digitised. And yes, that might have helped, for a while. But as the BBC doomsday fiasco tells us, just because something's digitised doesn't mean it lasts forever. BBC, remember, had embarked on a huge project in 1986 to crowdsource a unique historical record for the ages, and a mere 16 years later, it had become unreadable, or unreadable.

had it. Let's meet Sally and Adrian Pearce, a couple of civically-minded nerds who lived in a small town to the south of London. They were interested in community activities such as maintaining local footpaths, but also in computers and education. Sally had been one of the original community researchers for the BBC Doomsday Project in the early 1980s. She had fond memories of gathering data.

By the year 2000, she was working as a professor of education at the University of Brighton, teaching the next generation of teachers to use computers to access and analyse historical documents. Her husband Adrian, meanwhile, was an IT consultant. Both of them had heard about how difficult it was to access the doomsday laserdisc systems.

Adrian was feeling burnt out from long hours patching old corporate computers. He needed a change of pace. And Sally suggested that helping to revive the BBC doomsday system might be just the project.

Sally's vision was that young teachers in classrooms of the 21st century would be able to access doomsday data from the 1980s, either using CD-ROMs or the internet. And Adrian had the technical expertise to try to make it happen. But a huge challenge faced Sally and Adrian Pearce because digital archives are like chains. One weak link can break them.

Consider those laser discs. They had been touted as being almost indestructible. And that may be true, but without the player to read them, the laser discs were just glorified mirrors. I'm a child of computer engineers.

I fondly remember from the 1980s the scream of the dot matrix printer. My mother with a screwdriver attacking the weird innards of a beige computer with its lid off, fixing it so I could play classic games again. But I can tell you from experience there are only so many times you can pound those keys excitedly as you shoot at space bandits before the system will fall apart.

So, of course, most Laserdisc systems from 1986 had stopped working by the 21st century, or schools had thrown them out to make room for shiny new PCs or Macs. But Sally Pearce got lucky. She discovered an entire doomsday system in storage at the University of Brighton. When they plugged it in, it still worked.

Yet as Adrian explored the Doomsday System, he realised there were more weak links in the chain. He had absolutely no technical documentation. He didn't know how the data was being stored or organised by the Doomsday System. It was all in hexadecimal. Picture the slow waterfall of green code in the movie The Matrix. How could it be translated into a format that a modern computer would understand?

Adrian Pearce ended up decoding the hexadecimal structure the hard way, by hand. He later described it as like trying to solve a crossword puzzle, if the crossword puzzle was enormous and written entirely in an unknown language. After a while, like Neo in The Matrix, Pearce was seeing patterns in the data by eye.

Reading programming books from the mid-1980s and slowly groping his way through the rows and columns, he began to understand how the data had been structured and to write new programs to search and interpret it. But Adrian also needed to solve a different problem. He needed to get all the data off the disk. And the only way he could see of doing that...

was to pipe every bit of data through the old BBC computer and onto something modern. The old computer wasn't built for that. Some of the files took more than 50 hours to transfer. A few of those marathon transfers and what happened next was inevitable. The BBC master's motherboard was fried. Adrian Pearce had started with a rare thing, a working doomsday system.

But in trying to extract the data, he'd destroyed that system. Cautionary Tales will be back in a moment.

I love cycling and I'm eager to get my kids cycling too. It's a great way for them to stay fit and move around our home city independently. But of course, I also want them to be confident and safe. Which is where Guardian Bikes comes in. The bike comes in a box and it's easy to assemble, with all the tools you need and simple online instructions. My son and I unboxed his bike together, spent about 20 minutes working as a team to assemble it,

And then he was on the bike and ready to ride. The bike looks great and with the SureStop braking system it brakes quickly and safely without locking the front wheel and sending you over the handlebars. Guardian bikes offer a 365-day money-back guarantee covering returns, repairs and spare parts. Join hundreds of thousands of happy families by getting a Guardian bike today.

Visit GuardianBikes.com to save up to 25% off bikes. No code needed. Plus, receive a free bike lock and pump with your first purchase after signing up for the newsletter. That's GuardianBikes.com. Happy riding! If you're listening to this right now, you probably like to stay on top of things, which is why I want to mention The Economist. Today, the world seems to be moving faster than ever. Climate and economics, politics and culture, science and technology, wherever you look,

Events are unfolding quickly, but now you can save 20% off an annual subscription to The Economist so you won't miss a thing. The Economist broadens your perspective with fact-checked, rigorous reporting and analysis. It's journalism you can truly trust. There is a lot going on these days, but with 20% off, you get access to in-depth, independent coverage of world events through podcasts, webinars, expert analysis, and even their extensive archives. So where

Whether you want to catch up on current events or dive deeper into specific issues, The Economist delivers global perspectives with distinctive clarity. Just to give an example, What's Next for Amazon as it turns 30? analyzes how Amazon's fourth decade looks like an area of integration for the company. Go beyond the headlines with The Economist. Save 20% for a limited time on an annual subscription. Go to economist.com and subscribe today.

Michael Braithwaite had lost the job that he loved. His own school had told him that he was an illegal immigrant. His own government had destroyed his only means of proving otherwise. Other people in his situation were being deported. It was just a matter of time then until he was deported too. "I was informed they turn up at six in the morning," he said.

I was already dressed and ready, waiting for that moment to come. Every morning, for 18 months, he got up early after a sleepless night, got dressed and waited for the knock at the door. I talked about Michael Braithwaite recently with my friend Patricia Sleeman. She's a digital archivist.

In her early career, she worked on the kind of nerdy projects that occupied people like Adrian and Sally Pierce, trying to pull data out of unreadable old computer systems. Then, about a decade ago, Patricia did something that, at the time, I couldn't really understand. She went off to work for the UNHCR, the UN agency responsible for protecting the rights and the welfare of refugees. I didn't get it.

It seemed like my wonderful, nerdy archivist friend was dashing off to join an emergency relief effort. What did the UNHCR need with an archivist? But when I realised what was happening to people such as Michael Braithwaite, I finally understood that archives are a human rights issue.

The UNHCR archive goes back to the 1950s and it contains photographs, interviews and documents describing the lives and fraught journeys of some of the most vulnerable people in the world. To prove where they came from and when and why, a refugee needs that data or they risk disappearing into some nightmarish bureaucratic black hole. Just like Michael Braithwaite.

condemned to stress, shame, unemployment and the fear of a knock on the door at six o'clock in the morning. Digital archives feel better to us than paper archives. Digital files are searchable. You can back them up with a click. You can store huge quantities of information in a tiny space.

In contrast, paper archives are a hassle. They take up space in filing cabinets, in rooms that could be used for something else. No wonder people are sometimes tempted to save money by throwing old paper archives away. But digital archives are also surprisingly vulnerable. While paper archives have to be deliberately discarded, digital archives can be lost without any effort at all.

For example, I have Microsoft Word documents on my computer, dating back to 1994, copied and recopied every time I bought a new computer. I always assumed I could read them any time. But after I talked to my friend Patricia Sleeman, I wasn't so sure. So I clicked over to the old archive folder and double-clicked on the first document I saw. Did it open? It did not. Oi, oi.

Instead, a pop-up informed me that "You are attempting to open a file type that has been blocked by your file block settings in the Trust Center." It turns out

that I can't open my own Microsoft Word documents. Well, what did you expect? This file is donkey's years old, and frankly... I'd carefully copied those old Word documents over and over again, but at some stage, my system stopped being able to read the files. And I never knew when that moment was, because I didn't check. Joni Mitchell sang, "'Don't it always seem to go "'that you don't know what you got till it's gone?'

When it comes to digital archives, you might not know what you've got till it's been gone for years or decades. The psychologist James Reason, an expert in human error, calls this a latent condition. When the batteries in the fire alarm have run flat, you won't discover that unless you check or until there's a fire. When your digital documents have become unreadable, you won't discover that either until you check

Or, since you probably won't check, you won't discover it until you desperately need them. And by then, it may be far, far too late. In 2007, three researchers studied how often links from online legal articles no longer existed. On the website of the US Supreme Court, half of all the links cited in legal opinions didn't work. Half of them.

In top legal journals, more than two-thirds of the links were broken. This is the law of the land we're talking about, simply coming apart at the seams. And it isn't just legal opinions. Political statements are often deleted by the politicians who made them. Old tweets, old speeches, they all vanish, unless someone makes it a priority to capture and preserve them. That somebody is often the Internet Archive.

most famous for operating the Wayback Machine, which allows you to travel back in time to view earlier versions of any web page. The Internet Archive is a private initiative, run on a shoestring, and people who don't like what it preserves keep trying to shut it down. We tend to take archives for granted. We assume that when there's a digital record of something, if it matters, it'll get preserved.

But this preservation doesn't happen by accident. It takes money and organisation and determination. George Orwell's 1984 painted a picture of life under a totalitarian state which continuously rewrote the historical record. The past was erased. The erasure was forgotten. The lie became truth.

But we don't need a totalitarian dictatorship to lose our grip on the past. We just need to stop paying attention. It's hard to imagine all the problems Adrian Pearce had to solve to reincarnate the doomsday system. They went so much further than just finding an old system in working order. He had to find a supplier of long, obsolete parts because he kept frying them.

To restore the video, he had to find the master tapes. And of course, it was nobody's job to keep the master tapes. In the end, cliche of cliches, the tapes were found gathering dust in the attic of the original BBC producer, Peter Armstrong. Adrian worked on the Doomsday Project for 16 months, unpaid, gazing so long at hexadecimal he could read it with his naked eye.

Finally, he was able to realise his wife Sally's dream. He produced a Windows-compatible version of the Doomsday Project and uploaded it to the web, doomsday1986.com. It all seems like a happy ending, right? Right? No. Have we learned nothing about taking digital archives for granted?

It was with a sinking feeling that I looked for Doomsday 1986, Adrian and Sally's labour of love. It's offline. I discovered that Adrian Pearce died in 2008 and the site went dark shortly afterwards. That's what happens to old websites.

Adrian's obituary in the local newspaper notes that... Some legacy. That website is gone too. There have been other doomsday preservation projects. Most of them are also gone. The BBC itself launched a doomsday reloaded project. It went online in 2011, then disappeared.

The BBC even made a radio programme all about the preservation efforts. The programme has a web page. It says, Sorry, this episode is not currently available. The UK's National Archives do have all the original text and video from those 1986 Laserdiscs, and it is online. But in archived form, it's basically useless. There's no way to navigate around and find what you're looking for. Or...

In 2021, a software engineer named Daniel Earwicker hacked together an interactive interface that looks like Google Maps. It can pull out a relevant page from the National Archives, turning an unusable heap of data into an interactive, searchable resource again. Earwicker called his project Doomsday 86 Reloaded Reloaded.

The multi-million pound project built around the labour of hundreds of thousands of volunteers is legible today because one volunteer, Daniel Earwicker, thought it would be really cool if that happened. He was right. It is really cool and it works, for now. But if the experience of Adrian Pearce taught me anything, it's that one volunteer's digital preservation effort, no matter how heroic,

is fragile. It may all be readable and searchable today. Tomorrow, it could be gone again, erased and forgotten, like all those old landing cards that nobody could be bothered to keep. Michael Braithwaite never did get the knock at the door.

Thanks to the reporting of journalists such as Amelia Gentleman, the plight of the people being deported came to public attention. It became a national scandal, known as the Windrush scandal, after a ship, the Empire Windrush, which brought more than a thousand people from Jamaica to the UK in 1948. An inquiry was held, a cabinet minister resigned, apologies were published.

but not before the UK government, to its shame, had illegally deported more than 80 elderly people who'd come legally to the UK as children but couldn't prove it. Michael eventually got his biometric ID card, but he couldn't face going back to his old job. To work alongside the colleagues had been too frightened to support him. Instead,

He found a new calling. As a campaigner for the thousands of people affected by the Windrush scandal. People who'd lost their jobs, their self-esteem. People who, like Michael, had been torn apart. After the inquiry, the government set up a compensation scheme. It's being administered by the Home Office. The people who caused the problem in the first place. It isn't going well.

You won't be surprised to hear that there's still plenty for justice campaigners such as Michael Braithwaite to do. And I wonder if we've fully appreciated all the right lessons from the Windrush scandal. It had its roots in anti-immigrant rhetoric and unexamined racism, but also in bad archival practices. As William the Conqueror could have told us, record-keeping matters.

And what about the original doomsday books? Nearly a millennium old. Great Doomsday and Little Doomsday. Today, they're regarded as the most complete surviving record of pre-industrial society anywhere in the world. Surviving, yes, surviving. For centuries, William the Conqueror's original manuscripts have been preserved for posterity.

In 1666, for example, they were saved from the Great Fire of London. In 1869, they were rebound with an ornate new leather cover. During the Second World War, they were moved beyond the reach of Nazi bombs. Now, they're kept in dry, cold storage at the National Archives in London. They're perfectly legible. 937 years old and still going strong.

If you think that archives don't matter, tell that to Michael Braithwaite. If you think that digitisation solves the problem, tell that to Adrian Pearce. And if you think that doomsday books survive through chance, think again. They exist only because every generation since 1086 cared enough to make the effort. What archives today will we care about enough to preserve for tomorrow?

For a full list of our sources, please see the show notes at timharford.com.

It features the voice talents of Ben Crow, Melanie Guttridge, Stella Harford, Gemma Saunders and Rufus Wright. The show also wouldn't have been possible without the work of Jacob Weisberg, Ryan Dilley, Greta Cohn, Vital Mollard, John Schnarz, Eric Sandler, Carrie Brody and Christina Sullivan.

Cautionary Tales is a production of Pushkin Industries. It's recorded at Wardour Studios in London by Tom Berry. If you like the show, please remember to share, rate and review. Tell your friends. And if you want to hear the show ad-free, sign up for Pushkin Plus on the show page in Apple Podcasts or at pushkin.fm.com.

I'm Malcolm Gladwell, and I'd like to take a moment to talk about an amazing new podcast I'm hosting called Medal of Honor.

It's a moving podcast series celebrating the untold stories of those who protect our country. And it's brought to you by LifeLock, the leader in identity theft protection. Your personal info is in a lot of places that can accidentally expose you to identity theft. And not everyone who handles your personal info is as careful as you.

LifeLock makes it easy to take control of your identity and will work to fix identity theft if it happens. Join the millions of Americans who trust LifeLock. Visit LifeLock.com slash metal today to save up to 40% off your first year.

So I have some big news for vegans and vegetarians everywhere. It's Hellman's plant-based mayo spread and dressing. Made for people with a plant-based diet or anyone really who wants to enjoy the great taste of Hellman's real without the eggs. Hellman's plant-based is perfect for sandwiches, salads, veggie burgers, or any of your family favorites.

To celebrate, Hellman's is sharing some easy, delicious plant-based recipes at hellmans.com. Hellman's Plant-Based Mayo Spread and Dressing. Same great taste, plant-based.

The news isn't always good news, but when you're getting quality journalism and in-depth expert analysis that's held up for more than 180 years, that is definitely good news. So if you haven't already, save 20% with The Economist's summer sale today and stay on top of the stories that matter to you. You'll instantly gain unlimited digital access to daily articles, special reports, award-winning podcasts, subscriber-only events, and so much more. Now that's

Good news. Go to economist.com and subscribe today.