SPEAKER_01: Every kid learns differently, so it's really important that your children have the educational support that they need to help them keep up and excel. If your child needs homework help, check out iXcel, the online learning platform for kids. iXcel covers math, language arts, science, and social studies through interactive practice problems from pre-K to 12th grade. As kids practice, they get positive feedback and even awards. With the school year ramping up, now is the best time to get iXcel. Our listeners can get an exclusive 20% off iXcel membership when they sign up today at iXcel.com slash invisible. That's the letters iXcel dot com slash invisible. Squarespace is the all in one platform for building your brand and growing your business online. Stand out with a beautiful website, engage with your audience and sell anything. Your products, content you create, and even your time. You can easily display posts from your social profiles on your website or share new blogs or videos to social media. Automatically push website content to your favorite channels so your followers can share it too. Go to squarespace dot com slash invisible for a free trial and when you're ready to launch, use the offer code invisible to save 10% off your first purchase of a website or domain. Bombas makes clothing designed for warm weather from soft breezy layers that you can move in with ease to socks that wick sweat and cushion every step. Socks, underwear and t-shirts are the number one, two and three most requested items in homeless shelters. That's why for every comfy item you purchase, Bombas donates another comfy item to someone in need. Every item is seamless, tagless and effortlessly soft. Bombas are the clothes that you want to get dressed and move in every day. I'm telling you, you are excited when you've done the laundry recently and the Bombas socks are at the top of the sock drawer because your feet are about to feel good all day long. Go to B O M B A S dot com slash 99 P I and use code 99 P I for 20% off your first purchase. That's Bombas B O M B A S dot com slash 99 P I code 99 P I. This is 99% Invisible. I'm Roman Mars. There are lessons to be learned in our failures. Touching a hot stove once will teach you to never touch a hot stove again. But when it comes to the failures of complex systems, it's sometimes hard to know what went wrong and when. This is where Tim Harford, also known as the Undercover Economist, and his brand new show Cautionary Tales, comes in. It's a podcast that brings you stories of awful human error, tragic catastrophes, daring heists and hilarious fiascos. His stories will delight you, and if you're smart, they will scare the bejesus out of you. But they'll also make you wiser. The episode we're hearing today is about a fiasco that is often blamed on bad typography, hence my specific interest in it. But the full explanation turns out to be much weirder and more surprising. Here's Tim Harford with Cautionary Tales.
SPEAKER_02: Their task seemed simple. Open a red envelope, take out a card, and read out the title of the film that had won the Academy Award for Best Picture. Beatty opens the envelope. So far so good. Then he looks at the card in his hand. He hesitates. Then he looks inside the envelope again, as though checking to see if there was a cover note. He looks over at Dunaway, then raises both eyebrows. She reaches over and touches his arm affectionately. In the Academy Award. Beatty begins. He pauses again. He looks at the card again. He slips his hand inside the envelope one more time. The audience laugh. At the moment of maximum tension, that old rogue is playing with everyone's emotions. He continues.
SPEAKER_02: For Best Picture. He stops again. Faye Dunaway thinks he's goofing around too. You're impossible, she says. Come on. He shows her the card. She doesn't hesitate for a moment.
SPEAKER_08: La La Land.
SPEAKER_02: The audience erupts in applause and the producers of La La Land take to the stage to give their acceptance speeches. Meanwhile, off in the wings, an accountant named Brian Cullinan knows that the biggest screw up in the history of the Academy Awards is in full flow. The 2016 winner of Best Picture isn't La La Land. It's Moonlight. So, yes, you've heard this story. But have you understood what it really means?
SPEAKER_02: You're listening to another cautionary tale. There's a simple way to tell the story of this fiasco. As Warren Beatty walked on stage, Brian Cullinan's job was to hand him the envelope for Best Picture. Instead, Cullinan handed over the envelope for Best Actress. A few moments earlier, that award had been won by Emma Stone for her performance in La La Land. And so, when Beatty opened the envelope, he saw Emma Stone, La La Land. Jimmy Kimmel, the host of the Oscars that evening, jokingly blamed it all on Beatty.
SPEAKER_02: Warren, what did you do?
SPEAKER_08: I wanted to tell you what happened. But it really wasn't Beatty's fault. He didn't understand what he was looking at.
SPEAKER_02: And rather than say the wrong thing, he hesitated. Then he turned to Faye Dunaway. She was the person who actually uttered the title of the wrong film, but it wasn't her fault either. Imagine her situation. She's on stage in front of the most star-studded audience imaginable, plus tens of millions watching live on television. Beatty seems to be messing around and she doesn't know why. The first thing she sees on the card is La La Land, and straight away that's what she says. Some people blame Beatty. Some people blame Dunaway. Most people blame Brian Cullinan, the accountant who handed over the wrong envelope. But all of those people, I think, are making a mistake. Almost a decade ago, years before this fiasco, I interviewed one of the world's most important thinkers on how accidents happen. He's a sociologist named Charles Perrault. And he told me something that stuck in my mind, that we always blame the operator. It's always, he says, a case of pilot error. Charles Perrault is a wise old man. He's older than the Academy Awards themselves. He was four back in 1929 when they were first presented. And Perrault is absolutely right. We inevitably look for someone to blame, and that inclination leads us astray. Our instinct is to blame the accountant, Brian Cullinan. He did give Beatty the wrong envelope. He was distracted. He'd tweeted a photograph of Emma Stone holding her Oscar statuette. At a time he should have been focusing on giving Beatty the right envelope, he was on his phone, enjoying being close to one of the world's most beautiful people at her moment of triumph. We can all learn a lesson from that. Get off your phone. Get off your phone when you're supposed to be having dinner with your family. Get off your phone when you're supposed to be driving, and get off your phone when you're supposed to be giving the envelope containing the best picture card to Warren Beatty. But the reason that it's a mistake to simply blame Cullinan is because Cullinan was just being human. Humans are always getting distracted. Humans are always making mistakes. If our systems can't cope with those mistakes, then it's hopeless to demand better humans. We need better systems. When La La Land fleetingly won Moonlight's Oscar, some rich and successful people suffered some embarrassment and some heartache, but nobody died. Yet the lesson of the fiasco is far from trivial. The same kind of mistake in different situations can be catastrophic. Such mistakes can lead to nuclear accidents and financial meltdowns. And when I say can lead, I mean have led. Such disasters have already occurred. So, let's try to understand what really happened that strange night at the Oscars. Perhaps we can use that insight to prevent far more serious calamities. Let's talk about problem number one. Bad typography. I know it sounds strange, but it's true. The card that Beatty took out of the envelope had nine words on it, and the largest word is Oscars. Really? Is that really the most important piece of information? Are we worried that without it, Warren Beatty is going to think he's at the Iowa State Fair handing out a medallion for the best hog? The words La La Land and Emma Stone are printed with equal weight. Even though the winner is Emma Stone, the rest is detail. Meanwhile, the important words best actress are tucked away at the bottom of the card, and they're tiny. If best actress had been prominent, Warren Beatty wouldn't have been confused. He would have known that he had the wrong card in his hand. And if Emma Stone had been in larger type than La La Land, Faye Dunaway wouldn't have blurted out the name of the wrong film. It would have been awkward for Beatty and Dunaway to walk off stage to get the right envelope, but not nearly as awkward as not walking off stage to get the right envelope. So the Academy should have hired a designer, but they're not the only ones. Imagine that you're the night shift supervisor at a nuclear power plant. It's four o'clock in the morning, and you don't know it yet, but the turbine system that draws away the heat from the reactor core has just shut down. You're going to have to make some quick decisions, assuming you can figure out what's going wrong and why.
SPEAKER_09: What's that? Uh, let's see. I think it's… Jesus, no! Can we shut it down?
SPEAKER_08: I think… no. Can you?
SPEAKER_05:
SPEAKER_02: During the first few minutes of the accident, more than 100 alarms went off, and there was no system for suppressing the unimportant signals so that operators could concentrate on the significant alarms. Information was not presented in a clear and sufficiently understandable form. That's from the overview of the official inquiry into what was then arguably the world's most serious nuclear accident at Three Mile Island in 1979. It destroyed the reactor, came close to a serious release of radioactive material on the eastern seaboard, and shattered the reputation of the American nuclear industry. It's striking how quickly the inquiry focused in on the question of design. But to anyone who studies how accidents happen, it's not surprising at all. The plant's control rooms were so poorly designed that error was inevitable.
SPEAKER_02: Don Norman, the director of the design lab at UC San Diego, was asked to help analyse the problems at Three Mile Island. Design was at fault, not the operators.
SPEAKER_02: The control panels were baffling. They displayed almost 750 lights, some next to the relevant switches, or above them, or below them, sometimes nowhere near the relevant switch at all. Red lights indicated open valves or active equipment. Green indicated closed valves or inactive equipment. But since some of the lights were typically red and others were normally green, the overall effect was dizzying. So, yes, the operators made mistakes at Three Mile Island, but with better design they might not have. Warren Beatty and Faye Dunaway would sympathise. But something else went wrong that night at the Oscars, something deeper and more surprising. It's a strange effect, and it was first observed by a man less famous for looking at why things go wrong, and more famous for looking at the stars. Galileo Galilei is known for his astronomy, and because his work was consigned to the Church's Index Librorum Prohibitorum, the list of forbidden books. But the great man's final work opens with a less provocative topic. The correct method of storing a stone column on a building site.
SPEAKER_02: Bear with me, this book from 1638 is going to explain the Oscar fiasco and much more. I must relate a circumstance which is worthy of your attention, as indeed are all events which happen contrary to expectation.
SPEAKER_09: Especially when a precautionary measure turns out to be a cause of disaster.
SPEAKER_02: A precautionary measure turns out to be a cause of disaster. That's very interesting, Galileo. Please go on. A large marble column was laid out so that its two ends rested each upon a piece of beam.
SPEAKER_02: I can picture that in my mind. Support the column while it's being stored horizontally, ready for use. If you lay it on the ground, it may get stained, and you'll probably break it when you try to get ropes underneath it to pull it upright. So, yes, store it flat, but propped up by a support at one end and a support at the other. But what if the column can't support its own weight like that and simply snaps in half? Galileo has thought of that.
SPEAKER_09: A little later, it occurred to a mechanic that, in order to be doubly sure it's not breaking in the middle, it would be wise to lay a third support midway. This seemed to all an excellent idea. Yes, if two supports are good, surely three supports are better.
SPEAKER_02: It was quite the opposite.
SPEAKER_09: For not many months passed before the column was found cracked and broken, exactly above the new middle support.
SPEAKER_02: How did that happen? One of the end supports had, after a long while, become decayed and sunken, but the middle one remained hard and strong,
SPEAKER_09: thus causing one half of the column to project in the air without any support.
SPEAKER_02: The central support didn't make the column safer. It pressed into it like the central pivot of a seesaw, snapping it in half. Galileo's tale isn't really about storing columns, and neither is mine. It's about what I'm going to call Galileo's principle. The steps we take to make ourselves safe sometimes lead us into danger. The problem Galileo described is well known to safety engineers. There's an article in the fine scholarly journal Process Safety Progress titled, No Good Deed Goes Unpunished. Case studies of incidents and potential incidents caused by protective systems. These case studies are magnificent. There's a chemical plant where two pressure relief systems interact in a way that means neither of them work. There's a flare designed to destroy pollutants, which ends up causing the release of toxic gases. There's an explosion suppression device that causes an explosion. This kind of thing happens more than you might think. An example is one of the earliest nuclear accidents at Fermi-1, an experimental reactor in Michigan. It's barely remembered now, except in Gil Scott Heron's song, We Almost Lost Detroit This Time. The operators at Fermi-1 lost control of the nuclear reaction for reasons that were baffling to them. Some of the reactor fuel melted. It was all touch and go. Eventually, they got the reactor under control, shut it all down, and waited until it was safe to take it all apart. It was almost a year before the reactor had cooled enough to identify the culprit. A piece of metal, the size of a crushed beer can, had blocked the circulation of the coolant in the reactor core. It was a filter that had been installed at the last moment for safety reasons at the express request of the Nuclear Regulatory Commission. It had come loose and caused the entire problem. Galileo's principle strikes again. Why do safety systems sometimes backfire? The wise old sociologist Charles Perrault's most famous book is called Normal Accidents. It's about how certain kinds of system are vulnerable to catastrophic failure. So vulnerable, in fact, that we should view accidents in those systems as inevitable. The vulnerable systems have two features. The first is that they're what Perrault calls tightly coupled. In a tightly coupled system, one thing leads to another, and another, and another. It's like domino toppling, which is actually a great example of a tightly coupled system. Once you start, it's hard to hit the pause button. A second feature is complexity. A complex system has elements that interact in unexpected ways. A rainforest is a complex system. So is Harvard University. But Harvard University usually isn't tightly coupled. If there's a problem, there's also time to find a solution. A system that's both complex and tightly coupled is dangerous. The complexity means there will occasionally be surprises. The tight coupling means that there will be no time to deal with the surprises. Charles Perrault's theory explains Galileo's principle. Every time you add a feature that's designed to prevent a problem, you're adding complexity. The middle support for the column added complexity. So did the safety filter that damaged the Fermi-1 reactor. Safety systems don't always make us safe.
SPEAKER_01: More of Tim Harford's cautionary tales on 99% Invisible after this. And that's all the time we have for today. With Canva, you don't need to be a designer to design visuals that stand out and stay on brand. Start designing today at Canva.com, the home for every brand. The International Rescue Committee works in more than 40 countries to serve people whose lives have been upended by conflict and disaster. Over 110 million people are displaced around the world, and the IRC urgently needs your help to meet this unprecedented need. The IRC aims to respond within 72 hours after an emergency strikes, and they stay as long as they are needed. Some of the IRC's most important work is addressing the inequalities facing women and girls, ensuring safety from harm, improving health outcomes, increasing access to education, improving economic well-being, and ensuring women and girls have the power to influence decisions that affect their lives. Generous people around the world give to the IRC to help families affected by humanitarian crises with emergency supplies. Your generous donation will give the IRC steady, reliable support, allowing them to continue their ongoing humanitarian efforts even as they respond to emergencies. Donate today by visiting rescue.org slash rebuild. Donate now and help refugee families in need.
SPEAKER_01: If you're thinking of starting therapy, give BetterHelp a try. It's entirely online, designed to be convenient, flexible, and suited to your schedule. Just fill out a brief questionnaire to get matched with a licensed therapist, and switch therapists at any time for no additional charge. Get a break from your thoughts with BetterHelp. Visit betterhelp.com slash invisible today to get 10% off your first month. That's betterhelp. H-E-L-P dot com slash invisible.
SPEAKER_02: Here's the question we should be asking about that bizarre evening at the Oscars. How was it even possible for the distracted accountant Brian Cullinan to give Warren Beatty the wrong envelope? A few minutes earlier, the envelope for best actress, the envelope containing the card that read Emma Stone, La La Land, that envelope had been in the hands of Leonardo DiCaprio as he stood on stage announcing her win. How could that envelope have made its way into the hands of Warren Beatty? The answer, it didn't. There were two envelopes. Every envelope for every category had a duplicate version waiting in the wings. These duplicate envelopes were there as a safety measure. And that safety measure is what made the fiasco possible. Galileo's principle had bitten hard. Charles Perrault's argument is that when systems are both complex and tightly coupled, we should expect catastrophic accidents. Does the Academy Awards ceremony fit that description? It's certainly tightly coupled. You can't easily interrupt a live TV spectacular in front of millions of people to ask for advice. The show must go on. Yet the ceremony doesn't have to be complex. Giving an envelope to Warren Beatty doesn't have to be complex. But you can make it complex if you try. Brian Cullinan's partner in crime that evening was Martha Ruiz. Like Cullinan, she was a senior accountant. The pair of them carried identical briefcases with an identical set of envelopes. On the day of the show, we'll get the ballots and Brian and I will go to the theatre on two separate roads.
SPEAKER_07: He'll go one route and I'll go another route. That's how Martha Ruiz helpfully explained things to journalists just before Oscar night.
SPEAKER_02: Both she and Cullinan had been proudly giving interviews about the foolproof system. We do that to ensure that in case anything happens to one, the other will be there on time and delivering what's needed with the full set.
SPEAKER_07: We do have security measures up until we're at the theatre and delivering that envelope to the presenter just seconds before they walk on stage. We'll be in two different locations. Brian will be on stage right and I'll be on stage left. It all sounds sensible and in many ways it is sensible. It's also complicated.
SPEAKER_02: The system of twin envelopes meant that every time an envelope was opened on stage, its duplicates in the wings had to be set aside. Martha Ruiz, stage left, handed the envelope for best actress to Leonardo DiCaprio, leaving Brian Cullinan, stage right, with a job of discarding the duplicate. The job he failed to do. If there hadn't been that set of twin envelopes, Warren Beatty could never have been given the wrong one. So, bad design helped cause the Oscar fiasco. It also helped cause the accident at Three Mile Island. And a complicated safety system was at the root of the Oscar farce. It was also at the root of the Fermi 1 accident. But it's not just Oscars and nuclear power. I promised you a financial catastrophe too. And in this one, both safety systems and bad typography are to blame. You might even start to see the banking crisis in a very different light. In September 2008, at the height of the financial crisis, an insurance executive named Robert Willemstad requested a meeting with Tim Geithner. Geithner would later be the Treasury Secretary. At the time, he was the president of the New York Federal Reserve. That meant he was responsible for supervising Wall Street's banks, including Lehman Brothers, which was on the brink of collapse. Robert Willemstad was the boss of an insurance company called AIG. And since AIG wasn't a bank, it was far from obvious why Willemstad was Geithner's problem. In his book, Too Big to Fail, the journalist Andrew Ross Sorkin reports the intimate details of this ill-fated meeting.
SPEAKER_06: I'm really sorry, Mr Willemstad. Mr Geithner's going to be a few minutes. No problem. I have time.
SPEAKER_06: I'm sorry. I know you've been waiting a long time. Mr Geithner's on the phone to the boss of Lehman Brothers. He's up to his eyeballs on Lehman.
SPEAKER_02: Tim Geithner was also exhausted. He'd been on an overnight flight from a banking conference in Switzerland. He must have felt completely overwhelmed. Who wouldn't have?
SPEAKER_04: Bob, sorry to keep you waiting. Come in.
SPEAKER_02: Willemstad got his moment. He badly needed to be able to borrow from the Fed. Not normally something AIG would be allowed to do. But he also didn't want to panic Geithner. He needed to walk a tightrope to suggest that AIG could use some help but wasn't actually bankrupt. Is this a critical or emergency situation, Bob?
SPEAKER_04: Well, you know, let me just say that it would be very beneficial to AIG, Mr Geithner. Perhaps I can leave this with you.
SPEAKER_02: Willemstad handed Geithner a briefing note. Buried deep within it was a fast ticking time bomb. The largest firms on Wall Street were relying on AIG to pay out on insurance against financial trouble. The total sum insured was a truly ludicrous $2,700 billion. AIG couldn't possibly pay if all the claims came in. And it was starting to look as though they might. But that meant that the big Wall Street banks wouldn't get the insurance payments they were relying on. AIG was both a bigger threat to the financial system than Lehman Brothers and a far more surprising one. If AIG was a safety net, it was one that wasn't going to break anyone's fall. But to realise that, Tim Geithner would actually have to read and absorb the information in the note. And he was busy. Really busy. So instead he filed it away and turned back to the Lehman Brothers problem. AIG would melt down a few days later. The parallels with Oscar night are uncanny. For one thing, Geithner, who's no fool, had no idea how to interpret what he was looking at. It was unexpected and the key information was buried in the small print. Faye Dunaway and Warren Beatty know the feeling. Then there's Galileo's principle. Safety systems don't always make us safe. Those insurance contracts were supposed to offset risk, not create it, right? But by now we know that safety systems also introduce new ways for things to go wrong. The insurance contracts that were about to destroy AIG were called credit default swaps. They'd become popular as a way to offset risk with the blessing of regulators. They seemed a smart idea. Just as the third support for the columns seems like a smart idea. And the metal filters at the Fermi reactor and the duplicate set of award envelopes. But they backfired. Wall Street banks were relying on these credit default swaps to keep them safe if there was trouble. When it became clear that insurance companies such as AIG couldn't possibly pay out, the banks all scrambled to sell off their risky investments at the exact same time for the exact same reason. A few days after Willemstad had met Geithner, officials and bankers worked through the weekend on the Lehman Brothers' problem. Only on Sunday evening did one of those bankers receive a request from a treasury official to ask if she could drop everything and work on rescuing AIG instead. The surprising phone call was greeted with a response that was unsurprisingly unsuitable for family ears. Hold on, hold on. You're calling me on a Sunday night saying that we just spent the entire weekend on Lehman
SPEAKER_06: and now we have this? How the f*** did we spend the past 48 hours on the wrong thing?
SPEAKER_02: How indeed. For the same reason they gave the Oscar to the wrong movie. Confusing communication and above all, a safety system that created a brand new way to fail. The banking crisis of 2008 shook the world financial system and destroyed millions of jobs. More than a decade later, we're still living with the consequences. It was, in its way, a more serious crisis than any nuclear accident. It was certainly far graver than a bungle at the Oscars. Yet the same problems were at the roots of all these accidents. After the La La Land shambles, Valenti Fair reported, The Oscars have an intense six-step plan to avoid another envelope disaster.
SPEAKER_07: The six steps include getting rid of the two accounting partners, Brian Cullinan and Martha Ruiz,
SPEAKER_02: and the twin sets of envelopes. Instead, says Valenti Fair, there will be three partners. A third partner will sit in the show's control room with the producers.
SPEAKER_07: All three partners will have a complete set of envelopes.
SPEAKER_02: If having two sets caused the problem, having three sets is better, right? I'm not sure Galileo would agree. You've been listening to Cautionary Tales. I expand on some of the ideas in this episode in my book, Adapt. You might like it. Cautionary Tales is written and presented by me, Tim Harford. Our producers are Ryan Dilley and Marilyn Rust. The sound designer and mixer was Pascal Wise, who also composed the amazing music.
SPEAKER_01: In the time since this story was produced, Charles Perrault, the brilliant sociologist and author of Normal Accidents, who was mentioned in the episode, passed away. Cautionary Tales is a production of Pushkin Industries, including the talented Julia Barton, Heather Fain, Mia Lo Bell, Carly McLeory, Jacob Weisberg, and Malcolm Gladwell. I don't know how you could have listened to more than three minutes of this episode and not subscribed to Cautionary Tales, but maybe you were driving or you were doing the dishes and your hands were wet. If so, you can remedy that right now by opening up the podcast app you're listening to and subscribe to Cautionary Tales. There's supposed to be eight episodes, I think, and I'm hoping it's a monster hit, because I want there to be dozens more for me to listen to. 99% Invisible is a project of KALW 91.7 in San Francisco and produced on Radio Row in beautiful downtown Oakland, California. We are a member of Radio-Topia from PRX, a fiercely independent collective of the most innovative shows in all of podcasting. Find them all at Radio-Topia.fm. You can find the show and join discussions about the show on Facebook. You can tweet at me, at Roman Mars, and the show at 99pi.org. We'll have a new episode produced by us next week, but if you need a fix in the meantime, you can always go to 99pi.org.
SPEAKER_01: Radio-Topia from PRX
SPEAKER_05: Welcome back to our studio where we have a special guest with us today, Toucan Sam from Fruit Loops.
SPEAKER_03: Toucan Sam, welcome. It's my pleasure to be here. Oh, and it's Fruit Loops, just so you know. Uh, fruit. Fruit. Yeah, fruit. No, it's Fruit Loops, the same way you say studio. That's not how we say it. Fruit Loops. Find the Loopy side.
