From: veritasium

Cosmic rays, an invisible phenomenon permeating the universe, can cause unexpected malfunctions in electronic devices, leading to incidents ranging from election recounts to aircraft plunges [00:00:11]. These high-energy particles can flip bits in computer memory, leading to what are known as “soft errors” [00:04:34].

Unintended Electronic Malfunctions

In 2003, a Belgian election recount was triggered in Schaerbeek, a municipality in central Brussels [00:00:44]. A little-known candidate, Maria Vindevogel, received 4,096 more votes than mathematically possible [00:00:54]. Investigations found no software bugs or hardware faults [00:01:38]. The number 4,096 is exactly 2 to the power of 12, or the 13th bit in binary [00:02:40]. This suggested that the 13th bit representing Vindevogel’s vote tally had flipped from a zero to a one [00:02:55]. Investigators suspected a particle from a cosmic ray shower struck a transistor in the computer, causing the bit flip [00:09:52].

Similar issues were reported by major computer companies starting in the 1970s [00:03:12]. In 1978, Intel found that natural radioactivity from trace amounts of uranium and thorium in the ceramic packaging of their DRAM chips caused bits to spontaneously flip [00:03:19]. Alpha particles emitted by these elements were energetic enough to create electron-hole pairs in silicon, accumulating electrons and flipping a bit from one to zero [00:04:14]. This issue became prominent as chip components miniaturized to the point where a single alpha particle could produce enough charge to flip a bit [00:05:01].

Today, chip manufacturers are more careful to avoid radioactive materials [00:05:18]. While not caused by natural radioactivity in the computer itself, the Belgian election incident is consistent with a cosmic ray interaction [00:05:26].

Discovery of Cosmic Rays

The existence of cosmic rays was first suggested by Theodore Wolf in 1910, who observed that radiation levels did not decrease as expected at the top of the Eiffel Tower [00:06:16]. Austrian physicist Victor Hess confirmed this in 1911-1912 by conducting balloon flights up to 5,200 meters, where he found radiation levels several times greater than on the ground, concluding the radiation came from the sky, not Earth [00:06:35]. Hess also found that a solar eclipse had no effect on the radiation levels, suggesting it did not emanate from the sun [00:07:32].

Today, we know cosmic rays are not electromagnetic rays but particles: about 90% protons, 9% helium nuclei, and 1% heavier nuclei [00:08:10]. High-energy cosmic rays originate from exploding stars (supernovae) in our galaxy and others, and the highest energy particles are thought to come from black holes [00:08:28]. These primary cosmic rays collide with air molecules about 25 kilometers above the ground, creating a cascade of secondary particles like neutrons, protons, muons, electrons, positrons, and photons that stream towards Earth [00:09:20].

Cosmic Rays and Terrestrial Systems

Single event upsets (SEUs) are a type of soft error where a bit changes without damaging the device [00:04:34]. These are constantly occurring:

  • Video Games: In 2013, during a Super Mario 64 speedrun, a player experienced an inexplicable “up warp” to a higher platform [00:11:32]. The best explanation is a cosmic ray caused a bit flip in Mario’s height coordinate, leading to the effect [00:12:08].
  • Operating Systems: A “blue screen of death” in an operating system can potentially be caused by a neutron, a product of cosmic ray showers [00:12:57].
  • General Computing: In 1996, IBM estimated that for each 256 megabytes of RAM, one bit flip occurs per month, with neutrons being the main culprit [00:13:19].

While cosmic rays were initially speculated to be the cause of Toyota’s unintended acceleration recalls starting in 2009, a NASA investigation identified sticky accelerator pedals, poorly fitted floor mats, and driver error as the main causes [00:13:34].

Impact on Supercomputers

Cosmic rays have caused crashes of supercomputers, especially at higher elevations [00:14:14]. Los Alamos National Labs, located 2200 meters above sea level, frequently deals with neutron-induced supercomputer crashes [00:14:21]. To mitigate this, their software auto-saves frequently, and neutron detectors have been installed throughout the facility [00:14:30].

Impact on Avionics

At cruising altitude in a plane, the radiation from cosmic rays increases significantly:

  • 0.5 microsieverts per hour at 18,000 feet [00:14:45]
  • 1 microsievert per hour at 23,000 feet [00:14:48]
  • Over 2 microsieverts per hour at 33,000 feet [00:14:51]
  • Over 3 microsieverts per hour at even higher altitudes and towards the poles [00:14:54]

This increases the chance of a single event upset by 10 to 30 times at cruising altitude [00:15:00].

On October 7, 2008, an Airbus A330 flying from Singapore to Perth suddenly pitched down, diving 200 meters in 20 seconds [00:15:12]. 119 people were injured [00:15:48]. The fault was traced to the first Air Data Inertial Reference Unit (ADIRU), which supplies critical flight data [00:15:57]. A bit flip in the first eight bits of a 32-bit binary word meant altitude information was mislabeled as angle of attack information [00:16:16]. The plane then sharply nosed down to correct what it thought was a stall [00:16:41]. While other possibilities were ruled out, investigators concluded that a single event effect from a high-energy atmospheric particle striking an integrated circuit was a potential triggering event [00:17:05]. The Airbus A330 was built in 1992, before specific regulatory requirements for airborne systems to be resilient to single event effects [00:17:24].

Mitigation in Space and Aerospace

For critical aerospace and space technology, radiation hardening is employed to protect electronics:

  • Space Shuttle: Redundancy was built into the space shuttle’s navigation and control systems, with four computers simultaneously running identical software [00:17:34]. If one computer had a soft error, the other three would overrule it [00:17:44]. On one five-day mission (STS 48), 161 separate bit flips were tracked [00:17:53].
  • Mars Rovers: The computer on the Perseverance Rover, launched in 2001, is a 20-year-old PowerPC with 256 megabytes of RAM and two gigabytes of flash storage [00:19:27]. It is radiation hardened, meaning its design, materials, circuits, and software are built to withstand 40 times the radiation of an ordinary computer [00:19:41]. This technology has been used on over a dozen space missions since 2005 [00:19:52].
  • Testing: Engineers test radiation-hardened processors by exposing them to particle beams on Earth and observing “blue screens of death” to understand failure modes and prevent them in space, where an unrecoverable crash would mean mission loss [00:19:57].

The sun’s 11-year activity cycle creates a protective bubble (the heliosphere) that helps deflect and slow cosmic rays from interstellar space, but this protection fluctuates, with lower cosmic ray flux on Earth when the sun is active [00:20:52].