The frequency of hazard exposure can sometimes be changed but the processes involved in the system are themselves intrinsically and irreducibly hazardous. It is the presence of these hazards that drives the creation of defenses against hazard that characterize these systems.
1→Complex systems are intrinsically hazardous systems
All of the interesting systems (e.g. transportation, healthcare, power generation, etc.) are inherently and unavoidably hazardous by the own nature.
...but also a variety of organizational, institutional, and regulatory defenses (e.g. policies and procedures, certification, work rules, team training).
The effect of these measures is to provide a series of shields that normally divert operations away from accidents.
These defenses include obvious technical components (e.g. backup systems, ‘safety’ features of equipment) and human components (e.g. training, knowledge)...
2→Complex systems are heavily and successfully defended against failure
The high consequences of failure lead over time to the construction of multiple layers of defense against failure.
Most initial failure trajectories are blocked by designed system safety components. Trajectories that reach the operational level are mostly blocked, usually by practitioners.
Each of these small failures is necessary to cause catastrophe but only the combination is sufficient to permit failure. Put another way, there are many more failure opportunities than overt system accidents.
3→Catastrophe requires multiple failures–single point failures are not enough
The array of defenses works. System operations are generally successful. Overt catastrophic failure occurs when small, apparently innocuous failures join to create opportunity for a systemic accident.
Eradication of all latent failures is limited primarily by economic cost but also because it is difficult before the fact to see how such failures might contribute to an accident.
4→Complex systems contain changing mixtures of failures latent within them
The complexity of these systems makes it impossible for them to run without multiple flaws being present.
Arguments that these degraded conditions should have been recognized before the overt accident are usually predicated on naïve notions of system performance. System operations are dynamic, with components (organizational, human, technical) failing and being replaced continuously.
5→Complex systems run in degraded mode.
A corollary to the preceding point is that complex systems run as broken systems. The system continues to function because it contains so many redundancies and because people can make it function, despite the presence of many flaws.
The potential for catastrophic outcome is a hallmark of complex systems. It is impossible to eliminate the potential for such catastrophic failure; the potential for such failure is always present by the system’s own nature.
6→Catastrophe is always just around the corner
Complex systems possess potential for catastrophic failure. Human practitioners are nearly always in close physical and temporal proximity to these potential failures – disaster can occur at any time and in nearly any place.
The evaluations based on such reasoning as ‘root cause’ do not reflect a technical understanding of the nature of failure but rather the social, cultural need to blame specific, localized forces or events for outcomes.
7→Post-accident attribution accident to a ‘root cause’ is fundamentally wrong
Because overt failure requires multiple faults, there is no isolated ‘cause’ of an accident. There are multiple contributors to accidents.
13K Followers 5K FollowingLorin Hochstein
Student of complex systems failures, resilience eng, cognitive sys eng. Will talk your ear off about @LFISoftware.
@[email protected]
26K Followers 1K FollowingCofounder, @AdaptiveCLabs, “the NTSB of Tech” bringing Resilience Engineering to industry. he/him. Won’t speak on all-male panels, and #blacklivesmatter.
1K Followers 942 FollowingCTIO and co-founder of @ExcellaCo. Jack of all trades and interested in all of them. Geek at heart. More at https://t.co/wgeHLZyZ2R.
13K Followers 2K FollowingFounder and CEO @jeli_io (acq’d by @pagerduty ). Ex-@slackhq @netflix . Co-wrote O’Reilly Chaos Eng x2. Created @LFISoftware. Angel Investor.
2K Followers 1K Following🩴🐦; 🤷♂️. Per @allspaw, have an unmatched ability to DDoS via questions on 🐦, which I am refiguring out how to use given new owner. he/him.
764 Followers 2K FollowingPerpetual cynic and hopeless optimist. SRE. Resilience in Software Foundation. Journalism, security and privacy. Equality for all. (he/him)
7K Followers 5K FollowingDocumentary series to educate & raise awareness on chronic pain prevention, effective management & recovery where possible https://t.co/CUXraJUb25
149 Followers 4K FollowingSociólogo, Planificador Urbano y Geógrafo (o sea, heteroflexible urbano); LINUX; amante del patinaje; por una movilidad alternativa, sustentable y SEGURA!!!
17 Followers 127 FollowingWar,strategy,operational art,tactics or any combination.1-5th generation Warfare.Boydian.Realpolitik,smokes and mirrors,unintended consequences.Wicked problems.
385 Followers 345 FollowingVP Product/Engineering @ Xentral
Anything on the boundary of technology and people interests me...
Statements / Opinions are my own.
139 Followers 904 FollowingEl objeto de la educación es formar seres aptos para gobernarse a sí mismos y no para ser gobernados por los demás. Herbert Spencer
150 Followers 455 FollowingDon’t mind me, just trying to make sense of it all. 🫠 Studying resilience engineering, & systems safety at #CSEL @OhioState (she/her)
2K Followers 2K FollowingCognitive Systems Engineer w/ a penchant for wild spaces. I study coordination, adaption & decision-making in high risk/high consequence work. 🇨🇦 🇺🇸
978 Followers 5K FollowingCommunity programmes run on relationships. Nectis maps them, measures how they grow, and turns them into the evidence that gets programmes funded and renewed.
485 Followers 666 FollowingForge the future!
Collective human energy is the most powerful force on the planet. I work with systems to enable next generation collaborative problem solving
450 Followers 751 FollowingEngineering leader building great teams and products @traversal_ai. Previously @wherobots, and @splunk/@signalfx. Tweets and opinions are my own. 🇫🇷🇺🇸