-
Learning From Lessons Learned: Preliminary Findings From a Study of Learning From Failure
Authors:
Jonathan Sillito,
Matt Pope
Abstract:
Due to various sources of uncertainty, emergent behavior, and ongoing changes, the reliability of many socio-technical systems depends on an iterative and collaborative process in which organizations (1) analyze and learn from system failures, and then (2) co-evolve both the technical and human parts of their systems based on what they learn. Many organizations have defined processes for learning…
▽ More
Due to various sources of uncertainty, emergent behavior, and ongoing changes, the reliability of many socio-technical systems depends on an iterative and collaborative process in which organizations (1) analyze and learn from system failures, and then (2) co-evolve both the technical and human parts of their systems based on what they learn. Many organizations have defined processes for learning from failure, often involving postmortem analyses conducted after any system failures that are judged to be sufficiently severe. Despite established processes and tool support, our preliminary research, and professional experience, suggest that it is not straightforward to take what was learned from a failure and successfully improve the reliability of the socio-technical system. To better understand this collaborative process and the associated challenges, we are conducting a study of how teams learn from failure. We are gathering incident reports from multiple organizations and conducting interviews with engineers and managers with relevant experience. Our analytic interest is in what is learned by teams as they reflect on failures, the learning processes involved, and how they use what is learned. Our data collection and analysis are not yet complete, but we have so far analyzed 13 incident reports and seven interviews. In this short paper we (1) present our preliminary findings, and (2) outline our broader research plans.
△ Less
Submitted 14 February, 2024;
originally announced February 2024.
-
The serotonergic psychedelic N,N-dipropyltryptamine alters information-processing dynamics in cortical neural circuits
Authors:
Thomas F. Varley,
Daniel Havert,
Leandro Fosque,
Abolfazl Alipour,
Naruepon Weerawongphrom,
Hiroki Naganobori,
Lily O'Shea,
Maria Pope,
John Beggs
Abstract:
Most of the recent work in psychedelic neuroscience has been done using non-invasive neuroimaging, with data recorded from the brains of adult volunteers under the influence of a variety of drugs. While this data provides holistic insights into the effects of psychedelics on whole-brain dynamics, the effects of psychedelics on the meso-scale dynamics of cortical circuits remains much less explored…
▽ More
Most of the recent work in psychedelic neuroscience has been done using non-invasive neuroimaging, with data recorded from the brains of adult volunteers under the influence of a variety of drugs. While this data provides holistic insights into the effects of psychedelics on whole-brain dynamics, the effects of psychedelics on the meso-scale dynamics of cortical circuits remains much less explored. Here, we report the effects of the serotonergic psychedelic N,N-diproptyltryptamine (DPT) on information-processing dynamics in a sample of in vitro organotypic cultures made from rat cortical tissue. Three hours of spontaneous activity were recorded: an hour of pre-drug control, and hour of exposure to 10$μ$M DPT solution, and a final hour of washout, once again under control conditions. We found that DPT reversibly alters information dynamics in multiple ways: first, the DPT condition was associated with higher entropy of spontaneous firing activity and reduced the amount of time information was stored in individual neurons. Second, DPT also reduced the reversibility of neural activity, increasing the entropy produced and suggesting a drive away from equilibrium. Third, DPT altered the structure of neuronal circuits, decreasing the overall information flow coming into each neuron, but increasing the number of weak connections, creating a dynamic that combines elements of integration and disintegration. Finally, DPT decreased the higher-order statistical synergy present in sets of three neurons. Collectively, these results paint a complex picture of how psychedelics regulate information processing in meso-scale cortical tissue. Implications for existing hypotheses of psychedelic action, such as the Entropic Brain Hypothesis, are discussed.
△ Less
Submitted 31 October, 2023;
originally announced October 2023.
-
Partial entropy decomposition reveals higher-order structures in human brain activity
Authors:
Thomas F Varley,
Maria Pope,
Maria Grazia Puxeddu,
Joshua Faskowitz,
Olaf Sporns
Abstract:
The standard approach to modeling the human brain as a complex system is with a network, where the basic unit of interaction is a pairwise link between two brain regions. While powerful, this approach is limited by the inability to assess higher-order interactions involving three or more elements directly. In this work, we present a method for capturing higher-order dependencies in discrete data b…
▽ More
The standard approach to modeling the human brain as a complex system is with a network, where the basic unit of interaction is a pairwise link between two brain regions. While powerful, this approach is limited by the inability to assess higher-order interactions involving three or more elements directly. In this work, we present a method for capturing higher-order dependencies in discrete data based on partial entropy decomposition (PED). Our approach decomposes the joint entropy of the whole system into a set of strictly non-negative partial entropy atoms that describe the redundant, unique, and synergistic interactions that compose the system's structure. We begin by showing how the PED can provide insights into the mathematical structure of both the FC network itself, as well as established measures of higher-order dependency such as the O-information. When applied to resting state fMRI data, we find robust evidence of higher-order synergies that are largely invisible to standard functional connectivity analyses. This synergistic structure distinct from structural features based on redundancy that have previously dominated FC analyses. Our approach can also be localized in time, allowing a frame-by-frame analysis of how the distributions of redundancies and synergies change over the course of a recording. We find that different ensembles of regions can transiently change from being redundancy-dominated to synergy-dominated, and that the temporal pattern is structured in time. These results provide strong evidence that there exists a large space of unexplored structures in human brain data that have been largely missed by a focus on bivariate network connectivity models. This synergistic "shadow structures" is dynamic in time and, likely will illuminate new and interesting links between brain and behavior.
△ Less
Submitted 12 January, 2023;
originally announced January 2023.
-
Multivariate Information Theory Uncovers Synergistic Subsystems of the Human Cerebral Cortex
Authors:
Thomas F. Varley,
Maria Pope,
Joshua Faskowitz,
Olaf Sporns
Abstract:
One of the most well-established tools for modeling the brain as a complex system is the functional connectivity network, which examines the correlations between pairs of interacting brain regions. While powerful, the network model is limited by the restriction that only pairwise dependencies are visible and potentially higher-order structures are missed. In this work, we explore how multivariate…
▽ More
One of the most well-established tools for modeling the brain as a complex system is the functional connectivity network, which examines the correlations between pairs of interacting brain regions. While powerful, the network model is limited by the restriction that only pairwise dependencies are visible and potentially higher-order structures are missed. In this work, we explore how multivariate information theory can reveal higher-order, synergistic dependencies in the human brain. Using the O-information, a measure of whether the structure of a system is redundancy- or synergy-dominated, we show that synergistic subsystems are widespread in the human brain. We provide a mathematical analysis of the O-information to locate it within a larger taxonomy of multivariate complexity measures. We also show the O-information is related to a previously established measure, the Tononi-Sporns-Edelman complexity, and can be understood as an expected difference in integration between system scales. Highly synergistic subsystems typically sit between canonical functional networks, and may serve to integrate those networks. We then use simulated annealing to find maximally synergistic subsystems, finding that such systems typically comprise $\approx$10 brain regions, also recruited from multiple canonical brain systems. Though ubiquitous, highly synergistic subsystems are invisible when considering pairwise functional connectivity, suggesting that higher-order dependencies form a kind of ``shadow structure" that has been unrecognized by established network-based analyses. We assert that higher-order interactions in the brain represent a vast and under-explored space that, made accessible with tools of multivariate information theory, may offer novel scientific insights.
△ Less
Submitted 13 June, 2022;
originally announced June 2022.
-
Quartermaster: A Tool for Modeling and Simulating System Degradation
Authors:
Matt Pope,
Jonathan Sillito
Abstract:
It is essential that software systems be tolerant to degradations in components they rely on. There are patterns and techniques which software engineers use to ensure their systems gracefully degrade. Despite these techniques being available in practice, tuning and configuration is hard to get right and it is expensive to explore possible changes to components and techniques in complex systems. To…
▽ More
It is essential that software systems be tolerant to degradations in components they rely on. There are patterns and techniques which software engineers use to ensure their systems gracefully degrade. Despite these techniques being available in practice, tuning and configuration is hard to get right and it is expensive to explore possible changes to components and techniques in complex systems. To fill these gaps, we propose Quartermaster to model and simulate systems and fault-tolerant techniques. We anticipate that Quartermaster will be useful to further research on graceful degradation and help inform software engineers about techniques that are most appropriate for their use cases.
△ Less
Submitted 5 March, 2021;
originally announced March 2021.
