-
System Safety Monitoring of Learned Components Using Temporal Metric Forecasting
Authors:
Sepehr Sharifi,
Andrea Stocco,
Lionel C. Briand
Abstract:
In learning-enabled autonomous systems, safety monitoring of learned components is crucial to ensure their outputs do not lead to system safety violations, given the operational context of the system. However, develo** a safety monitor for practical deployment in real-world applications is challenging. This is due to limited access to internal workings and training data of the learned component.…
▽ More
In learning-enabled autonomous systems, safety monitoring of learned components is crucial to ensure their outputs do not lead to system safety violations, given the operational context of the system. However, develo** a safety monitor for practical deployment in real-world applications is challenging. This is due to limited access to internal workings and training data of the learned component. Furthermore, safety monitors should predict safety violations with low latency, while consuming a reasonable amount of computation.
To address the challenges, we propose a safety monitoring method based on probabilistic time series forecasting. Given the learned component outputs and an operational context, we empirically investigate different Deep Learning (DL)-based probabilistic forecasting to predict the objective measure capturing the satisfaction or violation of a safety requirement (safety metric). We empirically evaluate safety metric and violation prediction accuracy, and inference latency and resource usage of four state-of-the-art models, with varying horizons, using an autonomous aviation case study. Our results suggest that probabilistic forecasting of safety metrics, given learned component outputs and scenarios, is effective for safety monitoring. Furthermore, for the autonomous aviation case study, Temporal Fusion Transformer (TFT) was the most accurate model for predicting imminent safety violations, with acceptable latency and resource consumption.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
Assessing Quality Metrics for Neural Reality Gap Input Mitigation in Autonomous Driving Testing
Authors:
Stefano Carlo Lambertenghi,
Andrea Stocco
Abstract:
Simulation-based testing of automated driving systems (ADS) is the industry standard, being a controlled, safe, and cost-effective alternative to real-world testing. Despite these advantages, virtual simulations often fail to accurately replicate real-world conditions like image fidelity, texture representation, and environmental accuracy. This can lead to significant differences in ADS behavior b…
▽ More
Simulation-based testing of automated driving systems (ADS) is the industry standard, being a controlled, safe, and cost-effective alternative to real-world testing. Despite these advantages, virtual simulations often fail to accurately replicate real-world conditions like image fidelity, texture representation, and environmental accuracy. This can lead to significant differences in ADS behavior between simulated and real-world domains, a phenomenon known as the sim2real gap. Researchers have used Image-to-Image (I2I) neural translation to mitigate the sim2real gap, enhancing the realism of simulated environments by transforming synthetic data into more authentic representations of real-world conditions. However, while promising, these techniques may potentially introduce artifacts, distortions, or inconsistencies in the generated data that can affect the effectiveness of ADS testing. In our empirical study, we investigated how the quality of image-to-image (I2I) techniques influences the mitigation of the sim2real gap, using a set of established metrics from the literature. We evaluated two popular generative I2I architectures, pix2pix, and CycleGAN, across two ADS perception tasks at a model level, namely vehicle detection and end-to-end lane kee**, using paired simulated and real-world datasets. Our findings reveal that the effectiveness of I2I architectures varies across different ADS tasks, and existing evaluation metrics do not consistently align with the ADS behavior. Thus, we conducted task-specific fine-tuning of perception metrics, which yielded a stronger correlation. Our findings indicate that a perception metric that incorporates semantic elements, tailored to each task, can facilitate selecting the most appropriate I2I technique for a reliable assessment of the sim2real gap mitigation.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification
Authors:
Ruben Grewal,
Paolo Tonella,
Andrea Stocco
Abstract:
The automated real-time recognition of unexpected situations plays a crucial role in the safety of autonomous vehicles, especially in unsupported and unpredictable scenarios. This paper evaluates different Bayesian uncertainty quantification methods from the deep learning domain for the anticipatory testing of safety-critical misbehaviours during system-level simulation-based testing. Specifically…
▽ More
The automated real-time recognition of unexpected situations plays a crucial role in the safety of autonomous vehicles, especially in unsupported and unpredictable scenarios. This paper evaluates different Bayesian uncertainty quantification methods from the deep learning domain for the anticipatory testing of safety-critical misbehaviours during system-level simulation-based testing. Specifically, we compute uncertainty scores as the vehicle executes, following the intuition that high uncertainty scores are indicative of unsupported runtime conditions that can be used to distinguish safe from failure-inducing driving behaviors. In our study, we conducted an evaluation of the effectiveness and computational overhead associated with two Bayesian uncertainty quantification methods, namely MC- Dropout and Deep Ensembles, for misbehaviour avoidance. Overall, for three benchmarks from the Udacity simulator comprising both out-of-distribution and unsafe conditions introduced via mutation testing, both methods successfully detected a high number of out-of-bounds episodes providing early warnings several seconds in advance, outperforming two state-of-the-art misbehaviour prediction methods based on autoencoders and attention maps in terms of effectiveness and efficiency. Notably, Deep Ensembles detected most misbehaviours without any false alarms and did so even when employing a relatively small number of models, making them computationally feasible for real-time detection. Our findings suggest that incorporating uncertainty quantification methods is a viable approach for building fail-safe mechanisms in deep neural network-based autonomous vehicles.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Lessons Learned in Performing a Trustworthy AI and Fundamental Rights Assessment
Authors:
Marjolein Boonstra,
Frédérick Bruneault,
Subrata Chakraborty,
Tjitske Faber,
Alessio Gallucci,
Eleanore Hickman,
Gerard Kema,
Hee** Kim,
Jaap Kooiker,
Elisabeth Hildt,
Annegret Lamadé,
Emilie Wiinblad Mathez,
Florian Möslein,
Genien Pathuis,
Giovanni Sartor,
Marijke Steege,
Alice Stocco,
Willy Tadema,
Jarno Tuimala,
Isabel van Vledder,
Dennis Vetter,
Jana Vetter,
Magnus Westerlund,
Roberto V. Zicari
Abstract:
This report shares the experiences, results and lessons learned in conducting a pilot project ``Responsible use of AI'' in cooperation with the Province of Friesland, Rijks ICT Gilde-part of the Ministry of the Interior and Kingdom Relations (BZK) (both in The Netherlands) and a group of members of the Z-Inspection$^{\small{\circledR}}$ Initiative. The pilot project took place from May 2022 throug…
▽ More
This report shares the experiences, results and lessons learned in conducting a pilot project ``Responsible use of AI'' in cooperation with the Province of Friesland, Rijks ICT Gilde-part of the Ministry of the Interior and Kingdom Relations (BZK) (both in The Netherlands) and a group of members of the Z-Inspection$^{\small{\circledR}}$ Initiative. The pilot project took place from May 2022 through January 2023. During the pilot, the practical application of a deep learning algorithm from the province of Frŷslan was assessed. The AI maps heathland grassland by means of satellite images for monitoring nature reserves. Environmental monitoring is one of the crucial activities carried on by society for several purposes ranging from maintaining standards on drinkable water to quantifying the CO2 emissions of a particular state or region. Using satellite imagery and machine learning to support decisions is becoming an important part of environmental monitoring. The main focus of this report is to share the experiences, results and lessons learned from performing both a Trustworthy AI assessment using the Z-Inspection$^{\small{\circledR}}$ process and the EU framework for Trustworthy AI, and combining it with a Fundamental Rights assessment using the Fundamental Rights and Algorithms Impact Assessment (FRAIA) as recommended by the Dutch government for the use of AI algorithms by the Dutch public authorities.
△ Less
Submitted 22 April, 2024;
originally announced April 2024.
-
Autonomous Engulfment of Active Colloids by Giant Lipid Vesicles
Authors:
Florent Fessler,
Martin Wittman,
Juliane Simmchen,
Antonio Stocco
Abstract:
The ability to design artificial micro/nanomachines able to perform sophisticated tasks crucially depends on the understanding of their interaction with biosystems and their compatibility with the biological environment. Here, Janus colloids fuelled only by glucose and light were designed, which can autonomously interact with cell-like compartments and trigger endocytosis. The crucial role played…
▽ More
The ability to design artificial micro/nanomachines able to perform sophisticated tasks crucially depends on the understanding of their interaction with biosystems and their compatibility with the biological environment. Here, Janus colloids fuelled only by glucose and light were designed, which can autonomously interact with cell-like compartments and trigger endocytosis. The crucial role played by the far field hydrodynamic interaction arising from the puller/pusher swimming mode and adhesion is evidenced. It is shown that a large contact time between the active particle and the lipid membrane is required to observe the engulfment of a particle inside a floppy giant lipid vesicle. Active Janus colloids showing relatively small velocities and a puller type swimming mode are able to target giant vesicles, deform their membranes and subsequently get stably engulfed. An instability arising from the unbound membrane segment is responsible for the transition between partial and complete stable engulfment. These experiments shed light on the physical criteria required for autonomous active particle engulfment in giant vesicles, which can serve as general principles in disciplines ranging from drug delivery and microbial infection to nanomedecine.
△ Less
Submitted 15 March, 2024;
originally announced March 2024.
-
Rotational and translational drags of a Janus particle close to a wall and a lipid membrane
Authors:
Vaibhav Sharma,
Florent Fessler,
Fabrice Thalmann,
Carlos Marques,
Antonio Stocco
Abstract:
Hypothesis: Measuring rotational and translational Brownian motion of single spherical particles reveals dissipations due to the interaction between the particle and the environment. Experiments: In this article, we show experiments where the in-plane translational and two rotational drag coefficients of a single spherical Brownian particle can be measured. These particle drags are functions of th…
▽ More
Hypothesis: Measuring rotational and translational Brownian motion of single spherical particles reveals dissipations due to the interaction between the particle and the environment. Experiments: In this article, we show experiments where the in-plane translational and two rotational drag coefficients of a single spherical Brownian particle can be measured. These particle drags are functions of the particle size and the particle-wall distance, and of the viscous dissipations at play. We measure drag coefficients for Janus particles close to a solid wall and close to a lipid bilayer membrane. Findings: For a particle close to wall, we show that according to hydrodynamic models, particlewall distance and particle size can be determined. For a particle partially wrapped by lipid membranes, in absence of strong binding interactions, translational and rotational drags are significantly larger than the ones of non-wrapped particles. Beside the effect of the membrane viscosity, we show that dissipations in the deformed membrane cap region strongly contribute to the drag coefficients.
△ Less
Submitted 21 September, 2023;
originally announced September 2023.
-
Neural Embeddings for Web Testing
Authors:
Andrea Stocco,
Alexandra Willi,
Luigi Libero Lucio Starace,
Matteo Biagiola,
Paolo Tonella
Abstract:
Web test automation techniques employ web crawlers to automatically produce a web app model that is used for test generation. Existing crawlers rely on app-specific, threshold-based, algorithms to assess state equivalence. Such algorithms are hard to tune in the general case and cannot accurately identify and remove near-duplicate web pages from crawl models. Failing to retrieve an accurate web ap…
▽ More
Web test automation techniques employ web crawlers to automatically produce a web app model that is used for test generation. Existing crawlers rely on app-specific, threshold-based, algorithms to assess state equivalence. Such algorithms are hard to tune in the general case and cannot accurately identify and remove near-duplicate web pages from crawl models. Failing to retrieve an accurate web app model results in automated test generation solutions that produce redundant test cases and inadequate test suites that do not cover the web app functionalities adequately. In this paper, we propose WEBEMBED, a novel abstraction function based on neural network embeddings and threshold-free classifiers that can be used to produce accurate web app models during model-based test generation. Our evaluation on nine web apps shows that WEBEMBED outperforms state-of-the-art techniques by detecting near-duplicates more accurately, inferring better web app models that exhibit 22% more precision, and 24% more recall on average. Consequently, the test suites generated from these models achieve higher code coverage, with improvements ranging from 2% to 59% on an app-wise basis and averaging at 23%.
△ Less
Submitted 12 June, 2023;
originally announced June 2023.
-
Two is Better Than One: Digital Siblings to Improve Autonomous Driving Testing
Authors:
Matteo Biagiola,
Andrea Stocco,
Vincenzo Riccio,
Paolo Tonella
Abstract:
Simulation-based testing represents an important step to ensure the reliability of autonomous driving software. In practice, when companies rely on third-party general-purpose simulators, either for in-house or outsourced testing, the generalizability of testing results to real autonomous vehicles is at stake. In this paper, we enhance simulation-based testing by introducing the notion of digital…
▽ More
Simulation-based testing represents an important step to ensure the reliability of autonomous driving software. In practice, when companies rely on third-party general-purpose simulators, either for in-house or outsourced testing, the generalizability of testing results to real autonomous vehicles is at stake. In this paper, we enhance simulation-based testing by introducing the notion of digital siblings, a multi-simulator approach that tests a given autonomous vehicle on multiple general-purpose simulators built with different technologies, that operate collectively as an ensemble in the testing process.
We exemplify our approach on a case study focused on testing the lane-kee** component of an autonomous vehicle. We use two open-source simulators as digital siblings, and we empirically compare such a multi-simulator approach against a digital twin of a physical scaled autonomous vehicle on a large set of test cases. Our approach requires generating and running test cases for each individual simulator, in the form of sequences of road points. Then, test cases are migrated between simulators, using feature maps to characterize the exercised driving conditions. Finally, the joint predicted failure probability is computed, and a failure is reported only in cases of agreement among the siblings.
Our empirical evaluation shows that the ensemble failure predictor by the digital siblings is superior to each individual simulator at predicting the failures of the digital twin. We discuss the findings of our case study and detail how our approach can help researchers interested in automated testing of autonomous driving software.
△ Less
Submitted 24 April, 2024; v1 submitted 14 May, 2023;
originally announced May 2023.
-
Entry of Microparticles into Giant Lipid Vesicles by Optical Tweezers
Authors:
Florent Fessler,
Vaibhav Sharma,
Pierre Muller,
Antonio Stocco
Abstract:
Entry of micro- or nano-sized objects into cells or vesicles made of lipid membranes occur in many processes such as entry of viruses in host cells, microplastics pollution, drug delivery or biomedical imaging. Here, we investigated the microparticle crossing of lipid membranes in giant unilamellar vesicles in the absence of strong binding interactions (e.g. streptavidin-biotin binding). In these…
▽ More
Entry of micro- or nano-sized objects into cells or vesicles made of lipid membranes occur in many processes such as entry of viruses in host cells, microplastics pollution, drug delivery or biomedical imaging. Here, we investigated the microparticle crossing of lipid membranes in giant unilamellar vesicles in the absence of strong binding interactions (e.g. streptavidin-biotin binding). In these conditions, we observed that organic and inorganic particles can always penetrate inside the vesicles provided that an external picoNewton force is applied and for relatively low membrane tensions. In the limit of a vanishing adhesion, we pointed out the role of the membrane area reservoir and show that a force minimum exists when the particle size is comparable to the bendocapillary length.
△ Less
Submitted 6 January, 2023;
originally announced January 2023.
-
Microparticle Brownian Motion near an Air-Water Interface Governed by Direction-Dependent Boundary Conditions
Authors:
Stefano Villa,
Christophe Blanc,
Abdallah Daddi-Moussa-Ider,
Antonio Stocco,
Maurizio Nobili
Abstract:
Although the dynamics of colloids in the vicinity of a solid interface has been widely characterized in the past, experimental studies of Brownian diffusion close to an air-water interface are rare and limited to particle-interface gap distances larger than the particle size. At the still unexplored lower distances, the dynamics is expected to be extremely sensitive to boundary conditions at the a…
▽ More
Although the dynamics of colloids in the vicinity of a solid interface has been widely characterized in the past, experimental studies of Brownian diffusion close to an air-water interface are rare and limited to particle-interface gap distances larger than the particle size. At the still unexplored lower distances, the dynamics is expected to be extremely sensitive to boundary conditions at the air-water interface. There, ad hoc experiments would provide a quantitative validation of predictions. Using a specially designed dual wave interferometric setup, the 3D dynamics of 9 micrometers diameter particles at a few hundreds of nanometers from an air-water interface is here measured in thermal equilibrium. Intriguingly, while the measured dynamics parallel to the interface approaches expected predictions for slip boundary conditions, the Brownian motion normal to the interface is very close to the predictions for no-slip boundary conditions. These puzzling results are rationalized considering current models of incompressible interfacial flow and deepened develo** an ad hoc model which considers the contribution of tiny concentrations of surface active particles at the interface. We argue that such condition governs the particle dynamics in a large spectrum of systems ranging from biofilm formation to flotation process.
△ Less
Submitted 22 September, 2022; v1 submitted 4 July, 2022;
originally announced July 2022.
-
Mind the Gap! A Study on the Transferability of Virtual vs Physical-world Testing of Autonomous Driving Systems
Authors:
Andrea Stocco,
Brian Pulfer,
Paolo Tonella
Abstract:
Safe deployment of self-driving cars (SDC) necessitates thorough simulated and in-field testing. Most testing techniques consider virtualized SDCs within a simulation environment, whereas less effort has been directed towards assessing whether such techniques transfer to and are effective with a physical real-world vehicle. In this paper, we shed light on the problem of generalizing testing result…
▽ More
Safe deployment of self-driving cars (SDC) necessitates thorough simulated and in-field testing. Most testing techniques consider virtualized SDCs within a simulation environment, whereas less effort has been directed towards assessing whether such techniques transfer to and are effective with a physical real-world vehicle. In this paper, we shed light on the problem of generalizing testing results obtained in a driving simulator to a physical platform and provide a characterization and quantification of the sim2real gap affecting SDC testing. In our empirical study, we compare SDC testing when deployed on a physical small-scale vehicle vs its digital twin. Due to the unavailability of driving quality indicators from the physical platform, we use neural rendering to estimate them through visual odometry, hence allowing full comparability with the digital twin. Then, we investigate the transferability of behavior and failure exposure between virtual and real-world environments, targeting both unintended abnormal test data and intended adversarial examples. Our study shows that, despite the usage of a faithful digital twin, there are still critical shortcomings that contribute to the reality gap between the virtual and physical world, threatening existing testing solutions that only consider virtual SDCs. On the positive side, our results present the test configurations for which physical testing can be avoided, either because their outcome does transfer between virtual and physical environments, or because the uncertainty profiles in the simulator can help predict their outcome in the real world.
△ Less
Submitted 25 August, 2022; v1 submitted 21 December, 2021;
originally announced December 2021.
-
Taxonomy of Real Faults in Deep Learning Systems
Authors:
Nargiz Humbatova,
Gunel Jahangirova,
Gabriele Bavota,
Vincenzo Riccio,
Andrea Stocco,
Paolo Tonella
Abstract:
The growing application of deep neural networks in safety-critical domains makes the analysis of faults that occur in such systems of enormous importance. In this paper we introduce a large taxonomy of faults in deep learning (DL) systems. We have manually analysed 1059 artefacts gathered from GitHub commits and issues of projects that use the most popular DL frameworks (TensorFlow, Keras and PyTo…
▽ More
The growing application of deep neural networks in safety-critical domains makes the analysis of faults that occur in such systems of enormous importance. In this paper we introduce a large taxonomy of faults in deep learning (DL) systems. We have manually analysed 1059 artefacts gathered from GitHub commits and issues of projects that use the most popular DL frameworks (TensorFlow, Keras and PyTorch) and from related Stack Overflow posts. Structured interviews with 20 researchers and practitioners describing the problems they have encountered in their experience have enriched our taxonomy with a variety of additional faults that did not emerge from the other two sources. Our final taxonomy was validated with a survey involving an additional set of 21 developers, confirming that almost all fault categories (13/15) were experienced by at least 50% of the survey participants.
△ Less
Submitted 7 November, 2019; v1 submitted 24 October, 2019;
originally announced October 2019.
-
Misbehaviour Prediction for Autonomous Driving Systems
Authors:
Andrea Stocco,
Michael Weiss,
Marco Calzana,
Paolo Tonella
Abstract:
Deep Neural Networks (DNNs) are the core component of modern autonomous driving systems. To date, it is still unrealistic that a DNN will generalize correctly in all driving conditions. Current testing techniques consist of offline solutions that identify adversarial or corner cases for improving the training phase, and little has been done for enabling online healing of DNN-based vehicles. In thi…
▽ More
Deep Neural Networks (DNNs) are the core component of modern autonomous driving systems. To date, it is still unrealistic that a DNN will generalize correctly in all driving conditions. Current testing techniques consist of offline solutions that identify adversarial or corner cases for improving the training phase, and little has been done for enabling online healing of DNN-based vehicles. In this paper, we address the problem of estimating the confidence of DNNs in response to unexpected execution contexts with the purpose of predicting potential safety-critical misbehaviours such as out of bound episodes or collisions. Our approach SelfOracle is based on a novel concept of self-assessment oracle, which monitors the DNN confidence at runtime, to predict unsupported driving scenarios in advance. SelfOracle uses autoencoder and time-series-based anomaly detection to reconstruct the driving scenarios seen by the car, and determine the confidence boundary of normal/unsupported conditions. In our empirical assessment, we evaluated the effectiveness of different variants of SelfOracle at predicting injected anomalous driving contexts, using DNN models and simulation environment from Udacity. Results show that, overall, SelfOracle can predict 77% misbehaviours, up to 6 seconds in advance, outperforming the online input validation approach of DeepRoad by a factor almost equal to 3.
△ Less
Submitted 10 October, 2019;
originally announced October 2019.
-
Web Test Dependency Detection
Authors:
Matteo Biagiola,
Andrea Stocco,
Ali Mesbah,
Filippo Ricca,
Paolo Tonella
Abstract:
E2E web test suites are prone to test dependencies due to the heterogeneous multi-tiered nature of modern web apps, which makes it difficult for developers to create isolated program states for each test case. In this paper, we present the first approach for detecting and validating test dependencies present in E2E web test suites. Our approach employs string analysis to extract an approximated se…
▽ More
E2E web test suites are prone to test dependencies due to the heterogeneous multi-tiered nature of modern web apps, which makes it difficult for developers to create isolated program states for each test case. In this paper, we present the first approach for detecting and validating test dependencies present in E2E web test suites. Our approach employs string analysis to extract an approximated set of dependencies from the test code. It then filters potential false dependencies through natural language processing of test names. Finally, it validates all dependencies, and uses a novel recovery algorithm to ensure no true dependencies are missed in the final test dependency graph. Our approach is implemented in a tool called TEDD and evaluated on the test suites of six open-source web apps. Our results show that TEDD can correctly detect and validate test dependencies up to 72% faster than the baseline with the original test ordering in which the graph contains all possible dependencies. The test dependency graphs produced by TEDD enable test execution parallelization, with a speed-up factor of up to 7x.
△ Less
Submitted 10 October, 2019; v1 submitted 1 May, 2019;
originally announced May 2019.
-
BrainNet: A Multi-Person Brain-to-Brain Interface for Direct Collaboration Between Brains
Authors:
Linxing Preston Jiang,
Andrea Stocco,
Darby M. Losey,
Justin A. Abernethy,
Chantel S. Prat,
Rajesh P. N. Rao
Abstract:
We present BrainNet which, to our knowledge, is the first multi-person non-invasive direct brain-to-brain interface for collaborative problem solving. The interface combines electroencephalography (EEG) to record brain signals and transcranial magnetic stimulation (TMS) to deliver information noninvasively to the brain. The interface allows three human subjects to collaborate and solve a task usin…
▽ More
We present BrainNet which, to our knowledge, is the first multi-person non-invasive direct brain-to-brain interface for collaborative problem solving. The interface combines electroencephalography (EEG) to record brain signals and transcranial magnetic stimulation (TMS) to deliver information noninvasively to the brain. The interface allows three human subjects to collaborate and solve a task using direct brain-to-brain communication. Two of the three subjects are "Senders" whose brain signals are decoded using real-time EEG data analysis to extract decisions about whether to rotate a block in a Tetris-like game before it is dropped to fill a line. The Senders' decisions are transmitted via the Internet to the brain of a third subject, the "Receiver," who cannot see the game screen. The decisions are delivered to the Receiver's brain via magnetic stimulation of the occipital cortex. The Receiver integrates the information received and makes a decision using an EEG interface about either turning the block or kee** it in the same position. A second round of the game gives the Senders one more chance to validate and provide feedback to the Receiver's action. We evaluated the performance of BrainNet in terms of (1) Group-level performance during the game; (2) True/False positive rates of subjects' decisions; (3) Mutual information between subjects. Five groups of three subjects successfully used BrainNet to perform the Tetris task, with an average accuracy of 0.813. Furthermore, by varying the information reliability of the Senders by artificially injecting noise into one Sender's signal, we found that Receivers are able to learn which Sender is more reliable based solely on the information transmitted to their brains. Our results raise the possibility of future brain-to-brain interfaces that enable cooperative problem solving by humans using a "social network" of connected brains.
△ Less
Submitted 22 May, 2019; v1 submitted 23 September, 2018;
originally announced September 2018.
