-
Interactivity: the missing link between virtual reality technology and drug discovery pipelines
Authors:
Rebecca K. Walters,
Ella M. Gale,
Jonathan Barnoud,
David R. Glowacki,
Adrian J. Mulholland
Abstract:
The potential of virtual reality (VR) to contribute to drug design and development has been recognised for many years. Hardware and software developments now mean that this potential is beginning to be realised, and VR methods are being actively used in this sphere. A recent advance is to use VR not only to visualise and interact with molecular structures, but also to interact with molecular dynam…
▽ More
The potential of virtual reality (VR) to contribute to drug design and development has been recognised for many years. Hardware and software developments now mean that this potential is beginning to be realised, and VR methods are being actively used in this sphere. A recent advance is to use VR not only to visualise and interact with molecular structures, but also to interact with molecular dynamics simulations of 'on the fly' (interactive molecular dynamics in VR, IMD-VR), which is useful not only for flexible docking but also to examine binding processes and conformational changes. iMD-VR has been shown to be useful for creating complexes of ligands bound to target proteins, e.g., recently applied to peptide inhibitors of the SARS-CoV-2 main protease. In this review, we use the term 'interactive VR' to refer to software where interactivity is an inherent part of the user VR experience e.g., in making structural modifications or interacting with a physically rigorous molecular dynamics (MD) simulation, as opposed to simply using VR controllers to rotate and translate the molecule for enhanced visualisation. Here, we describe these methods and their application to problems relevant to drug discovery, highlighting the possibilities that they offer in this arena. We suggest that the ease of viewing and manipulating molecular structures and dynamics, and the ability to modify structures on the fly (e.g., adding or deleting atoms) makes modern interactive VR a valuable tool to add to the armoury of drug development methods.
△ Less
Submitted 8 February, 2022;
originally announced February 2022.
-
Are there any 'object detectors' in the hidden layers of CNNs trained to identify objects or scenes?
Authors:
Ella M. Gale,
Nicholas Martin,
Ryan Blything,
Anh Nguyen,
Jeffrey S. Bowers
Abstract:
Various methods of measuring unit selectivity have been developed with the aim of better understanding how neural networks work. But the different measures provide divergent estimates of selectivity, and this has led to different conclusions regarding the conditions in which selective object representations are learned and the functional relevance of these representations. In an attempt to better…
▽ More
Various methods of measuring unit selectivity have been developed with the aim of better understanding how neural networks work. But the different measures provide divergent estimates of selectivity, and this has led to different conclusions regarding the conditions in which selective object representations are learned and the functional relevance of these representations. In an attempt to better characterize object selectivity, we undertake a comparison of various selectivity measures on a large set of units in AlexNet, including localist selectivity, precision, class-conditional mean activity selectivity (CCMAS), network dissection,the human interpretation of activation maximization (AM) images, and standard signal-detection measures. We find that the different measures provide different estimates of object selectivity, with precision and CCMAS measures providing misleadingly high estimates. Indeed, the most selective units had a poor hit-rate or a high false-alarm rate (or both) in object classification, making them poor object detectors. We fail to find any units that are even remotely as selective as the 'grandmother cell' units reported in recurrent neural networks. In order to generalize these results, we compared selectivity measures on units in VGG-16 and GoogLeNet trained on the ImageNet or Places-365 datasets that have been described as 'object detectors'. Again, we find poor hit-rates and high false-alarm rates for object classification. We conclude that signal-detection measures provide a better assessment of single-unit selectivity compared to common alternative approaches, and that deep convolutional networks of image classification do not learn object detectors in their hidden layers.
△ Less
Submitted 2 July, 2020;
originally announced July 2020.
-
Subtle Sensing: Detecting Differences in the Flexibility of Virtually Simulated Molecular Objects
Authors:
Rhoslyn Roebuck Williams,
Xan Varcoe,
Becca R. Glowacki,
Ella M. Gale,
Alexander Jamieson-Binnie,
David R. Glowacki
Abstract:
During VR demos we have performed over last few years, many participants (in the absence of any haptic feedback) have commented on their perceived ability to 'feel' differences between simulated molecular objects. The mechanisms for such 'feeling' are not entirely clear: observing from outside VR, one can see that there is nothing physical for participants to 'feel'. Here we outline exploratory us…
▽ More
During VR demos we have performed over last few years, many participants (in the absence of any haptic feedback) have commented on their perceived ability to 'feel' differences between simulated molecular objects. The mechanisms for such 'feeling' are not entirely clear: observing from outside VR, one can see that there is nothing physical for participants to 'feel'. Here we outline exploratory user studies designed to evaluate the extent to which participants can distinguish quantitative differences in the flexibility of VR-simulated molecular objects. The results suggest that an individual's capacity to detect differences in molecular flexibility is enhanced when they can interact with and manipulate the molecules, as opposed to merely observing the same interaction. Building on these results, we intend to carry out further studies investigating humans' ability to sense quantitative properties of VR simulations without haptic technology.
△ Less
Submitted 7 May, 2020;
originally announced May 2020.
-
Isness: Using Multi-Person VR to Design Peak Mystical-Type Experiences Comparable to Psychedelics
Authors:
David R. Glowacki,
Mark D. Wonnacott,
Rachel Freire,
Becca R. Glowacki,
Ella M. Gale,
James E. Pike,
Tiu de Haan,
Mike Chatziapostolou,
Oussama Metatla
Abstract:
Studies combining psychotherapy with psychedelic drugs (PsiDs) have demonstrated positive outcomes that are often associated with PsiDs' ability to induce 'mystical-type' experiences (MTEs) - i.e., subjective experiences whose characteristics include a sense of connectedness, transcendence, and ineffability. We suggest that both PsiDs and virtual reality can be situated on a broader spectrum of ps…
▽ More
Studies combining psychotherapy with psychedelic drugs (PsiDs) have demonstrated positive outcomes that are often associated with PsiDs' ability to induce 'mystical-type' experiences (MTEs) - i.e., subjective experiences whose characteristics include a sense of connectedness, transcendence, and ineffability. We suggest that both PsiDs and virtual reality can be situated on a broader spectrum of psychedelic technologies. To test this hypothesis, we used concepts, methods, and analysis strategies from PsiD research to design and evaluate 'Isness', a multi-person VR journey where participants experience the collective emergence, fluctuation, and dissipation of their bodies as energetic essences. A study (N=57) analyzing participant responses to a commonly used PsiD experience questionnaire (MEQ30) indicates that Isness participants had MTEs comparable to those reported in double-blind clinical studies after high doses of psilocybin & LSD. Within a supportive setting and conceptual framework, VR phenomenology can create the conditions for MTEs from which participants derive insight and meaning.
△ Less
Submitted 5 May, 2020; v1 submitted 3 February, 2020;
originally announced February 2020.
-
My, and others', spiking memristors are true memristors: a response to R.S. Williams' question at the New Memory Paradigms: Memristive Phenomena and Neuromorphic Applications Faraday Discussion
Authors:
Ella M. Gale
Abstract:
At the Faraday Discussion, in the paper titled `Neuromorphic computation with spiking memristors: habituation, experimental instantiation of logic gates and a novel sequence-sensitive perceptron model' it was demonstrated that a large amount of computation could be done in a sequential way using memristor current spikes (d.c. response). As these spikes are found in many memristors (possibly all),…
▽ More
At the Faraday Discussion, in the paper titled `Neuromorphic computation with spiking memristors: habituation, experimental instantiation of logic gates and a novel sequence-sensitive perceptron model' it was demonstrated that a large amount of computation could be done in a sequential way using memristor current spikes (d.c. response). As these spikes are found in many memristors (possibly all), this novel approach could be highly useful for fast and reproducible memristor circuits. However, questions were raised as to whether these spikes were actually due to memristance or merely capacitance in the circuit. In this longer version of the Faraday Discussion response, as much information as is available from both published and unpublished data from my lab is marshalled together. We find that the devices are likely imperfect memristors with some capacitance, and that the spikes are related to the frequency effect seen in memristor hysteresis curves, thus are an integral part of memristance.
△ Less
Submitted 14 December, 2018;
originally announced December 2018.
-
When and where do feed-forward neural networks learn localist representations?
Authors:
Ella M. Gale,
Nicolas Martin,
Jeffrey S. Bowers
Abstract:
According to parallel distributed processing (PDP) theory in psychology, neural networks (NN) learn distributed rather than interpretable localist representations. This view has been held so strongly that few researchers have analysed single units to determine if this assumption is correct. However, recent results from psychology, neuroscience and computer science have shown the occasional existen…
▽ More
According to parallel distributed processing (PDP) theory in psychology, neural networks (NN) learn distributed rather than interpretable localist representations. This view has been held so strongly that few researchers have analysed single units to determine if this assumption is correct. However, recent results from psychology, neuroscience and computer science have shown the occasional existence of local codes emerging in artificial and biological neural networks. In this paper, we undertake the first systematic survey of when local codes emerge in a feed-forward neural network, using generated input and output data with known qualities. We find that the number of local codes that emerge from a NN follows a well-defined distribution across the number of hidden layer neurons, with a peak determined by the size of input data, number of examples presented and the sparsity of input data. Using a 1-hot output code drastically decreases the number of local codes on the hidden layer. The number of emergent local codes increases with the percentage of dropout applied to the hidden layer, suggesting that the localist encoding may offer a resilience to noisy networks. This data suggests that localist coding can emerge from feed-forward PDP networks and suggests some of the conditions that may lead to interpretable localist representations in the cortex. The findings highlight how local codes should not be dismissed out of hand.
△ Less
Submitted 11 June, 2018;
originally announced June 2018.
-
Spiking memristor logic gates are a type of time-variant perceptron
Authors:
Ella M. Gale
Abstract:
Memristors are low-power memory-holding resistors thought to be useful for neuromophic computing, which can compute via spike-interactions mediated through the device's short-term memory. Using interacting spikes, it is possible to build an AND gate that computes OR at the same time, similarly a full adder can be built that computes the arithmetical sum of its inputs. Here we show how these gates…
▽ More
Memristors are low-power memory-holding resistors thought to be useful for neuromophic computing, which can compute via spike-interactions mediated through the device's short-term memory. Using interacting spikes, it is possible to build an AND gate that computes OR at the same time, similarly a full adder can be built that computes the arithmetical sum of its inputs. Here we show how these gates can be understood by modelling the memristors as a novel type of perceptron: one which is sensitive to input order. The memristor's memory can change the input weights for later inputs, and thus the memristor gates cannot be accurately described by a single perceptron, requiring either a network of time-invarient perceptrons or a complex time-varying self-reprogrammable perceptron. This work demonstrates the high functionality of memristor logic gates, and also that the addition of theasholding could enable the creation of a standard perceptron in hardware, which may have use in building neural net chips.
△ Less
Submitted 8 January, 2018;
originally announced January 2018.
-
Self-assembled monolayer molecule dynamics are perturbed by surface- and surrounding monolayer-derived geometrical confinement
Authors:
Ella M Gale
Abstract:
The surface a thin-film is attached to and the surrounding monolayer causes geometrical confinement of a interrogated molecule; we look at the base case of a SC$_{18}H_{37}$ in a SC$_{18}H_{37}$ monolayer on Au[111]. Normal mode analysis was used to get vibrations, and these are analysed using mode character indicators which can quantify: how active an element is in a mode; the overall direction o…
▽ More
The surface a thin-film is attached to and the surrounding monolayer causes geometrical confinement of a interrogated molecule; we look at the base case of a SC$_{18}H_{37}$ in a SC$_{18}H_{37}$ monolayer on Au[111]. Normal mode analysis was used to get vibrations, and these are analysed using mode character indicators which can quantify: how active an element is in a mode; the overall direction of the mode; and which chemical coordinates are relevant. We examined the 4 possible packing structures. We find that the more thermodynamically stable structures were less perturbed by the surface and more supported by the surrounding monolayer. The surface-perturbed modes were below 100cm$^{-1}$, had a higher global, carbon, sulfur, longitudinal and torsional characters, indicating unit cell backbone motions, often with increased S motion parallel to the surface, and an increased terminal methyl group motion. Modes identified by this technique showed a difference between experimental vibrations (with and without the surface) that was twice as large as those not identified. The surrounding monolayer had a larger effect on a single molecule dynamics than the surface, including stabilising the molecules enough for 12 high energy modes to move $\approx$425cm$^{-1}$ down in energy to below $k_B T$, allowing them to be populated at room temperature. These modes had higher local and higher H characters, and were highly modulated by the SAM structure. This work shows novels ways to analyse vibrations, and demonstrates the crucial need to include geometric confinement effects in SAM studies.
△ Less
Submitted 28 June, 2017;
originally announced June 2017.
-
Which Memristor Theory is Best for Relating Devices Properties to Memristive Function?
Authors:
Ella M. Gale,
Benjamin de Lacy Costello,
Andrew Adamatzky
Abstract:
There are three theoretical models which purport to relate experimentally-measurable or fabrication-controllable device properties to the memristor's operation: 1. Strukov et al's phenomenological model; 2. Georgiou et al's Bernoulli rewrite of that phenomenological model; 3. Gale's memory-conservation model. They differ in their prediction of the effect on memristance of changing the electrode si…
▽ More
There are three theoretical models which purport to relate experimentally-measurable or fabrication-controllable device properties to the memristor's operation: 1. Strukov et al's phenomenological model; 2. Georgiou et al's Bernoulli rewrite of that phenomenological model; 3. Gale's memory-conservation model. They differ in their prediction of the effect on memristance of changing the electrode size and factors that affect the hysteresis. Using a batch of TiO$_2$ sol-gel memristors fabricated with different top electrode widths we test and compare these three theories. It was found that, contrary to model 2's prediction, the `dimensionless lumped parameter', $β$, did not correlate to any measure of the hysteresis. Contrary to model 1, memristance was found to be dependent on the three spatial dimensions of the TiO$_2$ layer, as was predicted by model 3. Model 3 was found to fit the change in resistance value with electrode size. Simulations using model 3 and experimentally derived values for contact resistance gave hysteresis values that were linearly related to (and only one order of magnitude out) from the experimentally-measured values. Memristor hysteresis was found to be related to the ON state resistance and thus the electrode size (as those two are related). These results offer a verification of the memory-conservation theory of memristance and its association of the vacancy magnetic flux with the missing magnetic flux in memristor theory. This is the first paper to experimentally test various theories pertaining to the operation of memristor devices.
△ Less
Submitted 16 December, 2013;
originally announced December 2013.
