-
Are there any 'object detectors' in the hidden layers of CNNs trained to identify objects or scenes?
Authors:
Ella M. Gale,
Nicholas Martin,
Ryan Blything,
Anh Nguyen,
Jeffrey S. Bowers
Abstract:
Various methods of measuring unit selectivity have been developed with the aim of better understanding how neural networks work. But the different measures provide divergent estimates of selectivity, and this has led to different conclusions regarding the conditions in which selective object representations are learned and the functional relevance of these representations. In an attempt to better…
▽ More
Various methods of measuring unit selectivity have been developed with the aim of better understanding how neural networks work. But the different measures provide divergent estimates of selectivity, and this has led to different conclusions regarding the conditions in which selective object representations are learned and the functional relevance of these representations. In an attempt to better characterize object selectivity, we undertake a comparison of various selectivity measures on a large set of units in AlexNet, including localist selectivity, precision, class-conditional mean activity selectivity (CCMAS), network dissection,the human interpretation of activation maximization (AM) images, and standard signal-detection measures. We find that the different measures provide different estimates of object selectivity, with precision and CCMAS measures providing misleadingly high estimates. Indeed, the most selective units had a poor hit-rate or a high false-alarm rate (or both) in object classification, making them poor object detectors. We fail to find any units that are even remotely as selective as the 'grandmother cell' units reported in recurrent neural networks. In order to generalize these results, we compared selectivity measures on units in VGG-16 and GoogLeNet trained on the ImageNet or Places-365 datasets that have been described as 'object detectors'. Again, we find poor hit-rates and high false-alarm rates for object classification. We conclude that signal-detection measures provide a better assessment of single-unit selectivity compared to common alternative approaches, and that deep convolutional networks of image classification do not learn object detectors in their hidden layers.
△ Less
Submitted 2 July, 2020;
originally announced July 2020.
-
Subtle Sensing: Detecting Differences in the Flexibility of Virtually Simulated Molecular Objects
Authors:
Rhoslyn Roebuck Williams,
Xan Varcoe,
Becca R. Glowacki,
Ella M. Gale,
Alexander Jamieson-Binnie,
David R. Glowacki
Abstract:
During VR demos we have performed over last few years, many participants (in the absence of any haptic feedback) have commented on their perceived ability to 'feel' differences between simulated molecular objects. The mechanisms for such 'feeling' are not entirely clear: observing from outside VR, one can see that there is nothing physical for participants to 'feel'. Here we outline exploratory us…
▽ More
During VR demos we have performed over last few years, many participants (in the absence of any haptic feedback) have commented on their perceived ability to 'feel' differences between simulated molecular objects. The mechanisms for such 'feeling' are not entirely clear: observing from outside VR, one can see that there is nothing physical for participants to 'feel'. Here we outline exploratory user studies designed to evaluate the extent to which participants can distinguish quantitative differences in the flexibility of VR-simulated molecular objects. The results suggest that an individual's capacity to detect differences in molecular flexibility is enhanced when they can interact with and manipulate the molecules, as opposed to merely observing the same interaction. Building on these results, we intend to carry out further studies investigating humans' ability to sense quantitative properties of VR simulations without haptic technology.
△ Less
Submitted 7 May, 2020;
originally announced May 2020.
-
Isness: Using Multi-Person VR to Design Peak Mystical-Type Experiences Comparable to Psychedelics
Authors:
David R. Glowacki,
Mark D. Wonnacott,
Rachel Freire,
Becca R. Glowacki,
Ella M. Gale,
James E. Pike,
Tiu de Haan,
Mike Chatziapostolou,
Oussama Metatla
Abstract:
Studies combining psychotherapy with psychedelic drugs (PsiDs) have demonstrated positive outcomes that are often associated with PsiDs' ability to induce 'mystical-type' experiences (MTEs) - i.e., subjective experiences whose characteristics include a sense of connectedness, transcendence, and ineffability. We suggest that both PsiDs and virtual reality can be situated on a broader spectrum of ps…
▽ More
Studies combining psychotherapy with psychedelic drugs (PsiDs) have demonstrated positive outcomes that are often associated with PsiDs' ability to induce 'mystical-type' experiences (MTEs) - i.e., subjective experiences whose characteristics include a sense of connectedness, transcendence, and ineffability. We suggest that both PsiDs and virtual reality can be situated on a broader spectrum of psychedelic technologies. To test this hypothesis, we used concepts, methods, and analysis strategies from PsiD research to design and evaluate 'Isness', a multi-person VR journey where participants experience the collective emergence, fluctuation, and dissipation of their bodies as energetic essences. A study (N=57) analyzing participant responses to a commonly used PsiD experience questionnaire (MEQ30) indicates that Isness participants had MTEs comparable to those reported in double-blind clinical studies after high doses of psilocybin & LSD. Within a supportive setting and conceptual framework, VR phenomenology can create the conditions for MTEs from which participants derive insight and meaning.
△ Less
Submitted 5 May, 2020; v1 submitted 3 February, 2020;
originally announced February 2020.
-
My, and others', spiking memristors are true memristors: a response to R.S. Williams' question at the New Memory Paradigms: Memristive Phenomena and Neuromorphic Applications Faraday Discussion
Authors:
Ella M. Gale
Abstract:
At the Faraday Discussion, in the paper titled `Neuromorphic computation with spiking memristors: habituation, experimental instantiation of logic gates and a novel sequence-sensitive perceptron model' it was demonstrated that a large amount of computation could be done in a sequential way using memristor current spikes (d.c. response). As these spikes are found in many memristors (possibly all),…
▽ More
At the Faraday Discussion, in the paper titled `Neuromorphic computation with spiking memristors: habituation, experimental instantiation of logic gates and a novel sequence-sensitive perceptron model' it was demonstrated that a large amount of computation could be done in a sequential way using memristor current spikes (d.c. response). As these spikes are found in many memristors (possibly all), this novel approach could be highly useful for fast and reproducible memristor circuits. However, questions were raised as to whether these spikes were actually due to memristance or merely capacitance in the circuit. In this longer version of the Faraday Discussion response, as much information as is available from both published and unpublished data from my lab is marshalled together. We find that the devices are likely imperfect memristors with some capacitance, and that the spikes are related to the frequency effect seen in memristor hysteresis curves, thus are an integral part of memristance.
△ Less
Submitted 14 December, 2018;
originally announced December 2018.
-
When and where do feed-forward neural networks learn localist representations?
Authors:
Ella M. Gale,
Nicolas Martin,
Jeffrey S. Bowers
Abstract:
According to parallel distributed processing (PDP) theory in psychology, neural networks (NN) learn distributed rather than interpretable localist representations. This view has been held so strongly that few researchers have analysed single units to determine if this assumption is correct. However, recent results from psychology, neuroscience and computer science have shown the occasional existen…
▽ More
According to parallel distributed processing (PDP) theory in psychology, neural networks (NN) learn distributed rather than interpretable localist representations. This view has been held so strongly that few researchers have analysed single units to determine if this assumption is correct. However, recent results from psychology, neuroscience and computer science have shown the occasional existence of local codes emerging in artificial and biological neural networks. In this paper, we undertake the first systematic survey of when local codes emerge in a feed-forward neural network, using generated input and output data with known qualities. We find that the number of local codes that emerge from a NN follows a well-defined distribution across the number of hidden layer neurons, with a peak determined by the size of input data, number of examples presented and the sparsity of input data. Using a 1-hot output code drastically decreases the number of local codes on the hidden layer. The number of emergent local codes increases with the percentage of dropout applied to the hidden layer, suggesting that the localist encoding may offer a resilience to noisy networks. This data suggests that localist coding can emerge from feed-forward PDP networks and suggests some of the conditions that may lead to interpretable localist representations in the cortex. The findings highlight how local codes should not be dismissed out of hand.
△ Less
Submitted 11 June, 2018;
originally announced June 2018.
-
Spiking memristor logic gates are a type of time-variant perceptron
Authors:
Ella M. Gale
Abstract:
Memristors are low-power memory-holding resistors thought to be useful for neuromophic computing, which can compute via spike-interactions mediated through the device's short-term memory. Using interacting spikes, it is possible to build an AND gate that computes OR at the same time, similarly a full adder can be built that computes the arithmetical sum of its inputs. Here we show how these gates…
▽ More
Memristors are low-power memory-holding resistors thought to be useful for neuromophic computing, which can compute via spike-interactions mediated through the device's short-term memory. Using interacting spikes, it is possible to build an AND gate that computes OR at the same time, similarly a full adder can be built that computes the arithmetical sum of its inputs. Here we show how these gates can be understood by modelling the memristors as a novel type of perceptron: one which is sensitive to input order. The memristor's memory can change the input weights for later inputs, and thus the memristor gates cannot be accurately described by a single perceptron, requiring either a network of time-invarient perceptrons or a complex time-varying self-reprogrammable perceptron. This work demonstrates the high functionality of memristor logic gates, and also that the addition of theasholding could enable the creation of a standard perceptron in hardware, which may have use in building neural net chips.
△ Less
Submitted 8 January, 2018;
originally announced January 2018.
-
Which Memristor Theory is Best for Relating Devices Properties to Memristive Function?
Authors:
Ella M. Gale,
Benjamin de Lacy Costello,
Andrew Adamatzky
Abstract:
There are three theoretical models which purport to relate experimentally-measurable or fabrication-controllable device properties to the memristor's operation: 1. Strukov et al's phenomenological model; 2. Georgiou et al's Bernoulli rewrite of that phenomenological model; 3. Gale's memory-conservation model. They differ in their prediction of the effect on memristance of changing the electrode si…
▽ More
There are three theoretical models which purport to relate experimentally-measurable or fabrication-controllable device properties to the memristor's operation: 1. Strukov et al's phenomenological model; 2. Georgiou et al's Bernoulli rewrite of that phenomenological model; 3. Gale's memory-conservation model. They differ in their prediction of the effect on memristance of changing the electrode size and factors that affect the hysteresis. Using a batch of TiO$_2$ sol-gel memristors fabricated with different top electrode widths we test and compare these three theories. It was found that, contrary to model 2's prediction, the `dimensionless lumped parameter', $β$, did not correlate to any measure of the hysteresis. Contrary to model 1, memristance was found to be dependent on the three spatial dimensions of the TiO$_2$ layer, as was predicted by model 3. Model 3 was found to fit the change in resistance value with electrode size. Simulations using model 3 and experimentally derived values for contact resistance gave hysteresis values that were linearly related to (and only one order of magnitude out) from the experimentally-measured values. Memristor hysteresis was found to be related to the ON state resistance and thus the electrode size (as those two are related). These results offer a verification of the memory-conservation theory of memristance and its association of the vacancy magnetic flux with the missing magnetic flux in memristor theory. This is the first paper to experimentally test various theories pertaining to the operation of memristor devices.
△ Less
Submitted 16 December, 2013;
originally announced December 2013.
