-
Cluster Flow: how a hierarchical clustering layer make allows deep-NNs more resilient to hacking, more human-like and easily implements relational reasoning
Authors:
Ella Gale,
Oliver Matthews
Abstract:
Despite the huge recent breakthroughs in neural networks (NNs) for artificial intelligence (specifically deep convolutional networks) such NNs do not achieve human-level performance: they can be hacked by images that would fool no human and lack `common sense'. It has been argued that a basis of human-level intelligence is mankind's ability to perform relational reasoning: the comparison of differ…
▽ More
Despite the huge recent breakthroughs in neural networks (NNs) for artificial intelligence (specifically deep convolutional networks) such NNs do not achieve human-level performance: they can be hacked by images that would fool no human and lack `common sense'. It has been argued that a basis of human-level intelligence is mankind's ability to perform relational reasoning: the comparison of different objects, measuring similarity, gras** of relations between objects and the converse, figuring out the odd one out in a set of objects. Mankind can even do this with objects they have never seen before. Here we show how ClusterFlow, a semi-supervised hierarchical clustering framework can operate on trained NNs utilising the rich multi-dimensional class and feature data found at the pre-SoftMax layer to build a hyperspacial map of classes/features and this adds more human-like functionality to modern deep convolutional neural networks. We demonstrate this with 3 tasks. 1. the statistical learning based `mistakes' made by infants when attending to images of cats and dogs. 2. improving both the resilience to hacking images and the accurate measure of certainty in deep-NNs. 3. Relational reasoning over sets of images, including those not known to the NN nor seen before. We also demonstrate that ClusterFlow can work on non-NN data and deal with missing data by testing it on a Chemistry dataset. This work suggests that modern deep NNs can be made more human-like without re-training of the NNs. As it is known that some methods used in deep and convolutional NNs are not biologically plausible or perhaps even the best approach: the ClusterFlow framework can sit on top of any NN and will be a useful tool to add as NNs are improved in this regard.
△ Less
Submitted 27 April, 2023;
originally announced April 2023.
-
Creating a Large-scale Synthetic Dataset for Human Activity Recognition
Authors:
Ollie Matthews,
Koki Ryu,
Tarun Srivastava
Abstract:
Creating and labelling datasets of videos for use in training Human Activity Recognition models is an arduous task. In this paper, we approach this by using 3D rendering tools to generate a synthetic dataset of videos, and show that a classifier trained on these videos can generalise to real videos. We use five different augmentation techniques to generate the videos, leading to a wide variety of…
▽ More
Creating and labelling datasets of videos for use in training Human Activity Recognition models is an arduous task. In this paper, we approach this by using 3D rendering tools to generate a synthetic dataset of videos, and show that a classifier trained on these videos can generalise to real videos. We use five different augmentation techniques to generate the videos, leading to a wide variety of accurately labelled unique videos. We fine tune a pre-trained I3D model on our videos, and find that the model is able to achieve a high accuracy of 73% on the HMDB51 dataset over three classes. We also find that augmenting the HMDB training set with our dataset provides a 2% improvement in the performance of the classifier. Finally, we discuss possible extensions to the dataset, including virtual try on and modeling motion of the people.
△ Less
Submitted 21 July, 2020;
originally announced July 2020.
-
The MosaicSim Simulator (Full Technical Report)
Authors:
Opeoluwa Matthews,
Aninda Manocha,
Davide Giri,
Marcelo Orenes-Vera,
Esin Tureci,
Tyler Sorensen,
Tae Jun Ham,
Juan L. Aragón,
Luca P. Carloni,
Margaret Martonosi
Abstract:
As Moore's Law has slowed and Dennard Scaling has ended, architects are increasingly turning to heterogeneous parallelism and domain-specific hardware-software co-designs. These trends present new challenges for simulation-based performance assessments that are central to early-stage architectural exploration. Simulators must be lightweight to support rich heterogeneous combinations of general pur…
▽ More
As Moore's Law has slowed and Dennard Scaling has ended, architects are increasingly turning to heterogeneous parallelism and domain-specific hardware-software co-designs. These trends present new challenges for simulation-based performance assessments that are central to early-stage architectural exploration. Simulators must be lightweight to support rich heterogeneous combinations of general purpose cores and specialized processing units. They must also support agile exploration of hardware-software co-design, i.e. changes in the programming model, compiler, ISA, and specialized hardware.
To meet these challenges, we introduce MosaicSim, a lightweight, modular simulator for heterogeneous systems, offering accuracy and agility designed specifically for hardware-software co-design explorations. By integrating the LLVM toolchain, MosaicSim enables efficient modeling of instruction dependencies and flexible additions across the stack. Its modularity also allows the composition and integration of different hardware components. We first demonstrate that MosaicSim captures architectural bottlenecks in applications, and accurately models both scaling trends in a multicore setting and accelerator behavior. We then present two case-studies where MosaicSim enables straightforward design space explorations for emerging systems, i.e. data science application acceleration and heterogeneous parallel architectures.
△ Less
Submitted 15 April, 2020;
originally announced April 2020.
-
Beyond Markov Chains, Towards Adaptive Memristor Network-based Music Generation
Authors:
Ella Gale,
Oliver Matthews,
Ben de Lacy Costello,
Andrew Adamatzky
Abstract:
We undertook a study of the use of a memristor network for music generation, making use of the memristor's memory to go beyond the Markov hypothesis. Seed transition matrices are created and populated using memristor equations, and which are shown to generate musical melodies and change in style over time as a result of feedback into the transition matrix. The spiking properties of simple memristo…
▽ More
We undertook a study of the use of a memristor network for music generation, making use of the memristor's memory to go beyond the Markov hypothesis. Seed transition matrices are created and populated using memristor equations, and which are shown to generate musical melodies and change in style over time as a result of feedback into the transition matrix. The spiking properties of simple memristor networks are demonstrated and discussed with reference to applications of music making. The limitations of simulating composing memristor networks in von Neumann hardware is discussed and a hardware solution based on physical memristor properties is presented.
△ Less
Submitted 4 February, 2013;
originally announced February 2013.
-
Magnetically moderated outbursts of WZ Sagittae
Authors:
O. M. Matthews,
R. Speith,
G. A. Wynn,
R. G. West
Abstract:
We argue that the quiescent value of the viscosity parameter of the accretion disc in WZ Sge may be alpha_{cold}~0.01, in agreement with estimates of alpha_{cold} for other dwarf novae. Assuming the white dwarf in WZ Sge to be magnetic, we show that, in quiescence, material close to the white dwarf can be propelled to larger radii, depleting the inner accretion disc. The propeller therefore has…
▽ More
We argue that the quiescent value of the viscosity parameter of the accretion disc in WZ Sge may be alpha_{cold}~0.01, in agreement with estimates of alpha_{cold} for other dwarf novae. Assuming the white dwarf in WZ Sge to be magnetic, we show that, in quiescence, material close to the white dwarf can be propelled to larger radii, depleting the inner accretion disc. The propeller therefore has the effect of stabilizing the inner disc and allowing the outer disc to accumulate mass. The outbursts of WZ Sge are then regulated by the (magnetically determined) evolution of the surface density of the outer disc at a radius close to the tidal limit. Numerical models confirm that the recurrence time can be significantly extended in this way. The outbursts are expected to be superoutbursts since the outer disc radius is forced to exceed the tidal (3:1 resonance) radius. The large, quiescent disc is expected to be massive, and to be able to supply the observed mass accretion rate during outburst. We predict that the long-term spin evolution of the white dwarf spin will involve a long cycle of spin up and spin down phases.
△ Less
Submitted 7 November, 2006;
originally announced November 2006.
-
Propeller activated resonances and the fate of short period cataclysmic variables
Authors:
O. M. Matthews,
P. J. Wheatley,
G. A. Wynn,
M. R. Truss
Abstract:
We show that the combination of a weak magnetic propeller and accretion disc resonances can effectively halt accretion in short period cataclysmic variables for large fractions of their lifetimes. This may help to explain the discrepancy between the observed and predicted orbital period distributions of cataclysmic variables at short periods. Orbital resonances cause the disc to become eccentric…
▽ More
We show that the combination of a weak magnetic propeller and accretion disc resonances can effectively halt accretion in short period cataclysmic variables for large fractions of their lifetimes. This may help to explain the discrepancy between the observed and predicted orbital period distributions of cataclysmic variables at short periods. Orbital resonances cause the disc to become eccentric, allowing material to fall back onto the donor star or out of the system. A weak magnetic field on a rapidly spinning primary star propels disc material outwards, allowing it to access these resonances. Numerical and analytic calculations show that this state can be long lived (~10^11 yr). This is because the magnetic propeller is required only to maintain access to the resonances, and not to push matter out of the Roche lobe, so that the spin down time-scale is much longer than for a classical propeller model.
△ Less
Submitted 22 August, 2006;
originally announced August 2006.
-
Modeling the Photopolarimetric Variability of AA Tau
Authors:
Mark O'Sullivan,
Michael Truss,
Christina Walker,
Kenneth Wood,
Owen Matthews,
Barbara Whitney,
J. E. Bjorkman
Abstract:
We present Monte Carlo scattered light models of a warped disk that reproduce the observed photopolarimetric variability of the classical T Tauri star AA Tau. For a system inclination of 75 deg and using an analytic description for a warped inner disk, we find that the shape and amplitude of the photopolarimetric variability are reproduced with a warp which occults the star, located at 0.07 au,…
▽ More
We present Monte Carlo scattered light models of a warped disk that reproduce the observed photopolarimetric variability of the classical T Tauri star AA Tau. For a system inclination of 75 deg and using an analytic description for a warped inner disk, we find that the shape and amplitude of the photopolarimetric variability are reproduced with a warp which occults the star, located at 0.07 au, amplitude 0.016 au, extending over radial and azimuthal ranges 0.0084 au and 145 deg. We also show a time sequence of high spatial resolution scattered light images, showing a dark shadow cast by the warp swee** round the disk. Using a modified smooth particle hydrodynamics code, we find that a stellar dipole magnetic field of strength 5.2 kG, inclined at 30 deg to the stellar rotation axis can reproduce the required disk war** to explain AA Tau's photopolarimetric variability.
△ Less
Submitted 25 January, 2005; v1 submitted 24 January, 2005;
originally announced January 2005.
-
The steady-state structure of accretion discs in central magnetic fields
Authors:
O. M. Matthews,
R. Speith,
M. R. Truss,
G. A. Wynn
Abstract:
We develop a new analytic solution for the steady-state structure of a thin accretion disc under the influence of a magnetic field that is anchored to the central star. The solution takes a form similar to that of Shakura and Sunyaev and tends to their solution as the magnetic moment of the star tends to zero. As well as the Kramer's law case, we obtain a solution for a general opacity. The effe…
▽ More
We develop a new analytic solution for the steady-state structure of a thin accretion disc under the influence of a magnetic field that is anchored to the central star. The solution takes a form similar to that of Shakura and Sunyaev and tends to their solution as the magnetic moment of the star tends to zero. As well as the Kramer's law case, we obtain a solution for a general opacity. The effects of varying the mass transfer rate, spin period and magnetic field of the star as well as the opacity model applied to the disc are explored for a range of objects. The solution depends on the position of the magnetic truncation radius. We propose a new approach for the identification of the truncation radius and present an analytic expression for its position.
△ Less
Submitted 20 October, 2004;
originally announced October 2004.
-
Outbursts of WZ Sagittae
Authors:
O. M. Matthews,
M. R. Truss,
G. A. Wynn,
R. Speith
Abstract:
The outbursts of the dwarf nova WZ Sagittae occur on timescales which are much longer than expected from the standard thermal viscous disc instability model, which correctly reproduces the outburst behaviour of many other dwarf novae. In addition short `echo' outbursts have sometimes been observed after the main outburst. The increased timescales could be explained by a magnetic propeller, ancho…
▽ More
The outbursts of the dwarf nova WZ Sagittae occur on timescales which are much longer than expected from the standard thermal viscous disc instability model, which correctly reproduces the outburst behaviour of many other dwarf novae. In addition short `echo' outbursts have sometimes been observed after the main outburst. The increased timescales could be explained by a magnetic propeller, anchored to the primary star, which clears the inner disc . We argue that the propeller, combined with the resonances of the binary orbit, may also be the cause of the echo outbursts. We present numerical models which reproduce the echo outbursts.
△ Less
Submitted 6 October, 2004;
originally announced October 2004.
-
Outbursts of Young Stellar Objects
Authors:
O. M. Matthews,
R. Speith,
G. A. Wynn
Abstract:
We argue that the outbursts of the FU Orionis stars occur on timescales which are much longer than expected from the standard disc instability model with α_{c} \gtrsim 10^{-3}. The outburst, recurrence, and rise times are consistent with the idea that the accretion disc in these objects is truncated at a radius R_{i} \sim 40 \rsun. In agreement with a number of previous authors we suggest that t…
▽ More
We argue that the outbursts of the FU Orionis stars occur on timescales which are much longer than expected from the standard disc instability model with α_{c} \gtrsim 10^{-3}. The outburst, recurrence, and rise times are consistent with the idea that the accretion disc in these objects is truncated at a radius R_{i} \sim 40 \rsun. In agreement with a number of previous authors we suggest that the inner regions of the accretion discs in FU Ori objects are evacuated by the action of a magnetic propeller anchored on the central star. We develop an analytic solution for the steady state structure of an accretion disc in the presence of a central magnetic torque, and present numerical calculations to follow its time evolution. These calculations confirm that a recurrence time that is consistent with observations can be obtained by selecting appropriate values for viscosity and magnetic field strength.
△ Less
Submitted 21 October, 2003;
originally announced October 2003.
