-
SKYNET: an efficient and robust neural network training tool for machine learning in astronomy
Authors:
Philip Graff,
Farhan Feroz,
Michael P. Hobson,
Anthony N. Lasenby
Abstract:
We present the first public release of our generic neural network training algorithm, called SkyNet. This efficient and robust machine learning tool is able to train large and deep feed-forward neural networks, including autoencoders, for use in a wide range of supervised and unsupervised learning applications, such as regression, classification, density estimation, clustering and dimensionality r…
▽ More
We present the first public release of our generic neural network training algorithm, called SkyNet. This efficient and robust machine learning tool is able to train large and deep feed-forward neural networks, including autoencoders, for use in a wide range of supervised and unsupervised learning applications, such as regression, classification, density estimation, clustering and dimensionality reduction. SkyNet uses a `pre-training' method to obtain a set of network parameters that has empirically been shown to be close to a good solution, followed by further optimisation using a regularised variant of Newton's method, where the level of regularisation is determined and adjusted automatically; the latter uses second-order derivative information to improve convergence, but without the need to evaluate or store the full Hessian matrix, by using a fast approximate method to calculate Hessian-vector products. This combination of methods allows for the training of complicated networks that are difficult to optimise using standard backpropagation techniques. SkyNet employs convergence criteria that naturally prevent overfitting, and also includes a fast algorithm for estimating the accuracy of network outputs. The utility and flexibility of SkyNet are demonstrated by application to a number of toy problems, and to astronomical problems focusing on the recovery of structure from blurred and noisy images, the identification of gamma-ray bursters, and the compression and denoising of galaxy images. The SkyNet software, which is implemented in standard ANSI C and fully parallelised using MPI, is available at http://www.mrao.cam.ac.uk/software/skynet/.
△ Less
Submitted 27 January, 2014; v1 submitted 3 September, 2013;
originally announced September 2013.
-
Optimal filters on the sphere
Authors:
J. D. McEwen,
M. P. Hobson,
A. N. Lasenby
Abstract:
We derive optimal filters on the sphere in the context of detecting compact objects embedded in a stochastic background process. The matched filter and the scale adaptive filter are derived on the sphere in the most general setting, allowing for directional template profiles and filters. The performance and relative merits of the two optimal filters are discussed. The application of optimal filt…
▽ More
We derive optimal filters on the sphere in the context of detecting compact objects embedded in a stochastic background process. The matched filter and the scale adaptive filter are derived on the sphere in the most general setting, allowing for directional template profiles and filters. The performance and relative merits of the two optimal filters are discussed. The application of optimal filter theory on the sphere to the detection of compact objects is demonstrated on simulated mock data. A naive detection strategy is adopted, with an initial aim of illustrating the application of the new optimal filters derived on the sphere. Nevertheless, this simple object detection strategy is demonstrated to perform well, even a low signal-to-noise ratio. Code written to compute optimal filters on the sphere (S2FIL), to perform fast directional filtering on the sphere (FastCSWT) and to construct the simulated mock data (COMB) are all made publicly available from http://www.mrao.cam.ac.uk/~jdm57/
△ Less
Submitted 28 July, 2008; v1 submitted 22 December, 2006;
originally announced December 2006.
-
A directional continuous wavelet transform on the sphere
Authors:
J. D. McEwen,
M. P. Hobson,
A. N. Lasenby
Abstract:
A new construction of a directional continuous wavelet analysis on the sphere is derived herein. We adopt the harmonic scaling idea for the spherical dilation operator recently proposed by Sanz et al. but extend the analysis to a more general directional framework. Directional wavelets are a powerful extension that allow one to also probe oriented structure in the analysed function. Our spherica…
▽ More
A new construction of a directional continuous wavelet analysis on the sphere is derived herein. We adopt the harmonic scaling idea for the spherical dilation operator recently proposed by Sanz et al. but extend the analysis to a more general directional framework. Directional wavelets are a powerful extension that allow one to also probe oriented structure in the analysed function. Our spherical wavelet methodology has the advantage that all functions and operators are defined directly on the sphere. The construction of wavelets in our framework is demonstrated with an example.
△ Less
Submitted 6 September, 2006;
originally announced September 2006.
-
Fast directional continuous spherical wavelet transform algorithms
Authors:
J. D. McEwen,
M. P. Hobson,
D. J. Mortlock,
A. N. Lasenby
Abstract:
We describe the construction of a spherical wavelet analysis through the inverse stereographic projection of the Euclidean planar wavelet framework, introduced originally by Antoine and Vandergheynst and developed further by Wiaux et al. Fast algorithms for performing the directional continuous wavelet analysis on the unit sphere are presented. The fast directional algorithm, based on the fast s…
▽ More
We describe the construction of a spherical wavelet analysis through the inverse stereographic projection of the Euclidean planar wavelet framework, introduced originally by Antoine and Vandergheynst and developed further by Wiaux et al. Fast algorithms for performing the directional continuous wavelet analysis on the unit sphere are presented. The fast directional algorithm, based on the fast spherical convolution algorithm developed by Wandelt and Gorski, provides a saving of O(sqrt(Npix)) over a direct quadrature implementation for Npix pixels on the sphere, and allows one to perform a directional spherical wavelet analysis of a 10^6 pixel map on a personal computer.
△ Less
Submitted 23 May, 2006; v1 submitted 14 June, 2005;
originally announced June 2005.
