Showing 1–50 of 193 results for author: Worrall, D

Optical- & UV-Continuum Morphologies of Compact Radio Source Hosts

Authors: Chetna Duggal, Christopher P. O'Dea, Stefi A. Baum, Alvaro Labiano, Clive Tadhunter, Diana M. Worrall, Raffaella Morganti, Grant R. Tremblay, Daniel Dicken

Abstract: We present the first systematic search for UV signatures from radio source-driven AGN feedback in Compact Steep Spectrum (CSS) radio galaxies. Owing to their characteristic sub-galactic jets (1-20 kpc projected linear sizes), CSS hosts are excellent laboratories for probing galaxy scale feedback via jet-triggered star formation. The sample consists of 7 powerful CSS galaxies, and 2 galaxies host t… ▽ More We present the first systematic search for UV signatures from radio source-driven AGN feedback in Compact Steep Spectrum (CSS) radio galaxies. Owing to their characteristic sub-galactic jets (1-20 kpc projected linear sizes), CSS hosts are excellent laboratories for probing galaxy scale feedback via jet-triggered star formation. The sample consists of 7 powerful CSS galaxies, and 2 galaxies host to radio sources >20 kpc as control, at low to intermediate redshifts (z<0.6). Our new HST images show extended UV continuum emission in 6/7 CSS galaxies; with 5 CSS hosts exhibiting UV knots co-spatial and aligned along the radio-jet axis. Young (<10 Myr), massive (>5 M$_\odot$) stellar populations are likely to be the dominant source of the blue excess emission in radio galaxies at these redshifts. Hence, the radio-aligned UV regions could be attributed to jet-induced starbursts. Lower near-UV SFRs compared to other indicators suggests low scattered AGN light contribution to the observed UV. Dust attenuation of UV emission appears unlikely from high internal extinction correction estimates in most sources. Comparison with evolutionary synthesis models shows that our observations are consistent with recent (~1-8 Myr old) star forming activity likely triggered by current or an earlier episode of radio emission, or by a confined radio source that has frustrated growth due to a dense environment. While follow-up spectroscopic and polarized light observations are needed to constrain the activity-related components in the observed UV, the detection of jet-induced star formation is a confirmation of an important prediction of the jet feedback paradigm. △ Less

Submitted 31 August, 2023; originally announced September 2023.

Comments: Submitted to ApJ

Learning Perturbations for Soft-Output Linear MIMO Demappers

Authors: Daniel E. Worrall, Markus Peschl, Arash Behboodi, Roberto Bondesan

Abstract: Tree-based demappers for multiple-input multiple-output (MIMO) detection such as the sphere decoder can achieve near-optimal performance but incur high computational cost due to their sequential nature. In this paper, we propose the perturbed linear demapper (PLM), which is a novel data-driven model for computing soft outputs in parallel. To achieve this, the PLM learns a distribution centered on… ▽ More Tree-based demappers for multiple-input multiple-output (MIMO) detection such as the sphere decoder can achieve near-optimal performance but incur high computational cost due to their sequential nature. In this paper, we propose the perturbed linear demapper (PLM), which is a novel data-driven model for computing soft outputs in parallel. To achieve this, the PLM learns a distribution centered on an initial linear estimate and a log-likelihood ratio clip** parameter using end-to-end Bayesian optimization. Furthermore, we show that lattice-reduction can be naturally incorporated into the PLM pipeline, which allows to trade off computational cost against coded block error rate reduction. We find that the optimized PLM can achieve near maximum-likelihood (ML) performance in Rayleigh channels, making it an efficient alternative to tree-based demappers. △ Less

Submitted 9 September, 2022; v1 submitted 1 September, 2022; originally announced September 2022.

Comments: Accepted at IEEE Global Communications Conference 2022

Neural Simulated Annealing

Authors: Alvaro H. C. Correia, Daniel E. Worrall, Roberto Bondesan

Abstract: Simulated annealing (SA) is a stochastic global optimisation technique applicable to a wide range of discrete and continuous variable problems. Despite its simplicity, the development of an effective SA optimiser for a given problem hinges on a handful of carefully handpicked components; namely, neighbour proposal distribution and temperature annealing schedule. In this work, we view SA from a rei… ▽ More Simulated annealing (SA) is a stochastic global optimisation technique applicable to a wide range of discrete and continuous variable problems. Despite its simplicity, the development of an effective SA optimiser for a given problem hinges on a handful of carefully handpicked components; namely, neighbour proposal distribution and temperature annealing schedule. In this work, we view SA from a reinforcement learning perspective and frame the proposal distribution as a policy, which can be optimised for higher solution quality given a fixed computational budget. We demonstrate that this Neural SA with such a learnt proposal distribution, parametrised by small equivariant neural networks, outperforms SA baselines on a number of problems: Rosenbrock's function, the Knapsack problem, the Bin Packing problem, and the Travelling Salesperson problem. We also show that Neural SA scales well to large problems - generalising to significantly larger problems than the ones seen during training - while achieving comparable performance to popular off-the-shelf solvers and other machine learning methods in terms of solution quality and wall-clock time. △ Less

Submitted 4 March, 2022; originally announced March 2022.

Journal ref: Proceedings of The 26th International Conference on Artificial Intelligence and Statistics, PMLR 206:4946-4962, 2023

Lie Point Symmetry Data Augmentation for Neural PDE Solvers

Authors: Johannes Brandstetter, Max Welling, Daniel E. Worrall

Abstract: Neural networks are increasingly being used to solve partial differential equations (PDEs), replacing slower numerical solvers. However, a critical issue is that neural PDE solvers require high-quality ground truth data, which usually must come from the very solvers they are designed to replace. Thus, we are presented with a proverbial chicken-and-egg problem. In this paper, we present a method, w… ▽ More Neural networks are increasingly being used to solve partial differential equations (PDEs), replacing slower numerical solvers. However, a critical issue is that neural PDE solvers require high-quality ground truth data, which usually must come from the very solvers they are designed to replace. Thus, we are presented with a proverbial chicken-and-egg problem. In this paper, we present a method, which can partially alleviate this problem, by improving neural PDE solver sample complexity -- Lie point symmetry data augmentation (LPSDA). In the context of PDEs, it turns out that we are able to quantitatively derive an exhaustive list of data transformations, based on the Lie point symmetry group of the PDEs in question, something not possible in other application areas. We present this framework and demonstrate how it can easily be deployed to improve neural PDE solver sample complexity by an order of magnitude. △ Less

Submitted 29 May, 2022; v1 submitted 15 February, 2022; originally announced February 2022.

Comments: Published at ICML 2022, Github: https://github.com/brandstetter-johannes/LPSDA

Message Passing Neural PDE Solvers

Authors: Johannes Brandstetter, Daniel Worrall, Max Welling

Abstract: The numerical solution of partial differential equations (PDEs) is difficult, having led to a century of research so far. Recently, there have been pushes to build neural--numerical hybrid solvers, which piggy-backs the modern trend towards fully end-to-end learned systems. Most works so far can only generalize over a subset of properties to which a generic solver would be faced, including: resolu… ▽ More The numerical solution of partial differential equations (PDEs) is difficult, having led to a century of research so far. Recently, there have been pushes to build neural--numerical hybrid solvers, which piggy-backs the modern trend towards fully end-to-end learned systems. Most works so far can only generalize over a subset of properties to which a generic solver would be faced, including: resolution, topology, geometry, boundary conditions, domain discretization regularity, dimensionality, etc. In this work, we build a solver, satisfying these properties, where all the components are based on neural message passing, replacing all heuristically designed components in the computation graph with backprop-optimized neural function approximators. We show that neural message passing solvers representationally contain some classical methods, such as finite differences, finite volumes, and WENO schemes. In order to encourage stability in training autoregressive models, we put forward a method that is based on the principle of zero-stability, posing stability as a domain adaptation problem. We validate our method on various fluid-like flow problems, demonstrating fast, stable, and accurate performance across different domain topologies, equation parameters, discretizations, etc., in 1D and 2D. △ Less

Submitted 20 March, 2023; v1 submitted 7 February, 2022; originally announced February 2022.

Comments: Published at ICLR 2022 (Spotlight paper), Github: https://github.com/brandstetter-johannes/MP-Neural-PDE-Solvers

Jet-triggered star formation in young radio galaxies

Authors: Chetna Duggal, Christopher O'Dea, Stefi Baum, Alvaro Labiano, Raffaella Morganti, Clive Tadhunter, Diana Worrall, Grant Tremblay, Daniel Dicken, Alessandro Capetti

Abstract: Emission in the ultraviolet continuum is a salient signature of the hot, massive and consequently short-lived, stellar population that traces recent or ongoing star formation. With the aim of map** star forming regions and morphologically separating the generic star formation from that associated with the galaxy-scale jet activity, we obtained high-resolution HST/UV imaging for a sample of nine… ▽ More Emission in the ultraviolet continuum is a salient signature of the hot, massive and consequently short-lived, stellar population that traces recent or ongoing star formation. With the aim of map** star forming regions and morphologically separating the generic star formation from that associated with the galaxy-scale jet activity, we obtained high-resolution HST/UV imaging for a sample of nine compact radio sources. Out of these, seven are known Compact Steep Spectrum (CSS) galaxies that host young, kpc-scale radio sources and hence are the best candidates for studying radio-mode feedback on galaxy scales, while the other two form a control sample of larger sources. Extended UV emission regions are observed in six of the seven CSS sources showing close spatial alignment with the radio-jet orientation. If other mechanisms possibly contributing to the observed UV emission are ruled out, this could be evidence in support of jet-triggered star formation in the CSS phase of radio galaxy evolution. △ Less

Submitted 6 November, 2021; originally announced November 2021.

Comments: 4 pages, 2 figures, Proceedings of the 6th Workshop on GHz-Peaked Spectrum (GPS) and Compact Steep Spectrum (CSS) sources

Quantum-resistance in blockchain networks

Authors: Marcos Allende, Diego López León, Sergio Cerón, Antonio Leal, Adrián Pareja, Marcelo Da Silva, Alejandro Pardo, Duncan Jones, David Worrall, Ben Merriman, Jonathan Gilmore, Nick Kitchener, Salvador E. Venegas-Andraca

Abstract: This paper describes the work carried out by the Inter-American Development Bank, the IDB Lab, LACChain, Cambridge Quantum Computing (CQC), and Tecnologico de Monterrey to identify and eliminate quantum threats in blockchain networks. The advent of quantum computing threatens internet protocols and blockchain networks because they utilize non-quantum resistant cryptographic algorithms. When quan… ▽ More This paper describes the work carried out by the Inter-American Development Bank, the IDB Lab, LACChain, Cambridge Quantum Computing (CQC), and Tecnologico de Monterrey to identify and eliminate quantum threats in blockchain networks. The advent of quantum computing threatens internet protocols and blockchain networks because they utilize non-quantum resistant cryptographic algorithms. When quantum computers become robust enough to run Shor's algorithm on a large scale, the most used asymmetric algorithms, utilized for digital signatures and message encryption, such as RSA, (EC)DSA, and (EC)DH, will be no longer secure. Quantum computers will be able to break them within a short period of time. Similarly, Grover's algorithm concedes a quadratic advantage for mining blocks in certain consensus protocols such as proof of work. Today, there are hundreds of billions of dollars denominated in cryptocurrencies that rely on blockchain ledgers as well as the thousands of blockchain-based applications storing value in blockchain networks. Cryptocurrencies and blockchain-based applications require solutions that guarantee quantum resistance in order to preserve the integrity of data and assets in their public and immutable ledgers. We have designed and developed a layer-two solution to secure the exchange of information between blockchain nodes over the internet and introduced a second signature in transactions using post-quantum keys. Our versatile solution can be applied to any blockchain network. In our implementation, quantum entropy was provided via the IronBridge Platform from CQC and we used LACChain Besu as the blockchain network. △ Less

Submitted 11 June, 2021; originally announced June 2021.

Comments: 31 pages, 11 figures

Beyond Simple AGN Unification with Chandra-observed 3CRR Sources

Authors: Joanna Kuraszkiewicz, Belinda J. Wilkes, Adam Atanas, Johannes Buchner, Jonathan C. McDowell, S. P. Willner, Matthew L. N. Ashby, Mojegan Azadi, Peter Barthel, Martin Haas, Diana M. Worrall, Mark Birkinshaw, Robert Antonucci, Rolf Chini, Giovanni G. Fazio, Charles Lawrence, Patrick Ogle

Abstract: Low-frequency radio selection finds radio-bright galaxies regardless of the amount of obscuration by gas and dust. We report \chandra\ observations of a complete 178~MHz-selected, and so orientation unbiased, sample of 44 $0.5<z<1$ 3CRR sources. The sample is comprised of quasars and narrow-line radio galaxies (NLRGs) with similar radio luminosities, and the radio structure serves as both an age a… ▽ More Low-frequency radio selection finds radio-bright galaxies regardless of the amount of obscuration by gas and dust. We report \chandra\ observations of a complete 178~MHz-selected, and so orientation unbiased, sample of 44 $0.5<z<1$ 3CRR sources. The sample is comprised of quasars and narrow-line radio galaxies (NLRGs) with similar radio luminosities, and the radio structure serves as both an age and an orientation indicator. Consistent with Unification, intrinsic obscuration (measured by \nh, X-ray hardness ratio, and X-ray luminosity) generally increases with inclination. However, the sample includes a population not seen in high-$z$ 3CRR sources: NLRGs viewed at intermediate inclination angles with \nh~$<10^{22}$~cm$^{-2}$. Multiwavelength analysis suggests these objects have lower $L/L_{\rm Edd}$ than typical NLRGs at similar orientation. Thus both orientation and $L/L_{\rm Edd}$ are important, and a "radiation-regulated Unification" provides a better explanation of the sample's observed properties. In comparison with the 3CRR sample at $1<z<2$, our lower-redshift sample shows a higher fraction of Compton-thin NLRGs (45\% vs.\ 29\%) but similar Compton-thick fraction (20\%), implying a larger covering factor of Compton-thin material at intermediate viewing angles and so a more "puffed-up" torus atmosphere. We posit that this is due to a range of $L/L_{\rm Edd}$ extending to lower values in this sample. In contrast, at high redshifts the narrower range and high $L/L_{\rm Edd}$ values allowed orientation (and so simple Unification) to dominate the sample's observed properties. △ Less

Submitted 27 April, 2021; originally announced April 2021.

Discovery of Candidate X-ray Jets in High-Redshift Quasars

Authors: Bradford Snios, Daniel A. Schwartz, Aneta Siemiginowska, Małgosia Sobolewska, Mark Birkinshaw, C. C. Cheung, Doug B. Gobeille, Herman L. Marshall, Giulia Migliori, John F. C. Wardle, Diana M. Worrall

Abstract: We present Chandra X-ray observations of 14 radio-loud quasars at redshifts $3 < z < 4$, selected from a well-defined sample. All quasars are detected in the 0.5-7.0 keV energy band, and resolved X-ray features are detected in five of the objects at distances of 1-12" from the quasar core. The X-ray features are spatially coincident with known radio features for four of the five quasars. This indi… ▽ More We present Chandra X-ray observations of 14 radio-loud quasars at redshifts $3 < z < 4$, selected from a well-defined sample. All quasars are detected in the 0.5-7.0 keV energy band, and resolved X-ray features are detected in five of the objects at distances of 1-12" from the quasar core. The X-ray features are spatially coincident with known radio features for four of the five quasars. This indicates that these systems contain X-ray jets. X-ray fluxes and luminosities are measured, and jet-to-core X-ray flux ratios are estimated. The flux ratios are consistent with those observed for nearby jet systems, suggesting that the observed X-ray emission mechanism is independent of redshift. For quasars with undetected jets, an upper limit on the average X-ray jet intensity is estimated using a stacked image analysis. Emission spectra of the quasar cores are extracted and modeled to obtain best-fit photon indices, and an Fe K emission line is detected from one quasar in our sample. We compare X-ray spectral properties with optical and radio emission in the context of both our sample and other quasar surveys. △ Less

Submitted 8 June, 2021; v1 submitted 24 February, 2021; originally announced February 2021.

Comments: Accepted to ApJ, 15 pages, 7 figures, 7 tables

Disentangling the AGN and Star-Formation Contributions to the Radio-X-ray Emission of Radio-Loud Quasars at 1<z<2

Authors: Mojegan Azadi, Belinda Wilkes, Joanna Kuraszkiewicz, Jonathan McDowell, Ralf Siebenmorgen, Matthew Ashby, Mark Birkinshaw, Diana Worrall, Natasha Abrams, Peter Barthel, Giovanni Fazio, Martin Haas, Sóley Hyman, Rafael Martínez-Galarza, Eileen Meyer

Abstract: We constrain the emission mechanisms responsible for the prodigious electromagnetic output generated by active galactic nuclei (AGN) and their host galaxies with a novel state-of-the-art AGN radio- to-X-ray spectral energy distribution model fitting code (ARXSED). ARXSED combines multiple components to fit the spectral energy distributions (SEDs) of AGN and their host galaxies. Emission components… ▽ More We constrain the emission mechanisms responsible for the prodigious electromagnetic output generated by active galactic nuclei (AGN) and their host galaxies with a novel state-of-the-art AGN radio- to-X-ray spectral energy distribution model fitting code (ARXSED). ARXSED combines multiple components to fit the spectral energy distributions (SEDs) of AGN and their host galaxies. Emission components include radio structures such as lobes and jets, infrared emission from the AGN torus, visible-to-X-ray emission from the accretion disk, and radio-to-ultraviolet emission from the host galaxy. Applying ARXSED to the radio SEDs of 20 3CRR quasars at 1 < z < 2 verifies the need for more than a simple power law when compact radio structures are present. The non-thermal emission contributes 91%-57% of the observed-frame 1.25mm to 850μm flux, and this component must be accounted for when using these wavelengths to estimate star-formation properties. We predict the presence of strong radio-linked X-ray emission in more than half the sample sources. ARXSED estimates median (and the associated first and third quartile ranges) BH mass of $2.9_{1.7}^{6.0} \times 10^9~\rm M_{\odot}$, logarithm of Eddington ratio of $ -1.0_{-1.2}^{-0.6} $, and spin of $ 0.98_{0.94}^{0.99} $ for our sample. The inferred AGN torus and accretion disk parameters agree with those estimated from spectroscopic analyses of similar samples in the literature. We present the median intrinsic SED of the luminous radio-loud quasars at 1 < z < 2 ; this SED represents a significant improvement in the way each component is modeled. △ Less

Submitted 24 February, 2023; v1 submitted 5 November, 2020; originally announced November 2020.

Two Candidate High-Redshift X-ray Jets Without Coincident Radio Jets

Authors: Daniel Schwartz, Aneta Siemiginowska, Brad Snios, Diana Worrall, Mark Birkinshaw, C. C. Cheung, Herman Marshall, Giulia Migliori, John F. C. Wardle, Doug Gobeille

Abstract: We report the detection of extended X-ray emission from two high-redshift radio quasars. These quasars, J1405+0415 at $z$=3.208 and J1610+1811 at $z$=3.118, were observed in a Chandra snapshot survey selected from a complete sample of the radio-brightest quasars in the overlap area of the VLA-FIRST radio survey and the Sloan Digital Sky Survey. The extended X-ray emission is located along the line… ▽ More We report the detection of extended X-ray emission from two high-redshift radio quasars. These quasars, J1405+0415 at $z$=3.208 and J1610+1811 at $z$=3.118, were observed in a Chandra snapshot survey selected from a complete sample of the radio-brightest quasars in the overlap area of the VLA-FIRST radio survey and the Sloan Digital Sky Survey. The extended X-ray emission is located along the line connecting the core to a radio knot or hotspot, favoring the interpretation of X-ray jets. The inferred rest frame jet X-ray luminosities from 2--30 keV would be of order 10$^{45}$ erg~s$^{-1}$ if emitted isotropically and without relativistic beaming. In the scenario of inverse Compton scattering of the cosmic microwave background (CMB), X-ray jets without a coincident radio counterpart may be common, and should be readily detectable to redshifts even beyond 3.2 due to the (1+$z$)$^4$ increase of the CMB energy density compensating for the (1+$z$)$^{-4}$ cosmological diminution of surface brightness. If these can be X-ray confirmed, they would be the second and third examples of quasar X-ray jets without detection of underlying continuous radio jets. △ Less

Submitted 13 October, 2020; originally announced October 2020.

Comments: 10 pages, 4 figures. Accepted for publication in The Astrophysical Journal

A Review of Gas-Surface Interaction Models for Orbital Aerodynamics Applications

Authors: Sabrina Livadiotti, Nicholas H. Crisp, Peter C. E. Roberts, Stephen D. Worrall, Vitor T. A. Oiko, Steve Edmondson, Sarah J. Haigh, Claire Huyton, Katharine L. Smith, Luciana A. Sinpetru, Brandon E. A. Holmes, Jonathan Becedas, Rosa María Domínguez, Valentín Cañas, Simon Christensen, Anders Mølgaard, Jens Nielsen, Morten Bisgaard, Yung-An Chan, Georg H. Herdrich, Francesco Romano, Stefanos Fasoulas, Constantin Traub, Daniel Garcia-Almiñana, Silvia Rodriguez-Donaire , et al. (7 additional authors not shown)

Abstract: Renewed interest in Very Low Earth Orbits (VLEO) - i.e. altitudes below 450 km - has led to an increased demand for accurate environment characterisation and aerodynamic force prediction. While the former requires knowledge of the mechanisms that drive density variations in the thermosphere, the latter also depends on the interactions between the gas-particles in the residual atmosphere and the su… ▽ More Renewed interest in Very Low Earth Orbits (VLEO) - i.e. altitudes below 450 km - has led to an increased demand for accurate environment characterisation and aerodynamic force prediction. While the former requires knowledge of the mechanisms that drive density variations in the thermosphere, the latter also depends on the interactions between the gas-particles in the residual atmosphere and the surfaces exposed to the flow. The determination of the aerodynamic coefficients is hindered by the numerous uncertainties that characterise the physical processes occurring at the exposed surfaces. Several models have been produced over the last 60 years with the intent of combining accuracy with relatively simple implementations. In this paper the most popular models have been selected and reviewed using as discriminating factors relevance with regards to orbital aerodynamics applications and theoretical agreement with gas-beam experimental data. More sophisticated models were neglected, since their increased accuracy is generally accompanied by a substantial increase in computation times which is likely to be unsuitable for most space engineering applications. For the sake of clarity, a distinction was introduced between physical and scattering kernel theory based gas-surface interaction models. The physical model category comprises the Hard Cube model, the Soft Cube model and the Washboard model, while the scattering kernel family consists of the Maxwell model, the Nocilla-Hurlbut-Sherman model and the Cercignani-Lampis-Lord model. Limits and assets of each model have been discussed with regards to the context of this paper. Wherever possible, comments have been provided to help the reader to identify possible future challenges for gas-surface interaction science with regards to orbital aerodynamic applications. △ Less

Submitted 22 November, 2020; v1 submitted 1 October, 2020; originally announced October 2020.

Comments: Journal paper (accepted for publication in "Progress in Aerospace Sciences") Replacement: Corrected typos in Equations

Journal ref: Progress in Aerospace Sciences, vol. 119 (2020)

SDSS-IV MaNGA: The Nature of an Off-galaxy H$α$ Blob -- A Multi-wavelength View of Offset Cooling in a Merging Galaxy Group

Authors: Hsi-An Pan, Lihwai Lin, Bau-Ching Hsieh, Michal J. Michalowski, Matthew S. Bothwell, Song Huang, Alexei V. Moiseev, Dmitry Oparin, Ewan O'Sullivan, Diana M. Worrall, Sebastian F. Sanchez, Stephen Gwyn, David R. Law, David V. Stark, Dmitry Bizyaev, Cheng Li, Chien-Hsiu Lee, Hai Fu, Francesco Belfiore, Kevin Bundy, Jose G. Fernandez-Trincado, Joseph Gelfand, Sebastien Peirani

Abstract: Galaxies in dense environments, such as groups and clusters, experience various processes by which galaxies gain and lose gas. Using data from the SDSS-IV MaNGA survey, we previously reported the discovery of a giant (6 -- 8 kpc in diameter) H$α$ blob, Totoro, about 8 kpc away from a pair of galaxies (Satsuki and Mei) residing in a galaxy group which is experiencing a group-group merger. Here, we… ▽ More Galaxies in dense environments, such as groups and clusters, experience various processes by which galaxies gain and lose gas. Using data from the SDSS-IV MaNGA survey, we previously reported the discovery of a giant (6 -- 8 kpc in diameter) H$α$ blob, Totoro, about 8 kpc away from a pair of galaxies (Satsuki and Mei) residing in a galaxy group which is experiencing a group-group merger. Here, we combine interferometric $^{12}$CO(1--0) molecular gas data, new wide-field H$α$, $u$-band data, and published X-ray data to determine the origin of the blob. Several scenarios are discussed to account for its multi-wavelength properties, including (1) H$α$ gas being stripped from galaxy Satsuki by ram-pressure; (2) a separated low-surface-brightness galaxy; (3) gas being ejected or ionized by an active galactic nucleus (AGN); and (4) a cooling intra-group medium (IGM). Scenarios (1) and (2) are less favored by the present data. Scenario (3) is also less likely as there is no evidence for an active ongoing AGN in the host galaxy. We find that the CO (cold) and H$α$ (warm) gas coexist with X-ray (hot) structures; moreover, the derived cooling time is within the regime where molecular and H$α$ gas are expected. The coexistence of gas with different temperatures also agrees with that of cooling gas in other systems. Our multi-wavelength results strongly suggest that the CO and H$α$ gas are the product of cooling from the IGM at its current location, i.e., cooling has occurred, and may be ongoing, well outside the host-galaxy core. △ Less

Submitted 14 September, 2020; originally announced September 2020.

Comments: 23 pages, 10 figures, Accepted for publication in ApJ

The Benefits of Very Low Earth Orbit for Earth Observation Missions

Authors: N. H. Crisp, P. C. E. Roberts, S. Livadiotti, V. T. A. Oiko, S. Edmondson, S. J. Haigh, C. Huyton, L. Sinpetru, K. L. Smith, S. D. Worrall, J. Becedas, R. M. Domínguez, D. González, V. Hanessian, A. Mølgaard, J. Nielsen, M. Bisgaard, Y. -A. Chan, S. Fasoulas, G. H. Herdrich, F. Romano, C. Traub, D. García-Almiñana, S. Rodríguez-Donaire, M. Sureda , et al. (8 additional authors not shown)

Abstract: Very low Earth orbits (VLEO), typically classified as orbits below approximately 450 km in altitude, have the potential to provide significant benefits to spacecraft over those that operate in higher altitude orbits. This paper provides a comprehensive review and analysis of these benefits to spacecraft operations in VLEO, with parametric investigation of those which apply specifically to Earth ob… ▽ More Very low Earth orbits (VLEO), typically classified as orbits below approximately 450 km in altitude, have the potential to provide significant benefits to spacecraft over those that operate in higher altitude orbits. This paper provides a comprehensive review and analysis of these benefits to spacecraft operations in VLEO, with parametric investigation of those which apply specifically to Earth observation missions. The most significant benefit for optical imaging systems is that a reduction in orbital altitude improves spatial resolution for a similar payload specification. Alternatively mass and volume savings can be made whilst maintaining a given performance. Similarly, for radar and lidar systems, the signal-to-noise ratio can be improved. Additional benefits include improved geospatial position accuracy, improvements in communications link-budgets, and greater launch vehicle insertion capability. The collision risk with orbital debris and radiation environment can be shown to be improved in lower altitude orbits, whilst compliance with IADC guidelines for spacecraft post-mission lifetime and deorbit is also assisted. Finally, VLEO offers opportunities to exploit novel atmosphere-breathing electric propulsion systems and aerodynamic attitude and orbit control methods. However, key challenges associated with our understanding of the lower thermosphere, aerodynamic drag, the requirement to provide a meaningful orbital lifetime whilst minimising spacecraft mass and complexity, and atomic oxygen erosion still require further research. Given the scope for significant commercial, societal, and environmental impact which can be realised with higher performing Earth observation platforms, renewed research efforts to address the challenges associated with VLEO operations are required. △ Less

Submitted 16 July, 2020; v1 submitted 15 July, 2020; originally announced July 2020.

Comments: 23 pages, 19 figures. Accepted for publication in Progress in Aerospace Sciences (24-04-2020)

Journal ref: Progress in Aerospace Sciences 117 (2020)

RF Helicon-based Inductive Plasma Thruster (IPT) Design for an Atmosphere-Breathing Electric Propulsion system (ABEP)

Authors: Francesco Romano, Yung-An Chan, Georg Herdrich, Peter C. E. Roberts, C. Traub S. Fasoulas, K. Smith, S. Edmondson, S. Haigh, N. H. Crisp, V. T. A. Oiko, S. D. Worrall, S. Livadiotti, C. Huyton, L. A. Sinpetru, A. Straker, J. Becedas, R. M. Domínguez, D. González, V. Cañas, V. Sulliotti-Linner, V. Hanessian, A. Mølgaard, J. Nielsen, M. Bisgaard, D. Garcia-Almiñana , et al. (10 additional authors not shown)

Abstract: Challenging space missions include those at very low altitudes, where the atmosphere is source of aerodynamic drag on the spacecraft. To extend such missions lifetime, an efficient propulsion system is required. One solution is Atmosphere-Breathing Electric Propulsion (ABEP). It collects atmospheric particles to be used as propellant for an electric thruster. The system would minimize the requirem… ▽ More Challenging space missions include those at very low altitudes, where the atmosphere is source of aerodynamic drag on the spacecraft. To extend such missions lifetime, an efficient propulsion system is required. One solution is Atmosphere-Breathing Electric Propulsion (ABEP). It collects atmospheric particles to be used as propellant for an electric thruster. The system would minimize the requirement of limited propellant availability and can also be applied to any planet with atmosphere, enabling new mission at low altitude ranges for longer times. Challenging is also the presence of reactive chemical species, such as atomic oxygen in Earth orbit. Such species cause erosion of (not only) propulsion system components, i.e. acceleration grids, electrodes, and discharge channels of conventional EP systems. IRS is develo** within the DISCOVERER project, an intake and a thruster for an ABEP system. The paper describes the design and implementation of the RF helicon-based inductive plasma thruster (IPT). This paper deals in particular with the design and implementation of a novel antenna called the birdcage antenna, a device well known in magnetic resonance imaging (MRI), and also lately employed for helicon-wave based plasma sources in fusion research. The IPT is based on RF electrodeless operation aided by an externally applied static magnetic field. The IPT is composed by an antenna, a discharge channel, a movable injector, and a solenoid. By changing the operational parameters along with the novel antenna design, the aim is to minimize losses in the RF circuit, and accelerate a quasi-neutral plasma plume. This is also to be aided by the formation of helicon waves within the plasma that are to improve the overall efficiency and achieve higher exhaust velocities. Finally, the designed IPT with a particular focus on the birdcage antenna design procedure is presented △ Less

Submitted 14 July, 2020; v1 submitted 13 July, 2020; originally announced July 2020.

Inverse-Compton scattering in the resolved jet of the high-redshift quasar PKS J1421-0643

Authors: D. M. Worrall, M. Birkinshaw, H. L. Marshall, D. A. Schwartz, A. Siemiginowska, J. F. C. Wardle

Abstract: Despite the fact that kpc-scale inverse-Compton (iC) scattering of cosmic microwave background (CMB) photons into the X-ray band is mandated, proof of detection in resolved quasar jets is often insecure. High redshift provides favourable conditions due to the increased energy density of the CMB, and it allows constraints to be placed on the radio synchrotron-emitting electron component at high ene… ▽ More Despite the fact that kpc-scale inverse-Compton (iC) scattering of cosmic microwave background (CMB) photons into the X-ray band is mandated, proof of detection in resolved quasar jets is often insecure. High redshift provides favourable conditions due to the increased energy density of the CMB, and it allows constraints to be placed on the radio synchrotron-emitting electron component at high energies that are otherwise inaccessible. We present new X-ray, optical and radio results from Chandra, HST and the VLA for the core and resolved jet in the $z=3.69$ quasar PKS J1421-0643. The X-ray jet extends for about $4.5''$ (32 kpc projected length). The jet's radio spectrum is abnormally steep and consistent with electrons being accelerated to a maximum Lorentz factor of about 5000. Results argue in favour of the detection of inverse-Compton X-rays for modest magnetic field strength of a few nT, Doppler factor of about 4, and viewing angle of about $15^\circ$, and predict the jet to be largely invisible in most other spectral bands including the far- and mid-infrared and high-energy gamma-ray. The jet power is estimated to be about $3 \times 10^{46}$ erg s$^{-1}$ which is of order a tenth of the quasar bolometric power, for an electron--positron jet. The jet radiative power is only about 0.07 per cent of the jet power, with a smaller radiated power ratio if the jet contains heavy particles, so most of the jet power is available for heating the intergalactic medium. △ Less

Submitted 7 July, 2020; originally announced July 2020.

Comments: 16 pages, 14 figures. Accepted for publication in MNRAS

X-ray Properties of Young Radio Quasars at z > 4.5

Authors: Bradford Snios, Aneta Siemiginowska, Małgosia Sobolewska, C. C. Cheung, Vinay Kashyap, Giulia Migliori, Daniel A. Schwartz, Łukasz Stawarz, Diana M. Worrall

Abstract: We present a comprehensive analysis of Chandra X-ray observations of 15 young radio quasars at redshifts $4.5 < z < 5.0$. All sources are detected in the $0.5-7.0$ keV energy band. Emission spectra are extracted, and the average photon index for the sample is measured to be $1.5\pm0.1$. Unabsorbed rest-frame $2-10$ keV luminosities are found to range between $(0.5-23.2) \times 10^{45}$ erg s… ▽ More We present a comprehensive analysis of Chandra X-ray observations of 15 young radio quasars at redshifts $4.5 < z < 5.0$. All sources are detected in the $0.5-7.0$ keV energy band. Emission spectra are extracted, and the average photon index for the sample is measured to be $1.5\pm0.1$. Unabsorbed rest-frame $2-10$ keV luminosities are found to range between $(0.5-23.2) \times 10^{45}$ erg s$^{-1}$. The optical-X-ray power-law spectral index $α_{ox}$ is calculated for each source using optical/UV data available in the literature. The $α_{ox}$-UV relationship is compared with other quasar surveys, and an anticorrelation is observed that agrees with independent estimates. Rest-frame radio and X-ray luminosities are established for the sample, and a correlation between the luminosities is detected. These multiwavelength results reinforce a lack of spectral evolution for quasars over a broad redshift range. We additionally identify three quasars from our multiwavelength analysis that are statistically significant outliers, with one source being a Compton-thick candidate in the early universe, and discuss each in detail. △ Less

Submitted 3 August, 2020; v1 submitted 2 July, 2020; originally announced July 2020.

Comments: Accepted to ApJ, 13 pages, 5 figures, 4 tables

MDP Homomorphic Networks: Group Symmetries in Reinforcement Learning

Authors: Elise van der Pol, Daniel E. Worrall, Herke van Hoof, Frans A. Oliehoek, Max Welling

Abstract: This paper introduces MDP homomorphic networks for deep reinforcement learning. MDP homomorphic networks are neural networks that are equivariant under symmetries in the joint state-action space of an MDP. Current approaches to deep reinforcement learning do not usually exploit knowledge about such structure. By building this prior knowledge into policy and value networks using an equivariance con… ▽ More This paper introduces MDP homomorphic networks for deep reinforcement learning. MDP homomorphic networks are neural networks that are equivariant under symmetries in the joint state-action space of an MDP. Current approaches to deep reinforcement learning do not usually exploit knowledge about such structure. By building this prior knowledge into policy and value networks using an equivariance constraint, we can reduce the size of the solution space. We specifically focus on group-structured symmetries (invertible transformations). Additionally, we introduce an easy method for constructing equivariant network layers numerically, so the system designer need not solve the constraints by hand, as is typically done. We construct MDP homomorphic MLPs and CNNs that are equivariant under either a group of reflections or rotations. We show that such networks converge faster than unstructured baselines on CartPole, a grid world and Pong. △ Less

Submitted 20 January, 2021; v1 submitted 30 June, 2020; originally announced June 2020.

SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networks

Authors: Fabian B. Fuchs, Daniel E. Worrall, Volker Fischer, Max Welling

Abstract: We introduce the SE(3)-Transformer, a variant of the self-attention module for 3D point clouds and graphs, which is equivariant under continuous 3D roto-translations. Equivariance is important to ensure stable and predictable performance in the presence of nuisance transformations of the data input. A positive corollary of equivariance is increased weight-tying within the model. The SE(3)-Transfor… ▽ More We introduce the SE(3)-Transformer, a variant of the self-attention module for 3D point clouds and graphs, which is equivariant under continuous 3D roto-translations. Equivariance is important to ensure stable and predictable performance in the presence of nuisance transformations of the data input. A positive corollary of equivariance is increased weight-tying within the model. The SE(3)-Transformer leverages the benefits of self-attention to operate on large point clouds and graphs with varying number of points, while guaranteeing SE(3)-equivariance for robustness. We evaluate our model on a toy N-body particle simulation dataset, showcasing the robustness of the predictions under rotations of the input. We further achieve competitive performance on two real-world datasets, ScanObjectNN and QM9. In all cases, our model outperforms a strong, non-equivariant attention baseline and an equivariant model without attention. △ Less

Submitted 24 November, 2020; v1 submitted 18 June, 2020; originally announced June 2020.

Evidence of AGN feedback and sloshing in the X-ray luminous NGC 1550 galaxy group

Authors: Konstantinos Kolokythas, Ewan O'Sullivan, Simona Giacintucci, Diana M. Worrall, Mark Birkinshaw, Somak Raychaudhury, Cathy Horellou, Huib Intema, Ilani Loubser

Abstract: We present results from GMRT and Chandra observations of the NGC 1550 galaxy group. Although previously thought of as relaxed, we show evidence that gas sloshing and active galactic nucleus (AGN) heating have affected the structure of the system. The 610 and 235 MHz radio images show an asymmetric jet-lobe structure with a total size of $\sim$33 kpc, with a sharp kink at the base of the more exten… ▽ More We present results from GMRT and Chandra observations of the NGC 1550 galaxy group. Although previously thought of as relaxed, we show evidence that gas sloshing and active galactic nucleus (AGN) heating have affected the structure of the system. The 610 and 235 MHz radio images show an asymmetric jet-lobe structure with a total size of $\sim$33 kpc, with a sharp kink at the base of the more extended western jet, and bending of the shorter eastern jet as it enters the lobe. The 235$-$610 MHz spectral index map shows that both radio lobes have steep spectral indices ($α_{235}^{610}\geq-1.5$) indicating the presence of an old electron population. The X-ray images reveal an asymmetric structure in the hot gas correlated with the radio structure, as well as potential cavities coincident with the radio lobes, with rims and arms of gas that may have been uplifted by the cavity expansion. The X-ray residual map reveals an arc shaped structure to the east that resembles a sloshing cold front. Radio spectral analysis suggests a radiative age of about 33 Myr for the source, comparable to the sloshing timescale and dynamical estimates of the age of the lobes. An estimate of the mechanical energy required to inflate the cavities suggests that the AGN of NGC 1550 is capable of balancing radiative losses from the intragroup medium (IGM) and preventing excessive cooling, providing that the AGN jets are efficiently coupled to the IGM gas. In conclusion, we find evidence of sloshing motions from both radio and X-ray structures, suggesting that NGC 1550 was perturbed by a minor merger or infalling galaxy about 33 Myr ago. △ Less

Submitted 26 May, 2020; originally announced May 2020.

Comments: Accepted for publication in MNRAS, 17 pages with 13 figures and 10 tables

A high-resolution view of the jets in 3C 465

Authors: E. Bempong-Manful, M. J. Hardcastle, M. Birkinshaw, R. A. Laing, J. P. Leahy, D. M. Worrall

Abstract: We present new high-resolution and high-sensitivity studies of the jets in the WAT source 3C 465, using deep transverse-resolved radio observations from e-MERLIN, and with complementary observations from the VLA. We derive a lower limit $β_{\rm j}$ = ($ν_{\rm j}$/$c$) $\gtrsim$ 0.5 for the jet speed, and an upper limit $θ_{\rm j}$ $\lesssim$ 61$^{\circ}$ for the jet angle to the line of sight. The… ▽ More We present new high-resolution and high-sensitivity studies of the jets in the WAT source 3C 465, using deep transverse-resolved radio observations from e-MERLIN, and with complementary observations from the VLA. We derive a lower limit $β_{\rm j}$ = ($ν_{\rm j}$/$c$) $\gtrsim$ 0.5 for the jet speed, and an upper limit $θ_{\rm j}$ $\lesssim$ 61$^{\circ}$ for the jet angle to the line of sight. The jet spectral index ($α$, defined in the sense $S \propto ν^α$) is fairly constant (<$α_{\rm jet}$> = $-$0.7), and spectral flattening within 4.4 kpc of the core coincides with bright knots and is consistent with the site of X-ray particle acceleration at the base of the radio jet found in previous studies. There is little difference between the spectra of the two hotspot components, plausibly indicating that electron populations of the same properties are injected there. The NW and SE plumes are approximately homologous structures, with variations in mass injection and propagation in external pressure and density gradients in the two regions plausibly accounting for the slightly steeper spectrum in the NW plume, <$α_{\rm NWp}$> = $-$1.43 compared with the SE plume, <$α_{\rm SEp}$> = $-$1.38. Our synchrotron lifetime model supports plausible reacceleration of particles within the plume materials. Overall, our results show that the first-order Fermi process at mildly relativistic and non-relativistic shocks is the most likely acceleration mechanism at play in 3C 465 and distinguish differences between the acceleration at $β_{\rm j}$ $>$ 0.5 and $β_{\rm j}$ $<$ 0.5. The former case can accelerate electrons to higher Lorentz factors. △ Less

Submitted 22 May, 2020; originally announced May 2020.

AGN feedback in the FR II galaxy 3C 220.1

Authors: Wenhao Liu, Ming Sun, Paul E. J. Nulsen, Diana M. Worrall, Mark Birkinshaw, Craig Sarazin, William R. Forman, Christine Jones, Chong Ge

Abstract: We present results from a deep (174 ks) Chandra observation of the FR-II radio galaxy 3C 220.1, the central brightest cluster galaxy (BCG) of a $kT \sim$ 4 keV cluster at $z=0.61$. The temperature of the hot cluster medium drops from $\sim5.9$ keV to $\sim3.9$ keV at $\sim$ 35 kpc radius, while the temperature at smaller radii may be substantially lower. The central active galactic nucleus (AGN) o… ▽ More We present results from a deep (174 ks) Chandra observation of the FR-II radio galaxy 3C 220.1, the central brightest cluster galaxy (BCG) of a $kT \sim$ 4 keV cluster at $z=0.61$. The temperature of the hot cluster medium drops from $\sim5.9$ keV to $\sim3.9$ keV at $\sim$ 35 kpc radius, while the temperature at smaller radii may be substantially lower. The central active galactic nucleus (AGN) outshines the whole cluster in X-rays, with a bolometric luminosity of $2.0\times10^{46}$ erg s$^{-1}$ ($\sim10$% of the Eddington rate). The system shows a pair of potential X-ray cavities $\sim35$ kpc east and west of the nucleus. The cavity power is estimated within the range of $1.0\times10^{44}$ erg s$^{-1}$ and $1.7\times10^{45}$ erg s$^{-1}$, from different methods. The X-ray enhancements in the radio lobes could be due to inverse Compton emission, with a total 2-10 keV luminosity of $\sim8.0\times10^{42}$ erg s$^{-1}$. We compare 3C 220.1 with other cluster BCGs, including Cygnus A, as there are few BCGs in rich clusters hosting an FR-II galaxy. We also summarize the jet power of FR-II galaxies from different methods. The comparison suggests that the cavity power of FR-II galaxies likely under-estimates the jet power. The properties of 3C 220.1 suggest that it is at the transition stage from quasar-mode feedback to radio-mode feedback. △ Less

Submitted 2 January, 2020; originally announced January 2020.

Comments: 14 pages, 13 figures, MNRAS accepted

Learning Likelihoods with Conditional Normalizing Flows

Authors: Christina Winkler, Daniel Worrall, Emiel Hoogeboom, Max Welling

Abstract: Normalizing Flows (NFs) are able to model complicated distributions p(y) with strong inter-dimensional correlations and high multimodality by transforming a simple base density p(z) through an invertible neural network under the change of variables formula. Such behavior is desirable in multivariate structured prediction tasks, where handcrafted per-pixel loss-based methods inadequately capture st… ▽ More Normalizing Flows (NFs) are able to model complicated distributions p(y) with strong inter-dimensional correlations and high multimodality by transforming a simple base density p(z) through an invertible neural network under the change of variables formula. Such behavior is desirable in multivariate structured prediction tasks, where handcrafted per-pixel loss-based methods inadequately capture strong correlations between output dimensions. We present a study of conditional normalizing flows (CNFs), a class of NFs where the base density to output space map** is conditioned on an input x, to model conditional densities p(y|x). CNFs are efficient in sampling and inference, they can be trained with a likelihood-based objective, and CNFs, being generative flows, do not suffer from mode collapse or training instabilities. We provide an effective method to train continuous CNFs for binary problems and in particular, we apply these CNFs to super-resolution and vessel segmentation tasks demonstrating competitive performance on standard benchmark datasets in terms of likelihood and conventional metrics. △ Less

Submitted 12 November, 2023; v1 submitted 29 November, 2019; originally announced December 2019.

Comments: 18 pages, 8 Tables, 9 Figures, Preprint

Affine Self Convolution

Authors: Nichita Diaconu, Daniel E Worrall

Abstract: Attention mechanisms, and most prominently self-attention, are a powerful building block for processing not only text but also images. These provide a parameter efficient method for aggregating inputs. We focus on self-attention in vision models, and we combine it with convolution, which as far as we know, are the first to do. What emerges is a convolution with data dependent filters. We call this… ▽ More Attention mechanisms, and most prominently self-attention, are a powerful building block for processing not only text but also images. These provide a parameter efficient method for aggregating inputs. We focus on self-attention in vision models, and we combine it with convolution, which as far as we know, are the first to do. What emerges is a convolution with data dependent filters. We call this an Affine Self Convolution. While this is applied differently at each spatial location, we show that it is translation equivariant. We also modify the Squeeze and Excitation variant of attention, extending both variants of attention to the roto-translation group. We evaluate these new models on CIFAR10 and CIFAR100 and show an improvement in the number of parameters, while reaching comparable or higher accuracy at test time against self-trained baselines. △ Less

Submitted 18 November, 2019; originally announced November 2019.

Chest CT Super-resolution and Domain-adaptation using Memory-efficient 3D Reversible GANs

Authors: Tycho F. A. van der Ouderaa, Daniel E. Worrall, Bram van Ginneken

Abstract: Recently, paired (e.g. Pix2pix) and unpaired (e.g. CycleGAN) image-to-image translation methods have shown effective in medical imaging tasks. In practice, however, it can be difficult to apply these deep models on medical data volumes, such as from MR and CT scans, since such data volumes tend to be 3-dimensional and of a high spatial resolution pushing the limits of the memory constraints of GPU… ▽ More Recently, paired (e.g. Pix2pix) and unpaired (e.g. CycleGAN) image-to-image translation methods have shown effective in medical imaging tasks. In practice, however, it can be difficult to apply these deep models on medical data volumes, such as from MR and CT scans, since such data volumes tend to be 3-dimensional and of a high spatial resolution pushing the limits of the memory constraints of GPU hardware that is typically used to train these models. Recent studies in the field of invertible neural networks have shown that reversible neural networks do not require to store intermediate activations for training. We use the RevGAN model that makes use of this property to perform memory-efficient partially-reversible image-to-image translation. We demonstrate this by performing a 3D super-resolution and a 3D domain-adaptation task on chest CT data volumes. △ Less

Submitted 1 August, 2019; originally announced August 2019.

Comments: MIDL 2019 [arXiv:1907.08612]

Report number: MIDL/2019/ExtendedAbstract/SkxueFsiFV

Uncertainty Quantification in Deep Learning for Safer Neuroimage Enhancement

Authors: Ryutaro Tanno, Daniel Worrall, Enrico Kaden, Aurobrata Ghosh, Francesco Grussu, Alberto Bizzi, Stamatios N. Sotiropoulos, Antonio Criminisi, Daniel C. Alexander

Abstract: Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here we introduce methods to characterise different components of uncertainty in such problems and demonstrate the ideas using diffusion MRI super-resolution. Speci… ▽ More Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here we introduce methods to characterise different components of uncertainty in such problems and demonstrate the ideas using diffusion MRI super-resolution. Specifically, we propose to account for $intrinsic$ uncertainty through a heteroscedastic noise model and for $parameter$ uncertainty through approximate Bayesian inference, and integrate the two to quantify $predictive$ uncertainty over the output image. Moreover, we introduce a method to propagate the predictive uncertainty on a multi-channelled image to derived scalar parameters, and separately quantify the effects of intrinsic and parameter uncertainty therein. The methods are evaluated for super-resolution of two different signal representations of diffusion MR images---DTIs and Mean Apparent Propagator MRI---and their derived quantities such as MD and FA, on multiple datasets of both healthy and pathological human brains. Results highlight three key benefits of uncertainty modelling for improving the safety of DL-based image enhancement systems. Firstly, incorporating uncertainty improves the predictive performance even when test data departs from training data. Secondly, the predictive uncertainty highly correlates with errors, and is therefore capable of detecting predictive "failures". Results demonstrate that such an uncertainty measure enables subject-specific and voxel-wise risk assessment of the output images. Thirdly, we show that the method for decomposing predictive uncertainty into its independent sources provides high-level "explanations" for the performance by quantifying how much uncertainty arises from the inherent difficulty of the task or the limited training examples. △ Less

Submitted 31 July, 2019; originally announced July 2019.

Supervised Uncertainty Quantification for Segmentation with Multiple Annotations

Authors: Shi Hu, Daniel Worrall, Stefan Knegt, Bas Veeling, Henkjan Huisman, Max Welling

Abstract: The accurate estimation of predictive uncertainty carries importance in medical scenarios such as lung node segmentation. Unfortunately, most existing works on predictive uncertainty do not return calibrated uncertainty estimates, which could be used in practice. In this work we exploit multi-grader annotation variability as a source of 'groundtruth' aleatoric uncertainty, which can be treated as… ▽ More The accurate estimation of predictive uncertainty carries importance in medical scenarios such as lung node segmentation. Unfortunately, most existing works on predictive uncertainty do not return calibrated uncertainty estimates, which could be used in practice. In this work we exploit multi-grader annotation variability as a source of 'groundtruth' aleatoric uncertainty, which can be treated as a target in a supervised learning problem. We combine this groundtruth uncertainty with a Probabilistic U-Net and test on the LIDC-IDRI lung nodule CT dataset and MICCAI2012 prostate MRI dataset. We find that we are able to improve predictive uncertainty estimates. We also find that we can improve sample accuracy and sample diversity. In real-world applications, our method could inform doctors about the confidence of the segmentation results. △ Less

Submitted 27 May, 2022; v1 submitted 3 July, 2019; originally announced July 2019.

Comments: MICCAI 2019. Fixed a few typos

Deep Scale-spaces: Equivariance Over Scale

Authors: Daniel E. Worrall, Max Welling

Abstract: We introduce deep scale-spaces (DSS), a generalization of convolutional neural networks, exploiting the scale symmetry structure of conventional image recognition tasks. Put plainly, the class of an image is invariant to the scale at which it is viewed. We construct scale equivariant cross-correlations based on a principled extension of convolutions, grounded in the theory of scale-spaces and semi… ▽ More We introduce deep scale-spaces (DSS), a generalization of convolutional neural networks, exploiting the scale symmetry structure of conventional image recognition tasks. Put plainly, the class of an image is invariant to the scale at which it is viewed. We construct scale equivariant cross-correlations based on a principled extension of convolutions, grounded in the theory of scale-spaces and semigroups. As a very basic operation, these cross-correlations can be used in almost any modern deep learning architecture in a plug-and-play manner. We demonstrate our networks on the Patch Camelyon and Cityscapes datasets, to prove their utility and perform introspective studies to further understand their properties. △ Less

Submitted 28 May, 2019; originally announced May 2019.

Learning to Convolve: A Generalized Weight-Tying Approach

Authors: Nichita Diaconu, Daniel E Worrall

Abstract: Recent work (Cohen & Welling, 2016) has shown that generalizations of convolutions, based on group theory, provide powerful inductive biases for learning. In these generalizations, filters are not only translated but can also be rotated, flipped, etc. However, coming up with exact models of how to rotate a 3 x 3 filter on a square pixel-grid is difficult. In this paper, we learn how to transform f… ▽ More Recent work (Cohen & Welling, 2016) has shown that generalizations of convolutions, based on group theory, provide powerful inductive biases for learning. In these generalizations, filters are not only translated but can also be rotated, flipped, etc. However, coming up with exact models of how to rotate a 3 x 3 filter on a square pixel-grid is difficult. In this paper, we learn how to transform filters for use in the group convolution, focussing on roto-translation. For this, we learn a filter basis and all rotated versions of that filter basis. Filters are then encoded by a set of rotation invariant coefficients. To rotate a filter, we switch the basis. We demonstrate we can produce feature maps with low sensitivity to input rotations, while achieving high performance on MNIST and CIFAR-10. △ Less

Submitted 12 May, 2019; originally announced May 2019.

Comments: Accepted to ICML 2019

Kiloparsec-scale Jets: Physics, Emission Mechanisms, and Challenges

Authors: Eric S. Perlman, Eileen Meyer, Jean Eilek, Sasha Tchekhovskoy, Kristina Nyland, Ivan Agudo, Stefi Baum, Martin Hardcastle, Matthias Kadler, Alvaro Labiano, Herman Marshall, Christopher ODea, Diana Worrall

Abstract: Jets are a ubiquitous part of the accretion process, created in AGN, by a coupling between the magnetic field near the central black hole and inflowing material. We point out what advances can be achieved by new technologies, concentrating on kiloparsec scales, beyond the Bondi radius, where accretion stops. Here, jets profoundly influence their host galaxy and the surrounding clusters and groups,… ▽ More Jets are a ubiquitous part of the accretion process, created in AGN, by a coupling between the magnetic field near the central black hole and inflowing material. We point out what advances can be achieved by new technologies, concentrating on kiloparsec scales, beyond the Bondi radius, where accretion stops. Here, jets profoundly influence their host galaxy and the surrounding clusters and groups, transporting prodigious amounts of matter and energies to scales of hundreds of kpc. Basic questions still remain regarding jet physics, which new instruments can advance greatly. The ngVLA, LOFAR, JWST and LUVOIR, as well as a Chandra successor, will give higher angular resolution and sensitivity. This will allow us to probe the emission mechanisms and dynamics of jets, and search for links between these areas, magnetic fields, particle acceleration and high-energy emission mechanisms. We stress the need for polarimetry in the X-ray and optical, critical to many of the most important questions in jet physics. We hope to directly probe resolved, flaring components, which for the first time will allow us to reveal how jets respond to stimuli and link statics and dynamics. △ Less

Submitted 8 March, 2019; originally announced March 2019.

Comments: 9 pages, 4 figures, submitted to Astro2020, the Decadal Survey of Astronomy and Astrophysics

Relativistic Jets in the Accretion & Collimation Zone: New Challenges Enabled by New Instruments

Authors: Eric S. Perlman, Mark Birkinshaw, Matthias Kadler, Serguei Komissarov, Matthew Lister, David Meier, Eileen Meyer, Masanori Nakamura, Kristina Nyland, Christopher ODea, Diana Worrall, Andrzej Zdziarski

Abstract: Jets are a ubiquitous part of the accretion process, seen in a wide variety of objects ranging from active galaxies (AGN) to X-ray binary stars and even newly formed stars. AGN jets are accelerated by the supermassive black hole of their host galaxy by a coupling between the magnetic field and inflowing material. They are the source for many exciting phenomena and can profoundly influence the larg… ▽ More Jets are a ubiquitous part of the accretion process, seen in a wide variety of objects ranging from active galaxies (AGN) to X-ray binary stars and even newly formed stars. AGN jets are accelerated by the supermassive black hole of their host galaxy by a coupling between the magnetic field and inflowing material. They are the source for many exciting phenomena and can profoundly influence the larger galaxy and surrounding cluster. This White Paper points out what advances can be achieved in the field by new technologies, concentrating on the zone where jets are accelerated to relativistic speeds and collimated. The ngVLA and new space VLBI missions will give higher angular resolution, sensitivity and fidelity in the radio, penetrating this zone for additional objects and allowing us to resolve fundamental questions over the physics of jet acceleration and collimation. Interferometry in other bands would allow us to probe directly flaring components. We also emphasize the need for polarimetry, which is essential to revealing the role and configuration of magnetic fields. △ Less

Submitted 26 February, 2019; originally announced February 2019.

Comments: 8 pages, 5 figures, submitted to Astro2020, the Decadal Survey of Astronomy & Astrophysics

Reversible GANs for Memory-efficient Image-to-Image Translation

Authors: Tycho F. A. van der Ouderaa, Daniel E. Worrall

Abstract: The Pix2pix and CycleGAN losses have vastly improved the qualitative and quantitative visual quality of results in image-to-image translation tasks. We extend this framework by exploring approximately invertible architectures which are well suited to these losses. These architectures are approximately invertible by design and thus partially satisfy cycle-consistency before training even begins. Fu… ▽ More The Pix2pix and CycleGAN losses have vastly improved the qualitative and quantitative visual quality of results in image-to-image translation tasks. We extend this framework by exploring approximately invertible architectures which are well suited to these losses. These architectures are approximately invertible by design and thus partially satisfy cycle-consistency before training even begins. Furthermore, since invertible architectures have constant memory complexity in depth, these models can be built arbitrarily deep. We are able to demonstrate superior quantitative output on the Cityscapes and Maps datasets at near constant memory budget. △ Less

Submitted 7 February, 2019; originally announced February 2019.

Variability and Proper Motion of X-ray Knots in the Jet of Centaurus A

Authors: Bradford Snios, Sarka Wykes, Paul E. J. Nulsen, Ralph P. Kraft, Eileen T. Meyer, Mark Birkinshaw, Diana M. Worrall, Martin J. Hardcastle, Elke Roediger, William R. Forman, Christine Jones

Abstract: We report results from Chandra observations analyzed for evidence of variability and proper motion in the X-ray jet of Centaurus A. Using data spanning 15 years, collective proper motion of $11.3\pm3.3$ mas yr$^{-1}$, or $0.68\pm0.20c$, is detected for the fainter X-ray knots and other substructure present within the jet. The three brightest knots (AX1A, AX1C, and BX2) are found to be stationary t… ▽ More We report results from Chandra observations analyzed for evidence of variability and proper motion in the X-ray jet of Centaurus A. Using data spanning 15 years, collective proper motion of $11.3\pm3.3$ mas yr$^{-1}$, or $0.68\pm0.20c$, is detected for the fainter X-ray knots and other substructure present within the jet. The three brightest knots (AX1A, AX1C, and BX2) are found to be stationary to an upper limit of $0.10c$. Brightness variations up to 27% are detected for several X-ray knots in the jet. For the fading knots, BX2 and AX1C, the changes in spectral slope expected to accompany synchrotron cooling are not found, ruling it out and placing upper limits of $\simeq 80\rm\ μG$ for each of their magnetic field strengths. Adiabatic expansion can account for the observed decreases in brightness. Constraints on models for the origin of the knots are established. Jet plasma overrunning an obstacle is favored as the generator of stationary knots, while moving knots are likely produced either by internal differences in jet speed or the late stages of jet interaction with nebular or cloud material. △ Less

Submitted 22 January, 2019; v1 submitted 2 January, 2019; originally announced January 2019.

Comments: Accepted to ApJ, 14 pages, 8 figures, 2 tables

Relativistic X-ray jets at high redshift

Authors: Daniel A Schwartz, Aneta Siemiginowska, Diana M Worrall, Mark Birkinshaw, Teddy Cheung, Herman Marshall, Guilia Migliori, John Wardle, Doug Gobeille

Abstract: Powerful radio sources and quasars emit relativistic jets of plasma and magnetic fields that travel hundreds of kilo-parsecs, ultimately depositing energy into the intra- or inter-cluster medium. In the rest frame of the jet, the energy density of the cosmic microwave background is enhanced by the bulk Lorentz factor squared, and when this exceeds the magnetic energy density the primary loss mecha… ▽ More Powerful radio sources and quasars emit relativistic jets of plasma and magnetic fields that travel hundreds of kilo-parsecs, ultimately depositing energy into the intra- or inter-cluster medium. In the rest frame of the jet, the energy density of the cosmic microwave background is enhanced by the bulk Lorentz factor squared, and when this exceeds the magnetic energy density the primary loss mechanism of the relativistic electrons is via inverse Compton scattering. The microwave energy density is also enhanced by a factor (1+z)^4, which becomes important at large redshifts. We are using Chandra to survey a z>3 sub-sample of radio sources selected with 21 cm wavelength flux density > 70 mJy, and with a spectroscopic redshift. Out of the first 12 objects observed, there are two clear cases of the X-rays extending beyond the detectable radio jet. △ Less

Submitted 31 December, 2018; originally announced January 2019.

Comments: 6 pages, 4 figures. In proceedings of the IWARA 2018 conference, to be published in Astronomische Nachrichten

A 1D fluid model of the Centaurus A jet

Authors: Sarka Wykes, Bradford T. Snios, Paul E. J. Nulsen, Ralph P. Kraft, Mark Birkinshaw, Martin J. Hardcastle, Diana M. Worrall, Iain McDonald, Marina Rejkuba, Thomas W. Jones, David J. Stark, William R. Forman, Eileen T. Meyer, Christine Jones

Abstract: We implement a steady, one-dimensional flow model for the X-ray jet of Centaurus A in which entrainment of stellar mass loss is the primary cause of dissipation. Using over 260 ks of new and archival Chandra/ACIS data, we have constrained the temperature, density and pressure distributions of gas in the central regions of the host galaxy of Centaurus A, and so the pressure throughout the length of… ▽ More We implement a steady, one-dimensional flow model for the X-ray jet of Centaurus A in which entrainment of stellar mass loss is the primary cause of dissipation. Using over 260 ks of new and archival Chandra/ACIS data, we have constrained the temperature, density and pressure distributions of gas in the central regions of the host galaxy of Centaurus A, and so the pressure throughout the length of its jet. The model is constrained by the observed profiles of pressure and jet width, and conserves matter and energy, enabling us to estimate jet velocities, and hence all the other flow properties. Invoking realistic stellar populations within the jet, we find that the increase in its momentum flux exceeds the net pressure force on the jet unless only about one half of the total stellar mass loss is entrained. For self-consistent models, the bulk speed only falls modestly, from ~0.67c to ~0.52c over the range of 0.25-5.94 kpc from the nucleus. The sonic Mach number varies between ~5.3 and 3.6 over this range. △ Less

Submitted 25 February, 2019; v1 submitted 11 December, 2018; originally announced December 2018.

Comments: 20 pages, 13 figures. Minor updates. Accepted by MNRAS

Determining the core radio luminosity function of radio AGNs via copula

Authors: Zunli Yuan, Jiancheng Wang, D. M. Worrall, Bin-Bin Zhang, Jirong Mao

Abstract: The radio luminosity functions (RLFs) of active galactic nuclei (AGNs) are traditionally measured based on total emission, which doesn't reflect the current activity of the central black hole. The increasing interest in compact radio cores of AGNs requires determination of the RLF based on core emission (i.e., core RLF). In this work we have established a large sample (totaling 1207) of radio-loud… ▽ More The radio luminosity functions (RLFs) of active galactic nuclei (AGNs) are traditionally measured based on total emission, which doesn't reflect the current activity of the central black hole. The increasing interest in compact radio cores of AGNs requires determination of the RLF based on core emission (i.e., core RLF). In this work we have established a large sample (totaling 1207) of radio-loud AGNs, mainly consisting of radio galaxies (RGs) and steep-spectrum radio quasars (SSRQs). Based on the sample, we explore the relationship between core luminosity ($L_c$) and total luminosity ($L_t$) via a powerful statistical tool called "Copula". The conditional probability distribution $p(\log L_{c} \mid \log L_{t})$ is obtained. We derive the core RLF as a convolution of $p(\log L_{c} \mid \log L_{t})$ with the total RLF which was determined by previous work. We relate the separate RG and SSRQ core RLFs via a relativistic beaming model and find that SSRQs have an average Lorentz factor of $γ=9.84_{-2.50}^{+3.61}$, and that most are seen within $8^{\circ} \lesssim θ\lesssim 45^{\circ}$ of the jet axis. Compared with the total RLF which is mainly contributed by extended emission, the core RLF shows a very weak luminosity-dependent evolution, with the number density peaking around $z\thicksim 0.8$ for all luminosities. Differences between core and total RLFs can be explained in a framework involving a combination of density and luminosity evolutions where the cores have significantly weaker luminosity evolution than the extended emission. △ Less

Submitted 30 October, 2018; originally announced October 2018.

Comments: Accepted for publication in the ApJS

Extreme jet bending on kiloparsec scales : the 'doughnut' in NGC 6109

Authors: Josie Rawes, Mark Birkinshaw, Diana M Worrall

Abstract: We present new radio observations of the z = 0.029 radio galaxy NGC 6109, a member of the 3CRR sample. We find the radio morphology of the counter-jet to be highly distorted, showing a unique 'doughnut' structure ~6 kpc in diameter. The doughnut is overpressured compared with the surrounding atmosphere as measured with Chandra. We investigate the polarisation properties of the source and find evid… ▽ More We present new radio observations of the z = 0.029 radio galaxy NGC 6109, a member of the 3CRR sample. We find the radio morphology of the counter-jet to be highly distorted, showing a unique 'doughnut' structure ~6 kpc in diameter. The doughnut is overpressured compared with the surrounding atmosphere as measured with Chandra. We investigate the polarisation properties of the source and find evidence for an interaction between the doughnut and the external environment. This may cause the extreme jet bend. Alternatively, while providing no explanation for the rotation-measure and magnetic field structure seen in the doughnut, a ballistic precession model may be feasible if the ballistic flow persists for a distance much less than the full extent of the 100 kpc-scale jet. A light jet being deflected by gas flows and winds just outside the transition between the galaxy and cluster atmospheres appears to be a more plausible interpretation. △ Less

Submitted 6 August, 2018; originally announced August 2018.

Detection of non-thermal X-ray emission in the lobes and jets of Cygnus A

Authors: M. N. de Vries, M. W. Wise, D. Huppenkothen, P. E. J. Nulsen, B. Snios, M. J. Hardcastle, M. Birkinshaw, D. M. Worrall, R. T. Duffy, B. R. McNamara

Abstract: We present a spectral analysis of the lobes and X-ray jets of Cygnus A, using more than 2 Ms of $\textit{Chandra}$ observations. The X-ray jets are misaligned with the radio jets and significantly wider. We detect non-thermal emission components in both lobes and jets. For the eastern lobe and jet, we find 1 keV flux densities of $71_{-10}^{+10}$ nJy and $24_{-4}^{+4}$ nJy, and photon indices of… ▽ More We present a spectral analysis of the lobes and X-ray jets of Cygnus A, using more than 2 Ms of $\textit{Chandra}$ observations. The X-ray jets are misaligned with the radio jets and significantly wider. We detect non-thermal emission components in both lobes and jets. For the eastern lobe and jet, we find 1 keV flux densities of $71_{-10}^{+10}$ nJy and $24_{-4}^{+4}$ nJy, and photon indices of $1.72_{-0.03}^{+0.03}$ and $1.64_{-0.04}^{+0.04}$ respectively. For the western lobe and jet, we find flux densities of $50_{-13}^{+12}$ nJy and $13_{-5}^{+5}$ nJy, and photon indices of $1.97_{-0.10}^{+0.23}$ and $1.86_{-0.12}^{+0.18}$ respectively. Using these results, we modeled the electron energy distributions of the lobes as broken power laws with age breaks. We find that a significant population of non-radiating particles is required to account for the total pressure of the eastern lobe. In the western lobe, no such population is required and the low energy cutoff to the electron distribution there needs to be raised to obtain pressures consistent with observations. This discrepancy is a consequence of the differing X-ray photon indices, which may indicate that the turnover in the inverse-Compton spectrum of the western lobe is at lower energies than in the eastern lobe. We modeled the emission from both jets as inverse-Compton emission. There is a narrow region of parameter space for which the X-ray jet can be a relic of an earlier active phase, although lack of knowledge about the jet's electron distribution and particle content makes the modelling uncertain. △ Less

Submitted 8 May, 2018; originally announced May 2018.

Comments: 21 pages, 8 figures

CubeNet: Equivariance to 3D Rotation and Translation

Authors: Daniel Worrall, Gabriel Brostow

Abstract: 3D Convolutional Neural Networks are sensitive to transformations applied to their input. This is a problem because a voxelized version of a 3D object, and its rotated clone, will look unrelated to each other after passing through to the last layer of a network. Instead, an idealized model would preserve a meaningful representation of the voxelized object, while explaining the pose-difference betw… ▽ More 3D Convolutional Neural Networks are sensitive to transformations applied to their input. This is a problem because a voxelized version of a 3D object, and its rotated clone, will look unrelated to each other after passing through to the last layer of a network. Instead, an idealized model would preserve a meaningful representation of the voxelized object, while explaining the pose-difference between the two inputs. An equivariant representation vector has two components: the invariant identity part, and a discernable encoding of the transformation. Models that can't explain pose-differences risk "diluting" the representation, in pursuit of optimizing a classification or regression loss function. We introduce a Group Convolutional Neural Network with linear equivariance to translations and right angle rotations in three dimensions. We call this network CubeNet, reflecting its cube-like symmetry. By construction, this network helps preserve a 3D shape's global and local signature, as it is transformed through successive layers. We apply this network to a variety of 3D inference problems, achieving state-of-the-art on the ModelNet10 classification challenge, and comparable performance on the ISBI 2012 Connectome Segmentation Benchmark. To the best of our knowledge, this is the first 3D rotation equivariant CNN for voxel representations. △ Less

Submitted 12 April, 2018; originally announced April 2018.

Comments: Preprint

The Cocoon Shocks of Cygnus A: Pressures and Their Implications for the Jets and Lobes

Authors: Bradford Snios, Paul E. J. Nulsen, Michael W. Wise, Martijn de Vries, Mark Birkinshaw, Diana M. Worrall, Ryan T. Duffy, Ralph P. Kraft, Brian R. McNamara, Chris Carilli, Judith H. Croston, Alastair C. Edge, Leith E. H. Godfrey, Martin J. Hardcastle, Daniel E. Harris, Robert A. Laing, William G. Mathews, John P. McKean, Richard A. Perley, David A. Rafferty, Andrew J. Young

Abstract: We use 2.0 Msec of Chandra observations to investigate the cocoon shocks of Cygnus A and some implications for its lobes and jet. Measured shock Mach numbers vary in the range 1.18-1.66 around the cocoon. We estimate a total outburst energy of $\simeq 4.7\times10^{60}\rm\ erg$, with an age of $\simeq 2 \times 10^{7}\rm\ yr$. The average postshock pressure is found to be… ▽ More We use 2.0 Msec of Chandra observations to investigate the cocoon shocks of Cygnus A and some implications for its lobes and jet. Measured shock Mach numbers vary in the range 1.18-1.66 around the cocoon. We estimate a total outburst energy of $\simeq 4.7\times10^{60}\rm\ erg$, with an age of $\simeq 2 \times 10^{7}\rm\ yr$. The average postshock pressure is found to be $8.6 \pm 0.3 \times 10^{-10}\rm\ erg\ cm^{-3}$, which agrees with the average pressure of the thin rim of compressed gas between the radio lobes and shocks, as determined from X-ray spectra. However, average rim pressures are found to be lower in the western lobe than in the eastern lobe by $\simeq 20\%$. Pressure estimates for hotspots A and D from synchrotron self-Compton models imply that each jet exerts a ram pressure $\gtrsim$ 3 times its static pressure, consistent with the positions of the hotspots moving about on the cocoon shock over time. A steady, one-dimensional flow model is used to estimate jet properties, finding mildly relativistic flow speeds within the allowed parameter range. Models in which the jet carries a negligible flux of rest mass are consistent with with the observed properties of the jets and hotspots. This favors the jets being light, implying that the kinetic power and momentum flux are carried primarily by the internal energy of the jet plasma rather than by its rest mass. △ Less

Submitted 27 February, 2018; originally announced February 2018.

Comments: Accepted to ApJ, 15 pages, 7 figures, 4 tables

The X-ray Ribs Within the Cocoon Shock of Cygnus A

Authors: R. T. Duffy, D. M. Worrall, M. Birkinshaw, P. E. J. Nulsen, M. W. Wise, M. N. de Vries, B. Snios, W. G. Mathews, R. A. Perley, M. J. Hardcastle, D. A. Rafferty, B. R. McNamara, A. C. Edge, J. P. McKean, C. L. Carilli, J. H. Croston, L. E. H. Godfrey, R. A. Laing

Abstract: We use new and archival Chandra observations of Cygnus A, totalling $\sim$1.9 Ms, to investigate the distribution and temperature structure of gas lying within the projected extent of the cocoon shock and exhibiting a rib-like structure. We confirm that the X-rays are dominated by thermal emission with an average temperature of around 4 keV, and have discovered an asymmetry in the temperature grad… ▽ More We use new and archival Chandra observations of Cygnus A, totalling $\sim$1.9 Ms, to investigate the distribution and temperature structure of gas lying within the projected extent of the cocoon shock and exhibiting a rib-like structure. We confirm that the X-rays are dominated by thermal emission with an average temperature of around 4 keV, and have discovered an asymmetry in the temperature gradient, with the southwestern part of the gas cooler than the rest by up to 2 keV. Pressure estimates suggest that the gas is a coherent structure of single origin located inside the cocoon, with a mass of roughly $2\times10^{10} M_{\odot}$. We conclude that the gas is debris resulting from disintegration of the cool core of the Cygnus A cluster after the passage of the jet during the early stages of the current epoch of activity. The 4 keV gas now lies on the central inside surface of the hotter cocoon rim. The temperature gradient could result from an offset between the centre of the cluster core and the Cygnus A host galaxy at the switch-on of current radio activity. △ Less

Submitted 26 February, 2018; originally announced February 2018.

Comments: 15 pages, 12 figures, accepted by MNRAS

An X-ray Imaging Survey of Quasar Jets -- The Complete Survey

Authors: H. L. Marshall, J. M. Gelbord, D. M. Worrall, M. Birkinshaw, D. A. Schwartz, D. L. Jauncey, G. Griffiths, D. W. Murphy, J. E. J. Lovell, E. S. Perlman, L. Godfrey

Abstract: We present Chandra X-ray imaging of a flux-limited sample of flat spectrum radio-emitting quasars with jet-like structure. X-rays are detected from 59% of 56 jets. No counterjets were detected. The core spectra are fitted by power law spectra with photon index $Γ_x$ whose distribution is consistent with a normal distribution with mean 1.61{+0.04}{-0.05} and dispersion 0.15{+0.04}{-0.03}. We show t… ▽ More We present Chandra X-ray imaging of a flux-limited sample of flat spectrum radio-emitting quasars with jet-like structure. X-rays are detected from 59% of 56 jets. No counterjets were detected. The core spectra are fitted by power law spectra with photon index $Γ_x$ whose distribution is consistent with a normal distribution with mean 1.61{+0.04}{-0.05} and dispersion 0.15{+0.04}{-0.03}. We show that the distribution of $α_{rx}$, the spectral index between the X-ray and radio band jet fluxes, fits a Gaussian with mean 0.974 $\pm$ 0.012 and dispersion 0.077 $\pm$ 0.008. We test the model in which kpc-scale X-rays result from inverse Compton scattering of cosmic microwave background photons off the jet's relativistic electrons (the IC-CMB model). In the IC-CMB model, a quantity Q computed from observed fluxes and the apparent size of the emission region depends on redshift as $(1+z)^{3+α}$. We fit $Q \propto (1+z)^{a}$, finding $a = 0.88 \pm 0.90$ and reject at 99.5% confidence the hypothesis that the average $α_{rx}$ depends on redshift in the manner expected in the IC-CMB model. This conclusion is mitigated by lack of detailed knowledge of the emission region geometry, which requires deeper or higher resolution X-ray observations. Furthermore, if the IC-CMB model is valid for X-ray emission from kpc-scale jets, then the jets must decelerate on average: bulk Lorentz factors should drop from about 15 to 2-3 between pc and kpc scales. Our results compound the problems that the IC-CMB model has in explaining the X-ray emission of kpc-scale jets. △ Less

Submitted 13 February, 2018; originally announced February 2018.

Comments: 41 pages, 15 figures, accepted for publication in the Astrophysical Journal Supplements

Virtual Adversarial Ladder Networks For Semi-supervised Learning

Authors: Saki Shinoda, Daniel E. Worrall, Gabriel J. Brostow

Abstract: Semi-supervised learning (SSL) partially circumvents the high cost of labeling data by augmenting a small labeled dataset with a large and relatively cheap unlabeled dataset drawn from the same distribution. This paper offers a novel interpretation of two deep learning-based SSL approaches, ladder networks and virtual adversarial training (VAT), as applying distributional smoothing to their respec… ▽ More Semi-supervised learning (SSL) partially circumvents the high cost of labeling data by augmenting a small labeled dataset with a large and relatively cheap unlabeled dataset drawn from the same distribution. This paper offers a novel interpretation of two deep learning-based SSL approaches, ladder networks and virtual adversarial training (VAT), as applying distributional smoothing to their respective latent spaces. We propose a class of models that fuse these approaches. We achieve near-supervised accuracy with high consistency on the MNIST dataset using just 5 labels per class: our best model, ladder with layer-wise virtual adversarial noise (LVAN-LW), achieves 1.42% +/- 0.12 average error rate on the MNIST test set, in comparison with 1.62% +/- 0.65 reported for the ladder network. On adversarial examples generated with L2-normalized fast gradient method, LVAN-LW trained with 5 examples per class achieves average error rate 2.4% +/- 0.3 compared to 68.6% +/- 6.5 for the ladder network and 9.9% +/- 7.5 for VAT. △ Less

Submitted 12 December, 2017; v1 submitted 20 November, 2017; originally announced November 2017.

Comments: Camera-ready version for NIPS 2017 workshop Learning with Limited Labeled Data

Testing for Shock-Heated X-ray Gas Around Compact Steep Spectrum Radio Galaxies

Authors: C. P. O'Dea, D. M. Worrall, G. R. Tremblay, T. E. Clarke, B. Rothberg, S. A. Baum, K. P. Christiansen, C. A. Mullarkey, J. Noel-Storr, R. Mittal

Abstract: We present Chandra and XMM-Newton X-ray, VLA radio, and optical observations of three candidate Compact Steep Spectrum (CSS) radio galaxies. CSS sources are galactic scale and are presumably driving a shock through the ISM of their host galaxy. B3 1445+410 is a low excitation emission line CSS radio galaxy with possibly a hybrid Fanaroff-Riley FRI/II (or Fat Double) radio morphology. The Chandra o… ▽ More We present Chandra and XMM-Newton X-ray, VLA radio, and optical observations of three candidate Compact Steep Spectrum (CSS) radio galaxies. CSS sources are galactic scale and are presumably driving a shock through the ISM of their host galaxy. B3 1445+410 is a low excitation emission line CSS radio galaxy with possibly a hybrid Fanaroff-Riley FRI/II (or Fat Double) radio morphology. The Chandra observations reveal a point-like source which is well fit with a power law consistent with emission from a Doppler boosted core. 3C 268.3 is a CSS broad line radio galaxy whose Chandra data are consistent spatially with a point source centered on the nucleus and spectrally with a double power-law model. PKS B1017-325 is a low excitation emission line radio galaxy with a bent double radio morphology. While from our new spectroscopic redshift, PKS B1017-325 falls outside the formal definition of a CSS, the XMNM-Newton observations are consistent with ISM emission with either a contribution from hot shocked gas or non-thermal jet emission. We compile selected radio and X-ray properties of the nine bona fide CSS radio galaxies with X-ray detections so far. We find that 2/9 show X-ray spectroscopic evidence for hot shocked gas. We note that the counts in the sources are low and the properties of the 2 sources with evidence for hot shocked gas are typical of the other CSS radio galaxies. We suggest that hot shocked gas may be typical of CSS radio galaxies due to their propagation through their host galaxies. △ Less

Submitted 8 November, 2017; originally announced November 2017.

Comments: 15 pages, 12 figures. Accepted for publication in the Astrophysical Journal

Interpretable Transformations with Encoder-Decoder Networks

Authors: Daniel E. Worrall, Stephan J. Garbin, Daniyar Turmukhambetov, Gabriel J. Brostow

Abstract: Deep feature spaces have the capacity to encode complex transformations of their input data. However, understanding the relative feature-space relationship between two transformed encoded images is difficult. For instance, what is the relative feature space relationship between two rotated images? What is decoded when we interpolate in feature space? Ideally, we want to disentangle confounding fac… ▽ More Deep feature spaces have the capacity to encode complex transformations of their input data. However, understanding the relative feature-space relationship between two transformed encoded images is difficult. For instance, what is the relative feature space relationship between two rotated images? What is decoded when we interpolate in feature space? Ideally, we want to disentangle confounding factors, such as pose, appearance, and illumination, from object identity. Disentangling these is difficult because they interact in very nonlinear ways. We propose a simple method to construct a deep feature space, with explicitly disentangled representations of several known transformations. A person or algorithm can then manipulate the disentangled representation, for example, to re-render an image with explicit control over parameterized degrees of freedom. The feature space is constructed using a transforming encoder-decoder network with a custom feature transform layer, acting on the hidden representations. We demonstrate the advantages of explicit disentangling on a variety of datasets and transformations, and as an aid for traditional tasks, such as classification. △ Less

Submitted 19 October, 2017; originally announced October 2017.

Comments: Accepted at ICCV 2017

A Multi-band Study of the remarkable Jet in Quasar 4C+19.44

Authors: Daniel Harris, Nicholas Lee, Dan Schwartz, Aneta Siemiginowska, Francesco Massaro, Mark Birkinshaw, Diana Worrall, Teddy Cheung, Jonathan Gelbord, Svetlana Jorstad, Alan Marscher, Hermine Landt, Herman Marshall, Eric Perlman, Lukasz Stawarz, Yasunobu Uchiyama, C. Megan Urry

Abstract: We present arc-second-resolution data in the radio, IR, optical and X-ray for 4C+19.44 (=PKS 1354+195), the longest and straightest quasar jet with deep X-ray observations. We report results from radio images with half to one arc-second angular resolution at three frequencies, plus HST and Spitzer data. The Chandra data allow us to measure the X-ray spectral index in 10 distinct regions along the… ▽ More We present arc-second-resolution data in the radio, IR, optical and X-ray for 4C+19.44 (=PKS 1354+195), the longest and straightest quasar jet with deep X-ray observations. We report results from radio images with half to one arc-second angular resolution at three frequencies, plus HST and Spitzer data. The Chandra data allow us to measure the X-ray spectral index in 10 distinct regions along the 18 arcsec jet and compare with the radio index. The radio and X-ray spectral indices of the jet regions are consistent with a value of $α=0.80$ throughout the jet, to within 2 sigma uncertainties. The X-ray jet structure to the south extends beyond the prominent radio jet and connects to the southern radio lobe, and there is extended X-ray emission in the direction of the unseen counter jet and coincident with the northern radio lobe. This jet is remarkable since its straight appearance over a large distance allows the geometry factors to be taken as fixed along the jet. Using the model of inverse Compton scattering of the cosmic microwave background (iC/CMB) by relativistic electrons, we find that the magnetic field strengths and Doppler factors are relatively constant along the jet. If instead the X-rays are synchrotron emission, they must arise from a population of electrons distinct from the particles producing the radio synchrotron spectrum. △ Less

Submitted 4 August, 2017; originally announced August 2017.

Comments: Accepted for ApJ

Bayesian Image Quality Transfer with CNNs: Exploring Uncertainty in dMRI Super-Resolution

Authors: Ryutaro Tanno, Daniel E. Worrall, Aurobrata Ghosh, Enrico Kaden, Stamatios N. Sotiropoulos, Antonio Criminisi, Daniel C. Alexander

Abstract: In this work, we investigate the value of uncertainty modeling in 3D super-resolution with convolutional neural networks (CNNs). Deep learning has shown success in a plethora of medical image transformation problems, such as super-resolution (SR) and image synthesis. However, the highly ill-posed nature of such problems results in inevitable ambiguity in the learning of networks. We propose to acc… ▽ More In this work, we investigate the value of uncertainty modeling in 3D super-resolution with convolutional neural networks (CNNs). Deep learning has shown success in a plethora of medical image transformation problems, such as super-resolution (SR) and image synthesis. However, the highly ill-posed nature of such problems results in inevitable ambiguity in the learning of networks. We propose to account for intrinsic uncertainty through a per-patch heteroscedastic noise model and for parameter uncertainty through approximate Bayesian inference in the form of variational dropout. We show that the combined benefits of both lead to the state-of-the-art performance SR of diffusion MR brain images in terms of errors compared to ground truth. We further show that the reduced error scores produce tangible benefits in downstream tractography. In addition, the probabilistic nature of the methods naturally confers a mechanism to quantify uncertainty over the super-resolved output. We demonstrate through experiments on both healthy and pathological brains the potential utility of such an uncertainty measure in the risk assessment of the super-resolved images for subsequent clinical use. △ Less

Submitted 30 May, 2017; v1 submitted 1 May, 2017; originally announced May 2017.

Comments: Accepted paper at MICCAI 2017

A non cool-core 4.6-keV cluster around the bright nearby radio galaxy PKS B1416-493

Authors: D. M. Worrall, M. Birkinshaw

Abstract: We present new X-ray (Chandra) and radio (ATCA) observations of the z=0.09 radio galaxy PKS B1416-493, a member of the southern equivalent of the 3CRR sample. We find the source to be embedded in a previously unrecognized bright kT=4.6 keV non cool-core cluster. The discovery of new clusters of such high temperature and luminosity within z=0.1 is rare. The radio source was chosen for observation b… ▽ More We present new X-ray (Chandra) and radio (ATCA) observations of the z=0.09 radio galaxy PKS B1416-493, a member of the southern equivalent of the 3CRR sample. We find the source to be embedded in a previously unrecognized bright kT=4.6 keV non cool-core cluster. The discovery of new clusters of such high temperature and luminosity within z=0.1 is rare. The radio source was chosen for observation based on its intermediate FRI/II morphology. We identify a cavity coincident with the northeast lobe, and excess counts associated with the southwest lobe that we interpret as inverse Compton X-ray emission. The jet power, at 5.3 x 10^44 erg/s, when weighted by radio source density, supports suggestions that radio sources of intermediate morphology and radio power may dominate radio-galaxy heating in the local Universe. △ Less

Submitted 2 February, 2017; originally announced February 2017.

Comments: 11 pages, 10 figures; Accepted for publication in MNRAS

Harmonic Networks: Deep Translation and Rotation Equivariance

Authors: Daniel E. Worrall, Stephan J. Garbin, Daniyar Turmukhambetov, Gabriel J. Brostow

Abstract: Translating or rotating an input image should not affect the results of many computer vision tasks. Convolutional neural networks (CNNs) are already translation equivariant: input image translations produce proportionate feature map translations. This is not the case for rotations. Global rotation equivariance is typically sought through data augmentation, but patch-wise equivariance is more diffi… ▽ More Translating or rotating an input image should not affect the results of many computer vision tasks. Convolutional neural networks (CNNs) are already translation equivariant: input image translations produce proportionate feature map translations. This is not the case for rotations. Global rotation equivariance is typically sought through data augmentation, but patch-wise equivariance is more difficult. We present Harmonic Networks or H-Nets, a CNN exhibiting equivariance to patch-wise translation and 360-rotation. We achieve this by replacing regular CNN filters with circular harmonics, returning a maximal response and orientation for every receptive field patch. H-Nets use a rich, parameter-efficient and low computational complexity representation, and we show that deep feature maps within the network encode complicated rotational invariants. We demonstrate that our layers are general enough to be used in conjunction with the latest architectures and techniques, such as deep supervision and batch normalization. We also achieve state-of-the-art classification on rotated-MNIST, and competitive results on other benchmark challenges. △ Less

Submitted 11 April, 2017; v1 submitted 14 December, 2016; originally announced December 2016.

Comments: Submitted to CVPR 2017

Buoyancy-driven inflow to a relic cold core: the gas belt in radio galaxy 3C 386

Authors: R. T. Duffy, D. M. Worrall, M. Birkinshaw, R. P. Kraft

Abstract: We report measurements from an XMM-Newton observation of the low-excitation radio galaxy 3C 386. The study focusses on an X-ray-emitting gas belt, which lies between and orthogonal to the radio lobes of 3C 386 and has a mean temperature of $0.94\pm0.05$ keV, cooler than the extended group atmosphere. The gas in the belt shows temperature structure with material closer to the surrounding medium bei… ▽ More We report measurements from an XMM-Newton observation of the low-excitation radio galaxy 3C 386. The study focusses on an X-ray-emitting gas belt, which lies between and orthogonal to the radio lobes of 3C 386 and has a mean temperature of $0.94\pm0.05$ keV, cooler than the extended group atmosphere. The gas in the belt shows temperature structure with material closer to the surrounding medium being hotter than gas closer to the host galaxy. We suggest that this gas belt involves a `buoyancy-driven inflow' of part of the group-gas atmosphere where the buoyant rise of the radio lobes through the ambient medium has directed an inflow towards the relic cold core of the group. Inverse-Compton emission from the radio lobes is detected at a level consistent with a slight suppression of the magnetic field below the equipartition value. △ Less

Submitted 20 April, 2016; originally announced April 2016.

Comments: 11 pages, 10 figures, accepted for publication in MNRAS