A Deep Network for Explainable Prediction of Non-Imaging Phenotypes using Anatomical Multi-View Data
Authors:
Yuxiang Wei,
Yuqian Chen,
Tengfei Xue,
Leo Zekelman,
Nikos Makris,
Yogesh Rathi,
Weidong Cai,
Fan Zhang,
Lauren J. O' Donnell
Abstract:
Large datasets often contain multiple distinct feature sets, or views, that offer complementary information that can be exploited by multi-view learning methods to improve results. We investigate anatomical multi-view data, where each brain anatomical structure is described with multiple feature sets. In particular, we focus on sets of white matter microstructure and connectivity features from dif…
▽ More
Large datasets often contain multiple distinct feature sets, or views, that offer complementary information that can be exploited by multi-view learning methods to improve results. We investigate anatomical multi-view data, where each brain anatomical structure is described with multiple feature sets. In particular, we focus on sets of white matter microstructure and connectivity features from diffusion MRI, as well as sets of gray matter area and thickness features from structural MRI. We investigate machine learning methodology that applies multi-view approaches to improve the prediction of non-imaging phenotypes, including demographics (age), motor (strength), and cognition (picture vocabulary). We present an explainable multi-view network (EMV-Net) that can use different anatomical views to improve prediction performance. In this network, each individual anatomical view is processed by a view-specific feature extractor and the extracted information from each view is fused using a learnable weight. This is followed by a wavelet transform-based module to obtain complementary information across views which is then applied to calibrate the view-specific information. Additionally, the calibrator produces an attention-based calibration score to indicate anatomical structures' importance for interpretation.
△ Less
Submitted 13 January, 2024; v1 submitted 9 January, 2024;
originally announced January 2024.
Survey of Gravitationally-lensed Objects in HSC Imaging (SuGOHI). VI. Crowdsourced lens finding with Space Warps
Authors:
Alessandro Sonnenfeld,
Aprajita Verma,
Anupreeta More,
Elisabeth Baeten,
Christine Macmillan,
Kenneth C. Wong,
James H. H. Chan,
Anton T. Jaelani,
Chien-Hsiu Lee,
Masamune Oguri,
Cristian E. Rusu,
Marten Veldthuis,
Laura Trouille,
Philip J. Marshall,
Roger Hutchings,
Campbell Allen,
James O' Donnell,
Claude Cornen,
Christopher Davis,
Adam McMaster,
Chris Lintott,
Grant Miller
Abstract:
Strong lenses are extremely useful probes of the distribution of matter on galaxy and cluster scales at cosmological distances, but are rare and difficult to find. The number of currently known lenses is on the order of 1,000. We wish to use crowdsourcing to carry out a lens search targeting massive galaxies selected from over 442 square degrees of photometric data from the Hyper Suprime-Cam (HSC)…
▽ More
Strong lenses are extremely useful probes of the distribution of matter on galaxy and cluster scales at cosmological distances, but are rare and difficult to find. The number of currently known lenses is on the order of 1,000. We wish to use crowdsourcing to carry out a lens search targeting massive galaxies selected from over 442 square degrees of photometric data from the Hyper Suprime-Cam (HSC) survey. We selected a sample of $\sim300,000$ galaxies with photometric redshifts in the range $0.2 < z_{phot} < 1.2$ and photometrically inferred stellar masses $\log{M_*} > 11.2$. We crowdsourced lens finding on this sample of galaxies on the Zooniverse platform, as part of the Space Warps project. The sample was complemented by a large set of simulated lenses and visually selected non-lenses, for training purposes. Nearly 6,000 citizen volunteers participated in the experiment. In parallel, we used YattaLens, an automated lens finding algorithm, to look for lenses in the same sample of galaxies. Based on a statistical analysis of classification data from the volunteers, we selected a sample of the most promising $\sim1,500$ candidates which we then visually inspected: half of them turned out to be possible (grade C) lenses or better. Including lenses found by YattaLens or serendipitously noticed in the discussion section of the Space Warps website, we were able to find 14 definite lenses, 129 probable lenses and 581 possible lenses. YattaLens found half the number of lenses discovered via crowdsourcing. Crowdsourcing is able to produce samples of lens candidates with high completeness and purity, compared to currently available automated algorithms. A hybrid approach, in which the visual inspection of samples of lens candidates pre-selected by discovery algorithms and/or coupled to machine learning is crowdsourced, will be a viable option for lens finding in the 2020s.
△ Less
Submitted 4 July, 2021; v1 submitted 1 April, 2020;
originally announced April 2020.
