Showing 1–50 of 162 results for author: Noble, J

Flux and fluence effects on the Vacuum-UV photodesorption and photoprocessing of CO$_2$ ices

Authors: Antoine B. Hacquard, Daniela Torres-Diaz, Romain Basalgète, Delfina Toulouse, Géraldine Féraud, Samuel Del Fré, Jennifer A. Noble, Laurent Philippe, Xavier Michaut, Jean-Hugues Fillion, Anne Lafosse, Lionel Amiaud, Mathieu Bertin

Abstract: CO$_2$ is a major component of the icy mantles surrounding dust grains in planet and star formation regions. Understanding its photodesorption is crucial for explaining gas phase abundances in the coldest environments of the interstellar medium irradiated by vacuum-UV (VUV) photons. Photodesorption yields determined experimentally from CO$_2$ samples grown at low temperatures (T=15~K) have been fo… ▽ More CO$_2$ is a major component of the icy mantles surrounding dust grains in planet and star formation regions. Understanding its photodesorption is crucial for explaining gas phase abundances in the coldest environments of the interstellar medium irradiated by vacuum-UV (VUV) photons. Photodesorption yields determined experimentally from CO$_2$ samples grown at low temperatures (T=15~K) have been found to be very sensitive to experimental methods and conditions. Several mechanisms have been suggested for explaining the desorption of CO$_2$, O$_2$ and CO from CO$_2$ ices. In the present study, the cross sections characterizing the dynamics of photodesorption as a function of photon fluence (determined from released molecules in the gas phase) and of ice composition modification (determined in situ in the solid phase) are compared for the first time for different photon flux conditions (from 7.3$\times 10^{12}$~photon/s/cm$^2$ to 2.2$\times 10^{14}$~photon/s/cm$^2$) using monochromatic synchrotron radiation in the VUV range (on the DESIRS beamline at SOLEIL). This approach reveals that CO and O$_2$ desorption are decorrelated from that of CO$_2$. CO and O$_2$ photodesorption yields depend on photon flux conditions and can be linked to surface chemistry. By contrast, the phodesorption yield of CO$_2$ is independent of the photon flux conditions and can be linked to bulk ice chemical modification, consistently with an indirect desorption induced by electronic transition (DIET) process. △ Less

Submitted 25 June, 2024; originally announced June 2024.

Comments: 11 pages, 7 figures

Journal ref: Phys. Chem. Chem. Phys., 2024

Feasibility of Federated Learning from Client Databases with Different Brain Diseases and MRI Modalities

Authors: Felix Wagner, Wentian Xu, Pramit Saha, Ziyun Liang, Daniel Whitehouse, David Menon, Natalie Voets, J. Alison Noble, Konstantinos Kamnitsas

Abstract: Segmentation models for brain lesions in MRI are commonly developed for a specific disease and trained on data with a predefined set of MRI modalities. Each such model cannot segment the disease using data with a different set of MRI modalities, nor can it segment any other type of disease. Moreover, this training paradigm does not allow a model to benefit from learning from heterogeneous database… ▽ More Segmentation models for brain lesions in MRI are commonly developed for a specific disease and trained on data with a predefined set of MRI modalities. Each such model cannot segment the disease using data with a different set of MRI modalities, nor can it segment any other type of disease. Moreover, this training paradigm does not allow a model to benefit from learning from heterogeneous databases that may contain scans and segmentation labels for different types of brain pathologies and diverse sets of MRI modalities. Is it feasible to use Federated Learning (FL) for training a single model on client databases that contain scans and labels of different brain pathologies and diverse sets of MRI modalities? We demonstrate promising results by combining appropriate, simple, and practical modifications to the model and training strategy: Designing a model with input channels that cover the whole set of modalities available across clients, training with random modality drop, and exploring the effects of feature normalization methods. Evaluation on 7 brain MRI databases with 5 different diseases shows that such FL framework can train a single model that is shown to be very promising in segmenting all disease types seen during training. Importantly, it is able to segment these diseases in new databases that contain sets of modalities different from those in training clients. These results demonstrate, for the first time, feasibility and effectiveness of using FL to train a single segmentation model on decentralised data with diverse brain diseases and MRI modalities, a necessary step towards leveraging heterogeneous real-world databases. Code will be made available at: https://github.com/FelixWag/FL-MultiDisease-MRI △ Less

Submitted 17 June, 2024; originally announced June 2024.

ACM Class: I.4.9; I.4.6; I.2.11; I.4.0

IterMask2: Iterative Unsupervised Anomaly Segmentation via Spatial and Frequency Masking for Brain Lesions in MRI

Authors: Ziyun Liang, Xiaoqing Guo, J. Alison Noble, Konstantinos Kamnitsas

Abstract: Unsupervised anomaly segmentation approaches to pathology segmentation train a model on images of healthy subjects, that they define as the 'normal' data distribution. At inference, they aim to segment any pathologies in new images as 'anomalies', as they exhibit patterns that deviate from those in 'normal' training data. Prevailing methods follow the 'corrupt-and-reconstruct' paradigm. They inten… ▽ More Unsupervised anomaly segmentation approaches to pathology segmentation train a model on images of healthy subjects, that they define as the 'normal' data distribution. At inference, they aim to segment any pathologies in new images as 'anomalies', as they exhibit patterns that deviate from those in 'normal' training data. Prevailing methods follow the 'corrupt-and-reconstruct' paradigm. They intentionally corrupt an input image, reconstruct it to follow the learned 'normal' distribution, and subsequently segment anomalies based on reconstruction error. Corrupting an input image, however, inevitably leads to suboptimal reconstruction even of normal regions, causing false positives. To alleviate this, we propose a novel iterative spatial mask-refining strategy IterMask2. We iteratively mask areas of the image, reconstruct them, and update the mask based on reconstruction error. This iterative process progressively adds information about areas that are confidently normal as per the model. The increasing content guides reconstruction of nearby masked areas, improving reconstruction of normal tissue under these areas, reducing false positives. We also use high-frequency image content as an auxiliary input to provide additional structural information for masked areas. This further improves reconstruction error of normal in comparison to anomalous areas, facilitating segmentation of the latter. We conduct experiments on several brain lesion datasets and demonstrate effectiveness of our method. Code is available at: https://github.com/ZiyunLiang/IterMask2 △ Less

Submitted 5 June, 2024; v1 submitted 4 June, 2024; originally announced June 2024.

Explaining Explainability: Understanding Concept Activation Vectors

Authors: Angus Nicolson, Lisa Schut, J. Alison Noble, Yarin Gal

Abstract: Recent interpretability methods propose using concept-based explanations to translate the internal representations of deep learning models into a language that humans are familiar with: concepts. This requires understanding which concepts are present in the representation space of a neural network. One popular method for finding concepts is Concept Activation Vectors (CAVs), which are learnt using… ▽ More Recent interpretability methods propose using concept-based explanations to translate the internal representations of deep learning models into a language that humans are familiar with: concepts. This requires understanding which concepts are present in the representation space of a neural network. One popular method for finding concepts is Concept Activation Vectors (CAVs), which are learnt using a probe dataset of concept exemplars. In this work, we investigate three properties of CAVs. CAVs may be: (1) inconsistent between layers, (2) entangled with different concepts, and (3) spatially dependent. Each property provides both challenges and opportunities in interpreting models. We introduce tools designed to detect the presence of these properties, provide insight into how they affect the derived explanations, and provide recommendations to minimise their impact. Understanding these properties can be used to our advantage. For example, we introduce spatially dependent CAVs to test if a model is translation invariant with respect to a specific concept and class. Our experiments are performed on ImageNet and a new synthetic dataset, Elements. Elements is designed to capture a known ground truth relationship between concepts and classes. We release this dataset to facilitate further research in understanding and evaluating interpretability methods. △ Less

Submitted 4 April, 2024; originally announced April 2024.

Comments: (54 pages, 39 figures)

ACM Class: I.2.6

Monocular Microscope to CT Registration using Pose Estimation of the Incus for Augmented Reality Cochlear Implant Surgery

Authors: Yike Zhang, Eduardo Davalos, Dingjie Su, Ange Lou, Jack H. Noble

Abstract: For those experiencing severe-to-profound sensorineural hearing loss, the cochlear implant (CI) is the preferred treatment. Augmented reality (AR) aided surgery can potentially improve CI procedures and hearing outcomes. Typically, AR solutions for image-guided surgery rely on optical tracking systems to register pre-operative planning information to the display so that hidden anatomy or other imp… ▽ More For those experiencing severe-to-profound sensorineural hearing loss, the cochlear implant (CI) is the preferred treatment. Augmented reality (AR) aided surgery can potentially improve CI procedures and hearing outcomes. Typically, AR solutions for image-guided surgery rely on optical tracking systems to register pre-operative planning information to the display so that hidden anatomy or other important information can be overlayed and co-registered with the view of the surgical scene. In this paper, our goal is to develop a method that permits direct 2D-to-3D registration of the microscope video to the pre-operative Computed Tomography (CT) scan without the need for external tracking equipment. Our proposed solution involves using surface map** of a portion of the incus in surgical recordings and determining the pose of this structure relative to the surgical microscope by performing pose estimation via the perspective-n-point (PnP) algorithm. This registration can then be applied to pre-operative segmentations of other anatomy-of-interest, as well as the planned electrode insertion trajectory to co-register this information for the AR display. Our results demonstrate the accuracy with an average rotation error of less than 25 degrees and a translation error of less than 2 mm, 3 mm, and 0.55% for the x, y, and z axes, respectively. Our proposed method has the potential to be applicable and generalized to other surgical procedures while only needing a monocular microscope during intra-operation. △ Less

Submitted 11 March, 2024; originally announced March 2024.

DaReNeRF: Direction-aware Representation for Dynamic Scenes

Authors: Ange Lou, Benjamin Planche, Zhongpai Gao, Yamin Li, Tianyu Luan, Hao Ding, Terrence Chen, Jack Noble, Ziyan Wu

Abstract: Addressing the intricate challenge of modeling and re-rendering dynamic scenes, most recent approaches have sought to simplify these complexities using plane-based explicit representations, overcoming the slow training time issues associated with methods like Neural Radiance Fields (NeRF) and implicit representations. However, the straightforward decomposition of 4D dynamic scenes into multiple 2D… ▽ More Addressing the intricate challenge of modeling and re-rendering dynamic scenes, most recent approaches have sought to simplify these complexities using plane-based explicit representations, overcoming the slow training time issues associated with methods like Neural Radiance Fields (NeRF) and implicit representations. However, the straightforward decomposition of 4D dynamic scenes into multiple 2D plane-based representations proves insufficient for re-rendering high-fidelity scenes with complex motions. In response, we present a novel direction-aware representation (DaRe) approach that captures scene dynamics from six different directions. This learned representation undergoes an inverse dual-tree complex wavelet transformation (DTCWT) to recover plane-based information. DaReNeRF computes features for each space-time point by fusing vectors from these recovered planes. Combining DaReNeRF with a tiny MLP for color regression and leveraging volume rendering in training yield state-of-the-art performance in novel view synthesis for complex dynamic scenes. Notably, to address redundancy introduced by the six real and six imaginary direction-aware wavelet coefficients, we introduce a trainable masking approach, mitigating storage issues without significant performance decline. Moreover, DaReNeRF maintains a 2x reduction in training time compared to prior art while delivering superior performance. △ Less

Submitted 4 March, 2024; originally announced March 2024.

Comments: Accepted at CVPR 2024. Paper + supplementary material

JWST MIRI MRS Images Disk Winds, Water, and CO in an Edge-On Protoplanetary Disk

Authors: Nicole Arulanantham, M. K. McClure, Klaus Pontoppidan, Tracy L. Beck, J. A. Sturm, D. Harsono, A. C. A. Boogert, M. Cordiner, E. Dartois, M. N. Drozdovskaya, C. Espaillat, G. J. Melnick, J. A. Noble, M. E. Palumbo, Y. J. Pendleton, H. Terada, E. F. van Dishoeck

Abstract: We present JWST MIRI MRS observations of the edge-on protoplanetary disk around the young sub-solar mass star Tau 042021, acquired as part of the Cycle 1 GO program "Map** Inclined Disk Astrochemical Signatures (MIDAS)." These data resolve the mid-IR spatial distributions of H$_2$, revealing X-shaped emission extending to ~200 au above the disk midplane with a semi-opening angle of $35 \pm 5$ de… ▽ More We present JWST MIRI MRS observations of the edge-on protoplanetary disk around the young sub-solar mass star Tau 042021, acquired as part of the Cycle 1 GO program "Map** Inclined Disk Astrochemical Signatures (MIDAS)." These data resolve the mid-IR spatial distributions of H$_2$, revealing X-shaped emission extending to ~200 au above the disk midplane with a semi-opening angle of $35 \pm 5$ degrees. We do not velocity-resolve the gas in the spectral images, but the measured semi-opening angle of the H$_2$ is consistent with an MHD wind origin. A collimated, bipolar jet is seen in forbidden emission lines from [Ne II], [Ne III], [Ni II], [Fe II], [Ar II], and [S III]. Extended H$_2$O and CO emission lines are also detected, reaching diameters between ~90 and 190 au, respectively. Hot molecular emission is not expected at such radii, and we interpret its extended spatial distribution as scattering of inner disk molecular emission by dust grains in the outer disk surface. H I recombination lines, characteristic of inner disk accretion shocks, are similarly extended, and are likely also scattered light from the innermost star-disk interface. Finally, we detect extended PAH emission at 11.3 microns co-spatial with the scattered light continuum, making this the first low-mass T Tauri star around which extended PAHs have been confirmed, to our knowledge. MIRI MRS line images of edge-on disks provide an unprecedented window into the outflow, accretion, and scattering processes within protoplanetary disks, allowing us to constrain the disk lifetimes and accretion and mass loss mechanisms. △ Less

Submitted 20 March, 2024; v1 submitted 19 February, 2024; originally announced February 2024.

Comments: Accepted for publication in ApJL on March 13th, 2024

Semi-weakly-supervised neural network training for medical image registration

Authors: Yiwen Li, Yunguan Fu, Iani J. M. B. Gayo, Qianye Yang, Zhe Min, Shaheer U. Saeed, Wen Yan, Yipei Wang, J. Alison Noble, Mark Emberton, Matthew J. Clarkson, Dean C. Barratt, Victor A. Prisacariu, Yipeng Hu

Abstract: For training registration networks, weak supervision from segmented corresponding regions-of-interest (ROIs) have been proven effective for (a) supplementing unsupervised methods, and (b) being used independently in registration tasks in which unsupervised losses are unavailable or ineffective. This correspondence-informing supervision entails cost in annotation that requires significant specialis… ▽ More For training registration networks, weak supervision from segmented corresponding regions-of-interest (ROIs) have been proven effective for (a) supplementing unsupervised methods, and (b) being used independently in registration tasks in which unsupervised losses are unavailable or ineffective. This correspondence-informing supervision entails cost in annotation that requires significant specialised effort. This paper describes a semi-weakly-supervised registration pipeline that improves the model performance, when only a small corresponding-ROI-labelled dataset is available, by exploiting unlabelled image pairs. We examine two types of augmentation methods by perturbation on network weights and image resampling, such that consistency-based unsupervised losses can be applied on unlabelled data. The novel WarpDDF and RegCut approaches are proposed to allow commutative perturbation between an image pair and the predicted spatial transformation (i.e. respective input and output of registration networks), distinct from existing perturbation methods for classification or segmentation. Experiments using 589 male pelvic MR images, labelled with eight anatomical ROIs, show the improvement in registration performance and the ablated contributions from the individual strategies. Furthermore, this study attempts to construct one of the first computational atlases for pelvic structures, enabled by registering inter-subject MRs, and quantifies the significant differences due to the proposed semi-weak supervision with a discussion on the potential clinical use of example atlas-derived statistics. △ Less

Submitted 16 February, 2024; originally announced February 2024.

DABS-LS: Deep Atlas-Based Segmentation Using Regional Level Set Self-Supervision

Authors: Hannah G. Mason, Jack H. Noble

Abstract: Cochlear implants (CIs) are neural prosthetics used to treat patients with severe-to-profound hearing loss. Patient-specific modeling of CI stimulation of the auditory nerve fiber (ANFs) can help audiologists improve the CI programming. These models require localization of the ANFs relative to surrounding anatomy and the CI. Localization is challenging because the ANFs are so small they are not di… ▽ More Cochlear implants (CIs) are neural prosthetics used to treat patients with severe-to-profound hearing loss. Patient-specific modeling of CI stimulation of the auditory nerve fiber (ANFs) can help audiologists improve the CI programming. These models require localization of the ANFs relative to surrounding anatomy and the CI. Localization is challenging because the ANFs are so small they are not directly visible in clinical imaging. In this work, we hypothesize the position of the ANFs can be accurately inferred from the location of the internal auditory canal (IAC), which has high contrast in CT, since the ANFs pass through this canal between the cochlea and the brain. Inspired by VoxelMorph, in this paper we propose a deep atlas-based IAC segmentation network. We create a single atlas in which the IAC and ANFs are pre-localized. Our network is trained to produce deformation fields (DFs) map** coordinates from the atlas to new target volumes and that accurately segment the IAC. We hypothesize that DFs that accurately segment the IAC in target images will also facilitate accurate atlas-based localization of the ANFs. As opposed to VoxelMorph, which aims to produce DFs that accurately register the entire volume, our novel contribution is an entirely self-supervised training scheme that aims to produce DFs that accurately segment the target structure. This self-supervision is facilitated using a regional level set (LS) inspired loss function. We call our method Deep Atlas Based Segmentation using Level Sets (DABS-LS). Results show that DABS-LS outperforms VoxelMorph for IAC segmentation. Tests with publicly available datasets for trachea and kidney segmentation also show significant improvement in segmentation accuracy, demonstrating the generalizability of the method. △ Less

Submitted 15 February, 2024; originally announced February 2024.

Examining Modality Incongruity in Multimodal Federated Learning for Medical Vision and Language-based Disease Detection

Authors: Pramit Saha, Divyanshu Mishra, Felix Wagner, Konstantinos Kamnitsas, J. Alison Noble

Abstract: Multimodal Federated Learning (MMFL) utilizes multiple modalities in each client to build a more powerful Federated Learning (FL) model than its unimodal counterpart. However, the impact of missing modality in different clients, also called modality incongruity, has been greatly overlooked. This paper, for the first time, analyses the impact of modality incongruity and reveals its connection with… ▽ More Multimodal Federated Learning (MMFL) utilizes multiple modalities in each client to build a more powerful Federated Learning (FL) model than its unimodal counterpart. However, the impact of missing modality in different clients, also called modality incongruity, has been greatly overlooked. This paper, for the first time, analyses the impact of modality incongruity and reveals its connection with data heterogeneity across participating clients. We particularly inspect whether incongruent MMFL with unimodal and multimodal clients is more beneficial than unimodal FL. Furthermore, we examine three potential routes of addressing this issue. Firstly, we study the effectiveness of various self-attention mechanisms towards incongruity-agnostic information fusion in MMFL. Secondly, we introduce a modality imputation network (MIN) pre-trained in a multimodal client for modality translation in unimodal clients and investigate its potential towards mitigating the missing modality problem. Thirdly, we assess the capability of client-level and server-level regularization techniques towards mitigating modality incongruity effects. Experiments are conducted under several MMFL settings on two publicly available real-world datasets, MIMIC-CXR and Open-I, with Chest X-Ray and radiology reports. △ Less

Submitted 7 February, 2024; originally announced February 2024.

Comments: 42 pages

Towards AI-Assisted Synthesis of Verified Dafny Methods

Authors: Md Rakib Hossain Misu, Cristina V. Lopes, Iris Ma, James Noble

Abstract: Large language models show great promise in many domains, including programming. A promise is easy to make but hard to keep, and language models often fail to keep their promises, generating erroneous code. A promising avenue to keep models honest is to incorporate formal verification: generating programs' specifications as well as code so that the code can be proved correct with respect to the sp… ▽ More Large language models show great promise in many domains, including programming. A promise is easy to make but hard to keep, and language models often fail to keep their promises, generating erroneous code. A promising avenue to keep models honest is to incorporate formal verification: generating programs' specifications as well as code so that the code can be proved correct with respect to the specifications. Unfortunately, existing large language models show a severe lack of proficiency in verified programming. In this paper, we demonstrate how to improve two pretrained models' proficiency in the Dafny verification-aware language. Using 178 problems from the MBPP dataset, we prompt two contemporary models (GPT-4 and PaLM-2) to synthesize Dafny methods. We use three different types of prompts: a direct Contextless prompt; a Signature prompt that includes a method signature and test cases, and a Chain of Thought (CoT) prompt that decomposes the problem into steps and includes retrieval augmentation generated example problems and solutions. Our results show that GPT-4 performs better than PaLM-2 on these tasks and that both models perform best with the retrieval augmentation generated CoT prompt. GPT-4 was able to generate verified, human-evaluated, Dafny methods for 58% of the problems, however, GPT-4 managed only 19% of the problems with the Contextless prompt, and even fewer (10%) for the Signature prompt. We are thus able to contribute 153 verified Dafny solutions to MBPP problems, 50 that we wrote manually, and 103 synthesized by GPT-4. Our results demonstrate that the benefits of formal program verification are now within reach of code generating large language models... △ Less

Submitted 10 June, 2024; v1 submitted 31 January, 2024; originally announced February 2024.

Comments: This is an author provided preprint. The final version will be published at Proc. ACM Softw. Eng; FSE 2024, in July 2024

Dual Conditioned Diffusion Models for Out-Of-Distribution Detection: Application to Fetal Ultrasound Videos

Authors: Divyanshu Mishra, He Zhao, Pramit Saha, Aris T. Papageorghiou, J. Alison Noble

Abstract: Out-of-distribution (OOD) detection is essential to improve the reliability of machine learning models by detecting samples that do not belong to the training distribution. Detecting OOD samples effectively in certain tasks can pose a challenge because of the substantial heterogeneity within the in-distribution (ID), and the high structural similarity between ID and OOD classes. For instance, when… ▽ More Out-of-distribution (OOD) detection is essential to improve the reliability of machine learning models by detecting samples that do not belong to the training distribution. Detecting OOD samples effectively in certain tasks can pose a challenge because of the substantial heterogeneity within the in-distribution (ID), and the high structural similarity between ID and OOD classes. For instance, when detecting heart views in fetal ultrasound videos there is a high structural similarity between the heart and other anatomies such as the abdomen, and large in-distribution variance as a heart has 5 distinct views and structural variations within each view. To detect OOD samples in this context, the resulting model should generalise to the intra-anatomy variations while rejecting similar OOD samples. In this paper, we introduce dual-conditioned diffusion models (DCDM) where we condition the model on in-distribution class information and latent features of the input image for reconstruction-based OOD detection. This constrains the generative manifold of the model to generate images structurally and semantically similar to those within the in-distribution. The proposed model outperforms reference methods with a 12% improvement in accuracy, 22% higher precision, and an 8% better F1 score. △ Less

Submitted 1 November, 2023; originally announced November 2023.

Comments: Published in MICCAI 2023

Rethinking Semi-Supervised Federated Learning: How to co-train fully-labeled and fully-unlabeled client imaging data

Authors: Pramit Saha, Divyanshu Mishra, J. Alison Noble

Abstract: The most challenging, yet practical, setting of semi-supervised federated learning (SSFL) is where a few clients have fully labeled data whereas the other clients have fully unlabeled data. This is particularly common in healthcare settings where collaborating partners (typically hospitals) may have images but not annotations. The bottleneck in this setting is the joint training of labeled and unl… ▽ More The most challenging, yet practical, setting of semi-supervised federated learning (SSFL) is where a few clients have fully labeled data whereas the other clients have fully unlabeled data. This is particularly common in healthcare settings where collaborating partners (typically hospitals) may have images but not annotations. The bottleneck in this setting is the joint training of labeled and unlabeled clients as the objective function for each client varies based on the availability of labels. This paper investigates an alternative way for effective training with labeled and unlabeled clients in a federated setting. We propose a novel learning scheme specifically designed for SSFL which we call Isolated Federated Learning (IsoFed) that circumvents the problem by avoiding simple averaging of supervised and semi-supervised models together. In particular, our training approach consists of two parts - (a) isolated aggregation of labeled and unlabeled client models, and (b) local self-supervised pretraining of isolated global models in all clients. We evaluate our model performance on medical image datasets of four different modalities publicly available within the biomedical image classification benchmark MedMNIST. We further vary the proportion of labeled clients and the degree of heterogeneity to demonstrate the effectiveness of the proposed method under varied experimental settings. △ Less

Submitted 28 October, 2023; originally announced October 2023.

Comments: Published in MICCAI 2023 with early acceptance and selected as 1 of the top 20 poster highlights under the category: Which work has the potential to impact other applications of AI and CV

Show from Tell: Audio-Visual Modelling in Clinical Settings

Authors: Jianbo Jiao, Mohammad Alsharid, Lior Drukker, Aris T. Papageorghiou, Andrew Zisserman, J. Alison Noble

Abstract: Auditory and visual signals usually present together and correlate with each other, not only in natural environments but also in clinical settings. However, the audio-visual modelling in the latter case can be more challenging, due to the different sources of audio/video signals and the noise (both signal-level and semantic-level) in auditory signals -- usually speech. In this paper, we consider a… ▽ More Auditory and visual signals usually present together and correlate with each other, not only in natural environments but also in clinical settings. However, the audio-visual modelling in the latter case can be more challenging, due to the different sources of audio/video signals and the noise (both signal-level and semantic-level) in auditory signals -- usually speech. In this paper, we consider audio-visual modelling in a clinical setting, providing a solution to learn medical representations that benefit various clinical tasks, without human expert annotation. A simple yet effective multi-modal self-supervised learning framework is proposed for this purpose. The proposed approach is able to localise anatomical regions of interest during ultrasound imaging, with only speech audio as a reference. Experimental evaluations on a large-scale clinical multi-modal ultrasound video dataset show that the proposed self-supervised method learns good transferable anatomical representations that boost the performance of automated downstream clinical tasks, even outperforming fully-supervised solutions. △ Less

Submitted 25 October, 2023; originally announced October 2023.

A JWST inventory of protoplanetary disk ices: The edge-on protoplanetary disk HH 48 NE, seen with the Ice Age ERS program

Authors: J. A. Sturm, M. K. McClure, T. L. Beck, D. Harsono, J. B. Bergner, E. Dartois, A. C. A. Boogert, J. E. Chiar, M. A. Cordiner, M. N. Drozdovskaya, S. Ioppolo, C. J. Law, H. Linnartz, D. C. Lis, G. J. Melnick, B. A. McGuire, J. A. Noble, K. I. Öberg, M. E. Palumbo, Y. J. Pendleton, G. Perotti, K. M. Pontoppidan, D. Qasim, W. R. M. Rocha, H. Terada , et al. (2 additional authors not shown)

Abstract: Ices are the main carriers of volatiles in protoplanetary disks and are crucial to our understanding of the chemistry that ultimately sets the organic composition of planets. The ERS program Ice Age on the JWST follows the ice evolution through all stages of star and planet formation. JWST/NIRSpec observations of the edge-on Class II protoplanetary disk HH~48~NE reveal spatially resolved absorptio… ▽ More Ices are the main carriers of volatiles in protoplanetary disks and are crucial to our understanding of the chemistry that ultimately sets the organic composition of planets. The ERS program Ice Age on the JWST follows the ice evolution through all stages of star and planet formation. JWST/NIRSpec observations of the edge-on Class II protoplanetary disk HH~48~NE reveal spatially resolved absorption features of the major ice components H$_2$O, CO$_2$, CO, and multiple weaker signatures from less abundant ices NH$_3$, OCN$^-$, and OCS. Isotopologue $^{13}$CO$_2$ ice has been detected for the first time in a protoplanetary disk. Since multiple complex light paths contribute to the observed flux, the ice absorption features are filled in by ice-free scattered light. The $^{12}$CO$_2$/$^{13}$CO$_2$ ratio of 14 implies that the $^{12}$CO$_2$ feature is saturated, without the flux approaching 0, indicative of a very high CO$_2$ column density on the line of sight, and a corresponding abundance with respect to hydrogen that is higher than ISM values by a factor of at least a few. Observations of rare isotopologues are crucial, as we show that the $^{13}$CO$_2$ observation allows us to determine the column density of CO$_2$ to be at an order of magnitude higher than the lower limit directly inferred from the observed optical depth. Radial variations in ice abundance, e.g., snowlines, are significantly modified since all observed photons have passed through the full radial extent of the disk. CO ice is observed at perplexing heights in the disk, extending to the top of the CO-emitting gas layer. We argue that the most likely interpretation is that we observe some CO ice at high temperatures, trapped in less volatile ices like H$_2$O and CO$_2$. Future radiative transfer models will be required to constrain the implications on our current understanding of disk physics and chemistry. △ Less

Submitted 14 September, 2023; originally announced September 2023.

Comments: 16 pages, 8 figures, accepted for publication in A&A

Reference Capabilities for Flexible Memory Management: Extended Version

Authors: Ellen Arvidsson, Elias Castegren, Sylvan Clebsch, Sophia Drossopoulou, James Noble, Matthew J. Parkinson, Tobias Wrigstad

Abstract: Verona is a concurrent object-oriented programming language that organises all the objects in a program into a forest of isolated regions. Memory is managed locally for each region, so programmers can control a program's memory use by adjusting objects' partition into regions, and by setting each region's memory management strategy. A thread can only mutate (allocate, deallocate) objects within on… ▽ More Verona is a concurrent object-oriented programming language that organises all the objects in a program into a forest of isolated regions. Memory is managed locally for each region, so programmers can control a program's memory use by adjusting objects' partition into regions, and by setting each region's memory management strategy. A thread can only mutate (allocate, deallocate) objects within one active region -- its "window of mutability". Memory management costs are localised to the active region, ensuring overheads can be predicted and controlled. Moving the mutability window between regions is explicit, so code can be executed wherever it is required, yet programs remain in control of memory use. An ownership type system based on reference capabilities enforces region isolation, controlling aliasing within and between regions, yet supporting objects moving between regions and threads. Data accesses never need expensive atomic operations, and are always thread-safe. △ Less

Submitted 6 September, 2023; originally announced September 2023.

Comments: 87 pages, 10 figures, 5 listings, 4 tables. Extended version of paper to be published at OOPSLA 2023

WS-SfMLearner: Self-supervised Monocular Depth and Ego-motion Estimation on Surgical Videos with Unknown Camera Parameters

Authors: Ange Lou, Jack Noble

Abstract: Depth estimation in surgical video plays a crucial role in many image-guided surgery procedures. However, it is difficult and time consuming to create depth map ground truth datasets in surgical videos due in part to inconsistent brightness and noise in the surgical scene. Therefore, building an accurate and robust self-supervised depth and camera ego-motion estimation system is gaining more atten… ▽ More Depth estimation in surgical video plays a crucial role in many image-guided surgery procedures. However, it is difficult and time consuming to create depth map ground truth datasets in surgical videos due in part to inconsistent brightness and noise in the surgical scene. Therefore, building an accurate and robust self-supervised depth and camera ego-motion estimation system is gaining more attention from the computer vision community. Although several self-supervision methods alleviate the need for ground truth depth maps and poses, they still need known camera intrinsic parameters, which are often missing or not recorded. Moreover, the camera intrinsic prediction methods in existing works depend heavily on the quality of datasets. In this work, we aimed to build a self-supervised depth and ego-motion estimation system which can predict not only accurate depth maps and camera pose, but also camera intrinsic parameters. We proposed a cost-volume-based supervision manner to give the system auxiliary supervision for camera parameters prediction. The experimental results showed that the proposed method improved the accuracy of estimated camera parameters, ego-motion, and depth estimation. △ Less

Submitted 5 February, 2024; v1 submitted 22 August, 2023; originally announced August 2023.

Comments: Accepted by SPIE 2024

SAMSNeRF: Segment Anything Model (SAM) Guides Dynamic Surgical Scene Reconstruction by Neural Radiance Field (NeRF)

Authors: Ange Lou, Yamin Li, Xing Yao, Yike Zhang, Jack Noble

Abstract: The accurate reconstruction of surgical scenes from surgical videos is critical for various applications, including intraoperative navigation and image-guided robotic surgery automation. However, previous approaches, mainly relying on depth estimation, have limited effectiveness in reconstructing surgical scenes with moving surgical tools. To address this limitation and provide accurate 3D positio… ▽ More The accurate reconstruction of surgical scenes from surgical videos is critical for various applications, including intraoperative navigation and image-guided robotic surgery automation. However, previous approaches, mainly relying on depth estimation, have limited effectiveness in reconstructing surgical scenes with moving surgical tools. To address this limitation and provide accurate 3D position prediction for surgical tools in all frames, we propose a novel approach called SAMSNeRF that combines Segment Anything Model (SAM) and Neural Radiance Field (NeRF) techniques. Our approach generates accurate segmentation masks of surgical tools using SAM, which guides the refinement of the dynamic surgical scene reconstruction by NeRF. Our experimental results on public endoscopy surgical videos demonstrate that our approach successfully reconstructs high-fidelity dynamic surgical scenes and accurately reflects the spatial information of surgical tools. Our proposed approach can significantly enhance surgical navigation and automation by providing surgeons with accurate 3D position information of surgical tools during surgery.The source code will be released soon. △ Less

Submitted 5 February, 2024; v1 submitted 22 August, 2023; originally announced August 2023.

Comments: Accepted by SPIE 2024

Astrochemical models of interstellar ices: History matters

Authors: A. Clément, A. Taillard, V. Wakelam, P. Gratier, J. -C. Loison, E. Dartois, F. Dulieu, J. A. Noble, M. Chabot

Abstract: Ice is ubiquitous in the interstellar medium. We model the formation of the main constituents of interstellar ices, including H2O, CO2 , CO, and CH3 OH. We strive to understand what physical or chemical parameters influence the final composition of the ice and how they benchmark to what has already been observed, with the aim of applying these models to the preparation and analysis of JWST observa… ▽ More Ice is ubiquitous in the interstellar medium. We model the formation of the main constituents of interstellar ices, including H2O, CO2 , CO, and CH3 OH. We strive to understand what physical or chemical parameters influence the final composition of the ice and how they benchmark to what has already been observed, with the aim of applying these models to the preparation and analysis of JWST observations. We used the Nautilus gas-grain model, which computes the gas and ice composition as a function of time for a set of physical conditions, starting from an initial gas phase composition. All important processes (gas-phase reactions, gas-grain interactions, and grain surface processes) are included and solved with the rate equation approximation. We first ran an astrochemical code for fixed conditions of temperature and density mapped in the cold core L429-C to benchmark the chemistry. One key parameter was revealed to be the dust temperature. When the dust temperature is higher than 12 K, CO2 will form efficiently at the expense of H2O, while at temperatures below 12 K, it will not form. Whatever hypothesis we assumed for the chemistry (within realistic conditions), the static simulations failed to reproduce the observed trends of interstellar ices in our target core. In a second step, we simulated the chemical evolution of parcels of gas undergoing different physical and chemical situations throughout the molecular cloud evolution and starting a few 1e7 yr prior to the core formation (dynamical simulations). Our dynamical simulations satisfactorily reproduce the main trends already observed for interstellar ices. Moreover, we predict that the apparent constant ratio of CO2/H2O observed to date is probably not true for regions of low AV , and that the history of the evolution of clouds plays an essential role, even prior to their formation. △ Less

Submitted 14 June, 2023; originally announced June 2023.

Comments: Accepted for publication in A&A

Surgical tool classification and localization: results and methods from the MICCAI 2022 SurgToolLoc challenge

Authors: Aneeq Zia, Kiran Bhattacharyya, Xi Liu, Max Berniker, Ziheng Wang, Rogerio Nespolo, Satoshi Kondo, Satoshi Kasai, Kousuke Hirasawa, Bo Liu, David Austin, Yiheng Wang, Michal Futrega, Jean-Francois Puget, Zhenqiang Li, Yoichi Sato, Ryo Fujii, Ryo Hachiuma, Mana Masuda, Hideo Saito, An Wang, Mengya Xu, Mobarakol Islam, Long Bai, Winnie Pang , et al. (46 additional authors not shown)

Abstract: The ability to automatically detect and track surgical instruments in endoscopic videos can enable transformational interventions. Assessing surgical performance and efficiency, identifying skilled tool use and choreography, and planning operational and logistical aspects of OR resources are just a few of the applications that could benefit. Unfortunately, obtaining the annotations needed to train… ▽ More The ability to automatically detect and track surgical instruments in endoscopic videos can enable transformational interventions. Assessing surgical performance and efficiency, identifying skilled tool use and choreography, and planning operational and logistical aspects of OR resources are just a few of the applications that could benefit. Unfortunately, obtaining the annotations needed to train machine learning models to identify and localize surgical tools is a difficult task. Annotating bounding boxes frame-by-frame is tedious and time-consuming, yet large amounts of data with a wide variety of surgical tools and surgeries must be captured for robust training. Moreover, ongoing annotator training is needed to stay up to date with surgical instrument innovation. In robotic-assisted surgery, however, potentially informative data like timestamps of instrument installation and removal can be programmatically harvested. The ability to rely on tool installation data alone would significantly reduce the workload to train robust tool-tracking models. With this motivation in mind we invited the surgical data science community to participate in the challenge, SurgToolLoc 2022. The goal was to leverage tool presence data as weak labels for machine learning models trained to detect tools and localize them in video frames with bounding boxes. We present the results of this challenge along with many of the team's efforts. We conclude by discussing these results in the broader context of machine learning and surgical data science. The training data used for this challenge consisting of 24,695 video clips with tool presence labels is also being released publicly and can be accessed at https://console.cloud.google.com/storage/browser/isi-surgtoolloc-2022. △ Less

Submitted 31 May, 2023; v1 submitted 11 May, 2023; originally announced May 2023.

Precision Measurement of the Specific Activity of $^{39}$Ar in Atmospheric Argon with the DEAP-3600 Detector

Authors: P. Adhikari, R. Ajaj, M. Alpízar-Venegas, P. -A. Amaudruz, J. Anstey, G. R. Araujo, D. J. Auty, M. Baldwin, M. Batygov, B. Beltran, H. Benmansour, C. E. Bina, J. Bonatt, W. Bonivento, M. G. Boulay, B. Broerman, J. F. Bueno, P. M. Burghardt, A. Butcher, M. Cadeddu, B. Cai, M. Cárdenas-Montes, S. Cavuoti, M. Chen, Y. Chen , et al. (125 additional authors not shown)

Abstract: The specific activity of the beta decay of $^{39}$Ar in atmospheric argon is measured using the DEAP-3600 detector. DEAP-3600, located 2 km underground at SNOLAB, uses a total of (3269 $\pm$ 24) kg of liquid argon distilled from the atmosphere to search for dark matter. This detector with very low background uses pulseshape discrimination to differentiate between nuclear recoils and electron recoi… ▽ More The specific activity of the beta decay of $^{39}$Ar in atmospheric argon is measured using the DEAP-3600 detector. DEAP-3600, located 2 km underground at SNOLAB, uses a total of (3269 $\pm$ 24) kg of liquid argon distilled from the atmosphere to search for dark matter. This detector with very low background uses pulseshape discrimination to differentiate between nuclear recoils and electron recoils and is well-suited to measure the decay of $^{39}$Ar. With 167 live-days of data, the measured specific activity at the time of atmospheric extraction is [0.964 $\pm$ 0.001 (stat) $\pm$ 0.024 (sys)] Bq/kg$_{\rm atmAr}$ which is consistent with results from other experiments. A cross-check analysis using different event selection criteria provides a consistent result. △ Less

Submitted 10 October, 2023; v1 submitted 27 February, 2023; originally announced February 2023.

Journal ref: Eur. Phys. J. C 83, 642 (2023)

Self-supervised Registration and Segmentation of the Ossicles with A Single Ground Truth Label

Authors: Yike Zhang, Jack Noble

Abstract: AI-assisted surgeries have drawn the attention of the medical image research community due to their real-world impact on improving surgery success rates. For image-guided surgeries, such as Cochlear Implants (CIs), accurate object segmentation can provide useful information for surgeons before an operation. Recently published image segmentation methods that leverage machine learning usually rely o… ▽ More AI-assisted surgeries have drawn the attention of the medical image research community due to their real-world impact on improving surgery success rates. For image-guided surgeries, such as Cochlear Implants (CIs), accurate object segmentation can provide useful information for surgeons before an operation. Recently published image segmentation methods that leverage machine learning usually rely on a large number of manually predefined ground truth labels. However, it is a laborious and time-consuming task to prepare the dataset. This paper presents a novel technique using a self-supervised 3D-UNet that produces a dense deformation field between an atlas and a target image that can be used for atlas-based segmentation of the ossicles. Our results show that our method outperforms traditional image segmentation methods and generates a more accurate boundary around the ossicles based on Dice similarity coefficient and point-to-point error comparison. The mean Dice coefficient is improved by 8.51% with our proposed method. △ Less

Submitted 15 February, 2023; originally announced February 2023.

Comments: conference

An Ice Age JWST inventory of dense molecular cloud ices

Authors: M. K. McClure, W. R. M. Rocha, K. M. Pontoppidan, N. Crouzet, L. E. U. Chu, E. Dartois, T. Lamberts, J. A. Noble, Y. J. Pendleton, G. Perotti, D. Qasim, M. G. Rachid, Z. L. Smith, Fengwu Sun, Tracy L Beck, A. C. A. Boogert, W. A. Brown, P. Caselli, S. B. Charnley, Herma M. Cuppen, H. Dickinson, M. N. Drozdovskaya, E. Egami, J. Erkal, H. Fraser , et al. (17 additional authors not shown)

Abstract: Icy grain mantles are the main reservoir of the volatile elements that link chemical processes in dark, interstellar clouds with the formation of planets and composition of their atmospheres. The initial ice composition is set in the cold, dense parts of molecular clouds, prior to the onset of star formation. With the exquisite sensitivity of JWST, this critical stage of ice evolution is now acces… ▽ More Icy grain mantles are the main reservoir of the volatile elements that link chemical processes in dark, interstellar clouds with the formation of planets and composition of their atmospheres. The initial ice composition is set in the cold, dense parts of molecular clouds, prior to the onset of star formation. With the exquisite sensitivity of JWST, this critical stage of ice evolution is now accessible for detailed study. Here we show the first results of the Early Release Science program "Ice Age" that reveal the rich composition of these dense cloud ices. Weak ices, including, $^{13}$CO$_2$, OCN$^-$, $^{13}$CO, OCS, and COMs functional groups are now detected along two pre-stellar lines of sight. The $^{12}$CO$_2$ ice profile indicates modest growth of the icy grains. Column densities of the major and minor ice species indicate that ices contribute between 2 and 19% of the bulk budgets of the key C, O, N, and S elements. Our results suggest that the formation of simple and complex molecules could begin early in a water-ice rich environment. △ Less

Submitted 22 January, 2023; originally announced January 2023.

Comments: To appear in Nature Astronomy on January 23rd, 2023. 33 pages, 16 figures, 3 tables; includes extended and supplemental data sections. Part of the JWST Ice Age Early Release Science program's science enabling products. Enhanced spectra downloadable on Zenodo at the following DOI: 10.5281/zenodo.7501239

Search for inelastic dark matter-nucleus scattering with the PICO-60 CF$_{3}$I and C$_{3}$F$_{8}$ bubble chambers

Authors: E. Adams, B. Ali, I. J. Arnquist, D. Baxter, E. Behnke, M. Bressler, B. Broerman, C. J. Chen, K. Clark, J. I. Collar, P. S. Cooper, C. Cripe, M. Crisler, C. E. Dahl, M. Das, S. Fallows, J. Farine, R. Filgas, A. García Viltres, G. Giroux, O. Harris, T. Hillier, E. W. Hoppe, C. M. Jackson, M. ** , et al. (30 additional authors not shown)

Abstract: PICO bubble chambers have exceptional sensitivity to inelastic dark matter-nucleus interactions due to a combination of their extended nuclear recoil energy detection window from a few keV to $O$(100 keV) or more and the use of iodine as a heavy target. Inelastic dark matter-nucleus scattering is interesting for studying the properties of dark matter, where many theoretical scenarios have been dev… ▽ More PICO bubble chambers have exceptional sensitivity to inelastic dark matter-nucleus interactions due to a combination of their extended nuclear recoil energy detection window from a few keV to $O$(100 keV) or more and the use of iodine as a heavy target. Inelastic dark matter-nucleus scattering is interesting for studying the properties of dark matter, where many theoretical scenarios have been developed. This study reports the results of a search for dark matter inelastic scattering with the PICO-60 bubble chambers. The analysis reported here comprises physics runs from PICO-60 bubble chambers using CF$_{3}$I and C$_{3}$F$_{8}$. The CF$_{3}$I run consisted of 36.8 kg of CF$_{3}$I reaching an exposure of 3415 kg-day operating at thermodynamic thresholds between 7 and 20 keV. The C$_{3}$F$_{8}$ runs consisted of 52 kg of C$_{3}$F$_{8}$ reaching exposures of 1404 kg-day and 1167 kg-day running at thermodynamic thresholds of 2.45 keV and 3.29 keV, respectively. The analysis disfavors various scenarios, in a wide region of parameter space, that provide a feasible explanation of the signal observed by DAMA, assuming an inelastic interaction, considering that the PICO CF$_{3}$I bubble chamber used iodine as the target material. △ Less

Submitted 21 January, 2023; originally announced January 2023.

Comments: 7 pages, 3 figures

Constraints on the non-thermal desorption of methanol in the cold core LDN 429-C

Authors: A. Taillard, V. WakelaM, P. Gratier, E. Dartois, M. Chabot, J. A. Noble, J. V. Keane, A. C. A. Boogert, D. Harsono

Abstract: Cold cores are an early step of star formation, characterized by densities > 10$^4$ cm$^{-3}$, low temperatures (< 15 K), and very low external UV radiation. We investigate the physico-chemical processes at play to tracing the origin of molecules that are predominantly formed via reactions on dust grain surfaces. We observed the cold core LDN 429-C with the NOEMA interferometer and the IRAM 30m si… ▽ More Cold cores are an early step of star formation, characterized by densities > 10$^4$ cm$^{-3}$, low temperatures (< 15 K), and very low external UV radiation. We investigate the physico-chemical processes at play to tracing the origin of molecules that are predominantly formed via reactions on dust grain surfaces. We observed the cold core LDN 429-C with the NOEMA interferometer and the IRAM 30m single dish telescope in order to obtain the gas-phase abundances of key species, including CO and CH$_3$OH. Comparing the observed gas phase of methanol to its solid phase previously observed with Spitzer allows us to put quantitative constraints on the efficiency of the non-thermal desorption of this species. With physical parameters determined from available Herschel data, we computed abundance maps of 11 detected molecules with a non-local thermal equilibrium radiative transfer model. These observations allowed us to probe the molecular abundances as a function of density and visual extinction, with the variation in temperature being restrained between 12 and 18 K. We then compared the observed abundances to the predictions of the Nautilus astrochemical model. We find that all molecules have lower abundances at high densities and visual extinctions with respect to lower density regions, except for methanol. Comparing these observations with a grid of chemical models based on the local physical conditions, we were able to reproduce these observations, allowing only the parameter time to vary. Comparing the observed gas-phase abundance of methanol with previous measurements of the methanol ice, we estimate a non-thermal desorption efficiency between 0.002% and 0.09%, increasing with density. The apparent increase in the desorption efficiency cannot be reproduced by our model unless the yield of cosmic-ray sputtering is altered due to the ice composition varying as a function of density. △ Less

Submitted 3 January, 2023; originally announced January 2023.

Energy transfer and restructuring in amorphous solid water upon consecutive irradiation

Authors: Herma M. Cuppen, Jennifer A. Noble, Stephane Coussan, Britta Redlich, Sergio Ioppolo

Abstract: Interstellar and cometary ices play an important role in the formation of planetary systems around young stars. Their main constituent is amorphous solid water (ASW). Although ASW is widely studied, vibrational energy dissipation and structural changes due to vibrational excitation are less well understood. The hydrogen-bonding network is likely a crucial component in this. Here we present experim… ▽ More Interstellar and cometary ices play an important role in the formation of planetary systems around young stars. Their main constituent is amorphous solid water (ASW). Although ASW is widely studied, vibrational energy dissipation and structural changes due to vibrational excitation are less well understood. The hydrogen-bonding network is likely a crucial component in this. Here we present experimental results on hydrogen-bonding changes in ASW induced by the intense, nearly monochromatic mid-IR free-electron laser (FEL) radiation of the FELIX-2 beamline at the HFML-FELIX facility at the Radboud University in Nijmegen, the Netherlands. Structural changes in ASW are monitored by reflection-absorption infrared spectroscopy and depend on the irradiation history of the ice. The experiments show that FEL irradiation can induce changes in the local neighborhood of the excited molecules due to energy transfer. Molecular Dynamics simulations confirm this picture: vibrationally excited molecules can reorient for a more optimal tetrahedral surrounding without breaking existing hydrogen bonds. The vibrational energy can transfer through the hydrogen-bonding network to water molecules that have the same vibrational frequency. We hence expect a reduced energy dissipation in amorphous material with respect to crystalline material due to the inhomogeneity in vibrational frequencies as well as the presence of specific hydrogen-bonding defect sites which can also hamper the energy transfer. △ Less

Submitted 29 November, 2022; originally announced November 2022.

Comments: 34 page, 9 figures

Self-Supervised Surgical Instrument 3D Reconstruction from a Single Camera Image

Authors: Ange Lou, Xing Yao, Ziteng Liu, **tong Han, Jack Noble

Abstract: Surgical instrument tracking is an active research area that can provide surgeons feedback about the location of their tools relative to anatomy. Recent tracking methods are mainly divided into two parts: segmentation and object detection. However, both can only predict 2D information, which is limiting for application to real-world surgery. An accurate 3D surgical instrument model is a prerequisi… ▽ More Surgical instrument tracking is an active research area that can provide surgeons feedback about the location of their tools relative to anatomy. Recent tracking methods are mainly divided into two parts: segmentation and object detection. However, both can only predict 2D information, which is limiting for application to real-world surgery. An accurate 3D surgical instrument model is a prerequisite for precise predictions of the pose and depth of the instrument. Recent single-view 3D reconstruction methods are only used in natural object reconstruction and do not achieve satisfying reconstruction accuracy without 3D attribute-level supervision. Further, those methods are not suitable for the surgical instruments because of their elongated shapes. In this paper, we firstly propose an end-to-end surgical instrument reconstruction system -- Self-supervised Surgical Instrument Reconstruction (SSIR). With SSIR, we propose a multi-cycle-consistency strategy to help capture the texture information from a slim instrument while only requiring a binary instrument label map. Experiments demonstrate that our approach improves the reconstruction quality of surgical instruments compared to other self-supervised methods and achieves promising results. △ Less

Submitted 25 November, 2022; originally announced November 2022.

Comments: Accepted by SPIE Medical Imaging 2023

Necessity Specifications for Robustness

Authors: Julian Mackay, Sophia Drossopoulou, James Noble, Susan Eisenbach

Abstract: Robust modules guarantee to do only what they are supposed to do - even in the presence of untrusted, malicious clients, and considering not just the direct behaviour of individual methods, but also the emergent behaviour from calls to more than one method. Necessity is a language for specifying robustness, based on novel necessity operators capturing temporal implication, and a proof logic that d… ▽ More Robust modules guarantee to do only what they are supposed to do - even in the presence of untrusted, malicious clients, and considering not just the direct behaviour of individual methods, but also the emergent behaviour from calls to more than one method. Necessity is a language for specifying robustness, based on novel necessity operators capturing temporal implication, and a proof logic that derives explicit robustness specifications from functional specifications. Soundness and an exemplar proof are mechanised in Coq. △ Less

Submitted 16 September, 2022; originally announced September 2022.

Prototypical few-shot segmentation for cross-institution male pelvic structures with spatial registration

Authors: Yiwen Li, Yunguan Fu, Iani Gayo, Qianye Yang, Zhe Min, Shaheer Saeed, Wen Yan, Yipei Wang, J. Alison Noble, Mark Emberton, Matthew J. Clarkson, Henkjan Huisman, Dean Barratt, Victor Adrian Prisacariu, Yipeng Hu

Abstract: The prowess that makes few-shot learning desirable in medical image analysis is the efficient use of the support image data, which are labelled to classify or segment new classes, a task that otherwise requires substantially more training images and expert annotations. This work describes a fully 3D prototypical few-shot segmentation algorithm, such that the trained networks can be effectively ada… ▽ More The prowess that makes few-shot learning desirable in medical image analysis is the efficient use of the support image data, which are labelled to classify or segment new classes, a task that otherwise requires substantially more training images and expert annotations. This work describes a fully 3D prototypical few-shot segmentation algorithm, such that the trained networks can be effectively adapted to clinically interesting structures that are absent in training, using only a few labelled images from a different institute. First, to compensate for the widely recognised spatial variability between institutions in episodic adaptation of novel classes, a novel spatial registration mechanism is integrated into prototypical learning, consisting of a segmentation head and an spatial alignment module. Second, to assist the training with observed imperfect alignment, support mask conditioning module is proposed to further utilise the annotation available from the support images. Extensive experiments are presented in an application of segmenting eight anatomical structures important for interventional planning, using a data set of 589 pelvic T2-weighted MR images, acquired at seven institutes. The results demonstrate the efficacy in each of the 3D formulation, the spatial registration, and the support mask conditioning, all of which made positive contributions independently or collectively. Compared with the previously proposed 2D alternatives, the few-shot segmentation performance was improved with statistical significance, regardless whether the support data come from the same or different institutes. △ Less

Submitted 25 August, 2023; v1 submitted 12 September, 2022; originally announced September 2022.

Comments: accepted by Medical Image Analysis

Anatomy-Aware Contrastive Representation Learning for Fetal Ultrasound

Authors: Zeyu Fu, Jianbo Jiao, Robail Yasrab, Lior Drukker, Aris T. Papageorghiou, J. Alison Noble

Abstract: Self-supervised contrastive representation learning offers the advantage of learning meaningful visual representations from unlabeled medical datasets for transfer learning. However, applying current contrastive learning approaches to medical data without considering its domain-specific anatomical characteristics may lead to visual representations that are inconsistent in appearance and semantics.… ▽ More Self-supervised contrastive representation learning offers the advantage of learning meaningful visual representations from unlabeled medical datasets for transfer learning. However, applying current contrastive learning approaches to medical data without considering its domain-specific anatomical characteristics may lead to visual representations that are inconsistent in appearance and semantics. In this paper, we propose to improve visual representations of medical images via anatomy-aware contrastive learning (AWCL), which incorporates anatomy information to augment the positive/negative pair sampling in a contrastive learning manner. The proposed approach is demonstrated for automated fetal ultrasound imaging tasks, enabling the positive pairs from the same or different ultrasound scans that are anatomically similar to be pulled together and thus improving the representation learning. We empirically investigate the effect of inclusion of anatomy information with coarse- and fine-grained granularity, for contrastive learning and find that learning with fine-grained anatomy information which preserves intra-class difference is more effective than its counterpart. We also analyze the impact of anatomy ratio on our AWCL framework and find that using more distinct but anatomically similar samples to compose positive pairs results in better quality representations. Experiments on a large-scale fetal ultrasound dataset demonstrate that our approach is effective for learning representations that transfer well to three clinical downstream tasks, and achieves superior performance compared to ImageNet supervised and the current state-of-the-art contrastive learning methods. In particular, AWCL outperforms ImageNet supervised method by 13.8% and state-of-the-art contrastive-based method by 7.1% on a cross-domain segmentation task. △ Less

Submitted 22 August, 2022; originally announced August 2022.

Comments: ECCV-MCV 2022

Multimodal-GuideNet: Gaze-Probe Bidirectional Guidance in Obstetric Ultrasound Scanning

Authors: Qianhui Men, Clare Teng, Lior Drukker, Aris T. Papageorghiou, J. Alison Noble

Abstract: Eye trackers can provide visual guidance to sonographers during ultrasound (US) scanning. Such guidance is potentially valuable for less experienced operators to improve their scanning skills on how to manipulate the probe to achieve the desired plane. In this paper, a multimodal guidance approach (Multimodal-GuideNet) is proposed to capture the stepwise dependency between a real-world US video si… ▽ More Eye trackers can provide visual guidance to sonographers during ultrasound (US) scanning. Such guidance is potentially valuable for less experienced operators to improve their scanning skills on how to manipulate the probe to achieve the desired plane. In this paper, a multimodal guidance approach (Multimodal-GuideNet) is proposed to capture the stepwise dependency between a real-world US video signal, synchronized gaze, and probe motion within a unified framework. To understand the causal relationship between gaze movement and probe motion, our model exploits multitask learning to jointly learn two related tasks: predicting gaze movements and probe signals that an experienced sonographer would perform in routine obstetric scanning. The two tasks are associated by a modality-aware spatial graph to detect the co-occurrence among the multi-modality inputs and share useful cross-modal information. Instead of a deterministic scanning path, Multimodal-GuideNet allows for scanning diversity by estimating the probability distribution of real scans. Experiments performed with three typical obstetric scanning examinations show that the new approach outperforms single-task learning for both probe motion guidance and gaze movement prediction. Multimodal-GuideNet also provides a visual guidance signal with an error rate of less than 10 pixels for a 224x288 US image. △ Less

Submitted 26 July, 2022; originally announced July 2022.

Comments: Early accepted by MICCAI 2022

Influence of grain growth on CO2 ice spectroscopic profiles : Modelling for dense cores and disks

Authors: Emmanuel Dartois, Jennifer A. Noble, Nathalie Ysard, Karine Demyk, Marin Chabot

Abstract: Interstellar dust grain growth in dense clouds and protoplanetary disks, even moderate, affects the observed interstellar ice profiles as soon as a significant fraction of dust grains is in the size range close to the wave vector at the considered wavelength. The continuum baseline correction made prior to analysing ice profiles influences the subsequent analysis and hence the estimated ice compos… ▽ More Interstellar dust grain growth in dense clouds and protoplanetary disks, even moderate, affects the observed interstellar ice profiles as soon as a significant fraction of dust grains is in the size range close to the wave vector at the considered wavelength. The continuum baseline correction made prior to analysing ice profiles influences the subsequent analysis and hence the estimated ice composition, typically obtained by band fitting using thin film ice mixture spectra. We model the effect of grain growth on ice mantle spectroscopic profiles, focusing on CO2 to see how it can affect interstellar ice mantle spectral analysis and interpretation. Using the Discrete Dipole Approximation for Scattering and Absorption of Light, the mass absorption coefficients of distributions of grains composed of ellipsoidal silicate cores with water and carbon dioxide ice mantles are calculated. A few other ice mantle compositions are also calculated. We explore the size distribution evolution from dense clouds to simulate the first steps of grain growth up to three microns in size. The results are injected into RADMC-3D full scattering radiative transfer models of spherical clouds and protoplanetary disk templates to retrieve observable spectral energy distributions. We focus on calculated profile of the CO2 antisymmetric stretching mode ice band profile at 4.27 microns, a meaningful indicator of grain growth. The observed profiles toward dense cores with the Infrared space observatory and Akari satellites already showed profiles possibly indicative of moderate grain growth.The observation of protoplanetary disks at high inclination with the JWST should present distorted profiles that will put constraints on the extent of dust growth. The more evolved the dust size distribution, the more the extraction of the ice mantle composition will require both understanding and taking into account grain growth. △ Less

Submitted 19 July, 2022; originally announced July 2022.

Comments: 19 pages, 16 figures

Journal ref: A&A 666, A153 (2022)

Ice features of low-luminosity protostars in near-infrared spectra of AKARI/IRC

Authors: Jaeyeong Kim, Jeong-Eun Lee, Woong-Seob Jeong, Il-Seok Kim, Yuri Aikawa, Jeniffer A. Noble, Minho Choi, Ho-Gyu Lee, Michael M. Dunham, Chul-Hwan Kim, Bon-Chul Koo

Abstract: We present near-infrared spectra of three low-luminosity protostars and one background star in the Perseus molecular cloud, acquired using the Infrared Camera (IRC) onboard the \textit{AKARI} space telescope. For the comparison with different star-forming environments, we also present spectra of the massive protostar AFGL 7009S, where the protostellar envelope is heated significantly, and the low-… ▽ More We present near-infrared spectra of three low-luminosity protostars and one background star in the Perseus molecular cloud, acquired using the Infrared Camera (IRC) onboard the \textit{AKARI} space telescope. For the comparison with different star-forming environments, we also present spectra of the massive protostar AFGL 7009S, where the protostellar envelope is heated significantly, and the low-mass protostar RNO 91, which is suspected to be undergoing an episodic burst. We detected ice absorption features of \ch{H2O}, \ch{CO2}, and \ch{CO} at all spectra around the wavelengths of 3.05, 4.27, and 4.67 $μ$m, respectively. At least two low-luminosity protostars, we also detected the \ch{XCN} ice feature at 4.62 $μ$m. The presence of the crystalline \ch{H2O} ice and \ch{XCN} ice components indicates that the low-luminosity protostars experienced a hot phase via accretion bursts during the past mass accretion process. We compared the ice abundances of low-luminosity protostars with those of the embedded low-mass protostars and the dense molecular clouds and cores, suggesting that their ice abundances reflect the strength of prior bursts and the timescale after the last burst. △ Less

Submitted 11 July, 2022; originally announced July 2022.

Comments: 34 pages, 9 figures

Determining the bubble nucleation efficiency of low-energy nuclear recoils in superheated C$_3$F$_8$ dark matter detectors

Authors: B. Ali, I. J. Arnquist, D. Baxter, E. Behnke, M. Bressler, B. Broerman, K. Clark, J. I. Collar, P. S. Cooper, C. Cripe, M. Crisler, C. E. Dahl, M. Das, D. Durnford, S. Fallows, J. Farine, R. Filgas, A. García-Viltres, F. Girard, G. Giroux, O. Harris, E. W. Hoppe, C. M. Jackson, M. **, C. B. Krauss , et al. (32 additional authors not shown)

Abstract: The bubble nucleation efficiency of low-energy nuclear recoils in superheated liquids plays a crucial role in interpreting results from direct searches for weakly interacting massive particle (WIMP) dark matter. The PICO Collaboration presents the results of the efficiencies for bubble nucleation from carbon and fluorine recoils in superheated C$_3$F$_8$ from calibration data taken with 5 distinct… ▽ More The bubble nucleation efficiency of low-energy nuclear recoils in superheated liquids plays a crucial role in interpreting results from direct searches for weakly interacting massive particle (WIMP) dark matter. The PICO Collaboration presents the results of the efficiencies for bubble nucleation from carbon and fluorine recoils in superheated C$_3$F$_8$ from calibration data taken with 5 distinct neutron spectra at various thermodynamic thresholds ranging from 2.1 keV to 3.9 keV. Instead of assuming any particular functional forms for the nuclear recoil efficiency, a generalized piecewise linear model is proposed with systematic errors included as nuisance parameters to minimize model-introduced uncertainties. A Markov-Chain Monte-Carlo (MCMC) routine is applied to sample the nuclear recoil efficiency for fluorine and carbon at 2.45 keV and 3.29 keV thermodynamic thresholds simultaneously. The nucleation efficiency for fluorine was found to be $\geq 50\, \%$ for nuclear recoils of 3.3 keV (3.7 keV) at a thermodynamic Seitz threshold of 2.45 keV (3.29 keV), and for carbon the efficiency was found to be $\geq 50\, \%$ for recoils of 10.6 keV (11.1 keV) at a threshold of 2.45 keV (3.29 keV). Simulated data sets are used to calculate a p-value for the fit, confirming that the model used is compatible with the data. The fit paradigm is also assessed for potential systematic biases, which although small, are corrected for. Additional steps are performed to calculate the expected interaction rates of WIMPs in the PICO-60 detector, a requirement for calculating WIMP exclusion limits. △ Less

Submitted 7 November, 2022; v1 submitted 11 May, 2022; originally announced May 2022.

Comments: 17 pages, 22 figures, 5 tables

Rusty Links in Local Chains

Authors: James Noble, Julian Mackay, Tobias Wrigstad

Abstract: Rust successfully applies ownership types to control memory allocation. This restricts the programs' topologies to the point where doubly-linked lists cannot be programmed in Safe Rust. We sketch how more flexible "local" ownership could be added to Rust, permitting multiple mutable references to objects, provided each reference is bounded by the object's lifetime. To maintain thread-safety, local… ▽ More Rust successfully applies ownership types to control memory allocation. This restricts the programs' topologies to the point where doubly-linked lists cannot be programmed in Safe Rust. We sketch how more flexible "local" ownership could be added to Rust, permitting multiple mutable references to objects, provided each reference is bounded by the object's lifetime. To maintain thread-safety, locally owned objects must remain thread-local; to maintain memory safety, local objects can be deallocated when their owner's lifetime expires. △ Less

Submitted 2 May, 2022; originally announced May 2022.

More Programming Than Programming: Teaching Formal Methods in a Software Engineering Programme

Authors: James Noble, David Streader, Isaac Oscar Gariano, Miniruwani Samarakoon

Abstract: Formal methods for software correctness are critical to the future of software engineering - and so must be an essential part of software engineering education. Unfortunately, formal methods are often resisted by students due to perceived difficulty, mathematicity, and practical irrelevance. We redeveloped our software correctness course by taking a programming intensive approach, using the solver… ▽ More Formal methods for software correctness are critical to the future of software engineering - and so must be an essential part of software engineering education. Unfortunately, formal methods are often resisted by students due to perceived difficulty, mathematicity, and practical irrelevance. We redeveloped our software correctness course by taking a programming intensive approach, using the solver-aided language Dafny to provide instant formative feedback via automated assessment. Our redeveloped course increased student retention and resulted in the best evaluation for the course for at least ten years. △ Less

Submitted 2 May, 2022; originally announced May 2022.

IRFEL Selective Irradiation of Amorphous Solid Water: from Dangling to Bulk Modes

Authors: S. Coussan, J. A. Noble, H. M. Cuppen, B. Redlich, S. Ioppolo

Abstract: Amorphous solid water (ASW) is one of the most widely studied solid phase systems. A better understanding of the nature of inter- and intramolecular forces in ASW is, however, still required to correctly interpret the catalytic role of ASW in the formation and preservation of molecular species in environments such as the icy surfaces of Solar System objects, on interstellar icy dust grains and pot… ▽ More Amorphous solid water (ASW) is one of the most widely studied solid phase systems. A better understanding of the nature of inter- and intramolecular forces in ASW is, however, still required to correctly interpret the catalytic role of ASW in the formation and preservation of molecular species in environments such as the icy surfaces of Solar System objects, on interstellar icy dust grains and potentially even in the upper layers of the Earth's atmosphere. In this work, we have systematically exposed porous ASW (pASW) to mid-infrared radiation generated by a free-electron laser at the HFML-FELIX facility in the Netherlands to study the effect of vibrational energy injection into the surface and bulk modes of pASW. During multiple sequential irradiations on the same ice spot, we observed selective effects both at the surface and in the bulk of the ice. Although the density of states in pASW should allow for a fast vibrational relaxation through the H-bonded network, part of the injected energy is converted into structural ice changes as illustrated by the observation of spectral modifications when performing Fourier transform infrared spectroscopy in reflection-absorption mode. Future studies will include the quantification of such effects by systematically investigating ice thickness, ice morphology, and ice composition. △ Less

Submitted 26 April, 2022; originally announced April 2022.

Comments: Published in The Journal of Physical Chemistry A

Journal ref: J. Phys. Chem. A 2022, 126, 14, 2262-2269

Results on photon-mediated dark matter-nucleus interactions from the PICO-60 C$_{3}$F$_{8}$ bubble chamber

Authors: B. Ali, I. J. Arnquist, D. Baxter, E. Behnke, M. Bressler, B. Broerman, C. J. Chen, K. Clark, J. I. Collar, P. S. Cooper, C. Cripe, M. Crisler, C. E. Dahl, M. Das, D. Durnford, S. Fallows, J. Farine, R. Filgas, A. García-Viltres, G. Giroux, O. Harris, T. Hillier, E. W. Hoppe, C. M. Jackson, M. ** , et al. (30 additional authors not shown)

Abstract: Many compelling models predict dark matter coupling to the electromagnetic current through higher multipole interactions, while remaining electrically neutral. Different multipole couplings have been studied, among them anapole moment, electric and magnetic dipole moments, and millicharge. This study sets limits on the couplings for these photon-mediated interactions using non-relativistic contact… ▽ More Many compelling models predict dark matter coupling to the electromagnetic current through higher multipole interactions, while remaining electrically neutral. Different multipole couplings have been studied, among them anapole moment, electric and magnetic dipole moments, and millicharge. This study sets limits on the couplings for these photon-mediated interactions using non-relativistic contact operators in an effective field theory framework. Using data from the PICO-60 bubble chamber leading limits for dark matter masses between 2.7 GeV/c$^2$ and 24 GeV/c$^2$ are reported for the coupling of these photon-mediated dark matter-nucleus interactions. The detector was filled with 52 kg of C$_3$F$_8$ operating at thermodynamic thresholds of 2.45 keV and 3.29 keV, reaching exposures of 1404 kg-day and 1167 kg-day, respectively. △ Less

Submitted 21 April, 2022; originally announced April 2022.

Min-Max Similarity: A Contrastive Semi-Supervised Deep Learning Network for Surgical Tools Segmentation

Authors: Ange Lou, Kareem Tawfik, Xing Yao, Ziteng Liu, Jack Noble

Abstract: A common problem with segmentation of medical images using neural networks is the difficulty to obtain a significant number of pixel-level annotated data for training. To address this issue, we proposed a semi-supervised segmentation network based on contrastive learning. In contrast to the previous state-of-the-art, we introduce Min-Max Similarity (MMS), a contrastive learning form of dual-view t… ▽ More A common problem with segmentation of medical images using neural networks is the difficulty to obtain a significant number of pixel-level annotated data for training. To address this issue, we proposed a semi-supervised segmentation network based on contrastive learning. In contrast to the previous state-of-the-art, we introduce Min-Max Similarity (MMS), a contrastive learning form of dual-view training by employing classifiers and projectors to build all-negative, and positive and negative feature pairs, respectively, to formulate the learning as solving a MMS problem. The all-negative pairs are used to supervise the networks learning from different views and to capture general features, and the consistency of unlabeled predictions is measured by pixel-wise contrastive loss between positive and negative pairs. To quantitatively and qualitatively evaluate our proposed method, we test it on four public endoscopy surgical tool segmentation datasets and one cochlear implant surgery dataset, which we manually annotated. Results indicate that our proposed method consistently outperforms state-of-the-art semi-supervised and fully supervised segmentation algorithms. And our semi-supervised segmentation algorithm can successfully recognize unknown surgical tools and provide good predictions. Also, our MMS approach could achieve inference speeds of about 40 frames per second (fps) and is suitable to deal with the real-time video segmentation. △ Less

Submitted 22 February, 2023; v1 submitted 28 March, 2022; originally announced March 2022.

Image quality assessment for machine learning tasks using meta-reinforcement learning

Authors: Shaheer U. Saeed, Yunguan Fu, Vasilis Stavrinides, Zachary M. C. Baum, Qianye Yang, Mirabela Rusu, Richard E. Fan, Geoffrey A. Sonn, J. Alison Noble, Dean C. Barratt, Yipeng Hu

Abstract: In this paper, we consider image quality assessment (IQA) as a measure of how images are amenable with respect to a given downstream task, or task amenability. When the task is performed using machine learning algorithms, such as a neural-network-based task predictor for image classification or segmentation, the performance of the task predictor provides an objective estimate of task amenability.… ▽ More In this paper, we consider image quality assessment (IQA) as a measure of how images are amenable with respect to a given downstream task, or task amenability. When the task is performed using machine learning algorithms, such as a neural-network-based task predictor for image classification or segmentation, the performance of the task predictor provides an objective estimate of task amenability. In this work, we use an IQA controller to predict the task amenability which, itself being parameterised by neural networks, can be trained simultaneously with the task predictor. We further develop a meta-reinforcement learning framework to improve the adaptability for both IQA controllers and task predictors, such that they can be fine-tuned efficiently on new datasets or meta-tasks. We demonstrate the efficacy of the proposed task-specific, adaptable IQA approach, using two clinical applications for ultrasound-guided prostate intervention and pneumonia detection on X-ray images. △ Less

Submitted 27 March, 2022; originally announced March 2022.

Comments: Accepted to Medical Image Analysis; Final published version available at: https://doi.org/10.1016/j.media.2022.102427

Journal ref: Medical Image Analysis, Volume 78, 2022, 102427, ISSN 1361-8415

Infrared free-electron laser irradiation of carbon dioxide ice

Authors: Sergio Ioppolo, Jennifer A. Noble, Alejandra Traspas Muiña, Herma M. Cuppen, Stéphane Coussan, Britta Redlich

Abstract: Interstellar ice grains are believed to play a key role in the formation of many of the simple and complex organic species detected in space. However, many fundamental questions on the physicochemical processes linked to the formation and survival of species in ice grains remain unanswered. Field work at large-scale facilities such as free-electron lasers (FELs) can aid the investigation of the co… ▽ More Interstellar ice grains are believed to play a key role in the formation of many of the simple and complex organic species detected in space. However, many fundamental questions on the physicochemical processes linked to the formation and survival of species in ice grains remain unanswered. Field work at large-scale facilities such as free-electron lasers (FELs) can aid the investigation of the composition and morphology of ice grains by providing novel tools to the laboratory astrophysics community. We combined the high tunability, wide infrared spectral range and intensity of the FEL beam line FELIX-2 at the HFML-FELIX Laboratory in the Netherlands with the characteristics of the ultrahigh vacuum LISA end station to perform wavelength-dependent mid-IR irradiation experiments of space-relevant pure carbon dioxide (CO2) ice at 20 K. We used the intense monochromatic radiation of FELIX to inject vibrational energy at selected frequencies into the CO2 ice to study ice restructuring effects in situ by Fourier Transform Reflection-Absorption Infrared (FT-RAIR) spectroscopy. This work improves our understanding of how vibrational energy introduced by external triggers such as photons, electrons, cosmic rays, and thermal heating coming from a nascent protostar or field stars is dissipated in an interstellar icy dust grain in space. Moreover, it adds to the current literature debate concerning the amorphous and polycrystalline structure of CO2 ice observed upon deposition at low temperatures, showing that, under our experimental conditions, CO2 ice presents amorphous characteristics when deposited at 20 K and is unambiguously crystalline if deposited at 75 K. △ Less

Submitted 24 March, 2022; originally announced March 2022.

Comments: Published in the 'Journal of Molecular Spectroscopy'. Includes 11 pages, 7 figures

Journal ref: J Mol Spectrosc (2022) 385, 111601

Learning to automate cryo-electron microscopy data collection with Ptolemy

Authors: Paul T. Kim, Alex J. Noble, Anchi Cheng, Tristan Bepler

Abstract: Over the past decade, cryogenic electron microscopy (cryo-EM) has emerged as a primary method for determining near-native, near-atomic resolution 3D structures of biological macromolecules. In order to meet increasing demand for cryo-EM, automated methods to improve throughput and efficiency while lowering costs are needed. Currently, all high-magnification cryo-EM data collection softwares requir… ▽ More Over the past decade, cryogenic electron microscopy (cryo-EM) has emerged as a primary method for determining near-native, near-atomic resolution 3D structures of biological macromolecules. In order to meet increasing demand for cryo-EM, automated methods to improve throughput and efficiency while lowering costs are needed. Currently, all high-magnification cryo-EM data collection softwares require human input and manual tuning of parameters. Expert operators must navigate low- and medium-magnification images to find good high-magnification collection locations. Automating this is non-trivial: the images suffer from low signal-to-noise ratio and are affected by a range of experimental parameters that can differ for each collection session. Here, we use various computer vision algorithms, including mixture models, convolutional neural networks, and U-Nets to develop the first pipeline to automate low- and medium-magnification targeting. Learned models in this pipeline are trained on a large internal dataset of images from real world cryo-EM data collection sessions, labeled with locations that were selected by operators. Using these models, we show that we can effectively detect and classify regions of interest in low- and medium-magnification images, and can generalize to unseen sessions, as well as to images captured using different microscopes from external facilities. We expect our open-source pipeline, Ptolemy, will be both immediately useful as a tool for automation of cryo-EM data collection, and serve as a foundation for future advanced methods for efficient and automated cryo-EM microscopy. △ Less

Submitted 14 January, 2022; v1 submitted 1 December, 2021; originally announced December 2021.

Comments: Main: 12 pages, 11 figures. Appendix: 2 pages, 1 figure

ACM Class: I.4.9; J.3

Dala: A Simple Capability-Based Dynamic Language Design For Data Race-Freedom

Authors: Kiko Fernandez-Reyes, Isaac Oscar Gariano, James Noble, Erin Greenwood-Thessman, Michael Homer, Tobias Wrigstad

Abstract: Dynamic languages like Erlang, Clojure, JavaScript, and E adopted data-race freedom by design. To enforce data-race freedom, these languages either deep copy objects during actor (thread) communication or proxy back to their owning thread. We present Dala, a simple programming model that ensures data-race freedom while supporting efficient inter-thread communication. Dala is a dynamic, concurrent,… ▽ More Dynamic languages like Erlang, Clojure, JavaScript, and E adopted data-race freedom by design. To enforce data-race freedom, these languages either deep copy objects during actor (thread) communication or proxy back to their owning thread. We present Dala, a simple programming model that ensures data-race freedom while supporting efficient inter-thread communication. Dala is a dynamic, concurrent, capability-based language that relies on three core capabilities: immutable values can be shared freely; isolated mutable objects can be transferred between threads but not aliased; local objects can be aliased within their owning thread but not dereferenced by other threads. Objects with capabilities can co-exist with unsafe objects, that are unchecked and may suffer data races, without compromising the safety of safe objects. We present a formal model of Dala, prove data race-freedom and state and prove a dynamic gradual guarantee. These theorems guarantee data race-freedom when using safe capabilities and show that the addition of capabilities is semantics preserving modulo permission and cast errors. △ Less

Submitted 15 September, 2021; originally announced September 2021.

Facial Anatomical Landmark Detection using Regularized Transfer Learning with Application to Fetal Alcohol Syndrome Recognition

Authors: Zeyu Fu, Jianbo Jiao, Michael Suttie, J. Alison Noble

Abstract: Fetal alcohol syndrome (FAS) caused by prenatal alcohol exposure can result in a series of cranio-facial anomalies, and behavioral and neurocognitive problems. Current diagnosis of FAS is typically done by identifying a set of facial characteristics, which are often obtained by manual examination. Anatomical landmark detection, which provides rich geometric information, is important to detect the… ▽ More Fetal alcohol syndrome (FAS) caused by prenatal alcohol exposure can result in a series of cranio-facial anomalies, and behavioral and neurocognitive problems. Current diagnosis of FAS is typically done by identifying a set of facial characteristics, which are often obtained by manual examination. Anatomical landmark detection, which provides rich geometric information, is important to detect the presence of FAS associated facial anomalies. This imaging application is characterized by large variations in data appearance and limited availability of labeled data. Current deep learning-based heatmap regression methods designed for facial landmark detection in natural images assume availability of large datasets and are therefore not wellsuited for this application. To address this restriction, we develop a new regularized transfer learning approach that exploits the knowledge of a network learned on large facial recognition datasets. In contrast to standard transfer learning which focuses on adjusting the pre-trained weights, the proposed learning approach regularizes the model behavior. It explicitly reuses the rich visual semantics of a domain-similar source model on the target task data as an additional supervisory signal for regularizing landmark detection optimization. Specifically, we develop four regularization constraints for the proposed transfer learning, including constraining the feature outputs from classification and intermediate layers, as well as matching activation attention maps in both spatial and channel levels. Experimental evaluation on a collected clinical imaging dataset demonstrate that the proposed approach can effectively improve model generalizability under limited training samples, and is advantageous to other approaches in the literature. △ Less

Submitted 12 September, 2021; originally announced September 2021.

Comments: To appear in IEEE journal of Biomedical and Health Informatics 2021

Adaptable image quality assessment using meta-reinforcement learning of task amenability

Authors: Shaheer U. Saeed, Yunguan Fu, Vasilis Stavrinides, Zachary M. C. Baum, Qianye Yang, Mirabela Rusu, Richard E. Fan, Geoffrey A. Sonn, J. Alison Noble, Dean C. Barratt, Yipeng Hu

Abstract: The performance of many medical image analysis tasks are strongly associated with image data quality. When develo** modern deep learning algorithms, rather than relying on subjective (human-based) image quality assessment (IQA), task amenability potentially provides an objective measure of task-specific image quality. To predict task amenability, an IQA agent is trained using reinforcement learn… ▽ More The performance of many medical image analysis tasks are strongly associated with image data quality. When develo** modern deep learning algorithms, rather than relying on subjective (human-based) image quality assessment (IQA), task amenability potentially provides an objective measure of task-specific image quality. To predict task amenability, an IQA agent is trained using reinforcement learning (RL) with a simultaneously optimised task predictor, such as a classification or segmentation neural network. In this work, we develop transfer learning or adaptation strategies to increase the adaptability of both the IQA agent and the task predictor so that they are less dependent on high-quality, expert-labelled training data. The proposed transfer learning strategy re-formulates the original RL problem for task amenability in a meta-reinforcement learning (meta-RL) framework. The resulting algorithm facilitates efficient adaptation of the agent to different definitions of image quality, each with its own Markov decision process environment including different images, labels and an adaptable task predictor. Our work demonstrates that the IQA agents pre-trained on non-expert task labels can be adapted to predict task amenability as defined by expert task labels, using only a small set of expert labels. Using 6644 clinical ultrasound images from 249 prostate cancer patients, our results for image classification and segmentation tasks show that the proposed IQA method can be adapted using data with as few as respective 19.7% and 29.6% expert-reviewed consensus labels and still achieve comparable IQA and task performance, which would otherwise require a training dataset with 100% expert labels. △ Less

Submitted 31 July, 2021; originally announced August 2021.

Comments: Accepted at ASMUS 2021 (The 2nd International Workshop of Advances in Simplifying Medical UltraSound)

Atlas-Based Segmentation of Intracochlear Anatomy in Metal Artifact Affected CT Images of the Ear with Co-trained Deep Neural Networks

Authors: Jianing Wang, Dingjie Su, Yubo Fan, Srijata Chakravorti, Jack H. Noble, Benoit M. Dawant

Abstract: We propose an atlas-based method to segment the intracochlear anatomy (ICA) in the post-implantation CT (Post-CT) images of cochlear implant (CI) recipients that preserves the point-to-point correspondence between the meshes in the atlas and the segmented volumes. To solve this problem, which is challenging because of the strong artifacts produced by the implant, we use a pair of co-trained deep n… ▽ More We propose an atlas-based method to segment the intracochlear anatomy (ICA) in the post-implantation CT (Post-CT) images of cochlear implant (CI) recipients that preserves the point-to-point correspondence between the meshes in the atlas and the segmented volumes. To solve this problem, which is challenging because of the strong artifacts produced by the implant, we use a pair of co-trained deep networks that generate dense deformation fields (DDFs) in opposite directions. One network is tasked with registering an atlas image to the Post-CT images and the other network is tasked with registering the Post-CT images to the atlas image. The networks are trained using loss functions based on voxel-wise labels, image content, fiducial registration error, and cycle-consistency constraint. The segmentation of the ICA in the Post-CT images is subsequently obtained by transferring the predefined segmentation meshes of the ICA in the atlas image to the Post-CT images using the corresponding DDFs generated by the trained registration networks. Our model can learn the underlying geometric features of the ICA even though they are obscured by the metal artifacts. We show that our end-to-end network produces results that are comparable to the current state of the art (SOTA) that relies on a two-steps approach that first uses conditional generative adversarial networks to synthesize artifact-free images from the Post-CT images and then uses an active shape model-based method to segment the ICA in the synthetic images. Our method requires a fraction of the time needed by the SOTA, which is important for end-user acceptance. △ Less

Submitted 9 July, 2021; v1 submitted 8 July, 2021; originally announced July 2021.

Comments: 10 pages, 5 figures

A multiresolution Discrete Element Method for triangulated objects with implicit timestep**

Authors: Peter J. Noble, Tobias Weinzierl

Abstract: Simulations of many rigid bodies colliding with each other sometimes yield particularly interesting results if the colliding objects differ significantly in size and are non-spherical. The most expensive part within such a simulation code is the collision detection. We propose a family of novel multiscale collision detection algorithms that can be applied to triangulated objects within explicit an… ▽ More Simulations of many rigid bodies colliding with each other sometimes yield particularly interesting results if the colliding objects differ significantly in size and are non-spherical. The most expensive part within such a simulation code is the collision detection. We propose a family of novel multiscale collision detection algorithms that can be applied to triangulated objects within explicit and implicit time step** methods. They are well-suited to handle objects that cannot be represented by analytical shapes or assemblies of analytical objects. Inspired by multigrid methods and adaptive mesh refinement, we determine collision points iteratively over a resolution hierarchy, and combine a functional minimisation plus penalty parameters with the actual comparision-based geometric distance calculation. Coarse surrogate geometry representations identify "no collision" scenarios early on and otherwise yield an educated guess which triangle subsets of the next finer level potentially yield collisions. They prune the search tree, and furthermore feed conservative contact force estimates into the iterative solve behind an implicit time step**. Implicit time step** and non-analytical shapes often yield prohibitive high compute cost for rigid body simulations. Our approach reduces these cost algorithmically by one to two orders of magnitude. It also exhibits high vectorisation efficiency due to its iterative nature. △ Less

Submitted 9 March, 2022; v1 submitted 26 May, 2021; originally announced May 2021.

MSC Class: 70E55; 70F35; 68U05; 51P05; 37N15

Pulseshape discrimination against low-energy Ar-39 beta decays in liquid argon with 4.5 tonne-years of DEAP-3600 data

Authors: The DEAP Collaboration, P. Adhikari, R. Ajaj, M. Alpízar-Venegas, P. -A. Amaudruz, D. J. Auty, M. Batygov, B. Beltran, H. Benmansour, C. E. Bina, J. Bonatt, W. Bonivento, M. G. Boulay, B. Broerman, J. F. Bueno, P. M. Burghardt, A. Butcher, M. Cadeddu, B. Cai, M. Cárdenas-Montes, S. Cavuoti, M. Chen, Y. Chen, B. T. Cleveland, J. M. Corning , et al. (104 additional authors not shown)

Abstract: The DEAP-3600 detector searches for the scintillation signal from dark matter particles scattering on a 3.3 tonne liquid argon target. The largest background comes from $^{39}$Ar beta decays and is suppressed using pulseshape discrimination (PSD). We use two types of PSD algorithm: the prompt-fraction, which considers the fraction of the scintillation signal in a narrow and a wide time window ar… ▽ More The DEAP-3600 detector searches for the scintillation signal from dark matter particles scattering on a 3.3 tonne liquid argon target. The largest background comes from $^{39}$Ar beta decays and is suppressed using pulseshape discrimination (PSD). We use two types of PSD algorithm: the prompt-fraction, which considers the fraction of the scintillation signal in a narrow and a wide time window around the event peak, and the log-likelihood-ratio, which compares the observed photon arrival times to a signal and a background model. We furthermore use two algorithms to determine the number of photons detected at a given time: (1) simply dividing the charge of each PMT pulse by the charge of a single photoelectron, and (2) a likelihood analysis that considers the probability to detect a certain number of photons at a given time, based on a model for the scintillation pulseshape and for afterpulsing in the light detectors. The prompt-fraction performs approximately as well as the log-likelihood-ratio PSD algorithm if the photon detection times are not biased by detector effects. We explain this result using a model for the information carried by scintillation photons as a function of the time when they are detected. △ Less

Submitted 6 April, 2021; v1 submitted 22 March, 2021; originally announced March 2021.

Comments: 14 pages, 9 figures

Journal ref: Eur. Phys. J. C 81, 823 (2021)

Principled Ultrasound Data Augmentation for Classification of Standard Planes

Authors: Lok Hin Lee, Yuan Gao, J. Alison Noble

Abstract: Deep learning models with large learning capacities often overfit to medical imaging datasets. This is because training sets are often relatively small due to the significant time and financial costs incurred in medical data acquisition and labelling. Data augmentation is therefore often used to expand the availability of training data and to increase generalization. However, augmentation strategi… ▽ More Deep learning models with large learning capacities often overfit to medical imaging datasets. This is because training sets are often relatively small due to the significant time and financial costs incurred in medical data acquisition and labelling. Data augmentation is therefore often used to expand the availability of training data and to increase generalization. However, augmentation strategies are often chosen on an ad-hoc basis without justification. In this paper, we present an augmentation policy search method with the goal of improving model classification performance. We include in the augmentation policy search additional transformations that are often used in medical image analysis and evaluate their performance. In addition, we extend the augmentation policy search to include non-linear mixed-example data augmentation strategies. Using these learned policies, we show that principled data augmentation for medical image model training can lead to significant improvements in ultrasound standard plane detection, with an an average F1-score improvement of 7.0% overall over naive data augmentation strategies in ultrasound fetal standard plane classification. We find that the learned representations of ultrasound images are better clustered and defined with optimized data augmentation. △ Less

Submitted 14 March, 2021; originally announced March 2021.

Comments: Information Processing in Medical Imaging (IPMI) 2021

Planar narrow-band-pass filter based on Si resonant metasurface

Authors: Ze Zheng, Andrei Komar, Khosro Zangeneh Kamali, John Noble, Lachlan Whichello, Andrey E. Miroshnichenko, Mohsen Rahmani, Dragomir N. Neshev, Lei Xu

Abstract: Optically resonant dielectric metasurfaces offer unique capability to fully control the wavefront, polarisation, intensity or spectral content of light based on the excitation and interference of different electric and magnetic Mie multipolar resonances. Recent advances of the wide accessibility in the nanofabrication and nanotechnologies have led to a surge in the research field of high-quality f… ▽ More Optically resonant dielectric metasurfaces offer unique capability to fully control the wavefront, polarisation, intensity or spectral content of light based on the excitation and interference of different electric and magnetic Mie multipolar resonances. Recent advances of the wide accessibility in the nanofabrication and nanotechnologies have led to a surge in the research field of high-quality functional optical metasurfaces which can potentially replace or even outperform conventional optical components with ultra-thin feature. Replacing conventional optical filtering components with metasurface technology offers remarkable advantages including lower integration cost, ultra-thin compact configuration, easy combination with multiple functions and less restriction on materials. Here we propose and experimentally demonstrate a planar narrow-band-pass filter based on the optical dielectric metasurface composed of Si nanoresonators in array. A broadband transmission spectral valley (around 200~nm) has been realised by combining electric and magnetic dipole resonances adjacent to each other. Meanwhile, we obtain a narrow-band transmission peak by exciting a high-quality leaky mode which is formed by partially breaking a bound state in the continuum generated by the collective longitudinal magnetic dipole resonances in the metasurface. Our proposed metasurface-based filter shows a stable performance for oblique light incidence with small angles (within 10 deg). Our work imply many potential applications of nanoscale photonics devices such as displays, spectroscopy, etc. △ Less

Submitted 5 January, 2021; v1 submitted 19 December, 2020; originally announced December 2020.

Comments: 6

Journal ref: Journal of Applied Physics 130, 053105 (2021)