Showing 51–100 of 176 results for author: Bai, W

The Extreme Cardiac MRI Analysis Challenge under Respiratory Motion (CMRxMotion)

Authors: Shuo Wang, Chen Qin, Chengyan Wang, Kang Wang, Haoran Wang, Chen Chen, Cheng Ouyang, Xutong Kuang, Chengliang Dai, Yuanhan Mo, Zhang Shi, Chenchen Dai, Xinrong Chen, He Wang, Wenjia Bai

Abstract: The quality of cardiac magnetic resonance (CMR) imaging is susceptible to respiratory motion artifacts. The model robustness of automated segmentation techniques in face of real-world respiratory motion artifacts is unclear. This manuscript describes the design of extreme cardiac MRI analysis challenge under respiratory motion (CMRxMotion Challenge). The challenge aims to establish a public benchm… ▽ More The quality of cardiac magnetic resonance (CMR) imaging is susceptible to respiratory motion artifacts. The model robustness of automated segmentation techniques in face of real-world respiratory motion artifacts is unclear. This manuscript describes the design of extreme cardiac MRI analysis challenge under respiratory motion (CMRxMotion Challenge). The challenge aims to establish a public benchmark dataset to assess the effects of respiratory motion on image quality and examine the robustness of segmentation models. The challenge recruited 40 healthy volunteers to perform different breath-hold behaviors during one imaging visit, obtaining paired cine imaging with artifacts. Radiologists assessed the image quality and annotated the level of respiratory motion artifacts. For those images with diagnostic quality, radiologists further segmented the left ventricle, left ventricle myocardium and right ventricle. The images of training set (20 volunteers) along with the annotations are released to the challenge participants, to develop an automated image quality assessment model (Task 1) and an automated segmentation model (Task 2). The images of validation set (5 volunteers) are released to the challenge participants but the annotations are withheld for online evaluation of submitted predictions. Both the images and annotations of the test set (15 volunteers) were withheld and only used for offline evaluation of submitted containerized dockers. The image quality assessment task is quantitatively evaluated by the Cohen's kappa statistics and the segmentation task is evaluated by the Dice scores and Hausdorff distances. △ Less

Submitted 12 October, 2022; originally announced October 2022.

Comments: Summary of CMRxMotion Challenge Design

Stochastic Constrained DRO with a Complexity Independent of Sample Size

Authors: Qi Qi, Jiameng Lyu, Kung sik Chan, Er Wei Bai, Tianbao Yang

Abstract: Distributionally Robust Optimization (DRO), as a popular method to train robust models against distribution shift between training and test sets, has received tremendous attention in recent years. In this paper, we propose and analyze stochastic algorithms that apply to both non-convex and convex losses for solving Kullback Leibler divergence constrained DRO problem. Compared with existing methods… ▽ More Distributionally Robust Optimization (DRO), as a popular method to train robust models against distribution shift between training and test sets, has received tremendous attention in recent years. In this paper, we propose and analyze stochastic algorithms that apply to both non-convex and convex losses for solving Kullback Leibler divergence constrained DRO problem. Compared with existing methods solving this problem, our stochastic algorithms not only enjoy competitive if not better complexity independent of sample size but also just require a constant batch size at every iteration, which is more practical for broad applications. We establish a nearly optimal complexity bound for finding an $ε$ stationary solution for non-convex losses and an optimal complexity for finding an $ε$ optimal solution for convex losses. Empirical studies demonstrate the effectiveness of the proposed algorithms for solving non-convex and convex constrained DRO problems. △ Less

Submitted 16 August, 2023; v1 submitted 11 October, 2022; originally announced October 2022.

Comments: 37 pages, 16 figures

Journal ref: Transactions on Machine Learning Research, 2023

Cost-effective photonic super-resolution millimeter-wave joint radar-communication system using self-coherent detection

Authors: Wenlin Bai, Peixuan Li, Xihua Zou, Ningyuan Zhong, Wei Pan, Lianshan Yan, Bin Luo

Abstract: A cost-effective millimeter-wave (MMW) joint radar-communication (JRC) system with super resolution is proposed and experimentally demonstrated, using optical heterodyne up-conversion and self-coherent detection down-conversion techniques. The point lies in the designed coherent dual-band constant envelope linear frequency modulation-orthogonal frequency division multiplexing (LFM-OFDM) signal wit… ▽ More A cost-effective millimeter-wave (MMW) joint radar-communication (JRC) system with super resolution is proposed and experimentally demonstrated, using optical heterodyne up-conversion and self-coherent detection down-conversion techniques. The point lies in the designed coherent dual-band constant envelope linear frequency modulation-orthogonal frequency division multiplexing (LFM-OFDM) signal with opposite phase modulation indexes for the JRC system. Then the self-coherent detection, as a simple and low-cost means, is accordingly facilitated for both de-chir** of MMW radar and frequency down-conversion reception of MMW communication, which circumvents the costly high-speed mixers along with MMW local oscillators and more significantly achieves the real-time decomposition of radar and communication information. Furthermore, a super resolution radar range profile is realized through the coherent fusion processing of dual-band JRC signal. In experiments, a dual-band LFM-OFDM JRC signal centered at 54-GHz and 61-GHz is generated. The dual bands are featured with an identical instantaneous bandwidth of 2 GHz and carry an OFDM signal of 1 GBaud, which help to achieve a 6-Gbit/s data rate for communication and a 1.76-cm range resolution for radar. △ Less

Submitted 9 October, 2022; originally announced October 2022.

Mesh-based 3D Motion Tracking in Cardiac MRI using Deep Learning

Authors: Qingjie Meng, Wenjia Bai, Tianrui Liu, Declan P O'Regan, Daniel Rueckert

Abstract: 3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and diagnosis of cardiovascular diseases. Most of the previous methods focus on estimating pixel-/voxel-wise motion fields in the full image space, which ignore the fact that motion estimation is mainly relevant and useful within the object of interest, e.g., the heart. In thi… ▽ More 3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and diagnosis of cardiovascular diseases. Most of the previous methods focus on estimating pixel-/voxel-wise motion fields in the full image space, which ignore the fact that motion estimation is mainly relevant and useful within the object of interest, e.g., the heart. In this work, we model the heart as a 3D geometric mesh and propose a novel deep learning-based method that can estimate 3D motion of the heart mesh from 2D short- and long-axis CMR images. By develo** a differentiable mesh-to-image rasterizer, the method is able to leverage the anatomical shape information from 2D multi-view CMR images for 3D motion estimation. The differentiability of the rasterizer enables us to train the method end-to-end. One advantage of the proposed method is that by tracking the motion of each vertex, it is able to keep the vertex correspondence of 3D meshes between time frames, which is important for quantitative assessment of the cardiac function on the mesh. We evaluate the proposed method on CMR images acquired from the UK Biobank study. Experimental results show that the proposed method quantitatively and qualitatively outperforms both conventional and learning-based cardiac motion tracking methods. △ Less

Submitted 5 September, 2022; originally announced September 2022.

Generative Modelling of the Ageing Heart with Cross-Sectional Imaging and Clinical Data

Authors: Mengyun Qiao, Berke Doga Basaran, Huaqi Qiu, Shuo Wang, Yi Guo, Yuanyuan Wang, Paul M. Matthews, Daniel Rueckert, Wenjia Bai

Abstract: Cardiovascular disease, the leading cause of death globally, is an age-related disease. Understanding the morphological and functional changes of the heart during ageing is a key scientific question, the answer to which will help us define important risk factors of cardiovascular disease and monitor disease progression. In this work, we propose a novel conditional generative model to describe the… ▽ More Cardiovascular disease, the leading cause of death globally, is an age-related disease. Understanding the morphological and functional changes of the heart during ageing is a key scientific question, the answer to which will help us define important risk factors of cardiovascular disease and monitor disease progression. In this work, we propose a novel conditional generative model to describe the changes of 3D anatomy of the heart during ageing. The proposed model is flexible and allows integration of multiple clinical factors (e.g. age, gender) into the generating process. We train the model on a large-scale cross-sectional dataset of cardiac anatomies and evaluate on both cross-sectional and longitudinal datasets. The model demonstrates excellent performance in predicting the longitudinal evolution of the ageing heart and modelling its data distribution. The codes are available at https://github.com/MengyunQ/AgeHeart. △ Less

Submitted 10 October, 2022; v1 submitted 28 August, 2022; originally announced August 2022.

CROLoss: Towards a Customizable Loss for Retrieval Models in Recommender Systems

Authors: Yongxiang Tang, Wentao Bai, Guilin Li, Xialong Liu, Yu Zhang

Abstract: In large-scale recommender systems, retrieving top N relevant candidates accurately with resource constrain is crucial. To evaluate the performance of such retrieval models, Recall@N, the frequency of positive samples being retrieved in the top N ranking, is widely used. However, most of the conventional loss functions for retrieval models such as softmax cross-entropy and pairwise comparison meth… ▽ More In large-scale recommender systems, retrieving top N relevant candidates accurately with resource constrain is crucial. To evaluate the performance of such retrieval models, Recall@N, the frequency of positive samples being retrieved in the top N ranking, is widely used. However, most of the conventional loss functions for retrieval models such as softmax cross-entropy and pairwise comparison methods do not directly optimize Recall@N. Moreover, those conventional loss functions cannot be customized for the specific retrieval size N required by each application and thus may lead to sub-optimal performance. In this paper, we proposed the Customizable Recall@N Optimization Loss (CROLoss), a loss function that can directly optimize the Recall@N metrics and is customizable for different choices of N. This proposed CROLoss formulation defines a more generalized loss function space, covering most of the conventional loss functions as special cases. Furthermore, we develop the Lambda method, a gradient-based method that invites more flexibility and can further boost the system performance. We evaluate the proposed CROLoss on two public benchmark datasets. The results show that CROLoss achieves SOTA results over conventional loss functions for both datasets with various choices of retrieval size N. CROLoss has been deployed onto our online E-commerce advertising platform, where a fourteen-day online A/B test demonstrated that CROLoss contributes to a significant business revenue growth of 4.75%. △ Less

Submitted 9 November, 2022; v1 submitted 4 August, 2022; originally announced August 2022.

Comments: 9 pages, 5 figures. Accepted by by CIKM 2022

Improved post-hoc probability calibration for out-of-domain MRI segmentation

Authors: Cheng Ouyang, Shuo Wang, Chen Chen, Zeju Li, Wenjia Bai, Bernhard Kainz, Daniel Rueckert

Abstract: Probability calibration for deep models is highly desirable in safety-critical applications such as medical imaging. It makes output probabilities of deep networks interpretable, by aligning prediction probability with the actual accuracy in test data. In image segmentation, well-calibrated probabilities allow radiologists to identify regions where model-predicted segmentations are unreliable. The… ▽ More Probability calibration for deep models is highly desirable in safety-critical applications such as medical imaging. It makes output probabilities of deep networks interpretable, by aligning prediction probability with the actual accuracy in test data. In image segmentation, well-calibrated probabilities allow radiologists to identify regions where model-predicted segmentations are unreliable. These unreliable predictions often occur to out-of-domain (OOD) images that are caused by imaging artifacts or unseen imaging protocols. Unfortunately, most previous calibration methods for image segmentation perform sub-optimally on OOD images. To reduce the calibration error when confronted with OOD images, we propose a novel post-hoc calibration model. Our model leverages the pixel susceptibility against perturbations at the local level, and the shape prior information at the global level. The model is tested on cardiac MRI segmentation datasets that contain unseen imaging artifacts and images from an unseen imaging protocol. We demonstrate reduced calibration errors compared with the state-of-the-art calibration algorithm. △ Less

Submitted 14 September, 2022; v1 submitted 4 August, 2022; originally announced August 2022.

Comments: Accepted for UNSURE workshop at MICCAI 2022

Subject-Specific Lesion Generation and Pseudo-Healthy Synthesis for Multiple Sclerosis Brain Images

Authors: Berke Doga Basaran, Mengyun Qiao, Paul M. Matthews, Wenjia Bai

Abstract: Understanding the intensity characteristics of brain lesions is key for defining image-based biomarkers in neurological studies and for predicting disease burden and outcome. In this work, we present a novel foreground-based generative method for modelling the local lesion characteristics that can both generate synthetic lesions on healthy images and synthesize subject-specific pseudo-healthy imag… ▽ More Understanding the intensity characteristics of brain lesions is key for defining image-based biomarkers in neurological studies and for predicting disease burden and outcome. In this work, we present a novel foreground-based generative method for modelling the local lesion characteristics that can both generate synthetic lesions on healthy images and synthesize subject-specific pseudo-healthy images from pathological images. Furthermore, the proposed method can be used as a data augmentation module to generate synthetic images for training brain image segmentation networks. Experiments on multiple sclerosis (MS) brain images acquired on magnetic resonance imaging (MRI) demonstrate that the proposed method can generate highly realistic pseudo-healthy and pseudo-pathological brain images. Data augmentation using the synthetic images improves the brain image segmentation performance compared to traditional data augmentation methods as well as a recent lesion-aware data augmentation technique, CarveMix. The code will be released at https://github.com/dogabasaran/lesion-synthesis. △ Less

Submitted 3 August, 2022; originally announced August 2022.

Comments: 13 pages, 6 figures, 2022 MICCAI SASHIMI (Simulation and Synthesis in Medical Imaging) Workshop paper

MulViMotion: Shape-aware 3D Myocardial Motion Tracking from Multi-View Cardiac MRI

Authors: Qingjie Meng, Chen Qin, Wenjia Bai, Tianrui Liu, Antonio de Marvao, Declan P O'Regan, Daniel Rueckert

Abstract: Recovering the 3D motion of the heart from cine cardiac magnetic resonance (CMR) imaging enables the assessment of regional myocardial function and is important for understanding and analyzing cardiovascular disease. However, 3D cardiac motion estimation is challenging because the acquired cine CMR images are usually 2D slices which limit the accurate estimation of through-plane motion. To address… ▽ More Recovering the 3D motion of the heart from cine cardiac magnetic resonance (CMR) imaging enables the assessment of regional myocardial function and is important for understanding and analyzing cardiovascular disease. However, 3D cardiac motion estimation is challenging because the acquired cine CMR images are usually 2D slices which limit the accurate estimation of through-plane motion. To address this problem, we propose a novel multi-view motion estimation network (MulViMotion), which integrates 2D cine CMR images acquired in short-axis and long-axis planes to learn a consistent 3D motion field of the heart. In the proposed method, a hybrid 2D/3D network is built to generate dense 3D motion fields by learning fused representations from multi-view images. To ensure that the motion estimation is consistent in 3D, a shape regularization module is introduced during training, where shape information from multi-view images is exploited to provide weak supervision to 3D motion estimation. We extensively evaluate the proposed method on 2D cine CMR images from 580 subjects of the UK Biobank study for 3D motion tracking of the left ventricular myocardium. Experimental results show that the proposed method quantitatively and qualitatively outperforms competing methods. △ Less

Submitted 29 July, 2022; originally announced August 2022.

MMOTU: A Multi-Modality Ovarian Tumor Ultrasound Image Dataset for Unsupervised Cross-Domain Semantic Segmentation

Authors: Qi Zhao, Shuchang Lyu, Wenpei Bai, Linghan Cai, Binghao Liu, Guangliang Cheng, Mei**g Wu, Xiubo Sang, Min Yang, Lijiang Chen

Abstract: Ovarian cancer is one of the most harmful gynecological diseases. Detecting ovarian tumors in early stage with computer-aided techniques can efficiently decrease the mortality rate. With the improvement of medical treatment standard, ultrasound images are widely applied in clinical treatment. However, recent notable methods mainly focus on single-modality ultrasound ovarian tumor segmentation or r… ▽ More Ovarian cancer is one of the most harmful gynecological diseases. Detecting ovarian tumors in early stage with computer-aided techniques can efficiently decrease the mortality rate. With the improvement of medical treatment standard, ultrasound images are widely applied in clinical treatment. However, recent notable methods mainly focus on single-modality ultrasound ovarian tumor segmentation or recognition, which means there still lacks researches on exploring the representation capability of multi-modality ultrasound ovarian tumor images. To solve this problem, we propose a Multi-Modality Ovarian Tumor Ultrasound (MMOTU) image dataset containing 1469 2d ultrasound images and 170 contrast enhanced ultrasonography (CEUS) images with pixel-wise and global-wise annotations. Based on MMOTU, we mainly focus on unsupervised cross-domain semantic segmentation task. To solve the domain shift problem, we propose a feature alignment based architecture named Dual-Scheme Domain-Selected Network (DS2Net). Specifically, we first design source-encoder and target-encoder to extract two-style features of source and target images. Then, we propose Domain-Distinct Selected Module (DDSM) and Domain-Universal Selected Module (DUSM) to extract the distinct and universal features in two styles (source-style or target-style). Finally, we fuse these two kinds of features and feed them into the source-decoder and target-decoder to generate final predictions. Extensive comparison experiments and analysis on MMOTU image dataset show that DS2Net can boost the segmentation performance for bidirectional cross-domain adaptation of 2d ultrasound images and CEUS images. Our proposed dataset and code are all available at https://github.com/cv516Buaa/MMOTU_DS2Net. △ Less

Submitted 30 November, 2023; v1 submitted 14 July, 2022; originally announced July 2022.

Comments: code: https://github.com/cv516Buaa/MMOTU_DS2Net paper:18 pages, 12 figures, 11 tables, 16 formulas

Cost-Asymmetric Memory Hard Password Hashing

Authors: Wenjie Bai, Jeremiah Blocki, Mohammad Hassan Ameri

Abstract: In the past decade, billions of user passwords have been exposed to the dangerous threat of offline password cracking attacks. An offline attacker who has stolen the cryptographic hash of a user's password can check as many password guesses as s/he likes limited only by the resources that s/he is willing to invest to crack the password. Pepper and key-stretching are two techniques that have been p… ▽ More In the past decade, billions of user passwords have been exposed to the dangerous threat of offline password cracking attacks. An offline attacker who has stolen the cryptographic hash of a user's password can check as many password guesses as s/he likes limited only by the resources that s/he is willing to invest to crack the password. Pepper and key-stretching are two techniques that have been proposed to deter an offline attacker by increasing guessing costs. Pepper ensures that the cost of rejecting an incorrect password guess is higher than the (expected) cost of verifying a correct password guess. This is useful because most of the offline attacker's guesses will be incorrect. Unfortunately, as we observe the traditional peppering defense seems to be incompatible with modern memory hard key-stretching algorithms such as Argon2 or Scrypt. We introduce an alternative to pepper which we call Cost-Asymmetric Memory Hard Password Authentication which benefits from the same cost-asymmetry as the classical peppering defense i.e., the cost of rejecting an incorrect password guess is larger than the expected cost to authenticate a correct password guess. When configured properly we prove that our mechanism can only reduce the percentage of user passwords that are cracked by a rational offline attacker whose goal is to maximize (expected) profit i.e., the total value of cracked passwords minus the total guessing costs. We evaluate the effectiveness of our mechanism on empirical password datasets against a rational offline attacker. Our empirical analysis shows that our mechanism can reduce significantly the percentage of user passwords that are cracked by a rational attacker by up to 10%. △ Less

Submitted 26 June, 2022; originally announced June 2022.

The Gender Pay Gap in China: Insights from a Discrimination Perspective

Authors: Wei Bai, Yan-Li Lee, **gyi Liao, Lusi Wu, Mei Xie, Tao Zhou

Abstract: Equal pay is an essential component of gender equality, one of the Sustainable Development Goals of the United Nations. Using resume data of over ten million Chinese online job seekers in 2015, we study the current gender pay gap in China. The results show that on average women only earned 71.57\% of what men earned in China. The gender pay gap exists across all age groups and educational levels.… ▽ More Equal pay is an essential component of gender equality, one of the Sustainable Development Goals of the United Nations. Using resume data of over ten million Chinese online job seekers in 2015, we study the current gender pay gap in China. The results show that on average women only earned 71.57\% of what men earned in China. The gender pay gap exists across all age groups and educational levels. Contrary to the commonly held view that developments in education, economy, and a more open culture would reduce the gender pay gap, the fusion analysis of resume data and socio-economic data presents that they have not helped reach the gender pay equality in China. China seems to be stuck in a place where traditional methods cannot make further progress. Our analysis further shows that 81.47\% of the variance in the gender pay gap can be potentially attributed to discrimination. In particular, compared with the unmarried, both the gender pay gap itself and proportion potentially attributed to discrimination of the married are larger, indicating that married women suffer greater inequality and more discrimination than unmarried ones. Taken together, we suggest that more research attention should be paid to the effect of discrimination in understanding gender pay gap based on the family constraint theory. We also suggest the Chinese government to increase investment in family-supportive policies and grants in addition to female education. △ Less

Submitted 18 June, 2022; originally announced June 2022.

Comments: 10 pages and 4 figures

Generative Myocardial Motion Tracking via Latent Space Exploration with Biomechanics-informed Prior

Authors: Chen Qin, Shuo Wang, Chen Chen, Wenjia Bai, Daniel Rueckert

Abstract: Myocardial motion and deformation are rich descriptors that characterize cardiac function. Image registration, as the most commonly used technique for myocardial motion tracking, is an ill-posed inverse problem which often requires prior assumptions on the solution space. In contrast to most existing approaches which impose explicit generic regularization such as smoothness, in this work we propos… ▽ More Myocardial motion and deformation are rich descriptors that characterize cardiac function. Image registration, as the most commonly used technique for myocardial motion tracking, is an ill-posed inverse problem which often requires prior assumptions on the solution space. In contrast to most existing approaches which impose explicit generic regularization such as smoothness, in this work we propose a novel method that can implicitly learn an application-specific biomechanics-informed prior and embed it into a neural network-parameterized transformation model. Particularly, the proposed method leverages a variational autoencoder-based generative model to learn a manifold for biomechanically plausible deformations. The motion tracking then can be performed via traversing the learnt manifold to search for the optimal transformations while considering the sequence information. The proposed method is validated on three public cardiac cine MRI datasets with comprehensive evaluations. The results demonstrate that the proposed method can outperform other approaches, yielding higher motion tracking accuracy with reasonable volume preservation and better generalizability to varying data distributions. It also enables better estimates of myocardial strains, which indicates the potential of the method in characterizing spatiotemporal signatures for understanding cardiovascular diseases. △ Less

Submitted 8 June, 2022; originally announced June 2022.

Comments: Under review

MaxStyle: Adversarial Style Composition for Robust Medical Image Segmentation

Authors: Chen Chen, Zeju Li, Cheng Ouyang, Matt Sinclair, Wenjia Bai, Daniel Rueckert

Abstract: Convolutional neural networks (CNNs) have achieved remarkable segmentation accuracy on benchmark datasets where training and test sets are from the same domain, yet their performance can degrade significantly on unseen domains, which hinders the deployment of CNNs in many clinical scenarios. Most existing works improve model out-of-domain (OOD) robustness by collecting multi-domain datasets for tr… ▽ More Convolutional neural networks (CNNs) have achieved remarkable segmentation accuracy on benchmark datasets where training and test sets are from the same domain, yet their performance can degrade significantly on unseen domains, which hinders the deployment of CNNs in many clinical scenarios. Most existing works improve model out-of-domain (OOD) robustness by collecting multi-domain datasets for training, which is expensive and may not always be feasible due to privacy and logistical issues. In this work, we focus on improving model robustness using a single-domain dataset only. We propose a novel data augmentation framework called MaxStyle, which maximizes the effectiveness of style augmentation for model OOD performance. It attaches an auxiliary style-augmented image decoder to a segmentation network for robust feature learning and data augmentation. Importantly, MaxStyle augments data with improved image style diversity and hardness, by expanding the style space with noise and searching for the worst-case style composition of latent features via adversarial training. With extensive experiments on multiple public cardiac and prostate MR datasets, we demonstrate that MaxStyle leads to significantly improved out-of-distribution robustness against unseen corruptions as well as common distribution shifts across multiple, different, unseen sites and unknown image sequences under both low- and high-training data settings. The code can be found at https://github.com/cherise215/MaxStyle. △ Less

Submitted 19 June, 2022; v1 submitted 2 June, 2022; originally announced June 2022.

Comments: Early accepted by MICCAI 2022 (Camera-ready version)

Suggestive Annotation of Brain MR Images with Gradient-guided Sampling

Authors: Chengliang Dai, Shuo Wang, Yuanhan Mo, Elsa Angelini, Yike Guo, Wenjia Bai

Abstract: Machine learning has been widely adopted for medical image analysis in recent years given its promising performance in image segmentation and classification tasks. The success of machine learning, in particular supervised learning, depends on the availability of manually annotated datasets. For medical imaging applications, such annotated datasets are not easy to acquire, it takes a substantial am… ▽ More Machine learning has been widely adopted for medical image analysis in recent years given its promising performance in image segmentation and classification tasks. The success of machine learning, in particular supervised learning, depends on the availability of manually annotated datasets. For medical imaging applications, such annotated datasets are not easy to acquire, it takes a substantial amount of time and resource to curate an annotated medical image set. In this paper, we propose an efficient annotation framework for brain MR images that can suggest informative sample images for human experts to annotate. We evaluate the framework on two different brain image analysis tasks, namely brain tumour segmentation and whole brain segmentation. Experiments show that for brain tumour segmentation task on the BraTS 2019 dataset, training a segmentation model with only 7% suggestively annotated image samples can achieve a performance comparable to that of training on the full dataset. For whole brain segmentation on the MALC dataset, training with 42% suggestively annotated image samples can achieve a comparable performance to training on the full dataset. The proposed framework demonstrates a promising way to save manual annotation cost and improve data efficiency in medical imaging applications. △ Less

Submitted 2 June, 2022; originally announced June 2022.

Comments: Manuscript accepted by MedIA

Memory-efficient Segmentation of High-resolution Volumetric MicroCT Images

Authors: Yuan Wang, Laura Blackie, Irene Miguel-Aliaga, Wenjia Bai

Abstract: In recent years, 3D convolutional neural networks have become the dominant approach for volumetric medical image segmentation. However, compared to their 2D counterparts, 3D networks introduce substantially more training parameters and higher requirement for the GPU memory. This has become a major limiting factor for designing and training 3D networks for high-resolution volumetric images. In this… ▽ More In recent years, 3D convolutional neural networks have become the dominant approach for volumetric medical image segmentation. However, compared to their 2D counterparts, 3D networks introduce substantially more training parameters and higher requirement for the GPU memory. This has become a major limiting factor for designing and training 3D networks for high-resolution volumetric images. In this work, we propose a novel memory-efficient network architecture for 3D high-resolution image segmentation. The network incorporates both global and local features via a two-stage U-net-based cascaded framework and at the first stage, a memory-efficient U-net (meU-net) is developed. The features learnt at the two stages are connected via post-concatenation, which further improves the information flow. The proposed segmentation method is evaluated on an ultra high-resolution microCT dataset with typically 250 million voxels per volume. Experiments show that it outperforms state-of-the-art 3D segmentation methods in terms of both segmentation accuracy and memory efficiency. △ Less

Submitted 31 May, 2022; originally announced May 2022.

Comments: The paper is accepted to MIDL 2022. The codes are available at https://github.com/Virgil3706/Memory-efficient-U-net

Mass Testing and Characterization of 20-inch PMTs for JUNO

Authors: Angel Abusleme, Thomas Adam, Shakeel Ahmad, Rizwan Ahmed, Sebastiano Aiello, Muhammad Akram, Abid Aleem, Tsagkarakis Alexandros, Fengpeng An, Qi An, Giuseppe Andronico, Nikolay Anfimov, Vito Antonelli, Tatiana Antoshkina, Burin Asavapibhop, Joao Pedro Athayde Marcondes de Andre, Didier Auguste, Weidong Bai, Nikita Balashov, Wander Baldini, Andrea Barresi, Davide Basilico, Eric Baussan, Marco Bellato, Antonio Bergnoli , et al. (541 additional authors not shown)

Abstract: Main goal of the JUNO experiment is to determine the neutrino mass ordering using a 20kt liquid-scintillator detector. Its key feature is an excellent energy resolution of at least 3 % at 1 MeV, for which its instruments need to meet a certain quality and thus have to be fully characterized. More than 20,000 20-inch PMTs have been received and assessed by JUNO after a detailed testing program whic… ▽ More Main goal of the JUNO experiment is to determine the neutrino mass ordering using a 20kt liquid-scintillator detector. Its key feature is an excellent energy resolution of at least 3 % at 1 MeV, for which its instruments need to meet a certain quality and thus have to be fully characterized. More than 20,000 20-inch PMTs have been received and assessed by JUNO after a detailed testing program which began in 2017 and elapsed for about four years. Based on this mass characterization and a set of specific requirements, a good quality of all accepted PMTs could be ascertained. This paper presents the performed testing procedure with the designed testing systems as well as the statistical characteristics of all 20-inch PMTs intended to be used in the JUNO experiment, covering more than fifteen performance parameters including the photocathode uniformity. This constitutes the largest sample of 20-inch PMTs ever produced and studied in detail to date, i.e. 15,000 of the newly developed 20-inch MCP-PMTs from Northern Night Vision Technology Co. (NNVT) and 5,000 of dynode PMTs from Hamamatsu Photonics K. K.(HPK). △ Less

Submitted 17 September, 2022; v1 submitted 17 May, 2022; originally announced May 2022.

Sub-percent Precision Measurement of Neutrino Oscillation Parameters with JUNO

Authors: JUNO Collaboration, Angel Abusleme, Thomas Adam, Shakeel Ahmad, Rizwan Ahmed, Sebastiano Aiello, Muhammad Akram, Abid Aleem, Tsagkarakis Alexandros, Fengpeng An, Qi An, Giuseppe Andronico, Nikolay Anfimov, Vito Antonelli, Tatiana Antoshkina, Burin Asavapibhop, João Pedro Athayde Marcondes de André, Didier Auguste, Weidong Bai, Nikita Balashov, Wander Baldini, Andrea Barresi, Davide Basilico, Eric Baussan, Marco Bellato , et al. (581 additional authors not shown)

Abstract: JUNO is a multi-purpose neutrino observatory under construction in the south of China. This publication presents new sensitivity estimates for the measurement of the $Δm^2_{31}$, $Δm^2_{21}$, $\sin^2 θ_{12}$, and $\sin^2 θ_{13}$ oscillation parameters using reactor antineutrinos, which is one of the primary physics goals of the experiment. The sensitivities are obtained using the best knowledge av… ▽ More JUNO is a multi-purpose neutrino observatory under construction in the south of China. This publication presents new sensitivity estimates for the measurement of the $Δm^2_{31}$, $Δm^2_{21}$, $\sin^2 θ_{12}$, and $\sin^2 θ_{13}$ oscillation parameters using reactor antineutrinos, which is one of the primary physics goals of the experiment. The sensitivities are obtained using the best knowledge available to date on the location and overburden of the experimental site, the nuclear reactors in the surrounding area and beyond, the detector response uncertainties, and the reactor antineutrino spectral shape constraints expected from the TAO satellite detector. It is found that the $Δm^2_{31}$, $Δm^2_{21}$, and $\sin^2 θ_{12}$ oscillation parameters will be determined to better than 0.5% precision in six years of data collection, which represents approximately an order of magnitude improvement over existing constraints. △ Less

Submitted 27 April, 2022; originally announced April 2022.

Comments: 29 pages, 10 figures, submitted to Chinese Physics C

Electromagnetic moments of scandium isotopes and $N=28$ isotones in the distinctive $0f_{7/2}$ orbit

Authors: S. W. Bai, Á. Koszorús, B. S. Hu, X. F. Yang, J. Billowes, C. L. Binnersley, M. L. Bissell, K. Blaum, P. Campbell, B. Cheal, T. E. Cocolios, R. P. de Groote, C. S. Devlin, K. T. Flanagan, R. F. Garcia Ruiz, H. Heylen, J. D. Holt, A. Kanellakopoulos, J. Krämer, V. Lagaki, B. Maaß, S. Malbrunot-Ettenauer, T. Miyagi, R. Neugart, G. Neyens , et al. (9 additional authors not shown)

Abstract: The electric quadrupole moment of $^{49}$Sc was measured by collinear laser spectroscopy at CERN-ISOLDE to be $Q_{\rm s}=-0.159(8)$ $e$b, and a nearly tenfold improvement in precision was reached for the electromagnetic moments of $^{47,49}$Sc. The single-particle behavior and nucleon-nucleon correlations are investigated with the electromagnetic moments of $Z=21$ isotopes and $N=28$ isotones as v… ▽ More The electric quadrupole moment of $^{49}$Sc was measured by collinear laser spectroscopy at CERN-ISOLDE to be $Q_{\rm s}=-0.159(8)$ $e$b, and a nearly tenfold improvement in precision was reached for the electromagnetic moments of $^{47,49}$Sc. The single-particle behavior and nucleon-nucleon correlations are investigated with the electromagnetic moments of $Z=21$ isotopes and $N=28$ isotones as valence neutrons and protons fill the distinctive $0f_{7/2}$ orbit, respectively, located between magic numbers, 20 and 28. The experimental data are interpreted with shell-model calculations using an effective interaction, and ab-initio valence-space in-medium similarity renormalization group calculations based on chiral interactions. These results highlight the sensitivity of nuclear electromagnetic moments to different types of nucleon-nucleon correlations, and establish an important benchmark for further developments of theoretical calculations. △ Less

Submitted 22 March, 2022; v1 submitted 17 March, 2022; originally announced March 2022.

Comments: Accepted by Physics Letters B (2022)

Construction and commissioning of the collinear laser spectroscopy system at BRIF

Authors: S. J. Wang, X. F. Yang, S. W. Bai, Y. C. Liu, P. Zhang, Y. S. Liu, H. R. Hu, H. W. Li, B. Tang, B. Q. Cui, C. Y. He, X. Ma, Q. T. Li, J. H. Chen, K. Ma, L. S. Yang, Z. Y. Hu, W. L. Pu, Y. Chen, Y. F. Guo, Z. Y. Du, Z. Yan, F. L. Liu, H. R. Wang, G. Q. Yang , et al. (2 additional authors not shown)

Abstract: We have constructed a collinear laser spectroscopy (CLS) system installed at the Bei**g Radioactive Ion-beam Facility (BRIF), aiming to investigate the nuclear properties of unstable nuclei. The first on-line commissioning experiment of this system was performed using the continuous stable ($^{39}$K) and unstable ($^{38}$K) ion beams produced by im**ing a 100-MeV proton beam on a CaO target. Hy… ▽ More We have constructed a collinear laser spectroscopy (CLS) system installed at the Bei**g Radioactive Ion-beam Facility (BRIF), aiming to investigate the nuclear properties of unstable nuclei. The first on-line commissioning experiment of this system was performed using the continuous stable ($^{39}$K) and unstable ($^{38}$K) ion beams produced by im**ing a 100-MeV proton beam on a CaO target. Hyperfine structure spectra of these two isotopes are reasonably reproduced, and the extracted magnetic dipole hyperfine parameters and isotope shift agree with the literature values. The on-line experiment demonstrates the overall functioning of this CLS system, opening new opportunities for laser spectroscopy measurement of unstable isotopes at BRIF and other radioactive ion beam facilities in China. △ Less

Submitted 11 March, 2022; originally announced March 2022.

Prompt electron and tau neutrinos and antineutrinos in the forward region at the LHC

Authors: Weidong Bai, Milind Vaman Diwan, Maria Vittoria Garzelli, Yu Seon Jeong, Karan Kumar, Mary Hall Reno

Abstract: Neutrino fluxes at high rapidity and at high energy are sensitive to QCD dynamics of heavy-flavor production in kinematic regions where measurements have not yet been made. The FASER$ν$ and SND@LHC experiments scheduled for Run 3 at the LHC and the proposed Forward Physics Facility with a suite of experiments during the High-Luminosity LHC phase will probe neutrinos at high pseudorapidity. This sh… ▽ More Neutrino fluxes at high rapidity and at high energy are sensitive to QCD dynamics of heavy-flavor production in kinematic regions where measurements have not yet been made. The FASER$ν$ and SND@LHC experiments scheduled for Run 3 at the LHC and the proposed Forward Physics Facility with a suite of experiments during the High-Luminosity LHC phase will probe neutrinos at high pseudorapidity. This short paper reports on recent evaluations of the prompt $ν_τ+\barν_τ$ and $ν_e+\barν_e$ double-differential cross sections in $pp$ collisions at the Large Hadron Collider from the production and decays of $D_s^\pm$ and $D^\pm$, respectively. For $\sqrt{s}=14$ TeV, the double-differential neutrino energy and pseudorapidity distributions are evaluated at NLO QCD. Data tables with these predictions are presented. Future work needed to refine predictions of neutrino and antineutrino fluxes in the forward region at the LHC is discussed. △ Less

Submitted 15 March, 2022; v1 submitted 14 March, 2022; originally announced March 2022.

Comments: 10 pages, 3 figures, contribution to Snowmass 2021, updated to include ancillary files

The Forward Physics Facility at the High-Luminosity LHC

Authors: Jonathan L. Feng, Felix Kling, Mary Hall Reno, Juan Rojo, Dennis Soldin, Luis A. Anchordoqui, Jamie Boyd, Ahmed Ismail, Lucian Harland-Lang, Kevin J. Kelly, Vishvas Pandey, Sebastian Trojanowski, Yu-Dai Tsai, Jean-Marco Alameddine, Takeshi Araki, Akitaka Ariga, Tomoko Ariga, Kento Asai, Alessandro Bacchetta, Kincso Balazs, Alan J. Barr, Michele Battistin, Jianming Bian, Caterina Bertone, Weidong Bai , et al. (211 additional authors not shown)

Abstract: High energy collisions at the High-Luminosity Large Hadron Collider (LHC) produce a large number of particles along the beam collision axis, outside of the acceptance of existing LHC experiments. The proposed Forward Physics Facility (FPF), to be located several hundred meters from the ATLAS interaction point and shielded by concrete and rock, will host a suite of experiments to probe Standard Mod… ▽ More High energy collisions at the High-Luminosity Large Hadron Collider (LHC) produce a large number of particles along the beam collision axis, outside of the acceptance of existing LHC experiments. The proposed Forward Physics Facility (FPF), to be located several hundred meters from the ATLAS interaction point and shielded by concrete and rock, will host a suite of experiments to probe Standard Model (SM) processes and search for physics beyond the Standard Model (BSM). In this report, we review the status of the civil engineering plans and the experiments to explore the diverse physics signals that can be uniquely probed in the forward region. FPF experiments will be sensitive to a broad range of BSM physics through searches for new particle scattering or decay signatures and deviations from SM expectations in high statistics analyses with TeV neutrinos in this low-background environment. High statistics neutrino detection will also provide valuable data for fundamental topics in perturbative and non-perturbative QCD and in weak interactions. Experiments at the FPF will enable synergies between forward particle production at the LHC and astroparticle physics to be exploited. We report here on these physics topics, on infrastructure, detector, and simulation studies, and on future directions to realize the FPF's physics potential. △ Less

Submitted 9 March, 2022; originally announced March 2022.

Comments: 429 pages, contribution to Snowmass 2021

Report number: UCI-TR-2022-01, CERN-PBC-Notes-2022-001, FERMILAB-PUB-22-094-ND-SCD-T, INT-PUB-22-006, BONN-TH-2022-04

Observation of the $π^2σ^2$-bond linear-chain molecular structure in $^{16}$C

Authors: J. X. Han, Y. Liu, Y. L. Ye, J. L. Lou, X. F. Yang, T. Baba, M. Kimura, B. Yang, Z. H. Li, Q. T. Li, J. Y. Xu, Y. C. Ge, H. Hua, Z. H. Yang, J. S. Wang, Y. Y. Yang, P. Ma, Z. Bai, Q. Hu, W. Liu, K. Ma, L. C. Tao, Y. Jiang, L. Y. Hu, H. L. Zang , et al. (15 additional authors not shown)

Abstract: Measurements of the $^2$H($^{16}$C,$^{16}$C$^{*}$$\rightarrow^4$He+$^{12}$Be or $^6$He+$^{10}$Be)$^2$H inelastic excitation and cluster-decay reactions have been carried out at a beam energy of about 23.5 MeV/u. A specially designed detection system, including one multi-layer silicon-strip telescope at around zero degrees, has allowed the high-efficiency three-fold coincident detection and therefo… ▽ More Measurements of the $^2$H($^{16}$C,$^{16}$C$^{*}$$\rightarrow^4$He+$^{12}$Be or $^6$He+$^{10}$Be)$^2$H inelastic excitation and cluster-decay reactions have been carried out at a beam energy of about 23.5 MeV/u. A specially designed detection system, including one multi-layer silicon-strip telescope at around zero degrees, has allowed the high-efficiency three-fold coincident detection and therefore the event-by-event determination of the energy of the unstable nucleus beam. The decay paths from the $^{16}$C resonances to various states of the final $^{10}$Be or $^{12}$Be nucleus are recognized thanks to the well-resolved $Q$-value spectra. The reconstructed resonances at 16.5(1), 17.3(2), 19.4(1) and 21.6(2) MeV are assigned as the $0^+$, $2^+$, $4^+$ and $6^+$ members, respectively, of the positive-parity $(3/2_π^-)^2(1/2_σ^-)^2$-bond linear-chain molecular band in $^{16}$C, based on the angular correlation analysis for the 16.5 MeV state and the excellent agreement of decay patterns between the measurements and theoretical predictions. Moreover, another intriguing high-lying state was observed at 27.2(1) MeV which decays almost exclusively to the $\sim$6 MeV states of $^{10}$Be, in line with the newly predicted pure $σ$-bond linear-chain configuration. △ Less

Submitted 11 February, 2022; originally announced February 2022.

Comments: 13 pages, 10 figures

Jum** to male-dominated occupations: A novel way to reduce gender wage gap for Chinese women

Authors: Wei Bai, Zhongtao Yue, Tao Zhou

Abstract: Occupational segregation is widely considered as one major reason leading to the gender discrimination in labor market. Using large-scale Chinese resume data of online job seekers, we uncover an interesting phenomenon that occupations with higher proportion of men have smaller gender wage gap measured by the female-male ratio on wage. We further show that the severity of occupational segregation i… ▽ More Occupational segregation is widely considered as one major reason leading to the gender discrimination in labor market. Using large-scale Chinese resume data of online job seekers, we uncover an interesting phenomenon that occupations with higher proportion of men have smaller gender wage gap measured by the female-male ratio on wage. We further show that the severity of occupational segregation in China is low both overall and regionally, and the inter-occupational discrimination is much smaller than the intra-occupational discrimination. That is to say, Chinese women do not face large barriers when changing their occupations. Accordingly, we suggest Chineses women a new way to narrow the gender wage gap: to join male-dominated occupations. Meanwhile, it is worth noticing that although the gender wage gap is smaller in male-dominated occupations, it does not mean that the gender discrimination is smaller there. △ Less

Submitted 8 January, 2022; originally announced January 2022.

Parton distribution function uncertainties in theoretical predictions for far-forward tau neutrinos at the Large Hadron Collider

Authors: Weidong Bai, Milind Diwan, Maria Vittoria Garzelli, Yu Seon Jeong, Fnu Karan Kumar, Mary Hall Reno

Abstract: New experiments to measure neutrinos in the far-forward region at the Large Hadron Collider (LHC) are under design or already in preparation. Two of them, FASER$ν$ and SND@LHC, are expected to be active during Run 3 and have the potential to detect neutrinos that come from high-energy collisions in one of the LHC interaction points, extracted along the direction tangent to the beam line. Tau neutr… ▽ More New experiments to measure neutrinos in the far-forward region at the Large Hadron Collider (LHC) are under design or already in preparation. Two of them, FASER$ν$ and SND@LHC, are expected to be active during Run 3 and have the potential to detect neutrinos that come from high-energy collisions in one of the LHC interaction points, extracted along the direction tangent to the beam line. Tau neutrinos and antineutrinos come predominantly from $D_s^\pm$ production in $pp$ collisions, followed by the leptonic decay of these mesons. Neutrino pseudorapidities in the range of $η>6.9$ and $η>8.9$ are relevant to these future experiments. At such pseudorapidities at high energies, theoretical predictions for the flux of tau neutrinos rely on parton distribution functions (PDFs) in a combination of very small and large parton$-x$ values. We evaluate PDF uncertainties in a next-to-leading order (NLO) QCD calculation of the flux of $ν_τ$ + $\barν_τ$ produced by $D_s^\pm$ decay in the far forward region at the LHC. The theoretical uncertainty associated with the 40 PDF sets of the PROSA19 group amounts to $\pm (20-30)$\% for the ($ν_τ$ + $\barν_τ$) number of charged-current (CC) events. Scale uncertainties are much larger, resulting in a range of CC event predictions from $\sim 70\%$ lower to $\sim 90\%$ higher than the central prediction. A comparison of the predictions with those obtained using as input the central PDFs from the 3-flavour NLO PDF sets of the CT14, ABMP16 and NNPDF3.1 collaborations show that far-forward neutrino energy distributions vary by as much as a factor of $\sim 2-4$ relative to the PROSA19 predictions at TeV neutrino energies. The Forward Physics Facility in the high luminosity LHC era will provide data capable of constraining NLO QCD evaluations with these PDF sets. △ Less

Submitted 1 July, 2022; v1 submitted 21 December, 2021; originally announced December 2021.

Comments: 61 pages, 23 figures, 12 tables

Journal ref: JHEP 06 (2022) 148

QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Results

Authors: Raghav Mehta, Angelos Filos, Ujjwal Baid, Chiharu Sako, Richard McKinley, Michael Rebsamen, Katrin Datwyler, Raphael Meier, Piotr Radojewski, Gowtham Krishnan Murugesan, Sahil Nalawade, Chandan Ganesh, Ben Wagner, Fang F. Yu, Baowei Fei, Ananth J. Madhuranthakam, Joseph A. Maldjian, Laura Daza, Catalina Gomez, Pablo Arbelaez, Chengliang Dai, Shuo Wang, Hadrien Reynaud, Yuan-han Mo, Elsa Angelini , et al. (67 additional authors not shown)

Abstract: Deep learning (DL) models have provided state-of-the-art performance in various medical imaging benchmarking challenges, including the Brain Tumor Segmentation (BraTS) challenges. However, the task of focal pathology multi-compartment segmentation (e.g., tumor and lesion sub-regions) is particularly challenging, and potential errors hinder translating DL models into clinical workflows. Quantifying… ▽ More Deep learning (DL) models have provided state-of-the-art performance in various medical imaging benchmarking challenges, including the Brain Tumor Segmentation (BraTS) challenges. However, the task of focal pathology multi-compartment segmentation (e.g., tumor and lesion sub-regions) is particularly challenging, and potential errors hinder translating DL models into clinical workflows. Quantifying the reliability of DL model predictions in the form of uncertainties could enable clinical review of the most uncertain regions, thereby building trust and paving the way toward clinical translation. Several uncertainty estimation methods have recently been introduced for DL medical image segmentation tasks. Develo** scores to evaluate and compare the performance of uncertainty measures will assist the end-user in making more informed decisions. In this study, we explore and evaluate a score developed during the BraTS 2019 and BraTS 2020 task on uncertainty quantification (QU-BraTS) and designed to assess and rank uncertainty estimates for brain tumor multi-compartment segmentation. This score (1) rewards uncertainty estimates that produce high confidence in correct assertions and those that assign low confidence levels at incorrect assertions, and (2) penalizes uncertainty measures that lead to a higher percentage of under-confident correct assertions. We further benchmark the segmentation uncertainties generated by 14 independent participating teams of QU-BraTS 2020, all of which also participated in the main BraTS segmentation task. Overall, our findings confirm the importance and complementary value that uncertainty estimates provide to segmentation algorithms, highlighting the need for uncertainty quantification in medical image analyses. Finally, in favor of transparency and reproducibility, our evaluation code is made publicly available at: https://github.com/RagMeh11/QU-BraTS. △ Less

Submitted 23 August, 2022; v1 submitted 19 December, 2021; originally announced December 2021.

Comments: Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA): https://www.melba-journal.org/papers/2022:026.html

Journal ref: Machine.Learning.for.Biomedical.Imaging. 1 (2022)

Causality-inspired Single-source Domain Generalization for Medical Image Segmentation

Authors: Cheng Ouyang, Chen Chen, Surui Li, Zeju Li, Chen Qin, Wenjia Bai, Daniel Rueckert

Abstract: Deep learning models usually suffer from domain shift issues, where models trained on one source domain do not generalize well to other unseen domains. In this work, we investigate the single-source domain generalization problem: training a deep network that is robust to unseen domains, under the condition that training data is only available from one source domain, which is common in medical imag… ▽ More Deep learning models usually suffer from domain shift issues, where models trained on one source domain do not generalize well to other unseen domains. In this work, we investigate the single-source domain generalization problem: training a deep network that is robust to unseen domains, under the condition that training data is only available from one source domain, which is common in medical imaging applications. We tackle this problem in the context of cross-domain medical image segmentation. Under this scenario, domain shifts are mainly caused by different acquisition processes. We propose a simple causality-inspired data augmentation approach to expose a segmentation model to synthesized domain-shifted training examples. Specifically, 1) to make the deep model robust to discrepancies in image intensities and textures, we employ a family of randomly-weighted shallow networks. They augment training images using diverse appearance transformations. 2) Further we show that spurious correlations among objects in an image are detrimental to domain robustness. These correlations might be taken by the network as domain-specific clues for making predictions, and they may break on unseen domains. We remove these spurious correlations via causal intervention. This is achieved by resampling the appearances of potentially correlated objects independently. The proposed approach is validated on three cross-domain segmentation tasks: cross-modality (CT-MRI) abdominal image segmentation, cross-sequence (bSSFP-LGE) cardiac MRI segmentation, and cross-center prostate MRI segmentation. The proposed approach yields consistent performance gains compared with competitive methods when tested on unseen domains. △ Less

Submitted 21 April, 2023; v1 submitted 24 November, 2021; originally announced November 2021.

Comments: This is an early, non-peer-reviewed version. For the final peer-reviewed full version that has been substantially revised, please find: https://ieeexplore.ieee.org/document/9961940. Please find the code at https://github.com/cheng-01037/Causality-Medical-Image-Domain-Generalization

DeepMCAT: Large-Scale Deep Clustering for Medical Image Categorization

Authors: Turkay Kart, Wenjia Bai, Ben Glocker, Daniel Rueckert

Abstract: In recent years, the research landscape of machine learning in medical imaging has changed drastically from supervised to semi-, weakly- or unsupervised methods. This is mainly due to the fact that ground-truth labels are time-consuming and expensive to obtain manually. Generating labels from patient metadata might be feasible but it suffers from user-originated errors which introduce biases. In t… ▽ More In recent years, the research landscape of machine learning in medical imaging has changed drastically from supervised to semi-, weakly- or unsupervised methods. This is mainly due to the fact that ground-truth labels are time-consuming and expensive to obtain manually. Generating labels from patient metadata might be feasible but it suffers from user-originated errors which introduce biases. In this work, we propose an unsupervised approach for automatically clustering and categorizing large-scale medical image datasets, with a focus on cardiac MR images, and without using any labels. We investigated the end-to-end training using both class-balanced and imbalanced large-scale datasets. Our method was able to create clusters with high purity and achieved over 0.99 cluster purity on these datasets. The results demonstrate the potential of the proposed method for categorizing unstructured large medical databases, such as organizing clinical PACS systems in hospitals. △ Less

Submitted 30 September, 2021; originally announced October 2021.

Comments: Accepted for the DALI workshop at MICCAI 2021 (full oral)

Multiple-Pilot Collaboration for Advanced Remote Intervention using Reinforcement Learning

Authors: Ziwei Wang, Weibang Bai, Zhang Chen, Bo Xiao, Bin Liang, Eric M. Yeatman

Abstract: The traditional master-slave teleoperation relies on human expertise without correction mechanisms, resulting in excessive physical and mental workloads. To address these issues, a co-pilot-in-the-loop control framework is investigated for cooperative teleoperation. A deep deterministic policy gradient(DDPG) based agent is realised to effectively restore the master operators' intents without prior… ▽ More The traditional master-slave teleoperation relies on human expertise without correction mechanisms, resulting in excessive physical and mental workloads. To address these issues, a co-pilot-in-the-loop control framework is investigated for cooperative teleoperation. A deep deterministic policy gradient(DDPG) based agent is realised to effectively restore the master operators' intents without prior knowledge on time delay. The proposed framework allows for introducing an operator (i.e., co-pilot) to generate commands at the slave side, whose weights are optimally assigned online through DDPG-based arbitration, thereby enhancing the command robustness in the case of possible human operational errors. With the help of interval type-2(IT2) Takagi-Sugeno (T-S) fuzzy identification, force feedback can be reconstructed at the master side without a sense of delay, thus ensuring the telepresence performance in the force-sensor-free scenarios. Two experimental applications validate the effectiveness of the proposed framework. △ Less

Submitted 27 September, 2021; originally announced September 2021.

Comments: 6 pages, 7 figures, accepted by IECON 2021

The Forward Physics Facility: Sites, Experiments, and Physics Potential

Authors: Luis A. Anchordoqui, Akitaka Ariga, Tomoko Ariga, Weidong Bai, Kincso Balazs, Brian Batell, Jamie Boyd, Joseph Bramante, Mario Campanelli, Adrian Carmona, Francesco G. Celiberto, Grigorios Chachamis, Matthew Citron, Giovanni De Lellis, Albert De Roeck, Hans Dembinski, Peter B. Denton, Antonia Di Crecsenzo, Milind V. Diwan, Liam Dougherty, Herbi K. Dreiner, Yong Du, Rikard Enberg, Yasaman Farzan, Jonathan L. Feng , et al. (56 additional authors not shown)

Abstract: The Forward Physics Facility (FPF) is a proposal to create a cavern with the space and infrastructure to support a suite of far-forward experiments at the Large Hadron Collider during the High Luminosity era. Located along the beam collision axis and shielded from the interaction point by at least 100 m of concrete and rock, the FPF will house experiments that will detect particles outside the acc… ▽ More The Forward Physics Facility (FPF) is a proposal to create a cavern with the space and infrastructure to support a suite of far-forward experiments at the Large Hadron Collider during the High Luminosity era. Located along the beam collision axis and shielded from the interaction point by at least 100 m of concrete and rock, the FPF will house experiments that will detect particles outside the acceptance of the existing large LHC experiments and will observe rare and exotic processes in an extremely low-background environment. In this work, we summarize the current status of plans for the FPF, including recent progress in civil engineering in identifying promising sites for the FPF and the experiments currently envisioned to realize the FPF's physics potential. We then review the many Standard Model and new physics topics that will be advanced by the FPF, including searches for long-lived particles, probes of dark matter and dark sectors, high-statistics studies of TeV neutrinos of all three flavors, aspects of perturbative and non-perturbative QCD, and high-energy astroparticle physics. △ Less

Submitted 25 May, 2022; v1 submitted 22 September, 2021; originally announced September 2021.

Comments: revised version, accepted by Physics Reports

Report number: BNL-222142-2021-FORE, CERN-PBC-Notes-2021-025, DESY-21-142, FERMILAB-CONF-21-452-AE-E-ND-PPD-T, KYUSHU-RCAPP-2021-01, LU TP 21-36, PITT-PACC-2118, SMU-HEP-21-10, UCI-TR-2021-22

Journal ref: Phys. Rept. 968 (2022), 1-50

Dual-arm Coordinated Manipulation for Object Twisting with Human Intelligence

Authors: Weibang Bai, Ningshan Zhang, Baoru Huang, Ziwei Wang, Francesco Cursi, Ya-Yen Tsai, Bo Xiao, Eric Yeatman

Abstract: Robotic dual-arm twisting is a common but very challenging task in both industrial production and daily services, as it often requires dexterous collaboration, a large scale of end-effector rotating, and good adaptivity for object manipulation. Meanwhile, safety and efficiency are preliminary concerns for robotic dual-arm coordinated manipulation. Thus, the normally adopted fully automated task ex… ▽ More Robotic dual-arm twisting is a common but very challenging task in both industrial production and daily services, as it often requires dexterous collaboration, a large scale of end-effector rotating, and good adaptivity for object manipulation. Meanwhile, safety and efficiency are preliminary concerns for robotic dual-arm coordinated manipulation. Thus, the normally adopted fully automated task execution approaches based on environmental perception and motion planning techniques are still inadequate and problematic for the arduous twisting tasks. To this end, this paper presents a novel strategy of the dual-arm coordinated control for twisting manipulation based on the combination of optimized motion planning for one arm and real-time telecontrol with human intelligence for the other. The analysis and simulation results showed it can achieve collision and singularity free for dual arms with enhanced dexterity, safety, and efficiency. △ Less

Submitted 26 August, 2021; originally announced August 2021.

Comments: Accepted by IEEE SMC 2021, 7 pages, 7 figures

Denoising ECG by Adaptive Filter with Empirical Mode Decomposition

Authors: Bingze Dai, Wen Bai

Abstract: Electrocardiogram (ECG) signal is an important physiological signal which contains cardiac information and is the basis to diagnosis cardiac related diseases. In this paper, several innovative and efficient methods based on adaptive filter and empirical mode decomposition (EMD) to denoise ECG signal contaminated by various kinds of noise, including baseline wander (BW), power line interference (PL… ▽ More Electrocardiogram (ECG) signal is an important physiological signal which contains cardiac information and is the basis to diagnosis cardiac related diseases. In this paper, several innovative and efficient methods based on adaptive filter and empirical mode decomposition (EMD) to denoise ECG signal contaminated by various kinds of noise, including baseline wander (BW), power line interference (PLI), electrode motion artifact (EM) and muscle artifact (MA), are proposed. We first present a novel method based on EMD and adaptive filter for the removal of BW and PLI in ECG signal. We then extend the method to the complex scenario where four most common noises, PLI, BW, EM and MA are present. The proposed Parallel EMD adaptive filter structure yields the best SNR improvement on the MIT-BIH arrhythmia database, corrupted by the four types of noises. △ Less

Submitted 18 August, 2021; originally announced August 2021.

Comments: 5 pages,10 figures

Enhancing MR Image Segmentation with Realistic Adversarial Data Augmentation

Authors: Chen Chen, Chen Qin, Cheng Ouyang, Zeju Li, Shuo Wang, Huaqi Qiu, Liang Chen, Giacomo Tarroni, Wenjia Bai, Daniel Rueckert

Abstract: The success of neural networks on medical image segmentation tasks typically relies on large labeled datasets for model training. However, acquiring and manually labeling a large medical image set is resource-intensive, expensive, and sometimes impractical due to data sharing and privacy issues. To address this challenge, we propose AdvChain, a generic adversarial data augmentation framework, aimi… ▽ More The success of neural networks on medical image segmentation tasks typically relies on large labeled datasets for model training. However, acquiring and manually labeling a large medical image set is resource-intensive, expensive, and sometimes impractical due to data sharing and privacy issues. To address this challenge, we propose AdvChain, a generic adversarial data augmentation framework, aiming at improving both the diversity and effectiveness of training data for medical image segmentation tasks. AdvChain augments data with dynamic data augmentation, generating randomly chained photo-metric and geometric transformations to resemble realistic yet challenging imaging variations to expand training data. By jointly optimizing the data augmentation model and a segmentation network during training, challenging examples are generated to enhance network generalizability for the downstream task. The proposed adversarial data augmentation does not rely on generative networks and can be used as a plug-in module in general segmentation networks. It is computationally efficient and applicable for both low-shot supervised and semi-supervised learning. We analyze and evaluate the method on two MR image segmentation tasks: cardiac segmentation and prostate segmentation with limited labeled data. Results show that the proposed approach can alleviate the need for labeled data while improving model generalization ability, indicating its practical value in medical imaging applications. △ Less

Submitted 19 June, 2022; v1 submitted 7 August, 2021; originally announced August 2021.

Comments: Under review

Joint Semi-supervised 3D Super-Resolution and Segmentation with Mixed Adversarial Gaussian Domain Adaptation

Authors: Nicolo Savioli, Antonio de Marvao, Wenjia Bai, Shuo Wang, Stuart A. Cook, Calvin W. L. Chin, Daniel Rueckert, Declan P. O'Regan

Abstract: Optimising the analysis of cardiac structure and function requires accurate 3D representations of shape and motion. However, techniques such as cardiac magnetic resonance imaging are conventionally limited to acquiring contiguous cross-sectional slices with low through-plane resolution and potential inter-slice spatial misalignment. Super-resolution in medical imaging aims to increase the resoluti… ▽ More Optimising the analysis of cardiac structure and function requires accurate 3D representations of shape and motion. However, techniques such as cardiac magnetic resonance imaging are conventionally limited to acquiring contiguous cross-sectional slices with low through-plane resolution and potential inter-slice spatial misalignment. Super-resolution in medical imaging aims to increase the resolution of images but is conventionally trained on features from low resolution datasets and does not super-resolve corresponding segmentations. Here we propose a semi-supervised multi-task generative adversarial network (Gemini-GAN) that performs joint super-resolution of the images and their labels using a ground truth of high resolution 3D cines and segmentations, while an unsupervised variational adversarial mixture autoencoder (V-AMA) is used for continuous domain adaptation. Our proposed approach is extensively evaluated on two transnational multi-ethnic populations of 1,331 and 205 adults respectively, delivering an improvement on state of the art methods in terms of Dice index, peak signal to noise ratio, and structural similarity index measure. This framework also exceeds the performance of state of the art generative domain adaptation models on external validation (Dice index 0.81 vs 0.74 for the left ventricle). This demonstrates how joint super-resolution and segmentation, trained on 3D ground-truth data with cross-domain generalization, enables robust precision phenoty** in diverse populations. △ Less

Submitted 16 July, 2021; originally announced July 2021.

Kinematic Parameter Optimization of a Miniaturized Surgical Instrument Based on Dexterous Workspace Determination

Authors: Xin Zhi, Weibang Bai, Eric M. Yeatman

Abstract: Miniaturized instruments are highly needed for robot assisted medical healthcare and treatment, especially for less invasive surgery as it empowers more flexible access to restricted anatomic intervention. But the robotic design is more challenging due to the contradictory needs of miniaturization and the capability of manipulating with a large dexterous workspace. Thus, kinematic parameter optimi… ▽ More Miniaturized instruments are highly needed for robot assisted medical healthcare and treatment, especially for less invasive surgery as it empowers more flexible access to restricted anatomic intervention. But the robotic design is more challenging due to the contradictory needs of miniaturization and the capability of manipulating with a large dexterous workspace. Thus, kinematic parameter optimization is of great significance in this case. To this end, this paper proposes an approach based on dexterous workspace determination for designing a miniaturized tendon-driven surgical instrument under necessary restraints. The workspace determination is achieved by boundary determination and volume estimation with partition and least-squares polynomial fitting methods. The final robotic configuration with optimized kinematic parameters is proved to be eligible with a large enough dexterous workspace and targeted miniature size. △ Less

Submitted 8 July, 2021; originally announced July 2021.

Comments: IEEE ICARM 2021, Best Paper Award Finalist, 7 pages, 10 figures

Joint Motion Correction and Super Resolution for Cardiac Segmentation via Latent Optimisation

Authors: Shuo Wang, Chen Qin, Nicolo Savioli, Chen Chen, Declan O'Regan, Stuart Cook, Yike Guo, Daniel Rueckert, Wenjia Bai

Abstract: In cardiac magnetic resonance (CMR) imaging, a 3D high-resolution segmentation of the heart is essential for detailed description of its anatomical structures. However, due to the limit of acquisition duration and respiratory/cardiac motion, stacks of multi-slice 2D images are acquired in clinical routine. The segmentation of these images provides a low-resolution representation of cardiac anatomy… ▽ More In cardiac magnetic resonance (CMR) imaging, a 3D high-resolution segmentation of the heart is essential for detailed description of its anatomical structures. However, due to the limit of acquisition duration and respiratory/cardiac motion, stacks of multi-slice 2D images are acquired in clinical routine. The segmentation of these images provides a low-resolution representation of cardiac anatomy, which may contain artefacts caused by motion. Here we propose a novel latent optimisation framework that jointly performs motion correction and super resolution for cardiac image segmentations. Given a low-resolution segmentation as input, the framework accounts for inter-slice motion in cardiac MR imaging and super-resolves the input into a high-resolution segmentation consistent with input. A multi-view loss is incorporated to leverage information from both short-axis view and long-axis view of cardiac imaging. To solve the inverse problem, iterative optimisation is performed in a latent space, which ensures the anatomical plausibility. This alleviates the need of paired low-resolution and high-resolution images for supervised learning. Experiments on two cardiac MR datasets show that the proposed framework achieves high performance, comparable to state-of-the-art super-resolution approaches and with better cross-domain generalisability and anatomical plausibility. △ Less

Submitted 8 July, 2021; originally announced July 2021.

Comments: The paper is early accepted to MICCAI 2021. The codes are available at https://github.com/shuowang26/SRHeart

Neutrinos from charm: forward production at the LHC and in the atmosphere

Authors: Yu Seon Jeong, Weidong Bai, Milind Diwan, Maria Vittoria Garzelli, Fnu Karan Kumar, Mary Hall Reno

Abstract: Theoretical predictions of the prompt atmospheric neutrino flux have large uncertainties associated with charm hadron production, by far the dominant source of prompt neutrinos in the atmosphere. The flux of cosmic rays, with its steeply falling energy spectrum, weights the forward production of charm in the evaluation of the atmospheric neutrino flux at high energies. The current LHCb experiment… ▽ More Theoretical predictions of the prompt atmospheric neutrino flux have large uncertainties associated with charm hadron production, by far the dominant source of prompt neutrinos in the atmosphere. The flux of cosmic rays, with its steeply falling energy spectrum, weights the forward production of charm in the evaluation of the atmospheric neutrino flux at high energies. The current LHCb experiment at CERN constrains charm production in kinematic regions relevant to the prompt atmospheric neutrino flux. The proposed Forward Physics Facility has additional capabilities to detect neutrino fluxes from forward charm production at the LHC. We discuss the implications of the current and planned experiments on the development of theoretical predictions of the high energy atmospheric neutrino flux. △ Less

Submitted 30 July, 2021; v1 submitted 2 July, 2021; originally announced July 2021.

Comments: 8 pages, 6 figures. Proceedings of the 37th International Cosmic Ray Conference (ICRC 2021)

Cooperative Training and Latent Space Data Augmentation for Robust Medical Image Segmentation

Authors: Chen Chen, Kerstin Hammernik, Cheng Ouyang, Chen Qin, Wenjia Bai, Daniel Rueckert

Abstract: Deep learning-based segmentation methods are vulnerable to unforeseen data distribution shifts during deployment, e.g. change of image appearances or contrasts caused by different scanners, unexpected imaging artifacts etc. In this paper, we present a cooperative framework for training image segmentation models and a latent space augmentation method for generating hard examples. Both contributions… ▽ More Deep learning-based segmentation methods are vulnerable to unforeseen data distribution shifts during deployment, e.g. change of image appearances or contrasts caused by different scanners, unexpected imaging artifacts etc. In this paper, we present a cooperative framework for training image segmentation models and a latent space augmentation method for generating hard examples. Both contributions improve model generalization and robustness with limited data. The cooperative training framework consists of a fast-thinking network (FTN) and a slow-thinking network (STN). The FTN learns decoupled image features and shape features for image reconstruction and segmentation tasks. The STN learns shape priors for segmentation correction and refinement. The two networks are trained in a cooperative manner. The latent space augmentation generates challenging examples for training by masking the decoupled latent space in both channel-wise and spatial-wise manners. We performed extensive experiments on public cardiac imaging datasets. Using only 10 subjects from a single site for training, we demonstrated improved cross-site segmentation performance and increased robustness against various unforeseen imaging artifacts compared to strong baseline methods. Particularly, cooperative training with latent space data augmentation yields 15% improvement in terms of average Dice score when compared to a standard training method. △ Less

Submitted 2 July, 2021; originally announced July 2021.

Comments: MICCAI 2021

Discover the Hidden Attack Path in Multi-domain Cyberspace Based on Reinforcement Learning

Authors: Lei Zhang, Wei Bai, Wei Li, Shiming Xia, Qibin Zheng

Abstract: In this work, we present a learning-based approach to analysis cyberspace security configuration. Unlike prior methods, our approach has the ability to learn from past experience and improve over time. In particular, as we train over a greater number of agents as attackers, our method becomes better at discovering hidden attack paths for previously methods, especially in multi-domain cyberspace. T… ▽ More In this work, we present a learning-based approach to analysis cyberspace security configuration. Unlike prior methods, our approach has the ability to learn from past experience and improve over time. In particular, as we train over a greater number of agents as attackers, our method becomes better at discovering hidden attack paths for previously methods, especially in multi-domain cyberspace. To achieve these results, we pose discovering attack paths as a Reinforcement Learning (RL) problem and train an agent to discover multi-domain cyberspace attack paths. To enable our RL policy to discover more hidden attack paths and shorter attack paths, we ground representation introduction an multi-domain action select module in RL. Our objective is to discover more hidden attack paths and shorter attack paths by our proposed method, to analysis the weakness of cyberspace security configuration. At last, we designed a simulated cyberspace experimental environment to verify our proposed method, the experimental results show that our method can discover more hidden multi-domain attack paths and shorter attack paths than existing baseline methods. △ Less

Submitted 14 April, 2021; originally announced April 2021.

Comments: 12 pages, 2 figures, 3 tables. arXiv admin note: substantial text overlap with arXiv:2007.04614

MSC Class: 68T01 ACM Class: I.2.0

Multiple-Channel Real Time Filtering for a Myoelectric Prosthetic Hand-Arm Robot System

Authors: Weibang Bai, Yinlai Jiang, Hiroshi Yokoi

Abstract: On the base of the developed master-slave prosthetic hand-arm robot system, which is controlled mainly based on signals obtained from bending sensors fixed on the data glove, the first idea deduced was to develop and add a multi-dimensional filter into the original control system to make the control signals cleaner and more stable at real time. By going further, a second new idea was also proposed… ▽ More On the base of the developed master-slave prosthetic hand-arm robot system, which is controlled mainly based on signals obtained from bending sensors fixed on the data glove, the first idea deduced was to develop and add a multi-dimensional filter into the original control system to make the control signals cleaner and more stable at real time. By going further, a second new idea was also proposed to predict new control information based on the combination of a new algorithm and prediction control theory. In order to fulfill the first idea properly, the possible methods to process data in real time, the different ways to produce Gaussian distributed random data, the way to combine the new algorithm with the previous complex program project, and the way to simplify and reduce the running time of the algorithm to maintain the high efficiency, the real time processing with multiple channels of the sensory system and the real-time performance of the control system were researched. Eventually, the experiment on the same provided robot system gives the results of the first idea and shows the improved performance of the filter comparing with the original control method. △ Less

Submitted 3 March, 2021; originally announced March 2021.

Comments: 14 pages, 12 figures

Property investigation for different wedge-shaped CsI(Tl)s

Authors: G. Li, J. L. Lou, Y. L. Ye, H. Hua, H. Wang, J. X. Han, W. Liu, S. W. Bai, Z. W. Tan, K. Ma, J. H. Chen, L. S. Yang, S. J. Wang, Z. Y. Hu, H. Z. Yu, H. Y. Zhu, B. L. Xia, Y. Jiang, Y. Liu, X. F. Yang, Q. T. Li, J. Y. Xu, J. S. Wang, Y. Y. Yang, J. B. Ma , et al. (10 additional authors not shown)

Abstract: Two types of wedge-shaped CsI(Tl)s were designed to be placed behind the annular double-sided silicon detectors (ADSSDs) to identify the light charged particles with the $ΔE-E$ method. The properties of CsI(Tl)s with different shapes and sizes, such as energy resolution, light output non-uniformity and particle identification capability, were compared by using a $α$-source and a radioactive beam o… ▽ More Two types of wedge-shaped CsI(Tl)s were designed to be placed behind the annular double-sided silicon detectors (ADSSDs) to identify the light charged particles with the $ΔE-E$ method. The properties of CsI(Tl)s with different shapes and sizes, such as energy resolution, light output non-uniformity and particle identification capability, were compared by using a $α$-source and a radioactive beam of $^{15}$C. The big-size CsI(Tl) was finally adopted to form the $ΔE-E$ telescope due to better properties. The property differences of these two types of CsI(Tl)s can be interpreted based on the Geant4 simulation results. △ Less

Submitted 2 March, 2021; originally announced March 2021.

Study of $s$- and $d$-wave intruder strengths in $^{13}{\rm B}_{\rm g.s.}$ via a $p(^{13}{\rm B},d)^{12}{\rm B}$ reaction

Authors: W. Liu, J. L. Lou, Y. L. Ye, Z. H. Li, Q. T. Li, H. Hua, X. F. Yang, J. Y. Xu, H. J. Ong, D. T. Tran, N. Aoi, E. Ideguchi, D. Y. Pang, C. X. Yuan, S. M. Wang, Y. Jiang, B. Yang, Y. Liu, J. G. Li, Z. Q. Chen, J. X. Han, S. W. Bai, G. Li, K. Ma, Z. W. Tan , et al. (2 additional authors not shown)

Abstract: Experimental results of the $p(^{13}{\rm B},d)^{12}{\rm B}$ transfer reaction to the low-lying states in $^{12}$B are reported. The optical potential parameters for the entrance channel are extracted from the elastic scattering $p$($^{13}{\rm B}$, $p$) measured in the same experiment, while those for the exit channel are global ones. Spectroscopic factors associated with the $p$-, $s$-, and $d$-wa… ▽ More Experimental results of the $p(^{13}{\rm B},d)^{12}{\rm B}$ transfer reaction to the low-lying states in $^{12}$B are reported. The optical potential parameters for the entrance channel are extracted from the elastic scattering $p$($^{13}{\rm B}$, $p$) measured in the same experiment, while those for the exit channel are global ones. Spectroscopic factors associated with the $p$-, $s$-, and $d$-wave neutron transfer to the known $^{12}$B states, are extracted by comparing the deuteron angular distributions with the calculation results. The separated $s$- and $d$-wave intruder strengths in $^{13}{\rm B}_{\rm g.s.}$ were determined to be $10(2)\%$ and $6(1)\%$, respectively, which follow roughly the systematics for the $N$ = 8 neutron-rich isotones. The measured total intruder strength is in good agreement with the shell model calculation, while the individual ones evolve quite differently. Particularly, the sudden change of the $d$-wave intensity between $^{13}$B and $^{12}$Be needs further theoretical interpretation. △ Less

Submitted 2 March, 2021; originally announced March 2021.

Comments: 8 pages,8 figures

A General Framework for Revealing Human Mind with auto-encoding GANs

Authors: Pan Wang, Rui Zhou, Shuo Wang, Ling Li, Wenjia Bai, Jialu Fan, Chunlin Li, Peter Childs, Yike Guo

Abstract: Addressing the question of visualising human mind could help us to find regions that are associated with observed cognition and responsible for expressing the elusive mental image, leading to a better understanding of cognitive function. The traditional approach treats brain decoding as a classification problem, reading the mind through statistical analysis of brain activity. However, human though… ▽ More Addressing the question of visualising human mind could help us to find regions that are associated with observed cognition and responsible for expressing the elusive mental image, leading to a better understanding of cognitive function. The traditional approach treats brain decoding as a classification problem, reading the mind through statistical analysis of brain activity. However, human thought is rich and varied, that it is often influenced by more of a combination of object features than a specific type of category. For this reason, we propose an end-to-end brain decoding framework which translates brain activity into an image by latent space alignment. To find the correspondence from brain signal features to image features, we embedded them into two latent spaces with modality-specific encoders and then aligned the two spaces by minimising the distance between paired latent representations. The proposed framework was trained by simultaneous electroencephalogram and functional MRI data, which were recorded when the subjects were viewing or imagining a set of image stimuli. In this paper, we focused on implementing the fMRI experiment. Our experimental results demonstrated the feasibility of translating brain activity to an image. The reconstructed image matches image stimuli approximate in both shape and colour. Our framework provides a promising direction for building a direct visualisation to reveal human mind. △ Less

Submitted 9 February, 2021; originally announced February 2021.

DAHash: Distribution Aware Tuning of Password Hashing Costs

Authors: Wenjie Bai, Jeremiah Blocki

Abstract: An attacker who breaks into an authentication server and steals all of the cryptographic password hashes is able to mount an offline-brute force attack against each user's password. Offline brute-force attacks against passwords are increasingly commonplace and the danger is amplified by the well documented human tendency to select low-entropy password and/or reuse these passwords across multiple a… ▽ More An attacker who breaks into an authentication server and steals all of the cryptographic password hashes is able to mount an offline-brute force attack against each user's password. Offline brute-force attacks against passwords are increasingly commonplace and the danger is amplified by the well documented human tendency to select low-entropy password and/or reuse these passwords across multiple accounts. Moderately hard password hashing functions are often deployed to help protect passwords against offline attacks by increasing the attacker's guessing cost. However, there is a limit to how "hard" one can make the password hash function as authentication servers are resource constrained and must avoid introducing substantial authentication delay. Observing that there is a wide gap in the strength of passwords selected by different users we introduce DAHash (Distribution Aware Password Hashing) a novel mechanism which reduces the number of passwords that an attacker will crack. Our key insight ishat a resource-constrained authentication server can dynamically tune the hardness parameters of a password hash function based on the (estimated) strength of the user's password. We introduce a Stackelberg game to model the interaction between a defender (authentication server) and an offline attacker. Our model allows the defender to optimize the parameters of DAHash e.g., specify how much effort is spent to hash weak/moderate/high strength passwords. We use several large scale password frequency datasets to empirically evaluate the effectiveness of our differentiated cost password hashing mechanism. We find that the defender who uses our mechanism can reduce the fraction of passwords that would be cracked by a rational offline attacker by around 15%. △ Less

Submitted 30 January, 2021; v1 submitted 25 January, 2021; originally announced January 2021.

Comments: 25 pages, 15 figures, Financial Crypto 2021

Quantitative Evaluations on Saliency Methods: An Experimental Study

Authors: Xiao-Hui Li, Yuhan Shi, Haoyang Li, Wei Bai, Yuanwei Song, Caleb Chen Cao, Lei Chen

Abstract: It has been long debated that eXplainable AI (XAI) is an important topic, but it lacks rigorous definition and fair metrics. In this paper, we briefly summarize the status quo of the metrics, along with an exhaustive experimental study based on them, including faithfulness, localization, false-positives, sensitivity check, and stability. With the experimental results, we conclude that among all th… ▽ More It has been long debated that eXplainable AI (XAI) is an important topic, but it lacks rigorous definition and fair metrics. In this paper, we briefly summarize the status quo of the metrics, along with an exhaustive experimental study based on them, including faithfulness, localization, false-positives, sensitivity check, and stability. With the experimental results, we conclude that among all the methods we compare, no single explanation method dominates others in all metrics. Nonetheless, Gradient-weighted Class Activation Map** (Grad-CAM) and Randomly Input Sampling for Explanation (RISE) perform fairly well in most of the metrics. Utilizing a set of filtered metrics, we further present a case study to diagnose the classification bases for models. While providing a comprehensive experimental study of metrics, we also examine measuring factors that are missed in current metrics and hope this valuable work could serve as a guide for future research. △ Less

Submitted 31 December, 2020; originally announced December 2020.

Comments: 14 pages, 16 figures

Charge radii of exotic potassium isotopes challenge nuclear theory and the magic character of $N = 32$

Authors: Á. Koszorús, X. F. Yang, W. G. Jiang, S. J. Novario, S. W. Bai, J. Billowes, C. L. Binnersley, M. L. Bissell, T. E. Cocolios, B. S. Cooper, R. P. de Groote, A. Ekström, K. T. Flanagan, C. Forssén, S. Franchoo, R. F. Garcia Ruiz, F. P. Gustafsson, G. Hagen, G. R. Jansen, A. Kanellakopoulos, M. Kortelainen, W. Nazarewicz, G. Neyens, T. Papenbrock, P. -G. Reinhard , et al. (4 additional authors not shown)

Abstract: Nuclear charge radii are sensitive probes of different aspects of the nucleon-nucleon interaction and the bulk properties of nuclear matter; thus, they provide a stringent test and challenge for nuclear theory. The calcium region has been of particular interest, as experimental evidence has suggested a new magic number at $N = 32$ [1-3], while the unexpectedly large increases in the charge radii [… ▽ More Nuclear charge radii are sensitive probes of different aspects of the nucleon-nucleon interaction and the bulk properties of nuclear matter; thus, they provide a stringent test and challenge for nuclear theory. The calcium region has been of particular interest, as experimental evidence has suggested a new magic number at $N = 32$ [1-3], while the unexpectedly large increases in the charge radii [4,5] open new questions about the evolution of nuclear size in neutron-rich systems. By combining the collinear resonance ionization spectroscopy method with $β$-decay detection, we were able to extend the charge radii measurement of potassium ($Z =19$) isotopes up to the exotic $^{52}$K ($t_{1/2}$ = 110 ms), produced in minute quantities. Our work provides the first charge radii measurement beyond $N = 32$ in the region, revealing no signature of the magic character at this neutron number. The results are interpreted with two state-of-the-art nuclear theories. For the first time, a long sequence of isotopes could be calculated with coupled-cluster calculations based on newly developed nuclear interactions. The strong increase in the charge radii beyond $N = 28$ is not well captured by these calculations, but is well reproduced by Fayans nuclear density functional theory, which, however, overestimates the odd-even staggering effect. These findings highlight our limited understanding on the nuclear size of neutron-rich systems, and expose pressing problems that are present in some of the best current models of nuclear theory. △ Less

Submitted 3 December, 2020; originally announced December 2020.

Comments: submitted version; revision accepted in Nature Physics

Journal ref: Nature Physics 17, 439 (2021)

Nuclear Moments of Germanium Isotopes around $N$ = 40

Authors: A. Kanellakopoulos, X. F. Yang, M. L. Bissell, M. L. Reitsma, S. W. Bai, J. Billowes, K. Blaum, A. Borschevsky, B. Cheal, C. S. Devlin, R. F. Garcia Ruiz, H. Heylen, S. Kaufmann, K. König, Á. Koszorús, S. Lechner, S. Malbrunot-Ettenauer, R. Neugart, G. Neyens, W. Nörtershäuser, T. Ratajczyk, L. V. Rodríguez, S. Sels, S. J. Wang, L. Xie , et al. (2 additional authors not shown)

Abstract: Collinear laser spectroscopy measurements were performed on $^{69,71,73}$Ge isotopes ($Z = 32$) at ISOLDE-CERN. The hyperfine structure of the $4s^2 4p^2 \, ^3P_1 \rightarrow 4s^2 4p 5s \, ^3P_1^o$ transition of the germanium atom was probed with laser light of 269 nm, produced by combining the frequency-mixing and frequency-doubling techniques. The hyperfine fields for both atomic levels were cal… ▽ More Collinear laser spectroscopy measurements were performed on $^{69,71,73}$Ge isotopes ($Z = 32$) at ISOLDE-CERN. The hyperfine structure of the $4s^2 4p^2 \, ^3P_1 \rightarrow 4s^2 4p 5s \, ^3P_1^o$ transition of the germanium atom was probed with laser light of 269 nm, produced by combining the frequency-mixing and frequency-doubling techniques. The hyperfine fields for both atomic levels were calculated using state-of-the-art atomic relativistic Fock-space coupled-cluster calculations. A new $^{73}$Ge quadrupole moment was determined from these calculations and previously measured precision hyperfine parameters, yielding $Q_{\rm s}$ = $-$0.198(4) b, in excellent agreement with the literature value from molecular calculations. The moments of $^{69}$Ge have been revised: $μ$ = +0.920(5) $μ_{N}$ and $Q_{\rm s}$= +0.114(8) b, and those of $^{71}$Ge have been confirmed. The experimental moments around $N = 40$ are interpreted with large-scale shell-model calculations using the JUN45 interaction, revealing rather mixed wave function configurations, although their $g$-factors are lying close to the effective single-particle values. Through a comparison with neighboring isotones, the structural change from the single-particle nature of nickel to deformation in germanium is further investigated around $N = 40$. △ Less

Submitted 3 November, 2020; originally announced November 2020.

Comments: accepted in Phys. Rev. C., in production

Password Strength Signaling: A Counter-Intuitive Defense Against Password Cracking

Authors: Wenjie Bai, Jeremiah Blocki, Ben Harsha

Abstract: We introduce password strength information signaling as a novel, yet counter-intuitive, defense mechanism against password cracking attacks. Recent breaches have exposed billions of user passwords to the dangerous threat of offline password cracking attacks. An offline attacker can quickly check millions (or sometimes billions/trillions) of password guesses by comparing their hash value with the s… ▽ More We introduce password strength information signaling as a novel, yet counter-intuitive, defense mechanism against password cracking attacks. Recent breaches have exposed billions of user passwords to the dangerous threat of offline password cracking attacks. An offline attacker can quickly check millions (or sometimes billions/trillions) of password guesses by comparing their hash value with the stolen hash from a breached authentication server. The attacker is limited only by the resources he is willing to invest. Our key idea is to have the authentication server store a (noisy) signal about the strength of each user password for an offline attacker to find. Surprisingly, we show that the noise distribution for the signal can often be tuned so that a rational (profit-maximizing) attacker will crack fewer passwords. The signaling scheme exploits the fact that password cracking is not a zero-sum game i.e., the attacker's profit is given by the value of the cracked passwords minus the total guessing cost. Thus, a well-defined signaling strategy will encourage the attacker to reduce his guessing costs by cracking fewer passwords. We use an evolutionary algorithm to compute the optimal signaling scheme for the defender. As a proof-of-concept, we evaluate our mechanism on several password datasets and show that it can reduce the total number of cracked passwords by up to $12\%$ (resp. $5\%$) of all users in defending against offline (resp. online) attacks. △ Less

Submitted 16 August, 2021; v1 submitted 21 September, 2020; originally announced September 2020.

Comments: 17 pages, 4 figures

Quality-aware semi-supervised learning for CMR segmentation

Authors: Bram Ruijsink, Esther Puyol-Anton, Ye Li, Wenja Bai, Eric Kerfoot, Reza Razavi, Andrew P. King

Abstract: One of the challenges in develo** deep learning algorithms for medical image segmentation is the scarcity of annotated training data. To overcome this limitation, data augmentation and semi-supervised learning (SSL) methods have been developed. However, these methods have limited effectiveness as they either exploit the existing data set only (data augmentation) or risk negative impact by adding… ▽ More One of the challenges in develo** deep learning algorithms for medical image segmentation is the scarcity of annotated training data. To overcome this limitation, data augmentation and semi-supervised learning (SSL) methods have been developed. However, these methods have limited effectiveness as they either exploit the existing data set only (data augmentation) or risk negative impact by adding poor training examples (SSL). Segmentations are rarely the final product of medical image analysis - they are typically used in downstream tasks to infer higher-order patterns to evaluate diseases. Clinicians take into account a wealth of prior knowledge on biophysics and physiology when evaluating image analysis results. We have used these clinical assessments in previous works to create robust quality-control (QC) classifiers for automated cardiac magnetic resonance (CMR) analysis. In this paper, we propose a novel scheme that uses QC of the downstream task to identify high quality outputs of CMR segmentation networks, that are subsequently utilised for further network training. In essence, this provides quality-aware augmentation of training data in a variant of SSL for segmentation networks (semiQCSeg). We evaluate our approach in two CMR segmentation tasks (aortic and short axis cardiac volume segmentation) using UK Biobank data and two commonly used network architectures (U-net and a Fully Convolutional Network) and compare against supervised and SSL strategies. We show that semiQCSeg improves training of the segmentation networks. It decreases the need for labelled data, while outperforming the other methods in terms of Dice and clinical metrics. SemiQCSeg can be an efficient approach for training segmentation networks for medical image data when labelled datasets are scarce. △ Less

Submitted 1 September, 2020; originally announced September 2020.

Comments: MICCAI STACOM 2020

Domain-specific Communication Optimization for Distributed DNN Training

Authors: Hao Wang, **grong Chen, Xinchen Wan, Han Tian, Jiacheng Xia, Gaoxiong Zeng, Weiyan Wang, Kai Chen, Wei Bai, Junchen Jiang

Abstract: Communication overhead poses an important obstacle to distributed DNN training and draws increasing attention in recent years. Despite continuous efforts, prior solutions such as gradient compression/reduction, compute/communication overlap** and layer-wise flow scheduling, etc., are still coarse-grained and insufficient for an efficient distributed training especially when the network is under… ▽ More Communication overhead poses an important obstacle to distributed DNN training and draws increasing attention in recent years. Despite continuous efforts, prior solutions such as gradient compression/reduction, compute/communication overlap** and layer-wise flow scheduling, etc., are still coarse-grained and insufficient for an efficient distributed training especially when the network is under pressure. We present DLCP, a novel solution exploiting the domain-specific properties of deep learning to optimize communication overhead of DNN training in a fine-grained manner. At its heart, DLCP comprises of several key innovations beyond prior work: e.g., it exploits {\em bounded loss tolerance} of SGD-based training to improve tail communication latency which cannot be avoided purely through gradient compression. It then performs fine-grained packet-level prioritization and drop**, as opposed to flow-level scheduling, based on layers and magnitudes of gradients to further speedup model convergence without affecting accuracy. In addition, it leverages inter-packet order-independency to perform per-packet load balancing without causing classical re-ordering issues. DLCP works with both Parameter Server and collective communication routines. We have implemented DLCP with commodity switches, integrated it with various training frameworks including TensorFlow, MXNet and PyTorch, and deployed it in our small-scale testbed with 10 Nvidia V100 GPUs. Our testbed experiments and large-scale simulations show that DLCP delivers up to $84.3\%$ additional training acceleration over the best existing solutions. △ Less

Submitted 16 August, 2020; originally announced August 2020.