-
Vox-UDA: Voxel-wise Unsupervised Domain Adaptation for Cryo-Electron Subtomogram Segmentation with Denoised Pseudo Labeling
Authors:
Haoran Li,
Xingjian Li,
Jiahua Shi,
Huaming Chen,
Bo Du,
Daisuke Kihara,
Johan Barthelemy,
Jun Shen,
Min Xu
Abstract:
Cryo-Electron Tomography (cryo-ET) is a 3D imaging technology facilitating the study of macromolecular structures at near-atomic resolution. Recent volumetric segmentation approaches on cryo-ET images have drawn widespread interest in biological sector. However, existing methods heavily rely on manually labeled data, which requires highly professional skills, thereby hindering the adoption of full…
▽ More
Cryo-Electron Tomography (cryo-ET) is a 3D imaging technology facilitating the study of macromolecular structures at near-atomic resolution. Recent volumetric segmentation approaches on cryo-ET images have drawn widespread interest in biological sector. However, existing methods heavily rely on manually labeled data, which requires highly professional skills, thereby hindering the adoption of fully-supervised approaches for cryo-ET images. Some unsupervised domain adaptation (UDA) approaches have been designed to enhance the segmentation network performance using unlabeled data. However, applying these methods directly to cryo-ET images segmentation tasks remains challenging due to two main issues: 1) the source data, usually obtained through simulation, contain a certain level of noise, while the target data, directly collected from raw-data from real-world scenario, have unpredictable noise levels. 2) the source data used for training typically consists of known macromoleculars, while the target domain data are often unknown, causing the model's segmenter to be biased towards these known macromolecules, leading to a domain shift problem. To address these challenges, in this work, we introduce the first voxel-wise unsupervised domain adaptation approach, termed Vox-UDA, specifically for cryo-ET subtomogram segmentation. Vox-UDA incorporates a noise generation module to simulate target-like noises in the source dataset for cross-noise level adaptation. Additionally, we propose a denoised pseudo-labeling strategy based on improved Bilateral Filter to alleviate the domain shift problem. Experimental results on both simulated and real cryo-ET subtomogram datasets demonstrate the superiority of our proposed approach compared to state-of-the-art UDA methods.
△ Less
Submitted 30 June, 2024; v1 submitted 24 June, 2024;
originally announced June 2024.
-
Regression on Deep Visual Features using Artificial Neural Networks (ANNs) to Predict Hydraulic Blockage at Culverts
Authors:
Umair Iqbal,
Johan Barthelemy,
Wanqing Li,
Pascal Perez
Abstract:
Cross drainage hydraulic structures (i.e., culverts, bridges) in urban landscapes are prone to getting blocked by transported debris which often results in causing the flash floods. In context of Australia, Wollongong City Council (WCC) blockage conduit policy is the only formal guideline to consider blockage in design process. However, many argue that this policy is based on the post floods visua…
▽ More
Cross drainage hydraulic structures (i.e., culverts, bridges) in urban landscapes are prone to getting blocked by transported debris which often results in causing the flash floods. In context of Australia, Wollongong City Council (WCC) blockage conduit policy is the only formal guideline to consider blockage in design process. However, many argue that this policy is based on the post floods visual inspections and hence can not be considered accurate representation of hydraulic blockage. As a result of this on-going debate, visual blockage and hydraulic blockage are considered two distinct terms with no established quantifiable relation among both. This paper attempts to relate both terms by proposing the use of deep visual features for prediction of hydraulic blockage at a given culvert. An end-to-end machine learning pipeline is propounded which takes an image of culvert as input, extract visual features using deep learning models, pre-process the visual features and feed into regression model to predict the corresponding hydraulic blockage. Dataset (i.e., Hydrology-Lab Dataset (HD), Visual Hydrology-Lab Dataset (VHD)) used in this research was collected from in-lab experiments carried out using scaled physical models of culverts where multiple blockage scenarios were replicated at scale. Performance of regression models was assessed using standard evaluation metrics. Furthermore, performance of overall machine learning pipeline was assessed in terms of processing times for relative comparison of models and hardware requirement analysis. From the results ANN used with MobileNet extracted visual features achieved the best regression performance with $R^{2}$ score of 0.7855. Positive value of $R^{2}$ score indicated the presence of correlation between visual features and hydraulic blockage and suggested that both can be interrelated with each other.
△ Less
Submitted 25 April, 2021;
originally announced May 2021.
-
Automating Visual Blockage Classification of Culverts with Deep Learning
Authors:
Umair Iqbal,
Johan Barthelemy,
Wanqing Li,
Pascal Perez
Abstract:
Blockage of culverts by transported debris materials is reported as main contributor in originating urban flash floods. Conventional modelling approaches had no success in addressing the problem largely because of unavailability of peak floods hydraulic data and highly non-linear behaviour of debris at culvert. This article explores a new dimension to investigate the issue by proposing the use of…
▽ More
Blockage of culverts by transported debris materials is reported as main contributor in originating urban flash floods. Conventional modelling approaches had no success in addressing the problem largely because of unavailability of peak floods hydraulic data and highly non-linear behaviour of debris at culvert. This article explores a new dimension to investigate the issue by proposing the use of Intelligent Video Analytic (IVA) algorithms for extracting blockage related information. Potential of using existing Convolutional Neural Network (CNN) algorithms (i.e., DarkNet53, DenseNet121, InceptionResNetV2, InceptionV3, MobileNet, ResNet50, VGG16, EfficientNetB3, NASNet) is investigated over a custom collected blockage dataset (i.e., Images of Culvert Openings and Blockage (ICOB)) to predict the blockage in a given image. Models were evaluated based on their performance on test dataset (i.e., accuracy, loss, precision, recall, F1-score, Jaccard-Index), Floating Point Operations Per Second (FLOPs) and response times to process a single test instance. From the results, NASNet was reported most efficient in classifying the blockage with the accuracy of 85\%; however, EfficientNetB3 was recommended for the hardware implementation because of its improved response time with accuracy comparable to NASNet (i.e., 83\%). False Negative (FN) instances, False Positive (FP) instances and CNN layers activation suggested that background noise and oversimplified labelling criteria were two contributing factors in degraded performance of existing CNN algorithms.
△ Less
Submitted 21 April, 2021;
originally announced May 2021.
-
Prediction of Hydraulic Blockage at Cross Drainage Structures using Regression Analysis
Authors:
Umair Iqbal,
Johan Barthelemy,
Pascal Perez,
Wanqing Li
Abstract:
Hydraulic blockage of cross-drainage structures such as culverts is considered one of main contributor in triggering urban flash floods. However, due to lack of during floods data and highly non-linear nature of debris interaction, conventional modelling for hydraulic blockage is not possible. This paper proposes to use machine learning regression analysis for the prediction of hydraulic blockage.…
▽ More
Hydraulic blockage of cross-drainage structures such as culverts is considered one of main contributor in triggering urban flash floods. However, due to lack of during floods data and highly non-linear nature of debris interaction, conventional modelling for hydraulic blockage is not possible. This paper proposes to use machine learning regression analysis for the prediction of hydraulic blockage. Relevant data has been collected by performing a scaled in-lab study and replicating different blockage scenarios. From the regression analysis, Artificial Neural Network (ANN) was reported best in hydraulic blockage prediction with $R^2$ of 0.89. With deployment of hydraulic sensors in smart cities, and availability of Big Data, regression analysis may prove helpful in addressing the blockage detection problem which is difficult to counter using conventional experimental and hydrological approaches.
△ Less
Submitted 5 March, 2021;
originally announced March 2021.
-
Hard 3-CNF-SAT problems are in $P$ -- A first step in proving $NP=P$
Authors:
Marcel Rémon,
Johan Barthélemy
Abstract:
The relationship between the complexity classes $P$ and $NP$ is an unsolved question in the field of theoretical computer science. In the first part of this paper, a lattice framework is proposed to handle the 3-CNF-SAT problems, known to be in $NP$. In the second section, we define a multi-linear descriptor function ${\cal H}_\varphi$ for any 3-CNF-SAT problem $\varphi$ of size $n$, in the sense…
▽ More
The relationship between the complexity classes $P$ and $NP$ is an unsolved question in the field of theoretical computer science. In the first part of this paper, a lattice framework is proposed to handle the 3-CNF-SAT problems, known to be in $NP$. In the second section, we define a multi-linear descriptor function ${\cal H}_\varphi$ for any 3-CNF-SAT problem $\varphi$ of size $n$, in the sense that ${\cal H}_\varphi : \{0,1\}^n \rightarrow \{0,1\}^n$ is such that $Im \; {\cal H}_\varphi$ is the set of all the solutions of $\varphi$. A new merge operation ${\cal H}_\varphi \bigwedge {\cal H}_ψ$ is defined, where $ψ$ is a single 3-CNF clause. Given ${\cal H}_\varphi$ [but this can be of exponential complexity], the complexity needed for the computation of $Im \; {\cal H}_\varphi$, the set of all solutions, is shown to be polynomial for hard 3-CNF-SAT problems, i.e. the one with few ($\leq 2^k$) or no solutions. The third part uses the relation between ${\cal H}_\varphi$ and the indicator function $\mathbb{1}_{{\cal S}_\varphi}$ for the set of solutions, to develop a greedy polynomial algorithm to solve hard 3-CNF-SAT problems.
△ Less
Submitted 3 January, 2020;
originally announced January 2020.
-
Comparison of Discrete Choice Models and Artificial Neural Networks in Presence of Missing Variables
Authors:
Johan Barthélemy,
Morgane Dumont,
Timoteo Carletti
Abstract:
Classification, the process of assigning a label (or class) to an observation given its features, is a common task in many applications. Nonetheless in most real-life applications, the labels can not be fully explained by the observed features. Indeed there can be many factors hidden to the modellers. The unexplained variation is then treated as some random noise which is handled differently depen…
▽ More
Classification, the process of assigning a label (or class) to an observation given its features, is a common task in many applications. Nonetheless in most real-life applications, the labels can not be fully explained by the observed features. Indeed there can be many factors hidden to the modellers. The unexplained variation is then treated as some random noise which is handled differently depending on the method retained by the practitioner. This work focuses on two simple and widely used supervised classification algorithms: discrete choice models and artificial neural networks in the context of binary classification.
Through various numerical experiments involving continuous or discrete explanatory features, we present a comparison of the retained methods' performance in presence of missing variables. The impact of the distribution of the two classes in the training data is also investigated. The outcomes of those experiments highlight the fact that artificial neural networks outperforms the discrete choice models, except when the distribution of the classes in the training data is highly unbalanced.
Finally, this work provides some guidelines for choosing the right classifier with respect to the training data.
△ Less
Submitted 6 November, 2018;
originally announced November 2018.
-
Interaction prediction between groundwater and quarry extension using discrete choice models and artificial neural networks
Authors:
Johan Barthélemy,
Timoteo Carletti,
Louise Collier,
Vincent Hallet,
Marie Moriamé,
Annick Sartenaer
Abstract:
Groundwater and rock are intensively exploited in the world. When a quarry is deepened the water table of the exploited geological formation might be reached. A dewatering system is therefore installed so that the quarry activities can continue, possibly impacting the nearby water catchments. In order to recommend an adequate feasibility study before deepening a quarry, we propose two interaction…
▽ More
Groundwater and rock are intensively exploited in the world. When a quarry is deepened the water table of the exploited geological formation might be reached. A dewatering system is therefore installed so that the quarry activities can continue, possibly impacting the nearby water catchments. In order to recommend an adequate feasibility study before deepening a quarry, we propose two interaction indices between extractive activity and groundwater resources based on hazard and vulnerability parameters used in the assessment of natural hazards. The levels of each index (low, medium, high, very high) correspond to the potential impact of the quarry on the regional hydrogeology.
The first index is based on a discrete choice modelling methodology while the second is relying on an artificial neural network. It is shown that these two complementary approaches (the former being probabilistic while the latter fully deterministic) are able to predict accurately the level of interaction. Their use is finally illustrated by their application on the Boverie quarry and the Tridaine gallery located in Belgium. The indices determine the current interaction level as well as the one resulting from future quarry extensions. The results highlight the very high interaction level of the quarry with the gallery.
△ Less
Submitted 27 November, 2016;
originally announced November 2016.
-
A 3-CNF-SAT descriptor algebra and the solution of the P=NP conjecture
Authors:
Marcel Rémon,
Johan Barthélemy
Abstract:
The relationship between the complexity classes P and NP is an unsolved question in the field of theoretical computer science. In this paper, we investigate a descriptor approach based on lattice properties. This paper proposes a new way to decide the satisfiability of any 3-CNF-SAT problem. The analysis of this exact [non heuristical] algorithm shows a strictly bounded exponential complexity. The…
▽ More
The relationship between the complexity classes P and NP is an unsolved question in the field of theoretical computer science. In this paper, we investigate a descriptor approach based on lattice properties. This paper proposes a new way to decide the satisfiability of any 3-CNF-SAT problem. The analysis of this exact [non heuristical] algorithm shows a strictly bounded exponential complexity. The complexity of any 3-CNF-SAT solution is bounded by O(2^490). This over-estimated bound is reached by an algorithm working on the smallest description (via descriptor functions) of the evolving set of solutions in function of the already considered clauses, without exploring these solutions. Any remark about this paper is warmly welcome.
△ Less
Submitted 25 July, 2016;
originally announced September 2016.
-
Boundary losses and spatial statistics of complex modes in a chaotic microwave cavity
Authors:
Jerome Barthelemy,
Olivier Legrand,
Fabrice Mortessagne
Abstract:
We experimentally study the various manifestations of ohmic losses in a two-dimensional microwave chaotic cavity and exhibit two different contributions to the resonance widths. We show that the parts of these widths, which vary from mode to mode, are associated to ohmic losses located at the boundary of the cavity. We also describe how this non-proportional dam** is responsible for the comple…
▽ More
We experimentally study the various manifestations of ohmic losses in a two-dimensional microwave chaotic cavity and exhibit two different contributions to the resonance widths. We show that the parts of these widths, which vary from mode to mode, are associated to ohmic losses located at the boundary of the cavity. We also describe how this non-proportional dam** is responsible for the complex character of wavefunctions (corresponding to a spatially non-uniform phase), which is ubiquitous in open or dissipative wave systems. We experimentally demonstrate that the non-proportional widths are related to a single parameter, which measures the amount of complexity of wavefunctions, and provide theoretical arguments in favor of this relation.
△ Less
Submitted 2 February, 2004;
originally announced February 2004.
-
Complete S-matrix in a microwave cavity at room temperature
Authors:
Jerome Barthelemy,
Olivier Legrand,
Fabrice Mortessagne
Abstract:
We experimentally study the widths of resonances in a two-dimensional microwave cavity at room temperature. By develo** a model for the coupling antennas, we are able to discriminate their contribution from those of ohmic losses to the broadening of resonances. Concerning ohmic losses, we experimentally put to evidence two mechanisms: dam** along propagation and absorption at the contour, th…
▽ More
We experimentally study the widths of resonances in a two-dimensional microwave cavity at room temperature. By develo** a model for the coupling antennas, we are able to discriminate their contribution from those of ohmic losses to the broadening of resonances. Concerning ohmic losses, we experimentally put to evidence two mechanisms: dam** along propagation and absorption at the contour, the latter being responsible for variations of widths from mode to mode due to its dependence on the spatial distribution of the field at the contour. A theory, based on an S-matrix formalism, is given for these variations. It is successfully validated through measurements of several hundreds of resonances in a rectangular cavity.
△ Less
Submitted 6 February, 2004; v1 submitted 30 January, 2004;
originally announced January 2004.