-
Dual Attention U-Net with Feature Infusion: Pushing the Boundaries of Multiclass Defect Segmentation
Authors:
Rasha Alshawi,
Md Tamjidul Hoque,
Md Meftahul Ferdaus,
Mahdi Abdelguerfi,
Kendall Niles,
Ken Prathak,
Joe Tom,
Jordan Klein,
Murtada Mousa,
Johny Javier Lopez
Abstract:
The proposed architecture, Dual Attentive U-Net with Feature Infusion (DAU-FI Net), addresses challenges in semantic segmentation, particularly on multiclass imbalanced datasets with limited samples. DAU-FI Net integrates multiscale spatial-channel attention mechanisms and feature injection to enhance precision in object localization. The core employs a multiscale depth-separable convolution block…
▽ More
The proposed architecture, Dual Attentive U-Net with Feature Infusion (DAU-FI Net), addresses challenges in semantic segmentation, particularly on multiclass imbalanced datasets with limited samples. DAU-FI Net integrates multiscale spatial-channel attention mechanisms and feature injection to enhance precision in object localization. The core employs a multiscale depth-separable convolution block, capturing localized patterns across scales. This block is complemented by a spatial-channel squeeze and excitation (scSE) attention unit, modeling inter-dependencies between channels and spatial regions in feature maps. Additionally, additive attention gates refine segmentation by connecting encoder-decoder pathways.
To augment the model, engineered features using Gabor filters for textural analysis, Sobel and Canny filters for edge detection are injected guided by semantic masks to expand the feature space strategically. Comprehensive experiments on a challenging sewer pipe and culvert defect dataset and a benchmark dataset validate DAU-FI Net's capabilities. Ablation studies highlight incremental benefits from attention blocks and feature injection. DAU-FI Net achieves state-of-the-art mean Intersection over Union (IoU) of 95.6% and 98.8% on the defect test set and benchmark respectively, surpassing prior methods by 8.9% and 12.6%, respectively. Ablation studies highlight incremental benefits from attention blocks and feature injection. The proposed architecture provides a robust solution, advancing semantic segmentation for multiclass problems with limited training data. Our sewer-culvert defects dataset, featuring pixel-level annotations, opens avenues for further research in this crucial domain. Overall, this work delivers key innovations in architecture, attention, and feature engineering to elevate semantic segmentation efficacy.
△ Less
Submitted 21 December, 2023;
originally announced December 2023.
-
Dual-Stream Attention Transformers for Sewer Defect Classification
Authors:
Abdullah Al Redwan Newaz,
Mahdi Abdeldguerfi,
Kendall N. Niles,
Joe Tom
Abstract:
We propose a dual-stream multi-scale vision transformer (DS-MSHViT) architecture that processes RGB and optical flow inputs for efficient sewer defect classification. Unlike existing methods that combine the predictions of two separate networks trained on each modality, we jointly train a single network with two branches for RGB and motion. Our key idea is to use self-attention regularization to h…
▽ More
We propose a dual-stream multi-scale vision transformer (DS-MSHViT) architecture that processes RGB and optical flow inputs for efficient sewer defect classification. Unlike existing methods that combine the predictions of two separate networks trained on each modality, we jointly train a single network with two branches for RGB and motion. Our key idea is to use self-attention regularization to harness the complementary strengths of the RGB and motion streams. The motion stream alone struggles to generate accurate attention maps, as motion images lack the rich visual features present in RGB images. To facilitate this, we introduce an attention consistency loss between the dual streams. By leveraging motion cues through a self-attention regularizer, we align and enhance RGB attention maps, enabling the network to concentrate on pertinent input regions. We evaluate our data on a public dataset as well as cross-validate our model performance in a novel dataset. Our method outperforms existing models that utilize either convolutional neural networks (CNNs) or multi-scale hybrid vision transformers (MSHViTs) without employing attention regularization between the two streams.
△ Less
Submitted 6 November, 2023;
originally announced November 2023.
-
Investigating the parametric dependence of the impact of two-way coupling on inertial particle settling in turbulence
Authors:
Soumak Bhattacharjee,
Josin Tom,
Maurizio Carbone,
Andrew D. Bragg
Abstract:
Tom et al.\ (J.\ Fluid Mech.\ 947, A7, 2022) investigated the impact of two-way coupling (2WC) on particle settling in turbulence. For the limited parameter choices explored, it was found that 2WC substantially enhances particle settling compared to the one-way coupled (1WC) case, even at low mass loading $Φ_m$. Moreover, contrary to previous claims, it was demonstrated that preferential swee**…
▽ More
Tom et al.\ (J.\ Fluid Mech.\ 947, A7, 2022) investigated the impact of two-way coupling (2WC) on particle settling in turbulence. For the limited parameter choices explored, it was found that 2WC substantially enhances particle settling compared to the one-way coupled (1WC) case, even at low mass loading $Φ_m$. Moreover, contrary to previous claims, it was demonstrated that preferential swee** remains the mechanism responsible for the particles settling faster than the Stokes settling velocity in 2WC flows. However, crucial questions remain: 1) how small must $Φ_m$ be for the effects of 2WC on particle settling to be negligible? 2) does the preferential swee** mechanism remain relevant in 2WC flows as $Φ_m$ is increased? To answer these, we explore a much broader portion of the parameter space, and our simulations cover cases where the impact of 2WC on the global fluid statistics ranges from negligible to strong. We find that even for $Φ_m=7.5\times 10^{-3}$, 2WC can noticeably increase the settling for some choices of the Stokes and Froude numbers. We also demonstrate that even when $Φ_m$ is large enough for the global fluid statistics to be strongly affected by the particles, preferential swee** is still the mechanism responsible for the enhanced particle settling. The difference between the 1WC and 2WC cases is that, in the latter the particles are not merely swept around the downward-moving side of vortices, but they also drag the fluid with them as they move down.
△ Less
Submitted 14 September, 2023;
originally announced September 2023.
-
How two-way coupling modifies the multiscale preferential swee** mechanism
Authors:
Josin Tom,
Maurizio Carbone,
Andrew D. Bragg
Abstract:
For one-way coupled (1WC) flows, Tom & Bragg (J. Fluid Mech., 871, pp. 244-270, 2019) advanced the analysis of Maxey (J. Fluid Mech., 174, pp. 441-465, 1987), which applied to weakly inertial particles, to particles of arbitrary inertia, and the new theoretical result revealed the role that different scales play in the preferential swee** mechanism that leads to enhanced particle settling in tur…
▽ More
For one-way coupled (1WC) flows, Tom & Bragg (J. Fluid Mech., 871, pp. 244-270, 2019) advanced the analysis of Maxey (J. Fluid Mech., 174, pp. 441-465, 1987), which applied to weakly inertial particles, to particles of arbitrary inertia, and the new theoretical result revealed the role that different scales play in the preferential swee** mechanism that leads to enhanced particle settling in turbulent flows. Monchaux & Dejoan (Phys. Rev. Fluids, 2, 104302, 2017) showed using direct numerical simulations (DNS) that while for low particle loading the effect of two-way coupling (2WC) on the global flow statistics is weak, 2WC enables the particles to drag the fluid in their vicinity down with them, significantly enhancing their settling, and they argued that 2WC suppresses the preferential swee** mechanism. We explore this further by considering the impact of 2WC on the contribution made by eddies of different sizes on the particle settling. In agreement with Monchaux & Dejoan, we show that even for low loading, 2WC strongly enhances particle settling, and we show how 2WC modifies the contribution from different flow scales. However, contrary to their study, we show that preferential swee** remains important in 2WC flows. In particular, for both 1WC and 2WC flows, the settling enhancement due to turbulence is dominated by contributions from particles in straining regions of the flow, but for the 2WC case, the particles in these regions also drag the fluid down with them, leading to an enhancement of their settling compared to the 1WC case.
△ Less
Submitted 2 February, 2022;
originally announced February 2022.
-
High-structure and its impact on performance gaps in large-enrollment frosh courses
Authors:
Pedro Morales-Almazan,
Hanjue Pan,
Jasmine Tom
Abstract:
We introduce the concept of structure-regions and their impact on student experience in large-enrollment frosh courses. These regions involve three major components: active learning, low-stakes assignments, and formative assessment. We analyze performance data and show that high-structure courses have a positive impact on class performance by decreasing the performance gap throughout the duration…
▽ More
We introduce the concept of structure-regions and their impact on student experience in large-enrollment frosh courses. These regions involve three major components: active learning, low-stakes assignments, and formative assessment. We analyze performance data and show that high-structure courses have a positive impact on class performance by decreasing the performance gap throughout the duration of a course.
△ Less
Submitted 26 November, 2021;
originally announced November 2021.
-
3D Convolution Neural Network based Person Identification using Gait cycles
Authors:
Ravi Shekhar Tiwari,
Supraja P,
Rijo Jackson Tom
Abstract:
Human identification plays a prominent role in terms of security. In modern times security is becoming the key term for an individual or a country, especially for countries which are facing internal or external threats. Gait analysis is interpreted as the systematic study of the locomotive in humans. It can be used to extract the exact walking features of individuals. Walking features depends on b…
▽ More
Human identification plays a prominent role in terms of security. In modern times security is becoming the key term for an individual or a country, especially for countries which are facing internal or external threats. Gait analysis is interpreted as the systematic study of the locomotive in humans. It can be used to extract the exact walking features of individuals. Walking features depends on biological as well as the physical feature of the object; hence, it is unique to every individual. In this work, gait features are used to identify an individual. The steps involve object detection, background subtraction, silhouettes extraction, skeletonization, and training 3D Convolution Neural Network on these gait features. The model is trained and evaluated on the dataset acquired by CASIA B Gait, which consists of 15000 videos of 124 subjects walking pattern captured from 11 different angles carrying objects such as bag and coat. The proposed method focuses more on the lower body part to extract features such as the angle between knee and thighs, hip angle, angle of contact, and many other features. The experimental results are compared with amongst accuracies of silhouettes as datasets for training and skeletonized image as training data. The results show that extracting the information from skeletonized data yields improved accuracy.
△ Less
Submitted 6 June, 2021;
originally announced June 2021.
-
An Explainable Machine Learning Model for Early Detection of Parkinson's Disease using LIME on DaTscan Imagery
Authors:
Pavan Rajkumar Magesh,
Richard Delwin Myloth,
Rijo Jackson Tom
Abstract:
Parkinson's disease (PD) is a degenerative and progressive neurological condition. Early diagnosis can improve treatment for patients and is performed through dopaminergic imaging techniques like the SPECT DaTscan. In this study, we propose a machine learning model that accurately classifies any given DaTscan as having Parkinson's disease or not, in addition to providing a plausible reason for the…
▽ More
Parkinson's disease (PD) is a degenerative and progressive neurological condition. Early diagnosis can improve treatment for patients and is performed through dopaminergic imaging techniques like the SPECT DaTscan. In this study, we propose a machine learning model that accurately classifies any given DaTscan as having Parkinson's disease or not, in addition to providing a plausible reason for the prediction. This is kind of reasoning is done through the use of visual indicators generated using Local Interpretable Model-Agnostic Explainer (LIME) methods. DaTscans were drawn from the Parkinson's Progression Markers Initiative database and trained on a CNN (VGG16) using transfer learning, yielding an accuracy of 95.2%, a sensitivity of 97.5%, and a specificity of 90.9%. Kee** model interpretability of paramount importance, especially in the healthcare field, this study utilises LIME explanations to distinguish PD from non-PD, using visual superpixels on the DaTscans. It could be concluded that the proposed system, in union with its measured interpretability and accuracy may effectively aid medical workers in the early diagnosis of Parkinson's Disease.
△ Less
Submitted 1 August, 2020;
originally announced August 2020.
-
Exploring the turbulent velocity gradients at different scales from the perspective of the strain-rate eigenframe
Authors:
Josin Tom,
Maurizio Carbone,
Andrew D Bragg
Abstract:
Expressing the evolution equations for the filtered velocity gradient tensor (FVGT) in the strain-rate eigenframe provides an insightful way to disentangle and understand various processes such as strain self-amplification, vortex stretching and tilting, and to consider their properties at different scales in the flow. Using data from Direct Numerical Simulation (DNS) of the forced Navier-Stokes e…
▽ More
Expressing the evolution equations for the filtered velocity gradient tensor (FVGT) in the strain-rate eigenframe provides an insightful way to disentangle and understand various processes such as strain self-amplification, vortex stretching and tilting, and to consider their properties at different scales in the flow. Using data from Direct Numerical Simulation (DNS) of the forced Navier-Stokes equation, we consider the relative importance of local and non-local terms in the FVGT eigenframe equations across the scales using statistical analysis. The analysis of the eigenframe rotation-rate, that drives vorticity tilting, shows that the anisotropic pressure Hessian plays a key role, with the sub-grid stress making an important contribution outside the dissipation range, and the local spinning due to vorticity making a much smaller contribution. The results also show the striking behavior that the vorticity tilting term remains highly intermittent even at relatively large scales. We derive a generalization of the Lumley triangle that allows us to show that the pressure Hessian has a preference for two-component axisymmetric configurations at small scales, with a transition to a more isotropic state at larger scales. Correlations between the sub-grid stress and other terms in the eigenframe equations are considered, highlighting the coupling between the sub-grid and nonlinear amplification terms, with the sub-grid term playing an important role in regularizing the system. These results provide useful guidelines for improving Lagrangian models of the FVGT, since current models fail to capture a number of subtle features observed in our results.
△ Less
Submitted 8 May, 2020;
originally announced May 2020.
-
Tensor Low Rank Modeling and Its Applications in Signal Processing
Authors:
Baburaj Madathil,
Sameera V Mohd Sagheer,
Abdu Rahiman V,
Anju Jose Tom,
Baiju P S,
Jobin Francis,
Sudhish N. George
Abstract:
Modeling of multidimensional signal using tensor is more convincing than representing it as a collection of matrices. The tensor based approaches can explore the abundant spatial and temporal structures of the mutlidimensional signal. The backbone of this modeling is the mathematical foundations of tensor algebra. The linear transform based tensor algebra furnishes low complex and high performance…
▽ More
Modeling of multidimensional signal using tensor is more convincing than representing it as a collection of matrices. The tensor based approaches can explore the abundant spatial and temporal structures of the mutlidimensional signal. The backbone of this modeling is the mathematical foundations of tensor algebra. The linear transform based tensor algebra furnishes low complex and high performance algebraic structures suitable for the introspection of the multidimensional signal. A comprehensive introduction of the linear transform based tensor algebra is provided from the signal processing viewpoint. The rank of a multidimensional signal is a precious property which gives an insight into the structural aspects of it. All natural multidimensional signals can be approximated to a low rank signal without losing significant information. The low rank approximation is beneficial in many signal processing applications such as denoising, missing sample estimation, resolution enhancement, classification, background estimation, object detection, deweathering, clustering and much more applications. Detailed case study of the ways and means of the low rank modeling in the above said signal processing applications are also presented.
△ Less
Submitted 6 December, 2019;
originally announced December 2019.
-
Business Process Privacy Analysis in Pleak
Authors:
Aivo Toots,
Reedik Tuuling,
Maksym Yerokhin,
Marlon Dumas,
Luciano García-Bañuelos,
Peeter Laud,
Raimundas Matulevičius,
Alisa Pankova,
Martin Pettai,
Pille Pullonen,
Jake Tom
Abstract:
Pleak is a tool to capture and analyze privacy-enhanced business process models to characterize and quantify to what extent the outputs of a process leak information about its inputs. Pleak incorporates an extensible set of analysis plugins, which enable users to inspect potential leakages at multiple levels of detail.
Pleak is a tool to capture and analyze privacy-enhanced business process models to characterize and quantify to what extent the outputs of a process leak information about its inputs. Pleak incorporates an extensible set of analysis plugins, which enable users to inspect potential leakages at multiple levels of detail.
△ Less
Submitted 13 February, 2019;
originally announced February 2019.
-
Multiscale preferential swee** of particles settling in turbulence
Authors:
Josin Tom,
Andrew D Bragg
Abstract:
In a seminal article, \citet[J. Fluid Mech., 174:441-465]{maxey87} presented a theoretical analysis showing that enhanced particle settling speeds in turbulence occur through the preferential swee** mechanism, which depends on the preferential sampling of the fluid velocity gradient field by the inertial particles. However, recent Direct Numerical Simulation (DNS) results in \citet[J. Fluid Mech…
▽ More
In a seminal article, \citet[J. Fluid Mech., 174:441-465]{maxey87} presented a theoretical analysis showing that enhanced particle settling speeds in turbulence occur through the preferential swee** mechanism, which depends on the preferential sampling of the fluid velocity gradient field by the inertial particles. However, recent Direct Numerical Simulation (DNS) results in \citet[J. Fluid Mech., 796:659--711]{ireland16b} show that even in a portion of the parameter space where this preferential sampling is absent, the particles nevertheless exhibit enhanced settling velocities. Further, there are several outstanding questions concerning the role of different turbulent flow scales on the enhanced settling, and the role of the Taylor Reynolds number $R_λ$. The analysis of Maxey does not explain these issues, partly since it was restricted to particle Stokes numbers $St\ll1$. To address these issues, we have developed a new theoretical result, valid for arbitrary $St$, that reveals the multiscale nature of the mechanism generating the enhanced settling speeds. In particular, it shows how the range of scales at which the preferential swee** mechanism operates depends on $St$. This analysis is complemented by results from DNS where we examine the role of different flow scales on the particle settling speeds by coarse-graining the underlying flow. The results show how the flow scales that contribute to the enhanced settling depend on $St$, and that contrary to previous claims, there can be no single turbulent velocity scale that characterizes the enhanced settling speed. The results explain the dependence of the particle settling speeds on $R_λ$, and show how the saturation of this dependence at sufficiently large $R_λ$ depends upon $St$. The results also show ...
△ Less
Submitted 20 April, 2019; v1 submitted 20 December, 2018;
originally announced December 2018.
-
Reuse, recycle, reweigh: Combating influenza through efficient sequential Bayesian computation for massive data
Authors:
Jennifer A. Tom,
Janet S. Sinsheimer,
Marc A. Suchard
Abstract:
Massive datasets in the gigabyte and terabyte range combined with the availability of increasingly sophisticated statistical tools yield analyses at the boundary of what is computationally feasible. Compromising in the face of this computational burden by partitioning the dataset into more tractable sizes results in stratified analyses, removed from the context that justified the initial data coll…
▽ More
Massive datasets in the gigabyte and terabyte range combined with the availability of increasingly sophisticated statistical tools yield analyses at the boundary of what is computationally feasible. Compromising in the face of this computational burden by partitioning the dataset into more tractable sizes results in stratified analyses, removed from the context that justified the initial data collection. In a Bayesian framework, these stratified analyses generate intermediate realizations, often compared using point estimates that fail to account for the variability within and correlation between the distributions these realizations approximate. However, although the initial concession to stratify generally precludes the more sensible analysis using a single joint hierarchical model, we can circumvent this outcome and capitalize on the intermediate realizations by extending the dynamic iterative reweighting MCMC algorithm. In doing so, we reuse the available realizations by reweighting them with importance weights, recycling them into a now tractable joint hierarchical model. We apply this technique to intermediate realizations generated from stratified analyses of 687 influenza A genomes spanning 13 years allowing us to revisit hypotheses regarding the evolutionary history of influenza within a hierarchical statistical framework.
△ Less
Submitted 5 January, 2011;
originally announced January 2011.
