-
Re-DiffiNet: Modeling discrepancies in tumor segmentation using diffusion models
Authors:
Tianyi Ren,
Abhishek Sharma,
Juampablo Heras Rivera,
Harshitha Rebala,
Ethan Honey,
Agamdeep Chopra,
Jacob Ruzevick,
Mehmet Kurt
Abstract:
Identification of tumor margins is essential for surgical decision-making for glioblastoma patients and provides reliable assistance for neurosurgeons. Despite improvements in deep learning architectures for tumor segmentation over the years, creating a fully autonomous system suitable for clinical floors remains a formidable challenge because the model predictions have not yet reached the desired…
▽ More
Identification of tumor margins is essential for surgical decision-making for glioblastoma patients and provides reliable assistance for neurosurgeons. Despite improvements in deep learning architectures for tumor segmentation over the years, creating a fully autonomous system suitable for clinical floors remains a formidable challenge because the model predictions have not yet reached the desired level of accuracy and generalizability for clinical applications. Generative modeling techniques have seen significant improvements in recent times. Specifically, Generative Adversarial Networks (GANs) and Denoising-diffusion-based models (DDPMs) have been used to generate higher-quality images with fewer artifacts and finer attributes. In this work, we introduce a framework called Re-Diffinet for modeling the discrepancy between the outputs of a segmentation model like U-Net and the ground truth, using DDPMs. By explicitly modeling the discrepancy, the results show an average improvement of 0.55\% in the Dice score and 16.28\% in HD95 from cross-validation over 5-folds, compared to the state-of-the-art U-Net segmentation model.
△ Less
Submitted 10 April, 2024; v1 submitted 11 February, 2024;
originally announced February 2024.
-
An Optimization Framework for Processing and Transfer Learning for the Brain Tumor Segmentation
Authors:
Tianyi Ren,
Ethan Honey,
Harshitha Rebala,
Abhishek Sharma,
Agamdeep Chopra,
Mehmet Kurt
Abstract:
Tumor segmentation from multi-modal brain MRI images is a challenging task due to the limited samples, high variance in shapes and uneven distribution of tumor morphology. The performance of automated medical image segmentation has been significant improvement by the recent advances in deep learning. However, the model predictions have not yet reached the desired level for clinical use in terms of…
▽ More
Tumor segmentation from multi-modal brain MRI images is a challenging task due to the limited samples, high variance in shapes and uneven distribution of tumor morphology. The performance of automated medical image segmentation has been significant improvement by the recent advances in deep learning. However, the model predictions have not yet reached the desired level for clinical use in terms of accuracy and generalizability. In order to address the distinct problems presented in Challenges 1, 2, and 3 of BraTS 2023, we have constructed an optimization framework based on a 3D U-Net model for brain tumor segmentation. This framework incorporates a range of techniques, including various pre-processing and post-processing techniques, and transfer learning. On the validation datasets, this multi-modality brain tumor segmentation framework achieves an average lesion-wise Dice score of 0.79, 0.72, 0.74 on Challenges 1, 2, 3 respectively.
△ Less
Submitted 10 February, 2024;
originally announced February 2024.
-
ExTTNet: A Deep Learning Algorithm for Extracting Table Texts from Invoice Images
Authors:
Adem Akdoğan,
Murat Kurt
Abstract:
In this work, product tables in invoices are obtained autonomously via a deep learning model, which is named as ExTTNet. Firstly, text is obtained from invoice images using Optical Character Recognition (OCR) techniques. Tesseract OCR engine [37] is used for this process. Afterwards, the number of existing features is increased by using feature extraction methods to increase the accuracy. Labeling…
▽ More
In this work, product tables in invoices are obtained autonomously via a deep learning model, which is named as ExTTNet. Firstly, text is obtained from invoice images using Optical Character Recognition (OCR) techniques. Tesseract OCR engine [37] is used for this process. Afterwards, the number of existing features is increased by using feature extraction methods to increase the accuracy. Labeling process is done according to whether each text obtained as a result of OCR is a table element or not. In this study, a multilayer artificial neural network model is used. The training has been carried out with an Nvidia RTX 3090 graphics card and taken $162$ minutes. As a result of the training, the F1 score is $0.92$.
△ Less
Submitted 3 February, 2024;
originally announced February 2024.
-
MelNet: A Real-Time Deep Learning Algorithm for Object Detection
Authors:
Yashar Azadvatan,
Murat Kurt
Abstract:
In this study, a novel deep learning algorithm for object detection, named MelNet, was introduced. MelNet underwent training utilizing the KITTI dataset for object detection. Following 300 training epochs, MelNet attained an mAP (mean average precision) score of 0.732. Additionally, three alternative models -YOLOv5, EfficientDet, and Faster-RCNN-MobileNetv3- were trained on the KITTI dataset and j…
▽ More
In this study, a novel deep learning algorithm for object detection, named MelNet, was introduced. MelNet underwent training utilizing the KITTI dataset for object detection. Following 300 training epochs, MelNet attained an mAP (mean average precision) score of 0.732. Additionally, three alternative models -YOLOv5, EfficientDet, and Faster-RCNN-MobileNetv3- were trained on the KITTI dataset and juxtaposed with MelNet for object detection.
The outcomes underscore the efficacy of employing transfer learning in certain instances. Notably, preexisting models trained on prominent datasets (e.g., ImageNet, COCO, and Pascal VOC) yield superior results. Another finding underscores the viability of creating a new model tailored to a specific scenario and training it on a specific dataset. This investigation demonstrates that training MelNet exclusively on the KITTI dataset also surpasses EfficientDet after 150 epochs. Consequently, post-training, MelNet's performance closely aligns with that of other pre-trained models.
△ Less
Submitted 31 January, 2024;
originally announced January 2024.
-
GenPluSSS: A Genetic Algorithm Based Plugin for Measured Subsurface Scattering Representation
Authors:
Barış Yıldırım,
Murat Kurt
Abstract:
This paper presents a plugin that adds a representation of homogeneous and heterogeneous, optically thick, translucent materials on the Blender 3D modeling tool. The working principle of this plugin is based on a combination of Genetic Algorithm (GA) and Singular Value Decomposition (SVD)-based subsurface scattering method (GenSSS). The proposed plugin has been implemented using Mitsuba renderer,…
▽ More
This paper presents a plugin that adds a representation of homogeneous and heterogeneous, optically thick, translucent materials on the Blender 3D modeling tool. The working principle of this plugin is based on a combination of Genetic Algorithm (GA) and Singular Value Decomposition (SVD)-based subsurface scattering method (GenSSS). The proposed plugin has been implemented using Mitsuba renderer, which is an open source rendering software. The proposed plugin has been validated on measured subsurface scattering data. It's shown that the proposed plugin visualizes homogeneous and heterogeneous subsurface scattering effects, accurately, compactly and computationally efficiently.
△ Less
Submitted 26 January, 2024;
originally announced January 2024.
-
A Bayesian hierarchical mixture cure modelling framework to utilize multiple survival datasets for long-term survivorship estimates: A case study from previously untreated metastatic melanoma
Authors:
Nathan Green,
Murat Kurt,
Andriy Moshyk,
James Larkin,
Gianluca Baio
Abstract:
Time to an event of interest over a lifetime is a central measure of the clinical benefit of an intervention used in a health technology assessment (HTA). Within the same trial multiple end-points may also be considered. For example, overall and progression-free survival time for different drugs in oncology studies. A common challenge is when an intervention is only effective for some proportion o…
▽ More
Time to an event of interest over a lifetime is a central measure of the clinical benefit of an intervention used in a health technology assessment (HTA). Within the same trial multiple end-points may also be considered. For example, overall and progression-free survival time for different drugs in oncology studies. A common challenge is when an intervention is only effective for some proportion of the population who are not clinically identifiable. Therefore, latent group membership as well as separate survival models for groups identified need to be estimated. However, follow-up in trials may be relatively short leading to substantial censoring. We present a general Bayesian hierarchical framework that can handle this complexity by exploiting the similarity of cure fractions between end-points; accounting for the correlation between them and improving the extrapolation beyond the observed data. Assuming exchangeability between cure fractions facilitates the borrowing of information between end-points. We show the benefits of using our approach with a motivating example, the CheckMate 067 phase 3 trial consisting of patients with metastatic melanoma treated with first line therapy.
△ Less
Submitted 24 January, 2024;
originally announced January 2024.
-
Hyper-Realist Rendering: A Theoretical Framework
Authors:
Ergun Akleman,
Murat Kurt,
Derya Akleman,
Gary Bruins,
Sitong Deng,
Meena Subramanian
Abstract:
This is the first paper in a series on hyper-realist rendering. In this paper, we introduce the concept of hyper-realist rendering and present a theoretical framework to obtain hyper-realist images. We are using the term Hyper-realism as an umbrella word that captures all types of visual artifacts that can evoke an impression of reality. The hyper-realist artifacts are visual representations that…
▽ More
This is the first paper in a series on hyper-realist rendering. In this paper, we introduce the concept of hyper-realist rendering and present a theoretical framework to obtain hyper-realist images. We are using the term Hyper-realism as an umbrella word that captures all types of visual artifacts that can evoke an impression of reality. The hyper-realist artifacts are visual representations that are not necessarily created by following logical and physical principles and can still be perceived as representations of reality. This idea stems from the principles of representational arts, which attain visually acceptable renderings of scenes without implementing strict physical laws of optics and materials. The objective of this work is to demonstrate that it is possible to obtain visually acceptable illusions of reality by employing such artistic approaches. With representational art methods, we can even obtain an alternate illusion of reality that looks more real even when it is not real. This paper demonstrates that it is common to create illusions of reality in visual arts with examples of paintings by representational artists. We propose an approach to obtain expressive local and global illuminations to obtain these stylistic illusions with a set of well-defined and formal methods.
△ Less
Submitted 23 January, 2024;
originally announced January 2024.
-
QFT based quantum arithmetic logic unit on IBM quantum computer
Authors:
Selçuk Çakmak,
Murat Kurt,
Azmi Gençten
Abstract:
In this study, we constructed a primitive quantum arithmetic logic unit (qALU) based on the quantum Fourier transform. The qALU is capable of performing arithmetic ADD (addition) and logic NAND gate operations. We presented two versions of the arithmetic logic unit, with two-input and four-input capabilities. By comparing the required number of quantum gates for serial and parallel architectures i…
▽ More
In this study, we constructed a primitive quantum arithmetic logic unit (qALU) based on the quantum Fourier transform. The qALU is capable of performing arithmetic ADD (addition) and logic NAND gate operations. We presented two versions of the arithmetic logic unit, with two-input and four-input capabilities. By comparing the required number of quantum gates for serial and parallel architectures in executing arithmetic addition, we evaluated the performance. We executed our quantum Fourier transform based qALU design on real quantum computer hardware provided by IBM. The results demonstrated that the proposed circuit can perform arithmetic and logic operations with a high success rate. Furthermore, we discussed the potential implementation of qALU circuit in the field of computer science, highlighting the possibility of constructing soft-core processor on quantum processing unit.
△ Less
Submitted 15 June, 2023;
originally announced June 2023.
-
Effects of surface roughness on the propulsive performance of pitching foils
Authors:
Rodrigo Vilumbrales-Garcia,
Melike Kurt,
Gabriel D. Weymouth,
Bharathram Ganapathisubramani
Abstract:
The hydrodynamic influence of surface texture on static surfaces ranges from large drag penalties (roughness) to potential performance benefits (shark-like skin). Although, it is of wide-ranging research interest, the impact of roughness on flap** systems has received limited attention. In this work, we explore the effect of roughness on unsteady performance of a harmonically pitching foil throu…
▽ More
The hydrodynamic influence of surface texture on static surfaces ranges from large drag penalties (roughness) to potential performance benefits (shark-like skin). Although, it is of wide-ranging research interest, the impact of roughness on flap** systems has received limited attention. In this work, we explore the effect of roughness on unsteady performance of a harmonically pitching foil through experiments using foils with different surface roughness, at a fixed Strouhal number and within the Reynolds number (Re) range of 15k-30k. The foils' surface roughness is altered by changing the distribution of spherical-cap shaped elements over the propulsor area. We find that the addition of surface roughness does not improve the performance compared to a smooth surface over the Re range considered. The analysis of the flow fields shows near identical wakes regardless of the foil's surface roughness. The performance reduction mainly occurs due to an increase in profile drag. However, we find that the drag penalty due to roughness is reduced from 76% for a static foil to 16% for a flap** foil at the same mean angle of attack, with the strongest decrease measured at the highest Re. Our findings highlight that the effect of roughness on dynamic systems is very different than that on static systems, thereby, cannot be accounted for by only using information obtained from static cases. This also indicates that the performance of unsteady, flap** systems is more robust to the changes in surface roughness.
△ Less
Submitted 10 January, 2023;
originally announced January 2023.
-
3D Inception-Based TransMorph: Pre- and Post-operative Multi-contrast MRI Registration in Brain Tumors
Authors:
Javid Abderezaei,
Aymeric Pionteck,
Agamdeep Chopra,
Mehmet Kurt
Abstract:
Deformable image registration is a key task in medical image analysis. The Brain Tumor Sequence Registration challenge (BraTS-Reg) aims at establishing correspondences between pre-operative and follow-up scans of the same patient diagnosed with an adult brain diffuse high-grade glioma and intends to address the challenging task of registering longitudinal data with major tissue appearance changes.…
▽ More
Deformable image registration is a key task in medical image analysis. The Brain Tumor Sequence Registration challenge (BraTS-Reg) aims at establishing correspondences between pre-operative and follow-up scans of the same patient diagnosed with an adult brain diffuse high-grade glioma and intends to address the challenging task of registering longitudinal data with major tissue appearance changes. In this work, we proposed a two-stage cascaded network based on the Inception and TransMorph models. The dataset for each patient was comprised of a native pre-contrast (T1), a contrast-enhanced T1-weighted (T1-CE), a T2-weighted (T2), and a Fluid Attenuated Inversion Recovery (FLAIR). The Inception model was used to fuse the 4 image modalities together and extract the most relevant information. Then, a variant of the TransMorph architecture was adapted to generate the displacement fields. The Loss function was composed of a standard image similarity measure, a diffusion regularizer, and an edge-map similarity measure added to overcome intensity dependence and reinforce correct boundary deformation. We observed that the addition of the Inception module substantially increased the performance of the network. Additionally, performing an initial affine registration before training the model showed improved accuracy in the landmark error measurements between pre and post-operative MRIs. We observed that our best model composed of the Inception and TransMorph architectures while using an initially affine registered dataset had the best performance with a median absolute error of 2.91 (initial error = 7.8). We achieved 6th place at the time of model submission in the final testing phase of the BraTS-Reg challenge.
△ Less
Submitted 8 December, 2022;
originally announced December 2022.
-
The Brain Tumor Sequence Registration (BraTS-Reg) Challenge: Establishing Correspondence Between Pre-Operative and Follow-up MRI Scans of Diffuse Glioma Patients
Authors:
Bhakti Baheti,
Satrajit Chakrabarty,
Hamed Akbari,
Michel Bilello,
Benedikt Wiestler,
Julian Schwarting,
Evan Calabrese,
Jeffrey Rudie,
Syed Abidi,
Mina Mousa,
Javier Villanueva-Meyer,
Brandon K. K. Fields,
Florian Kofler,
Russell Takeshi Shinohara,
Juan Eugenio Iglesias,
Tony C. W. Mok,
Albert C. S. Chung,
Marek Wodzinski,
Artur Jurgas,
Niccolo Marini,
Manfredo Atzori,
Henning Muller,
Christoph Grobroehmer,
Hanna Siebert,
Lasse Hansen
, et al. (48 additional authors not shown)
Abstract:
Registration of longitudinal brain MRI scans containing pathologies is challenging due to dramatic changes in tissue appearance. Although there has been progress in develo** general-purpose medical image registration techniques, they have not yet attained the requisite precision and reliability for this task, highlighting its inherent complexity. Here we describe the Brain Tumor Sequence Registr…
▽ More
Registration of longitudinal brain MRI scans containing pathologies is challenging due to dramatic changes in tissue appearance. Although there has been progress in develo** general-purpose medical image registration techniques, they have not yet attained the requisite precision and reliability for this task, highlighting its inherent complexity. Here we describe the Brain Tumor Sequence Registration (BraTS-Reg) challenge, as the first public benchmark environment for deformable registration algorithms focusing on estimating correspondences between pre-operative and follow-up scans of the same patient diagnosed with a diffuse brain glioma. The BraTS-Reg data comprise de-identified multi-institutional multi-parametric MRI (mpMRI) scans, curated for size and resolution according to a canonical anatomical template, and divided into training, validation, and testing sets. Clinical experts annotated ground truth (GT) landmark points of anatomical locations distinct across the temporal domain. Quantitative evaluation and ranking were based on the Median Euclidean Error (MEE), Robustness, and the determinant of the Jacobian of the displacement field. The top-ranked methodologies yielded similar performance across all evaluation metrics and shared several methodological commonalities, including pre-alignment, deep neural networks, inverse consistency analysis, and test-time instance optimization per-case basis as a post-processing step. The top-ranked method attained the MEE at or below that of the inter-rater variability for approximately 60% of the evaluated landmarks, underscoring the scope for further accuracy and robustness improvements, especially relative to human experts. The aim of BraTS-Reg is to continue to serve as an active resource for research, with the data and online evaluation tools accessible at https://bratsreg.github.io/.
△ Less
Submitted 17 April, 2024; v1 submitted 13 December, 2021;
originally announced December 2021.
-
Two-dimensionally stable self-organization arises in simple schooling swimmers through hydrodynamic interactions
Authors:
Pedro Costa Ormonde,
Melike Kurt,
Amin Mivehchi,
Keith W. Moored
Abstract:
We present new constrained and free-swimming experiments and simulations of a pair of pitching hydrofoils interacting in a minimal school. The hydrofoils have an out-of-phase synchronization and they are varied through in-line, staggered, and side-by-side formations within the two-dimensional interaction plane. It is discovered that there is a \textit{two-dimensionally} stable equilibrium point fo…
▽ More
We present new constrained and free-swimming experiments and simulations of a pair of pitching hydrofoils interacting in a minimal school. The hydrofoils have an out-of-phase synchronization and they are varied through in-line, staggered, and side-by-side formations within the two-dimensional interaction plane. It is discovered that there is a \textit{two-dimensionally} stable equilibrium point for a side-by-side formation. In fact, this formation is super-stable, meaning that hydrodynamic forces will passively maintain this formation even under external perturbations and the school as a whole has no net forces acting on it that cause it to drift to one side or the other. Moreover, previously discovered \textit{one-dimensionally} stable equilibria driven by wake vortex interactions are shown to be, in fact, two-dimensionally \textit{unstable}, at least for an out-of-phase synchronization. Additionally, it is discovered that a trailing-edge vortex mechanism provides the restorative force to stabilize a side-by-side formation. The stable equilibrium is further verified by experiments and simulations for freely-swimming foils where dynamic recoil motions are present. When constrained, swimmers in compact side-by-side formations experience collective efficiency and thrust increases up to 40\% and 100\%, respectively, whereas slightly staggered formations output an even higher efficiency improvement of 84\% with a 87\% increase in thrust. Freely-swimming foils in a stable side-by-side formation show an efficiency and speed enhancement of up to 9\% and 15\%, respectively. These newfound schooling performance and stability characteristics suggest that fluid-mediated equilibria may play a role in the control strategies of schooling fish and fish-inspired robots.
△ Less
Submitted 31 July, 2023; v1 submitted 6 February, 2021;
originally announced February 2021.
-
Scaling Laws for the Propulsive Performance of a Purely Pitching Foil in Ground Effect
Authors:
Amin Mivehchi,
Qiang Zhang,
Melike Kurt,
Daniel B. Quinn,
Keith W. Moored
Abstract:
Scaling laws for the thrust production and power consumption of a purely pitching hydrofoil in ground effect are presented. For the first time, ground effect scaling laws based on physical insights capture the propulsive performance over a wide range of biologically-relevant Strouhal numbers, dimensionless amplitudes, and dimensionless ground distances. This is achieved by advancing previous scali…
▽ More
Scaling laws for the thrust production and power consumption of a purely pitching hydrofoil in ground effect are presented. For the first time, ground effect scaling laws based on physical insights capture the propulsive performance over a wide range of biologically-relevant Strouhal numbers, dimensionless amplitudes, and dimensionless ground distances. This is achieved by advancing previous scaling laws (Moored & Quinn 2018) with physics-driven modifications to the added mass and circulatory forces to account for ground distance variations. The key physics introduced are the increase in the added mass of a foil near the ground and the reduction in the influence of a wake vortex system due to the influence of its image system. The scaling laws are found to be in good agreement with new inviscid simulations and viscous experiments, and can be used to accelerate the design of bio-inspired hydrofoils that oscillate near a ground plane or two out-of-phase foils in a side-by-side arrangement.
△ Less
Submitted 23 November, 2020;
originally announced November 2020.
-
Exact solutions for ground effect
Authors:
Peter J. Baddoo,
Melike Kurt,
Lorna J. Ayton,
Keith W. Moored
Abstract:
"Ground effect" refers to the enhanced performance enjoyed by fliers or swimmers operating close to the ground. We derive a number of exact solutions for this phenomenon, thereby elucidating the underlying physical mechanisms involved in ground effect. Unlike previous analytic studies, our solutions are not restricted to particular parameter regimes such as "weak" or "extreme" ground effect, and d…
▽ More
"Ground effect" refers to the enhanced performance enjoyed by fliers or swimmers operating close to the ground. We derive a number of exact solutions for this phenomenon, thereby elucidating the underlying physical mechanisms involved in ground effect. Unlike previous analytic studies, our solutions are not restricted to particular parameter regimes such as "weak" or "extreme" ground effect, and do not even require thin aerofoil theory. Moreover, the solutions are valid for a hitherto intractable range of flow phenomena including point vortices, uniform and straining flows, unsteady motions of the wing, and the Kutta condition. We model the ground effect as the potential flow past a wing inclined above a flat wall. The solution of the model requires two steps: firstly, a coordinate transformation between the physical domain and a concentric annulus, and secondly, the solution of the potential flow problem inside the annulus. We show that both steps can be solved by introducing a new special function which is straightforward to compute. Moreover, the ensuing solutions are simple to express and offer new insight into the mathematical structure of ground effect. In order to identify the missing physics in our potential flow model, we compare our solutions against new experimental data. The experiments show that boundary layer separation on the wing and wall occurs at small angles of attack, and we suggest ways in which our model could be extended to account for these effects.
△ Less
Submitted 5 December, 2019;
originally announced December 2019.
-
The physical studies and interaction with anti-apoptotic proteins of 2-(bis(cyanomethyl)amino)-2-oxoethyl methacrylate molecule
Authors:
S. Yalcin,
E. B. Sas,
N. Cankaya,
F. Ercan,
M. Kurt
Abstract:
In this work 2-(bis(cyanomethyl)amino)-2-oxoethyl methacrylate (CMA2OEM) molecule has been characterized theoretically. First, the potential energy surface has been calculated to find the lowest energy state of the molecule. After the most stable state of the molecule, Mulliken atomic charge and nonlinear-optical properties were investigated. Also in the study, binding poses of CMA2OEM molecule an…
▽ More
In this work 2-(bis(cyanomethyl)amino)-2-oxoethyl methacrylate (CMA2OEM) molecule has been characterized theoretically. First, the potential energy surface has been calculated to find the lowest energy state of the molecule. After the most stable state of the molecule, Mulliken atomic charge and nonlinear-optical properties were investigated. Also in the study, binding poses of CMA2OEM molecule and anti-apoptotic proteins, such as BCL-2, BCL-w, MCL-1, AKT1 and BRAF were investigated. The molecular docking results showed that the most stable complex was obtained with this molecule and BRAF protein. The molecular docking results showed that the most stable complex was obtained with this molecule and serine/threonine-protein kinase protein. This study suggested that molecular docking approach may be a potential tool to identify the hydrogen bond interactions in order to treat a disease. Finally, this new ligand could pave the way to experimental studies.
△ Less
Submitted 2 October, 2019;
originally announced October 2019.
-
Secure Distributed Dynamic State Estimation in Wide-Area Smart Grids
Authors:
Mehmet Necip Kurt,
Yasin Yilmaz,
Xiaodong Wang
Abstract:
Smart grid is a large complex network with a myriad of vulnerabilities, usually operated in adversarial settings and regulated based on estimated system states. In this study, we propose a novel highly secure distributed dynamic state estimation mechanism for wide-area (multi-area) smart grids, composed of geographically separated subregions, each supervised by a local control center. We firstly p…
▽ More
Smart grid is a large complex network with a myriad of vulnerabilities, usually operated in adversarial settings and regulated based on estimated system states. In this study, we propose a novel highly secure distributed dynamic state estimation mechanism for wide-area (multi-area) smart grids, composed of geographically separated subregions, each supervised by a local control center. We firstly propose a distributed state estimator assuming regular system operation, that achieves near-optimal performance based on the local Kalman filters and with the exchange of necessary information between local centers. To enhance the security, we further propose to (i) protect the network database and the network communication channels against attacks and data manipulations via a blockchain (BC)-based system design, where the BC operates on the peer-to-peer network of local centers, (ii) locally detect the measurement anomalies in real-time to eliminate their effects on the state estimation process, and (iii) detect misbehaving (hacked/faulty) local centers in real-time via a distributed trust management scheme over the network. We provide theoretical guarantees regarding the false alarm rates of the proposed detection schemes, where the false alarms can be easily controlled. Numerical studies illustrate that the proposed mechanism offers reliable state estimation under regular system operation, timely and accurate detection of anomalies, and good state recovery performance in case of anomalies.
△ Less
Submitted 14 July, 2019; v1 submitted 19 February, 2019;
originally announced February 2019.
-
Multi-directional dynamic model for traumatic brain injury detection
Authors:
Kaveh Laksari,
Michael Fanton,
Lyndia C. Wu,
Taylor H. Nguyen,
Mehmet Kurt,
Chiara Giordano,
Eoin Kelly,
Eoin O'Keeffe,
Eugene Wallace,
Colin Doherty,
Matthew Campbell,
Stephen Tiernan,
Gerald Grant,
Jesse Ruan,
Saeed Barbat,
David B. Camarillo
Abstract:
Traumatic brain injury (TBI) is a complex injury that is hard to predict and diagnose, with many studies focused on associating head kinematics to brain injury risk. Recently, there has been a push towards using computationally expensive finite element (FE) models of the brain to create tissue deformation metrics of brain injury. Here, we developed a 3 degree-of-freedom lumped-parameter brain mode…
▽ More
Traumatic brain injury (TBI) is a complex injury that is hard to predict and diagnose, with many studies focused on associating head kinematics to brain injury risk. Recently, there has been a push towards using computationally expensive finite element (FE) models of the brain to create tissue deformation metrics of brain injury. Here, we developed a 3 degree-of-freedom lumped-parameter brain model, built based on the measured natural frequencies of a FE brain model simulated with live human impact data, to be used to rapidly estimate peak brain strains experienced during head rotational accelerations. On our dataset, the simplified model correlates with peak principal FE strain by an R2 of 0.80. Further, coronal and axial model displacement correlated with fiber-oriented peak strain in the corpus callosum with an R2 of 0.77. Using the maximum displacement predicted by our brain model, we propose an injury criteria and compare it against a number of existing rotational and translational kinematic injury metrics on a dataset of head kinematics from 27 clinically diagnosed injuries and 887 non-injuries. We found that our proposed metric performed comparably to peak angular acceleration, linear acceleration, and angular velocity in classifying injury and non-injury events. Metrics which separated time traces into their directional components had improved deviance to those which combined components into a single time trace magnitude. Our brain model can be used in future work as a computationally efficient alternative to FE models for classifying injuries over a wide range of loading conditions.
△ Less
Submitted 2 April, 2019; v1 submitted 18 December, 2018;
originally announced December 2018.
-
Online Cyber-Attack Detection in Smart Grid: A Reinforcement Learning Approach
Authors:
Mehmet Necip Kurt,
Oyetunji Ogundijo,
Chong Li,
Xiaodong Wang
Abstract:
Early detection of cyber-attacks is crucial for a safe and reliable operation of the smart grid. In the literature, outlier detection schemes making sample-by-sample decisions and online detection schemes requiring perfect attack models have been proposed. In this paper, we formulate the online attack/anomaly detection problem as a partially observable Markov decision process (POMDP) problem and p…
▽ More
Early detection of cyber-attacks is crucial for a safe and reliable operation of the smart grid. In the literature, outlier detection schemes making sample-by-sample decisions and online detection schemes requiring perfect attack models have been proposed. In this paper, we formulate the online attack/anomaly detection problem as a partially observable Markov decision process (POMDP) problem and propose a universal robust online detection algorithm using the framework of model-free reinforcement learning (RL) for POMDPs. Numerical studies illustrate the effectiveness of the proposed RL-based algorithm in timely and accurate detection of cyber-attacks targeting the smart grid.
△ Less
Submitted 14 September, 2018;
originally announced September 2018.
-
Real-Time Nonparametric Anomaly Detection in High-Dimensional Settings
Authors:
Mehmet Necip Kurt,
Yasin Yilmaz,
Xiaodong Wang
Abstract:
Timely detection of abrupt anomalies is crucial for real-time monitoring and security of modern systems producing high-dimensional data. With this goal, we propose effective and scalable algorithms. Proposed algorithms are nonparametric as both the nominal and anomalous multivariate data distributions are assumed unknown. We extract useful univariate summary statistics and perform anomaly detectio…
▽ More
Timely detection of abrupt anomalies is crucial for real-time monitoring and security of modern systems producing high-dimensional data. With this goal, we propose effective and scalable algorithms. Proposed algorithms are nonparametric as both the nominal and anomalous multivariate data distributions are assumed unknown. We extract useful univariate summary statistics and perform anomaly detection in a single-dimensional space. We model anomalies as persistent outliers and propose to detect them via a cumulative sum-like algorithm. In case the observed data have a low intrinsic dimensionality, we learn a submanifold in which the nominal data are embedded and evaluate whether the sequentially acquired data persistently deviate from the nominal submanifold. Further, in the general case, we learn an acceptance region for nominal data via Geometric Entropy Minimization and evaluate whether the sequentially observed data persistently fall outside the acceptance region. We provide an asymptotic lower bound and an asymptotic approximation for the average false alarm period of the proposed algorithm. Moreover, we provide a sufficient condition to asymptotically guarantee that the decision statistic of the proposed algorithm does not diverge in the absence of anomalies. Experiments illustrate the effectiveness of the proposed schemes in quick and accurate anomaly detection in high-dimensional settings.
△ Less
Submitted 27 January, 2020; v1 submitted 14 September, 2018;
originally announced September 2018.
-
Real-Time Detection of Hybrid and Stealthy Cyber-Attacks in Smart Grid
Authors:
Mehmet Necip Kurt,
Yasin Yilmaz,
Xiaodong Wang
Abstract:
For a safe and reliable operation of the smart grid, timely detection of cyber-attacks is of critical importance. Moreover, considering smarter and more capable attackers, robust detection mechanisms are needed against a diverse range of cyber-attacks. With these purposes, we propose a robust online detection algorithm for (possibly combined) false data injection (FDI) and jamming attacks, that al…
▽ More
For a safe and reliable operation of the smart grid, timely detection of cyber-attacks is of critical importance. Moreover, considering smarter and more capable attackers, robust detection mechanisms are needed against a diverse range of cyber-attacks. With these purposes, we propose a robust online detection algorithm for (possibly combined) false data injection (FDI) and jamming attacks, that also provides online estimates of the unknown and time-varying attack parameters and recovered state estimates. Further, considering smarter attackers that are capable of designing stealthy attacks to prevent the detection or to increase the detection delay of the proposed algorithm, we propose additional countermeasures. Numerical studies illustrate the quick and reliable response of the proposed detection mechanisms against hybrid and stealthy cyber-attacks.
△ Less
Submitted 27 June, 2018; v1 submitted 28 February, 2018;
originally announced March 2018.
-
Multi-Sensor Sequential Change Detection with Unknown Change Propagation Pattern
Authors:
Mehmet Necip Kurt,
Xiaodong Wang
Abstract:
The problem of detecting changes with multiple sensors has received significant attention in the literature. In many practical applications such as critical infrastructure monitoring and modeling of disease spread, a useful change propagation model is one where change eventually happens at all sensors, but where not all sensors witness change at the same time instant. While prior work considered t…
▽ More
The problem of detecting changes with multiple sensors has received significant attention in the literature. In many practical applications such as critical infrastructure monitoring and modeling of disease spread, a useful change propagation model is one where change eventually happens at all sensors, but where not all sensors witness change at the same time instant. While prior work considered the case of known change propagation dynamics, this paper studies a more general setting of unknown change propagation pattern (trajectory). A Bayesian formulation of the problem in both centralized and decentralized settings is studied with the goal of detecting the first time instant at which any sensor witnesses a change. Using the dynamic programming (DP) framework, the optimal solution structure is derived and in the rare change regime, several more practical change detection algorithms are proposed. Under certain conditions, the first-order asymptotic optimality of a proposed algorithm called multichart test is shown as the false alarm probability vanishes. To further reduce the computational complexity, change detection algorithms are proposed based on online estimation of the unknown change propagation pattern. Numerical studies illustrate that the proposed detection techniques offer near-optimal performance. Further, in the decentralized setting, it is shown that if an event-triggered sampling scheme called level-crossing sampling with hysteresis (LCSH) is used for sampling and transmission of local statistics, the detection performance can be significantly improved using the same amount of communication resources compared to the conventional uniform-in-time sampling (US) scheme.
△ Less
Submitted 20 September, 2018; v1 submitted 15 August, 2017;
originally announced August 2017.
-
Optimal Jammer Placement in Wireless Localization Systems
Authors:
Sinan Gezici,
Suat Bayram,
Mehmet Necip Kurt,
Mohammad Reza Gholami
Abstract:
In this study, the optimal jammer placement problem is proposed and analyzed for wireless localization systems. In particular, the optimal location of a jammer node is obtained by maximizing the minimum of the Cramer-Rao lower bounds (CRLBs) for a number of target nodes under location related constraints for the jammer node. For scenarios with more than two target nodes, theoretical results are de…
▽ More
In this study, the optimal jammer placement problem is proposed and analyzed for wireless localization systems. In particular, the optimal location of a jammer node is obtained by maximizing the minimum of the Cramer-Rao lower bounds (CRLBs) for a number of target nodes under location related constraints for the jammer node. For scenarios with more than two target nodes, theoretical results are derived to specify conditions under which the jammer node is located as close to a certain target node as possible, or the optimal location of the jammer node is determined by two of the target nodes. Also, explicit expressions are provided for the optimal location of the jammer node in the presence of two target nodes. In addition, in the absence of distance constraints for the jammer node, it is proved, for scenarios with more than two target nodes, that the optimal jammer location lies on the convex hull formed by the locations of the target nodes and is determined by two or three of the target nodes, which have equalized CRLBs. Numerical examples are presented to provide illustrations of the theoretical results in different scenarios.
△ Less
Submitted 24 May, 2016;
originally announced May 2016.
-
In vivo evaluation of wearable head impact sensors
Authors:
Lyndia C. Wu,
Vaibhav Nangia,
Kevin Bui,
Bradley Hammoor,
Mehmet Kurt,
Fidel Hernandez,
Calvin Kuo,
David B. Camarillo
Abstract:
Inertial sensors are commonly used to measure human head motion. Some sensors have been validated with dummy or cadaver experiments, but methods to evaluate sensors in vivo are lacking. Here we present an in vivo method using high speed video to evaluate teeth-mounted (mouthguard), soft tissue-mounted (skin patch), and headgear-mounted (skull cap) sensors during 6-13g sagittal soccer head impacts.…
▽ More
Inertial sensors are commonly used to measure human head motion. Some sensors have been validated with dummy or cadaver experiments, but methods to evaluate sensors in vivo are lacking. Here we present an in vivo method using high speed video to evaluate teeth-mounted (mouthguard), soft tissue-mounted (skin patch), and headgear-mounted (skull cap) sensors during 6-13g sagittal soccer head impacts. Sensor coupling to the skull is quantified by displacement from an ear-canal reference. Mouthguard displacements were within video measurement error (<1mm), while the skin patch and skull cap displaced up to 4mm and 13mm from the ear-canal reference, respectively. We used the mouthguard, which had the least displacement from skull, as the reference to assess 6-degree-of-freedom skin patch and skull cap measurements. Linear and rotational acceleration magnitudes were over-predicted by both the skin patch (with 120% NRMS error for a_mag, 290% for alpha_mag) and the skull cap (320% NRMS error for a_mag, 500% for alpha_mag). Such over-predictions were largely due to out-of-plane motion. To model sensor error, we found that in-plane acceleration peaks from the skin patch in the anterior-posterior direction could be modeled by an underdamped viscoelastic system. In summary, the mouthguard showed tighter skull coupling in vivo than the other sensors. Furthermore, the in vivo methods presented are valuable for investigating skull acceleration sensor technologies.
△ Less
Submitted 20 August, 2015; v1 submitted 13 March, 2015;
originally announced March 2015.
