-
Information Flow in Graph Neural Networks: A Clinical Triage Use Case
Authors:
Víctor Valls,
Mykhaylo Zayats,
Alessandra Pascale
Abstract:
Graph Neural Networks (GNNs) have gained popularity in healthcare and other domains due to their ability to process multi-modal and multi-relational graphs. However, efficient training of GNNs remains challenging, with several open research questions. In this paper, we investigate how the flow of embedding information within GNNs affects the prediction of links in Knowledge Graphs (KGs). Specifica…
▽ More
Graph Neural Networks (GNNs) have gained popularity in healthcare and other domains due to their ability to process multi-modal and multi-relational graphs. However, efficient training of GNNs remains challenging, with several open research questions. In this paper, we investigate how the flow of embedding information within GNNs affects the prediction of links in Knowledge Graphs (KGs). Specifically, we propose a mathematical model that decouples the GNN connectivity from the connectivity of the graph data and evaluate the performance of GNNs in a clinical triage use case. Our results demonstrate that incorporating domain knowledge into the GNN connectivity leads to better performance than using the same connectivity as the KG or allowing unconstrained embedding propagation. Moreover, we show that negative edges play a crucial role in achieving good predictions, and that using too many GNN layers can degrade performance.
△ Less
Submitted 12 September, 2023;
originally announced September 2023.
-
A recommender for the management of chronic pain in patients undergoing spinal cord stimulation
Authors:
Tigran Tchrakian,
Mykhaylo Zayats,
Alessandra Pascale,
Dat Huynh,
Pritish Parida,
Carla Agurto Rios,
Sergiy Zhuk,
Jeffrey L. Rogers,
ENVISION Studies Physician Author Group,
Boston Scientific Research Scientists Consortium
Abstract:
Spinal cord stimulation (SCS) is a therapeutic approach used for the management of chronic pain. It involves the delivery of electrical impulses to the spinal cord via an implanted device, which when given suitable stimulus parameters can mask or block pain signals. Selection of optimal stimulation parameters usually happens in the clinic under the care of a provider whereas at-home SCS optimizati…
▽ More
Spinal cord stimulation (SCS) is a therapeutic approach used for the management of chronic pain. It involves the delivery of electrical impulses to the spinal cord via an implanted device, which when given suitable stimulus parameters can mask or block pain signals. Selection of optimal stimulation parameters usually happens in the clinic under the care of a provider whereas at-home SCS optimization is managed by the patient. In this paper, we propose a recommender system for the management of pain in chronic pain patients undergoing SCS. In particular, we use a contextual multi-armed bandit (CMAB) approach to develop a system that recommends SCS settings to patients with the aim of improving their condition. These recommendations, sent directly to patients though a digital health ecosystem, combined with a patient monitoring system closes the therapeutic loop around a chronic pain patient over their entire patient journey. We evaluated the system in a cohort of SCS-implanted ENVISION study subjects (Clinicaltrials.gov ID: NCT03240588) using a combination of quality of life metrics and Patient States (PS), a novel measure of holistic outcomes. SCS recommendations provided statistically significant improvement in clinical outcomes (pain and/or QoL) in 85\% of all subjects (N=21). Among subjects in moderate PS (N=7) prior to receiving recommendations, 100\% showed statistically significant improvements and 5/7 had improved PS dwell time. This analysis suggests SCS patients may benefit from SCS recommendations, resulting in additional clinical improvement on top of benefits already received from SCS therapy.
△ Less
Submitted 6 September, 2023;
originally announced September 2023.
-
Otter-Knowledge: benchmarks of multimodal knowledge graph representation learning from different sources for drug discovery
Authors:
Hoang Thanh Lam,
Marco Luca Sbodio,
Marcos Martínez Galindo,
Mykhaylo Zayats,
Raúl Fernández-Díaz,
Víctor Valls,
Gabriele Picco,
Cesar Berrospi Ramis,
Vanessa López
Abstract:
Recent research on predicting the binding affinity between drug molecules and proteins use representations learned, through unsupervised learning techniques, from large databases of molecule SMILES and protein sequences. While these representations have significantly enhanced the predictions, they are usually based on a limited set of modalities, and they do not exploit available knowledge about e…
▽ More
Recent research on predicting the binding affinity between drug molecules and proteins use representations learned, through unsupervised learning techniques, from large databases of molecule SMILES and protein sequences. While these representations have significantly enhanced the predictions, they are usually based on a limited set of modalities, and they do not exploit available knowledge about existing relations among molecules and proteins. In this study, we demonstrate that by incorporating knowledge graphs from diverse sources and modalities into the sequences or SMILES representation, we can further enrich the representation and achieve state-of-the-art results for drug-target binding affinity prediction in the established Therapeutic Data Commons (TDC) benchmarks. We release a set of multimodal knowledge graphs, integrating data from seven public data sources, and containing over 30 million triples. Our intention is to foster additional research to explore how multimodal knowledge enhanced protein/molecule embeddings can improve prediction tasks, including prediction of binding affinity. We also release some pretrained models learned from our multimodal knowledge graphs, along with source code for running standard benchmark tasks for prediction of biding affinity.
△ Less
Submitted 19 October, 2023; v1 submitted 22 June, 2023;
originally announced June 2023.
-
Super Resolution for Turbulent Flows in 2D: Stabilized Physics Informed Neural Networks
Authors:
Mykhaylo Zayats,
Małgorzata J. Zimoń,
Kyongmin Yeo,
Sergiy Zhuk
Abstract:
We propose a new design of a neural network for solving a zero shot super resolution problem for turbulent flows. We embed Luenberger-type observer into the network's architecture to inform the network of the physics of the process, and to provide error correction and stabilization mechanisms. In addition, to compensate for decrease of observer's performance due to the presence of unknown destabil…
▽ More
We propose a new design of a neural network for solving a zero shot super resolution problem for turbulent flows. We embed Luenberger-type observer into the network's architecture to inform the network of the physics of the process, and to provide error correction and stabilization mechanisms. In addition, to compensate for decrease of observer's performance due to the presence of unknown destabilizing forcing, the network is designed to estimate the contribution of the unknown forcing implicitly from the data over the course of training. By running a set of numerical experiments, we demonstrate that the proposed network does recover unknown forcing from data and is capable of predicting turbulent flows in high resolution from low resolution noisy observations.
△ Less
Submitted 15 April, 2022;
originally announced April 2022.
-
Detectability and global observer design for 2D Navier-Stokes equations with uncertain inputs
Authors:
Sergiy Zhuk,
Mykhaylo Zayats,
Emilia Fridman
Abstract:
We present simulation friendly detectability conditions for 2D Navier-Stokes Equation (NSE) with periodic boundary conditions, and describe a generic class of ``detectable'' observation operators: it includes pointwise evaluation of NSE's solution at interpolation nodes, and spatial average measurements. For ``detectable'' observation operators we design a global infinite-dimensional observer for…
▽ More
We present simulation friendly detectability conditions for 2D Navier-Stokes Equation (NSE) with periodic boundary conditions, and describe a generic class of ``detectable'' observation operators: it includes pointwise evaluation of NSE's solution at interpolation nodes, and spatial average measurements. For ``detectable'' observation operators we design a global infinite-dimensional observer for NSE with uncertain possibly destabilizing inputs: in our numerical experiments we illustrate $H^1$-sensitivity of NSE to small perturbations of initial conditions, yet the observer converges for known and uncertain inputs.
△ Less
Submitted 30 March, 2023; v1 submitted 14 October, 2021;
originally announced October 2021.
-
Localised sequential state estimation for advection dominated flows with non-Gaussian uncertainty description
Authors:
Emanuele Ragnoli,
Mykhaylo Zayats,
Fearghal O'Donncha,
Sergiy Zhuk
Abstract:
This paper presents a new iterative state estimation algorithm for advection dominated flows with non-Gaussian uncertainty description of $L^\infty$-type: uncertain initial condition and model error are assumed to be pointvise bounded in space and time, and the observation noise has uncertain but bounded second moments. The algorithm approximates this $L^\infty$-type bounding set by a union of pos…
▽ More
This paper presents a new iterative state estimation algorithm for advection dominated flows with non-Gaussian uncertainty description of $L^\infty$-type: uncertain initial condition and model error are assumed to be pointvise bounded in space and time, and the observation noise has uncertain but bounded second moments. The algorithm approximates this $L^\infty$-type bounding set by a union of possibly overlap** ellipsoids, which are localized (in space) on a number of sub-domains. On each sub-domain the state of the original system is estimated by the standard $L^2$-type filter (e.g. Kalman/minimax filter) which uses Gaussian/ellipsoidal uncertainty description and observations (if any) which correspond to this sub-domain. The resulting local state estimates are stitched together by the iterative d-ADN Schwartz method to reconstruct the state of the original system. The efficacy of the proposed method is demonstrated with a set of numerical examples.
△ Less
Submitted 3 December, 2017;
originally announced December 2017.
-
Simulation of Arsenic Diffusion During Rapid Thermal Annealing of Silicon Layers Doped with Low-Energy High-Dose Ion Implantation
Authors:
O. I. Velichko,
A. M. Mironov,
V. A. Tsurko,
G. M. Zayats
Abstract:
The model of transient enhanced diffusion of ion-implanted As is formulated and the finite-difference method for numerical solution of the system of equations obtained is developed. The nonuniform distribution of point defects near the interface and more accurate description of arsenic clustering are simultaneously taking into account. Simulation of As diffusion during rapid annealing gives a re…
▽ More
The model of transient enhanced diffusion of ion-implanted As is formulated and the finite-difference method for numerical solution of the system of equations obtained is developed. The nonuniform distribution of point defects near the interface and more accurate description of arsenic clustering are simultaneously taking into account. Simulation of As diffusion during rapid annealing gives a reasonable agreement with the experimental data.
Keywords: diffusion; clusters; ion implantation; arsenic; silicon
PACS: 66.30.Jt
△ Less
Submitted 9 November, 2006; v1 submitted 30 September, 2005;
originally announced September 2005.
