-
Data Selection for Transfer Unlearning
Authors:
Nazanin Mohammadi Sepahvand,
Vincent Dumoulin,
Eleni Triantafillou,
Gintare Karolina Dziugaite
Abstract:
As deep learning models are becoming larger and data-hungrier, there are growing ethical, legal and technical concerns over use of data: in practice, agreements on data use may change over time, rendering previously-used training data impermissible for training purposes. These issues have driven increased attention to machine unlearning: removing "the influence of" a subset of training data from a…
▽ More
As deep learning models are becoming larger and data-hungrier, there are growing ethical, legal and technical concerns over use of data: in practice, agreements on data use may change over time, rendering previously-used training data impermissible for training purposes. These issues have driven increased attention to machine unlearning: removing "the influence of" a subset of training data from a trained model. In this work, we advocate for a relaxed definition of unlearning that does not address privacy applications but targets a scenario where a data owner withdraws permission of use of their data for training purposes. In this context, we consider the important problem of \emph{transfer unlearning} where a pretrained model is transferred to a target dataset that contains some "non-static" data that may need to be unlearned in the future. We propose a new method that uses a mechanism for selecting relevant examples from an auxiliary "static" dataset, and finetunes on the selected data instead of "non-static" target data; addressing all unlearning requests ahead of time. We also adapt a recent relaxed definition of unlearning to our problem setting and demonstrate that our approach is an exact transfer unlearner according to it, while being highly efficient (amortized). We find that our method outperforms the gold standard "exact unlearning" (finetuning on only the "static" portion of the target dataset) on several datasets, especially for small "static" sets, sometimes approaching an upper bound for test accuracy. We also analyze factors influencing the accuracy boost obtained by data selection.
△ Less
Submitted 16 May, 2024;
originally announced May 2024.
-
Exploring the Jet Formation in binary systems applying 3D MHD simulations
Authors:
Somayeh Sheikhnezami,
Mostafa Sepahvand
Abstract:
We investigate the formation of an ideal magnetized jet that originates from a disk acting as a boundary by conducting axisymmetric MHD simulations. Our simulations demonstrate that the magnetized jet is consistently launched and reaches a stable state. We extended the model setup to three dimensions to further advance our study. We performed 3D MHD simulations of the jet launched from a disk surf…
▽ More
We investigate the formation of an ideal magnetized jet that originates from a disk acting as a boundary by conducting axisymmetric MHD simulations. Our simulations demonstrate that the magnetized jet is consistently launched and reaches a stable state. We extended the model setup to three dimensions to further advance our study. We performed 3D MHD simulations of the jet launched from a disk surface, achieving a stable and appropriate model setup. Additionally, we expanded our study by incorporating the companion star and examining the influence of the Roche potential on the jet material. Specifically, we investigate whether including the companion star in the model significantly affects the dynamical evolution of the jet. Our findings reveal the formation of an ``arc-like'' structure in the density map of the jet cross-section, which is attributed to the direct tidal effects. This implies that while the primary physical effects and characteristics of the outflow on a larger scale are attributed to the host accretion disk, the direct tidal effects on the jet dynamics have a substantial impact, particularly in the vicinity of the Roche lobe and towards the secondary star.
△ Less
Submitted 4 March, 2024;
originally announced March 2024.
-
HAD-Net: A Hierarchical Adversarial Knowledge Distillation Network for Improved Enhanced Tumour Segmentation Without Post-Contrast Images
Authors:
Saverio Vadacchino,
Raghav Mehta,
Nazanin Mohammadi Sepahvand,
Brennan Nichyporuk,
James J. Clark,
Tal Arbel
Abstract:
Segmentation of enhancing tumours or lesions from MRI is important for detecting new disease activity in many clinical contexts. However, accurate segmentation requires the inclusion of medical images (e.g., T1 post contrast MRI) acquired after injecting patients with a contrast agent (e.g., Gadolinium), a process no longer thought to be safe. Although a number of modality-agnostic segmentation ne…
▽ More
Segmentation of enhancing tumours or lesions from MRI is important for detecting new disease activity in many clinical contexts. However, accurate segmentation requires the inclusion of medical images (e.g., T1 post contrast MRI) acquired after injecting patients with a contrast agent (e.g., Gadolinium), a process no longer thought to be safe. Although a number of modality-agnostic segmentation networks have been developed over the past few years, they have been met with limited success in the context of enhancing pathology segmentation. In this work, we present HAD-Net, a novel offline adversarial knowledge distillation (KD) technique, whereby a pre-trained teacher segmentation network, with access to all MRI sequences, teaches a student network, via hierarchical adversarial training, to better overcome the large domain shift presented when crucial images are absent during inference. In particular, we apply HAD-Net to the challenging task of enhancing tumour segmentation when access to post-contrast imaging is not available. The proposed network is trained and tested on the BraTS 2019 brain tumour segmentation challenge dataset, where it achieves performance improvements in the ranges of 16% - 26% over (a) recent modality-agnostic segmentation methods (U-HeMIS, U-HVED), (b) KD-Net adapted to this problem, (c) the pre-trained student network and (d) a non-hierarchical version of the network (AD-Net), in terms of Dice scores for enhancing tumour (ET). The network also shows improvements in tumour core (TC) Dice scores. Finally, the network outperforms both the baseline student network and AD-Net in terms of uncertainty quantification for enhancing tumour segmentation based on the BraTs 2019 uncertainty challenge metrics. Our code is publicly available at: https://github.com/SaverioVad/HAD_Net
△ Less
Submitted 12 May, 2021; v1 submitted 30 March, 2021;
originally announced March 2021.
-
Generating Graphical Chain by Mutual Matching of Bayesian Network and Extracted Rules of Bayesian Network Using Genetic Algorithm
Authors:
Mostafa Sepahvand,
Ghasem Alikhajeh,
Meysam Ghaffari,
Abdolreza Mirzaei
Abstract:
With the technology development, the need of analyze and extraction of useful information is increasing. Bayesian networks contain knowledge from data and experts that could be used for decision making processes But they are not easily understandable thus the rule extraction methods have been used but they have high computation costs. To overcome this problem we extract rules from Bayesian network…
▽ More
With the technology development, the need of analyze and extraction of useful information is increasing. Bayesian networks contain knowledge from data and experts that could be used for decision making processes But they are not easily understandable thus the rule extraction methods have been used but they have high computation costs. To overcome this problem we extract rules from Bayesian network using genetic algorithm. Then we generate the graphical chain by mutually matching the extracted rules and Bayesian network. This graphical chain could shows the sequence of events that lead to the target which could help the decision making process. The experimental results on small networks show that the proposed method has comparable results with brute force method which has a significantly higher computation cost.
△ Less
Submitted 15 December, 2014;
originally announced December 2014.
