-
What to Prune and What Not to Prune at Initialization
Authors:
Maham Haroon
Abstract:
Post-training dropout based approaches achieve high sparsity and are well established means of deciphering problems relating to computational cost and overfitting in Neural Network architectures. Contrastingly, pruning at initialization is still far behind. Initialization pruning is more efficacious when it comes to scaling computation cost of the network. Furthermore, it handles overfitting just…
▽ More
Post-training dropout based approaches achieve high sparsity and are well established means of deciphering problems relating to computational cost and overfitting in Neural Network architectures. Contrastingly, pruning at initialization is still far behind. Initialization pruning is more efficacious when it comes to scaling computation cost of the network. Furthermore, it handles overfitting just as well as post training dropout.
In approbation of the above reasons, the paper presents two approaches to prune at initialization. The goal is to achieve higher sparsity while preserving performance. 1) K-starts, begins with k random p-sparse matrices at initialization. In the first couple of epochs the network then determines the "fittest" of these p-sparse matrices in an attempt to find the "lottery ticket" p-sparse network. The approach is adopted from how evolutionary algorithms find the best individual. Depending on the Neural Network architecture, fitness criteria can be based on magnitude of network weights, magnitude of gradient accumulation over an epoch or a combination of both. 2) Dissipating gradients approach, aims at eliminating weights that remain within a fraction of their initial value during the first couple of epochs. Removing weights in this manner despite their magnitude best preserves performance of the network. Contrarily, the approach also takes the most epochs to achieve higher sparsity. 3) Combination of dissipating gradients and kstarts outperforms either methods and random dropout consistently.
The benefits of using the provided pertaining approaches are: 1) They do not require specific knowledge of the classification task, fixing of dropout threshold or regularization parameters 2) Retraining of the model is neither necessary nor affects the performance of the p-sparse network.
△ Less
Submitted 5 September, 2022;
originally announced September 2022.
-
YouTube, The Great Radicalizer? Auditing and Mitigating Ideological Biases in YouTube Recommendations
Authors:
Muhammad Haroon,
Anshuman Chhabra,
Xin Liu,
Prasant Mohapatra,
Zubair Shafiq,
Magdalena Wojcieszak
Abstract:
Recommendations algorithms of social media platforms are often criticized for placing users in "rabbit holes" of (increasingly) ideologically biased content. Despite these concerns, prior evidence on this algorithmic radicalization is inconsistent. Furthermore, prior work lacks systematic interventions that reduce the potential ideological bias in recommendation algorithms. We conduct a systematic…
▽ More
Recommendations algorithms of social media platforms are often criticized for placing users in "rabbit holes" of (increasingly) ideologically biased content. Despite these concerns, prior evidence on this algorithmic radicalization is inconsistent. Furthermore, prior work lacks systematic interventions that reduce the potential ideological bias in recommendation algorithms. We conduct a systematic audit of YouTube's recommendation system using a hundred thousand sock puppets to determine the presence of ideological bias (i.e., are recommendations aligned with users' ideology), its magnitude (i.e., are users recommended an increasing number of videos aligned with their ideology), and radicalization (i.e., are the recommendations progressively more extreme). Furthermore, we design and evaluate a bottom-up intervention to minimize ideological bias in recommendations without relying on cooperation from YouTube. We find that YouTube's recommendations do direct users -- especially right-leaning users -- to ideologically biased and increasingly radical content on both homepages and in up-next recommendations. Our intervention effectively mitigates the observed bias, leading to more recommendations to ideologically neutral, diverse, and dissimilar content, yet debiasing is especially challenging for right-leaning users. Our systematic assessment shows that while YouTube recommendations lead to ideological bias, such bias can be mitigated through our intervention.
△ Less
Submitted 24 March, 2022; v1 submitted 20 March, 2022;
originally announced March 2022.
-
Bicycling As A Mode Of Transport In Dhaka City Status And Prospects
Authors:
S. M. Haroon,
A. K. Bhakta,
M. Shahabuddin,
N. Rahman,
M. R. Mahmud
Abstract:
This study aims to find out the current status and prospects of using a bicycle as a mode for commuting within Dhaka city. Bicycling is a very sustainable mode of transport but unfortunately is used very less by the commuters of Dhaka. There has been a lot of factors affecting the choice of bicycle to commute. This study was aimed to find out what factors could motivate the commuters of Dhaka to u…
▽ More
This study aims to find out the current status and prospects of using a bicycle as a mode for commuting within Dhaka city. Bicycling is a very sustainable mode of transport but unfortunately is used very less by the commuters of Dhaka. There has been a lot of factors affecting the choice of bicycle to commute. This study was aimed to find out what factors could motivate the commuters of Dhaka to use a bicycle as a mode of transport. For determining the motivators, a survey was administered among the commuters of Dhaka city in which the respondents were asked to answer how certain factors would affect their choice to use a bicycle to commute. A Likert scale was used in the survey and the responses were analyzed, from which the top motivators were found. The Motivators were then grouped together using exploratory factor analysis to support possible policy making. Four factors were extracted using the method. The factors were named Additional Perks, General benefits, Personal Benefits, and Infrastructural benefits
△ Less
Submitted 31 January, 2022;
originally announced January 2022.
-
HARPO: Learning to Subvert Online Behavioral Advertising
Authors:
Jiang Zhang,
Konstantinos Psounis,
Muhammad Haroon,
Zubair Shafiq
Abstract:
Online behavioral advertising, and the associated tracking paraphernalia, poses a real privacy threat. Unfortunately, existing privacy-enhancing tools are not always effective against online advertising and tracking. We propose Harpo, a principled learning-based approach to subvert online behavioral advertising through obfuscation. Harpo uses reinforcement learning to adaptively interleave real pa…
▽ More
Online behavioral advertising, and the associated tracking paraphernalia, poses a real privacy threat. Unfortunately, existing privacy-enhancing tools are not always effective against online advertising and tracking. We propose Harpo, a principled learning-based approach to subvert online behavioral advertising through obfuscation. Harpo uses reinforcement learning to adaptively interleave real page visits with fake pages to distort a tracker's view of a user's browsing profile. We evaluate Harpo against real-world user profiling and ad targeting models used for online behavioral advertising. The results show that Harpo improves privacy by triggering more than 40% incorrect interest segments and 6x higher bid values. Harpo outperforms existing obfuscation tools by as much as 16x for the same overhead. Harpo is also able to achieve better stealthiness to adversarial detection than existing obfuscation tools. Harpo meaningfully advances the state-of-the-art in leveraging obfuscation to subvert online behavioral advertising
△ Less
Submitted 23 November, 2021; v1 submitted 8 November, 2021;
originally announced November 2021.
-
Avengers Ensemble! Improving Transferability of Authorship Obfuscation
Authors:
Muhammad Haroon,
Fareed Zaffar,
Padmini Srinivasan,
Zubair Shafiq
Abstract:
Stylometric approaches have been shown to be quite effective for real-world authorship attribution. To mitigate the privacy threat posed by authorship attribution, researchers have proposed automated authorship obfuscation approaches that aim to conceal the stylometric artefacts that give away the identity of an anonymous document's author. Recent work has focused on authorship obfuscation approac…
▽ More
Stylometric approaches have been shown to be quite effective for real-world authorship attribution. To mitigate the privacy threat posed by authorship attribution, researchers have proposed automated authorship obfuscation approaches that aim to conceal the stylometric artefacts that give away the identity of an anonymous document's author. Recent work has focused on authorship obfuscation approaches that rely on black-box access to an attribution classifier to evade attribution while preserving semantics. However, to be useful under a realistic threat model, it is important that these obfuscation approaches work well even when the adversary's attribution classifier is different from the one used internally by the obfuscator. Unfortunately, existing authorship obfuscation approaches do not transfer well to unseen attribution classifiers. In this paper, we propose an ensemble-based approach for transferable authorship obfuscation. Our experiments show that if an obfuscator can evade an ensemble attribution classifier, which is based on multiple base attribution classifiers, it is more likely to transfer to different attribution classifiers. Our analysis shows that ensemble-based authorship obfuscation achieves better transferability because it combines the knowledge from each of the base attribution classifiers by essentially averaging their decision boundaries.
△ Less
Submitted 8 October, 2021; v1 submitted 14 September, 2021;
originally announced September 2021.
-
$β$-Decay Half-Lives of 55 Neutron-Rich Isotopes beyond the N=82 Shell Gap
Authors:
J. Wu,
S. Nishimura,
P. Möller,
M. R. Mumpower,
R. Lozeva,
C. B. Moon,
A. Odahara,
H. Baba,
F. Browne,
R. Daido,
P. Doornenbal,
Y. F. Fang,
M. Haroon,
T. Isobe,
H. S. Jung,
G. Lorusso,
B. Moon,
Z. Patel,
S. Rice,
H. Sakurai,
Y. Shimizu,
L. Sinclair,
P. -A. Söderström,
T. Sumikama,
H. Watanabe
, et al. (26 additional authors not shown)
Abstract:
The $β$-decay half-lives of 55 neutron-rich nuclei $^{134-139}$Sn, $^{134-142}$Sb, $^{137-144}$Te, $^{140-146}$I, $^{142-148}$Xe, $^{145-151}$Cs, $^{148-153}$Ba, $^{151-155}$La were measured at the Radioactive Isotope Beam Factory (RIBF) employing the projectile fission fragments of $^{238}$U. The nuclear level structure, which relates to deformation, has a large effect on the half-lives. The impa…
▽ More
The $β$-decay half-lives of 55 neutron-rich nuclei $^{134-139}$Sn, $^{134-142}$Sb, $^{137-144}$Te, $^{140-146}$I, $^{142-148}$Xe, $^{145-151}$Cs, $^{148-153}$Ba, $^{151-155}$La were measured at the Radioactive Isotope Beam Factory (RIBF) employing the projectile fission fragments of $^{238}$U. The nuclear level structure, which relates to deformation, has a large effect on the half-lives. The impact of newly-measured half-lives on modeling the astrophysical origin of the heavy elements is studied in the context of $r$ process nucleosynthesis. For a wide variety of astrophysical conditions, including those in which fission recycling occurs, the half-lives have an important local impact on the second ($A$ $\approx$ 130) peak.
△ Less
Submitted 31 March, 2020;
originally announced April 2020.
-
First principles calculations on theoretical band gap improvement of IIIA-VA zinc-blende semiconductor InAs
Authors:
Waqas Mahmood,
Arfan Bukhtiar,
Muhammad Haroon,
Bing Dong
Abstract:
The structural, electronic, dielectric and vibrational properties of zinc-blende (ZB) InAs were studied within the framework of density functional theory (DFT) by employing local density approximation and norm-conserving pseudopotentials. The optimal lattice parameter, direct band gap, static dielectric constant, phonon frequencies and Born effective charges calculated by treating In-4d electrons…
▽ More
The structural, electronic, dielectric and vibrational properties of zinc-blende (ZB) InAs were studied within the framework of density functional theory (DFT) by employing local density approximation and norm-conserving pseudopotentials. The optimal lattice parameter, direct band gap, static dielectric constant, phonon frequencies and Born effective charges calculated by treating In-4d electrons as valence states are in satisfactory agreement with other reported theoretical and experimental findings. The calculated band gap is reasonably accurate and improved in comparison to other findings.
△ Less
Submitted 27 November, 2019;
originally announced November 2019.
