-
Damage GAN: A Generative Model for Imbalanced Data
Authors:
Ali Anaissi,
Yuanzhe Jia,
Ali Braytee,
Mohamad Naji,
Widad Alyassine
Abstract:
This study delves into the application of Generative Adversarial Networks (GANs) within the context of imbalanced datasets. Our primary aim is to enhance the performance and stability of GANs in such datasets. In pursuit of this objective, we introduce a novel network architecture known as Damage GAN, building upon the ContraD GAN framework which seamlessly integrates GANs and contrastive learning…
▽ More
This study delves into the application of Generative Adversarial Networks (GANs) within the context of imbalanced datasets. Our primary aim is to enhance the performance and stability of GANs in such datasets. In pursuit of this objective, we introduce a novel network architecture known as Damage GAN, building upon the ContraD GAN framework which seamlessly integrates GANs and contrastive learning. Through the utilization of contrastive learning, the discriminator is trained to develop an unsupervised representation capable of distinguishing all provided samples. Our approach draws inspiration from the straightforward framework for contrastive learning of visual representations (SimCLR), leading to the formulation of a distinctive loss function. We also explore the implementation of self-damaging contrastive learning (SDCLR) to further enhance the optimization of the ContraD GAN model. Comparative evaluations against baseline models including the deep convolutional GAN (DCGAN) and ContraD GAN demonstrate the evident superiority of our proposed model, Damage GAN, in terms of generated image distribution, model stability, and image quality when applied to imbalanced datasets.
△ Less
Submitted 8 December, 2023;
originally announced December 2023.
-
Efficient Sparse Artificial Neural Networks
Authors:
Seyed Majid Naji,
Azra Abtahi,
Farokh Marvasti
Abstract:
The brain, as the source of inspiration for Artificial Neural Networks (ANN), is based on a sparse structure. This sparse structure helps the brain to consume less energy, learn easier and generalize patterns better than any other ANN. In this paper, two evolutionary methods for adopting sparsity to ANNs are proposed. In the proposed methods, the sparse structure of a network as well as the values…
▽ More
The brain, as the source of inspiration for Artificial Neural Networks (ANN), is based on a sparse structure. This sparse structure helps the brain to consume less energy, learn easier and generalize patterns better than any other ANN. In this paper, two evolutionary methods for adopting sparsity to ANNs are proposed. In the proposed methods, the sparse structure of a network as well as the values of its parameters are trained and updated during the learning process. The simulation results show that these two methods have better accuracy and faster convergence while they need fewer training samples compared to their sparse and non-sparse counterparts. Furthermore, the proposed methods significantly improve the generalization power and reduce the number of parameters. For example, the sparsification of the ResNet47 network by exploiting our proposed methods for the image classification of ImageNet dataset uses 40 % fewer parameters while the top-1 accuracy of the model improves by 12% and 5% compared to the dense network and their sparse counterpart, respectively. As another example, the proposed methods for the CIFAR10 dataset converge to their final structure 7 times faster than its sparse counterpart, while the final accuracy increases by 6%.
△ Less
Submitted 13 March, 2021;
originally announced March 2021.
-
On the Raman Spectrum of Plutonium dioxide: vibrational and crystal electric field modes
Authors:
M. Naji,
N. Magnani,
L. J. Bonales,
S. Mastromarino,
J. -Y. Colle,
J. Cobos,
D. Manara
Abstract:
The Raman spectrum of plutonium dioxide is studied both experimentally and theoretically. Particular attention has been devoted to the identification of high-energy modes at $2120$ cm$^{-1}$ and $2625$ cm$^{-1}$, the attribution of which has so far been controversial. The temperature dependence of both modes suggests an electronic origin. Crystal Field (CF) calculations reported in this work shows…
▽ More
The Raman spectrum of plutonium dioxide is studied both experimentally and theoretically. Particular attention has been devoted to the identification of high-energy modes at $2120$ cm$^{-1}$ and $2625$ cm$^{-1}$, the attribution of which has so far been controversial. The temperature dependence of both modes suggests an electronic origin. Crystal Field (CF) calculations reported in this work shows that these two modes can be respectively assigned to the $Γ_{1}$ $\rightarrow$ $Γ_{5}$ and $Γ_{1}$ $\rightarrow $ $Γ_{3}$ CF transitions within the $^{5}I_{4}$ manifold. These two modes, together with the only vibrational line foreseen by the group theory for the Fm${-3}$m PuO$_{2}$ symmetry the T$_{2g}$ PuO stretching mode observed at $478$ cm$^{-1}$ can thus be used as Raman fingerprint of fcc plutonium dioxide.
△ Less
Submitted 26 July, 2016; v1 submitted 10 March, 2016;
originally announced March 2016.
