-
Feedback-guided Domain Synthesis with Multi-Source Conditional Diffusion Models for Domain Generalization
Authors:
Mehrdad Noori,
Milad Cheraghalikhani,
Ali Bahri,
Gustavo Adolfo Vargas Hakim,
David Osowiechi,
Moslem Yazdanpanah,
Ismail Ben Ayed,
Christian Desrosiers
Abstract:
Standard deep learning architectures such as convolutional neural networks and vision transformers often fail to generalize to previously unseen domains due to the implicit assumption that both source and target data are drawn from independent and identically distributed (i.i.d.) populations. In response, Domain Generalization techniques aim to enhance model robustness by simulating novel data dis…
▽ More
Standard deep learning architectures such as convolutional neural networks and vision transformers often fail to generalize to previously unseen domains due to the implicit assumption that both source and target data are drawn from independent and identically distributed (i.i.d.) populations. In response, Domain Generalization techniques aim to enhance model robustness by simulating novel data distributions during training, typically through various augmentation or stylization strategies. However, these methods frequently suffer from limited control over the diversity of generated images and lack assurance that these images span distinct distributions. To address these challenges, we propose FDS, a novel strategy that employs diffusion models to synthesize samples from new domains by training on source distribution samples and performing domain mixing. By incorporating images that pose classification challenges to models trained on original samples, alongside the original dataset, we ensure the generation of a training set that spans a broad distribution spectrum. Our comprehensive evaluations demonstrate that this methodology sets new benchmarks in domain generalization performance across a range of challenging datasets, effectively managing diverse types of domain shifts. The implementation is available at: \url{https://github.com/Mehrdad-Noori/FDS.git}.
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
-
WATT: Weight Average Test-Time Adaptation of CLIP
Authors:
David Osowiechi,
Mehrdad Noori,
Gustavo Adolfo Vargas Hakim,
Moslem Yazdanpanah,
Ali Bahri,
Milad Cheraghalikhani,
Sahar Dastani,
Farzad Beizaee,
Ismail Ben Ayed,
Christian Desrosiers
Abstract:
Vision-Language Models (VLMs) such as CLIP have yielded unprecedented performance for zero-shot image classification, yet their generalization capability may still be seriously challenged when confronted to domain shifts. In response, we present Weight Average Test-Time Adaptation (WATT) of CLIP, a pioneering approach facilitating full test-time adaptation (TTA) of this VLM. Our method employs a d…
▽ More
Vision-Language Models (VLMs) such as CLIP have yielded unprecedented performance for zero-shot image classification, yet their generalization capability may still be seriously challenged when confronted to domain shifts. In response, we present Weight Average Test-Time Adaptation (WATT) of CLIP, a pioneering approach facilitating full test-time adaptation (TTA) of this VLM. Our method employs a diverse set of templates for text prompts, augmenting the existing framework of CLIP. Predictions are utilized as pseudo labels for model updates, followed by weight averaging to consolidate the learned information globally. Furthermore, we introduce a text ensemble strategy, enhancing overall test performance by aggregating diverse textual cues. Our findings underscore the efficacy of WATT in enhancing performance across diverse datasets, including CIFAR-10-C, CIFAR-10.1, CIFAR-100-C, VisDA-C, and several other challenging datasets, effectively covering a wide range of domain shifts. Notably, these enhancements are achieved without necessitating additional model transformations or trainable modules. Moreover, compared to other Test-Time Adaptation methods, our approach can operate effectively with just a single image. Highlighting the potential of innovative test-time strategies, this research emphasizes their role in fortifying the adaptability of VLMs. The implementation is available at: \url{https://github.com/Mehrdad-Noori/WATT.git}.
△ Less
Submitted 24 June, 2024; v1 submitted 19 June, 2024;
originally announced June 2024.
-
GeoMask3D: Geometrically Informed Mask Selection for Self-Supervised Point Cloud Learning in 3D
Authors:
Ali Bahri,
Moslem Yazdanpanah,
Mehrdad Noori,
Milad Cheraghalikhani,
Gustavo Adolfo Vargas Hakim,
David Osowiechi,
Farzad Beizaee,
Ismail Ben Ayed,
Christian Desrosiers
Abstract:
We introduce a pioneering approach to self-supervised learning for point clouds, employing a geometrically informed mask selection strategy called GeoMask3D (GM3D) to boost the efficiency of Masked Auto Encoders (MAE). Unlike the conventional method of random masking, our technique utilizes a teacher-student model to focus on intricate areas within the data, guiding the model's focus toward region…
▽ More
We introduce a pioneering approach to self-supervised learning for point clouds, employing a geometrically informed mask selection strategy called GeoMask3D (GM3D) to boost the efficiency of Masked Auto Encoders (MAE). Unlike the conventional method of random masking, our technique utilizes a teacher-student model to focus on intricate areas within the data, guiding the model's focus toward regions with higher geometric complexity. This strategy is grounded in the hypothesis that concentrating on harder patches yields a more robust feature representation, as evidenced by the improved performance on downstream tasks. Our method also presents a complete-to-partial feature-level knowledge distillation technique designed to guide the prediction of geometric complexity utilizing a comprehensive context from feature-level information. Extensive experiments confirm our method's superiority over State-Of-The-Art (SOTA) baselines, demonstrating marked improvements in classification, and few-shot tasks.
△ Less
Submitted 20 May, 2024;
originally announced May 2024.
-
Rooting of thornless blackberry cuttings as induced by the extract of white willow (Salix alba L.) shoots collected in different times
Authors:
Kocher Omer Salih,
Aram Akram Mohammed,
Ibrahim Maaroof Noori
Abstract:
The aqueous extract of Salix spp contains many compounds which may act as root-promoting agents in cuttings. S. alba is a deciduous tree containing variable phytochemicals which are variable throughout the year. So, in this study, one- and two-year-old shoots of S. alba were collected on the 15th of each month in the year 2022, extracted in 2% ethanol at 9 g.L-1, and placed in a water bath at 35 °…
▽ More
The aqueous extract of Salix spp contains many compounds which may act as root-promoting agents in cuttings. S. alba is a deciduous tree containing variable phytochemicals which are variable throughout the year. So, in this study, one- and two-year-old shoots of S. alba were collected on the 15th of each month in the year 2022, extracted in 2% ethanol at 9 g.L-1, and placed in a water bath at 35 °C, then they applied to thornless blackberry cuttings for 1.5 hr. The results explained that the highest rooting percentage (66.67%) was obtained in the cuttings soaked in the extract of willow shoots collected on 15th of January. They were not significantly different from control cuttings, but they were different from the cuttings soaked in the extract of willow shoots collected on 15th of August and October (33.33%). The majority of other shoot and root traits were high in the cuttings soaked in the extract of willow shoots collected on 15th of December. The willow shoots collected on 15th of January contained the lowest total phenols (51.4 μg.mL-1) and total flavonoids (29.07 μg.mL-1). Moreover, the highest total phenols (57 μg.mL-1) and IAA (365.17 μg.mL-1) were recorded in the willow shoots collected on 15th of March, however each total flavonoids (44.96 μg.mL-1) and salicylic acid (492.61 μg.mL-1) were the highest in the willow shoots collected on 15th of April. Generally, based on rooting percentage, it is advisable to collect willow shoots on 15th of January and February for extraction and application to the thornless blackberry cuttings.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
CLIPArTT: Light-weight Adaptation of CLIP to New Domains at Test Time
Authors:
Gustavo Adolfo Vargas Hakim,
David Osowiechi,
Mehrdad Noori,
Milad Cheraghalikhani,
Ali Bahri,
Moslem Yazdanpanah,
Ismail Ben Ayed,
Christian Desrosiers
Abstract:
Pre-trained vision-language models (VLMs), exemplified by CLIP, demonstrate remarkable adaptability across zero-shot classification tasks without additional training. However, their performance diminishes in the presence of domain shifts. In this study, we introduce CLIP Adaptation duRing Test-Time (CLIPArTT), a fully test-time adaptation (TTA) approach for CLIP, which involves automatic text prom…
▽ More
Pre-trained vision-language models (VLMs), exemplified by CLIP, demonstrate remarkable adaptability across zero-shot classification tasks without additional training. However, their performance diminishes in the presence of domain shifts. In this study, we introduce CLIP Adaptation duRing Test-Time (CLIPArTT), a fully test-time adaptation (TTA) approach for CLIP, which involves automatic text prompts construction during inference for their use as text supervision. Our method employs a unique, minimally invasive text prompt tuning process, wherein multiple predicted classes are aggregated into a single new text prompt, used as pseudo label to re-classify inputs in a transductive manner. Additionally, we pioneer the standardization of TTA benchmarks (e.g., TENT) in the realm of VLMs. Our findings demonstrate that, without requiring additional transformations nor new trainable modules, CLIPArTT enhances performance dynamically across non-corrupted datasets such as CIFAR-10, corrupted datasets like CIFAR-10-C and CIFAR-10.1, alongside synthetic datasets such as VisDA-C. This research underscores the potential for improving VLMs' adaptability through novel test-time strategies, offering insights for robust performance across varied datasets and environments. The code can be found at: https://github.com/dosowiechi/CLIPArTT.git
△ Less
Submitted 1 May, 2024;
originally announced May 2024.
-
NC-TTT: A Noise Contrastive Approach for Test-Time Training
Authors:
David Osowiechi,
Gustavo A. Vargas Hakim,
Mehrdad Noori,
Milad Cheraghalikhani,
Ali Bahri,
Moslem Yazdanpanah,
Ismail Ben Ayed,
Christian Desrosiers
Abstract:
Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing. Test-Time Training (TTT) methods have recently gained popularity by their ability to enhance the robustness of models through the addition of an auxiliary objective that is jointly optimized with the main task. Being strictly unsupervised, this auxiliary objectiv…
▽ More
Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing. Test-Time Training (TTT) methods have recently gained popularity by their ability to enhance the robustness of models through the addition of an auxiliary objective that is jointly optimized with the main task. Being strictly unsupervised, this auxiliary objective is used at test time to adapt the model without any access to labels. In this work, we propose Noise-Contrastive Test-Time Training (NC-TTT), a novel unsupervised TTT technique based on the discrimination of noisy feature maps. By learning to classify noisy views of projected feature maps, and then adapting the model accordingly on new domains, classification performance can be recovered by an important margin. Experiments on several popular test-time adaptation baselines demonstrate the advantages of our method compared to recent approaches for this task. The code can be found at:https://github.com/GustavoVargasHakim/NCTTT.git
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
Rooting capacity of hardwood cuttings of some fruit trees in relation to cutting pattern
Authors:
Aram Akram Mohammed,
Rasul Rafiq Aziz,
Faraydwn Karim Ahmad,
Ibrahim Maaroof Noori,
Tariq Abubakr Ahmad
Abstract:
Study two cut patterns in hardwood cuttings of (Cydonia oblonga), (Punica granatum) and (Ficus carica). The cuttings have been cut either straight with different internode stub lengths [0 (just onto the basal node as control), 0.5, 1.0, 2.0 or 3.0 cm below the basal node], or slant with 45 degree angle for each length mentioned above (except the first length (0 cm). Effect of the basal cut directi…
▽ More
Study two cut patterns in hardwood cuttings of (Cydonia oblonga), (Punica granatum) and (Ficus carica). The cuttings have been cut either straight with different internode stub lengths [0 (just onto the basal node as control), 0.5, 1.0, 2.0 or 3.0 cm below the basal node], or slant with 45 degree angle for each length mentioned above (except the first length (0 cm). Effect of the basal cut directions on rooting percentage and other shoot and root characteristics were not significantly different, while the effect of slant cut pattern on one-side rooting at the basal margin observed in some quince cuttings but it was rarely observed in pomegranate and fig cuttings. Quince cuttings gave no different rooting percentage and other shoot and root characteristics significantly with different internode stub lengths. While, internode stub 1 and 2 cm in pomegranate cuttings, and 0 cm in fig cuttings gave the best rooting percentages 44.44% and 100%, respectively. Also, interaction effects of the two factors on rooting percentage and other shoot and root characteristics were just significantly different in pomegranate and fig cuttings. The best rooting capacity achieved in pomegranate cuttings (49.99%) in those were cut straightly at the base with 1 and 2 cm basal internode stub lengths, and fig cuttings straightly cut at the base with 0 and 1 cm basal internode stub lengths gave the highest rooting capacity (100%).
△ Less
Submitted 8 November, 2023;
originally announced November 2023.
-
No Catch-22 for Fuzzy Dark Matter: testing substructure counts and core sizes via high-resolution cosmological simulations
Authors:
Sana Elgamal,
Matteo Nori,
Andrea V. Macciò,
Marco Baldi,
Stefan Waterval
Abstract:
Fuzzy Dark Matter (FDM) has recently emerged as an interesting alternative model to the standard Cold Dark Matter (CDM). In this model, dark matter consists of very light bosonic particles with quantum mechanical effects on galactic scales. Using the N-body code AX-GADGET, we perform cosmological simulations of FDM that fully model the dynamical effects of the quantum potential throughout cosmic e…
▽ More
Fuzzy Dark Matter (FDM) has recently emerged as an interesting alternative model to the standard Cold Dark Matter (CDM). In this model, dark matter consists of very light bosonic particles with quantum mechanical effects on galactic scales. Using the N-body code AX-GADGET, we perform cosmological simulations of FDM that fully model the dynamical effects of the quantum potential throughout cosmic evolution. Through the combined analysis of FDM volume and high-resolution zoom-in simulations of different FDM particle masses ($m_χ$ $\sim$ $10^{-23} - 10^{-21}$ eV/c$^2$), we study how FDM impacts the abundance of substructure and the inner density profiles of dark matter haloes. For the first time, using our FDM volume simulations, we provide a fitting formula for the FDM-to-CDM subhalo abundance ratio as a function of the FDM mass.
More importantly, our simulations clearly demonstrate that there exists an extended FDM particle mass interval able to reproduce the observed substructure counts and, at the same time, create substantial cores ($r_{c} \sim 1$ kpc) in the density profile of dwarf galaxies ($\approx 10^{9}-10^{10}$ M$_{\odot}$), which stands in stark contrast with CDM predictions even with baryonic effects taken into account. The dark matter distribution in the faintest galaxies offers then a clear way to discriminate between FDM and CDM.
△ Less
Submitted 6 November, 2023;
originally announced November 2023.
-
ClusT3: Information Invariant Test-Time Training
Authors:
Gustavo A. Vargas Hakim,
David Osowiechi,
Mehrdad Noori,
Milad Cheraghalikhani,
Ismail Ben Ayed,
Christian Desrosiers
Abstract:
Deep Learning models have shown remarkable performance in a broad range of vision tasks. However, they are often vulnerable against domain shifts at test-time. Test-time training (TTT) methods have been developed in an attempt to mitigate these vulnerabilities, where a secondary task is solved at training time simultaneously with the main task, to be later used as an self-supervised proxy task at…
▽ More
Deep Learning models have shown remarkable performance in a broad range of vision tasks. However, they are often vulnerable against domain shifts at test-time. Test-time training (TTT) methods have been developed in an attempt to mitigate these vulnerabilities, where a secondary task is solved at training time simultaneously with the main task, to be later used as an self-supervised proxy task at test-time. In this work, we propose a novel unsupervised TTT technique based on the maximization of Mutual Information between multi-scale feature maps and a discrete latent representation, which can be integrated to the standard training as an auxiliary clustering task. Experimental results demonstrate competitive classification performance on different popular test-time adaptation benchmarks.
△ Less
Submitted 18 October, 2023;
originally announced October 2023.
-
TFS-ViT: Token-Level Feature Stylization for Domain Generalization
Authors:
Mehrdad Noori,
Milad Cheraghalikhani,
Ali Bahri,
Gustavo A. Vargas Hakim,
David Osowiechi,
Ismail Ben Ayed,
Christian Desrosiers
Abstract:
Standard deep learning models such as convolutional neural networks (CNNs) lack the ability of generalizing to domains which have not been seen during training. This problem is mainly due to the common but often wrong assumption of such models that the source and target data come from the same i.i.d. distribution. Recently, Vision Transformers (ViTs) have shown outstanding performance for a broad…
▽ More
Standard deep learning models such as convolutional neural networks (CNNs) lack the ability of generalizing to domains which have not been seen during training. This problem is mainly due to the common but often wrong assumption of such models that the source and target data come from the same i.i.d. distribution. Recently, Vision Transformers (ViTs) have shown outstanding performance for a broad range of computer vision tasks. However, very few studies have investigated their ability to generalize to new domains. This paper presents a first Token-level Feature Stylization (TFS-ViT) approach for domain generalization, which improves the performance of ViTs to unseen data by synthesizing new domains. Our approach transforms token features by mixing the normalization statistics of images from different domains. We further improve this approach with a novel strategy for attention-aware stylization, which uses the attention maps of class (CLS) tokens to compute and mix normalization statistics of tokens corresponding to different image regions. The proposed method is flexible to the choice of backbone model and can be easily applied to any ViT-based architecture with a negligible increase in computational complexity. Comprehensive experiments show that our approach is able to achieve state-of-the-art performance on five challenging benchmarks for domain generalization, and demonstrate its ability to deal with different types of domain shifts. The implementation is available at: https://github.com/Mehrdad-Noori/TFS-ViT_Token-level_Feature_Stylization.
△ Less
Submitted 16 March, 2024; v1 submitted 27 March, 2023;
originally announced March 2023.
-
TTTFlow: Unsupervised Test-Time Training with Normalizing Flow
Authors:
David Osowiechi,
Gustavo A. Vargas Hakim,
Mehrdad Noori,
Milad Cheraghalikhani,
Ismail Ben Ayed,
Christian Desrosiers
Abstract:
A major problem of deep neural networks for image classification is their vulnerability to domain changes at test-time. Recent methods have proposed to address this problem with test-time training (TTT), where a two-branch model is trained to learn a main classification task and also a self-supervised task used to perform test-time adaptation. However, these techniques require defining a proxy tas…
▽ More
A major problem of deep neural networks for image classification is their vulnerability to domain changes at test-time. Recent methods have proposed to address this problem with test-time training (TTT), where a two-branch model is trained to learn a main classification task and also a self-supervised task used to perform test-time adaptation. However, these techniques require defining a proxy task specific to the target application. To tackle this limitation, we propose TTTFlow: a Y-shaped architecture using an unsupervised head based on Normalizing Flows to learn the normal distribution of latent features and detect domain shifts in test examples. At inference, kee** the unsupervised head fixed, we adapt the model to domain-shifted examples by maximizing the log likelihood of the Normalizing Flow. Our results show that our method can significantly improve the accuracy with respect to previous works.
△ Less
Submitted 20 October, 2022;
originally announced October 2022.
-
Fuzzy Aquarius: evolution of a Milky-way like system in the Fuzzy Dark Matter scenario
Authors:
Matteo Nori,
Andrea V. Macciò,
Marco Baldi
Abstract:
We present the first high-resolution zoom-in simulation of a Milky-way-like halo extracted from the Aquarius Project in the Fuzzy Dark Matter (FDM) framework. We use the N-body code AX-GADGET, based on a particle oriented solution of the Schrödinger-Poisson equations, able to detail the complexity of structure formation while kee** track of the quantum effects in FDM. The halo shows a cored dens…
▽ More
We present the first high-resolution zoom-in simulation of a Milky-way-like halo extracted from the Aquarius Project in the Fuzzy Dark Matter (FDM) framework. We use the N-body code AX-GADGET, based on a particle oriented solution of the Schrödinger-Poisson equations, able to detail the complexity of structure formation while kee** track of the quantum effects in FDM. The halo shows a cored density profile, with a core size of several kpc for a FDM mass of $m_χ=2.5h \times 10^{-22}\ {\rm eV}/c^2$. A flattening is observed also in the velocity profile, representing a distinct feature of FDM dynamics. We provide a quantitative analysis of the impact of fuzziness on satellites in terms of abundance, mass, distance and velocity distribution functions and their evolution with redshift. Very interestingly, we show that all collapsed structures, despite showing a flat density profile at $z=0$, do not reach the solitonic ground-state at the time of formation: on the contrary, they asymptotically converge to it on a timescale that depends on their mass and formation history. This implies that current limits on FDM mass - obtained by applying simple scaling relations to observed galaxies - should be taken with extreme care, since single objects can significantly deviate from the expected asymptotic behavior during their evolution.
△ Less
Submitted 14 October, 2022;
originally announced October 2022.
-
NIHAO XXVIII: Collateral effects of AGN on dark matter concentration and stellar kinematics
Authors:
Stefan Waterval,
Sana Elgamal,
Matteo Nori,
Mario Pasquato,
Andrea V. Macciò,
Marvin Blank,
Keri L. Dixon,
Xi Kang,
Tengiz Ibrayev
Abstract:
Although active galactic nuclei (AGN) feedback is required in simulations of galaxies to regulate star formation, further downstream effects on the dark matter distribution of the halo and stellar kinematics of the central galaxy can be expected. We combine simulations of galaxies with and without AGN physics from the Numerical Investigation of a Hundred Astrophysical Objects (NIHAO) to investigat…
▽ More
Although active galactic nuclei (AGN) feedback is required in simulations of galaxies to regulate star formation, further downstream effects on the dark matter distribution of the halo and stellar kinematics of the central galaxy can be expected. We combine simulations of galaxies with and without AGN physics from the Numerical Investigation of a Hundred Astrophysical Objects (NIHAO) to investigate the effect of AGN on the dark matter profile and central stellar rotation of the host galaxies. Specifically, we study how the concentration-halo mass ($c-M$) relation and the stellar spin parameter ($λ_R$) are affected by AGN feedback. We find that AGN physics is crucial to reduce the central density of simulated massive ($\gtrsim 10^{12}$ M$_\odot$) galaxies and bring their concentration to agreement with results from the Spitzer Photometry & Accurate Rotation Curves (SPARC) sample. Similarly, AGN feedback has a key role in reproducing the dichotomy between slow and fast rotators as observed by the ATLAS$^{3\text{D}}$ survey. Without star formation suppression due to AGN feedback, the number of fast rotators strongly exceeds the observational constraints. Our study shows that there are several collateral effects that support the importance of AGN feedback in galaxy formation, and these effects can be used to constrain its implementation in numerical simulations.
△ Less
Submitted 28 April, 2022;
originally announced April 2022.
-
Closed-Loop MOEMS Accelerometer
Authors:
Majid Taghavi,
Abolfazl Abedi,
Gholam-Mohammad Parsanasab,
Mojtaba Rahimi,
Mohammad Noori,
Hamzeh Nourolahi,
hamid latifi
Abstract:
In this paper, a closed-loop micro-opto-electro-mechanical system (MOEMS) accelerometer based on the Fabry-Pérot (FP) interferometer is presented. The FP cavity is formed between the end of a cleaved single-mode optical fiber and the cross-section of a proof mass (PM) which is suspended by four U-shaped springs. The applied acceleration tends to move the PM in the opposite direction. The arrays of…
▽ More
In this paper, a closed-loop micro-opto-electro-mechanical system (MOEMS) accelerometer based on the Fabry-Pérot (FP) interferometer is presented. The FP cavity is formed between the end of a cleaved single-mode optical fiber and the cross-section of a proof mass (PM) which is suspended by four U-shaped springs. The applied acceleration tends to move the PM in the opposite direction. The arrays of fixed and movable comb fingers produce an electrostatic force which keeps the PM in its resting position. The voltage that can provide this electrostatic force is considered as the output of the sensor. Using a closed-loop detection method it is possible to increase the measurement range without losing the resolution. The proposed sensor is fabricated on a silicon-on-insulator wafer using the bulk micromachining method. The results of the sensor characterization show that the accelerometer has a linear response in the range of 5 g. In the closed-loop mode, the sensitivity and bias instability of the sensor are 1.16 V/g and 40 g, respectively.
△ Less
Submitted 28 May, 2022; v1 submitted 7 February, 2022;
originally announced February 2022.
-
Zero-Shot Open-Book Question Answering
Authors:
Sia Gholami,
Mehdi Noori
Abstract:
Open book question answering is a subset of question answering tasks where the system aims to find answers in a given set of documents (open-book) and common knowledge about a topic. This article proposes a solution for answering natural language questions from a corpus of Amazon Web Services (AWS) technical documents with no domain-specific labeled data (zero-shot). These questions can have yes-n…
▽ More
Open book question answering is a subset of question answering tasks where the system aims to find answers in a given set of documents (open-book) and common knowledge about a topic. This article proposes a solution for answering natural language questions from a corpus of Amazon Web Services (AWS) technical documents with no domain-specific labeled data (zero-shot). These questions can have yes-no-none answers, short answers, long answers, or any combination of the above. This solution comprises a two-step architecture in which a retriever finds the right document and an extractor finds the answers in the retrieved document. We are introducing a new test dataset for open-book QA based on real customer questions on AWS technical documentation. After experimenting with several information retrieval systems and extractor models based on extractive language models, the solution attempts to find the yes-no-none answers and text answers in the same pass. The model is trained on the The Stanford Question Answering Dataset - SQuAD (Rajpurkaret al., 2016) and Natural Questions (Kwiatkowski et al., 2019) datasets. We were able to achieve 49% F1 and 39% exact match score (EM) end-to-end with no domain-specific training.
△ Less
Submitted 22 November, 2021;
originally announced November 2021.
-
Influence of image noise on crack detection performance of deep convolutional neural networks
Authors:
Riccardo Chianese,
Andy Nguyen,
Vahidreza Gharehbaghi,
Thiru Aravinthan,
Mohammad Noori
Abstract:
Development of deep learning techniques to analyse image data is an expansive and emerging field. The benefits of tracking, identifying, measuring, and sorting features of interest from image data has endless applications for saving cost, time, and improving safety. Much research has been conducted on classifying cracks from image data using deep convolutional neural networks; however, minimal res…
▽ More
Development of deep learning techniques to analyse image data is an expansive and emerging field. The benefits of tracking, identifying, measuring, and sorting features of interest from image data has endless applications for saving cost, time, and improving safety. Much research has been conducted on classifying cracks from image data using deep convolutional neural networks; however, minimal research has been conducted to study the efficacy of network performance when noisy images are used. This paper will address the problem and is dedicated to investigating the influence of image noise on network accuracy. The methods used incorporate a benchmark image data set, which is purposely deteriorated with two types of noise, followed by treatment with image enhancement pre-processing techniques. These images, including their native counterparts, are then used to train and validate two different networks to study the differences in accuracy and performance. Results from this research reveal that noisy images have a moderate to high impact on the network's capability to accurately classify images despite the application of image pre-processing. A new index has been developed for finding the most efficient method for classification in terms of computation timing and accuracy. Consequently, AlexNet was selected as the most efficient model based on the proposed index.
△ Less
Submitted 3 November, 2021;
originally announced November 2021.
-
Fast Federated Learning by Balancing Communication Trade-Offs
Authors:
Milad Khademi Nori,
Sangseok Yun,
Il-Min Kim
Abstract:
Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication overheads, two main techniques have been studied: (i) local update of weights characterizing the trade-off between communication and computation and (ii) gradie…
▽ More
Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication overheads, two main techniques have been studied: (i) local update of weights characterizing the trade-off between communication and computation and (ii) gradient compression characterizing the trade-off between communication and precision. To the best of our knowledge, studying and balancing those two trade-offs jointly and dynamically while considering their impacts on convergence has remained unresolved even though it promises significantly faster FL. In this paper, we first formulate our problem to minimize learning error with respect to two variables: local update coefficients and sparsity budgets of gradient compression who characterize trade-offs between communication and computation/precision, respectively. We then derive an upper bound of the learning error in a given wall-clock time considering the interdependency between the two variables. Based on this theoretical analysis, we propose an enhanced FL scheme, namely Fast FL (FFL), that jointly and dynamically adjusts the two variables to minimize the learning error. We demonstrate that FFL consistently achieves higher accuracies faster than similar schemes existing in the literature.
△ Less
Submitted 23 May, 2021;
originally announced May 2021.
-
Distributed Storage Allocations for Optimal Service Rates
Authors:
Pei Peng,
Moslem Noori,
Emina Soljanin
Abstract:
Redundant storage maintains the performance of distributed systems under various forms of uncertainty. This paper considers the uncertainty in node access and download service. We consider two access models under two download service models. In one access model, a user can access each node with a fixed probability, and in the other, a user can access a random fixed-size subset of nodes. We conside…
▽ More
Redundant storage maintains the performance of distributed systems under various forms of uncertainty. This paper considers the uncertainty in node access and download service. We consider two access models under two download service models. In one access model, a user can access each node with a fixed probability, and in the other, a user can access a random fixed-size subset of nodes. We consider two download service models. In the first (small file) model, the randomness associated with the file size is negligible. In the second (large file) model, randomness is associated with both the file size and the system's operations. We focus on the service rate of the system. For a fixed redundancy level, the systems' service rate is determined by the allocation of coded chunks over the storage nodes. We consider quasi-uniform allocations, where coded content is uniformly spread among a subset of nodes. The question we address asks what the size of this subset (spreading) should be. We show that in the small file model, concentrating the coded content to a minimum-size subset is universally optimal. For the large file model, the optimal spreading depends on the system parameters. These conclusions hold for both access models.
△ Less
Submitted 5 August, 2021; v1 submitted 8 February, 2021;
originally announced February 2021.
-
INT monitoring survey of Local Group dwarf galaxies: star formation history and chemical enrichment
Authors:
Tahere Parto,
Shahrzad Dehghani,
Atefeh Javadi,
Elham Saremi,
Jacco Th. van Loon,
Habib Khosroshahi,
Mohammad Taghi Mirtorabi,
Hedieh Abdollahi,
Mahtab Gholami,
Seyed Azim Hashemi,
Mahdieh Navabi,
Majedeh Noori,
Sima Taefi Aghdam,
Maryam Torki,
Mahshid Vafaeizade
Abstract:
The Local Group (LG) hosts many dwarf galaxies with diverse physical characteristics in terms of morphology, mass, star formation, and metallicity. To this end, LG can offer a unique site to tackle questions about the formation and evolution of galaxies by providing detailed information. While large telescopes are often the first choices for such studies, small telescope surveys that perform dedic…
▽ More
The Local Group (LG) hosts many dwarf galaxies with diverse physical characteristics in terms of morphology, mass, star formation, and metallicity. To this end, LG can offer a unique site to tackle questions about the formation and evolution of galaxies by providing detailed information. While large telescopes are often the first choices for such studies, small telescope surveys that perform dedicated observations are still important, particularly in studying bright objects in the nearby universe. In this regard, we conducted a nine epoch survey of 55 dwarf galaxies called the Local Group dwarf galaxies survey using the 2.5m Isaac Newton Telescope (INT) in La Palma to identify Long-Period Variable (LPV) stars, namely Asymptotic Giant Branch (AGB) and Red Super Giant (RSG) stars. AGB stars formed at different times and studying their radial distribution and mass-loss rate can shed light on the structure formation in galaxies. To further investigate the evolutionary path of these galaxies, we construct their star formation history (SFH) using the LPV stars, which are at the final stages of their evolution and therefore experience brightness fluctuations on the timescales between hundred to thousand days. In this paper, we present some of the results of the Local Group dwarf galaxies survey.
△ Less
Submitted 26 January, 2021;
originally announced January 2021.
-
The Isaac Newton Telescope monitoring survey of Local Group dwarf galaxies -- IV. The star formation history of Andromeda VII derived from long period variable stars
Authors:
Mahdieh Navabi,
Elham Saremi,
Atefeh Javadi,
Majedeh Noori,
Jacco Th. van Loon,
Habib G. Khosroshahi,
Iain McDonald,
Mina Alizadeh,
Arash Danesh,
Ghassem Gozaliasl,
Alireza Molaeinezhad,
Tahere Parto,
Mojtaba Raouf
Abstract:
We have examined the star formation history (SFH) of Andromeda VII (And VII), the brightest and most massive dwarf spheroidal (dSph) satellite of the Andromeda galaxy (M 31). Although M 31 is surrounded by several dSph companions with old stellar populations and low metallicity, it has a metal-rich stellar halo with an age of 6$-$8 Gyr. This indicates that any evolutionary association between the…
▽ More
We have examined the star formation history (SFH) of Andromeda VII (And VII), the brightest and most massive dwarf spheroidal (dSph) satellite of the Andromeda galaxy (M 31). Although M 31 is surrounded by several dSph companions with old stellar populations and low metallicity, it has a metal-rich stellar halo with an age of 6$-$8 Gyr. This indicates that any evolutionary association between the stellar halo of M 31 and its dSph system is frail. Therefore, the question is whether And VII (a high-metallicity dSph located $\sim$220 kpc from M 31), can be associated with M 31's young, metal-rich halo. Here, we perform the first reconstruction of the SFH of And VII employing long-period variable (LPV) stars. As the most-evolved asymptotic giant branch (AGB) and red supergiant (RSG) stars, the birth mass of LPVs can be determined by connecting their near-infrared photometry to theoretical evolutionary tracks. We found 55 LPV candidates within two half-light radii, using multi-epoch imaging with the Isaac Newton Telescope in the $i$ and $V$ bands. Based on their birth mass function, the star-formation rate (SFR) of And VII was obtained as a function of cosmic time. The main epoch of star formation occurred $\simeq 6.2$ Gyr ago with a SFR of $0.006\pm0.002$ M$_\odot$ yr$^{-1}$. Over the past 6 Gyr, we find slow star formation, which continued until 500 Myr ago with a SFR $\sim0.0005\pm0.0002$ M$_\odot$ yr$^{-1}$. We determined And VII's stellar mass $M=(13.3\pm5.3)\times10^6$ M$_\odot$ within a half-light radius $r_{\frac{1}{2}}=3.8\pm0.3$ arcmin and metallicity $Z=0.0007$, and also derived its distance modulus of $μ=24.38$ mag.
△ Less
Submitted 5 April, 2021; v1 submitted 25 January, 2021;
originally announced January 2021.
-
Quantum Multiple Kernel Learning
Authors:
Seyed Shakib Vedaie,
Moslem Noori,
Jaspreet S. Oberoi,
Barry C. Sanders,
Ehsan Zahedinejad
Abstract:
Kernel methods play an important role in machine learning applications due to their conceptual simplicity and superior performance on numerous machine learning tasks. Expressivity of a machine learning model, referring to the ability of the model to approximate complex functions, has a significant influence on its performance in these tasks. One approach to enhancing the expressivity of kernel mac…
▽ More
Kernel methods play an important role in machine learning applications due to their conceptual simplicity and superior performance on numerous machine learning tasks. Expressivity of a machine learning model, referring to the ability of the model to approximate complex functions, has a significant influence on its performance in these tasks. One approach to enhancing the expressivity of kernel machines is to combine multiple individual kernels to arrive at a more expressive combined kernel. This approach is referred to as multiple kernel learning (MKL). In this work, we propose an MKL method we refer to as quantum MKL, which combines multiple quantum kernels. Our method leverages the power of deterministic quantum computing with one qubit (DQC1) to estimate the combined kernel for a set of classically intractable individual quantum kernels. The combined kernel estimation is achieved without explicitly computing each individual kernel, while still allowing for the tuning of individual kernels in order to achieve better expressivity. Our simulations on two binary classification problems---one performed on a synthetic dataset and the other on a German credit dataset---demonstrate the superiority of the quantum MKL method over single quantum kernel machines.
△ Less
Submitted 19 November, 2020;
originally announced November 2020.
-
Scaling relations of Fuzzy Dark Matter haloes I: individual systems in their cosmological environment
Authors:
Matteo Nori,
Marco Baldi
Abstract:
Dark matter models involving a very light bosonic particle, generally known as Fuzzy Dark Matter (FDM), have been recently attracting great interest in the cosmology community, as their wave-like phenomenology would simultaneously explain the longstanding mis-detection of a dark matter particle and help easing the small-scale issues related to the standard Cold Dark Matter (CDM) scenario. With the…
▽ More
Dark matter models involving a very light bosonic particle, generally known as Fuzzy Dark Matter (FDM), have been recently attracting great interest in the cosmology community, as their wave-like phenomenology would simultaneously explain the longstanding mis-detection of a dark matter particle and help easing the small-scale issues related to the standard Cold Dark Matter (CDM) scenario. With the present work, we initiate a series of papers aiming at investigating the evolution of FDM structures in a cosmological framework performed with our N-body code AX-GADGET, detailing for the first time in the literature how the actual scaling relations between solitonic cores and host haloes properties are significantly affected by the dynamical state, morphology and merger history of the individual systems. In particular, in this first paper we confirm the ability of AX-GADGET to correctly reproduce the typical FDM solitonic core and we employ it to study the non-linear evolution of eight FDM haloes in their cosmological context through the zoom-in simulation approach. We find that the scaling relations identified in previous works for isolated systems are generally modified for haloes evolving in a realistic cosmological environment, and appear to be valid only as a limit for the most relaxed and spherically symmetric systems.
△ Less
Submitted 2 July, 2020;
originally announced July 2020.
-
Dynamic Zoom Simulations: a fast, adaptive algorithm for simulating lightcones
Authors:
Enrico Garaldi,
Matteo Nori,
Marco Baldi
Abstract:
The advent of a new generation of large-scale galaxy surveys is pushing cosmological numerical simulations in an uncharted territory. The simultaneous requirements of high resolution and very large volume pose serious technical challenges, due to their computational and data storage demand. In this paper, we present a novel approach dubbed Dynamic Zoom Simulations -- or DZS -- developed to tackle…
▽ More
The advent of a new generation of large-scale galaxy surveys is pushing cosmological numerical simulations in an uncharted territory. The simultaneous requirements of high resolution and very large volume pose serious technical challenges, due to their computational and data storage demand. In this paper, we present a novel approach dubbed Dynamic Zoom Simulations -- or DZS -- developed to tackle these issues. Our method is tailored to the production of lightcone outputs from N-body numerical simulations, which allow for a more efficient storage and post-processing compared to standard comoving snapshots, and more directly mimic the format of survey data. In DZS, the resolution of the simulation is dynamically decreased outside the lightcone surface, reducing the computational work load, while simultaneously preserving the accuracy inside the lightcone and the large-scale gravitational field. We show that our approach can achieve virtually identical results to traditional simulations at half of the computational cost for our largest box. We also forecast this speedup to increase up to a factor of 5 for larger and/or higher-resolution simulations. We assess the accuracy of the numerical integration by comparing pairs of identical simulations run with and without DZS. Deviations in the lightcone halo mass function, in the sky-projected lightcone, and in the 3D matter lightcone always remain below 0.1%. In summary, our results indicate that the DZS technique may provide a highly-valuable tool to address the technical challenges that will characterise the next generation of large-scale cosmological simulations.
△ Less
Submitted 24 September, 2020; v1 submitted 11 May, 2020;
originally announced May 2020.
-
Attention-Guided Version of 2D UNet for Automatic Brain Tumor Segmentation
Authors:
Mehrdad Noori,
Ali Bahri,
Karim Mohammadi
Abstract:
Gliomas are the most common and aggressive among brain tumors, which cause a short life expectancy in their highest grade. Therefore, treatment assessment is a key stage to enhance the quality of the patients' lives. Recently, deep convolutional neural networks (DCNNs) have achieved a remarkable performance in brain tumor segmentation, but this task is still difficult owing to high varying intensi…
▽ More
Gliomas are the most common and aggressive among brain tumors, which cause a short life expectancy in their highest grade. Therefore, treatment assessment is a key stage to enhance the quality of the patients' lives. Recently, deep convolutional neural networks (DCNNs) have achieved a remarkable performance in brain tumor segmentation, but this task is still difficult owing to high varying intensity and appearance of gliomas. Most of the existing methods, especially UNet-based networks, integrate low-level and high-level features in a naive way, which may result in confusion for the model. Moreover, most approaches employ 3D architectures to benefit from 3D contextual information of input images. These architectures contain more parameters and computational complexity than 2D architectures. On the other hand, using 2D models causes not to benefit from 3D contextual information of input images. In order to address the mentioned issues, we design a low-parameter network based on 2D UNet in which we employ two techniques. The first technique is an attention mechanism, which is adopted after concatenation of low-level and high-level features. This technique prevents confusion for the model by weighting each of the channels adaptively. The second technique is the Multi-View Fusion. By adopting this technique, we can benefit from 3D contextual information of input images despite using a 2D model. Experimental results demonstrate that our method performs favorably against 2017 and 2018 state-of-the-art methods.
△ Less
Submitted 4 April, 2020;
originally announced April 2020.
-
DFNet: Discriminative feature extraction and integration network for salient object detection
Authors:
Mehrdad Noori,
Sina Mohammadi,
Sina Ghofrani Majelan,
Ali Bahri,
Mohammad Havaei
Abstract:
Despite the powerful feature extraction capability of Convolutional Neural Networks, there are still some challenges in saliency detection. In this paper, we focus on two aspects of challenges: i) Since salient objects appear in various sizes, using single-scale convolution would not capture the right size. Moreover, using multi-scale convolutions without considering their importance may confuse t…
▽ More
Despite the powerful feature extraction capability of Convolutional Neural Networks, there are still some challenges in saliency detection. In this paper, we focus on two aspects of challenges: i) Since salient objects appear in various sizes, using single-scale convolution would not capture the right size. Moreover, using multi-scale convolutions without considering their importance may confuse the model. ii) Employing multi-level features helps the model use both local and global context. However, treating all features equally results in information redundancy. Therefore, there needs to be a mechanism to intelligently select which features in different levels are useful. To address the first challenge, we propose a Multi-scale Attention Guided Module. This module not only extracts multi-scale features effectively but also gives more attention to more discriminative feature maps corresponding to the scale of the salient object. To address the second challenge, we propose an Attention-based Multi-level Integrator Module to give the model the ability to assign different weights to multi-level feature maps. Furthermore, our Sharpening Loss function guides our network to output saliency maps with higher certainty and less blurry salient objects, and it has far better performance than the Cross-entropy loss. For the first time, we adopt four different backbones to show the generalization of our method. Experiments on five challenging datasets prove that our method achieves the state-of-the-art performance. Our approach is fast as well and can run at a real-time speed.
△ Less
Submitted 3 April, 2020;
originally announced April 2020.
-
CAGNet: Content-Aware Guidance for Salient Object Detection
Authors:
Sina Mohammadi,
Mehrdad Noori,
Ali Bahri,
Sina Ghofrani Majelan,
Mohammad Havaei
Abstract:
Beneficial from Fully Convolutional Neural Networks (FCNs), saliency detection methods have achieved promising results. However, it is still challenging to learn effective features for detecting salient objects in complicated scenarios, in which i) non-salient regions may have "salient-like" appearance; ii) the salient objects may have different-looking regions. To handle these complex scenarios,…
▽ More
Beneficial from Fully Convolutional Neural Networks (FCNs), saliency detection methods have achieved promising results. However, it is still challenging to learn effective features for detecting salient objects in complicated scenarios, in which i) non-salient regions may have "salient-like" appearance; ii) the salient objects may have different-looking regions. To handle these complex scenarios, we propose a Feature Guide Network which exploits the nature of low-level and high-level features to i) make foreground and background regions more distinct and suppress the non-salient regions which have "salient-like" appearance; ii) assign foreground label to different-looking salient regions. Furthermore, we utilize a Multi-scale Feature Extraction Module (MFEM) for each level of abstraction to obtain multi-scale contextual information. Finally, we design a loss function which outperforms the widely-used Cross-entropy loss. By adopting four different pre-trained models as the backbone, we prove that our method is very general with respect to the choice of the backbone model. Experiments on five challenging datasets demonstrate that our method achieves the state-of-the-art performance in terms of different evaluation metrics. Additionally, our approach contains fewer parameters than the existing ones, does not need any post-processing, and runs fast at a real-time speed of 28 FPS when processing a 480 x 480 image.
△ Less
Submitted 4 April, 2020; v1 submitted 29 November, 2019;
originally announced November 2019.
-
Adiabatic Quantum Kitchen Sinks for Learning Kernels Using Randomized Features
Authors:
Moslem Noori,
Seyed Shakib Vedaie,
Inderpreet Singh,
Daniel Crawford,
Jaspreet S. Oberoi,
Barry C. Sanders,
Ehsan Zahedinejad
Abstract:
Quantum information processing is likely to have far-reaching impact in the field of artificial intelligence. While the race to build an error-corrected quantum computer is ongoing, noisy, intermediate-scale quantum (NISQ) devices provide an immediate platform for exploring a possible quantum advantage through hybrid quantum--classical machine learning algorithms. One example of such a hybrid algo…
▽ More
Quantum information processing is likely to have far-reaching impact in the field of artificial intelligence. While the race to build an error-corrected quantum computer is ongoing, noisy, intermediate-scale quantum (NISQ) devices provide an immediate platform for exploring a possible quantum advantage through hybrid quantum--classical machine learning algorithms. One example of such a hybrid algorithm is "quantum kitchen sinks", which builds upon the classical algorithm known as "random kitchen sinks" to leverage a gate model quantum computer for machine learning applications. We propose an alternative algorithm called "adiabatic quantum kitchen sinks", which employs an adiabatic quantum device to transform data features into new features in a non-linear manner, which can then be employed by classical machine learning algorithms. We present the effectiveness of our algorithm for performing binary classification on both a synthetic dataset and a real-world dataset. In terms of classification accuracy, our algorithm significantly enhances the performance of a classical linear classifier on the studied binary classification tasks and can potentially be implemented on a current adiabatic quantum device to solve practical problems.
△ Less
Submitted 17 September, 2019;
originally announced September 2019.
-
A Variable Neighbourhood Descent Heuristic for Conformational Search Using a Quantum Annealer
Authors:
D. J. J. Marchand,
M. Noori,
A. Roberts,
G. Rosenberg,
B. Woods,
U. Yildiz,
M. Coons,
D. Devore,
P. Margl
Abstract:
Discovering the low-energy conformations of a molecule is of great interest to computational chemists, with applications in {\em in silico} materials design and drug discovery. In this paper, we propose a variable neighbourhood search heuristic for the conformational search problem. Using the structure of a molecule, neighbourhoods are chosen to allow for the efficient use of a binary quadratic op…
▽ More
Discovering the low-energy conformations of a molecule is of great interest to computational chemists, with applications in {\em in silico} materials design and drug discovery. In this paper, we propose a variable neighbourhood search heuristic for the conformational search problem. Using the structure of a molecule, neighbourhoods are chosen to allow for the efficient use of a binary quadratic optimizer for conformational search. The method is flexible with respect to the choice of molecular force field and the number of discretization levels in the search space, and can be further generalized to take advantage of higher-order binary polynomial optimizers. It is well-suited for the use of devices such as quantum annealers. After carefully defining neighbourhoods, the method easily adapts to the size and topology of these devices, allowing for seamless scaling alongside their future improvements.
△ Less
Submitted 21 June, 2019; v1 submitted 16 November, 2018;
originally announced November 2018.
-
Lyman-$α$ forest and non-linear structure characterization in Fuzzy Dark Matter cosmologies
Authors:
Matteo Nori,
Riccardo Murgia,
Vid Iršič,
Marco Baldi,
Matteo Viel
Abstract:
Fuzzy Dark Matter (FDM) represents an alternative and intriguing description of the standard Cold Dark Matter (CDM) fluid, able to explain the lack of direct detection of dark matter particles in the GeV sector and to alleviate small scales tensions in the cosmic large-scale structure formation. Cosmological simulations of FDM models in the literature were performed either with very expensive high…
▽ More
Fuzzy Dark Matter (FDM) represents an alternative and intriguing description of the standard Cold Dark Matter (CDM) fluid, able to explain the lack of direct detection of dark matter particles in the GeV sector and to alleviate small scales tensions in the cosmic large-scale structure formation. Cosmological simulations of FDM models in the literature were performed either with very expensive high-resolution grid-based simulations of individual haloes or through N-body simulations encompassing larger cosmic volumes but resorting on significant approximations in the FDM non-linear dynamics to reduce their computational cost. With the use of the new N-body cosmological hydrodynamical code AX-GADGET, we are now able not only to overcome such numerical problems, but also to combine a fully consistent treatment of FDM dynamics with the presence of gas particles and baryonic physical processes, in order to quantify the FDM impact on specific astrophysical observables. In particular, in this paper we perform and analyse several hydrodynamical simulations in order to constrain the FDM mass by quantifying the impact of FDM on Lyman-$α$ forest observations, as obtained for the first time in the literature in a N-body setup without approximating the FDM dynamics. We also study the statistical properties of haloes, exploiting the large available sample, to extract information on how FDM affects the abundance, the shape, and density profiles of dark matter haloes.
△ Less
Submitted 27 September, 2018; v1 submitted 24 September, 2018;
originally announced September 2018.
-
Constructible Sheaves
Authors:
Madhav V. Nori
Abstract:
This article contains a proof of the basic lemma. This lemma, discovered by Beilinson, yields a motivic proof of the Andreotti-Frankel theorem for affine varieties. Next, it is shown that the category of Cohomologically Constructible Sheaves (as it is referred to in the Riemann-Hilbert correspondence) coincides with the derived category of bounded complexes of constructible sheaves. It is also sho…
▽ More
This article contains a proof of the basic lemma. This lemma, discovered by Beilinson, yields a motivic proof of the Andreotti-Frankel theorem for affine varieties. Next, it is shown that the category of Cohomologically Constructible Sheaves (as it is referred to in the Riemann-Hilbert correspondence) coincides with the derived category of bounded complexes of constructible sheaves. It is also shown that higher direct images and the sheaf-Ext groups are effaceable in the category of constructible sheaves.
△ Less
Submitted 7 August, 2018;
originally announced August 2018.
-
Statistics of Photospheric Supergranular Cells Observed by SDO/HMI
Authors:
Majedeh Noori,
Mohsen Javaherian,
Hossein Safari,
Hamid Nadjari
Abstract:
Aims: The statistics of the photospheric granulation pattern are investigated using continuum images observed by Solar Dynamic Observatory (SDO)/Helioseismic and Magnetic Imager (HMI) taken at 6713~Å.
Methods: The supergranular boundaries can be extracted by tracking photospheric velocity plasma flows. The local ball-tracking method is employed to apply on the HMI data gathered over the years 20…
▽ More
Aims: The statistics of the photospheric granulation pattern are investigated using continuum images observed by Solar Dynamic Observatory (SDO)/Helioseismic and Magnetic Imager (HMI) taken at 6713~Å.
Methods: The supergranular boundaries can be extracted by tracking photospheric velocity plasma flows. The local ball-tracking method is employed to apply on the HMI data gathered over the years 2011-2015 to estimate the boundaries of the cells. The edge sharpening techniques are exerted on the output of ball-tracking to precisely identify the cells borders. To study the fractal dimensionality (FD) of supergranulation, the box counting method is used.
Results: We found that both the size and eccentricity follow the log-normal distributions with peak values about 330 Mm$^2$ and 0.85, respectively. The five-year mean value of the cells number appeared in half-hour sequences is obtained to be about 60 $\pm$ 6 within an area of $350^{\prime\prime}\times350^{\prime\prime}$. The cells orientation distribution presents the power-law behavior.
Conclusions: The orientation of supergranular cells ($O$) and their size ($S$) follows a power-law function as $|O| \propto S^{9.5}$. We found that the non-roundish cells with smaller and larger sizes than 600 Mm$^2$ are aligned and perpendicular with the solar rotational velocity on the photosphere, respectively. The FD analysis shows that the supergranular cells form the self-similar patterns.
△ Less
Submitted 19 July, 2018;
originally announced July 2018.
-
AX-GADGET: a new code for cosmological simulations of Fuzzy Dark Matter and Axion models
Authors:
M. Nori,
M. Baldi
Abstract:
We present a new module of the parallel N-Body code P-GADGET3 for cosmological simulations of light bosonic non-thermal dark matter, often referred as Fuzzy Dark Matter (FDM). The dynamics of the FDM features a highly non-linear Quantum Potential (QP) that suppresses the growth of structures at small scales. Most of the previous attempts of FDM simulations either evolved suppressed initial conditi…
▽ More
We present a new module of the parallel N-Body code P-GADGET3 for cosmological simulations of light bosonic non-thermal dark matter, often referred as Fuzzy Dark Matter (FDM). The dynamics of the FDM features a highly non-linear Quantum Potential (QP) that suppresses the growth of structures at small scales. Most of the previous attempts of FDM simulations either evolved suppressed initial conditions, completely neglecting the dynamical effects of QP throughout cosmic evolution, or resorted to numerically challenging full-wave solvers. The code provides an interesting alternative, following the FDM evolution without impairing the overall performance. This is done by computing the QP acceleration through the Smoothed Particle Hydrodynamics (SPH) routines, with improved schemes to ensure precise and stable derivatives. As an extension of the P-GADGET3 code, it inherits all the additional physics modules implemented up to date, opening a wide range of possibilities to constrain FDM models and explore its degeneracies with other physical phenomena. Simulations are compared with analytical predictions and results of other codes, validating the QP as a crucial player in structure formation at small scales.
△ Less
Submitted 5 July, 2018; v1 submitted 24 January, 2018;
originally announced January 2018.
-
On a duality theorem of Schneider-Stuhler
Authors:
Madhav Nori,
Dipendra Prasad
Abstract:
We extend a duality theorem of Schneider-Stuhler about $Ext^i[π_1,π_2]$ proved there for smooth representations of a $p$-adic group $G$ with central characters to all smooth representations assuming their result for only irreducible representations by generalities in homological algebra.
We extend a duality theorem of Schneider-Stuhler about $Ext^i[π_1,π_2]$ proved there for smooth representations of a $p$-adic group $G$ with central characters to all smooth representations assuming their result for only irreducible representations by generalities in homological algebra.
△ Less
Submitted 6 November, 2017;
originally announced November 2017.
-
Partial Zero-Forcing for Multi-Way Relay Networks
Authors:
Samira Rahimian,
Wuhua Zhang,
Moslem Noori,
Yindi **g,
Masoud Ardakani
Abstract:
The ever increasing demands for mobile network access have resulted in a significant increase in bandwidth usage. By improving the system spectral efficiency, multi-way relay networks (MWRNs) provide promising approaches to address this challenge. In this paper, we propose a novel linear beamforming design, namely partial zero-forcing (PZF), for MWRNs with a multiple-input-multiple-output (MIMO) r…
▽ More
The ever increasing demands for mobile network access have resulted in a significant increase in bandwidth usage. By improving the system spectral efficiency, multi-way relay networks (MWRNs) provide promising approaches to address this challenge. In this paper, we propose a novel linear beamforming design, namely partial zero-forcing (PZF), for MWRNs with a multiple-input-multiple-output (MIMO) relay. Compared to zero-forcing (ZF), PZF relaxes the constraints on the relay beamforming matrix such that only partial user-interference, instead of all, is canceled at the relay. The users eliminate the remaining interferences through self-interference and successive interference cancellation. A sum-rate maximization problem is formulated and solved to exploit the extra degrees-of-freedom resulted from PZF. Simulation results show that the proposed PZF relay beamforming design achieves significantly higher network sum-rates than the existing linear beamforming designs.
△ Less
Submitted 19 April, 2018; v1 submitted 11 October, 2017;
originally announced October 2017.
-
Storage Allocation for Multi-Class Distributed Data Storage Systems
Authors:
Koosha Pourtahmasi Roshandeh,
Moslem Noori,
Masoud Ardakani,
Chintha Tellambura
Abstract:
Distributed storage systems (DSSs) provide a scalable solution for reliably storing massive amounts of data coming from various sources. Heterogeneity of these data sources often means different data classes (types) exist in a DSS, each needing a different level of quality of service (QoS). As a result, efficient data storage and retrieval processes that satisfy various QoS requirements are needed…
▽ More
Distributed storage systems (DSSs) provide a scalable solution for reliably storing massive amounts of data coming from various sources. Heterogeneity of these data sources often means different data classes (types) exist in a DSS, each needing a different level of quality of service (QoS). As a result, efficient data storage and retrieval processes that satisfy various QoS requirements are needed. This paper studies storage allocation, meaning how data of different classes must be spread over the set of storage nodes of a DSS. More specifically, assuming a probabilistic access to the storage nodes, we aim at maximizing the weighted sum of the probability of successful data recovery of data classes, when for each class a minimum QoS (probability of successful recovery) is guaranteed. Solving this optimization problem for a general setup is intractable. Thus, we find the optimal storage allocation when the data of each class is spread minimally over the storage nodes, i.e. minimal spreading allocation (MSA). Using upper bounds on the performance of the optimal storage allocation, we show that the optimal MSA allocation approaches the optimal performance in many practical cases. Computer simulations are also presented to better illustrate the results.
△ Less
Submitted 23 January, 2017;
originally announced January 2017.
-
Maximizing Data Rate for Multiway Relay Channels with Pairwise Transmission Strategy
Authors:
Reza Rafie Borujeny,
Moslem Noori,
Masoud Ardakani
Abstract:
In a multiway relay channel (MWRC), pairwise transmission strategy can be used to reduce the computational complexity at the relay and the users without sacrificing the data rate, significantly. The performance of such pairwise strategies, however, is affected by the way that the users are paired to transmit. In this paper, we study the effect of pairing on the common rate and sum rate of an MWRC…
▽ More
In a multiway relay channel (MWRC), pairwise transmission strategy can be used to reduce the computational complexity at the relay and the users without sacrificing the data rate, significantly. The performance of such pairwise strategies, however, is affected by the way that the users are paired to transmit. In this paper, we study the effect of pairing on the common rate and sum rate of an MWRC with functional-decode-forward (FDF) relaying strategy where users experience asymmetric channel conditions. To this end, we first develop a graphical model for an MWRC with pairwise transmission strategy. Using this model, we then find the maximum achievable common rate and sum rate as well as the user pairings that achieve these rates. This marks the ultimate performance of FDF relaying in an MWRC setup. Further, we show that the rate enhancement achieved through the optimal user pairing becomes less pronounced at higher SNRs. Using computer simulations, the performance of the optimal pairing is compared with those of other proposed pairings in the literature.
△ Less
Submitted 29 August, 2016;
originally announced August 2016.
-
On the Capacity Region of ALOHA Protocol for the Internet of Things
Authors:
Moslem Noori,
Samira Rahimian,
Masoud Ardakani
Abstract:
Accommodating the needs of a large number of diverse users in the Internet of Things (IoT), notably managing how the users access the common channel, has posed unique challenges to the network designers. In this paper, we study a heterogeneous IoT network consisting of multiple classes of users who may have different service requirements. For this network, we consider the application of irregular…
▽ More
Accommodating the needs of a large number of diverse users in the Internet of Things (IoT), notably managing how the users access the common channel, has posed unique challenges to the network designers. In this paper, we study a heterogeneous IoT network consisting of multiple classes of users who may have different service requirements. For this network, we consider the application of irregular repetition slotted ALOHA (IRSA) that is shown to offer large throughput for single-class networks. Then, we focus on finding the network performance boundaries by studying the set of feasible throughput values for each class, called the capacity region. To this end, we first introduce the concept of dual network of a multi-class network meaning a homogeneous network with the same number of users. We then prove that finding the capacity region of the assumed multi-class network boils down to finding the maximum achievable throughput of its dual network. Using this finding, we then discuss how any given point of the capacity region can be achieved. Further, a delay performance study is conducted to evaluate the average and maximum packet transmission delay experienced by the users of each class.
△ Less
Submitted 27 May, 2016;
originally announced May 2016.
-
On Storage Allocation for Maximum Service Rate in Distributed Storage Systems
Authors:
Moslem Noori,
Emina Soljanin,
Masoud Ardakani
Abstract:
Storage allocation affects important performance measures of distributed storage systems. Most previous studies on the storage allocation consider its effect separately either on the success of the data recovery or on the service rate (time) where it is assumed that no access failure happens in the system. In this paper, we go one step further and incorporate the access model and the success of da…
▽ More
Storage allocation affects important performance measures of distributed storage systems. Most previous studies on the storage allocation consider its effect separately either on the success of the data recovery or on the service rate (time) where it is assumed that no access failure happens in the system. In this paper, we go one step further and incorporate the access model and the success of data recovery into the service rate analysis. In particular, we focus on quasi-uniform storage allocation and provide a service rate analysis for both fixed-size and probabilistic access models at the nodes. Using this analysis, we then show that for the case of exponential waiting time distribution at individuals storage nodes, minimal spreading allocation results in the highest system service rate for both access models. This means that for a given storage budget, replication provides a better service rate than a coded storage solution.
△ Less
Submitted 11 May, 2016;
originally announced May 2016.
-
Unveiling the nature of the unidentified gamma-ray sources VI: gamma-ray blazar candidates in the WISH survey and their radio properties
Authors:
M. Nori,
M. Giroletti,
F. Massaro,
R. D'Abrusco,
A. Paggi,
G. Tosti,
S. Funk
Abstract:
According to the second Fermi LAT Catalog (2FGL), about one third of the gamma-ray sources listed have no assigned counterparts at lower energies. Many statistical methods have been developed to find proper counterparts for these sources. We explore the sky area covered at low radio frequency by Westerbork in the Southern Hemisphere (WISH) survey to search for blazar-like associations among the un…
▽ More
According to the second Fermi LAT Catalog (2FGL), about one third of the gamma-ray sources listed have no assigned counterparts at lower energies. Many statistical methods have been developed to find proper counterparts for these sources. We explore the sky area covered at low radio frequency by Westerbork in the Southern Hemisphere (WISH) survey to search for blazar-like associations among the unidentified gamma-ray sources listed in the 2FGL (UGSs). Searching the WISH and NRAO VLA Sky Survey (NVSS) radio surveys within the positional uncertainty regions of the 2FGL UGSs, we select as gamma-ray blazar candidates the radio sources characterized by flat radio spectra between 352 MHz and 1400 MHz. We propose new gamma-ray blazar associations for eight UGSs and we also discuss their spectral properties at low radio frequencies. We compare the radio flux density distribution of the low radio frequency gamma-ray blazar candidates with that of gamma-ray blazars associated with other methods. We find significant differences between these distributions. Finally, we discuss the results of this association method and its possible applicability to other regions of the sky and future radio surveys.
△ Less
Submitted 10 March, 2015;
originally announced March 2015.
-
On the Achievable Rates of Pairwise Multiway Relay Channels
Authors:
Reza Rafie Borujeny,
Moslem Noori,
Masoud Ardakani
Abstract:
In this paper, we study the effect of users' transmission ordering on the common rate and sum rate of pairwise multiway relay channels (MWRCs) with functional-decode-forward strategy. To this end, we first develop a graphical model for the data transmission in a pairwise MWRC. Using this model, we then find the optimal orderings that achieve the maximum common rate and sum rate of the system. The…
▽ More
In this paper, we study the effect of users' transmission ordering on the common rate and sum rate of pairwise multiway relay channels (MWRCs) with functional-decode-forward strategy. To this end, we first develop a graphical model for the data transmission in a pairwise MWRC. Using this model, we then find the optimal orderings that achieve the maximum common rate and sum rate of the system. The achieved maximum common and sum rate are also found. Moreover, we show that the performance gap between optimal orderings and a random ordering vanishes when SNR increases. Computer simulations are presented for better illustration of the results.
△ Less
Submitted 18 June, 2014;
originally announced June 2014.
-
Unveiling the nature of the unidentified gamma-ray sources III: gamma-ray blazar-like counterparts at low radio frequencies
Authors:
F. Massaro,
R. D'Abrusco,
M. Giroletti,
A. Paggi,
N. Masetti,
G. Tosti,
M. Nori,
S. Funk
Abstract:
About one third of the gamma-ray sources listed in the second Fermi LAT catalog (2FGL) have no firmly established counterpart at lower energies so being classified as unidentified gamma-ray sources (UGSs). Here we propose a new approach to find candidate counterparts for the UGSs based on the 325 MHz radio survey performed with Westerbork Synthesis Radio Telescope (WSRT) in the northern hemisphere…
▽ More
About one third of the gamma-ray sources listed in the second Fermi LAT catalog (2FGL) have no firmly established counterpart at lower energies so being classified as unidentified gamma-ray sources (UGSs). Here we propose a new approach to find candidate counterparts for the UGSs based on the 325 MHz radio survey performed with Westerbork Synthesis Radio Telescope (WSRT) in the northern hemisphere. First we investigate the low-frequency radio properties of blazars, the largest known population of gamma-ray sources; then we search for sources with similar radio properties combining the information derived from the Westerbork Northern Sky Survey (WENSS) with those of the NRAO VLA Sky survey (NVSS). We present a list of candidate counterparts for 32 UGSs with at least one counterpart in the WENSS. We also performed an extensive research in literature to look for infrared and optical counterparts of the gamma-ray blazar candidates selected with the low-frequency radio observations to confirm their nature. On the basis of our multifrequency research we identify 23 new gamma-ray blazar candidates out of 32 UGSs investigated. Comparison with previous results on the UGSs are also presented. Finally, we speculate on the advantages on the use of the low-frequency radio observations to associate UGSs and to search for gamma-ray pulsar candidates.
△ Less
Submitted 1 August, 2013;
originally announced August 2013.
-
Low-Latency Data Sharing in Erasure Multi-Way Relay Channels
Authors:
Moslem Noori,
Hossein Bagheri,
Masoud Ardakani
Abstract:
We consider an erasure multi-way relay channel (EMWRC) in which several users share their data through a relay over erasure links. Assuming no feedback channel between the users and the relay, we first identify the challenges for designing a data sharing scheme over an EMWRC. Then, to overcome these challenges, we propose practical low-latency and low-complexity data sharing schemes based on fount…
▽ More
We consider an erasure multi-way relay channel (EMWRC) in which several users share their data through a relay over erasure links. Assuming no feedback channel between the users and the relay, we first identify the challenges for designing a data sharing scheme over an EMWRC. Then, to overcome these challenges, we propose practical low-latency and low-complexity data sharing schemes based on fountain coding. Later, we introduce the notion of end-to-end erasure rate (EEER) and analytically derive it for the proposed schemes. EEER is then used to calculate the achievable rate and transmission overhead of the proposed schemes. Using EEER and computer simulations, the achievable rates and transmission overhead of our proposed schemes are compared with the ones of one-way relaying. This comparison implies that when the number of users and the channel erasure rates are not large, our proposed schemes outperform one-way relaying. We also find an upper bound on the achievable rates of EMWRC and observe that depending on the number of users and channel erasure rates, our proposed solutions can perform very close to this bound.
△ Less
Submitted 30 July, 2013; v1 submitted 5 November, 2012;
originally announced November 2012.
-
Summation and the Poisson formula
Authors:
Madhav V. Nori
Abstract:
By giving the definition of the sum of a series indexed by a set on which a group acts, we prove that the sum of the series that defines the Riemann zeta function, the Epstein zeta function, and a few other series indexed by $\Z^k$ has an intrinsic meaning as a complex number, independent of the requirements of analytic continuation.
The definition of the sum requires nothing more than algebra a…
▽ More
By giving the definition of the sum of a series indexed by a set on which a group acts, we prove that the sum of the series that defines the Riemann zeta function, the Epstein zeta function, and a few other series indexed by $\Z^k$ has an intrinsic meaning as a complex number, independent of the requirements of analytic continuation.
The definition of the sum requires nothing more than algebra and the concept of absolute convergence. The analytical significance of the algebraically defined sum is then explained by an argument that relies on the Poisson formula for tempered distributions.
△ Less
Submitted 9 February, 2020; v1 submitted 16 April, 2012;
originally announced April 2012.
-
K-theory and the Enriched Tits Building
Authors:
M. V. Nori,
V. Srinivas
Abstract:
Motivated by the splitting principle, we define certain simplicial complexes associated to an associative ring $A$, which have an action of the general linear group $GL(A)$. This leads to an exact sequence, involving Quillen's algebraic K-groups of $A$ and the symbol map. Computations in low degrees lead to another view on Suslin's theorem on the Bloch group, and perhaps show a way towards possibl…
▽ More
Motivated by the splitting principle, we define certain simplicial complexes associated to an associative ring $A$, which have an action of the general linear group $GL(A)$. This leads to an exact sequence, involving Quillen's algebraic K-groups of $A$ and the symbol map. Computations in low degrees lead to another view on Suslin's theorem on the Bloch group, and perhaps show a way towards possible generalizations.
△ Less
Submitted 31 May, 2010; v1 submitted 27 April, 2010;
originally announced April 2010.
-
A Probability Model for Lifetime of Wireless Sensor Networks
Authors:
Moslem Noori,
Masoud Ardakani
Abstract:
Considering a wireless sensor network whose nodes are distributed randomly over a given area, a probability model for the network lifetime is provided. Using this model and assuming that packet generation follows a Poisson distribution, an analytical expression for the complementary cumulative density function (ccdf) of the lifetime is obtained. Using this ccdf, one can accurately find the proba…
▽ More
Considering a wireless sensor network whose nodes are distributed randomly over a given area, a probability model for the network lifetime is provided. Using this model and assuming that packet generation follows a Poisson distribution, an analytical expression for the complementary cumulative density function (ccdf) of the lifetime is obtained. Using this ccdf, one can accurately find the probability that the network achieves a given lifetime. It is also shown that when the number of sensors, $N$, is large, with an error exponentially decaying with $N$, one can predict whether or not a certain lifetime can be achieved. The results of this work are obtained for both multi-hop and single-hop wireless sensor networks and are verified with computer simulation. The approaches of this paper are shown to be applicable to other packet generation models and the effect of the area shape is also investigated.
△ Less
Submitted 28 September, 2007;
originally announced October 2007.
-
Solvable fundamental groups of algebraic varieties and Kähler manifolds
Authors:
Donu Arapura,
Madhav Nori
Abstract:
This is a long overdue write up of the following: If the fundamental group of a normal complex algebraic variety (respectively Zariski open subset of a compact Kähler manifold) is a solvable group of matrices over Q (respectively polycyclic group), then it is virtually nilpotent. This should be interpreted as saying that a large class of solvable groups will not occur as fundamental groups of su…
▽ More
This is a long overdue write up of the following: If the fundamental group of a normal complex algebraic variety (respectively Zariski open subset of a compact Kähler manifold) is a solvable group of matrices over Q (respectively polycyclic group), then it is virtually nilpotent. This should be interpreted as saying that a large class of solvable groups will not occur as fundamental groups of such spaces. The essential strategy is to first "complete" these groups to algebraic groups (generalizing constructions of Malcev and Mostow), and then check that the identity component is unipotent. This is done by Galois theoretic methods in the algebraic case, and is reduced to homological properties of one dimensional characters in the analytic case.
△ Less
Submitted 24 June, 1997; v1 submitted 24 June, 1997;
originally announced June 1997.