-
Hardware Realization of Neuromorphic Computing with a 4-Port Photonic Reservoir for Modulation Format Identification
Authors:
Enes Şeker,
Rijil Thomas,
Guillermo von Hünefeld,
Stephan Suckow,
Mahdi Kaveh,
Gregor Ronniger,
Pooyan Safari,
Isaac Sackey,
David Stahl,
Colja Schubert,
Johannes Karl Fischer,
Ronald Freund,
Max C. Lemme
Abstract:
The fields of machine learning and artificial intelligence drive researchers to explore energy-efficient, brain-inspired new hardware. Reservoir computing encompasses recurrent neural networks for sequential data processing and matches the performance of other recurrent networks with less training and lower costs. However, traditional software-based neural networks suffer from high energy consumpt…
▽ More
The fields of machine learning and artificial intelligence drive researchers to explore energy-efficient, brain-inspired new hardware. Reservoir computing encompasses recurrent neural networks for sequential data processing and matches the performance of other recurrent networks with less training and lower costs. However, traditional software-based neural networks suffer from high energy consumption due to computational demands and massive data transfer needs. Photonic reservoir computing overcomes this challenge with energy-efficient neuromorphic photonic integrated circuits or NeuroPICs. Here, we introduce a reservoir NeuroPIC used for modulation format identification in C-band telecommunication network monitoring. It is built on a silicon-on-insulator platform with a 4-port reservoir architecture consisting of a set of physical nodes connected via delay lines. We comprehensively describe the NeuroPIC design and fabrication, experimentally demonstrate its performance, and compare it with simulations. The NeuroPIC incorporates non-linearity through a simple digital readout and achieves close to 100% accuracy in identifying several configurations of quadrature amplitude modulation formats transmitted over 20 km of optical fiber at 32 GBaud symbol rate. The NeuroPIC performance is robust against fabrication imperfections like waveguide propagation loss, phase randomization, etc. and delay line length variations. Furthermore, the experimental results exceeded numerical simulations, which we attribute to enhanced signal interference in the experimental NeuroPIC output. Our energy-efficient photonic approach has the potential for high-speed temporal data processing in a variety of applications.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
Identification of the Chromophores in Prussian blue
Authors:
Li Musen,
Robin Purchase,
Parvin Safari,
Martyna Judd,
Emily C. Barker,
Jeffrey R. Reimers,
Nicholas Cox,
Paul J. Low,
Elmars Krausz
Abstract:
Prussian blue was the world's first synthetic dye. Its structural, optical and magnetic properties have led to many applications in technology and medicine, and provide paradigms for understanding coordination polymers, framework materials and mixed-valence compounds. The intense red absorption of Prussian blue that characterises chemical and physical properties critical to many of these applicati…
▽ More
Prussian blue was the world's first synthetic dye. Its structural, optical and magnetic properties have led to many applications in technology and medicine, and provide paradigms for understanding coordination polymers, framework materials and mixed-valence compounds. The intense red absorption of Prussian blue that characterises chemical and physical properties critical to many of these applications is now shown to arise from localised intervalence charge transfer transitions within two chromophoric variants (ligand isomers) of an idealised "dimer" fragment {(NC)5FeII}(mu-CN){FeIII(NC)3(H2O)2}. This fragment is only available in modern interpretations of the material's crystal structure, with the traditional motif {(NC)5FeII}(mu-CN){FeIII(NC)5} shown not to facilitate visible absorption. Essential to the analysis is the demonstration, obtained independently using absorption and magnetic circular dichroism spectroscopies, that spectra of Prussian blues are strongly influenced by particle size and (subsequent) light scattering. These interpretations are guided and supported by density functional theory calculations (CAM-B3LYP), supplemented by coupled cluster and Bethe-Salpeter spectral simulations, as well as electron paramagnetic resonance spectroscopy of Prussian blue and a model molecular dimeric ion [Fe2(CN)11]6-.
△ Less
Submitted 7 July, 2023;
originally announced July 2023.
-
On Radical of Intuitionistic Fuzzy Primary Submodule
Authors:
Abbas Taherpour,
Shaban Ghalandarzadeh,
Parastoo Malakooti Rad,
Parvin Safari
Abstract:
In this paper, we further study the theory of Intuitionistic fuzzy submodules and we will define intuitionistic fuzzy primary submodule with the help of the definition of a radical submodule, and we also study the properties of these submodules. Furthermore, homomorphic image and pre-image of intuitionistic fuzzy primary submodule are investigated.
In this paper, we further study the theory of Intuitionistic fuzzy submodules and we will define intuitionistic fuzzy primary submodule with the help of the definition of a radical submodule, and we also study the properties of these submodules. Furthermore, homomorphic image and pre-image of intuitionistic fuzzy primary submodule are investigated.
△ Less
Submitted 20 July, 2022;
originally announced July 2022.
-
The Persian Dependency Treebank Made Universal
Authors:
Mohammad Sadegh Rasooli,
Pegah Safari,
Amirsaeid Moloodi,
Alireza Nourian
Abstract:
We describe an automatic method for converting the Persian Dependency Treebank (Rasooli et al, 2013) to Universal Dependencies. This treebank contains 29107 sentences. Our experiments along with manual linguistic analysis show that our data is more compatible with Universal Dependencies than the Uppsala Persian Universal Dependency Treebank (Seraji et al., 2016), and is larger in size and more div…
▽ More
We describe an automatic method for converting the Persian Dependency Treebank (Rasooli et al, 2013) to Universal Dependencies. This treebank contains 29107 sentences. Our experiments along with manual linguistic analysis show that our data is more compatible with Universal Dependencies than the Uppsala Persian Universal Dependency Treebank (Seraji et al., 2016), and is larger in size and more diverse in vocabulary. Our data brings in a labeled attachment F-score of 85.2 in supervised parsing. Our delexicalized Persian-to-English parser transfer experiments show that a parsing model trained on our data is ~2% absolutely more accurate than that of Seraji et al. (2016) in terms of labeled attachment score.
△ Less
Submitted 22 September, 2020; v1 submitted 21 September, 2020;
originally announced September 2020.
-
Relative Seiberg-Witten invariants and a sum formula
Authors:
Mohammad Farajzadeh-Tehrani,
Pedram Safari
Abstract:
We study relative Seiberg-Witten moduli spaces and define relative invariants for a pair $(X,Σ)$ consisting of a smooth, closed, oriented 4-manifold $X$ and a smooth, closed, oriented 2-dimensional submanifold $Σ\!\subset\!X$ with positive genus. These relative Seiberg-Witten invariants are meant to be the counterparts of relative Gromov-Witten invariants. We also obtain a sum formula (aka a produ…
▽ More
We study relative Seiberg-Witten moduli spaces and define relative invariants for a pair $(X,Σ)$ consisting of a smooth, closed, oriented 4-manifold $X$ and a smooth, closed, oriented 2-dimensional submanifold $Σ\!\subset\!X$ with positive genus. These relative Seiberg-Witten invariants are meant to be the counterparts of relative Gromov-Witten invariants. We also obtain a sum formula (aka a product formula) that relates the SW invariants of a sum $X$ of two closed oriented 4-manifolds $X_1$ and $X_2$ along a common oriented surface $Σ$ with dual self-intersections to the relative SW invariants of $(X_1,Σ)$ and $(X_2,Σ)$. Our formula generalizes Morgan-Szabó-Taubes' product formula.
△ Less
Submitted 20 September, 2020;
originally announced September 2020.
-
Privacy-Preserving Distributed Learning Framework for 6G Telecom Ecosystems
Authors:
Pooyan Safari,
Behnam Shariati,
Johannes Karl Fischer
Abstract:
We present a privacy-preserving distributed learning framework for telecom ecosystems in the 6G-era that enables the vision of shared ownership and governance of ML models, while protecting the privacy of the data owners. We demonstrate its benefits by applying it to the use-case of Quality of Transmission (QoT) estimation in multi-domain multi-vendor optical networks, where no data of individual…
▽ More
We present a privacy-preserving distributed learning framework for telecom ecosystems in the 6G-era that enables the vision of shared ownership and governance of ML models, while protecting the privacy of the data owners. We demonstrate its benefits by applying it to the use-case of Quality of Transmission (QoT) estimation in multi-domain multi-vendor optical networks, where no data of individual domains is shared with the network management system (NMS).
△ Less
Submitted 17 August, 2020;
originally announced August 2020.
-
Self-attention encoding and pooling for speaker recognition
Authors:
Pooyan Safari,
Miquel India,
Javier Hernando
Abstract:
The computing power of mobile devices limits the end-user applications in terms of storage size, processing, memory and energy consumption. These limitations motivate researchers for the design of more efficient deep models. On the other hand, self-attention networks based on Transformer architecture have attracted remarkable interests due to their high parallelization capabilities and strong perf…
▽ More
The computing power of mobile devices limits the end-user applications in terms of storage size, processing, memory and energy consumption. These limitations motivate researchers for the design of more efficient deep models. On the other hand, self-attention networks based on Transformer architecture have attracted remarkable interests due to their high parallelization capabilities and strong performance on a variety of Natural Language Processing (NLP) applications. Inspired by the Transformer, we propose a tandem Self-Attention Encoding and Pooling (SAEP) mechanism to obtain a discriminative speaker embedding given non-fixed length speech utterances. SAEP is a stack of identical blocks solely relied on self-attention and position-wise feed-forward networks to create vector representation of speakers. This approach encodes short-term speaker spectral features into speaker embeddings to be used in text-independent speaker verification. We have evaluated this approach on both VoxCeleb1 & 2 datasets. The proposed architecture is able to outperform the baseline x-vector, and shows competitive performance to some other benchmarks based on convolutions, with a significant reduction in model size. It employs 94%, 95%, and 73% less parameters compared to ResNet-34, ResNet-50, and x-vector, respectively. This indicates that the proposed fully attention based architecture is more efficient in extracting time-invariant features from speaker utterances.
△ Less
Submitted 3 August, 2020;
originally announced August 2020.
-
Double Multi-Head Attention for Speaker Verification
Authors:
Miquel India,
Pooyan Safari,
Javier Hernando
Abstract:
Most state-of-the-art Deep Learning systems for speaker verification are based on speaker embedding extractors. These architectures are commonly composed of a feature extractor front-end together with a pooling layer to encode variable-length utterances into fixed-length speaker vectors. In this paper we present Double Multi-Head Attention pooling, which extends our previous approach based on Self…
▽ More
Most state-of-the-art Deep Learning systems for speaker verification are based on speaker embedding extractors. These architectures are commonly composed of a feature extractor front-end together with a pooling layer to encode variable-length utterances into fixed-length speaker vectors. In this paper we present Double Multi-Head Attention pooling, which extends our previous approach based on Self Multi-Head Attention. An additional self attention layer is added to the pooling layer that summarizes the context vectors produced by Multi-Head Attention into a unique speaker representation. This method enhances the pooling mechanism by giving weights to the information captured for each head and it results in creating more discriminative speaker embeddings. We have evaluated our approach with the VoxCeleb2 dataset. Our results show 6.09% and 5.23% relative improvement in terms of EER compared to Self Attention pooling and Self Multi-Head Attention, respectively. According to the obtained results, Double Multi-Head Attention has shown to be an excellent approach to efficiently select the most relevant features captured by the CNN-based front-ends from the speech signal.
△ Less
Submitted 9 January, 2021; v1 submitted 26 July, 2020;
originally announced July 2020.
-
Self Multi-Head Attention for Speaker Recognition
Authors:
Miquel India,
Pooyan Safari,
Javier Hernando
Abstract:
Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to obtain an utterance level speaker representation. In this work we propose the use of an attention mechanism to obtain a discriminative speaker embedding given non…
▽ More
Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to obtain an utterance level speaker representation. In this work we propose the use of an attention mechanism to obtain a discriminative speaker embedding given non fixed length speech utterances. Our system is based on a Convolutional Neural Network (CNN) that encodes short-term speaker features from the spectrogram and a self multi-head attention model that maps these representations into a long-term speaker embedding. The attention model that we propose produces multiple alignments from different subsegments of the CNN encoded states over the sequence. Hence this mechanism works as a pooling layer which decides the most discriminative features over the sequence to obtain an utterance level representation. We have tested this approach for the verification task for the VoxCeleb1 dataset. The results show that self multi-head attention outperforms both temporal and statistical pooling methods with a 18\% of relative EER. Obtained results show a 58\% relative improvement in EER compared to i-vector+PLDA.
△ Less
Submitted 1 July, 2019; v1 submitted 24 June, 2019;
originally announced June 2019.
-
Towards Recognizing Phrase Translation Processes: Experiments on English-French
Authors:
Yuming Zhai,
Pooyan Safari,
Gabriel Illouz,
Alexandre Allauzen,
Anne Vilnat
Abstract:
When translating phrases (words or group of words), human translators, consciously or not, resort to different translation processes apart from the literal translation, such as Idiom Equivalence, Generalization, Particularization, Semantic Modulation, etc. Translators and linguists (such as Vinay and Darbelnet, Newmark, etc.) have proposed several typologies to characterize the different translati…
▽ More
When translating phrases (words or group of words), human translators, consciously or not, resort to different translation processes apart from the literal translation, such as Idiom Equivalence, Generalization, Particularization, Semantic Modulation, etc. Translators and linguists (such as Vinay and Darbelnet, Newmark, etc.) have proposed several typologies to characterize the different translation processes. However, to the best of our knowledge, there has not been effort to automatically classify these fine-grained translation processes. Recently, an English-French parallel corpus of TED Talks has been manually annotated with translation process categories, along with established annotation guidelines. Based on these annotated examples, we propose an automatic classification of translation processes at subsentential level. Experimental results show that we can distinguish non-literal translation from literal translation with an accuracy of 87.09%, and 55.20% for classifying among five non-literal translation processes. This work demonstrates that it is possible to automatically classify translation processes. Even with a small amount of annotated examples, our experiments show the directions that we can follow in future work. One of our long term objectives is leveraging this automatic classification to better control paraphrase extraction from bilingual parallel corpora.
△ Less
Submitted 27 April, 2019;
originally announced April 2019.
-
Future exchange rates and Siegel's paradox
Authors:
Keivan Mallahi-Karai,
Pedram Safari
Abstract:
Siegel's paradox is a fundamental question in international finance about exchange rates for futures contracts and has puzzled many scholars for over forty years. The unorthodox approach presented in this article leads to an arbitrage-free solution which is invariant under currency re-denominations and is symmetric, as explained. We will also give a complete classification of all such aggregators…
▽ More
Siegel's paradox is a fundamental question in international finance about exchange rates for futures contracts and has puzzled many scholars for over forty years. The unorthodox approach presented in this article leads to an arbitrage-free solution which is invariant under currency re-denominations and is symmetric, as explained. We will also give a complete classification of all such aggregators in the general case. The formula obtained in this setting therefore describes all the negotiated no-arbitrage forward exchange rates in terms of a reciprocity function.
Keywords: Siegel's paradox, forward exchange rates, discount bias.
△ Less
Submitted 8 May, 2018;
originally announced May 2018.
-
Kripke Semantics for Fuzzy Logics
Authors:
Parvin Safari,
Saeed Salehi
Abstract:
Kripke frames (and models) provide a suitable semantics for sub-classical logics, for example Intuitionistic Logic (of Brouwer and Heyting) axiomatizes the reflexive and transitive Kripke frames (with persistent satisfaction relations), and the Basic Logic (of Visser) axiomatizes transitive Kripke frames (with persistent satisfaction relations). Here, we investigate whether Kripke frames/models co…
▽ More
Kripke frames (and models) provide a suitable semantics for sub-classical logics, for example Intuitionistic Logic (of Brouwer and Heyting) axiomatizes the reflexive and transitive Kripke frames (with persistent satisfaction relations), and the Basic Logic (of Visser) axiomatizes transitive Kripke frames (with persistent satisfaction relations). Here, we investigate whether Kripke frames/models could provide a semantics for fuzzy logics. For each axiom of the Basic Fuzzy Logic, necessary and sufficient conditions are sought for Kripke frames/models which satisfy them. It turns out that the only fuzzy logics (logics containing the Basic Fuzzy Logic) which are sound and complete with respect to a class of Kripke frames/models are the extensions of the Gödel Logic (or the super-intuitionistic logic of Dummett), indeed this logic is sound and strongly complete with respect to reflexive, transitive and connected (linear) Kripke frames (with persistent satisfaction relations). This provides a semantic characterization for the Gödel Logic among (propositional) fuzzy logics.
△ Less
Submitted 10 December, 2016; v1 submitted 14 July, 2016;
originally announced July 2016.
-
Gluing Seiberg-Witten monopoles
Authors:
Pedram Safari
Abstract:
We establish a canonical gluing procedure for Seiberg-Witten monopoles on the two pieces of a closed, oriented 4-manifold X which is split along a 3-dimensional closed, oriented submanifold. We only assume that the (unperturbed) character variety is Kuranishi-smooth and the limiting maps are transversal -- then we will be able to glue regular monopoles over the irreducible points of the characte…
▽ More
We establish a canonical gluing procedure for Seiberg-Witten monopoles on the two pieces of a closed, oriented 4-manifold X which is split along a 3-dimensional closed, oriented submanifold. We only assume that the (unperturbed) character variety is Kuranishi-smooth and the limiting maps are transversal -- then we will be able to glue regular monopoles over the irreducible points of the character variety.
△ Less
Submitted 19 November, 2003;
originally announced November 2003.
