Showing 1–50 of 57 results for author: Marković, Đ

Training of Physical Neural Networks

Authors: Ali Momeni, Babak Rahmani, Benjamin Scellier, Logan G. Wright, Peter L. McMahon, Clara C. Wanjura, Yuhang Li, Anas Skalli, Natalia G. Berloff, Tatsuhiro Onodera, Ilker Oguz, Francesco Morichetti, Philipp del Hougne, Manuel Le Gallo, Abu Sebastian, Azalia Mirhoseini, Cheng Zhang, Danijela Marković, Daniel Brunner, Christophe Moser, Sylvain Gigan, Florian Marquardt, Aydogan Ozcan, Julie Grollier, Andrea J. Liu , et al. (3 additional authors not shown)

Abstract: Physical neural networks (PNNs) are a class of neural-like networks that leverage the properties of physical systems to perform computation. While PNNs are so far a niche research area with small-scale laboratory demonstrations, they are arguably one of the most underappreciated important opportunities in modern AI. Could we train AI models 1000x larger than current ones? Could we do this and also… ▽ More Physical neural networks (PNNs) are a class of neural-like networks that leverage the properties of physical systems to perform computation. While PNNs are so far a niche research area with small-scale laboratory demonstrations, they are arguably one of the most underappreciated important opportunities in modern AI. Could we train AI models 1000x larger than current ones? Could we do this and also have them perform inference locally and privately on edge devices, such as smartphones or sensors? Research over the past few years has shown that the answer to all these questions is likely "yes, with enough research": PNNs could one day radically change what is possible and practical for AI systems. To do this will however require rethinking both how AI models work, and how they are trained - primarily by considering the problems through the constraints of the underlying hardware physics. To train PNNs at large scale, many methods including backpropagation-based and backpropagation-free approaches are now being explored. These methods have various trade-offs, and so far no method has been shown to scale to the same scale and performance as the backpropagation algorithm widely used in deep learning today. However, this is rapidly changing, and a diverse ecosystem of training techniques provides clues for how PNNs may one day be utilized to create both more efficient realizations of current-scale AI models, and to enable unprecedented-scale models. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Comments: 29 pages, 4 figures

Reframing the Expected Free Energy: Four Formulations and a Unification

Authors: Théophile Champion, Howard Bowman, Dimitrije Marković, Marek Grześ

Abstract: Active inference is a leading theory of perception, learning and decision making, which can be applied to neuroscience, robotics, psychology, and machine learning. Active inference is based on the expected free energy, which is mostly justified by the intuitive plausibility of its formulations, e.g., the risk plus ambiguity and information gain / pragmatic value formulations. This paper seek to fo… ▽ More Active inference is a leading theory of perception, learning and decision making, which can be applied to neuroscience, robotics, psychology, and machine learning. Active inference is based on the expected free energy, which is mostly justified by the intuitive plausibility of its formulations, e.g., the risk plus ambiguity and information gain / pragmatic value formulations. This paper seek to formalize the problem of deriving these formulations from a single root expected free energy definition, i.e., the unification problem. Then, we study two settings, each one having its own root expected free energy definition. In the first setting, no justification for the expected free energy has been proposed to date, but all the formulations can be recovered from it. However, in this setting, the agent cannot have arbitrary prior preferences over observations. Indeed, only a limited class of prior preferences over observations is compatible with the likelihood map** of the generative model. In the second setting, a justification of the root expected free energy definition is known, but this setting only accounts for two formulations, i.e., the risk over states plus ambiguity and entropy plus expected energy formulations. △ Less

Submitted 22 February, 2024; originally announced February 2024.

Comments: 17 pages, 2 figures

ScoreDec: A Phase-preserving High-Fidelity Audio Codec with A Generalized Score-based Diffusion Post-filter

Authors: Yi-Chiao Wu, Dejan Marković, Steven Krenn, Israel D. Gebru, Alexander Richard

Abstract: Although recent mainstream waveform-domain end-to-end (E2E) neural audio codecs achieve impressive coded audio quality with a very low bitrate, the quality gap between the coded and natural audio is still significant. A generative adversarial network (GAN) training is usually required for these E2E neural codecs because of the difficulty of direct phase modeling. However, such adversarial learning… ▽ More Although recent mainstream waveform-domain end-to-end (E2E) neural audio codecs achieve impressive coded audio quality with a very low bitrate, the quality gap between the coded and natural audio is still significant. A generative adversarial network (GAN) training is usually required for these E2E neural codecs because of the difficulty of direct phase modeling. However, such adversarial learning hinders these codecs from preserving the original phase information. To achieve human-level naturalness with a reasonable bitrate, preserve the original phase, and get rid of the tricky and opaque GAN training, we develop a score-based diffusion post-filter (SPF) in the complex spectral domain and combine our previous AudioDec with the SPF to propose ScoreDec, which can be trained using only spectral and score-matching losses. Both the objective and subjective experimental results show that ScoreDec with a 24~kbps bitrate encodes and decodes full-band 48~kHz speech with human-level naturalness and well-preserved phase information. △ Less

Submitted 22 January, 2024; originally announced January 2024.

Comments: 5 pages, 3 figures, 2 tables. Proc. ICASSP, 2024

Thermodynamic formalism and anomalous transport in 1D semiclassical Bose-Hubbard chain

Authors: Dragan Marković, Mihailo Čubrović

Abstract: We analyze the time-dependent free energy functionals of the semiclassical one-dimensional Bose-Hubbard chain. We first review the weakly chaotic dynamics and the consequent early-time anomalous diffusion in the system. The anomalous diffusion is robust, appears with strictly quantized coefficients, and persists even for very long chains (more than hundred sites), crossing over to normal diffusion… ▽ More We analyze the time-dependent free energy functionals of the semiclassical one-dimensional Bose-Hubbard chain. We first review the weakly chaotic dynamics and the consequent early-time anomalous diffusion in the system. The anomalous diffusion is robust, appears with strictly quantized coefficients, and persists even for very long chains (more than hundred sites), crossing over to normal diffusion at late times. We identify fast (angle) and slow (action) variables and thus consider annealed and quenched partition functions, corresponding to fixing the actions and integrating over the actions, respectively. We observe the leading quantum effects in the annealed free energy, whereas the quenched energy is undefined in the thermodynamic limit, signaling the absence of thermodynamic equilibrium in the quenched regime. But already the leading correction away from the quenched regime reproduces the annealed partition function exactly. This encapsulates the fact that in both slow- and fast-chaos regime both the anomalous and the normal diffusion can be seen (though at different times). △ Less

Submitted 22 March, 2024; v1 submitted 28 December, 2023; originally announced December 2023.

Comments: 16 pages, 3 figures; proceedings of PHOTONICA 2023, Belgrade, ; this version: review part reduced, new results on transport, clarified the connection between transport and thermodynamics

An epistemic logic for modeling decisions in the context of incomplete knowledge

Authors: Đorđe Marković, Simon Vandevelde, Linde Vanbesien, Joost Vennekens, Marc Denecker

Abstract: Substantial efforts have been made in develo** various Decision Modeling formalisms, both from industry and academia. A challenging problem is that of expressing decision knowledge in the context of incomplete knowledge. In such contexts, decisions depend on what is known or not known. We argue that none of the existing formalisms for modeling decisions are capable of correctly capturing the epi… ▽ More Substantial efforts have been made in develo** various Decision Modeling formalisms, both from industry and academia. A challenging problem is that of expressing decision knowledge in the context of incomplete knowledge. In such contexts, decisions depend on what is known or not known. We argue that none of the existing formalisms for modeling decisions are capable of correctly capturing the epistemic nature of such decisions, inevitably causing issues in situations of uncertainty. This paper presents a new language for modeling decisions with incomplete knowledge. It combines three principles: stratification, autoepistemic logic, and definitions. A knowledge base in this language is a hierarchy of epistemic theories, where each component theory may epistemically reason on the knowledge in lower theories, and decisions are made using definitions with epistemic conditions. △ Less

Submitted 18 December, 2023; originally announced December 2023.

Comments: 9 pages, 3 figures, to be published as a poster version in the ACM/SIGAPP conference

Supervised structure learning

Authors: Karl J. Friston, Lancelot Da Costa, Alexander Tschantz, Alex Kiefer, Tommaso Salvatori, Victorita Neacsu, Magnus Koudahl, Conor Heins, Noor Sajid, Dimitrije Markovic, Thomas Parr, Tim Verbelen, Christopher L Buckley

Abstract: This paper concerns structure learning or discovery of discrete generative models. It focuses on Bayesian model selection and the assimilation of training data or content, with a special emphasis on the order in which data are ingested. A key move - in the ensuing schemes - is to place priors on the selection of models, based upon expected free energy. In this setting, expected free energy reduces… ▽ More This paper concerns structure learning or discovery of discrete generative models. It focuses on Bayesian model selection and the assimilation of training data or content, with a special emphasis on the order in which data are ingested. A key move - in the ensuing schemes - is to place priors on the selection of models, based upon expected free energy. In this setting, expected free energy reduces to a constrained mutual information, where the constraints inherit from priors over outcomes (i.e., preferred outcomes). The resulting scheme is first used to perform image classification on the MNIST dataset to illustrate the basic idea, and then tested on a more challenging problem of discovering models with dynamics, using a simple sprite-based visual disentanglement paradigm and the Tower of Hanoi (cf., blocks world) problem. In these examples, generative models are constructed autodidactically to recover (i.e., disentangle) the factorial structure of latent states - and their characteristic paths or dynamics. △ Less

Submitted 16 November, 2023; originally announced November 2023.

Sounding Bodies: Modeling 3D Spatial Sound of Humans Using Body Pose and Audio

Authors: Xudong Xu, Dejan Markovic, Jacob Sandakly, Todd Keebler, Steven Krenn, Alexander Richard

Abstract: While 3D human body modeling has received much attention in computer vision, modeling the acoustic equivalent, i.e. modeling 3D spatial audio produced by body motion and speech, has fallen short in the community. To close this gap, we present a model that can generate accurate 3D spatial audio for full human bodies. The system consumes, as input, audio signals from headset microphones and body pos… ▽ More While 3D human body modeling has received much attention in computer vision, modeling the acoustic equivalent, i.e. modeling 3D spatial audio produced by body motion and speech, has fallen short in the community. To close this gap, we present a model that can generate accurate 3D spatial audio for full human bodies. The system consumes, as input, audio signals from headset microphones and body pose, and produces, as output, a 3D sound field surrounding the transmitter's body, from which spatial audio can be rendered at any arbitrary position in the 3D space. We collect a first-of-its-kind multimodal dataset of human bodies, recorded with multiple cameras and a spherical array of 345 microphones. In an empirical evaluation, we demonstrate that our model can produce accurate body-induced sound fields when trained with a suitable loss. Dataset and code are available online. △ Less

Submitted 1 November, 2023; originally announced November 2023.

Comments: 37th Conference on Neural Information Processing Systems (NeurIPS 2023)

Bayesian sparsification for deep neural networks with Bayesian model reduction

Authors: Dimitrije Marković, Karl J. Friston, Stefan J. Kiebel

Abstract: Deep learning's immense capabilities are often constrained by the complexity of its models, leading to an increasing demand for effective sparsification techniques. Bayesian sparsification for deep learning emerges as a crucial approach, facilitating the design of models that are both computationally efficient and competitive in terms of performance across various deep learning applications. The s… ▽ More Deep learning's immense capabilities are often constrained by the complexity of its models, leading to an increasing demand for effective sparsification techniques. Bayesian sparsification for deep learning emerges as a crucial approach, facilitating the design of models that are both computationally efficient and competitive in terms of performance across various deep learning applications. The state-of-the-art -- in Bayesian sparsification of deep neural networks -- combines structural shrinkage priors on model weights with an approximate inference scheme based on stochastic variational inference. However, model inversion of the full generative model is exceptionally computationally demanding, especially when compared to standard deep learning of point estimates. In this context, we advocate for the use of Bayesian model reduction (BMR) as a more efficient alternative for pruning of model weights. As a generalization of the Savage-Dickey ratio, BMR allows a post-hoc elimination of redundant model weights based on the posterior estimates under a straightforward (non-hierarchical) generative model. Our comparative study highlights the advantages of the BMR method relative to established approaches based on hierarchical horseshoe priors over model weights. We illustrate the potential of BMR across various deep learning architectures, from classical networks like LeNet to modern frameworks such as Vision Transformers and MLP-Mixers. △ Less

Submitted 27 October, 2023; v1 submitted 21 September, 2023; originally announced September 2023.

MSC Class: 68T07

Chaos and anomalous transport in a semiclassical Bose-Hubbard chain

Authors: Dragan Marković, Mihailo Čubrović

Abstract: We study chaotic dynamics and anomalous transport in a Bose-Hubbard chain in the semiclassical regime (the limit when the number of particles goes to infinity). We find that the system has mixed phase space with both regular and chaotic dynamics, even for long chains with up to hundred wells. The consequence of the mixed phase space is strongly anomalous diffusion in the space of occupation number… ▽ More We study chaotic dynamics and anomalous transport in a Bose-Hubbard chain in the semiclassical regime (the limit when the number of particles goes to infinity). We find that the system has mixed phase space with both regular and chaotic dynamics, even for long chains with up to hundred wells. The consequence of the mixed phase space is strongly anomalous diffusion in the space of occupation numbers, with a discrete set of transport exponents. After very long times the system crosses over to the hydrodynamic regime with normal diffusion. Anomalous transport is quite universal, almost completely independent of the parameters of the model (Coulomb interaction, chemical potential): it is mainly determined by the initial distribution of particles along the chain. We corroborate our findings by analytical arguments: scaling analysis for the anomalous regime and the Langevin equation for the normal diffusion regime. △ Less

Submitted 20 February, 2024; v1 submitted 28 August, 2023; originally announced August 2023.

Comments: 24 pages, 18 figures; this version: added discussion of hyperchaos and Lyapunov exponents plus minor clarifications and corrections

Journal ref: Phys. Rev. E 109 (2024) 3, 034213

Training an Ising Machine with Equilibrium Propagation

Authors: Jérémie Laydevant, Danijela Markovic, Julie Grollier

Abstract: Ising machines, which are hardware implementations of the Ising model of coupled spins, have been influential in the development of unsupervised learning algorithms at the origins of Artificial Intelligence (AI). However, their application to AI has been limited due to the complexities in matching supervised training methods with Ising machine physics, even though these methods are essential for a… ▽ More Ising machines, which are hardware implementations of the Ising model of coupled spins, have been influential in the development of unsupervised learning algorithms at the origins of Artificial Intelligence (AI). However, their application to AI has been limited due to the complexities in matching supervised training methods with Ising machine physics, even though these methods are essential for achieving high accuracy. In this study, we demonstrate a novel approach to train Ising machines in a supervised way through the Equilibrium Propagation algorithm, achieving comparable results to software-based implementations. We employ the quantum annealing procedure of the D-Wave Ising machine to train a fully-connected neural network on the MNIST dataset. Furthermore, we demonstrate that the machine's connectivity supports convolution operations, enabling the training of a compact convolutional network with minimal spins per neuron. Our findings establish Ising machines as a promising trainable hardware platform for AI, with the potential to enhance machine learning applications. △ Less

Submitted 22 May, 2023; originally announced May 2023.

AudioDec: An Open-source Streaming High-fidelity Neural Audio Codec

Authors: Yi-Chiao Wu, Israel D. Gebru, Dejan Marković, Alexander Richard

Abstract: A good audio codec for live applications such as telecommunication is characterized by three key properties: (1) compression, i.e.\ the bitrate that is required to transmit the signal should be as low as possible; (2) latency, i.e.\ encoding and decoding the signal needs to be fast enough to enable communication without or with only minimal noticeable delay; and (3) reconstruction quality of the s… ▽ More A good audio codec for live applications such as telecommunication is characterized by three key properties: (1) compression, i.e.\ the bitrate that is required to transmit the signal should be as low as possible; (2) latency, i.e.\ encoding and decoding the signal needs to be fast enough to enable communication without or with only minimal noticeable delay; and (3) reconstruction quality of the signal. In this work, we propose an open-source, streamable, and real-time neural audio codec that achieves strong performance along all three axes: it can reconstruct highly natural sounding 48~kHz speech signals while operating at only 12~kbps and running with less than 6~ms (GPU)/10~ms (CPU) latency. An efficient training paradigm is also demonstrated for develo** such neural audio codecs for real-world scenarios. Both objective and subjective evaluations using the VCTK corpus are provided. To sum up, AudioDec is a well-developed plug-and-play benchmark for audio codec applications. △ Less

Submitted 26 May, 2023; originally announced May 2023.

Comments: 5 pages, 1 figure, 5 tables. Proc. ICASSP, 2023

Compensation of anisotropy in spin-Hall devices for neuromorphic applications

Authors: Pankaj Sethi, Dédalo Sanz-Hernández, Florian Godel, Sachin Krishnia, Fernando Ajejas, Alice Mizrahi, Vincent Cros, Danijela Marković, Julie Grollier

Abstract: Spintronic nano-oscillators with reduced non-linearity could offer key benefits for realizing neuromorphic applications such as spike-based neurons and frequency multiplexing in neural networks. Here, we experimentally demonstrate the reduction in non-linearity of a spin-Hall nano-oscillator (SHNO) by compensation of its effective magnetic anisotropy. The study involves optimization of Co/Ni multi… ▽ More Spintronic nano-oscillators with reduced non-linearity could offer key benefits for realizing neuromorphic applications such as spike-based neurons and frequency multiplexing in neural networks. Here, we experimentally demonstrate the reduction in non-linearity of a spin-Hall nano-oscillator (SHNO) by compensation of its effective magnetic anisotropy. The study involves optimization of Co/Ni multilayer growth to achieve the compensation, followed by spin diode measurements on patterned microstrips to quantify their anisotropy. The relation between the second ($H_{k2}$ = 0.47 mT) and the first order ($H_{k1}^{eff}$ = $-$0.8 mT) anisotropy fields reveals the existence of an easy cone, thereby validating the presence of compensation. Furthermore, we demonstrate a synapse based on the compensated spin diode which has a fixed frequency when the input power is varied. We then study the current-induced auto-oscillation properties of SHNOs on compensated films by patterning nano-constrictions of widths 200 and 100 nm. The invariance of the resonance frequency and linewidth of the compensated SHNO with applied dc current indicates the absence of non-linearity. This independence is maintained irrespective of the applied external fields and its orientations. The compensated SHNO obtained has a linewidth of 1.1 MHz and a peak output power of up to 1 pW/MHz emulating a nano-neuron with a low linewidth and a fixed frequency. △ Less

Submitted 10 January, 2023; originally announced January 2023.

Multilayer spintronic neural networks with radio-frequency connections

Authors: Andrew Ross, Nathan Leroux, Arnaud de Riz, Danijela Marković, Dédalo Sanz-Hernández, Juan Trastoy, Paolo Bortolotti, Damien Querlioz, Leandro Martins, Luana Benetti, Marcel S. Claro, Pedro Anacleto, Alejandro Schulman, Thierry Taris, Jean-Baptiste Begueret, Sylvain Saïghi, Alex S. Jenkins, Ricardo Ferreira, Adrien F. Vincent, Alice Mizrahi, Julie Grollier

Abstract: Spintronic nano-synapses and nano-neurons perform complex cognitive computations with high accuracy thanks to their rich, reproducible and controllable magnetization dynamics. These dynamical nanodevices could transform artificial intelligence hardware, provided that they implement state-of-the art deep neural networks. However, there is today no scalable way to connect them in multilayers. Here w… ▽ More Spintronic nano-synapses and nano-neurons perform complex cognitive computations with high accuracy thanks to their rich, reproducible and controllable magnetization dynamics. These dynamical nanodevices could transform artificial intelligence hardware, provided that they implement state-of-the art deep neural networks. However, there is today no scalable way to connect them in multilayers. Here we show that the flagship nano-components of spintronics, magnetic tunnel junctions, can be connected into multilayer neural networks where they implement both synapses and neurons thanks to their magnetization dynamics, and communicate by processing, transmitting and receiving radio frequency (RF) signals. We build a hardware spintronic neural network composed of nine magnetic tunnel junctions connected in two layers, and show that it natively classifies nonlinearly-separable RF inputs with an accuracy of 97.7%. Using physical simulations, we demonstrate that a large network of nanoscale junctions can achieve state-of the-art identification of drones from their RF transmissions, without digitization, and consuming only a few milliwatts, which is a gain of more than four orders of magnitude in power consumption compared to currently used techniques. This study lays the foundation for deep, dynamical, spintronic neural networks. △ Less

Submitted 7 November, 2022; originally announced November 2022.

Classification of multi-frequency RF signals by extreme learning, using magnetic tunnel junctions as neurons and synapses

Authors: Nathan Leroux, Danijela Marković, Dédalo Sanz-Hernández, Juan Trastoy, Paolo Bortolotti, Alejandro Schulman, Luana Benetti, Alex Jenkins, Ricardo Ferreira, Julie Grollier, Alice Mizrahi

Abstract: Extracting information from radiofrequency (RF) signals using artificial neural networks at low energy cost is a critical need for a wide range of applications from radars to health. These RF inputs are composed of multiples frequencies. Here we show that magnetic tunnel junctions can process analogue RF inputs with multiple frequencies in parallel and perform synaptic operations. Using a backprop… ▽ More Extracting information from radiofrequency (RF) signals using artificial neural networks at low energy cost is a critical need for a wide range of applications from radars to health. These RF inputs are composed of multiples frequencies. Here we show that magnetic tunnel junctions can process analogue RF inputs with multiple frequencies in parallel and perform synaptic operations. Using a backpropagation-free method called extreme learning, we classify noisy images encoded by RF signals, using experimental data from magnetic tunnel junctions functioning as both synapses and neurons. We achieve the same accuracy as an equivalent software neural network. These results are a key step for embedded radiofrequency artificial intelligence. △ Less

Submitted 20 April, 2023; v1 submitted 2 November, 2022; originally announced November 2022.

Comments: 9 pages, 5 figures

Reconstructing the Dynamic Directivity of Unconstrained Speech

Authors: Camille Noufi, Dejan Markovic, Peter Dodds

Abstract: This article presents a method for estimating and reconstructing the spatial energy distribution pattern of natural speech, which is crucial for achieving realistic vocal presence in virtual communication settings. The method comprises two stages. First, recordings of speech captured by a real, static microphone array are used to create an egocentric virtual array that tracks the movement of the s… ▽ More This article presents a method for estimating and reconstructing the spatial energy distribution pattern of natural speech, which is crucial for achieving realistic vocal presence in virtual communication settings. The method comprises two stages. First, recordings of speech captured by a real, static microphone array are used to create an egocentric virtual array that tracks the movement of the speaker over time. This virtual array is used to measure and encode the high-resolution directivity pattern of the speech signal as it evolves dynamically with natural speech and movement. In the second stage, the encoded directivity representation is utilized to train a machine learning model that can estimate the full, dynamic directivity pattern given a limited set of speech signals, such as those recorded using the microphones on a head-mounted display. Our results show that neural networks can accurately estimate the full directivity pattern of natural, unconstrained speech from limited information. The proposed method for estimating and reconstructing the spatial energy distribution pattern of natural speech, along with the evaluation of various machine learning models and training paradigms, provides an important contribution to the development of realistic vocal presence in virtual communication settings. △ Less

Submitted 5 September, 2023; v1 submitted 9 September, 2022; originally announced September 2022.

Comments: In proceedings of I3DA 2023 - The 2023 International Conference on Immersive and 3D Audio. DOI coming soon

Quantum reservoir neural network implementation on coherently coupled quantum oscillators

Authors: Julien Dudas, Baptiste Carles, Erwan Plouet, Alice Mizrahi, Julie Grollier, Danijela Marković

Abstract: Quantum reservoir computing is a promising approach for quantum neural networks, capable of solving hard learning tasks on both classical and quantum input data. However, current approaches with qubits suffer from limited connectivity. We propose an implementation for quantum reservoir that obtains a large number of densely connected neurons by using parametrically coupled quantum oscillators inst… ▽ More Quantum reservoir computing is a promising approach for quantum neural networks, capable of solving hard learning tasks on both classical and quantum input data. However, current approaches with qubits suffer from limited connectivity. We propose an implementation for quantum reservoir that obtains a large number of densely connected neurons by using parametrically coupled quantum oscillators instead of physically coupled qubits. We analyse a specific hardware implementation based on superconducting circuits: with just two coupled quantum oscillators, we create a quantum reservoir comprising up to 81 neurons. We obtain state-of-the-art accuracy of 99 % on benchmark tasks that otherwise require at least 24 classical oscillators to be solved. Our results give the coupling and dissipation requirements in the system and show how they affect the performance of the quantum reservoir. Beyond quantum reservoir computing, the use of parametrically coupled bosonic modes holds promise for realizing large quantum neural network architectures, with billions of neurons implemented with only 10 coupled quantum oscillators. △ Less

Submitted 2 May, 2023; v1 submitted 7 September, 2022; originally announced September 2022.

End-to-End Binaural Speech Synthesis

Authors: Wen Chin Huang, Dejan Markovic, Alexander Richard, Israel Dejene Gebru, Anjali Menon

Abstract: In this work, we present an end-to-end binaural speech synthesis system that combines a low-bitrate audio codec with a powerful binaural decoder that is capable of accurate speech binauralization while faithfully reconstructing environmental factors like ambient noise or reverb. The network is a modified vector-quantized variational autoencoder, trained with several carefully designed objectives,… ▽ More In this work, we present an end-to-end binaural speech synthesis system that combines a low-bitrate audio codec with a powerful binaural decoder that is capable of accurate speech binauralization while faithfully reconstructing environmental factors like ambient noise or reverb. The network is a modified vector-quantized variational autoencoder, trained with several carefully designed objectives, including an adversarial loss. We evaluate the proposed system on an internal binaural dataset with objective metrics and a perceptual study. Results show that the proposed approach matches the ground truth data more closely than previous methods. In particular, we demonstrate the capability of the adversarial loss in capturing environment effects needed to create an authentic auditory scene. △ Less

Submitted 8 July, 2022; originally announced July 2022.

Comments: Accepted to INTERSPEECH 2022. Demo link: https://unilight.github.io/Publication-Demos/publications/e2e-binaural-synthesis

Implicit Neural Spatial Filtering for Multichannel Source Separation in the Waveform Domain

Authors: Dejan Markovic, Alexandre Defossez, Alexander Richard

Abstract: We present a single-stage casual waveform-to-waveform multichannel model that can separate moving sound sources based on their broad spatial locations in a dynamic acoustic scene. We divide the scene into two spatial regions containing, respectively, the target and the interfering sound sources. The model is trained end-to-end and performs spatial processing implicitly, without any components base… ▽ More We present a single-stage casual waveform-to-waveform multichannel model that can separate moving sound sources based on their broad spatial locations in a dynamic acoustic scene. We divide the scene into two spatial regions containing, respectively, the target and the interfering sound sources. The model is trained end-to-end and performs spatial processing implicitly, without any components based on traditional processing or use of hand-crafted spatial features. We evaluate the proposed model on a real-world dataset and show that the model matches the performance of an oracle beamformer followed by a state-of-the-art single-channel enhancement network. △ Less

Submitted 30 June, 2022; originally announced June 2022.

Comments: Interspeech 2022

Coherently coupled quantum oscillators for quantum reservoir computing

Authors: Julien Dudas, Julie Grollier, Danijela Marković

Abstract: We analyze the properties of a quantum system composed of two coherently coupled quantum oscillators and show through simulations that it fulfills the two properties required for reservoir computing: non-linearity and fading memory. We first show that the basis states of this system apply a set of nonlinear transformations on the input signals and thus can implement neurons. We then show that the… ▽ More We analyze the properties of a quantum system composed of two coherently coupled quantum oscillators and show through simulations that it fulfills the two properties required for reservoir computing: non-linearity and fading memory. We first show that the basis states of this system apply a set of nonlinear transformations on the input signals and thus can implement neurons. We then show that the system exhibits a fading memory that can be controlled by its dissipation rates. Finally we show that a strong coupling between the oscillators is important in order to ensure complex dynamics and to populate a number of basis state neurons that is exponential in the number of physical devices. △ Less

Submitted 29 April, 2022; originally announced April 2022.

Audio-Visual Speech Codecs: Rethinking Audio-Visual Speech Enhancement by Re-Synthesis

Authors: Karren Yang, Dejan Markovic, Steven Krenn, Vasu Agrawal, Alexander Richard

Abstract: Since facial actions such as lip movements contain significant information about speech content, it is not surprising that audio-visual speech enhancement methods are more accurate than their audio-only counterparts. Yet, state-of-the-art approaches still struggle to generate clean, realistic speech without noise artifacts and unnatural distortions in challenging acoustic environments. In this pap… ▽ More Since facial actions such as lip movements contain significant information about speech content, it is not surprising that audio-visual speech enhancement methods are more accurate than their audio-only counterparts. Yet, state-of-the-art approaches still struggle to generate clean, realistic speech without noise artifacts and unnatural distortions in challenging acoustic environments. In this paper, we propose a novel audio-visual speech enhancement framework for high-fidelity telecommunications in AR/VR. Our approach leverages audio-visual speech cues to generate the codes of a neural speech codec, enabling efficient synthesis of clean, realistic speech from noisy signals. Given the importance of speaker-specific cues in speech, we focus on develo** personalized models that work well for individual speakers. We demonstrate the efficacy of our approach on a new audio-visual speech dataset collected in an unconstrained, large vocabulary setting, as well as existing audio-visual datasets, outperforming speech enhancement baselines on both quantitative metrics and human evaluation studies. Please see the supplemental video for qualitative results at https://github.com/facebookresearch/facestar/releases/download/paper_materials/video.mp4. △ Less

Submitted 31 March, 2022; originally announced March 2022.

Detecting few-body quantum chaos: out-of-time ordered correlators at saturation

Authors: Dragan Marković, Mihailo Čubrović

Abstract: We study numerically and analytically the time dependence and saturation of out-of-time ordered correlators (OTOC) in chaotic few-body quantum-mechanical systems: quantum Henon-Heiles system (weakly chaotic), BMN matrix quantum mechanics (strongly chaotic) and Gaussian random matrix ensembles. The growth pattern of quantum-mechanical OTOC is complex and nonuniversal, with no clear exponential regi… ▽ More We study numerically and analytically the time dependence and saturation of out-of-time ordered correlators (OTOC) in chaotic few-body quantum-mechanical systems: quantum Henon-Heiles system (weakly chaotic), BMN matrix quantum mechanics (strongly chaotic) and Gaussian random matrix ensembles. The growth pattern of quantum-mechanical OTOC is complex and nonuniversal, with no clear exponential regime at relevant timescales in any of the examples studied (which is not in contradiction to the exponential growth found in the literature for many-body systems, i.e. fields). On the other hand, the plateau (saturated) value of OTOC reached at long times decreases with temperature in a simple and universal way: $\exp(\mathrm{const.}/T^2)$ for strong chaos (including random matrices) and $\exp(\mathrm{const.}/T)$ for weak chaos. For small matrices and sufficiently complex operators, there is also another, high-temperature regime where the saturated OTOC grows with temperature. Therefore, the plateau OTOC value is a meaningful indicator of few-body quantum chaos. We also discuss some general consequences of our findings for the AdS/CFT duality. △ Less

Submitted 29 May, 2022; v1 submitted 18 February, 2022; originally announced February 2022.

Comments: 27 pages, 10 figures. Final version: typos corrected, published in JHEP

Journal ref: JHEP05 2022, 023 (2022)

Convolutional Neural Networks with Radio-Frequency Spintronic Nano-Devices

Authors: Nathan Leroux, Arnaud De Riz, Dédalo Sanz-Hernández, Danijela Marković, Alice Mizrahi, Julie Grollier

Abstract: Convolutional neural networks are state-of-the-art and ubiquitous in modern signal processing and machine vision. Nowadays, hardware solutions based on emerging nanodevices are designed to reduce the power consumption of these networks. Spintronics devices are promising for information processing because of the various neural and synaptic functionalities they offer. However, due to their low OFF/O… ▽ More Convolutional neural networks are state-of-the-art and ubiquitous in modern signal processing and machine vision. Nowadays, hardware solutions based on emerging nanodevices are designed to reduce the power consumption of these networks. Spintronics devices are promising for information processing because of the various neural and synaptic functionalities they offer. However, due to their low OFF/ON ratio, performing all the multiplications required for convolutions in a single step with a crossbar array of spintronic memories would cause sneak-path currents. Here we present an architecture where synaptic communications have a frequency selectivity that prevents crosstalk caused by sneak-path currents. We first demonstrate how a chain of spintronic resonators can function as synapses and make convolutions by sequentially rectifying radio-frequency signals encoding consecutive sets of inputs. We show that a parallel implementation is possible with multiple chains of spintronic resonators to avoid storing intermediate computational steps in memory. We propose two different spatial arrangements for these chains. For each of them, we explain how to tune many artificial synapses simultaneously, exploiting the synaptic weight sharing specific to convolutions. We show how information can be transmitted between convolutional layers by using spintronic oscillators as artificial microwave neurons. Finally, we simulate a network of these radio-frequency resonators and spintronic oscillators to solve the MNIST handwritten digits dataset, and obtain results comparable to software convolutional neural networks. Since it can run convolutional neural networks fully in parallel in a single step with nano devices, the architecture proposed in this paper is promising for embedded applications requiring machine vision, such as autonomous driving. △ Less

Submitted 9 November, 2021; originally announced November 2021.

Easy-plane spin Hall nano-oscillators as spiking neurons for neuromorphic computing

Authors: Danijela Marković, Matthew W. Daniels, Pankaj Sethi, Andrew D. Kent, Mark D. Stiles, Julie Grollier

Abstract: We show analytically using a macrospin approximation that easy-plane spin Hall nano-oscillators excited by a spin-current polarized perpendicularly to the easy-plane have phase dynamics analogous to that of Josephson junctions. Similarly to Josephson junctions, they can reproduce the spiking behavior of biological neurons that is appropriate for neuromorphic computing. We perform micromagnetic sim… ▽ More We show analytically using a macrospin approximation that easy-plane spin Hall nano-oscillators excited by a spin-current polarized perpendicularly to the easy-plane have phase dynamics analogous to that of Josephson junctions. Similarly to Josephson junctions, they can reproduce the spiking behavior of biological neurons that is appropriate for neuromorphic computing. We perform micromagnetic simulations of such oscillators realized in the nano-constriction geometry and show that the easy-plane spiking dynamics is preserved in an experimentally feasible architecture. Finally we simulate two elementary neural network blocks that implement operations essential for neuromorphic computing. First, we show that output spikes energies from two neurons can be summed and injected into a following layer neuron and second, we demonstrate that outputs can be multiplied by synaptic weights implemented by locally modifying the anisotropy. △ Less

Submitted 13 October, 2021; originally announced October 2021.

Comments: 9 pages, 11 figures

2022 Roadmap on Neuromorphic Computing and Engineering

Authors: Dennis V. Christensen, Regina Dittmann, Bernabé Linares-Barranco, Abu Sebastian, Manuel Le Gallo, Andrea Redaelli, Stefan Slesazeck, Thomas Mikolajick, Sabina Spiga, Stephan Menzel, Ilia Valov, Gianluca Milano, Carlo Ricciardi, Shi-Jun Liang, Feng Miao, Mario Lanza, Tyler J. Quill, Scott T. Keene, Alberto Salleo, Julie Grollier, Danijela Marković, Alice Mizrahi, Peng Yao, J. Joshua Yang, Giacomo Indiveri , et al. (34 additional authors not shown)

Abstract: Modern computation based on the von Neumann architecture is today a mature cutting-edge science. In the Von Neumann architecture, processing and memory units are implemented as separate blocks interchanging data intensively and continuously. This data transfer is responsible for a large part of the power consumption. The next generation computer technology is expected to solve problems at the exas… ▽ More Modern computation based on the von Neumann architecture is today a mature cutting-edge science. In the Von Neumann architecture, processing and memory units are implemented as separate blocks interchanging data intensively and continuously. This data transfer is responsible for a large part of the power consumption. The next generation computer technology is expected to solve problems at the exascale with 1018 calculations each second. Even though these future computers will be incredibly powerful, if they are based on von Neumann type architectures, they will consume between 20 and 30 megawatts of power and will not have intrinsic physically built-in capabilities to learn or deal with complex data as our brain does. These needs can be addressed by neuromorphic computing systems which are inspired by the biological concepts of the human brain. This new generation of computers has the potential to be used for the storage and processing of large amounts of digital information with much lower power consumption than conventional processors. Among their potential future applications, an important niche is moving the control from data centers to edge devices. The aim of this Roadmap is to present a snapshot of the present state of neuromorphic technology and provide an opinion on the challenges and opportunities that the future holds in the major areas of neuromorphic technology, namely materials, devices, neuromorphic circuits, neuromorphic algorithms, applications, and ethics. The Roadmap is a collection of perspectives where leading researchers in the neuromorphic community provide their own view about the current state and the future challenges. We hope that this Roadmap will be a useful resource to readers outside this field, for those who are just entering the field, and for those who are well established in the neuromorphic community. https://doi.org/10.1088/2634-4386/ac4a83 △ Less

Submitted 13 January, 2022; v1 submitted 12 May, 2021; originally announced May 2021.

Journal ref: Neuromorph. Comput. Eng. 2 022501 (2022)

Hardware realization of the multiply and accumulate operation on radio-frequency signals with magnetic tunnel junctions

Authors: Nathan Leroux, Alice Mizrahi, Danijela Markovic, Dedalo Sanz-Hernandez, Juan Trastoy, Paolo Bortolotti, Leandro Martins, Alex Jenkins, Ricardo Ferreira, Julie Grollier

Abstract: Artificial neural networks are a valuable tool for radio-frequency (RF) signal classification in many applications, but digitization of analog signals and the use of general purpose hardware non-optimized for training make the process slow and energetically costly. Recent theoretical work has proposed to use nano-devices called magnetic tunnel junctions, which exhibit intrinsic RF dynamics, to imp… ▽ More Artificial neural networks are a valuable tool for radio-frequency (RF) signal classification in many applications, but digitization of analog signals and the use of general purpose hardware non-optimized for training make the process slow and energetically costly. Recent theoretical work has proposed to use nano-devices called magnetic tunnel junctions, which exhibit intrinsic RF dynamics, to implement in hardware the Multiply and Accumulate (MAC) operation, a key building block of neural networks, directly using analogue RF signals. In this article, we experimentally demonstrate that a magnetic tunnel junction can perform multiplication of RF powers, with tunable positive and negative synaptic weights. Using two magnetic tunnel junctions connected in series we demonstrate the MAC operation and use it for classification of RF signals. These results open the path to embedded systems capable of analyzing RF signals with neural networks directly after the antenna, at low power cost and high speed. △ Less

Submitted 14 April, 2021; v1 submitted 22 March, 2021; originally announced March 2021.

Comments: 10 pages, 4 figures

An empirical evaluation of active inference in multi-armed bandits

Authors: Dimitrije Markovic, Hrvoje Stojic, Sarah Schwoebel, Stefan J. Kiebel

Abstract: A key feature of sequential decision making under uncertainty is a need to balance between exploiting--choosing the best action according to the current knowledge, and exploring--obtaining information about values of other actions. The multi-armed bandit problem, a classical task that captures this trade-off, served as a vehicle in machine learning for develo** bandit algorithms that proved to b… ▽ More A key feature of sequential decision making under uncertainty is a need to balance between exploiting--choosing the best action according to the current knowledge, and exploring--obtaining information about values of other actions. The multi-armed bandit problem, a classical task that captures this trade-off, served as a vehicle in machine learning for develo** bandit algorithms that proved to be useful in numerous industrial applications. The active inference framework, an approach to sequential decision making recently developed in neuroscience for understanding human and animal behaviour, is distinguished by its sophisticated strategy for resolving the exploration-exploitation trade-off. This makes active inference an exciting alternative to already established bandit algorithms. Here we derive an efficient and scalable approximate active inference algorithm and compare it to two state-of-the-art bandit algorithms: Bayesian upper confidence bound and optimistic Thompson sampling. This comparison is done on two types of bandit problems: a stationary and a dynamic switching bandit. Our empirical evaluation shows that the active inference algorithm does not produce efficient long-term behaviour in stationary bandits. However, in the more challenging switching bandit problem active inference performs substantially better than the two state-of-the-art bandit algorithms. The results open exciting venues for further research in theoretical and applied machine learning, as well as lend additional credibility to active inference as a general framework for studying human and animal behaviour. △ Less

Submitted 4 August, 2021; v1 submitted 21 January, 2021; originally announced January 2021.

Radio-Frequency Multiply-And-Accumulate Operations with Spintronic Synapses

Authors: N. Leroux, D. Marković, E. Martin, T. Petrisor, D. Querlioz, A. Mizrahi, J. Grollier

Abstract: Exploiting the physics of nanoelectronic devices is a major lead for implementing compact, fast, and energy efficient artificial intelligence. In this work, we propose an original road in this direction, where assemblies of spintronic resonators used as artificial synapses can classify an-alogue radio-frequency signals directly without digitalization. The resonators convert the ra-dio-frequency in… ▽ More Exploiting the physics of nanoelectronic devices is a major lead for implementing compact, fast, and energy efficient artificial intelligence. In this work, we propose an original road in this direction, where assemblies of spintronic resonators used as artificial synapses can classify an-alogue radio-frequency signals directly without digitalization. The resonators convert the ra-dio-frequency input signals into direct voltages through the spin-diode effect. In the process, they multiply the input signals by a synaptic weight, which depends on their resonance fre-quency. We demonstrate through physical simulations with parameters extracted from exper-imental devices that frequency-multiplexed assemblies of resonators implement the corner-stone operation of artificial neural networks, the Multiply-And-Accumulate (MAC), directly on microwave inputs. The results show that even with a non-ideal realistic model, the outputs obtained with our architecture remain comparable to that of a traditional MAC operation. Us-ing a conventional machine learning framework augmented with equations describing the physics of spintronic resonators, we train a single layer neural network to classify radio-fre-quency signals encoding 8x8 pixel handwritten digits pictures. The spintronic neural network recognizes the digits with an accuracy of 99.96 %, equivalent to purely software neural net-works. This MAC implementation offers a promising solution for fast, low-power radio-fre-quency classification applications, and a new building block for spintronic deep neural net-works. △ Less

Submitted 5 April, 2021; v1 submitted 16 November, 2020; originally announced November 2020.

Journal ref: Phys. Rev. Applied 15, 034067 (2021)

Quantum neuromorphic computing

Authors: Danijela Marković, Julie Grollier

Abstract: Quantum neuromorphic computing physically implements neural networks in brain-inspired quantum hardware to speed up their computation. In this perspective article, we show that this emerging paradigm could make the best use of the existing and near future intermediate size quantum computers. Some approaches are based on parametrized quantum circuits, and use neural network-inspired algorithms to t… ▽ More Quantum neuromorphic computing physically implements neural networks in brain-inspired quantum hardware to speed up their computation. In this perspective article, we show that this emerging paradigm could make the best use of the existing and near future intermediate size quantum computers. Some approaches are based on parametrized quantum circuits, and use neural network-inspired algorithms to train them. Other approaches, closer to classical neuromorphic computing, take advantage of the physical properties of quantum oscillator assemblies to mimic neurons and compute. We discuss the different implementations of quantum neuromorphic networks with digital and analog circuits, highlight their respective advantages, and review exciting recent experimental results. △ Less

Submitted 26 June, 2020; originally announced June 2020.

Neuronal Sequence Models for Bayesian Online Inference

Authors: Sascha Frölich, Dimitrije Marković, Stefan J. Kiebel

Abstract: Sequential neuronal activity underlies a wide range of processes in the brain. Neuroscientific evidence for neuronal sequences has been reported in domains as diverse as perception, motor control, speech, spatial navigation and memory. Consequently, different dynamical principles have been proposed as possible sequence-generating mechanisms. Combining experimental findings with computational conce… ▽ More Sequential neuronal activity underlies a wide range of processes in the brain. Neuroscientific evidence for neuronal sequences has been reported in domains as diverse as perception, motor control, speech, spatial navigation and memory. Consequently, different dynamical principles have been proposed as possible sequence-generating mechanisms. Combining experimental findings with computational concepts like the Bayesian brain hypothesis and predictive coding leads to the interesting possibility that predictive and inferential processes in the brain are grounded on generative processes which maintain a sequential structure. While probabilistic inference about ongoing sequences is a useful computational model for both the analysis of neuroscientific data and a wide range of problems in artificial recognition and motor control, research on the subject is relatively scarce and distributed over different fields in the neurosciences. Here we review key findings about neuronal sequences and relate these to the concept of online inference on sequences as a model of sensory-motor processing and recognition. We propose that describing sequential neuronal activity as an expression of probabilistic inference over sequences may lead to novel perspectives on brain function. Importantly, it is promising to translate the key idea of probabilistic inference on sequences to machine learning, in order to address challenges in the real-time recognition of speech and human motion. △ Less

Submitted 2 April, 2020; originally announced April 2020.

Physics for Neuromorphic Computing

Authors: Danijela Markovic, Alice Mizrahi, Damien Querlioz, Julie Grollier

Abstract: Neuromorphic computing takes inspiration from the brain to create energy efficient hardware for information processing, capable of highly sophisticated tasks. In this article, we make the case that building this new hardware necessitates reinventing electronics. We show that research in physics and material science will be key to create artificial nano-neurons and synapses, to connect them togethe… ▽ More Neuromorphic computing takes inspiration from the brain to create energy efficient hardware for information processing, capable of highly sophisticated tasks. In this article, we make the case that building this new hardware necessitates reinventing electronics. We show that research in physics and material science will be key to create artificial nano-neurons and synapses, to connect them together in huge numbers, to organize them in complex systems, and to compute with them efficiently. We describe how some researchers choose to take inspiration from artificial intelligence to move forward in this direction, whereas others prefer taking inspiration from neuroscience, and we highlight recent striking results obtained with these two approaches. Finally, we discuss the challenges and perspectives in neuromorphic physics, which include develo** the algorithms and the hardware hand in hand, making significant advances with small toy systems, as well as building large scale networks. △ Less

Submitted 8 March, 2020; originally announced March 2020.

Wireless communication between two magnetic tunnel junctions acting as oscillator and diode

Authors: Danijela Marković, Nathan Leroux, Alice Mizrahi, Juan Trastoy, Vincent Cros, Paolo Bortolotti, Leandro Martins, Alex Jenkins, Ricardo Ferreira, Julie Grollier

Abstract: Magnetic tunnel junctions are nanoscale spintronic devices with microwave generation and detection capabilities. Here we use the rectification effect called "spin-diode" in a magnetic tunnel junction to wirelessly detect the microwave emission of another junction in the auto-oscillatory regime. We show that the rectified spin-diode voltage measured at the receiving junction end can be reconstructe… ▽ More Magnetic tunnel junctions are nanoscale spintronic devices with microwave generation and detection capabilities. Here we use the rectification effect called "spin-diode" in a magnetic tunnel junction to wirelessly detect the microwave emission of another junction in the auto-oscillatory regime. We show that the rectified spin-diode voltage measured at the receiving junction end can be reconstructed from the independently measured auto-oscillation and spin diode spectra in each junction. Finally we adapt the auto-oscillator model to the case of spin-torque oscillator and spin-torque diode and we show that accurately reproduces the experimentally observed features. These results will be useful to design circuits and chips based on spintronic nanodevices communicating through microwaves. △ Less

Submitted 19 February, 2020; v1 submitted 2 January, 2020; originally announced January 2020.

Journal ref: Phys. Rev. Applied 13, 044050 (2020)

The Cosmological Analysis of the SDSS/BOSS data from the Effective Field Theory of Large-Scale Structure

Authors: Guido D'Amico, Jérôme Gleyzes, Nickolas Kokron, Dida Markovic, Leonardo Senatore, Pierre Zhang, Florian Beutler, Héctor Gil-Marín

Abstract: The Effective Field Theory of Large-Scale Structure (EFTofLSS) is a formalism that allows us to predict the clustering of Cosmological Large-Scale Structure in the mildly non-linear regime in an accurate and reliable way. After validating our technique against several sets of numerical simulations, we perform the analysis for the cosmological parameters of the DR12 BOSS data. We assume $Λ$CDM, a f… ▽ More The Effective Field Theory of Large-Scale Structure (EFTofLSS) is a formalism that allows us to predict the clustering of Cosmological Large-Scale Structure in the mildly non-linear regime in an accurate and reliable way. After validating our technique against several sets of numerical simulations, we perform the analysis for the cosmological parameters of the DR12 BOSS data. We assume $Λ$CDM, a fixed value of the baryon/dark-matter ratio, $Ω_b/Ω_c$, and of the tilt of the primordial power spectrum, $n_s$, and no significant input from numerical simulations. By using the one-loop power spectrum multipoles, we measure the primordial amplitude of the power spectrum, $A_s$, the abundance of matter, $Ω_m$, and the Hubble parameter, $H_0$, to about $13\%$, $3.2\%$ and $3.2\%$ respectively, obtaining $\ln(10^{10}As)=2.72\pm 0.13$, $Ω_m=0.309\pm 0.010$, $H_0=68.5\pm 2.2$ km/(s Mpc) at 68\% confidence level. If we then add a CMB prior on the sound horizon, the error bar on $H_0$ is reduced to $1.6\%$. These results are a substantial qualitative and quantitative improvement with respect to former analyses, and suggest that the EFTofLSS is a powerful instrument to extract cosmological information from Large-Scale Structure. △ Less

Submitted 11 September, 2019; originally announced September 2019.

Comments: 78 pages, 27 figures

Sequential dispersive measurement of a superconducting qubit

Authors: Théau Peronnin, Danijela Marković, Quentin Ficheux, Benjamin Huard

Abstract: We present a superconducting device that realizes the sequential measurement of a transmon qubit. The device disables common limitations of dispersive readout such as Purcell effect or transients in the cavity mode by turning on and off the coupling to the measurement channel on demand. The qubit measurement begins by loading a readout resonator that is coupled to the qubit. After an optimal inter… ▽ More We present a superconducting device that realizes the sequential measurement of a transmon qubit. The device disables common limitations of dispersive readout such as Purcell effect or transients in the cavity mode by turning on and off the coupling to the measurement channel on demand. The qubit measurement begins by loading a readout resonator that is coupled to the qubit. After an optimal interaction time with negligible loss, a microwave pump releases the content of the readout mode by upconversion into a measurement line in a characteristic time as low as 10~ns, which is 400 times shorter than the lifetime of the readout resonator. A direct measurement of the released field quadratures demonstrates a readout fidelity of $97.5~\%$ in a total measurement time of $220~\mathrm{ns}$. The Wigner tomography of the readout mode allows us to characterize the non-Gaussian nature of the readout mode and its dynamics. △ Less

Submitted 21 April, 2020; v1 submitted 9 April, 2019; originally announced April 2019.

Comments: The supplemental materials are included in the document

Journal ref: Phys. Rev. Lett. 124, 180502 (2020)

Injection locking and parametric locking in a superconducting circuit

Authors: Danijela Marković, Jean-Damien Pillet, Emmanuel Flurin, Nicolas Roch, Benjamin Huard

Abstract: When a signal is injected in a parametric oscillator close enough to its resonance, the oscillator frequency and phase get locked to those of the injected signal. Here, we demonstrate two frequency locking schemes using a Josephson mixer in the parametric down-conversion regime, pumped beyond the parametric oscillation threshold. The circuit then emits radiation out of two spectraly and spatially… ▽ More When a signal is injected in a parametric oscillator close enough to its resonance, the oscillator frequency and phase get locked to those of the injected signal. Here, we demonstrate two frequency locking schemes using a Josephson mixer in the parametric down-conversion regime, pumped beyond the parametric oscillation threshold. The circuit then emits radiation out of two spectraly and spatially separated resonators at frequencies determined by the locking schemes that we choose. When we inject the signal close to a resonance, it locks the oscillator emission to the signal frequency by injection locking. When we inject the signal close to the difference of resonances, it locks the oscillator emission by parametric locking. We compare both schemes and investigate the dependence of the parametric locking range on the pump and the injection signal power. Our results can be interpreted using Adler's theory for lasers, which makes a new link between laser physics and superconducting circuits that could enable better understanding of pumped circuits for quantum information applications such as error correction, circulators and photon number detectors. △ Less

Submitted 27 July, 2019; v1 submitted 2 April, 2019; originally announced April 2019.

Journal ref: Phys. Rev. Applied 12, 024034 (2019)

Reservoir computing with the frequency, phase and amplitude of spin-torque nano-oscillators

Authors: Danijela Marković, Nathan Leroux, Mathieu Riou, Flavio Abreu Araujo, Jacob Torrejon, Damien Querlioz, Akio Fukushima, Shinji Yuasa, Juan Trastoy, Paolo Bortolotti, Julie Grollier

Abstract: Spin-torque nano-oscillators can emulate neurons at the nanoscale. Recent works show that the non-linearity of their oscillation amplitude can be leveraged to achieve waveform classification for an input signal encoded in the amplitude of the input voltage. Here we show that the frequency and the phase of the oscillator can also be used to recognize waveforms. For this purpose, we phase-lock the o… ▽ More Spin-torque nano-oscillators can emulate neurons at the nanoscale. Recent works show that the non-linearity of their oscillation amplitude can be leveraged to achieve waveform classification for an input signal encoded in the amplitude of the input voltage. Here we show that the frequency and the phase of the oscillator can also be used to recognize waveforms. For this purpose, we phase-lock the oscillator to the input waveform, which carries information in its modulated frequency. In this way we considerably decrease amplitude, phase and frequency noise. We show that this method allows classifying sine and square waveforms with an accuracy above 99% when decoding the output from the oscillator amplitude, phase or frequency. We find that recognition rates are directly related to the noise and non-linearity of each variable. These results prove that spin-torque nano-oscillators offer an interesting platform to implement different computing schemes leveraging their rich dynamical features. △ Less

Submitted 1 November, 2018; originally announced November 2018.

Demonstration of an effective ultrastrong coupling between two oscillators

Authors: Danijela Marković, Sébastien Jezouin, Quentin Ficheux, Serguei Fedortchenko, Simone Felicetti, Thomas Coudreau, Perola Milman, Zaki Leghtas, Benjamin Huard

Abstract: When the coupling rate between two quantum systems becomes as large as their characteristic frequencies, it induces dramatic effects on their dynamics and even on the nature of their ground state. The case of a qubit coupled to a harmonic oscillator in this ultrastrong coupling regime has been investigated theoretically and experimentally. Here, we explore the case of two harmonic oscillators in t… ▽ More When the coupling rate between two quantum systems becomes as large as their characteristic frequencies, it induces dramatic effects on their dynamics and even on the nature of their ground state. The case of a qubit coupled to a harmonic oscillator in this ultrastrong coupling regime has been investigated theoretically and experimentally. Here, we explore the case of two harmonic oscillators in the ultrastrong coupling regime. Specifically, we realize an analog quantum simulation of this coupled system by dual frequency pum** a nonlinear superconducting circuit. The pump amplitudes directly tune the effective coupling rate. We observe spectroscopic signature of a mode hybridization that is characteristic of the ultrastrong coupling. Further we experimentally demon- strate a key property of the ground state of this simulated ultrastrong coupling between modes by observing simultaneous single-mode and two-mode squeezing of the radiated field below vacuum fluctuations. △ Less

Submitted 23 April, 2018; originally announced April 2018.

Journal ref: Phys. Rev. Lett. 121, 040505 (2018)

Perturbative Yang-Mills theory without Faddeev-Popov ghost fields

Authors: Helmuth Huffel, Danijel Markovic

Abstract: A modifed Faddeev-Popov path integral density for the quantization of Yang-Mills theory in the Feynman gauge is discussed, where contributions of the Faddeev-Popov ghost fields are replaced by multi-point gauge field interactions. An explicit calculation to $O(g^2)$ shows the equivalence of the usual Faddeev-Popov scheme and its modified version. A modifed Faddeev-Popov path integral density for the quantization of Yang-Mills theory in the Feynman gauge is discussed, where contributions of the Faddeev-Popov ghost fields are replaced by multi-point gauge field interactions. An explicit calculation to $O(g^2)$ shows the equivalence of the usual Faddeev-Popov scheme and its modified version. △ Less

Submitted 21 March, 2018; v1 submitted 29 December, 2017; originally announced December 2017.

Comments: 5 pages, 1 table. Extended version accepted for publication in Physics Letters B

Report number: UWThPh-2017-32

Journal ref: Physics Letters B 780, 418 (2018)

Quantum simulation of ultrastrongly coupled bosonic modes using superconducting circuits

Authors: S. Fedortchenko, S. Felicetti, D. Marković, S. Jezouin, A. Keller, T. Coudreau, B. Huard, P. Milman

Abstract: The ground state of a pair of ultrastrongly coupled bosonic modes is predicted to be a two-mode squeezed vacuum. However, the corresponding quantum correlations are currently unobservable in condensed matter where such a coupling can be reached, since it cannot be extracted from these systems. Here, we show that superconducting circuits can be used to perform an analog simulation of a system of tw… ▽ More The ground state of a pair of ultrastrongly coupled bosonic modes is predicted to be a two-mode squeezed vacuum. However, the corresponding quantum correlations are currently unobservable in condensed matter where such a coupling can be reached, since it cannot be extracted from these systems. Here, we show that superconducting circuits can be used to perform an analog simulation of a system of two bosonic modes in regimes ranging from strong to ultrastrong coupling. More importantly, our quantum simulation setup enables us to detect output excitations that are related to the ground-state properties of the bosonic modes. We compute the emission spectra of this physical system and show that the produced state presents single- and two-mode squeezing simultaneously. △ Less

Submitted 21 April, 2017; v1 submitted 16 December, 2016; originally announced December 2016.

Comments: 8 pages, 4 figures

Journal ref: Phys. Rev. A 95, 042313 (2017)

Body movement to sound interface with vector autoregressive hierarchical hidden Markov models

Authors: Dimitrije Marković, Borjana Valčić, Nebojša Malešević

Abstract: Interfacing a kinetic action of a person to an action of a machine system is an important research topic in many application areas. One of the key factors for intimate human-machine interaction is the ability of the control algorithm to detect and classify different user commands with shortest possible latency, thus making a highly correlated link between cause and effect. In our research, we focu… ▽ More Interfacing a kinetic action of a person to an action of a machine system is an important research topic in many application areas. One of the key factors for intimate human-machine interaction is the ability of the control algorithm to detect and classify different user commands with shortest possible latency, thus making a highly correlated link between cause and effect. In our research, we focused on the task of map** user kinematic actions into sound samples. The presented methodology relies on the wireless sensor nodes equipped with inertial measurement units and the real-time algorithm dedicated for early detection and classification of a variety of movements/gestures performed by a user. The core algorithm is based on the approximate Bayesian inference of Vector Autoregressive Hierarchical Hidden Markov Models (VAR-HHMM), where models database is derived from the set of motion gestures. The performance of the algorithm was compared with an online version of the K-nearest neighbours (KNN) algorithm, where we used offline expert based classification as the benchmark. In almost all of the evaluation metrics (e.g. confusion matrix, recall and precision scores) the VAR-HHMM algorithm outperformed KNN. Furthermore, the VAR-HHMM algorithm, in some cases, achieved faster movement onset detection compared with the offline standard. The proposed concept, although envisioned for movement-to-sound application, could be implemented in other human-machine interfaces. △ Less

Submitted 26 October, 2016; originally announced October 2016.

Comments: 12 pages, 7 figures, a pre-submission draft

ACM Class: F.1.2; G.3; H.1.2; H.5.1; H.5.2; I.1.4; I.2.9

Cosmology and Fundamental Physics with the Euclid Satellite

Authors: Luca Amendola, Stephen Appleby, Anastasios Avgoustidis, David Bacon, Tessa Baker, Marco Baldi, Nicola Bartolo, Alain Blanchard, Camille Bonvin, Stefano Borgani, Enzo Branchini, Clare Burrage, Stefano Camera, Carmelita Carbone, Luciano Casarini, Mark Cropper, Claudia de Rham, Joerg P. Dietrich, Cinzia Di Porto, Ruth Durrer, Anne Ealet, Pedro G. Ferreira, Fabio Finelli, Juan Garcia-Bellido, Tommaso Giannantonio , et al. (47 additional authors not shown)

Abstract: Euclid is a European Space Agency medium class mission selected for launch in 2020 within the Cosmic Vision 2015 2025 program. The main goal of Euclid is to understand the origin of the accelerated expansion of the universe. Euclid will explore the expansion history of the universe and the evolution of cosmic structures by measuring shapes and redshifts of galaxies as well as the distribution of c… ▽ More Euclid is a European Space Agency medium class mission selected for launch in 2020 within the Cosmic Vision 2015 2025 program. The main goal of Euclid is to understand the origin of the accelerated expansion of the universe. Euclid will explore the expansion history of the universe and the evolution of cosmic structures by measuring shapes and redshifts of galaxies as well as the distribution of clusters of galaxies over a large fraction of the sky. Although the main driver for Euclid is the nature of dark energy, Euclid science covers a vast range of topics, from cosmology to galaxy evolution to planetary research. In this review we focus on cosmology and fundamental physics, with a strong emphasis on science beyond the current standard models. We discuss five broad topics: dark energy and modified gravity, dark matter, initial conditions, basic assumptions and questions of methodology in the data analysis. This review has been planned and carried out within Euclid's Theory Working Group and is meant to provide a guide to the scientific themes that will underlie the activity of the group during the preparation of the Euclid mission. △ Less

Submitted 1 June, 2016; originally announced June 2016.

Comments: This article provides an update of arXiv:1206.1225, with different authors. Forecasts are not updated in this version

Journal ref: Living Reviews in Relativity 21 (2018)

Power laws and Self-Organized Criticality in Theory and Nature

Authors: Dimitrije Markovic, Claudius Gros

Abstract: Power laws and distributions with heavy tails are common features of many experimentally studied complex systems, like the distribution of the sizes of earthquakes and solar flares, or the duration of neuronal avalanches in the brain. Previously, researchers surmised that a single general concept may act as a unifying underlying generative mechanism, with the theory of self organized criticality b… ▽ More Power laws and distributions with heavy tails are common features of many experimentally studied complex systems, like the distribution of the sizes of earthquakes and solar flares, or the duration of neuronal avalanches in the brain. Previously, researchers surmised that a single general concept may act as a unifying underlying generative mechanism, with the theory of self organized criticality being a weighty contender. Consequently, a substantial amount of effort has gone into develo** new and extended models and, hitherto, three classes of models have emerged. The first line of models is based on a separation between the time scales of drive and dissipation, and includes the original sandpile model and its extensions, like the dissipative earthquake model. Within this approach the steady state is close to criticality in terms of an absorbing phase transition. The second line of models is based on external drives and internal dynamics competing on similar time scales and includes the coherent noise model, which has a non-critical steady state characterized by heavy-tailed distributions. The third line of models proposes a non-critical self-organizing state, being guided by an optimization principle, such as the concept of highly optimized tolerance. We present a comparative overview regarding distinct modeling approaches together with a discussion of their potential relevance as underlying generative models for real-world phenomena. The complexity of physical and biological scaling phenomena has been found to transcend the explanatory power of individual paradigmal concepts. The interaction between theoretical development and experimental observations has been very fruitful, leading to a series of novel concepts and insights. △ Less

Submitted 12 December, 2013; v1 submitted 21 October, 2013; originally announced October 2013.

Comments: Review article, Physics Reports, in press

Journal ref: Physics Reports 536, 41-74 (2014)

Observing scale-invariance in non-critical dynamical systems

Authors: Claudius Gros, Dimitrije Markovic

Abstract: Recent observation for scale invariant neural avalanches in the brain have been discussed in details in the scientific literature. We point out, that these results do not necessarily imply that the properties of the underlying neural dynamics are also scale invariant. The reason for this discrepancy lies in the fact that the sampling statistics of observations and experiments is generically biased… ▽ More Recent observation for scale invariant neural avalanches in the brain have been discussed in details in the scientific literature. We point out, that these results do not necessarily imply that the properties of the underlying neural dynamics are also scale invariant. The reason for this discrepancy lies in the fact that the sampling statistics of observations and experiments is generically biased by the size of the basins of attraction of the processes to be studied. One has hence to precisely define what one means with statements like `the brain is critical'. We recapitulate the notion of criticality, as originally introduced in statistical physics for second order phase transitions, turning then to the discussion of critical dynamical systems. We elucidate in detail the difference between a 'critical system', viz a system on the verge of a phase transition, and a 'critical state', viz state with scale-invariant correlations, stressing the fact that the notion of universality is linked to critical states. We then discuss rigorous results for two classes of critical dynamical systems, the Kauffman net and a vertex routing model, which both have non-critical states. However, an external observer that samples randomly the phase space of these two critical models, would find scale invariance. We denote this phenomenon as 'observational criticality' and discuss its relevance for the response properties of critical dynamical systems. △ Less

Submitted 12 October, 2012; originally announced October 2012.

Neuropsychological constraints to human data production on a global scale

Authors: Claudius Gros, Gregor Kaczor, Dimitrije Markovic

Abstract: Which are the factors underlying human information production on a global level? In order to gain an insight into this question we study a corpus of 252-633 Million publicly available data files on the Internet corresponding to an overall storage volume of 284-675 Terabytes. Analyzing the file size distribution for several distinct data types we find indications that the neuropsychological capacit… ▽ More Which are the factors underlying human information production on a global level? In order to gain an insight into this question we study a corpus of 252-633 Million publicly available data files on the Internet corresponding to an overall storage volume of 284-675 Terabytes. Analyzing the file size distribution for several distinct data types we find indications that the neuropsychological capacity of the human brain to process and record information may constitute the dominant limiting factor for the overall growth of globally stored information, with real-world economic constraints having only a negligible influence. This supposition draws support from the observation that the files size distributions follow a power law for data without a time component, like images, and a log-normal distribution for multimedia files, for which time is a defining qualia. △ Less

Submitted 27 November, 2011; originally announced November 2011.

Comments: to be published in: European Physical Journal B

Journal ref: European Physical Journal B, 85: 28 (2012)

Intrinsic adaptation in autonomous recurrent neural networks

Authors: Dimitrije Markovic, Claudius Gros

Abstract: A massively recurrent neural network responds on one side to input stimuli and is autonomously active, on the other side, in the absence of sensory inputs. Stimuli and information processing depends crucially on the qualia of the autonomous-state dynamics of the ongoing neural activity. This default neural activity may be dynamically structured in time and space, showing regular, synchronized, bur… ▽ More A massively recurrent neural network responds on one side to input stimuli and is autonomously active, on the other side, in the absence of sensory inputs. Stimuli and information processing depends crucially on the qualia of the autonomous-state dynamics of the ongoing neural activity. This default neural activity may be dynamically structured in time and space, showing regular, synchronized, bursting or chaotic activity patterns. We study the influence of non-synaptic plasticity on the default dynamical state of recurrent neural networks. The non-synaptic adaption considered acts on intrinsic neural parameters, such as the threshold and the gain, and is driven by the optimization of the information entropy. We observe, in the presence of the intrinsic adaptation processes, three distinct and globally attracting dynamical regimes, a regular synchronized, an overall chaotic and an intermittent bursting regime. The intermittent bursting regime is characterized by intervals of regular flows, which are quite insensitive to external stimuli, interseeded by chaotic bursts which respond sensitively to input signals. We discuss these finding in the context of self-organized information processing and critical brain dynamics. △ Less

Submitted 14 October, 2011; originally announced October 2011.

Comments: 24 pages, 8 figures

Journal ref: Neural Computation February 2012, Vol. 24, No. 2: 523-540

Criticality in conserved dynamical systems: Experimental observation vs. exact properties

Authors: Dimitrije Markovic, Andre Schuelein, Claudius Gros

Abstract: Conserved dynamical systems are generally considered to be critical. We study a class of critical routing models, equivalent to random maps, which can be solved rigorously in the thermodynamic limit. The information flow is conserved for these routing models and governed by cyclic attractors. We consider two classes of information flow, Markovian routing without memory and vertex routing involving… ▽ More Conserved dynamical systems are generally considered to be critical. We study a class of critical routing models, equivalent to random maps, which can be solved rigorously in the thermodynamic limit. The information flow is conserved for these routing models and governed by cyclic attractors. We consider two classes of information flow, Markovian routing without memory and vertex routing involving a one-step routing memory. Investigating the respective cycle length distributions for complete graphs we find log corrections to power-law scaling for the mean cycle length, as a function of the number of vertices, and a sub-polynomial growth for the overall number of cycles. When observing experimentally a real-world dynamical system one normally samples stochastically its phase space. The number and the length of the attractors are then weighted by the size of their respective basins of attraction. This situation is equivalent to `on the fly' generation of routing tables for which we find power law scaling for the weighted average length of attractors, for both conserved routing models. These results show that critical dynamical systems are generically not scale-invariant, but may show power-law scaling when sampled stochastically. It is hence important to distinguish between intrinsic properties of a critical dynamical system and its behavior that one would observe when randomly probing its phase space. △ Less

Submitted 12 October, 2012; v1 submitted 4 July, 2011; originally announced July 2011.

Journal ref: Chaos 23, 013106 (2013)

Self-organized chaos through polyhomeostatic optimization

Authors: Dimitrije Markovic, Claudius Gros

Abstract: The goal of polyhomeostatic control is to achieve a certain target distribution of behaviors, in contrast to polyhomeostatic regulation which aims at stabilizing a steady-state dynamical state. We consider polyhomeostasis for individual and networks of firing-rate neurons, adapting to achieve target distributions of firing rates maximizing information entropy. We show that any finite polyhomeostat… ▽ More The goal of polyhomeostatic control is to achieve a certain target distribution of behaviors, in contrast to polyhomeostatic regulation which aims at stabilizing a steady-state dynamical state. We consider polyhomeostasis for individual and networks of firing-rate neurons, adapting to achieve target distributions of firing rates maximizing information entropy. We show that any finite polyhomeostatic adaption rate destroys all attractors in Hopfield-like network setups, leading to intermittently bursting behavior and self-organized chaos. The importance of polyhomeostasis to adapting behavior in general is discussed. △ Less

Submitted 28 May, 2010; v1 submitted 5 January, 2010; originally announced January 2010.

Journal ref: Phys. Rev. Lett. 105, 068702 (2010)

Vertex routing models

Authors: Dimitrije Markovic, Claudius Gros

Abstract: A class of models describing the flow of information within networks via routing processes is proposed and investigated, concentrating on the effects of memory traces on the global properties. The long-term flow of information is governed by cyclic attractors, allowing to define a measure for the information centrality of a vertex given by the number of attractors passing through this vertex. We… ▽ More A class of models describing the flow of information within networks via routing processes is proposed and investigated, concentrating on the effects of memory traces on the global properties. The long-term flow of information is governed by cyclic attractors, allowing to define a measure for the information centrality of a vertex given by the number of attractors passing through this vertex. We find the number of vertices having a non-zero information centrality to be extensive/sub-extensive for models with/without a memory trace in the thermodynamic limit. We evaluate the distribution of the number of cycles, of the cycle length and of the maximal basins of attraction, finding a complete scaling collapse in the thermodynamic limit for the latter. Possible implications of our results on the information flow in social networks are discussed. △ Less

Submitted 26 June, 2009; originally announced June 2009.

Comments: 12 pages, 6 figures

Properties of r modes in rotating magnetic neutron stars. II. Evolution of the r modes and stellar magnetic field

Authors: Luciano Rezzolla, Frederick L. Lamb, Dragoljub Markovic, Stuart L. Shapiro

Abstract: The evolution of the r-mode instability is likely to be accompanied by secular kinematic effects which will produce differential rotation with large scale drifts of fluid elements, mostly in the azimuthal direction. As first discussed by Rezzolla, Lamb and Shapiro 2000, the interaction of these secular velocity fields with a pre-existing neutron star magnetic field could result in the generation… ▽ More The evolution of the r-mode instability is likely to be accompanied by secular kinematic effects which will produce differential rotation with large scale drifts of fluid elements, mostly in the azimuthal direction. As first discussed by Rezzolla, Lamb and Shapiro 2000, the interaction of these secular velocity fields with a pre-existing neutron star magnetic field could result in the generation of intense and large scale toroidal fields. Following their derivation in the companion paper, we here discuss the numerical solution of the evolution equations for the magnetic field. The values of the magnetic fields obtained in this way are used to estimate the conditions under which the r-mode instability might be prevented or suppressed. We also assess the impact of the generation of large magnetic fields on the gravitational wave detectability of r-mode unstable neutron stars. Our results indicate that the signal to noise ratio in the detection of gravitational waves from the r-mode instability might be considerably decreased if the latter develops in neutron stars with initial magnetic fields larger than 10^10 G. △ Less

Submitted 17 July, 2001; originally announced July 2001.

Comments: 16 pages, 12 figures. To appear in Phys. Rev. D

Journal ref: Phys. Rev. D, 64 104014 (2001)

Properties of r modes in rotating magnetic neutron stars. I. Kinematic Secular Effects and Magnetic Evolution Equations

Authors: Luciano Rezzolla, Frederick L. Lamb, Dragoljub Markovic, Stuart L. Shapiro

Abstract: The instability of r-mode oscillations in rapidly rotating neutron stars has attracted attention as a potential mechanism for producing high frequency, almost periodic gravitational waves. The analyses carried so far have shown the existence of these modes and have considered dam** by shear and bulk viscosity. However, the magnetohydrodynamic coupling of the modes with a stellar magnetic field… ▽ More The instability of r-mode oscillations in rapidly rotating neutron stars has attracted attention as a potential mechanism for producing high frequency, almost periodic gravitational waves. The analyses carried so far have shown the existence of these modes and have considered dam** by shear and bulk viscosity. However, the magnetohydrodynamic coupling of the modes with a stellar magnetic field and its role in the dam** of the instability has not been fully investigated yet. Following our introductory paper (Rezzolla, Lamb and Shapiro 2000), we here discuss in more detail the existence of secular higher-order kinematical effects which will produce toroidal fluid drifts. We also define the sets of equations that account for the time evolution of the magnetic fields produced by these secular velocity fields and show that the magnetic fields produced can reach equipartition in less than a year. The full numerical calculations as well as the evaluation of the impact of strong magnetic fields on the onset and evolution of the r-mode instability will be presented in a companion paper. △ Less

Submitted 17 July, 2001; originally announced July 2001.

Comments: 15 pages, 4 figures. To appear in Phys. Rev. D

Journal ref: Phys. Rev. D, 64 104013 (2001)

Bound near-equatorial orbits around neutron stars

Authors: Draza Markovic

Abstract: Recent discovery of kilohertz quasi-periodic brightness oscillations of low mass X-ray binaries (LMXBs) has attracted attention to highly relativistic periodic motion near accreting neutron stars. Most models proposed so far involve (almost) inertial motion in the vicinity of the stars' innermost stable circular orbits. In the present paper we study general-relativistic circular and eccentric or… ▽ More Recent discovery of kilohertz quasi-periodic brightness oscillations of low mass X-ray binaries (LMXBs) has attracted attention to highly relativistic periodic motion near accreting neutron stars. Most models proposed so far involve (almost) inertial motion in the vicinity of the stars' innermost stable circular orbits. In the present paper we study general-relativistic circular and eccentric orbits around spinning neutron stars assuming the orbits are slightly tilted with respect to the stars' equatorial planes. We develop analytical and numerical techniques for integrating bound timelike geodesics in fully relativistic neutron star spacetimes obtained by modern numerical codes. We use equations of state of neutron star matter that span a broad range of stiffness, while the explored range of masses M > 1.7 M(solar) and spin frequencies nu_s < 600 Hz is motivated by the observations of LMXBs. We investigate the general-relativistic effects of periastron advance and nodal precession in the strong gravitational fields of rotating neutron stars and compare quantitatively the associated orbital frequencies with the more readily obtainable frequencies of orbits around Kerr black holes on the one hand, and low-order post-Newtonian (PN) expansions, on the other. While Kerr results approximate the periastron advance frequency much better than the PN expressions, the retrograde torque caused by the high quadrupole moments of the rotating stars clearly favours the PN approximation in the case of nodal precession. The methods developed in the present paper are used in the companion paper to test recent hypotheses regarding the origin of quasi-periodic oscillations in accreting neutron star sources. △ Less

Submitted 27 September, 2000; originally announced September 2000.

Comments: 12 pages, 12 figures, uses mnusa.sty; submitted to MNRAS on March 20, 2000