Showing 1–26 of 26 results for author: Turitsyn, K

Multi-Task Learning to Enhance Generalizability of Neural Network Equalizers in Coherent Optical Systems

Authors: Sasipim Srivallapanondh, Pedro J. Freire, Ashraful Alam, Nelson Costa, Bernhard Spinnler, Antonio Napoli, Egor Sedov, Sergei K. Turitsyn, Jaroslaw E. Prilepsky

Abstract: For the first time, multi-task learning is proposed to improve the flexibility of NN-based equalizers in coherent systems. A "single" NN-based equalizer improves Q-factor by up to 4 dB compared to CDC, without re-training, even with variations in launch power, symbol rate, or transmission distance. For the first time, multi-task learning is proposed to improve the flexibility of NN-based equalizers in coherent systems. A "single" NN-based equalizer improves Q-factor by up to 4 dB compared to CDC, without re-training, even with variations in launch power, symbol rate, or transmission distance. △ Less

Submitted 3 November, 2023; v1 submitted 4 July, 2023; originally announced July 2023.

Comments: 4 pages, European Conference on Optical Communication (ECOC)

Hardware Realization of Nonlinear Activation Functions for NN-based Optical Equalizers

Authors: Sasipim Srivallapanondh, Pedro J. Freire, Antonio Napoli, Sergei K. Turitsyn, Jaroslaw E. Prilepsky

Abstract: To reduce the complexity of the hardware implementation of neural network-based optical channel equalizers, we demonstrate that the performance of the biLSTM equalizer with approximated activation functions is close to that of the original model. To reduce the complexity of the hardware implementation of neural network-based optical channel equalizers, we demonstrate that the performance of the biLSTM equalizer with approximated activation functions is close to that of the original model. △ Less

Submitted 16 May, 2023; originally announced May 2023.

Comments: 2 pages, 1 figure, 1 table, Conference on Lasers & Electro-Optics 2023

Implementing Neural Network-Based Equalizers in a Coherent Optical Transmission System Using Field-Programmable Gate Arrays

Authors: Pedro J. Freire, Sasipim Srivallapanondh, Michael Anderson, Bernhard Spinnler, Thomas Bex, Tobias A. Eriksson, Antonio Napoli, Wolfgang Schairer, Nelson Costa, Michaela Blott, Sergei K. Turitsyn, Jaroslaw E. Prilepsky

Abstract: In this work, we demonstrate the offline FPGA realization of both recurrent and feedforward neural network (NN)-based equalizers for nonlinearity compensation in coherent optical transmission systems. First, we present a realization pipeline showing the conversion of the models from Python libraries to the FPGA chip synthesis and implementation. Then, we review the main alternatives for the hardwa… ▽ More In this work, we demonstrate the offline FPGA realization of both recurrent and feedforward neural network (NN)-based equalizers for nonlinearity compensation in coherent optical transmission systems. First, we present a realization pipeline showing the conversion of the models from Python libraries to the FPGA chip synthesis and implementation. Then, we review the main alternatives for the hardware implementation of nonlinear activation functions. The main results are divided into three parts: a performance comparison, an analysis of how activation functions are implemented, and a report on the complexity of the hardware. The performance in Q-factor is presented for the cases of bidirectional long-short-term memory coupled with convolutional NN (biLSTM + CNN) equalizer, CNN equalizer, and standard 1-StpS digital back-propagation (DBP) for the simulation and experiment propagation of a single channel dual-polarization (SC-DP) 16QAM at 34 GBd along 17x70km of LEAF. The biLSTM+CNN equalizer provides a similar result to DBP and a 1.7 dB Q-factor gain compared with the chromatic dispersion compensation baseline in the experimental dataset. After that, we assess the Q-factor and the impact of hardware utilization when approximating the activation functions of NN using Taylor series, piecewise linear, and look-up table (LUT) approximations. We also show how to mitigate the approximation errors with extra training and provide some insights into possible gradient problems in the LUT approximation. Finally, to evaluate the complexity of hardware implementation to achieve 200G and 400G throughput, fixed-point NN-based equalizers with approximated activation functions are developed and implemented in an FPGA. △ Less

Submitted 19 February, 2023; v1 submitted 9 December, 2022; originally announced December 2022.

Comments: Invited paper at Journal of Lightwave Technology - IEEE

Knowledge Distillation Applied to Optical Channel Equalization: Solving the Parallelization Problem of Recurrent Connection

Authors: Sasipim Srivallapanondh, Pedro J. Freire, Bernhard Spinnler, Nelson Costa, Antonio Napoli, Sergei K. Turitsyn, Jaroslaw E. Prilepsky

Abstract: To circumvent the non-parallelizability of recurrent neural network-based equalizers, we propose knowledge distillation to recast the RNN into a parallelizable feedforward structure. The latter shows 38\% latency decrease, while impacting the Q-factor by only 0.5dB. To circumvent the non-parallelizability of recurrent neural network-based equalizers, we propose knowledge distillation to recast the RNN into a parallelizable feedforward structure. The latter shows 38\% latency decrease, while impacting the Q-factor by only 0.5dB. △ Less

Submitted 8 December, 2022; originally announced December 2022.

Comments: Paper Accepted for Oral presentation - OFC 2023 (Optical Fiber Communication Conference)

Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation

Authors: Pedro J. Freire, Antonio Napoli, Diego Arguello Ron, Bernhard Spinnler, Michael Anderson, Wolfgang Schairer, Thomas Bex, Nelson Costa, Sergei K. Turitsyn, Jaroslaw E. Prilepsky

Abstract: In this paper, a new methodology is proposed that allows for the low-complexity development of neural network (NN) based equalizers for the mitigation of impairments in high-speed coherent optical transmission systems. In this work, we provide a comprehensive description and comparison of various deep model compression approaches that have been applied to feed-forward and recurrent NN designs. Add… ▽ More In this paper, a new methodology is proposed that allows for the low-complexity development of neural network (NN) based equalizers for the mitigation of impairments in high-speed coherent optical transmission systems. In this work, we provide a comprehensive description and comparison of various deep model compression approaches that have been applied to feed-forward and recurrent NN designs. Additionally, we evaluate the influence these strategies have on the performance of each NN equalizer. Quantization, weight clustering, pruning, and other cutting-edge strategies for model compression are taken into consideration. In this work, we propose and evaluate a Bayesian optimization-assisted compression, in which the hyperparameters of the compression are chosen to simultaneously reduce complexity and improve performance. In conclusion, the trade-off between the complexity of each compression approach and its performance is evaluated by utilizing both simulated and experimental data in order to complete the analysis. By utilizing optimal compression approaches, we show that it is possible to design an NN-based equalizer that is simpler to implement and has better performance than the conventional digital back-propagation (DBP) equalizer with only one step per span. This is accomplished by reducing the number of multipliers used in the NN equalizer after applying the weighted clustering and pruning algorithms. Furthermore, we demonstrate that an equalizer based on NN can also achieve superior performance while still maintaining the same degree of complexity as the full electronic chromatic dispersion compensation block. We conclude our analysis by highlighting open questions and existing challenges, as well as possible future research directions. △ Less

Submitted 26 November, 2022; v1 submitted 26 August, 2022; originally announced August 2022.

Computational Complexity Evaluation of Neural Network Applications in Signal Processing

Authors: Pedro Freire, Sasipim Srivallapanondh, Antonio Napoli, Jaroslaw E. Prilepsky, Sergei K. Turitsyn

Abstract: In this paper, we provide a systematic approach for assessing and comparing the computational complexity of neural network layers in digital signal processing. We provide and link four software-to-hardware complexity measures, defining how the different complexity metrics relate to the layers' hyper-parameters. This paper explains how to compute these four metrics for feed-forward and recurrent la… ▽ More In this paper, we provide a systematic approach for assessing and comparing the computational complexity of neural network layers in digital signal processing. We provide and link four software-to-hardware complexity measures, defining how the different complexity metrics relate to the layers' hyper-parameters. This paper explains how to compute these four metrics for feed-forward and recurrent layers, and defines in which case we ought to use a particular metric depending on whether we characterize a more soft- or hardware-oriented application. One of the four metrics, called `the number of additions and bit shifts (NABS)', is newly introduced for heterogeneous quantization. NABS characterizes the impact of not only the bitwidth used in the operation but also the type of quantization used in the arithmetical operations. We intend this work to serve as a baseline for the different levels (purposes) of complexity estimation related to the neural networks' application in real-time digital signal processing, aiming at unifying the computational complexity estimation. △ Less

Submitted 10 March, 2024; v1 submitted 24 June, 2022; originally announced June 2022.

Towards FPGA Implementation of Neural Network-Based Nonlinearity Mitigation Equalizers in Coherent Optical Transmission Systems

Authors: Pedro J. Freire, Michael Anderson, Bernhard Spinnler, Thomas Bex, Jaroslaw E. Prilepsky, Tobias A. Eriksson, Nelson Costa, Wolfgang Schairer, Michaela Blott, Antonio Napoli, Sergei K. Turitsyn

Abstract: For the first time, recurrent and feedforward neural network-based equalizers for nonlinearity compensation are implemented in an FPGA, with a level of complexity comparable to that of a dispersion equalizer. We demonstrate that the NN-based equalizers can outperform a 1 step-per-span DBP. For the first time, recurrent and feedforward neural network-based equalizers for nonlinearity compensation are implemented in an FPGA, with a level of complexity comparable to that of a dispersion equalizer. We demonstrate that the NN-based equalizers can outperform a 1 step-per-span DBP. △ Less

Submitted 24 June, 2022; originally announced June 2022.

Comments: Accepted Oral in the European Conference on Optical Communication (ECOC) 2022

Model-Based Deep Learning of Joint Probabilistic and Geometric Sha** for Optical Communication

Authors: Vladislav Neskorniuk, Andrea Carnio, Domenico Marsella, Sergei K. Turitsyn, Jaroslaw E. Prilepsky, Vahid Aref

Abstract: Autoencoder-based deep learning is applied to jointly optimize geometric and probabilistic constellation sha** for optical coherent communication. The optimized constellation sha** outperforms the 256 QAM Maxwell-Boltzmann probabilistic distribution with extra 0.05 bits/4D-symbol mutual information for 64 GBd transmission over 170 km SMF link. Autoencoder-based deep learning is applied to jointly optimize geometric and probabilistic constellation sha** for optical coherent communication. The optimized constellation sha** outperforms the 256 QAM Maxwell-Boltzmann probabilistic distribution with extra 0.05 bits/4D-symbol mutual information for 64 GBd transmission over 170 km SMF link. △ Less

Submitted 5 April, 2022; originally announced April 2022.

Comments: 2 pages; accepted for oral presentation at CLEO 2022 in May 2022

Domain Adaptation: the Key Enabler of Neural Network Equalizers in Coherent Optical Systems

Authors: Pedro J. Freire, Bernhard Spinnler, Daniel Abode, Jaroslaw E. Prilepsky, Abdallah A. I. Ali, Nelson Costa, Wolfgang Schairer, Antonio Napoli, Andrew D. Ellis, Sergei K. Turitsyn

Abstract: We introduce the domain adaptation and randomization approach for calibrating neural network-based equalizers for real transmissions, using synthetic data. The approach renders up to 99\% training process reduction, which we demonstrate in three experimental setups. We introduce the domain adaptation and randomization approach for calibrating neural network-based equalizers for real transmissions, using synthetic data. The approach renders up to 99\% training process reduction, which we demonstrate in three experimental setups. △ Less

Submitted 25 February, 2022; originally announced February 2022.

Comments: Paper Accepted at OFC 2022

Experimental Evaluation of Computational Complexity for Different Neural Network Equalizers in Optical Communications

Authors: Pedro J. Freire, Yevhenii Osadchuk, Antonio Napoli, Bernhard Spinnler, Wolfgang Schairer, Nelson Costa, Jaroslaw E. Prilepsky, Sergei K. Turitsyn

Abstract: Addressing the neural network-based optical channel equalizers, we quantify the trade-off between their performance and complexity by carrying out the comparative analysis of several neural network architectures, presenting the results for TWC and SSMF set-ups. Addressing the neural network-based optical channel equalizers, we quantify the trade-off between their performance and complexity by carrying out the comparative analysis of several neural network architectures, presenting the results for TWC and SSMF set-ups. △ Less

Submitted 17 September, 2021; originally announced September 2021.

Comments: ORAL presentation at the Asia Communications and Photonics Conference (ACP 2021)

End-to-End Deep Learning of Long-Haul Coherent Optical Fiber Communications via Regular Perturbation Model

Authors: Vladislav Neskorniuk, Andrea Carnio, Vinod Bajaj, Domenico Marsella, Sergei K. Turitsyn, Jaroslaw E. Prilepsky, Vahid Aref

Abstract: We present a novel end-to-end autoencoder-based learning for coherent optical communications using a "parallelizable" perturbative channel model. We jointly optimized constellation sha** and nonlinear pre-emphasis achieving mutual information gain of 0.18 bits/sym./pol. simulating 64 GBd dual-polarization single-channel transmission over 30x80 km G.652 SMF link with EDFAs. We present a novel end-to-end autoencoder-based learning for coherent optical communications using a "parallelizable" perturbative channel model. We jointly optimized constellation sha** and nonlinear pre-emphasis achieving mutual information gain of 0.18 bits/sym./pol. simulating 64 GBd dual-polarization single-channel transmission over 30x80 km G.652 SMF link with EDFAs. △ Less

Submitted 26 July, 2021; originally announced July 2021.

Comments: 4 pages; accepted for presentation at ECOC 2021 in September 2021

Data-driven control of micro-climate in buildings: an event-triggered reinforcement learning approach

Authors: Ashkan Haji Hosseinloo, Alexander Ryzhov, Aldo Bischi, Henni Ouerdane, Konstantin Turitsyn, Munther A. Dahleh

Abstract: Smart buildings have great potential for sha** an energy-efficient, sustainable, and more economic future for our planet as buildings account for approximately 40% of the global energy consumption. Future of the smart buildings lies in using sensory data for adaptive decision making and control that is currently gloomed by the key challenge of learning a good control policy in a short period of… ▽ More Smart buildings have great potential for sha** an energy-efficient, sustainable, and more economic future for our planet as buildings account for approximately 40% of the global energy consumption. Future of the smart buildings lies in using sensory data for adaptive decision making and control that is currently gloomed by the key challenge of learning a good control policy in a short period of time in an online and continuing fashion. To tackle this challenge, an event-triggered -- as opposed to classic time-triggered -- paradigm, is proposed in which learning and control decisions are made when events occur and enough information is collected. Events are characterized by certain design conditions and they occur when the conditions are met, for instance, when a certain state threshold is reached. By systematically adjusting the time of learning and control decisions, the proposed framework can potentially reduce the variance in learning, and consequently, improve the control process. We formulate the micro-climate control problem based on semi-Markov decision processes that allow for variable-time state transitions and decision making. Using extended policy gradient theorems and temporal difference methods in a reinforcement learning set-up, we propose two learning algorithms for event-triggered control of micro-climate in buildings. We show the efficacy of our proposed approach via designing a smart learning thermostat that simultaneously optimizes energy consumption and occupants' comfort in a test building. △ Less

Submitted 2 July, 2020; v1 submitted 28 January, 2020; originally announced January 2020.

Journal ref: Applied Energy vol. 277, 115451 (2020)

New approaches to coding information using inverse scattering transform

Authors: L. L. Frumin, A. A. Gelash, S. K. Turitsyn

Abstract: Remarkable mathematical properties of the integrable nonlinear Schrödinger equation (NLSE) can offer advanced solutions for the mitigation of nonlinear signal distortions in optical fibre links. Fundamental optical soliton, continuous and discrete eigenvalues of the nonlinear spectrum have already been considered for transmission of information in fibre-optic channels. Here we propose to apply sig… ▽ More Remarkable mathematical properties of the integrable nonlinear Schrödinger equation (NLSE) can offer advanced solutions for the mitigation of nonlinear signal distortions in optical fibre links. Fundamental optical soliton, continuous and discrete eigenvalues of the nonlinear spectrum have already been considered for transmission of information in fibre-optic channels. Here we propose to apply signal modulation to the kernel of the Gelfand-Levitan-Marchenko equations (GLME) that offers the advantage of a relatively simple decoder design. First, we describe an approach based on exploiting the general N-soliton solution of the NLSE for simultaneous coding of $N$ symbols involving $4\times N$ coding parameters. As a specific elegant sub-class of the general schemes we introduce a soliton orthogonal frequency division multiplexing (SOFDM) method. This method is based on the choice of identical imaginary parts of the N-soliton solution eigenvalues, corresponding to equidistant soliton frequencies making it similar to the conventional OFDM scheme, thus, allowing use of the efficient fast Fourier transform algorithm to recover the data. Then, we demonstrate how to use this new approach to control signal parameters in the case of the continuous spectrum. △ Less

Submitted 9 March, 2017; originally announced March 2017.

Comments: 6 pages plus supplementary materials, 4 figures

Journal ref: Phys. Rev. Lett. 118, 223901 (2017)

Capacity Lower Bounds of the Noncentral Chi-Channel with Applications to Soliton Amplitude Modulation

Authors: Nikita A. Shevchenko, Stanislav A. Derevyanko, Jaroslaw E. Prilepsky, Alex Alvarado, Polina Bayvel, Sergei K. Turitsyn

Abstract: The channel law for amplitude-modulated solitons transmitted through a nonlinear optical fibre with ideal distributed amplification and a receiver based on the nonlinear Fourier transform is a noncentral chi-distribution with $2n$ degrees of freedom, where $n=2$ and $n=3$ correspond to the single- and dual-polarisation cases, respectively. In this paper, we study capacity lower bounds of this chan… ▽ More The channel law for amplitude-modulated solitons transmitted through a nonlinear optical fibre with ideal distributed amplification and a receiver based on the nonlinear Fourier transform is a noncentral chi-distribution with $2n$ degrees of freedom, where $n=2$ and $n=3$ correspond to the single- and dual-polarisation cases, respectively. In this paper, we study capacity lower bounds of this channel under an average power constraint in bits per channel use. We develop an asymptotic semi-analytic approximation for a capacity lower bound for arbitrary $n$ and a Rayleigh input distribution. It is shown that this lower bound grows logarithmically with signal-to-noise ratio (SNR), independently of the value of $n$. Numerical results for other continuous input distributions are also provided. A half-Gaussian input distribution is shown to give larger rates than a Rayleigh input distribution for $n=1,2,3$. At an SNR of $25$ dB, the best lower bounds we developed are approximately $3.68$ bit per channel use. The practically relevant case of amplitude shift-keying (ASK) constellations is also numerically analysed. For the same SNR of $25$ dB, a $16$-ASK constellation yields a rate of approximately $3.45$ bit per channel use. △ Less

Submitted 16 February, 2018; v1 submitted 8 September, 2016; originally announced September 2016.

Calculation of mutual information for nonlinear communication channel at large SNR

Authors: I. S. Terekhov, A. V. Reznichenko, S. K. Turitsyn

Abstract: Using the path-integral technique we examine the mutual information for the communication channel modelled by the nonlinear Schrödinger equation with additive Gaussian noise. The nonlinear Schrödinger equation is one of the fundamental models in nonlinear physics, and it has a broad range of applications, including fiber optical communications --- the backbone of the Internet. At large signal-to-n… ▽ More Using the path-integral technique we examine the mutual information for the communication channel modelled by the nonlinear Schrödinger equation with additive Gaussian noise. The nonlinear Schrödinger equation is one of the fundamental models in nonlinear physics, and it has a broad range of applications, including fiber optical communications --- the backbone of the Internet. At large signal-to-noise ratio ($\mathrm{SNR}$) we present the mutual information through the path-integral which is convenient for the perturbative expansion in nonlinearity. In the limit of small noise and small nonlinearity we derive analytically the first nonzero nonlinear correction to the mutual information for the channel. △ Less

Submitted 5 July, 2016; originally announced July 2016.

Comments: 8 pages, 3 figures

Journal ref: Phys. Rev. E 94, 042203 (2016)

Recent Advances in Computational Methods for the Power Flow Equations

Authors: Dhagash Mehta, Daniel K Molzahn, Konstantin Turitsyn

Abstract: The power flow equations are at the core of most of the computations for designing and operating electric power systems. The power flow equations are a system of multivariate nonlinear equations which relate the power injections and voltages in a power system. A plethora of methods have been devised to solve these equations, starting from Newton-based methods to homotopy continuation and other opt… ▽ More The power flow equations are at the core of most of the computations for designing and operating electric power systems. The power flow equations are a system of multivariate nonlinear equations which relate the power injections and voltages in a power system. A plethora of methods have been devised to solve these equations, starting from Newton-based methods to homotopy continuation and other optimization-based methods. While many of these methods often efficiently find a high-voltage, stable solution due to its large basin of attraction, most of the methods struggle to find low-voltage solutions which play significant role in certain stability-related computations. While we do not claim to have exhausted the existing literature on all related methods, this tutorial paper introduces some of the recent advances in methods for solving power flow equations to the wider power systems community as well as bringing attention from the computational mathematics and optimization communities to the power systems problems. After briefly reviewing some of the traditional computational methods used to solve the power flow equations, we focus on three emerging methods: the numerical polynomial homotopy continuation method, Groebner basis techniques, and moment/sum-of-squares relaxations using semidefinite programming. In passing, we also emphasize the importance of an upper bound on the number of solutions of the power flow equations and review the current status of research in this direction. △ Less

Submitted 30 September, 2015; originally announced October 2015.

Comments: 13 pages, 2 figures. Submitted to the Tutorial Session at IEEE 2016 American Control Conference

Report number: ADP-15-35/T937

Optimal input signal distribution and per-sample mutual information for nondispersive nonlinear optical fiber channel at large SNR

Authors: I. S. Terekhov, A. V. Reznichenko, Ya. A. Kharkov, S. K. Turitsyn

Abstract: We consider a model nondispersive nonlinear optical fiber channel with additive white Gaussian noise at large $\mathrm{SNR}$ (signal-to-noise ratio) in the intermediate power region. Using Feynman path-integral technique we for the first time find the optimal input signal distribution maximizing the channel's per-sample mutual information. The finding of the optimal input signal distribution allow… ▽ More We consider a model nondispersive nonlinear optical fiber channel with additive white Gaussian noise at large $\mathrm{SNR}$ (signal-to-noise ratio) in the intermediate power region. Using Feynman path-integral technique we for the first time find the optimal input signal distribution maximizing the channel's per-sample mutual information. The finding of the optimal input signal distribution allows us to improve previously known estimates for the channel capacity. The output signal entropy, conditional entropy, and per-sample mutual information are calculated for Gaussian, half-Gaussian and modified Gaussian input signal distributions. We explicitly show that in the intermediate power regime the per-sample mutual information for the optimal input signal distribution is greater than the per-sample mutual information for the Gaussian and half-Gaussian input signal distributions. △ Less

Submitted 5 May, 2016; v1 submitted 24 August, 2015; originally announced August 2015.

Comments: 18 pages, 3 figures

A Lower Bound on the per Soliton Capacity of the Nonlinear Optical Fibre Channel

Authors: Nikita A. Shevchenko, Jaroslaw E. Prilepsky, Stanislav A. Derevyanko, Alex Alvarado, Polina Bayvel, Sergei K. Turitsyn

Abstract: A closed-form expression for a lower bound on the per soliton capacity of the nonlinear optical fibre channel in the presence of (optical) amplifier spontaneous emission (ASE) noise is derived. This bound is based on a non-Gaussian conditional probability density function for the soliton amplitude jitter induced by the ASE noise and is proven to grow logarithmically as the signal-to-noise ratio in… ▽ More A closed-form expression for a lower bound on the per soliton capacity of the nonlinear optical fibre channel in the presence of (optical) amplifier spontaneous emission (ASE) noise is derived. This bound is based on a non-Gaussian conditional probability density function for the soliton amplitude jitter induced by the ASE noise and is proven to grow logarithmically as the signal-to-noise ratio increases. △ Less

Submitted 21 August, 2015; v1 submitted 19 August, 2015; originally announced August 2015.

Comments: To be presented at the 2015 IEEE Information Theory Workshop, Jeju Island, Korea, October 11-15, 2015

Probabilistic Power Flow Computation via Low-Rank and Sparse Tensor Recovery

Authors: Zheng Zhang, Hung Dinh Nguyen, Konstantin Turitsyn, Luca Daniel

Abstract: This paper presents a tensor-recovery method to solve probabilistic power flow problems. Our approach generates a high-dimensional and sparse generalized polynomial-chaos expansion that provides useful statistical information. The result can also speed up other essential routines in power systems (e.g., stochastic planning, operations and controls). Instead of simulating a power flow equation at… ▽ More This paper presents a tensor-recovery method to solve probabilistic power flow problems. Our approach generates a high-dimensional and sparse generalized polynomial-chaos expansion that provides useful statistical information. The result can also speed up other essential routines in power systems (e.g., stochastic planning, operations and controls). Instead of simulating a power flow equation at all quadrature points, our approach only simulates an extremely small subset of samples. We suggest a model to exploit the underlying low-rank and sparse structure of high-dimensional simulation data arrays, making our technique applicable to power systems with many random parameters. We also present a numerical method to solve the resulting nonlinear optimization problem. Our algorithm is implemented in MATLAB and is verified by several benchmarks in MATPOWER $5.1$. Accurate results are obtained for power systems with up to $50$ independent random parameters, with a speedup factor up to $9\times 10^{20}$. △ Less

Submitted 11 August, 2015; originally announced August 2015.

Comments: 8 pages, 10 figures, submitted to IEEE Trans. Power Systems

Digital Backpropagation in the Nonlinear Fourier Domain

Authors: Sander Wahls, Son T. Le, Jaroslaw E. Prilepsky, H. Vincent Poor, Sergei K. Turitsyn

Abstract: Nonlinear and dispersive transmission impairments in coherent fiber-optic communication systems are often compensated by reverting the nonlinear Schrödinger equation, which describes the evolution of the signal in the link, numerically. This technique is known as digital backpropagation. Typical digital backpropagation algorithms are based on split-step Fourier methods in which the signal has to b… ▽ More Nonlinear and dispersive transmission impairments in coherent fiber-optic communication systems are often compensated by reverting the nonlinear Schrödinger equation, which describes the evolution of the signal in the link, numerically. This technique is known as digital backpropagation. Typical digital backpropagation algorithms are based on split-step Fourier methods in which the signal has to be discretized in time and space. The need to discretize in both time and space however makes the real-time implementation of digital backpropagation a challenging problem. In this paper, a new fast algorithm for digital backpropagation based on nonlinear Fourier transforms is presented. Aiming at a proof of concept, the main emphasis will be put on fibers with normal dispersion in order to avoid the issue of solitonic components in the signal. However, it is demonstrated that the algorithm also works for anomalous dispersion if the signal power is low enough. Since the spatial evolution of a signal governed by the nonlinear Schrödinger equation can be reverted analytically in the nonlinear Fourier domain through simple phase-shifts, there is no need to discretize the spatial domain. The proposed algorithm requires only $\mathcal{O}(D\log^{2}D)$ floating point operations to backpropagate a signal given by $D$ samples, independently of the fiber's length, and is therefore highly promising for real-time implementations. The merits of this new approach are illustrated through numerical simulations. △ Less

Submitted 29 September, 2015; v1 submitted 24 April, 2015; originally announced April 2015.

Comments: Invited paper presented in the special session on "Signal Processing, Coding, and Information Theory for Optical Communications" at IEEE SPAWC 2015. Minor changes

Journal ref: Proceedings of the 2015 IEEE 16th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), Stockholm, Sweden, Jun. 2015, pp.445-449

Mutual information in nonlinear communication channel. Preliminary analytical results in large SNR and small nonlinearity limit

Authors: I. S. Terekhov, A. V. Reznichenko, S. K. Turitsyn

Abstract: Applying perturbation theory to the path-integral representation for the mutual information of the nonlinear communication channel described by the nonlinear Shrödinger equation (NLSE) with the additive Gaussian noise we analyze the analytical expression for the mutual information at large signal-to-noise ratio ($\mathrm{SNR}$) and small nonlinearity. We classify all possible corrections to the mu… ▽ More Applying perturbation theory to the path-integral representation for the mutual information of the nonlinear communication channel described by the nonlinear Shrödinger equation (NLSE) with the additive Gaussian noise we analyze the analytical expression for the mutual information at large signal-to-noise ratio ($\mathrm{SNR}$) and small nonlinearity. We classify all possible corrections to the mutual information in nonlinearity parameter and demonstrate that all singular in $\mathrm{SNR}$ terms vanish in the final result. Furthermore our analytical result demonstrates that the corrections to Shannon's contribution to the mutual information in the leading order in $\mathrm{SNR}$ are of order of squared nonlinearity parameter. We outline the way for the calculation of these corrections in the further investigations. △ Less

Submitted 18 August, 2016; v1 submitted 27 November, 2014; originally announced November 2014.

Comments: 12 pages

Conditional probability calculations for the nonlinear Schrödinger equation with additive noise

Authors: I. S. Terekhov, S. S. Vergeles, S. K. Turitsyn

Abstract: The method for computation of conditional probability density function for the nonlinear Schrödinger equation with additive noise is developed. We present in a constructive form the conditional probability density function in the limit of a small noise and analytically derive it in a weakly nonlinear case. The general theory results are illustrated using fibre-optic communications as a particular,… ▽ More The method for computation of conditional probability density function for the nonlinear Schrödinger equation with additive noise is developed. We present in a constructive form the conditional probability density function in the limit of a small noise and analytically derive it in a weakly nonlinear case. The general theory results are illustrated using fibre-optic communications as a particular, albeit practically very important, example. △ Less

Submitted 25 November, 2014; originally announced November 2014.

Shannon capacity of nonlinear regenerative channels

Authors: M. A. Sorokina, S. K. Turitsyn

Abstract: We compute Shannon capacity of nonlinear channels with regenerative elements. Conditions are found under which capacity of such nonlinear channels is higher than the Shannon capacity of the classical linear additive white Gaussian noise channel. We develop a general scheme for designing the proposed channels and apply it to the particular nonlinear sine-map**. The upper bound for regeneration ef… ▽ More We compute Shannon capacity of nonlinear channels with regenerative elements. Conditions are found under which capacity of such nonlinear channels is higher than the Shannon capacity of the classical linear additive white Gaussian noise channel. We develop a general scheme for designing the proposed channels and apply it to the particular nonlinear sine-map**. The upper bound for regeneration efficiency is found and the asymptotic behavior of the capacity in the saturation regime is derived. △ Less

Submitted 7 May, 2013; originally announced May 2013.

Comments: 5 pages, 4 figures

Fast Algorithm for N-2 Contingency Problem

Authors: K. S. Turitsyn, P. A. Kaplunovich

Abstract: We present a novel selection algorithm for N-2 contingency analysis problem. The algorithm is based on the iterative bounding of line outage distribution factors and successive pruning of the set of contingency pair candidates. The selection procedure is non-heuristic, and is certified to identify all events that lead to thermal constraints violations in DC approximation. The complexity of the alg… ▽ More We present a novel selection algorithm for N-2 contingency analysis problem. The algorithm is based on the iterative bounding of line outage distribution factors and successive pruning of the set of contingency pair candidates. The selection procedure is non-heuristic, and is certified to identify all events that lead to thermal constraints violations in DC approximation. The complexity of the algorithm is O(N^2) comparable to the complexity of N-1 contingency problem. We validate and test the algorithm on the Polish grid network with around 3000 lines. For this test case two iterations of the pruning procedure reduce the total number of candidate pairs by a factor of almost 1000 from 5 millions line pairs to only 6128. △ Less

Submitted 4 November, 2012; originally announced November 2012.

Comments: HICCS

Non-Equilibrium Statistical Physics of Currents in Queuing Networks

Authors: Vladimir Y. Chernyak, Michael Chertkov, David A. Goldberg, Konstantin Turitsyn

Abstract: We consider a stable open queuing network as a steady non-equilibrium system of interacting particles. The network is completely specified by its underlying graphical structure, type of interaction at each node, and the Markovian transition rates between nodes. For such systems, we ask the question ``What is the most likely way for large currents to accumulate over time in a network ?'', where tim… ▽ More We consider a stable open queuing network as a steady non-equilibrium system of interacting particles. The network is completely specified by its underlying graphical structure, type of interaction at each node, and the Markovian transition rates between nodes. For such systems, we ask the question ``What is the most likely way for large currents to accumulate over time in a network ?'', where time is large compared to the system correlation time scale. We identify two interesting regimes. In the first regime, in which the accumulation of currents over time exceeds the expected value by a small to moderate amount (moderate large deviation), we find that the large-deviation distribution of currents is universal (independent of the interaction details), and there is no long-time and averaged over time accumulation of particles (condensation) at any nodes. In the second regime, in which the accumulation of currents over time exceeds the expected value by a large amount (severe large deviation), we find that the large-deviation current distribution is sensitive to interaction details, and there is a long-time accumulation of particles (condensation) at some nodes. The transition between the two regimes can be described as a dynamical second order phase transition. We illustrate these ideas using the simple, yet non-trivial, example of a single node with feedback. △ Less

Submitted 19 June, 2010; v1 submitted 29 January, 2010; originally announced January 2010.

Comments: 26 pages, 5 figures

Report number: LA-UR 10-00419

Irreversible Monte Carlo Algorithms for Efficient Sampling

Authors: Konstantin S. Turitsyn, Michael Chertkov, Marija Vucelja

Abstract: Equilibrium systems evolve according to Detailed Balance (DB). This principe guided development of the Monte-Carlo sampling techniques, of which Metropolis-Hastings (MH) algorithm is the famous representative. It is also known that DB is sufficient but not necessary. We construct irreversible deformation of a given reversible algorithm capable of dramatic improvement of sampling from known distr… ▽ More Equilibrium systems evolve according to Detailed Balance (DB). This principe guided development of the Monte-Carlo sampling techniques, of which Metropolis-Hastings (MH) algorithm is the famous representative. It is also known that DB is sufficient but not necessary. We construct irreversible deformation of a given reversible algorithm capable of dramatic improvement of sampling from known distribution. Our transformation modifies transition rates kee** the structure of transitions intact. To illustrate the general scheme we design an Irreversible version of Metropolis-Hastings (IMH) and test it on example of a spin cluster. Standard MH for the model suffers from the critical slowdown, while IMH is free from critical slowdown. △ Less

Submitted 23 September, 2008; v1 submitted 4 September, 2008; originally announced September 2008.

Comments: 4 pages, 2 figures