-
Multi-Task Learning to Enhance Generalizability of Neural Network Equalizers in Coherent Optical Systems
Authors:
Sasipim Srivallapanondh,
Pedro J. Freire,
Ashraful Alam,
Nelson Costa,
Bernhard Spinnler,
Antonio Napoli,
Egor Sedov,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky
Abstract:
For the first time, multi-task learning is proposed to improve the flexibility of NN-based equalizers in coherent systems. A "single" NN-based equalizer improves Q-factor by up to 4 dB compared to CDC, without re-training, even with variations in launch power, symbol rate, or transmission distance.
For the first time, multi-task learning is proposed to improve the flexibility of NN-based equalizers in coherent systems. A "single" NN-based equalizer improves Q-factor by up to 4 dB compared to CDC, without re-training, even with variations in launch power, symbol rate, or transmission distance.
△ Less
Submitted 3 November, 2023; v1 submitted 4 July, 2023;
originally announced July 2023.
-
Hardware Realization of Nonlinear Activation Functions for NN-based Optical Equalizers
Authors:
Sasipim Srivallapanondh,
Pedro J. Freire,
Antonio Napoli,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky
Abstract:
To reduce the complexity of the hardware implementation of neural network-based optical channel equalizers, we demonstrate that the performance of the biLSTM equalizer with approximated activation functions is close to that of the original model.
To reduce the complexity of the hardware implementation of neural network-based optical channel equalizers, we demonstrate that the performance of the biLSTM equalizer with approximated activation functions is close to that of the original model.
△ Less
Submitted 16 May, 2023;
originally announced May 2023.
-
Implementing Neural Network-Based Equalizers in a Coherent Optical Transmission System Using Field-Programmable Gate Arrays
Authors:
Pedro J. Freire,
Sasipim Srivallapanondh,
Michael Anderson,
Bernhard Spinnler,
Thomas Bex,
Tobias A. Eriksson,
Antonio Napoli,
Wolfgang Schairer,
Nelson Costa,
Michaela Blott,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky
Abstract:
In this work, we demonstrate the offline FPGA realization of both recurrent and feedforward neural network (NN)-based equalizers for nonlinearity compensation in coherent optical transmission systems. First, we present a realization pipeline showing the conversion of the models from Python libraries to the FPGA chip synthesis and implementation. Then, we review the main alternatives for the hardwa…
▽ More
In this work, we demonstrate the offline FPGA realization of both recurrent and feedforward neural network (NN)-based equalizers for nonlinearity compensation in coherent optical transmission systems. First, we present a realization pipeline showing the conversion of the models from Python libraries to the FPGA chip synthesis and implementation. Then, we review the main alternatives for the hardware implementation of nonlinear activation functions. The main results are divided into three parts: a performance comparison, an analysis of how activation functions are implemented, and a report on the complexity of the hardware. The performance in Q-factor is presented for the cases of bidirectional long-short-term memory coupled with convolutional NN (biLSTM + CNN) equalizer, CNN equalizer, and standard 1-StpS digital back-propagation (DBP) for the simulation and experiment propagation of a single channel dual-polarization (SC-DP) 16QAM at 34 GBd along 17x70km of LEAF. The biLSTM+CNN equalizer provides a similar result to DBP and a 1.7 dB Q-factor gain compared with the chromatic dispersion compensation baseline in the experimental dataset. After that, we assess the Q-factor and the impact of hardware utilization when approximating the activation functions of NN using Taylor series, piecewise linear, and look-up table (LUT) approximations. We also show how to mitigate the approximation errors with extra training and provide some insights into possible gradient problems in the LUT approximation. Finally, to evaluate the complexity of hardware implementation to achieve 200G and 400G throughput, fixed-point NN-based equalizers with approximated activation functions are developed and implemented in an FPGA.
△ Less
Submitted 19 February, 2023; v1 submitted 9 December, 2022;
originally announced December 2022.
-
Knowledge Distillation Applied to Optical Channel Equalization: Solving the Parallelization Problem of Recurrent Connection
Authors:
Sasipim Srivallapanondh,
Pedro J. Freire,
Bernhard Spinnler,
Nelson Costa,
Antonio Napoli,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky
Abstract:
To circumvent the non-parallelizability of recurrent neural network-based equalizers, we propose knowledge distillation to recast the RNN into a parallelizable feedforward structure. The latter shows 38\% latency decrease, while impacting the Q-factor by only 0.5dB.
To circumvent the non-parallelizability of recurrent neural network-based equalizers, we propose knowledge distillation to recast the RNN into a parallelizable feedforward structure. The latter shows 38\% latency decrease, while impacting the Q-factor by only 0.5dB.
△ Less
Submitted 8 December, 2022;
originally announced December 2022.
-
Computational Complexity Evaluation of Neural Network Applications in Signal Processing
Authors:
Pedro Freire,
Sasipim Srivallapanondh,
Antonio Napoli,
Jaroslaw E. Prilepsky,
Sergei K. Turitsyn
Abstract:
In this paper, we provide a systematic approach for assessing and comparing the computational complexity of neural network layers in digital signal processing. We provide and link four software-to-hardware complexity measures, defining how the different complexity metrics relate to the layers' hyper-parameters. This paper explains how to compute these four metrics for feed-forward and recurrent la…
▽ More
In this paper, we provide a systematic approach for assessing and comparing the computational complexity of neural network layers in digital signal processing. We provide and link four software-to-hardware complexity measures, defining how the different complexity metrics relate to the layers' hyper-parameters. This paper explains how to compute these four metrics for feed-forward and recurrent layers, and defines in which case we ought to use a particular metric depending on whether we characterize a more soft- or hardware-oriented application. One of the four metrics, called `the number of additions and bit shifts (NABS)', is newly introduced for heterogeneous quantization. NABS characterizes the impact of not only the bitwidth used in the operation but also the type of quantization used in the arithmetical operations. We intend this work to serve as a baseline for the different levels (purposes) of complexity estimation related to the neural networks' application in real-time digital signal processing, aiming at unifying the computational complexity estimation.
△ Less
Submitted 10 March, 2024; v1 submitted 24 June, 2022;
originally announced June 2022.
