-
Bounds on the Approximation Power of Feedforward Neural Networks
Authors:
Mohammad Mehrabi,
Aslan Tchamkerten,
Mansoor I. Yousefi
Abstract:
The approximation power of general feedforward neural networks with piecewise linear activation functions is investigated. First, lower bounds on the size of a network are established in terms of the approximation error and network depth and width. These bounds improve upon state-of-the-art bounds for certain classes of functions, such as strongly convex functions. Second, an upper bound is establ…
▽ More
The approximation power of general feedforward neural networks with piecewise linear activation functions is investigated. First, lower bounds on the size of a network are established in terms of the approximation error and network depth and width. These bounds improve upon state-of-the-art bounds for certain classes of functions, such as strongly convex functions. Second, an upper bound is established on the difference of two neural networks with identical weights but different activation functions.
△ Less
Submitted 29 June, 2018;
originally announced June 2018.
-
Polarization-Division Multiplexing Based on the Nonlinear Fourier Transform
Authors:
Jan-Willem Goossens,
Mansoor I. Yousefi,
Yves Jaouën,
Hartmut Hafermann
Abstract:
Polarization-division multiplexed (PDM) transmission based on the nonlinear Fourier transform (NFT) is proposed for optical fiber communication. The NFT algorithms are generalized from the scalar nonlinear Schrödinger equation for one polarization to the Manakov system for two polarizations. The transmission performance of the PDM nonlinear frequency-division multiplexing (NFDM) and PDM orthogonal…
▽ More
Polarization-division multiplexed (PDM) transmission based on the nonlinear Fourier transform (NFT) is proposed for optical fiber communication. The NFT algorithms are generalized from the scalar nonlinear Schrödinger equation for one polarization to the Manakov system for two polarizations. The transmission performance of the PDM nonlinear frequency-division multiplexing (NFDM) and PDM orthogonal frequency-division multiplexing (OFDM) are determined. It is shown that the transmission performance in terms of Q-factor is approximately the same in PDM-NFDM and single polarization NFDM at twice the data rate and that the polarization-mode dispersion does not seriously degrade system performance. Compared with PDM-OFDM, PDM-NFDM achieves a Q-factor gain of 6.4 dB. The theory can be generalized to multi-mode fibers in the strong coupling regime, paving the way for the application of the NFT to address the nonlinear effects in space-division multiplexing.
△ Less
Submitted 26 July, 2017;
originally announced July 2017.
-
Capacity-Achieving Input Distribution in Per-Sample Zero-Dispersion Model of Optical Fiber
Authors:
Jihad Fahs,
Aslan Tchamkerten,
Mansoor I. Yousefi
Abstract:
The per-sample zero-dispersion channel model of the optical fiber is considered. It is shown that capacity is uniquely achieved by an input probability distribution that has continuous uniform phase and discrete amplitude that takes on finitely many values. This result holds when the channel is subject to general input cost constraints, that include a peak amplitude constraint and a joint average…
▽ More
The per-sample zero-dispersion channel model of the optical fiber is considered. It is shown that capacity is uniquely achieved by an input probability distribution that has continuous uniform phase and discrete amplitude that takes on finitely many values. This result holds when the channel is subject to general input cost constraints, that include a peak amplitude constraint and a joint average and peak amplitude constraint.
△ Less
Submitted 23 September, 2018; v1 submitted 17 April, 2017;
originally announced April 2017.
-
Nonlinear Frequency-Division Multiplexing in the Focusing Regime
Authors:
Xianhe Yangzhang,
Mansoor I. Yousefi,
Alex Alvarado,
Domanic Lavery,
Polina Bayvel
Abstract:
Achievable rates of the nonlinear frequency-division multiplexing (NFDM) and wavelength-division multiplexing (WDM) subject to the same power and bandwidth constraints are computed as a function of transmit power in the standard single-mode fiber. NFDM achieves higher rates than WDM.
Achievable rates of the nonlinear frequency-division multiplexing (NFDM) and wavelength-division multiplexing (WDM) subject to the same power and bandwidth constraints are computed as a function of transmit power in the standard single-mode fiber. NFDM achieves higher rates than WDM.
△ Less
Submitted 1 November, 2016;
originally announced November 2016.
-
The Asymptotic Capacity of the Optical Fiber
Authors:
Mansoor I. Yousefi
Abstract:
It is shown that signal energy is the only available degree-of-freedom (DOF) for fiber-optic transmission as the input power tends to infinity. With $n$ signal DOFs at the input, $n-1$ DOFs are asymptotically lost to signal-noise interactions. The main observation is that, nonlinearity introduces a multiplicative noise in the channel, similar to fading in wireless channels. The channel is viewed i…
▽ More
It is shown that signal energy is the only available degree-of-freedom (DOF) for fiber-optic transmission as the input power tends to infinity. With $n$ signal DOFs at the input, $n-1$ DOFs are asymptotically lost to signal-noise interactions. The main observation is that, nonlinearity introduces a multiplicative noise in the channel, similar to fading in wireless channels. The channel is viewed in the spherical coordinate system, where signal vector $\underline{X}\in\mathbb{C}^n$ is represented in terms of its norm $|\underline{X}|$ and direction $\underline{\hat{X}}$. The multiplicative noise causes signal direction $\underline{\hat{X}}$ to vary randomly on the surface of the unit $(2n-1)$-sphere in $\mathbb{C}^{n}$, in such a way that the effective area of the support of $\underline{\hat{X}}$ does not vanish as $|\underline{X}|\rightarrow\infty$. On the other hand, the surface area of the sphere is finite, so that $\underline{\hat{X}}$ carries finite information. This observation is used to show several results. Firstly, let $\mathcal C(\mathcal P)$ be the capacity of a discrete-time periodic model of the optical fiber with distributed noise and frequency-dependent loss, as a function of the average input power $\mathcal P$. It is shown that asymptotically as $\mathcal P\rightarrow\infty$, $\mathcal C=\frac{1}{n}\log\bigl(\log\mathcal P\bigr)+c$, where $n$ is the dimension of the input signal space and $c$ is a bounded number. In particular, $\lim_{\mathcal P\rightarrow\infty}\mathcal C(\mathcal P)=\infty$ in finite-dimensional periodic models. Secondly, it is shown that capacity saturates to a constant in infinite-dimensional models where $n=\infty$.
△ Less
Submitted 20 October, 2016;
originally announced October 2016.
-
Linear and Nonlinear Frequency-Division Multiplexing
Authors:
Mansoor I. Yousefi,
Xianhe Yangzhang
Abstract:
Two signal multiplexing schemes for optical fiber communication are considered: Wavelength-division multiplexing (WDM) and nonlinear frequency-division multiplexing (NFDM), based on the nonlinear Fourier transform (NFT). Achievable information rates (AIRs) of NFDM and WDM are compared in a network scenario with an ideal lossless model of the optical fiber in the defocusing regime. It is shown that…
▽ More
Two signal multiplexing schemes for optical fiber communication are considered: Wavelength-division multiplexing (WDM) and nonlinear frequency-division multiplexing (NFDM), based on the nonlinear Fourier transform (NFT). Achievable information rates (AIRs) of NFDM and WDM are compared in a network scenario with an ideal lossless model of the optical fiber in the defocusing regime. It is shown that the NFDM AIR is greater than the WDM AIR subject to a bandwidth and average power constraint, in a representative system with one symbol per user. The improvement results from nonlinear signal multiplexing.
△ Less
Submitted 23 April, 2018; v1 submitted 14 March, 2016;
originally announced March 2016.
-
Upper Bound on the Capacity of a Cascade of Nonlinear and Noisy Channels
Authors:
Gerhard Kramer,
Mansoor I. Yousefi,
Frank R. Kschischang
Abstract:
An upper bound on the capacity of a cascade of nonlinear and noisy channels is presented. The cascade mimics the split-step Fourier method for computing waveform propagation governed by the stochastic generalized nonlinear Schroedinger equation. It is shown that the spectral efficiency of the cascade is at most log(1+SNR), where SNR is the receiver signal-to-noise ratio. The results may be applied…
▽ More
An upper bound on the capacity of a cascade of nonlinear and noisy channels is presented. The cascade mimics the split-step Fourier method for computing waveform propagation governed by the stochastic generalized nonlinear Schroedinger equation. It is shown that the spectral efficiency of the cascade is at most log(1+SNR), where SNR is the receiver signal-to-noise ratio. The results may be applied to optical fiber channels. However, the definition of bandwidth is subtle and leaves open interpretations of the bound. Some of these interpretations are discussed.
△ Less
Submitted 23 April, 2015; v1 submitted 26 March, 2015;
originally announced March 2015.
-
Upper Bound on the Capacity of the Nonlinear Schrödinger Channel
Authors:
Mansoor I. Yousefi,
Gerhard Kramer,
Frank R. Kschischang
Abstract:
It is shown that the capacity of the channel modeled by (a discretized version of) the stochastic nonlinear Schrödinger (NLS) equation is upper-bounded by $\log(1+\text{SNR})$ with $\text{SNR}=\mathcal P_0/σ^2(z)$, where $\mathcal P_0$ is the average input signal power and $σ^2(z)$ is the total noise power up to distance $z$. The result is a consequence of the fact that the deterministic NLS equat…
▽ More
It is shown that the capacity of the channel modeled by (a discretized version of) the stochastic nonlinear Schrödinger (NLS) equation is upper-bounded by $\log(1+\text{SNR})$ with $\text{SNR}=\mathcal P_0/σ^2(z)$, where $\mathcal P_0$ is the average input signal power and $σ^2(z)$ is the total noise power up to distance $z$. The result is a consequence of the fact that the deterministic NLS equation is a Hamiltonian energy-preserving dynamical system.
△ Less
Submitted 31 March, 2015; v1 submitted 23 February, 2015;
originally announced February 2015.
-
The Kolmogorov-Zakharov Model for Optical Fiber Communication
Authors:
Mansoor I. Yousefi
Abstract:
A mathematical framework is presented to study the evolution of multi-point cumulants in nonlinear dispersive partial differential equations with random input data, based on the theory of weak wave turbulence (WWT). This framework is used to explain how energy is distributed among Fourier modes in the nonlinear Schrödinger equation. This is achieved by considering interactions among four Fourier m…
▽ More
A mathematical framework is presented to study the evolution of multi-point cumulants in nonlinear dispersive partial differential equations with random input data, based on the theory of weak wave turbulence (WWT). This framework is used to explain how energy is distributed among Fourier modes in the nonlinear Schrödinger equation. This is achieved by considering interactions among four Fourier modes and studying the role of the resonant, non-resonant, and trivial quartets in the dynamics. As an application, a power spectral density is suggested for calculating the interference power in dense wavelength-division multiplexed optical systems, based on the kinetic equation of the WWT. This power spectrum, termed the Kolmogorov-Zakharov (KZ) model, results in a better estimate of the signal spectrum in optical fiber, compared with the so-called Gaussian noise (GN) model. The KZ model is generalized to non-stationary inputs and multi-span optical systems.
△ Less
Submitted 10 March, 2017; v1 submitted 24 November, 2014;
originally announced November 2014.
-
On the Per-Sample Capacity of Nondispersive Optical Fibers
Authors:
Mansoor I. Yousefi,
Frank R. Kschischang
Abstract:
The capacity of the channel defined by the stochastic nonlinear Schrödinger equation, which includes the effects of the Kerr nonlinearity and amplified spontaneous emission noise, is considered in the case of zero dispersion. In the absence of dispersion, this channel behaves as a collection of parallel per-sample channels. The conditional probability density function of the nonlinear per-sample c…
▽ More
The capacity of the channel defined by the stochastic nonlinear Schrödinger equation, which includes the effects of the Kerr nonlinearity and amplified spontaneous emission noise, is considered in the case of zero dispersion. In the absence of dispersion, this channel behaves as a collection of parallel per-sample channels. The conditional probability density function of the nonlinear per-sample channels is derived using both a sum-product and a Fokker-Planck differential equation approach. It is shown that, for a fixed noise power, the per-sample capacity grows unboundedly with input signal. The channel can be partitioned into amplitude and phase subchannels, and it is shown that the contribution to the total capacity of the phase channel declines for large input powers. It is found that a two-dimensional distribution with a half-Gaussian profile on the amplitude and uniform phase provides a lower bound for the zero-dispersion optical fiber channel, which is simple and asymptotically capacity-achieving at high signal-to-noise ratios (SNRs). A lower bound on the capacity is also derived in the medium-SNR region. The exact capacity subject to peak and average power constraints is numerically quantified using dense multiple ring modulation formats. The differential model underlying the zero-dispersion channel is reduced to an algebraic model, which is more tractable for digital communication studies, and in particular it provides a relation between the zero-dispersion optical channel and a $2 \times 2$ multiple-input multiple-output Rician fading channel. It appears that the structure of the capacity-achieving input distribution resembles that of the Rician fading channel, i.e., it is discrete in amplitude with a finite number of mass points, while continuous and uniform in phase.
△ Less
Submitted 7 October, 2014;
originally announced October 2014.
-
Information Transmission using the Nonlinear Fourier Transform, Part III: Spectrum Modulation
Authors:
Mansoor I. Yousefi,
Frank R. Kschischang
Abstract:
Motivated by the looming "capacity crunch" in fiber-optic networks, information transmission over such systems is revisited. Among numerous distortions, inter-channel interference in multiuser wavelength-division multiplexing (WDM) is identified as the seemingly intractable factor limiting the achievable rate at high launch power. However, this distortion and similar ones arising from nonlinearity…
▽ More
Motivated by the looming "capacity crunch" in fiber-optic networks, information transmission over such systems is revisited. Among numerous distortions, inter-channel interference in multiuser wavelength-division multiplexing (WDM) is identified as the seemingly intractable factor limiting the achievable rate at high launch power. However, this distortion and similar ones arising from nonlinearity are primarily due to the use of methods suited for linear systems, namely WDM and linear pulse-train transmission, for the nonlinear optical channel. Exploiting the integrability of the nonlinear Schrödinger (NLS) equation, a nonlinear frequency-division multiplexing (NFDM) scheme is presented, which directly modulates non-interacting signal degrees-of-freedom under NLS propagation. The main distinction between this and previous methods is that NFDM is able to cope with the nonlinearity, and thus, as the the signal power or transmission distance is increased, the new method does not suffer from the deterministic cross-talk between signal components which has degraded the performance of previous approaches. In this paper, emphasis is placed on modulation of the discrete component of the nonlinear Fourier transform of the signal and some simple examples of achievable spectral efficiencies are provided.
△ Less
Submitted 7 October, 2014; v1 submitted 12 February, 2013;
originally announced February 2013.
-
Information Transmission using the Nonlinear Fourier Transform, Part II: Numerical Methods
Authors:
Mansoor I. Yousefi,
Frank R. Kschischang
Abstract:
In this paper, numerical methods are suggested to compute the discrete and the continuous spectrum of a signal with respect to the Zakharov-Shabat system, a Lax operator underlying numerous integrable communication channels including the nonlinear Schrödinger channel, modeling pulse propagation in optical fibers. These methods are subsequently tested and their ability to estimate the spectrum are…
▽ More
In this paper, numerical methods are suggested to compute the discrete and the continuous spectrum of a signal with respect to the Zakharov-Shabat system, a Lax operator underlying numerous integrable communication channels including the nonlinear Schrödinger channel, modeling pulse propagation in optical fibers. These methods are subsequently tested and their ability to estimate the spectrum are compared against each other. These methods are used to compute the spectrum of various signals commonly used in the optical fiber communications. It is found that the layer-peeling and the spectral methods are suitable schemes to estimate the nonlinear spectra with good accuracy. To illustrate the structure of the spectrum, the locus of the eigenvalues is determined under amplitude and phase modulation in a number of examples. It is observed that in some cases, as signal parameters vary, eigenvalues collide and change their course of motion. The real axis is typically the place from which new eigenvalues originate or are absorbed into after traveling a trajectory in the complex plane.
△ Less
Submitted 7 October, 2014; v1 submitted 3 April, 2012;
originally announced April 2012.
-
Information Transmission using the Nonlinear Fourier Transform, Part I: Mathematical Tools
Authors:
Mansoor I. Yousefi,
Frank R. Kschischang
Abstract:
The nonlinear Fourier transform (NFT), a powerful tool in soliton theory and exactly solvable models, is a method for solving integrable partial differential equations governing wave propagation in certain nonlinear media. The NFT decorrelates signal degrees-of-freedom in such models, in much the same way that the Fourier transform does for linear systems. In this three-part series of papers, this…
▽ More
The nonlinear Fourier transform (NFT), a powerful tool in soliton theory and exactly solvable models, is a method for solving integrable partial differential equations governing wave propagation in certain nonlinear media. The NFT decorrelates signal degrees-of-freedom in such models, in much the same way that the Fourier transform does for linear systems. In this three-part series of papers, this observation is exploited for data transmission over integrable channels such as optical fibers, where pulse propagation is governed by the nonlinear Schrödinger equation. In this transmission scheme, which can be viewed as a nonlinear analogue of orthogonal frequency-division multiplexing commonly used in linear channels, information is encoded in the nonlinear frequencies and their spectral amplitudes. Unlike most other fiber-optic transmission schemes, this technique deals with both dispersion and nonlinearity directly and unconditionally without the need for dispersion or nonlinearity compensation methods. This first paper explains the mathematical tools that underlie the method.
△ Less
Submitted 7 October, 2014; v1 submitted 16 February, 2012;
originally announced February 2012.
