Feature-Dependent Cross-Connections in Multi-Path Neural Networks
Authors:
Dumindu Tissera,
Kasun Vithanage,
Rukshan Wijesinghe,
Kumara Kahatapitiya,
Subha Fernando,
Ranga Rodrigo
Abstract:
Learning a particular task from a dataset, samples in which originate from diverse contexts, is challenging, and usually addressed by deepening or widening standard neural networks. As opposed to conventional network widening, multi-path architectures restrict the quadratic increment of complexity to a linear scale. However, existing multi-column/path networks or model ensembling methods do not co…
▽ More
Learning a particular task from a dataset, samples in which originate from diverse contexts, is challenging, and usually addressed by deepening or widening standard neural networks. As opposed to conventional network widening, multi-path architectures restrict the quadratic increment of complexity to a linear scale. However, existing multi-column/path networks or model ensembling methods do not consider any feature-dependent allocation of parallel resources, and therefore, tend to learn redundant features. Given a layer in a multi-path network, if we restrict each path to learn a context-specific set of features and introduce a mechanism to intelligently allocate incoming feature maps to such paths, each path can specialize in a certain context, reducing the redundancy and improving the quality of extracted features. This eventually leads to better-optimized usage of parallel resources. To do this, we propose inserting feature-dependent cross-connections between parallel sets of feature maps in successive layers. The weighting coefficients of these cross-connections are computed from the input features of the particular layer. Our multi-path networks show improved image recognition accuracy at a similar complexity compared to conventional and state-of-the-art methods for deepening, widening and adaptive feature extracting, in both small and large scale datasets.
△ Less
Submitted 1 January, 2021; v1 submitted 24 June, 2020;
originally announced June 2020.
Outage Analysis of $2\times2 $ MIMO-MRC in Correlated Rician Fading
Authors:
Prathapasinghe Dharmawansa,
Kumara Kahatapitiya,
Saman Atapattu,
Chintha Tellambura
Abstract:
This paper addresses one of the classical problems in random matrix theory-- finding the distribution of the maximum eigenvalue of the correlated Wishart unitary ensemble. In particular, we derive a new exact expression for the cumulative distribution function (c.d.f.) of the maximum eigenvalue of a $2\times 2$ correlated non-central Wishart matrix with rank-$1$ mean. By using this new result, we…
▽ More
This paper addresses one of the classical problems in random matrix theory-- finding the distribution of the maximum eigenvalue of the correlated Wishart unitary ensemble. In particular, we derive a new exact expression for the cumulative distribution function (c.d.f.) of the maximum eigenvalue of a $2\times 2$ correlated non-central Wishart matrix with rank-$1$ mean. By using this new result, we derive an exact analytical expression for the outage probability of $2\times 2$ multiple-input multiple-output maximum-ratio-combining (MIMO-MRC) in Rician fading with transmit correlation and a strong line-of-sight (LoS) component (rank-$1$ channel mean). We also show that the outage performance is affected by the relative alignment of the eigen-spaces of the mean and correlation matrices. In general, when the LoS path aligns with the least eigenvector of the correlation matrix, in the {\it high} transmit signal-to-noise ratio (SNR) regime, the outage gradually improves with the increasing correlation. Moreover, we show that as $K$ (Rician factor) grows large, the outage event can be approximately characterized by the c.d.f. of a certain Gaussian random variable.
△ Less
Submitted 16 November, 2018;
originally announced November 2018.
