-
Fast and Efficient Zero-Learning Image Fusion
Authors:
Fayez Lahoud,
Sabine Süsstrunk
Abstract:
We propose a real-time image fusion method using pre-trained neural networks. Our method generates a single image containing features from multiple sources. We first decompose images into a base layer representing large scale intensity variations, and a detail layer containing small scale changes. We use visual saliency to fuse the base layers, and deep feature maps extracted from a pre-trained ne…
▽ More
We propose a real-time image fusion method using pre-trained neural networks. Our method generates a single image containing features from multiple sources. We first decompose images into a base layer representing large scale intensity variations, and a detail layer containing small scale changes. We use visual saliency to fuse the base layers, and deep feature maps extracted from a pre-trained neural network to fuse the detail layers. We conduct ablation studies to analyze our method's parameters such as decomposition filters, weight construction methods, and network depth and architecture. Then, we validate its effectiveness and speed on thermal, medical, and multi-focus fusion. We also apply it to multiple image inputs such as multi-exposure sequences. The experimental results demonstrate that our technique achieves state-of-the-art performance in visual quality, objective assessment, and runtime efficiency.
△ Less
Submitted 9 May, 2019;
originally announced May 2019.
-
Self-Binarizing Networks
Authors:
Fayez Lahoud,
Radhakrishna Achanta,
Pablo Márquez-Neila,
Sabine Süsstrunk
Abstract:
We present a method to train self-binarizing neural networks, that is, networks that evolve their weights and activations during training to become binary. To obtain similar binary networks, existing methods rely on the sign activation function. This function, however, has no gradients for non-zero values, which makes standard backpropagation impossible. To circumvent the difficulty of training a…
▽ More
We present a method to train self-binarizing neural networks, that is, networks that evolve their weights and activations during training to become binary. To obtain similar binary networks, existing methods rely on the sign activation function. This function, however, has no gradients for non-zero values, which makes standard backpropagation impossible. To circumvent the difficulty of training a network relying on the sign activation function, these methods alternate between floating-point and binary representations of the network during training, which is sub-optimal and inefficient. We approach the binarization task by training on a unique representation involving a smooth activation function, which is iteratively sharpened during training until it becomes a binary representation equivalent to the sign activation function. Additionally, we introduce a new technique to perform binary batch normalization that simplifies the conventional batch normalization by transforming it into a simple comparison operation. This is unlike existing methods, which are forced to the retain the conventional floating-point-based batch normalization. Our binary networks, apart from displaying advantages of lower memory and computation as compared to conventional floating-point and binary networks, also show higher classification accuracy than existing state-of-the-art methods on multiple benchmark datasets.
△ Less
Submitted 2 February, 2019;
originally announced February 2019.
-
Joint User Association, Power Control and Scheduling in Multi-Cell 5G Networks
Authors:
Kinda Khawam,
Bilal Maaz,
Samir Tohmé,
Jad Nasreddine,
Samer Lahoud,
France Lahoud
Abstract:
-The focus of this paper is targeted towards multi-cell 5G networks which are composed of HPNs (High Power Node) such as evolved NodeBs (HPNs) that control signaling and system broadcasting information and of simplified LPNs (Low Power Node) co-existing in the same operating area and sharing the scare radio resources. Consequently, greater emphasis is given to Inter-Cell Interference Coordination…
▽ More
-The focus of this paper is targeted towards multi-cell 5G networks which are composed of HPNs (High Power Node) such as evolved NodeBs (HPNs) that control signaling and system broadcasting information and of simplified LPNs (Low Power Node) co-existing in the same operating area and sharing the scare radio resources. Consequently, greater emphasis is given to Inter-Cell Interference Coordination (ICIC) based on multi-resource management techniques that take in particular user association into account. Beside user association to HPNs, this paper takes also power control and scheduling into consideration. This addressed problem is remained largely unsolved, mainly due to its non-convex nature that makes the global optimal solution difficult to obtain. We address the user association challenge according to the two broadly adopted approaches in wireless networks: the network-centric approach where user association is allocated efficiently in a centralized fashion; and the user-centric approach where distributed allocation prevails for reduced complexity. The scheduling and HPNs power allocation are solved in a centralized fashion, in order to reach an optimal solution of the joint optimization problem.
△ Less
Submitted 7 March, 2018;
originally announced March 2018.
