Showing 1–50 of 52 results for author: Evans, L

SciJava Ops: An Improved Algorithms Framework for Fiji and Beyond

Authors: Gabriel J. Selzer, Curtis T. Rueden, Mark C. Hiner, Edward L. Evans III, David Kolb, Marcel Wiedenmann, Christian Birkhold, Tim-Oliver Buchholz, Stefan Helfrich, Brian Northan, Alison Walter, Johannes Schindelin, Tobias Pietzsch, Stephan Saalfeld, Michael R. Berthold, Kevin W. Eliceiri

Abstract: Many scientific software platforms provide plugin mechanisms that simplify the integration, deployment, and execution of externally developed functionality. One of the most widely used platforms in the imaging space is Fiji, a popular open-source application for scientific image analysis. Fiji incorporates and builds on the ImageJ and ImageJ2 platforms, which provide a powerful plugin architecture… ▽ More Many scientific software platforms provide plugin mechanisms that simplify the integration, deployment, and execution of externally developed functionality. One of the most widely used platforms in the imaging space is Fiji, a popular open-source application for scientific image analysis. Fiji incorporates and builds on the ImageJ and ImageJ2 platforms, which provide a powerful plugin architecture used by thousands of plugins to solve a wide variety of problems. This capability is a major part of Fiji's success, and it has become a widely used biological image analysis tool and a target for new functionality. However, a plugin-based software architecture cannot unify disparate platforms operating on incompatible data structures; interoperability necessitates the creation of adaptation or "bridge" layers to translate data and invoke functionality. As a result, while platforms like Fiji enable a high degree of interconnectivity and extensibility, they were not fundamentally designed to integrate across the many data types, programming languages, and architectural differences of various software platforms.To help address this challenge, we present SciJava Ops, a foundational software library for expressing algorithms as plugins in a unified and extensible way. Continuing the evolution of Fiji's SciJava plugin mechanism, SciJava Ops enables users to harness algorithms from various software platforms within a central execution environment. In addition, SciJava Ops automatically adapts data into the most appropriate structure for each algorithm, allowing users to freely and transparently combine algorithms from otherwise incompatible tools. While SciJava Ops is initially distributed as a Fiji update site, the framework does not require Fiji, ImageJ, or ImageJ2, and would be suitable for integration with additional image analysis platforms. △ Less

Submitted 20 May, 2024; originally announced May 2024.

Comments: 33 pages, 11 figures

URHand: Universal Relightable Hands

Authors: Zhaoxi Chen, Gyeongsik Moon, Kaiwen Guo, Chen Cao, Stanislav Pidhorskyi, Tomas Simon, Rohan Joshi, Yuan Dong, Yichen Xu, Bernardo Pires, He Wen, Lucas Evans, Bo Peng, Julia Buffalini, Autumn Trimble, Kevyn McPhail, Melissa Schoeller, Shoou-I Yu, Javier Romero, Michael Zollhöfer, Yaser Sheikh, Ziwei Liu, Shunsuke Saito

Abstract: Existing photorealistic relightable hand models require extensive identity-specific observations in different views, poses, and illuminations, and face challenges in generalizing to natural illuminations and novel identities. To bridge this gap, we present URHand, the first universal relightable hand model that generalizes across viewpoints, poses, illuminations, and identities. Our model allows f… ▽ More Existing photorealistic relightable hand models require extensive identity-specific observations in different views, poses, and illuminations, and face challenges in generalizing to natural illuminations and novel identities. To bridge this gap, we present URHand, the first universal relightable hand model that generalizes across viewpoints, poses, illuminations, and identities. Our model allows few-shot personalization using images captured with a mobile phone, and is ready to be photorealistically rendered under novel illuminations. To simplify the personalization process while retaining photorealism, we build a powerful universal relightable prior based on neural relighting from multi-view images of hands captured in a light stage with hundreds of identities. The key challenge is scaling the cross-identity training while maintaining personalized fidelity and sharp details without compromising generalization under natural illuminations. To this end, we propose a spatially varying linear lighting model as the neural renderer that takes physics-inspired shading as input feature. By removing non-linear activations and bias, our specifically designed lighting model explicitly keeps the linearity of light transport. This enables single-stage training from light-stage data while generalizing to real-time rendering under arbitrary continuous illuminations across diverse identities. In addition, we introduce the joint learning of a physically based model and our neural relighting model, which further improves fidelity and generalization. Extensive experiments show that our approach achieves superior performance over existing methods in terms of both quality and generalizability. We also demonstrate quick personalization of URHand from a short phone scan of an unseen identity. △ Less

Submitted 10 January, 2024; originally announced January 2024.

Comments: Project Page https://frozenburning.github.io/projects/urhand/

Sharp error estimates for target measure diffusion maps with applications to the committor problem

Authors: Shashank Sule, Luke Evans, Maria Cameron

Abstract: We obtain asymptotically sharp error estimates for the consistency error of the Target Measure Diffusion map (TMDmap) (Banisch et al. 2020), a variant of diffusion maps featuring importance sampling and hence allowing input data drawn from an arbitrary density. The derived error estimates include the bias error and the variance error. The resulting convergence rates are consistent with the approxi… ▽ More We obtain asymptotically sharp error estimates for the consistency error of the Target Measure Diffusion map (TMDmap) (Banisch et al. 2020), a variant of diffusion maps featuring importance sampling and hence allowing input data drawn from an arbitrary density. The derived error estimates include the bias error and the variance error. The resulting convergence rates are consistent with the approximation theory of graph Laplacians. The key novelty of our results lies in the explicit quantification of all the prefactors on leading-order terms. We also prove an error estimate for solutions of Dirichlet BVPs obtained using TMDmap, showing that the solution error is controlled by consistency error. We use these results to study an important application of TMDmap in the analysis of rare events in systems governed by overdamped Langevin dynamics using the framework of transition path theory (TPT). The cornerstone ingredient of TPT is the solution of the committor problem, a boundary value problem for the backward Kolmogorov PDE. Remarkably, we find that the TMDmap algorithm is particularly suited as a meshless solver to the committor problem due to the cancellation of several error terms in the prefactor formula. Furthermore, significant improvements in bias and variance errors occur when using a quasi-uniform sampling density. Our numerical experiments show that these improvements in accuracy are realizable in practice when using $δ$-nets as spatially uniform inputs to the TMDmap algorithm. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Twitter Permeability to financial events: an experiment towards a model for sensing irregularities

Authors: Ana Fernández Vilas, Rebeca P. Díaz Redondo, Keeley Crockett, Majdi Owda, Lewis Evans

Abstract: There is a general consensus of the good sensing and novelty characteristics of Twitter as an information media for the complex financial market. This paper investigates the permeability of Twittersphere, the total universe of Twitter users and their habits, towards relevant events in the financial market. Analysis shows that a general purpose social media is permeable to financial-specific events… ▽ More There is a general consensus of the good sensing and novelty characteristics of Twitter as an information media for the complex financial market. This paper investigates the permeability of Twittersphere, the total universe of Twitter users and their habits, towards relevant events in the financial market. Analysis shows that a general purpose social media is permeable to financial-specific events and establishes Twitter as a relevant feeder for taking decisions regarding the financial market and event fraudulent activities in that market. However, the provenance of contributions, their different levels of credibility and quality and even the purpose or intention behind them should to be considered and carefully contemplated if Twitter is used as a single source for decision taking. With the overall aim of this research, to deploy an architecture for real-time monitoring of irregularities in the financial market, this paper conducts a series of experiments on the level of permeability and the permeable features of Twitter in the event of one of these irregularities. To be precise, Twitter data is collected concerning an event comprising of a specific financial action on the 27th January 2017:{~ }the announcement about the merge of two companies Tesco PLC and Booker Group PLC, listed in the main market of the London Stock Exchange (LSE), to create the UK's Leading Food Business. The experiment attempts to answer five key research questions which aim to characterize the features of Twitter permeability to the financial market. The experimental results confirm that a far-impacting financial event, such as the merger considered, caused apparent disturbances in all the features considered, that is, information volume, content and sentiment as well as geographical provenance. Analysis shows that despite, Twitter not being a specific financial forum, it is permeable to financial events. △ Less

Submitted 14 December, 2023; originally announced December 2023.

Journal ref: Multimed Tools Appl 78, 2019

Multi-Modality Guidance Network For Missing Modality Inference

Authors: Zhuokai Zhao, Harish Palani, Tianyi Liu, Lena Evans, Ruth Toner

Abstract: Multimodal models have gained significant success in recent years. Standard multimodal approaches often assume unchanged modalities from training stage to inference stage. In practice, however, many scenarios fail to satisfy such assumptions with missing modalities during inference, leading to limitations on where multimodal models can be applied. While existing methods mitigate the problem throug… ▽ More Multimodal models have gained significant success in recent years. Standard multimodal approaches often assume unchanged modalities from training stage to inference stage. In practice, however, many scenarios fail to satisfy such assumptions with missing modalities during inference, leading to limitations on where multimodal models can be applied. While existing methods mitigate the problem through reconstructing the missing modalities, it increases unnecessary computational cost, which could be just as critical, especially for large, deployed systems. To solve the problem from both sides, we propose a novel guidance network that promotes knowledge sharing during training, taking advantage of the multimodal representations to train better single-modality models for inference. Real-life experiment in violence detection shows that our proposed framework trains single-modality models that significantly outperform its traditionally trained counterparts while maintaining the same inference cost. △ Less

Submitted 6 September, 2023; originally announced September 2023.

14 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathon

Authors: Kevin Maik Jablonka, Qianxiang Ai, Alexander Al-Feghali, Shruti Badhwar, Joshua D. Bocarsly, Andres M Bran, Stefan Bringuier, L. Catherine Brinson, Kamal Choudhary, Defne Circi, Sam Cox, Wibe A. de Jong, Matthew L. Evans, Nicolas Gastellu, Jerome Genzling, María Victoria Gil, Ankur K. Gupta, Zhi Hong, Alishba Imran, Sabine Kruschwitz, Anne Labarre, Jakub Lála, Tao Liu, Steven Ma, Sauradeep Majumdar , et al. (28 additional authors not shown)

Abstract: Large-language models (LLMs) such as GPT-4 caught the interest of many scientists. Recent studies suggested that these models could be useful in chemistry and materials science. To explore these possibilities, we organized a hackathon. This article chronicles the projects built as part of this hackathon. Participants employed LLMs for various applications, including predicting properties of mole… ▽ More Large-language models (LLMs) such as GPT-4 caught the interest of many scientists. Recent studies suggested that these models could be useful in chemistry and materials science. To explore these possibilities, we organized a hackathon. This article chronicles the projects built as part of this hackathon. Participants employed LLMs for various applications, including predicting properties of molecules and materials, designing novel interfaces for tools, extracting knowledge from unstructured data, and develo** new educational applications. The diverse topics and the fact that working prototypes could be generated in less than two days highlight that LLMs will profoundly impact the future of our fields. The rich collection of ideas and projects also indicates that the applications of LLMs are not limited to materials science and chemistry but offer potential benefits to a wide range of scientific disciplines. △ Less

Submitted 14 July, 2023; v1 submitted 9 June, 2023; originally announced June 2023.

Learning-Based One-Bit Maximum Likelihood Detection for Massive MIMO Systems: Dithering-Aided Adaptive Approach

Authors: Yunseong Cho, **seok Choi, Brian L. Evans

Abstract: In this paper, we propose a learning-based detection framework for uplink massive multiple-input and multiple-output (MIMO) systems with one-bit analog-to-digital converters. The learning-based detection only requires counting the occurrences of the quantized outputs of -1 and +1 for estimating a likelihood probability at each antenna. Accordingly, the key advantage of this approach is to perform… ▽ More In this paper, we propose a learning-based detection framework for uplink massive multiple-input and multiple-output (MIMO) systems with one-bit analog-to-digital converters. The learning-based detection only requires counting the occurrences of the quantized outputs of -1 and +1 for estimating a likelihood probability at each antenna. Accordingly, the key advantage of this approach is to perform maximum likelihood detection without explicit channel estimation which has been one of the primary challenges of one-bit quantized systems. However, due to the quasi-deterministic reception in the high signal-to-noise ratio (SNR) regime, one-bit observations in the high SNR regime are biased to either +1 or -1, and thus, the learning requires excessive training to estimate the small likelihood probabilities. To address this drawback, we propose a dither-and-learning technique to estimate likelihood functions from dithered signals. First, we add a dithering signal to artificially decrease the SNR and then infer the likelihood function from the quantized dithered signals by using an SNR estimate derived from a deep neural network-based estimator which is trained offline. We extend our technique by develo** an adaptive dither-and-learning method that updates the dithering power according to the patterns observed in the quantized dithered signals. The proposed framework is also applied to channel-coded MIMO systems by computing a bit-wise and user-wise log-likelihood ratio from the refined likelihood probabilities. Simulation results validate the performance of the proposed methods in both uncoded and coded systems. △ Less

Submitted 21 March, 2024; v1 submitted 16 April, 2023; originally announced April 2023.

Comments: Accepted for publication in IEEE Transactions on Vehicular Technologies

Adaptive Learning-Based Detection for One-Bit Quantized Massive MIMO Systems

Authors: Yunseong Cho, **seok Choi, Brian L. Evans

Abstract: We propose an adaptive learning-based framework for uplink massive multiple-input multiple-output (MIMO) systems with one-bit analog-to-digital converters. Learning-based detection does not need to estimate channels, which overcomes a key drawback in one-bit quantized systems. During training, learning-based detection suffers at high signal-to-noise ratio (SNR) because observations will be biased… ▽ More We propose an adaptive learning-based framework for uplink massive multiple-input multiple-output (MIMO) systems with one-bit analog-to-digital converters. Learning-based detection does not need to estimate channels, which overcomes a key drawback in one-bit quantized systems. During training, learning-based detection suffers at high signal-to-noise ratio (SNR) because observations will be biased to +1 or -1 which leads to many zero-valued empirical likelihood functions. At low SNR, observations vary frequently in value but the high noise power makes capturing the effect of the channel difficult. To address these drawbacks, we propose an adaptive dithering-and-learning method. During training, received values are mixed with dithering noise whose statistics are known to the base station, and the dithering noise power is updated for each antenna element depending on the observed pattern of the output. We then use the refined probabilities in the one-bit maximum likelihood detection rule. Simulation results validate the detection performance of the proposed method vs. our previous method using fixed dithering noise power as well as zero-forcing and optimal ML detection both of which assume perfect channel knowledge. △ Less

Submitted 13 November, 2022; originally announced November 2022.

Comments: 6 pages 6 figures

From latent dynamics to meaningful representations

Authors: Dedi Wang, Yihang Wang, Luke Evans, Pratyush Tiwary

Abstract: While representation learning has been central to the rise of machine learning and artificial intelligence, a key problem remains in making the learned representations meaningful. For this, the typical approach is to regularize the learned representation through prior probability distributions. However, such priors are usually unavailable or are ad hoc. To deal with this, recent efforts have shift… ▽ More While representation learning has been central to the rise of machine learning and artificial intelligence, a key problem remains in making the learned representations meaningful. For this, the typical approach is to regularize the learned representation through prior probability distributions. However, such priors are usually unavailable or are ad hoc. To deal with this, recent efforts have shifted towards leveraging the insights from physical principles to guide the learning process. In this spirit, we propose a purely dynamics-constrained representation learning framework. Instead of relying on predefined probabilities, we restrict the latent representation to follow overdamped Langevin dynamics with a learnable transition density - a prior driven by statistical mechanics. We show this is a more natural constraint for representation learning in stochastic dynamical systems, with the crucial ability to uniquely identify the ground truth representation. We validate our framework for different systems including a real-world fluorescent DNA movie dataset. We show that our algorithm can uniquely identify orthogonal, isometric and meaningful latent representations. △ Less

Submitted 9 April, 2024; v1 submitted 2 September, 2022; originally announced September 2022.

Coordinated Per-Antenna Power Minimization for Multicell Massive MIMO Systems with Low-Resolution Data Converters

Authors: Yunseong Cho, **seok Choi, Brian L. Evans

Abstract: A multicell-coordinated beamforming solution for massive multiple-input multiple-output orthogonal frequency-division multiplexing (OFDM) systems is presented when employing low-resolution data converters and per-antenna level constraints. For a more realistic deployment, we aim to find the downlink (DL) beamformer that minimizes the maximum power on transmit antenna array of each basestation unde… ▽ More A multicell-coordinated beamforming solution for massive multiple-input multiple-output orthogonal frequency-division multiplexing (OFDM) systems is presented when employing low-resolution data converters and per-antenna level constraints. For a more realistic deployment, we aim to find the downlink (DL) beamformer that minimizes the maximum power on transmit antenna array of each basestation under received signal quality constraints while minimizing per-antenna transmit power. We show that strong duality holds between the primal DL formulation and its manageable Lagrangian dual problem which can be interpreted as the virtual uplink (UL) problem with adjustable noise covariance matrices. For a fixed set of noise covariance matrices, we claim that the virtual UL solution is effectively used to compute the DL beamformer and noise covariance matrices can be subsequently updated with an associated subgradient. Our primary contributions are then (1) formulating the quantized DL OFDM antenna power minimax problem and deriving its associated dual problem, (2) showing strong duality and interpreting the dual as a virtual quantized UL OFDM problem, and (3) develo** an iterative minimax algorithm based on the dual problem. Simulations validate the proposed algorithm in terms of the maximum antenna transmit power and peak-to-average-power ratio. △ Less

Submitted 10 September, 2023; v1 submitted 8 August, 2022; originally announced August 2022.

Comments: submitted for possible IEEE journal publication

Multiface: A Dataset for Neural Face Rendering

Authors: Cheng-hsin Wuu, Ningyuan Zheng, Scott Ardisson, Rohan Bali, Danielle Belko, Eric Brockmeyer, Lucas Evans, Timothy Godisart, Hyowon Ha, Xuhua Huang, Alexander Hypes, Taylor Koska, Steven Krenn, Stephen Lombardi, Xiaomin Luo, Kevyn McPhail, Laura Millerschoen, Michal Perdoch, Mark Pitts, Alexander Richard, Jason Saragih, Junko Saragih, Takaaki Shiratori, Tomas Simon, Matt Stewart , et al. (6 additional authors not shown)

Abstract: Photorealistic avatars of human faces have come a long way in recent years, yet research along this area is limited by a lack of publicly available, high-quality datasets covering both, dense multi-view camera captures, and rich facial expressions of the captured subjects. In this work, we present Multiface, a new multi-view, high-resolution human face dataset collected from 13 identities at Reali… ▽ More Photorealistic avatars of human faces have come a long way in recent years, yet research along this area is limited by a lack of publicly available, high-quality datasets covering both, dense multi-view camera captures, and rich facial expressions of the captured subjects. In this work, we present Multiface, a new multi-view, high-resolution human face dataset collected from 13 identities at Reality Labs Research for neural face rendering. We introduce Mugsy, a large scale multi-camera apparatus to capture high-resolution synchronized videos of a facial performance. The goal of Multiface is to close the gap in accessibility to high quality data in the academic community and to enable research in VR telepresence. Along with the release of the dataset, we conduct ablation studies on the influence of different model architectures toward the model's interpolation capacity of novel viewpoint and expressions. With a conditional VAE model serving as our baseline, we found that adding spatial bias, texture warp field, and residual connections improves performance on novel view synthesis. Our code and data is available at: https://github.com/facebookresearch/multiface △ Less

Submitted 26 June, 2023; v1 submitted 22 July, 2022; originally announced July 2022.

Coordinated Beamforming in Quantized Massive MIMO Systems with Per-Antenna Constraints

Authors: Yunseong Cho, **seok Choi, Brian L. Evans

Abstract: In this work, we present a solution for coordinated beamforming for large-scale downlink (DL) communication systems with low-resolution data converters when employing a per-antenna power constraint that limits the maximum antenna power to alleviate hardware cost. To this end, we formulate and solve the antenna power minimax problem for the coarsely quantized DL system with target signal-to-interfe… ▽ More In this work, we present a solution for coordinated beamforming for large-scale downlink (DL) communication systems with low-resolution data converters when employing a per-antenna power constraint that limits the maximum antenna power to alleviate hardware cost. To this end, we formulate and solve the antenna power minimax problem for the coarsely quantized DL system with target signal-to-interference-plus-noise ratio requirements. We show that the associated Lagrangian dual with uncertain noise covariance matrices achieves zero duality gap and that the dual solution can be used to obtain the primal DL solution. Using strong duality, we propose an iterative algorithm to determine the optimal dual solution, which is used to compute the optimal DL beamformer. We further update the noise covariance matrices using the optimal DL solution with an associated subgradient and perform projection onto the feasible domain. Through simulation, we evaluate the proposed method in maximum antenna power consumption and peak-to-average power ratio which are directly related to hardware efficiency. △ Less

Submitted 18 October, 2021; originally announced October 2021.

Comments: 6 pages, 3 figures, 1 table, submitted to WCNC 2022

Adaptive Self-Interference Cancellation for Full-Duplex Wireless Communication Systems

Authors: Elyes Balti, Brian L. Evans

Abstract: In this letter, we consider single-cell, single-user systems wherein uplink and downlink user equipment communicate with a full-duplex relay. Due to the near-far problem, the self-interference (SI) can be 100-1000x the received signal power. In this context, we consider the adaptive Least Mean Squares (LMS) algorithm to estimate the SI channel and then subtract the SI from the desired received sig… ▽ More In this letter, we consider single-cell, single-user systems wherein uplink and downlink user equipment communicate with a full-duplex relay. Due to the near-far problem, the self-interference (SI) can be 100-1000x the received signal power. In this context, we consider the adaptive Least Mean Squares (LMS) algorithm to estimate the SI channel and then subtract the SI from the desired received signal before the analog-to-digital converter (ADC). We measure the robustness of this technique in terms of bit error rate (BER) and spectral efficiency. △ Less

Submitted 1 June, 2021; v1 submitted 3 April, 2021; originally announced April 2021.

Reservoir Computing with Magnetic Thin Films

Authors: Matthew Dale, David Griffin, Richard F. L. Evans, Sarah Jenkins, Simon O'Keefe, Angelika Sebald, Susan Stepney, Fernando Torre, Martin Trefzer

Abstract: Advances in artificial intelligence are driven by technologies inspired by the brain, but these technologies are orders of magnitude less powerful and energy efficient than biological systems. Inspired by the nonlinear dynamics of neural networks, new unconventional computing hardware has emerged with the potential to exploit natural phenomena and gain efficiency, in a similar manner to biological… ▽ More Advances in artificial intelligence are driven by technologies inspired by the brain, but these technologies are orders of magnitude less powerful and energy efficient than biological systems. Inspired by the nonlinear dynamics of neural networks, new unconventional computing hardware has emerged with the potential to exploit natural phenomena and gain efficiency, in a similar manner to biological systems. Physical reservoir computing demonstrates this with a variety of unconventional systems, from optical-based to memristive systems. Reservoir computers provide a nonlinear projection of the task input into a high-dimensional feature space by exploiting the system's internal dynamics. A trained readout layer then combines features to perform tasks, such as pattern recognition and time-series analysis. Despite progress, achieving state-of-the-art performance without external signal processing to the reservoir remains challenging. Here we perform an initial exploration of three magnetic materials in thin-film geometries via microscale simulation. Our results reveal that basic spin properties of magnetic films generate the required nonlinear dynamics and memory to solve machine learning tasks (although there would be practical challenges in exploiting these particular materials in physical implementations). The method of exploration can be applied to other materials, so this work opens up the possibility of testing different materials, from relatively simple (alloys) to significantly complex (antiferromagnetic reservoirs). △ Less

Submitted 30 October, 2023; v1 submitted 29 January, 2021; originally announced January 2021.

Comments: 30 pages, 10 figures, updated and clarified

Journal ref: International Journal of Unconventional Computing, 19(1):63-92, 2024

Coordinated Multicell Beamforming and Power Allocation for Massive MIMO with Low-Resolution ADC/DAC

Authors: Yunseong Cho, **seok Choi, Brian L. Evans

Abstract: In this work, we present a solution for coordinated beamforming and power allocation when base stations employ a massive number of antennas equipped with low-resolution analog-to-digital and digital-to-analog converters. We address total power minimization problems of the coarsely quantized uplink (UL) and downlink (DL) communication systems with target signal-to-interference-plus-noise ratio (SIN… ▽ More In this work, we present a solution for coordinated beamforming and power allocation when base stations employ a massive number of antennas equipped with low-resolution analog-to-digital and digital-to-analog converters. We address total power minimization problems of the coarsely quantized uplink (UL) and downlink (DL) communication systems with target signal-to-interference-plus-noise ratio (SINR) constraints. By combining the UL problem with minimum mean square error combiners and deriving the Lagrangian dual of the DL problem, we prove UL-DL duality and show there is no duality gap even with coarse data converters. Inspired by strong duality, we devise an iterative algorithm to determine the optimal UL transmit powers, and then linearly amplify the UL combiners with proper weights to acquire the optimal DL precoder. Simulation results validate strong duality and evaluate the proposed method in terms of total power consumption and achieved SINR. △ Less

Submitted 7 March, 2021; v1 submitted 25 May, 2020; originally announced May 2020.

Comments: 6 pages, 4 figures, IEEE ICC 2021

Quantized Massive MIMO Systems with Multicell Coordinated Beamforming and Power Control

Authors: **seok Choi, Yunseong Cho, Brian L. Evans

Abstract: In this paper, we investigate a coordinated multipoint (CoMP) beamforming and power control problem for base stations (BSs) with a massive number of antenna arrays under coarse quantization at low-resolution analog-to-digital converters (ADCs) and digital-to-analog converter (DACs). Unlike high-resolution ADC and DAC systems, non-negligible quantization noise that needs to be considered in CoMP de… ▽ More In this paper, we investigate a coordinated multipoint (CoMP) beamforming and power control problem for base stations (BSs) with a massive number of antenna arrays under coarse quantization at low-resolution analog-to-digital converters (ADCs) and digital-to-analog converter (DACs). Unlike high-resolution ADC and DAC systems, non-negligible quantization noise that needs to be considered in CoMP design makes the problem more challenging. We first formulate total power minimization problems of both uplink (UL) and downlink (DL) systems subject to signal-to-interference-and-noise ratio (SINR) constraints. We then derive strong duality for the UL and DL problems under coarse quantization systems. Leveraging the duality, we propose a framework that is directed toward a twofold aim: to discover the optimal transmit powers in UL by develo** iterative algorithm in a distributed manner and to obtain the optimal precoder in DL as a scaled instance of UL combiner. Under homogeneous transmit power and SINR constraints per cell, we further derive a deterministic solution for the UL CoMP problem by analyzing the lower bound of the SINR. Lastly, we extend the derived result to wideband orthogonal frequency-division multiplexing systems to optimize transmit power and beamformer for all subcarriers. Simulation results validate the theoretical results and proposed algorithms. △ Less

Submitted 15 May, 2020; originally announced May 2020.

Comments: 30 pages, 4 figures, submitted to IEEE Transactions on Communications

Compressed-Sensing based Beam Detection in 5G NR Initial Access

Authors: Junmo Sung, Brian L. Evans

Abstract: To support millimeter wave (mmWave) frequency bands in cellular communications, both the base station and the mobile platform utilize large antenna arrays to steer narrow beams towards each other to compensate the path loss and improve communication performance. The time-frequency resource allocated for initial access, however, is limited, which gives rise to need for efficient approaches for beam… ▽ More To support millimeter wave (mmWave) frequency bands in cellular communications, both the base station and the mobile platform utilize large antenna arrays to steer narrow beams towards each other to compensate the path loss and improve communication performance. The time-frequency resource allocated for initial access, however, is limited, which gives rise to need for efficient approaches for beam detection. For hybrid analog-digital beamforming (HB) architectures, which are used to reduce power consumption, we propose a compressed sensing (CS) based approach for 5G initial access beam detection that is for a HB architecture and that is compliant with the 3GPP standard. The CS-based approach is compared with the exhaustive search in terms of beam detection accuracy and by simulation is shown to outperform. Up to 256 antennas are considered, and the importance of a careful codebook design is reaffirmed. △ Less

Submitted 2 May, 2020; originally announced May 2020.

Comments: 5 pages, 6 figures, SPAWC2020

Advanced Receiver Architectures for Millimeter Wave Communications with Low-Resolution ADCs

Authors: **seok Choi, Gilwon Lee, Ahmed Alkhateeb, Alan Gatherer, Naofal Al-Dhahir, Brian L. Evans

Abstract: Employing low-resolution analog-to-digital converters (ADCs) for millimeter wave receivers with large antenna arrays provides opportunity to efficiently reduce power consumption of the receiver. Reducing ADC resolution, however, results in performance degradation due to non-negligible quantization error. In addition, the large number of radio frequency (RF) chains is still not desirable. According… ▽ More Employing low-resolution analog-to-digital converters (ADCs) for millimeter wave receivers with large antenna arrays provides opportunity to efficiently reduce power consumption of the receiver. Reducing ADC resolution, however, results in performance degradation due to non-negligible quantization error. In addition, the large number of radio frequency (RF) chains is still not desirable. Accordingly, conventional low-resolution ADC systems require more efficient designs to minimize the cost and complexity while maximizing performance. In this article, we discuss advanced low-resolution ADC receiver architectures that further improve the spectral and energy efficiency tradeoff. To reduce both the numbers of RF chains and ADC bits, hybrid analog-and-digital beamforming is jointly considered with low-resolution ADCs. We explore the challenges in designing such receivers and present key insights on how the advanced architectures overcome such challenges. As an alternative low-resolution ADC receiver, we also introduce receivers with learning-based detection. The receiver does not require explicit channel estimation, thereby is suitable for one-bit ADC systems. Finally, future challenges and research issues are discussed. △ Less

Submitted 10 May, 2020; v1 submitted 7 March, 2020; originally announced March 2020.

Comments: Accepted to IEEE Communications Magazine (7 pages, 5 figures)

Deep Learning Predictive Band Switching in Wireless Networks

Authors: Faris B. Mismar, Ahmad AlAmmouri, Ahmed Alkhateeb, Jeffrey G. Andrews, Brian L. Evans

Abstract: In cellular systems, the user equipment (UE) can request a change in the frequency band when its rate drops below a threshold on the current band. The UE is then instructed by the base station (BS) to measure the quality of candidate bands, which requires a measurement gap in the data transmission, thus lowering the data rate. We propose an online-learning based band switching approach that does n… ▽ More In cellular systems, the user equipment (UE) can request a change in the frequency band when its rate drops below a threshold on the current band. The UE is then instructed by the base station (BS) to measure the quality of candidate bands, which requires a measurement gap in the data transmission, thus lowering the data rate. We propose an online-learning based band switching approach that does not require any measurement gap. Our proposed classifier-based band switching policy instead exploits spatial and spectral correlation between radio frequency signals in different bands based on knowledge of the UE location. We focus on switching between a lower (e.g., 3.5 GHz) band and a millimeter wave band (e.g., 28 GHz), and design and evaluate two classification models that are trained on a ray-tracing dataset. A key insight is that measurement gaps are overkill, in that only the relative order of the bands is necessary for band selection, rather than a full channel estimate. Our proposed machine learning based policies achieve roughly 30% improvement in mean effective rates over those of the industry standard policy, while achieving misclassification errors well below 0.5% and maintaining resilience against blockage uncertainty. △ Less

Submitted 1 September, 2020; v1 submitted 2 October, 2019; originally announced October 2019.

Comments: 31 pages, 15 figures, revised and resubmitted to IEEE Transactions on Wireless Communications on October 2, 2019, March 9, 2020, July 2, 2020, and September 1, 2020

Journal ref: 2020 IEEE Transactions on Wireless Communications

Hybrid Beamformer Codebook Design and Ordering for Compressive mmWave Channel Estimation

Authors: Junmo Sung, Brian L. Evans

Abstract: In millimeter wave (mmWave) communication systems, beamforming with large antenna arrays is critical to overcome high path losses. Separating all-digital beamforming into analog and digital stages can provide the large reduction in power consumption and small loss in spectral efficiency needed for practical implementations. Develo** algorithms with this favorable tradeoff is challenging due to t… ▽ More In millimeter wave (mmWave) communication systems, beamforming with large antenna arrays is critical to overcome high path losses. Separating all-digital beamforming into analog and digital stages can provide the large reduction in power consumption and small loss in spectral efficiency needed for practical implementations. Develo** algorithms with this favorable tradeoff is challenging due to the additional degrees of freedom in the analog stage and its accompanying hardware constraints. In hybrid beamforming systems, for example, channel estimation algorithms do not directly observe the channels, face a high channel count, and operate at low SNR before transmit-receive beam alignment. Since mmWave channels are sparse in time and beam domains, many compressed sensing (CS) channel estimation algorithms have been developed that randomly configure the analog beamformers, digital beamformers, and/or pilot symbols. In this paper, we propose to design deterministic beamformers and pilot symbols for open-loop channel estimation. We use CS approaches that rely on low coherence for their recovery guarantees, and hence seek to minimize the mutual coherence of the compressed sensing matrix. We also propose a precoder column ordering to design the pilot symbols. Simulation results show that our beamformer designs reduce channel estimation error over competing methods. △ Less

Submitted 21 September, 2019; originally announced September 2019.

Versatile Compressive mmWave Hybrid Beamformer Codebook Design Framework

Authors: Junmo Sung, Brian L. Evans

Abstract: Hybrid beamforming (HB) architectures are attractive for wireless communication systems with large antenna arrays because the analog beamforming stage can significantly reduce the number of RF transceivers and hence power consumption. In HB systems, channel estimation (CE) becomes challenging due to indirect access by the baseband processing to the communication channels and due to low SNR before… ▽ More Hybrid beamforming (HB) architectures are attractive for wireless communication systems with large antenna arrays because the analog beamforming stage can significantly reduce the number of RF transceivers and hence power consumption. In HB systems, channel estimation (CE) becomes challenging due to indirect access by the baseband processing to the communication channels and due to low SNR before beam alignment. Compressed sensing (CS) based algorithms have been adopted to address these challenges by leveraging the sparse nature of millimeter wave multi-input multi-output (mmWave MIMO) channels. In many CS algorithms for narrowband CE, the hybrid beamformers are randomly configured which does not always yield the low-coherence sensing matrices desirable for those CS algorithms whose recovery guarantees rely on coherence. In this paper, we propose a versatile deterministic HB codebook design framework for CS algorithms with coherence-based recovery guarantees to enhance CE accuracy. Simulation results show that the proposed design can obtain lower channel estimation error and higher spectral efficiency compared with random codebook for phase-shifter-, switch-, and lens-based HB architectures. △ Less

Submitted 21 September, 2019; originally announced September 2019.

Base Station Antenna Selection for Low-Resolution ADC Systems

Authors: **seok Choi, Junmo Sung, Narayan Prasad, Xiao-Feng Qi, Brian L. Evans, Alan Gatherer

Abstract: This paper investigates antenna selection at a base station with large antenna arrays and low-resolution analog-to-digital converters. For downlink transmit antenna selection for narrowband channels, we show (1) a selection criterion that maximizes sum rate with zero-forcing precoding equivalent to that of a perfect quantization system; (2) maximum sum rate increases with number of selected antenn… ▽ More This paper investigates antenna selection at a base station with large antenna arrays and low-resolution analog-to-digital converters. For downlink transmit antenna selection for narrowband channels, we show (1) a selection criterion that maximizes sum rate with zero-forcing precoding equivalent to that of a perfect quantization system; (2) maximum sum rate increases with number of selected antennas; (3) derivation of the sum rate loss function from using a subset of antennas; and (4) unlike high-resolution converter systems, sum rate loss reaches a maximum at a point of total transmit power and decreases beyond that point to converge to zero. For wideband orthogonal-frequency-division-multiplexing (OFDM) systems, our results hold when entire subcarriers share a common subset of antennas. For uplink receive antenna selection for narrowband channels, we (1) generalize a greedy antenna selection criterion to capture tradeoffs between channel gain and quantization error; (2) propose a quantization-aware fast antenna selection algorithm using the criterion; and (3) derive a lower bound on sum rate achieved by the proposed algorithm based on submodular functions. For wideband OFDM systems, we extend our algorithm and derive a lower bound on its sum rate. Simulation results validate theoretical analyses and show increases in sum rate over conventional algorithms. △ Less

Submitted 30 June, 2019; originally announced July 2019.

Comments: Submitted to IEEE Transactions on Communications

Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

Authors: Faris B. Mismar, Brian L. Evans, Ahmed Alkhateeb

Abstract: The fifth generation of wireless communications (5G) promises massive increases in traffic volume and data rates, as well as improved reliability in voice calls. Jointly optimizing beamforming, power control, and interference coordination in a 5G wireless network to enhance the communication performance to end users poses a significant challenge. In this paper, we formulate the joint design of bea… ▽ More The fifth generation of wireless communications (5G) promises massive increases in traffic volume and data rates, as well as improved reliability in voice calls. Jointly optimizing beamforming, power control, and interference coordination in a 5G wireless network to enhance the communication performance to end users poses a significant challenge. In this paper, we formulate the joint design of beamforming, power control, and interference coordination as a non-convex optimization problem to maximize the signal to interference plus noise ratio (SINR) and solve this problem using deep reinforcement learning. By using the greedy nature of deep Q-learning to estimate future rewards of actions and using the reported coordinates of the users served by the network, we propose an algorithm for voice bearers and data bearers in sub-6 GHz and millimeter wave (mmWave) frequency bands, respectively. The algorithm improves the performance measured by SINR and sum-rate capacity. In realistic cellular environments, the simulation results show that our algorithm outperforms the link adaptation industry standards for sub-6 GHz voice bearers. For data bearers in the mmWave frequency band, our algorithm approaches the maximum sum-rate capacity, but with less than 4% of the required run time. △ Less

Submitted 28 December, 2019; v1 submitted 28 June, 2019; originally announced July 2019.

Comments: (c) 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Journal ref: 2019 IEEE Transactions on Communications

Deep Learning in Downlink Coordinated Multipoint in New Radio Heterogeneous Networks

Authors: Faris B. Mismar, Brian L. Evans

Abstract: We propose a method to improve the performance of the downlink coordinated multipoint (DL CoMP) in heterogeneous fifth generation New Radio (NR) networks. The standards-compliant method is based on the construction of a surrogate CoMP trigger function using deep learning. The cooperating set is a single-tier of sub-6 GHz heterogeneous base stations operating in the frequency division duplex mode (… ▽ More We propose a method to improve the performance of the downlink coordinated multipoint (DL CoMP) in heterogeneous fifth generation New Radio (NR) networks. The standards-compliant method is based on the construction of a surrogate CoMP trigger function using deep learning. The cooperating set is a single-tier of sub-6 GHz heterogeneous base stations operating in the frequency division duplex mode (i.e., no channel reciprocity). This surrogate function enhances the downlink user throughput distribution through online learning of non-linear interactions of features and lower bias learning models. In simulation, the proposed method outperforms industry standards in a realistic and scalable heterogeneous cellular environment. △ Less

Submitted 14 March, 2019; v1 submitted 8 December, 2018; originally announced December 2018.

Comments: (c) 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Journal ref: 2019 IEEE Wireless Communications Letters

A Hybrid Beamforming Receiver with Two-Stage Analog Combining and Low-Resolution ADCs

Authors: **seok Choi, Gilwon Lee, Brian L. Evans

Abstract: In this paper, we propose a two-stage analog combining architecture for millimeter wave (mmWave) communications with hybrid analog/digital beamforming and low-resolution analog-to-digital converters (ADCs). We first derive a two-stage combining solution by solving a mutual information (MI) maximization problem without a constant modulus constraint on analog combiners. With the derived solution, th… ▽ More In this paper, we propose a two-stage analog combining architecture for millimeter wave (mmWave) communications with hybrid analog/digital beamforming and low-resolution analog-to-digital converters (ADCs). We first derive a two-stage combining solution by solving a mutual information (MI) maximization problem without a constant modulus constraint on analog combiners. With the derived solution, the proposed receiver architecture splits the analog combining into a channel gain aggregation stage followed by a spreading stage to maximize the MI by effectively managing quantization error. We show that the derived two-stage combiner achieves the optimal scaling law with respect to the number of radio frequency (RF) chains and maximizes the MI for homogeneous singular values of a MIMO channel. Then, we develop a two-stage analog combining algorithm to implement the derived solution under a constant modulus constraint for mmWave channels. Simulation results validate the algorithm performance in terms of MI. △ Less

Submitted 30 November, 2018; originally announced December 2018.

Comments: 6 pages, submitted to ICC 2019. arXiv admin note: substantial text overlap with arXiv:1808.01013

Robust Learning-Based ML Detection for Massive MIMO Systems with One-Bit Quantized Signals

Authors: **seok Choi, Yunseong Cho, Brian L. Evans, Alan Gatherer

Abstract: In this paper, we investigate learning-based maximum likelihood (ML) detection for uplink massive multiple-input and multiple-output (MIMO) systems with one-bit analog-to-digital converters (ADCs). To overcome the significant dependency of learning-based detection on the training length, we propose two one-bit ML detection methods: a biased-learning method and a dithering-and-learning method. The… ▽ More In this paper, we investigate learning-based maximum likelihood (ML) detection for uplink massive multiple-input and multiple-output (MIMO) systems with one-bit analog-to-digital converters (ADCs). To overcome the significant dependency of learning-based detection on the training length, we propose two one-bit ML detection methods: a biased-learning method and a dithering-and-learning method. The biased-learning method keeps likelihood functions with zero probability from wi** out the obtained information through learning, thereby providing more robust detection performance. Extending the biased method to a system with knowledge of the received signal-to-noise ratio, the dithering-and-learning method estimates more likelihood functions by adding dithering noise to the quantizer input. The proposed methods are further improved by adopting the post likelihood function update, which exploits correctly decoded data symbols as training pilot symbols. The proposed methods avoid the need for channel estimation. Simulation results validate the detection performance of the proposed methods in symbol error rate. △ Less

Submitted 26 August, 2019; v1 submitted 30 November, 2018; originally announced November 2018.

Comments: Accepted to GLOBECOM 2019

A Framework for Automated Cellular Network Tuning with Reinforcement Learning

Authors: Faris B. Mismar, **seok Choi, Brian L. Evans

Abstract: Tuning cellular network performance against always occurring wireless impairments can dramatically improve reliability to end users. In this paper, we formulate cellular network performance tuning as a reinforcement learning (RL) problem and provide a solution to improve the performance for indoor and outdoor environments. By leveraging the ability of Q-learning to estimate future performance impr… ▽ More Tuning cellular network performance against always occurring wireless impairments can dramatically improve reliability to end users. In this paper, we formulate cellular network performance tuning as a reinforcement learning (RL) problem and provide a solution to improve the performance for indoor and outdoor environments. By leveraging the ability of Q-learning to estimate future performance improvement rewards, we propose two algorithms: (1) closed loop power control (PC) for downlink voice over LTE (VoLTE) and (2) self-organizing network (SON) fault management. The VoLTE PC algorithm uses RL to adjust the indoor base station transmit power so that the signal to interference plus noise ratio (SINR) of a user equipment (UE) meets the target SINR. It does so without the UE having to send power control requests. The SON fault management algorithm uses RL to improve the performance of an outdoor base station cluster by resolving faults in the network through configuration management. Both algorithms exploit measurements from the connected users, wireless impairments, and relevant configuration parameters to solve a non-convex performance optimization problem using RL. Simulation results show that our proposed RL based algorithms outperform the industry standards today in realistic cellular communication environments. △ Less

Submitted 28 December, 2019; v1 submitted 13 August, 2018; originally announced August 2018.

Comments: (c) 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Journal ref: 2019 IEEE Transactions on Communications

Two-Stage Analog Combining in Hybrid Beamforming Systems with Low-Resolution ADCs

Authors: **seok Choi, Gilwon Lee, Brian L. Evans

Abstract: In this paper, we investigate hybrid analog/digital beamforming for multiple-input multiple-output (MIMO) systems with low-resolution analog-to-digital converters (ADCs) for millimeter wave (mmWave) communications. In the receiver, we propose to split the analog combining subsystem into a channel gain aggregation stage followed by a spreading stage. Both stages use phase shifters. Our goal is to d… ▽ More In this paper, we investigate hybrid analog/digital beamforming for multiple-input multiple-output (MIMO) systems with low-resolution analog-to-digital converters (ADCs) for millimeter wave (mmWave) communications. In the receiver, we propose to split the analog combining subsystem into a channel gain aggregation stage followed by a spreading stage. Both stages use phase shifters. Our goal is to design the two-stage analog combiner to optimize mutual information (MI) between the transmitted and quantized signals by effectively managing quantization error. To this end, we formulate an unconstrained MI maximization problem without a constant modulus constraint on analog combiners, and derive a two-stage analog combining solution. The solution achieves the optimal scaling law with respect to the number of radio frequency chains and maximizes the MI for homogeneous singular values of a MIMO channel. We further develop a two-stage analog combining algorithm to implement the derived solution for mmWave channels. By decoupling channel gain aggregation and spreading functions from the derived solution, the proposed algorithm implements the two functions by using array response vectors and a discrete Fourier transform matrix under the constant modulus constraint on each matrix element. Therefore, the proposed algorithm provides a near optimal solution for the unconstrained problem, whereas conventional hybrid approaches offer a near optimal solution only for a constrained problem. The closed-form approximation of the ergodic rate is derived for the algorithm, showing that a practical digital combiner with two-stage analog combining also achieves the optimal scaling law. Simulation results validate the algorithm performance and the derived ergodic rate. △ Less

Submitted 5 August, 2018; v1 submitted 2 August, 2018; originally announced August 2018.

Comments: 13 pages, 7 figures, submitted to IEEE Transactions on Signal Processing

Analysis of Ergodic Rate for Transmit Antenna Selection in Low-Resolution ADC Systems

Authors: **seok Choi, Brian L. Evans

Abstract: In this paper, we analyze the ergodic rate of single transmit antenna selection (TAS) in low-resolution analog-to-digital converter (ADC) systems. Using low-resolution ADCs is a potential power-reduction solution for multiple antenna systems. Low-resolution ADC systems with TAS can further reduce cost and power consumption in wireless transceivers. Considering such systems, we derive the approxima… ▽ More In this paper, we analyze the ergodic rate of single transmit antenna selection (TAS) in low-resolution analog-to-digital converter (ADC) systems. Using low-resolution ADCs is a potential power-reduction solution for multiple antenna systems. Low-resolution ADC systems with TAS can further reduce cost and power consumption in wireless transceivers. Considering such systems, we derive the approximated lower bound of ergodic rate with TAS. Here, we exploit the approximated distribution of the sum of Weibull random variables to address the challenge involved in analyzing the quantization error. We, then, derive the approximated ergodic rate with TAS for a single receive antenna in closed form, which reveals the TAS gain in low-resolution ADC systems. The upper bound of a single transmit and single receive antenna system under coarse quantization is derived to compare with the ergodic rate of the TAS system. The analysis shows that the TAS method achieves a large improvement in ergodic rate with a moderate number of transmit antennas. Simulation results validate the derived ergodic rates and resulting intuition. △ Less

Submitted 25 January, 2019; v1 submitted 25 May, 2018; originally announced May 2018.

Comments: Published in IEEE Transactions on Vehicular Technology

User Scheduling for Millimeter Wave Hybrid Beamforming Systems with Low-Resolution ADCs

Authors: **seok Choi, Gilwon Lee, Brian L. Evans

Abstract: We investigate uplink user scheduling for millimeter wave (mmWave) hybrid analog/digital beamforming systems with low-resolution analog-to-digital converters (ADCs). Deriving new scheduling criteria for the mmWave systems, we show that the channel structure in the beamspace, in addition to the channel magnitude and orthogonality, plays a key role in maximizing the achievable rates of scheduled use… ▽ More We investigate uplink user scheduling for millimeter wave (mmWave) hybrid analog/digital beamforming systems with low-resolution analog-to-digital converters (ADCs). Deriving new scheduling criteria for the mmWave systems, we show that the channel structure in the beamspace, in addition to the channel magnitude and orthogonality, plays a key role in maximizing the achievable rates of scheduled users due to quantization error. The criteria show that to maximize the achievable rate for a given channel gain, the channels of the scheduled users need to have (1) as many propagation paths as possible with unique angle-of-arrivals (AoAs) and (2) even power distribution in the beamspace. Leveraging the derived criteria, we propose an efficient scheduling algorithm for mmWave zero-forcing receivers with low-resolution ADCs. We further propose a chordal distance-based scheduling algorithm that exploits only the AoA knowledge and analyze the performance by deriving ergodic rates in closed form. Based on the derived rates, we show that the beamspace channel leakage resulting from phase offsets between AoAs and quantized angles of analog combiners can lead to sum rate gain by reducing quantization error compared to the channel without leakage. Simulation results validate the sum rate performance of the proposed algorithms and derived ergodic rates expressions. △ Less

Submitted 14 February, 2019; v1 submitted 9 April, 2018; originally announced April 2018.

Comments: Submitted to Transactions on Wireless Communications

Antenna Selection for Large-Scale MIMO Systems with Low-Resolution ADCs

Authors: **seok Choi, Junmo Sung, Brian L. Evans, Alan Gatherer

Abstract: One way to reduce the power consumption in large-scale multiple-input multiple-output (MIMO) systems is to employ low-resolution analog-to-digital converters (ADCs). In this paper, we investigate antenna selection for large-scale MIMO receivers with low-resolution ADCs, thereby providing more flexibility in resolution and number of ADCs. To incorporate quantization effects, we generalize an existi… ▽ More One way to reduce the power consumption in large-scale multiple-input multiple-output (MIMO) systems is to employ low-resolution analog-to-digital converters (ADCs). In this paper, we investigate antenna selection for large-scale MIMO receivers with low-resolution ADCs, thereby providing more flexibility in resolution and number of ADCs. To incorporate quantization effects, we generalize an existing objective function for a greedy capacity-maximization antenna selection approach. The derived objective function offers an opportunity to select an antenna with the best tradeoff between the additional channel gain and increase in quantization error. Using the generalized objective function, we propose an antenna selection algorithm based on a conventional antenna selection algorithm without an increase in overall complexity. Simulation results show that the proposed algorithm outperforms the conventional algorithm in achievable capacity for the same number of antennas. △ Less

Submitted 20 April, 2019; v1 submitted 29 January, 2018; originally announced January 2018.

Comments: IEEE International Conference on Acoustics, Speech and Signal Processing 2018

ADC Bit Optimization for Spectrum- and Energy-Efficient Millimeter Wave Communications

Authors: **seok Choi, Junmo Sung, Brian L. Evans, Alan Gatherer

Abstract: A spectrum- and energy-efficient system is essential for millimeter wave communication systems that require large antenna arrays with power-demanding ADCs. We propose an ADC bit allocation (BA) algorithm that solves a minimum mean squared quantization error problem under a power constraint. Unlike existing BA methods that only consider an ADC power constraint, the proposed algorithm regards total… ▽ More A spectrum- and energy-efficient system is essential for millimeter wave communication systems that require large antenna arrays with power-demanding ADCs. We propose an ADC bit allocation (BA) algorithm that solves a minimum mean squared quantization error problem under a power constraint. Unlike existing BA methods that only consider an ADC power constraint, the proposed algorithm regards total receiver power constraint for a hybrid analog-digital beamforming architecture. The major challenge is the non-linearities in the minimization problem. To address this issue, we first convert the problem into a convex optimization problem through real number relaxation and substitution of ADC resolution switching power with constant average switching power. Then, we derive a closed-form solution by fixing the number of activated radio frequency (RF) chains M. Leveraging the solution, the binary search finds the optimal M and its corresponding optimal solution. We also provide an off-line training and modeling approach to estimate the average switching power. Simulation results validate the spectral and energy efficiency of the proposed algorithm. In particular, existing state-of-the-art digital beamformers can be used in the system in conjunction with the BA algorithm as it makes the quantization error negligible in the low-resolution regime. △ Less

Submitted 5 December, 2017; originally announced December 2017.

Comments: Accepted to Globecom 2017 Singapore

User Scheduling for Millimeter Wave MIMO Communications with Low-Resolution ADCs

Authors: **seok Choi, Brian L. Evans

Abstract: In millimeter wave (mmWave) systems, we investigate uplink user scheduling when a basestation employs low-resolution analog-to-digital converters (ADCs) with a large number of antennas. To reduce power consumption in the receiver, low-resolution ADCs can be a potential solution for mmWave systems in which many antennas are likely to be deployed to compensate for the large path loss. Due to quantiz… ▽ More In millimeter wave (mmWave) systems, we investigate uplink user scheduling when a basestation employs low-resolution analog-to-digital converters (ADCs) with a large number of antennas. To reduce power consumption in the receiver, low-resolution ADCs can be a potential solution for mmWave systems in which many antennas are likely to be deployed to compensate for the large path loss. Due to quantization error, we show that the channel structure in the beamspace, in addition to the channel magnitude and beamspace orthogonality, plays a key role in maximizing the achievable rates of scheduled users. Consequently, we derive the optimal criteria with respect to the channel structure in the beamspace that maximizes the uplink sum rate for multi-user multiple input multiple output (MIMO) systems with a zero-forcing receiver. Leveraging the derived criteria, we propose an efficient scheduling algorithm for mmWave systems with low-resolution ADCs. Numerical results validate that the proposed algorithm outperforms conventional user scheduling methods in terms of the sum rate. △ Less

Submitted 30 January, 2018; v1 submitted 1 November, 2017; originally announced November 2017.

Comments: Accepted to International Conference on Communications 2018

Narrowband Channel Estimation for Hybrid Beamforming Millimeter Wave Communication Systems with One-bit Quantization

Authors: Junmo Sung, **seok Choi, Brian L. Evans

Abstract: Millimeter wave (mmWave) spectrum has drawn attention due to its tremendous available bandwidth. The high propagation losses in the mmWave bands necessitate beamforming with a large number of antennas. Traditionally each antenna is paired with a high-speed analog-to-digital converter (ADC), which results in high power consumption. A hybrid beamforming architecture and one-bit resolution ADCs have… ▽ More Millimeter wave (mmWave) spectrum has drawn attention due to its tremendous available bandwidth. The high propagation losses in the mmWave bands necessitate beamforming with a large number of antennas. Traditionally each antenna is paired with a high-speed analog-to-digital converter (ADC), which results in high power consumption. A hybrid beamforming architecture and one-bit resolution ADCs have been proposed to reduce power consumption. However, analog beamforming and one-bit quantization make channel estimation more challenging. In this paper, we propose a narrowband channel estimation algorithm for mmWave communication systems with one-bit ADCs and hybrid beamforming based on generalized approximate message passing (GAMP). We show through simulation that 1) GAMP variants with one-bit ADCs have better performance than do least-squares estimation methods without quantization, 2) the proposed one-bit GAMP algorithm achieves the lowest estimation error among the GAMP variants, and 3) exploiting more frames and RF chains enhances the channel estimation performance. △ Less

Submitted 29 May, 2018; v1 submitted 29 October, 2017; originally announced October 2017.

Comments: 5 pages, 5 figures, accepted to ICASSP 2018

Wideband Channel Estimation for Hybrid Beamforming Millimeter Wave Communication Systems with Low-Resolution ADCs

Authors: Junmo Sung, **seok Choi, Brian L. Evans

Abstract: A potential tremendous spectrum resource makes millimeter wave (mmWave) communications a promising technology. High power consumption due to a large number of antennas and analog-to-digital converters (ADCs) for beamforming to overcome the large propagation losses is problematic in practice. As a hybrid beamforming architecture and low-resolution ADCs are considered to reduce power consumption, es… ▽ More A potential tremendous spectrum resource makes millimeter wave (mmWave) communications a promising technology. High power consumption due to a large number of antennas and analog-to-digital converters (ADCs) for beamforming to overcome the large propagation losses is problematic in practice. As a hybrid beamforming architecture and low-resolution ADCs are considered to reduce power consumption, estimation of mmWave channels becomes challenging. We evaluate several channel estimation algorithms for wideband mmWave systems with hybrid beamforming and low-resolution ADCs. Through simulation, we show that 1) infinite bit ADCs with least-squares estimation have worse channel estimation performance than do one-bit ADCs with orthogonal matching pursuit (OMP) in an SNR range of interest, 2) three- and four-bit quantizers can achieve channel estimation performance close to the unquantized case when using OMP, 3) a receiver with a single RF chain can yield better estimates than that with four RF chains if enough frames are exploited, and 4) for one-bit ADCs, exploitation of higher transmit power and more frames for performance enhancement adversely affects estimation performance after a certain point. △ Less

Submitted 29 October, 2017; originally announced October 2017.

Comments: 6 pages, 8 figures, submitted to ICC 2018

Partially Blind Handovers for mmWave New Radio Aided by Sub-6 GHz LTE Signaling

Authors: Faris B. Mismar, Brian L. Evans

Abstract: For a base station that supports cellular communications in sub-6 GHz LTE and millimeter (mmWave) bands, we propose a supervised machine learning algorithm to improve the success rate in the handover between the two radio frequencies using sub-6 GHz and mmWave prior channel measurements within a temporal window. The main contributions of our paper are to 1) introduce partially blind handovers, 2)… ▽ More For a base station that supports cellular communications in sub-6 GHz LTE and millimeter (mmWave) bands, we propose a supervised machine learning algorithm to improve the success rate in the handover between the two radio frequencies using sub-6 GHz and mmWave prior channel measurements within a temporal window. The main contributions of our paper are to 1) introduce partially blind handovers, 2) employ machine learning to perform handover success predictions from sub-6 GHz to mmWave frequencies, and 3) show that this machine learning based algorithm combined with partially blind handovers can improve the handover success rate in a realistic network setup of colocated cells. Simulation results show improvement in handover success rates for our proposed algorithm compared to standard handover algorithms. △ Less

Submitted 17 July, 2018; v1 submitted 5 October, 2017; originally announced October 2017.

Comments: (c) 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Journal ref: 2018 IEEE International Conference on Communications Workshops (ICC Workshops), Kansas City, MO, USA, 2018, pp. 1-5

Conjugate Phase Retrieval on ${\mathbb C}^M$ by real vectors

Authors: Luke Evans, Chun-Kit Lai

Abstract: In this paper, we will introduce the notion of {\it conjugate phase retrieval}, which is a relaxed definition of phase retrieval allowing recovery of signals up to conjugacy as well as a global phase factor. It is known that frames of real vectors are never phase retrievable on ${\mathbb C}^M$ in the ordinary sense, but we show that they can be conjugate phase retrievable in complex vector spaces.… ▽ More In this paper, we will introduce the notion of {\it conjugate phase retrieval}, which is a relaxed definition of phase retrieval allowing recovery of signals up to conjugacy as well as a global phase factor. It is known that frames of real vectors are never phase retrievable on ${\mathbb C}^M$ in the ordinary sense, but we show that they can be conjugate phase retrievable in complex vector spaces. We continue to develop the theory on conjugate phase retrievable real frames. In particular, a complete characterization of conjugate phase retrievable real frames on ${\mathbb C}^2$ and ${\mathbb C}^3$ is given. Furthermore, we show that a generic real frame with at least $4M - 6$ measurements is conjugate phase retrievable in ${\mathbb C}^M$ for $ M \ge 4.$ △ Less

Submitted 20 May, 2019; v1 submitted 26 September, 2017; originally announced September 2017.

Comments: Minor revisions, typos fixed

Q-Learning Algorithm for VoLTE Closed-Loop Power Control in Indoor Small Cells

Authors: Faris B. Mismar, Brian L. Evans

Abstract: We propose a reinforcement learning (RL) based closed loop power control algorithm for the downlink of the voice over LTE (VoLTE) radio bearer for an indoor environment served by small cells. The main contributions of our paper are to 1) use RL to solve performance tuning problems in an indoor cellular network for voice bearers and 2) show that our derived lower bound loss in effective signal to i… ▽ More We propose a reinforcement learning (RL) based closed loop power control algorithm for the downlink of the voice over LTE (VoLTE) radio bearer for an indoor environment served by small cells. The main contributions of our paper are to 1) use RL to solve performance tuning problems in an indoor cellular network for voice bearers and 2) show that our derived lower bound loss in effective signal to interference plus noise ratio due to neighboring cell failure is sufficient for VoLTE power control purposes in practical cellular networks. In our simulation, the proposed RL-based power control algorithm significantly improves both voice retainability and mean opinion score compared to current industry standards. The improvement is due to maintaining an effective downlink signal to interference plus noise ratio against adverse network operational issues and faults. △ Less

Submitted 7 November, 2018; v1 submitted 9 July, 2017; originally announced July 2017.

Comments: (c) 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Journal ref: 2018 52nd Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA, 2018, pp. 1-5

Deep Q-Learning for Self-Organizing Networks Fault Management and Radio Performance Improvement

Authors: Faris B. Mismar, Brian L. Evans

Abstract: We propose an algorithm to automate fault management in an outdoor cellular network using deep reinforcement learning (RL) against wireless impairments. This algorithm enables the cellular network cluster to self-heal by allowing RL to learn how to improve the downlink signal to interference plus noise ratio through exploration and exploitation of various alarm corrective actions. The main contrib… ▽ More We propose an algorithm to automate fault management in an outdoor cellular network using deep reinforcement learning (RL) against wireless impairments. This algorithm enables the cellular network cluster to self-heal by allowing RL to learn how to improve the downlink signal to interference plus noise ratio through exploration and exploitation of various alarm corrective actions. The main contributions of this paper are to 1) introduce a deep RL-based fault handling algorithm which self-organizing networks can implement in a polynomial runtime and 2) show that this fault management method can improve the radio link performance in a realistic network setup. Simulation results show that our proposed algorithm learns an action sequence to clear alarms and improve the performance in the cellular cluster better than existing algorithms, even against the randomness of the network fault occurrences and user movements. △ Less

Submitted 10 January, 2019; v1 submitted 9 July, 2017; originally announced July 2017.

Comments: (c) 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Journal ref: 2018 52nd Annual Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA, 2018, pp. 1-5

Complex Block Floating-Point Format with Box Encoding For Wordlength Reduction in Communication Systems

Authors: Yeong Foong Choo, Brian L. Evans, Alan Gatherer

Abstract: We propose a new complex block floating-point format to reduce implementation complexity. The new format achieves wordlength reduction by sharing an exponent across the block of samples, and uses box encoding for the shared exponent to reduce quantization error. Arithmetic operations are performed on blocks of samples at time, which can also reduce implementation complexity. For a case study of a… ▽ More We propose a new complex block floating-point format to reduce implementation complexity. The new format achieves wordlength reduction by sharing an exponent across the block of samples, and uses box encoding for the shared exponent to reduce quantization error. Arithmetic operations are performed on blocks of samples at time, which can also reduce implementation complexity. For a case study of a baseband quadrature amplitude modulation (QAM) transmitter and receiver, we quantify the tradeoffs in signal quality vs. implementation complexity using the new approach to represent IQ samples. Signal quality is measured using error vector magnitude (EVM) in the receiver, and implementation complexity is measured in terms of arithmetic complexity as well as memory allocation and memory input/output rates. The primary contributions of this paper are (1) a complex block floating-point format with box encoding of the shared exponent to reduce quantization error, (2) arithmetic operations using the new complex block floating-point format, and (3) a QAM transceiver case study to quantify signal quality vs. implementation complexity tradeoffs using the new format and arithmetic operations. △ Less

Submitted 25 October, 2017; v1 submitted 2 May, 2017; originally announced May 2017.

Comments: 6 pages, 9 figures, submitted to Asilomar Conference on Signals, Systems, and Computers 2017

Resolution-Adaptive Hybrid MIMO Architectures for Millimeter Wave Communications

Authors: **seok Choi, Brian L. Evans, Alan Gatherer

Abstract: In this paper, we propose a hybrid analog-digital beamforming architecture with resolution-adaptive ADCs for millimeter wave (mmWave) receivers with large antenna arrays. We adopt array response vectors for the analog combiners and derive ADC bit-allocation (BA) solutions in closed form. The BA solutions reveal that the optimal number of ADC bits is logarithmically proportional to the RF chain's s… ▽ More In this paper, we propose a hybrid analog-digital beamforming architecture with resolution-adaptive ADCs for millimeter wave (mmWave) receivers with large antenna arrays. We adopt array response vectors for the analog combiners and derive ADC bit-allocation (BA) solutions in closed form. The BA solutions reveal that the optimal number of ADC bits is logarithmically proportional to the RF chain's signal-to-noise ratio raised to the 1/3 power. Using the solutions, two proposed BA algorithms minimize the mean square quantization error of received analog signals under a total ADC power constraint. Contributions of this paper include 1) ADC bit-allocation algorithms to improve communication performance of a hybrid MIMO receiver, 2) approximation of the capacity with the BA algorithm as a function of channels, and 3) a worst-case analysis of the ergodic rate of the proposed MIMO receiver that quantifies system tradeoffs and serves as the lower bound. Simulation results demonstrate that the BA algorithms outperform a fixed-ADC approach in both spectral and energy efficiency, and validate the capacity and ergodic rate formula. For a power constraint equivalent to that of fixed 4-bit ADCs, the revised BA algorithm makes the quantization error negligible while achieving 22% better energy efficiency. Having negligible quantization error allows existing state-of-the-art digital beamformers to be readily applied to the proposed system. △ Less

Submitted 15 August, 2017; v1 submitted 11 April, 2017; originally announced April 2017.

Comments: Accepted to IEEE Transactions on Signal Processing

GNSS Signal Authentication via Power and Distortion Monitoring

Authors: Kyle D. Wesson, Jason N. Gross, Todd E. Humphreys, Brian L. Evans

Abstract: We propose a simple low-cost technique that enables civil Global Positioning System (GPS) receivers and other civil global navigation satellite system (GNSS) receivers to reliably detect carry-off spoofing and jamming. The technique, which we call the Power-Distortion detector, classifies received signals as interference-free, multipath-afflicted, spoofed, or jammed according to observations of re… ▽ More We propose a simple low-cost technique that enables civil Global Positioning System (GPS) receivers and other civil global navigation satellite system (GNSS) receivers to reliably detect carry-off spoofing and jamming. The technique, which we call the Power-Distortion detector, classifies received signals as interference-free, multipath-afflicted, spoofed, or jammed according to observations of received power and correlation function distortion. It does not depend on external hardware or a network connection and can be readily implemented on many receivers via a firmware update. Crucially, the detector can with high probability distinguish low-power spoofing from ordinary multipath. In testing against over 25 high-quality empirical data sets yielding over 900,000 separate detection tests, the detector correctly alarms on all malicious spoofing or jamming attacks while maintaining a <0.6% single-channel false alarm rate. △ Less

Submitted 26 March, 2020; v1 submitted 21 February, 2017; originally announced February 2017.

Journal ref: IEEE Transactions on Aerospace and Electronic Systems, vol. 54, no. 2, Apr. 2018, pp. 739-754

ADC Bit Allocation under a Power Constraint for MmWave Massive MIMO Communication Receivers

Authors: **seok Choi, Brian L. Evans, Alan Gatherer

Abstract: Millimeter wave (mmWave) systems operating over a wide bandwidth and using a large number of antennas impose a heavy burden on power consumption. In a massive multiple-input multiple-output (MIMO) uplink, analog-to-digital con- verters (ADCs) would be the primary consumer of power in the base station receiver. This paper proposes a bit allocation (BA) method for mmWave multi-user (MU) massive MIMO… ▽ More Millimeter wave (mmWave) systems operating over a wide bandwidth and using a large number of antennas impose a heavy burden on power consumption. In a massive multiple-input multiple-output (MIMO) uplink, analog-to-digital con- verters (ADCs) would be the primary consumer of power in the base station receiver. This paper proposes a bit allocation (BA) method for mmWave multi-user (MU) massive MIMO systems under a power constraint. We apply ADCs to the outputs of an analog phased array for beamspace projection to exploit mmWave channel sparsity. We relax a mean square quantization error (MSQE) minimization problem and map the closed-form solution to non-negative integer bits at each ADC. In link-level simulations, the proposed method gives better communication performance than conventional low-resolution ADCs for the same or less power. Our contribution is a near optimal low-complexity BA method that minimizes total MSQE under a power constraint. △ Less

Submitted 24 February, 2017; v1 submitted 16 September, 2016; originally announced September 2016.

Comments: Accepted to IEEE International Conference on Acoustics, Speech and Signal Processing, 2017

Real-time testbed for diversity in powerline and wireless smart grid communications

Authors: Junmo Sung, Brian L. Evans

Abstract: Two-way communication is a key feature in a smart grid. It is enabled by either powerline communication or wireless communication technologies. Utilizing both technologies can potentially enhance communication reliability, and many diversity combining schemes have been proposed. In this paper, we propose a flexible real-time testbed to evaluate diversity combining schemes over physical channels. T… ▽ More Two-way communication is a key feature in a smart grid. It is enabled by either powerline communication or wireless communication technologies. Utilizing both technologies can potentially enhance communication reliability, and many diversity combining schemes have been proposed. In this paper, we propose a flexible real-time testbed to evaluate diversity combining schemes over physical channels. The testbed provides essential parts of physical layers on which both powerline and wireless communications operate. The contributions of this paper are 1) design and implementation of a real-time testbed for diversity of simultaneous powerline and wireless communications, 2) release of the setup information and complete source code for the testbed, and 3) performance evaluation of maximal ratio combining (MRC) on the testbed. As initial results, we show that performance of MRC from measurements obtained on the testbed over physical channels is very close to that in simulations in various test cases under a controlled laboratory environment. △ Less

Submitted 29 October, 2017; v1 submitted 14 September, 2016; originally announced September 2016.

Comments: 6 pages, 5 figures, submitted to ICC 2018

Spectral Efficiency Bounds for Interference-Limited SVD-MIMO Cellular Communication Systems

Authors: **seok Choi, Jeonghun Park, Brian L. Evans

Abstract: The ergodic spectral efficiency (SE) in interference-limited multiple-input multiple-output (MIMO) downlink cellular systems is characterized based on stochastic geometry. A single user is served by using singular value decomposition precoding and combining. By approximating the expectations of the channel eigenvalues, we derive upper and lower bounds on the ergodic SE. The obtained upper bound is… ▽ More The ergodic spectral efficiency (SE) in interference-limited multiple-input multiple-output (MIMO) downlink cellular systems is characterized based on stochastic geometry. A single user is served by using singular value decomposition precoding and combining. By approximating the expectations of the channel eigenvalues, we derive upper and lower bounds on the ergodic SE. The obtained upper bound is the best possible system-level performance of any MIMO strategy in non-cooperative cellular networks. We validate our analytical results through simulation. We also conjecture that there exists the optimal number of streams being proportional to the pathloss exponent. △ Less

Submitted 30 October, 2016; v1 submitted 3 September, 2016; originally announced September 2016.

Comments: submitted to IEEE Wireless Communications Letters

Machine Learning in Downlink Coordinated Multipoint in Heterogeneous Networks

Authors: Faris B. Mismar, Brian L. Evans

Abstract: We propose a method for downlink coordinated multipoint (DL CoMP) in heterogeneous fifth generation New Radio (NR) networks. The primary contribution of our paper is an algorithm to enhance the trigger of DL CoMP using online machine learning. We use support vector machine (SVM) classifiers to enhance the user downlink throughput in a realistic frequency division duplex network environment. Our si… ▽ More We propose a method for downlink coordinated multipoint (DL CoMP) in heterogeneous fifth generation New Radio (NR) networks. The primary contribution of our paper is an algorithm to enhance the trigger of DL CoMP using online machine learning. We use support vector machine (SVM) classifiers to enhance the user downlink throughput in a realistic frequency division duplex network environment. Our simulation results show improvement in both the macro and pico base station downlink throughputs due to the informed triggering of the multiple radio streams as learned by the SVM classifier. △ Less

Submitted 1 February, 2019; v1 submitted 29 August, 2016; originally announced August 2016.

Comments: 5 pages, 4 figures. arXiv admin note: text overlap with arXiv:1812.03421

Estimating Optimal Active Learning via Model Retraining Improvement

Authors: Lewis P. G. Evans, Niall M. Adams, Christoforos Anagnostopoulos

Abstract: A central question for active learning (AL) is: "what is the optimal selection?" Defining optimality by classifier loss produces a new characterisation of optimal AL behaviour, by treating expected loss reduction as a statistical target for estimation. This target forms the basis of model retraining improvement (MRI), a novel approach providing a statistical estimation framework for AL. This frame… ▽ More A central question for active learning (AL) is: "what is the optimal selection?" Defining optimality by classifier loss produces a new characterisation of optimal AL behaviour, by treating expected loss reduction as a statistical target for estimation. This target forms the basis of model retraining improvement (MRI), a novel approach providing a statistical estimation framework for AL. This framework is constructed to address the central question of AL optimality, and to motivate the design of estimation algorithms. MRI allows the exploration of optimal AL behaviour, and the examination of AL heuristics, showing precisely how they make sub-optimal selections. The abstract formulation of MRI is used to provide a new guarantee for AL, that an unbiased MRI estimator should outperform random selection. This MRI framework reveals intricate estimation issues that in turn motivate the construction of new statistical AL algorithms. One new algorithm in particular performs strongly in a large-scale experimental study, compared to standard AL methods. This competitive performance suggests that practical efforts to minimise estimation bias may be important for AL applications. △ Less

Submitted 5 February, 2015; originally announced February 2015.

Comments: arXiv admin note: substantial text overlap with arXiv:1407.8042

When does Active Learning Work?

Authors: Lewis Evans, Niall M. Adams, Christoforos Anagnostopoulos

Abstract: Active Learning (AL) methods seek to improve classifier performance when labels are expensive or scarce. We consider two central questions: Where does AL work? How much does it help? To address these questions, a comprehensive experimental simulation study of Active Learning is presented. We consider a variety of tasks, classifiers and other AL factors, to present a broad exploration of AL perform… ▽ More Active Learning (AL) methods seek to improve classifier performance when labels are expensive or scarce. We consider two central questions: Where does AL work? How much does it help? To address these questions, a comprehensive experimental simulation study of Active Learning is presented. We consider a variety of tasks, classifiers and other AL factors, to present a broad exploration of AL performance in various settings. A precise way to quantify performance is needed in order to know when AL works. Thus we also present a detailed methodology for tackling the complexities of assessing AL performance in the context of this experimental study. △ Less

Submitted 6 August, 2014; originally announced August 2014.

Targeting Optimal Active Learning via Example Quality

Authors: Lewis P. G. Evans, Niall M. Adams, Christoforos Anagnostopoulos

Abstract: In many classification problems unlabelled data is abundant and a subset can be chosen for labelling. This defines the context of active learning (AL), where methods systematically select that subset, to improve a classifier by retraining. Given a classification problem, and a classifier trained on a small number of labelled examples, consider the selection of a single further example. This exampl… ▽ More In many classification problems unlabelled data is abundant and a subset can be chosen for labelling. This defines the context of active learning (AL), where methods systematically select that subset, to improve a classifier by retraining. Given a classification problem, and a classifier trained on a small number of labelled examples, consider the selection of a single further example. This example will be labelled by the oracle and then used to retrain the classifier. This example selection raises a central question: given a fully specified stochastic description of the classification problem, which example is the optimal selection? If optimality is defined in terms of loss, this definition directly produces expected loss reduction (ELR), a central quantity whose maximum yields the optimal example selection. This work presents a new theoretical approach to AL, example quality, which defines optimal AL behaviour in terms of ELR. Once optimal AL behaviour is defined mathematically, reasoning about this abstraction provides insights into AL. In a theoretical context the optimal selection is compared to existing AL methods, showing that heuristics can make sub-optimal selections. Algorithms are constructed to estimate example quality directly. A large-scale experimental study shows these algorithms to be competitive with standard AL methods. △ Less

Submitted 30 July, 2014; originally announced July 2014.

A Factor Graph Approach to Joint OFDM Channel Estimation and Decoding in Impulsive Noise Environments

Authors: Marcel Nassar, Philip Schniter, Brian L. Evans

Abstract: We propose a novel receiver for orthogonal frequency division multiplexing (OFDM) transmissions in impulsive noise environments. Impulsive noise arises in many modern wireless and wireline communication systems, such as Wi-Fi and powerline communications, due to uncoordinated interference that is much stronger than thermal noise. We first show that the bit-error-rate optimal receiver jointly estim… ▽ More We propose a novel receiver for orthogonal frequency division multiplexing (OFDM) transmissions in impulsive noise environments. Impulsive noise arises in many modern wireless and wireline communication systems, such as Wi-Fi and powerline communications, due to uncoordinated interference that is much stronger than thermal noise. We first show that the bit-error-rate optimal receiver jointly estimates the propagation channel coefficients, the noise impulses, the finite-alphabet symbols, and the unknown bits. We then propose a near-optimal yet computationally tractable approach to this joint estimation problem using loopy belief propagation. In particular, we merge the recently proposed "generalized approximate message passing" (GAMP) algorithm with the forward-backward algorithm and soft-input soft-output decoding using a "turbo" approach. Numerical results indicate that the proposed receiver drastically outperforms existing receivers under impulsive noise and comes within 1 dB of the matched-filter bound. Meanwhile, with N tones, the proposed factor-graph-based receiver has only O(N log N) complexity, and it can be parallelized. △ Less

Submitted 7 June, 2013; originally announced June 2013.

Comments: 13 pages, 9 figures, submitted to IEEE Transactions on Signal Processing