-
CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Data
Authors:
Wei Fang,
Yuxing Tang,
Heng Guo,
Mingze Yuan,
Tony C. W. Mok,
Ke Yan,
Jiawen Yao,
Xin Chen,
Zaiyi Liu,
Le Lu,
Ling Zhang,
Minfeng Xu
Abstract:
In the realm of medical 3D data, such as CT and MRI images, prevalent anisotropic resolution is characterized by high intra-slice but diminished inter-slice resolution. The lowered resolution between adjacent slices poses challenges, hindering optimal viewing experiences and impeding the development of robust downstream analysis algorithms. Various volumetric super-resolution algorithms aim to sur…
▽ More
In the realm of medical 3D data, such as CT and MRI images, prevalent anisotropic resolution is characterized by high intra-slice but diminished inter-slice resolution. The lowered resolution between adjacent slices poses challenges, hindering optimal viewing experiences and impeding the development of robust downstream analysis algorithms. Various volumetric super-resolution algorithms aim to surmount these challenges, enhancing inter-slice resolution and overall 3D medical imaging quality. However, existing approaches confront inherent challenges: 1) often tailored to specific upsampling factors, lacking flexibility for diverse clinical scenarios; 2) newly generated slices frequently suffer from over-smoothing, degrading fine details, and leading to inter-slice inconsistency. In response, this study presents CycleINR, a novel enhanced Implicit Neural Representation model for 3D medical data volumetric super-resolution. Leveraging the continuity of the learned implicit function, the CycleINR model can achieve results with arbitrary up-sampling rates, eliminating the need for separate training. Additionally, we enhance the grid sampling in CycleINR with a local attention mechanism and mitigate over-smoothing by integrating cycle-consistent loss. We introduce a new metric, Slice-wise Noise Level Inconsistency (SNLI), to quantitatively assess inter-slice noise level inconsistency. The effectiveness of our approach is demonstrated through image quality evaluations on an in-house dataset and a downstream task analysis on the Medical Segmentation Decathlon liver tumor dataset.
△ Less
Submitted 7 April, 2024;
originally announced April 2024.
-
Robust Analysis of Full-Duplex Two-Way Space Shift Keying With RIS Systems
Authors:
Xusheng Zhu,
Wen Chen,
Qingqing Wu,
Wen Fang,
Chaoying Huang,
Jun Li
Abstract:
Reconfigurable intelligent surface (RIS)-assisted index modulation system schemes are considered a promising technology for sixth-generation (6G) wireless communication systems, which can enhance various system capabilities such as coverage and reliability. However, obtaining perfect channel state information (CSI) is challenging due to the lack of a radio frequency chain in RIS. In this paper, we…
▽ More
Reconfigurable intelligent surface (RIS)-assisted index modulation system schemes are considered a promising technology for sixth-generation (6G) wireless communication systems, which can enhance various system capabilities such as coverage and reliability. However, obtaining perfect channel state information (CSI) is challenging due to the lack of a radio frequency chain in RIS. In this paper, we investigate the RIS-assisted full-duplex (FD) two-way space shift keying (SSK) system under imperfect CSI, where the signal emissions are augmented by deploying RISs in the vicinity of two FD users. The maximum likelihood detector is utilized to recover the transmit antenna index. With this in mind, we derive closed-form average bit error probability (ABEP) expression based on the Gaussian-Chebyshev quadrature (GCQ) method and provide the upper bound and asymptotic ABEP expressions in the presence of channel estimation errors. To gain more insights, we also derive the outage probability and provide the throughput of the proposed scheme with imperfect CSI. The correctness of the analytical derivation results is confirmed via Monte Carlo simulations. It is demonstrated that increasing the number of elements of RIS can significantly improve the ABEP performance of the FD system over the half-duplex (HD) system. Furthermore, in the high SNR region, the ABEP performance of the FD system is better than that of the HD system.
△ Less
Submitted 26 March, 2024;
originally announced March 2024.
-
Submodel Partitioning in Hierarchical Federated Learning: Algorithm Design and Convergence Analysis
Authors:
Wenzhi Fang,
Dong-Jun Han,
Christopher G. Brinton
Abstract:
Hierarchical federated learning (HFL) has demonstrated promising scalability advantages over the traditional "star-topology" architecture-based federated learning (FL). However, HFL still imposes significant computation, communication, and storage burdens on the edge, especially when training a large-scale model over resource-constrained Internet of Things (IoT) devices. In this paper, we propose…
▽ More
Hierarchical federated learning (HFL) has demonstrated promising scalability advantages over the traditional "star-topology" architecture-based federated learning (FL). However, HFL still imposes significant computation, communication, and storage burdens on the edge, especially when training a large-scale model over resource-constrained Internet of Things (IoT) devices. In this paper, we propose hierarchical independent submodel training (HIST), a new FL methodology that aims to address these issues in hierarchical settings. The key idea behind HIST is a hierarchical version of model partitioning, where we partition the global model into disjoint submodels in each round, and distribute them across different cells, so that each cell is responsible for training only one partition of the full model. This enables each client to save computation/storage costs while alleviating the communication loads throughout the hierarchy. We characterize the convergence behavior of HIST for non-convex loss functions under mild assumptions, showing the impact of several attributes (e.g., number of cells, local and global aggregation frequency) on the performance-efficiency tradeoff. Finally, through numerical experiments, we verify that HIST is able to save communication costs by a wide margin while achieving the same target testing accuracy.
△ Less
Submitted 27 October, 2023;
originally announced October 2023.
-
A Deep Registration Method for Accurate Quantification of Joint Space Narrowing Progression in Rheumatoid Arthritis
Authors:
Haolin Wang,
Yafei Ou,
Wanxuan Fang,
Prasoon Ambalathankandy,
Naoto Goto,
Gen Ota,
Masayuki Ikebe,
Tamotsu Kamishima
Abstract:
Rheumatoid arthritis (RA) is a chronic autoimmune inflammatory disease that results in progressive articular destruction and severe disability. Joint space narrowing (JSN) progression has been regarded as an important indicator for RA progression and has received sustained attention. In the diagnosis and monitoring of RA, radiology plays a crucial role to monitor joint space. A new framework for m…
▽ More
Rheumatoid arthritis (RA) is a chronic autoimmune inflammatory disease that results in progressive articular destruction and severe disability. Joint space narrowing (JSN) progression has been regarded as an important indicator for RA progression and has received sustained attention. In the diagnosis and monitoring of RA, radiology plays a crucial role to monitor joint space. A new framework for monitoring joint space by quantifying JSN progression through image registration in radiographic images has been developed. This framework offers the advantage of high accuracy, however, challenges do exist in reducing mismatches and improving reliability. In this work, a deep intra-subject rigid registration network is proposed to automatically quantify JSN progression in the early stage of RA. In our experiments, the mean-square error of Euclidean distance between moving and fixed image is 0.0031, standard deviation is 0.0661 mm, and the mismatching rate is 0.48\%. The proposed method has sub-pixel level accuracy, exceeding manual measurements by far, and is equipped with immune to noise, rotation, and scaling of joints. Moreover, this work provides loss visualization, which can aid radiologists and rheumatologists in assessing quantification reliability, with important implications for possible future clinical applications. As a result, we are optimistic that this proposed work will make a significant contribution to the automatic quantification of JSN progression in RA.
△ Less
Submitted 26 April, 2023;
originally announced April 2023.
-
CancerUniT: Towards a Single Unified Model for Effective Detection, Segmentation, and Diagnosis of Eight Major Cancers Using a Large Collection of CT Scans
Authors:
Jieneng Chen,
Yingda Xia,
Jiawen Yao,
Ke Yan,
Jianpeng Zhang,
Le Lu,
Fakai Wang,
Bo Zhou,
Mingyan Qiu,
Qihang Yu,
Mingze Yuan,
Wei Fang,
Yuxing Tang,
Minfeng Xu,
Jian Zhou,
Yuqian Zhao,
Qifeng Wang,
Xianghua Ye,
Xiaoli Yin,
Yu Shi,
Xin Chen,
**gren Zhou,
Alan Yuille,
Zaiyi Liu,
Ling Zhang
Abstract:
Human readers or radiologists routinely perform full-body multi-organ multi-disease detection and diagnosis in clinical practice, while most medical AI systems are built to focus on single organs with a narrow list of a few diseases. This might severely limit AI's clinical adoption. A certain number of AI models need to be assembled non-trivially to match the diagnostic process of a human reading…
▽ More
Human readers or radiologists routinely perform full-body multi-organ multi-disease detection and diagnosis in clinical practice, while most medical AI systems are built to focus on single organs with a narrow list of a few diseases. This might severely limit AI's clinical adoption. A certain number of AI models need to be assembled non-trivially to match the diagnostic process of a human reading a CT scan. In this paper, we construct a Unified Tumor Transformer (CancerUniT) model to jointly detect tumor existence & location and diagnose tumor characteristics for eight major cancers in CT scans. CancerUniT is a query-based Mask Transformer model with the output of multi-tumor prediction. We decouple the object queries into organ queries, tumor detection queries and tumor diagnosis queries, and further establish hierarchical relationships among the three groups. This clinically-inspired architecture effectively assists inter- and intra-organ representation learning of tumors and facilitates the resolution of these complex, anatomically related multi-organ cancer image reading tasks. CancerUniT is trained end-to-end using a curated large-scale CT images of 10,042 patients including eight major types of cancers and occurring non-cancer tumors (all are pathology-confirmed with 3D tumor masks annotated by radiologists). On the test set of 631 patients, CancerUniT has demonstrated strong performance under a set of clinically relevant evaluation metrics, substantially outperforming both multi-disease methods and an assembly of eight single-organ expert models in tumor detection, segmentation, and diagnosis. This moves one step closer towards a universal high performance cancer screening tool.
△ Less
Submitted 6 October, 2023; v1 submitted 28 January, 2023;
originally announced January 2023.
-
Binocular Localization Using Resonant Beam
Authors:
Mengyuan Xu,
Mingqing Liu,
Qingwei Jiang,
Wen Fang,
Qingwen Liu,
Shengli Zhou
Abstract:
Locating mobile devices precisely in indoor scenarios is a challenging task because of the signal diffraction and reflection in complicated environments. One vital cause deteriorating the localization performance is the inevitable power dissipation along the propagation path of localization signals. In this paper, we propose a high-accuracy localization scheme based on the resonant beam system (RB…
▽ More
Locating mobile devices precisely in indoor scenarios is a challenging task because of the signal diffraction and reflection in complicated environments. One vital cause deteriorating the localization performance is the inevitable power dissipation along the propagation path of localization signals. In this paper, we propose a high-accuracy localization scheme based on the resonant beam system (RBS) and the binocular vision, i.e., binocular based resonant beam localization (BRBL). The BRBL system utilizes the energy-concentrated and self-aligned transmission of RBS to realize high-efficiency signal propagation and self-positioning for the target. The binocular method is combined with RBS to obtain the three-dimensional (3-D) coordinates of the target for the first time. To exhibit the localization mechanism, we first elaborate on the binocular localization model, including the resonant beam transmission analysis and the geometric derivation of the binocular method with RBS. Then, we establish the power model of RBS, and the signal and noise models of beam spot imaging, respectively, to analyse the performance of the BRBL system. Finally, the numerical results show an outstanding performance of centimeter level accuracy (i.e., $<5\mathrm{cm}$ in $0.4\mathrm{m}$ width and $0.4\mathrm{m}$ length effective range at $1\mathrm{m}$ vertical distance, $<13\mathrm{cm}$ in $0.6\mathrm{m}$ width and $0.6\mathrm{m}$ length effective range at $2\mathrm{m}$ vertical distance), which applies to indoor scenarios.
△ Less
Submitted 1 December, 2022;
originally announced December 2022.
-
Transmission Model for Resonant Beam SWIPT with Telescope Internal Modulator
Authors:
Wen Fang,
Yunfeng Bai,
Qingwen Liu,
Shengli Zhou
Abstract:
To satisfy the long-range and energy self-sustaining communication needs of electronic devices in the Internet of Things (IoT), we introduce a simultaneous wireless information and power transfer (SWIPT) system using the resonant beam that incorporates a telescope modulator inside a cavity for suppressing diffraction losses. We theoretically analyze power transfer in the resonant beam system with…
▽ More
To satisfy the long-range and energy self-sustaining communication needs of electronic devices in the Internet of Things (IoT), we introduce a simultaneous wireless information and power transfer (SWIPT) system using the resonant beam that incorporates a telescope modulator inside a cavity for suppressing diffraction losses. We theoretically analyze power transfer in the resonant beam system with telescope internal modulator (TIM-RBS) considering the electromagnetic field propagation, the end-to-end (E2E) power transfer, and power and information reception. The numerical evaluation demonstrates that the TIM can effectively compress the beam spot, which allows the TIM-RBS to transmit energy twice as far as the RBS without TIM at higher power. Additionally, the largest transmission distance and maximum output power are proportional to the input power, and about 34m transmission distance, 4W electric power, and 12bps/Hz spectral efficiency can be achieved in the TIM-RBS with 200W input power. Hence, TIM-RBS can be considered as a promising option for realizing long-range, high-power, and high-rate SWIPT.
△ Less
Submitted 29 September, 2022;
originally announced September 2022.
-
Communication-Efficient Stochastic Zeroth-Order Optimization for Federated Learning
Authors:
Wenzhi Fang,
Ziyi Yu,
Yuning Jiang,
Yuanming Shi,
Colin N. Jones,
Yong Zhou
Abstract:
Federated learning (FL), as an emerging edge artificial intelligence paradigm, enables many edge devices to collaboratively train a global model without sharing their private data. To enhance the training efficiency of FL, various algorithms have been proposed, ranging from first-order to second-order methods. However, these algorithms cannot be applied in scenarios where the gradient information…
▽ More
Federated learning (FL), as an emerging edge artificial intelligence paradigm, enables many edge devices to collaboratively train a global model without sharing their private data. To enhance the training efficiency of FL, various algorithms have been proposed, ranging from first-order to second-order methods. However, these algorithms cannot be applied in scenarios where the gradient information is not available, e.g., federated black-box attack and federated hyperparameter tuning. To address this issue, in this paper we propose a derivative-free federated zeroth-order optimization (FedZO) algorithm featured by performing multiple local updates based on stochastic gradient estimators in each communication round and enabling partial device participation. Under non-convex settings, we derive the convergence performance of the FedZO algorithm on non-independent and identically distributed data and characterize the impact of the numbers of local iterates and participating edge devices on the convergence. To enable communication-efficient FedZO over wireless networks, we further propose an over-the-air computation (AirComp) assisted FedZO algorithm. With an appropriate transceiver design, we show that the convergence of AirComp-assisted FedZO can still be preserved under certain signal-to-noise ratio conditions. Simulation results demonstrate the effectiveness of the FedZO algorithm and validate the theoretical observations.
△ Less
Submitted 10 October, 2022; v1 submitted 24 January, 2022;
originally announced January 2022.
-
Structural Consensus in Networks with Directed Topologies and Its Cryptographic Implementation
Authors:
Wentuo Fang,
Zhiyong Chen,
Mohsen Zamani
Abstract:
The existing cryptosystem based approaches for privacy-preserving consensus of networked systems are usually limited to those with undirected topologies. This paper proposes a new privacy-preserving algorithm for networked systems with directed topologies to reach confidential consensus. As a prerequisite for applying the algorithm, a structural consensus problem is formulated and the solvability…
▽ More
The existing cryptosystem based approaches for privacy-preserving consensus of networked systems are usually limited to those with undirected topologies. This paper proposes a new privacy-preserving algorithm for networked systems with directed topologies to reach confidential consensus. As a prerequisite for applying the algorithm, a structural consensus problem is formulated and the solvability conditions are discussed for an explicitly constructed controller. The controller is then implemented with encryption to achieve consensus while avoiding individual's information leakage to external eavesdroppers and/or malicious internal neighbors.
△ Less
Submitted 18 January, 2022;
originally announced January 2022.
-
A Cloud-Edge-Terminal Collaborative System for Temperature Measurement in COVID-19 Prevention
Authors:
Zheyi Ma,
Hao Li,
Wen Fang,
Qingwen Liu,
Bin Zhou,
Zhiyong Bu
Abstract:
To prevent the spread of coronavirus disease 2019 (COVID-19), preliminary temperature measurement and mask detection in public areas are conducted. However, the existing temperature measurement methods face the problems of safety and deployment. In this paper, to realize safe and accurate temperature measurement even when a person's face is partially obscured, we propose a cloud-edge-terminal coll…
▽ More
To prevent the spread of coronavirus disease 2019 (COVID-19), preliminary temperature measurement and mask detection in public areas are conducted. However, the existing temperature measurement methods face the problems of safety and deployment. In this paper, to realize safe and accurate temperature measurement even when a person's face is partially obscured, we propose a cloud-edge-terminal collaborative system with a lightweight infrared temperature measurement model. A binocular camera with an RGB lens and a thermal lens is utilized to simultaneously capture image pairs. Then, a mobile detection model based on a multi-task cascaded convolutional network (MTCNN) is proposed to realize face alignment and mask detection on the RGB images. For accurate temperature measurement, we transform the facial landmarks on the RGB images to the thermal images by an affine transformation and select a more accurate temperature measurement area on the forehead. The collected information is uploaded to the cloud in real time for COVID-19 prevention. Experiments show that the detection model is only 6.1M and the average detection speed is 257ms. At a distance of 1m, the error of indoor temperature measurement is about 3%. That is, the proposed system can realize real-time temperature measurement in public areas.
△ Less
Submitted 11 July, 2021;
originally announced July 2021.
-
End-to-End Transmission Analysis of Simultaneous Wireless Information and Power Transfer using Resonant Beam
Authors:
Wen Fang,
Hao Deng,
Qingwen Liu,
Mingqing Liu,
Mengyuan Xu,
Liuqing Yang,
Georgios B. Giannakis
Abstract:
Integrating the wireless power transfer (WPT) technology into the wireless communication system has been important for operational cost saving and power-hungry problem solving of electronic devices. In this paper, we propose a resonant beam simultaneous wireless information and power transfer (RB-SWIPT) system, which utilizes a gain medium and two retro-reflecting surfaces to enhance and retro-ref…
▽ More
Integrating the wireless power transfer (WPT) technology into the wireless communication system has been important for operational cost saving and power-hungry problem solving of electronic devices. In this paper, we propose a resonant beam simultaneous wireless information and power transfer (RB-SWIPT) system, which utilizes a gain medium and two retro-reflecting surfaces to enhance and retro-reflect energy, and allows devices to recharge their batteries and exchange information from the resonant beam wirelessly. To reveal the SWIPT mechanism and evaluate the SWIPT performance, we establish an analytical end-to-end (E2E) transmission model based on a modular approach and the electromagnetic field propagation. Then, the intra-cavity power intensity distribution, transmission loss, output power, and E2E efficiency can be obtained. The numerical evaluation illustrates that the exemplary RB-SWIPT system can provide about 4.20W electric power and 12.41bps/Hz spectral efficiency, and shorter transmission distance or larger retro-reflecting surface size can lead to higher E2E efficiency. The RB-SWIPT presents a new way for high-power, long-range WPT, and high-rate communication.
△ Less
Submitted 10 June, 2021;
originally announced June 2021.
-
Charging A Smartphone Over the Air: The Resonant Beam Charging Method
Authors:
Qingwen Liu,
Mingqing Xiong,
Mingqing Liu,
Qingwei Jiang,
Wen Fang,
Yunfeng Bai
Abstract:
Wireless charging for mobile Internet of Things (IoT) devices such as smartphones is extremely difficult. To reduce energy dissipation during wireless transmission in mobile scenarios, laser or narrow radio beams with sophisticated tracking control are typically required. However, reaching the necessary tracking accuracy and reliability is really difficult. In this paper, inspired by the features…
▽ More
Wireless charging for mobile Internet of Things (IoT) devices such as smartphones is extremely difficult. To reduce energy dissipation during wireless transmission in mobile scenarios, laser or narrow radio beams with sophisticated tracking control are typically required. However, reaching the necessary tracking accuracy and reliability is really difficult. In this paper, inspired by the features of optical resonators and retroreflectors, we develop an experiment on a self-aligned resonant beam charging system for long-distance mobile power transfer. It exploits light resonances inside a double-retroreflector-based spatially separated laser resonator (SSLR), which eliminates the requirement for any kind of tracking control. Focal telecentric cat's eye retroreflectors are employed here. The SSLR was investigated by both theoretical calculation and experiment. We also well assembled the transmitter and the receiver and demonstrated its application in mobile smartphone charging. The results show that above 5-W optical power (also obtained more than 0.6-W electrical power) transferring with negligible diffraction loss to a few-centimeter-size receiver is realized while the receiver moves arbitrarily within 2-m vertical distance and 6° field of view from the transmitter. The maximum horizontal moving range is up to 18cm. This wireless charging system empowers a smartphone in mobile operation with unlimited battery life without the need for a cable.
△ Less
Submitted 12 January, 2022; v1 submitted 24 May, 2021;
originally announced May 2021.
-
Over-the-Air Computation via Reconfigurable Intelligent Surface
Authors:
Wenzhi Fang,
Yuning Jiang,
Yuanming Shi,
Yong Zhou,
Wei Chen,
Khaled B. Letaief
Abstract:
Over-the-air computation (AirComp) is a disruptive technique for fast wireless data aggregation in Internet of Things (IoT) networks via exploiting the waveform superposition property of multiple-access channels. However, the performance of AirComp is bottlenecked by the worst channel condition among all links between the IoT devices and the access point. In this paper, a reconfigurable intelligen…
▽ More
Over-the-air computation (AirComp) is a disruptive technique for fast wireless data aggregation in Internet of Things (IoT) networks via exploiting the waveform superposition property of multiple-access channels. However, the performance of AirComp is bottlenecked by the worst channel condition among all links between the IoT devices and the access point. In this paper, a reconfigurable intelligent surface (RIS) assisted AirComp system is proposed to boost the received signal power and thus mitigate the performance bottleneck by reconfiguring the propagation channels. With an objective to minimize the AirComp distortion, we propose a joint design of AirComp transceivers and RIS phase-shifts, which however turns out to be a highly intractable non-convex programming problem. To this end, we develop a novel alternating minimization framework in conjunction with the successive convex approximation technique, which is proved to converge monotonically. To reduce the computational complexity, we transform the subproblem in each alternation as a smooth convex-concave saddle point problem, which is then tackled by proposing a Mirror-Prox method that only involves a sequence of closed-form updates. Simulations show that the computation time of the proposed algorithm can be two orders of magnitude smaller than that of the state-of-the-art algorithms, while achieving a similar distortion performance.
△ Less
Submitted 11 May, 2021;
originally announced May 2021.
-
Optimal Receive Beamforming for Over-the-Air Computation
Authors:
Wenzhi Fang,
Yinan Zou,
Hongbin Zhu,
Yuanming Shi,
Yong Zhou
Abstract:
In this paper, we consider fast wireless data aggregation via over-the-air computation (AirComp) in Internet of Things (IoT) networks, where an access point (AP) with multiple antennas aim to recover the arithmetic mean of sensory data from multiple IoT devices. To minimize the estimation distortion, we formulate a mean-squared-error (MSE) minimization problem that involves the joint optimization…
▽ More
In this paper, we consider fast wireless data aggregation via over-the-air computation (AirComp) in Internet of Things (IoT) networks, where an access point (AP) with multiple antennas aim to recover the arithmetic mean of sensory data from multiple IoT devices. To minimize the estimation distortion, we formulate a mean-squared-error (MSE) minimization problem that involves the joint optimization of the transmit scalars at the IoT devices as well as the denoising factor and the receive beamforming vector at the AP. To this end, we derive the transmit scalars and the denoising factor in closed-form, resulting in a non-convex quadratic constrained quadratic programming (QCQP) problem concerning the receive beamforming vector.Different from the existing studies that only obtain sub-optimal beamformers, we propose a branch and bound (BnB) algorithm to design the globally optimal receive beamformer.Extensive simulations demonstrate the superior performance of the proposed algorithm in terms of MSE. Moreover, the proposed BnB algorithm can serve as a benchmark to evaluate the performance of the existing sub-optimal algorithms.
△ Less
Submitted 11 May, 2021;
originally announced May 2021.
-
A Symbolic Regression Method for Dynamic Modeling and Control of Quadrotor UAVs
Authors:
Wei Fang,
Zhiyong Chen
Abstract:
This paper presents a mathematic dynamic model of a quadrotor unmanned aerial vehicle (QUAV) by using the symbolic regression approach and then proposes a hierarchical control scheme for trajectory tracking. The symbolic regression approach is capable of constructing analytical quadrotor dynamic equations only through the collected data, which relieves the burden of first principle modeling. To fa…
▽ More
This paper presents a mathematic dynamic model of a quadrotor unmanned aerial vehicle (QUAV) by using the symbolic regression approach and then proposes a hierarchical control scheme for trajectory tracking. The symbolic regression approach is capable of constructing analytical quadrotor dynamic equations only through the collected data, which relieves the burden of first principle modeling. To facilitate position tracking control of a QUAV, the design of controller can be decomposed into two parts: a proportional-integral controller for the position subsystem is first designed to obtain the desired horizontal position and the backstep** method for the attitude subsystem is developed to ensure that the Euler angles and the altitude can fast converge to the reference values. The effectiveness is verified through experiments on a benchmark multicopter simulator.
△ Less
Submitted 6 May, 2021;
originally announced May 2021.
-
Stochastic Beamforming for Reconfigurable Intelligent Surface Aided Over-the-Air Computation
Authors:
Wenzhi Fang,
Min Fu,
Kunlun Wang,
Yuanming Shi,
Yong Zhou
Abstract:
Over-the-air computation (AirComp) is a promising technology that is capable of achieving fast data aggregation in Internet of Things (IoT) networks. The mean-squared error (MSE) performance of AirComp is bottlenecked by the unfavorable channel conditions. This limitation can be mitigated by deploying a reconfigurable intelligent surface (RIS), which reconfigures the propagation environment to fac…
▽ More
Over-the-air computation (AirComp) is a promising technology that is capable of achieving fast data aggregation in Internet of Things (IoT) networks. The mean-squared error (MSE) performance of AirComp is bottlenecked by the unfavorable channel conditions. This limitation can be mitigated by deploying a reconfigurable intelligent surface (RIS), which reconfigures the propagation environment to facilitate the receiving power equalization. The achievable performance of RIS relies on the availability of accurate channel state information (CSI), which however is generally difficult to be obtained. In this paper, we consider an RIS-aided AirComp IoT network, where an access point (AP) aggregates sensing data from distributed devices. Without assuming any prior knowledge on the underlying channel distribution, we formulate a stochastic optimization problem to maximize the probability that the MSE is below a certain threshold. The formulated problem turns out to be non-convex and highly intractable. To this end, we propose a data-driven approach to jointly optimize the receive beamforming vector at the AP and the phase-shift vector at the RIS based on historical channel realizations. After smoothing the objective function by adopting the sigmoid function, we develop an alternating stochastic variance reduced gradient (SVRG) algorithm with a fast convergence rate to solve the problem. Simulation results demonstrate the effectiveness of the proposed algorithm and the importance of deploying an RIS in reducing the MSE outage probability.
△ Less
Submitted 16 September, 2020; v1 submitted 21 May, 2020;
originally announced May 2020.
-
Outage Minimization for Intelligent Reflecting Surface Aided MISO Communication Systems via Stochastic Beamforming
Authors:
Wenzhi Fang,
Min Fu,
Yuanming Shi,
Yong Zhou
Abstract:
Intelligent reflecting surface (IRS) has the potential to significantly enhance the network performance by reconfiguring the wireless propagation environments. It is however difficult to obtain the accurate downlink channel state information (CSI) for efficient beamforming design in IRS-aided wireless networks. In this article, we consider an IRS-aided downlink multiple-input single-output (MISO)…
▽ More
Intelligent reflecting surface (IRS) has the potential to significantly enhance the network performance by reconfiguring the wireless propagation environments. It is however difficult to obtain the accurate downlink channel state information (CSI) for efficient beamforming design in IRS-aided wireless networks. In this article, we consider an IRS-aided downlink multiple-input single-output (MISO) network, where the base station (BS) is not required to know the underlying channel distribution. We formulate an outage probability minimization problem by jointly optimizing the beamforming vector at the BS and the phase-shift matrix at the IRS, while taking into account the transmit power and unimodular constraints. The formulated problem turns out to be a non-convex non-smooth stochastic optimization problem. To this end, we employ the sigmoid function as the surrogate to tackle the non-smoothness of the objective function. In addition, we propose a data-driven efficient alternating stochastic gradient descent (SGD) algorithm to solve the problem by utilizing the historical channel samples. Simulation results demonstrate the performance gains of the proposed algorithm over the benchmark methods in terms of minimizing the outage probability.
△ Less
Submitted 15 May, 2020;
originally announced May 2020.
-
Mask R-CNN Based Object Detection for Intelligent Wireless Power Transfer
Authors:
Aozhou Wu,
Qingqing Zhang,
Wen Fang,
Hao Deng,
Sai Jiang,
Qingwen Liu
Abstract:
Resonant Beam Charging (RBC) is a promising multi-Watt and multi-meter wireless power transfer method with safety, mobility and simultaneously-charging capability. However, RBC system operation relies on information availability including power receiver location, class label and the receiver number. Since smartphone is the most widely-used mobile device, we propose a Mask R-CNN based smartphone de…
▽ More
Resonant Beam Charging (RBC) is a promising multi-Watt and multi-meter wireless power transfer method with safety, mobility and simultaneously-charging capability. However, RBC system operation relies on information availability including power receiver location, class label and the receiver number. Since smartphone is the most widely-used mobile device, we propose a Mask R-CNN based smartphone detection model in the RBC system. Experiments illustrate that our model reduces the smartphone scanning time to one third. Thus, this machine learningdetectionapproachprovidesanintelligentwaytoimprove the user experience in wireless power transfer for mobile and Internet of Things (IoT) devices.
△ Less
Submitted 25 April, 2020; v1 submitted 19 April, 2020;
originally announced April 2020.
-
Channel-Dependent Scheduling in Wireless Energy Transfer for Mobile Devices
Authors:
Wen Fang,
Gang Wang,
Georgios B. Giannakis,
Qingwen Liu,
Xin Wang,
Hao Deng
Abstract:
Resonant Beam Charging (RBC) is the Wireless Power Transfer (WPT) technology, which can provide high-power, long-distance, mobile, and safe wireless charging for Internet of Things (IoT) devices. Supporting multiple IoT devices charging simultaneously is a significant feature of the RBC system. To optimize the multi-user charging performance, the transmitting power should be scheduled for charging…
▽ More
Resonant Beam Charging (RBC) is the Wireless Power Transfer (WPT) technology, which can provide high-power, long-distance, mobile, and safe wireless charging for Internet of Things (IoT) devices. Supporting multiple IoT devices charging simultaneously is a significant feature of the RBC system. To optimize the multi-user charging performance, the transmitting power should be scheduled for charging all IoT devices simultaneously. In order to keep all IoT devices working as long as possible for fairness, we propose the First Access First Charge (FAFC) scheduling algorithm. Then, we formulate the scheduling parameters quantitatively for algorithm implementation. Finally, we analyze the performance of FAFC scheduling algorithm considering the impacts of the receiver number, the transmitting power and the charging time. Based on the analysis, we summarize the methods of improving the WPT performance for multiple IoT devices, which include limiting the receiver number, increasing the transmitting power, prolonging the charging time and improving the single-user's charging efficiency. The FAFC scheduling algorithm design and analysis provide a fair WPT solution for the multi-user RBC system.
△ Less
Submitted 14 April, 2020;
originally announced April 2020.
-
Predicting Effective Diffusivity of Porous Media from Images by Deep Learning
Authors:
Haiyi Wu,
Wen-Zhen Fang,
Qinjun Kang,
Wen-Quan Tao,
Rui Qiao
Abstract:
We report the application of machine learning methods for predicting the effective diffusivity (De) of two-dimensional porous media from images of their structures. Pore structures are built using reconstruction methods and represented as images, and their effective diffusivity is computed by lattice Boltzmann (LBM) simulations. The datasets thus generated are used to train convolutional neural ne…
▽ More
We report the application of machine learning methods for predicting the effective diffusivity (De) of two-dimensional porous media from images of their structures. Pore structures are built using reconstruction methods and represented as images, and their effective diffusivity is computed by lattice Boltzmann (LBM) simulations. The datasets thus generated are used to train convolutional neural network (CNN) models and evaluate their performance. The trained model predicts the effective diffusivity of porous structures with computational cost orders of magnitude lower than LBM simulations. The optimized model performs well on porous media with realistic topology, large variation of porosity (0.28-0.98), and effective diffusivity spanning more than one order of magnitude (), e.g., >95% of predicted De have truncated relative error of <10% when the true De is larger than 0.2. The CNN model provides better prediction than the empirical Bruggeman equation, especially for porous structure with small diffusivity. The relative error of CNN predictions, however, is rather high for structures with De < 0.1. To address this issue, the porosity of porous structures is encoded directly into the neural network but the performance is enhanced marginally. Further improvement, i.e., 70% of the CNN predictions for structures with true De < 0.1 have relative error <30%, is achieved by removing trapped regions and dead-end pathways using a simple algorithm. These results suggest that deep learning augmented by field knowledge can be a powerful technique for predicting the transport properties of porous media. Directions for future research of machine learning in porous media are discussed based on detailed analysis of the performance of CNN models in the present work.
△ Less
Submitted 2 December, 2019;
originally announced December 2019.
-
Universal Adversarial Perturbations for CNN Classifiers in EEG-Based BCIs
Authors:
Zihan Liu,
Lubin Meng,
Xiao Zhang,
Weili Fang,
Dongrui Wu
Abstract:
Multiple convolutional neural network (CNN) classifiers have been proposed for electroencephalogram (EEG) based brain-computer interfaces (BCIs). However, CNN models have been found vulnerable to universal adversarial perturbations (UAPs), which are small and example-independent, yet powerful enough to degrade the performance of a CNN model, when added to a benign example. This paper proposes a no…
▽ More
Multiple convolutional neural network (CNN) classifiers have been proposed for electroencephalogram (EEG) based brain-computer interfaces (BCIs). However, CNN models have been found vulnerable to universal adversarial perturbations (UAPs), which are small and example-independent, yet powerful enough to degrade the performance of a CNN model, when added to a benign example. This paper proposes a novel total loss minimization (TLM) approach to generate UAPs for EEG-based BCIs. Experimental results demonstrated the effectiveness of TLM on three popular CNN classifiers for both target and non-target attacks. We also verified the transferability of UAPs in EEG-based BCI systems. To our knowledge, this is the first study on UAPs of CNN classifiers in EEG-based BCIs. UAPs are easy to construct, and can attack BCIs in real-time, exposing a potentially critical security concern of BCIs.
△ Less
Submitted 23 June, 2021; v1 submitted 2 December, 2019;
originally announced December 2019.
-
Seismic data interpolation based on U-net with texture loss
Authors:
Wenqian Fang,
Lihua Fu,
Meng Zhang,
Zhiming Li
Abstract:
Missing traces in acquired seismic data is a common occurrence during the collection of seismic data. Deep neural network (DNN) has shown considerable promise in restoring incomplete seismic data. However, several DNN-based approaches ignore the specific characteristics of seismic data itself, and only focus on reducing the difference between the recovered and the original signals. In this study,…
▽ More
Missing traces in acquired seismic data is a common occurrence during the collection of seismic data. Deep neural network (DNN) has shown considerable promise in restoring incomplete seismic data. However, several DNN-based approaches ignore the specific characteristics of seismic data itself, and only focus on reducing the difference between the recovered and the original signals. In this study, a novel Seismic U-net InterpolaTor (SUIT) is proposed to preserve the seismic texture information while reconstructing the missing traces. Aside from minimizing the reconstruction error, SUIT enhances the texture consistency between the recovery and the original completely seismic data, by designing a pre-trained U-Net to extract the texture information. The experiments show that our method outperforms the classic state-of-art methods in terms of robustness.
△ Less
Submitted 11 November, 2019;
originally announced November 2019.
-
Towards Transfer Learning for End-to-End Speech Synthesis from Deep Pre-Trained Language Models
Authors:
Wei Fang,
Yu-An Chung,
James Glass
Abstract:
Modern text-to-speech (TTS) systems are able to generate audio that sounds almost as natural as human speech. However, the bar of develo** high-quality TTS systems remains high since a sizable set of studio-quality <text, audio> pairs is usually required. Compared to commercial data used to develop state-of-the-art systems, publicly available data are usually worse in terms of both quality and s…
▽ More
Modern text-to-speech (TTS) systems are able to generate audio that sounds almost as natural as human speech. However, the bar of develo** high-quality TTS systems remains high since a sizable set of studio-quality <text, audio> pairs is usually required. Compared to commercial data used to develop state-of-the-art systems, publicly available data are usually worse in terms of both quality and size. Audio generated by TTS systems trained on publicly available data tends to not only sound less natural, but also exhibits more background noise. In this work, we aim to lower TTS systems' reliance on high-quality data by providing them the textual knowledge extracted by deep pre-trained language models during training. In particular, we investigate the use of BERT to assist the training of Tacotron-2, a state of the art TTS consisting of an encoder and an attention-based decoder. BERT representations learned from large amounts of unlabeled text data are shown to contain very rich semantic and syntactic information about the input text, and have potential to be leveraged by a TTS system to compensate the lack of high-quality data. We incorporate BERT as a parallel branch to the Tacotron-2 encoder with its own attention head. For an input text, it is simultaneously passed into BERT and the Tacotron-2 encoder. The representations extracted by the two branches are concatenated and then fed to the decoder. As a preliminary study, although we have not found incorporating BERT into Tacotron-2 generates more natural or cleaner speech at a human-perceivable level, we observe improvements in other aspects such as the model is being significantly better at knowing when to stop decoding such that there is much less babbling at the end of the synthesized audio and faster convergence during training.
△ Less
Submitted 17 June, 2019;
originally announced June 2019.
-
Earning Maximization with Quality of Charging Service Guarantee for IoT Devices
Authors:
Wen Fang,
Qingqing Zhang,
Mingqing Liu,
Qingwen Liu,
Pengfei Xia
Abstract:
Resonant Beam Charging (RBC) is a promising Wireless Power Transfer (WPT) technology to provide long-range, high-power, mobile and safe wireless power for the Internet of Things (IoT) devices. The Point-to-Multipoint (PtMP) RBC system can charge multiple receivers simultaneously similar to WiFi communications. To guarantee the Quality of Charging Service (QoCS) for each receiver and maximize the o…
▽ More
Resonant Beam Charging (RBC) is a promising Wireless Power Transfer (WPT) technology to provide long-range, high-power, mobile and safe wireless power for the Internet of Things (IoT) devices. The Point-to-Multipoint (PtMP) RBC system can charge multiple receivers simultaneously similar to WiFi communications. To guarantee the Quality of Charging Service (QoCS) for each receiver and maximize the overall earning in the PtMP RBC service, we specify the Charging Pricing Strategy (CPS) and develop the High Priority Charge (HPC) scheduling algorithm to control the charging order and power allocation. Each receiver is assigned a priority, which is updated dynamically based on its State of Charging (SOC) and specified charging power. The receivers with high priorities are scheduled to be charged in each time slot. We present the pseudo code of the HPC algorithm based on quantifying the receiver's SOC, discharging energy and various relevant parameters. Relying on simulation analysis, we demonstrate that the HPC algorithm can achieve better QoCS and earning than the Round-Robin Charge (RRC) scheduling algorithm. Based on the performance evaluation, we illustrate that the methods to improve the PtMP RBC service are: 1) limiting the receiver number within a reasonable range and 2) prolonging the charging duration as long as possible. In summary, the HPC scheduling algorithm provides a practical strategy to maximize the earning of the PtMP RBC service with each receiver's QoCS guarantee.
△ Less
Submitted 25 September, 2018;
originally announced September 2018.
-
Fair Scheduling in Resonant Beam Charging for IoT Devices
Authors:
Wen Fang,
Qingqing Zhang,
Qingwen Liu,
Jun Wu,
Pengfei Xia
Abstract:
Resonant Beam Charging (RBC) is the Wireless Power Transfer (WPT) technology, which can provide high-power, long-distance, mobile, and safe wireless charging for Internet of Things (IoT) devices. Supporting multiple IoT devices charging simultaneously is a significant feature of the RBC system. To optimize the multi-user charging performance, the transmitting power should be scheduled for charging…
▽ More
Resonant Beam Charging (RBC) is the Wireless Power Transfer (WPT) technology, which can provide high-power, long-distance, mobile, and safe wireless charging for Internet of Things (IoT) devices. Supporting multiple IoT devices charging simultaneously is a significant feature of the RBC system. To optimize the multi-user charging performance, the transmitting power should be scheduled for charging all IoT devices simultaneously. In order to keep all IoT devices working as long as possible for fairness, we propose the First Access First Charge (FAFC) scheduling algorithm. Then, we formulate the scheduling parameters quantitatively for algorithm implementation. Finally, we analyze the performance of FAFC scheduling algorithm considering the impacts of the receiver number, the transmitting power and the charging time. Based on the analysis, we summarize the methods of improving the WPT performance for multiple IoT devices, which include limiting the receiver number, increasing the transmitting power, prolonging the charging time and improving the single-user's charging efficiency. The FAFC scheduling algorithm design and analysis provide a fair WPT solution for the multi-user RBC system.
△ Less
Submitted 25 September, 2018;
originally announced September 2018.
-
Adaptive Resonant Beam Charging for Intelligent Wireless Power Transfer
Authors:
Qingqing Zhang,
Wen Fang,
Mingliang Xiong,
Qingwen Liu,
Jun Wu,
Pengfei Xia
Abstract:
As a long-range high-power wireless power transfer (WPT) technology, resonant beam charging (RBC) can transmit Watt-level power over long distance for the devices in the internet of things (IoT). Due to its open-loop architecture, RBC faces the challenge of providing dynamic current and voltage to optimize battery charging performance. In RBC, battery overcharge may cause energy waste, thermal eff…
▽ More
As a long-range high-power wireless power transfer (WPT) technology, resonant beam charging (RBC) can transmit Watt-level power over long distance for the devices in the internet of things (IoT). Due to its open-loop architecture, RBC faces the challenge of providing dynamic current and voltage to optimize battery charging performance. In RBC, battery overcharge may cause energy waste, thermal effects, and even safety issues. On the other hand, battery undercharge may lead to charging time extension and significant battery capacity reduction. In this paper, we present an adaptive resonant beam charging (ARBC) system for battery charging optimization. Based on RBC, ARBC uses a feedback system to control the supplied power dynamically according to the battery preferred charging values. Moreover, in order to transform the received current and voltage to match the battery preferred charging values, ARBC adopts a direct current to direct current (DC-DC) conversion circuit. Relying on the analytical models for RBC power transmission, we obtain the end-to-end power transfer relationship in the approximate linear closed-form of ARBC. Thus, the battery preferred charging power at the receiver can be mapped to the supplied power at the transmitter for feedback control. Numerical evaluation demonstrates that ARBC can save 61% battery charging energy and 53%-60% supplied energy compared with RBC. Furthermore, ARBC has high energy-saving gain over RBC when the WPT is unefficient. ARBC in WPT is similar to link adaption in wireless communications. Both of them play the important roles in their respective areas.
△ Less
Submitted 25 September, 2018;
originally announced September 2018.
-
Secure and Privacy Preserving Consensus for Second-order Systems Based on Paillier Encryption
Authors:
Wentuo Fang,
Mohsen Zamani,
Zhiyong Chen
Abstract:
This paper aims at secure and privacy preserving consensus algorithms of networked systems. Due to the technical challenges behind decentralized design of such algorithms, the existing results are mainly restricted to a network of systems with simplest first-order dynamics. Like many other control problems, breakthrough of the gap between first-order dynamics and higher-order ones demands for more…
▽ More
This paper aims at secure and privacy preserving consensus algorithms of networked systems. Due to the technical challenges behind decentralized design of such algorithms, the existing results are mainly restricted to a network of systems with simplest first-order dynamics. Like many other control problems, breakthrough of the gap between first-order dynamics and higher-order ones demands for more advanced technical developments. In this paper, we explore a Paillier encryption based average consensus algorithm for a network of systems with second-order dynamics, with randomness added to network weights. The conditions for privacy preserving, especially depending on consensus rate, are thoroughly studied with theoretical analysis and numerical verification.
△ Less
Submitted 10 October, 2018; v1 submitted 2 May, 2018;
originally announced May 2018.
-
Distributed Laser Charging: A Wireless Power Transfer Approach
Authors:
Qingqing Zhang,
Wen Fang,
Qingwen Liu,
Jun Wu,
Pengfei Xia,
Liuqing Yang
Abstract:
Wireless power transfer (WPT) is a promising solution to provide convenient and perpetual energy supplies to electronics. Traditional WPT technologies face the challenge of providing Watt-level power over meter-level distance for Internet of Things (IoT) and mobile devices, such as sensors, controllers, smart-phones, laptops, etc.. Distributed laser charging (DLC), a new WPT alternative, has the p…
▽ More
Wireless power transfer (WPT) is a promising solution to provide convenient and perpetual energy supplies to electronics. Traditional WPT technologies face the challenge of providing Watt-level power over meter-level distance for Internet of Things (IoT) and mobile devices, such as sensors, controllers, smart-phones, laptops, etc.. Distributed laser charging (DLC), a new WPT alternative, has the potential to solve these problems and enable WPT with the similar experience as WiFi communications. In this paper, we present a multi-module DLC system model, in order to illustrate its physical fundamentals and mathematical formula. This analytical modeling enables the evaluation of power conversion or transmission for each individual module, considering the impacts of laser wavelength, transmission attenuation and photovoltaic-cell (PV-cell) temperature. Based on the linear approximation of electricity-to-laser and laser-to-electricity power conversion validated by measurement and simulation, we derive the maximum power transmission efficiency in closed-form. Thus, we demonstrate the variation of the maximum power transmission efficiency depending on the supply power at the transmitter, laser wavelength, transmission distance, and PV-cell temperature. Similar to the maximization of information transmission capacity in wireless information transfer (WIT), the maximization of the power transmission efficiency is equally important in WPT. Therefore, this work not only provides the insight of DLC in theory, but also offers the guideline of DLC system design in practice.
△ Less
Submitted 8 October, 2018; v1 submitted 26 December, 2017;
originally announced January 2018.
