Showing 1–37 of 37 results for author: Liu, N

Ptychographic non-line-of-sight imaging for depth-resolved visualization of hidden objects

Authors: Pengming Song, Qianhao Zhao, Ruihai Wang, Ninghe Liu, Yingqi Qiang, Tianbo Wang, Xincheng Zhang, Yi Zhang, Liangcai Cao, Guoan Zheng

Abstract: Non-line-of-sight (NLOS) imaging enables the visualization of objects hidden from direct view, with applications in surveillance, remote sensing, and light detection and ranging. Here, we introduce a NLOS imaging technique termed ptychographic NLOS (pNLOS), which leverages coded ptychography for depth-resolved imaging of obscured objects. Our approach involves scanning a laser spot on a wall to il… ▽ More Non-line-of-sight (NLOS) imaging enables the visualization of objects hidden from direct view, with applications in surveillance, remote sensing, and light detection and ranging. Here, we introduce a NLOS imaging technique termed ptychographic NLOS (pNLOS), which leverages coded ptychography for depth-resolved imaging of obscured objects. Our approach involves scanning a laser spot on a wall to illuminate the hidden objects in an obscured region. The reflected wavefields from these objects then travel back to the wall, get modulated by the wall's complex-valued profile, and the resulting diffraction patterns are captured by a camera. By modulating the object wavefields, the wall surface serves the role of the coded layer as in coded ptychography. As we scan the laser spot to different positions, the reflected object wavefields on the wall translate accordingly, with the shifts varying for objects at different depths. This translational diversity enables the acquisition of a set of modulated diffraction patterns referred to as a ptychogram. By processing the ptychogram, we recover both the objects at different depths and the modulation profile of the wall surface. Experimental results demonstrate high-resolution, high-fidelity imaging of hidden objects, showcasing the potential of pNLOS for depth-aware vision beyond the direct line of sight. △ Less

Submitted 17 May, 2024; originally announced May 2024.

Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturing

Authors: Ning Liu, Xuxiao Li, Manoj R. Rajanna, Edward W. Reutzel, Brady Sawyer, Prahalada Rao, Jim Lua, Nam Phan, Yue Yu

Abstract: A digital twin (DT), with the components of a physics-based model, a data-driven model, and a machine learning (ML) enabled efficient surrogate, behaves as a virtual twin of the real-world physical process. In terms of Laser Powder Bed Fusion (L-PBF) based additive manufacturing (AM), a DT can predict the current and future states of the melt pool and the resulting defects corresponding to the inp… ▽ More A digital twin (DT), with the components of a physics-based model, a data-driven model, and a machine learning (ML) enabled efficient surrogate, behaves as a virtual twin of the real-world physical process. In terms of Laser Powder Bed Fusion (L-PBF) based additive manufacturing (AM), a DT can predict the current and future states of the melt pool and the resulting defects corresponding to the input laser parameters, evolve itself by assimilating in-situ sensor data, and optimize the laser parameters to mitigate defect formation. In this paper, we present a deep neural operator enabled computational framework of the DT for closed-loop feedback control of the L-PBF process. This is accomplished by building a high-fidelity computational model to accurately represent the melt pool states, an efficient surrogate model to approximate the melt pool solution field, followed by an physics-based procedure to extract information from the computed melt pool simulation that can further be correlated to the defect quantities of interest (e.g., surface roughness). In particular, we leverage the data generated from the high-fidelity physics-based model and train a series of Fourier neural operator (FNO) based ML models to effectively learn the relation between the input laser parameters and the corresponding full temperature field of the melt pool. Subsequently, a set of physics-informed variables such as the melt pool dimensions and the peak temperature can be extracted to compute the resulting defects. An optimization algorithm is then exercised to control laser input and minimize defects. On the other hand, the constructed DT can also evolve with the physical twin via offline finetuning and online material calibration. Finally, a probabilistic framework is adopted for uncertainty quantification. The developed DT is envisioned to guide the AM process and facilitate high-quality manufacturing. △ Less

Submitted 12 May, 2024; originally announced May 2024.

Large Language Model-aided Edge Learning in Distribution System State Estimation

Authors: Renyou Xie, Xin Yin, Chaojie Li, Nian Liu, Bo Zhao, Zhaoyang Dong

Abstract: Distribution system state estimation (DSSE) plays a crucial role in the real-time monitoring, control, and operation of distribution networks. Besides intensive computational requirements, conventional DSSE methods need high-quality measurements to obtain accurate states, whereas missing values often occur due to sensor failures or communication delays. To address these challenging issues, a forec… ▽ More Distribution system state estimation (DSSE) plays a crucial role in the real-time monitoring, control, and operation of distribution networks. Besides intensive computational requirements, conventional DSSE methods need high-quality measurements to obtain accurate states, whereas missing values often occur due to sensor failures or communication delays. To address these challenging issues, a forecast-then-estimate framework of edge learning is proposed for DSSE, leveraging large language models (LLMs) to forecast missing measurements and provide pseudo-measurements. Firstly, natural language-based prompts and measurement sequences are integrated by the proposed LLM to learn patterns from historical data and provide accurate forecasting results. Secondly, a convolutional layer-based neural network model is introduced to improve the robustness of state estimation under missing measurement. Thirdly, to alleviate the overfitting of the deep learning-based DSSE, it is reformulated as a multi-task learning framework containing shared and task-specific layers. The uncertainty weighting algorithm is applied to find the optimal weights to balance different tasks. The numerical simulation on the Simbench case is used to demonstrate the effectiveness of the proposed forecast-then-estimate framework. △ Less

Submitted 11 May, 2024; originally announced May 2024.

Leveraging Anatomical Constraints with Uncertainty for Pneumothorax Segmentation

Authors: Han Yuan, Chuan Hong, Nguyen Tuan Anh Tran, Xinxing Xu, Nan Liu

Abstract: Pneumothorax is a medical emergency caused by abnormal accumulation of air in the pleural space - the potential space between the lungs and chest wall. On 2D chest radiographs, pneumothorax occurs within the thoracic cavity and outside of the mediastinum and we refer to this area as "lung+ space". While deep learning (DL) has increasingly been utilized to segment pneumothorax lesions in chest radi… ▽ More Pneumothorax is a medical emergency caused by abnormal accumulation of air in the pleural space - the potential space between the lungs and chest wall. On 2D chest radiographs, pneumothorax occurs within the thoracic cavity and outside of the mediastinum and we refer to this area as "lung+ space". While deep learning (DL) has increasingly been utilized to segment pneumothorax lesions in chest radiographs, many existing DL models employ an end-to-end approach. These models directly map chest radiographs to clinician-annotated lesion areas, often neglecting the vital domain knowledge that pneumothorax is inherently location-sensitive. We propose a novel approach that incorporates the lung+ space as a constraint during DL model training for pneumothorax segmentation on 2D chest radiographs. To circumvent the need for additional annotations and to prevent potential label leakage on the target task, our method utilizes external datasets and an auxiliary task of lung segmentation. This approach generates a specific constraint of lung+ space for each chest radiograph. Furthermore, we have incorporated a discriminator to eliminate unreliable constraints caused by the domain shift between the auxiliary and target datasets. Our results demonstrated significant improvements, with average performance gains of 4.6%, 3.6%, and 3.3% regarding Intersection over Union (IoU), Dice Similarity Coefficient (DSC), and Hausdorff Distance (HD). Our research underscores the significance of incorporating medical domain knowledge about the location-specific nature of pneumothorax to enhance DL-based lesion segmentation. △ Less

Submitted 26 November, 2023; originally announced November 2023.

Transmission line condition prediction based on semi-supervised learning

Authors: Sizhe Li, Xun Ma, Nan Liu, Yi **

Abstract: Transmission line state assessment and prediction are of great significance for the rational formulation of operation and maintenance strategy and improvement of operation and maintenance level. Aiming at the problem that existing models cannot take into account the robustness and data demand, this paper proposes a state prediction method based on semi-supervised learning. Firstly, for the expande… ▽ More Transmission line state assessment and prediction are of great significance for the rational formulation of operation and maintenance strategy and improvement of operation and maintenance level. Aiming at the problem that existing models cannot take into account the robustness and data demand, this paper proposes a state prediction method based on semi-supervised learning. Firstly, for the expanded feature vector, the regular matrix is used to fill in the missing data, and the sparse coding problem is solved by representation learning. Then, with the help of a small number of labelled samples to initially determine the category centers of line segments in different defective states. Finally, the estimated parameters of the model are corrected using unlabeled samples. Example analysis shows that this method can improve the recognition accuracy and use data more efficiently than the existing models. △ Less

Submitted 6 December, 2023; v1 submitted 30 October, 2023; originally announced October 2023.

Channel Estimation for Reconfigurable Intelligent Surface-Aided Multiuser Communication Systems Exploiting Statistical CSI of Correlated RIS-User Channels

Authors: Haochen Li, Zhiwen Pan, Bin Wang, Nan Liu, Xiaohu You

Abstract: Reconfigurable intelligent surface (RIS) is a promising candidate technology for the upcoming Sixth Generation (6G) communication system for its ability to manipulate the wireless communication environment by controlling the coefficients of reflection elements (REs). However, since the RIS usually consists of a large number of passive REs, the pilot overhead for channel estimation in the RIS-aided… ▽ More Reconfigurable intelligent surface (RIS) is a promising candidate technology for the upcoming Sixth Generation (6G) communication system for its ability to manipulate the wireless communication environment by controlling the coefficients of reflection elements (REs). However, since the RIS usually consists of a large number of passive REs, the pilot overhead for channel estimation in the RIS-aided system is prohibitively high. In this paper, the channel estimation problem for a RIS-aided multi-user multiple-input-single-output (MISO) communication system with clustered users is investigated. First, to describe the correlated feature for RIS-user channels, a beam domain channel model is developed for RIS-user channels. Then, a pilot reuse strategy is put forward to reduce the pilot overhead and decompose the channel estimation problem into several subproblems. Finally, by leveraging the correlated nature of RIS-user channels, an eigenspace projection (EP) algorithm is proposed to solve each subproblem respectively. Simulation results show that the proposed EP channel estimation scheme can achieve accurate channel estimation with lower pilot overhead than existing schemes. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Comments: 10 pages, 11 figures

Statistical CSI Based Beamforming for Reconfigurable Intelligent Surface Aided MISO Systems with Channel Correlation

Authors: Haochen Li, Zhiwen Pan, Bin Wang, Nan Liu, Xiaohu You

Abstract: Reconfigurable intelligent surface (RIS) is a promising candidate technology of the upcoming Sixth Generation (6G) communication system for its ability to provide unprecedented spectral and energy efficiency increment through passive beamforming. However, it is challenging to obtain instantaneous channel state information (I-CSI) for RIS, which obliges us to use statistical channel state informati… ▽ More Reconfigurable intelligent surface (RIS) is a promising candidate technology of the upcoming Sixth Generation (6G) communication system for its ability to provide unprecedented spectral and energy efficiency increment through passive beamforming. However, it is challenging to obtain instantaneous channel state information (I-CSI) for RIS, which obliges us to use statistical channel state information (S-CSI) to achieve passive beamforming. In this paper, RIS-aided multiple-input single-output (MISO) multi-user downlink communication system with correlated channels is investigated. Then, we formulate the problem of joint beamforming design at the AP and RIS to maximize the sum ergodic spectral efficiency (ESE) of all users to improve the network capacity. Since it is too hard to compute sum ESE, an ESE approximation is adopted to reformulate the problem into a more tractable form. Then, we present two joint beamforming algorithms, namely the singular value decomposition-gradient descent (SVD-GD) algorithm and the fractional programming-gradient descent (FP-GD) algorithm. Simulation results show the effectiveness of our proposed algorithms and validate that 2-bits quantizer is enough for RIS phase shifts implementation. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Comments: 10 pages, 9 figures,

Sparsity-regularized coded ptychography for robust and efficient lensless microscopy on a chip

Authors: Ninghe Liu, Qianhao Zhao, Guoan Zheng

Abstract: In ptychographic imaging, the trade-off between the number of acquisitions and the resultant imaging quality presents a complex optimization problem. Increasing the number of acquisitions typically yields reconstructions with higher spatial resolution and finer details. Conversely, a reduction in measurement frequency often compromises the quality of the reconstructed images, manifesting as increa… ▽ More In ptychographic imaging, the trade-off between the number of acquisitions and the resultant imaging quality presents a complex optimization problem. Increasing the number of acquisitions typically yields reconstructions with higher spatial resolution and finer details. Conversely, a reduction in measurement frequency often compromises the quality of the reconstructed images, manifesting as increased noise and coarser details. To address this challenge, we employ sparsity priors to reformulate the ptychographic reconstruction task as a total variation regularized optimization problem. We introduce a new computational framework, termed the ptychographic proximal total-variation (PPTV) solver, designed to integrate into existing ptychography settings without necessitating hardware modifications. Through comprehensive numerical simulations, we validate that PPTV-driven coded ptychography is capable of producing highly accurate reconstructions with a minimal set of eight intensity measurements. Convergence analysis further substantiates the robustness, stability, and computational feasibility of the proposed PPTV algorithm. Experimental results obtained from optical setups unequivocally demonstrate that the PPTV algorithm facilitates high-throughput, high-resolution imaging while significantly reducing the measurement burden. These findings indicate that the PPTV algorithm has the potential to substantially mitigate the resource-intensive requirements traditionally associated with high-quality ptychographic imaging, thereby offering a pathway toward the development of more compact and efficient ptychographic microscopy systems. △ Less

Submitted 24 September, 2023; originally announced September 2023.

Comments: 15 pages, 7 figures

StableVQA: A Deep No-Reference Quality Assessment Model for Video Stability

Authors: Tengchuan Kou, Xiaohong Liu, Wei Sun, Jun Jia, Xiongkuo Min, Guangtao Zhai, Ning Liu

Abstract: Video shakiness is an unpleasant distortion of User Generated Content (UGC) videos, which is usually caused by the unstable hold of cameras. In recent years, many video stabilization algorithms have been proposed, yet no specific and accurate metric enables comprehensively evaluating the stability of videos. Indeed, most existing quality assessment models evaluate video quality as a whole without… ▽ More Video shakiness is an unpleasant distortion of User Generated Content (UGC) videos, which is usually caused by the unstable hold of cameras. In recent years, many video stabilization algorithms have been proposed, yet no specific and accurate metric enables comprehensively evaluating the stability of videos. Indeed, most existing quality assessment models evaluate video quality as a whole without specifically taking the subjective experience of video stability into consideration. Therefore, these models cannot measure the video stability explicitly and precisely when severe shakes are present. In addition, there is no large-scale video database in public that includes various degrees of shaky videos with the corresponding subjective scores available, which hinders the development of Video Quality Assessment for Stability (VQA-S). To this end, we build a new database named StableDB that contains 1,952 diversely-shaky UGC videos, where each video has a Mean Opinion Score (MOS) on the degree of video stability rated by 34 subjects. Moreover, we elaborately design a novel VQA-S model named StableVQA, which consists of three feature extractors to acquire the optical flow, semantic, and blur features respectively, and a regression layer to predict the final stability score. Extensive experiments demonstrate that the StableVQA achieves a higher correlation with subjective opinions than the existing VQA-S models and generic VQA models. The database and codes are available at https://github.com/QMME/StableVQA. △ Less

Submitted 27 October, 2023; v1 submitted 9 August, 2023; originally announced August 2023.

Comments: Accepted by ACM MM'23

Resource Allocation for Cell-free Massive MIMO-enabled URLLC Downlink Systems

Authors: Qihao Peng, Hong Ren, Cunhua Pan, Nan Liu, Maged Elkashlan

Abstract: Ultra-reliable and low-latency communication (URLLC) is a pivotal technique for enabling the wireless control over industrial Internet-of-Things (IIoT) devices. By deploying distributed access points (APs), cell-free massive multiple-input and multiple-output (CF mMIMO) has great potential to provide URLLC services for IIoT devices. In this paper, we investigate CF mMIMO-enabled URLLC in a smart f… ▽ More Ultra-reliable and low-latency communication (URLLC) is a pivotal technique for enabling the wireless control over industrial Internet-of-Things (IIoT) devices. By deploying distributed access points (APs), cell-free massive multiple-input and multiple-output (CF mMIMO) has great potential to provide URLLC services for IIoT devices. In this paper, we investigate CF mMIMO-enabled URLLC in a smart factory. Lower bounds (LBs) of downlink ergodic data rate under finite channel blocklength (FCBL) with imperfect channel state information (CSI) are derived for maximum-ratio transmission (MRT), full-pilot zero-forcing (FZF), and local zero-forcing (LZF) precoding schemes. Meanwhile, the weighted sum rate is maximized by jointly optimizing the pilot power and transmission power based on the derived LBs. Specifically, we first provide the globally optimal solution of the pilot power, and then introduce some approximations to transform the original problems into a series of subproblems, which can be expressed in a geometric programming (GP) form that can be readily solved. Finally, an iterative algorithm is proposed to optimize the power allocation based on various precoding schemes. Simulation results demonstrate that the proposed algorithm is superior to the existing algorithms, and that the quality of URLLC services will benefit by deploying more APs, except for the FZF precoding scheme. △ Less

Submitted 18 February, 2023; originally announced February 2023.

Comments: Accepted by IEEE TVT

The application of Nano-silica gel in sealing well micro-annuli and cement channeling

Authors: Olaytunji Olayiwola, Vu Nguyen, Randy Andres, Ning Liu

Abstract: The possibility for hydrocarbon fluids to migrate through debonded micro-annuli wells is a major concern in the petroleum industry. With effective permeability of 0.1-1.0 mD, the existence of channels in a cement annulus with apertures of 10-300 micrometer constitutes a major threat. Squeeze cement is typically difficult to repair channels-leakage with small apertures; hence, a low-viscosity seale… ▽ More The possibility for hydrocarbon fluids to migrate through debonded micro-annuli wells is a major concern in the petroleum industry. With effective permeability of 0.1-1.0 mD, the existence of channels in a cement annulus with apertures of 10-300 micrometer constitutes a major threat. Squeeze cement is typically difficult to repair channels-leakage with small apertures; hence, a low-viscosity sealer that can be inserted into these channels while producing a long-term resilient seal is sought. A novel application using nano-silica sealants could be the key to seal these channels. In the construction and sealing of hydrocarbon wells, cementing is a critical phase. Cement is prone to cracking during the life cycle of a well because of the changes in downhole conditions. The usage of micro-sized cross-linked nano-silica gel as a sealant material to minimize damaged cement sheaths is investigated in this study. Fluid leakage through channels in the cement was investigated using an experimental system. With a diameter of 0.05 inches, the impact of the cement channel size was explored. The sealing efficiency increased from 86 percent to 95 percent when the nano-silica concentration of the sealing gel increased from 13 percent to 25 percent. This demonstrates that the concentration of nano-silica in the sealing gel affects the gel's ability to seal against fluid flow. This research proposes a new way for improving cement zonal isolation and thereby lowering the impact of cement failure in the oil and gas industry. △ Less

Submitted 19 January, 2023; originally announced January 2023.

Comments: 10 pages

Well Cement Degradation and Wellbore Integrity in Geological CO2 Storages: A Literature Review

Authors: Vu Nguyen, Olatunji Olayiwola, Boyun Guo, Ning Liu

Abstract: Carbon capture and storage (CCS) has emerged as the most effective method to curb the CO2 concentration in the atmosphere. It can store up to 5 billion tons of CO2 per year. To guarantee a safe and economical geological storage, the well cement degradation and wellbore integrity need to be studied thoroughly. This review paper is designed to provide a fundamental background of well cement degradat… ▽ More Carbon capture and storage (CCS) has emerged as the most effective method to curb the CO2 concentration in the atmosphere. It can store up to 5 billion tons of CO2 per year. To guarantee a safe and economical geological storage, the well cement degradation and wellbore integrity need to be studied thoroughly. This review paper is designed to provide a fundamental background of well cement degradation and wellbore integrity in geological CO2 storages to support the researchers in further investigation. The review mainly focuses on mechanical, thermal, chemical property changes and corrosion time for cement in experiments and simulation during geological CO2 storage. However, the debonding interface between casing/cement or cement/formation has not been addressed profoundly. A further investigation should inspect how pressure, temperature, and chemical reaction affect the micro-annuli of casing/cement or cement/formation. Also, a mathe-matical model should be established to predict the corrosion rate in geological CO2 storage. △ Less

Submitted 10 January, 2023; v1 submitted 5 January, 2023; originally announced January 2023.

Comments: 17 pages

Journal ref: Petroleum & Petrochemical Engineering 5 (2021)

Resource Allocation for Uplink Cell-Free Massive MIMO enabled URLLC in a Smart Factory

Authors: Qihao Peng, Hong Ren, Cunhua Pan, Nan Liu, Maged Elkashlan

Abstract: Smart factories need to support the simultaneous communication of multiple industrial Internet-of-Things (IIoT) devices with ultra-reliability and low-latency communication (URLLC). Meanwhile, short packet transmission for IIoT applications incurs performance loss compared to traditional long packet transmission for human-to-human communications. On the other hand, cell-free massive multiple-input… ▽ More Smart factories need to support the simultaneous communication of multiple industrial Internet-of-Things (IIoT) devices with ultra-reliability and low-latency communication (URLLC). Meanwhile, short packet transmission for IIoT applications incurs performance loss compared to traditional long packet transmission for human-to-human communications. On the other hand, cell-free massive multiple-input and multiple-output (CF mMIMO) technology can provide uniform services for all devices by deploying distributed access points (APs). In this paper, we adopt CF mMIMO to support URLLC in a smart factory. Specifically, we first derive the lower bound (LB) on achievable uplink data rate under the finite blocklength (FBL) with imperfect channel state information (CSI) for both maximum-ratio combining (MRC) and full-pilot zero-forcing (FZF) decoders. \textcolor{black}{The derived LB rates based on the MRC case have the same trends as the ergodic rate, while LB rates using the FZF decoder tightly match the ergodic rates}, which means that resource allocation can be performed based on the LB data rate rather the exact ergodic data rate under FBL. The \textcolor{black}{log-function method} and successive convex approximation (SCA) are then used to approximately transform the non-convex weighted sum rate problem into a series of geometric program (GP) problems, and an iterative algorithm is proposed to jointly optimize the pilot and payload power allocation. Simulation results demonstrate that CF mMIMO significantly improves the average weighted sum rate (AWSR) compared to centralized mMIMO. An interesting observation is that increasing the number of devices improves the AWSR for CF mMIMO whilst the AWSR remains relatively constant for centralized mMIMO. △ Less

Submitted 22 November, 2022; originally announced November 2022.

Comments: Accepted by Transactions on Communications

Network-Wide Task Offloading With LEO Satellites: A Computation and Transmission Fusion Approach

Authors: Jiaqi Cao, Shengli Zhang, Qingxia Chen, Houtian Wang, Mingzhe Wang, Nai** Liu

Abstract: Computing tasks are ubiquitous in space missions. Conventionally, these tasks are offloaded to ground servers for computation, where the transmission of raw data on satellite-to-ground links severely constrains the performance. To overcome this limitation, recent works offload tasks to visible low-earth-orbit (LEO) satellites. However, this offloading scheme is difficult to achieve good performanc… ▽ More Computing tasks are ubiquitous in space missions. Conventionally, these tasks are offloaded to ground servers for computation, where the transmission of raw data on satellite-to-ground links severely constrains the performance. To overcome this limitation, recent works offload tasks to visible low-earth-orbit (LEO) satellites. However, this offloading scheme is difficult to achieve good performance in actual networks with uneven loads because visible satellites over hotspots tend to be overloaded. Therefore, it is urgent to extend the offloading targets to the entire network. To address the network-wide offloading problem, we propose a metagraph-based computation and transmission fusion offloading scheme for multi-tier networks. Specifically, virtual edges, between the original network and its duplicate, are generated to fuse computation and transmission in single-tier networks. Then, a metagraph is employed to integrate the fusion in multi-tier networks. After assigning appropriate edge weights to the metagraph, the network-wide offloading problem can be solved by searching the shortest path. In addition, we apply the proposed scheme to solve the spatial computation offloading problem in a real multi-tier network. The superiority of the proposed scheme over two benchmark schemes are proved theoretically and empirically. Simulation results show that the proposed scheme decreases the weighted average delay by up to 87.51% and 18.70% compared with the ground offloading scheme and the visible offloading scheme, respectively. △ Less

Submitted 16 November, 2022; originally announced November 2022.

Computing-Aware Routing for LEO Satellite Networks: A Transmission and Computation Integration Approach

Authors: Jiaqi Cao, Shengli Zhang, Qingxia Chen, Houtian Wang, Mingzhe Wang, Nai** Liu

Abstract: The advancements of remote sensing (RS) pose increasingly high demands on computation and transmission resources. Conventional ground-offloading techniques, which transmit large amounts of raw data to the ground, suffer from poor satellite-to-ground link quality. In addition, existing satellite-offloading techniques, which offload computational tasks to low earth orbit (LEO) satellites located wit… ▽ More The advancements of remote sensing (RS) pose increasingly high demands on computation and transmission resources. Conventional ground-offloading techniques, which transmit large amounts of raw data to the ground, suffer from poor satellite-to-ground link quality. In addition, existing satellite-offloading techniques, which offload computational tasks to low earth orbit (LEO) satellites located within the visible range of RS satellites for processing, cannot leverage the full computing capability of the network because the computational resources of visible LEO satellites are limited. This situation is even worse in hotspot areas. In this paper, for efficient offloading via LEO satellite networks, we propose a novel computing-aware routing scheme. It fuses the transmission and computation processes and optimizes the overall delay of both. Specifically, we first model the LEO satellite network as a snapshot-free dynamic network, whose nodes and edges both have time-varying weights. By utilizing time-varying network parameters to characterize the network dynamics, the proposed method establishes a continuous-time model which scales well on large networks and improves the accuracy. Next, we propose a computing-aware routing scheme following the model. It processes tasks during the routing process instead of offloading raw data to ground stations, reducing the overall delay and avoiding network congestion consequently. Finally, we formulate the computing-aware routing problem in the dynamic network as a combination of multiple dynamic single source shortest path (DSSSP) problems and propose a genetic algorithm (GA) based method to approximate the results in a reasonable time. Simulation results show that the computing-aware routing scheme decreases the overall delay by up to 78.31% compared with offloading raw data to the ground to process. △ Less

Submitted 16 November, 2022; originally announced November 2022.

Adaptive Task Offloading for Space Missions: A State-Graph-Based Approach

Authors: Jiaqi Cao, Shengli Zhang, Mingzhe Wang, Qingxia Chen, Houtian Wang, Nai** Liu

Abstract: Advances in space exploration have led to an explosion of tasks. Conventionally, these tasks are offloaded to ground servers for enhanced computing capability, or to adjacent low-earth-orbit satellites for reduced transmission delay. However, the overall delay is determined by both computation and transmission costs. The existing offloading schemes, while being highly-optimized for either costs, c… ▽ More Advances in space exploration have led to an explosion of tasks. Conventionally, these tasks are offloaded to ground servers for enhanced computing capability, or to adjacent low-earth-orbit satellites for reduced transmission delay. However, the overall delay is determined by both computation and transmission costs. The existing offloading schemes, while being highly-optimized for either costs, can be abysmal for the overall performance. The computation-transmission cost dilemma is yet to be solved. In this paper, we propose an adaptive offloading scheme to reduce the overall delay. The core idea is to jointly model and optimize the transmission-computation process over the entire network. Specifically, to represent the computation state migrations, we generalize graph nodes with multiple states. In this way, the joint optimization problem is transformed into a shortest path problem over the state graph. We further provide an extended Dijkstra's algorithm for efficient path finding. Simulation results show that the proposed scheme outperforms the ground and one-hop offloading schemes by up to 37.56% and 39.35% respectively on SpaceCube v2.0. △ Less

Submitted 16 November, 2022; originally announced November 2022.

A Framework for Mutual Information-based MIMO Integrated Sensing and Communication Beamforming Design

Authors: ** Li, Gui Zhou, Tantao Gong, Nan Liu

Abstract: Integrated sensing and communication (ISAC) unifies sensing and communication, and improves the efficiency of the spectrum, energy, and hardware. In this work, we investigate the ISAC beamforming design to maximize the mutual information between the target response matrix of a point radar target and the echo signals, while ensuring the data rate requirements of the communication users. In order to… ▽ More Integrated sensing and communication (ISAC) unifies sensing and communication, and improves the efficiency of the spectrum, energy, and hardware. In this work, we investigate the ISAC beamforming design to maximize the mutual information between the target response matrix of a point radar target and the echo signals, while ensuring the data rate requirements of the communication users. In order to study the impact of the echo interference caused by communication users on sensing performance, we study two scenarios: a single communication user and multiple communication users. For the case of a single communication user, we consider three types of echo interference, no interference, a point interference, and an extended interference. For the case of multiple communication users, the interference is also an extended one, and furthermore, each user's communication rate requirement needs to be satisfied. To find the optimal beamforming design in these problems, we provide a closed-form solution with low complexiy, a semidefinite relaxation (SDR) method, a low-complexity algorithm based on the Majorization-Minimization (MM) method and the successive convex approximation (SCA) method, and an algorithm based on MM method and SCA method, respectively. Numerical results demonstrate that, compared to the ISAC beamforming schemes based on the Cramér-Rao bound (CRB) metric and the beampattern metric, the proposed mutual information metric can bring better beampattern and root mean square error (RMSE) of angle estimation. Furthermore, our proposed schemes designed based on the mutual information metric can suppress the echo interference from the communication users effectively. △ Less

Submitted 11 January, 2023; v1 submitted 14 November, 2022; originally announced November 2022.

Comments: 33 pages, 8 figures, will be submitted to IEEE journal

Integrated Sensing and Communication Beamforming Design Based on Mutual Information

Authors: ** Li, Nan Liu

Abstract: Integrated sensing and communication (ISAC) unifies radar sensing and communication, and improves the efficiency of the spectrum, energy and hardware. In this paper, we investigate the ISAC beamforming design in a downlink system with a communication user and a point radar target to be perceived. The design criterion for radar sensing is the mutual information between the target response matrix an… ▽ More Integrated sensing and communication (ISAC) unifies radar sensing and communication, and improves the efficiency of the spectrum, energy and hardware. In this paper, we investigate the ISAC beamforming design in a downlink system with a communication user and a point radar target to be perceived. The design criterion for radar sensing is the mutual information between the target response matrix and the echo signals, while the single user transmission rate is used as the performance metric of the communication. Two scenarios without and with interference from the communication user are investigated. A closed-form solution with low complexity and a solution based on the semidefinite relaxation (SDR) method are provided to solve these two problems, respectively. Numerical results demonstrate that, compared to the results obtained by SDR based on the CVX toolbox, the closed-form solution is tight in the feasible region. In addition, we show that the SDR method obtains an optimal solution. △ Less

Submitted 8 November, 2022; originally announced November 2022.

TITAN: Bringing The Deep Image Prior to Implicit Representations

Authors: Lorenzo Luzi, Daniel LeJeune, Ali Siahkoohi, Sina Alemohammad, Vishwanath Saragadam, Hossein Babaei, Naiming Liu, Zichao Wang, Richard G. Baraniuk

Abstract: We study the interpolation capabilities of implicit neural representations (INRs) of images. In principle, INRs promise a number of advantages, such as continuous derivatives and arbitrary sampling, being freed from the restrictions of a raster grid. However, empirically, INRs have been observed to poorly interpolate between the pixels of the fit image; in other words, they do not inherently posse… ▽ More We study the interpolation capabilities of implicit neural representations (INRs) of images. In principle, INRs promise a number of advantages, such as continuous derivatives and arbitrary sampling, being freed from the restrictions of a raster grid. However, empirically, INRs have been observed to poorly interpolate between the pixels of the fit image; in other words, they do not inherently possess a suitable prior for natural images. In this paper, we propose to address and improve INRs' interpolation capabilities by explicitly integrating image prior information into the INR architecture via deep decoder, a specific implementation of the deep image prior (DIP). Our method, which we call TITAN, leverages a residual connection from the input which enables integrating the principles of the grid-based DIP into the grid-free INR. Through super-resolution and computed tomography experiments, we demonstrate that our method significantly improves upon classic INRs, thanks to the induced natural image bias. We also find that by constraining the weights to be sparse, image quality and sharpness are enhanced, increasing the Lipschitz constant. △ Less

Submitted 1 May, 2024; v1 submitted 31 October, 2022; originally announced November 2022.

Comments: 6 pages, 4 figures

A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences

Authors: Yu Fan, Zicheng Zhang, Wei Sun, Xiongkuo Min, Wei Lu, Tao Wang, Ning Liu, Guangtao Zhai

Abstract: Point cloud is one of the most widely used digital formats of 3D models, the visual quality of which is quite sensitive to distortions such as downsampling, noise, and compression. To tackle the challenge of point cloud quality assessment (PCQA) in scenarios where reference is not available, we propose a no-reference quality assessment metric for colored point cloud based on captured video sequenc… ▽ More Point cloud is one of the most widely used digital formats of 3D models, the visual quality of which is quite sensitive to distortions such as downsampling, noise, and compression. To tackle the challenge of point cloud quality assessment (PCQA) in scenarios where reference is not available, we propose a no-reference quality assessment metric for colored point cloud based on captured video sequences. Specifically, three video sequences are obtained by rotating the camera around the point cloud through three specific orbits. The video sequences not only contain the static views but also include the multi-frame temporal information, which greatly helps understand the human perception of the point clouds. Then we modify the ResNet3D as the feature extraction model to learn the correlation between the capture videos and corresponding subjective quality scores. The experimental results show that our method outperforms most of the state-of-the-art full-reference and no-reference PCQA metrics, which validates the effectiveness of the proposed method. △ Less

Submitted 20 September, 2022; v1 submitted 9 June, 2022; originally announced June 2022.

Comments: Accepted to IEEE 24th International Workshop on Multimedia Signal Processing, 2022

A Survey on Hyperspectral Image Restoration: From the View of Low-Rank Tensor Approximation

Authors: Na Liu, Wei Li, Yinjian Wang, Rao Tao, Qian Du, Jocelyn Chanussot

Abstract: The ability of capturing fine spectral discriminative information enables hyperspectral images (HSIs) to observe, detect and identify objects with subtle spectral discrepancy. However, the captured HSIs may not represent true distribution of ground objects and the received reflectance at imaging instruments may be degraded, owing to environmental disturbances, atmospheric effects and sensors' hard… ▽ More The ability of capturing fine spectral discriminative information enables hyperspectral images (HSIs) to observe, detect and identify objects with subtle spectral discrepancy. However, the captured HSIs may not represent true distribution of ground objects and the received reflectance at imaging instruments may be degraded, owing to environmental disturbances, atmospheric effects and sensors' hardware limitations. These degradations include but are not limited to: complex noise (i.e., Gaussian noise, impulse noise, sparse stripes, and their mixtures), heavy stripes, deadlines, cloud and shadow occlusion, blurring and spatial-resolution degradation and spectral absorption, etc. These degradations dramatically reduce the quality and usefulness of HSIs. Low-rank tensor approximation (LRTA) is such an emerging technique, having gained much attention in HSI restoration community, with ever-growing theoretical foundation and pivotal technological innovation. Compared to low-rank matrix approximation (LRMA), LRTA is capable of characterizing more complex intrinsic structure of high-order data and owns more efficient learning abilities, being established to address convex and non-convex inverse optimization problems induced by HSI restoration. This survey mainly attempts to present a sophisticated, cutting-edge, and comprehensive technical survey of LRTA toward HSI restoration, specifically focusing on the following six topics: Denoising, Destri**, Inpainting, Deblurring, Super--resolution and Fusion. The theoretical development and variants of LRTA techniques are also elaborated. For each topic, the state-of-the-art restoration methods are compared by assessing their performance both quantitatively and visually. Open issues and challenges are also presented, including model formulation, algorithm design, prior exploration and application concerning the interpretation requirements. △ Less

Submitted 18 May, 2022; originally announced May 2022.

Comments: Under review in Science China Information Siences

Low-Interception Waveform: To Prevent the Recognition of Spectrum Waveform Modulation via Adversarial Examples

Authors: Haidong Xie, Jia Tan, Xiaoying Zhang, Nan Ji, Haihua Liao, Zuguo Yu, Xueshuang Xiang, Nai** Liu

Abstract: Deep learning is applied to many complex tasks in the field of wireless communication, such as modulation recognition of spectrum waveforms, because of its convenience and efficiency. This leads to the problem of a malicious third party using a deep learning model to easily recognize the modulation format of the transmitted waveform. Some existing works address this problem directly using the conc… ▽ More Deep learning is applied to many complex tasks in the field of wireless communication, such as modulation recognition of spectrum waveforms, because of its convenience and efficiency. This leads to the problem of a malicious third party using a deep learning model to easily recognize the modulation format of the transmitted waveform. Some existing works address this problem directly using the concept of adversarial examples in the image domain without fully considering the characteristics of the waveform transmission in the physical world. Therefore, we propose a low-intercept waveform~(LIW) generation method that can reduce the probability of the modulation being recognized by a third party without affecting the reliable communication of the friendly party. Our LIW exhibits significant low-interception performance even in the physical hardware experiment, decreasing the accuracy of the state of the art model to approximately $15\%$ with small perturbations. △ Less

Submitted 20 January, 2022; originally announced January 2022.

Comments: 4 pages, 4 figures, published in 2021 34th General Assembly and Scientific Symposium of the International Union of Radio Science, URSI GASS 2021

Journal ref: URSI GASS, 2021, pp. 1-4

Adversarial Jamming for a More Effective Constellation Attack

Authors: Haidong Xie, Yizhou Xu, Yuanqing Chen, Nan Ji, Shuai Yuan, Nai** Liu, Xueshuang Xiang

Abstract: The common jamming mode in wireless communication is band barrage jamming, which is controllable and difficult to resist. Although this method is simple to implement, it is obviously not the best jamming waveform. Therefore, based on the idea of adversarial examples, we propose the adversarial jamming waveform, which can independently optimize and find the best jamming waveform. We attack QAM with… ▽ More The common jamming mode in wireless communication is band barrage jamming, which is controllable and difficult to resist. Although this method is simple to implement, it is obviously not the best jamming waveform. Therefore, based on the idea of adversarial examples, we propose the adversarial jamming waveform, which can independently optimize and find the best jamming waveform. We attack QAM with adversarial jamming and find that the optimal jamming waveform is equivalent to the amplitude and phase between the nearest constellation points. Furthermore, by verifying the jamming performance on a hardware platform, it is shown that our method significantly improves the bit error rate compared to other methods. △ Less

Submitted 20 January, 2022; originally announced January 2022.

Comments: 3 pages, 2 figures, published in The 13th International Symposium on Antennas, Propagation and EM Theory (ISAPE 2021)

A Computational Efficient Maximum Likelihood Direct Position Determination Approach for Multiple Emitters Using Angle and Doppler Measurements

Authors: Ziqiang Wang, Yimao Sun, Qun Wan, Lei Xie, Ning Liu

Abstract: Emitter localization is widely applied in the military and civilian _elds. In this paper, we tackle the problem of position estimation for multiple stationary emitters using Doppler frequency shifts and angles by moving receivers. The computational load for the exhaustive maximum likelihood (ML) direct position determination (DPD) search is insu_erable. Based on the Pincus' theorem and importance… ▽ More Emitter localization is widely applied in the military and civilian _elds. In this paper, we tackle the problem of position estimation for multiple stationary emitters using Doppler frequency shifts and angles by moving receivers. The computational load for the exhaustive maximum likelihood (ML) direct position determination (DPD) search is insu_erable. Based on the Pincus' theorem and importance sampling (IS) concept, we propose a novel non-iterative ML DPD method. The proposed method transforms the original multidimensional grid search into random variables generation with multiple low-dimensional pseudo-probability density functions (PDF), and the circular mean is used for superior position estimation performance. The computational complexity of the proposed method is modest, and the o_-grid problem that most existing DPD techniques face is signi_cantly alleviated. Moreover, it can be implemented in parallel separately. Simulation results demonstrate that the proposed ML DPD estimator can achieve better estimation accuracy than state-of-the-art DPD techniques. With a reasonable parameter choice, the estimation performance of the proposed technique is very close to the Cram_er-Rao lower bound (CRLB), even in the adverse conditions of low signal-to-noise ratios (SNR) levels. △ Less

Submitted 3 December, 2021; originally announced December 2021.

Comments: 23 pages, 7 figures, 38 references

Metasurface-Enabled On-Chip Multiplexed Diffractive Neural Networks in the Visible

Authors: Xuhao Luo, Yueqiang Hu, Xin Li, Xiangnian Ou, Jiajie Lai, Na Liu, Huigao Duan

Abstract: Replacing electrons with photons is a compelling route towards light-speed, highly parallel, and low-power artificial intelligence computing. Recently, all-optical diffractive neural deep neural networks have been demonstrated. However, the existing architectures often comprise bulky components and, most critically, they cannot mimic the human brain for multitasking. Here, we demonstrate a multi-s… ▽ More Replacing electrons with photons is a compelling route towards light-speed, highly parallel, and low-power artificial intelligence computing. Recently, all-optical diffractive neural deep neural networks have been demonstrated. However, the existing architectures often comprise bulky components and, most critically, they cannot mimic the human brain for multitasking. Here, we demonstrate a multi-skilled diffractive neural network based on a metasurface device, which can perform on-chip multi-channel sensing and multitasking at the speed of light in the visible. The metasurface is integrated with a complementary metal oxide semiconductor imaging sensor. Polarization multiplexing scheme of the subwavelength nanostructures are applied to construct a multi-channel classifier framework for simultaneous recognition of digital and fashionable items. The areal density of the artificial neurons can reach up to 6.25x106/mm2 multiplied by the number of channels. Our platform provides an integrated solution with all-optical on-chip sensing and computing for applications in machine vision, autonomous driving, and precision medicine. △ Less

Submitted 13 July, 2021; originally announced July 2021.

RadioNet: Transformer based Radio Map Prediction Model For Dense Urban Environments

Authors: Yu Tian, Shuai Yuan, Weisheng Chen, Nai** Liu

Abstract: Radio Map Prediction (RMP), aiming at estimating coverage of radio wave, has been widely recognized as an enabling technology for improving radio spectrum efficiency. However, fast and reliable radio map prediction can be very challenging due to the complicated interaction between radio waves and the environment. In this paper, a novel Transformer based deep learning model termed as RadioNet is pr… ▽ More Radio Map Prediction (RMP), aiming at estimating coverage of radio wave, has been widely recognized as an enabling technology for improving radio spectrum efficiency. However, fast and reliable radio map prediction can be very challenging due to the complicated interaction between radio waves and the environment. In this paper, a novel Transformer based deep learning model termed as RadioNet is proposed for radio map prediction in urban scenarios. In addition, a novel Grid Embedding technique is proposed to substitute the original Position Embedding in Transformer to better anchor the relative position of the radiation source, destination and environment. The effectiveness of proposed method is verified on an urban radio wave propagation dataset. Compared with the SOTA model on RMP task, RadioNet reduces the validation loss by 27.3\%, improves the prediction reliability from 90.9\% to 98.9\%. The prediction speed is increased by 4 orders of magnitude, when compared with ray-tracing based method. We believe that the proposed method will be beneficial to high-efficiency wireless communication, real-time radio visualization, and even high-speed image rendering. △ Less

Submitted 15 May, 2021; originally announced May 2021.

Mean Field MARL Based Bandwidth Negotiation Method for Massive Devices Spectrum Sharing

Authors: Tianhao Li, Yu Tian, Shuai Yuan, Nai** Liu

Abstract: In this paper, a novel bandwidth negotiation mechanism is proposed for massive devices wireless spectrum sharing, in which individual device locally negotiates bandwidth usage with neighbor devices and globally optimal spectrum utilization is achieved through distributed decision-making. Since only sparse feedback is needed, the proposed mechanism can greatly reduce the signaling overhead. In orde… ▽ More In this paper, a novel bandwidth negotiation mechanism is proposed for massive devices wireless spectrum sharing, in which individual device locally negotiates bandwidth usage with neighbor devices and globally optimal spectrum utilization is achieved through distributed decision-making. Since only sparse feedback is needed, the proposed mechanism can greatly reduce the signaling overhead. In order to solve the distributed optimization problem when massive devices coexist, mean field multi-agent reinforcement learning (MF-MARL) based bandwidth decision algorithm is proposed, which allow device make globally optimal decision leveraging only neighborhood observation. In simulation, distributed bandwidth negotiation between 1000 devices is demonstrated and the spectrum utilization rate is above 95%. The proposed method is beneficial to reduce spectrum conflicts, increase spectrum utilization for massive devices spectrum sharing. △ Less

Submitted 30 April, 2021; originally announced April 2021.

Noise Attention based Spectrum Anomaly Detection Method for Unauthorized Bands

Authors: **g Xu, Yu Tian, Shuai Yuan, Nai** Liu

Abstract: Spectrum anomaly detection is of great importance in wireless communication to secure safety and improve spectrum efficiency. However, spectrum anomaly detection faces many difficulties, especially in unauthorized frequency bands. For example, the composition of unauthorized frequency bands is very complex and the abnormal usage patterns are unknown in prior. In this paper, a noise attention metho… ▽ More Spectrum anomaly detection is of great importance in wireless communication to secure safety and improve spectrum efficiency. However, spectrum anomaly detection faces many difficulties, especially in unauthorized frequency bands. For example, the composition of unauthorized frequency bands is very complex and the abnormal usage patterns are unknown in prior. In this paper, a noise attention method is proposed for unsupervised spectrum anomaly detection in unauthorized bands. First of all, we theoretically prove that the anomalies in unauthorized bands will raise the noise floor of spectrogram after VAE reconstruction. Then, we introduce a novel anomaly metric named as noise attention score to more effectively capture spectrum anomaly. The effectiveness of the proposed method is experimentally verified in 2.4 GHz ISM band. Leveraging the noise attention score, the AUC metric of anomaly detection is increased by 0.193. The proposed method is beneficial to reliably detecting abnormal spectrum while kee** low false alarm rate. △ Less

Submitted 17 April, 2021; originally announced April 2021.

Comments: 6 pages, 4 figures

Chronological age estimation of lateral cephalometric radiographs with deep learning

Authors: Ningtao Liu

Abstract: The traditional manual age estimation method is crucial labor based on many kinds of the X-Ray image. Some current studies have shown that lateral cephalometric(LC) images can be used to estimate age. However, these methods are based on manually measuring some image features and making age estimates based on experience or scoring. Therefore, these methods are time-consuming and labor-intensive, an… ▽ More The traditional manual age estimation method is crucial labor based on many kinds of the X-Ray image. Some current studies have shown that lateral cephalometric(LC) images can be used to estimate age. However, these methods are based on manually measuring some image features and making age estimates based on experience or scoring. Therefore, these methods are time-consuming and labor-intensive, and the effect will be affected by subjective opinions. In this work, we propose a saliency map-enhanced age estimation method, which can automatically perform age estimation based on LC images. Meanwhile, it can also show the importance of each region in the image for age estimation, which undoubtedly increases the method's Interpretability. Our method was tested on 3014 LC images from 4 to 40 years old. The MEA of the experimental result is 1.250, which is less than the result of the state-of-the-art benchmark because it performs significantly better in the age group with fewer data. Besides, our model is trained in each area with a high contribution to age estimation in LC images, so the effect of these different areas on the age estimation task was verified. Consequently, we conclude that the proposed saliency map enhancements chronological age estimation method of lateral cephalometric radiographs can work well in chronological age estimation task, especially when the amount of data is small. Besides, compared with traditional deep learning, our method is also interpretable. △ Less

Submitted 6 December, 2021; v1 submitted 27 January, 2021; originally announced January 2021.

Wearing a MASK: Compressed Representations of Variable-Length Sequences Using Recurrent Neural Tangent Kernels

Authors: Sina Alemohammad, Hossein Babaei, Randall Balestriero, Matt Y. Cheung, Ahmed Imtiaz Humayun, Daniel LeJeune, Naiming Liu, Lorenzo Luzi, Jasper Tan, Zichao Wang, Richard G. Baraniuk

Abstract: High dimensionality poses many challenges to the use of data, from visualization and interpretation, to prediction and storage for historical preservation. Techniques abound to reduce the dimensionality of fixed-length sequences, yet these methods rarely generalize to variable-length sequences. To address this gap, we extend existing methods that rely on the use of kernels to variable-length seque… ▽ More High dimensionality poses many challenges to the use of data, from visualization and interpretation, to prediction and storage for historical preservation. Techniques abound to reduce the dimensionality of fixed-length sequences, yet these methods rarely generalize to variable-length sequences. To address this gap, we extend existing methods that rely on the use of kernels to variable-length sequences via use of the Recurrent Neural Tangent Kernel (RNTK). Since a deep neural network with ReLu activation is a Max-Affine Spline Operator (MASO), we dub our approach Max-Affine Spline Kernel (MASK). We demonstrate how MASK can be used to extend principal components analysis (PCA) and t-distributed stochastic neighbor embedding (t-SNE) and apply these new algorithms to separate synthetic time series data sampled from second-order differential equations. △ Less

Submitted 17 April, 2021; v1 submitted 26 October, 2020; originally announced October 2020.

Deep Compressed Pneumonia Detection for Low-Power Embedded Devices

Authors: Hongjia Li, Sheng Lin, Ning Liu, Caiwen Ding, Yanzhi Wang

Abstract: Deep neural networks (DNNs) have been expanded into medical fields and triggered the revolution of some medical applications by extracting complex features and achieving high accuracy and performance, etc. On the contrast, the large-scale network brings high requirements of both memory storage and computation resource, especially for portable medical devices and other embedded systems. In this wor… ▽ More Deep neural networks (DNNs) have been expanded into medical fields and triggered the revolution of some medical applications by extracting complex features and achieving high accuracy and performance, etc. On the contrast, the large-scale network brings high requirements of both memory storage and computation resource, especially for portable medical devices and other embedded systems. In this work, we first train a DNN for pneumonia detection using the dataset provided by RSNA Pneumonia Detection Challenge. To overcome hardware limitation for implementing large-scale networks, we develop a systematic structured weight pruning method with filter sparsity, column sparsity and combined sparsity. Experiments show that we can achieve up to 36x compression ratio compared to the original model with 106 layers, while maintaining no accuracy degradation. We evaluate the proposed methods on an embedded low-power device, Jetson TX2, and achieve low power usage and high energy efficiency. △ Less

Submitted 4 November, 2019; originally announced November 2019.

A photonic-assisted method based on the MDA technique for the frequency estimation precision improvement

Authors: Guangyu Gao, Nai** Liu

Abstract: A novel photonics-assisted method based on presampling and MDA technique is proposed for significantly improving the frequency estimation precision without introducing other complex algorithms. This method is also compatible with existing FFT-based high-precision estimation algorithms A novel photonics-assisted method based on presampling and MDA technique is proposed for significantly improving the frequency estimation precision without introducing other complex algorithms. This method is also compatible with existing FFT-based high-precision estimation algorithms △ Less

Submitted 31 July, 2019; originally announced August 2019.

Comments: 3 pages,5 figs,conference paper

A Stochastic-Computing based Deep Learning Framework using Adiabatic Quantum-Flux-Parametron SuperconductingTechnology

Authors: Ruizhe Cai, Ao Ren, Olivia Chen, Ning Liu, Caiwen Ding, Xuehai Qian, Jie Han, Wenhui Luo, Nobuyuki Yoshikawa, Yanzhi Wang

Abstract: The Adiabatic Quantum-Flux-Parametron (AQFP) superconducting technology has been recently developed, which achieves the highest energy efficiency among superconducting logic families, potentially huge gain compared with state-of-the-art CMOS. In 2016, the successful fabrication and testing of AQFP-based circuits with the scale of 83,000 JJs have demonstrated the scalability and potential of implem… ▽ More The Adiabatic Quantum-Flux-Parametron (AQFP) superconducting technology has been recently developed, which achieves the highest energy efficiency among superconducting logic families, potentially huge gain compared with state-of-the-art CMOS. In 2016, the successful fabrication and testing of AQFP-based circuits with the scale of 83,000 JJs have demonstrated the scalability and potential of implementing large-scale systems using AQFP. As a result, it will be promising for AQFP in high-performance computing and deep space applications, with Deep Neural Network (DNN) inference acceleration as an important example. Besides ultra-high energy efficiency, AQFP exhibits two unique characteristics: the deep pipelining nature since each AQFP logic gate is connected with an AC clock signal, which increases the difficulty to avoid RAW hazards; the second is the unique opportunity of true random number generation (RNG) using a single AQFP buffer, far more efficient than RNG in CMOS. We point out that these two characteristics make AQFP especially compatible with the \emph{stochastic computing} (SC) technique, which uses a time-independent bit sequence for value representation, and is compatible with the deep pipelining nature. Further, the application of SC has been investigated in DNNs in prior work, and the suitability has been illustrated as SC is more compatible with approximate computations. This work is the first to develop an SC-based DNN acceleration framework using AQFP technology. △ Less

Submitted 21 July, 2019; originally announced July 2019.

An Algorithm for Transmitting VR Video Based on Adaptive Modulation

Authors: Jie Feng, Yongpeng Wu, Guangtao Zhai, Ning Liu, Wenjun Zhang

Abstract: Virtual reality (VR) is making waves around the world recently. However, traditional video streaming is not suitable for VR video because of the huge size and view switch requirements of VR videos. Since the view of each user is limited, it is unnecessary to send the whole 360-degree scene at high quality which can be a heavy burden for the transmission system. Assuming filed-of-view (FoV) of each… ▽ More Virtual reality (VR) is making waves around the world recently. However, traditional video streaming is not suitable for VR video because of the huge size and view switch requirements of VR videos. Since the view of each user is limited, it is unnecessary to send the whole 360-degree scene at high quality which can be a heavy burden for the transmission system. Assuming filed-of-view (FoV) of each user can be predicted with high probability, we can divide the video screen into partitions and send those partitions which will appear in FoV at high quality. Hence, we propose an novel strategy for VR video streaming. First, we define a quality-of-experience metric to measure the viewing experience of users and define a channel model to reflect the fluctuation of the wireless channel. Next, we formulate the optimization problem and find its feasible solution by convex optimization. In order to improve bandwidth efficiency, we also add adaptive modulation to this part. Finally, we compare our algorithm with other VR streaming algorithm in the simulation. It turns out that our algorithm outperforms other algorithms. △ Less

Submitted 26 June, 2019; originally announced June 2019.

Comments: This paper contains 6 pages with 6 figures and has been accepted by 2019 IEEE/CIC International Conference on Communications in China (ICCC)

A code-free optical undersampling technique for broadband microwave spectrum measurement

Authors: Guangyu Gao, Xueshuang Xiang, Qijun Liang, Nai** Liu

Abstract: A novel broadband microwave (MW) spectrum measurement (BMSM) scheme based on code-free optical undersampling and homodyne detection is proposed. The fully analog generation of optical pulses with a far-less-than-Nyquist rate is only through modulating cascaded electrooptical modulators by a single RF tone instead of any high-speed coding sequence modulation. Homodyne detection will reduce the anal… ▽ More A novel broadband microwave (MW) spectrum measurement (BMSM) scheme based on code-free optical undersampling and homodyne detection is proposed. The fully analog generation of optical pulses with a far-less-than-Nyquist rate is only through modulating cascaded electrooptical modulators by a single RF tone instead of any high-speed coding sequence modulation. Homodyne detection will reduce the analysis bandwidth of BMSM and enhance the detection performance of weak signal. A multi-band signal with 20 GHz spectral range and SNR = 61 dB is used to investigate the BMSM performance of this scheme, and the results show good performance for BMSM. The potentials for further optimization in practice are also discussed. △ Less

Submitted 31 July, 2019; v1 submitted 29 April, 2018; originally announced May 2018.

Comments: 3 pages and 7 figures

Tuner control system of spoke012 SRF cavity for C-ADS injector I at IHEP

Authors: Na Liu, Yi Sun, Guang-Wei Wang, Zheng-Hui Mi, Hai-Ying Lin, Qun-Yao Wang, Rong Liu, Xin-Peng Ma

Abstract: A new tuner control system of spoke superconducting radio frequency (SRF) cavity has been developed and applied to cryomodule I (CM1) of C-ADS injector I at IHEP. We have successfully implemented the tuner controllerfor the first time and achieved a cavity tuning phase error of 0.7degrees (about 4 Hz peak to peak) in the presence of electromechanical coupled resonance. This paper will present the… ▽ More A new tuner control system of spoke superconducting radio frequency (SRF) cavity has been developed and applied to cryomodule I (CM1) of C-ADS injector I at IHEP. We have successfully implemented the tuner controllerfor the first time and achieved a cavity tuning phase error of 0.7degrees (about 4 Hz peak to peak) in the presence of electromechanical coupled resonance. This paper will present the preliminary experimental results based on the new tuner controller under proton beam commissioning. △ Less

Submitted 1 June, 2016; v1 submitted 3 February, 2016; originally announced February 2016.

Towards a Reliable Framework of Uncertainty-Based Group Decision Support System

Authors: Junyi Chai, James N. K. Liu

Abstract: This study proposes a framework of Uncertainty-based Group Decision Support System (UGDSS). It provides a platform for multiple criteria decision analysis in six aspects including (1) decision environment, (2) decision problem, (3) decision group, (4) decision conflict, (5) decision schemes and (6) group negotiation. Based on multiple artificial intelligent technologies, this framework provides re… ▽ More This study proposes a framework of Uncertainty-based Group Decision Support System (UGDSS). It provides a platform for multiple criteria decision analysis in six aspects including (1) decision environment, (2) decision problem, (3) decision group, (4) decision conflict, (5) decision schemes and (6) group negotiation. Based on multiple artificial intelligent technologies, this framework provides reliable support for the comprehensive manipulation of applications and advanced decision approaches through the design of an integrated multi-agents architecture. △ Less

Submitted 30 June, 2011; originally announced July 2011.

Comments: Accepted paper in IEEE-ICDM2010; Print ISBN: 978-1-4244-9244-2