-
SciAssess: Benchmarking LLM Proficiency in Scientific Literature Analysis
Authors:
Hengxing Cai,
Xiaochen Cai,
Junhan Chang,
Sihang Li,
Lin Yao,
Changxin Wang,
Zhifeng Gao,
Hongshuai Wang,
Yongge Li,
Mujie Lin,
Shuwen Yang,
Jiankun Wang,
Mingjun Xu,
** Huang,
Fang Xi,
Jiaxi Zhuang,
Yuqi Yin,
Yaqi Li,
Changhong Chen,
Zheng Cheng,
Zifeng Zhao,
Linfeng Zhang,
Guolin Ke
Abstract:
Recent breakthroughs in Large Language Models (LLMs) have revolutionized natural language understanding and generation, sparking significant interest in applying them to scientific literature analysis. However, existing benchmarks fail to adequately evaluate the proficiency of LLMs in this domain, particularly in scenarios requiring higher-level abilities beyond mere memorization and the handling…
▽ More
Recent breakthroughs in Large Language Models (LLMs) have revolutionized natural language understanding and generation, sparking significant interest in applying them to scientific literature analysis. However, existing benchmarks fail to adequately evaluate the proficiency of LLMs in this domain, particularly in scenarios requiring higher-level abilities beyond mere memorization and the handling of multimodal data. In response to this gap, we introduce SciAssess, a benchmark specifically designed for the comprehensive evaluation of LLMs in scientific literature analysis. SciAssess aims to thoroughly assess the efficacy of LLMs by focusing on their capabilities in Memorization (L1), Comprehension (L2), and Analysis \& Reasoning (L3). It encompasses a variety of tasks drawn from diverse scientific fields, including fundamental science, alloy materials, biomedicine, drug discovery, and organic materials. To ensure the reliability of SciAssess, rigorous quality control measures have been implemented, ensuring accuracy, anonymization, and compliance with copyright standards. SciAssess evaluates 11 LLMs, including GPT, Claude, and Gemini, highlighting their strengths and areas for improvement. This evaluation supports the ongoing development of LLM applications in the analysis of scientific literature. SciAssess and its resources are available at \url{https://sci-assess.github.io/}.
△ Less
Submitted 18 June, 2024; v1 submitted 4 March, 2024;
originally announced March 2024.
-
Reinforcement learning adaptive fuzzy controller for lighting systems: application to aircraft cabin
Authors:
Kritika Vashishtha,
Anas Saad,
Reza Faieghi,
Fengfeng Xi
Abstract:
The lighting requirements are subjective and one light setting cannot work for all. However, there is little work on develo** smart lighting algorithms that can adapt to user preferences. To address this gap, this paper uses fuzzy logic and reinforcement learning to develop an adaptive lighting algorithm. In particular, we develop a baseline fuzzy inference system (FIS) using the domain knowledg…
▽ More
The lighting requirements are subjective and one light setting cannot work for all. However, there is little work on develo** smart lighting algorithms that can adapt to user preferences. To address this gap, this paper uses fuzzy logic and reinforcement learning to develop an adaptive lighting algorithm. In particular, we develop a baseline fuzzy inference system (FIS) using the domain knowledge. We use the existing literature to create a FIS that generates lighting setting recommendations based on environmental conditions i.e. daily glare index, and user information including age, activity, and chronotype. Through a feedback mechanism, the user interacts with the algorithm, correcting the algorithm output to their preferences. We interpret these corrections as rewards to a Q-learning agent, which tunes the FIS parameters online to match the user preferences. We implement the algorithm in an aircraft cabin mockup and conduct an extensive user study to evaluate the effectiveness of the algorithm and understand its learning behavior. Our implementation results demonstrate that the developed algorithm possesses the capability to learn user preferences while successfully adapting to a wide range of environmental conditions and user characteristics. and can deal with a diverse spectrum of environmental conditions and user characteristics. This underscores its viability as a potent solution for intelligent light management, featuring advanced learning capabilities.
△ Less
Submitted 30 September, 2023;
originally announced October 2023.
-
Time Encoding Sampling of Bandpass Signals
Authors:
Zhong Liu,
Feng Xi,
Shengyao Chen
Abstract:
This paper investigates the problem of sampling and reconstructing bandpass signals using time encoding machine(TEM). It is shown that the sampling in principle is equivalent to periodic non-uniform sampling (PNS). Then the TEM parameters can be set according to the signal bandwidth and amplitude instead of upper-edge frequency and amplitude as in the case of bandlimited/lowpass signals. For a ban…
▽ More
This paper investigates the problem of sampling and reconstructing bandpass signals using time encoding machine(TEM). It is shown that the sampling in principle is equivalent to periodic non-uniform sampling (PNS). Then the TEM parameters can be set according to the signal bandwidth and amplitude instead of upper-edge frequency and amplitude as in the case of bandlimited/lowpass signals. For a bandpass signal of a single information band, it can be perfectly reconstructed if the TEM parameters are such that the difference between any consecutive values of the time sequence in each channel is bounded by the inverse of the signal bandwidth. A reconstruction method incorporating the interpolation functions of PNS is proposed. Numerical experiments validate the feasibility and effectiveness of the proposed TEM scheme.
△ Less
Submitted 14 February, 2023; v1 submitted 29 January, 2023;
originally announced January 2023.
-
Space-Time Adaptive Processing Using Random Matrix Theory Under Limited Training Samples
Authors:
Di Song,
Shengyao Chen,
Feng Xi,
Zhong Liu
Abstract:
Space-time adaptive processing (STAP) is one of the most effective approaches to suppressing ground clutters in airborne radar systems. It basically takes two forms, i.e., full-dimension STAP (FD-STAP) and reduced-dimension STAP (RD-STAP). When the numbers of clutter training samples are less than two times their respective system degrees-of-freedom (DOF), the performances of both FD-STAP and RD-S…
▽ More
Space-time adaptive processing (STAP) is one of the most effective approaches to suppressing ground clutters in airborne radar systems. It basically takes two forms, i.e., full-dimension STAP (FD-STAP) and reduced-dimension STAP (RD-STAP). When the numbers of clutter training samples are less than two times their respective system degrees-of-freedom (DOF), the performances of both FD-STAP and RD-STAP degrade severely due to inaccurate clutter estimation. To enhance STAP performance under the limited training samples, this paper develops a STAP theory with random matrix theory (RMT). By minimizing the output clutter-plus-noise power, the estimate of the inversion of clutter plus noise covariance matrix (CNCM) can be obtained through optimally manipulating its eigenvalues, and thus producing the optimal STAP weight vector. Two STAP algorithms, FD-STAP using RMT (RMT-FD-STAP) and RD-STAP using RMT (RMT-RD-STAP), are proposed. It is found that both RMT-FD-STAP and RMT-RD-STAP greatly outperform other-related STAP algorithms when the numbers of training samples are larger than their respective clutter DOFs, which are much less than the corresponding system DOFs. Theoretical analyses and simulation demonstrate the effectiveness and the performance advantages of the proposed STAP algorithms.
△ Less
Submitted 10 February, 2022;
originally announced February 2022.
-
Radar Interferometry using Two Images with Different Resolutions
Authors:
Huizhang Yang,
Chengzhi Chen,
Shengyao Chen,
Feng Xi,
Zhong Liu
Abstract:
Radar interferometry usually exploits two complex-valued radar images with the same resolution to extract terrain elevation information. This paper considers the interferometry using two radar images with different resolutions, which we refer to as dual-resolution radar interferometry. We find that it is feasible to recover a high-resolution interferogram from a high-resolution image and a low-res…
▽ More
Radar interferometry usually exploits two complex-valued radar images with the same resolution to extract terrain elevation information. This paper considers the interferometry using two radar images with different resolutions, which we refer to as dual-resolution radar interferometry. We find that it is feasible to recover a high-resolution interferogram from a high-resolution image and a low-resolution one. We formulate the dual-resolution interferometry into a compressive sensing problem, and exploit the wavelet-domain sparsity of the interferogram to solve it. Due to the speckle effect in coherent radar imaging, the sensing matrix of our model is expected to have small mutual coherence, which guarantees the performance of our method. In comparison with the conventional radar interferometry methods, the proposed method reduces the resolution requirement of radar image acquisition. It therefore can promote wide coverage, low sampling/data rate and storage cost. Numerical experiments on Sentinel-1 data are made to validate our method.
△ Less
Submitted 13 December, 2018;
originally announced December 2018.
-
Quadrature compressive sampling SAR imaging
Authors:
Huizhang Yang,
Shengyao Chen,
Feng Xi,
Zhong Liu
Abstract:
This paper presents a quadrature compressive sampling (QuadCS) and associated fast imaging scheme for synthetic aperture radar (SAR). Different from other analog-to-information conversions (AIC), QuadCS AICs using independent spreading signals sample the SAR echoes due to different transmitted pulses. Then the resulting sensing matrix has lower correlation between any two columns than that by a fi…
▽ More
This paper presents a quadrature compressive sampling (QuadCS) and associated fast imaging scheme for synthetic aperture radar (SAR). Different from other analog-to-information conversions (AIC), QuadCS AICs using independent spreading signals sample the SAR echoes due to different transmitted pulses. Then the resulting sensing matrix has lower correlation between any two columns than that by a fixed spreading signal, and better SAR image can be reconstructed. With proper setting of the spreading signals in QuadCS, the sensing matrix has the structures suitable for fast computation of matrix-vector multiplication operations, which leads to the fast image reconstruction. The performance of the proposed scheme is assessed using real SAR image. The reconstructed SAR images with only one-fourth of the Nyquist data achieve the image quality similar to that of the classical SAR images with Nyquist samples.
△ Less
Submitted 10 January, 2018;
originally announced January 2018.
-
A General and Yet Efficient Scheme for Sub-Nyquist Radar Processing
Authors:
Shengyao Chen,
Feng Xi,
Zhong Liu
Abstract:
We study the target parameter estimation for sub-Nyquist pulse-Doppler radar. Several past works have addressed this problem but either have low estimation accuracy for off-grid targets, take large computation load, or lack versatility for analog-to-information conversion (AIC) systems. To overcome these difficulties, we present a general and efficient estimation scheme. The scheme first formulate…
▽ More
We study the target parameter estimation for sub-Nyquist pulse-Doppler radar. Several past works have addressed this problem but either have low estimation accuracy for off-grid targets, take large computation load, or lack versatility for analog-to-information conversion (AIC) systems. To overcome these difficulties, we present a general and efficient estimation scheme. The scheme first formulates a general model in the sense that it is applicable to all AICs regardless of whether the targets are on or off the grids. The estimation of Doppler shifts and delays is performed sequentially, in which the Doppler estimation is formulated into a spatial spectrum estimation problem and the delay estimation is decomposed into a series of compressive parameter estimation problems with each corresponding to an estimated Doppler shift. By the sequential and decomposed processing, the computational complexity is substantially reduced, and by the parametric estimation techniques, the high accurate estimation is obtained. Theoretical analyses and numerical experiments show the effectiveness and the correctness of the proposed scheme.
△ Less
Submitted 25 July, 2017;
originally announced July 2017.
-
A General Sequential Delay-Doppler Estimation Scheme for Sub-Nyquist Pulse-Doppler Radar
Authors:
Shengyao Chen,
Feng Xi,
Zhong Liu
Abstract:
Sequential estimation of the delay and Doppler parameters for sub-Nyquist radars by analog-to-information conversion (AIC) systems has received wide attention recently. However, the estimation methods reported are AIC-dependent and have poor performance for off-grid targets. This paper develops a general estimation scheme in the sense that it is applicable to all AICs regardless whether the target…
▽ More
Sequential estimation of the delay and Doppler parameters for sub-Nyquist radars by analog-to-information conversion (AIC) systems has received wide attention recently. However, the estimation methods reported are AIC-dependent and have poor performance for off-grid targets. This paper develops a general estimation scheme in the sense that it is applicable to all AICs regardless whether the targets are on or off the grids. The proposed scheme estimates the delay and Doppler parameters sequentially, in which the delay estimation is formulated into a beamspace direction-of- arrival problem and the Doppler estimation is translated into a line spectrum estimation problem. Then the well-known spatial and temporal spectrum estimation techniques are used to provide efficient and high-resolution estimates of the delay and Doppler parameters. In addition, sufficient conditions on the AIC to guarantee the successful estimation of off-grid targets are provided, while the existing conditions are mostly related to the on-grid targets. Theoretical analyses and numerical experiments show the effectiveness and the correctness of the proposed scheme.
△ Less
Submitted 13 January, 2017;
originally announced January 2017.
-
Gridless Quadrature Compressive Sampling with Interpolated Array Technique
Authors:
Feng Xi,
Shengyao Chen,
Yimin D. Zhang,
Zhong Liu
Abstract:
Quadrature compressive sampling (QuadCS) is a sub-Nyquist sampling scheme for acquiring in-phase and quadrature (I/Q) components in radar. In this scheme, the received intermediate frequency (IF) signals are expressed as a linear combination of time-delayed and scaled replicas of the transmitted waveforms. For sparse IF signals on discrete grids of time-delay space, the QuadCS can efficiently reco…
▽ More
Quadrature compressive sampling (QuadCS) is a sub-Nyquist sampling scheme for acquiring in-phase and quadrature (I/Q) components in radar. In this scheme, the received intermediate frequency (IF) signals are expressed as a linear combination of time-delayed and scaled replicas of the transmitted waveforms. For sparse IF signals on discrete grids of time-delay space, the QuadCS can efficiently reconstruct the I/Q components from sub-Nyquist samples. In practice, the signals are characterized by a set of unknown time-delay parameters in a continuous space. Then conventional sparse signal reconstruction will deteriorate the QuadCS reconstruction performance. This paper focuses on the reconstruction of the I/Q components with continuous delay parameters. A parametric spectrum-matched dictionary is defined, which sparsely describes the IF signals in the frequency domain by delay parameters and gain coefficients, and the QuadCS system is reexamined under the new dictionary. With the inherent structure of the QuadCS system, it is found that the estimation of delay parameters can be decoupled from that of sparse gain coefficients, yielding a beamspace direction-of-arrival (DOA) estimation formulation with a time-varying beamforming matrix. Then an interpolated beamspace DOA method is developed to perform the DOA estimation. An optimal interpolated array is established and sufficient conditions to guarantee the successful estimation of the delay parameters are derived. With the estimated delays, the gain coefficients can be conveniently determined by solving a linear least-squares problem. Extensive simulations demonstrate the superior performance of the proposed algorithm in reconstructing the sparse signals with continuous delay parameters.
△ Less
Submitted 2 March, 2015;
originally announced March 2015.
-
Segment-Sliding Reconstruction of Pulsed Radar Echoes with Sub-Nyquist Sampling
Authors:
Suling Zhang,
Feng Xi,
Shengyao Chen,
Yimin D. Zhang,
Zhong Liu
Abstract:
It has been shown that analog-to-information con- version (AIC) is an efficient scheme to perform sub-Nyquist sampling of pulsed radar echoes. However, it is often impractical, if not infeasible, to reconstruct full-range Nyquist samples because of huge storage and computational load requirements. Based on the analyses of AIC measurement system, this paper develops a novel segment-sliding reconstr…
▽ More
It has been shown that analog-to-information con- version (AIC) is an efficient scheme to perform sub-Nyquist sampling of pulsed radar echoes. However, it is often impractical, if not infeasible, to reconstruct full-range Nyquist samples because of huge storage and computational load requirements. Based on the analyses of AIC measurement system, this paper develops a novel segment-sliding reconstruction (SegSR) scheme to effectively reconstruct the Nyquist samples. The SegSR per- forms segment-by-segment reconstruction in a sliding mode and can be implemented in real-time. An important characteristic that distinguish the proposed SegSR from the existing methods is that the measurement matrix in each segment satisfies the restricted isometry property (RIP) condition. Partial support in the previous segment can be incorporated into the estimation of the Nyquist samples in the current segment. The effect of interference intro- duced from adjacent segments is theoretically analyzed, and it is revealed that the interference consists of two interference levels having different impacts to the signal reconstruction performance. With these observations, a two-step orthogonal matching pursuit (OMP) procedure is proposed for segment reconstruction, which takes into account different interference levels and partially known support of the previous segment. The proposed SegSR achieves nearly optimal reconstruction performance with a signi- ficant reduction of computational loads and storage requirements. Theoretical analyses and simulations verify its effectiveness.
△ Less
Submitted 2 March, 2015;
originally announced March 2015.
-
Quadrature Compressive Sampling for Radar Signals
Authors:
Feng Xi,
Shengyao Chen,
Zhong Liu
Abstract:
Quadrature sampling has been widely applied in coherent radar systems to extract in-phase and quadrature (I and Q) components in the received radar signal. However, the sampling is inefficient because the received signal contains only a small number of significant target signals. This paper incorporates the compressive sampling (CS) theory into the design of the quadrature sampling system, and dev…
▽ More
Quadrature sampling has been widely applied in coherent radar systems to extract in-phase and quadrature (I and Q) components in the received radar signal. However, the sampling is inefficient because the received signal contains only a small number of significant target signals. This paper incorporates the compressive sampling (CS) theory into the design of the quadrature sampling system, and develops a quadrature compressive sampling (QuadCS) system to acquire the I and Q components with low sampling rate. The QuadCS system first randomly projects the received signal into a compressive bandpass signal and then utilizes the quadrature sampling to output compressive I and Q components. The compressive outputs are used to reconstruct the I and Q components. To understand the system performance, we establish the frequency domain representation of the QuadCS system. With the waveform-matched dictionary, we prove that the QuadCS system satisfies the restricted isometry property with overwhelming probability. For K target signals in the observation interval T, simulations show that the QuadCS requires just O(Klog(BT/K)) samples to stably reconstruct the signal, where B is the signal bandwidth. The reconstructed signal-to-noise ratio decreases by 3dB for every octave increase in the target number K and increases by 3dB for every octave increase in the compressive bandwidth. Theoretical analyses and simulations verify that the proposed QuadCS is a valid system to acquire the I and Q components in the received radar signals.
△ Less
Submitted 7 January, 2014;
originally announced January 2014.
-
Pulse-Doppler Signal Processing with Quadrature Compressive Sampling
Authors:
Chao Liu,
Feng Xi,
Shengyao Chen,
Zhong Liu
Abstract:
Quadrature compressive sampling (QuadCS) is a newly introduced sub-Nyquist sampling for acquiring inphase and quadrature (I/Q) components of radio-frequency signals. For applications to pulse-Doppler radars, the QuadCS outputs can be arranged in 2-dimensional data similar to that by Nyquist sampling. This paper develops a compressive sampling pulse-Doppler (CoSaPD) processing scheme from the sub-N…
▽ More
Quadrature compressive sampling (QuadCS) is a newly introduced sub-Nyquist sampling for acquiring inphase and quadrature (I/Q) components of radio-frequency signals. For applications to pulse-Doppler radars, the QuadCS outputs can be arranged in 2-dimensional data similar to that by Nyquist sampling. This paper develops a compressive sampling pulse-Doppler (CoSaPD) processing scheme from the sub-Nyquist samples. The CoSaPD scheme follows Doppler estimation/detection and range estimation and is conducted on the sub-Nyquist samples without recovering the Nyquist samples. The Doppler estimation is realized through spectrum analyzer as in classic processing. The detection is done on the Doppler bin data. The range estimation is performed through sparse recovery algorithms on the detected targets and thus the computational load is reduced. The detection threshold can be set at a low value for improving detection probability and then the introduced false targets are removed in the range estimation stage through inherent detection characteristic in the recovery algorithms. Simulation results confirm our findings. The CoSaPD scheme with the data at one eighth the Nyquist rate and for SNR above -25dB can achieve performance of the classic processing with Nyquist samples.
△ Less
Submitted 26 February, 2014; v1 submitted 20 October, 2013;
originally announced October 2013.
-
Chaotic Analog-to-Information Conversion with Chaotic State Modulation
Authors:
ShengYao Chen,
Feng Xi,
Zhong Liu
Abstract:
Chaotic compressive sensing is a nonlinear framework for compressive sensing. Along the framework, this paper proposes a chaotic analog-to-information converter, chaotic modulation, to acquire and reconstruct band-limited sparse analog signals at sub-Nyquist rate. In the chaotic modulation, the sparse signal is randomized through state modulation of continuous-time chaotic system and one state out…
▽ More
Chaotic compressive sensing is a nonlinear framework for compressive sensing. Along the framework, this paper proposes a chaotic analog-to-information converter, chaotic modulation, to acquire and reconstruct band-limited sparse analog signals at sub-Nyquist rate. In the chaotic modulation, the sparse signal is randomized through state modulation of continuous-time chaotic system and one state output is sampled as compressive measurements. The reconstruction is achieved through the estimation of the sparse coefficients with principle of chaotic impulsive synchronization and Lp-norm regularized nonlinear least squares. The concept of supreme local Lyapunov exponents (SLLE) is introduced to study the reconstructablity. It is found that the sparse signals are reconstructable, if the largest SLLE of the error dynamical system is negative. As examples, the Lorenz system and Liu system excited by the sparse multi-tone signals are taken to illustrate the principle and the performance.
△ Less
Submitted 20 October, 2013; v1 submitted 3 January, 2013;
originally announced January 2013.
-
Chaotic Analog-to-Information Conversion: Principle and Reconstructability with Parameter Identifiability
Authors:
Feng Xi,
Sheng Yao Chen,
Zhong Liu
Abstract:
This paper proposes a chaos-based analog-to-information conversion system for the acquisition and reconstruction of sparse analog signals. The sparse signal acts as an excitation term of a continuous-time chaotic system and the compressive measurements are performed by sampling chaotic system outputs. The reconstruction is realized through the estimation of the sparse coefficients with principle o…
▽ More
This paper proposes a chaos-based analog-to-information conversion system for the acquisition and reconstruction of sparse analog signals. The sparse signal acts as an excitation term of a continuous-time chaotic system and the compressive measurements are performed by sampling chaotic system outputs. The reconstruction is realized through the estimation of the sparse coefficients with principle of chaotic parameter estimation. With the deterministic formulation, the analysis on the reconstructability is conducted via the sensitivity matrix from the parameter identifiability of chaotic systems. For the sparsity-regularized nonlinear least squares estimation, it is shown that the sparse signal is locally reconstructable if the columns of the sparsity-regularized sensitivity matrix are linearly independent. A Lorenz system excited by the sparse multitone signal is taken as an example to illustrate the principle and the performance.
△ Less
Submitted 21 October, 2013; v1 submitted 12 December, 2012;
originally announced December 2012.
-
A Compressed Sensing Framework of Frequency-Sparse Signals through Chaotic Systems
Authors:
Zhong Liu,
Shengyao Chen,
Feng Xi
Abstract:
This paper proposes a compressed sensing (CS) framework for the acquisition and reconstruction of frequency-sparse signals with chaotic dynamical systems. The sparse signal is acting as an excitation term of a discrete-time chaotic system and the compressed measurement is obtained by downsampling the system output. The reconstruction is realized through the estimation of the excitation coefficient…
▽ More
This paper proposes a compressed sensing (CS) framework for the acquisition and reconstruction of frequency-sparse signals with chaotic dynamical systems. The sparse signal is acting as an excitation term of a discrete-time chaotic system and the compressed measurement is obtained by downsampling the system output. The reconstruction is realized through the estimation of the excitation coefficients with principle of impulsive chaos synchronization. The -norm regularized nonlinear least squares is used to find the estimation. The proposed framework is easily implementable and creates secure measurements. The Henon map is used as an example to illustrate the principle and the performance.
△ Less
Submitted 14 December, 2011;
originally announced December 2011.