Showing 1–28 of 28 results for author: Feng, N

Dr.E Bridges Graphs with Large Language Models through Words

Authors: Zipeng Liu, Likang Wu, Ming He, Zhong Guan, Hongke Zhao, Nan Feng

Abstract: Significant efforts have been directed toward integrating powerful Large Language Models (LLMs) with diverse modalities, particularly focusing on the fusion of vision, language, and audio data. However, the graph-structured data, inherently rich in structural and domain-specific knowledge, have not yet been gracefully adapted to LLMs. Existing methods either describe the graph with raw text, suffe… ▽ More Significant efforts have been directed toward integrating powerful Large Language Models (LLMs) with diverse modalities, particularly focusing on the fusion of vision, language, and audio data. However, the graph-structured data, inherently rich in structural and domain-specific knowledge, have not yet been gracefully adapted to LLMs. Existing methods either describe the graph with raw text, suffering the loss of graph structural information, or feed Graph Neural Network (GNN) embeddings directly into LLM at the cost of losing semantic representation. To bridge this gap, we introduce an innovative, end-to-end modality-aligning framework, equipped with a pretrained Dual-Residual Vector Quantized-Variational AutoEncoder (Dr.E). This framework is specifically designed to facilitate token-level alignment with LLMs, enabling an effective translation of the intrinsic `language' of graphs into comprehensible natural language. Our experimental evaluations on standard GNN node classification tasks demonstrate competitive performance against other state-of-the-art approaches. Additionally, our framework ensures interpretability, efficiency, and robustness, with its effectiveness further validated under both fine-tuning and few-shot settings. This study marks the first successful endeavor to achieve token-level alignment between GNNs and LLMs. △ Less

Submitted 19 June, 2024; originally announced June 2024.

TimeSieve: Extracting Temporal Dynamics through Information Bottlenecks

Authors: Ninghui Feng, Songning Lai, Fobao Zhou, Zhenxiao Yin, Hang Zhao

Abstract: Time series forecasting has become an increasingly popular research area due to its critical applications in various real-world domains such as traffic management, weather prediction, and financial analysis. Despite significant advancements, existing models face notable challenges, including the necessity of manual hyperparameter tuning for different datasets, and difficulty in effectively disting… ▽ More Time series forecasting has become an increasingly popular research area due to its critical applications in various real-world domains such as traffic management, weather prediction, and financial analysis. Despite significant advancements, existing models face notable challenges, including the necessity of manual hyperparameter tuning for different datasets, and difficulty in effectively distinguishing signal from redundant features in data characterized by strong seasonality. These issues hinder the generalization and practical application of time series forecasting models. To solve this issues, we propose an innovative time series forecasting model TimeSieve designed to address these challenges. Our approach employs wavelet transforms to preprocess time series data, effectively capturing multi-scale features without the need for additional parameters or manual hyperparameter tuning. Additionally, we introduce the information bottleneck theory that filters out redundant features from both detail and approximation coefficients, retaining only the most predictive information. This combination reduces significantly improves the model's accuracy. Extensive experiments demonstrate that our model outperforms existing state-of-the-art methods on 70\% of the datasets, achieving higher predictive accuracy and better generalization across diverse datasets. Our results validate the effectiveness of our approach in addressing the key challenges in time series forecasting, paving the way for more reliable and efficient predictive models in practical applications. The code for our model is available at https://github.com/xll0328/TimeSieve. △ Less

Submitted 7 June, 2024; originally announced June 2024.

FTS: A Framework to Find a Faithful TimeSieve

Authors: Songning Lai, Ninghui Feng, Haochen Sui, Ze Ma, Hao Wang, Zichen Song, Hang Zhao, Yutao Yue

Abstract: The field of time series forecasting has garnered significant attention in recent years, prompting the development of advanced models like TimeSieve, which demonstrates impressive performance. However, an analysis reveals certain unfaithfulness issues, including high sensitivity to random seeds and minute input noise perturbations. Recognizing these challenges, we embark on a quest to define the c… ▽ More The field of time series forecasting has garnered significant attention in recent years, prompting the development of advanced models like TimeSieve, which demonstrates impressive performance. However, an analysis reveals certain unfaithfulness issues, including high sensitivity to random seeds and minute input noise perturbations. Recognizing these challenges, we embark on a quest to define the concept of \textbf{\underline{F}aithful \underline{T}ime\underline{S}ieve \underline{(FTS)}}, a model that consistently delivers reliable and robust predictions. To address these issues, we propose a novel framework aimed at identifying and rectifying unfaithfulness in TimeSieve. Our framework is designed to enhance the model's stability and resilience, ensuring that its outputs are less susceptible to the aforementioned factors. Experimentation validates the effectiveness of our proposed framework, demonstrating improved faithfulness in the model's behavior. Looking forward, we plan to expand our experimental scope to further validate and optimize our algorithm, ensuring comprehensive faithfulness across a wide range of scenarios. Ultimately, we aspire to make this framework can be applied to enhance the faithfulness of not just TimeSieve but also other state-of-the-art temporal methods, thereby contributing to the reliability and robustness of temporal modeling as a whole. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Journal ref: IJCAI2024 workshop

iVideoGPT: Interactive VideoGPTs are Scalable World Models

Authors: Jialong Wu, Shaofeng Yin, Ningya Feng, Xu He, Dong Li, Jianye Hao, Mingsheng Long

Abstract: World models empower model-based agents to interactively explore, reason, and plan within imagined environments for real-world decision-making. However, the high demand for interactivity poses challenges in harnessing recent advancements in video generative models for develo** world models at scale. This work introduces Interactive VideoGPT (iVideoGPT), a scalable autoregressive transformer fram… ▽ More World models empower model-based agents to interactively explore, reason, and plan within imagined environments for real-world decision-making. However, the high demand for interactivity poses challenges in harnessing recent advancements in video generative models for develo** world models at scale. This work introduces Interactive VideoGPT (iVideoGPT), a scalable autoregressive transformer framework that integrates multimodal signals--visual observations, actions, and rewards--into a sequence of tokens, facilitating an interactive experience of agents via next-token prediction. iVideoGPT features a novel compressive tokenization technique that efficiently discretizes high-dimensional visual observations. Leveraging its scalable architecture, we are able to pre-train iVideoGPT on millions of human and robotic manipulation trajectories, establishing a versatile foundation that is adaptable to serve as interactive world models for a wide range of downstream tasks. These include action-conditioned video prediction, visual planning, and model-based reinforcement learning, where iVideoGPT achieves competitive performance compared with state-of-the-art methods. Our work advances the development of interactive general world models, bridging the gap between generative video models and practical model-based reinforcement learning applications. △ Less

Submitted 2 June, 2024; v1 submitted 24 May, 2024; originally announced May 2024.

Comments: Project website: https://thuml.github.io/iVideoGPT

Normative Requirements Operationalization with Large Language Models

Authors: Nick Feng, Lina Marsso, S. Getir Yaman, Isobel Standen, Yesugen Baatartogtokh, Reem Ayad, Victória Oldemburgo de Mello, Bev Townsend, Hanne Bartels, Ana Cavalcanti, Radu Calinescu, Marsha Chechik

Abstract: Normative non-functional requirements specify constraints that a system must observe in order to avoid violations of social, legal, ethical, empathetic, and cultural norms. As these requirements are typically defined by non-technical system stakeholders with different expertise and priorities (ethicists, lawyers, social scientists, etc.), ensuring their well-formedness and consistency is very chal… ▽ More Normative non-functional requirements specify constraints that a system must observe in order to avoid violations of social, legal, ethical, empathetic, and cultural norms. As these requirements are typically defined by non-technical system stakeholders with different expertise and priorities (ethicists, lawyers, social scientists, etc.), ensuring their well-formedness and consistency is very challenging. Recent research has tackled this challenge using a domain-specific language to specify normative requirements as rules whose consistency can then be analysed with formal methods. In this paper, we propose a complementary approach that uses Large Language Models to extract semantic relationships between abstract representations of system capabilities. These relations, which are often assumed implicitly by non-technical stakeholders (e.g., based on common sense or domain knowledge), are then used to enrich the automated reasoning techniques for eliciting and analyzing the consistency of normative requirements. We show the effectiveness of our approach to normative requirements elicitation and operationalization through a range of real-world case studies. △ Less

Submitted 28 May, 2024; v1 submitted 18 April, 2024; originally announced April 2024.

Phase transitions in typical fluorite-type ferroelectrics

Authors: Heng Yu, Kan-Hao Xue, Nan Feng, Yunzhe Zheng, Yan Cheng, Ben Xu, Xiangshui Miao

Abstract: While ferroelectric hafnia ($\mathrm{HfO_2}$) has become a technically important material for microelectronics, the physical origin of its ferroelectricity remains poorly understood. The tetragonal $P4_2/nmc$ phase is commonly assigned as its paraelectric mother phase but has no soft mode at the Brillouin zone center. In this work, we propose that the paraelectric-ferroelectric transition in hafni… ▽ More While ferroelectric hafnia ($\mathrm{HfO_2}$) has become a technically important material for microelectronics, the physical origin of its ferroelectricity remains poorly understood. The tetragonal $P4_2/nmc$ phase is commonly assigned as its paraelectric mother phase but has no soft mode at the Brillouin zone center. In this work, we propose that the paraelectric-ferroelectric transition in hafnia-like $Pca2_1$ ferroelectric family can be described by a $Pcca$-$Pca2_1$ transition, where the $Pcca$ mother phase will evolve into either the $Pca2_1$ ferroelectric phase or the centrosymmetric $P2_1/c$ monoclinic phase, depending on the strain conditions. The $Pcca$ phase is directly linked to both phases in the context of continuous phase transition. Hafnia is regarded as a special case of this family, in that it has accidental atomic degeneracy because all anions are oxygen. The theory is also correlated to the seven-coordination theory that explains the ferroelectricity in hafnia from a chemical perspective. In addition, the strain conditions to promote the ferroelectric phase in hafnia are discussed. △ Less

Submitted 4 June, 2024; v1 submitted 13 March, 2024; originally announced March 2024.

Comments: 12 pages, 4 figures

DRAT Proofs of Unsatisfiability for SAT Modulo Monotonic Theories

Authors: Nick Feng, Alan J. Hu, Sam Bayless, Syed M. Iqbal, Patrick Trentin, Mike Whalen, Lee Pike, John Backes

Abstract: Generating proofs of unsatisfiability is a valuable capability of most SAT solvers, and is an active area of research for SMT solvers. This paper introduces the first method to efficiently generate proofs of unsatisfiability specifically for an important subset of SMT: SAT Modulo Monotonic Theories (SMMT), which includes many useful finite-domain theories (e.g., bit vectors and many graph-theoreti… ▽ More Generating proofs of unsatisfiability is a valuable capability of most SAT solvers, and is an active area of research for SMT solvers. This paper introduces the first method to efficiently generate proofs of unsatisfiability specifically for an important subset of SMT: SAT Modulo Monotonic Theories (SMMT), which includes many useful finite-domain theories (e.g., bit vectors and many graph-theoretic properties) and is used in production at Amazon Web Services. Our method uses propositional definitions of the theory predicates, from which it generates compact Horn approximations of the definitions, which lead to efficient DRAT proofs, leveraging the large investment the SAT community has made in DRAT. In experiments on practical SMMT problems, our proof generation overhead is minimal (7.41% geometric mean slowdown, 28.8% worst-case), and we can generate and check proofs for many problems that were previously intractable. △ Less

Submitted 18 April, 2024; v1 submitted 19 January, 2024; originally announced January 2024.

Analyzing and Debugging Normative Requirements via Satisfiability Checking

Authors: Nick Feng, Lina Marsso, Sinem Getir Yaman, Yesugen Baatartogtokh, Reem Ayad, Victória Oldemburgo de Mello, Beverley Townsend, Isobel Standen, Ioannis Stefanakos, Calum Imrie, Genaína Nunes Rodrigues, Ana Cavalcanti, Radu Calinescu, Marsha Chechik

Abstract: As software systems increasingly interact with humans in application domains such as transportation and healthcare, they raise concerns related to the social, legal, ethical, empathetic, and cultural (SLEEC) norms and values of their stakeholders. Normative non-functional requirements (N-NFRs) are used to capture these concerns by setting SLEEC-relevant boundaries for system behavior. Since N-NFRs… ▽ More As software systems increasingly interact with humans in application domains such as transportation and healthcare, they raise concerns related to the social, legal, ethical, empathetic, and cultural (SLEEC) norms and values of their stakeholders. Normative non-functional requirements (N-NFRs) are used to capture these concerns by setting SLEEC-relevant boundaries for system behavior. Since N-NFRs need to be specified by multiple stakeholders with widely different, non-technical expertise (ethicists, lawyers, regulators, end users, etc.), N-NFR elicitation is very challenging. To address this challenge, we introduce N-Check, a novel tool-supported formal approach to N-NFR analysis and debugging. N-Check employs satisfiability checking to identify a broad spectrum of N-NFR well-formedness issues (WFI), such as conflicts, redundancy, restrictiveness, insufficiency, yielding diagnostics which pinpoint their causes in a user-friendly way that enables non-technical stakeholders to understand and fix them. We show the effectiveness and usability of our approach through nine case studies in which teams of ethicists, lawyers, philosophers, psychologists, safety analysts, and engineers used N-Check to analyse and debug 233 N-NFRs comprising 62 issues for the software underpinning the operation of systems ranging from assistive-care robots and tree-disease detection drones to manufacturing collaborative robots. △ Less

Submitted 11 January, 2024; originally announced January 2024.

Bi-discriminator Domain Adversarial Neural Networks with Class-Level Gradient Alignment

Authors: Chuang Zhao, Hongke Zhao, Hengshu Zhu, Zhenya Huang, Nan Feng, Enhong Chen, Hui Xiong

Abstract: Unsupervised domain adaptation aims to transfer rich knowledge from the annotated source domain to the unlabeled target domain with the same label space. One prevalent solution is the bi-discriminator domain adversarial network, which strives to identify target domain samples outside the support of the source domain distribution and enforces their classification to be consistent on both discrimina… ▽ More Unsupervised domain adaptation aims to transfer rich knowledge from the annotated source domain to the unlabeled target domain with the same label space. One prevalent solution is the bi-discriminator domain adversarial network, which strives to identify target domain samples outside the support of the source domain distribution and enforces their classification to be consistent on both discriminators. Despite being effective, agnostic accuracy and overconfident estimation for out-of-distribution samples hinder its further performance improvement. To address the above challenges, we propose a novel bi-discriminator domain adversarial neural network with class-level gradient alignment, i.e. BACG. BACG resorts to gradient signals and second-order probability estimation for better alignment of domain distributions. Specifically, for accuracy-awareness, we first design an optimizable nearest neighbor algorithm to obtain pseudo-labels of samples in the target domain, and then enforce the backward gradient approximation of the two discriminators at the class level. Furthermore, following evidential learning theory, we transform the traditional softmax-based optimization method into a Multinomial Dirichlet hierarchical model to infer the class probability distribution as well as samples uncertainty, thereby alleviating misestimation of out-of-distribution samples and guaranteeing high-quality classes alignment. In addition, inspired by contrastive learning, we develop a memory bank-based variant, i.e. Fast-BACG, which can greatly shorten the training process at the cost of a minor decrease in accuracy. Extensive experiments and detailed theoretical analysis on four benchmark data sets validate the effectiveness and robustness of our algorithm. △ Less

Submitted 1 November, 2023; v1 submitted 21 October, 2023; originally announced October 2023.

Comments: False Figure citation. For instance, Figure 8 hasn't been cited

HarmonyDream: Task Harmonization Inside World Models

Authors: Haoyu Ma, Jialong Wu, Ningya Feng, Chenjun Xiao, Dong Li, Jianye Hao, Jianmin Wang, Mingsheng Long

Abstract: Model-based reinforcement learning (MBRL) holds the promise of sample-efficient learning by utilizing a world model, which models how the environment works and typically encompasses components for two tasks: observation modeling and reward modeling. In this paper, through a dedicated empirical investigation, we gain a deeper understanding of the role each task plays in world models and uncover the… ▽ More Model-based reinforcement learning (MBRL) holds the promise of sample-efficient learning by utilizing a world model, which models how the environment works and typically encompasses components for two tasks: observation modeling and reward modeling. In this paper, through a dedicated empirical investigation, we gain a deeper understanding of the role each task plays in world models and uncover the overlooked potential of sample-efficient MBRL by mitigating the domination of either observation or reward modeling. Our key insight is that while prevalent approaches of explicit MBRL attempt to restore abundant details of the environment via observation models, it is difficult due to the environment's complexity and limited model capacity. On the other hand, reward models, while dominating implicit MBRL and adept at learning compact task-centric dynamics, are inadequate for sample-efficient learning without richer learning signals. Motivated by these insights and discoveries, we propose a simple yet effective approach, HarmonyDream, which automatically adjusts loss coefficients to maintain task harmonization, i.e. a dynamic equilibrium between the two tasks in world model learning. Our experiments show that the base MBRL method equipped with HarmonyDream gains 10%-69% absolute performance boosts on visual robotic tasks and sets a new state-of-the-art result on the Atari 100K benchmark. Code is available at https://github.com/thuml/HarmonyDream. △ Less

Submitted 5 June, 2024; v1 submitted 30 September, 2023; originally announced October 2023.

Comments: ICML 2024. Code is available at https://github.com/thuml/HarmonyDream

Sub-SQL electronic field sensing by simultaneously using quantum entanglements and squeezings

Authors: X. N. Feng, M. Zhang, L. F. Wei

Abstract: Quantum entanglement and quantum squeezing are two most typical approaches to beat the standard quantum limit (SQL) of the sensitive phase estimations in quantum metrology. Each of them has already been utilized individually to improve the sensitivity of electric field sensing with the trapped ion platform, but the upper bound of the demonstrated sensitivity gain is very limited, i.e., the experim… ▽ More Quantum entanglement and quantum squeezing are two most typical approaches to beat the standard quantum limit (SQL) of the sensitive phase estimations in quantum metrology. Each of them has already been utilized individually to improve the sensitivity of electric field sensing with the trapped ion platform, but the upper bound of the demonstrated sensitivity gain is very limited, i.e., the experimental 3dB and theoretical 6dB, over the SQL. Here, by simultaneously using the internal (spin)-external (oscillator) state entanglements and the oscillator squeezings to effectively amplify the accumulation phase, we show that these sensitivity gains can be effectively surpassed. Hopefully, the proposal provides a novel approach to the stronger beaten of the SQL for the sensitive sensings of the desired electric field and also the other metrologies. △ Less

Submitted 25 August, 2023; v1 submitted 8 August, 2023; originally announced August 2023.

Artificial Intelligence-Generated Terahertz Multi-Resonant Metasurfaces via Improved Transformer and CGAN Neural Networks

Authors: Yangpeng Huang, Naixing Feng, Yijun Cai

Abstract: It is well known that the inverse design of terahertz (THz) multi-resonant graphene metasurfaces by using traditional deep neural networks (DNNs) has limited generalization ability. In this paper, we propose improved Transformer and conditional generative adversarial neural networks (CGAN) for the inverse design of graphene metasurfaces based upon THz multi-resonant absorption spectra. The improve… ▽ More It is well known that the inverse design of terahertz (THz) multi-resonant graphene metasurfaces by using traditional deep neural networks (DNNs) has limited generalization ability. In this paper, we propose improved Transformer and conditional generative adversarial neural networks (CGAN) for the inverse design of graphene metasurfaces based upon THz multi-resonant absorption spectra. The improved Transformer can obtain higher accuracy and generalization performance in the StoV (Spectrum to Vector) design compared to traditional multilayer perceptron (MLP) neural networks, while the StoI (Spectrum to Image) design achieved through CGAN can provide more comprehensive information and higher accuracy than the StoV design obtained by MLP. Moreover, the improved CGAN can achieve the inverse design of graphene metasurface images directly from the desired multi-resonant absorption spectra. It is turned out that this work can finish facilitating the design process of artificial intelligence-generated metasurfaces (AIGM), and even provide a useful guide for develo** complex THz metasurfaces based on 2D materials using generative neural networks. △ Less

Submitted 20 July, 2023; originally announced July 2023.

Contact Edit: Artist Tools for Intuitive Modeling of Hand-Object Interactions

Authors: Arjun S. Lakshmipathy, Nicole Feng, Yu Xi Lee, Moshe Mahler, Nancy S. Pollard

Abstract: Posing high-contact interactions is challenging and time-consuming, with hand-object interactions being especially difficult due to the large number of degrees of freedom (DOF) of the hand and the fact that humans are experts at judging hand poses. This paper addresses this challenge by elevating contact areas to first-class primitives. We provide \textit{end-to-end art-directable} (EAD) tools to… ▽ More Posing high-contact interactions is challenging and time-consuming, with hand-object interactions being especially difficult due to the large number of degrees of freedom (DOF) of the hand and the fact that humans are experts at judging hand poses. This paper addresses this challenge by elevating contact areas to first-class primitives. We provide \textit{end-to-end art-directable} (EAD) tools to model interactions based on contact areas, directly manipulate contact areas, and compute corresponding poses automatically. To make these operations intuitive and fast, we present a novel axis-based contact model that supports real-time approximately isometry-preserving operations on triangulated surfaces, permits movement between surfaces, and is both robust and scalable to large areas. We show that use of our contact model facilitates high quality posing even for unconstrained, high-DOF custom rigs intended for traditional keyframe-based animation pipelines. We additionally evaluate our approach with comparisons to prior art, ablation studies, user studies, qualitative assessments, and extensions to full-body interaction. △ Less

Submitted 18 May, 2023; v1 submitted 3 May, 2023; originally announced May 2023.

Sensitive detection of millimeter wave electric field by driving trapped surface-state electrons

Authors: Miao Zhang, Y. F. Wang, X. Y. Peng, X. N. Feng, S. R. He, Y. F. Li, L. F. Wei

Abstract: Sensitive detection of electromagnetic wave electric field plays an important role for electromagnetic communication and sensing. Here, we propose a quantum sensor to sensitively detect the electric field of the millimeter (mm) wave. The quantum sensor consists of many surface-state electrons trapped individually on liquid helium by a scalable electrode-network at the bottom of the helium film. On… ▽ More Sensitive detection of electromagnetic wave electric field plays an important role for electromagnetic communication and sensing. Here, we propose a quantum sensor to sensitively detect the electric field of the millimeter (mm) wave. The quantum sensor consists of many surface-state electrons trapped individually on liquid helium by a scalable electrode-network at the bottom of the helium film. On such a chip, each of the trapped electrons can be manipulated by the biased dc-current to deliver the strong spin-orbit couplings. The mm wave signal to be detected is applied to non-dispersively drive the orbital states of the trapped electrons, just resulting in the Stark shifts of the dressed spin-orbital states. As a consequence, the electric field of the applied mm wave could be detected sensitively by using the spin-echo interferometry of the long-lived spin states of the electrons trapped on liquid helium. The reasonable accuracy of the detection and also the feasibility of the proposal are discussed. △ Less

Submitted 11 April, 2023; originally announced April 2023.

Comments: 8 pages

Robust phase metrology with hybrid quantum interferometers against particle losses

Authors: X. N. Feng, D. He, L. F. Wei

Abstract: Entanglement is an important quantum resource to achieve high sensitive quantum metrology. However, the rapid decoherence of quantum entangled states, due to the unavoidable environment noise, result in practically the unwanted sharp drop of the measurement sensitivity. To overcome such a difficulty, here we propose a spin-oscillator hybrid quantum interferometer to achieve the desirable precise e… ▽ More Entanglement is an important quantum resource to achieve high sensitive quantum metrology. However, the rapid decoherence of quantum entangled states, due to the unavoidable environment noise, result in practically the unwanted sharp drop of the measurement sensitivity. To overcome such a difficulty, here we propose a spin-oscillator hybrid quantum interferometer to achieve the desirable precise estimation of the parameter encoded in the vibrations of the oscillator. Differing from the conventional two-mode quantum interferometers input by the two-mode NOON state or entangled coherent states (ECS), whose achievable sensitivities are strongly limited by the decoherence of the entangled vibrational states, we demonstrate that the present interferometer, input by a spin-dependent two-mode entangled state, possesses a manifest advantage, i.e., the measurement sensitivity of the estimated parameter is not influenced by the decoherence from the spin-oscillator entanglement. This is because that, by applying a spin-oscillator disentangled operation, the information of the estimated parameter encoded originally in the vibrational degrees can be effectively transferred into the spin degree and then can be sensitively estimated by the precise spin-state population measurements. As consequence, the proposed hybrid quantum interferometer possesses a manifest robustness against the particle losses of the vibrational modes. Interestingly, the achieved phase measurement sensitivity can still surpass the SQL obviously, even if relatively large number of particle loss occurs in one of the two modes. The potential application of the proposed spin-oscillator hybrid quantum interferometer is also discussed. △ Less

Submitted 12 March, 2023; originally announced March 2023.

Early Verification of Legal Compliance via Bounded Satisfiability Checking

Authors: Nick Feng, Lina Marsso, Mehrdad Sabetzadeh, Marsha Chechik

Abstract: Legal properties involve reasoning about data values and time. Metric first-order temporal logic (MFOTL) provides a rich formalism for specifying legal properties. While MFOTL has been successfully used for verifying legal properties over operational systems via runtime monitoring, no solution exists for MFOTL-based verification in early-stage system development captured by requirements. Given a l… ▽ More Legal properties involve reasoning about data values and time. Metric first-order temporal logic (MFOTL) provides a rich formalism for specifying legal properties. While MFOTL has been successfully used for verifying legal properties over operational systems via runtime monitoring, no solution exists for MFOTL-based verification in early-stage system development captured by requirements. Given a legal property and system requirements, both formalized in MFOTL, the compliance of the property can be verified on the requirements via satisfiability checking. In this paper, we propose a practical, sound, and complete (within a given bound) satisfiability checking approach for MFOTL. The approach, based on satisfiability modulo theories (SMT), employs a counterexample-guided strategy to incrementally search for a satisfying solution. We implemented our approach using the Z3 SMT solver and evaluated it on five case studies spanning the healthcare, business administration, banking and aviation domains. Our results indicate that our approach can efficiently determine whether legal properties of interest are met, or generate counterexamples that lead to compliance violations. △ Less

Submitted 27 May, 2023; v1 submitted 8 September, 2022; originally announced September 2022.

Five-channel frequency-division multiplexing using low-loss epsilon-near-zero metamaterial waveguide

Authors: Binbin Hong, Lei Sun, Wanlin Wang, Yanbing Qiu, Naixing Feng, Dong Su, Nutapong Somjit, Ian Robertson, Guo ** Wang

Abstract: The rapidly growing global data usage has demanded more efficient ways to utilize the scarce electromagnetic spectrum resource. Recent research has focused on the development of efficient multiplexing techniques in the millimeter-wave band (1-10 mm, or 30-300 GHz) due to the promise of large available bandwidth for future wireless networks. Frequency-division multiplexing is still one of the most… ▽ More The rapidly growing global data usage has demanded more efficient ways to utilize the scarce electromagnetic spectrum resource. Recent research has focused on the development of efficient multiplexing techniques in the millimeter-wave band (1-10 mm, or 30-300 GHz) due to the promise of large available bandwidth for future wireless networks. Frequency-division multiplexing is still one of the most commonly-used techniques to maximize the transmission capacity of a wireless network. Based on the frequency-selective tunnelling effect of the low-loss epsilon-near-zero metamaterial waveguide, we numerically and experimentally demonstrate five-channel frequency-division multiplexing and demultiplexing in the millimeter-wave range. We show that this device architecture offers great flexibility to manipulate the filter Q-factors and the transmission spectra of different channels, by changing of the epsilon-near-zero metamaterial waveguide topology and by adding a standard waveguide between two epsilon-near-zero channels. This strategy of frequency-division multiplexing may pave a way for efficiently allocating the spectrum for future communication networks. △ Less

Submitted 23 June, 2022; originally announced June 2022.

Comments: 10 pages, 7 figures

Journal ref: Sci. China Phys. Mech. Astron. 65, 274211 (2022)

On the Application of Data-Driven Deep Neural Networks in Linear and Nonlinear Structural Dynamics

Authors: Nan Feng, Guodong Zhang, Kapil Khandelwal

Abstract: The use of deep neural network (DNN) models as surrogates for linear and nonlinear structural dynamical systems is explored. The goal is to develop DNN based surrogates to predict structural response, i.e., displacements and accelerations, for given input (harmonic) excitations. In particular, the focus is on the development of efficient network architectures using fully-connected, sparsely-connec… ▽ More The use of deep neural network (DNN) models as surrogates for linear and nonlinear structural dynamical systems is explored. The goal is to develop DNN based surrogates to predict structural response, i.e., displacements and accelerations, for given input (harmonic) excitations. In particular, the focus is on the development of efficient network architectures using fully-connected, sparsely-connected, and convolutional network layers, and on the corresponding training strategies that can provide a balance between the overall network complexity and prediction accuracy in the target dataspaces. For linear dynamics, sparsity patterns of the weight matrix in the network layers are used to construct convolutional DNNs with sparse layers. For nonlinear dynamics, it is shown that sparsity in network layers is lost, and efficient DNNs architectures with fully-connected and convolutional network layers are explored. A transfer learning strategy is also introduced to successfully train the proposed DNNs, and various loading factors that influence the network architectures are studied. It is shown that the proposed DNNs can be used as effective and accurate surrogates for predicting linear and nonlinear dynamical responses under harmonic loadings. △ Less

Submitted 3 November, 2021; originally announced November 2021.

Comments: 82 pages, 12 Tables, 42 Figures

Quality control tests of the front-end optical link components for the ATLAS Liquid Argon Calorimeter Phase-1 upgrade

Authors: B. Deng, J. Thomas, L. Zhang, E. Baker, A. Barsallo, M. L. Bleile, C. Chen, I. Cohen, E. Cruda, J. Fang, N. Feng, D. Gong, S. Hou, X. Huang, T. Lozano-Brown, C. Liu, T. Liu, A. Muhammad, L. A. Murphy, P. M. Price, J. H. Ray, C. Rhoades, A. H. Santhi, D. Sela, H. Sun , et al. (7 additional authors not shown)

Abstract: We present the procedures and results of the quality control tests for the front-end optical link components in the ATLAS Liquid Argon Calorimeter Phase-1 upgrade. The components include a Vertical-Cavity Surface-Emitting Laser (VCSEL) driver ASIC LOCld, custom optical transmitter/transceiver modules MTx/MTRx, and a transmitter ASIC LOCx2. LOCld, MTx, and LOCx2 each contain two channels with the s… ▽ More We present the procedures and results of the quality control tests for the front-end optical link components in the ATLAS Liquid Argon Calorimeter Phase-1 upgrade. The components include a Vertical-Cavity Surface-Emitting Laser (VCSEL) driver ASIC LOCld, custom optical transmitter/transceiver modules MTx/MTRx, and a transmitter ASIC LOCx2. LOCld, MTx, and LOCx2 each contain two channels with the same structure, while MTRx has a transmitter channel and a receiver channel. Each channel is tested at 5.12 Gbps. A total of 5341 LOCld chips, 3275 MTx modules, 797 MTRx modules, and 3198 LOCx2 chips are qualified. The yields are 73.9%, 98.0%, 98.4%, and 61.9% for LOCld, LOCx2, MTx, and MTRx, respectively. △ Less

Submitted 9 August, 2021; originally announced August 2021.

Comments: 18 pages, 17 figures

Computational frameworks for homogenization and multiscale stability analyses of nonlinear periodic metamaterials

Authors: Guodong Zhang, Nan Feng, Kapil Khandelwal

Abstract: This paper presents a consistent computational framework for multiscale 1st order finite strain homogenization and stability analyses of rate-independent solids with periodic microstructures. Based on the principle of multiscale virtual power, the homogenization formulation is built on a priori discretized microstructure, and algorithms for computing the matrix representations of the homogenized s… ▽ More This paper presents a consistent computational framework for multiscale 1st order finite strain homogenization and stability analyses of rate-independent solids with periodic microstructures. Based on the principle of multiscale virtual power, the homogenization formulation is built on a priori discretized microstructure, and algorithms for computing the matrix representations of the homogenized stresses and tangent moduli are consistently derived. The homogenization results lose their validity at the onset of 1st bifurcation, which can be computed from multiscale stability analysis. The multiscale instabilities include: a) microscale structural instability which is calculated by Bloch wave analysis; and b) macroscale material instability which is calculated by rank-1 convexity checks on the homogenized tangent moduli. Details on the implementation of the Bloch wave analysis are provided, including the selection of the wave vector space and the retrieval of the real-valued buckling mode from the complex-valued Bloch wave. Three methods are detailed for solving the resulted constrained eigenvalue problem - two condensation methods and a null-space based projection method. Both implementations of the homogenization and stability analyses are validated using numerical examples including hyperelastic and elastoplastic metamaterials. Various microscale buckling phenomena are also demonstrated by examining several representative metamaterial examples. Aligned with theoretical results, the numerical results show that the microscopic long wavelength buckling can be equivalently detected by the loss of rank-1 convexity of the homogenized tangent moduli. △ Less

Submitted 5 October, 2020; originally announced October 2020.

Comments: 75 pages, 39 Figures

Learning Unsplit-field-based PML for the FDTD Method by Deep Differentiable Forest

Authors: Yingshi Chen, Naixing Feng

Abstract: Alternative unsplit-filed-based absorbing boundary condition (ABC) computation approach for the finite-difference time-domain (FDTD) is efficiently proposed based on the deep differentiable forest. The deep differentiable forest (DDF) model is introduced to replace the conventional perfectly matched layer (PML) ABC during the computation process of FDTD. The field component data on the interface o… ▽ More Alternative unsplit-filed-based absorbing boundary condition (ABC) computation approach for the finite-difference time-domain (FDTD) is efficiently proposed based on the deep differentiable forest. The deep differentiable forest (DDF) model is introduced to replace the conventional perfectly matched layer (PML) ABC during the computation process of FDTD. The field component data on the interface of traditional PML are adopted to train the DDF-based PML model. DDF has the advantages of both trees and neural networks. Its tree structure is easy to use and explain for the numerical PML data. It has full differentiability like neural networks. DDF could be trained by powerful techniques from deep learning. So compared to the traditional PML implementation, the proposed method can greatly reduce the size of FDTD physical domain and the calculation complexity of FDTD due to the novel model which only involves the one-cell thickness of boundary layer. Numerical simulations have been carried out to benchmark the performance of the proposed approach. Numerical results illustrate that the proposed method can not only easily replace the traditional PML, but also be integrated into the FDTD computation process with satisfactory numerical accuracy and compatibility to the FDTD. △ Less

Submitted 7 April, 2020; originally announced April 2020.

Comments: 4 pages,2 figures. arXiv admin note: substantial text overlap with arXiv:2003.00223

Transmissive Metagrating for Arbitrary Wavefront Sha** Over the Full Visible Spectrum

Authors: Zi-Lan Deng, Xuan Ye, Hao-Yang Qiu, Qing-An Tu, Tan Shi, Ze-Peng Zhuang, Yaoyu Cao, Bai-Ou Guan, Naixing Feng, Guo ** Wang, Andrea Alù, Jian-Wen Dong, ** Li

Abstract: Metagratings have been shown to form an agile and efficient platform for extreme wavefront manipulation, going beyond the limitations of gradient metasurfaces. Previous approaches for transmissive metagratings have resorted on compound asymmetric inclusions to achieve single-channel near-perfect diffraction. However, such complex inclusions are sensitive to geometric parameters and lack the flexib… ▽ More Metagratings have been shown to form an agile and efficient platform for extreme wavefront manipulation, going beyond the limitations of gradient metasurfaces. Previous approaches for transmissive metagratings have resorted on compound asymmetric inclusions to achieve single-channel near-perfect diffraction. However, such complex inclusions are sensitive to geometric parameters and lack the flexibility for arbitrary phase modulation, restricting applications to beam deflection. Here, we show perfect unitary diffraction in all-dielectric transmissive metagratings using rectangular inclusions by tailoring their multipole interferences. Using this principle, we experimentally demonstrate analog phase profile encoding of a hologram through displacement modulation of CMOS-compatible silicon nitride nanobars, manifesting broadband and wide-angle high diffraction efficiencies for both polarizations and across the entire visible range. Featured with extreme angle/wavelength/polarization tolerance and alleviated structural complexity for both design and fabrication, our demonstration unlocks the full potential of metagrating-based wavefront manipulation for a variety of practical applications. △ Less

Submitted 18 March, 2020; originally announced March 2020.

Generator of Pythagorean triples and Je$\acute{s}$manowicz conjecture

Authors: Nainrong Feng

Abstract: Let $a,b,c$ be relatively prime positive integers such that $a^2+b^2=c^2, 2|b$. In this paper, we show that Pythagorean triples $(a, b,c)$ must satisfy $abc\equiv{0\; (\mod3\cdot{4}\cdot{5}})$ and $c\neq{0\; (\mod{3}})$, and we also prove that for… ▽ More Let $a,b,c$ be relatively prime positive integers such that $a^2+b^2=c^2, 2|b$. In this paper, we show that Pythagorean triples $(a, b,c)$ must satisfy $abc\equiv{0\; (\mod3\cdot{4}\cdot{5}})$ and $c\neq{0\; (\mod{3}})$, and we also prove that for $(a,b,c)\in\{(a,b,c)|a\equiv{0\;(\mod{3}}),b\equiv{0\;(\mod{4}}),c\equiv{0\; (\mod{5}})\}\bigcup\{(a,b,c)|b\equiv{0\;(\mod{12}}),c\equiv{0\;(\mod{5}})\}$, the only solution of $$a^x+b^y=c^z\qquad{z},y,z\in{N}$$ in positive integers is $(x, y, z) = (2, 2,2)$. △ Less

Submitted 23 January, 2020; originally announced January 2020.

MSC Class: 11D61

Uniform attractors of non-autonomous Kirchhoff wave models

Authors: Zhijian Yang, Yanan Li, Na Feng

Abstract: The paper investigates the existence and upper semicontinuity of uniform attractors of the perturbed non-autonomous Kirchhoff wave equations with strong dam** and supercritical nonlinearity: $u_{tt}-Δu_{t}-(1+ε\|\nabla u\|^{2})Δu+f(u)=g(x,t)$, where $ε\in [0,1]$ is a perturbed parameter. It shows that when the nonlinearity $f(u)$ is of supercritical growth… ▽ More The paper investigates the existence and upper semicontinuity of uniform attractors of the perturbed non-autonomous Kirchhoff wave equations with strong dam** and supercritical nonlinearity: $u_{tt}-Δu_{t}-(1+ε\|\nabla u\|^{2})Δu+f(u)=g(x,t)$, where $ε\in [0,1]$ is a perturbed parameter. It shows that when the nonlinearity $f(u)$ is of supercritical growth $p: \frac{N+2}{N-2}=p^*<p<p^{**}=\frac{N+4}{(N-4)^+}$: (i) the related evolution process has a compact uniform attractor $\mathcal{A}_\ls^\e $ for each $ε\in [0,1]$; (ii) the family of uniform attractor $\mathcal{A}_\ls^\e $ is upper semicontinuous on the perturbed parameter $ε$ in the sense of partially strong topology. △ Less

Submitted 18 August, 2019; originally announced August 2019.

Substrate Integrated Bragg Waveguide: an Octave-bandwidth Single-mode Functional Transmission-Line for Millimeter-Wave and Terahertz Applications

Authors: Binbin Hong, Naixing Feng, **g Chen, Guo ** Wang, Viktor Doychinov, Roland Clarke, Nutapong Somjit, John Cunningham, Ian Robertson

Abstract: We demonstrate an air-core single-mode hollow waveguide that uses Bragg reflector structures in place of the vertical metal walls of the standard rectangular waveguide or via holes of the so-called substrate integrated waveguide. The high-order modes in the waveguide are substantially suppressed by a modal-filtering effect, making the waveguide operate in the fundamental mode over more than one oc… ▽ More We demonstrate an air-core single-mode hollow waveguide that uses Bragg reflector structures in place of the vertical metal walls of the standard rectangular waveguide or via holes of the so-called substrate integrated waveguide. The high-order modes in the waveguide are substantially suppressed by a modal-filtering effect, making the waveguide operate in the fundamental mode over more than one octave. Numerical simulations show that the propagation loss of the proposed waveguide can be lower than that of classic hollow metallic rectangular waveguides at terahertz frequencies, benefiting from a significant reduction in Ohmic loss. To facilitate fabrication and characterization, a proof-of-concept 20 to 45 GHz waveguide is demonstrated, which verifies the properties and advantages of the proposed waveguide. A zero group-velocity dispersion point is observed at near the middle of the operating band. This work offers a step towards a novel hybrid transmission-line medium that can be used in a variety of functional components for broadband millimeter-wave and terahertz applications. △ Less

Submitted 2 September, 2019; v1 submitted 19 May, 2019; originally announced May 2019.

Comments: 11 pages, 9 figures, journal article

Compact optical phased array using a serial grating antenna design

Authors: Lingxuan Zhang, Xiaochen Sun, Wenfu Zhang, Guoxi Wang, Ningning Feng, Wei Zhao

Abstract: We propose an on-chip Si photonics optical phased array based on a serial grating design which eliminates the use of directional couplers in previous designs. It significantly reduces overall phased array size especially when the number of the antenna is small which is often demanded in practice. The simulation results show our design reduces overall phased array size, increases optical power util… ▽ More We propose an on-chip Si photonics optical phased array based on a serial grating design which eliminates the use of directional couplers in previous designs. It significantly reduces overall phased array size especially when the number of the antenna is small which is often demanded in practice. The simulation results show our design reduces overall phased array size, increases optical power utilization while maintains comparable far field performance. △ Less

Submitted 16 February, 2019; originally announced March 2019.

Possible structural origin of superconductivity in Sr-doped Bi2Se3

Authors: Zhuojun Li, Meng Wang, Dejiong Zhang, Nan Feng, Wenxiang Jiang, Chaoqun Han, Weijiong Chen, Mao Ye, Chunlei Gao, **feng Jia, Jixue Li, Shan Qiao, Dong Qian, Ben Xu, He Tian, Bo Gao

Abstract: Do** bismuth selenide (Bi2Se3) with elements such as copper and strontium (Sr) can induce superconductivity, making the doped materials interesting candidates to explore potential topological superconducting behaviors. It was thought that the superconductivity of doped Bi2Se3 was induced by dopant atoms intercalated in van der Waals gaps. However, several experiments have shown that the intercal… ▽ More Do** bismuth selenide (Bi2Se3) with elements such as copper and strontium (Sr) can induce superconductivity, making the doped materials interesting candidates to explore potential topological superconducting behaviors. It was thought that the superconductivity of doped Bi2Se3 was induced by dopant atoms intercalated in van der Waals gaps. However, several experiments have shown that the intercalation of dopant atoms may not necessarily make doped Bi2Se3 superconducting. Thus, the structural origin of superconductivity in doped Bi2Se3 remains an open question. Herein, we combined material synthesis and characterization, high-resolution transmission electron microscopy, and first-principles calculations to study the do** structure of Sr-doped Bi2Se3. We found that the emergence of superconductivity is strongly related with n-type dopant atoms. Atomic-level energy-dispersive X-ray map** revealed various n-type Sr dopants that occupy intercalated and interstitial positions. First-principles calculations showed that the formation energy of a specific interstitial Sr do** position depends strongly on Sr do** level. This site changes from a metastable position at low Sr do** level to a stable position at high Sr do** level. The calculation results explain why quenching is necessary to obtain superconducting samples when the Sr do** level is low and also why slow furnace cooling can yield superconducting samples when the Sr do** level is high. Our findings suggest that Sr atoms doped at interstitial locations, instead of those intercalated in van der Waals gaps, are most likely to be responsible for the emergence of superconductivity in Sr-doped Bi2Se3. △ Less

Submitted 7 March, 2018; originally announced March 2018.

Comments: 21 pages, 4 figures

Journal ref: Phys. Rev. Materials 2, 014201(2018)

All of zeros of Riemann's Zeta-Function are on $σ$=1/2

Authors: Nianrong Feng, Yongzheng Wang

Abstract: The research shows that Riemann proved that all of zeros of Riemann's zeta function are on $σ=1/2$ based on the functional equation \begin{align*} π^{-\frac{s}{2}}Γ\left( \frac{s}{2} \right) ζ(s)&={\frac{1}{s(s-1)} + \int\limits_1^\infty ψ(x) \left( x^{\frac{s}{2} - 1} + x^{-\frac{1+s}{2}} \right) \,dx,}\quad\qquad{s}=σ+it, \end{align*} which is in Riemann's ``Über die Anzahl der Primzahlen… ▽ More The research shows that Riemann proved that all of zeros of Riemann's zeta function are on $σ=1/2$ based on the functional equation \begin{align*} π^{-\frac{s}{2}}Γ\left( \frac{s}{2} \right) ζ(s)&={\frac{1}{s(s-1)} + \int\limits_1^\infty ψ(x) \left( x^{\frac{s}{2} - 1} + x^{-\frac{1+s}{2}} \right) \,dx,}\quad\qquad{s}=σ+it, \end{align*} which is in Riemann's ``Über die Anzahl der Primzahlen unter einer gegebenen Grosse". According to the geometric meaning of the functional equation and the argument principle, we obtain the number of zeros $N_0(T)$ of the Riemann zeta function on the critical segment $σ=1/2,0\leq{t}\leq{T}$ and the number of zeros $N(T)$ of the Riemann zeta function in the rectangular region $-1\leqσ\leq{2},0\leq{t}\leq{T}$, respectively. The result is \begin{align*} N(T)&=N_0(T)=\frac{\arg{\left[π^{-\frac{s}{2}}Γ\left(\frac{s}{2} \right)ζ(s)\right]}}π+1\\ &=\frac{T}{2π}\log\frac{T}{2π}-\frac{T}{2π}+O(\log{T}),\qquad{s=1/2+iT}. \end{align*} △ Less

Submitted 3 November, 2022; v1 submitted 6 August, 2015; originally announced August 2015.

Comments: AMS-LaTeX v2.2, 11 pages

MSC Class: 11M06; 11M26; 11H05