-
Systematic interval observer design for linear systems
Authors:
Thach Ngoc Dinh,
Gia Quoc Bao Tran
Abstract:
We first propose systematic and comprehensive interval observer designs for linear time-invariant systems, under standard assumptions involving observability and interval bounds on the initial condition and disturbances. Historically, such designs rely on transformations with certain limitations into a form that is Metzler (for continuous time) or non-negative (for discrete time). We show that the…
▽ More
We first propose systematic and comprehensive interval observer designs for linear time-invariant systems, under standard assumptions involving observability and interval bounds on the initial condition and disturbances. Historically, such designs rely on transformations with certain limitations into a form that is Metzler (for continuous time) or non-negative (for discrete time). We show that they can be effectively replaced with a linear time-invariant transformation that can be easily computed offline. Then, we propose the extension to the time-varying setting, where conventional transformations lack guaranteed outcomes. Academic examples are presented to illustrate our methods.
△ Less
Submitted 22 May, 2024; v1 submitted 10 May, 2024;
originally announced May 2024.
-
A Unified KKL-based Interval Observer for Nonlinear Discrete-time Systems
Authors:
Thach Ngoc Dinh,
Gia Quoc Bao Tran
Abstract:
This work proposes an interval observer design for nonlinear discrete-time systems based on the Kazantzis-Kravaris/Luenberger (KKL) paradigm. Our design extends to generic nonlinear systems without any assumption on the structure of its dynamics and output maps. Relying on a transformation putting the system into a target form where an interval observer can be directly designed, we then propose a…
▽ More
This work proposes an interval observer design for nonlinear discrete-time systems based on the Kazantzis-Kravaris/Luenberger (KKL) paradigm. Our design extends to generic nonlinear systems without any assumption on the structure of its dynamics and output maps. Relying on a transformation putting the system into a target form where an interval observer can be directly designed, we then propose a method to reconstruct the bounds in the original coordinates using the bounds in the target coordinates, thanks to the Lipschitz injectivity of this transformation achieved under Lipschitz distinguishability when the target dynamics have a high enough dimension and are pushed sufficiently fast. An academic example serves to illustrate our methods.
△ Less
Submitted 27 April, 2024; v1 submitted 25 January, 2024;
originally announced January 2024.
-
Quantitative diffraction imaging using attosecond pulses
Authors:
G. N. Tran,
Katsumi Midorikawa,
Eiji J. Takahashi
Abstract:
We have proposed and developed a method to utilize attosecond pulses in diffraction imaging techniques applied to complex samples. In this study, the effects of the broadband properties of the wavefield owing to attosecond pulses are considered in the reconstruction of images through the decomposition of the broad spectrum into multi-spectral components. This method successfully reconstructs the m…
▽ More
We have proposed and developed a method to utilize attosecond pulses in diffraction imaging techniques applied to complex samples. In this study, the effects of the broadband properties of the wavefield owing to attosecond pulses are considered in the reconstruction of images through the decomposition of the broad spectrum into multi-spectral components. This method successfully reconstructs the multi-spectral information of complex samples, probes, and spectral bandwidths using broadband diffraction intensities generated from computational scanning experiments. The results obtained in this research open the opportunities to perform quantitative ultrafast imaging using the attosecond pulses.
△ Less
Submitted 29 November, 2023;
originally announced November 2023.
-
Mechanistically-guided materials chemistry: synthesis of new ternary nitrides, CaZrN$_2$ and CaHfN$_2$
Authors:
Christopher L. Rom,
Andrew Novick,
Matthew J. McDermott,
Andrey A. Yakovenko,
Jessica R. Gallawa,
Gia Thinh Tran,
Dominic C. Asebiah,
Emily N. Storck,
Brennan C. McBride,
Rebecca C. Miller,
Amy L. Prieto,
Kristin A. Persson,
Eric Toberer,
Vladan Stevanović,
Andriy Zakutayev,
James R. Neilson
Abstract:
Recent computational studies have predicted many new ternary nitrides, revealing synthetic opportunities in this underexplored phase space. However, synthesizing new ternary nitrides is difficult, in part because intermediate and product phases often have high cohesive energies that inhibit diffusion. Here, we report the synthesis of two new phases, calcium zirconium nitride (CaZrN$_2$) and calciu…
▽ More
Recent computational studies have predicted many new ternary nitrides, revealing synthetic opportunities in this underexplored phase space. However, synthesizing new ternary nitrides is difficult, in part because intermediate and product phases often have high cohesive energies that inhibit diffusion. Here, we report the synthesis of two new phases, calcium zirconium nitride (CaZrN$_2$) and calcium hafnium nitride (CaHfN$_2$), by solid state metathesis reactions between Ca$_3$N$_2$ and $M$Cl$_4$ ($M$ = Zr, Hf). Although the reaction nominally proceeds to the target phases in a 1:1 ratio of the precursors via Ca$_3$N$_2$ + $M$Cl$_4$ $\rightarrow$ Ca$M$N$_2$ + 2 CaCl$_2$, reactions prepared this way result in Ca-poor materials (Ca$_xM_{2-x}$N$_2$, $x<1$). A small excess of Ca$_3$N$_2$ (ca. 20 mol\%) is needed to yield stoichiometric Ca$M$N$_2$, as confirmed by high-resolution synchrotron powder X-ray diffraction. In situ synchrotron X-ray diffraction studies reveal that nominally stoichiometric reactions produce Zr$^{3+}$ intermediates early in the reaction pathway, and the excess Ca$_3$N$_2$ is needed to reoxidize Zr$^{3+}$ intermediates back to the Zr$^{4+}$ oxidation state of CaZrN$_2$. Analysis of computationally-derived chemical potential diagrams rationalizes this synthetic approach and its contrast from the synthesis of MgZrN$_2$. These findings additionally highlight the utility of in situ diffraction studies and computational thermochemistry to provide mechanistic guidance for synthesis.
△ Less
Submitted 30 October, 2023;
originally announced October 2023.
-
Fast Multipole Attention: A Divide-and-Conquer Attention Mechanism for Long Sequences
Authors:
Yanming Kang,
Giang Tran,
Hans De Sterck
Abstract:
Transformer-based models have achieved state-of-the-art performance in many areas. However, the quadratic complexity of self-attention with respect to the input length hinders the applicability of Transformer-based models to long sequences. To address this, we present Fast Multipole Attention, a new attention mechanism that uses a divide-and-conquer strategy to reduce the time and memory complexit…
▽ More
Transformer-based models have achieved state-of-the-art performance in many areas. However, the quadratic complexity of self-attention with respect to the input length hinders the applicability of Transformer-based models to long sequences. To address this, we present Fast Multipole Attention, a new attention mechanism that uses a divide-and-conquer strategy to reduce the time and memory complexity of attention for sequences of length $n$ from $\mathcal{O}(n^2)$ to $\mathcal{O}(n \log n)$ or $O(n)$, while retaining a global receptive field. The hierarchical approach groups queries, keys, and values into $\mathcal{O}( \log n)$ levels of resolution, where groups at greater distances are increasingly larger in size and the weights to compute group quantities are learned. As such, the interaction between tokens far from each other is considered in lower resolution in an efficient hierarchical manner. The overall complexity of Fast Multipole Attention is $\mathcal{O}(n)$ or $\mathcal{O}(n \log n)$, depending on whether the queries are down-sampled or not. This multi-level divide-and-conquer strategy is inspired by fast summation methods from $n$-body physics and the Fast Multipole Method. We perform evaluation on autoregressive and bidirectional language modeling tasks and compare our Fast Multipole Attention model with other efficient attention variants on medium-size datasets. We find empirically that the Fast Multipole Transformer performs much better than other efficient transformers in terms of memory size and accuracy. The Fast Multipole Attention mechanism has the potential to empower large language models with much greater sequence lengths, taking the full context into account in an efficient, naturally hierarchical manner during training and when generating long sequences.
△ Less
Submitted 20 October, 2023; v1 submitted 18 October, 2023;
originally announced October 2023.
-
Diffusion Random Feature Model
Authors:
Esha Saha,
Giang Tran
Abstract:
Diffusion probabilistic models have been successfully used to generate data from noise. However, most diffusion models are computationally expensive and difficult to interpret with a lack of theoretical justification. Random feature models on the other hand have gained popularity due to their interpretability but their application to complex machine learning tasks remains limited. In this work, we…
▽ More
Diffusion probabilistic models have been successfully used to generate data from noise. However, most diffusion models are computationally expensive and difficult to interpret with a lack of theoretical justification. Random feature models on the other hand have gained popularity due to their interpretability but their application to complex machine learning tasks remains limited. In this work, we present a diffusion model-inspired deep random feature model that is interpretable and gives comparable numerical results to a fully connected neural network having the same number of trainable parameters. Specifically, we extend existing results for random features and derive generalization bounds between the distribution of sampled data and the true distribution using properties of score matching. We validate our findings by generating samples on the fashion MNIST dataset and instrumental audio data.
△ Less
Submitted 8 October, 2023; v1 submitted 6 October, 2023;
originally announced October 2023.
-
Assessing Thermodynamic Selectivity of Solid-State Reactions for the Predictive Synthesis of Inorganic Materials
Authors:
Matthew J. McDermott,
Brennan C. McBride,
Corlyn Regier,
Gia Thinh Tran,
Yu Chen,
Adam A. Corrao,
Max C. Gallant,
Gabrielle E. Kamm,
Christopher J. Bartel,
Karena W. Chapman,
Peter G. Khalifah,
Gerbrand Ceder,
James R. Neilson,
Kristin A. Persson
Abstract:
Synthesis is a major challenge in the discovery of new inorganic materials. Currently, there is limited theoretical guidance for identifying optimal solid-state synthesis procedures. We introduce two selectivity metrics, primary and secondary competition, to assess the favorability of target/impurity phase formation in solid-state reactions. We used these metrics to analyze 3,520 solid-state react…
▽ More
Synthesis is a major challenge in the discovery of new inorganic materials. Currently, there is limited theoretical guidance for identifying optimal solid-state synthesis procedures. We introduce two selectivity metrics, primary and secondary competition, to assess the favorability of target/impurity phase formation in solid-state reactions. We used these metrics to analyze 3,520 solid-state reactions in the literature, ranking existing approaches to popular target materials. Additionally, we implemented these metrics in a data-driven synthesis planning workflow and demonstrated its application in the synthesis of barium titanate (BaTiO$_3$). Using an 18-element chemical reaction network with first-principles thermodynamic data from the Materials Project, we identified 82,985 possible BaTiO$_3$ synthesis reactions and selected nine for experimental testing. Characterization of reaction pathways via synchrotron powder X-ray diffraction reveals that our selectivity metrics correlate with observed target/impurity formation. We discovered two efficient reactions using unconventional precursors (BaS/BaCl$_2$ and Na$_2$TiO$_3$) that produce BaTiO$_3$ faster and with fewer impurities than conventional methods, highlighting the importance of considering complex chemistries with additional elements during precursor selection. Our framework provides a foundation for predictive inorganic synthesis, facilitating the optimization of existing recipes and the discovery of new materials, including those not easily attainable with conventional precursors.
△ Less
Submitted 27 September, 2023; v1 submitted 22 August, 2023;
originally announced August 2023.
-
Hessian-Aware Bayesian Optimization for Decision Making Systems
Authors:
Mohit Rajpal,
Lac Gia Tran,
Yehong Zhang,
Bryan Kian Hsiang Low
Abstract:
Many approaches for optimizing decision making systems rely on gradient based methods requiring informative feedback from the environment. However, in the case where such feedback is sparse or uninformative, such approaches may result in poor performance. Derivative-free approaches such as Bayesian Optimization mitigate the dependency on the quality of gradient feedback, but are known to scale poo…
▽ More
Many approaches for optimizing decision making systems rely on gradient based methods requiring informative feedback from the environment. However, in the case where such feedback is sparse or uninformative, such approaches may result in poor performance. Derivative-free approaches such as Bayesian Optimization mitigate the dependency on the quality of gradient feedback, but are known to scale poorly in the high-dimension setting of complex decision making systems. This problem is exacerbated if the system requires interactions between several actors cooperating to accomplish a shared goal. To address the dimensionality challenge, we propose a compact multi-layered architecture modeling the dynamics of actor interactions through the concept of role. We introduce Hessian-aware Bayesian Optimization to efficiently optimize the multi-layered architecture parameterized by a large number of parameters, and give the first improved regret bound in additive high-dimensional Bayesian Optimization since Mutny & Krause (2018). Our approach shows strong empirical results under malformed or sparse reward.
△ Less
Submitted 1 December, 2023; v1 submitted 1 August, 2023;
originally announced August 2023.
-
Benchmarking Jetson Edge Devices with an End-to-end Video-based Anomaly Detection System
Authors:
Hoang Viet Pham,
Thinh Gia Tran,
Chuong Dinh Le,
An Dinh Le,
Hien Bich Vo
Abstract:
Innovative enhancement in embedded system platforms, specifically hardware accelerations, significantly influence the application of deep learning in real-world scenarios. These innovations translate human labor efforts into automated intelligent systems employed in various areas such as autonomous driving, robotics, Internet-of-Things (IoT), and numerous other impactful applications. NVIDIA's Jet…
▽ More
Innovative enhancement in embedded system platforms, specifically hardware accelerations, significantly influence the application of deep learning in real-world scenarios. These innovations translate human labor efforts into automated intelligent systems employed in various areas such as autonomous driving, robotics, Internet-of-Things (IoT), and numerous other impactful applications. NVIDIA's Jetson platform is one of the pioneers in offering optimal performance regarding energy efficiency and throughput in the execution of deep learning algorithms. Previously, most benchmarking analysis was based on 2D images with a single deep learning model for each comparison result. In this paper, we implement an end-to-end video-based crime-scene anomaly detection system inputting from surveillance videos and the system is deployed and completely operates on multiple Jetson edge devices (Nano, AGX Xavier, Orin Nano). The comparison analysis includes the integration of Torch-TensorRT as a software developer kit from NVIDIA for the model performance optimisation. The system is built based on the PySlowfast open-source project from Facebook as the coding template. The end-to-end system process comprises the videos from camera, data preprocessing pipeline, feature extractor and the anomaly detection. We provide the experience of an AI-based system deployment on various Jetson Edge devices with Docker technology. Regarding anomaly detectors, a weakly supervised video-based deep learning model called Robust Temporal Feature Magnitude Learning (RTFM) is applied in the system. The approach system reaches 47.56 frames per second (FPS) inference speed on a Jetson edge device with only 3.11 GB RAM usage total. We also discover the promising Jetson device that the AI system achieves 15% better performance than the previous version of Jetson devices while consuming 50% less energy power.
△ Less
Submitted 12 September, 2023; v1 submitted 28 July, 2023;
originally announced July 2023.
-
Sheaf-theoretic self-filtering network of low-cost sensors for local air quality monitoring: A causal approach
Authors:
Anh-Duy Pham,
Chuong Dinh Le,
Hoang Viet Pham,
Thinh Gia Tran,
Dat Thanh Vo,
Chau Long Tran,
An Dinh Le,
Hien Bich Vo
Abstract:
Sheaf theory, which is a complex but powerful tool supported by topological theory, offers more flexibility and precision than traditional graph theory when it comes to modeling relationships between multiple features. In the realm of air quality monitoring, this can be incredibly useful in detecting sudden changes in local dust particle density, which can be difficult to accurately measure using…
▽ More
Sheaf theory, which is a complex but powerful tool supported by topological theory, offers more flexibility and precision than traditional graph theory when it comes to modeling relationships between multiple features. In the realm of air quality monitoring, this can be incredibly useful in detecting sudden changes in local dust particle density, which can be difficult to accurately measure using commercial instruments. Traditional methods for air quality measurement often rely on calibrating the measurement with public standard instruments or calculating the measurements moving average over a constant period. However, this can lead to an incorrect index at the measurement location, as well as an oversmoothing effect on the signal. In this study, we propose a compact device that uses sheaf theory to detect and count vehicles as a local air quality change-causing factor. By inferring the number of vehicles into the PM2.5 index and propagating it into the recorded PM2.5 index from low-cost air monitoring sensors such as PMS7003 and BME280, we can achieve self-correction in real-time. Plus, the sheaf-theoretic method allows for easy scaling to multiple nodes for further filtering effects. By implementing sheaf theory in air quality monitoring, we can overcome the limitations of traditional methods and provide more accurate and reliable results.
△ Less
Submitted 29 December, 2022;
originally announced December 2022.
-
Scalable, low-cost, and versatile system design for air pollution and traffic density monitoring and analysis
Authors:
Thinh Gia Tran,
Dat Thanh Vo,
Long Chau Tran,
Hoang Viet Pham,
Chuong Dinh Le,
An Dinh Le,
Duy Anh Pham,
Hien Bich Vo
Abstract:
Vietnam requires a sustainable urbanization, for which city sensing is used in planning and de-cision-making. Large cities need portable, scalable, and inexpensive digital technology for this purpose. End-to-end air quality monitoring companies such as AirVisual and Plume Air have shown their reliability with portable devices outfitted with superior air sensors. They are pricey, yet homeowners use…
▽ More
Vietnam requires a sustainable urbanization, for which city sensing is used in planning and de-cision-making. Large cities need portable, scalable, and inexpensive digital technology for this purpose. End-to-end air quality monitoring companies such as AirVisual and Plume Air have shown their reliability with portable devices outfitted with superior air sensors. They are pricey, yet homeowners use them to get local air data without evaluating the causal effect. Our air quality inspection system is scalable, reasonably priced, and flexible. Minicomputer of the sys-tem remotely monitors PMS7003 and BME280 sensor data through a microcontroller processor. The 5-megapixel camera module enables researchers to infer the causal relationship between traffic intensity and dust concentration. The design enables inexpensive, commercial-grade hardware, with Azure Blob storing air pollution data and surrounding-area imagery and pre-venting the system from physically expanding. In addition, by including an air channel that re-plenishes and distributes temperature, the design improves ventilation and safeguards electrical components. The gadget allows for the analysis of the correlation between traffic and air quali-ty data, which might aid in the establishment of sustainable urban development plans and poli-cies.
△ Less
Submitted 8 December, 2022;
originally announced December 2022.
-
SPADE4: Sparsity and Delay Embedding based Forecasting of Epidemics
Authors:
Esha Saha,
Lam Si Tung Ho,
Giang Tran
Abstract:
Predicting the evolution of diseases is challenging, especially when the data availability is scarce and incomplete. The most popular tools for modelling and predicting infectious disease epidemics are compartmental models. They stratify the population into compartments according to health status and model the dynamics of these compartments using dynamical systems. However, these predefined system…
▽ More
Predicting the evolution of diseases is challenging, especially when the data availability is scarce and incomplete. The most popular tools for modelling and predicting infectious disease epidemics are compartmental models. They stratify the population into compartments according to health status and model the dynamics of these compartments using dynamical systems. However, these predefined systems may not capture the true dynamics of the epidemic due to the complexity of the disease transmission and human interactions. In order to overcome this drawback, we propose Sparsity and Delay Embedding based Forecasting (SPADE4) for predicting epidemics. SPADE4 predicts the future trajectory of an observable variable without the knowledge of the other variables or the underlying system. We use random features model with sparse regression to handle the data scarcity issue and employ Takens' delay embedding theorem to capture the nature of the underlying system from the observed variable. We show that our approach outperforms compartmental models when applied to both simulated and real data.
△ Less
Submitted 13 June, 2023; v1 submitted 11 November, 2022;
originally announced November 2022.
-
SRMD: Sparse Random Mode Decomposition
Authors:
Nicholas Richardson,
Hayden Schaeffer,
Giang Tran
Abstract:
Signal decomposition and multiscale signal analysis provide many useful tools for time-frequency analysis. We proposed a random feature method for analyzing time-series data by constructing a sparse approximation to the spectrogram. The randomization is both in the time window locations and the frequency sampling, which lowers the overall sampling and computational cost. The sparsification of the…
▽ More
Signal decomposition and multiscale signal analysis provide many useful tools for time-frequency analysis. We proposed a random feature method for analyzing time-series data by constructing a sparse approximation to the spectrogram. The randomization is both in the time window locations and the frequency sampling, which lowers the overall sampling and computational cost. The sparsification of the spectrogram leads to a sharp separation between time-frequency clusters which makes it easier to identify intrinsic modes, and thus leads to a new data-driven mode decomposition. The applications include signal representation, outlier removal, and mode decomposition. On the benchmark tests, we show that our approach outperforms other state-of-the-art decomposition methods.
△ Less
Submitted 15 March, 2023; v1 submitted 12 April, 2022;
originally announced April 2022.
-
Coexistence of Surface Lattice Resonances and Bound states In the Continuum in a Plasmonic Lattice
Authors:
Quoc Trung Trinh,
Sy Khiem Nguyen,
Dinh Hai Nguyen,
Gia Khanh Tran,
Viet Hoang Le,
Hai Son Nguyen,
Quynh Le-Van
Abstract:
We present a numerical study on a 2D array of plasmonic structures covered by a subwavelength film. We explain the origin of surface lattice resonances (SLRs) using coupled dipole approximation and show that the diffraction-assisted plasmonic resonances and formation of bound states in the continuum (BICs) can be controlled by altering the optical environment. Our study shows that when the refract…
▽ More
We present a numerical study on a 2D array of plasmonic structures covered by a subwavelength film. We explain the origin of surface lattice resonances (SLRs) using coupled dipole approximation and show that the diffraction-assisted plasmonic resonances and formation of bound states in the continuum (BICs) can be controlled by altering the optical environment. Our study shows that when the refractive index contrast is small ( $Δ$n < -0.1), the SLR cannot be excited, while a significant contrast ($Δ$n > 0.3) not only sustains plasmonic-induced resonances but also forms both symmetry-protected and accidental BICs. The results can aid the streamlined design of plasmonic lattices in studies on light-matter interaction and applications in biosensors and optoelectronic devices.
△ Less
Submitted 28 March, 2022;
originally announced March 2022.
-
HARFE: Hard-Ridge Random Feature Expansion
Authors:
Esha Saha,
Hayden Schaeffer,
Giang Tran
Abstract:
We propose a random feature model for approximating high-dimensional sparse additive functions called the hard-ridge random feature expansion method (HARFE). This method utilizes a hard-thresholding pursuit-based algorithm applied to the sparse ridge regression (SRR) problem to approximate the coefficients with respect to the random feature matrix. The SRR formulation balances between obtaining sp…
▽ More
We propose a random feature model for approximating high-dimensional sparse additive functions called the hard-ridge random feature expansion method (HARFE). This method utilizes a hard-thresholding pursuit-based algorithm applied to the sparse ridge regression (SRR) problem to approximate the coefficients with respect to the random feature matrix. The SRR formulation balances between obtaining sparse models that use fewer terms in their representation and ridge-based smoothing that tend to be robust to noise and outliers. In addition, we use a random sparse connectivity pattern in the random feature matrix to match the additive function assumption. We prove that the HARFE method is guaranteed to converge with a given error bound depending on the noise and the parameters of the sparse ridge regression model. Based on numerical results on synthetic data as well as on real datasets, the HARFE approach obtains lower (or comparable) error than other state-of-the-art algorithms.
△ Less
Submitted 2 May, 2023; v1 submitted 6 February, 2022;
originally announced February 2022.
-
nmfMap**: a cloud-based web application for non-negative matrix factorization of powder diffraction and pair distribution function datasets
Authors:
Zachary Thatcher,
Chia-Hao Liu,
Long Yang,
Brennan C. McBride,
Gia Thinh Tran,
Allison Wustrow,
Martin A. Karlsen,
James R. Neilson,
Dorthe B. Ravnsbæk,
Simon J. L. Billinge
Abstract:
A cloud-hosted web-based software application, nmfMap**, for carrying out a nonnegative matrix factorization of a set of powder diffraction or atomic pair distribution function datasets is described. This app allows structure scientists to rapidly find trends in sets of related data such as from in situ and operando diffraction experiments. The application is easy to use and does not require any…
▽ More
A cloud-hosted web-based software application, nmfMap**, for carrying out a nonnegative matrix factorization of a set of powder diffraction or atomic pair distribution function datasets is described. This app allows structure scientists to rapidly find trends in sets of related data such as from in situ and operando diffraction experiments. The application is easy to use and does not require any programming expertise. It is available at the pdfitc.org website.
△ Less
Submitted 25 December, 2021;
originally announced December 2021.
-
Observation and modelling of Stimulated Raman Scattering driven by an optically smoothed laser beam in experimental conditions relevant for Shock Ignition
Authors:
G. Cristoforetti,
S. Huller,
P. Koester,
L. Antonelli,
S. Atzeni,
F. Baffigi,
D. Batani,
C. Baird,
N. Booth,
M. Galimberti,
K. Glize,
A. Heron,
M. Khan,
P. Loiseau,
D. Mancelli,
M. Notley,
P. Oliveira,
O. Renner,
M. Smid,
A. Schiavi,
G. Tran,
N. C. Woolsey,
L. A. Gizzi
Abstract:
We report results and modelling of an experiment performed at the TAW Vulcan laser facility, aimed at investigating laser-plasma interaction in conditions which are of interest for the Shock Ignition scheme to Inertial Confinement Fusion, i.e. laser intensity higher than 10^16 W/cm2 im**ing on a hot (T > 1 keV), inhomogeneous and long scalelength preformed plasma. Measurements show a significant…
▽ More
We report results and modelling of an experiment performed at the TAW Vulcan laser facility, aimed at investigating laser-plasma interaction in conditions which are of interest for the Shock Ignition scheme to Inertial Confinement Fusion, i.e. laser intensity higher than 10^16 W/cm2 im**ing on a hot (T > 1 keV), inhomogeneous and long scalelength preformed plasma. Measurements show a significant SRS backscattering (4 - 20% of laser energy) driven at low plasma densities and no signatures of TPD/SRS driven at the quarter critical density region. Results are satisfactorily reproduced by an analytical model accounting for the convective SRS growth in independent laser speckles, in conditions where the reflectivity is dominated by the contribution from the most intense speckles, where SRS gets saturated. Analytical and kinetic simulations well reproduce the onset of SRS at low plasma densities in a regime strongly affected by non linear Landau dam** and by filamentation of the most intense laser speckles. The absence of TPD/SRS at higher densities is explained by pump depletion and plasma smoothing driven by filamentation. The prevalence of laser coupling in the low density profile justifies the low temperature measured for hot electrons (7 - 12 keV), well reproduced by numerical simulations.
△ Less
Submitted 30 August, 2021;
originally announced August 2021.
-
Adaptive Group Lasso Neural Network Models for Functions of Few Variables and Time-Dependent Data
Authors:
Lam Si Tung Ho,
Nicholas Richardson,
Giang Tran
Abstract:
In this paper, we propose an adaptive group Lasso deep neural network for high-dimensional function approximation where input data are generated from a dynamical system and the target function depends on few active variables or few linear combinations of variables. We approximate the target function by a deep neural network and enforce an adaptive group Lasso constraint to the weights of a suitabl…
▽ More
In this paper, we propose an adaptive group Lasso deep neural network for high-dimensional function approximation where input data are generated from a dynamical system and the target function depends on few active variables or few linear combinations of variables. We approximate the target function by a deep neural network and enforce an adaptive group Lasso constraint to the weights of a suitable hidden layer in order to represent the constraint on the target function. We utilize the proximal algorithm to optimize the penalized loss function. Using the non-negative property of the Bregman distance, we prove that the proposed optimization procedure achieves loss decay. Our empirical studies show that the proposed method outperforms recent state-of-the-art methods including the sparse dictionary matrix method, neural networks with or without group Lasso penalty.
△ Less
Submitted 3 December, 2021; v1 submitted 24 August, 2021;
originally announced August 2021.
-
Generalization Bounds for Sparse Random Feature Expansions
Authors:
Abolfazl Hashemi,
Hayden Schaeffer,
Robert Shi,
Ufuk Topcu,
Giang Tran,
Rachel Ward
Abstract:
Random feature methods have been successful in various machine learning tasks, are easy to compute, and come with theoretical accuracy bounds. They serve as an alternative approach to standard neural networks since they can represent similar function spaces without a costly training phase. However, for accuracy, random feature methods require more measurements than trainable parameters, limiting t…
▽ More
Random feature methods have been successful in various machine learning tasks, are easy to compute, and come with theoretical accuracy bounds. They serve as an alternative approach to standard neural networks since they can represent similar function spaces without a costly training phase. However, for accuracy, random feature methods require more measurements than trainable parameters, limiting their use for data-scarce applications or problems in scientific machine learning. This paper introduces the sparse random feature expansion to obtain parsimonious random feature models. Specifically, we leverage ideas from compressive sensing to generate random feature expansions with theoretical guarantees even in the data-scarce setting. In particular, we provide generalization bounds for functions in a certain class (that is dense in a reproducing kernel Hilbert space) depending on the number of samples and the distribution of features. The generalization bounds improve with additional structural conditions, such as coordinate sparsity, compact clusters of the spectrum, or rapid spectral decay. In particular, by introducing sparse features, i.e. features with random sparse weights, we provide improved bounds for low order functions. We show that the sparse random feature expansions outperforms shallow networks in several scientific machine learning tasks.
△ Less
Submitted 20 August, 2021; v1 submitted 4 March, 2021;
originally announced March 2021.
-
Learning to Emphasize: Dataset and Shared Task Models for Selecting Emphasis in Presentation Slides
Authors:
Amirreza Shirani,
Giai Tran,
Hieu Trinh,
Franck Dernoncourt,
Nedim Lipka,
Paul Asente,
Jose Echevarria,
Thamar Solorio
Abstract:
Presentation slides have become a common addition to the teaching material. Emphasizing strong leading words in presentation slides can allow the audience to direct the eye to certain focal points instead of reading the entire slide, retaining the attention to the speaker during the presentation. Despite a large volume of studies on automatic slide generation, few studies have addressed the automa…
▽ More
Presentation slides have become a common addition to the teaching material. Emphasizing strong leading words in presentation slides can allow the audience to direct the eye to certain focal points instead of reading the entire slide, retaining the attention to the speaker during the presentation. Despite a large volume of studies on automatic slide generation, few studies have addressed the automation of design assistance during the creation process. Motivated by this demand, we study the problem of Emphasis Selection (ES) in presentation slides, i.e., choosing candidates for emphasis, by introducing a new dataset containing presentation slides with a wide variety of topics, each is annotated with emphasis words in a crowdsourced setting. We evaluate a range of state-of-the-art models on this novel dataset by organizing a shared task and inviting multiple researchers to model emphasis in this new domain. We present the main findings and compare the results of these models, and by examining the challenges of the dataset, we provide different analysis components.
△ Less
Submitted 2 January, 2021;
originally announced January 2021.
-
A Clinical Evaluation of a Low-Cost Strain Gauge Respiration Belt and Machine Learning to Detect Sleep Apnea
Authors:
Stein Kristiansen,
Konstantinos Nikolaidis,
Thomas Plagemann,
Vera Goebel,
Gunn Marit Traaen,
Britt Øverland,
Lars Aakerøy,
Tove-Elizabeth Hunt,
Jan Pål Loennechen,
Sigurd Loe Steinshamn,
Christina Holt Bendz,
Ole-Gunnar Anfinsen,
Lars Gullestad,
Harriet Akre
Abstract:
Sleep apnea is a serious and severely under-diagnosed sleep-related respiration disorder characterized by repeated disrupted breathing events during sleep. It is diagnosed via polysomnography which is an expensive test conducted in a sleep lab requiring sleep experts to manually score the recorded data. Since the symptoms of sleep apnea are often ambiguous, it is difficult for a physician to decid…
▽ More
Sleep apnea is a serious and severely under-diagnosed sleep-related respiration disorder characterized by repeated disrupted breathing events during sleep. It is diagnosed via polysomnography which is an expensive test conducted in a sleep lab requiring sleep experts to manually score the recorded data. Since the symptoms of sleep apnea are often ambiguous, it is difficult for a physician to decide whether to prescribe polysomnography. In this study, we investigate whether helpful information can be obtained by collecting and automatically analysing sleep data using a smartphone and an inexpensive strain gauge respiration belt. We evaluate how accurately we can detect sleep apnea with wide variety of machine learning techniques with data from a clinical study with 49 overnight sleep recordings. With less than one hour of training, we can distinguish between normal and apneic minutes with an accuracy, sensitivity, and specificity of 0.7609, 0.7833, and 0.7217, respectively. These results can be achieved even if we train only on high-quality data from an entirely separate, clinically certified sensor, which has the potential to substantially reduce the cost of data collection. Data from a complete night can be analyzed in about one second on a smartphone.
△ Less
Submitted 7 January, 2021;
originally announced January 2021.
-
Sparse within Sparse Gaussian Processes using Neighbor Information
Authors:
Gia-Lac Tran,
Dimitrios Milios,
Pietro Michiardi,
Maurizio Filippone
Abstract:
Approximations to Gaussian processes based on inducing variables, combined with variational inference techniques, enable state-of-the-art sparse approaches to infer GPs at scale through mini batch-based learning. In this work, we address one limitation of sparse GPs, which is due to the challenge in dealing with a large number of inducing variables without imposing a special structure on the induc…
▽ More
Approximations to Gaussian processes based on inducing variables, combined with variational inference techniques, enable state-of-the-art sparse approaches to infer GPs at scale through mini batch-based learning. In this work, we address one limitation of sparse GPs, which is due to the challenge in dealing with a large number of inducing variables without imposing a special structure on the inducing inputs. In particular, we introduce a novel hierarchical prior, which imposes sparsity on the set of inducing variables. We treat our model variationally, and we experimentally show considerable computational gains compared to standard sparse GPs when sparsity on the inducing variables is realized considering the nearest inducing inputs of a random mini-batch of the data. We perform an extensive experimental validation that demonstrates the effectiveness of our approach compared to the state-of-the-art. Our approach enables the possibility to use sparse GPs using a large number of inducing points without incurring a prohibitive computational cost.
△ Less
Submitted 20 July, 2021; v1 submitted 10 November, 2020;
originally announced November 2020.
-
My Health Sensor, my Classifier: Adapting a Trained Classifier to Unlabeled End-User Data
Authors:
Konstantinos Nikolaidis,
Stein Kristiansen,
Thomas Plagemann,
Vera Goebel,
Knut Liestøl,
Mohan Kankanhalli,
Gunn Marit Traaen,
Britt Øverland,
Harriet Akre,
Lars Aakerøy,
Sigurd Steinshamn
Abstract:
In this work, we present an approach for unsupervised domain adaptation (DA) with the constraint, that the labeled source data are not directly available, and instead only access to a classifier trained on the source data is provided. Our solution, iteratively labels only high confidence sub-regions of the target data distribution, based on the belief of the classifier. Then it iteratively learns…
▽ More
In this work, we present an approach for unsupervised domain adaptation (DA) with the constraint, that the labeled source data are not directly available, and instead only access to a classifier trained on the source data is provided. Our solution, iteratively labels only high confidence sub-regions of the target data distribution, based on the belief of the classifier. Then it iteratively learns new classifiers from the expanding high-confidence dataset. The goal is to apply the proposed approach on DA for the task of sleep apnea detection and achieve personalization based on the needs of the patient. In a series of experiments with both open and closed sleep monitoring datasets, the proposed approach is applied to data from different sensors, for DA between the different datasets. The proposed approach outperforms in all experiments the classifier trained in the source domain, with an improvement of the kappa coefficient that varies from 0.012 to 0.242. Additionally, our solution is applied to digit classification DA between three well established digit datasets, to investigate the generalizability of the approach, and to allow for comparison with related work. Even without direct access to the source data, it achieves good results, and outperforms several well established unsupervised DA methods.
△ Less
Submitted 22 September, 2020;
originally announced September 2020.
-
Learning Realistic Patterns from Unrealistic Stimuli: Generalization and Data Anonymization
Authors:
Konstantinos Nikolaidis,
Stein Kristiansen,
Thomas Plagemann,
Vera Goebel,
Knut Liestøl,
Mohan Kankanhalli,
Gunn Marit Traaen,
Britt Øverland,
Harriet Akre,
Lars Aakerøy,
Sigurd Steinshamn
Abstract:
Good training data is a prerequisite to develop useful ML applications. However, in many domains existing data sets cannot be shared due to privacy regulations (e.g., from medical studies). This work investigates a simple yet unconventional approach for anonymized data synthesis to enable third parties to benefit from such private data. We explore the feasibility of learning implicitly from unreal…
▽ More
Good training data is a prerequisite to develop useful ML applications. However, in many domains existing data sets cannot be shared due to privacy regulations (e.g., from medical studies). This work investigates a simple yet unconventional approach for anonymized data synthesis to enable third parties to benefit from such private data. We explore the feasibility of learning implicitly from unrealistic, task-relevant stimuli, which are synthesized by exciting the neurons of a trained deep neural network (DNN). As such, neuronal excitation serves as a pseudo-generative model. The stimuli data is used to train new classification models. Furthermore, we extend this framework to inhibit representations that are associated with specific individuals. We use sleep monitoring data from both an open and a large closed clinical study and evaluate whether (1) end-users can create and successfully use customized classification models for sleep apnea detection, and (2) the identity of participants in the study is protected. Extensive comparative empirical investigation shows that different algorithms trained on the stimuli are able generalize successfully on the same task as the original model. However, architectural and algorithmic similarity between new and original models play an important role in performance. For similar architectures, the performance is close to that of using the true data (e.g., Accuracy difference of 0.56\%, Kappa coefficient difference of 0.03-0.04). Further experiments show that the stimuli can to a large extent successfully anonymize participants of the clinical studies.
△ Less
Submitted 9 December, 2021; v1 submitted 21 September, 2020;
originally announced September 2020.
-
Recovery guarantees for polynomial approximation from dependent data with outliers
Authors:
Lam Si Tung Ho,
Hayden Schaeffer,
Giang Tran,
Rachel Ward
Abstract:
Learning non-linear systems from noisy, limited, and/or dependent data is an important task across various scientific fields including statistics, engineering, computer science, mathematics, and many more. In general, this learning task is ill-posed; however, additional information about the data's structure or on the behavior of the unknown function can make the task well-posed. In this work, we…
▽ More
Learning non-linear systems from noisy, limited, and/or dependent data is an important task across various scientific fields including statistics, engineering, computer science, mathematics, and many more. In general, this learning task is ill-posed; however, additional information about the data's structure or on the behavior of the unknown function can make the task well-posed. In this work, we study the problem of learning nonlinear functions from corrupted and dependent data. The learning problem is recast as a sparse robust linear regression problem where we incorporate both the unknown coefficients and the corruptions in a basis pursuit framework. The main contribution of our paper is to provide a reconstruction guarantee for the associated $\ell_1$-optimization problem where the sampling matrix is formed from dependent data. Specifically, we prove that the sampling matrix satisfies the null space property and the stable null space property, provided that the data is compact and satisfies a suitable concentration inequality. We show that our recovery results are applicable to various types of dependent data such as exponentially strongly $α$-mixing data, geometrically $\mathcal{C}$-mixing data, and uniformly ergodic Markov chain. Our theoretical results are verified via several numerical simulations.
△ Less
Submitted 25 November, 2018;
originally announced November 2018.
-
Low-Temperature and Dynamic Magnetism of Highly Frustrated 5d2 Li4MgOsO6 Polymorphs in Comparison with 5d3 Li3Mg2OsO6
Authors:
Gia T. Tran,
Phuong-Hieu T. Nguyen,
Charles J. Bloed,
Michael E. Evans,
Jamie A. Anczarski,
William P. Martin,
Jefferson Toro,
Demetrios V. Papakostas,
James Beare,
Murray N. Wilson,
John E. Greedan,
Graeme M. Luke,
Thomas Gredig,
Jeremy P. Carlo,
Shahab Derakhshan
Abstract:
Geometric magnetic frustration (GMF) has attracted substantial interest due to the exotic physics and rich phase diagrams revealed by the cancellation of normally-dominant magnetic interactions, giving impetus for the search for novel frustrated systems, most often based on antiferromagnetic correlations between magnetic ions decorating triangular or tetrahedral lattices. We report here low-temper…
▽ More
Geometric magnetic frustration (GMF) has attracted substantial interest due to the exotic physics and rich phase diagrams revealed by the cancellation of normally-dominant magnetic interactions, giving impetus for the search for novel frustrated systems, most often based on antiferromagnetic correlations between magnetic ions decorating triangular or tetrahedral lattices. We report here low-temperature magnetic susceptibility and muon spin relaxation results on Li4MgOsO6 and Li3Mg2OsO6, members of the A5BO6 "rock salt ordered" family of frustrated materials. In Li3Mg2OsO6 we find spin freezing below 12K. In Li4MgOsO6, which can crystallize into either orthorhombic Fddd or monoclinic C2/m crystal symmetries depending on synthesis conditions, we find magnetism consistent with glassy-like behavior dominating below 2K, with partial ordering and evidence for dynamics at somewhat higher temperatures.
△ Less
Submitted 1 November, 2018; v1 submitted 12 September, 2018;
originally announced September 2018.
-
Calibrating Deep Convolutional Gaussian Processes
Authors:
Gia-Lac Tran,
Edwin V. Bonilla,
John P. Cunningham,
Pietro Michiardi,
Maurizio Filippone
Abstract:
The wide adoption of Convolutional Neural Networks (CNNs) in applications where decision-making under uncertainty is fundamental, has brought a great deal of attention to the ability of these models to accurately quantify the uncertainty in their predictions. Previous work on combining CNNs with Gaussian processes (GPs) has been developed under the assumption that the predictive probabilities of t…
▽ More
The wide adoption of Convolutional Neural Networks (CNNs) in applications where decision-making under uncertainty is fundamental, has brought a great deal of attention to the ability of these models to accurately quantify the uncertainty in their predictions. Previous work on combining CNNs with Gaussian processes (GPs) has been developed under the assumption that the predictive probabilities of these models are well-calibrated. In this paper we show that, in fact, current combinations of CNNs and GPs are miscalibrated. We proposes a novel combination that considerably outperforms previous approaches on this aspect, while achieving state-of-the-art performance on image classification tasks.
△ Less
Submitted 26 May, 2018;
originally announced May 2018.
-
Extracting structured dynamical systems using sparse optimization with very few samples
Authors:
Hayden Schaeffer,
Giang Tran,
Rachel Ward,
Linan Zhang
Abstract:
Learning governing equations allows for deeper understanding of the structure and dynamics of data. We present a random sampling method for learning structured dynamical systems from under-sampled and possibly noisy state-space measurements. The learning problem takes the form of a sparse least-squares fitting over a large set of candidate functions. Based on a Bernstein-like inequality for partly…
▽ More
Learning governing equations allows for deeper understanding of the structure and dynamics of data. We present a random sampling method for learning structured dynamical systems from under-sampled and possibly noisy state-space measurements. The learning problem takes the form of a sparse least-squares fitting over a large set of candidate functions. Based on a Bernstein-like inequality for partly dependent random variables, we provide theoretical guarantees on the recovery rate of the sparse coefficients and the identification of the candidate functions for the corresponding problem. Computational results are demonstrated on datasets generated by the Lorenz 96 equation, the viscous Burgers' equation, and the two-component reaction-diffusion equations (which is challenging due to parameter sensitives in the model). This formulation has several advantages including ease of use, theoretical guarantees of success, and computational efficiency with respect to ambient dimension and number of candidate functions.
△ Less
Submitted 10 May, 2018;
originally announced May 2018.
-
A Guide of Fingerprint Based Radio Emitter Localization using Multiple Sensors
Authors:
Tao Yu,
Azril Haniz,
Kentaro Sano,
Ryosuke Iwata,
Ryouta Kosaka,
Yusuke Kuki,
Gia Khanh Tran,
Jun-Ichi Takada,
Kei Sakaguchi
Abstract:
Location information is essential to varieties of applications. It is one of the most important context to be detected by wireless distributed sensors, which is a key technology in Internet-of-Things. Fingerprint-based methods, which compare location unique fingerprints collected beforehand with the fingerprint measured from the target, have attracted much attention recently in both of academia an…
▽ More
Location information is essential to varieties of applications. It is one of the most important context to be detected by wireless distributed sensors, which is a key technology in Internet-of-Things. Fingerprint-based methods, which compare location unique fingerprints collected beforehand with the fingerprint measured from the target, have attracted much attention recently in both of academia and industry. They have been successfully used for many location-based applications.From the viewpoint of practical applications, in this paper, four different typical approaches of fingerprint-based radio emitter localization system are introduced with four different representative applications: localization of LTE smart phone used for anti-cheating in exams, indoor localization of Wi-Fi terminals, localized light control in BEMS using location information of occupants, and illegal radio localization in outdoor environments. Based on the different practical application scenarios, different solutions, which are designed to enhance the localization performance, are discussed in detail. To the best of the authors' knowledge, this is the first paper to give a guideline for readers about fingerprint-based localization system in terms of fingerprint selection, hardware architecture design and algorithm enhancement
△ Less
Submitted 5 April, 2018;
originally announced April 2018.
-
Learning Dynamical Systems and Bifurcation via Group Sparsity
Authors:
Hayden Schaeffer,
Giang Tran,
Rachel Ward
Abstract:
Learning governing equations from a family of data sets which share the same physical laws but differ in bifurcation parameters is challenging. This is due, in part, to the wide range of phenomena that could be represented in the data sets as well as the range of parameter values. On the other hand, it is common to assume only a small number of candidate functions contribute to the observed dynami…
▽ More
Learning governing equations from a family of data sets which share the same physical laws but differ in bifurcation parameters is challenging. This is due, in part, to the wide range of phenomena that could be represented in the data sets as well as the range of parameter values. On the other hand, it is common to assume only a small number of candidate functions contribute to the observed dynamics. Based on these observations, we propose a group-sparse penalized method for model selection and parameter estimation for such data. We also provide convergence guarantees for our proposed numerical scheme. Various numerical experiments including the 1D logistic equation, the 3D Lorenz sampled from different bifurcation regions, and a switching system provide numerical validation for our method and suggest potential applications to applied dynamical systems.
△ Less
Submitted 5 September, 2017;
originally announced September 2017.
-
Extracting Sparse High-Dimensional Dynamics from Limited Data
Authors:
Hayden Schaeffer,
Giang Tran,
Rachel Ward
Abstract:
Extracting governing equations from dynamic data is an essential task in model selection and parameter estimation. The form of the governing equation is rarely known a priori; however, based on the sparsity-of-effect principle one may assume that the number of candidate functions needed to represent the dynamics is very small. In this work, we leverage the sparse structure of the governing equatio…
▽ More
Extracting governing equations from dynamic data is an essential task in model selection and parameter estimation. The form of the governing equation is rarely known a priori; however, based on the sparsity-of-effect principle one may assume that the number of candidate functions needed to represent the dynamics is very small. In this work, we leverage the sparse structure of the governing equations along with recent results from random sampling theory to develop methods for selecting dynamical systems from under-sampled data. In particular, we detail three sampling strategies that lead to the exact recovery of first-order dynamical systems when we are given fewer samples than unknowns. The first method makes no assumptions on the behavior of the data, and requires a certain number of random initial samples. The second method utilizes the structure of the governing equation to limit the number of random initializations needed. The third method leverages chaotic behavior in the data to construct a nearly deterministic sampling strategy. Using results from compressive sensing, we show that the strategies lead to exact recovery, which is stable to the sparse structure of the governing equations and robust to noise in the estimation of the velocity. Computational results validate each of the sampling strategies and highlight potential applications.
△ Less
Submitted 18 October, 2018; v1 submitted 26 July, 2017;
originally announced July 2017.
-
Cu2+ Affects Amyloid-\b{eta} (1-42) Aggregation by Increasing Peptide-Peptide Binding Forces
Authors:
Francis Hane,
Gary Tran,
Simon Attwood,
Zoya Leonenko
Abstract:
The link between metals, Alzheimers disease (AD) and its implicated protein, amyloid \b{eta} (A\b{eta}), is complex and highly studied. AD is believed to occur as a result of the misfolding and aggregation of A\b{eta}. The dyshomeostasis of metal ions and their propensity to interact with A\b{eta} has also been implicated in AD. In this work, we use single molecule atomic force spectroscopy to mea…
▽ More
The link between metals, Alzheimers disease (AD) and its implicated protein, amyloid \b{eta} (A\b{eta}), is complex and highly studied. AD is believed to occur as a result of the misfolding and aggregation of A\b{eta}. The dyshomeostasis of metal ions and their propensity to interact with A\b{eta} has also been implicated in AD. In this work, we use single molecule atomic force spectroscopy to measure the rupture force required to dissociate two A\b{eta} (1 42) peptides in the presence of copper ions, Cu2+. In addition, we use atomic force microscopy to resolve the aggregation of A\b{eta} formed. Previous research has shown that metal ions decrease the lag time associated with A\b{eta} aggregation. We show that with the addition of copper ions the unbinding force increases notably. This suggests that the reduction of lag time associated with A\b{eta} aggregation occurs on a single molecule level as a result of an increase in binding forces during the very initial interactions between two A\b{eta} peptides. We attribute these results to copper ions acting as a bridge between the two peptide molecules, increasing the stability of the peptide-peptide complex.
△ Less
Submitted 26 April, 2017;
originally announced April 2017.
-
Where, When, and How mmWave is Used in 5G and Beyon
Authors:
Kei Sakaguchi,
Thomas Haustein,
Sergio Barbarossa,
Emilio Calvanese Strinati,
Antonio Clemente,
Giuseppe Destino,
Aarno Pärssinen,
Ilgyu Kim,
Heesang Chung,
Junhyeong Kim,
Wilhelm Keusgen,
Richard J. Weiler,
Koji Takinami,
Elena Ceci,
Ali Sadri,
Liang Xain,
Alexander Maltsev,
Gia Khanh Tran,
Hiroaki Ogawa,
Kim Mahler,
Robert W. Heath Jr
Abstract:
Wireless engineers and business planners commonly raise the question on where, when, and how millimeter-wave (mmWave) will be used in 5G and beyond. Since the next generation network is not just a new radio access standard, but instead an integration of networks for vertical markets with diverse applications, answers to the question depend on scenarios and use cases to be deployed. This paper give…
▽ More
Wireless engineers and business planners commonly raise the question on where, when, and how millimeter-wave (mmWave) will be used in 5G and beyond. Since the next generation network is not just a new radio access standard, but instead an integration of networks for vertical markets with diverse applications, answers to the question depend on scenarios and use cases to be deployed. This paper gives four 5G mmWave deployment examples and describes in chronological order the scenarios and use cases of their probable deployment, including expected system architectures and hardware prototypes. The paper starts with 28 GHz outdoor backhauling for fixed wireless access and moving hotspots, which will be demonstrated at the PyeongChang winter Olympic games in 2018. The second deployment example is a 60 GHz unlicensed indoor access system at the Tokyo-Narita airport, which is combined with Mobile Edge Computing (MEC) to enable ultra-high speed content download with low latency. The third example is mmWave mesh network to be used as a micro Radio Access Network (μ-RAN), for cost-effective backhauling of small-cell Base Stations (BSs) in dense urban scenarios. The last example is mmWave based Vehicular-to-Vehicular (V2V) and Vehicular-to-Everything (V2X) communications system, which enables automated driving by exchanging High Definition (HD) dynamic map information between cars and Roadside Units (RSUs). For 5G and beyond, mmWave and MEC will play important roles for a diverse set of applications that require both ultra-high data rate and low latency communications.
△ Less
Submitted 26 April, 2017;
originally announced April 2017.
-
Exact Recovery of Chaotic Systems from Highly Corrupted Data
Authors:
Giang Tran,
Rachel Ward
Abstract:
Learning the governing equations in dynamical systems from time-varying measurements is of great interest across different scientific fields. This task becomes prohibitive when such data is moreover highly corrupted, for example, due to the recording mechanism failing over unknown intervals of time. When the underlying system exhibits chaotic behavior, such as sensitivity to initial conditions, it…
▽ More
Learning the governing equations in dynamical systems from time-varying measurements is of great interest across different scientific fields. This task becomes prohibitive when such data is moreover highly corrupted, for example, due to the recording mechanism failing over unknown intervals of time. When the underlying system exhibits chaotic behavior, such as sensitivity to initial conditions, it is crucial to recover the governing equations with high precision. In this work, we consider continuous time dynamical systems $\dot{x} = f(x)$ where each component of $f: \mathbb{R}^{d} \rightarrow \mathbb{R}^d$ is a multivariate polynomial of maximal degree $p$; we aim to identify $f$ exactly from possibly highly corrupted measurements $x(t_1), x(t_2), \dots, x(t_m)$. As our main theoretical result, we show that if the system is sufficiently ergodic that this data satisfies a strong central limit theorem (as is known to hold for chaotic Lorenz systems), then the governing equations $f$ can be exactly recovered as the solution to an $\ell_1$ minimization problem -- even if a large percentage of the data is corrupted by outliers. Numerically, we apply the alternating minimization method to solve the corresponding constrained optimization problem. Through several examples of 3D chaotic systems and higher dimensional hyperchaotic systems, we illustrate the power, generality, and efficiency of the algorithm for recovering governing equations from noisy and highly corrupted measurement data.
△ Less
Submitted 19 July, 2016; v1 submitted 4 July, 2016;
originally announced July 2016.
-
Experimental Study on Battery-less Sensor Network Activated by Multi-point Wireless Energy Transmission
Authors:
Daiki Maehara,
Gia Khanh Tran,
Kei Sakaguchi,
Kiyomichi Araki
Abstract:
This paper empirically validates battery-less sensor activation via wireless energy transmission to release sensors from wires and batteries. To seamlessly extend the coverage and activate sensor nodes distributed in any indoor environment, we proposed multi-point wireless energy transmission with carrier shift diversity. In this scheme, multiple transmitters are employed to compensate path-loss a…
▽ More
This paper empirically validates battery-less sensor activation via wireless energy transmission to release sensors from wires and batteries. To seamlessly extend the coverage and activate sensor nodes distributed in any indoor environment, we proposed multi-point wireless energy transmission with carrier shift diversity. In this scheme, multiple transmitters are employed to compensate path-loss attenuation and orthogonal frequencies are allocated to the multiple transmitters to avoid the destructive interference that occurs when the same frequency is used by all transmitters. In our previous works, the effectiveness of the proposed scheme was validated theoretically and also empirically by using just a spectrum analyzer to measure the received power. In this paper, we develop low-energy battery-less sensor nodes whose consumed power and required received power for activation are respectively 142 uW and 400 uW. In addition, we conduct indoor experiments in which the received power and activation of battery-less sensor node are simultaneously observed by using the developed battery-less sensor node and a spectrum analyzer. The results show that the coverage of single-point and multi-point wireless energy transmission without carrier shift diversity are, respectively, 84.4% and 83.7%, while the coverage of the proposed scheme is 100%. It can be concluded that the effectiveness of the proposed scheme can be verified by our experiments using real battery-less sensor nodes.
△ Less
Submitted 5 January, 2016;
originally announced January 2016.
-
Millimeter-wave Evolution for 5G Cellular Networks
Authors:
Kei Sakaguchi,
Gia Khanh Tran,
Hidekazu Shimodaira,
Shinobu Nanba,
Toshiaki Sakurai,
Koji Takinami,
Isabelle Siaud,
Emilio Calvanese Strinati,
Antonio Capone,
Ingolf Karls,
Reza Arefi,
Thomas Haustein
Abstract:
Triggered by the explosion of mobile traffic, 5G (5th Generation) cellular network requires evolution to increase the system rate 1000 times higher than the current systems in 10 years. Motivated by this common problem, there are several studies to integrate mm-wave access into current cellular networks as multi-band heterogeneous networks to exploit the ultra-wideband aspect of the mm-wave band.…
▽ More
Triggered by the explosion of mobile traffic, 5G (5th Generation) cellular network requires evolution to increase the system rate 1000 times higher than the current systems in 10 years. Motivated by this common problem, there are several studies to integrate mm-wave access into current cellular networks as multi-band heterogeneous networks to exploit the ultra-wideband aspect of the mm-wave band. The authors of this paper have proposed comprehensive architecture of cellular networks with mm-wave access, where mm-wave small cell basestations and a conventional macro basestation are connected to Centralized-RAN (C-RAN) to effectively operate the system by enabling power efficient seamless handover as well as centralized resource control including dynamic cell structuring to match the limited coverage of mm-wave access with high traffic user locations via user-plane/control-plane splitting. In this paper, to prove the effectiveness of the proposed 5G cellular networks with mm-wave access, system level simulation is conducted by introducing an expected future traffic model, a measurement based mm-wave propagation model, and a centralized cell association algorithm by exploiting the C-RAN architecture. The numerical results show the effectiveness of the proposed network to realize 1000 times higher system rate than the current network in 10 years which is not achieved by the small cells using commonly considered 3.5 GHz band. Furthermore, the paper also gives latest status of mm-wave devices and regulations to show the feasibility of using mm-wave in the 5G systems.
△ Less
Submitted 16 December, 2014; v1 submitted 10 December, 2014;
originally announced December 2014.
-
Experiments Validating the Effectiveness of Multi-point Wireless Energy Transmission with Carrier Shift Diversity
Authors:
Daiki Maehara,
Gia Khanh Tran,
Kei Sakaguchi,
Kiyomichi Araki,
Minoru Furukawa
Abstract:
This paper presents a method to seamlessly extend the coverage of energy supply field for wireless sensor networks in order to free sensors from wires and batteries, where the multi-point scheme is employed to overcome path-loss attenuation, while the carrier shift diversity is introduced to mitigate the effect of interference between multiple wave sources. As we focus on the energy transmission p…
▽ More
This paper presents a method to seamlessly extend the coverage of energy supply field for wireless sensor networks in order to free sensors from wires and batteries, where the multi-point scheme is employed to overcome path-loss attenuation, while the carrier shift diversity is introduced to mitigate the effect of interference between multiple wave sources. As we focus on the energy transmission part, sensor or communication schemes are out of scope of this paper. To verify the effectiveness of the proposed wireless energy transmission, this paper conducts indoor experiments in which we compare the power distribution and the coverage performance of different energy transmission schemes including conventional single-point, simple multi-point and our proposed multi-point scheme. To easily observe the effect of the standing-wave caused by multipath and interference between multiple wave sources, 3D measurements are performed in an empty room. The results of our experiments together with those of a simulation that assumes a similar antenna setting in free space environment show that the coverage of single-point and multi-point wireless energy transmission without carrier shift diversity are limited by path-loss, standing-wave created by multipath and interference between multiple wave sources. On the other hand, the proposed scheme can overcome power attenuation due to the path-loss as well as the effect of standing-wave created by multipath and interference between multiple wave sources.
△ Less
Submitted 20 August, 2014;
originally announced August 2014.
-
An L1 Penalty Method for General Obstacle Problems
Authors:
Giang Tran,
Hayden Schaeffer,
William M. Feldman,
Stanley J. Osher
Abstract:
We construct an efficient numerical scheme for solving obstacle problems in divergence form. The numerical method is based on a reformulation of the obstacle in terms of an L1-like penalty on the variational problem. The reformulation is an exact regularizer in the sense that for large (but finite) penalty parameter, we recover the exact solution. Our formulation is applied to classical elliptic o…
▽ More
We construct an efficient numerical scheme for solving obstacle problems in divergence form. The numerical method is based on a reformulation of the obstacle in terms of an L1-like penalty on the variational problem. The reformulation is an exact regularizer in the sense that for large (but finite) penalty parameter, we recover the exact solution. Our formulation is applied to classical elliptic obstacle problems as well as some related free boundary problems, for example the two-phase membrane problem and the Hele-Shaw model. One advantage of the proposed method is that the free boundary inherent in the obstacle problem arises naturally in our energy minimization without any need for problem specific or complicated discretization. In addition, our scheme also works for nonlinear variational inequalities arising from convex minimization problems.
△ Less
Submitted 4 April, 2014;
originally announced April 2014.
-
PDEs with Compressed Solutions
Authors:
Russel E. Caflisch,
Stanley J. Osher,
Hayden Schaeffer,
Giang Tran
Abstract:
Sparsity plays a central role in recent developments in signal processing, linear algebra, statistics, optimization, and other fields. In these developments, sparsity is promoted through the addition of an $L^1$ norm (or related quantity) as a constraint or penalty in a variational principle. We apply this approach to partial differential equations that come from a variational quantity, either by…
▽ More
Sparsity plays a central role in recent developments in signal processing, linear algebra, statistics, optimization, and other fields. In these developments, sparsity is promoted through the addition of an $L^1$ norm (or related quantity) as a constraint or penalty in a variational principle. We apply this approach to partial differential equations that come from a variational quantity, either by minimization (to obtain an elliptic PDE) or by gradient flow (to obtain a parabolic PDE). Also, we show that some PDEs can be rewritten in an $L^1$ form, such as the divisible sandpile problem and signum-Gordon. Addition of an $L^1$ term in the variational principle leads to a modified PDE where a subgradient term appears. It is known that modified PDEs of this form will often have solutions with compact support, which corresponds to the discrete solution being sparse. We show that this is advantageous numerically through the use of efficient algorithms for solving $L^1$ based problems.
△ Less
Submitted 1 August, 2014; v1 submitted 22 November, 2013;
originally announced November 2013.
-
Distributed Power Control Network and Green Building Test-bed for Demand Response in Smart Grid
Authors:
Kei Sakaguchi,
Van Ky Nguyen,
Yu Tao,
Gia Khanh Tran,
Kiyomichi Araki
Abstract:
It is known that demand and supply power balancing is an essential method to operate power delivery system and prevent blackouts caused by power shortage. In this paper, we focus on the implementation of demand response strategy to save power during peak hours by using Smart Grid. It is obviously impractical with centralized power control network to realize the real-time control performance, where…
▽ More
It is known that demand and supply power balancing is an essential method to operate power delivery system and prevent blackouts caused by power shortage. In this paper, we focus on the implementation of demand response strategy to save power during peak hours by using Smart Grid. It is obviously impractical with centralized power control network to realize the real-time control performance, where a single central controller measures the huge metering data and sends control command back to all customers. For that purpose, we propose a new architecture of hierarchical distributed power control network which is scalable regardless of the network size. The sub-controllers are introduced to partition the large system into smaller distributed clusters where low-latency local feedback power control loops are conducted to guarantee control stability. Furthermore, sub-controllers are stacked up in an hierarchical manner such that data are fed back layer-by-layer in the inbound while in the outbound control responses are decentralized in each local sub-controller for realizing the global objectives. Numerical simulations in a realistic scenario of up to 5000 consumers show the effectiveness of the proposed scheme to achieve a desired 10% peak power saving by using off-the-shelf wireless devices with IEEE802.15.4g standard. In addition, a small scale power control system for green building test-bed is implemented to demonstrate the potential use of the proposed scheme for power saving in real life.
△ Less
Submitted 22 May, 2013;
originally announced May 2013.