Showing 1–50 of 121 results for author: Tsuchiya, T

A Simple and Adaptive Learning Rate for FTRL in Online Learning with Minimax Regret of $Θ(T^{2/3})$ and its Application to Best-of-Both-Worlds

Authors: Taira Tsuchiya, Shinji Ito

Abstract: Follow-the-Regularized-Leader (FTRL) is a powerful framework for various online learning problems. By designing its regularizer and learning rate to be adaptive to past observations, FTRL is known to work adaptively to various properties of an underlying environment. However, most existing adaptive learning rates are for online learning problems with a minimax regret of $Θ(\sqrt{T})$ for the numbe… ▽ More Follow-the-Regularized-Leader (FTRL) is a powerful framework for various online learning problems. By designing its regularizer and learning rate to be adaptive to past observations, FTRL is known to work adaptively to various properties of an underlying environment. However, most existing adaptive learning rates are for online learning problems with a minimax regret of $Θ(\sqrt{T})$ for the number of rounds $T$, and there are only a few studies on adaptive learning rates for problems with a minimax regret of $Θ(T^{2/3})$, which include several important problems dealing with indirect feedback. To address this limitation, we establish a new adaptive learning rate framework for problems with a minimax regret of $Θ(T^{2/3})$. Our learning rate is designed by matching the stability, penalty, and bias terms that naturally appear in regret upper bounds for problems with a minimax regret of $Θ(T^{2/3})$. As applications of this framework, we consider two major problems dealing with indirect feedback: partial monitoring and graph bandits. We show that FTRL with our learning rate and the Tsallis entropy regularizer improves existing Best-of-Both-Worlds (BOBW) regret upper bounds, which achieve simultaneous optimality in the stochastic and adversarial regimes. The resulting learning rate is surprisingly simple compared to the existing learning rates for BOBW algorithms for problems with a minimax regret of $Θ(T^{2/3})$. △ Less

Submitted 30 May, 2024; originally announced May 2024.

Comments: 31 pages

Adaptive Learning Rate for Follow-the-Regularized-Leader: Competitive Analysis and Best-of-Both-Worlds

Authors: Shinji Ito, Taira Tsuchiya, Junya Honda

Abstract: Follow-The-Regularized-Leader (FTRL) is known as an effective and versatile approach in online learning, where appropriate choice of the learning rate is crucial for smaller regret. To this end, we formulate the problem of adjusting FTRL's learning rate as a sequential decision-making problem and introduce the framework of competitive analysis. We establish a lower bound for the competitive ratio… ▽ More Follow-The-Regularized-Leader (FTRL) is known as an effective and versatile approach in online learning, where appropriate choice of the learning rate is crucial for smaller regret. To this end, we formulate the problem of adjusting FTRL's learning rate as a sequential decision-making problem and introduce the framework of competitive analysis. We establish a lower bound for the competitive ratio and propose update rules for learning rate that achieves an upper bound within a constant factor of this lower bound. Specifically, we illustrate that the optimal competitive ratio is characterized by the (approximate) monotonicity of components of the penalty term, showing that a constant competitive ratio is achievable if the components of the penalty term form a monotonically non-increasing sequence, and derive a tight competitive ratio when penalty terms are $ξ$-approximately monotone non-increasing. Our proposed update rule, referred to as \textit{stability-penalty matching}, also facilitates constructing the Best-Of-Both-Worlds (BOBW) algorithms for stochastic and adversarial environments. In these environments our result contributes to achieve tighter regret bound and broaden the applicability of algorithms for various settings such as multi-armed bandits, graph bandits, linear bandits, and contextual bandits. △ Less

Submitted 10 March, 2024; v1 submitted 1 March, 2024; originally announced March 2024.

Error estimation for finite element method on meshes that contain thin elements

Authors: Kenta Kobayashi, Takuya Tsuchiya

Abstract: In an error estimation of finite element solutions to the Poisson equation, we usually impose the shape regularity assumption on the meshes to be used. In this paper, we show that even if the shape regularity condition is violated, the standard error estimation can be obtained if "bad" elements (elements that violate the shape regularity or maximum angle condition) are covered virtually by "good"… ▽ More In an error estimation of finite element solutions to the Poisson equation, we usually impose the shape regularity assumption on the meshes to be used. In this paper, we show that even if the shape regularity condition is violated, the standard error estimation can be obtained if "bad" elements (elements that violate the shape regularity or maximum angle condition) are covered virtually by "good" simplices. A numerical experiment confirms the theoretical result. △ Less

Submitted 29 February, 2024; originally announced February 2024.

MSC Class: 65D05; 65N30

Fast Rates in Online Convex Optimization by Exploiting the Curvature of Feasible Sets

Authors: Taira Tsuchiya, Shinji Ito

Abstract: In this paper, we explore online convex optimization (OCO) and introduce a new analysis that provides fast rates by exploiting the curvature of feasible sets. In online linear optimization, it is known that if the average gradient of loss functions is larger than a certain value, the curvature of feasible sets can be exploited by the follow-the-leader (FTL) algorithm to achieve a logarithmic regre… ▽ More In this paper, we explore online convex optimization (OCO) and introduce a new analysis that provides fast rates by exploiting the curvature of feasible sets. In online linear optimization, it is known that if the average gradient of loss functions is larger than a certain value, the curvature of feasible sets can be exploited by the follow-the-leader (FTL) algorithm to achieve a logarithmic regret. This paper reveals that algorithms adaptive to the curvature of loss functions can also leverage the curvature of feasible sets. We first prove that if an optimal decision is on the boundary of a feasible set and the gradient of an underlying loss function is non-zero, then the algorithm achieves a regret upper bound of $O(ρ\log T)$ in stochastic environments. Here, $ρ> 0$ is the radius of the smallest sphere that includes the optimal decision and encloses the feasible set. Our approach, unlike existing ones, can work directly with convex loss functions, exploiting the curvature of loss functions simultaneously, and can achieve the logarithmic regret only with a local property of feasible sets. Additionally, it achieves an $O(\sqrt{T})$ regret even in adversarial environments where FTL suffers an $Ω(T)$ regret, and attains an $O(ρ\log T + \sqrt{C ρ\log T})$ regret bound in corrupted stochastic environments with corruption level $C$. Furthermore, by extending our analysis, we establish a regret upper bound of $O\Big(T^{\frac{q-2}{2(q-1)}} (\log T)^{\frac{q}{2(q-1)}}\Big)$ for $q$-uniformly convex feasible sets, where uniformly convex sets include strongly convex sets and $\ell_p$-balls for $p \in [1,\infty)$. This bound bridges the gap between the $O(\log T)$ regret bound for strongly convex sets ($q=2$) and the $O(\sqrt{T})$ regret bound for non-curved sets ($q\to\infty$). △ Less

Submitted 20 February, 2024; originally announced February 2024.

Comments: 17 pages

Online Control of Linear Systems with Unbounded and Degenerate Noise

Authors: Kaito Ito, Taira Tsuchiya

Abstract: This paper investigates the problem of controlling a linear system under possibly unbounded and degenerate noise with unknown cost functions, known as an online control problem. In contrast to the existing work, which assumes the boundedness of noise, we reveal that for convex costs, an $ \widetilde{O}(\sqrt{T}) $ regret bound can be achieved even for unbounded noise, where $ T $ denotes the time… ▽ More This paper investigates the problem of controlling a linear system under possibly unbounded and degenerate noise with unknown cost functions, known as an online control problem. In contrast to the existing work, which assumes the boundedness of noise, we reveal that for convex costs, an $ \widetilde{O}(\sqrt{T}) $ regret bound can be achieved even for unbounded noise, where $ T $ denotes the time horizon. Moreover, when the costs are strongly convex, we establish an $ O({\rm poly} (\log T)) $ regret bound without the assumption that noise covariance is non-degenerate, which has been required in the literature. The key ingredient in removing the rank assumption on noise is a system transformation associated with the noise covariance. This simultaneously enables the parameter reduction of an online control algorithm. △ Less

Submitted 15 February, 2024; originally announced February 2024.

Comments: 26 pages

Exploration by Optimization with Hybrid Regularizers: Logarithmic Regret with Adversarial Robustness in Partial Monitoring

Authors: Taira Tsuchiya, Shinji Ito, Junya Honda

Abstract: Partial monitoring is a generic framework of online decision-making problems with limited observations. To make decisions from such limited observations, it is necessary to find an appropriate distribution for exploration. Recently, a powerful approach for this purpose, exploration by optimization (ExO), was proposed, which achieves the optimal bounds in adversarial environments with follow-the-re… ▽ More Partial monitoring is a generic framework of online decision-making problems with limited observations. To make decisions from such limited observations, it is necessary to find an appropriate distribution for exploration. Recently, a powerful approach for this purpose, exploration by optimization (ExO), was proposed, which achieves the optimal bounds in adversarial environments with follow-the-regularized-leader for a wide range of online decision-making problems. However, a naive application of ExO in stochastic environments significantly degrades regret bounds. To resolve this problem in locally observable games, we first establish a novel framework and analysis for ExO with a hybrid regularizer. This development allows us to significantly improve the existing regret bounds of best-of-both-worlds (BOBW) algorithms, which achieves nearly optimal bounds both in stochastic and adversarial environments. In particular, we derive a stochastic regret bound of $O(\sum_{a \neq a^*} k^2 m^2 \log T / Δ_a)$, where $k$, $m$, and $T$ are the numbers of actions, observations and rounds, $a^*$ is an optimal action, and $Δ_a$ is the suboptimality gap for action $a$. This bound is roughly $Θ(k^2 \log T)$ times smaller than existing BOBW bounds. In addition, for globally observable games, we provide a new BOBW algorithm with the first $O(\log T)$ stochastic bound. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Comments: 30 pages

Online Structured Prediction with Fenchel--Young Losses and Improved Surrogate Regret for Online Multiclass Classification with Logistic Loss

Authors: Shinsaku Sakaue, Han Bao, Taira Tsuchiya, Taihei Oki

Abstract: This paper studies online structured prediction with full-information feedback. For online multiclass classification, Van der Hoeven (2020) established \emph{finite} surrogate regret bounds, which are independent of the time horizon, by introducing an elegant \emph{exploit-the-surrogate-gap} framework. However, this framework has been limited to multiclass classification primarily because it relie… ▽ More This paper studies online structured prediction with full-information feedback. For online multiclass classification, Van der Hoeven (2020) established \emph{finite} surrogate regret bounds, which are independent of the time horizon, by introducing an elegant \emph{exploit-the-surrogate-gap} framework. However, this framework has been limited to multiclass classification primarily because it relies on a classification-specific procedure for converting estimated scores to outputs. We extend the exploit-the-surrogate-gap framework to online structured prediction with \emph{Fenchel--Young losses}, a large family of surrogate losses that includes the logistic loss for multiclass classification as a special case, obtaining finite surrogate regret bounds in various structured prediction problems. To this end, we propose and analyze \emph{randomized decoding}, which converts estimated scores to general structured outputs. Moreover, by applying our decoding to online multiclass classification with the logistic loss, we obtain a surrogate regret bound of $O(\| \mathbf{U} \|_\mathrm{F}^2)$, where $\mathbf{U}$ is the best offline linear estimator and $\| \cdot \|_\mathrm{F}$ denotes the Frobenius norm. This bound is tight up to logarithmic factors and improves the previous bound of $O(d\| \mathbf{U} \|_\mathrm{F}^2)$ due to Van der Hoeven (2020) by a factor of $d$, the number of classes. △ Less

Submitted 10 June, 2024; v1 submitted 12 February, 2024; originally announced February 2024.

Best-of-Both-Worlds Algorithms for Linear Contextual Bandits

Authors: Yuko Kuroki, Alberto Rumi, Taira Tsuchiya, Fabio Vitale, Nicolò Cesa-Bianchi

Abstract: We study best-of-both-worlds algorithms for $K$-armed linear contextual bandits. Our algorithms deliver near-optimal regret bounds in both the adversarial and stochastic regimes, without prior knowledge about the environment. In the stochastic regime, we achieve the polylogarithmic rate $\frac{(dK)^2\mathrm{poly}\log(dKT)}{Δ_{\min}}$, where $Δ_{\min}$ is the minimum suboptimality gap over the $d$-… ▽ More We study best-of-both-worlds algorithms for $K$-armed linear contextual bandits. Our algorithms deliver near-optimal regret bounds in both the adversarial and stochastic regimes, without prior knowledge about the environment. In the stochastic regime, we achieve the polylogarithmic rate $\frac{(dK)^2\mathrm{poly}\log(dKT)}{Δ_{\min}}$, where $Δ_{\min}$ is the minimum suboptimality gap over the $d$-dimensional context space. In the adversarial regime, we obtain either the first-order $\widetilde{O}(dK\sqrt{L^*})$ bound, or the second-order $\widetilde{O}(dK\sqrt{Λ^*})$ bound, where $L^*$ is the cumulative loss of the best action and $Λ^*$ is a notion of the cumulative second moment for the losses incurred by the algorithm. Moreover, we develop an algorithm based on FTRL with Shannon entropy regularizer that does not require the knowledge of the inverse of the covariance matrix, and achieves a polylogarithmic regret in the stochastic regime while obtaining $\widetilde{O}\big(dK\sqrt{T}\big)$ regret bounds in the adversarial regime. △ Less

Submitted 19 February, 2024; v1 submitted 24 December, 2023; originally announced December 2023.

Comments: Accepted at AISTATS2024

A high-performance deep reservoir computing experimentally demonstrated with ion-gating reservoirs

Authors: Daiki Nishioka, Takashi Tsuchiya, Masataka Imura, Yasuo Koide, Tohru Higuchi, Kazuya Terabe

Abstract: While physical reservoir computing (PRC) is a promising way to achieve low power consumption neuromorphic computing, its computational performance is still insufficient at a practical level. One promising approach to improving PRC performance is deep reservoir computing (deep-RC), in which the component reservoirs are multi-layered. However, all of the deep-RC schemes reported so far have been eff… ▽ More While physical reservoir computing (PRC) is a promising way to achieve low power consumption neuromorphic computing, its computational performance is still insufficient at a practical level. One promising approach to improving PRC performance is deep reservoir computing (deep-RC), in which the component reservoirs are multi-layered. However, all of the deep-RC schemes reported so far have been effective only for simulation reservoirs and limited PRCs, and there have been no reports of nanodevice implementations. Here, as the first nanodevice implementation of Deep-RC, we report a demonstration of deep physical reservoir computing using an ion gating reservoir (IGR), which is a small and high-performance physical reservoir. While previously reported Deep-RC scheme did not improve the performance of IGR, our Deep-IGR achieved a normalized mean squared error of 0.0092 on a second-order nonlinear autoregressive moving average task, with is the best performance of any physical reservoir so far reported. More importantly, the device outperformed full simulation reservoir computing. The dramatic performance improvement of the IGR with our deep-RC architecture paves the way for high-performance, large-scale, physical neural network devices. △ Less

Submitted 11 September, 2023; v1 submitted 6 September, 2023; originally announced September 2023.

Comments: 21 pages, 6 figures

Hadamard variation of eigenvalues with respect to general domain perturbations

Authors: Takashi Suzuki, Takuya Tsuchiya

Abstract: We study Hadamard variation of eigenvalues of Laplacian with respect to general domain perturbations. We show their existence up to the second order rigorously and characterize the derivatives, using associated eigenvalue problems in finite dimensional spaces. Then smooth rearrangement of multiple eigenvalues is explicitly given. This result follows from an abstract theory, applicable to general p… ▽ More We study Hadamard variation of eigenvalues of Laplacian with respect to general domain perturbations. We show their existence up to the second order rigorously and characterize the derivatives, using associated eigenvalue problems in finite dimensional spaces. Then smooth rearrangement of multiple eigenvalues is explicitly given. This result follows from an abstract theory, applicable to general perturbations of symmetric bilinear forms. △ Less

Submitted 5 June, 2024; v1 submitted 1 September, 2023; originally announced September 2023.

Comments: to appear in Journal of the Mathematical Society of Japan

MSC Class: 35J25; 25R35

Computational Dating for the Nuzi Cuneiform Archive: The Least Squares Constrained by Family Trees and Synchronisms

Authors: Sumie Ueda, Takashi Tsuchiya, Yoshiaki Itoh

Abstract: We introduce a computational method of dating for an archive in ancient Mesopotamia. We use the name index Nuzi Personal Names (NPN) published in 1943. We made an electronic version of NPN and added the kinships of the two powerful families to NPN to reflect the Nuzi studies after 1943. Nuzi is a town from the 15th - 14th century B.C.E.for a period of some five generations in Arrapha. The cuneifor… ▽ More We introduce a computational method of dating for an archive in ancient Mesopotamia. We use the name index Nuzi Personal Names (NPN) published in 1943. We made an electronic version of NPN and added the kinships of the two powerful families to NPN to reflect the Nuzi studies after 1943. Nuzi is a town from the 15th - 14th century B.C.E.for a period of some five generations in Arrapha. The cuneiform tablets listed in NPN are for contracts on land transactions, marriage, loans, slavery, etc. In NPN, the kinships and cuneiform tablets (contracts, documents, texts) involved are listed for each person. We reconstruct family trees from the added NPN to formulate the least squares problem with the constraints: a person's father is at least 22.5 years older than the person, contractors were living at the time of the contract, etc. Our results agree with the Assyriological results of M. P. Maidman on the seniority among siblings of a powerful family. Our method could be applied to the other clay tablet archives once we have the name index in the format of NPN. △ Less

Submitted 23 August, 2023; originally announced August 2023.

Few-molecule reservoir computing experimentally demonstrated with surface enhanced Raman scattering and ion-gating stimulation

Authors: Daiki Nishioka, Yoshitaka Shingaya, Takashi Tsuchiya, Tohru Higuchi, Kazuya Terabe

Abstract: Reservoir computing (RC) is a promising solution for achieving low power consumption neuromorphic computing, although the large volume of the physical reservoirs reported to date has been a serious drawback in their practical application. Here, we report the development of a few-molecule RC that employs the molecular vibration dynamics in the para-mercaptobenzoic acid (pMBA) detected by surface en… ▽ More Reservoir computing (RC) is a promising solution for achieving low power consumption neuromorphic computing, although the large volume of the physical reservoirs reported to date has been a serious drawback in their practical application. Here, we report the development of a few-molecule RC that employs the molecular vibration dynamics in the para-mercaptobenzoic acid (pMBA) detected by surface enhanced Raman scattering (SERS) with tungsten oxide nanorod/silver nanoparticles (WOx@Ag-NPs). The Raman signals of the pMBA molecules, adsorbed at the SERS active site of WOx@Ag-NPs, were reversibly perturbated by the application of voltage-induced local pH changes in the vicinity of the molecules, and then used to perform RC of pattern recognition and prediction tasks. In spite of the small number of molecules employed, our system achieved good performance, including 95.1% to 97.7% accuracy in various nonlinear waveform transformations and 94.3% accuracy in solving a second-order nonlinear dynamic equation task. Our work provides a new concept of molecular computing with practical computation capabilities. △ Less

Submitted 18 July, 2023; originally announced July 2023.

Comments: 22 pages, 4 figures

Blockchain Censorship

Authors: Anton Wahrstätter, Jens Ernstberger, Aviv Yaish, Liyi Zhou, Kaihua Qin, Taro Tsuchiya, Sebastian Steinhorst, Davor Svetinovic, Nicolas Christin, Mikolaj Barczentewicz, Arthur Gervais

Abstract: Permissionless blockchains promise to be resilient against censorship by a single entity. This suggests that deterministic rules, and not third-party actors, are responsible for deciding if a transaction is appended to the blockchain or not. In 2022, the U.S. Office of Foreign Assets Control (OFAC) sanctioned a Bitcoin mixer and an Ethereum application, putting the neutrality of permissionless blo… ▽ More Permissionless blockchains promise to be resilient against censorship by a single entity. This suggests that deterministic rules, and not third-party actors, are responsible for deciding if a transaction is appended to the blockchain or not. In 2022, the U.S. Office of Foreign Assets Control (OFAC) sanctioned a Bitcoin mixer and an Ethereum application, putting the neutrality of permissionless blockchains to the test. In this paper, we formalize quantify and analyze the security impact of blockchain censorship. We start by defining censorship, followed by a quantitative assessment of current censorship practices. We find that 46% of Ethereum blocks were made by censoring actors that intend to comply with OFAC sanctions, indicating the significant impact of OFAC sanctions on the neutrality of public blockchains. We further uncover that censorship not only impacts neutrality, but also security. We show how after Ethereum's move to Proof-of-Stake (PoS) and adoption of Proposer-Builder Separation (PBS) the inclusion of censored transactions was delayed by an average of 85%. Inclusion delays compromise a transaction's security by, e.g., strengthening a sandwich adversary. Finally we prove a fundamental limitation of PoS and Proof-of-Work (PoW) protocols against censorship resilience. △ Less

Submitted 2 June, 2023; v1 submitted 29 May, 2023; originally announced May 2023.

Stability-penalty-adaptive follow-the-regularized-leader: Sparsity, game-dependency, and best-of-both-worlds

Authors: Taira Tsuchiya, Shinji Ito, Junya Honda

Abstract: Adaptivity to the difficulties of a problem is a key property in sequential decision-making problems to broaden the applicability of algorithms. Follow-the-regularized-leader (FTRL) has recently emerged as one of the most promising approaches for obtaining various types of adaptivity in bandit problems. Aiming to further generalize this adaptivity, we develop a generic adaptive learning rate, call… ▽ More Adaptivity to the difficulties of a problem is a key property in sequential decision-making problems to broaden the applicability of algorithms. Follow-the-regularized-leader (FTRL) has recently emerged as one of the most promising approaches for obtaining various types of adaptivity in bandit problems. Aiming to further generalize this adaptivity, we develop a generic adaptive learning rate, called stability-penalty-adaptive (SPA) learning rate for FTRL. This learning rate yields a regret bound jointly depending on stability and penalty of the algorithm, into which the regret of FTRL is typically decomposed. With this result, we establish several algorithms with three types of adaptivity: sparsity, game-dependency, and best-of-both-worlds (BOBW). Despite the fact that sparsity appears frequently in real problems, existing sparse multi-armed bandit algorithms with $k$-arms assume that the sparsity level $s \leq k$ is known in advance, which is often not the case in real-world scenarios. To address this issue, we first establish $s$-agnostic algorithms with regret bounds of $\tilde{O}(\sqrt{sT})$ in the adversarial regime for $T$ rounds, which matches the existing lower bound up to a logarithmic factor. Meanwhile, BOBW algorithms aim to achieve a near-optimal regret in both the stochastic and adversarial regimes. Leveraging the SPA learning rate and the technique for $s$-agnostic algorithms combined with a new analysis to bound the variation in FTRL output in response to changes in a regularizer, we establish the first BOBW algorithm with a sparsity-dependent bound. Additionally, we explore partial monitoring and demonstrate that the proposed SPA learning rate framework allows us to achieve a game-dependent bound and the BOBW simultaneously. △ Less

Submitted 13 February, 2024; v1 submitted 26 May, 2023; originally announced May 2023.

Comments: Published version in Advances in Neural Information Processing Systems 36 (NeurIPS 2023), 32 pages

Closing Duality Gaps of SDPs through Perturbation

Authors: Takashi Tsuchiya, Bruno F. Lourenço, Masakazu Muramatsu, Takayuki Okuno

Abstract: Let $({\bf P},{\bf D})$ be a primal-dual pair of SDPs with a nonzero finite duality gap. Under such circumstances, ${\bf P}$ and ${\bf D}$ are weakly feasible and if we perturb the problem data to recover strong feasibility, the (common) optimal value function $v$ as a function of the perturbation is not well-defined at zero (unperturbed data) since there are ``two different optimal values''… ▽ More Let $({\bf P},{\bf D})$ be a primal-dual pair of SDPs with a nonzero finite duality gap. Under such circumstances, ${\bf P}$ and ${\bf D}$ are weakly feasible and if we perturb the problem data to recover strong feasibility, the (common) optimal value function $v$ as a function of the perturbation is not well-defined at zero (unperturbed data) since there are ``two different optimal values'' $v({\bf P})$ and $v({\bf D})$, where $v({\bf P})$ and $v({\bf D})$ are the optimal values of ${\bf P}$ and ${\bf D}$ respectively. Thus, continuity of $v$ is lost at zero though $v$ is continuous elsewhere. Nevertheless, we show that a limiting version ${v_a}$ of $v$ is a well-defined monotone decreasing continuous bijective function connecting $v({\bf P})$ and $v({\bf D})$ with domain $[0, π/2]$ under the assumption that both ${\bf P}$ and ${\bf D}$ have singularity degree one. The domain $[0,π/2]$ corresponds to directions of perturbation defined in a certain manner. Thus, ${v_a}$ ``completely fills'' the nonzero duality gap under a mild regularity condition. Our result is tight in that there exists an instance with singularity degree two for which ${v_a}$ is not continuous. △ Less

Submitted 10 April, 2023; originally announced April 2023.

Comments: 26 pages. Comments welcome

Build a training interface to install the bat's echolocation skills in humans

Authors: Miyoko Tsumaki, Yu Teshima, Takao Tsuchiya, Kaoru Ashihara, Kohta I. Kobayasi, Shizuko Hiryu

Abstract: Bats use a sophisticated ultrasonic sensing method called echolocation to recognize the environment. Recently, it has been reported that sighted human participants with no prior experience in echolocation can improve their ability to perceive the spatial layout of various environments through training to listen to echoes (Norman, et al., 2021). In this study, we developed the new training system f… ▽ More Bats use a sophisticated ultrasonic sensing method called echolocation to recognize the environment. Recently, it has been reported that sighted human participants with no prior experience in echolocation can improve their ability to perceive the spatial layout of various environments through training to listen to echoes (Norman, et al., 2021). In this study, we developed the new training system for human echolocation using the eye-tracker. Binaural echoes of consecutive downward linear FM pulses that were inspired by feeding strategies of echolocating bats were simulated using the wave equation finite difference time domain method. The virtual echoes were presented to the sighted subject in response to his or her eye movements on the monitor. The latency from eye gazing to the echo presentation wasn't audible delay to perceive. In a preliminary experiment in which the participants were asked to identify the shapes of the hidden target, the participants were found to concentrate their gaze on the edges of the hidden target on the monitor. We will conduct a psycho-acoustical experiment to examine the learning process of human echolocation in a shape-identification task, which will lead to device development in the field of welfare engineering. △ Less

Submitted 17 February, 2023; originally announced February 2023.

Comments: 4 pages, 3 figures

Numerical accuracy and stability of semilinear Klein--Gordon equation in de Sitter spacetime

Authors: Takuya Tsuchiya, Makoto Nakamura

Abstract: Numerical simulations of the semilinear Klein--Gordon equation in the de Sitter spacetime are performed. We use two structure-preserving discrete forms of the Klein--Gordon equation. The disparity between the two forms is the discretization of the differential term. We show that one of the forms has higher numerical stability and second-order numerical accuracy with respect to the grid, and we exp… ▽ More Numerical simulations of the semilinear Klein--Gordon equation in the de Sitter spacetime are performed. We use two structure-preserving discrete forms of the Klein--Gordon equation. The disparity between the two forms is the discretization of the differential term. We show that one of the forms has higher numerical stability and second-order numerical accuracy with respect to the grid, and we explain the reason for the instability of the other form. △ Less

Submitted 16 November, 2022; originally announced November 2022.

Comments: 7 pages

Journal ref: JSIAM Letters vol. 15, pp. 45--48 (2023)

Finding Critical Nodes in Interdependent Networks with SAT and ILP Solvers

Authors: Kyozo Hida, Tatsuhiro Tsuchiya

Abstract: Infrastructure systems, such as power systems, often experience cascading failures. Modeling an infrastructure system as a collection of interdependent networks has recently received attention as a way to explain cascading failures. In this study, we propose an approach to find the set of critical nodes in an interdependent network. For an integer k, we say that a set of k nodes is critical if the… ▽ More Infrastructure systems, such as power systems, often experience cascading failures. Modeling an infrastructure system as a collection of interdependent networks has recently received attention as a way to explain cascading failures. In this study, we propose an approach to find the set of critical nodes in an interdependent network. For an integer k, we say that a set of k nodes is critical if the initial failures of these k nodes result in the most severe cascading failure among all sets of k nodes. This approach adopts the seminal model of interdependent networks proposed by Buldyrev et al., in which new link failures occur in a network if the connectivity is lost in the paired network. The problem of finding critical nodes is NP-hard; thus the aim of the approach is to accurately solve the problem in feasible time for moderate-size problem instances. The proposed approach consists of two phases. In the first phase, the maximum number of failure propagation stages is computed by repeatedly solving the Boolean satisfiability problem. This number is then used in the second phase, where the set of critical nodes is computed using integer linear programming. The results of applying this approach to a variety of problem instances demonstrate that the approach is feasible for up to at least 30 nodes and can be used as the baseline to compare the performance of heuristic solutions. △ Less

Submitted 10 November, 2022; originally announced November 2022.

Liouville's formulae and Hadamard variation with respect to general domain perturbations

Authors: Takashi Suzuki, Takuya Tsuchiya

Abstract: We study Hadamard variations with respect to general domain perturbations, particularly for the Neumann boundary condition. They are derived from new Liouville's formulae concerning the transformation of volume and area integrals. Then, relations to several geometric quantities are discussed; differential forms and the second fundamental form on the boundary. We study Hadamard variations with respect to general domain perturbations, particularly for the Neumann boundary condition. They are derived from new Liouville's formulae concerning the transformation of volume and area integrals. Then, relations to several geometric quantities are discussed; differential forms and the second fundamental form on the boundary. △ Less

Submitted 1 February, 2023; v1 submitted 2 October, 2022; originally announced October 2022.

Comments: This paper will appear in Journal of Mathematical Society of Japan

MSC Class: 35J25; 35R35

Journal ref: Journal of Mathematical Society of Japan, 75 (2023) 983--1024

A Redox-based Ion-Gating Reservoir, Utilizing Double Reservoir States in Drain and Gate Nonlinear Responses

Authors: Tomoki Wada, Daiki Nishioka, Wataru Namiki, Takashi Tsuchiya, Tohru Higuchi, Kazuya Terabe

Abstract: We have demonstrated physical reservoir computing with a redox-based ion-gating reservoir (redox-IGR) comprising LixWO3 thin film and lithium ion conducting glass ceramic (LICGC). The subject redox-IGR successfully solved a second-order nonlinear dynamic equation by utilizing voltage pulse driven ion-gating in a LixWO3 channel to enable reservoir computing. Under the normal conditions, in which on… ▽ More We have demonstrated physical reservoir computing with a redox-based ion-gating reservoir (redox-IGR) comprising LixWO3 thin film and lithium ion conducting glass ceramic (LICGC). The subject redox-IGR successfully solved a second-order nonlinear dynamic equation by utilizing voltage pulse driven ion-gating in a LixWO3 channel to enable reservoir computing. Under the normal conditions, in which only the drain current (ID) is used for the reservoir states, the lowest prediction error is 7.39x10-4. Performance was enhanced by the addition of IG to the reservoir states, resulting in a significant lowering of the prediction error to 5.06x10-4, which is noticeably lower than other types of physical reservoirs reported to date. A second-order nonlinear autoregressive moving average (NARMA2) task, a typical benchmark of reservoir computing, was also performed with the IGR and good performance was achieved, with an NMSE of 0.163. A short-term memory task was performed to investigate an enhancement mechanism resulting from the IG addition. An increase in memory capacity, from 1.87 without IG to 2.73 with IG, was observed in the forgetting curves, indicating that enhancement of both high dimensionality and memory capacity are attributed to the origin of the performance improvement. △ Less

Submitted 12 August, 2022; originally announced August 2022.

Comments: 22 pages, 4 figures

Best-of-Both-Worlds Algorithms for Partial Monitoring

Authors: Taira Tsuchiya, Shinji Ito, Junya Honda

Abstract: This study considers the partial monitoring problem with $k$-actions and $d$-outcomes and provides the first best-of-both-worlds algorithms, whose regrets are favorably bounded both in the stochastic and adversarial regimes. In particular, we show that for non-degenerate locally observable games, the regret is $O(m^2 k^4 \log(T) \log(k_Π T) / Δ_{\min})$ in the stochastic regime and… ▽ More This study considers the partial monitoring problem with $k$-actions and $d$-outcomes and provides the first best-of-both-worlds algorithms, whose regrets are favorably bounded both in the stochastic and adversarial regimes. In particular, we show that for non-degenerate locally observable games, the regret is $O(m^2 k^4 \log(T) \log(k_Π T) / Δ_{\min})$ in the stochastic regime and $O(m k^{2/3} \sqrt{T \log(T) \log k_Π})$ in the adversarial regime, where $T$ is the number of rounds, $m$ is the maximum number of distinct observations per action, $Δ_{\min}$ is the minimum suboptimality gap, and $k_Π$ is the number of Pareto optimal actions. Moreover, we show that for globally observable games, the regret is $O(c_{\mathcal{G}}^2 \log(T) \log(k_Π T) / Δ_{\min}^2)$ in the stochastic regime and $O((c_{\mathcal{G}}^2 \log(T) \log(k_Π T))^{1/3} T^{2/3})$ in the adversarial regime, where $c_{\mathcal{G}}$ is a game-dependent constant. We also provide regret bounds for a stochastic regime with adversarial corruptions. Our algorithms are based on the follow-the-regularized-leader framework and are inspired by the approach of exploration by optimization and the adaptive learning rate in the field of online learning with feedback graphs. △ Less

Submitted 9 October, 2022; v1 submitted 29 July, 2022; originally announced July 2022.

Comments: 31 pages

Experimental Demonstration of High-Performance Physical Reservoir Computing with Nonlinear Interfered Spin Wave Multi-Detection

Authors: Wataru Namiki, Daiki Nishioka, Yu Yamaguchi, Takashi Tsuchiya, Tohru Higuchi, Kazuya Terabe

Abstract: Physical reservoir computing, which is a promising method for the implementation of highly efficient artificial intelligence devices, requires a physical system with nonlinearity, fading memory, and the ability to map in high dimensions. Although it is expected that spin wave interference can perform as highly efficient reservoir computing in some micromagnetic simulations, there has been no exper… ▽ More Physical reservoir computing, which is a promising method for the implementation of highly efficient artificial intelligence devices, requires a physical system with nonlinearity, fading memory, and the ability to map in high dimensions. Although it is expected that spin wave interference can perform as highly efficient reservoir computing in some micromagnetic simulations, there has been no experimental verification to date. Herein, we demonstrate reservoir computing that utilizes multidetected nonlinear spin wave interference in an yttrium iron garnet single crystal. The subject computing system achieved excellent performance when used for hand-written digit recognition, second-order nonlinear dynamical tasks, and nonlinear autoregressive moving average (NARMA). It is of particular note that normalized mean square errors (NMSEs) for NARMA2 and second-order nonlinear dynamical tasks were 1.81x10-2 and 8.37x10-5, respectively, which are the lowest figures for any experimental physical reservoir so far reported. Said high performance was achieved with higher nonlinearity and the large memory capacity of interfered spin wave multi-detection. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Comments: 19 pages, 5 figures

Edge-Of-Chaos Learning Achieved by Ion-Electron Coupled Dynamics in an Ion-Gating Reservoir

Authors: Daiki Nishioka, Takashi Tsuchiya, Wataru Namiki, Makoto Takayanagi, Masataka Imura, Yasuo Koide, Tohru Higuchi, Kazuya Terabe

Abstract: Physical reservoir computing has recently been attracting attention for its ability to significantly reduce the computational resources required to process time-series data. However, the physical reservoirs that have been reported to date have had insufficient expression power, and most of them have a large volume, which makes their practical application difficult. Herein we describe the developme… ▽ More Physical reservoir computing has recently been attracting attention for its ability to significantly reduce the computational resources required to process time-series data. However, the physical reservoirs that have been reported to date have had insufficient expression power, and most of them have a large volume, which makes their practical application difficult. Herein we describe the development of a Li+-electrolyte based ion-gating reservoir (IGR), with ion-electron coupled dynamics, for use in high performance physical reservoir computing. A variety of synaptic responses were obtained in response to past experience, which responses were stored as transient charge density patterns in an electric double layer, at the Li+-electrolyte/diamond interface. Performance, which was tested using a nonlinear autoregressive moving-average (NARMA) task, was found to be excellent, with a NMSE of 0.023 for NARMA2, which is the highest for any physical reservoir reported to date. The maximum Lyapunov exponent of the IGR was 0.0083: the edge of chaos state enabling the best computational capacity. The IGR described herein opens the way for high-performance and integrated neural network devices. △ Less

Submitted 6 July, 2022; originally announced July 2022.

Comments: 25 pages, 5 figures for main part and 4 figures for Supplementary information

On the stability of covariant BSSN formulation

Authors: Ryosuke Urakawa, Takuya Tsuchiya, Gen Yoneda

Abstract: In this study, we investigate the numerical stability of the covariant BSSN (cBSSN) formulation proposed by Brown. We calculate the constraint amplification factor (CAF), which is an eigenvalue of the coefficient matrix of the evolution equations of the constraints on the cBSSN formulation and on some adjusted formulations with constraints added to the evolution equations. The adjusted formulation… ▽ More In this study, we investigate the numerical stability of the covariant BSSN (cBSSN) formulation proposed by Brown. We calculate the constraint amplification factor (CAF), which is an eigenvalue of the coefficient matrix of the evolution equations of the constraints on the cBSSN formulation and on some adjusted formulations with constraints added to the evolution equations. The adjusted formulations have a higher numerical stability than the cBSSN formulation from the viewpoint of the CAF. △ Less

Submitted 26 June, 2022; originally announced June 2022.

Comments: 18 pages, 6 figures

Generalized Two Color Map Theorem -- Complete Theorem of Robust Gait Plan for a Tilt-rotor

Authors: Zhe Shen, Yudong Ma, Takeshi Tsuchiya

Abstract: Gait plan is a procedure that is typically applied on the ground robots, e.g., quadrupedal robots; the tilt-rotor, a novel type of quadrotor with eight inputs, is not one of them. While controlling the tilt-rotor relying on feedback linearization, the tilting angles (inputs) are expected to change over-intensively, which may not be expected in the application. To help suppress the intensive change… ▽ More Gait plan is a procedure that is typically applied on the ground robots, e.g., quadrupedal robots; the tilt-rotor, a novel type of quadrotor with eight inputs, is not one of them. While controlling the tilt-rotor relying on feedback linearization, the tilting angles (inputs) are expected to change over-intensively, which may not be expected in the application. To help suppress the intensive change in the tilting angles, a gait plan procedure is introduced to the tilt-rotor before feedback linearization. The tilting angles are specified with time in advance by users rather than given by the control rule. However, based on this scenario, the decoupling matrix in feedback linearization can be singular for some attitudes, combinations of roll angle and pitch angle. It hinders the further application of the feedback linearization. With this concern, Two Color Map Theorem is established to maximize the acceptable attitude region, where the combinations of roll and pitch will give an invertible decoupling matrix. That theorem, however, over-restricts the choice of the tilting angles, which can rule out some feasible robust gaits. This paper gives the generalized Two Color Map Theorem; all the robust gaits can be found based on this generalized theorem. The robustness of three gaits that satisfy this generalized Two Color Map Theorem (while violating Two Color Map Theorem) are analyzed. The results show that Generalized Two Color Map Theorem completes the search for the robust gaits for a tilt-rotor. △ Less

Submitted 12 November, 2023; v1 submitted 27 June, 2022; originally announced June 2022.

The Robust Gait of a Tilt-rotor and Its Application to Tracking Control -- Application of Two Color Map Theorem

Authors: Zhe Shen, Takeshi Tsuchiya

Abstract: Rylls tilt-rotor is a UAV with eight inputs; the four magnitudes of the thrusts as well as four tilting angles of the thrusts can be specified in need, e.g., based on a control rule. Despite of the success in simulation, conventional feedback linearization witnesses the over-intensive change in the inputs while applying to stabilize Rylls tilt-rotor. Our previous research thus put the extra proced… ▽ More Rylls tilt-rotor is a UAV with eight inputs; the four magnitudes of the thrusts as well as four tilting angles of the thrusts can be specified in need, e.g., based on a control rule. Despite of the success in simulation, conventional feedback linearization witnesses the over-intensive change in the inputs while applying to stabilize Rylls tilt-rotor. Our previous research thus put the extra procedure named gait plan forward to suppress the unexpected changes in the tilting angles. Accompanying the Two Color Map Theorem, the tilting-angles are planned robustly and continuously. The designed gaits are robust to the change of the attitude. However, this is not a complete theory before further applying to the tracking simulation test. This paper further discusses some gaits following the Two Color Map Theorem and simulates a tracking problem for a tilt-rotor. A uniform circular moving reference is designed to be tracked by the tilt-rotor equipped with the designed robust gait and the feedback linearization controller. The gaits satisfying Two Color Map Theorem show the robustness. The results from the simulation show the success in tracking of the tilt-rotor. △ Less

Submitted 26 June, 2022; v1 submitted 22 June, 2022; originally announced June 2022.

Comments: Submitted to ICCAS 2022

Joint Analysis of Acoustic Scenes and Sound Events Based on Multitask Learning with Dynamic Weight Adaptation

Authors: Kayo Nada, Keisuke Imoto, Takao Tsuchiya

Abstract: Acoustic scene classification (ASC) and sound event detection (SED) are major topics in environmental sound analysis. Considering that acoustic scenes and sound events are closely related to each other, the joint analysis of acoustic scenes and sound events using multitask learning (MTL)-based neural networks was proposed in some previous works. Conventional methods train MTL-based models using a… ▽ More Acoustic scene classification (ASC) and sound event detection (SED) are major topics in environmental sound analysis. Considering that acoustic scenes and sound events are closely related to each other, the joint analysis of acoustic scenes and sound events using multitask learning (MTL)-based neural networks was proposed in some previous works. Conventional methods train MTL-based models using a linear combination of ASC and SED loss functions with constant weights. However, the performance of conventional MTL-based methods depends strongly on the weights of the ASC and SED losses, and it is difficult to determine the appropriate balance between the constant weights of the losses of MTL of ASC and SED. In this paper, we thus propose dynamic weight adaptation methods for MTL of ASC and SED based on dynamic weight average and multi--focal loss to adjust the learning weights automatically. Evaluation experiments using parts of the TUT Acoustic Scenes 2016/2017 and TUT Sound Events 2016/2017 are conducted, and we show that the proposed methods improve the scene classification and event detection performance characteristics compared with the conventional MTL-based method. We then investigate how the learning weights of ASC and SED tasks dynamically adapt as the model training progresses. △ Less

Submitted 21 June, 2022; originally announced June 2022.

Comments: Submitted to Acoustical Science and Technology

Adversarially Robust Multi-Armed Bandit Algorithm with Variance-Dependent Regret Bounds

Authors: Shinji Ito, Taira Tsuchiya, Junya Honda

Abstract: This paper considers the multi-armed bandit (MAB) problem and provides a new best-of-both-worlds (BOBW) algorithm that works nearly optimally in both stochastic and adversarial settings. In stochastic settings, some existing BOBW algorithms achieve tight gap-dependent regret bounds of $O(\sum_{i: Δ_i>0} \frac{\log T}{Δ_i})$ for suboptimality gap $Δ_i$ of arm $i$ and time horizon $T$. As Audibert e… ▽ More This paper considers the multi-armed bandit (MAB) problem and provides a new best-of-both-worlds (BOBW) algorithm that works nearly optimally in both stochastic and adversarial settings. In stochastic settings, some existing BOBW algorithms achieve tight gap-dependent regret bounds of $O(\sum_{i: Δ_i>0} \frac{\log T}{Δ_i})$ for suboptimality gap $Δ_i$ of arm $i$ and time horizon $T$. As Audibert et al. [2007] have shown, however, that the performance can be improved in stochastic environments with low-variance arms. In fact, they have provided a stochastic MAB algorithm with gap-variance-dependent regret bounds of $O(\sum_{i: Δ_i>0} (\frac{σ_i^2}{Δ_i} + 1) \log T )$ for loss variance $σ_i^2$ of arm $i$. In this paper, we propose the first BOBW algorithm with gap-variance-dependent bounds, showing that the variance information can be used even in the possibly adversarial environment. Further, the leading constant factor in our gap-variance dependent bound is only (almost) twice the value for the lower bound. Additionally, the proposed algorithm enjoys multiple data-dependent regret bounds in adversarial settings and works well in stochastic settings with adversarial corruptions. The proposed algorithm is based on the follow-the-regularized-leader method and employs adaptive learning rates that depend on the empirical prediction error of the loss, which leads to gap-variance-dependent regret bounds reflecting the variance of the arms. △ Less

Submitted 14 June, 2022; originally announced June 2022.

Comments: Accepted for presentation at the 35th Annual Conference on Learning Theory (COLT 2022). Only the extended abstract will appear in the conference proceedings

Minimax Optimal Algorithms for Fixed-Budget Best Arm Identification

Authors: Junpei Komiyama, Taira Tsuchiya, Junya Honda

Abstract: We consider the fixed-budget best arm identification problem where the goal is to find the arm of the largest mean with a fixed number of samples. It is known that the probability of misidentifying the best arm is exponentially small to the number of rounds. However, limited characterizations have been discussed on the rate (exponent) of this value. In this paper, we characterize the minimax optim… ▽ More We consider the fixed-budget best arm identification problem where the goal is to find the arm of the largest mean with a fixed number of samples. It is known that the probability of misidentifying the best arm is exponentially small to the number of rounds. However, limited characterizations have been discussed on the rate (exponent) of this value. In this paper, we characterize the minimax optimal rate as a result of an optimization over all possible parameters. We introduce two rates, $R^{\mathrm{go}}$ and $R^{\mathrm{go}}_{\infty}$, corresponding to lower bounds on the probability of misidentification, each of which is associated with a proposed algorithm. The rate $R^{\mathrm{go}}$ is associated with $R^{\mathrm{go}}$-tracking, which can be efficiently implemented by a neural network and is shown to outperform existing algorithms. However, this rate requires a nontrivial condition to be achievable. To address this issue, we introduce the second rate $R^{\mathrm{go}}_\infty$. We show that this rate is indeed achievable by introducing a conceptual algorithm called delayed optimal tracking (DOT). △ Less

Submitted 26 October, 2022; v1 submitted 9 June, 2022; originally announced June 2022.

Comments: NeurIPS 2022 version https://openreview.net/forum?id=TIQfmR7IF6H

Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback Graphs

Authors: Shinji Ito, Taira Tsuchiya, Junya Honda

Abstract: This study considers online learning with general directed feedback graphs. For this problem, we present best-of-both-worlds algorithms that achieve nearly tight regret bounds for adversarial environments as well as poly-logarithmic regret bounds for stochastic environments. As Alon et al. [2015] have shown, tight regret bounds depend on the structure of the feedback graph: strongly observable gra… ▽ More This study considers online learning with general directed feedback graphs. For this problem, we present best-of-both-worlds algorithms that achieve nearly tight regret bounds for adversarial environments as well as poly-logarithmic regret bounds for stochastic environments. As Alon et al. [2015] have shown, tight regret bounds depend on the structure of the feedback graph: strongly observable graphs yield minimax regret of $\tildeΘ( α^{1/2} T^{1/2} )$, while weakly observable graphs induce minimax regret of $\tildeΘ( δ^{1/3} T^{2/3} )$, where $α$ and $δ$, respectively, represent the independence number of the graph and the domination number of a certain portion of the graph. Our proposed algorithm for strongly observable graphs has a regret bound of $\tilde{O}( α^{1/2} T^{1/2} ) $ for adversarial environments, as well as of $ {O} ( \frac{α(\ln T)^3 }{Δ_{\min}} ) $ for stochastic environments, where $Δ_{\min}$ expresses the minimum suboptimality gap. This result resolves an open question raised by Erez and Koren [2021]. We also provide an algorithm for weakly observable graphs that achieves a regret bound of $\tilde{O}( δ^{1/3}T^{2/3} )$ for adversarial environments and poly-logarithmic regret for stochastic environments. The proposed algorithms are based on the follow-the-regularized-leader approach combined with newly designed update rules for learning rates. △ Less

Submitted 26 December, 2022; v1 submitted 2 June, 2022; originally announced June 2022.

Comments: Accepted at NeurIPS 2022

Embedded System Evolution in IoT System Development Based on MAPE-K Loop Mechanism

Authors: Hiroyuki Nakagawa, Shinya Tsuchida, Emiliano Tramontana, Andrea Fornaia, Tatsuhiro Tsuchiya

Abstract: Embedded systems including IoT devices are designed for specialized functions; thus, changes in functions are not considered following their release. For this reason, changing functions to satisfy the requirements of IoT systems is difficult. In this study, we focus on updating existing embedded systems without modifying them. We investigate the design of new functions and their implementation wit… ▽ More Embedded systems including IoT devices are designed for specialized functions; thus, changes in functions are not considered following their release. For this reason, changing functions to satisfy the requirements of IoT systems is difficult. In this study, we focus on updating existing embedded systems without modifying them. We investigate the design of new functions and their implementation with limited resources. This paper describes an evolution mechanism for updating the functionalities of existing embedded systems. The evolution mechanism uses a control unit that is deployed outside the embedded system. To guide the steady implementation of the evolution mechanism, we define an evolution process that effectively uses the state machine diagram at the design time and runtime to update the embedded systems. The programming framework implemented in this study supports the evolution process. We evaluate the evolution mechanism based on the results from two experiments. The first experiment involved applying the evolution mechanism to a cleaning robot, this demonstrated that the evolution mechanism systematically enables the injection of new functions into an embedded system in the real world. The second experiment, on the probabilistic model checking, demonstrated that the mechanism provides almost the same performance as the ordinary embedded system with an improved robustness. △ Less

Submitted 26 May, 2022; originally announced May 2022.

Two are not always better than one: Role specialization is an important determinant of collaborative task performance

Authors: Asuka Takai, Qiushi Fu, Yuzuru Doibata, Giuseppe Lisi, Toshiki Tsuchiya, Keivan Mojtahedi, Toshinori Yoshioka, Mitsuo Kawato, Jun Morimoto, Marco Santello

Abstract: Collaboration frequently yields better results in decision making, learning, and haptic interactions than when these actions are performed individually. However, is collaboration always superior to solo actions, or do its benefits depend on whether collaborating individuals have different or the same roles? To answer this question, we asked human subjects to perform virtual-reality collaborative a… ▽ More Collaboration frequently yields better results in decision making, learning, and haptic interactions than when these actions are performed individually. However, is collaboration always superior to solo actions, or do its benefits depend on whether collaborating individuals have different or the same roles? To answer this question, we asked human subjects to perform virtual-reality collaborative and individual beam transportation tasks. These tasks were simulated in real-time by coupling the motion of a pair of hand-held robotic manipulanda to the virtual beam using virtual spring-dampers. For the task to be considered successful, participants had to complete it within temporal and spatial constraints. While the visual feedback remained the same, the underlying dynamics of the beam were altered to create two distinctive task contexts which were determined by a moving pivot constraint. When the pivot was placed at the center of the beam, two hands contribute to the task with symmetric mechanical leverage (symmetric context). When the pivot was placed at the left side of the beam, two hands contribute to the task with asymmetric mechanical leverage (asymmetric context). Participants performed these task contexts either individually with both hands (solo), or collaboratively by pairing one hand with another one (dyads). We found that dyads in the asymmetric context performed better than solos. In contrast, solos performed the symmetric context better than dyads. Importantly, we found that two hands took different roles in the asymmetric context for both solos and dyads. In contrast, the contribution from each hand was statistically indistinguishable in the symmetric context. Our findings suggest that better performance in dyads than solos is not a general phenomenon, but rather that collaboration yields better performance only when role specialization emerges in dyadic interactions. △ Less

Submitted 12 May, 2022; originally announced May 2022.

Four-dimensional Gait Surfaces for A Tilt-rotor -- Two Color Map Theorem

Authors: Zhe Shen, Yudong Ma, Takeshi Tsuchiya

Abstract: This article presents the four-dimensional surfaces which instruct the gait plan for a tilt-rotor. The previous gaits analyzed in the tilt-rotor research are inspired by animals; no theoretical base backs the robustness of these gaits. This research deduces the gaits by diminishing the effect of the attitude of the tilt-rotor for the first time. Four-dimensional gait surfaces are subsequently foun… ▽ More This article presents the four-dimensional surfaces which instruct the gait plan for a tilt-rotor. The previous gaits analyzed in the tilt-rotor research are inspired by animals; no theoretical base backs the robustness of these gaits. This research deduces the gaits by diminishing the effect of the attitude of the tilt-rotor for the first time. Four-dimensional gait surfaces are subsequently found, on which the gaits are expected to be robust to the attitude. These surfaces provide the region where the gait is suggested to be planned. However, a discontinuous region may hinder the gait plan process while utilizing the proposal gait surfaces. A Two Color Map Theorem is then established to guarantee the continuity of each gait designed. The robustness of the typical gaits obeying the Two Color Map Theorem and on the gait surface is demonstrated by comparing the singular curve in attitude with the gaits not on the gait surface. The result shows that the acceptable attitudes enlarge for the gaits on the gait surface. △ Less

Submitted 4 April, 2022; originally announced April 2022.

Cat-inspired Gaits for A Tilt-rotor -- from Symmetrical to Asymmetrical

Authors: Zhe Shen, Takeshi Tsuchiya

Abstract: Among the tilt-rotors (quadrotors) developed in the last decades, Rylls model with eight inputs (four magnitudes of the thrusts and four tilting angles) attracted great attention. Typical feedback linearization maneuvers all the eight inputs with a united control rule to stabilize this tilt-rotor. Instead of assigning the tilting angles by the control rule, the recent research predetermined the ti… ▽ More Among the tilt-rotors (quadrotors) developed in the last decades, Rylls model with eight inputs (four magnitudes of the thrusts and four tilting angles) attracted great attention. Typical feedback linearization maneuvers all the eight inputs with a united control rule to stabilize this tilt-rotor. Instead of assigning the tilting angles by the control rule, the recent research predetermined the tilting angles and left the magnitudes of the thrusts the only control signals. These tilting angles are designed to mimic the cat-trot gait, avoiding the singular decoupling matrix feedback linearization. To complete the discussions of the cat-gaits inspired tilt-rotor gaits, this research addresses the analyses on the rest of the common cat gaits, walk, run, transverse gallop, and rotary gallop. It is found that the singular decoupling matrix exist in walk gait and rotary gallop. Further modifications are conducted to these two gaits to accommodate the application of feedback linearization. The modified gaits with different periods are then applied to the tilt-rotor in tracking experiments, in which the references are uniform rectilinear motion and uniform circular motion. All the experiments are simulated in Simulink, MATLAB. The result shows that. △ Less

Submitted 22 March, 2022; originally announced March 2022.

Numerical simulations of semilinear Klein--Gordon equation in the de Sitter spacetime with structure-preserving scheme

Authors: Takuya Tsuchiya, Makoto Nakamura

Abstract: We perform some simulations of the semilinear Klein--Gordon equation in the de Sitter spacetime. We reported the accurate numerical results of the equation with the structure-preserving scheme (SPS) in an earlier publication (Tsuchiya and Nakamura in J. Comput. Appl. Math. \textbf{361}: 396--412, 2019). To investigate the factors for the stability and accuracy of the numerical results with SPS, we… ▽ More We perform some simulations of the semilinear Klein--Gordon equation in the de Sitter spacetime. We reported the accurate numerical results of the equation with the structure-preserving scheme (SPS) in an earlier publication (Tsuchiya and Nakamura in J. Comput. Appl. Math. \textbf{361}: 396--412, 2019). To investigate the factors for the stability and accuracy of the numerical results with SPS, we perform some simulations with three discretized formulations. The first formulation is the discretized equations with SPS, the second one is with SPS that replaces the second-order difference as the standard second-order central difference, and the third one is with SPS that replaces the discretized nonlinear term as the standard discretized expression. As a result, the above two replacements in SPS are found to be effective for accurate simulations. On the other hand, the ingenuity of replacing the second-order difference in the first formulation is not effective for maintaining the stability of the simulations. △ Less

Submitted 5 July, 2022; v1 submitted 17 March, 2022; originally announced March 2022.

Comments: 8 pages, 4 figures, accepted for publication in Birkhauser book series "Research Perspectives" under the title Analysis, Applications, and Computations - Selected contributions of the 13th ISAAC Congress, Ghent, Belgium, 2021

MSC Class: 65Mxx ACM Class: G.1.8

Stable numerical simulation of Einstein equations in gravitational collapse space--time

Authors: Takuya Tsuchiya, Ryosuke Urakawa, Gen Yoneda

Abstract: We perform simulations in a gravitational collapsing model using the Einstein equations. In this paper, we review the equations for constructing the initial values and the evolution form of the Einstein equations called the BSSN formulation. In addition, since we treat a nonvacuum case, we review the evolution equations of the matter fields of a perfect fluid. To make the simulations stable, we pr… ▽ More We perform simulations in a gravitational collapsing model using the Einstein equations. In this paper, we review the equations for constructing the initial values and the evolution form of the Einstein equations called the BSSN formulation. In addition, since we treat a nonvacuum case, we review the evolution equations of the matter fields of a perfect fluid. To make the simulations stable, we propose a modified system, which decreases numerical errors in analysis, and we actually perform stable simulations with decreased numerical errors. △ Less

Submitted 6 July, 2022; v1 submitted 9 March, 2022; originally announced March 2022.

Comments: 8 pages, 4 figures

MSC Class: 83C05; 65M06

Journal ref: JSIAM Letters Vol. 14 (2022) pp. 84-87

Feedback Linearization Based Tracking Control of A Tilt-rotor with Cat-trot Gait Plan

Authors: Zhe Shen, Yudong Ma, Takeshi Tsuchiya

Abstract: With the introduction of the laterally bounded forces, the tilt-rotor gains more flexibility in the controller design. Typical feedback linearization methods utilize all the inputs in controlling this vehicle; the magnitudes as well as the directions of the thrusts are maneuvered simultaneously based on a unified control rule. Although several promising results indicate that these controllers may… ▽ More With the introduction of the laterally bounded forces, the tilt-rotor gains more flexibility in the controller design. Typical feedback linearization methods utilize all the inputs in controlling this vehicle; the magnitudes as well as the directions of the thrusts are maneuvered simultaneously based on a unified control rule. Although several promising results indicate that these controllers may track the desired complicated trajectories, the tilting angles are required to change relatively fast or in large scale during the flight, which turns to be a challenge in application. The recent gait plan for a tilt-rotor may solve this problem; the tilting angles are fixed or vary in a predetermined pattern without being maneuvered by the control algorithm. Carefully avoiding the singular decoupling matrix, several attitudes can be tracked without changing the tilting angles frequently. While the position was not directly regulated in that research, which left the position-tracking still an open question. In this research, we elucidate the coupling relationship between the position and the attitude. Based on this, we design the position-tracking controller, adopting feedback linearization. A cat-trot gait is further designed for a tilt-rotor to track the reference; three types of references are designed for our tracking experiments: setpoint, uniform rectilinear motion, and uniform circular motion. The significant improvement with less steady state error is witnessed after equip** with our modified attitude-position decoupler. It is also found that the frequency of the cat-trot gait highly influenced the steady state error. △ Less

Submitted 26 March, 2022; v1 submitted 6 February, 2022; originally announced February 2022.

Gait Analysis for A Tilt-rotor: The Dynamic Invertible Gait

Authors: Zhe Shen, Takeshi Tsuchiya

Abstract: Conventional Feedback-Linearization-based controller, applied to the tilt-rotor (eight inputs), results in the extensive changes in the tilting angles, which are not expected in practice. To solve this problem, we introduce the novel concept UAV gait to restrict the tilting angles. The gait plan was initially to solve the control problems for quadruped (four-legged) robots. Transplanting this appr… ▽ More Conventional Feedback-Linearization-based controller, applied to the tilt-rotor (eight inputs), results in the extensive changes in the tilting angles, which are not expected in practice. To solve this problem, we introduce the novel concept UAV gait to restrict the tilting angles. The gait plan was initially to solve the control problems for quadruped (four-legged) robots. Transplanting this approach, accompanied by feedback linearization, to the tiltrotor may cause the well-known non-invertible problem in the decoupling matrix. In this research, we explore the invertible gait for the tiltrotor and apply feedback linearization to stabilize the attitude and the altitude. The equivalent conditions to achieve a full-rank decoupling matrix are deduced and simplified to a near zero roll and zero pitch. This paper proposed several invertible gaits to conduct the attitude-altitude control test. The accepted gaits within the region of interest are visualized. The experiment is simulated in Simulink, MATLAB. The results show the promising response in attitude and altitude. △ Less

Submitted 11 February, 2022; v1 submitted 5 January, 2022; originally announced January 2022.

Fully coupled drift-less Forward and backward Stochastic Differential Equations in a degenerate case

Authors: Takahiro Tsuchiya

Abstract: Existence and uniqueness results of fully coupled forward stochastic differential equations without drifts and backward stochastic differential equations in a degenerate case are obtained for an arbitrarily large time duration. Existence and uniqueness results of fully coupled forward stochastic differential equations without drifts and backward stochastic differential equations in a degenerate case are obtained for an arbitrarily large time duration. △ Less

Submitted 19 October, 2022; v1 submitted 22 December, 2021; originally announced December 2021.

Comments: modified the proof of theorem 4.1

Stability Analysis of a Feedback-linearization-based Controller with Saturation: A Tilt Vehicle with the Penguin-inspired Gait Plan

Authors: Zhe Shen, Yudong Ma, Takeshi Tsuchiya

Abstract: Saturations in control signal can challenge the stability proof of a feedback-linearization-based controller, even leading the system unstable [1]. Thus, several approaches are established to avoid reaching the saturation bound [2,3]. Meanwhile, to help design the controller for a quad-tilt-rotor, [1] modeled a tilt vehicle with implementing the feedback-linearization-based controllers. In this ar… ▽ More Saturations in control signal can challenge the stability proof of a feedback-linearization-based controller, even leading the system unstable [1]. Thus, several approaches are established to avoid reaching the saturation bound [2,3]. Meanwhile, to help design the controller for a quad-tilt-rotor, [1] modeled a tilt vehicle with implementing the feedback-linearization-based controllers. In this article, we provide a gait plan for this tilt vehicle and control it utilizing the feedback linearization. Since saturations exist in the control signals, we study the stability based on Lyapunov theory. △ Less

Submitted 29 November, 2021; originally announced November 2021.

State Drift and Gait Plan in Feedback Linearization Control of A Tilt Vehicle

Authors: Zhe Shen, Takeshi Tsuchiya

Abstract: To stabilize a conventional quadrotor, simplified equivalent vehicles, e.g., autonomous car, are developed to test the designed controller. Based on that, various controllers based on feedback linearization have been developed. With the recently developed concept of tilt-rotor, there lacks the simplified or equivalent model, however. Indeed, the tilt structure is relatively unusual in vehicles. In… ▽ More To stabilize a conventional quadrotor, simplified equivalent vehicles, e.g., autonomous car, are developed to test the designed controller. Based on that, various controllers based on feedback linearization have been developed. With the recently developed concept of tilt-rotor, there lacks the simplified or equivalent model, however. Indeed, the tilt structure is relatively unusual in vehicles. In this research, we put forward a unique fictional vehicle with tilt structure, which is to help evaluate the property of the tilt-structure-aimed controllers. One phenomenon, state drift, in controlling an over-actuated tilt structure by feedback linearization is presented subsequently. State drift can be easily neglected and is not paid attention to in the current researches in tilt-rotor controller design so far. We report this phenomenon and provide a potential approach to avoid this behavior. △ Less

Submitted 24 March, 2022; v1 submitted 8 November, 2021; originally announced November 2021.

Journal ref: 8th International Conference on Control, Modeling and Computing (CMC 2022)

Singular Zone in Quadrotor Yaw-Position Feedback Linearization

Authors: Zhe Shen, Takeshi Tsuchiya

Abstract: It is well known that the conventional quadrotor is an under-actuated MIMO system. The number of the inputs is less than the degree of freedom. One approach in controlling this non-holonomic system is feedback linearization. In the frequently cited (305 times) application, the yaw and the position are selected as the controlled variables. It is reported that no singularity is found in their delta… ▽ More It is well known that the conventional quadrotor is an under-actuated MIMO system. The number of the inputs is less than the degree of freedom. One approach in controlling this non-holonomic system is feedback linearization. In the frequently cited (305 times) application, the yaw and the position are selected as the controlled variables. It is reported that no singularity is found in their delta matrix, making it possible to apply the inversion within a wide range. However, we find the ignored singular zone within the range of interest. The unreported singular area can cause the failure in the controller design. This paper visualizes this uninvertible area and details the deduction process. △ Less

Submitted 27 October, 2021; v1 submitted 14 October, 2021; originally announced October 2021.

Comments: 17 pages, 11 figures

Constrained Detecting Arrays: Mathematical Structures for Fault Identification in Combinatorial Interaction Testing

Authors: Hao **, Ce Shi, Tatsuhiro Tsuchiya

Abstract: Context: Detecting arrays are mathematical structures aimed at fault identification in combinatorial interaction testing. However, they cannot be directly applied to systems that have constraints among test parameters. Such constraints are prevalent in real-world systems. Objectives: This paper proposes Constrained Detecting Arrays (CDAs), an extension of detecting arrays, which can be used for… ▽ More Context: Detecting arrays are mathematical structures aimed at fault identification in combinatorial interaction testing. However, they cannot be directly applied to systems that have constraints among test parameters. Such constraints are prevalent in real-world systems. Objectives: This paper proposes Constrained Detecting Arrays (CDAs), an extension of detecting arrays, which can be used for systems with constraints. Methods: The paper examines the properties and capabilities of CDAs with rigorous arguments. The paper also proposes two algorithms for constructing CDAs: One is aimed at generating minimum CDAs and the other is a heuristic algorithm aimed at fast generation of CDAs. The algorithms are evaluated through experiments using a benchmark dataset. Results: Experimental results show that the first algorithm can generate minimum CDAs if a sufficiently long generation time is allowed, and the second algorithm can generate minimum or near-minimum CDAs in a reasonable time. Conclusion: CDAs enhance detecting arrays to be applied to systems with constraints. The two proposed algorithms have different advantages with respect to the array size and generation time △ Less

Submitted 12 October, 2021; originally announced October 2021.

The Pareto-frontier-based Stiffness of A Controller: Trade-off between Trajectory Plan and Controller Design

Authors: Zhe Shen, Takeshi Tsuchiya

Abstract: Approaching a set goal for a UAV comprises a trajectory plan and a controller design (control after plan problems). The optimal trajectory (reference) is calculated before being tracked with a proper controller. It is believed that the quadrotor will follow the designed trajectory totally in the trajectory plan process. However, the dynamic state error usually, for a mismatched feed-forward, spoil… ▽ More Approaching a set goal for a UAV comprises a trajectory plan and a controller design (control after plan problems). The optimal trajectory (reference) is calculated before being tracked with a proper controller. It is believed that the quadrotor will follow the designed trajectory totally in the trajectory plan process. However, the dynamic state error usually, for a mismatched feed-forward, spoils this assumption, making the unwanted sacrifice in the objective function defined in the trajectory plan process. We base the target problem in this research on a second-order system model which widely exists in the dynamics of vehicles. Specially, the unavoidable dynamic state error is considered in the trajectory plan process, assuming the LQR without the feed-forward is applied in the subsequent control after plan problems. The Copenhagen Limit provides the possibility of estimating the dynamic state error in an analytical solution. The trade-off results are provided in multiobjective Pareto front solutions and the mapped pseudo Pareto fronts. We explore the relationship between the controller and the corresponding pseudo Pareto fronts. △ Less

Submitted 19 August, 2021; originally announced August 2021.

Quad-cone-rotor: A Novel Tilt Quadrotor with Severe-fault-tolerant Ability

Authors: Zhe Shen, Yudong Ma, Takeshi Tsuchiya

Abstract: Conventional quadrotors received great attention in trajectory design and fault-tolerant control in these years. The direction of each thrust is perpendicular to the body because of the geometrics in mechanical design. Comparing with the conventional quadrotor, a novel quadrotor named quad-tilt-rotor brings better freedom in manipulating the thrust vector. Quad-tilt-rotor augments the additional d… ▽ More Conventional quadrotors received great attention in trajectory design and fault-tolerant control in these years. The direction of each thrust is perpendicular to the body because of the geometrics in mechanical design. Comparing with the conventional quadrotor, a novel quadrotor named quad-tilt-rotor brings better freedom in manipulating the thrust vector. Quad-tilt-rotor augments the additional degrees of freedom in the thrust, providing the possibility of violating the normal direction of the thrust in the conventional quadrotor. This provides the ability of greater agility in control. This paper presents a novel design of a quad-tilt-rotor (quad-cone-rotor) whose thrust can be assigned along the edge of a cone shape. Besides the inheriting merits in agile from quad-tilt-rotor, the quad-cone-rotor is expected to take fault-tolerant control in severe dynamic failure (total loss in all thrusts). We simulate the control result in a UAV simulator in SIMULINK, MATLAB. △ Less

Submitted 19 August, 2021; originally announced August 2021.

A Novel Formula Calculating the Dynamic State Error and Its Application in UAV Tracking Control Problem

Authors: Zhe Shen, Takeshi Tsuchiya

Abstract: This paper gives a novel formula (Copenhagen Limit) to calculate/estimate the dynamic state error of a system without a feedforward signal. Copenhagen Limit is in the form of a limit and finds the dynamic error in an analytical solution. It can be used to design the controller in a tracking control problem. A numerical example is displayed to illustrate the accuracy of the Copenhagen Limit. Beside… ▽ More This paper gives a novel formula (Copenhagen Limit) to calculate/estimate the dynamic state error of a system without a feedforward signal. Copenhagen Limit is in the form of a limit and finds the dynamic error in an analytical solution. It can be used to design the controller in a tracking control problem. A numerical example is displayed to illustrate the accuracy of the Copenhagen Limit. Besides, the controller of a UAV (quadrotor) is designed using the Copenhagen Limit in a trajectory-tracking problem. The result of it is also demonstrated and analyzed. △ Less

Submitted 18 August, 2021; originally announced August 2021.

Anisotropic interpolation error estimates using a new geometric parameter

Authors: Hiroki Ishizaka, Kenta Kobayashi, Takuya Tsuchiya

Abstract: We present precise anisotropic interpolation error estimates for smooth functions using a new geometric parameter and derive inverse inequalities on anisotropic meshes. In our theory, the interpolation error is bounded in terms of the diameter of a simplex and the geometric parameter. Imposing additional assumptions makes it possible to obtain anisotropic error estimates. This paper also includes… ▽ More We present precise anisotropic interpolation error estimates for smooth functions using a new geometric parameter and derive inverse inequalities on anisotropic meshes. In our theory, the interpolation error is bounded in terms of the diameter of a simplex and the geometric parameter. Imposing additional assumptions makes it possible to obtain anisotropic error estimates. This paper also includes corrections to an error in Theorem 2 of our previous paper, "General theory of interpolation error estimates on anisotropic meshes" (Japan Journal of Industrial and Applied Mathematics, 38 (2021) 163-191). △ Less

Submitted 2 August, 2022; v1 submitted 7 June, 2021; originally announced June 2021.

Comments: 36 pages, 12 figures

Lectures on error analysis of interpolation on simplicial triangulations without the shape-regularity assumption, Part 2: Lagrange interpolation on tetrahedrons

Authors: Kenta Kobayashi, Takuya Tsuchiya

Abstract: This is the second lecture note on the error analysis of interpolation on simplicial elements without the shape regularity assumption (the previous one is arXiv:1908.03894). In this manuscript, we explain the error analysis of Lagrange interpolation on (possibly anisotropic) tetrahedrons. The manuscript is not intended to be a research paper. We hope that, in the future, it will be merged into a t… ▽ More This is the second lecture note on the error analysis of interpolation on simplicial elements without the shape regularity assumption (the previous one is arXiv:1908.03894). In this manuscript, we explain the error analysis of Lagrange interpolation on (possibly anisotropic) tetrahedrons. The manuscript is not intended to be a research paper. We hope that, in the future, it will be merged into a textbook on the mathematical theory of the finite element methods. △ Less

Submitted 1 September, 2023; v1 submitted 14 March, 2021; originally announced March 2021.

Comments: arXiv admin note: text overlap with arXiv:2102.04767

A new geometric condition equivalent to the maximum angle condition for tetrahedrons

Authors: Hiroki Ishizaka, Kenta Kobayashi, Ryo Suzuki, Takuya Tsuchiya

Abstract: For a tetrahedron, suppose that all internal angles of faces and all dihedral angles are less than a fixed constant $C$ that is smaller than $π$. Then, it is said to satisfy the maximum angle condition with the constant $C$. The maximum angle condition is important in the error analysis of Lagrange interpolation on tetrahedrons. This condition ensures that we can obtain an error estimation, even o… ▽ More For a tetrahedron, suppose that all internal angles of faces and all dihedral angles are less than a fixed constant $C$ that is smaller than $π$. Then, it is said to satisfy the maximum angle condition with the constant $C$. The maximum angle condition is important in the error analysis of Lagrange interpolation on tetrahedrons. This condition ensures that we can obtain an error estimation, even on certain kinds of anisotropic tetrahedrons. In this paper, using two quantities that represent the geometry of tetrahedrons, we present an equivalent geometric condition to the maximum angle condition for tetrahedrons. △ Less

Submitted 25 August, 2021; v1 submitted 9 February, 2021; originally announced February 2021.

Comments: to appear in Computers & Mathematics with Applications

MSC Class: 65D05; 65N30

Journal ref: Computers & Mathematics with Applications, 99 (2021) 323-328

Stability-Certified Reinforcement Learning via Spectral Normalization

Authors: Ryoichi Takase, Nobuyuki Yoshikawa, Toshisada Mariyama, Takeshi Tsuchiya

Abstract: In this article, two types of methods from different perspectives based on spectral normalization are described for ensuring the stability of the system controlled by a neural network. The first one is that the L2 gain of the feedback system is bounded less than 1 to satisfy the stability condition derived from the small-gain theorem. While explicitly including the stability condition, the first m… ▽ More In this article, two types of methods from different perspectives based on spectral normalization are described for ensuring the stability of the system controlled by a neural network. The first one is that the L2 gain of the feedback system is bounded less than 1 to satisfy the stability condition derived from the small-gain theorem. While explicitly including the stability condition, the first method may provide an insufficient performance on the neural network controller due to its strict stability condition. To overcome this difficulty, the second one is proposed, which improves the performance while ensuring the local stability with a larger region of attraction. In the second method, the stability is ensured by solving linear matrix inequalities after training the neural network controller. The spectral normalization proposed in this article improves the feasibility of the a-posteriori stability test by constructing tighter local sectors. The numerical experiments show that the second method provides enough performance compared with the first one while ensuring enough stability compared with the existing reinforcement learning algorithms. △ Less

Submitted 26 December, 2020; originally announced December 2020.