-
Online Control of Linear Systems with Unbounded and Degenerate Noise
Authors:
Kaito Ito,
Taira Tsuchiya
Abstract:
This paper investigates the problem of controlling a linear system under possibly unbounded and degenerate noise with unknown cost functions, known as an online control problem. In contrast to the existing work, which assumes the boundedness of noise, we reveal that for convex costs, an $ \widetilde{O}(\sqrt{T}) $ regret bound can be achieved even for unbounded noise, where $ T $ denotes the time…
▽ More
This paper investigates the problem of controlling a linear system under possibly unbounded and degenerate noise with unknown cost functions, known as an online control problem. In contrast to the existing work, which assumes the boundedness of noise, we reveal that for convex costs, an $ \widetilde{O}(\sqrt{T}) $ regret bound can be achieved even for unbounded noise, where $ T $ denotes the time horizon. Moreover, when the costs are strongly convex, we establish an $ O({\rm poly} (\log T)) $ regret bound without the assumption that noise covariance is non-degenerate, which has been required in the literature. The key ingredient in removing the rank assumption on noise is a system transformation associated with the noise covariance. This simultaneously enables the parameter reduction of an online control algorithm.
△ Less
Submitted 15 February, 2024;
originally announced February 2024.
-
Build a training interface to install the bat's echolocation skills in humans
Authors:
Miyoko Tsumaki,
Yu Teshima,
Takao Tsuchiya,
Kaoru Ashihara,
Kohta I. Kobayasi,
Shizuko Hiryu
Abstract:
Bats use a sophisticated ultrasonic sensing method called echolocation to recognize the environment. Recently, it has been reported that sighted human participants with no prior experience in echolocation can improve their ability to perceive the spatial layout of various environments through training to listen to echoes (Norman, et al., 2021). In this study, we developed the new training system f…
▽ More
Bats use a sophisticated ultrasonic sensing method called echolocation to recognize the environment. Recently, it has been reported that sighted human participants with no prior experience in echolocation can improve their ability to perceive the spatial layout of various environments through training to listen to echoes (Norman, et al., 2021). In this study, we developed the new training system for human echolocation using the eye-tracker. Binaural echoes of consecutive downward linear FM pulses that were inspired by feeding strategies of echolocating bats were simulated using the wave equation finite difference time domain method. The virtual echoes were presented to the sighted subject in response to his or her eye movements on the monitor. The latency from eye gazing to the echo presentation wasn't audible delay to perceive. In a preliminary experiment in which the participants were asked to identify the shapes of the hidden target, the participants were found to concentrate their gaze on the edges of the hidden target on the monitor. We will conduct a psycho-acoustical experiment to examine the learning process of human echolocation in a shape-identification task, which will lead to device development in the field of welfare engineering.
△ Less
Submitted 17 February, 2023;
originally announced February 2023.
-
Joint Analysis of Acoustic Scenes and Sound Events Based on Multitask Learning with Dynamic Weight Adaptation
Authors:
Kayo Nada,
Keisuke Imoto,
Takao Tsuchiya
Abstract:
Acoustic scene classification (ASC) and sound event detection (SED) are major topics in environmental sound analysis. Considering that acoustic scenes and sound events are closely related to each other, the joint analysis of acoustic scenes and sound events using multitask learning (MTL)-based neural networks was proposed in some previous works. Conventional methods train MTL-based models using a…
▽ More
Acoustic scene classification (ASC) and sound event detection (SED) are major topics in environmental sound analysis. Considering that acoustic scenes and sound events are closely related to each other, the joint analysis of acoustic scenes and sound events using multitask learning (MTL)-based neural networks was proposed in some previous works. Conventional methods train MTL-based models using a linear combination of ASC and SED loss functions with constant weights. However, the performance of conventional MTL-based methods depends strongly on the weights of the ASC and SED losses, and it is difficult to determine the appropriate balance between the constant weights of the losses of MTL of ASC and SED. In this paper, we thus propose dynamic weight adaptation methods for MTL of ASC and SED based on dynamic weight average and multi--focal loss to adjust the learning weights automatically. Evaluation experiments using parts of the TUT Acoustic Scenes 2016/2017 and TUT Sound Events 2016/2017 are conducted, and we show that the proposed methods improve the scene classification and event detection performance characteristics compared with the conventional MTL-based method. We then investigate how the learning weights of ASC and SED tasks dynamically adapt as the model training progresses.
△ Less
Submitted 21 June, 2022;
originally announced June 2022.
-
Gait Analysis for A Tilt-rotor: The Dynamic Invertible Gait
Authors:
Zhe Shen,
Takeshi Tsuchiya
Abstract:
Conventional Feedback-Linearization-based controller, applied to the tilt-rotor (eight inputs), results in the extensive changes in the tilting angles, which are not expected in practice. To solve this problem, we introduce the novel concept UAV gait to restrict the tilting angles. The gait plan was initially to solve the control problems for quadruped (four-legged) robots. Transplanting this appr…
▽ More
Conventional Feedback-Linearization-based controller, applied to the tilt-rotor (eight inputs), results in the extensive changes in the tilting angles, which are not expected in practice. To solve this problem, we introduce the novel concept UAV gait to restrict the tilting angles. The gait plan was initially to solve the control problems for quadruped (four-legged) robots. Transplanting this approach, accompanied by feedback linearization, to the tiltrotor may cause the well-known non-invertible problem in the decoupling matrix. In this research, we explore the invertible gait for the tiltrotor and apply feedback linearization to stabilize the attitude and the altitude. The equivalent conditions to achieve a full-rank decoupling matrix are deduced and simplified to a near zero roll and zero pitch. This paper proposed several invertible gaits to conduct the attitude-altitude control test. The accepted gaits within the region of interest are visualized. The experiment is simulated in Simulink, MATLAB. The results show the promising response in attitude and altitude.
△ Less
Submitted 11 February, 2022; v1 submitted 5 January, 2022;
originally announced January 2022.
-
Stability Analysis of a Feedback-linearization-based Controller with Saturation: A Tilt Vehicle with the Penguin-inspired Gait Plan
Authors:
Zhe Shen,
Yudong Ma,
Takeshi Tsuchiya
Abstract:
Saturations in control signal can challenge the stability proof of a feedback-linearization-based controller, even leading the system unstable [1]. Thus, several approaches are established to avoid reaching the saturation bound [2,3]. Meanwhile, to help design the controller for a quad-tilt-rotor, [1] modeled a tilt vehicle with implementing the feedback-linearization-based controllers. In this ar…
▽ More
Saturations in control signal can challenge the stability proof of a feedback-linearization-based controller, even leading the system unstable [1]. Thus, several approaches are established to avoid reaching the saturation bound [2,3]. Meanwhile, to help design the controller for a quad-tilt-rotor, [1] modeled a tilt vehicle with implementing the feedback-linearization-based controllers. In this article, we provide a gait plan for this tilt vehicle and control it utilizing the feedback linearization. Since saturations exist in the control signals, we study the stability based on Lyapunov theory.
△ Less
Submitted 29 November, 2021;
originally announced November 2021.
-
State Drift and Gait Plan in Feedback Linearization Control of A Tilt Vehicle
Authors:
Zhe Shen,
Takeshi Tsuchiya
Abstract:
To stabilize a conventional quadrotor, simplified equivalent vehicles, e.g., autonomous car, are developed to test the designed controller. Based on that, various controllers based on feedback linearization have been developed. With the recently developed concept of tilt-rotor, there lacks the simplified or equivalent model, however. Indeed, the tilt structure is relatively unusual in vehicles. In…
▽ More
To stabilize a conventional quadrotor, simplified equivalent vehicles, e.g., autonomous car, are developed to test the designed controller. Based on that, various controllers based on feedback linearization have been developed. With the recently developed concept of tilt-rotor, there lacks the simplified or equivalent model, however. Indeed, the tilt structure is relatively unusual in vehicles. In this research, we put forward a unique fictional vehicle with tilt structure, which is to help evaluate the property of the tilt-structure-aimed controllers. One phenomenon, state drift, in controlling an over-actuated tilt structure by feedback linearization is presented subsequently. State drift can be easily neglected and is not paid attention to in the current researches in tilt-rotor controller design so far. We report this phenomenon and provide a potential approach to avoid this behavior.
△ Less
Submitted 24 March, 2022; v1 submitted 8 November, 2021;
originally announced November 2021.
-
Singular Zone in Quadrotor Yaw-Position Feedback Linearization
Authors:
Zhe Shen,
Takeshi Tsuchiya
Abstract:
It is well known that the conventional quadrotor is an under-actuated MIMO system. The number of the inputs is less than the degree of freedom. One approach in controlling this non-holonomic system is feedback linearization. In the frequently cited (305 times) application, the yaw and the position are selected as the controlled variables. It is reported that no singularity is found in their delta…
▽ More
It is well known that the conventional quadrotor is an under-actuated MIMO system. The number of the inputs is less than the degree of freedom. One approach in controlling this non-holonomic system is feedback linearization. In the frequently cited (305 times) application, the yaw and the position are selected as the controlled variables. It is reported that no singularity is found in their delta matrix, making it possible to apply the inversion within a wide range. However, we find the ignored singular zone within the range of interest. The unreported singular area can cause the failure in the controller design. This paper visualizes this uninvertible area and details the deduction process.
△ Less
Submitted 27 October, 2021; v1 submitted 14 October, 2021;
originally announced October 2021.
-
The Pareto-frontier-based Stiffness of A Controller: Trade-off between Trajectory Plan and Controller Design
Authors:
Zhe Shen,
Takeshi Tsuchiya
Abstract:
Approaching a set goal for a UAV comprises a trajectory plan and a controller design (control after plan problems). The optimal trajectory (reference) is calculated before being tracked with a proper controller. It is believed that the quadrotor will follow the designed trajectory totally in the trajectory plan process. However, the dynamic state error usually, for a mismatched feed-forward, spoil…
▽ More
Approaching a set goal for a UAV comprises a trajectory plan and a controller design (control after plan problems). The optimal trajectory (reference) is calculated before being tracked with a proper controller. It is believed that the quadrotor will follow the designed trajectory totally in the trajectory plan process. However, the dynamic state error usually, for a mismatched feed-forward, spoils this assumption, making the unwanted sacrifice in the objective function defined in the trajectory plan process. We base the target problem in this research on a second-order system model which widely exists in the dynamics of vehicles. Specially, the unavoidable dynamic state error is considered in the trajectory plan process, assuming the LQR without the feed-forward is applied in the subsequent control after plan problems. The Copenhagen Limit provides the possibility of estimating the dynamic state error in an analytical solution. The trade-off results are provided in multiobjective Pareto front solutions and the mapped pseudo Pareto fronts. We explore the relationship between the controller and the corresponding pseudo Pareto fronts.
△ Less
Submitted 19 August, 2021;
originally announced August 2021.
-
Quad-cone-rotor: A Novel Tilt Quadrotor with Severe-fault-tolerant Ability
Authors:
Zhe Shen,
Yudong Ma,
Takeshi Tsuchiya
Abstract:
Conventional quadrotors received great attention in trajectory design and fault-tolerant control in these years. The direction of each thrust is perpendicular to the body because of the geometrics in mechanical design. Comparing with the conventional quadrotor, a novel quadrotor named quad-tilt-rotor brings better freedom in manipulating the thrust vector. Quad-tilt-rotor augments the additional d…
▽ More
Conventional quadrotors received great attention in trajectory design and fault-tolerant control in these years. The direction of each thrust is perpendicular to the body because of the geometrics in mechanical design. Comparing with the conventional quadrotor, a novel quadrotor named quad-tilt-rotor brings better freedom in manipulating the thrust vector. Quad-tilt-rotor augments the additional degrees of freedom in the thrust, providing the possibility of violating the normal direction of the thrust in the conventional quadrotor. This provides the ability of greater agility in control. This paper presents a novel design of a quad-tilt-rotor (quad-cone-rotor) whose thrust can be assigned along the edge of a cone shape. Besides the inheriting merits in agile from quad-tilt-rotor, the quad-cone-rotor is expected to take fault-tolerant control in severe dynamic failure (total loss in all thrusts). We simulate the control result in a UAV simulator in SIMULINK, MATLAB.
△ Less
Submitted 19 August, 2021;
originally announced August 2021.
-
A Novel Formula Calculating the Dynamic State Error and Its Application in UAV Tracking Control Problem
Authors:
Zhe Shen,
Takeshi Tsuchiya
Abstract:
This paper gives a novel formula (Copenhagen Limit) to calculate/estimate the dynamic state error of a system without a feedforward signal. Copenhagen Limit is in the form of a limit and finds the dynamic error in an analytical solution. It can be used to design the controller in a tracking control problem. A numerical example is displayed to illustrate the accuracy of the Copenhagen Limit. Beside…
▽ More
This paper gives a novel formula (Copenhagen Limit) to calculate/estimate the dynamic state error of a system without a feedforward signal. Copenhagen Limit is in the form of a limit and finds the dynamic error in an analytical solution. It can be used to design the controller in a tracking control problem. A numerical example is displayed to illustrate the accuracy of the Copenhagen Limit. Besides, the controller of a UAV (quadrotor) is designed using the Copenhagen Limit in a trajectory-tracking problem. The result of it is also demonstrated and analyzed.
△ Less
Submitted 18 August, 2021;
originally announced August 2021.
-
Stability-Certified Reinforcement Learning via Spectral Normalization
Authors:
Ryoichi Takase,
Nobuyuki Yoshikawa,
Toshisada Mariyama,
Takeshi Tsuchiya
Abstract:
In this article, two types of methods from different perspectives based on spectral normalization are described for ensuring the stability of the system controlled by a neural network. The first one is that the L2 gain of the feedback system is bounded less than 1 to satisfy the stability condition derived from the small-gain theorem. While explicitly including the stability condition, the first m…
▽ More
In this article, two types of methods from different perspectives based on spectral normalization are described for ensuring the stability of the system controlled by a neural network. The first one is that the L2 gain of the feedback system is bounded less than 1 to satisfy the stability condition derived from the small-gain theorem. While explicitly including the stability condition, the first method may provide an insufficient performance on the neural network controller due to its strict stability condition. To overcome this difficulty, the second one is proposed, which improves the performance while ensuring the local stability with a larger region of attraction. In the second method, the stability is ensured by solving linear matrix inequalities after training the neural network controller. The spectral normalization proposed in this article improves the feasibility of the a-posteriori stability test by constructing tighter local sectors. The numerical experiments show that the second method provides enough performance compared with the first one while ensuring enough stability compared with the existing reinforcement learning algorithms.
△ Less
Submitted 26 December, 2020;
originally announced December 2020.
